Skip to content

Commit

Permalink
chore(benchmarks): new benchmark environment change (20240408.01) (#1228
Browse files Browse the repository at this point in the history
)
  • Loading branch information
dhess authored Apr 8, 2024
2 parents b89cc7a + af00c2b commit 15f8d37
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 1 deletion.
1 change: 1 addition & 0 deletions docs/benchmarking.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,3 +12,4 @@ the table below, we make a best-effort attempt to track the commits to
|------------------------------------------|------------------
| [d81d43e2](https://github.com/hackworthltd/primer/commit/d81d43e2fe0f466410b0b984aa66ba8e83c19dec) | Retired previous benchmark machine, a dedicated AMD Ryzen 5 3600 6-Core Processor host running only benchmark jobs, and moved subsequent benchmark jobs to a VM running other CI jobs, with an 8-core AMD Ryzen 9 5900HX with Radeon Graphics.
| [d38b9738](https://github.com/hackworthltd/primer/commit/d38b973874bc2491904811567b5da55e70116f54) | Back to previous benchmark machine, as the mixed-use CI machine was not a reliable benchmarking host.
| [04867463](https://github.com/hackworthltd/primer/commit/048674636bbca82a98dd99b9de9561739ea49a48) | Retired previous benchmark machine, and moved subsequent benchmark jobs to an 8-core AMD EPYC 7402P virtual machine.
2 changes: 1 addition & 1 deletion flake.nix
Original file line number Diff line number Diff line change
Expand Up @@ -635,7 +635,7 @@
# them.
benchmarks =
let
lastEnvChange = "20230130.01";
lastEnvChange = "20240408.01";
in
final.callPackage ./nix/pkgs/benchmarks {
inherit lastEnvChange;
Expand Down

1 comment on commit 15f8d37

@github-actions
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Performance Alert ⚠️

Possible performance regression was detected for benchmark 'Primer benchmarks'.
Benchmark result of this commit is worse than the previous benchmark result exceeding threshold 2.

Benchmark suite Current: 15f8d37 Previous: b89cc7a Ratio
evalTestM/pure logs/mapEven 1: outlier variance 0.2657485176901999 outlier variance 0.027006172839506157 outlier variance 9.84
evalTestM/pure logs/mapEven 10: outlier variance 0.31210705520056 outlier variance 0.1388888888888889 outlier variance 2.25
typecheck/mapOddPrim 100: outlier variance 0.06737795997671232 outlier variance 0.023242630385487528 outlier variance 2.90

This comment was automatically generated by workflow using github-action-benchmark.

CC: @dhess

Please sign in to comment.