Skip to content

Commit

Permalink
Merge pull request #17 from DawidNiezgodka/trend_det_ave
Browse files Browse the repository at this point in the history
commit comment and summary for trend ave
  • Loading branch information
DawidNiezgodka authored Jan 23, 2024
2 parents e247a80 + 20fe890 commit c86dc5a
Show file tree
Hide file tree
Showing 6 changed files with 348 additions and 19 deletions.
7 changes: 4 additions & 3 deletions .github/workflows/test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ on:
push:
branches:
- main
- missing_eval
- trend_det_ave

jobs:
test:
Expand Down Expand Up @@ -34,8 +34,9 @@ jobs:
file_with_bench_data: data.json
folder_with_current_benchmark_results: resultsFolder
bench_group_name: "MongoDB Benchmark"
evaluation_method: "jump_detection"
jump_detection_thresholds: "10, 10, 10, 10, 10"
evaluation_method: "trend_detection_moving_ave"
moving_ave_window_size: 5
trend_thresholds: "10, 10, 10, 10, 10"
save_curr_bench_res: true
github_token: ${{ secrets.GH_TOKEN }}
github_context: ${{ toJson(github) }}
Expand Down
180 changes: 172 additions & 8 deletions dist/index.js

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

5 changes: 3 additions & 2 deletions src/bench_data.js
Original file line number Diff line number Diff line change
Expand Up @@ -90,7 +90,7 @@ module.exports.getLatestBenchmark = function (
)

const nthLatestBenchmarkData = sortedBenchmarkData[n - 1]
core.debug(`nthLatestBenchmarkData.metrics ${JSON.stringify(nthLatestBenchmarkData)}`)
//core.debug(`nthLatestBenchmarkData.metrics ${JSON.stringify(nthLatestBenchmarkData)}`)
return convertBenchDataToCompleteBenchmarkInstance(nthLatestBenchmarkData, benchmarkGroupName)

}
Expand Down Expand Up @@ -171,8 +171,9 @@ module.exports.getNLatestBenchmarks = function (
const nthLatest = sortedBenchmarkData.slice(0, n).map(data => {
return convertBenchDataToCompleteBenchmarkInstance(data, benchmarkGroupName);
});
core.debug(`nthLatest ${JSON.stringify(nthLatest)}`)
core.debug('--- end getNLatestBenchmarks ---')
return nthLatest;

} catch (error) {
console.error('An error occurred:', error);
return null;
Expand Down
Loading

1 comment on commit c86dc5a

@DawidNiezgodka
Copy link
Owner Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark results

Benchmark group: MongoDB Benchmark

The chosen evaluation method is trend_detection_moving_ave.
For each metric, the procedure checks if the current value does not exceed the average
of a particular number of last measurements more than a given threshold

Execution time: 0m 11s

Parametrization:

  • storageEngine: N/A
  • logVerbosity: N/A
  • bindIp: 0.0.0.0
  • port: 27017

Other Info: YCSB Parameters: workload=workloada, recordcount=200000, threads=32,

Results

Metric Curr: c86dc5a Max.Jump Was No builds Res
OVERALL Throughput 16747.613465081227 ops/sec 10 75.08 5 🔴
[READ], AverageLatency(us) 1825.4436406295827 us 10 0.81 5 🟢
[READ], MaxLatency(us) 87807 us 10 25.52 5 🔴
[UPDATE], AverageLatency(us) 1871.9681377399565 us 10 1.00 5 🟢
[UPDATE], MaxLatency(us) 151423 us 10 17.72 5 🔴

Benchmark failed

The chosen failing condition was any.
At least one metric didn't pass the tests.

Please sign in to comment.