Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Performance test remove tag comparison #206

Merged
merged 2 commits into from
Nov 26, 2024
Merged

Performance test remove tag comparison #206

merged 2 commits into from
Nov 26, 2024

Conversation

louiseschmidtgen
Copy link
Contributor

Description

Removing tag comparison on the tags, this is unnecessary because we can get the comparison by changing the base-code of a PR.

@louiseschmidtgen louiseschmidtgen requested a review from a team as a code owner November 15, 2024 08:24
@louiseschmidtgen louiseschmidtgen changed the title Follow up Performance test remove tag comparison Performance test remove tag comparison Nov 15, 2024
@github-actions GitHub Actions
Copy link

Benchmark Result

goos: linux
goarch: amd64
pkg: github.com/canonical/k8s-dqlite/test
cpu: AMD EPYC 7763 64-Core Processor                
                                        │      Before      │                 After                 │
                                        │      sec/op      │     sec/op      vs base               │
Compaction/sqlite-4                        20.21µ ±     5%    20.57µ ±   7%        ~ (p=0.209 n=7)
Compaction/dqlite-4                        42.99µ ±     1%    43.42µ ±   3%        ~ (p=0.456 n=7)
Create/sqlite/1-workers-4                  489.2µ ±    14%    532.0µ ±   8%        ~ (p=0.535 n=7)
Create/sqlite/4-workers-4                  502.5µ ±    14%    492.6µ ±   9%        ~ (p=0.318 n=7)
Create/sqlite/16-workers-4                 470.1µ ±    10%    450.5µ ±  15%        ~ (p=0.805 n=7)
Create/sqlite/64-workers-4                 542.5µ ±  1840%    484.8µ ±  52%        ~ (p=0.318 n=7)
Create/sqlite/128-workers-4                837.7µ ±   377%   1112.8µ ±  46%        ~ (p=0.805 n=7)
Create/dqlite/1-workers-4                  1.133m ±    10%    1.077m ±   5%        ~ (p=0.097 n=7)
Create/dqlite/4-workers-4                  1.076m ±     4%    1.047m ±   6%        ~ (p=0.053 n=7)
Create/dqlite/16-workers-4                 1.055m ±     3%    1.059m ±  11%        ~ (p=0.535 n=7)
Create/dqlite/64-workers-4                1076.4µ ±     9%    946.5µ ±   5%  -12.07% (p=0.004 n=7)
Create/dqlite/128-workers-4                984.3µ ±     8%    922.9µ ±   6%   -6.23% (p=0.017 n=7)
Delete/sqlite/1-workers-4                  527.8µ ±     4%    468.5µ ±   3%  -11.22% (p=0.001 n=7)
Delete/sqlite/4-workers-4                  505.9µ ±     6%    445.1µ ±   3%  -12.01% (p=0.001 n=7)
Delete/sqlite/16-workers-4                 477.4µ ±     9%    429.8µ ±   5%   -9.97% (p=0.001 n=7)
Delete/sqlite/64-workers-4                 664.9µ ±  2397%    462.9µ ±  15%  -30.38% (p=0.007 n=7)
Delete/sqlite/128-workers-4                713.9µ ±  1385%    804.5µ ±  79%        ~ (p=0.805 n=7)
Delete/dqlite/1-workers-4                  1.188m ±     6%    1.045m ±  12%  -11.99% (p=0.002 n=7)
Delete/dqlite/4-workers-4                  971.7µ ±     7%    960.9µ ±   5%        ~ (p=0.165 n=7)
Delete/dqlite/16-workers-4                1013.2µ ±     5%    943.2µ ±  21%   -6.90% (p=0.026 n=7)
Delete/dqlite/64-workers-4                1039.0µ ±     6%    918.9µ ±  27%  -11.56% (p=0.038 n=7)
Delete/dqlite/128-workers-4               1022.8µ ±     5%    987.3µ ±   8%        ~ (p=0.128 n=7)
Get/sqlite-4                               240.8µ ±     1%    242.9µ ±   1%   +0.87% (p=0.011 n=7)
Get/dqlite-4                               363.2µ ±     1%    367.6µ ±   1%   +1.19% (p=0.001 n=7)
List/sqlite-tiny/all-4                     3.896µ ±    10%    4.080µ ±   8%        ~ (p=0.383 n=7)
List/sqlite-tiny/pagination-4              8.312µ ±     2%    8.299µ ±   2%        ~ (p=0.710 n=7)
List/sqlite-fits-in-page/all-4             7.721µ ±     4%    7.822µ ±   5%        ~ (p=0.876 n=7)
List/sqlite-fits-in-page/pagination-4      22.23µ ±     5%    22.23µ ±   4%        ~ (p=0.902 n=7)
List/sqlite-overflows-page/all-4           17.24µ ±     4%    17.22µ ±   3%        ~ (p=0.902 n=7)
List/sqlite-overflows-page/pagination-4    42.13µ ±    10%    42.03µ ±   6%        ~ (p=0.902 n=7)
List/dqlite-tiny/all-4                     2.905µ ±     6%    2.916µ ±   8%        ~ (p=1.000 n=7)
List/dqlite-tiny/pagination-4              6.111µ ±     3%    6.069µ ±   3%        ~ (p=0.128 n=7)
List/dqlite-fits-in-page/all-4             6.676µ ±     9%    6.570µ ±  10%        ~ (p=0.259 n=7)
List/dqlite-fits-in-page/pagination-4      17.47µ ±     1%    17.25µ ±   2%   -1.28% (p=0.011 n=7)
List/dqlite-overflows-page/all-4           21.04µ ±     5%    21.73µ ±   2%        ~ (p=0.165 n=7)
List/dqlite-overflows-page/pagination-4    45.91µ ±     2%    44.68µ ±   4%        ~ (p=0.053 n=7)
Update/sqlite/1-workers-4                  516.4µ ±     5%    511.3µ ±   7%        ~ (p=0.805 n=7)
Update/sqlite/4-workers-4                  489.6µ ±     5%    497.6µ ±  15%        ~ (p=0.710 n=7)
Update/sqlite/16-workers-4                 491.2µ ±    20%    484.4µ ±  16%        ~ (p=0.620 n=7)
Update/sqlite/64-workers-4                 533.7µ ±    29%    582.4µ ±  14%        ~ (p=0.318 n=7)
Update/sqlite/128-workers-4               5664.6µ ± 22277%    685.7µ ± 160%        ~ (p=0.053 n=7)
Update/dqlite/1-workers-4                  1.148m ±     5%    1.132m ±   7%        ~ (p=0.318 n=7)
Update/dqlite/4-workers-4                  993.8µ ±     7%    996.9µ ±   4%        ~ (p=1.000 n=7)
Update/dqlite/16-workers-4                 1.034m ±     3%    1.018m ±   7%        ~ (p=0.259 n=7)
Update/dqlite/64-workers-4                 1.054m ±    10%    1.078m ±   4%        ~ (p=0.209 n=7)
Update/dqlite/128-workers-4                1.050m ±     6%    1.138m ±   8%   +8.37% (p=0.002 n=7)
geomean                                    225.1µ             211.3µ          -6.15%

                                        │        Before        │                    After                     │
                                        │ page-cache-misses/op │ page-cache-misses/op  vs base                │
Compaction/sqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Compaction/dqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/sqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                                      ²                         +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │        Before        │                    After                     │
                                        │ page-cache-spills/op │ page-cache-spills/op  vs base                │
Compaction/sqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Compaction/dqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/sqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                                      ²                         +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │     Before     │                After                │
                                        │ page-reads/op  │ page-reads/op  vs base              │
Compaction/sqlite-4                        12.22 ±    1%     12.24 ±  1%       ~ (p=0.293 n=7)
Compaction/dqlite-4                        12.20 ±    1%     12.22 ±  1%       ~ (p=0.475 n=7)
Create/sqlite/1-workers-4                  13.90 ±    1%     13.86 ±  1%       ~ (p=0.103 n=7)
Create/sqlite/4-workers-4                  12.45 ±    7%     12.54 ±  5%       ~ (p=0.301 n=7)
Create/sqlite/16-workers-4                 10.63 ±    9%     10.49 ±  7%       ~ (p=0.364 n=7)
Create/sqlite/64-workers-4                 9.042 ±   48%     8.992 ±  8%       ~ (p=1.000 n=7)
Create/sqlite/128-workers-4                8.255 ±   33%     7.996 ±  7%       ~ (p=0.805 n=7)
Create/dqlite/1-workers-4                  13.28 ±    2%     13.22 ±  2%       ~ (p=0.805 n=7)
Create/dqlite/4-workers-4                  10.87 ±    2%     10.83 ±  1%       ~ (p=0.432 n=7)
Create/dqlite/16-workers-4                 10.87 ±    1%     10.90 ±  3%       ~ (p=0.781 n=7)
Create/dqlite/64-workers-4                 10.95 ±    2%     10.96 ±  1%       ~ (p=0.396 n=7)
Create/dqlite/128-workers-4                11.03 ±    1%     11.00 ±  1%       ~ (p=0.161 n=7)
Delete/sqlite/1-workers-4                  16.23 ±    0%     16.23 ±  0%       ~ (p=0.988 n=7)
Delete/sqlite/4-workers-4                  14.66 ±    4%     14.34 ±  2%  -2.18% (p=0.001 n=7)
Delete/sqlite/16-workers-4                 12.09 ±    2%     12.04 ±  5%       ~ (p=0.245 n=7)
Delete/sqlite/64-workers-4                10.440 ±   29%     9.600 ±  6%  -8.05% (p=0.038 n=7)
Delete/sqlite/128-workers-4                9.540 ±   28%     9.386 ±  3%       ~ (p=0.535 n=7)
Delete/dqlite/1-workers-4                  15.76 ±    1%     15.68 ±  1%       ~ (p=0.223 n=7)
Delete/dqlite/4-workers-4                  13.44 ±    1%     13.34 ±  1%       ~ (p=0.090 n=7)
Delete/dqlite/16-workers-4                 13.38 ±    1%     13.43 ±  1%       ~ (p=0.454 n=7)
Delete/dqlite/64-workers-4                 13.41 ±    2%     13.34 ±  1%       ~ (p=0.102 n=7)
Delete/dqlite/128-workers-4                13.32 ±    4%     13.25 ±  1%       ~ (p=0.516 n=7)
Get/sqlite-4                               14.96 ±    0%     14.95 ±  0%       ~ (p=0.057 n=7)
Get/dqlite-4                               11.96 ±    0%     11.95 ±  0%       ~ (p=0.639 n=7)
List/sqlite-tiny/all-4                    191.3m ±    1%    192.5m ±  2%       ~ (p=0.515 n=7)
List/sqlite-tiny/pagination-4              1.131 ±    0%     1.131 ±  0%       ~ (p=1.000 n=7)
List/sqlite-fits-in-page/all-4            164.7m ±    1%    163.7m ±  1%       ~ (p=0.091 n=7)
List/sqlite-fits-in-page/pagination-4     965.3m ±    3%    963.6m ±  0%       ~ (p=0.592 n=7)
List/sqlite-overflows-page/all-4          177.1m ±    0%    177.1m ±  0%       ~ (p=1.000 n=7)
List/sqlite-overflows-page/pagination-4    1.507 ±   38%     1.322 ± 40%       ~ (p=0.318 n=7)
List/dqlite-tiny/all-4                    191.4m ±    0%    191.5m ±  1%       ~ (p=0.808 n=7)
List/dqlite-tiny/pagination-4              1.126 ±    3%     1.126 ±  3%       ~ (p=0.853 n=7)
List/dqlite-fits-in-page/all-4            164.1m ±    1%    163.9m ±  0%       ~ (p=0.563 n=7)
List/dqlite-fits-in-page/pagination-4     955.3m ±    0%    954.8m ±  3%  -0.05% (p=0.013 n=7)
List/dqlite-overflows-page/all-4          183.8m ±    0%    184.3m ±  0%  +0.27% (p=0.016 n=7)
List/dqlite-overflows-page/pagination-4    1.071 ±    3%     1.071 ±  0%       ~ (p=0.269 n=7)
Update/sqlite/1-workers-4                  15.82 ±    0%     15.82 ±  0%       ~ (p=1.000 n=7)
Update/sqlite/4-workers-4                  14.42 ±    2%     14.41 ±  3%       ~ (p=0.830 n=7)
Update/sqlite/16-workers-4                 12.86 ±    4%     12.91 ±  8%       ~ (p=0.556 n=7)
Update/sqlite/64-workers-4                 11.31 ±    7%     11.26 ±  3%       ~ (p=0.977 n=7)
Update/sqlite/128-workers-4                10.24 ± 6052%     10.71 ± 12%       ~ (p=0.805 n=7)
Update/dqlite/1-workers-4                  15.39 ±    1%     15.27 ±  1%  -0.78% (p=0.017 n=7)
Update/dqlite/4-workers-4                  12.78 ±    1%     12.65 ±  1%  -1.02% (p=0.029 n=7)
Update/dqlite/16-workers-4                 12.81 ±    1%     12.58 ±  1%  -1.80% (p=0.001 n=7)
Update/dqlite/64-workers-4                 13.13 ±    3%     12.94 ±  2%       ~ (p=0.274 n=7)
Update/dqlite/128-workers-4                13.12 ±    6%     13.45 ±  5%       ~ (p=0.091 n=7)
geomean                                    5.206             5.170        -0.67%

                                        │      Before       │                 After                  │
                                        │  page-writes/op   │ page-writes/op  vs base                │
Compaction/sqlite-4                       190.8m ±     0%        190.5m ± 0%       ~ (p=0.336 n=7)
Compaction/dqlite-4                       187.5m ±     0%        187.8m ± 0%       ~ (p=0.175 n=7)
Create/sqlite/1-workers-4                  4.361 ±     0%         4.353 ± 0%       ~ (p=0.152 n=7)
Create/sqlite/4-workers-4                  4.319 ±     0%         4.323 ± 1%       ~ (p=0.776 n=7)
Create/sqlite/16-workers-4                 4.263 ±     1%         4.284 ± 0%       ~ (p=0.400 n=7)
Create/sqlite/64-workers-4                 4.252 ±     6%         4.237 ± 1%       ~ (p=0.435 n=7)
Create/sqlite/128-workers-4                4.180 ±     4%         4.119 ± 3%       ~ (p=0.805 n=7)
Create/dqlite/1-workers-4                  4.198 ±     2%         4.271 ± 1%  +1.74% (p=0.029 n=7)
Create/dqlite/4-workers-4                  4.246 ±     2%         4.270 ± 1%       ~ (p=0.709 n=7)
Create/dqlite/16-workers-4                 4.282 ±     1%         4.280 ± 2%       ~ (p=0.533 n=7)
Create/dqlite/64-workers-4                 4.259 ±     2%         4.299 ± 0%  +0.94% (p=0.001 n=7)
Create/dqlite/128-workers-4                4.289 ±     1%         4.302 ± 0%  +0.30% (p=0.050 n=7)
Delete/sqlite/1-workers-4                  4.386 ±     0%         4.390 ± 0%       ~ (p=0.114 n=7)
Delete/sqlite/4-workers-4                  4.398 ±     1%         4.384 ± 1%       ~ (p=0.122 n=7)
Delete/sqlite/16-workers-4                 4.374 ±     1%         4.371 ± 1%       ~ (p=1.000 n=7)
Delete/sqlite/64-workers-4                 4.335 ±     5%         4.358 ± 1%       ~ (p=0.137 n=7)
Delete/sqlite/128-workers-4                4.335 ±     5%         4.335 ± 1%       ~ (p=0.618 n=7)
Delete/dqlite/1-workers-4                  4.343 ±     1%         4.368 ± 0%       ~ (p=0.091 n=7)
Delete/dqlite/4-workers-4                  4.384 ±     1%         4.382 ± 1%       ~ (p=1.000 n=7)
Delete/dqlite/16-workers-4                 4.360 ±     1%         4.362 ± 0%       ~ (p=0.902 n=7)
Delete/dqlite/64-workers-4                 4.375 ±     1%         4.344 ± 0%  -0.71% (p=0.025 n=7)
Delete/dqlite/128-workers-4                4.352 ±     1%         4.373 ± 1%       ~ (p=0.272 n=7)
Get/sqlite-4                               0.000 ±     0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                               0.000 ±     0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                     0.000 ±     0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4              0.000 ±     0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4             0.000 ±     0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4      0.000 ±     0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4           0.000 ±     0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4    0.000 ±     0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                     0.000 ±     0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4              0.000 ±     0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4             0.000 ±     0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4      0.000 ±     0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4           0.000 ±     0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4    0.000 ±     0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                  4.243 ±     0%         4.242 ± 0%       ~ (p=0.876 n=7)
Update/sqlite/4-workers-4                  4.315 ±     1%         4.313 ± 1%       ~ (p=0.480 n=7)
Update/sqlite/16-workers-4                 4.316 ±     1%         4.333 ± 1%       ~ (p=0.639 n=7)
Update/sqlite/64-workers-4                 4.342 ±     2%         4.347 ± 2%       ~ (p=0.902 n=7)
Update/sqlite/128-workers-4                4.730 ± 10788%         4.452 ± 3%       ~ (p=0.364 n=7)
Update/dqlite/1-workers-4                  4.207 ±     0%         4.210 ± 0%       ~ (p=0.476 n=7)
Update/dqlite/4-workers-4                  4.202 ±     1%         4.209 ± 0%       ~ (p=0.456 n=7)
Update/dqlite/16-workers-4                 4.242 ±     1%         4.230 ± 1%       ~ (p=0.710 n=7)
Update/dqlite/64-workers-4                 4.357 ±     2%         4.358 ± 3%       ~ (p=0.902 n=7)
Update/dqlite/128-workers-4                4.391 ±     6%         4.613 ± 4%       ~ (p=0.053 n=7)
geomean                                                   ²                   +0.04%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │     Before      │                 After                 │
                                        │ sec-reading/op  │ sec-reading/op  vs base               │
Compaction/sqlite-4                        28.00µ ±   11%     28.10µ ± 36%        ~ (p=0.598 n=7)
Compaction/dqlite-4                        29.20µ ±   29%     30.10µ ± 36%        ~ (p=0.596 n=7)
Create/sqlite/1-workers-4                  19.00µ ±   30%     19.50µ ± 23%        ~ (p=0.902 n=7)
Create/sqlite/4-workers-4                  18.40µ ±   29%     20.20µ ± 16%        ~ (p=0.402 n=7)
Create/sqlite/16-workers-4                 23.90µ ±   17%     20.60µ ± 19%        ~ (p=0.128 n=7)
Create/sqlite/64-workers-4                 25.00µ ±  180%     22.20µ ± 39%        ~ (p=0.209 n=7)
Create/sqlite/128-workers-4                21.90µ ±   54%     23.10µ ± 63%        ~ (p=0.318 n=7)
Create/dqlite/1-workers-4                 10.700µ ±   56%     9.500µ ± 29%        ~ (p=0.513 n=7)
Create/dqlite/4-workers-4                  10.80µ ±   26%     11.40µ ± 32%        ~ (p=0.686 n=7)
Create/dqlite/16-workers-4                 12.10µ ±   20%     11.10µ ± 33%        ~ (p=0.259 n=7)
Create/dqlite/64-workers-4                10.200µ ±   57%     9.700µ ± 43%        ~ (p=0.805 n=7)
Create/dqlite/128-workers-4                9.800µ ±   17%    10.200µ ± 59%        ~ (p=1.000 n=7)
Delete/sqlite/1-workers-4                  30.30µ ±   20%     31.90µ ± 17%        ~ (p=0.245 n=7)
Delete/sqlite/4-workers-4                  33.00µ ±   22%     34.30µ ± 16%        ~ (p=0.686 n=7)
Delete/sqlite/16-workers-4                 32.60µ ±   12%     37.20µ ± 15%  +14.11% (p=0.037 n=7)
Delete/sqlite/64-workers-4                 35.20µ ±   21%     39.00µ ± 20%        ~ (p=0.128 n=7)
Delete/sqlite/128-workers-4                34.80µ ±   14%     39.90µ ± 27%  +14.66% (p=0.017 n=7)
Delete/dqlite/1-workers-4                  13.10µ ±   55%     15.00µ ± 23%        ~ (p=0.334 n=7)
Delete/dqlite/4-workers-4                  16.90µ ±   29%     16.90µ ± 33%        ~ (p=0.901 n=7)
Delete/dqlite/16-workers-4                 15.00µ ±   30%     16.90µ ± 36%        ~ (p=0.318 n=7)
Delete/dqlite/64-workers-4                 14.90µ ±   36%     16.20µ ± 28%        ~ (p=0.620 n=7)
Delete/dqlite/128-workers-4                13.60µ ±   32%     15.20µ ± 30%        ~ (p=0.301 n=7)
Get/sqlite-4                               66.70µ ±    7%     65.30µ ± 11%        ~ (p=0.902 n=7)
Get/dqlite-4                               33.60µ ±   12%     34.30µ ± 13%        ~ (p=0.684 n=7)
List/sqlite-tiny/all-4                     6.600µ ±   21%     7.700µ ± 35%        ~ (p=0.433 n=7)
List/sqlite-tiny/pagination-4              14.70µ ±    3%     14.70µ ±  3%        ~ (p=0.980 n=7)
List/sqlite-fits-in-page/all-4             14.10µ ±   16%     12.80µ ± 13%        ~ (p=0.250 n=7)
List/sqlite-fits-in-page/pagination-4      38.10µ ±   13%     36.10µ ±  9%        ~ (p=0.740 n=7)
List/sqlite-overflows-page/all-4           13.50µ ±    4%     13.40µ ±  4%        ~ (p=0.874 n=7)
List/sqlite-overflows-page/pagination-4    46.40µ ±   38%     40.90µ ± 34%        ~ (p=0.383 n=7)
List/dqlite-tiny/all-4                     4.100µ ±   20%     4.100µ ± 22%        ~ (p=0.391 n=7)
List/dqlite-tiny/pagination-4              9.600µ ±   12%     8.800µ ± 11%        ~ (p=0.153 n=7)
List/dqlite-fits-in-page/all-4             9.200µ ±   18%    10.600µ ± 15%        ~ (p=0.255 n=7)
List/dqlite-fits-in-page/pagination-4      26.40µ ±   13%     25.60µ ±  9%        ~ (p=0.155 n=7)
List/dqlite-overflows-page/all-4           34.50µ ±   18%     34.70µ ± 12%        ~ (p=0.397 n=7)
List/dqlite-overflows-page/pagination-4    68.70µ ±    3%     67.00µ ± 11%        ~ (p=0.476 n=7)
Update/sqlite/1-workers-4                  23.50µ ±   30%     22.80µ ± 26%        ~ (p=0.535 n=7)
Update/sqlite/4-workers-4                  19.50µ ±   43%     19.50µ ± 22%        ~ (p=0.828 n=7)
Update/sqlite/16-workers-4                 21.70µ ±   36%     20.70µ ± 19%        ~ (p=0.105 n=7)
Update/sqlite/64-workers-4                 21.60µ ±   32%     25.20µ ± 21%        ~ (p=0.221 n=7)
Update/sqlite/128-workers-4                39.30µ ± 7534%     26.90µ ± 37%        ~ (p=0.165 n=7)
Update/dqlite/1-workers-4                  12.30µ ±   36%     10.60µ ± 27%        ~ (p=0.332 n=7)
Update/dqlite/4-workers-4                  10.70µ ±   51%     12.50µ ± 46%        ~ (p=0.733 n=7)
Update/dqlite/16-workers-4                 13.50µ ±   29%     12.10µ ± 39%        ~ (p=1.000 n=7)
Update/dqlite/64-workers-4                 11.80µ ±   57%     10.10µ ± 72%        ~ (p=0.620 n=7)
Update/dqlite/128-workers-4                11.20µ ±   69%     11.10µ ± 41%        ~ (p=1.000 n=7)
geomean                                    18.85µ             18.85µ         -0.02%

                                        │       Before       │                  After                  │
                                        │   sec-writing/op   │ sec-writing/op  vs base                 │
Compaction/sqlite-4                        9.100µ ±     3%       9.500µ ± 21%        ~ (p=0.064 n=7)
Compaction/dqlite-4                        6.700µ ±     9%       7.000µ ± 10%        ~ (p=0.691 n=7)
Create/sqlite/1-workers-4                  257.2µ ±    20%       308.6µ ± 16%        ~ (p=0.053 n=7)
Create/sqlite/4-workers-4                  1.552m ±    13%       1.440m ±  6%        ~ (p=0.209 n=7)
Create/sqlite/16-workers-4                 5.537m ±    10%       5.702m ± 11%        ~ (p=0.805 n=7)
Create/sqlite/64-workers-4                 20.15m ±   330%       19.26m ±  8%        ~ (p=0.165 n=7)
Create/sqlite/128-workers-4                42.15m ±   113%       49.23m ± 32%        ~ (p=0.902 n=7)
Create/dqlite/1-workers-4                  44.50µ ±    25%       40.30µ ± 19%        ~ (p=0.434 n=7)
Create/dqlite/4-workers-4                  45.60µ ±    23%       50.30µ ± 14%  +10.31% (p=0.017 n=7)
Create/dqlite/16-workers-4                 42.50µ ±    24%       49.30µ ± 15%        ~ (p=0.209 n=7)
Create/dqlite/64-workers-4                 42.00µ ±    21%       49.30µ ± 30%        ~ (p=0.165 n=7)
Create/dqlite/128-workers-4                44.70µ ±    25%       44.10µ ± 26%        ~ (p=1.000 n=7)
Delete/sqlite/1-workers-4                  300.6µ ±     6%       234.1µ ±  7%  -22.12% (p=0.001 n=7)
Delete/sqlite/4-workers-4                  1.560m ±    13%       1.376m ±  7%  -11.79% (p=0.017 n=7)
Delete/sqlite/16-workers-4                 5.959m ±    13%       5.357m ±  7%  -10.10% (p=0.026 n=7)
Delete/sqlite/64-workers-4                 19.79m ±   737%       18.34m ±  7%   -7.33% (p=0.007 n=7)
Delete/sqlite/128-workers-4                37.79m ±   153%       35.54m ± 32%        ~ (p=0.209 n=7)
Delete/dqlite/1-workers-4                  39.40µ ±    39%       43.10µ ± 25%        ~ (p=0.477 n=7)
Delete/dqlite/4-workers-4                  47.00µ ±    28%       49.20µ ± 12%        ~ (p=0.318 n=7)
Delete/dqlite/16-workers-4                 47.10µ ±    27%       49.80µ ± 26%        ~ (p=0.620 n=7)
Delete/dqlite/64-workers-4                 52.10µ ±    23%       49.60µ ± 25%        ~ (p=0.620 n=7)
Delete/dqlite/128-workers-4                47.60µ ±    25%       48.90µ ± 20%        ~ (p=0.456 n=7)
Get/sqlite-4                                0.000 ±     0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
Get/dqlite-4                                0.000 ±     0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                      0.000 ±     0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4               0.000 ±     0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4              0.000 ±     0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4       0.000 ±     0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4            0.000 ±     0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4     0.000 ±     0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                      0.000 ±     0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4               0.000 ±     0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4              0.000 ±     0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4       0.000 ±     0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4            0.000 ±     0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4     0.000 ±     0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                  273.9µ ±     8%       297.2µ ± 18%        ~ (p=0.535 n=7)
Update/sqlite/4-workers-4                  1.450m ±    10%       1.548m ± 14%        ~ (p=0.209 n=7)
Update/sqlite/16-workers-4                 5.662m ±    14%       5.768m ± 11%        ~ (p=0.902 n=7)
Update/sqlite/64-workers-4                 20.12m ±    11%       19.39m ± 10%        ~ (p=0.383 n=7)
Update/sqlite/128-workers-4               117.00m ± 12464%       40.74m ± 39%  -65.18% (p=0.026 n=7)
Update/dqlite/1-workers-4                  43.00µ ±    34%       35.20µ ± 76%        ~ (p=0.318 n=7)
Update/dqlite/4-workers-4                  44.30µ ±    27%       41.40µ ± 39%        ~ (p=0.737 n=7)
Update/dqlite/16-workers-4                 49.40µ ±    25%       49.80µ ± 32%        ~ (p=0.684 n=7)
Update/dqlite/64-workers-4                 43.10µ ±    17%       52.60µ ± 49%        ~ (p=0.053 n=7)
Update/dqlite/128-workers-4                46.80µ ±    30%       44.20µ ± 28%        ~ (p=0.456 n=7)
geomean                                                    ²                    -1.87%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │      Before      │                After                │
                                        │       B/op       │     B/op       vs base              │
Compaction/sqlite-4                       2.374Ki ±    10%   2.333Ki ± 49%       ~ (p=0.456 n=7)
Compaction/dqlite-4                       4.772Ki ±    31%   4.854Ki ± 49%       ~ (p=0.710 n=7)
Create/sqlite/1-workers-4                 20.50Ki ±     0%   20.50Ki ±  0%       ~ (p=0.209 n=7)
Create/sqlite/4-workers-4                 20.50Ki ±     0%   20.49Ki ±  0%       ~ (p=1.000 n=7)
Create/sqlite/16-workers-4                20.49Ki ±     0%   20.49Ki ±  0%       ~ (p=0.929 n=7)
Create/sqlite/64-workers-4                20.55Ki ±    11%   20.52Ki ±  0%       ~ (p=0.620 n=7)
Create/sqlite/128-workers-4               20.68Ki ±     5%   20.79Ki ±  1%       ~ (p=0.682 n=7)
Create/dqlite/1-workers-4                 19.76Ki ±     0%   19.74Ki ±  0%       ~ (p=0.200 n=7)
Create/dqlite/4-workers-4                 19.74Ki ±     0%   19.74Ki ±  0%       ~ (p=0.875 n=7)
Create/dqlite/16-workers-4                19.74Ki ±     0%   19.75Ki ±  0%       ~ (p=0.476 n=7)
Create/dqlite/64-workers-4                19.76Ki ±    11%   19.73Ki ±  0%  -0.13% (p=0.024 n=7)
Create/dqlite/128-workers-4               19.76Ki ±     0%   19.75Ki ± 11%  -0.07% (p=0.029 n=7)
Delete/sqlite/1-workers-4                 22.94Ki ±     0%   22.92Ki ±  0%  -0.07% (p=0.001 n=7)
Delete/sqlite/4-workers-4                 22.94Ki ±     0%   22.92Ki ±  0%       ~ (p=0.119 n=7)
Delete/sqlite/16-workers-4                22.90Ki ±     0%   22.88Ki ±  0%       ~ (p=0.154 n=7)
Delete/sqlite/64-workers-4                22.96Ki ±     8%   22.90Ki ±  0%  -0.26% (p=0.012 n=7)
Delete/sqlite/128-workers-4               23.06Ki ±     9%   23.03Ki ±  1%       ~ (p=0.318 n=7)
Delete/dqlite/1-workers-4                 22.04Ki ±     0%   22.01Ki ±  0%  -0.15% (p=0.002 n=7)
Delete/dqlite/4-workers-4                 21.99Ki ±     0%   21.98Ki ±  0%       ~ (p=0.558 n=7)
Delete/dqlite/16-workers-4                22.00Ki ±     0%   22.00Ki ±  1%       ~ (p=0.971 n=7)
Delete/dqlite/64-workers-4                22.02Ki ±     0%   21.99Ki ±  0%  -0.12% (p=0.026 n=7)
Delete/dqlite/128-workers-4               22.03Ki ±    10%   22.03Ki ±  0%       ~ (p=1.000 n=7)
Get/sqlite-4                              24.41Ki ±     0%   24.43Ki ±  0%       ~ (p=0.400 n=7)
Get/dqlite-4                              23.25Ki ±     0%   23.25Ki ±  0%       ~ (p=0.301 n=7)
List/sqlite-tiny/all-4                    1.176Ki ±    10%   1.209Ki ± 23%       ~ (p=0.620 n=7)
List/sqlite-tiny/pagination-4             1.583Ki ±     5%   1.550Ki ±  4%  -2.10% (p=0.026 n=7)
List/sqlite-fits-in-page/all-4            7.974Ki ±    14%   7.394Ki ± 10%       ~ (p=0.073 n=7)
List/sqlite-fits-in-page/pagination-4     10.95Ki ±    14%   10.17Ki ± 12%       ~ (p=0.402 n=7)
List/sqlite-overflows-page/all-4          20.54Ki ±     0%   20.54Ki ± 12%       ~ (p=0.931 n=7)
List/sqlite-overflows-page/pagination-4   27.40Ki ±    61%   23.47Ki ± 46%       ~ (p=0.259 n=7)
List/dqlite-tiny/all-4                    1.045Ki ±     6%   1.051Ki ±  7%       ~ (p=0.830 n=7)
List/dqlite-tiny/pagination-4               972.0 ±     3%     970.0 ±  2%       ~ (p=0.300 n=7)
List/dqlite-fits-in-page/all-4            6.086Ki ±     6%   6.017Ki ±  8%       ~ (p=0.318 n=7)
List/dqlite-fits-in-page/pagination-4     5.510Ki ±     3%   5.459Ki ±  4%       ~ (p=0.259 n=7)
List/dqlite-overflows-page/all-4          29.99Ki ±     2%   30.55Ki ±  8%       ~ (p=0.073 n=7)
List/dqlite-overflows-page/pagination-4   30.05Ki ±     5%   29.23Ki ±  9%  -2.74% (p=0.038 n=7)
Update/sqlite/1-workers-4                 22.28Ki ±     0%   22.28Ki ±  0%       ~ (p=0.640 n=7)
Update/sqlite/4-workers-4                 22.29Ki ±     0%   22.29Ki ±  0%       ~ (p=0.245 n=7)
Update/sqlite/16-workers-4                22.32Ki ±     0%   22.35Ki ±  0%       ~ (p=0.318 n=7)
Update/sqlite/64-workers-4                22.57Ki ±     2%   22.62Ki ±  1%       ~ (p=1.000 n=7)
Update/sqlite/128-workers-4               25.31Ki ± 11449%   23.49Ki ±  5%       ~ (p=0.053 n=7)
Update/dqlite/1-workers-4                 21.50Ki ±     0%   21.50Ki ±  0%       ~ (p=1.000 n=7)
Update/dqlite/4-workers-4                 21.49Ki ±     0%   21.50Ki ±  0%       ~ (p=0.782 n=7)
Update/dqlite/16-workers-4                21.65Ki ±     1%   21.58Ki ±  1%       ~ (p=0.902 n=7)
Update/dqlite/64-workers-4                22.10Ki ±     2%   22.19Ki ±  3%       ~ (p=0.710 n=7)
Update/dqlite/128-workers-4               21.95Ki ±     7%   23.36Ki ±  4%  +6.43% (p=0.038 n=7)
geomean                                   14.41Ki            14.30Ki        -0.74%

                                        │     Before     │                After                │
                                        │   allocs/op    │  allocs/op   vs base                │
Compaction/sqlite-4                       51.00 ±    10%   50.00 ± 50%       ~ (p=0.811 n=7)
Compaction/dqlite-4                       114.0 ±    32%   116.0 ± 50%       ~ (p=0.640 n=7)
Create/sqlite/1-workers-4                 399.0 ±     0%   399.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                 399.0 ±     0%   399.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/sqlite/16-workers-4                399.0 ±     0%   399.0 ±  0%       ~ (p=1.000 n=7)
Create/sqlite/64-workers-4                399.0 ±     4%   399.0 ±  0%       ~ (p=0.429 n=7)
Create/sqlite/128-workers-4               401.0 ±     2%   401.0 ±  1%       ~ (p=0.914 n=7)
Create/dqlite/1-workers-4                 369.0 ±     0%   369.0 ±  0%       ~ (p=0.192 n=7)
Create/dqlite/4-workers-4                 368.0 ±     0%   369.0 ±  0%       ~ (p=0.592 n=7)
Create/dqlite/16-workers-4                369.0 ±     0%   369.0 ±  0%       ~ (p=1.000 n=7)
Create/dqlite/64-workers-4                368.0 ±    13%   368.0 ±  0%       ~ (p=0.269 n=7)
Create/dqlite/128-workers-4               368.0 ±     0%   368.0 ± 14%       ~ (p=1.000 n=7)
Delete/sqlite/1-workers-4                 431.0 ±     0%   431.0 ±  0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/4-workers-4                 431.0 ±     0%   431.0 ±  0%       ~ (p=1.000 n=7)
Delete/sqlite/16-workers-4                430.0 ±     0%   430.0 ±  0%       ~ (p=1.000 n=7)
Delete/sqlite/64-workers-4                431.0 ±     1%   430.0 ±  0%       ~ (p=0.452 n=7)
Delete/sqlite/128-workers-4               432.0 ±     0%   431.0 ±  1%       ~ (p=0.110 n=7)
Delete/dqlite/1-workers-4                 399.0 ±     0%   399.0 ±  0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                 399.0 ±     0%   399.0 ±  0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/16-workers-4                399.0 ±     0%   399.0 ±  1%       ~ (p=1.000 n=7)
Delete/dqlite/64-workers-4                399.0 ±     0%   399.0 ±  0%       ~ (p=1.000 n=7)
Delete/dqlite/128-workers-4               398.0 ±    12%   399.0 ±  0%       ~ (p=0.213 n=7)
Get/sqlite-4                              445.0 ±     0%   445.0 ±  0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                              412.0 ±     0%   412.0 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                    16.00 ±    19%   18.00 ± 33%       ~ (p=0.411 n=7)
List/sqlite-tiny/pagination-4             25.00 ±     4%   25.00 ±  0%       ~ (p=1.000 n=7)
List/sqlite-fits-in-page/all-4            23.00 ±    22%   21.00 ± 14%       ~ (p=0.145 n=7)
List/sqlite-fits-in-page/pagination-4     41.00 ±    20%   37.00 ± 16%       ~ (p=0.179 n=7)
List/sqlite-overflows-page/all-4          9.000 ±     0%   9.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4   16.00 ±   106%   13.00 ± 77%       ~ (p=0.398 n=7)
List/dqlite-tiny/all-4                    14.00 ±     7%   15.00 ± 13%       ~ (p=1.000 n=7)
List/dqlite-tiny/pagination-4             14.00 ±     7%   14.00 ±  7%       ~ (p=1.000 n=7)
List/dqlite-fits-in-page/all-4            20.00 ±    15%   19.00 ±  5%       ~ (p=0.592 n=7)
List/dqlite-fits-in-page/pagination-4     19.00 ±     5%   19.00 ±  5%       ~ (p=0.392 n=7)
List/dqlite-overflows-page/all-4          33.00 ±     3%   34.00 ±  3%       ~ (p=0.057 n=7)
List/dqlite-overflows-page/pagination-4   34.00 ±     3%   34.00 ±  6%       ~ (p=0.188 n=7)
Update/sqlite/1-workers-4                 412.0 ±     0%   412.0 ±  0%       ~ (p=1.000 n=7)
Update/sqlite/4-workers-4                 412.0 ±     0%   412.0 ±  0%       ~ (p=1.000 n=7)
Update/sqlite/16-workers-4                412.0 ±     0%   413.0 ±  0%       ~ (p=0.082 n=7)
Update/sqlite/64-workers-4                416.0 ±     2%   417.0 ±  1%       ~ (p=0.979 n=7)
Update/sqlite/128-workers-4               466.0 ± 11268%   434.0 ±  4%       ~ (p=0.053 n=7)
Update/dqlite/1-workers-4                 381.0 ±     0%   381.0 ±  0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                 382.0 ±     0%   382.0 ±  0%       ~ (p=1.000 n=7)
Update/dqlite/16-workers-4                383.0 ±     1%   382.0 ±  1%       ~ (p=1.000 n=7)
Update/dqlite/64-workers-4                392.0 ±     3%   393.0 ±  3%       ~ (p=0.783 n=7)
Update/dqlite/128-workers-4               389.0 ±     7%   413.0 ±  4%  +6.17% (p=0.042 n=7)
geomean                                   171.4            170.5        -0.53%
¹ all samples are equal

                                        │        Before         │                    After                    │
                                        │ network-bytes-read/op │ network-bytes-read/op  vs base              │
Compaction/dqlite-4                               1.721Ki ± 32%           1.751Ki ± 50%       ~ (p=0.710 n=7)
Create/dqlite/1-workers-4                           240.4 ±  0%             241.4 ±  0%  +0.42% (p=0.019 n=7)
Create/dqlite/4-workers-4                           241.2 ±  0%             241.2 ±  0%       ~ (p=0.973 n=7)
Create/dqlite/16-workers-4                          241.5 ±  0%             241.4 ±  0%       ~ (p=0.431 n=7)
Create/dqlite/64-workers-4                          241.2 ± 34%             242.2 ±  0%  +0.41% (p=0.001 n=7)
Create/dqlite/128-workers-4                         241.7 ±  0%             242.2 ± 35%       ~ (p=0.154 n=7)
Delete/dqlite/1-workers-4                           715.7 ±  0%             718.2 ±  0%  +0.35% (p=0.001 n=7)
Delete/dqlite/4-workers-4                           719.2 ±  0%             719.6 ±  0%       ~ (p=0.548 n=7)
Delete/dqlite/16-workers-4                          719.1 ±  0%             718.8 ±  1%       ~ (p=0.477 n=7)
Delete/dqlite/64-workers-4                          717.7 ±  0%             719.8 ±  1%  +0.29% (p=0.023 n=7)
Delete/dqlite/128-workers-4                         717.9 ± 11%             718.8 ±  0%       ~ (p=0.097 n=7)
Get/dqlite-4                                      1.133Ki ±  0%           1.132Ki ±  0%  -0.09% (p=0.029 n=7)
List/dqlite-tiny/all-4                              210.3 ±  9%             212.4 ± 13%       ~ (p=0.732 n=7)
List/dqlite-tiny/pagination-4                       198.4 ±  2%             197.9 ±  1%       ~ (p=0.456 n=7)
List/dqlite-fits-in-page/all-4                    1.363Ki ± 12%           1.333Ki ±  3%       ~ (p=0.434 n=7)
List/dqlite-fits-in-page/pagination-4             1.330Ki ±  7%           1.306Ki ±  4%  -1.84% (p=0.038 n=7)
List/dqlite-overflows-page/all-4                  6.876Ki ±  3%           7.153Ki ±  4%  +4.03% (p=0.004 n=7)
List/dqlite-overflows-page/pagination-4           7.155Ki ±  4%           7.026Ki ±  4%       ~ (p=0.073 n=7)
Update/dqlite/1-workers-4                           262.7 ±  0%             262.8 ±  0%       ~ (p=0.720 n=7)
Update/dqlite/4-workers-4                           263.2 ±  0%             263.3 ±  0%       ~ (p=0.636 n=7)
Update/dqlite/16-workers-4                          264.3 ±  1%             263.5 ±  1%       ~ (p=0.876 n=7)
Update/dqlite/64-workers-4                          270.1 ±  2%             270.7 ±  3%       ~ (p=0.710 n=7)
Update/dqlite/128-workers-4                         268.2 ±  7%             284.6 ±  4%       ~ (p=0.053 n=7)
geomean                                             561.6                   563.6        +0.35%

                                        │          Before          │                     After                      │
                                        │ network-bytes-written/op │ network-bytes-written/op  vs base              │
Compaction/dqlite-4                                    4.470 ±  5%                4.475 ±  8%       ~ (p=0.620 n=7)
Create/dqlite/1-workers-4                              114.4 ±  2%                116.0 ±  1%  +1.40% (p=0.028 n=7)
Create/dqlite/4-workers-4                              115.7 ±  2%                115.5 ±  1%       ~ (p=0.972 n=7)
Create/dqlite/16-workers-4                             116.1 ±  1%                115.9 ±  1%       ~ (p=0.399 n=7)
Create/dqlite/64-workers-4                             115.3 ± 23%                117.3 ±  1%  +1.73% (p=0.001 n=7)
Create/dqlite/128-workers-4                            116.6 ±  2%                117.5 ± 24%       ~ (p=0.078 n=7)
Delete/dqlite/1-workers-4                              81.61 ±  0%                82.66 ±  1%  +1.29% (p=0.001 n=7)
Delete/dqlite/4-workers-4                              83.07 ±  1%                83.19 ±  1%       ~ (p=0.535 n=7)
Delete/dqlite/16-workers-4                             83.00 ±  1%                82.92 ±  2%       ~ (p=0.456 n=7)
Delete/dqlite/64-workers-4                             82.29 ±  1%                83.31 ±  2%  +1.24% (p=0.024 n=7)
Delete/dqlite/128-workers-4                            82.52 ± 33%                82.94 ±  1%       ~ (p=0.053 n=7)
Get/dqlite-4                                           80.51 ±  0%                80.57 ±  0%  +0.07% (p=0.026 n=7)
List/dqlite-tiny/all-4                               0.04601 ± 17%              0.04686 ± 24%       ~ (p=0.620 n=7)
List/dqlite-tiny/pagination-4                        0.05055 ±  8%              0.05000 ±  7%       ~ (p=0.805 n=7)
List/dqlite-fits-in-page/all-4                       0.06235 ± 18%              0.06021 ±  4%       ~ (p=0.318 n=7)
List/dqlite-fits-in-page/pagination-4                0.09170 ± 15%              0.07804 ± 21%       ~ (p=0.053 n=7)
List/dqlite-overflows-page/all-4                     0.07664 ±  4%              0.08135 ±  4%  +6.15% (p=0.004 n=7)
List/dqlite-overflows-page/pagination-4               0.1194 ± 15%               0.1293 ± 11%       ~ (p=0.456 n=7)
Update/dqlite/1-workers-4                              136.7 ±  0%                136.8 ±  0%       ~ (p=0.913 n=7)
Update/dqlite/4-workers-4                              136.8 ±  0%                136.8 ±  0%       ~ (p=0.617 n=7)
Update/dqlite/16-workers-4                             137.8 ±  1%                137.1 ±  1%       ~ (p=0.674 n=7)
Update/dqlite/64-workers-4                             141.0 ±  3%                141.4 ±  3%       ~ (p=0.805 n=7)
Update/dqlite/128-workers-4                            139.7 ±  7%                148.7 ±  4%  +6.44% (p=0.036 n=7)
geomean                                                13.84                      13.89        +0.34%
Current status 
goos: linux
goarch: amd64
pkg: github.com/canonical/k8s-dqlite/test
cpu: AMD EPYC 7763 64-Core Processor                
                                        │     After     │
                                        │    sec/op     │
Compaction/sqlite-4                       20.57µ ±   7%
Compaction/dqlite-4                       43.42µ ±   3%
Create/sqlite/1-workers-4                 532.0µ ±   8%
Create/sqlite/4-workers-4                 492.6µ ±   9%
Create/sqlite/16-workers-4                450.5µ ±  15%
Create/sqlite/64-workers-4                484.8µ ±  52%
Create/sqlite/128-workers-4               1.113m ±  46%
Create/dqlite/1-workers-4                 1.077m ±   5%
Create/dqlite/4-workers-4                 1.047m ±   6%
Create/dqlite/16-workers-4                1.059m ±  11%
Create/dqlite/64-workers-4                946.5µ ±   5%
Create/dqlite/128-workers-4               922.9µ ±   6%
Delete/sqlite/1-workers-4                 468.5µ ±   3%
Delete/sqlite/4-workers-4                 445.1µ ±   3%
Delete/sqlite/16-workers-4                429.8µ ±   5%
Delete/sqlite/64-workers-4                462.9µ ±  15%
Delete/sqlite/128-workers-4               804.5µ ±  79%
Delete/dqlite/1-workers-4                 1.045m ±  12%
Delete/dqlite/4-workers-4                 960.9µ ±   5%
Delete/dqlite/16-workers-4                943.2µ ±  21%
Delete/dqlite/64-workers-4                918.9µ ±  27%
Delete/dqlite/128-workers-4               987.3µ ±   8%
Get/sqlite-4                              242.9µ ±   1%
Get/dqlite-4                              367.6µ ±   1%
List/sqlite-tiny/all-4                    4.080µ ±   8%
List/sqlite-tiny/pagination-4             8.299µ ±   2%
List/sqlite-fits-in-page/all-4            7.822µ ±   5%
List/sqlite-fits-in-page/pagination-4     22.23µ ±   4%
List/sqlite-overflows-page/all-4          17.22µ ±   3%
List/sqlite-overflows-page/pagination-4   42.03µ ±   6%
List/dqlite-tiny/all-4                    2.916µ ±   8%
List/dqlite-tiny/pagination-4             6.069µ ±   3%
List/dqlite-fits-in-page/all-4            6.570µ ±  10%
List/dqlite-fits-in-page/pagination-4     17.25µ ±   2%
List/dqlite-overflows-page/all-4          21.73µ ±   2%
List/dqlite-overflows-page/pagination-4   44.68µ ±   4%
Update/sqlite/1-workers-4                 511.3µ ±   7%
Update/sqlite/4-workers-4                 497.6µ ±  15%
Update/sqlite/16-workers-4                484.4µ ±  16%
Update/sqlite/64-workers-4                582.4µ ±  14%
Update/sqlite/128-workers-4               685.7µ ± 160%
Update/dqlite/1-workers-4                 1.132m ±   7%
Update/dqlite/4-workers-4                 996.9µ ±   4%
Update/dqlite/16-workers-4                1.018m ±   7%
Update/dqlite/64-workers-4                1.078m ±   4%
Update/dqlite/128-workers-4               1.138m ±   8%
geomean                                   211.3µ

                                        │        After         │
                                        │ page-cache-misses/op │
Compaction/sqlite-4                               0.000 ± 0%
Compaction/dqlite-4                               0.000 ± 0%
Create/sqlite/1-workers-4                         0.000 ± 0%
Create/sqlite/4-workers-4                         0.000 ± 0%
Create/sqlite/16-workers-4                        0.000 ± 0%
Create/sqlite/64-workers-4                        0.000 ± 0%
Create/sqlite/128-workers-4                       0.000 ± 0%
Create/dqlite/1-workers-4                         0.000 ± 0%
Create/dqlite/4-workers-4                         0.000 ± 0%
Create/dqlite/16-workers-4                        0.000 ± 0%
Create/dqlite/64-workers-4                        0.000 ± 0%
Create/dqlite/128-workers-4                       0.000 ± 0%
Delete/sqlite/1-workers-4                         0.000 ± 0%
Delete/sqlite/4-workers-4                         0.000 ± 0%
Delete/sqlite/16-workers-4                        0.000 ± 0%
Delete/sqlite/64-workers-4                        0.000 ± 0%
Delete/sqlite/128-workers-4                       0.000 ± 0%
Delete/dqlite/1-workers-4                         0.000 ± 0%
Delete/dqlite/4-workers-4                         0.000 ± 0%
Delete/dqlite/16-workers-4                        0.000 ± 0%
Delete/dqlite/64-workers-4                        0.000 ± 0%
Delete/dqlite/128-workers-4                       0.000 ± 0%
Get/sqlite-4                                      0.000 ± 0%
Get/dqlite-4                                      0.000 ± 0%
List/sqlite-tiny/all-4                            0.000 ± 0%
List/sqlite-tiny/pagination-4                     0.000 ± 0%
List/sqlite-fits-in-page/all-4                    0.000 ± 0%
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%
List/sqlite-overflows-page/all-4                  0.000 ± 0%
List/sqlite-overflows-page/pagination-4           0.000 ± 0%
List/dqlite-tiny/all-4                            0.000 ± 0%
List/dqlite-tiny/pagination-4                     0.000 ± 0%
List/dqlite-fits-in-page/all-4                    0.000 ± 0%
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%
List/dqlite-overflows-page/all-4                  0.000 ± 0%
List/dqlite-overflows-page/pagination-4           0.000 ± 0%
Update/sqlite/1-workers-4                         0.000 ± 0%
Update/sqlite/4-workers-4                         0.000 ± 0%
Update/sqlite/16-workers-4                        0.000 ± 0%
Update/sqlite/64-workers-4                        0.000 ± 0%
Update/sqlite/128-workers-4                       0.000 ± 0%
Update/dqlite/1-workers-4                         0.000 ± 0%
Update/dqlite/4-workers-4                         0.000 ± 0%
Update/dqlite/16-workers-4                        0.000 ± 0%
Update/dqlite/64-workers-4                        0.000 ± 0%
Update/dqlite/128-workers-4                       0.000 ± 0%
geomean                                                      ¹
¹ summaries must be >0 to compute geomean

                                        │        After         │
                                        │ page-cache-spills/op │
Compaction/sqlite-4                               0.000 ± 0%
Compaction/dqlite-4                               0.000 ± 0%
Create/sqlite/1-workers-4                         0.000 ± 0%
Create/sqlite/4-workers-4                         0.000 ± 0%
Create/sqlite/16-workers-4                        0.000 ± 0%
Create/sqlite/64-workers-4                        0.000 ± 0%
Create/sqlite/128-workers-4                       0.000 ± 0%
Create/dqlite/1-workers-4                         0.000 ± 0%
Create/dqlite/4-workers-4                         0.000 ± 0%
Create/dqlite/16-workers-4                        0.000 ± 0%
Create/dqlite/64-workers-4                        0.000 ± 0%
Create/dqlite/128-workers-4                       0.000 ± 0%
Delete/sqlite/1-workers-4                         0.000 ± 0%
Delete/sqlite/4-workers-4                         0.000 ± 0%
Delete/sqlite/16-workers-4                        0.000 ± 0%
Delete/sqlite/64-workers-4                        0.000 ± 0%
Delete/sqlite/128-workers-4                       0.000 ± 0%
Delete/dqlite/1-workers-4                         0.000 ± 0%
Delete/dqlite/4-workers-4                         0.000 ± 0%
Delete/dqlite/16-workers-4                        0.000 ± 0%
Delete/dqlite/64-workers-4                        0.000 ± 0%
Delete/dqlite/128-workers-4                       0.000 ± 0%
Get/sqlite-4                                      0.000 ± 0%
Get/dqlite-4                                      0.000 ± 0%
List/sqlite-tiny/all-4                            0.000 ± 0%
List/sqlite-tiny/pagination-4                     0.000 ± 0%
List/sqlite-fits-in-page/all-4                    0.000 ± 0%
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%
List/sqlite-overflows-page/all-4                  0.000 ± 0%
List/sqlite-overflows-page/pagination-4           0.000 ± 0%
List/dqlite-tiny/all-4                            0.000 ± 0%
List/dqlite-tiny/pagination-4                     0.000 ± 0%
List/dqlite-fits-in-page/all-4                    0.000 ± 0%
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%
List/dqlite-overflows-page/all-4                  0.000 ± 0%
List/dqlite-overflows-page/pagination-4           0.000 ± 0%
Update/sqlite/1-workers-4                         0.000 ± 0%
Update/sqlite/4-workers-4                         0.000 ± 0%
Update/sqlite/16-workers-4                        0.000 ± 0%
Update/sqlite/64-workers-4                        0.000 ± 0%
Update/sqlite/128-workers-4                       0.000 ± 0%
Update/dqlite/1-workers-4                         0.000 ± 0%
Update/dqlite/4-workers-4                         0.000 ± 0%
Update/dqlite/16-workers-4                        0.000 ± 0%
Update/dqlite/64-workers-4                        0.000 ± 0%
Update/dqlite/128-workers-4                       0.000 ± 0%
geomean                                                      ¹
¹ summaries must be >0 to compute geomean

                                        │     After     │
                                        │ page-reads/op │
Compaction/sqlite-4                         12.24 ±  1%
Compaction/dqlite-4                         12.22 ±  1%
Create/sqlite/1-workers-4                   13.86 ±  1%
Create/sqlite/4-workers-4                   12.54 ±  5%
Create/sqlite/16-workers-4                  10.49 ±  7%
Create/sqlite/64-workers-4                  8.992 ±  8%
Create/sqlite/128-workers-4                 7.996 ±  7%
Create/dqlite/1-workers-4                   13.22 ±  2%
Create/dqlite/4-workers-4                   10.83 ±  1%
Create/dqlite/16-workers-4                  10.90 ±  3%
Create/dqlite/64-workers-4                  10.96 ±  1%
Create/dqlite/128-workers-4                 11.00 ±  1%
Delete/sqlite/1-workers-4                   16.23 ±  0%
Delete/sqlite/4-workers-4                   14.34 ±  2%
Delete/sqlite/16-workers-4                  12.04 ±  5%
Delete/sqlite/64-workers-4                  9.600 ±  6%
Delete/sqlite/128-workers-4                 9.386 ±  3%
Delete/dqlite/1-workers-4                   15.68 ±  1%
Delete/dqlite/4-workers-4                   13.34 ±  1%
Delete/dqlite/16-workers-4                  13.43 ±  1%
Delete/dqlite/64-workers-4                  13.34 ±  1%
Delete/dqlite/128-workers-4                 13.25 ±  1%
Get/sqlite-4                                14.95 ±  0%
Get/dqlite-4                                11.95 ±  0%
List/sqlite-tiny/all-4                     192.5m ±  2%
List/sqlite-tiny/pagination-4               1.131 ±  0%
List/sqlite-fits-in-page/all-4             163.7m ±  1%
List/sqlite-fits-in-page/pagination-4      963.6m ±  0%
List/sqlite-overflows-page/all-4           177.1m ±  0%
List/sqlite-overflows-page/pagination-4     1.322 ± 40%
List/dqlite-tiny/all-4                     191.5m ±  1%
List/dqlite-tiny/pagination-4               1.126 ±  3%
List/dqlite-fits-in-page/all-4             163.9m ±  0%
List/dqlite-fits-in-page/pagination-4      954.8m ±  3%
List/dqlite-overflows-page/all-4           184.3m ±  0%
List/dqlite-overflows-page/pagination-4     1.071 ±  0%
Update/sqlite/1-workers-4                   15.82 ±  0%
Update/sqlite/4-workers-4                   14.41 ±  3%
Update/sqlite/16-workers-4                  12.91 ±  8%
Update/sqlite/64-workers-4                  11.26 ±  3%
Update/sqlite/128-workers-4                 10.71 ± 12%
Update/dqlite/1-workers-4                   15.27 ±  1%
Update/dqlite/4-workers-4                   12.65 ±  1%
Update/dqlite/16-workers-4                  12.58 ±  1%
Update/dqlite/64-workers-4                  12.94 ±  2%
Update/dqlite/128-workers-4                 13.45 ±  5%
geomean                                     5.170

                                        │     After      │
                                        │ page-writes/op │
Compaction/sqlite-4                        190.5m ± 0%
Compaction/dqlite-4                        187.8m ± 0%
Create/sqlite/1-workers-4                   4.353 ± 0%
Create/sqlite/4-workers-4                   4.323 ± 1%
Create/sqlite/16-workers-4                  4.284 ± 0%
Create/sqlite/64-workers-4                  4.237 ± 1%
Create/sqlite/128-workers-4                 4.119 ± 3%
Create/dqlite/1-workers-4                   4.271 ± 1%
Create/dqlite/4-workers-4                   4.270 ± 1%
Create/dqlite/16-workers-4                  4.280 ± 2%
Create/dqlite/64-workers-4                  4.299 ± 0%
Create/dqlite/128-workers-4                 4.302 ± 0%
Delete/sqlite/1-workers-4                   4.390 ± 0%
Delete/sqlite/4-workers-4                   4.384 ± 1%
Delete/sqlite/16-workers-4                  4.371 ± 1%
Delete/sqlite/64-workers-4                  4.358 ± 1%
Delete/sqlite/128-workers-4                 4.335 ± 1%
Delete/dqlite/1-workers-4                   4.368 ± 0%
Delete/dqlite/4-workers-4                   4.382 ± 1%
Delete/dqlite/16-workers-4                  4.362 ± 0%
Delete/dqlite/64-workers-4                  4.344 ± 0%
Delete/dqlite/128-workers-4                 4.373 ± 1%
Get/sqlite-4                                0.000 ± 0%
Get/dqlite-4                                0.000 ± 0%
List/sqlite-tiny/all-4                      0.000 ± 0%
List/sqlite-tiny/pagination-4               0.000 ± 0%
List/sqlite-fits-in-page/all-4              0.000 ± 0%
List/sqlite-fits-in-page/pagination-4       0.000 ± 0%
List/sqlite-overflows-page/all-4            0.000 ± 0%
List/sqlite-overflows-page/pagination-4     0.000 ± 0%
List/dqlite-tiny/all-4                      0.000 ± 0%
List/dqlite-tiny/pagination-4               0.000 ± 0%
List/dqlite-fits-in-page/all-4              0.000 ± 0%
List/dqlite-fits-in-page/pagination-4       0.000 ± 0%
List/dqlite-overflows-page/all-4            0.000 ± 0%
List/dqlite-overflows-page/pagination-4     0.000 ± 0%
Update/sqlite/1-workers-4                   4.242 ± 0%
Update/sqlite/4-workers-4                   4.313 ± 1%
Update/sqlite/16-workers-4                  4.333 ± 1%
Update/sqlite/64-workers-4                  4.347 ± 2%
Update/sqlite/128-workers-4                 4.452 ± 3%
Update/dqlite/1-workers-4                   4.210 ± 0%
Update/dqlite/4-workers-4                   4.209 ± 0%
Update/dqlite/16-workers-4                  4.230 ± 1%
Update/dqlite/64-workers-4                  4.358 ± 3%
Update/dqlite/128-workers-4                 4.613 ± 4%
geomean                                                ¹
¹ summaries must be >0 to compute geomean

                                        │     After      │
                                        │ sec-reading/op │
Compaction/sqlite-4                         28.10µ ± 36%
Compaction/dqlite-4                         30.10µ ± 36%
Create/sqlite/1-workers-4                   19.50µ ± 23%
Create/sqlite/4-workers-4                   20.20µ ± 16%
Create/sqlite/16-workers-4                  20.60µ ± 19%
Create/sqlite/64-workers-4                  22.20µ ± 39%
Create/sqlite/128-workers-4                 23.10µ ± 63%
Create/dqlite/1-workers-4                   9.500µ ± 29%
Create/dqlite/4-workers-4                   11.40µ ± 32%
Create/dqlite/16-workers-4                  11.10µ ± 33%
Create/dqlite/64-workers-4                  9.700µ ± 43%
Create/dqlite/128-workers-4                 10.20µ ± 59%
Delete/sqlite/1-workers-4                   31.90µ ± 17%
Delete/sqlite/4-workers-4                   34.30µ ± 16%
Delete/sqlite/16-workers-4                  37.20µ ± 15%
Delete/sqlite/64-workers-4                  39.00µ ± 20%
Delete/sqlite/128-workers-4                 39.90µ ± 27%
Delete/dqlite/1-workers-4                   15.00µ ± 23%
Delete/dqlite/4-workers-4                   16.90µ ± 33%
Delete/dqlite/16-workers-4                  16.90µ ± 36%
Delete/dqlite/64-workers-4                  16.20µ ± 28%
Delete/dqlite/128-workers-4                 15.20µ ± 30%
Get/sqlite-4                                65.30µ ± 11%
Get/dqlite-4                                34.30µ ± 13%
List/sqlite-tiny/all-4                      7.700µ ± 35%
List/sqlite-tiny/pagination-4               14.70µ ±  3%
List/sqlite-fits-in-page/all-4              12.80µ ± 13%
List/sqlite-fits-in-page/pagination-4       36.10µ ±  9%
List/sqlite-overflows-page/all-4            13.40µ ±  4%
List/sqlite-overflows-page/pagination-4     40.90µ ± 34%
List/dqlite-tiny/all-4                      4.100µ ± 22%
List/dqlite-tiny/pagination-4               8.800µ ± 11%
List/dqlite-fits-in-page/all-4              10.60µ ± 15%
List/dqlite-fits-in-page/pagination-4       25.60µ ±  9%
List/dqlite-overflows-page/all-4            34.70µ ± 12%
List/dqlite-overflows-page/pagination-4     67.00µ ± 11%
Update/sqlite/1-workers-4                   22.80µ ± 26%
Update/sqlite/4-workers-4                   19.50µ ± 22%
Update/sqlite/16-workers-4                  20.70µ ± 19%
Update/sqlite/64-workers-4                  25.20µ ± 21%
Update/sqlite/128-workers-4                 26.90µ ± 37%
Update/dqlite/1-workers-4                   10.60µ ± 27%
Update/dqlite/4-workers-4                   12.50µ ± 46%
Update/dqlite/16-workers-4                  12.10µ ± 39%
Update/dqlite/64-workers-4                  10.10µ ± 72%
Update/dqlite/128-workers-4                 11.10µ ± 41%
geomean                                     18.85µ

                                        │     After      │
                                        │ sec-writing/op │
Compaction/sqlite-4                       9.500µ ± 21%
Compaction/dqlite-4                       7.000µ ± 10%
Create/sqlite/1-workers-4                 308.6µ ± 16%
Create/sqlite/4-workers-4                 1.440m ±  6%
Create/sqlite/16-workers-4                5.702m ± 11%
Create/sqlite/64-workers-4                19.26m ±  8%
Create/sqlite/128-workers-4               49.23m ± 32%
Create/dqlite/1-workers-4                 40.30µ ± 19%
Create/dqlite/4-workers-4                 50.30µ ± 14%
Create/dqlite/16-workers-4                49.30µ ± 15%
Create/dqlite/64-workers-4                49.30µ ± 30%
Create/dqlite/128-workers-4               44.10µ ± 26%
Delete/sqlite/1-workers-4                 234.1µ ±  7%
Delete/sqlite/4-workers-4                 1.376m ±  7%
Delete/sqlite/16-workers-4                5.357m ±  7%
Delete/sqlite/64-workers-4                18.34m ±  7%
Delete/sqlite/128-workers-4               35.54m ± 32%
Delete/dqlite/1-workers-4                 43.10µ ± 25%
Delete/dqlite/4-workers-4                 49.20µ ± 12%
Delete/dqlite/16-workers-4                49.80µ ± 26%
Delete/dqlite/64-workers-4                49.60µ ± 25%
Delete/dqlite/128-workers-4               48.90µ ± 20%
Get/sqlite-4                               0.000 ±  0%
Get/dqlite-4                               0.000 ±  0%
List/sqlite-tiny/all-4                     0.000 ±  0%
List/sqlite-tiny/pagination-4              0.000 ±  0%
List/sqlite-fits-in-page/all-4             0.000 ±  0%
List/sqlite-fits-in-page/pagination-4      0.000 ±  0%
List/sqlite-overflows-page/all-4           0.000 ±  0%
List/sqlite-overflows-page/pagination-4    0.000 ±  0%
List/dqlite-tiny/all-4                     0.000 ±  0%
List/dqlite-tiny/pagination-4              0.000 ±  0%
List/dqlite-fits-in-page/all-4             0.000 ±  0%
List/dqlite-fits-in-page/pagination-4      0.000 ±  0%
List/dqlite-overflows-page/all-4           0.000 ±  0%
List/dqlite-overflows-page/pagination-4    0.000 ±  0%
Update/sqlite/1-workers-4                 297.2µ ± 18%
Update/sqlite/4-workers-4                 1.548m ± 14%
Update/sqlite/16-workers-4                5.768m ± 11%
Update/sqlite/64-workers-4                19.39m ± 10%
Update/sqlite/128-workers-4               40.74m ± 39%
Update/dqlite/1-workers-4                 35.20µ ± 76%
Update/dqlite/4-workers-4                 41.40µ ± 39%
Update/dqlite/16-workers-4                49.80µ ± 32%
Update/dqlite/64-workers-4                52.60µ ± 49%
Update/dqlite/128-workers-4               44.20µ ± 28%
geomean                                                ¹
¹ summaries must be >0 to compute geomean

                                        │     After     │
                                        │     B/op      │
Compaction/sqlite-4                       2.333Ki ± 49%
Compaction/dqlite-4                       4.854Ki ± 49%
Create/sqlite/1-workers-4                 20.50Ki ±  0%
Create/sqlite/4-workers-4                 20.49Ki ±  0%
Create/sqlite/16-workers-4                20.49Ki ±  0%
Create/sqlite/64-workers-4                20.52Ki ±  0%
Create/sqlite/128-workers-4               20.79Ki ±  1%
Create/dqlite/1-workers-4                 19.74Ki ±  0%
Create/dqlite/4-workers-4                 19.74Ki ±  0%
Create/dqlite/16-workers-4                19.75Ki ±  0%
Create/dqlite/64-workers-4                19.73Ki ±  0%
Create/dqlite/128-workers-4               19.75Ki ± 11%
Delete/sqlite/1-workers-4                 22.92Ki ±  0%
Delete/sqlite/4-workers-4                 22.92Ki ±  0%
Delete/sqlite/16-workers-4                22.88Ki ±  0%
Delete/sqlite/64-workers-4                22.90Ki ±  0%
Delete/sqlite/128-workers-4               23.03Ki ±  1%
Delete/dqlite/1-workers-4                 22.01Ki ±  0%
Delete/dqlite/4-workers-4                 21.98Ki ±  0%
Delete/dqlite/16-workers-4                22.00Ki ±  1%
Delete/dqlite/64-workers-4                21.99Ki ±  0%
Delete/dqlite/128-workers-4               22.03Ki ±  0%
Get/sqlite-4                              24.43Ki ±  0%
Get/dqlite-4                              23.25Ki ±  0%
List/sqlite-tiny/all-4                    1.209Ki ± 23%
List/sqlite-tiny/pagination-4             1.550Ki ±  4%
List/sqlite-fits-in-page/all-4            7.394Ki ± 10%
List/sqlite-fits-in-page/pagination-4     10.17Ki ± 12%
List/sqlite-overflows-page/all-4          20.54Ki ± 12%
List/sqlite-overflows-page/pagination-4   23.47Ki ± 46%
List/dqlite-tiny/all-4                    1.051Ki ±  7%
List/dqlite-tiny/pagination-4               970.0 ±  2%
List/dqlite-fits-in-page/all-4            6.017Ki ±  8%
List/dqlite-fits-in-page/pagination-4     5.459Ki ±  4%
List/dqlite-overflows-page/all-4          30.55Ki ±  8%
List/dqlite-overflows-page/pagination-4   29.23Ki ±  9%
Update/sqlite/1-workers-4                 22.28Ki ±  0%
Update/sqlite/4-workers-4                 22.29Ki ±  0%
Update/sqlite/16-workers-4                22.35Ki ±  0%
Update/sqlite/64-workers-4                22.62Ki ±  1%
Update/sqlite/128-workers-4               23.49Ki ±  5%
Update/dqlite/1-workers-4                 21.50Ki ±  0%
Update/dqlite/4-workers-4                 21.50Ki ±  0%
Update/dqlite/16-workers-4                21.58Ki ±  1%
Update/dqlite/64-workers-4                22.19Ki ±  3%
Update/dqlite/128-workers-4               23.36Ki ±  4%
geomean                                   14.30Ki

                                        │    After    │
                                        │  allocs/op  │
Compaction/sqlite-4                       50.00 ± 50%
Compaction/dqlite-4                       116.0 ± 50%
Create/sqlite/1-workers-4                 399.0 ±  0%
Create/sqlite/4-workers-4                 399.0 ±  0%
Create/sqlite/16-workers-4                399.0 ±  0%
Create/sqlite/64-workers-4                399.0 ±  0%
Create/sqlite/128-workers-4               401.0 ±  1%
Create/dqlite/1-workers-4                 369.0 ±  0%
Create/dqlite/4-workers-4                 369.0 ±  0%
Create/dqlite/16-workers-4                369.0 ±  0%
Create/dqlite/64-workers-4                368.0 ±  0%
Create/dqlite/128-workers-4               368.0 ± 14%
Delete/sqlite/1-workers-4                 431.0 ±  0%
Delete/sqlite/4-workers-4                 431.0 ±  0%
Delete/sqlite/16-workers-4                430.0 ±  0%
Delete/sqlite/64-workers-4                430.0 ±  0%
Delete/sqlite/128-workers-4               431.0 ±  1%
Delete/dqlite/1-workers-4                 399.0 ±  0%
Delete/dqlite/4-workers-4                 399.0 ±  0%
Delete/dqlite/16-workers-4                399.0 ±  1%
Delete/dqlite/64-workers-4                399.0 ±  0%
Delete/dqlite/128-workers-4               399.0 ±  0%
Get/sqlite-4                              445.0 ±  0%
Get/dqlite-4                              412.0 ±  0%
List/sqlite-tiny/all-4                    18.00 ± 33%
List/sqlite-tiny/pagination-4             25.00 ±  0%
List/sqlite-fits-in-page/all-4            21.00 ± 14%
List/sqlite-fits-in-page/pagination-4     37.00 ± 16%
List/sqlite-overflows-page/all-4          9.000 ±  0%
List/sqlite-overflows-page/pagination-4   13.00 ± 77%
List/dqlite-tiny/all-4                    15.00 ± 13%
List/dqlite-tiny/pagination-4             14.00 ±  7%
List/dqlite-fits-in-page/all-4            19.00 ±  5%
List/dqlite-fits-in-page/pagination-4     19.00 ±  5%
List/dqlite-overflows-page/all-4          34.00 ±  3%
List/dqlite-overflows-page/pagination-4   34.00 ±  6%
Update/sqlite/1-workers-4                 412.0 ±  0%
Update/sqlite/4-workers-4                 412.0 ±  0%
Update/sqlite/16-workers-4                413.0 ±  0%
Update/sqlite/64-workers-4                417.0 ±  1%
Update/sqlite/128-workers-4               434.0 ±  4%
Update/dqlite/1-workers-4                 381.0 ±  0%
Update/dqlite/4-workers-4                 382.0 ±  0%
Update/dqlite/16-workers-4                382.0 ±  1%
Update/dqlite/64-workers-4                393.0 ±  3%
Update/dqlite/128-workers-4               413.0 ±  4%
geomean                                   170.5

                                        │         After         │
                                        │ network-bytes-read/op │
Compaction/dqlite-4                               1.751Ki ± 50%
Create/dqlite/1-workers-4                           241.4 ±  0%
Create/dqlite/4-workers-4                           241.2 ±  0%
Create/dqlite/16-workers-4                          241.4 ±  0%
Create/dqlite/64-workers-4                          242.2 ±  0%
Create/dqlite/128-workers-4                         242.2 ± 35%
Delete/dqlite/1-workers-4                           718.2 ±  0%
Delete/dqlite/4-workers-4                           719.6 ±  0%
Delete/dqlite/16-workers-4                          718.8 ±  1%
Delete/dqlite/64-workers-4                          719.8 ±  1%
Delete/dqlite/128-workers-4                         718.8 ±  0%
Get/dqlite-4                                      1.132Ki ±  0%
List/dqlite-tiny/all-4                              212.4 ± 13%
List/dqlite-tiny/pagination-4                       197.9 ±  1%
List/dqlite-fits-in-page/all-4                    1.333Ki ±  3%
List/dqlite-fits-in-page/pagination-4             1.306Ki ±  4%
List/dqlite-overflows-page/all-4                  7.153Ki ±  4%
List/dqlite-overflows-page/pagination-4           7.026Ki ±  4%
Update/dqlite/1-workers-4                           262.8 ±  0%
Update/dqlite/4-workers-4                           263.3 ±  0%
Update/dqlite/16-workers-4                          263.5 ±  1%
Update/dqlite/64-workers-4                          270.7 ±  3%
Update/dqlite/128-workers-4                         284.6 ±  4%
geomean                                             563.6

                                        │          After           │
                                        │ network-bytes-written/op │
Compaction/dqlite-4                                    4.475 ±  8%
Create/dqlite/1-workers-4                              116.0 ±  1%
Create/dqlite/4-workers-4                              115.5 ±  1%
Create/dqlite/16-workers-4                             115.9 ±  1%
Create/dqlite/64-workers-4                             117.3 ±  1%
Create/dqlite/128-workers-4                            117.5 ± 24%
Delete/dqlite/1-workers-4                              82.66 ±  1%
Delete/dqlite/4-workers-4                              83.19 ±  1%
Delete/dqlite/16-workers-4                             82.92 ±  2%
Delete/dqlite/64-workers-4                             83.31 ±  2%
Delete/dqlite/128-workers-4                            82.94 ±  1%
Get/dqlite-4                                           80.57 ±  0%
List/dqlite-tiny/all-4                               0.04686 ± 24%
List/dqlite-tiny/pagination-4                        0.05000 ±  7%
List/dqlite-fits-in-page/all-4                       0.06021 ±  4%
List/dqlite-fits-in-page/pagination-4                0.07804 ± 21%
List/dqlite-overflows-page/all-4                     0.08135 ±  4%
List/dqlite-overflows-page/pagination-4               0.1293 ± 11%
Update/dqlite/1-workers-4                              136.8 ±  0%
Update/dqlite/4-workers-4                              136.8 ±  0%
Update/dqlite/16-workers-4                             137.1 ±  1%
Update/dqlite/64-workers-4                             141.4 ±  3%
Update/dqlite/128-workers-4                            148.7 ±  4%
geomean                                                13.89

bschimke95
bschimke95 approved these changes Nov 26, 2024
View reviewed changes
Copy link
Contributor

@bschimke95 bschimke95 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@louiseschmidtgen louiseschmidtgen merged commit 1e36ad1 into master Nov 26, 2024
9 checks passed
@louiseschmidtgen louiseschmidtgen deleted the perf-test-follow-up branch November 26, 2024 16:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bschimke95 bschimke95 bschimke95 approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@louiseschmidtgen @bschimke95