20260905T073915Z-5f145831-tap-compare-scaling
Same-hardware TAP-server resource-scaling comparison: the parity
protocol's corpus, gates, query stream, formats and statistics, with
both servers' resource pins raised tier by tier. Within a tier each
server is measured alone under that tier's pins (the host cannot hold
two pinned stacks of the larger tiers at once), so repetitions do not
interleave across servers; the gates run per tier with both stacks up.
The pins actually applied, as docker inspect and SHOW saw them, are
under pins/. See benchmarks/tap-compare/scaling/PROTOCOL.md for
the pre-registered design. Where resources.jsonl covers a rung, the
resource tables give each server's CPU cores used, CPU time per request
and memory over the rung's window (resources.csv has every rung);
rungs measured before the sampler started show —.
Tier 8
Gates
| target |
TAP |
taplint |
maxrec default |
| dachs-local |
1.1 |
PASS (0 errors) |
20000 |
| egernia-local |
1.1 |
PASS (0 errors) |
10000 |
Agreement gate: 11 classes agree, none disagree.
csv
| class |
c |
dachs-local rps |
dachs-local p95 (s) |
egernia-local rps |
egernia-local p95 (s) |
verdict |
| Q01 |
8 |
16.9 ±0.1 |
0.573 ±0.006 |
191.7 ±1.5 |
0.059 ±0.001 |
egernia-local |
| Q01 |
32 |
15.5 ±0.6 |
2.214 ±0.092 |
174.5 ±1.2 |
0.226 ±0.003 |
egernia-local |
| Q01 |
64 |
15.5 ±0.2 |
4.325 ±0.004 |
163.5 ±1.8 |
0.498 ±0.008 |
egernia-local |
| Q02 |
8 |
9.3 ±0.2 |
1.058 ±0.014 |
151.9 ±1.3 |
0.074 ±0.002 |
egernia-local |
| Q02 |
32 |
8.8 ±0.1 |
3.897 ±0.101 |
140.5 ±0.5 |
0.279 ±0.003 |
egernia-local |
| Q02 |
64 |
8.9 ±0.2 |
7.505 ±0.096 |
132.8 ±0.3 |
0.578 ±0.009 |
egernia-local |
| Q03 |
8 |
11.5 ±0.1 |
0.849 ±0.006 |
137.8 ±3.0 |
0.191 ±0.002 |
egernia-local |
| Q03 |
32 |
11.0 ±0.4 |
3.128 ±0.182 |
128.5 ±3.0 |
0.390 ±0.009 |
egernia-local |
| Q03 |
64 |
11.1 ±0.0 |
6.055 ±0.077 |
122.5 ±3.7 |
0.670 ±0.011 |
egernia-local |
| Q04 |
8 |
11.6 ±0.1 |
0.836 ±0.016 |
131.8 ±0.4 |
0.080 ±0.000 |
egernia-local |
| Q04 |
32 |
10.6 ±1.5 |
4.700 ±6.801 |
127.1 ±0.3 |
0.303 ±0.006 |
egernia-local |
| Q04 |
64 |
11.0 ±0.2 |
6.125 ±0.196 |
121.0 ±0.6 |
0.622 ±0.010 |
egernia-local |
| Q05 |
8 |
7.8 ±0.1 |
1.273 ±0.088 |
177.8 ±0.8 |
0.064 ±0.000 |
egernia-local |
| Q05 |
32 |
8.2 ±0.1 |
4.185 ±0.079 |
159.6 ±0.6 |
0.249 ±0.002 |
egernia-local |
| Q05 |
64 |
7.9 ±0.5 |
8.220 ±0.050 |
149.0 ±0.5 |
0.518 ±0.012 |
egernia-local |
| Q06 |
8 |
7.7 ±0.1 |
1.287 ±0.037 |
140.0 ±0.4 |
0.079 ±0.000 |
egernia-local |
| Q06 |
32 |
7.9 ±0.2 |
4.343 ±0.050 |
128.1 ±4.2 |
0.306 ±0.016 |
egernia-local |
| Q06 |
64 |
7.6 ±0.1 |
8.356 ±0.245 |
121.9 ±1.7 |
0.627 ±0.004 |
egernia-local |
| Q07 |
8 |
7.5 ±0.1 |
1.316 ±0.015 |
165.2 ±1.7 |
0.068 ±0.001 |
egernia-local |
| Q07 |
32 |
7.7 ±0.2 |
4.491 ±0.114 |
150.3 ±0.3 |
0.263 ±0.004 |
egernia-local |
| Q07 |
64 |
7.7 ±0.3 |
8.698 ±0.051 |
141.0 ±0.8 |
0.558 ±0.021 |
egernia-local |
| Q10 |
8 |
10.2 ±0.1 |
0.952 ±0.022 |
88.1 ±0.7 |
0.117 ±0.001 |
egernia-local |
| Q10 |
32 |
9.8 ±0.0 |
3.469 ±0.027 |
84.3 ±0.9 |
0.457 ±0.005 |
egernia-local |
| Q10 |
64 |
9.9 ±0.1 |
6.771 ±0.084 |
79.9 ±0.6 |
0.910 ±0.007 |
egernia-local |
| Q11 |
8 |
3.8 ±0.1 |
2.656 ±0.189 |
15.5 ±0.2 |
0.629 ±0.034 |
egernia-local |
| Q11 |
32 |
4.1 ±0.1 |
11.983 ±2.446 |
16.5 ±0.1 |
2.234 ±0.002 |
egernia-local |
| Q11 |
64 |
4.1 ±0.2 |
24.833 ±5.111 |
16.2 ±0.1 |
4.333 ±0.177 |
egernia-local |
| Q12 |
8 |
7.9 ±0.2 |
1.264 ±0.119 |
180.7 ±0.5 |
0.062 ±0.001 |
egernia-local |
| Q12 |
32 |
8.1 ±0.1 |
4.220 ±0.018 |
162.0 ±0.6 |
0.247 ±0.011 |
egernia-local |
| Q12 |
64 |
7.8 ±0.3 |
8.225 ±0.031 |
151.5 ±0.5 |
0.520 ±0.019 |
egernia-local |
| Q13 |
8 |
9.9 ±0.1 |
1.113 ±0.060 |
9.6 ±0.4 |
1.113 ±0.021 |
tie |
| Q13 |
32 |
9.4 ±0.0 |
3.723 ±0.064 |
9.6 ±0.3 |
3.715 ±0.100 |
tie |
| Q13 |
64 |
9.5 ±0.1 |
7.099 ±0.079 |
9.7 ±0.5 |
7.810 ±0.565 |
tie |
| mix |
8 |
9.4 ±0.2 |
1.324 ±0.001 |
151.7 ±0.2 |
0.083 ±0.000 |
egernia-local |
| mix |
32 |
8.8 ±0.8 |
4.323 ±0.939 |
138.2 ±1.8 |
0.319 ±0.011 |
egernia-local |
| mix |
64 |
8.8 ±0.1 |
7.671 ±0.240 |
130.3 ±0.7 |
0.628 ±0.007 |
egernia-local |
votable
| class |
c |
dachs-local rps |
dachs-local p95 (s) |
egernia-local rps |
egernia-local p95 (s) |
verdict |
| Q01 |
8 |
16.9 ±0.5 |
0.569 ±0.005 |
190.6 ±1.9 |
0.059 ±0.001 |
egernia-local |
| Q01 |
32 |
14.7 ±1.5 |
2.294 ±0.203 |
173.4 ±1.9 |
0.228 ±0.001 |
egernia-local |
| Q01 |
64 |
15.1 ±0.2 |
4.437 ±0.076 |
162.2 ±1.3 |
0.491 ±0.028 |
egernia-local |
| Q02 |
8 |
9.2 ±0.2 |
1.060 ±0.033 |
149.0 ±0.4 |
0.075 ±0.001 |
egernia-local |
| Q02 |
32 |
8.6 ±0.1 |
3.943 ±0.231 |
137.8 ±0.7 |
0.282 ±0.005 |
egernia-local |
| Q02 |
64 |
8.8 ±0.1 |
7.549 ±0.028 |
130.3 ±1.0 |
0.586 ±0.016 |
egernia-local |
| Q03 |
8 |
11.4 ±0.1 |
0.862 ±0.009 |
136.2 ±1.9 |
0.189 ±0.002 |
egernia-local |
| Q03 |
32 |
10.8 ±0.3 |
3.211 ±0.124 |
127.8 ±1.7 |
0.387 ±0.004 |
egernia-local |
| Q03 |
64 |
10.8 ±0.3 |
6.206 ±0.148 |
121.1 ±2.6 |
0.677 ±0.013 |
egernia-local |
| Q04 |
8 |
11.5 ±0.2 |
0.841 ±0.025 |
126.0 ±1.3 |
0.084 ±0.000 |
egernia-local |
| Q04 |
32 |
10.8 ±0.0 |
3.146 ±0.089 |
121.7 ±1.3 |
0.317 ±0.005 |
egernia-local |
| Q04 |
64 |
11.0 ±0.2 |
6.067 ±0.115 |
115.5 ±0.5 |
0.648 ±0.021 |
egernia-local |
| Q05 |
8 |
7.8 ±0.1 |
1.264 ±0.040 |
174.7 ±1.5 |
0.064 ±0.001 |
egernia-local |
| Q05 |
32 |
8.0 ±0.2 |
4.318 ±0.080 |
155.3 ±1.7 |
0.257 ±0.010 |
egernia-local |
| Q05 |
64 |
7.6 ±0.1 |
8.365 ±0.072 |
147.1 ±1.7 |
0.534 ±0.009 |
egernia-local |
| Q06 |
8 |
7.7 ±0.2 |
1.267 ±0.028 |
136.1 ±0.8 |
0.082 ±0.001 |
egernia-local |
| Q06 |
32 |
7.7 ±0.3 |
4.388 ±0.125 |
125.2 ±0.8 |
0.312 ±0.003 |
egernia-local |
| Q06 |
64 |
7.9 ±0.4 |
8.525 ±0.306 |
118.5 ±1.8 |
0.657 ±0.015 |
egernia-local |
| Q07 |
8 |
7.4 ±0.1 |
1.298 ±0.054 |
161.1 ±0.5 |
0.069 ±0.000 |
egernia-local |
| Q07 |
32 |
7.7 ±0.1 |
4.510 ±0.164 |
145.6 ±0.1 |
0.272 ±0.005 |
egernia-local |
| Q07 |
64 |
7.6 ±0.3 |
8.779 ±0.306 |
138.6 ±1.1 |
0.556 ±0.011 |
egernia-local |
| Q10 |
8 |
10.4 ±0.3 |
0.931 ±0.026 |
81.4 ±0.8 |
0.126 ±0.003 |
egernia-local |
| Q10 |
32 |
10.0 ±0.1 |
3.420 ±0.035 |
79.1 ±0.1 |
0.483 ±0.004 |
egernia-local |
| Q10 |
64 |
10.1 ±0.1 |
6.710 ±0.190 |
75.8 ±0.2 |
0.961 ±0.019 |
egernia-local |
| Q11 |
8 |
4.2 ±0.2 |
2.352 ±0.156 |
14.2 ±0.3 |
0.672 ±0.017 |
egernia-local |
| Q11 |
32 |
4.4 ±0.2 |
10.938 ±1.073 |
14.8 ±0.1 |
2.461 ±0.035 |
egernia-local |
| Q11 |
64 |
4.2 ±0.7 |
22.121 ±3.781 |
14.6 ±0.4 |
4.782 ±0.017 |
egernia-local |
| Q12 |
8 |
7.8 ±0.2 |
1.284 ±0.062 |
178.8 ±0.3 |
0.063 ±0.001 |
egernia-local |
| Q12 |
32 |
8.0 ±0.3 |
4.272 ±0.156 |
159.5 ±1.7 |
0.250 ±0.007 |
egernia-local |
| Q12 |
64 |
7.8 ±0.4 |
8.341 ±0.154 |
149.3 ±0.5 |
0.527 ±0.027 |
egernia-local |
| Q13 |
8 |
9.8 ±0.2 |
1.108 ±0.026 |
9.6 ±0.3 |
1.112 ±0.027 |
tie |
| Q13 |
32 |
9.4 ±0.2 |
3.733 ±0.105 |
9.5 ±0.2 |
3.803 ±0.088 |
tie |
| Q13 |
64 |
9.0 ±0.2 |
7.197 ±0.074 |
9.3 ±0.3 |
7.900 ±0.335 |
tie |
| mix |
8 |
9.6 ±0.4 |
1.286 ±0.033 |
147.9 ±1.4 |
0.087 ±0.002 |
egernia-local |
| mix |
32 |
9.2 ±0.1 |
4.059 ±0.147 |
134.8 ±1.0 |
0.323 ±0.013 |
egernia-local |
| mix |
64 |
9.0 ±0.7 |
7.560 ±0.371 |
127.4 ±1.1 |
0.654 ±0.019 |
egernia-local |
resources, csv
| class |
c |
dachs-local cores |
CPU s/req |
mem mean GiB |
mem peak GiB |
egernia-local cores |
CPU s/req |
mem mean GiB |
mem peak GiB |
| Q01 |
8 |
1.95 |
115.4 ms |
1.01 |
1.01 |
1.43 |
7.5 ms |
1.53 |
1.53 |
| Q01 |
32 |
1.90 |
124.5 ms |
1.01 |
1.01 |
1.41 |
8.1 ms |
1.53 |
1.54 |
| Q01 |
64 |
1.89 |
127.2 ms |
1.01 |
1.01 |
1.39 |
8.5 ms |
1.51 |
1.53 |
| Q02 |
8 |
5.28 |
569.9 ms |
1.02 |
1.03 |
3.01 |
19.8 ms |
1.49 |
1.50 |
| Q02 |
32 |
5.10 |
592.9 ms |
1.02 |
1.04 |
2.87 |
20.5 ms |
1.48 |
1.50 |
| Q02 |
64 |
5.12 |
618.8 ms |
1.03 |
1.04 |
2.76 |
20.8 ms |
1.48 |
1.49 |
| Q03 |
8 |
2.16 |
188.2 ms |
1.02 |
1.03 |
5.02 |
36.5 ms |
1.49 |
1.50 |
| Q03 |
32 |
2.15 |
199.1 ms |
1.02 |
1.02 |
4.83 |
37.6 ms |
1.49 |
1.49 |
| Q03 |
64 |
2.13 |
203.0 ms |
1.02 |
1.03 |
4.61 |
37.7 ms |
1.49 |
1.50 |
| Q04 |
8 |
1.85 |
160.6 ms |
1.02 |
1.02 |
3.50 |
26.6 ms |
1.49 |
1.49 |
| Q04 |
32 |
1.80 |
171.1 ms |
1.02 |
1.03 |
3.38 |
26.6 ms |
1.49 |
1.49 |
| Q04 |
64 |
1.85 |
175.6 ms |
1.03 |
1.03 |
3.25 |
26.9 ms |
1.49 |
1.50 |
| Q05 |
8 |
6.14 |
792.3 ms |
1.14 |
1.23 |
2.03 |
11.4 ms |
1.49 |
1.49 |
| Q05 |
32 |
6.63 |
837.6 ms |
1.16 |
1.23 |
1.96 |
12.3 ms |
1.50 |
1.51 |
| Q05 |
64 |
6.58 |
871.0 ms |
1.16 |
1.24 |
1.89 |
12.7 ms |
1.50 |
1.50 |
| Q06 |
8 |
6.03 |
782.9 ms |
1.14 |
1.23 |
3.02 |
21.6 ms |
1.50 |
1.51 |
| Q06 |
32 |
6.40 |
832.3 ms |
1.15 |
1.23 |
2.86 |
22.3 ms |
1.49 |
1.50 |
| Q06 |
64 |
6.43 |
854.1 ms |
1.15 |
1.23 |
2.76 |
22.7 ms |
1.49 |
1.49 |
| Q07 |
8 |
6.14 |
826.2 ms |
1.15 |
1.24 |
2.49 |
15.1 ms |
1.48 |
1.48 |
| Q07 |
32 |
6.49 |
879.2 ms |
1.15 |
1.22 |
2.38 |
15.8 ms |
1.49 |
1.50 |
| Q07 |
64 |
6.48 |
907.3 ms |
1.17 |
1.24 |
2.29 |
16.3 ms |
1.49 |
1.49 |
| Q10 |
8 |
1.78 |
174.8 ms |
1.03 |
1.04 |
3.97 |
45.1 ms |
1.49 |
1.50 |
| Q10 |
32 |
1.82 |
188.8 ms |
1.04 |
1.05 |
3.73 |
44.3 ms |
1.49 |
1.50 |
| Q10 |
64 |
1.82 |
196.0 ms |
1.04 |
1.05 |
3.57 |
44.8 ms |
1.49 |
1.50 |
| Q11 |
8 |
1.47 |
382.7 ms |
1.08 |
1.11 |
5.56 |
359.2 ms |
1.51 |
1.52 |
| Q11 |
32 |
1.58 |
392.8 ms |
1.12 |
1.16 |
5.70 |
346.3 ms |
1.55 |
1.57 |
| Q11 |
64 |
1.61 |
400.2 ms |
1.15 |
1.24 |
5.59 |
349.4 ms |
1.62 |
1.65 |
| Q12 |
8 |
6.22 |
792.8 ms |
1.17 |
1.24 |
1.96 |
10.9 ms |
1.51 |
1.52 |
| Q12 |
32 |
6.61 |
845.6 ms |
1.17 |
1.25 |
1.90 |
11.7 ms |
1.51 |
1.51 |
| Q12 |
64 |
6.58 |
863.3 ms |
1.17 |
1.22 |
1.84 |
12.1 ms |
1.51 |
1.53 |
| Q13 |
8 |
5.50 |
561.2 ms |
1.04 |
1.06 |
7.99 |
832.7 ms |
1.60 |
1.61 |
| Q13 |
32 |
5.41 |
586.5 ms |
1.04 |
1.07 |
7.99 |
843.4 ms |
1.59 |
1.62 |
| Q13 |
64 |
5.46 |
607.2 ms |
1.04 |
1.06 |
7.99 |
851.7 ms |
1.59 |
1.61 |
| mix |
8 |
4.85 |
522.3 ms |
1.07 |
1.19 |
3.19 |
21.0 ms |
1.52 |
1.54 |
| mix |
32 |
4.76 |
544.7 ms |
1.07 |
1.19 |
3.00 |
21.7 ms |
1.53 |
1.54 |
| mix |
64 |
4.82 |
555.3 ms |
1.08 |
1.16 |
2.87 |
22.1 ms |
1.53 |
1.53 |
resources, votable
| class |
c |
dachs-local cores |
CPU s/req |
mem mean GiB |
mem peak GiB |
egernia-local cores |
CPU s/req |
mem mean GiB |
mem peak GiB |
| Q01 |
8 |
1.99 |
117.9 ms |
0.73 |
0.73 |
— |
— |
— |
— |
| Q01 |
32 |
1.88 |
128.4 ms |
0.73 |
0.74 |
— |
— |
— |
— |
| Q01 |
64 |
1.93 |
132.7 ms |
0.75 |
0.76 |
— |
— |
— |
— |
| Q02 |
8 |
5.25 |
573.3 ms |
0.76 |
0.77 |
— |
— |
— |
— |
| Q02 |
32 |
5.08 |
597.6 ms |
0.76 |
0.78 |
— |
— |
— |
— |
| Q02 |
64 |
5.11 |
621.0 ms |
0.78 |
0.79 |
— |
— |
— |
— |
| Q03 |
8 |
2.16 |
190.9 ms |
0.77 |
0.78 |
— |
— |
— |
— |
| Q03 |
32 |
2.13 |
201.4 ms |
0.77 |
0.78 |
— |
— |
— |
— |
| Q03 |
64 |
2.13 |
207.7 ms |
0.77 |
0.78 |
— |
— |
— |
— |
| Q04 |
8 |
1.84 |
160.6 ms |
0.76 |
0.76 |
— |
— |
— |
— |
| Q04 |
32 |
1.85 |
173.4 ms |
0.77 |
0.77 |
— |
— |
— |
— |
| Q04 |
64 |
1.86 |
177.7 ms |
0.78 |
0.79 |
— |
— |
— |
— |
| Q05 |
8 |
6.15 |
795.5 ms |
0.89 |
0.97 |
— |
— |
— |
— |
| Q05 |
32 |
6.51 |
841.4 ms |
0.90 |
0.98 |
1.95 |
12.6 ms |
1.40 |
1.41 |
| Q05 |
64 |
6.50 |
866.3 ms |
0.91 |
0.99 |
1.90 |
12.9 ms |
1.40 |
1.40 |
| Q06 |
8 |
6.06 |
793.7 ms |
0.89 |
0.97 |
3.06 |
22.5 ms |
1.39 |
1.40 |
| Q06 |
32 |
6.35 |
833.7 ms |
0.91 |
1.00 |
2.89 |
23.1 ms |
1.40 |
1.41 |
| Q06 |
64 |
6.36 |
857.5 ms |
0.91 |
0.98 |
2.78 |
23.5 ms |
1.40 |
1.40 |
| Q07 |
8 |
6.12 |
831.2 ms |
0.90 |
0.98 |
2.51 |
15.6 ms |
1.40 |
1.40 |
| Q07 |
32 |
6.47 |
870.2 ms |
0.91 |
0.98 |
2.39 |
16.4 ms |
1.41 |
1.42 |
| Q07 |
64 |
6.42 |
904.3 ms |
0.91 |
0.98 |
2.31 |
16.7 ms |
1.41 |
1.42 |
| Q10 |
8 |
1.80 |
174.0 ms |
0.79 |
0.79 |
3.97 |
48.8 ms |
1.41 |
1.42 |
| Q10 |
32 |
1.85 |
188.6 ms |
0.79 |
0.80 |
3.75 |
47.5 ms |
1.42 |
1.42 |
| Q10 |
64 |
1.85 |
196.3 ms |
0.79 |
0.80 |
3.61 |
47.9 ms |
1.43 |
1.44 |
| Q11 |
8 |
1.53 |
360.8 ms |
0.95 |
0.99 |
5.55 |
392.7 ms |
1.45 |
1.47 |
| Q11 |
32 |
1.63 |
373.9 ms |
1.05 |
1.11 |
5.55 |
374.4 ms |
1.52 |
1.54 |
| Q11 |
64 |
1.62 |
384.6 ms |
1.13 |
1.26 |
5.48 |
380.0 ms |
1.62 |
1.66 |
| Q12 |
8 |
6.13 |
795.2 ms |
1.14 |
1.21 |
1.98 |
11.1 ms |
1.47 |
1.48 |
| Q12 |
32 |
6.54 |
842.8 ms |
1.13 |
1.22 |
1.90 |
11.9 ms |
1.47 |
1.47 |
| Q12 |
64 |
6.51 |
866.3 ms |
1.13 |
1.19 |
1.84 |
12.3 ms |
1.47 |
1.49 |
| Q13 |
8 |
5.49 |
562.5 ms |
1.01 |
1.03 |
7.99 |
841.9 ms |
1.56 |
1.57 |
| Q13 |
32 |
5.43 |
586.0 ms |
1.01 |
1.03 |
7.99 |
858.4 ms |
1.56 |
1.59 |
| Q13 |
64 |
5.43 |
617.3 ms |
1.02 |
1.03 |
7.99 |
889.5 ms |
1.56 |
1.59 |
| mix |
8 |
4.93 |
520.4 ms |
0.77 |
0.82 |
— |
— |
— |
— |
| mix |
32 |
4.89 |
538.6 ms |
0.79 |
0.84 |
— |
— |
— |
— |
| mix |
64 |
4.87 |
557.0 ms |
0.80 |
0.88 |
— |
— |
— |
— |
throughput vs CPU cores used (mix)
| format |
c |
target |
API workers |
rps |
cores |
rps per core |
CPU ms/req |
| csv |
8 |
dachs-local |
— |
9.4 |
4.85 |
1.9 |
522.3 |
| csv |
8 |
egernia-local |
1 |
151.7 |
3.19 |
47.6 |
21.0 |
| csv |
32 |
dachs-local |
— |
8.8 |
4.76 |
1.9 |
544.7 |
| csv |
32 |
egernia-local |
1 |
138.2 |
3.00 |
46.1 |
21.7 |
| csv |
64 |
dachs-local |
— |
8.8 |
4.82 |
1.8 |
555.3 |
| csv |
64 |
egernia-local |
1 |
130.3 |
2.87 |
45.4 |
22.1 |
| votable |
8 |
dachs-local |
— |
9.6 |
4.93 |
1.9 |
520.4 |
| votable |
32 |
dachs-local |
— |
9.2 |
4.89 |
1.9 |
538.6 |
| votable |
64 |
dachs-local |
— |
9.0 |
4.87 |
1.8 |
557.0 |
Tier 16
Gates
| target |
TAP |
taplint |
maxrec default |
| dachs-local |
1.1 |
PASS (0 errors) |
20000 |
| egernia-local |
1.1 |
PASS (0 errors) |
10000 |
Agreement gate: 11 classes agree, none disagree.
csv
| class |
c |
dachs-local rps |
dachs-local p95 (s) |
egernia-local rps |
egernia-local p95 (s) |
verdict |
| Q01 |
8 |
17.4 ±0.3 |
0.561 ±0.004 |
384.3 ±3.6 |
0.030 ±0.007 |
egernia-local |
| Q01 |
32 |
15.8 ±0.2 |
2.166 ±0.035 |
345.2 ±2.6 |
0.121 ±0.002 |
egernia-local |
| Q01 |
64 |
15.4 ±0.2 |
4.241 ±0.013 |
326.5 ±4.0 |
0.255 ±0.051 |
egernia-local |
| Q02 |
8 |
11.0 ±0.3 |
0.893 ±0.017 |
266.0 ±8.2 |
0.043 ±0.005 |
egernia-local |
| Q02 |
32 |
10.5 ±0.2 |
3.241 ±0.039 |
279.2 ±1.9 |
0.160 ±0.033 |
egernia-local |
| Q02 |
64 |
10.5 ±0.6 |
6.316 ±0.115 |
264.7 ±0.3 |
0.308 ±0.041 |
egernia-local |
| Q03 |
8 |
11.9 ±0.1 |
0.825 ±0.012 |
195.4 ±6.1 |
0.156 ±0.003 |
egernia-local |
| Q03 |
32 |
11.3 ±0.1 |
3.055 ±0.111 |
259.4 ±2.7 |
0.259 ±0.009 |
egernia-local |
| Q03 |
64 |
11.1 ±0.6 |
6.835 ±3.875 |
246.5 ±7.4 |
0.396 ±0.014 |
egernia-local |
| Q04 |
8 |
11.9 ±0.1 |
0.816 ±0.010 |
222.9 ±9.9 |
0.048 ±0.006 |
egernia-local |
| Q04 |
32 |
11.3 ±0.2 |
3.060 ±0.019 |
255.4 ±1.9 |
0.166 ±0.025 |
egernia-local |
| Q04 |
64 |
11.3 ±0.3 |
5.888 ±0.129 |
244.5 ±2.7 |
0.339 ±0.091 |
egernia-local |
| Q05 |
8 |
9.2 ±0.3 |
1.128 ±0.083 |
337.3 ±7.7 |
0.033 ±0.006 |
egernia-local |
| Q05 |
32 |
10.1 ±0.3 |
3.459 ±0.305 |
315.4 ±1.1 |
0.141 ±0.025 |
egernia-local |
| Q05 |
64 |
10.1 ±0.6 |
6.649 ±0.160 |
298.3 ±1.4 |
0.263 ±0.009 |
egernia-local |
| Q06 |
8 |
8.9 ±0.1 |
1.172 ±0.072 |
230.5 ±22.6 |
0.053 ±0.009 |
egernia-local |
| Q06 |
32 |
9.7 ±0.2 |
3.559 ±0.088 |
257.3 ±0.5 |
0.170 ±0.025 |
egernia-local |
| Q06 |
64 |
9.8 ±0.2 |
6.882 ±0.184 |
244.7 ±2.0 |
0.327 ±0.014 |
egernia-local |
| Q07 |
8 |
8.6 ±0.3 |
1.184 ±0.111 |
290.4 ±26.9 |
0.043 ±0.008 |
egernia-local |
| Q07 |
32 |
9.5 ±0.3 |
3.615 ±0.040 |
297.4 ±1.0 |
0.140 ±0.012 |
egernia-local |
| Q07 |
64 |
9.3 ±0.6 |
7.173 ±0.165 |
281.2 ±3.0 |
0.289 ±0.039 |
egernia-local |
| Q10 |
8 |
10.4 ±0.3 |
0.924 ±0.040 |
134.1 ±27.3 |
0.082 ±0.017 |
egernia-local |
| Q10 |
32 |
10.0 ±0.2 |
3.426 ±0.043 |
167.8 ±0.8 |
0.248 ±0.017 |
egernia-local |
| Q10 |
64 |
10.1 ±0.2 |
6.616 ±0.146 |
161.7 ±1.5 |
0.484 ±0.042 |
egernia-local |
| Q11 |
8 |
4.0 ±0.1 |
2.639 ±0.185 |
22.4 ±4.6 |
0.447 ±0.122 |
egernia-local |
| Q11 |
32 |
4.1 ±0.0 |
12.869 ±0.612 |
31.3 ±2.0 |
1.453 ±0.762 |
egernia-local |
| Q11 |
64 |
4.1 ±0.0 |
23.655 ±5.990 |
31.2 ±1.2 |
2.580 ±0.509 |
egernia-local |
| Q12 |
8 |
9.3 ±0.3 |
1.110 ±0.084 |
346.4 ±13.1 |
0.032 ±0.007 |
egernia-local |
| Q12 |
32 |
10.1 ±0.3 |
3.409 ±0.135 |
320.8 ±1.2 |
0.130 ±0.003 |
egernia-local |
| Q12 |
64 |
10.1 ±0.2 |
6.637 ±0.101 |
303.8 ±4.6 |
0.267 ±0.048 |
egernia-local |
| Q13 |
8 |
11.6 ±0.2 |
0.968 ±0.015 |
20.8 ±0.3 |
0.525 ±0.013 |
egernia-local |
| Q13 |
32 |
11.4 ±0.1 |
3.117 ±0.050 |
21.2 ±0.1 |
2.172 ±0.209 |
egernia-local |
| Q13 |
64 |
10.9 ±0.3 |
6.468 ±1.972 |
21.2 ±0.1 |
3.590 ±0.236 |
egernia-local |
| mix |
8 |
10.8 ±0.3 |
1.181 ±0.054 |
263.9 ±10.1 |
0.052 ±0.001 |
egernia-local |
| mix |
32 |
10.3 ±0.2 |
3.594 ±0.035 |
274.5 ±3.5 |
0.168 ±0.011 |
egernia-local |
| mix |
64 |
10.1 ±0.3 |
6.716 ±0.111 |
259.0 ±0.5 |
0.326 ±0.005 |
egernia-local |
votable
| class |
c |
dachs-local rps |
dachs-local p95 (s) |
egernia-local rps |
egernia-local p95 (s) |
verdict |
| Q01 |
8 |
17.4 ±0.4 |
0.558 ±0.032 |
382.4 ±11.9 |
0.034 ±0.014 |
egernia-local |
| Q01 |
32 |
15.6 ±0.1 |
2.206 ±0.030 |
345.2 ±1.5 |
0.121 ±0.002 |
egernia-local |
| Q01 |
64 |
15.5 ±0.3 |
4.342 ±0.188 |
326.0 ±0.2 |
0.247 ±0.025 |
egernia-local |
| Q02 |
8 |
11.0 ±0.2 |
0.908 ±0.044 |
259.7 ±10.3 |
0.044 ±0.004 |
egernia-local |
| Q02 |
32 |
10.3 ±0.1 |
3.325 ±0.041 |
274.7 ±1.1 |
0.151 ±0.005 |
egernia-local |
| Q02 |
64 |
10.0 ±0.4 |
6.386 ±0.104 |
260.8 ±1.0 |
0.301 ±0.013 |
egernia-local |
| Q03 |
8 |
11.7 ±0.2 |
0.850 ±0.014 |
192.8 ±1.4 |
0.157 ±0.000 |
egernia-local |
| Q03 |
32 |
11.1 ±0.1 |
3.079 ±0.046 |
256.9 ±0.6 |
0.259 ±0.018 |
egernia-local |
| Q03 |
64 |
11.2 ±0.6 |
5.969 ±0.085 |
244.9 ±1.1 |
0.403 ±0.022 |
egernia-local |
| Q04 |
8 |
11.8 ±0.1 |
0.831 ±0.018 |
214.7 ±7.6 |
0.050 ±0.006 |
egernia-local |
| Q04 |
32 |
11.0 ±0.5 |
3.132 ±0.324 |
245.9 ±1.9 |
0.176 ±0.021 |
egernia-local |
| Q04 |
64 |
11.1 ±0.4 |
5.978 ±0.043 |
233.5 ±1.9 |
0.328 ±0.006 |
egernia-local |
| Q05 |
8 |
9.1 ±0.3 |
1.124 ±0.045 |
324.9 ±27.5 |
0.038 ±0.009 |
egernia-local |
| Q05 |
32 |
9.8 ±0.3 |
3.544 ±0.038 |
313.7 ±2.9 |
0.137 ±0.022 |
egernia-local |
| Q05 |
64 |
10.0 ±0.3 |
6.698 ±0.142 |
294.7 ±5.9 |
0.266 ±0.012 |
egernia-local |
| Q06 |
8 |
8.9 ±0.1 |
1.165 ±0.019 |
230.4 ±26.9 |
0.052 ±0.014 |
egernia-local |
| Q06 |
32 |
9.5 ±0.3 |
3.667 ±0.172 |
249.9 ±2.0 |
0.177 ±0.034 |
egernia-local |
| Q06 |
64 |
9.5 ±0.2 |
7.026 ±0.078 |
238.5 ±1.4 |
0.368 ±0.021 |
egernia-local |
| Q07 |
8 |
8.6 ±0.1 |
1.132 ±0.060 |
294.7 ±11.8 |
0.040 ±0.006 |
egernia-local |
| Q07 |
32 |
9.3 ±0.1 |
3.765 ±0.025 |
292.5 ±1.3 |
0.143 ±0.001 |
egernia-local |
| Q07 |
64 |
9.0 ±1.0 |
7.170 ±0.463 |
277.1 ±1.8 |
0.285 ±0.021 |
egernia-local |
| Q10 |
8 |
10.6 ±0.0 |
0.921 ±0.008 |
133.6 ±1.3 |
0.080 ±0.001 |
egernia-local |
| Q10 |
32 |
10.3 ±0.3 |
3.360 ±0.104 |
156.7 ±1.5 |
0.268 ±0.023 |
egernia-local |
| Q10 |
64 |
10.2 ±0.5 |
6.493 ±0.266 |
150.9 ±0.3 |
0.525 ±0.077 |
egernia-local |
| Q11 |
8 |
4.2 ±0.9 |
2.940 ±2.594 |
20.6 ±0.6 |
0.485 ±0.014 |
egernia-local |
| Q11 |
32 |
4.5 ±0.1 |
10.691 ±2.133 |
26.2 ±3.7 |
1.792 ±0.463 |
egernia-local |
| Q11 |
64 |
4.6 ±0.1 |
22.363 ±2.833 |
25.9 ±1.7 |
3.769 ±1.326 |
egernia-local |
| Q12 |
8 |
9.0 ±0.2 |
1.143 ±0.033 |
336.0 ±0.5 |
0.036 ±0.000 |
egernia-local |
| Q12 |
32 |
10.0 ±0.0 |
3.493 ±0.047 |
315.1 ±1.1 |
0.145 ±0.031 |
egernia-local |
| Q12 |
64 |
9.9 ±0.3 |
6.860 ±0.287 |
297.4 ±3.5 |
0.276 ±0.041 |
egernia-local |
| Q13 |
8 |
11.5 ±0.3 |
0.983 ±0.072 |
20.7 ±0.3 |
0.532 ±0.006 |
egernia-local |
| Q13 |
32 |
11.2 ±0.0 |
3.177 ±0.058 |
20.8 ±0.1 |
2.090 ±0.480 |
egernia-local |
| Q13 |
64 |
11.0 ±0.5 |
6.091 ±0.056 |
20.8 ±0.1 |
3.756 ±0.699 |
egernia-local |
| mix |
8 |
10.9 ±0.2 |
1.168 ±0.067 |
258.1 ±0.9 |
0.055 ±0.001 |
egernia-local |
| mix |
32 |
10.5 ±0.4 |
3.535 ±0.105 |
267.7 ±1.1 |
0.177 ±0.009 |
egernia-local |
| mix |
64 |
10.4 ±0.2 |
6.642 ±0.060 |
253.8 ±2.1 |
0.337 ±0.020 |
egernia-local |
resources, csv
| class |
c |
dachs-local cores |
CPU s/req |
mem mean GiB |
mem peak GiB |
egernia-local cores |
CPU s/req |
mem mean GiB |
mem peak GiB |
| Q01 |
8 |
2.01 |
115.7 ms |
1.06 |
1.07 |
2.71 |
7.1 ms |
2.05 |
2.05 |
| Q01 |
32 |
1.96 |
125.6 ms |
1.05 |
1.06 |
2.79 |
8.1 ms |
2.05 |
2.06 |
| Q01 |
64 |
1.96 |
128.8 ms |
1.05 |
1.06 |
2.76 |
8.5 ms |
2.02 |
2.04 |
| Q02 |
8 |
5.91 |
537.1 ms |
1.06 |
1.08 |
4.96 |
18.6 ms |
1.99 |
2.00 |
| Q02 |
32 |
5.75 |
554.0 ms |
1.06 |
1.08 |
5.71 |
20.5 ms |
1.98 |
1.99 |
| Q02 |
64 |
5.74 |
573.2 ms |
1.07 |
1.08 |
5.52 |
20.9 ms |
1.97 |
1.98 |
| Q03 |
8 |
2.21 |
186.7 ms |
1.06 |
1.07 |
6.30 |
32.3 ms |
1.98 |
1.98 |
| Q03 |
32 |
2.21 |
198.3 ms |
1.06 |
1.07 |
9.44 |
36.5 ms |
1.98 |
1.98 |
| Q03 |
64 |
2.17 |
206.1 ms |
1.07 |
1.09 |
9.08 |
36.9 ms |
1.98 |
1.98 |
| Q04 |
8 |
1.90 |
159.7 ms |
1.06 |
1.07 |
5.23 |
23.5 ms |
1.99 |
2.00 |
| Q04 |
32 |
1.91 |
173.1 ms |
1.07 |
1.07 |
6.56 |
25.7 ms |
2.00 |
2.00 |
| Q04 |
64 |
1.91 |
178.6 ms |
1.07 |
1.08 |
6.37 |
26.1 ms |
2.00 |
2.01 |
| Q05 |
8 |
6.49 |
713.7 ms |
1.18 |
1.27 |
3.68 |
10.9 ms |
2.00 |
2.02 |
| Q05 |
32 |
7.45 |
752.1 ms |
1.21 |
1.29 |
3.90 |
12.4 ms |
2.01 |
2.02 |
| Q05 |
64 |
7.46 |
780.1 ms |
1.20 |
1.30 |
3.81 |
12.8 ms |
2.01 |
2.02 |
| Q06 |
8 |
6.32 |
710.6 ms |
1.21 |
1.26 |
4.67 |
20.3 ms |
2.01 |
2.01 |
| Q06 |
32 |
7.16 |
751.9 ms |
1.21 |
1.28 |
5.70 |
22.2 ms |
2.00 |
2.01 |
| Q06 |
64 |
7.12 |
768.5 ms |
1.21 |
1.31 |
5.52 |
22.6 ms |
1.98 |
1.99 |
| Q07 |
8 |
6.40 |
749.9 ms |
1.20 |
1.27 |
4.16 |
14.3 ms |
1.98 |
1.99 |
| Q07 |
32 |
7.33 |
794.2 ms |
1.22 |
1.30 |
4.75 |
16.0 ms |
1.97 |
1.98 |
| Q07 |
64 |
7.22 |
814.5 ms |
1.21 |
1.30 |
4.60 |
16.4 ms |
1.97 |
1.98 |
| Q10 |
8 |
1.83 |
175.4 ms |
1.08 |
1.08 |
5.60 |
41.7 ms |
1.97 |
1.97 |
| Q10 |
32 |
1.87 |
189.3 ms |
1.08 |
1.09 |
7.37 |
43.9 ms |
1.98 |
1.98 |
| Q10 |
64 |
1.87 |
197.6 ms |
1.08 |
1.09 |
7.15 |
44.3 ms |
1.98 |
1.98 |
| Q11 |
8 |
1.50 |
379.0 ms |
1.16 |
1.19 |
7.26 |
324.6 ms |
1.99 |
2.01 |
| Q11 |
32 |
1.60 |
390.6 ms |
1.19 |
1.24 |
10.86 |
348.7 ms |
2.07 |
2.09 |
| Q11 |
64 |
1.61 |
390.3 ms |
1.22 |
1.35 |
10.77 |
347.3 ms |
2.12 |
2.15 |
| Q12 |
8 |
6.51 |
705.8 ms |
1.27 |
1.35 |
3.59 |
10.4 ms |
2.03 |
2.03 |
| Q12 |
32 |
7.48 |
753.3 ms |
1.28 |
1.38 |
3.79 |
11.8 ms |
2.03 |
2.04 |
| Q12 |
64 |
7.40 |
780.8 ms |
1.29 |
1.38 |
3.70 |
12.2 ms |
2.03 |
2.03 |
| Q13 |
8 |
6.00 |
520.7 ms |
1.14 |
1.15 |
15.57 |
752.9 ms |
2.11 |
2.13 |
| Q13 |
32 |
6.10 |
545.7 ms |
1.14 |
1.15 |
15.98 |
756.6 ms |
2.17 |
2.19 |
| Q13 |
64 |
5.94 |
559.0 ms |
1.14 |
1.16 |
15.98 |
765.5 ms |
2.16 |
2.18 |
| mix |
8 |
5.17 |
482.3 ms |
1.12 |
1.22 |
5.20 |
19.7 ms |
2.04 |
2.05 |
| mix |
32 |
5.17 |
511.1 ms |
1.14 |
1.21 |
5.93 |
21.6 ms |
2.05 |
2.05 |
| mix |
64 |
5.15 |
517.5 ms |
1.14 |
1.22 |
5.71 |
22.1 ms |
2.05 |
2.05 |
resources, votable
| class |
c |
dachs-local cores |
CPU s/req |
mem mean GiB |
mem peak GiB |
egernia-local cores |
CPU s/req |
mem mean GiB |
mem peak GiB |
| Q01 |
8 |
2.07 |
118.7 ms |
0.86 |
0.87 |
2.69 |
7.0 ms |
1.90 |
1.90 |
| Q01 |
32 |
2.00 |
130.3 ms |
0.86 |
0.87 |
2.80 |
8.1 ms |
1.90 |
1.90 |
| Q01 |
64 |
1.99 |
134.0 ms |
0.87 |
0.88 |
2.78 |
8.5 ms |
1.90 |
1.90 |
| Q02 |
8 |
5.90 |
540.2 ms |
0.89 |
0.90 |
5.00 |
19.3 ms |
1.90 |
1.90 |
| Q02 |
32 |
5.68 |
561.7 ms |
0.89 |
0.91 |
5.83 |
21.2 ms |
1.90 |
1.91 |
| Q02 |
64 |
5.71 |
577.8 ms |
0.90 |
0.92 |
5.63 |
21.6 ms |
1.91 |
1.91 |
| Q03 |
8 |
2.20 |
188.3 ms |
0.89 |
0.90 |
6.29 |
32.7 ms |
1.90 |
1.90 |
| Q03 |
32 |
2.21 |
202.4 ms |
0.90 |
0.90 |
9.46 |
36.9 ms |
1.90 |
1.91 |
| Q03 |
64 |
2.20 |
205.6 ms |
0.90 |
0.91 |
9.10 |
37.2 ms |
1.91 |
1.92 |
| Q04 |
8 |
1.89 |
161.5 ms |
0.90 |
0.90 |
5.24 |
24.4 ms |
1.91 |
1.92 |
| Q04 |
32 |
1.91 |
176.3 ms |
0.90 |
0.90 |
6.56 |
26.7 ms |
1.90 |
1.91 |
| Q04 |
64 |
1.92 |
179.1 ms |
0.90 |
0.91 |
6.32 |
27.1 ms |
1.86 |
1.88 |
| Q05 |
8 |
6.50 |
719.2 ms |
1.02 |
1.10 |
3.57 |
11.0 ms |
1.82 |
1.85 |
| Q05 |
32 |
7.28 |
752.8 ms |
1.03 |
1.11 |
3.93 |
12.5 ms |
1.82 |
1.82 |
| Q05 |
64 |
7.35 |
781.4 ms |
1.05 |
1.14 |
3.83 |
13.0 ms |
1.82 |
1.83 |
| Q06 |
8 |
6.28 |
714.7 ms |
1.02 |
1.10 |
4.91 |
21.3 ms |
1.83 |
1.83 |
| Q06 |
32 |
6.99 |
750.6 ms |
1.04 |
1.11 |
5.76 |
23.1 ms |
1.83 |
1.83 |
| Q06 |
64 |
7.02 |
784.5 ms |
1.04 |
1.13 |
5.59 |
23.5 ms |
1.84 |
1.85 |
| Q07 |
8 |
6.47 |
761.0 ms |
1.01 |
1.10 |
4.34 |
14.7 ms |
1.83 |
1.83 |
| Q07 |
32 |
7.18 |
797.1 ms |
1.04 |
1.11 |
4.78 |
16.3 ms |
1.83 |
1.84 |
| Q07 |
64 |
7.23 |
830.2 ms |
1.04 |
1.13 |
4.64 |
16.8 ms |
1.83 |
1.84 |
| Q10 |
8 |
1.84 |
174.0 ms |
0.91 |
0.92 |
6.10 |
45.7 ms |
1.83 |
1.84 |
| Q10 |
32 |
1.90 |
188.3 ms |
0.92 |
0.92 |
7.38 |
47.1 ms |
1.85 |
1.86 |
| Q10 |
64 |
1.90 |
197.6 ms |
0.92 |
0.92 |
7.16 |
47.5 ms |
1.88 |
1.88 |
| Q11 |
8 |
1.47 |
355.0 ms |
1.08 |
1.12 |
7.37 |
358.0 ms |
1.90 |
1.92 |
| Q11 |
32 |
1.63 |
368.3 ms |
1.15 |
1.20 |
9.76 |
374.0 ms |
1.97 |
2.00 |
| Q11 |
64 |
1.67 |
367.1 ms |
1.21 |
1.36 |
9.83 |
381.9 ms |
2.04 |
2.10 |
| Q12 |
8 |
6.40 |
715.2 ms |
1.21 |
1.28 |
3.55 |
10.6 ms |
1.94 |
1.94 |
| Q12 |
32 |
7.38 |
750.5 ms |
1.20 |
1.29 |
3.79 |
12.0 ms |
1.95 |
1.95 |
| Q12 |
64 |
7.25 |
778.1 ms |
1.20 |
1.28 |
3.70 |
12.5 ms |
1.95 |
1.95 |
| Q13 |
8 |
5.95 |
520.6 ms |
1.07 |
1.09 |
15.57 |
755.3 ms |
2.04 |
2.06 |
| Q13 |
32 |
6.00 |
548.3 ms |
1.07 |
1.10 |
15.98 |
769.2 ms |
2.12 |
2.14 |
| Q13 |
64 |
6.03 |
571.0 ms |
1.07 |
1.08 |
15.97 |
773.9 ms |
2.12 |
2.15 |
| mix |
8 |
5.24 |
483.3 ms |
0.90 |
0.97 |
5.24 |
20.3 ms |
1.75 |
1.77 |
| mix |
32 |
5.26 |
503.2 ms |
0.91 |
1.02 |
5.95 |
22.3 ms |
1.85 |
1.87 |
| mix |
64 |
5.21 |
520.5 ms |
0.93 |
1.01 |
5.76 |
22.7 ms |
1.89 |
1.91 |
throughput vs CPU cores used (mix)
| format |
c |
target |
API workers |
rps |
cores |
rps per core |
CPU ms/req |
| csv |
8 |
dachs-local |
— |
10.8 |
5.17 |
2.1 |
482.3 |
| csv |
8 |
egernia-local |
2 |
263.9 |
5.20 |
50.8 |
19.7 |
| csv |
32 |
dachs-local |
— |
10.3 |
5.17 |
2.0 |
511.1 |
| csv |
32 |
egernia-local |
2 |
274.5 |
5.93 |
46.3 |
21.6 |
| csv |
64 |
dachs-local |
— |
10.1 |
5.15 |
2.0 |
517.5 |
| csv |
64 |
egernia-local |
2 |
259.0 |
5.71 |
45.3 |
22.1 |
| votable |
8 |
dachs-local |
— |
10.9 |
5.24 |
2.1 |
483.3 |
| votable |
8 |
egernia-local |
2 |
258.1 |
5.24 |
49.2 |
20.3 |
| votable |
32 |
dachs-local |
— |
10.5 |
5.26 |
2.0 |
503.2 |
| votable |
32 |
egernia-local |
2 |
267.7 |
5.95 |
45.0 |
22.3 |
| votable |
64 |
dachs-local |
— |
10.4 |
5.21 |
2.0 |
520.5 |
| votable |
64 |
egernia-local |
2 |
253.8 |
5.76 |
44.0 |
22.7 |
Tier 24
Gates
| target |
TAP |
taplint |
maxrec default |
| dachs-local |
1.1 |
PASS (0 errors) |
20000 |
| egernia-local |
1.1 |
PASS (0 errors) |
10000 |
Agreement gate: 11 classes agree, none disagree.
csv
| class |
c |
dachs-local rps |
dachs-local p95 (s) |
egernia-local rps |
egernia-local p95 (s) |
verdict |
| Q01 |
8 |
17.6 ±0.2 |
0.556 ±0.015 |
625.3 ±200.4 |
0.022 ±0.009 |
egernia-local |
| Q01 |
32 |
15.9 ±0.4 |
2.156 ±0.034 |
671.0 ±6.8 |
0.078 ±0.032 |
egernia-local |
| Q01 |
64 |
15.9 ±0.3 |
4.200 ±0.078 |
639.6 ±0.5 |
0.150 ±0.032 |
egernia-local |
| Q02 |
8 |
11.5 ±0.5 |
0.862 ±0.036 |
299.5 ±70.5 |
0.042 ±0.015 |
egernia-local |
| Q02 |
32 |
10.9 ±0.2 |
3.138 ±0.053 |
489.0 ±62.9 |
0.122 ±0.090 |
egernia-local |
| Q02 |
64 |
11.0 ±0.2 |
6.075 ±0.140 |
491.3 ±3.8 |
0.187 ±0.039 |
egernia-local |
| Q03 |
8 |
12.1 ±0.1 |
0.820 ±0.015 |
214.2 ±5.8 |
0.149 ±0.001 |
egernia-local |
| Q03 |
32 |
11.4 ±0.1 |
2.984 ±0.016 |
434.9 ±8.1 |
0.226 ±0.006 |
egernia-local |
| Q03 |
64 |
11.1 ±0.1 |
5.804 ±0.076 |
437.1 ±1.0 |
0.324 ±0.048 |
egernia-local |
| Q04 |
8 |
12.0 ±0.2 |
0.811 ±0.013 |
261.0 ±26.3 |
0.042 ±0.012 |
egernia-local |
| Q04 |
32 |
11.4 ±0.1 |
2.991 ±0.015 |
457.8 ±14.0 |
0.101 ±0.006 |
egernia-local |
| Q04 |
64 |
11.1 ±0.5 |
5.918 ±0.100 |
449.4 ±2.1 |
0.212 ±0.022 |
egernia-local |
| Q05 |
8 |
9.6 ±0.2 |
1.077 ±0.072 |
424.6 ±38.3 |
0.028 ±0.001 |
egernia-local |
| Q05 |
32 |
10.8 ±0.3 |
3.226 ±0.100 |
603.6 ±1.8 |
0.091 ±0.026 |
egernia-local |
| Q05 |
64 |
10.8 ±0.2 |
6.274 ±0.247 |
567.2 ±10.9 |
0.171 ±0.073 |
egernia-local |
| Q06 |
8 |
9.4 ±0.0 |
1.094 ±0.055 |
301.1 ±53.3 |
0.039 ±0.016 |
egernia-local |
| Q06 |
32 |
10.3 ±0.2 |
3.354 ±0.174 |
464.1 ±9.9 |
0.112 ±0.034 |
egernia-local |
| Q06 |
64 |
10.0 ±0.7 |
6.545 ±0.195 |
453.7 ±3.0 |
0.204 ±0.028 |
egernia-local |
| Q07 |
8 |
9.0 ±0.3 |
1.105 ±0.053 |
408.6 ±20.8 |
0.028 ±0.002 |
egernia-local |
| Q07 |
32 |
9.8 ±0.2 |
3.506 ±0.166 |
542.0 ±48.7 |
0.105 ±0.029 |
egernia-local |
| Q07 |
64 |
10.0 ±0.3 |
6.779 ±0.189 |
531.6 ±7.3 |
0.205 ±0.048 |
egernia-local |
| Q10 |
8 |
10.6 ±0.1 |
0.925 ±0.011 |
170.7 ±9.1 |
0.062 ±0.001 |
egernia-local |
| Q10 |
32 |
10.2 ±0.2 |
3.357 ±0.025 |
287.0 ±29.9 |
0.162 ±0.033 |
egernia-local |
| Q10 |
64 |
10.0 ±0.5 |
6.623 ±0.049 |
290.1 ±0.3 |
0.302 ±0.059 |
egernia-local |
| Q11 |
8 |
3.9 ±0.2 |
2.674 ±0.620 |
27.1 ±0.5 |
0.364 ±0.006 |
egernia-local |
| Q11 |
32 |
4.0 ±0.4 |
12.522 ±1.056 |
37.9 ±3.9 |
1.509 ±0.663 |
egernia-local |
| Q11 |
64 |
4.1 ±0.2 |
24.859 ±5.980 |
38.2 ±5.7 |
2.738 ±1.163 |
egernia-local |
| Q12 |
8 |
9.6 ±0.3 |
1.075 ±0.075 |
488.0 ±57.4 |
0.024 ±0.007 |
egernia-local |
| Q12 |
32 |
10.8 ±0.2 |
3.269 ±0.154 |
614.1 ±3.3 |
0.078 ±0.015 |
egernia-local |
| Q12 |
64 |
10.8 ±0.3 |
6.244 ±0.084 |
579.2 ±4.5 |
0.169 ±0.055 |
egernia-local |
| Q13 |
8 |
12.2 ±0.5 |
0.935 ±0.032 |
29.6 ±0.3 |
0.349 ±0.002 |
egernia-local |
| Q13 |
32 |
11.8 ±0.4 |
2.986 ±0.110 |
31.9 ±0.3 |
1.467 ±0.072 |
egernia-local |
| Q13 |
64 |
11.8 ±0.1 |
5.739 ±0.038 |
32.0 ±0.1 |
2.868 ±0.653 |
egernia-local |
| mix |
8 |
11.3 ±0.3 |
1.128 ±0.042 |
306.1 ±42.7 |
0.046 ±0.008 |
egernia-local |
| mix |
32 |
10.8 ±0.2 |
3.446 ±0.085 |
497.7 ±11.8 |
0.105 ±0.012 |
egernia-local |
| mix |
64 |
10.8 ±0.0 |
6.459 ±0.112 |
477.7 ±17.1 |
0.205 ±0.016 |
egernia-local |
votable
| class |
c |
dachs-local rps |
dachs-local p95 (s) |
egernia-local rps |
egernia-local p95 (s) |
verdict |
| Q01 |
8 |
17.7 ±0.4 |
0.555 ±0.026 |
653.4 ±195.8 |
0.019 ±0.012 |
egernia-local |
| Q01 |
32 |
15.6 ±0.1 |
2.181 ±0.038 |
669.5 ±8.2 |
0.074 ±0.023 |
egernia-local |
| Q01 |
64 |
15.4 ±0.5 |
4.328 ±0.029 |
632.9 ±2.3 |
0.146 ±0.040 |
egernia-local |
| Q02 |
8 |
11.4 ±0.2 |
0.873 ±0.027 |
317.1 ±50.4 |
0.036 ±0.006 |
egernia-local |
| Q02 |
32 |
10.9 ±0.1 |
3.165 ±0.052 |
498.9 ±14.0 |
0.093 ±0.007 |
egernia-local |
| Q02 |
64 |
11.0 ±0.1 |
6.139 ±0.035 |
481.6 ±6.0 |
0.212 ±0.065 |
egernia-local |
| Q03 |
8 |
11.9 ±0.1 |
0.826 ±0.020 |
208.2 ±8.9 |
0.149 ±0.001 |
egernia-local |
| Q03 |
32 |
11.2 ±0.1 |
3.069 ±0.029 |
427.3 ±11.9 |
0.226 ±0.001 |
egernia-local |
| Q03 |
64 |
11.3 ±0.1 |
5.927 ±0.112 |
426.0 ±13.3 |
0.327 ±0.026 |
egernia-local |
| Q04 |
8 |
11.9 ±0.2 |
0.815 ±0.024 |
238.4 ±66.3 |
0.046 ±0.020 |
egernia-local |
| Q04 |
32 |
11.2 ±0.3 |
3.048 ±0.090 |
435.3 ±9.8 |
0.104 ±0.020 |
egernia-local |
| Q04 |
64 |
11.1 ±0.3 |
5.956 ±0.127 |
423.3 ±3.1 |
0.226 ±0.036 |
egernia-local |
| Q05 |
8 |
9.5 ±0.4 |
1.057 ±0.074 |
458.8 ±16.0 |
0.027 ±0.006 |
egernia-local |
| Q05 |
32 |
10.5 ±0.2 |
3.312 ±0.108 |
588.3 ±19.1 |
0.085 ±0.010 |
egernia-local |
| Q05 |
64 |
10.4 ±0.2 |
6.422 ±0.150 |
557.6 ±2.4 |
0.177 ±0.073 |
egernia-local |
| Q06 |
8 |
9.3 ±0.3 |
1.081 ±0.024 |
282.6 ±91.1 |
0.041 ±0.018 |
egernia-local |
| Q06 |
32 |
10.1 ±0.1 |
3.471 ±0.081 |
428.0 ±69.9 |
0.116 ±0.024 |
egernia-local |
| Q06 |
64 |
9.9 ±0.4 |
7.084 ±1.917 |
439.1 ±8.7 |
0.244 ±0.187 |
egernia-local |
| Q07 |
8 |
8.9 ±0.1 |
1.132 ±0.021 |
386.3 ±36.4 |
0.032 ±0.007 |
egernia-local |
| Q07 |
32 |
9.7 ±0.3 |
3.567 ±0.188 |
542.8 ±10.8 |
0.103 ±0.057 |
egernia-local |
| Q07 |
64 |
9.9 ±0.1 |
6.853 ±0.165 |
517.7 ±2.5 |
0.190 ±0.025 |
egernia-local |
| Q10 |
8 |
10.7 ±0.2 |
0.919 ±0.026 |
144.1 ±24.8 |
0.075 ±0.019 |
egernia-local |
| Q10 |
32 |
10.3 ±0.1 |
3.340 ±0.071 |
265.0 ±10.7 |
0.189 ±0.021 |
egernia-local |
| Q10 |
64 |
9.9 ±0.5 |
7.204 ±3.094 |
269.3 ±1.1 |
0.322 ±0.015 |
egernia-local |
| Q11 |
8 |
4.3 ±0.1 |
2.321 ±0.098 |
24.1 ±0.2 |
0.407 ±0.012 |
egernia-local |
| Q11 |
32 |
4.5 ±0.1 |
11.148 ±2.228 |
32.2 ±2.7 |
1.616 ±0.425 |
egernia-local |
| Q11 |
64 |
4.5 ±0.1 |
21.936 ±5.013 |
31.1 ±4.0 |
3.282 ±0.630 |
egernia-local |
| Q12 |
8 |
9.5 ±0.1 |
1.070 ±0.026 |
455.5 ±210.8 |
0.025 ±0.009 |
egernia-local |
| Q12 |
32 |
10.5 ±0.5 |
3.326 ±0.122 |
599.3 ±15.9 |
0.082 ±0.012 |
egernia-local |
| Q12 |
64 |
10.5 ±0.5 |
6.337 ±0.125 |
566.8 ±6.8 |
0.158 ±0.037 |
egernia-local |
| Q13 |
8 |
12.0 ±0.2 |
0.922 ±0.021 |
29.4 ±0.3 |
0.351 ±0.004 |
egernia-local |
| Q13 |
32 |
11.7 ±0.2 |
3.008 ±0.062 |
31.3 ±0.1 |
1.474 ±0.038 |
egernia-local |
| Q13 |
64 |
11.7 ±0.4 |
5.781 ±0.028 |
31.1 ±0.3 |
2.916 ±0.230 |
egernia-local |
| mix |
8 |
11.1 ±1.3 |
1.147 ±0.041 |
297.7 ±43.9 |
0.048 ±0.005 |
egernia-local |
| mix |
32 |
10.9 ±0.3 |
3.414 ±0.108 |
485.5 ±21.3 |
0.117 ±0.039 |
egernia-local |
| mix |
64 |
10.9 ±0.1 |
6.312 ±0.048 |
467.0 ±3.9 |
0.225 ±0.018 |
egernia-local |
resources, csv
| class |
c |
dachs-local cores |
CPU s/req |
mem mean GiB |
mem peak GiB |
egernia-local cores |
CPU s/req |
mem mean GiB |
mem peak GiB |
| Q01 |
8 |
2.05 |
116.5 ms |
1.05 |
1.05 |
3.97 |
6.4 ms |
2.55 |
2.55 |
| Q01 |
32 |
1.99 |
126.4 ms |
1.05 |
1.06 |
5.42 |
8.1 ms |
2.55 |
2.55 |
| Q01 |
64 |
1.99 |
128.9 ms |
1.05 |
1.06 |
5.42 |
8.5 ms |
2.48 |
2.53 |
| Q02 |
8 |
6.08 |
530.0 ms |
1.06 |
1.07 |
5.39 |
18.0 ms |
2.42 |
2.47 |
| Q02 |
32 |
5.87 |
546.8 ms |
1.06 |
1.09 |
10.05 |
20.5 ms |
2.37 |
2.39 |
| Q02 |
64 |
5.88 |
562.0 ms |
1.06 |
1.08 |
10.65 |
21.7 ms |
2.37 |
2.38 |
| Q03 |
8 |
2.24 |
186.5 ms |
1.06 |
1.06 |
6.69 |
31.3 ms |
2.39 |
2.40 |
| Q03 |
32 |
2.24 |
196.7 ms |
1.06 |
1.07 |
16.29 |
37.5 ms |
2.40 |
2.40 |
| Q03 |
64 |
2.23 |
204.0 ms |
1.06 |
1.08 |
17.00 |
38.9 ms |
2.40 |
2.41 |
| Q04 |
8 |
1.91 |
159.1 ms |
1.06 |
1.07 |
5.90 |
22.6 ms |
2.40 |
2.41 |
| Q04 |
32 |
1.94 |
172.3 ms |
1.06 |
1.07 |
11.78 |
25.7 ms |
2.41 |
2.42 |
| Q04 |
64 |
1.93 |
177.0 ms |
1.07 |
1.07 |
12.02 |
26.8 ms |
2.41 |
2.41 |
| Q05 |
8 |
6.55 |
688.8 ms |
1.19 |
1.27 |
4.46 |
10.5 ms |
2.43 |
2.44 |
| Q05 |
32 |
7.66 |
727.3 ms |
1.21 |
1.30 |
7.46 |
12.4 ms |
2.43 |
2.44 |
| Q05 |
64 |
7.66 |
745.6 ms |
1.21 |
1.30 |
7.38 |
13.0 ms |
2.43 |
2.44 |
| Q06 |
8 |
6.41 |
690.3 ms |
1.20 |
1.27 |
5.95 |
19.8 ms |
2.44 |
2.44 |
| Q06 |
32 |
7.31 |
723.0 ms |
1.21 |
1.31 |
10.48 |
22.6 ms |
2.42 |
2.43 |
| Q06 |
64 |
7.26 |
747.0 ms |
1.20 |
1.27 |
10.60 |
23.4 ms |
2.39 |
2.40 |
| Q07 |
8 |
6.58 |
734.8 ms |
1.22 |
1.27 |
5.66 |
13.9 ms |
2.39 |
2.40 |
| Q07 |
32 |
7.44 |
768.1 ms |
1.23 |
1.30 |
8.63 |
15.9 ms |
2.38 |
2.38 |
| Q07 |
64 |
7.45 |
798.0 ms |
1.22 |
1.32 |
8.93 |
16.8 ms |
2.38 |
2.40 |
| Q10 |
8 |
1.85 |
175.0 ms |
1.08 |
1.08 |
6.86 |
40.2 ms |
2.38 |
2.38 |
| Q10 |
32 |
1.90 |
190.5 ms |
1.09 |
1.09 |
13.21 |
46.0 ms |
2.39 |
2.39 |
| Q10 |
64 |
1.89 |
197.9 ms |
1.09 |
1.10 |
13.51 |
46.6 ms |
2.40 |
2.41 |
| Q11 |
8 |
1.49 |
383.3 ms |
1.17 |
1.20 |
8.39 |
310.1 ms |
2.41 |
2.41 |
| Q11 |
32 |
1.60 |
396.4 ms |
1.21 |
1.24 |
13.51 |
357.2 ms |
2.47 |
2.50 |
| Q11 |
64 |
1.63 |
415.6 ms |
1.24 |
1.32 |
13.85 |
363.8 ms |
2.54 |
2.59 |
| Q12 |
8 |
6.58 |
687.0 ms |
1.27 |
1.36 |
4.82 |
9.9 ms |
2.44 |
2.45 |
| Q12 |
32 |
7.66 |
725.1 ms |
1.29 |
1.38 |
7.26 |
11.8 ms |
2.44 |
2.44 |
| Q12 |
64 |
7.62 |
748.7 ms |
1.29 |
1.37 |
7.18 |
12.4 ms |
2.44 |
2.44 |
| Q13 |
8 |
6.06 |
501.9 ms |
1.14 |
1.15 |
21.39 |
723.3 ms |
2.54 |
2.55 |
| Q13 |
32 |
6.22 |
532.3 ms |
1.14 |
1.16 |
23.91 |
751.3 ms |
2.66 |
2.68 |
| Q13 |
64 |
6.18 |
541.0 ms |
1.14 |
1.15 |
23.92 |
751.6 ms |
2.67 |
2.69 |
| mix |
8 |
5.23 |
469.1 ms |
1.11 |
1.17 |
5.82 |
19.1 ms |
2.51 |
2.55 |
| mix |
32 |
5.28 |
493.4 ms |
1.11 |
1.18 |
11.07 |
22.3 ms |
2.55 |
2.56 |
| mix |
64 |
5.26 |
505.0 ms |
1.13 |
1.23 |
10.99 |
23.0 ms |
2.55 |
2.56 |
resources, votable
| class |
c |
dachs-local cores |
CPU s/req |
mem mean GiB |
mem peak GiB |
egernia-local cores |
CPU s/req |
mem mean GiB |
mem peak GiB |
| Q01 |
8 |
2.11 |
119.4 ms |
0.81 |
0.82 |
4.22 |
6.5 ms |
2.36 |
2.36 |
| Q01 |
32 |
2.03 |
131.9 ms |
0.82 |
0.83 |
5.46 |
8.2 ms |
2.36 |
2.37 |
| Q01 |
64 |
2.02 |
135.1 ms |
0.83 |
0.84 |
5.44 |
8.6 ms |
2.37 |
2.37 |
| Q02 |
8 |
6.01 |
528.7 ms |
0.85 |
0.87 |
5.96 |
18.8 ms |
2.37 |
2.38 |
| Q02 |
32 |
5.83 |
547.8 ms |
0.85 |
0.87 |
10.87 |
21.8 ms |
2.38 |
2.39 |
| Q02 |
64 |
5.83 |
560.2 ms |
0.86 |
0.87 |
10.88 |
22.6 ms |
2.38 |
2.39 |
| Q03 |
8 |
2.25 |
189.0 ms |
0.85 |
0.86 |
6.62 |
31.8 ms |
2.38 |
2.39 |
| Q03 |
32 |
2.24 |
204.0 ms |
0.86 |
0.86 |
16.24 |
38.1 ms |
2.38 |
2.39 |
| Q03 |
64 |
2.24 |
209.4 ms |
0.86 |
0.87 |
16.71 |
39.3 ms |
2.38 |
2.39 |
| Q04 |
8 |
1.92 |
161.4 ms |
0.86 |
0.86 |
5.67 |
23.8 ms |
2.38 |
2.39 |
| Q04 |
32 |
1.94 |
177.2 ms |
0.86 |
0.87 |
11.82 |
27.2 ms |
2.32 |
2.38 |
| Q04 |
64 |
1.93 |
178.1 ms |
0.86 |
0.87 |
11.89 |
28.1 ms |
2.24 |
2.28 |
| Q05 |
8 |
6.53 |
695.0 ms |
0.99 |
1.06 |
4.88 |
10.6 ms |
2.19 |
2.20 |
| Q05 |
32 |
7.49 |
728.3 ms |
1.00 |
1.08 |
7.44 |
12.7 ms |
2.19 |
2.19 |
| Q05 |
64 |
7.48 |
751.4 ms |
1.00 |
1.09 |
7.42 |
13.3 ms |
2.19 |
2.20 |
| Q06 |
8 |
6.37 |
688.6 ms |
0.98 |
1.06 |
5.86 |
20.8 ms |
2.21 |
2.22 |
| Q06 |
32 |
7.21 |
726.6 ms |
1.00 |
1.07 |
10.07 |
23.5 ms |
2.22 |
2.23 |
| Q06 |
64 |
7.15 |
753.2 ms |
1.00 |
1.12 |
10.71 |
24.4 ms |
2.23 |
2.24 |
| Q07 |
8 |
6.48 |
735.3 ms |
1.00 |
1.06 |
5.51 |
14.3 ms |
2.22 |
2.24 |
| Q07 |
32 |
7.32 |
771.0 ms |
1.01 |
1.10 |
8.98 |
16.5 ms |
2.22 |
2.23 |
| Q07 |
64 |
7.38 |
799.6 ms |
1.01 |
1.08 |
8.98 |
17.3 ms |
2.23 |
2.24 |
| Q10 |
8 |
1.86 |
174.2 ms |
0.87 |
0.87 |
6.32 |
43.9 ms |
2.23 |
2.24 |
| Q10 |
32 |
1.93 |
189.7 ms |
0.88 |
0.88 |
13.30 |
50.2 ms |
2.25 |
2.26 |
| Q10 |
64 |
1.86 |
193.1 ms |
0.88 |
0.89 |
13.60 |
50.5 ms |
2.28 |
2.30 |
| Q11 |
8 |
1.54 |
357.0 ms |
1.03 |
1.08 |
8.26 |
343.6 ms |
2.29 |
2.30 |
| Q11 |
32 |
1.64 |
362.8 ms |
1.10 |
1.15 |
12.29 |
382.3 ms |
2.35 |
2.39 |
| Q11 |
64 |
1.64 |
365.7 ms |
1.18 |
1.37 |
12.27 |
395.7 ms |
2.40 |
2.46 |
| Q12 |
8 |
6.54 |
694.8 ms |
1.17 |
1.26 |
4.63 |
10.2 ms |
2.32 |
2.33 |
| Q12 |
32 |
7.53 |
727.3 ms |
1.18 |
1.25 |
7.25 |
12.1 ms |
2.32 |
2.32 |
| Q12 |
64 |
7.52 |
749.7 ms |
1.18 |
1.26 |
7.19 |
12.7 ms |
2.32 |
2.33 |
| Q13 |
8 |
6.06 |
507.4 ms |
1.05 |
1.07 |
21.36 |
727.9 ms |
2.44 |
2.45 |
| Q13 |
32 |
6.16 |
531.6 ms |
1.05 |
1.07 |
23.91 |
765.7 ms |
2.61 |
2.65 |
| Q13 |
64 |
6.14 |
549.8 ms |
1.05 |
1.07 |
23.92 |
771.4 ms |
2.65 |
2.68 |
| mix |
8 |
5.19 |
471.7 ms |
0.87 |
0.97 |
5.86 |
19.7 ms |
2.06 |
2.09 |
| mix |
32 |
5.32 |
494.4 ms |
0.88 |
0.94 |
11.13 |
23.0 ms |
2.30 |
2.32 |
| mix |
64 |
5.34 |
504.5 ms |
0.88 |
0.94 |
11.06 |
23.7 ms |
2.36 |
2.38 |
throughput vs CPU cores used (mix)
| format |
c |
target |
API workers |
rps |
cores |
rps per core |
CPU ms/req |
| csv |
8 |
dachs-local |
— |
11.3 |
5.23 |
2.2 |
469.1 |
| csv |
8 |
egernia-local |
4 |
306.1 |
5.82 |
52.6 |
19.1 |
| csv |
32 |
dachs-local |
— |
10.8 |
5.28 |
2.0 |
493.4 |
| csv |
32 |
egernia-local |
4 |
497.7 |
11.07 |
44.9 |
22.3 |
| csv |
64 |
dachs-local |
— |
10.8 |
5.26 |
2.0 |
505.0 |
| csv |
64 |
egernia-local |
4 |
477.7 |
10.99 |
43.5 |
23.0 |
| votable |
8 |
dachs-local |
— |
11.1 |
5.19 |
2.1 |
471.7 |
| votable |
8 |
egernia-local |
4 |
297.7 |
5.86 |
50.8 |
19.7 |
| votable |
32 |
dachs-local |
— |
10.9 |
5.32 |
2.0 |
494.4 |
| votable |
32 |
egernia-local |
4 |
485.5 |
11.13 |
43.6 |
23.0 |
| votable |
64 |
dachs-local |
— |
10.9 |
5.34 |
2.0 |
504.5 |
| votable |
64 |
egernia-local |
4 |
467.0 |
11.06 |
42.2 |
23.7 |
Claims
This run may claim the relative behaviour of these versions, on this
hardware, on this corpus, as deployed by their own documentation,
under the recorded resource pins — nothing else. A tie verdict is
pre-registered: overlapping 95% intervals, or under 10% apart
in throughput. Classes a gate excluded are absent, not hidden.
Threats to validity
- The corpus is generated by egernia's own seeder; its distributions
may flatter egernia's index choices.
- The query classes descend from egernia's own performance history.
- The team operates egernia expertly and DaCHS from its documentation.
- Single hardware, single run window; versions frozen at the recorded
digests.
- Within a tier the servers were measured one after the other, not
interleaved: host drift over a tier's hours lands on one server.
The order alternates between tiers (recorded in
pins/).
Reproduce with
scripts/export_obscore_snapshot.sh benchmarks/tap-compare/corpus
benchmarks/tap-compare/scaling/run.sh
Environment: see environment.json (git 5f145831, seed 424242, corpus 9f9da00f45f1…).
Run notes
- Protocol:
benchmarks/tap-compare/scaling/PROTOCOL.md, pre-registered
at tag tap-compare-scaling-prereg-v1 (5f14583, PR #148) before any
measurement. Tiers 8 / 16 / 24 CPUs and GiB per server; egernia with
1 / 2 / 4 API workers and PostgreSQL sized by the PR #146 rule; DaCHS
with the same limits, a cpuset, and its Debian PostgreSQL sized to the
container by the same rule (pins/). Grid per server-tier: 2 formats ×
12 classes × c ∈ {8, 32, 64} × 3 repetitions, 20 s warm-up + 60 s
windows; 1,296 rungs in all, none invalid, no generator guard trip (peak
41% of one core), no rung with more than 1% errors — egernia shed no
load at c=64 at any tier.
- Timeline (UTC): 2026-09-05 07:39 start; tier 8 egernia 07:41–12:41,
DaCHS 12:42–17:57; tier 16 DaCHS 17:59–23:11, egernia 23:12–04:13;
tier 24 egernia 04:16–09:19, DaCHS 09:20–14:31 (2026-09-06); 30.9 h in
all against the 30.3 h estimate. Both stacks returned to the parity pins
at the end. Gates passed at every tier (taplint 0 errors both, 11/11
classes agree).
- Versions: egernia images built from
main 8fec0e7 (the second parity
run's code; main 5eb148f differs only in docs); DaCHS image unchanged
from the parity runs. Harness commits during the run (review fixes on PR
#148, none touching the measurement path): the DaCHS tier-8 block onward
ran under 5c8732f, tier 16 onward under 6acbcdd — recorded as resumed
entries in environment.json.
- H3 (sanity) holds: egernia's 24 tier-8 c=8 cells are within ±1.6% of
the parity run's (20 of 24 with overlapping 95% intervals; the rest differ
by 1.3–1.6% with sub-1% intervals on both sides). DaCHS's tier-8 cells are
not a replication (cpuset and PostgreSQL drop-in, see the protocol): its
mixed workload at c=8 reads 9.4 rps against 9.9 in the parity run, Q13 at
c=8 9.9 against 10.0 — the fairer PostgreSQL did not move DaCHS.
- H2 holds: egernia's mixed-workload throughput at c=64 is 130.3 →
259.0 → 477.7 rps (CSV; VOTable 127.4 → 253.8 → 467.0) across the tiers —
×2.0 and ×3.7 on ×2 and ×3 the resources — with non-overlapping intervals,
while p95 falls 0.63 → 0.33 → 0.21 s. CPU cores used at c=64: 2.9 → 5.7
→ 11.0, at a flat 22–24 ms of CPU per request; the API's share is what
grows (1 → 2 → 4 workers). At c=8 the closed loop, not the server, is the
limit from tier 16 on (264 → 306 rps with 5.2–5.8 cores busy).
- H1 does not hold as stated, but the shape does: DaCHS is not flat by
the tie rule — 42 of 72 cells are faster at tier 16 than at tier 8 and 41
of 72 at tier 24 (never slower), by 10–25% (mixed workload at c=64: 8.8 →
10.1 → 10.8 rps; Q13 c=8: 9.9 → 11.6 → 12.2). Its CPU use, however, stays
at 4.8–5.3 cores whatever the tier, at 470–560 ms of CPU per request,
and tier 24 is a tie with tier 16 in every cell: DaCHS uses none of the
additional cores, and the modest gain from 8 to 16 is not CPU.
- Verdicts: tier 8 egernia 66 / ties 6 (Q13 at every concurrency, both
formats, as in the parity run); tier 16 egernia 72 / 0; tier 24 egernia
72 / 0 — Q13, the one class DaCHS matched with one API worker, is
egernia's from two workers on (21 against 11 rps at c=64, 32 against 12 at
tier 24). Per-server scaling: egernia is faster than its own tier-8 cell
in 72 of 72 cells at both tiers.
- Resource telemetry (Amendment 1) started 2026-09-05T08:47:02Z, 66 min
into the tier-8 egernia block: 48 of its 216 rungs have no resource data
(
— in the tables; 1,248 of 1,296 rungs covered, resources.csv). API
worker counts come from the steady python process count (1 / 4 / 6 =
workers + supervisor + resource tracker above one worker). A second
sampler instance ran for two minutes at 08:48–08:50Z and 44 samples of
the Prometheus container were recorded before it was excluded; the join
sorts by time and ignores unknown containers, so neither affects a cell.
Memory (server, mean/peak over a rung): egernia 1.5 / 2.0 / 2.6 GiB peak
at tiers 8 / 16 / 24 (CSV mix), DaCHS 1.2 GiB at every tier.
- Order and neighbours: tier 8 egernia first, tier 16 DaCHS first, tier
24 egernia first (
pins/*.txt record the order). Nothing else ran on the
pinned cores; the idle toolkit containers and an egernia Prometheus shared
the host. Generators: 6 processes on cores 24–29.