rolling view · 11 complete · 7 partial · 0 valid negative / 25 lanes

Antfly Circus — Latest

The newest reviewed result available for each Antfly benchmark lane. Sections may use different Antfly releases or main commits; every evidence block names its exact Antfly subject.

Reading contract

Latest selects the newest reviewed outcome available for each lane. Antfly versions, machines, dates, and protocols may differ; every evidence block names its exact subject.

I

3 of 3 lanes measured

VectorDBBench

Qualified vector search quality, throughput, serial latency, serving demand, and database volume across operating points.

i

vector-vdbbench-50k

complete

50K

Antfly main-09b78df97, stripped ReleaseFast, passed three fresh 50K lifecycles at a 30-client ceiling with zero request errors: recall 0.963 and mean peak throughput 834.0 QPS.

Methodology scope · protocol · interpretation

Standard vector publication protocol

Each of three fresh Linux ARM64 lifecycles builds one index, selects its search-time setting using only 200 deterministic calibration queries, and measures the disjoint 800-query publication holdout without rebuilding. The complete publication sweep uses 1, 5, 10, 20, and 30 clients for 30 seconds per point, plus a serial pass. Every lifecycle must complete the declared sweep with zero request errors. Results do not establish capacity above 30 clients.

Throughput and latency are arithmetic means across the three lifecycles; retained per-concurrency observations include trial values and ranges. Database-service memory demand is sampled cgroup anon + shmem from before indexing through publication, excluding the benchmark client. Final database volume is checksum-verified post-stop allocated bytes across the complete declared volume, with three-trial mean and range.

Historical peer observations retain their original versions and dates. They are reference measurements, not fresh matched comparisons; no peer database was rerun.

Run evidence parameters · variation · provenance

Benchmark parameters

{"concurrency_duration_seconds":30,"concurrency_schedule":[1,5,10,20,30],"execution_environment":{"container_runtime":"podman podman version 6.1.1","controller_platform":"darwin-arm64","processor":"Apple M4 Max","service_platform":"linux-arm64","vm_cpus":10,"vm_memory_bytes":29347610624,"vm_memory_gib":27.3},"lifecycle_search_values":[0.45,0.45,0.45],"query_count":800,"query_partition_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","search_parameter":"search_effort"}

Trial variation

[{"engine":"Antfly","ranges":{"demand_working_set":{"maximum":1444.2,"mean":1348.8,"minimum":1290.7,"unit":"MB"},"final_database_volume":{"maximum":368.443392,"mean":368.050176,"minimum":367.521792,"unit":"MB"},"p99_at_30_concurrent":{"maximum":88.2,"mean":86.1,"minimum":84.3,"unit":"ms"}},"workload":"1536d-50K"},{"engine":"Chroma","ranges":{"demand_working_set":{"maximum":466.7,"mean":463.3,"minimum":460.9,"unit":"MB"},"final_database_volume":{"maximum":332.488704,"mean":332.485973,"minimum":332.480512,"unit":"MB"},"p99_at_30_concurrent":{"maximum":179,"mean":177.6,"minimum":175.3,"unit":"ms"}},"workload":"1536d-50K"},{"engine":"Elasticsearch","ranges":{"demand_working_set":{"maximum":1952.7,"mean":1941,"minimum":1934.8,"unit":"MB"},"final_database_volume":{"maximum":312.082432,"mean":312.067413,"minimum":312.049664,"unit":"MB"},"p99_at_30_concurrent":{"maximum":15.1,"mean":14.467,"minimum":14,"unit":"ms"}},"workload":"1536d-50K"},{"engine":"Milvus 2.6.22","ranges":{"demand_working_set":{"maximum":2766.6,"mean":2666.2,"minimum":2563.6,"unit":"MB"},"final_database_volume":{"maximum":2393.47712,"mean":2393.459371,"minimum":2393.432064,"unit":"MB"},"p99_at_30_concurrent":{"maximum":11.4,"mean":11.233,"minimum":11.1,"unit":"ms"}},"workload":"1536d-50K"},{"engine":"pgvector","ranges":{"demand_working_set":{"maximum":2303.8,"mean":2303.7,"minimum":2303.7,"unit":"MB"},"final_database_volume":{"maximum":1523.970048,"mean":1523.967317,"minimum":1523.965952,"unit":"MB"},"p99_at_30_concurrent":{"maximum":33.1,"mean":32.033,"minimum":31.4,"unit":"ms"}},"workload":"1536d-50K"},{"engine":"Weaviate","ranges":{"demand_working_set":{"maximum":977.9,"mean":953.8,"minimum":936.6,"unit":"MB"},"final_database_volume":{"maximum":391.55712,"mean":391.514795,"minimum":391.491584,"unit":"MB"},"p99_at_30_concurrent":{"maximum":89.6,"mean":86.967,"minimum":85.3,"unit":"ms"}},"workload":"1536d-50K"},{"engine":"Milvus 3.0.0","ranges":{"demand_working_set":{"maximum":2949.6,"mean":2819,"minimum":2719.7,"unit":"MB"},"final_database_volume":{"maximum":2489.167872,"mean":2489.156949,"minimum":2489.143296,"unit":"MB"},"p99_at_30_concurrent":{"maximum":12,"mean":11.667,"minimum":11.4,"unit":"ms"}},"workload":"1536d-50K"}]

Peer versions

  • Chroma1.5.9
  • Elasticsearch9.5.2
  • Milvus 2.6.222.6.22
  • pgvector0.8.6 (PostgreSQL 16)
  • Weaviate1.39.2
  • Milvus 3.0.03.0.0

Evidence digests

Receipt
488df681970e7beba9a2fb9d6b81d7d0a690a82c041568f5ff12aa4bb559d7bd
Aggregate
0349cf53351b72af9d3e6b8b1296b2a68987060cf4e186f71d105573eeafd065
Provenance
0349cf53351b72af9d3e6b8b1296b2a68987060cf4e186f71d105573eeafd065
Harness commit
82c699bb7a687b65efc691ec329368494ce8499e

Peer cohort evidence · 1536d-50K

Completed
Fresh lifecycles
18
Peer variants
6
Receipt
782e8e470765fae9914945e67c9da3f3e82a1b38571ebe6e5940228a8248601c
Aggregate
0eb49aba01e15e065ec68b1667beb2c41a580cde5dab2cb928b6f8c01c16daf4
Provenance
700d49bf35039da97e9b5366d4a4e6ec4c417fdfdb5fd720b980349a538d68c3
Selected measurement
Completed
Antfly
main-09b78df97 ·
Runtime
1h 34m
Platform
linux · arm64
Machine
Apple M4 Max
Build
ReleaseFast

Peer cohort · 1536d-50K

Completed
Variants
6 independently executed peers
Lifecycles
18 fresh
Compatibility
Historical reference · not a matched runtime

Peak throughput

Antfly main-09b78df97 (09b78df9, ReleaseFast/stripped) · linux-arm64 · 1536d-50K · three fresh lifecycles · 1/5/10/20/30 clients · 30 s/point · partition seed antfly-circus-vdbbench-v1 · Higher is better · Apple M4 Max · podman podman version 6.1.1 · 10 VM CPUs / 27.3 GiB · Historical peers, not a matched run

Serial query p95

Antfly main-09b78df97 (09b78df9, ReleaseFast/stripped) · linux-arm64 · 1536d-50K · three fresh lifecycles · 1/5/10/20/30 clients · 30 s/point · partition seed antfly-circus-vdbbench-v1 · Lower is better · Apple M4 Max · podman podman version 6.1.1 · 10 VM CPUs / 27.3 GiB · Historical peers, not a matched run

Demand working set

Antfly main-09b78df97 (09b78df9, ReleaseFast/stripped) · linux-arm64 · 1536d-50K · three fresh lifecycles · 1/5/10/20/30 clients · 30 s/point · partition seed antfly-circus-vdbbench-v1 · Lower is better · Apple M4 Max · podman podman version 6.1.1 · 10 VM CPUs / 27.3 GiB · Historical peers, not a matched run

Final database volume

Antfly main-09b78df97 (09b78df9, ReleaseFast/stripped) · linux-arm64 · 1536d-50K · three fresh lifecycles · 1/5/10/20/30 clients · 30 s/point · partition seed antfly-circus-vdbbench-v1 · Lower is better · Apple M4 Max · podman podman version 6.1.1 · 10 VM CPUs / 27.3 GiB · Historical peers, not a matched run

Performance, quality, and resource evidence

Antfly main-09b78df97 · 09b78df9

EngineWorkloadRecallnDCGPeak QPS queries/sp95 msDemand working set MBCache-inclusive peak MBFinal database volume MBTrials
Antfly1536d-50K0.96300.9670834.08.8671,348.8 MB1,785.2 MB368.1 MB3
Chroma1536d-50K0.98700.9890180.98.067463.3 MB812.9 MB332.5 MB3
Elasticsearch1536d-50K0.95600.96404,434.62.0331,941.0 MB4,385.1 MB312.1 MB3
Milvus 2.6.221536d-50K0.96300.97005,293.11.6002,666.2 MB5,426.1 MB2,393.5 MB3
pgvector1536d-50K0.96900.97502,721.04.1672,303.7 MB3,533.5 MB1,524.0 MB3
Weaviate1536d-50K0.95500.96301,008.86.300953.8 MB1,511.3 MB391.5 MB3
Milvus 3.0.01536d-50K0.96300.97005,019.71.7002,819.0 MB5,557.7 MB2,489.2 MB3
ii

vector-vdbbench-1m

complete

1M

Antfly main-09b78df97, stripped ReleaseFast, passed three fresh 1M lifecycles at a 30-client ceiling with zero request errors: recall 0.963 and mean peak throughput 591.9 QPS.

Methodology scope · protocol · interpretation

Standard vector publication protocol

Each of three fresh Linux ARM64 lifecycles builds one index, selects its search-time setting using only 200 deterministic calibration queries, and measures the disjoint 800-query publication holdout without rebuilding. The complete publication sweep uses 1, 5, 10, 20, and 30 clients for 30 seconds per point, plus a serial pass. Every lifecycle must complete the declared sweep with zero request errors. Results do not establish capacity above 30 clients.

Throughput and latency are arithmetic means across the three lifecycles; retained per-concurrency observations include trial values and ranges. Database-service memory demand is sampled cgroup anon + shmem from before indexing through publication, excluding the benchmark client. Final database volume is checksum-verified post-stop allocated bytes across the complete declared volume, with three-trial mean and range.

Historical peer observations retain their original versions and dates. They are reference measurements, not fresh matched comparisons; no peer database was rerun.

Run evidence parameters · variation · provenance

Benchmark parameters

{"concurrency_duration_seconds":30,"concurrency_schedule":[1,5,10,20,30],"execution_environment":{"container_runtime":"podman podman version 6.1.1","controller_platform":"darwin-arm64","processor":"Apple M4 Max","service_platform":"linux-arm64","vm_cpus":10,"vm_memory_bytes":29347610624,"vm_memory_gib":27.3},"lifecycle_search_values":[0.425,0.425,0.425],"query_count":800,"query_partition_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","search_parameter":"search_effort"}

Trial variation

[{"engine":"Antfly","ranges":{"demand_working_set":{"maximum":4521.2,"mean":4246.7,"minimum":3837.8,"unit":"MB"},"final_database_volume":{"maximum":5937.778688,"mean":5928.665088,"minimum":5918.507008,"unit":"MB"},"p99_at_30_concurrent":{"maximum":144.2,"mean":135.5,"minimum":119.6,"unit":"ms"}},"workload":"768d-1M"},{"engine":"Chroma","ranges":{"demand_working_set":{"maximum":3699.1,"mean":3693.6,"minimum":3688.8,"unit":"MB"},"final_database_volume":{"maximum":3460.194304,"mean":3459.731456,"minimum":3458.838528,"unit":"MB"},"p99_at_30_concurrent":{"maximum":136.1,"mean":135.567,"minimum":134.6,"unit":"ms"}},"workload":"768d-1M"},{"engine":"Elasticsearch","ranges":{"demand_working_set":{"maximum":2135.8,"mean":2095.2,"minimum":2029.8,"unit":"MB"},"final_database_volume":{"maximum":3148.750848,"mean":3148.500992,"minimum":3148.361728,"unit":"MB"},"p99_at_30_concurrent":{"maximum":21.6,"mean":20.967,"minimum":19.7,"unit":"ms"}},"workload":"768d-1M"},{"engine":"Milvus 2.6.22","ranges":{"demand_working_set":{"maximum":13999.4,"mean":13920.6,"minimum":13837.1,"unit":"MB"},"final_database_volume":{"maximum":25669.378048,"mean":25642.164224,"minimum":25626.836992,"unit":"MB"},"p99_at_30_concurrent":{"maximum":13.7,"mean":13.633,"minimum":13.5,"unit":"ms"}},"workload":"768d-1M"},{"engine":"pgvector","ranges":{"demand_working_set":{"maximum":2318.6,"mean":2317.3,"minimum":2316.6,"unit":"MB"},"final_database_volume":{"maximum":9329.364992,"mean":9329.318571,"minimum":9329.27488,"unit":"MB"},"p99_at_30_concurrent":{"maximum":76.6,"mean":72.867,"minimum":69.9,"unit":"ms"}},"workload":"768d-1M"},{"engine":"Weaviate","ranges":{"demand_working_set":{"maximum":7370.7,"mean":7345.1,"minimum":7331,"unit":"MB"},"final_database_volume":{"maximum":3955.232768,"mean":3947.47904,"minimum":3942.985728,"unit":"MB"},"p99_at_30_concurrent":{"maximum":68.3,"mean":67.2,"minimum":65.7,"unit":"ms"}},"workload":"768d-1M"},{"engine":"Milvus 3.0.0","ranges":{"demand_working_set":{"maximum":13551.8,"mean":13262.6,"minimum":13016.7,"unit":"MB"},"final_database_volume":{"maximum":35112.308736,"mean":33718.551893,"minimum":33003.88864,"unit":"MB"},"p99_at_30_concurrent":{"maximum":14.4,"mean":14.233,"minimum":14.1,"unit":"ms"}},"workload":"768d-1M"}]

Peer versions

  • Chroma1.5.9
  • Elasticsearch9.5.2
  • Milvus 2.6.222.6.22
  • pgvector0.8.6 (PostgreSQL 16)
  • Weaviate1.39.2
  • Milvus 3.0.03.0.0

Evidence digests

Receipt
bee7787ceaa3b737a0b5da4888039e04369d810d0823d376e232d6bc289da5de
Aggregate
15c0f5c09b43c79611ddbadf40f16e829f99d32c85873b47d336be08ad4c47ab
Provenance
15c0f5c09b43c79611ddbadf40f16e829f99d32c85873b47d336be08ad4c47ab
Harness commit
82c699bb7a687b65efc691ec329368494ce8499e

Peer cohort evidence · 768d-1M

Completed
Fresh lifecycles
18
Peer variants
6
Receipt
4366569aa9cfe5f7e796c5eadc30a6d2ae610cde650543eb3546ddcb856dfebf
Aggregate
828e2d97f299926c3bb1f39866db983ef61895793243ec02a569fe955507a197
Provenance
4af875e079c7c2538ed378027ac14be10294f30a7761e8fe0300f885ea3a1ea4
Selected measurement
Completed
Antfly
main-09b78df97 ·
Runtime
1h 34m
Platform
linux · arm64
Machine
Apple M4 Max
Build
ReleaseFast

Peer cohort · 768d-1M

Completed
Variants
6 independently executed peers
Lifecycles
18 fresh
Compatibility
Historical reference · not a matched runtime

Peak throughput

Antfly main-09b78df97 (09b78df9, ReleaseFast/stripped) · linux-arm64 · 768d-1M · three fresh lifecycles · 1/5/10/20/30 clients · 30 s/point · partition seed antfly-circus-vdbbench-v1 · Higher is better · Apple M4 Max · podman podman version 6.1.1 · 10 VM CPUs / 27.3 GiB · Historical peers, not a matched run

Serial query p95

Antfly main-09b78df97 (09b78df9, ReleaseFast/stripped) · linux-arm64 · 768d-1M · three fresh lifecycles · 1/5/10/20/30 clients · 30 s/point · partition seed antfly-circus-vdbbench-v1 · Lower is better · Apple M4 Max · podman podman version 6.1.1 · 10 VM CPUs / 27.3 GiB · Historical peers, not a matched run

Demand working set

Antfly main-09b78df97 (09b78df9, ReleaseFast/stripped) · linux-arm64 · 768d-1M · three fresh lifecycles · 1/5/10/20/30 clients · 30 s/point · partition seed antfly-circus-vdbbench-v1 · Lower is better · Apple M4 Max · podman podman version 6.1.1 · 10 VM CPUs / 27.3 GiB · Historical peers, not a matched run

Final database volume

Antfly main-09b78df97 (09b78df9, ReleaseFast/stripped) · linux-arm64 · 768d-1M · three fresh lifecycles · 1/5/10/20/30 clients · 30 s/point · partition seed antfly-circus-vdbbench-v1 · Lower is better · Apple M4 Max · podman podman version 6.1.1 · 10 VM CPUs / 27.3 GiB · Historical peers, not a matched run

Performance, quality, and resource evidence

Antfly main-09b78df97 · 09b78df9

EngineWorkloadRecallnDCGPeak QPS queries/sp95 msDemand working set MBCache-inclusive peak MBFinal database volume MBTrials
Antfly768d-1M0.96300.9670591.917.8004,246.7 MB10,241.9 MB5,928.7 MB3
Chroma768d-1M0.95600.9620238.76.6003,693.6 MB7,289.8 MB3,459.7 MB3
Elasticsearch768d-1M0.95900.96103,110.83.2332,095.2 MB11,426.8 MB3,148.5 MB3
Milvus 2.6.22768d-1M0.96100.96604,085.92.20013,920.6 MB21,605.9 MB25,642.2 MB3
pgvector768d-1M0.96600.9700955.810.7672,317.3 MB11,974.9 MB9,329.3 MB3
Weaviate768d-1M0.95600.96201,300.85.7007,345.1 MB13,791.8 MB3,947.5 MB3
Milvus 3.0.0768d-1M0.96100.96703,898.52.36713,262.6 MB21,631.0 MB33,718.6 MB3
iii

vector-vdbbench-scale

complete

Scale

Antfly main-09b78df97, stripped ReleaseFast, completed all 24 fresh lifecycles across twelve corpus sizes from 20K to 3M with zero request errors. At 3M, peak throughput averaged 222 QPS across a 114–330 QPS range; service demand averaged 9.21 GB and final allocated volume 29.97 GB. This is a two-lifecycle scale diagnostic, separate from three-lifecycle honed publication.

Methodology scope · protocol · interpretation

Vector scale diagnostic: retained methodology

The complete cohort contains Fast 20K,40K,60K,80K,100K and Big 200K,400K,600K,800K,1M,2M,3M: 12 sizes, two fresh lifecycles each (24 cells), 1/5/10/20/30 clients for 30 seconds each (120 concurrency windows). Trial 1 traverses all sizes ascending; trial 2 descends. This is descriptive two-lifecycle evidence, not the three-lifecycle honed publication cohort.

All sizes use deterministic zero-copy prefixes of the first three pinned Cohere10M training shards, the same 1000 test embeddings, exact cosine top-100 prefix ground truth, dimensions 768, and float32 L2 normalization. Seed antfly-circus-vdbbench-v1 separates 200 calibration and 800 held-out publication queries without overlap. The lowest calibrated search effort reaching recall 0.955 is selected; held-out quality must meet 0.95. Dataset manifests and source checksums are retained in the neutral protocol.

The final cohort uniformly uses persistent-stdin-exec memory collection. Demand measures cgroup-v2 anon+shmem through the full lifecycle, excludes reclaimable file cache, and keeps exact peak bytes, sample counts, coverage boundaries and maximum gaps beside rounded source metrics. Storage retains allocated/apparent byte observations at empty,ready,post-workload,final barriers, service-stop qualification and receipt fingerprints; the selected yardstick is final allocated bytes. Product defaults remain unchanged.

Concurrency latency arrays retain original seconds; aggregate p95/p99 observations convert to milliseconds. Means and ranges are arithmetic across trial 1 then trial 2; percentile means are not pooled percentiles. Full numerical publication metrics, serial calibration candidates and selected settings, index-build components, lifecycle timing, source-cell object/receipt digests and timestamps remain evidence.

Earlier one-shot captures and previous/historical comparisons are supplementary only and never pooled into selected metrics. Attempt 2 retains eleven qualified trial-1 cells and an unqualified 3M query observation: its three failed memory samples and 92.91-second maximum gap forbid qualifying the observed memory peak. The slot exhausted two attempts; first-attempt detailed files were overwritten by the previous retry policy and are not synthesized. Collector recovery and independent final verification are attached. Fixed ascending client sweeps confound client count with elapsed time. Cross-run binary/build/environment/fixture/load differences prohibit causal product speedup claims.

Raw logs, memory timelines, query text, corpora and binaries remain Circus-side; this package retains portable artifact names and verified checksums, not fabricated public uploads.

Run evidence parameters · variation · provenance

Benchmark parameters

{"calibration_qualification_floor":0.955,"calibration_queries":200,"client_import_mode":"selected","concurrency_schedule":[1,5,10,20,30],"dataset_generator":"circus-cohere-10m-scale-prefix-v1","dataset_manifests":[{"artifact_identity":{"bytes":1351,"files_count":1,"sha256":"519ec730306a19f504b958cdef58ab4ba702c089a3d38ba8c15c310dbad447ef"},"manifest":{"dimensions":768,"generation":{"batch_rows":4096,"normalization":"float32 L2","prefix_order":"ordered source shard rows","tie_break":"score descending then vector ID ascending"},"generator":"circus-cohere-10m-scale-prefix-v1","metric":"cosine","outputs":{"neighbors.parquet":"62200b46789213490b034feafa5a5bada1a01ce20de90236a32bab43b3304c1b","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"queries":1000,"schema_version":1,"source_relative":"cohere/cohere_large_10m","source_row_range":[0,20000],"source_sha256":{"scalar_labels.parquet":"604613ff5cdb4086c94ff5168538e96c503517efd0489f6b44ed53a229568251","shuffle_train-00-of-10.parquet":"f7bc9a94961d2d45856d6c49e0fa35465ea8919a063c5bc5c06df289eb5f3d3c","shuffle_train-01-of-10.parquet":"4cbeaa1447c91c7a47923f995db5f76d63a979e528845236c7d2fdbb6877fd77","shuffle_train-02-of-10.parquet":"69d23f161942d549c5416c8b74464c193dbd0c4d3c024440e32fa3f7935bb3f5","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"top_k":100,"training_file_rows":[1000000],"training_files":["cohere/cohere_large_10m/shuffle_train-00-of-10.parquet"],"vectors":20000,"zero_copy_training":true},"manifest_sha256":"39304250117bdaf86b96d999d75f9b9771794955d5718b23f3370959f133c3cf"},{"artifact_identity":{"bytes":1351,"files_count":1,"sha256":"cfec0511b2ebdc992c66ca78494eb77939f1c32c99f7b36fcf20bcebd706d2a9"},"manifest":{"dimensions":768,"generation":{"batch_rows":4096,"normalization":"float32 L2","prefix_order":"ordered source shard rows","tie_break":"score descending then vector ID ascending"},"generator":"circus-cohere-10m-scale-prefix-v1","metric":"cosine","outputs":{"neighbors.parquet":"6c393f166f09f35e64badb60003ff098b043f43d62ea2827b47820b9b370ce27","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"queries":1000,"schema_version":1,"source_relative":"cohere/cohere_large_10m","source_row_range":[0,40000],"source_sha256":{"scalar_labels.parquet":"604613ff5cdb4086c94ff5168538e96c503517efd0489f6b44ed53a229568251","shuffle_train-00-of-10.parquet":"f7bc9a94961d2d45856d6c49e0fa35465ea8919a063c5bc5c06df289eb5f3d3c","shuffle_train-01-of-10.parquet":"4cbeaa1447c91c7a47923f995db5f76d63a979e528845236c7d2fdbb6877fd77","shuffle_train-02-of-10.parquet":"69d23f161942d549c5416c8b74464c193dbd0c4d3c024440e32fa3f7935bb3f5","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"top_k":100,"training_file_rows":[1000000],"training_files":["cohere/cohere_large_10m/shuffle_train-00-of-10.parquet"],"vectors":40000,"zero_copy_training":true},"manifest_sha256":"0de67ddf70b901ad36225f92e0202bd6327fe480ccf8e4b8d9f6968f68a7c458"},{"artifact_identity":{"bytes":1351,"files_count":1,"sha256":"d7e95b8968f6d7a350449080bd0cb5d6e88e621af7273294846f819057c0bbe1"},"manifest":{"dimensions":768,"generation":{"batch_rows":4096,"normalization":"float32 L2","prefix_order":"ordered source shard rows","tie_break":"score descending then vector ID ascending"},"generator":"circus-cohere-10m-scale-prefix-v1","metric":"cosine","outputs":{"neighbors.parquet":"c12d5fc1b8e7933a6bf5f5411b2632d8f18625bdb9df730566a21da4a404a64a","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"queries":1000,"schema_version":1,"source_relative":"cohere/cohere_large_10m","source_row_range":[0,60000],"source_sha256":{"scalar_labels.parquet":"604613ff5cdb4086c94ff5168538e96c503517efd0489f6b44ed53a229568251","shuffle_train-00-of-10.parquet":"f7bc9a94961d2d45856d6c49e0fa35465ea8919a063c5bc5c06df289eb5f3d3c","shuffle_train-01-of-10.parquet":"4cbeaa1447c91c7a47923f995db5f76d63a979e528845236c7d2fdbb6877fd77","shuffle_train-02-of-10.parquet":"69d23f161942d549c5416c8b74464c193dbd0c4d3c024440e32fa3f7935bb3f5","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"top_k":100,"training_file_rows":[1000000],"training_files":["cohere/cohere_large_10m/shuffle_train-00-of-10.parquet"],"vectors":60000,"zero_copy_training":true},"manifest_sha256":"35d1c9c41cfb8339fcd10b86ce91358cb77652a031dd873ca55a9517ccdde491"},{"artifact_identity":{"bytes":1351,"files_count":1,"sha256":"26a7ae25edb45f13a47dc237ad64bcdb6a161940526f5f91be39e509833f6bf5"},"manifest":{"dimensions":768,"generation":{"batch_rows":4096,"normalization":"float32 L2","prefix_order":"ordered source shard rows","tie_break":"score descending then vector ID ascending"},"generator":"circus-cohere-10m-scale-prefix-v1","metric":"cosine","outputs":{"neighbors.parquet":"62f4ca1dfafa0dda7d151d5823f16b2c36def610ecacb71f236f7a0f57928a07","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"queries":1000,"schema_version":1,"source_relative":"cohere/cohere_large_10m","source_row_range":[0,80000],"source_sha256":{"scalar_labels.parquet":"604613ff5cdb4086c94ff5168538e96c503517efd0489f6b44ed53a229568251","shuffle_train-00-of-10.parquet":"f7bc9a94961d2d45856d6c49e0fa35465ea8919a063c5bc5c06df289eb5f3d3c","shuffle_train-01-of-10.parquet":"4cbeaa1447c91c7a47923f995db5f76d63a979e528845236c7d2fdbb6877fd77","shuffle_train-02-of-10.parquet":"69d23f161942d549c5416c8b74464c193dbd0c4d3c024440e32fa3f7935bb3f5","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"top_k":100,"training_file_rows":[1000000],"training_files":["cohere/cohere_large_10m/shuffle_train-00-of-10.parquet"],"vectors":80000,"zero_copy_training":true},"manifest_sha256":"787c6441a8eb042bc5be287e41147e474f4506e4acd1e7e0b5cca95d127fcca7"},{"artifact_identity":{"bytes":1353,"files_count":1,"sha256":"823d6846de8e63a5ce48465882c9a5cdb8ab5f7848107af7a4c3311f88ed5ea1"},"manifest":{"dimensions":768,"generation":{"batch_rows":4096,"normalization":"float32 L2","prefix_order":"ordered source shard rows","tie_break":"score descending then vector ID ascending"},"generator":"circus-cohere-10m-scale-prefix-v1","metric":"cosine","outputs":{"neighbors.parquet":"6dfe09840684ca96815079f4fdc38798085a4f2e29764e62b3104b5bc3aa7805","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"queries":1000,"schema_version":1,"source_relative":"cohere/cohere_large_10m","source_row_range":[0,100000],"source_sha256":{"scalar_labels.parquet":"604613ff5cdb4086c94ff5168538e96c503517efd0489f6b44ed53a229568251","shuffle_train-00-of-10.parquet":"f7bc9a94961d2d45856d6c49e0fa35465ea8919a063c5bc5c06df289eb5f3d3c","shuffle_train-01-of-10.parquet":"4cbeaa1447c91c7a47923f995db5f76d63a979e528845236c7d2fdbb6877fd77","shuffle_train-02-of-10.parquet":"69d23f161942d549c5416c8b74464c193dbd0c4d3c024440e32fa3f7935bb3f5","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"top_k":100,"training_file_rows":[1000000],"training_files":["cohere/cohere_large_10m/shuffle_train-00-of-10.parquet"],"vectors":100000,"zero_copy_training":true},"manifest_sha256":"647c3b0f9f906f7528c85257ee34f8d1be1c4751eb7fd2b011aa4a4042f3e0f6"},{"artifact_identity":{"bytes":1353,"files_count":1,"sha256":"ab1fa4cafff1fd712098f33425b9aa25bd594a62c95069706e54a77ee29cb289"},"manifest":{"dimensions":768,"generation":{"batch_rows":4096,"normalization":"float32 L2","prefix_order":"ordered source shard rows","tie_break":"score descending then vector ID ascending"},"generator":"circus-cohere-10m-scale-prefix-v1","metric":"cosine","outputs":{"neighbors.parquet":"34cdea7f0b21f48c9280de5d9ca4f9fbb3807fd1446cc8b190e656851807ac04","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"queries":1000,"schema_version":1,"source_relative":"cohere/cohere_large_10m","source_row_range":[0,200000],"source_sha256":{"scalar_labels.parquet":"604613ff5cdb4086c94ff5168538e96c503517efd0489f6b44ed53a229568251","shuffle_train-00-of-10.parquet":"f7bc9a94961d2d45856d6c49e0fa35465ea8919a063c5bc5c06df289eb5f3d3c","shuffle_train-01-of-10.parquet":"4cbeaa1447c91c7a47923f995db5f76d63a979e528845236c7d2fdbb6877fd77","shuffle_train-02-of-10.parquet":"69d23f161942d549c5416c8b74464c193dbd0c4d3c024440e32fa3f7935bb3f5","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"top_k":100,"training_file_rows":[1000000],"training_files":["cohere/cohere_large_10m/shuffle_train-00-of-10.parquet"],"vectors":200000,"zero_copy_training":true},"manifest_sha256":"973077edb7d5eabb8248eabf5b0401878c889ff3b6d3577a69db5c6acfc96566"},{"artifact_identity":{"bytes":1353,"files_count":1,"sha256":"dd9ea9c49ee300f2a40085650c7728e2e32a1d951e86fefee25fde43a576537c"},"manifest":{"dimensions":768,"generation":{"batch_rows":4096,"normalization":"float32 L2","prefix_order":"ordered source shard rows","tie_break":"score descending then vector ID ascending"},"generator":"circus-cohere-10m-scale-prefix-v1","metric":"cosine","outputs":{"neighbors.parquet":"90b6df213c434f534e6d699a9fb1310f0956d454f8d253fa27250e33f22f8e40","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"queries":1000,"schema_version":1,"source_relative":"cohere/cohere_large_10m","source_row_range":[0,400000],"source_sha256":{"scalar_labels.parquet":"604613ff5cdb4086c94ff5168538e96c503517efd0489f6b44ed53a229568251","shuffle_train-00-of-10.parquet":"f7bc9a94961d2d45856d6c49e0fa35465ea8919a063c5bc5c06df289eb5f3d3c","shuffle_train-01-of-10.parquet":"4cbeaa1447c91c7a47923f995db5f76d63a979e528845236c7d2fdbb6877fd77","shuffle_train-02-of-10.parquet":"69d23f161942d549c5416c8b74464c193dbd0c4d3c024440e32fa3f7935bb3f5","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"top_k":100,"training_file_rows":[1000000],"training_files":["cohere/cohere_large_10m/shuffle_train-00-of-10.parquet"],"vectors":400000,"zero_copy_training":true},"manifest_sha256":"41db3654e03f02b6eeda6ae479ad469ffcd44e3ee963eaa93f2f610c01252d6c"},{"artifact_identity":{"bytes":1353,"files_count":1,"sha256":"6f0fb4d276fc19ad98aa7baf1351500995e72897984435b65aa3fde868cba72b"},"manifest":{"dimensions":768,"generation":{"batch_rows":4096,"normalization":"float32 L2","prefix_order":"ordered source shard rows","tie_break":"score descending then vector ID ascending"},"generator":"circus-cohere-10m-scale-prefix-v1","metric":"cosine","outputs":{"neighbors.parquet":"1e9e731ef2578eb6fc104280a7b36e9409ead4975d780eadd6418725c6b8d591","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"queries":1000,"schema_version":1,"source_relative":"cohere/cohere_large_10m","source_row_range":[0,600000],"source_sha256":{"scalar_labels.parquet":"604613ff5cdb4086c94ff5168538e96c503517efd0489f6b44ed53a229568251","shuffle_train-00-of-10.parquet":"f7bc9a94961d2d45856d6c49e0fa35465ea8919a063c5bc5c06df289eb5f3d3c","shuffle_train-01-of-10.parquet":"4cbeaa1447c91c7a47923f995db5f76d63a979e528845236c7d2fdbb6877fd77","shuffle_train-02-of-10.parquet":"69d23f161942d549c5416c8b74464c193dbd0c4d3c024440e32fa3f7935bb3f5","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"top_k":100,"training_file_rows":[1000000],"training_files":["cohere/cohere_large_10m/shuffle_train-00-of-10.parquet"],"vectors":600000,"zero_copy_training":true},"manifest_sha256":"6c2f64a89ea8c75d3ec923bf9167411859d1a40d9253dec37708530764f85f70"},{"artifact_identity":{"bytes":1353,"files_count":1,"sha256":"90f9c2fef62abb27ef4f0f243cd2e28623e6b77e03c64e9074a5471bfa8a56b1"},"manifest":{"dimensions":768,"generation":{"batch_rows":4096,"normalization":"float32 L2","prefix_order":"ordered source shard rows","tie_break":"score descending then vector ID ascending"},"generator":"circus-cohere-10m-scale-prefix-v1","metric":"cosine","outputs":{"neighbors.parquet":"f39491ecbc25b4f8c80d50c026b78158062a88b264b67c24b0192e0dd98f379b","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"queries":1000,"schema_version":1,"source_relative":"cohere/cohere_large_10m","source_row_range":[0,800000],"source_sha256":{"scalar_labels.parquet":"604613ff5cdb4086c94ff5168538e96c503517efd0489f6b44ed53a229568251","shuffle_train-00-of-10.parquet":"f7bc9a94961d2d45856d6c49e0fa35465ea8919a063c5bc5c06df289eb5f3d3c","shuffle_train-01-of-10.parquet":"4cbeaa1447c91c7a47923f995db5f76d63a979e528845236c7d2fdbb6877fd77","shuffle_train-02-of-10.parquet":"69d23f161942d549c5416c8b74464c193dbd0c4d3c024440e32fa3f7935bb3f5","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"top_k":100,"training_file_rows":[1000000],"training_files":["cohere/cohere_large_10m/shuffle_train-00-of-10.parquet"],"vectors":800000,"zero_copy_training":true},"manifest_sha256":"add7a3ed849604b62a3e7cda642ef2dbcbf3c06f357bb2c49a1dcc427bb08d13"},{"artifact_identity":{"bytes":1355,"files_count":1,"sha256":"e2f7579a4a7699f9405ad3396494cdf6c339a8d1d5909fc555d9295440855d9b"},"manifest":{"dimensions":768,"generation":{"batch_rows":4096,"normalization":"float32 L2","prefix_order":"ordered source shard rows","tie_break":"score descending then vector ID ascending"},"generator":"circus-cohere-10m-scale-prefix-v1","metric":"cosine","outputs":{"neighbors.parquet":"4a94233f4eac60144fe7e33b65bd2e207efb12079b0f3dc14de6e2f148b199b5","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"queries":1000,"schema_version":1,"source_relative":"cohere/cohere_large_10m","source_row_range":[0,1000000],"source_sha256":{"scalar_labels.parquet":"604613ff5cdb4086c94ff5168538e96c503517efd0489f6b44ed53a229568251","shuffle_train-00-of-10.parquet":"f7bc9a94961d2d45856d6c49e0fa35465ea8919a063c5bc5c06df289eb5f3d3c","shuffle_train-01-of-10.parquet":"4cbeaa1447c91c7a47923f995db5f76d63a979e528845236c7d2fdbb6877fd77","shuffle_train-02-of-10.parquet":"69d23f161942d549c5416c8b74464c193dbd0c4d3c024440e32fa3f7935bb3f5","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"top_k":100,"training_file_rows":[1000000],"training_files":["cohere/cohere_large_10m/shuffle_train-00-of-10.parquet"],"vectors":1000000,"zero_copy_training":true},"manifest_sha256":"88ebb2b60eceebabefd482942cebd0a6a6672cfc5b2949b8a6ed38d4a39976af"},{"artifact_identity":{"bytes":1430,"files_count":1,"sha256":"8580182b73164e6c4218c2f06de6fad2350b2f3c19086b485e943e0411d306b4"},"manifest":{"dimensions":768,"generation":{"batch_rows":4096,"normalization":"float32 L2","prefix_order":"ordered source shard rows","tie_break":"score descending then vector ID ascending"},"generator":"circus-cohere-10m-scale-prefix-v1","metric":"cosine","outputs":{"neighbors.parquet":"c1cda1125252eec4fe535d73a7c64f837d14e68db01c004a3801ebc104699829","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"queries":1000,"schema_version":1,"source_relative":"cohere/cohere_large_10m","source_row_range":[0,2000000],"source_sha256":{"scalar_labels.parquet":"604613ff5cdb4086c94ff5168538e96c503517efd0489f6b44ed53a229568251","shuffle_train-00-of-10.parquet":"f7bc9a94961d2d45856d6c49e0fa35465ea8919a063c5bc5c06df289eb5f3d3c","shuffle_train-01-of-10.parquet":"4cbeaa1447c91c7a47923f995db5f76d63a979e528845236c7d2fdbb6877fd77","shuffle_train-02-of-10.parquet":"69d23f161942d549c5416c8b74464c193dbd0c4d3c024440e32fa3f7935bb3f5","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"top_k":100,"training_file_rows":[1000000,1000000],"training_files":["cohere/cohere_large_10m/shuffle_train-00-of-10.parquet","cohere/cohere_large_10m/shuffle_train-01-of-10.parquet"],"vectors":2000000,"zero_copy_training":true},"manifest_sha256":"5203997ea34599299b802df69a92a7d13024d9fd952a9f61d4b1296090db59f1"},{"artifact_identity":{"bytes":1505,"files_count":1,"sha256":"98355cd528fb766f07ca0b30e4ea5ec098b6320d66fbb5878c65b8cb2d2d344b"},"manifest":{"dimensions":768,"generation":{"batch_rows":4096,"normalization":"float32 L2","prefix_order":"ordered source shard rows","tie_break":"score descending then vector ID ascending"},"generator":"circus-cohere-10m-scale-prefix-v1","metric":"cosine","outputs":{"neighbors.parquet":"cc28941186ad832058ac537237aa8f47cd566eed65564219d1efe1008527dce9","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"queries":1000,"schema_version":1,"source_relative":"cohere/cohere_large_10m","source_row_range":[0,3000000],"source_sha256":{"scalar_labels.parquet":"604613ff5cdb4086c94ff5168538e96c503517efd0489f6b44ed53a229568251","shuffle_train-00-of-10.parquet":"f7bc9a94961d2d45856d6c49e0fa35465ea8919a063c5bc5c06df289eb5f3d3c","shuffle_train-01-of-10.parquet":"4cbeaa1447c91c7a47923f995db5f76d63a979e528845236c7d2fdbb6877fd77","shuffle_train-02-of-10.parquet":"69d23f161942d549c5416c8b74464c193dbd0c4d3c024440e32fa3f7935bb3f5","test.parquet":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c"},"top_k":100,"training_file_rows":[1000000,1000000,1000000],"training_files":["cohere/cohere_large_10m/shuffle_train-00-of-10.parquet","cohere/cohere_large_10m/shuffle_train-01-of-10.parquet","cohere/cohere_large_10m/shuffle_train-02-of-10.parquet"],"vectors":3000000,"zero_copy_training":true},"manifest_sha256":"65792257139941cae8ab09693412c628853a33cf1cfecea6ae86dc89d46c5ef2"}],"dataset_prefix_contract":"all twelve sizes are deterministic zero-copy row prefixes of the same first three pinned cohere_large_10m shards and same 1000 test embeddings; exact cosine top-100 ground truth per prefix","dataset_source":"cohere/cohere_large_10m","dimensions":768,"execution_order":"All 12 sizes ascending in trial 1 then descending in trial 2","memory_capture_transport":"persistent-stdin-exec","memory_yardstick":"cgroup-v2-anon-plus-shmem-full-lifecycle","metric":"cosine","post_load_settle_seconds":300,"publication_queries":800,"quality_floor":0.95,"query_admission":"unchanged product default","query_fixture_sha256":"a3b0416f2e7eb0e932a0f15f75ed25c76d53777cd7e52d74b1b2e62066f46a4c","query_partition_seed":"antfly-circus-vdbbench-v1","shared_query_storage":true,"storage_metric":"final_allocated_bytes","top_k":100,"window_seconds":30}

Execution provenance

{"antfly":{"artifacts":[{"platform":"linux-arm64","sha256":"6366535c49a75b8c4da691096b0cb7799daa6968f68e5a45377f20e6a321c470"}],"binary_bytes":142212224,"binary_sha256":"6366535c49a75b8c4da691096b0cb7799daa6968f68e5a45377f20e6a321c470","build":{"compiler":"Zig","compiler_version":"0.17.0","cpu":"baseline","description":"Zig 0.17.0; ReleaseFast; aarch64-linux-musl; baseline CPU; stripped; onnx=false; metal=false; system-blas=false; -j1; scheduler maxrss 25769803776 bytes","linkage":"static","metal":false,"onnx":false,"stripped":true,"system_blas":false,"target":"aarch64-linux-musl"},"build_edition":"full","build_mode":"ReleaseFast","commit":"09b78df97ec69e020a56110a684b46fce9d4a511","commit_short":"09b78df97","subject_id":"antfly-main-09b78df97-releasefast","tag":"main-09b78df97"},"completed_at":"2026-10-08T07:52:07.722863+00:00","duration_seconds":29951.999,"environment":{"architecture":"arm64","operating_system":"linux","platform":"linux-arm64","processor":"Apple M4 Max"},"harness_commit":"b3ae41f","harness_commit_precision":"retained-short-commit","measured_lifecycle_runtime_seconds":29906.79398369789,"started_at":"2026-10-07T23:32:54.188128+00:00","time_source":"retained-command-execution-bounds"}

Where the time went

One pinned Cohere10M-source fixture supplies nested 768D prefixes at all twelve sizes, with 200 calibration queries and a disjoint 800-query holdout. Each of two fresh lifecycles sweeps 1/5/10/20/30 clients for 30 seconds per point; all use the same frozen binary, default server settings, and persistent cgroup collector. At 1M, 10 to 20 clients adds only 3.1% throughput while p99 more than doubles. Mean peak throughput falls from 797 QPS at 1M to 445 at 2M and 222 at 3M; 3M trial peaks range from 114 to 330 QPS. One 3M/20-client window reached 10.73 seconds p99 despite zero request errors. Fixed-order sweeps confound concurrency with elapsed lifecycle time; the cause of the variation is not isolated, and these observations are not stable-capacity bounds. Adding 50% more vectors from 2M to 3M costs 1.91 times the allocated storage and 2.71 times the build time. Demand is database-service cgroup anon + shmem, excluding the client. Per-trial concurrency observations, earlier-result comparisons, superseded measurements, and capture recovery are retained in Run details. Earlier honed and scale fixtures and the old one-shot collector are not matched with this run; no product speedup is claimed. The failed 3M capture remains unqualified and is not mixed into the clean curve.

Trial variation

Each size retains ordered trials 1 and 2, held-out qualification and selected effort. When captured, concurrency observations report QPS and p95/p99 in milliseconds at every client count; original publication metric latency arrays remain in seconds. These are two-lifecycle diagnostics, not the three-lifecycle honed cohort.

[{"concurrency_observations":[{"clients":1,"p95_ms":{"max":4.698534976341762,"mean":4.661173721251544,"min":4.623812466161326,"values":[4.698534976341762,4.623812466161326]},"p99_ms":{"max":4.995431527495381,"mean":4.959379016218007,"min":4.923326504940632,"values":[4.995431527495381,4.923326504940632]},"qps":{"max":236.4744,"mean":234.9839,"min":233.4934,"values":[233.4934,236.4744]}},{"clients":5,"p95_ms":{"max":5.880510911811142,"mean":5.863387954013887,"min":5.8462649962166315,"values":[5.880510911811142,5.8462649962166315]},"p99_ms":{"max":7.591670435504064,"mean":7.5601884382194875,"min":7.528706440934911,"values":[7.591670435504064,7.528706440934911]},"qps":{"max":957.6334,"mean":956.5594000000001,"min":955.4854,"values":[957.6334,955.4854]}},{"clients":10,"p95_ms":{"max":9.551274206023663,"mean":9.544054901925847,"min":9.53683559782803,"values":[9.551274206023663,9.53683559782803]},"p99_ms":{"max":11.187825742235873,"mean":11.151206890499456,"min":11.11458803876304,"values":[11.11458803876304,11.187825742235873]},"qps":{"max":1424.3308,"mean":1422.6637,"min":1420.9966,"values":[1420.9966,1424.3308]}},{"clients":20,"p95_ms":{"max":24.92757159052417,"mean":24.540354941564146,"min":24.153138292604126,"values":[24.92757159052417,24.153138292604126]},"p99_ms":{"max":30.749195839744075,"mean":30.228271528903853,"min":29.70734721806363,"values":[30.749195839744075,29.70734721806363]},"qps":{"max":1405.1164,"mean":1383.7641,"min":1362.4118,"values":[1362.4118,1405.1164]}},{"clients":30,"p95_ms":{"max":40.65867779572727,"mean":40.5086591556028,"min":40.35864051547833,"values":[40.65867779572727,40.35864051547833]},"p99_ms":{"max":51.317565254867084,"mean":50.969483983353726,"min":50.62140271184036,"values":[51.317565254867084,50.62140271184036]},"qps":{"max":1362.617,"mean":1352.9421,"min":1343.2672,"values":[1343.2672,1362.617]}}],"concurrency_trials":[{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-1","ndcg":0.9963,"p95_ms":5.7,"p99_ms":6.1,"parameter":"search_effort","recall":0.995,"status":"ok","value":1,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p4","ndcg":0.9537,"p95_ms":4.7,"p99_ms":5.2,"parameter":"search_effort","recall":0.9471,"status":"ok","value":0.4,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p475","ndcg":0.991,"p95_ms":4.9,"p99_ms":5.3,"parameter":"search_effort","recall":0.9889,"status":"ok","value":0.475,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p45","ndcg":0.9828,"p95_ms":4.8,"p99_ms":5.2,"parameter":"search_effort","recall":0.9798,"status":"ok","value":0.45,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p55","ndcg":0.9955,"p95_ms":4.9,"p99_ms":5.2,"parameter":"search_effort","recall":0.9942,"status":"ok","value":0.55,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p425","ndcg":0.9715,"p95_ms":4.8,"p99_ms":5.4,"parameter":"search_effort","recall":0.9668,"status":"ok","value":0.425,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p35","ndcg":0.908,"p95_ms":13.8,"p99_ms":20.4,"parameter":"search_effort","recall":0.8967,"status":"ok","value":0.35,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p8","ndcg":0.9963,"p95_ms":5.2,"p99_ms":5.6,"parameter":"search_effort","recall":0.995,"status":"ok","value":0.8,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p6","ndcg":0.996,"p95_ms":4.9,"p99_ms":5.2,"parameter":"search_effort","recall":0.9947,"status":"ok","value":0.6,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p375","ndcg":0.9339,"p95_ms":4.6,"p99_ms":4.8,"parameter":"search_effort","recall":0.925,"status":"ok","value":0.375,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p7","ndcg":0.9963,"p95_ms":5.1,"p99_ms":5.3,"parameter":"search_effort","recall":0.995,"status":"ok","value":0.7,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p5","ndcg":0.9949,"p95_ms":4.9,"p99_ms":5.2,"parameter":"search_effort","recall":0.9934,"status":"ok","value":0.5,"workload":"scale-fast-20k"}],"cell_sha256":"b137c15407456cc6652b5cf8a71ec13df94ca59c6cfd3c9179210166aca1ac4e","index_build":{"insert_duration":4.5631,"optimize_duration":2.041,"seconds":6.604100000000001},"lifecycle":{"cache_key":"dd59b15c1d656cddc983f92cb862c6d6ae13d9b76eeb83761b60d1962ae8a0ae","duration_seconds":631.8214304447174,"finished_at":1791416641.9898944,"object_sha256":"feccf73b5c8240eb752af3338cd6e40df3dda43c56df5f88b14b577586f66a1e","receipt_sha256":"bd73162be67c327c17dd551ac416de46ec66ee6110b7d6e319c99b91cdb2ac8d","started_at":1791416010.168464},"memory":{"anon_shmem_peak_mb":1825.8,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":1986.9,"cgroup_current_peak_mb":1984.9,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":1825.8,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":1984868352,"cgroup_kernel_peak_sum_bytes":1986916352,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":1825804288,"ended":1791416615.4662528,"failed_samples":0,"first_sample_at":1791416014.328859,"kind":"container_cgroup_v2","last_sample_at":1791416615.2477338,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":2911,"schema_version":3,"started":1791416014.3002138,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791416014.328859,"index_started_at":1791416014.3513112,"last_sample_at":1791416615.2477338,"max_sample_gap_s":0.296,"publication_finished_at":1791416615.146813,"sampler_ended_at":1791416615.4662528,"sampler_started_at":1791416014.3002138,"samples":2911,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.004273321311374459,0.005209013639777358,0.007016593929102096,0.014617440680952939,0.022199148963647684],"conc_latency_p95_list":[0.004698534976341762,0.0058805109118111425,0.009551274206023664,0.02492757159052417,0.04065867779572727],"conc_latency_p99_list":[0.0049954315274953805,0.007591670435504063,0.01111458803876304,0.030749195839744076,0.05131756525486708],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[233.4934,957.6334,1420.9966,1362.4118,1343.2672],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9698,"optimize_duration":0,"p99_c30_ms":51.317565254867084,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":10,"peak_qps":1420.9966,"qps":1420.9966,"qps_c30":1343.2672,"recall":0.965,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0047,"serial_latency_p99":0.0049,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9698,"recall":0.965,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.425},"trial":1},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":4.6,"load_s":6.6,"source_label":"antfly-qualification-scale-fast-20k-0p35"},"ndcg":0.9715,"p95_ms":4.8,"p99_ms":5.4,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9668,"selection_mode":"swept","value":0.425},"status":"ok","storage":{"created_at":"2026-10-07T23:33:31.098878+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-fast-20k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-07T23:33:31.248628+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-07T23:33:31.248602+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-07T23:33:31.141914+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]},"final":{"allocated_bytes":84373504,"apparent_bytes":83674236,"completed_at":"2026-10-07T23:43:36.020926+00:00","samples":[{"allocated_bytes":84373504,"apparent_bytes":83674236,"captured_at":"2026-10-07T23:43:36.020902+00:00","entries":387,"volumes":[{"allocated_bytes":84373504,"apparent_bytes":83674236,"entries":387,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-07T23:43:35.946339+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-fast-20k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":84373504,"apparent_bytes":83674236,"entries":387,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]},"post_workload":{"allocated_bytes":84365312,"apparent_bytes":83673194,"completed_at":"2026-10-07T23:43:35.649169+00:00","samples":[{"allocated_bytes":84365312,"apparent_bytes":83673194,"captured_at":"2026-10-07T23:43:35.649147+00:00","entries":384,"volumes":[{"allocated_bytes":84365312,"apparent_bytes":83673194,"entries":384,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-07T23:43:35.570447+00:00","volumes":[{"allocated_bytes":84365312,"apparent_bytes":83673194,"entries":384,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-07T23:33:34.201806+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-07T23:33:34.201781+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-07T23:33:34.115637+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]},"protocol_fingerprint":"59fd6c619a49cccd431304d689233276e078b528ffd64f5181d53f0b622e1c61","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-07T23:43:36.020929+00:00"},"trial":1},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p8","ndcg":0.9969,"p95_ms":5.1,"p99_ms":5.5,"parameter":"search_effort","recall":0.9958,"status":"ok","value":0.8,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p6","ndcg":0.9965,"p95_ms":5,"p99_ms":5.1,"parameter":"search_effort","recall":0.9954,"status":"ok","value":0.6,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p55","ndcg":0.9962,"p95_ms":4.8,"p99_ms":5.2,"parameter":"search_effort","recall":0.995,"status":"ok","value":0.55,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p425","ndcg":0.9687,"p95_ms":4.6,"p99_ms":4.8,"parameter":"search_effort","recall":0.9634,"status":"ok","value":0.425,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p45","ndcg":0.9818,"p95_ms":4.7,"p99_ms":4.9,"parameter":"search_effort","recall":0.9783,"status":"ok","value":0.45,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p35","ndcg":0.9055,"p95_ms":15.9,"p99_ms":27.1,"parameter":"search_effort","recall":0.8932,"status":"ok","value":0.35,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p4","ndcg":0.9511,"p95_ms":4.4,"p99_ms":4.6,"parameter":"search_effort","recall":0.9438,"status":"ok","value":0.4,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p5","ndcg":0.9959,"p95_ms":4.8,"p99_ms":5.1,"parameter":"search_effort","recall":0.9947,"status":"ok","value":0.5,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p7","ndcg":0.9969,"p95_ms":4.9,"p99_ms":5.2,"parameter":"search_effort","recall":0.9958,"status":"ok","value":0.7,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-1","ndcg":0.9969,"p95_ms":5.7,"p99_ms":6,"parameter":"search_effort","recall":0.9958,"status":"ok","value":1,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p475","ndcg":0.9915,"p95_ms":4.9,"p99_ms":5.2,"parameter":"search_effort","recall":0.9897,"status":"ok","value":0.475,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p375","ndcg":0.9319,"p95_ms":4.4,"p99_ms":4.9,"parameter":"search_effort","recall":0.9218,"status":"ok","value":0.375,"workload":"scale-fast-20k"}],"cell_sha256":"dd9fa5838594d991cb43d9024245d769b0ab14052bbad4d03f32acf33d095d88","index_build":{"insert_duration":4.1333,"optimize_duration":2.0376,"seconds":6.1709},"lifecycle":{"cache_key":"b5fcfaa257eac98b0c9557ca1e882d4e41cf05b7e77419638f667f63fba0f7f7","duration_seconds":631.7154726982117,"finished_at":1791445926.3475325,"object_sha256":"8d7693c6ce50696192fc0b09437beeb368fcc39902a3ff7f7b5283a9edad79df","receipt_sha256":"80c8199546d702559bf50fccd7eb05647727968270ac8c74536e36d6f4905cd9","started_at":1791445294.6320598},"memory":{"anon_shmem_peak_mb":1825.4,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":1986.6,"cgroup_current_peak_mb":1985.5,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":1825.4,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":1985531904,"cgroup_kernel_peak_sum_bytes":1986568192,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":1825402880,"ended":1791445895.9330869,"failed_samples":0,"first_sample_at":1791445297.8652894,"kind":"container_cgroup_v2","last_sample_at":1791445895.7151651,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":2890,"schema_version":3,"started":1791445297.8350406,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791445297.8652894,"index_started_at":1791445297.8994243,"last_sample_at":1791445895.7151651,"max_sample_gap_s":0.244,"publication_finished_at":1791445895.596955,"sampler_ended_at":1791445895.9330869,"sampler_started_at":1791445297.8350406,"samples":2890,"status":"qualified","trial":2,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.004219458893998546,0.005219721598874987,0.007000324860199192,0.014173662157325203,0.021898420596547764],"conc_latency_p95_list":[0.004623812466161325,0.005846264996216631,0.00953683559782803,0.024153138292604126,0.04035864051547833],"conc_latency_p99_list":[0.004923326504940632,0.0075287064409349114,0.011187825742235874,0.02970734721806363,0.05062140271184036],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[236.4744,955.4854,1424.3308,1405.1164,1362.617],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9677,"optimize_duration":0,"p99_c30_ms":50.62140271184036,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":10,"peak_qps":1424.3308,"qps":1424.3308,"qps_c30":1362.617,"recall":0.9626,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0046,"serial_latency_p99":0.0048,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9677,"recall":0.9626,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.425},"trial":2},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":4.1,"load_s":6.2,"source_label":"antfly-qualification-scale-fast-20k-0p35"},"ndcg":0.9687,"p95_ms":4.6,"p99_ms":4.8,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9634,"selection_mode":"swept","value":0.425},"status":"ok","storage":{"created_at":"2026-10-08T07:41:35.184491+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"2","workload":"scale-fast-20k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T07:41:35.292348+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T07:41:35.292323+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-20k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T07:41:35.221362+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-20k-antfly-data"}]},"final":{"allocated_bytes":84410368,"apparent_bytes":83710235,"completed_at":"2026-10-08T07:51:36.427491+00:00","samples":[{"allocated_bytes":84410368,"apparent_bytes":83710235,"captured_at":"2026-10-08T07:51:36.427465+00:00","entries":387,"volumes":[{"allocated_bytes":84410368,"apparent_bytes":83710235,"entries":387,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-20k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T07:51:36.348136+00:00","termination":{"container":"antfly_bench_vdbb_scale_t2_scale-fast-20k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":84410368,"apparent_bytes":83710235,"entries":387,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-20k-antfly-data"}]},"post_workload":{"allocated_bytes":84402176,"apparent_bytes":83709193,"completed_at":"2026-10-08T07:51:36.120589+00:00","samples":[{"allocated_bytes":84402176,"apparent_bytes":83709193,"captured_at":"2026-10-08T07:51:36.120564+00:00","entries":384,"volumes":[{"allocated_bytes":84402176,"apparent_bytes":83709193,"entries":384,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-20k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T07:51:36.043658+00:00","volumes":[{"allocated_bytes":84402176,"apparent_bytes":83709193,"entries":384,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-20k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T07:41:37.756097+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T07:41:37.756071+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-20k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T07:41:37.679644+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-20k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t2_scale-fast-20k-antfly-data"}]},"protocol_fingerprint":"5ae9cc40842f0994ff7470b86db03dcb075278e0d747c67879644ed54c98b235","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T07:51:36.427495+00:00"},"trial":2}],"metrics":{"demand_mb":{"max":1825.8,"mean":1825.6,"min":1825.4,"values":[1825.8,1825.4]},"final_allocated_bytes":{"max":84410368,"mean":84391936,"min":84373504,"values":[84373504,84410368]},"index_build_seconds":{"max":6.604100000000001,"mean":6.3875,"min":6.1709,"values":[6.604100000000001,6.1709]},"lifecycle_seconds":{"max":631.8214304447174,"mean":631.7684515714645,"min":631.7154726982117,"values":[631.8214304447174,631.7154726982117]},"peak_clients":{"max":10,"mean":10,"min":10,"values":[10,10]},"peak_qps":{"max":1424.3308,"mean":1422.6637,"min":1420.9966,"values":[1420.9966,1424.3308]},"serial_p95_ms":{"max":4.7,"mean":4.65,"min":4.6,"values":[4.7,4.6]}},"profile":"fast","qualification":{"ndcg_min":0.9677,"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall_min":0.9626,"request_errors":0,"trials":[{"ndcg":0.9698,"recall":0.965,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.425},"trial":1},{"ndcg":0.9677,"recall":0.9626,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.425},"trial":2}]},"storage_qualification":{"metric":"final_allocated_bytes","qualified_trials":2,"status":"qualified","total_trials":2,"trials":[{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"59fd6c619a49cccd431304d689233276e078b528ffd64f5181d53f0b622e1c61","status":"qualified","trial":1},{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"5ae9cc40842f0994ff7470b86db03dcb075278e0d747c67879644ed54c98b235","status":"qualified","trial":2}]},"vectors":20000},{"concurrency_observations":[{"clients":1,"p95_ms":{"max":5.137695989105849,"mean":5.106477878143777,"min":5.075259767181706,"values":[5.137695989105849,5.075259767181706]},"p99_ms":{"max":5.914607335580514,"mean":5.741350265452638,"min":5.568093195324762,"values":[5.914607335580514,5.568093195324762]},"qps":{"max":219.7159,"mean":219.2285,"min":218.7411,"values":[218.7411,219.7159]}},{"clients":5,"p95_ms":{"max":6.503763493674341,"mean":6.380773153068731,"min":6.25778281246312,"values":[6.25778281246312,6.503763493674341]},"p99_ms":{"max":8.47143088438315,"mean":8.45490059975418,"min":8.438370315125212,"values":[8.438370315125212,8.47143088438315]},"qps":{"max":907.5931,"mean":901.1397,"min":894.6863,"values":[907.5931,894.6863]}},{"clients":10,"p95_ms":{"max":10.418453501188193,"mean":10.145554147311486,"min":9.872654793434778,"values":[9.872654793434778,10.418453501188193]},"p99_ms":{"max":12.213153428165242,"mean":11.937663474236613,"min":11.662173520307984,"values":[11.662173520307984,12.213153428165242]},"qps":{"max":1391.2341,"mean":1349.5454,"min":1307.8567,"values":[1391.2341,1307.8567]}},{"clients":20,"p95_ms":{"max":25.515185412950803,"mean":24.717363055970047,"min":23.919540698989294,"values":[23.919540698989294,25.515185412950803]},"p99_ms":{"max":31.298067515017472,"mean":30.606799828528906,"min":29.915532142040345,"values":[29.915532142040345,31.298067515017472]},"qps":{"max":1394.9858,"mean":1347.1723499999998,"min":1299.3589,"values":[1394.9858,1299.3589]}},{"clients":30,"p95_ms":{"max":42.19921102048829,"mean":41.08512926177354,"min":39.971047503058784,"values":[39.971047503058784,42.19921102048829]},"p99_ms":{"max":52.64786839252343,"mean":51.32851518719694,"min":50.00916198187046,"values":[50.00916198187046,52.64786839252343]},"qps":{"max":1368.2315,"mean":1320.6316000000002,"min":1273.0317,"values":[1368.2315,1273.0317]}}],"concurrency_trials":[{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p7","ndcg":0.9973,"p95_ms":5.7,"p99_ms":6,"parameter":"search_effort","recall":0.9964,"status":"ok","value":0.7,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-1","ndcg":0.9973,"p95_ms":6.8,"p99_ms":7.1,"parameter":"search_effort","recall":0.9964,"status":"ok","value":1,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p45","ndcg":0.9884,"p95_ms":5.5,"p99_ms":5.9,"parameter":"search_effort","recall":0.9858,"status":"ok","value":0.45,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p8","ndcg":0.9973,"p95_ms":5.9,"p99_ms":6.3,"parameter":"search_effort","recall":0.9964,"status":"ok","value":0.8,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p425","ndcg":0.9783,"p95_ms":5.3,"p99_ms":5.6,"parameter":"search_effort","recall":0.9744,"status":"ok","value":0.425,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p6","ndcg":0.9973,"p95_ms":5.7,"p99_ms":6.4,"parameter":"search_effort","recall":0.9964,"status":"ok","value":0.6,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p35","ndcg":0.9135,"p95_ms":23.9,"p99_ms":38.8,"parameter":"search_effort","recall":0.9027,"status":"ok","value":0.35,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p475","ndcg":0.994,"p95_ms":5.7,"p99_ms":6,"parameter":"search_effort","recall":0.9926,"status":"ok","value":0.475,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p5","ndcg":0.9971,"p95_ms":5.7,"p99_ms":6,"parameter":"search_effort","recall":0.9962,"status":"ok","value":0.5,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p55","ndcg":0.9972,"p95_ms":5.6,"p99_ms":5.9,"parameter":"search_effort","recall":0.9963,"status":"ok","value":0.55,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p375","ndcg":0.9399,"p95_ms":5.1,"p99_ms":5.3,"parameter":"search_effort","recall":0.9326,"status":"ok","value":0.375,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p4","ndcg":0.9634,"p95_ms":5.2,"p99_ms":5.4,"parameter":"search_effort","recall":0.9579,"status":"ok","value":0.4,"workload":"scale-fast-40k"}],"cell_sha256":"549c6855fc3bbff5c796dd945433d12067fd19f430d9bcde34a6ef3290731f8a","index_build":{"insert_duration":7.8233,"optimize_duration":4.0516,"seconds":11.8749},"lifecycle":{"cache_key":"6ab90fb36ba4cab3f68bf7321e3203a76a55875f77aad1e92332bbb734b20cda","duration_seconds":631.7855544090271,"finished_at":1791417274.1522005,"object_sha256":"0a0aaf778384a1630d40d5e5c52342c1a5a434b374711dab7b843c4f040deea1","receipt_sha256":"2db46e8bd3649a9dcef84d9de7ab929f257fd00385311356cfd80f125e9f8711","started_at":1791416642.366646},"memory":{"anon_shmem_peak_mb":2132.5,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":2373.3,"cgroup_current_peak_mb":2371.7,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":2132.5,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":2371715072,"cgroup_kernel_peak_sum_bytes":2373345280,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":2132459520,"ended":1791417252.2811234,"failed_samples":0,"first_sample_at":1791416645.624028,"kind":"container_cgroup_v2","last_sample_at":1791417252.0711763,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":2938,"schema_version":3,"started":1791416645.5948892,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791416645.624028,"index_started_at":1791416645.6576433,"last_sample_at":1791417252.0711763,"max_sample_gap_s":0.256,"publication_finished_at":1791417252.052805,"sampler_ended_at":1791417252.2811234,"sampler_started_at":1791416645.5948892,"samples":2938,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.004562403439644179,0.005493818696685188,0.007166250413811625,0.014271655316851982,0.02180947473472442],"conc_latency_p95_list":[0.005137695989105849,0.006257782812463119,0.009872654793434778,0.023919540698989293,0.039971047503058785],"conc_latency_p99_list":[0.005914607335580514,0.008438370315125211,0.011662173520307984,0.029915532142040343,0.05000916198187046],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[218.7411,907.5931,1391.2341,1394.9858,1368.2315],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9576,"optimize_duration":0,"p99_c30_ms":50.00916198187046,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":20,"peak_qps":1394.9858,"qps":1394.9858,"qps_c30":1368.2315,"recall":0.9518,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0049,"serial_latency_p99":0.0052,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9576,"recall":0.9518,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":1},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":7.8,"load_s":11.9,"source_label":"antfly-qualification-scale-fast-40k-0p35"},"ndcg":0.9634,"p95_ms":5.2,"p99_ms":5.4,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9579,"selection_mode":"swept","value":0.4},"status":"ok","storage":{"created_at":"2026-10-07T23:44:02.945162+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-fast-40k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-07T23:44:03.059783+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-07T23:44:03.059756+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-07T23:44:02.984035+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]},"final":{"allocated_bytes":165646336,"apparent_bytes":164952381,"completed_at":"2026-10-07T23:54:12.767785+00:00","samples":[{"allocated_bytes":165646336,"apparent_bytes":164952381,"captured_at":"2026-10-07T23:54:12.767760+00:00","entries":388,"volumes":[{"allocated_bytes":165646336,"apparent_bytes":164952381,"entries":388,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-07T23:54:12.689812+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-fast-40k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":165646336,"apparent_bytes":164952381,"entries":388,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]},"post_workload":{"allocated_bytes":165642240,"apparent_bytes":164952443,"completed_at":"2026-10-07T23:54:12.466639+00:00","samples":[{"allocated_bytes":165642240,"apparent_bytes":164952443,"captured_at":"2026-10-07T23:54:12.466615+00:00","entries":386,"volumes":[{"allocated_bytes":165642240,"apparent_bytes":164952443,"entries":386,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-07T23:54:12.384685+00:00","volumes":[{"allocated_bytes":165642240,"apparent_bytes":164952443,"entries":386,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-07T23:44:05.515476+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-07T23:44:05.515450+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-07T23:44:05.437070+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]},"protocol_fingerprint":"d42b4710fbf653ade53533f91140e28591cf182cfd844c8b229b23781e6a7e8d","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-07T23:54:12.767787+00:00"},"trial":1},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p425","ndcg":0.9764,"p95_ms":5.3,"p99_ms":5.8,"parameter":"search_effort","recall":0.9722,"status":"ok","value":0.425,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p6","ndcg":0.9964,"p95_ms":5.6,"p99_ms":5.8,"parameter":"search_effort","recall":0.9951,"status":"ok","value":0.6,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p4","ndcg":0.9614,"p95_ms":5.3,"p99_ms":5.6,"parameter":"search_effort","recall":0.9553,"status":"ok","value":0.4,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p5","ndcg":0.9963,"p95_ms":5.6,"p99_ms":6.4,"parameter":"search_effort","recall":0.9951,"status":"ok","value":0.5,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p55","ndcg":0.9964,"p95_ms":5.6,"p99_ms":5.9,"parameter":"search_effort","recall":0.9952,"status":"ok","value":0.55,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p7","ndcg":0.9964,"p95_ms":5.9,"p99_ms":6.1,"parameter":"search_effort","recall":0.9952,"status":"ok","value":0.7,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p8","ndcg":0.9964,"p95_ms":5.8,"p99_ms":6,"parameter":"search_effort","recall":0.9952,"status":"ok","value":0.8,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p35","ndcg":0.9129,"p95_ms":23.8,"p99_ms":35.1,"parameter":"search_effort","recall":0.9024,"status":"ok","value":0.35,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p45","ndcg":0.9878,"p95_ms":5.5,"p99_ms":5.9,"parameter":"search_effort","recall":0.985,"status":"ok","value":0.45,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p475","ndcg":0.9941,"p95_ms":5.8,"p99_ms":6.1,"parameter":"search_effort","recall":0.9924,"status":"ok","value":0.475,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-1","ndcg":0.9964,"p95_ms":6.8,"p99_ms":7.5,"parameter":"search_effort","recall":0.9952,"status":"ok","value":1,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p375","ndcg":0.9414,"p95_ms":4.9,"p99_ms":5.2,"parameter":"search_effort","recall":0.9334,"status":"ok","value":0.375,"workload":"scale-fast-40k"}],"cell_sha256":"f8f6965b80242d7b74cca2df0ea0e7cc63d4cf45789b62ec0fab06740be2e0d7","index_build":{"insert_duration":7.5084,"optimize_duration":6.0566,"seconds":13.565000000000001},"lifecycle":{"cache_key":"4b3210e37ebcc5dffcd3b0f4498f77560cc15863df911ae20cc5a76df3dd9ce4","duration_seconds":631.8831629753113,"finished_at":1791445294.2646887,"object_sha256":"33666f2c8adc28acec98e9d369439cf28ba928f34c70b237a78334b745337744","receipt_sha256":"be30132801c28b50df92ec51f0f92a44ffb13dc4c9770f2e5c9a6dcaa8b66d82","started_at":1791444662.3815258},"memory":{"anon_shmem_peak_mb":1361,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":1598.5,"cgroup_current_peak_mb":1597.2,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":1361,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":1597161472,"cgroup_kernel_peak_sum_bytes":1598484480,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":1360982016,"ended":1791445274.0794775,"failed_samples":0,"first_sample_at":1791444665.666339,"kind":"container_cgroup_v2","last_sample_at":1791445273.861609,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":2944,"schema_version":3,"started":1791444665.644237,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791444665.666339,"index_started_at":1791444665.708516,"last_sample_at":1791445273.861609,"max_sample_gap_s":0.255,"publication_finished_at":1791445273.659341,"sampler_ended_at":1791445274.0794775,"sampler_started_at":1791444665.644237,"samples":2944,"status":"qualified","trial":2,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.00454147137488753,0.005573614884822391,0.0076237764866197814,0.015325100494128297,0.02343051320894541],"conc_latency_p95_list":[0.005075259767181706,0.006503763493674341,0.010418453501188193,0.025515185412950805,0.04219921102048829],"conc_latency_p99_list":[0.005568093195324762,0.00847143088438315,0.012213153428165242,0.03129806751501747,0.05264786839252343],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[219.7159,894.6863,1307.8567,1299.3589,1273.0317],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9574,"optimize_duration":0,"p99_c30_ms":52.64786839252343,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":10,"peak_qps":1307.8567,"qps":1307.8567,"qps_c30":1273.0317,"recall":0.951,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0049,"serial_latency_p99":0.0051,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9574,"recall":0.951,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":2},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":7.5,"load_s":13.6,"source_label":"antfly-qualification-scale-fast-40k-0p35"},"ndcg":0.9614,"p95_ms":5.3,"p99_ms":5.6,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9553,"selection_mode":"swept","value":0.4},"status":"ok","storage":{"created_at":"2026-10-08T07:31:03.004342+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"2","workload":"scale-fast-40k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T07:31:03.116410+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T07:31:03.116384+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-40k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T07:31:03.042046+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-40k-antfly-data"}]},"final":{"allocated_bytes":166739968,"apparent_bytes":166042869,"completed_at":"2026-10-08T07:41:14.636719+00:00","samples":[{"allocated_bytes":166739968,"apparent_bytes":166042869,"captured_at":"2026-10-08T07:41:14.636693+00:00","entries":391,"volumes":[{"allocated_bytes":166739968,"apparent_bytes":166042869,"entries":391,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-40k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T07:41:14.559867+00:00","termination":{"container":"antfly_bench_vdbb_scale_t2_scale-fast-40k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":166739968,"apparent_bytes":166042869,"entries":391,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-40k-antfly-data"}]},"post_workload":{"allocated_bytes":166735872,"apparent_bytes":166045906,"completed_at":"2026-10-08T07:41:14.266936+00:00","samples":[{"allocated_bytes":166735872,"apparent_bytes":166045906,"captured_at":"2026-10-08T07:41:14.266915+00:00","entries":388,"volumes":[{"allocated_bytes":166735872,"apparent_bytes":166045906,"entries":388,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-40k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T07:41:14.189649+00:00","volumes":[{"allocated_bytes":166735872,"apparent_bytes":166045906,"entries":388,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-40k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T07:31:05.563192+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T07:31:05.563169+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-40k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T07:31:05.485097+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-40k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t2_scale-fast-40k-antfly-data"}]},"protocol_fingerprint":"6f0a5c79057dbcc0b613d79a50f9f69ff77e9c3ddeb7fda585b8170217aa1261","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T07:41:14.636722+00:00"},"trial":2}],"metrics":{"demand_mb":{"max":2132.5,"mean":1746.75,"min":1361,"values":[2132.5,1361]},"final_allocated_bytes":{"max":166739968,"mean":166193152,"min":165646336,"values":[165646336,166739968]},"index_build_seconds":{"max":13.565000000000001,"mean":12.71995,"min":11.8749,"values":[11.8749,13.565000000000001]},"lifecycle_seconds":{"max":631.8831629753113,"mean":631.8343586921692,"min":631.7855544090271,"values":[631.7855544090271,631.8831629753113]},"peak_clients":{"max":20,"mean":15,"min":10,"values":[20,10]},"peak_qps":{"max":1394.9858,"mean":1351.4212499999999,"min":1307.8567,"values":[1394.9858,1307.8567]},"serial_p95_ms":{"max":4.9,"mean":4.9,"min":4.9,"values":[4.9,4.9]}},"profile":"fast","qualification":{"ndcg_min":0.9574,"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall_min":0.951,"request_errors":0,"trials":[{"ndcg":0.9576,"recall":0.9518,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":1},{"ndcg":0.9574,"recall":0.951,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":2}]},"storage_qualification":{"metric":"final_allocated_bytes","qualified_trials":2,"status":"qualified","total_trials":2,"trials":[{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"d42b4710fbf653ade53533f91140e28591cf182cfd844c8b229b23781e6a7e8d","status":"qualified","trial":1},{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"6f0a5c79057dbcc0b613d79a50f9f69ff77e9c3ddeb7fda585b8170217aa1261","status":"qualified","trial":2}]},"vectors":40000},{"concurrency_observations":[{"clients":1,"p95_ms":{"max":5.850485002156347,"mean":5.71654450322967,"min":5.582604004302993,"values":[5.850485002156347,5.582604004302993]},"p99_ms":{"max":7.2553824051283256,"mean":7.075612110202199,"min":6.895841815276073,"values":[7.2553824051283256,6.895841815276073]},"qps":{"max":210.2986,"mean":204.6538,"min":199.009,"values":[199.009,210.2986]}},{"clients":5,"p95_ms":{"max":7.100235001416877,"mean":6.981946396263083,"min":6.86365779110929,"values":[6.86365779110929,7.100235001416877]},"p99_ms":{"max":9.12540478835581,"mean":9.048141822568143,"min":8.970878856780475,"values":[9.12540478835581,8.970878856780475]},"qps":{"max":867.9956,"mean":851.9593,"min":835.923,"values":[835.923,867.9956]}},{"clients":10,"p95_ms":{"max":10.832840707735159,"mean":10.628231344890082,"min":10.423621982045006,"values":[10.832840707735159,10.423621982045006]},"p99_ms":{"max":12.81956848746632,"mean":12.609311399864968,"min":12.399054312263617,"values":[12.81956848746632,12.399054312263617]},"qps":{"max":1318.9556,"mean":1291.1150499999999,"min":1263.2745,"values":[1263.2745,1318.9556]}},{"clients":20,"p95_ms":{"max":27.181605389341705,"mean":26.111312720604467,"min":25.04102005186723,"values":[27.181605389341705,25.04102005186723]},"p99_ms":{"max":33.8121365522965,"mean":32.48159254362686,"min":31.151048534957212,"values":[33.8121365522965,31.151048534957212]},"qps":{"max":1334.6909,"mean":1288.2192,"min":1241.7475,"values":[1241.7475,1334.6909]}},{"clients":30,"p95_ms":{"max":44.03656224167207,"mean":42.54762761775055,"min":41.05869299382903,"values":[44.03656224167207,41.05869299382903]},"p99_ms":{"max":56.26031476276694,"mean":54.02131137889228,"min":51.78230799501762,"values":[56.26031476276694,51.78230799501762]},"qps":{"max":1304.6174,"mean":1263.5173,"min":1222.4172,"values":[1222.4172,1304.6174]}}],"concurrency_trials":[{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p6","ndcg":0.9968,"p95_ms":6.4,"p99_ms":7.2,"parameter":"search_effort","recall":0.9958,"status":"ok","value":0.6,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p375","ndcg":0.9372,"p95_ms":5.6,"p99_ms":6.4,"parameter":"search_effort","recall":0.9296,"status":"ok","value":0.375,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p7","ndcg":0.9969,"p95_ms":6.5,"p99_ms":7.5,"parameter":"search_effort","recall":0.9959,"status":"ok","value":0.7,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p55","ndcg":0.9967,"p95_ms":6.1,"p99_ms":6.4,"parameter":"search_effort","recall":0.9957,"status":"ok","value":0.55,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p5","ndcg":0.9966,"p95_ms":6.4,"p99_ms":6.8,"parameter":"search_effort","recall":0.9956,"status":"ok","value":0.5,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p4","ndcg":0.9594,"p95_ms":5.7,"p99_ms":6,"parameter":"search_effort","recall":0.9539,"status":"ok","value":0.4,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p425","ndcg":0.9784,"p95_ms":6,"p99_ms":6.3,"parameter":"search_effort","recall":0.9748,"status":"ok","value":0.425,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p475","ndcg":0.9946,"p95_ms":6,"p99_ms":6.6,"parameter":"search_effort","recall":0.9931,"status":"ok","value":0.475,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p35","ndcg":0.9085,"p95_ms":31.9,"p99_ms":41.8,"parameter":"search_effort","recall":0.8986,"status":"ok","value":0.35,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p45","ndcg":0.9892,"p95_ms":6,"p99_ms":6.4,"parameter":"search_effort","recall":0.9871,"status":"ok","value":0.45,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-1","ndcg":0.9969,"p95_ms":7.8,"p99_ms":8.1,"parameter":"search_effort","recall":0.9959,"status":"ok","value":1,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p8","ndcg":0.9969,"p95_ms":6.4,"p99_ms":6.8,"parameter":"search_effort","recall":0.9959,"status":"ok","value":0.8,"workload":"scale-fast-60k"}],"cell_sha256":"b844c468d6610822f7e72eb64786c8eb8821715abf60e98f2b79b0eada6dce84","index_build":{"insert_duration":11.5407,"optimize_duration":4.0497,"seconds":15.590399999999999},"lifecycle":{"cache_key":"5b149022770774bdbb55aa8c181de3662872332049e5032654209fd977e0c8e2","duration_seconds":631.8226687908173,"finished_at":1791417906.341576,"object_sha256":"7d32dcc723e4100a42b88de4e5c6439bb9e012c6e783c28d192d815d9ae3e5dc","receipt_sha256":"518ae6fc542e5626b25f211536658710d298ea544c0035f192db689bf5ebbc7f","started_at":1791417274.5189073},"memory":{"anon_shmem_peak_mb":2150.9,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":2470.8,"cgroup_current_peak_mb":2468.6,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":2150.9,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":2468605952,"cgroup_kernel_peak_sum_bytes":2470801408,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":2150903808,"ended":1791417889.4037967,"failed_samples":0,"first_sample_at":1791417277.7964303,"kind":"container_cgroup_v2","last_sample_at":1791417889.1814482,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":2962,"schema_version":3,"started":1791417277.7729177,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791417277.7964303,"index_started_at":1791417277.8343534,"last_sample_at":1791417889.1814482,"max_sample_gap_s":0.234,"publication_finished_at":1791417889.0286117,"sampler_ended_at":1791417889.4037967,"sampler_started_at":1791417277.7729177,"samples":2962,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.005015643521910728,0.0059668403171457525,0.007893238650205772,0.016038305267206027,0.02438005635598893],"conc_latency_p95_list":[0.005850485002156347,0.00686365779110929,0.010832840707735159,0.027181605389341706,0.04403656224167207],"conc_latency_p99_list":[0.007255382405128325,0.009125404788355811,0.01281956848746632,0.0338121365522965,0.05626031476276694],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[199.009,835.923,1263.2745,1241.7475,1222.4172],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9756,"optimize_duration":0,"p99_c30_ms":56.26031476276694,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":10,"peak_qps":1263.2745,"qps":1263.2745,"qps_c30":1222.4172,"recall":0.972,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0055,"serial_latency_p99":0.0059,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9756,"recall":0.972,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.425},"trial":1},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":11.5,"load_s":15.6,"source_label":"antfly-qualification-scale-fast-60k-0p35"},"ndcg":0.9784,"p95_ms":6,"p99_ms":6.3,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9748,"selection_mode":"swept","value":0.425},"status":"ok","storage":{"created_at":"2026-10-07T23:54:35.117061+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-fast-60k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-07T23:54:35.237432+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-07T23:54:35.237407+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-07T23:54:35.155203+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]},"final":{"allocated_bytes":248819712,"apparent_bytes":248089928,"completed_at":"2026-10-08T00:04:49.922593+00:00","samples":[{"allocated_bytes":248819712,"apparent_bytes":248089928,"captured_at":"2026-10-08T00:04:49.922568+00:00","entries":390,"volumes":[{"allocated_bytes":248819712,"apparent_bytes":248089928,"entries":390,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T00:04:49.835673+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-fast-60k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":248819712,"apparent_bytes":248089928,"entries":390,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]},"post_workload":{"allocated_bytes":248807424,"apparent_bytes":248089043,"completed_at":"2026-10-08T00:04:49.616796+00:00","samples":[{"allocated_bytes":248807424,"apparent_bytes":248089043,"captured_at":"2026-10-08T00:04:49.616770+00:00","entries":387,"volumes":[{"allocated_bytes":248807424,"apparent_bytes":248089043,"entries":387,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T00:04:49.523201+00:00","volumes":[{"allocated_bytes":248807424,"apparent_bytes":248089043,"entries":387,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-07T23:54:37.691279+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-07T23:54:37.691255+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-07T23:54:37.603067+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]},"protocol_fingerprint":"6dccbfe3e6bffdfd10c60388738e9e90ae52bd9eae4a6b897d05c6658c2d5243","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T00:04:49.922597+00:00"},"trial":1},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p45","ndcg":0.9897,"p95_ms":5.8,"p99_ms":6.1,"parameter":"search_effort","recall":0.9874,"status":"ok","value":0.45,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p6","ndcg":0.9965,"p95_ms":6.2,"p99_ms":6.6,"parameter":"search_effort","recall":0.9953,"status":"ok","value":0.6,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p375","ndcg":0.9432,"p95_ms":5.5,"p99_ms":6.5,"parameter":"search_effort","recall":0.9362,"status":"ok","value":0.375,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p8","ndcg":0.9965,"p95_ms":6.5,"p99_ms":6.7,"parameter":"search_effort","recall":0.9954,"status":"ok","value":0.8,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p55","ndcg":0.9963,"p95_ms":6.1,"p99_ms":6.6,"parameter":"search_effort","recall":0.9952,"status":"ok","value":0.55,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p4","ndcg":0.9653,"p95_ms":5.6,"p99_ms":6.3,"parameter":"search_effort","recall":0.9601,"status":"ok","value":0.4,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p425","ndcg":0.9805,"p95_ms":5.7,"p99_ms":6.4,"parameter":"search_effort","recall":0.9767,"status":"ok","value":0.425,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p35","ndcg":0.9162,"p95_ms":29.5,"p99_ms":40.6,"parameter":"search_effort","recall":0.9063,"status":"ok","value":0.35,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p475","ndcg":0.995,"p95_ms":6.1,"p99_ms":6.6,"parameter":"search_effort","recall":0.9936,"status":"ok","value":0.475,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p5","ndcg":0.9963,"p95_ms":6,"p99_ms":6.2,"parameter":"search_effort","recall":0.9951,"status":"ok","value":0.5,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p7","ndcg":0.9965,"p95_ms":6.5,"p99_ms":7.4,"parameter":"search_effort","recall":0.9954,"status":"ok","value":0.7,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-1","ndcg":0.9965,"p95_ms":7.9,"p99_ms":8.4,"parameter":"search_effort","recall":0.9954,"status":"ok","value":1,"workload":"scale-fast-60k"}],"cell_sha256":"d85638140ec64561ef7d10ae7370228f83d32f6d76dfc72c0a6f73b3b83b0568","index_build":{"insert_duration":11.5144,"optimize_duration":4.0453,"seconds":15.5597},"lifecycle":{"cache_key":"8b06e126971df10ce95e3ba74f389a91c64cb428f96681193dec327b2d696c61","duration_seconds":631.8736236095428,"finished_at":1791444661.9872365,"object_sha256":"6550265315541da8b75e5e51e304510770ec7114750293451ae63cd355767373","receipt_sha256":"1f3cedc46e6954265b37dd0fa72981ae3aad171a5f886f0086ecba532bf333a1","started_at":1791444030.113613},"memory":{"anon_shmem_peak_mb":1953.2,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":2272,"cgroup_current_peak_mb":2270.5,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":1953.2,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":2270474240,"cgroup_kernel_peak_sum_bytes":2272034816,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":1953198080,"ended":1791444643.8997514,"failed_samples":0,"first_sample_at":1791444033.3615847,"kind":"container_cgroup_v2","last_sample_at":1791444643.6804097,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":2955,"schema_version":3,"started":1791444033.3366938,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791444033.3615847,"index_started_at":1791444033.3994043,"last_sample_at":1791444643.6804097,"max_sample_gap_s":0.242,"publication_finished_at":1791444643.6116438,"sampler_ended_at":1791444643.8997514,"sampler_started_at":1791444033.3366938,"samples":2955,"status":"qualified","trial":2,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.004745712139737435,0.005745940237143748,0.007561742793800918,0.014921945626311536,0.022861052221398427],"conc_latency_p95_list":[0.005582604004302993,0.007100235001416877,0.010423621982045005,0.02504102005186723,0.04105869299382903],"conc_latency_p99_list":[0.006895841815276073,0.008970878856780475,0.012399054312263617,0.03115104853495721,0.05178230799501762],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[210.2986,867.9956,1318.9556,1334.6909,1304.6174],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9606,"optimize_duration":0,"p99_c30_ms":51.78230799501762,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":20,"peak_qps":1334.6909,"qps":1334.6909,"qps_c30":1304.6174,"recall":0.9552,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0052,"serial_latency_p99":0.0056,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9606,"recall":0.9552,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":2},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":11.5,"load_s":15.6,"source_label":"antfly-qualification-scale-fast-60k-0p35"},"ndcg":0.9653,"p95_ms":5.6,"p99_ms":6.3,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9601,"selection_mode":"swept","value":0.4},"status":"ok","storage":{"created_at":"2026-10-08T07:20:30.698416+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"2","workload":"scale-fast-60k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T07:20:30.809463+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T07:20:30.809438+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-60k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T07:20:30.735676+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-60k-antfly-data"}]},"final":{"allocated_bytes":249368576,"apparent_bytes":248637676,"completed_at":"2026-10-08T07:30:44.427577+00:00","samples":[{"allocated_bytes":249368576,"apparent_bytes":248637676,"captured_at":"2026-10-08T07:30:44.427552+00:00","entries":390,"volumes":[{"allocated_bytes":249368576,"apparent_bytes":248637676,"entries":390,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-60k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T07:30:44.352517+00:00","termination":{"container":"antfly_bench_vdbb_scale_t2_scale-fast-60k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":249368576,"apparent_bytes":248637676,"entries":390,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-60k-antfly-data"}]},"post_workload":{"allocated_bytes":249356288,"apparent_bytes":248636791,"completed_at":"2026-10-08T07:30:44.094146+00:00","samples":[{"allocated_bytes":249356288,"apparent_bytes":248636791,"captured_at":"2026-10-08T07:30:44.094121+00:00","entries":387,"volumes":[{"allocated_bytes":249356288,"apparent_bytes":248636791,"entries":387,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-60k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T07:30:44.014824+00:00","volumes":[{"allocated_bytes":249356288,"apparent_bytes":248636791,"entries":387,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-60k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T07:20:33.256650+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T07:20:33.256626+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-60k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T07:20:33.184388+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-60k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t2_scale-fast-60k-antfly-data"}]},"protocol_fingerprint":"7eac2c3f3ac1a4616a8991a65a3903a0dd0855d8a5dcfd778bc2857aecce326b","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T07:30:44.427580+00:00"},"trial":2}],"metrics":{"demand_mb":{"max":2150.9,"mean":2052.05,"min":1953.2,"values":[2150.9,1953.2]},"final_allocated_bytes":{"max":249368576,"mean":249094144,"min":248819712,"values":[248819712,249368576]},"index_build_seconds":{"max":15.590399999999999,"mean":15.57505,"min":15.5597,"values":[15.590399999999999,15.5597]},"lifecycle_seconds":{"max":631.8736236095428,"mean":631.84814620018,"min":631.8226687908173,"values":[631.8226687908173,631.8736236095428]},"peak_clients":{"max":20,"mean":15,"min":10,"values":[10,20]},"peak_qps":{"max":1334.6909,"mean":1298.9827,"min":1263.2745,"values":[1263.2745,1334.6909]},"serial_p95_ms":{"max":5.5,"mean":5.35,"min":5.2,"values":[5.5,5.2]}},"profile":"fast","qualification":{"ndcg_min":0.9606,"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall_min":0.9552,"request_errors":0,"trials":[{"ndcg":0.9756,"recall":0.972,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.425},"trial":1},{"ndcg":0.9606,"recall":0.9552,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":2}]},"storage_qualification":{"metric":"final_allocated_bytes","qualified_trials":2,"status":"qualified","total_trials":2,"trials":[{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"6dccbfe3e6bffdfd10c60388738e9e90ae52bd9eae4a6b897d05c6658c2d5243","status":"qualified","trial":1},{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"7eac2c3f3ac1a4616a8991a65a3903a0dd0855d8a5dcfd778bc2857aecce326b","status":"qualified","trial":2}]},"vectors":60000},{"concurrency_observations":[{"clients":1,"p95_ms":{"max":6.189395097317173,"mean":6.153598881792277,"min":6.117802666267381,"values":[6.117802666267381,6.189395097317173]},"p99_ms":{"max":8.626453623583076,"mean":8.41385880601593,"min":8.201263988448783,"values":[8.201263988448783,8.626453623583076]},"qps":{"max":196.921,"mean":196.8731,"min":196.8252,"values":[196.921,196.8252]}},{"clients":5,"p95_ms":{"max":7.024981347785794,"mean":6.95902276856941,"min":6.8930641893530264,"values":[6.8930641893530264,7.024981347785794]},"p99_ms":{"max":9.28470050857868,"mean":9.277892812824575,"min":9.271085117070468,"values":[9.28470050857868,9.271085117070468]},"qps":{"max":833.0406,"mean":830.0101,"min":826.9796,"values":[833.0406,826.9796]}},{"clients":10,"p95_ms":{"max":11.275936740275938,"mean":11.269993865425931,"min":11.264050990575925,"values":[11.264050990575925,11.275936740275938]},"p99_ms":{"max":13.480745238484818,"mean":13.429033722059105,"min":13.37732220563339,"values":[13.480745238484818,13.37732220563339]},"qps":{"max":1236.0612,"mean":1235.6032,"min":1235.1452,"values":[1235.1452,1236.0612]}},{"clients":20,"p95_ms":{"max":27.305808005621657,"mean":27.029516131733544,"min":26.75322425784543,"values":[26.75322425784543,27.305808005621657]},"p99_ms":{"max":33.35095135553269,"mean":33.106747276906354,"min":32.862543198280015,"values":[32.862543198280015,33.35095135553269]},"qps":{"max":1257.4715,"mean":1241.48585,"min":1225.5002,"values":[1257.4715,1225.5002]}},{"clients":30,"p95_ms":{"max":44.491865998133996,"mean":43.59650657279414,"min":42.701147147454286,"values":[44.491865998133996,42.701147147454286]},"p99_ms":{"max":56.92263799021019,"mean":55.16282164346191,"min":53.40300529671364,"values":[56.92263799021019,53.40300529671364]},"qps":{"max":1241.4726,"mean":1237.00865,"min":1232.5447,"values":[1232.5447,1241.4726]}}],"concurrency_trials":[{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p55","ndcg":0.9969,"p95_ms":6.6,"p99_ms":7.4,"parameter":"search_effort","recall":0.9959,"status":"ok","value":0.55,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p6","ndcg":0.9969,"p95_ms":6.8,"p99_ms":7.3,"parameter":"search_effort","recall":0.9959,"status":"ok","value":0.6,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p425","ndcg":0.9791,"p95_ms":6.6,"p99_ms":6.9,"parameter":"search_effort","recall":0.9755,"status":"ok","value":0.425,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-1","ndcg":0.9969,"p95_ms":8.7,"p99_ms":9.4,"parameter":"search_effort","recall":0.9959,"status":"ok","value":1,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p475","ndcg":0.9957,"p95_ms":6.9,"p99_ms":7.6,"parameter":"search_effort","recall":0.9946,"status":"ok","value":0.475,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p8","ndcg":0.9969,"p95_ms":7.2,"p99_ms":7.4,"parameter":"search_effort","recall":0.9959,"status":"ok","value":0.8,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p7","ndcg":0.9969,"p95_ms":6.9,"p99_ms":7.2,"parameter":"search_effort","recall":0.9959,"status":"ok","value":0.7,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p45","ndcg":0.99,"p95_ms":6.9,"p99_ms":7.3,"parameter":"search_effort","recall":0.9878,"status":"ok","value":0.45,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p375","ndcg":0.9425,"p95_ms":5.8,"p99_ms":6.1,"parameter":"search_effort","recall":0.9348,"status":"ok","value":0.375,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p35","ndcg":0.9148,"p95_ms":31.9,"p99_ms":46.8,"parameter":"search_effort","recall":0.9044,"status":"ok","value":0.35,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p5","ndcg":0.9968,"p95_ms":6.9,"p99_ms":7.5,"parameter":"search_effort","recall":0.9957,"status":"ok","value":0.5,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p4","ndcg":0.9643,"p95_ms":5.9,"p99_ms":6.6,"parameter":"search_effort","recall":0.9586,"status":"ok","value":0.4,"workload":"scale-fast-80k"}],"cell_sha256":"79b423ef96b920f986db3b6557668ed1e94d181f4047131182657e1a46c11c5a","index_build":{"insert_duration":15.4031,"optimize_duration":6.05,"seconds":21.4531},"lifecycle":{"cache_key":"6f98d012b1c5761ce1c56754f4836c1f2e6edd12717989e97093f4de4b756f00","duration_seconds":631.8429760932922,"finished_at":1791418538.566339,"object_sha256":"412991492f2836b25b479586bfdf5cf0806f62df534c799cfcbe79f6f249740f","receipt_sha256":"77b8175de79dd0743faffd425d2b8693c7f480f1999db7fdf8d7a6dea96fe414","started_at":1791417906.723363},"memory":{"anon_shmem_peak_mb":2226.4,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":2621.2,"cgroup_current_peak_mb":2618.7,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":2226.4,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":2618712064,"cgroup_kernel_peak_sum_bytes":2621239296,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":2226401280,"ended":1791418526.6814709,"failed_samples":0,"first_sample_at":1791417910.0743804,"kind":"container_cgroup_v2","last_sample_at":1791418526.4633377,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":2985,"schema_version":3,"started":1791417910.0532181,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791417910.0743804,"index_started_at":1791417910.113944,"last_sample_at":1791418526.4633377,"max_sample_gap_s":0.229,"publication_finished_at":1791418526.3280761,"sampler_ended_at":1791418526.6814709,"sampler_started_at":1791417910.0532181,"samples":2985,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.005067201552279781,0.005988266503588489,0.00807211704324574,0.015830380858295388,0.02415581947249847],"conc_latency_p95_list":[0.006117802666267381,0.006893064189353026,0.011264050990575925,0.02675322425784543,0.044491865998134],"conc_latency_p99_list":[0.008201263988448783,0.00928470050857868,0.013480745238484818,0.03286254319828002,0.05692263799021019],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[196.921,833.0406,1235.1452,1257.4715,1232.5447],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9593,"optimize_duration":0,"p99_c30_ms":56.92263799021019,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":20,"peak_qps":1257.4715,"qps":1257.4715,"qps_c30":1232.5447,"recall":0.9542,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0056,"serial_latency_p99":0.0059,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9593,"recall":0.9542,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":1},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":15.4,"load_s":21.5,"source_label":"antfly-qualification-scale-fast-80k-0p35"},"ndcg":0.9643,"p95_ms":5.9,"p99_ms":6.6,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9586,"selection_mode":"swept","value":0.4},"status":"ok","storage":{"created_at":"2026-10-08T00:05:07.349575+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-fast-80k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T00:05:07.472589+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T00:05:07.472555+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T00:05:07.389821+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]},"final":{"allocated_bytes":330031104,"apparent_bytes":329318586,"completed_at":"2026-10-08T00:15:27.246304+00:00","samples":[{"allocated_bytes":330031104,"apparent_bytes":329318586,"captured_at":"2026-10-08T00:15:27.246277+00:00","entries":393,"volumes":[{"allocated_bytes":330031104,"apparent_bytes":329318586,"entries":393,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T00:15:27.168603+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-fast-80k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":330031104,"apparent_bytes":329318586,"entries":393,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]},"post_workload":{"allocated_bytes":330027008,"apparent_bytes":329321621,"completed_at":"2026-10-08T00:15:26.887301+00:00","samples":[{"allocated_bytes":330027008,"apparent_bytes":329321621,"captured_at":"2026-10-08T00:15:26.887270+00:00","entries":390,"volumes":[{"allocated_bytes":330027008,"apparent_bytes":329321621,"entries":390,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T00:15:26.792457+00:00","volumes":[{"allocated_bytes":330027008,"apparent_bytes":329321621,"entries":390,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T00:05:09.970986+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T00:05:09.970961+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T00:05:09.885138+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]},"protocol_fingerprint":"c9fd9a93889ea2b23201ff65083afa1109545c45a1ad0a11c490908348101b7c","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T00:15:27.246308+00:00"},"trial":1},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p425","ndcg":0.9823,"p95_ms":6.3,"p99_ms":6.8,"parameter":"search_effort","recall":0.979,"status":"ok","value":0.425,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p35","ndcg":0.9175,"p95_ms":36,"p99_ms":45.1,"parameter":"search_effort","recall":0.9064,"status":"ok","value":0.35,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p6","ndcg":0.9968,"p95_ms":6.7,"p99_ms":7.5,"parameter":"search_effort","recall":0.9958,"status":"ok","value":0.6,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p45","ndcg":0.9911,"p95_ms":6.6,"p99_ms":7,"parameter":"search_effort","recall":0.989,"status":"ok","value":0.45,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p5","ndcg":0.9968,"p95_ms":6.6,"p99_ms":7.4,"parameter":"search_effort","recall":0.9958,"status":"ok","value":0.5,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p8","ndcg":0.9969,"p95_ms":7.1,"p99_ms":7.7,"parameter":"search_effort","recall":0.9959,"status":"ok","value":0.8,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p7","ndcg":0.9969,"p95_ms":6.8,"p99_ms":7.6,"parameter":"search_effort","recall":0.9959,"status":"ok","value":0.7,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p475","ndcg":0.9955,"p95_ms":6.5,"p99_ms":7.3,"parameter":"search_effort","recall":0.9942,"status":"ok","value":0.475,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p375","ndcg":0.9464,"p95_ms":5.9,"p99_ms":6.4,"parameter":"search_effort","recall":0.9382,"status":"ok","value":0.375,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-1","ndcg":0.9969,"p95_ms":8.7,"p99_ms":9,"parameter":"search_effort","recall":0.9959,"status":"ok","value":1,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p55","ndcg":0.9967,"p95_ms":6.5,"p99_ms":6.8,"parameter":"search_effort","recall":0.9956,"status":"ok","value":0.55,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p4","ndcg":0.9674,"p95_ms":6.1,"p99_ms":6.7,"parameter":"search_effort","recall":0.9619,"status":"ok","value":0.4,"workload":"scale-fast-80k"}],"cell_sha256":"bd7fc43fe6f7843247b49c9857cf40dae403d8a3005b300cf333a0f0e78cc391","index_build":{"insert_duration":15.3717,"optimize_duration":8.0601,"seconds":23.431800000000003},"lifecycle":{"cache_key":"394ce38b181b08be162cdb51defd7cf9857067c243c380fe57e0bb04ce625772","duration_seconds":661.9016163349152,"finished_at":1791444029.7363853,"object_sha256":"9dee85f1ec78e126f41e06ae0b75bb52dc3426ef07f59b55b4612627fcdd34f7","receipt_sha256":"a2182611ab852d53a63be2519e569913e273c0a686b1510b258f050231ecccf2","started_at":1791443367.834769},"memory":{"anon_shmem_peak_mb":2296.9,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":2690.1,"cgroup_current_peak_mb":2688,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":2296.9,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":2687950848,"cgroup_kernel_peak_sum_bytes":2690060288,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":2296926208,"ended":1791443989.8713312,"failed_samples":0,"first_sample_at":1791443371.2304344,"kind":"container_cgroup_v2","last_sample_at":1791443989.6531947,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":2996,"schema_version":3,"started":1791443371.2048779,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791443371.2304344,"index_started_at":1791443371.259569,"last_sample_at":1791443989.6531947,"max_sample_gap_s":0.227,"publication_finished_at":1791443989.5793002,"sampler_ended_at":1791443989.8713312,"sampler_started_at":1791443371.2048779,"samples":2996,"status":"qualified","trial":2,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.005074005927782631,0.006031322551746405,0.008067901985633013,0.016255223800318835,0.02402529770958815],"conc_latency_p95_list":[0.006189395097317173,0.0070249813477857945,0.011275936740275938,0.027305808005621657,0.04270114714745429],"conc_latency_p99_list":[0.008626453623583077,0.009271085117070468,0.013377322205633391,0.03335095135553269,0.053403005296713636],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[196.8252,826.9796,1236.0612,1225.5002,1241.4726],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9637,"optimize_duration":0,"p99_c30_ms":53.40300529671364,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":30,"peak_qps":1241.4726,"qps":1241.4726,"qps_c30":1241.4726,"recall":0.9585,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0054,"serial_latency_p99":0.0057,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9637,"recall":0.9585,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":2},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":15.4,"load_s":23.4,"source_label":"antfly-qualification-scale-fast-80k-0p35"},"ndcg":0.9674,"p95_ms":6.1,"p99_ms":6.7,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9619,"selection_mode":"swept","value":0.4},"status":"ok","storage":{"created_at":"2026-10-08T07:09:28.491233+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"2","workload":"scale-fast-80k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T07:09:28.622124+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T07:09:28.622099+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-80k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T07:09:28.530180+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-80k-antfly-data"}]},"final":{"allocated_bytes":329883648,"apparent_bytes":329179909,"completed_at":"2026-10-08T07:19:50.447477+00:00","samples":[{"allocated_bytes":329883648,"apparent_bytes":329179909,"captured_at":"2026-10-08T07:19:50.447451+00:00","entries":390,"volumes":[{"allocated_bytes":329883648,"apparent_bytes":329179909,"entries":390,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-80k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T07:19:50.371319+00:00","termination":{"container":"antfly_bench_vdbb_scale_t2_scale-fast-80k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":329883648,"apparent_bytes":329179909,"entries":390,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-80k-antfly-data"}]},"post_workload":{"allocated_bytes":329875456,"apparent_bytes":329179008,"completed_at":"2026-10-08T07:19:50.055468+00:00","samples":[{"allocated_bytes":329875456,"apparent_bytes":329179008,"captured_at":"2026-10-08T07:19:50.055443+00:00","entries":387,"volumes":[{"allocated_bytes":329875456,"apparent_bytes":329179008,"entries":387,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-80k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T07:19:49.982390+00:00","volumes":[{"allocated_bytes":329875456,"apparent_bytes":329179008,"entries":387,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-80k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T07:09:31.116069+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T07:09:31.116046+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-80k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T07:09:31.031113+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-80k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t2_scale-fast-80k-antfly-data"}]},"protocol_fingerprint":"1c90a83d40b32e480519f6aa8d0a5c462cbf8f660169d3217d3da2c74f10d916","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T07:19:50.447480+00:00"},"trial":2}],"metrics":{"demand_mb":{"max":2296.9,"mean":2261.65,"min":2226.4,"values":[2226.4,2296.9]},"final_allocated_bytes":{"max":330031104,"mean":329957376,"min":329883648,"values":[330031104,329883648]},"index_build_seconds":{"max":23.431800000000003,"mean":22.44245,"min":21.4531,"values":[21.4531,23.431800000000003]},"lifecycle_seconds":{"max":661.9016163349152,"mean":646.8722962141037,"min":631.8429760932922,"values":[631.8429760932922,661.9016163349152]},"peak_clients":{"max":30,"mean":25,"min":20,"values":[20,30]},"peak_qps":{"max":1257.4715,"mean":1249.47205,"min":1241.4726,"values":[1257.4715,1241.4726]},"serial_p95_ms":{"max":5.6,"mean":5.5,"min":5.4,"values":[5.6,5.4]}},"profile":"fast","qualification":{"ndcg_min":0.9593,"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall_min":0.9542,"request_errors":0,"trials":[{"ndcg":0.9593,"recall":0.9542,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":1},{"ndcg":0.9637,"recall":0.9585,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":2}]},"storage_qualification":{"metric":"final_allocated_bytes","qualified_trials":2,"status":"qualified","total_trials":2,"trials":[{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"c9fd9a93889ea2b23201ff65083afa1109545c45a1ad0a11c490908348101b7c","status":"qualified","trial":1},{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"1c90a83d40b32e480519f6aa8d0a5c462cbf8f660169d3217d3da2c74f10d916","status":"qualified","trial":2}]},"vectors":80000},{"concurrency_observations":[{"clients":1,"p95_ms":{"max":6.935102446004748,"mean":6.875583274813834,"min":6.816064103622919,"values":[6.816064103622919,6.935102446004748]},"p99_ms":{"max":9.798959093459406,"mean":9.66354054267867,"min":9.528121991897933,"values":[9.528121991897933,9.798959093459406]},"qps":{"max":186.9016,"mean":185.79305,"min":184.6845,"values":[186.9016,184.6845]}},{"clients":5,"p95_ms":{"max":7.48181229282635,"mean":7.2964673985552455,"min":7.11112250428414,"values":[7.11112250428414,7.48181229282635]},"p99_ms":{"max":9.943580513936467,"mean":9.902998765755918,"min":9.86241701757537,"values":[9.86241701757537,9.943580513936467]},"qps":{"max":804.7051,"mean":798.6107999999999,"min":792.5165,"values":[804.7051,792.5165]}},{"clients":10,"p95_ms":{"max":11.433521503931841,"mean":11.29972832932253,"min":11.165935154713221,"values":[11.165935154713221,11.433521503931841]},"p99_ms":{"max":13.471017398987897,"mean":13.344277588039407,"min":13.217537777090916,"values":[13.217537777090916,13.471017398987897]},"qps":{"max":1230.8279,"mean":1218.42105,"min":1206.0142,"values":[1230.8279,1206.0142]}},{"clients":20,"p95_ms":{"max":27.681361696159005,"mean":27.22398136756965,"min":26.766601038980298,"values":[26.766601038980298,27.681361696159005]},"p99_ms":{"max":34.34714074392103,"mean":33.70088863768618,"min":33.054636531451315,"values":[33.054636531451315,34.34714074392103]},"qps":{"max":1238.0174,"mean":1222.93665,"min":1207.8559,"values":[1238.0174,1207.8559]}},{"clients":30,"p95_ms":{"max":44.05718150519533,"mean":43.552087128773564,"min":43.0469927523518,"values":[43.0469927523518,44.05718150519533]},"p99_ms":{"max":56.23919245990691,"mean":55.15628138164175,"min":54.073370303376585,"values":[54.073370303376585,56.23919245990691]},"qps":{"max":1215.3696,"mean":1211.1403500000001,"min":1206.9111,"values":[1215.3696,1206.9111]}}],"concurrency_trials":[{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p35","ndcg":0.9154,"p95_ms":37.6,"p99_ms":47.1,"parameter":"search_effort","recall":0.907,"status":"ok","value":0.35,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p4","ndcg":0.9663,"p95_ms":6.7,"p99_ms":7.3,"parameter":"search_effort","recall":0.961,"status":"ok","value":0.4,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p5","ndcg":0.9962,"p95_ms":7.3,"p99_ms":7.8,"parameter":"search_effort","recall":0.995,"status":"ok","value":0.5,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p6","ndcg":0.9965,"p95_ms":7.6,"p99_ms":8,"parameter":"search_effort","recall":0.9954,"status":"ok","value":0.6,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p475","ndcg":0.9953,"p95_ms":7,"p99_ms":7.7,"parameter":"search_effort","recall":0.9941,"status":"ok","value":0.475,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p425","ndcg":0.9811,"p95_ms":6.6,"p99_ms":7.1,"parameter":"search_effort","recall":0.9777,"status":"ok","value":0.425,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-1","ndcg":0.9966,"p95_ms":9.6,"p99_ms":10.5,"parameter":"search_effort","recall":0.9955,"status":"ok","value":1,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p8","ndcg":0.9966,"p95_ms":7.7,"p99_ms":8.7,"parameter":"search_effort","recall":0.9954,"status":"ok","value":0.8,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p45","ndcg":0.9903,"p95_ms":7,"p99_ms":8.1,"parameter":"search_effort","recall":0.9885,"status":"ok","value":0.45,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p55","ndcg":0.9963,"p95_ms":7.5,"p99_ms":8,"parameter":"search_effort","recall":0.9952,"status":"ok","value":0.55,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p375","ndcg":0.9452,"p95_ms":6.6,"p99_ms":7.6,"parameter":"search_effort","recall":0.9381,"status":"ok","value":0.375,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p7","ndcg":0.9966,"p95_ms":7.2,"p99_ms":7.7,"parameter":"search_effort","recall":0.9954,"status":"ok","value":0.7,"workload":"scale-fast-100k"}],"cell_sha256":"7fad2ae3a694b8ea3ab32fe1e3bd0e0fac9b5e881059f8200b7af99fcf4a2217","index_build":{"insert_duration":18.6002,"optimize_duration":8.0555,"seconds":26.655700000000003},"lifecycle":{"cache_key":"589936f94a64672406de34b07e4b04657b02372e5d3bf16170e4af51a8011e64","duration_seconds":661.9279553890228,"finished_at":1791419200.9026754,"object_sha256":"e707efebd94d502c89a6d1213d0d2802dd294c14275f074bcf8aa5f06888ddd6","receipt_sha256":"0816593f89c7e16a1c9df1bbb41d79205ae7f9e267cb7a13969564eb7937adda","started_at":1791418538.97472},"memory":{"anon_shmem_peak_mb":2183,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":2650.3,"cgroup_current_peak_mb":2647.9,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":2183,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":2647891968,"cgroup_kernel_peak_sum_bytes":2650324992,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":2182955008,"ended":1791419166.0112715,"failed_samples":0,"first_sample_at":1791418542.3501964,"kind":"container_cgroup_v2","last_sample_at":1791419165.7980442,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":3019,"schema_version":3,"started":1791418542.3246565,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791418542.3501964,"index_started_at":1791418542.3823795,"last_sample_at":1791419165.7980442,"max_sample_gap_s":0.264,"publication_finished_at":1791419165.6670074,"sampler_ended_at":1791419166.0112715,"sampler_started_at":1791418542.3246565,"samples":3019,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.005339145346427087,0.00620199400643793,0.008101336196762761,0.016080277682715444,0.02450634293167263],"conc_latency_p95_list":[0.006816064103622919,0.00711112250428414,0.011165935154713221,0.0267666010389803,0.0430469927523518],"conc_latency_p99_list":[0.009528121991897932,0.00986241701757537,0.013217537777090916,0.03305463653145132,0.05407337030337658],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[186.9016,804.7051,1230.8279,1238.0174,1215.3696],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9634,"optimize_duration":0,"p99_c30_ms":54.073370303376585,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":20,"peak_qps":1238.0174,"qps":1238.0174,"qps_c30":1215.3696,"recall":0.9584,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0058,"serial_latency_p99":0.0063,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9634,"recall":0.9584,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":1},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":18.6,"load_s":26.7,"source_label":"antfly-qualification-scale-fast-100k-0p35"},"ndcg":0.9663,"p95_ms":6.7,"p99_ms":7.3,"parameter":"search_effort","qualification_floor":0.955,"recall":0.961,"selection_mode":"swept","value":0.4},"status":"ok","storage":{"created_at":"2026-10-08T00:15:39.626565+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-fast-100k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T00:15:39.743993+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T00:15:39.743970+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T00:15:39.665309+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]},"final":{"allocated_bytes":413728768,"apparent_bytes":413047786,"completed_at":"2026-10-08T00:26:06.609275+00:00","samples":[{"allocated_bytes":413728768,"apparent_bytes":413047786,"captured_at":"2026-10-08T00:26:06.609248+00:00","entries":388,"volumes":[{"allocated_bytes":413728768,"apparent_bytes":413047786,"entries":388,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T00:26:06.532129+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-fast-100k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":413728768,"apparent_bytes":413047786,"entries":388,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]},"post_workload":{"allocated_bytes":413724672,"apparent_bytes":413050819,"completed_at":"2026-10-08T00:26:06.224709+00:00","samples":[{"allocated_bytes":413724672,"apparent_bytes":413050819,"captured_at":"2026-10-08T00:26:06.224683+00:00","entries":385,"volumes":[{"allocated_bytes":413724672,"apparent_bytes":413050819,"entries":385,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T00:26:06.123779+00:00","volumes":[{"allocated_bytes":413724672,"apparent_bytes":413050819,"entries":385,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T00:15:42.239509+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T00:15:42.239484+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T00:15:42.151287+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]},"protocol_fingerprint":"f3eb11ce0948b21d059386a040aaf499b99ab83dbd317d4391cc6c7ede2739d0","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T00:26:06.609279+00:00"},"trial":1},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p55","ndcg":0.9966,"p95_ms":7.5,"p99_ms":8.4,"parameter":"search_effort","recall":0.9955,"status":"ok","value":0.55,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p35","ndcg":0.9153,"p95_ms":36.6,"p99_ms":54.2,"parameter":"search_effort","recall":0.9058,"status":"ok","value":0.35,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-1","ndcg":0.9968,"p95_ms":9.6,"p99_ms":10,"parameter":"search_effort","recall":0.9957,"status":"ok","value":1,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p425","ndcg":0.9808,"p95_ms":7.1,"p99_ms":8.3,"parameter":"search_effort","recall":0.9784,"status":"ok","value":0.425,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p6","ndcg":0.9967,"p95_ms":7.6,"p99_ms":8.1,"parameter":"search_effort","recall":0.9957,"status":"ok","value":0.6,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p5","ndcg":0.9965,"p95_ms":7.6,"p99_ms":8.6,"parameter":"search_effort","recall":0.9954,"status":"ok","value":0.5,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p475","ndcg":0.9952,"p95_ms":10.3,"p99_ms":11.3,"parameter":"search_effort","recall":0.9938,"status":"ok","value":0.475,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p375","ndcg":0.9464,"p95_ms":6.3,"p99_ms":6.8,"parameter":"search_effort","recall":0.94,"status":"ok","value":0.375,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p45","ndcg":0.9903,"p95_ms":7.3,"p99_ms":7.9,"parameter":"search_effort","recall":0.9884,"status":"ok","value":0.45,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p8","ndcg":0.9968,"p95_ms":7.5,"p99_ms":8.3,"parameter":"search_effort","recall":0.9957,"status":"ok","value":0.8,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p7","ndcg":0.9967,"p95_ms":7.3,"p99_ms":8.1,"parameter":"search_effort","recall":0.9957,"status":"ok","value":0.7,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p4","ndcg":0.967,"p95_ms":6.8,"p99_ms":7.2,"parameter":"search_effort","recall":0.9627,"status":"ok","value":0.4,"workload":"scale-fast-100k"}],"cell_sha256":"70d1a5b012bb7be769c704807b888bd6f5f5515f8f31bc8126c66b4d7c911639","index_build":{"insert_duration":19.0172,"optimize_duration":8.0607,"seconds":27.0779},"lifecycle":{"cache_key":"224c0d8ff234b49a4adcebb3a9fd76bc5dc4972340fab2d8a6b1ad6721dcf98a","duration_seconds":661.8190445899963,"finished_at":1791443367.4590273,"object_sha256":"e6a73b85ed69a43067203f425d78cad22dcbd20105da313229a752db1208adce","receipt_sha256":"fa5901508a3904d3c9e239c301ae0109721adca04b2f0aab89ecc76b83e51c5d","started_at":1791442705.6399827},"memory":{"anon_shmem_peak_mb":2275.8,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":2742,"cgroup_current_peak_mb":2740,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":2275.8,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":2739994624,"cgroup_kernel_peak_sum_bytes":2742026240,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":2275827712,"ended":1791443333.6604843,"failed_samples":0,"first_sample_at":1791442708.9994667,"kind":"container_cgroup_v2","last_sample_at":1791443333.442881,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":3027,"schema_version":3,"started":1791442708.974208,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791442708.9994667,"index_started_at":1791442709.0312803,"last_sample_at":1791443333.442881,"max_sample_gap_s":0.28,"publication_finished_at":1791443333.2847161,"sampler_ended_at":1791443333.6604843,"sampler_started_at":1791442708.974208,"samples":3027,"status":"qualified","trial":2,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.00540358084916037,0.006293354212640867,0.008267385426694206,0.016486428184737882,0.024721116555794752],"conc_latency_p95_list":[0.006935102446004748,0.00748181229282635,0.011433521503931841,0.027681361696159004,0.04405718150519533],"conc_latency_p99_list":[0.009798959093459406,0.009943580513936467,0.013471017398987897,0.034347140743921034,0.05623919245990691],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[184.6845,792.5165,1206.0142,1207.8559,1206.9111],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9631,"optimize_duration":0,"p99_c30_ms":56.23919245990691,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":20,"peak_qps":1207.8559,"qps":1207.8559,"qps_c30":1206.9111,"recall":0.9585,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0057,"serial_latency_p99":0.006,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9631,"recall":0.9585,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":2},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":19,"load_s":27.1,"source_label":"antfly-qualification-scale-fast-100k-0p35"},"ndcg":0.967,"p95_ms":6.8,"p99_ms":7.2,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9627,"selection_mode":"swept","value":0.4},"status":"ok","storage":{"created_at":"2026-10-08T06:58:26.289137+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"2","workload":"scale-fast-100k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T06:58:26.408450+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T06:58:26.408423+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-100k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T06:58:26.327135+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-100k-antfly-data"}]},"final":{"allocated_bytes":412139520,"apparent_bytes":411455896,"completed_at":"2026-10-08T07:08:54.258374+00:00","samples":[{"allocated_bytes":412139520,"apparent_bytes":411455896,"captured_at":"2026-10-08T07:08:54.258351+00:00","entries":391,"volumes":[{"allocated_bytes":412139520,"apparent_bytes":411455896,"entries":391,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-100k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T07:08:54.179732+00:00","termination":{"container":"antfly_bench_vdbb_scale_t2_scale-fast-100k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":412139520,"apparent_bytes":411455896,"entries":391,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-100k-antfly-data"}]},"post_workload":{"allocated_bytes":412139520,"apparent_bytes":411459875,"completed_at":"2026-10-08T07:08:53.854074+00:00","samples":[{"allocated_bytes":412139520,"apparent_bytes":411459875,"captured_at":"2026-10-08T07:08:53.854049+00:00","entries":389,"volumes":[{"allocated_bytes":412139520,"apparent_bytes":411459875,"entries":389,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-100k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T07:08:53.771895+00:00","volumes":[{"allocated_bytes":412139520,"apparent_bytes":411459875,"entries":389,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-100k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T06:58:28.889240+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T06:58:28.889215+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-100k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T06:58:28.807711+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-fast-100k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t2_scale-fast-100k-antfly-data"}]},"protocol_fingerprint":"d19cb671e0cd4a5606c6415c4545f42a2c9016a8f89a5063abe057cddff5268d","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T07:08:54.258377+00:00"},"trial":2}],"metrics":{"demand_mb":{"max":2275.8,"mean":2229.4,"min":2183,"values":[2183,2275.8]},"final_allocated_bytes":{"max":413728768,"mean":412934144,"min":412139520,"values":[413728768,412139520]},"index_build_seconds":{"max":27.0779,"mean":26.8668,"min":26.655700000000003,"values":[26.655700000000003,27.0779]},"lifecycle_seconds":{"max":661.9279553890228,"mean":661.8734999895096,"min":661.8190445899963,"values":[661.9279553890228,661.8190445899963]},"peak_clients":{"max":20,"mean":20,"min":20,"values":[20,20]},"peak_qps":{"max":1238.0174,"mean":1222.93665,"min":1207.8559,"values":[1238.0174,1207.8559]},"serial_p95_ms":{"max":5.8,"mean":5.75,"min":5.7,"values":[5.8,5.7]}},"profile":"fast","qualification":{"ndcg_min":0.9631,"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall_min":0.9584,"request_errors":0,"trials":[{"ndcg":0.9634,"recall":0.9584,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":1},{"ndcg":0.9631,"recall":0.9585,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":2}]},"storage_qualification":{"metric":"final_allocated_bytes","qualified_trials":2,"status":"qualified","total_trials":2,"trials":[{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"f3eb11ce0948b21d059386a040aaf499b99ab83dbd317d4391cc6c7ede2739d0","status":"qualified","trial":1},{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"d19cb671e0cd4a5606c6415c4545f42a2c9016a8f89a5063abe057cddff5268d","status":"qualified","trial":2}]},"vectors":100000},{"concurrency_observations":[{"clients":1,"p95_ms":{"max":9.443339199060574,"mean":9.192660709959453,"min":8.941982220858332,"values":[9.443339199060574,8.941982220858332]},"p99_ms":{"max":13.832073475350628,"mean":13.309118360339202,"min":12.786163245327776,"values":[13.832073475350628,12.786163245327776]},"qps":{"max":170.5932,"mean":169.77134999999998,"min":168.9495,"values":[168.9495,170.5932]}},{"clients":5,"p95_ms":{"max":8.63692078419262,"mean":8.45173158377292,"min":8.26654238335322,"values":[8.63692078419262,8.26654238335322]},"p99_ms":{"max":10.44013331527822,"mean":10.408303725998856,"min":10.376474136719489,"values":[10.44013331527822,10.376474136719489]},"qps":{"max":770.5304,"mean":767.8467499999999,"min":765.1631,"values":[770.5304,765.1631]}},{"clients":10,"p95_ms":{"max":11.923250494874083,"mean":11.84015105245635,"min":11.757051610038614,"values":[11.923250494874083,11.757051610038614]},"p99_ms":{"max":14.289082486066034,"mean":14.117505678441374,"min":13.945928870816713,"values":[14.289082486066034,13.945928870816713]},"qps":{"max":1173.8425,"mean":1172.2310499999999,"min":1170.6196,"values":[1170.6196,1173.8425]}},{"clients":20,"p95_ms":{"max":28.601420792983856,"mean":28.318191149446655,"min":28.03496150590945,"values":[28.03496150590945,28.601420792983856]},"p99_ms":{"max":35.22189945564606,"mean":35.17389472282957,"min":35.12588999001309,"values":[35.12588999001309,35.22189945564606]},"qps":{"max":1192.5346,"mean":1184.6480000000001,"min":1176.7614,"values":[1192.5346,1176.7614]}},{"clients":30,"p95_ms":{"max":46.14897419960473,"mean":45.153333896450945,"min":44.157693593297154,"values":[44.157693593297154,46.14897419960473]},"p99_ms":{"max":59.3168609120767,"mean":57.40693545245455,"min":55.497009992832396,"values":[55.497009992832396,59.3168609120767]},"qps":{"max":1190.7989,"mean":1171.9021,"min":1153.0053,"values":[1190.7989,1153.0053]}}],"concurrency_trials":[{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p6","ndcg":0.9963,"p95_ms":9.7,"p99_ms":10.5,"parameter":"search_effort","recall":0.995,"status":"ok","value":0.6,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p35","ndcg":0.9423,"p95_ms":43.7,"p99_ms":56.1,"parameter":"search_effort","recall":0.9349,"status":"ok","value":0.35,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p8","ndcg":0.9963,"p95_ms":10.3,"p99_ms":12.5,"parameter":"search_effort","recall":0.9951,"status":"ok","value":0.8,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p5","ndcg":0.9961,"p95_ms":9.1,"p99_ms":10,"parameter":"search_effort","recall":0.9948,"status":"ok","value":0.5,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p475","ndcg":0.9958,"p95_ms":8.8,"p99_ms":10.9,"parameter":"search_effort","recall":0.9946,"status":"ok","value":0.475,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p375","ndcg":0.9621,"p95_ms":8.1,"p99_ms":9.7,"parameter":"search_effort","recall":0.9566,"status":"ok","value":0.375,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p4","ndcg":0.9761,"p95_ms":8.1,"p99_ms":9.1,"parameter":"search_effort","recall":0.9722,"status":"ok","value":0.4,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-1","ndcg":0.9964,"p95_ms":12.8,"p99_ms":14,"parameter":"search_effort","recall":0.9952,"status":"ok","value":1,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p425","ndcg":0.9866,"p95_ms":8.5,"p99_ms":9.3,"parameter":"search_effort","recall":0.984,"status":"ok","value":0.425,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p45","ndcg":0.9929,"p95_ms":8.3,"p99_ms":9.3,"parameter":"search_effort","recall":0.9912,"status":"ok","value":0.45,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p7","ndcg":0.9963,"p95_ms":9.3,"p99_ms":9.8,"parameter":"search_effort","recall":0.995,"status":"ok","value":0.7,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p55","ndcg":0.996,"p95_ms":8.9,"p99_ms":9.5,"parameter":"search_effort","recall":0.9948,"status":"ok","value":0.55,"workload":"scale-big-200k"}],"cell_sha256":"35f168cf89311bc844502bf81ffaedefba77557f8b1a1b1961b5156605baed70","index_build":{"insert_duration":40.1411,"optimize_duration":14.0743,"seconds":54.2154},"lifecycle":{"cache_key":"88c31dc495287e0b2a2afac263c0b585fee6a527da89e8e7b58df833dc354d35","duration_seconds":691.938873052597,"finished_at":1791419893.2199633,"object_sha256":"271e7ef35b30d24c1b6964861f75d4378cd1ec2c8d3294d21c8fa3bf140454c7","receipt_sha256":"b45a23281b4afd09c29858c76ad88459a2deea50dada2a0864a5a059c9ee74c5","started_at":1791419201.2810903},"memory":{"anon_shmem_peak_mb":2676.4,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":3570.3,"cgroup_current_peak_mb":3565.6,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":2676.4,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":3565613056,"cgroup_kernel_peak_sum_bytes":3570327552,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":2676379648,"ended":1791419861.480267,"failed_samples":0,"first_sample_at":1791419204.614188,"kind":"container_cgroup_v2","last_sample_at":1791419861.2626007,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":3182,"schema_version":3,"started":1791419204.5880976,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791419204.614188,"index_started_at":1791419204.6469831,"last_sample_at":1791419861.2626007,"max_sample_gap_s":0.44,"publication_finished_at":1791419861.0889013,"sampler_ended_at":1791419861.480267,"sampler_started_at":1791419204.5880976,"samples":3182,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.0059068106837457625,0.006472323864853416,0.008517997137716652,0.016692511295332883,0.025014636497271637],"conc_latency_p95_list":[0.009443339199060574,0.00863692078419262,0.011923250494874083,0.02803496150590945,0.04415769359329715],"conc_latency_p99_list":[0.013832073475350627,0.010440133315278221,0.014289082486066034,0.03512588999001309,0.05549700999283239],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[168.9495,770.5304,1170.6196,1192.5346,1190.7989],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9622,"optimize_duration":0,"p99_c30_ms":55.497009992832396,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":20,"peak_qps":1192.5346,"qps":1192.5346,"qps_c30":1190.7989,"recall":0.9566,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0062,"serial_latency_p99":0.0068,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9622,"recall":0.9566,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.375},"trial":1},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":40.1,"load_s":54.2,"source_label":"antfly-qualification-scale-big-200k-0p35"},"ndcg":0.9621,"p95_ms":8.1,"p99_ms":9.7,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9566,"selection_mode":"swept","value":0.375},"status":"ok","storage":{"created_at":"2026-10-08T00:26:41.902686+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-big-200k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T00:26:42.043003+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T00:26:42.042979+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T00:26:41.949186+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]},"final":{"allocated_bytes":909885440,"apparent_bytes":909206579,"completed_at":"2026-10-08T00:37:42.092091+00:00","samples":[{"allocated_bytes":909885440,"apparent_bytes":909206579,"captured_at":"2026-10-08T00:37:42.092059+00:00","entries":391,"volumes":[{"allocated_bytes":909885440,"apparent_bytes":909206579,"entries":391,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T00:37:42.010602+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-big-200k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":909885440,"apparent_bytes":909206579,"entries":391,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]},"post_workload":{"allocated_bytes":909881344,"apparent_bytes":909209612,"completed_at":"2026-10-08T00:37:41.703780+00:00","samples":[{"allocated_bytes":909881344,"apparent_bytes":909209612,"captured_at":"2026-10-08T00:37:41.703748+00:00","entries":388,"volumes":[{"allocated_bytes":909881344,"apparent_bytes":909209612,"entries":388,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T00:37:41.598636+00:00","volumes":[{"allocated_bytes":909881344,"apparent_bytes":909209612,"entries":388,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T00:26:44.504700+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T00:26:44.504673+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T00:26:44.421961+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]},"protocol_fingerprint":"d399474383f5a01a59b572f7e0df2eec6efb6af8f865167377f3b450affdca3d","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T00:37:42.092096+00:00"},"trial":1},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p7","ndcg":0.9972,"p95_ms":9.5,"p99_ms":10,"parameter":"search_effort","recall":0.9963,"status":"ok","value":0.7,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p375","ndcg":0.964,"p95_ms":7.7,"p99_ms":8.4,"parameter":"search_effort","recall":0.9582,"status":"ok","value":0.375,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p45","ndcg":0.9947,"p95_ms":8.2,"p99_ms":9.1,"parameter":"search_effort","recall":0.9934,"status":"ok","value":0.45,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p8","ndcg":0.9973,"p95_ms":10.6,"p99_ms":11.6,"parameter":"search_effort","recall":0.9964,"status":"ok","value":0.8,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p6","ndcg":0.9972,"p95_ms":10.1,"p99_ms":11,"parameter":"search_effort","recall":0.9963,"status":"ok","value":0.6,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p425","ndcg":0.9889,"p95_ms":7.7,"p99_ms":8.9,"parameter":"search_effort","recall":0.9866,"status":"ok","value":0.425,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p5","ndcg":0.9971,"p95_ms":9.4,"p99_ms":10.4,"parameter":"search_effort","recall":0.9962,"status":"ok","value":0.5,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p55","ndcg":0.9971,"p95_ms":9.3,"p99_ms":10.4,"parameter":"search_effort","recall":0.9962,"status":"ok","value":0.55,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p475","ndcg":0.9968,"p95_ms":8.4,"p99_ms":8.8,"parameter":"search_effort","recall":0.9958,"status":"ok","value":0.475,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-1","ndcg":0.9974,"p95_ms":13.1,"p99_ms":15.3,"parameter":"search_effort","recall":0.9965,"status":"ok","value":1,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p4","ndcg":0.9792,"p95_ms":7.5,"p99_ms":8.3,"parameter":"search_effort","recall":0.9754,"status":"ok","value":0.4,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p35","ndcg":0.9442,"p95_ms":46.8,"p99_ms":55.7,"parameter":"search_effort","recall":0.936,"status":"ok","value":0.35,"workload":"scale-big-200k"}],"cell_sha256":"b988c45631fdad0296a11efee5a56e55359d5f943c0fc73fa2c51c07d22ad9b0","index_build":{"insert_duration":41.0641,"optimize_duration":14.072,"seconds":55.1361},"lifecycle":{"cache_key":"09edfe53abe854bdcb3a7412749dd169b7e3a0e4f8d525393bd048dcede5564f","duration_seconds":691.9344844818115,"finished_at":1791442705.2534764,"object_sha256":"b748556c86c1589ee534b9ac2196023c707eada1fb2473ffe890af7a15636943","receipt_sha256":"c6b37e9dcc7c4801bf3adffd17dbf4c05c0a52370d3792a294bf81af5a6473bb","started_at":1791442013.318992},"memory":{"anon_shmem_peak_mb":2107.4,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":2992.6,"cgroup_current_peak_mb":2989.8,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":2107.4,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":2989805568,"cgroup_kernel_peak_sum_bytes":2992623616,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":2107424768,"ended":1791442674.582301,"failed_samples":0,"first_sample_at":1791442016.6531646,"kind":"container_cgroup_v2","last_sample_at":1791442674.3630311,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":3192,"schema_version":3,"started":1791442016.630705,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791442016.6531646,"index_started_at":1791442016.6974356,"last_sample_at":1791442674.3630311,"max_sample_gap_s":0.229,"publication_finished_at":1791442674.2119434,"sampler_ended_at":1791442674.582301,"sampler_started_at":1791442016.630705,"samples":3192,"status":"qualified","trial":2,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.005849183923694681,0.00651786832784757,0.008494416991363142,0.016927101746990754,0.02581054415825591],"conc_latency_p95_list":[0.008941982220858333,0.00826654238335322,0.011757051610038614,0.028601420792983855,0.04614897419960473],"conc_latency_p99_list":[0.012786163245327777,0.010376474136719488,0.013945928870816714,0.03522189945564606,0.0593168609120767],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[170.5932,765.1631,1173.8425,1176.7614,1153.0053],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9607,"optimize_duration":0,"p99_c30_ms":59.3168609120767,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":20,"peak_qps":1176.7614,"qps":1176.7614,"qps_c30":1153.0053,"recall":0.9548,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0064,"serial_latency_p99":0.0072,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9607,"recall":0.9548,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.375},"trial":2},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":41.1,"load_s":55.1,"source_label":"antfly-qualification-scale-big-200k-0p35"},"ndcg":0.964,"p95_ms":7.7,"p99_ms":8.4,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9582,"selection_mode":"swept","value":0.375},"status":"ok","storage":{"created_at":"2026-10-08T06:46:53.961491+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"2","workload":"scale-big-200k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T06:46:54.074340+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T06:46:54.074312+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-200k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T06:46:53.998067+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-200k-antfly-data"}]},"final":{"allocated_bytes":905539584,"apparent_bytes":904863166,"completed_at":"2026-10-08T06:57:55.246473+00:00","samples":[{"allocated_bytes":905539584,"apparent_bytes":904863166,"captured_at":"2026-10-08T06:57:55.246450+00:00","entries":391,"volumes":[{"allocated_bytes":905539584,"apparent_bytes":904863166,"entries":391,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-200k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T06:57:55.165416+00:00","termination":{"container":"antfly_bench_vdbb_scale_t2_scale-big-200k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":905539584,"apparent_bytes":904863166,"entries":391,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-200k-antfly-data"}]},"post_workload":{"allocated_bytes":905535488,"apparent_bytes":904866199,"completed_at":"2026-10-08T06:57:54.791020+00:00","samples":[{"allocated_bytes":905535488,"apparent_bytes":904866199,"captured_at":"2026-10-08T06:57:54.790995+00:00","entries":388,"volumes":[{"allocated_bytes":905535488,"apparent_bytes":904866199,"entries":388,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-200k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T06:57:54.693855+00:00","volumes":[{"allocated_bytes":905535488,"apparent_bytes":904866199,"entries":388,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-200k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T06:46:56.551673+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T06:46:56.551648+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-200k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T06:46:56.476199+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-200k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t2_scale-big-200k-antfly-data"}]},"protocol_fingerprint":"e9108d31768f6952e6cbad38321c0e173c07dd9fc2064b2ff267880715abc5c8","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T06:57:55.246477+00:00"},"trial":2}],"metrics":{"demand_mb":{"max":2676.4,"mean":2391.9,"min":2107.4,"values":[2676.4,2107.4]},"final_allocated_bytes":{"max":909885440,"mean":907712512,"min":905539584,"values":[909885440,905539584]},"index_build_seconds":{"max":55.1361,"mean":54.67575,"min":54.2154,"values":[54.2154,55.1361]},"lifecycle_seconds":{"max":691.938873052597,"mean":691.9366787672043,"min":691.9344844818115,"values":[691.938873052597,691.9344844818115]},"peak_clients":{"max":20,"mean":20,"min":20,"values":[20,20]},"peak_qps":{"max":1192.5346,"mean":1184.6480000000001,"min":1176.7614,"values":[1192.5346,1176.7614]},"serial_p95_ms":{"max":6.4,"mean":6.300000000000001,"min":6.2,"values":[6.2,6.4]}},"profile":"big","qualification":{"ndcg_min":0.9607,"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall_min":0.9548,"request_errors":0,"trials":[{"ndcg":0.9622,"recall":0.9566,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.375},"trial":1},{"ndcg":0.9607,"recall":0.9548,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.375},"trial":2}]},"storage_qualification":{"metric":"final_allocated_bytes","qualified_trials":2,"status":"qualified","total_trials":2,"trials":[{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"d399474383f5a01a59b572f7e0df2eec6efb6af8f865167377f3b450affdca3d","status":"qualified","trial":1},{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"e9108d31768f6952e6cbad38321c0e173c07dd9fc2064b2ff267880715abc5c8","status":"qualified","trial":2}]},"vectors":200000},{"concurrency_observations":[{"clients":1,"p95_ms":{"max":16.4955613494385,"mean":11.904845926619599,"min":7.314130503800698,"values":[16.4955613494385,7.314130503800698]},"p99_ms":{"max":23.54924621875399,"mean":15.723775062942881,"min":7.898303907131773,"values":[23.54924621875399,7.898303907131773]},"qps":{"max":154.0465,"mean":138.40625,"min":122.766,"values":[122.766,154.0465]}},{"clients":5,"p95_ms":{"max":8.528496095095758,"mean":8.489288548298644,"min":8.45008100150153,"values":[8.528496095095758,8.45008100150153]},"p99_ms":{"max":12.172227436094545,"mean":12.052408246381667,"min":11.932589056668787,"values":[12.172227436094545,11.932589056668787]},"qps":{"max":661.2561,"mean":661.24235,"min":661.2286,"values":[661.2561,661.2286]}},{"clients":10,"p95_ms":{"max":14.179863466415549,"mean":14.052975583763324,"min":13.9260877011111,"values":[13.9260877011111,14.179863466415549]},"p99_ms":{"max":16.970074526034285,"mean":16.88533398613799,"min":16.800593446241695,"values":[16.800593446241695,16.970074526034285]},"qps":{"max":1015.3511,"mean":1004.4911,"min":993.6311,"values":[1015.3511,993.6311]}},{"clients":20,"p95_ms":{"max":32.74188018986024,"mean":31.956241589796264,"min":31.170602989732288,"values":[32.74188018986024,31.170602989732288]},"p99_ms":{"max":40.59205516590736,"mean":39.53032603778409,"min":38.46859690966082,"values":[40.59205516590736,38.46859690966082]},"qps":{"max":1053.9994,"mean":1036.66735,"min":1019.3353,"values":[1019.3353,1053.9994]}},{"clients":30,"p95_ms":{"max":49.53377999627263,"mean":49.15984509789267,"min":48.78591019951272,"values":[48.78591019951272,49.53377999627263]},"p99_ms":{"max":63.88565315137383,"mean":63.086573681357535,"min":62.28749421134124,"values":[62.28749421134124,63.88565315137383]},"qps":{"max":1040.7036,"mean":1030.2276000000002,"min":1019.7516,"values":[1040.7036,1019.7516]}}],"concurrency_trials":[{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p425","ndcg":0.9903,"p95_ms":11.5,"p99_ms":12.7,"parameter":"search_effort","recall":0.9883,"status":"ok","value":0.425,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p45","ndcg":0.9945,"p95_ms":11.7,"p99_ms":14.1,"parameter":"search_effort","recall":0.9929,"status":"ok","value":0.45,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p6","ndcg":0.9962,"p95_ms":15.2,"p99_ms":16.5,"parameter":"search_effort","recall":0.9949,"status":"ok","value":0.6,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p55","ndcg":0.996,"p95_ms":13.8,"p99_ms":14.3,"parameter":"search_effort","recall":0.9946,"status":"ok","value":0.55,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p475","ndcg":0.9956,"p95_ms":12.8,"p99_ms":13.5,"parameter":"search_effort","recall":0.9942,"status":"ok","value":0.475,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p375","ndcg":0.9706,"p95_ms":10.4,"p99_ms":11.9,"parameter":"search_effort","recall":0.9657,"status":"ok","value":0.375,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p7","ndcg":0.9962,"p95_ms":14.9,"p99_ms":15.4,"parameter":"search_effort","recall":0.9949,"status":"ok","value":0.7,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p4","ndcg":0.9829,"p95_ms":11,"p99_ms":12,"parameter":"search_effort","recall":0.9796,"status":"ok","value":0.4,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p8","ndcg":0.9963,"p95_ms":17.1,"p99_ms":18.6,"parameter":"search_effort","recall":0.995,"status":"ok","value":0.8,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p5","ndcg":0.996,"p95_ms":14.3,"p99_ms":15.4,"parameter":"search_effort","recall":0.9946,"status":"ok","value":0.5,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p35","ndcg":0.9534,"p95_ms":59.5,"p99_ms":74.1,"parameter":"search_effort","recall":0.9465,"status":"ok","value":0.35,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-1","ndcg":0.9963,"p95_ms":23.4,"p99_ms":26.8,"parameter":"search_effort","recall":0.9951,"status":"ok","value":1,"workload":"scale-big-400k"}],"cell_sha256":"133424a1c1b4403687ce2b7e41bdc942e558c1bbe2a3eeba144134658aff1d70","index_build":{"insert_duration":88.7107,"optimize_duration":30.0839,"seconds":118.7946},"lifecycle":{"cache_key":"f0dd077b5d68b97a4d415fbc57dbaf8510b74e2da791d6af460b3431eef0c1b4","duration_seconds":752.1534693241119,"finished_at":1791420645.7567644,"object_sha256":"a92bc11ab9af20f15c586994213c845c18937db1215faf61f1b4b9fa98527d57","receipt_sha256":"275cfbec6391ecb42522f443a9ff28d1e8a882e9fe28c579728ab4041c4d7521","started_at":1791419893.603295},"memory":{"anon_shmem_peak_mb":2829.8,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":4527.3,"cgroup_current_peak_mb":4526.9,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":2829.8,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":4526948352,"cgroup_kernel_peak_sum_bytes":4527288320,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":2829787136,"ended":1791420630.933748,"failed_samples":0,"first_sample_at":1791419896.932204,"kind":"container_cgroup_v2","last_sample_at":1791420630.7152488,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":3567,"schema_version":3,"started":1791419896.9060988,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791419896.932204,"index_started_at":1791419896.9722872,"last_sample_at":1791420630.7152488,"max_sample_gap_s":0.23,"publication_finished_at":1791420630.7061627,"sampler_ended_at":1791420630.933748,"sampler_started_at":1791419896.9060988,"samples":3567,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.008130453212486724,0.007544579550912769,0.00981739796299212,0.019531987948746492,0.028643348306741027],"conc_latency_p95_list":[0.0164955613494385,0.008528496095095758,0.0139260877011111,0.03274188018986024,0.04878591019951272],"conc_latency_p99_list":[0.02354924621875399,0.012172227436094545,0.016800593446241695,0.04059205516590736,0.06228749421134124],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[122.766,661.2561,1015.3511,1019.3353,1040.7036],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9684,"optimize_duration":0,"p99_c30_ms":62.28749421134124,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":30,"peak_qps":1040.7036,"qps":1040.7036,"qps_c30":1040.7036,"recall":0.964,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0072,"serial_latency_p99":0.0075,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9684,"recall":0.964,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.375},"trial":1},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":88.7,"load_s":118.8,"source_label":"antfly-qualification-scale-big-400k-0p35"},"ndcg":0.9706,"p95_ms":10.4,"p99_ms":11.9,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9657,"selection_mode":"swept","value":0.375},"status":"ok","storage":{"created_at":"2026-10-08T00:38:14.256879+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-big-400k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T00:38:14.376543+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T00:38:14.376518+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T00:38:14.295310+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]},"final":{"allocated_bytes":1971286016,"apparent_bytes":1970563411,"completed_at":"2026-10-08T00:50:31.713004+00:00","samples":[{"allocated_bytes":1971286016,"apparent_bytes":1970563411,"captured_at":"2026-10-08T00:50:31.712973+00:00","entries":393,"volumes":[{"allocated_bytes":1971286016,"apparent_bytes":1970563411,"entries":393,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T00:50:31.630637+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-big-400k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":1971286016,"apparent_bytes":1970563411,"entries":393,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]},"post_workload":{"allocated_bytes":1971277824,"apparent_bytes":1970561491,"completed_at":"2026-10-08T00:50:31.162483+00:00","samples":[{"allocated_bytes":1971277824,"apparent_bytes":1970561491,"captured_at":"2026-10-08T00:50:31.162458+00:00","entries":391,"volumes":[{"allocated_bytes":1971277824,"apparent_bytes":1970561491,"entries":391,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T00:50:31.066206+00:00","volumes":[{"allocated_bytes":1971277824,"apparent_bytes":1970561491,"entries":391,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T00:38:16.826000+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T00:38:16.825974+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T00:38:16.750836+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]},"protocol_fingerprint":"4a195169710349229800eff87d8506e659fedc6818468d2ace03c1bb18234cae","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T00:50:31.713008+00:00"},"trial":1},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p4","ndcg":0.9821,"p95_ms":7.8,"p99_ms":8.2,"parameter":"search_effort","recall":0.9787,"status":"ok","value":0.4,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p55","ndcg":0.9961,"p95_ms":13.1,"p99_ms":13.8,"parameter":"search_effort","recall":0.9949,"status":"ok","value":0.55,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-1","ndcg":0.9965,"p95_ms":20.3,"p99_ms":20.9,"parameter":"search_effort","recall":0.9954,"status":"ok","value":1,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p375","ndcg":0.9697,"p95_ms":7.3,"p99_ms":7.6,"parameter":"search_effort","recall":0.9648,"status":"ok","value":0.375,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p8","ndcg":0.9963,"p95_ms":14.9,"p99_ms":15.7,"parameter":"search_effort","recall":0.9952,"status":"ok","value":0.8,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p7","ndcg":0.9963,"p95_ms":14,"p99_ms":14.9,"parameter":"search_effort","recall":0.9952,"status":"ok","value":0.7,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p6","ndcg":0.9963,"p95_ms":13.6,"p99_ms":14,"parameter":"search_effort","recall":0.9952,"status":"ok","value":0.6,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p5","ndcg":0.9961,"p95_ms":12.8,"p99_ms":13.2,"parameter":"search_effort","recall":0.9949,"status":"ok","value":0.5,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p475","ndcg":0.9956,"p95_ms":11.3,"p99_ms":11.8,"parameter":"search_effort","recall":0.9944,"status":"ok","value":0.475,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p35","ndcg":0.9519,"p95_ms":10.8,"p99_ms":31.3,"parameter":"search_effort","recall":0.9448,"status":"ok","value":0.35,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p45","ndcg":0.9945,"p95_ms":9.8,"p99_ms":10.1,"parameter":"search_effort","recall":0.9932,"status":"ok","value":0.45,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p425","ndcg":0.9903,"p95_ms":8.7,"p99_ms":9.1,"parameter":"search_effort","recall":0.9884,"status":"ok","value":0.425,"workload":"scale-big-400k"}],"cell_sha256":"2ca2c89155ee96bacf65052c6add924f6f70468de2a21b418f8eb1e84faa6f24","index_build":{"insert_duration":90.6132,"optimize_duration":30.0742,"seconds":120.68740000000001},"lifecycle":{"cache_key":"d01524db5436483fc81c91a58efc9b6f28294d9703eb39e0644279ccd4a3e15d","duration_seconds":752.3403947353363,"finished_at":1791442012.922818,"object_sha256":"480a1d15ea3127807d6b3c0c72a1ce21dd76c8134ab5771b18e7e23bb2427d21","receipt_sha256":"8bf24ba6d99b0871355044e5991a0d175f8eafc3f10dcbeaf7c9df52c0b5fd1e","started_at":1791441260.5824232},"memory":{"anon_shmem_peak_mb":2412.9,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":4469.9,"cgroup_current_peak_mb":4469.4,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":2412.9,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":4469420032,"cgroup_kernel_peak_sum_bytes":4469882880,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":2412871680,"ended":1791441992.0177195,"failed_samples":0,"first_sample_at":1791441263.9959571,"kind":"container_cgroup_v2","last_sample_at":1791441991.7914999,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":3538,"schema_version":3,"started":1791441263.973664,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791441263.9959571,"index_started_at":1791441264.03603,"last_sample_at":1791441991.7914999,"max_sample_gap_s":0.249,"publication_finished_at":1791441991.712938,"sampler_ended_at":1791441992.0177195,"sampler_started_at":1791441263.973664,"samples":3538,"status":"qualified","trial":2,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.006478001002998418,0.007541807233824141,0.01003927022018164,0.018890595585250986,0.029166189995368113],"conc_latency_p95_list":[0.007314130503800698,0.00845008100150153,0.01417986346641555,0.031170602989732288,0.04953377999627263],"conc_latency_p99_list":[0.007898303907131773,0.011932589056668786,0.016970074526034284,0.03846859690966082,0.06388565315137383],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[154.0465,661.2286,993.6311,1053.9994,1019.7516],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9684,"optimize_duration":0,"p99_c30_ms":63.88565315137383,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":20,"peak_qps":1053.9994,"qps":1053.9994,"qps_c30":1019.7516,"recall":0.9636,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0073,"serial_latency_p99":0.0076,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9684,"recall":0.9636,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.375},"trial":2},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":90.6,"load_s":120.7,"source_label":"antfly-qualification-scale-big-400k-0p35"},"ndcg":0.9697,"p95_ms":7.3,"p99_ms":7.6,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9648,"selection_mode":"swept","value":0.375},"status":"ok","storage":{"created_at":"2026-10-08T06:34:21.280941+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"2","workload":"scale-big-400k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T06:34:21.398096+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T06:34:21.398073+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-400k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T06:34:21.322294+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-400k-antfly-data"}]},"final":{"allocated_bytes":1974374400,"apparent_bytes":1970217062,"completed_at":"2026-10-08T06:46:32.748060+00:00","samples":[{"allocated_bytes":1974374400,"apparent_bytes":1970217062,"captured_at":"2026-10-08T06:46:32.748037+00:00","entries":2063,"volumes":[{"allocated_bytes":1974374400,"apparent_bytes":1970217062,"entries":2063,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-400k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T06:46:32.659788+00:00","termination":{"container":"antfly_bench_vdbb_scale_t2_scale-big-400k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":1974374400,"apparent_bytes":1970217062,"entries":2063,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-400k-antfly-data"}]},"post_workload":{"allocated_bytes":1974370304,"apparent_bytes":1970215293,"completed_at":"2026-10-08T06:46:32.231796+00:00","samples":[{"allocated_bytes":1974370304,"apparent_bytes":1970215293,"captured_at":"2026-10-08T06:46:32.231770+00:00","entries":2061,"volumes":[{"allocated_bytes":1974370304,"apparent_bytes":1970215293,"entries":2061,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-400k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T06:46:32.139650+00:00","volumes":[{"allocated_bytes":1974370304,"apparent_bytes":1970215293,"entries":2061,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-400k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T06:34:23.894257+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T06:34:23.894233+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-400k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T06:34:23.810415+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-400k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t2_scale-big-400k-antfly-data"}]},"protocol_fingerprint":"b1f8da0f1a29d69272668dba6de8982ac17a4cf8b45db2354a913a35d3a1feb5","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T06:46:32.748063+00:00"},"trial":2}],"metrics":{"demand_mb":{"max":2829.8,"mean":2621.3500000000004,"min":2412.9,"values":[2829.8,2412.9]},"final_allocated_bytes":{"max":1974374400,"mean":1972830208,"min":1971286016,"values":[1971286016,1974374400]},"index_build_seconds":{"max":120.68740000000001,"mean":119.74100000000001,"min":118.7946,"values":[118.7946,120.68740000000001]},"lifecycle_seconds":{"max":752.3403947353363,"mean":752.2469320297241,"min":752.1534693241119,"values":[752.1534693241119,752.3403947353363]},"peak_clients":{"max":30,"mean":25,"min":20,"values":[30,20]},"peak_qps":{"max":1053.9994,"mean":1047.3515,"min":1040.7036,"values":[1040.7036,1053.9994]},"serial_p95_ms":{"max":7.3,"mean":7.25,"min":7.2,"values":[7.2,7.3]}},"profile":"big","qualification":{"ndcg_min":0.9684,"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall_min":0.9636,"request_errors":0,"trials":[{"ndcg":0.9684,"recall":0.964,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.375},"trial":1},{"ndcg":0.9684,"recall":0.9636,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.375},"trial":2}]},"storage_qualification":{"metric":"final_allocated_bytes","qualified_trials":2,"status":"qualified","total_trials":2,"trials":[{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"4a195169710349229800eff87d8506e659fedc6818468d2ace03c1bb18234cae","status":"qualified","trial":1},{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"b1f8da0f1a29d69272668dba6de8982ac17a4cf8b45db2354a913a35d3a1feb5","status":"qualified","trial":2}]},"vectors":400000},{"concurrency_observations":[{"clients":1,"p95_ms":{"max":24.49628220929298,"mean":16.46920655330177,"min":8.442130897310562,"values":[8.442130897310562,24.49628220929298]},"p99_ms":{"max":33.404771991481546,"mean":21.44386877873331,"min":9.482965565985072,"values":[9.482965565985072,33.404771991481546]},"qps":{"max":138.5968,"mean":118.1057,"min":97.6146,"values":[138.5968,97.6146]}},{"clients":5,"p95_ms":{"max":12.634504385641774,"mean":12.5157746966579,"min":12.397045007674024,"values":[12.634504385641774,12.397045007674024]},"p99_ms":{"max":14.574428186169825,"mean":14.523745599435642,"min":14.47306301270146,"values":[14.574428186169825,14.47306301270146]},"qps":{"max":582.0172,"mean":578.26655,"min":574.5159,"values":[582.0172,574.5159]}},{"clients":10,"p95_ms":{"max":16.082111897412684,"mean":15.972759446594862,"min":15.86340699577704,"values":[15.86340699577704,16.082111897412684]},"p99_ms":{"max":19.09909298119599,"mean":18.90655634051653,"min":18.714019699837067,"values":[18.714019699837067,19.09909298119599]},"qps":{"max":892.9995,"mean":887.22555,"min":881.4516,"values":[892.9995,881.4516]}},{"clients":20,"p95_ms":{"max":37.25478024716722,"mean":36.86396074772347,"min":36.47314124827972,"values":[36.47314124827972,37.25478024716722]},"p99_ms":{"max":47.34292279754299,"mean":46.05892521241912,"min":44.77492762729525,"values":[44.77492762729525,47.34292279754299]},"qps":{"max":908.7505,"mean":898.0235,"min":887.2965,"values":[908.7505,887.2965]}},{"clients":30,"p95_ms":{"max":58.33142489864252,"mean":58.04842084835397,"min":57.76541679806542,"values":[57.76541679806542,58.33142489864252]},"p99_ms":{"max":72.2786308953073,"mean":71.56903785740724,"min":70.85944481950719,"values":[72.2786308953073,70.85944481950719]},"qps":{"max":909.5705,"mean":905.482,"min":901.3935,"values":[909.5705,901.3935]}}],"concurrency_trials":[{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p8","ndcg":0.9954,"p95_ms":19.5,"p99_ms":20.4,"parameter":"search_effort","recall":0.994,"status":"ok","value":0.8,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p375","ndcg":0.9646,"p95_ms":8.2,"p99_ms":8.5,"parameter":"search_effort","recall":0.96,"status":"ok","value":0.375,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p6","ndcg":0.9954,"p95_ms":16.4,"p99_ms":16.9,"parameter":"search_effort","recall":0.994,"status":"ok","value":0.6,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p5","ndcg":0.9951,"p95_ms":15,"p99_ms":15.6,"parameter":"search_effort","recall":0.9936,"status":"ok","value":0.5,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p475","ndcg":0.9945,"p95_ms":12.6,"p99_ms":13,"parameter":"search_effort","recall":0.9931,"status":"ok","value":0.475,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p55","ndcg":0.9951,"p95_ms":15.3,"p99_ms":15.8,"parameter":"search_effort","recall":0.9936,"status":"ok","value":0.55,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p35","ndcg":0.9486,"p95_ms":13.6,"p99_ms":31.5,"parameter":"search_effort","recall":0.9424,"status":"ok","value":0.35,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p4","ndcg":0.9781,"p95_ms":8.8,"p99_ms":9.1,"parameter":"search_effort","recall":0.9746,"status":"ok","value":0.4,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p425","ndcg":0.9876,"p95_ms":10.1,"p99_ms":10.6,"parameter":"search_effort","recall":0.9851,"status":"ok","value":0.425,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-1","ndcg":0.9955,"p95_ms":28.6,"p99_ms":29.9,"parameter":"search_effort","recall":0.9941,"status":"ok","value":1,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p45","ndcg":0.9921,"p95_ms":15.6,"p99_ms":17.8,"parameter":"search_effort","recall":0.9904,"status":"ok","value":0.45,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p7","ndcg":0.9954,"p95_ms":17.4,"p99_ms":18.4,"parameter":"search_effort","recall":0.994,"status":"ok","value":0.7,"workload":"scale-big-600k"}],"cell_sha256":"c43ade8ad87b4a4824eeceae5938c9e501ce6533b3e0177b13af3247e1e2bc53","index_build":{"insert_duration":151.5751,"optimize_duration":58.1155,"seconds":209.6906},"lifecycle":{"cache_key":"d376c53d5a7a221a1aba0d117b90a936dd87dea5fe9239bc6537bba01dc3cb5a","duration_seconds":842.3805015087128,"finished_at":1791421488.5272603,"object_sha256":"482b1e6e94ebba198d43f1b993217f2da6e32f1397129766e98ba0492e83a3bf","receipt_sha256":"c318463dddef1c69c3a004c554e343fae20f9887c03b513375a8951202fa473a","started_at":1791420646.1467588},"memory":{"anon_shmem_peak_mb":2870.5,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":6049.6,"cgroup_current_peak_mb":6047.7,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":2870.5,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":6047707136,"cgroup_kernel_peak_sum_bytes":6049566720,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":2870460416,"ended":1791421476.1460838,"failed_samples":0,"first_sample_at":1791420649.5795028,"kind":"container_cgroup_v2","last_sample_at":1791421475.9228241,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":4023,"schema_version":3,"started":1791420649.5495014,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791420649.5795028,"index_started_at":1791420649.610338,"last_sample_at":1791421475.9228241,"max_sample_gap_s":0.322,"publication_finished_at":1791421475.8505516,"sampler_ended_at":1791421476.1460838,"sampler_started_at":1791420649.5495014,"samples":4023,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.007199326534261594,0.008570824865296835,0.011165874394347066,0.021909071487105122,0.032727798850374114],"conc_latency_p95_list":[0.008442130897310562,0.012634504385641775,0.01586340699577704,0.03647314124827972,0.05776541679806542],"conc_latency_p99_list":[0.009482965565985072,0.014574428186169825,0.018714019699837065,0.04477492762729525,0.0722786308953073],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[138.5968,582.0172,892.9995,908.7505,909.5705],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.964,"optimize_duration":0,"p99_c30_ms":72.2786308953073,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":30,"peak_qps":909.5705,"qps":909.5705,"qps_c30":909.5705,"recall":0.9592,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0094,"serial_latency_p99":0.012,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.964,"recall":0.9592,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.375},"trial":1},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":151.6,"load_s":209.7,"source_label":"antfly-qualification-scale-big-600k-0p35"},"ndcg":0.9646,"p95_ms":8.2,"p99_ms":8.5,"parameter":"search_effort","qualification_floor":0.955,"recall":0.96,"selection_mode":"swept","value":0.375},"status":"ok","storage":{"created_at":"2026-10-08T00:50:46.860091+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-big-600k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T00:50:46.996449+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T00:50:46.996424+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T00:50:46.902006+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]},"final":{"allocated_bytes":3117531136,"apparent_bytes":3112718819,"completed_at":"2026-10-08T01:04:37.050750+00:00","samples":[{"allocated_bytes":3117531136,"apparent_bytes":3112718819,"captured_at":"2026-10-08T01:04:37.050723+00:00","entries":2447,"volumes":[{"allocated_bytes":3117531136,"apparent_bytes":3112718819,"entries":2447,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T01:04:36.960268+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-big-600k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":3117531136,"apparent_bytes":3112718819,"entries":2447,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]},"post_workload":{"allocated_bytes":3117527040,"apparent_bytes":3112717050,"completed_at":"2026-10-08T01:04:36.403113+00:00","samples":[{"allocated_bytes":3117527040,"apparent_bytes":3112717050,"captured_at":"2026-10-08T01:04:36.403079+00:00","entries":2445,"volumes":[{"allocated_bytes":3117527040,"apparent_bytes":3112717050,"entries":2445,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T01:04:36.276581+00:00","volumes":[{"allocated_bytes":3117527040,"apparent_bytes":3112717050,"entries":2445,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T00:50:49.466722+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T00:50:49.466697+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T00:50:49.384466+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]},"protocol_fingerprint":"b301644d8d334d2d49a48a0c6793e1f9f10495b066a916d0425efbca52a14d5d","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T01:04:37.050754+00:00"},"trial":1},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p45","ndcg":0.9931,"p95_ms":13.9,"p99_ms":14.9,"parameter":"search_effort","recall":0.9916,"status":"ok","value":0.45,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p35","ndcg":0.9502,"p95_ms":73.3,"p99_ms":85.7,"parameter":"search_effort","recall":0.9434,"status":"ok","value":0.35,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-1","ndcg":0.9966,"p95_ms":30.9,"p99_ms":36.4,"parameter":"search_effort","recall":0.9955,"status":"ok","value":1,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p375","ndcg":0.9664,"p95_ms":13.9,"p99_ms":14.9,"parameter":"search_effort","recall":0.9618,"status":"ok","value":0.375,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p7","ndcg":0.9964,"p95_ms":17.6,"p99_ms":18.1,"parameter":"search_effort","recall":0.9952,"status":"ok","value":0.7,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p55","ndcg":0.9959,"p95_ms":15.7,"p99_ms":16.6,"parameter":"search_effort","recall":0.9946,"status":"ok","value":0.55,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p425","ndcg":0.9889,"p95_ms":14.3,"p99_ms":16.4,"parameter":"search_effort","recall":0.987,"status":"ok","value":0.425,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p5","ndcg":0.9957,"p95_ms":16.2,"p99_ms":17.4,"parameter":"search_effort","recall":0.9946,"status":"ok","value":0.5,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p475","ndcg":0.9951,"p95_ms":14.6,"p99_ms":15.6,"parameter":"search_effort","recall":0.9939,"status":"ok","value":0.475,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p6","ndcg":0.9964,"p95_ms":17.4,"p99_ms":19,"parameter":"search_effort","recall":0.9952,"status":"ok","value":0.6,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p8","ndcg":0.9965,"p95_ms":20.5,"p99_ms":23.1,"parameter":"search_effort","recall":0.9954,"status":"ok","value":0.8,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p4","ndcg":0.9794,"p95_ms":13.3,"p99_ms":15.8,"parameter":"search_effort","recall":0.9767,"status":"ok","value":0.4,"workload":"scale-big-600k"}],"cell_sha256":"abf49594ce1c03b4fab06389f1d7186ff8e6bdb0199287b91ca8a8e7c9167fd0","index_build":{"insert_duration":152.1892,"optimize_duration":60.1222,"seconds":212.3114},"lifecycle":{"cache_key":"d155225af8de459040a3c12bb6eb016d711e18743cce83f59862e1fd52e48b3c","duration_seconds":872.3618550300598,"finished_at":1791441260.2020757,"object_sha256":"a3dd9b23b3d321d7eeb5730e3bc7426b9bc23b48e6fe849be155d0c6540f1ed3","receipt_sha256":"2750feaa8c95d40270d2861365a1fb8f2c613a9b0ac87d7e66083233928ebcc7","started_at":1791440387.8402207},"memory":{"anon_shmem_peak_mb":2820,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":5323.7,"cgroup_current_peak_mb":5302.1,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":2820,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":5302132736,"cgroup_kernel_peak_sum_bytes":5323677696,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":2819973120,"ended":1791441227.970227,"failed_samples":0,"first_sample_at":1791440391.2794237,"kind":"container_cgroup_v2","last_sample_at":1791441227.7304633,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":4078,"schema_version":3,"started":1791440391.2560775,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791440391.2794237,"index_started_at":1791440391.3192832,"last_sample_at":1791441227.7304633,"max_sample_gap_s":0.226,"publication_finished_at":1791441227.6076784,"sampler_ended_at":1791441227.970227,"sampler_started_at":1791440391.2560775,"samples":4078,"status":"qualified","trial":2,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.0102255968018404,0.008683037358616353,0.011311397932867806,0.022396234587408085,0.03304901680370763],"conc_latency_p95_list":[0.02449628220929298,0.012397045007674024,0.016082111897412685,0.03725478024716722,0.058331424898642514],"conc_latency_p99_list":[0.03340477199148154,0.01447306301270146,0.01909909298119599,0.04734292279754299,0.07085944481950719],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[97.6146,574.5159,881.4516,887.2965,901.3935],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9649,"optimize_duration":0,"p99_c30_ms":70.85944481950719,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":30,"peak_qps":901.3935,"qps":901.3935,"qps_c30":901.3935,"recall":0.9601,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0079,"serial_latency_p99":0.0085,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9649,"recall":0.9601,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.375},"trial":2},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":152.2,"load_s":212.3,"source_label":"antfly-qualification-scale-big-600k-0p35"},"ndcg":0.9664,"p95_ms":13.9,"p99_ms":14.9,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9618,"selection_mode":"swept","value":0.375},"status":"ok","storage":{"created_at":"2026-10-08T06:19:48.556707+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"2","workload":"scale-big-600k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T06:19:48.689132+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T06:19:48.689105+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-600k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T06:19:48.596402+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-600k-antfly-data"}]},"final":{"allocated_bytes":3098079232,"apparent_bytes":3097438845,"completed_at":"2026-10-08T06:33:48.724386+00:00","samples":[{"allocated_bytes":3098079232,"apparent_bytes":3097438845,"captured_at":"2026-10-08T06:33:48.724360+00:00","entries":398,"volumes":[{"allocated_bytes":3098079232,"apparent_bytes":3097438845,"entries":398,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-600k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T06:33:48.637780+00:00","termination":{"container":"antfly_bench_vdbb_scale_t2_scale-big-600k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":3098079232,"apparent_bytes":3097438845,"entries":398,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-600k-antfly-data"}]},"post_workload":{"allocated_bytes":3098075136,"apparent_bytes":3097437251,"completed_at":"2026-10-08T06:33:48.236396+00:00","samples":[{"allocated_bytes":3098075136,"apparent_bytes":3097437251,"captured_at":"2026-10-08T06:33:48.236365+00:00","entries":396,"volumes":[{"allocated_bytes":3098075136,"apparent_bytes":3097437251,"entries":396,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-600k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T06:33:48.127889+00:00","volumes":[{"allocated_bytes":3098075136,"apparent_bytes":3097437251,"entries":396,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-600k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T06:19:51.173336+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T06:19:51.173308+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-600k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T06:19:51.094685+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-600k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t2_scale-big-600k-antfly-data"}]},"protocol_fingerprint":"2515b85f95480bdf041aaf3a0886167566f015c870334e1de0f4bfcf0f855926","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T06:33:48.724389+00:00"},"trial":2}],"metrics":{"demand_mb":{"max":2870.5,"mean":2845.25,"min":2820,"values":[2870.5,2820]},"final_allocated_bytes":{"max":3117531136,"mean":3107805184,"min":3098079232,"values":[3117531136,3098079232]},"index_build_seconds":{"max":212.3114,"mean":211.00099999999998,"min":209.6906,"values":[209.6906,212.3114]},"lifecycle_seconds":{"max":872.3618550300598,"mean":857.3711782693863,"min":842.3805015087128,"values":[842.3805015087128,872.3618550300598]},"peak_clients":{"max":30,"mean":30,"min":30,"values":[30,30]},"peak_qps":{"max":909.5705,"mean":905.482,"min":901.3935,"values":[909.5705,901.3935]},"serial_p95_ms":{"max":9.4,"mean":8.65,"min":7.9,"values":[9.4,7.9]}},"profile":"big","qualification":{"ndcg_min":0.964,"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall_min":0.9592,"request_errors":0,"trials":[{"ndcg":0.964,"recall":0.9592,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.375},"trial":1},{"ndcg":0.9649,"recall":0.9601,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.375},"trial":2}]},"storage_qualification":{"metric":"final_allocated_bytes","qualified_trials":2,"status":"qualified","total_trials":2,"trials":[{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"b301644d8d334d2d49a48a0c6793e1f9f10495b066a916d0425efbca52a14d5d","status":"qualified","trial":1},{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"2515b85f95480bdf041aaf3a0886167566f015c870334e1de0f4bfcf0f855926","status":"qualified","trial":2}]},"vectors":600000},{"concurrency_observations":[{"clients":1,"p95_ms":{"max":34.50383944000349,"mean":22.768509072921,"min":11.033178705838509,"values":[11.033178705838509,34.50383944000349]},"p99_ms":{"max":48.09641366824509,"mean":30.214550701930428,"min":12.332687735615766,"values":[12.332687735615766,48.09641366824509]},"qps":{"max":109.5893,"mean":88.604,"min":67.6187,"values":[109.5893,67.6187]}},{"clients":5,"p95_ms":{"max":15.139762021135539,"mean":13.07895390491467,"min":11.0181457886938,"values":[11.0181457886938,15.139762021135539]},"p99_ms":{"max":17.838430608389896,"mean":17.458573729381897,"min":17.078716850373894,"values":[17.078716850373894,17.838430608389896]},"qps":{"max":504.3763,"mean":498.55100000000004,"min":492.7257,"values":[504.3763,492.7257]}},{"clients":10,"p95_ms":{"max":18.42472940334119,"mean":18.32058244908694,"min":18.216435494832687,"values":[18.42472940334119,18.216435494832687]},"p99_ms":{"max":22.29292378877289,"mean":22.084768628410522,"min":21.876613468048156,"values":[21.876613468048156,22.29292378877289]},"qps":{"max":792.2728,"mean":788.38985,"min":784.5069,"values":[784.5069,792.2728]}},{"clients":20,"p95_ms":{"max":41.11130424280418,"mean":40.50416521713487,"min":39.89702619146555,"values":[41.11130424280418,39.89702619146555]},"p99_ms":{"max":51.64103236165826,"mean":50.993815043475465,"min":50.34659772529267,"values":[51.64103236165826,50.34659772529267]},"qps":{"max":823.1555,"mean":810.0417,"min":796.9279,"values":[796.9279,823.1555]}},{"clients":30,"p95_ms":{"max":66.79442840977568,"mean":64.96812358454915,"min":63.141818759322604,"values":[66.79442840977568,63.141818759322604]},"p99_ms":{"max":84.09385485574597,"mean":80.71953435864995,"min":77.34521386155393,"values":[84.09385485574597,77.34521386155393]},"qps":{"max":815.3408,"mean":806.26565,"min":797.1905,"values":[797.1905,815.3408]}}],"concurrency_trials":[{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p425","ndcg":0.9843,"p95_ms":10.9,"p99_ms":11.1,"parameter":"search_effort","recall":0.9818,"status":"ok","value":0.425,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p475","ndcg":0.9936,"p95_ms":13.9,"p99_ms":14.6,"parameter":"search_effort","recall":0.992,"status":"ok","value":0.475,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-1","ndcg":0.9962,"p95_ms":37.5,"p99_ms":39.8,"parameter":"search_effort","recall":0.995,"status":"ok","value":1,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p55","ndcg":0.9952,"p95_ms":18.6,"p99_ms":27.8,"parameter":"search_effort","recall":0.9938,"status":"ok","value":0.55,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p6","ndcg":0.9957,"p95_ms":18.4,"p99_ms":19.4,"parameter":"search_effort","recall":0.9944,"status":"ok","value":0.6,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p375","ndcg":0.9574,"p95_ms":10.1,"p99_ms":10.6,"parameter":"search_effort","recall":0.9522,"status":"ok","value":0.375,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p45","ndcg":0.9907,"p95_ms":12.6,"p99_ms":13,"parameter":"search_effort","recall":0.9887,"status":"ok","value":0.45,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p7","ndcg":0.9958,"p95_ms":20.2,"p99_ms":20.6,"parameter":"search_effort","recall":0.9944,"status":"ok","value":0.7,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p8","ndcg":0.9961,"p95_ms":23.2,"p99_ms":23.8,"parameter":"search_effort","recall":0.9948,"status":"ok","value":0.8,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p5","ndcg":0.9951,"p95_ms":16.5,"p99_ms":17.1,"parameter":"search_effort","recall":0.9937,"status":"ok","value":0.5,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p35","ndcg":0.9362,"p95_ms":28.3,"p99_ms":45.7,"parameter":"search_effort","recall":0.9289,"status":"ok","value":0.35,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p4","ndcg":0.9739,"p95_ms":9.7,"p99_ms":10,"parameter":"search_effort","recall":0.97,"status":"ok","value":0.4,"workload":"scale-big-800k"}],"cell_sha256":"0d1f4850983bc6aa1b63f488c348b074eea04cbbfea5fea8b63c8ff22d9f2388","index_build":{"insert_duration":218.7439,"optimize_duration":74.1262,"seconds":292.8701},"lifecycle":{"cache_key":"e7a5323774e31f4ec6eddb7a21e8249ee676fce2cd20279827ed4b4508828522","duration_seconds":932.5341374874115,"finished_at":1791422421.4874156,"object_sha256":"1bee51cd74398c0e2ecdf647d878f7c9c90cccd8fc678fdd6b355aa69310dad9","receipt_sha256":"7d30b032d169fd0b137b1b6068b0f987019755a5da9e008fc9ed35af5e2657f2","started_at":1791421488.953278},"memory":{"anon_shmem_peak_mb":3464.2,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":7813.3,"cgroup_current_peak_mb":7812.7,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":3464.2,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":7812714496,"cgroup_kernel_peak_sum_bytes":7813300224,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":3464151040,"ended":1791422410.0480917,"failed_samples":0,"first_sample_at":1791421492.4683554,"kind":"container_cgroup_v2","last_sample_at":1791422409.813037,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":4474,"schema_version":3,"started":1791421492.4418955,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791421492.4683554,"index_started_at":1791421492.500197,"last_sample_at":1791422409.813037,"max_sample_gap_s":0.238,"publication_finished_at":1791422409.6005447,"sampler_ended_at":1791422410.0480917,"sampler_started_at":1791421492.4418955,"samples":4474,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.009106970814208451,0.009889722162049535,0.012711766817530381,0.02496075871931332,0.037358249396088145],"conc_latency_p95_list":[0.011033178705838509,0.011018145788693801,0.018424729403341188,0.04111130424280418,0.06679442840977567],"conc_latency_p99_list":[0.012332687735615766,0.017078716850373894,0.021876613468048155,0.05164103236165826,0.08409385485574597],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[109.5893,504.3763,784.5069,796.9279,797.1905],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9711,"optimize_duration":0,"p99_c30_ms":84.09385485574597,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":30,"peak_qps":797.1905,"qps":797.1905,"qps_c30":797.1905,"recall":0.9667,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0096,"serial_latency_p99":0.0126,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9711,"recall":0.9667,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":1},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":218.7,"load_s":292.9,"source_label":"antfly-qualification-scale-big-800k-0p35"},"ndcg":0.9739,"p95_ms":9.7,"p99_ms":10,"parameter":"search_effort","qualification_floor":0.955,"recall":0.97,"selection_mode":"swept","value":0.4},"status":"ok","storage":{"created_at":"2026-10-08T01:04:49.744485+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-big-800k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T01:04:49.869165+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T01:04:49.869136+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T01:04:49.781462+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]},"final":{"allocated_bytes":4260016128,"apparent_bytes":4254117395,"completed_at":"2026-10-08T01:20:10.976183+00:00","samples":[{"allocated_bytes":4260016128,"apparent_bytes":4254117395,"captured_at":"2026-10-08T01:20:10.976136+00:00","entries":2961,"volumes":[{"allocated_bytes":4260016128,"apparent_bytes":4254117395,"entries":2961,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T01:20:10.887402+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-big-800k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":4260016128,"apparent_bytes":4254117395,"entries":2961,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]},"post_workload":{"allocated_bytes":4260012032,"apparent_bytes":4254115569,"completed_at":"2026-10-08T01:20:10.288412+00:00","samples":[{"allocated_bytes":4260012032,"apparent_bytes":4254115569,"captured_at":"2026-10-08T01:20:10.288387+00:00","entries":2959,"volumes":[{"allocated_bytes":4260012032,"apparent_bytes":4254115569,"entries":2959,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T01:20:10.186481+00:00","volumes":[{"allocated_bytes":4260012032,"apparent_bytes":4254115569,"entries":2959,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T01:04:52.354733+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T01:04:52.354710+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T01:04:52.270076+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]},"protocol_fingerprint":"aaa511ca0340136a4cc3a811e9712bfba079016d1b7d297c3285328ae9d5a95d","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T01:20:10.976187+00:00"},"trial":1},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p55","ndcg":0.9962,"p95_ms":16.9,"p99_ms":17.5,"parameter":"search_effort","recall":0.9951,"status":"ok","value":0.55,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p7","ndcg":0.9965,"p95_ms":20.6,"p99_ms":21.5,"parameter":"search_effort","recall":0.9954,"status":"ok","value":0.7,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p425","ndcg":0.9841,"p95_ms":15.9,"p99_ms":17.9,"parameter":"search_effort","recall":0.9814,"status":"ok","value":0.425,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p45","ndcg":0.9909,"p95_ms":19.1,"p99_ms":22.3,"parameter":"search_effort","recall":0.9891,"status":"ok","value":0.45,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p8","ndcg":0.9966,"p95_ms":25.2,"p99_ms":27.1,"parameter":"search_effort","recall":0.9955,"status":"ok","value":0.8,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p5","ndcg":0.9961,"p95_ms":18.1,"p99_ms":20.9,"parameter":"search_effort","recall":0.9951,"status":"ok","value":0.5,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p4","ndcg":0.974,"p95_ms":14.6,"p99_ms":20,"parameter":"search_effort","recall":0.9703,"status":"ok","value":0.4,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p475","ndcg":0.9948,"p95_ms":16.8,"p99_ms":19.2,"parameter":"search_effort","recall":0.9936,"status":"ok","value":0.475,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p375","ndcg":0.9594,"p95_ms":16.2,"p99_ms":20.6,"parameter":"search_effort","recall":0.9544,"status":"ok","value":0.375,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p6","ndcg":0.9962,"p95_ms":21.1,"p99_ms":27.4,"parameter":"search_effort","recall":0.9952,"status":"ok","value":0.6,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-1","ndcg":0.9966,"p95_ms":40.4,"p99_ms":42.2,"parameter":"search_effort","recall":0.9955,"status":"ok","value":1,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p35","ndcg":0.9392,"p95_ms":82.5,"p99_ms":99.9,"parameter":"search_effort","recall":0.932,"status":"ok","value":0.35,"workload":"scale-big-800k"}],"cell_sha256":"fafd1202df81f085f3b3b47233917dd54631682c54bd34043e3e1c75b24de548","index_build":{"insert_duration":226.9953,"optimize_duration":86.1945,"seconds":313.1898},"lifecycle":{"cache_key":"dd1d37562482daf137457f6848f1e7bb1fe9505faf0672f0ca5391fdc1b0aae0","duration_seconds":992.8572626113892,"finished_at":1791440387.4037292,"object_sha256":"4afba2d075240f59fc28306a6fbb7eef244c3b50a9f0742464d5fba1aa8e93cc","receipt_sha256":"38f6dcb16c51d3d439a08dfead51bdf29c1f2aed9a4c26700dbbb5ec86a98316","started_at":1791439394.5464666},"memory":{"anon_shmem_peak_mb":3938.3,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":7622,"cgroup_current_peak_mb":7606.1,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":3938.3,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":7606128640,"cgroup_kernel_peak_sum_bytes":7621992448,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":3938267136,"ended":1791440347.695377,"failed_samples":0,"first_sample_at":1791439398.0283663,"kind":"container_cgroup_v2","last_sample_at":1791440347.475477,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":4630,"schema_version":3,"started":1791439397.9993436,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791439398.0283663,"index_started_at":1791439398.0616136,"last_sample_at":1791440347.475477,"max_sample_gap_s":0.341,"publication_finished_at":1791440347.4350233,"sampler_ended_at":1791440347.695377,"sampler_started_at":1791439397.9993436,"samples":4630,"status":"qualified","trial":2,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.014763777066423425,0.010122353860050276,0.01258383039268875,0.024185856846165314,0.03644061824065798],"conc_latency_p95_list":[0.034503839440003486,0.015139762021135539,0.01821643549483269,0.03989702619146555,0.06314181875932261],"conc_latency_p99_list":[0.04809641366824509,0.017838430608389896,0.02229292378877289,0.050346597725292666,0.07734521386155394],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[67.6187,492.7257,792.2728,823.1555,815.3408],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9726,"optimize_duration":0,"p99_c30_ms":77.34521386155393,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":20,"peak_qps":823.1555,"qps":823.1555,"qps_c30":815.3408,"recall":0.9685,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0113,"serial_latency_p99":0.0169,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9726,"recall":0.9685,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":2},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":227,"load_s":313.2,"source_label":"antfly-qualification-scale-big-800k-0p35"},"ndcg":0.974,"p95_ms":14.6,"p99_ms":20,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9703,"selection_mode":"swept","value":0.4},"status":"ok","storage":{"created_at":"2026-10-08T06:03:15.267033+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"2","workload":"scale-big-800k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T06:03:15.401994+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T06:03:15.401966+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-800k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T06:03:15.306823+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-800k-antfly-data"}]},"final":{"allocated_bytes":4396199936,"apparent_bytes":4395584053,"completed_at":"2026-10-08T06:19:08.489329+00:00","samples":[{"allocated_bytes":4396199936,"apparent_bytes":4395584053,"captured_at":"2026-10-08T06:19:08.489295+00:00","entries":402,"volumes":[{"allocated_bytes":4396199936,"apparent_bytes":4395584053,"entries":402,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-800k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T06:19:08.397646+00:00","termination":{"container":"antfly_bench_vdbb_scale_t2_scale-big-800k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":4396199936,"apparent_bytes":4395584053,"entries":402,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-800k-antfly-data"}]},"post_workload":{"allocated_bytes":4427755520,"apparent_bytes":4427140664,"completed_at":"2026-10-08T06:19:07.926709+00:00","samples":[{"allocated_bytes":4427755520,"apparent_bytes":4427140664,"captured_at":"2026-10-08T06:19:07.926686+00:00","entries":402,"volumes":[{"allocated_bytes":4427755520,"apparent_bytes":4427140664,"entries":402,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-800k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T06:19:07.831489+00:00","volumes":[{"allocated_bytes":4427755520,"apparent_bytes":4427140664,"entries":402,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-800k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T06:03:17.919323+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T06:03:17.919296+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-800k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T06:03:17.832086+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-800k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t2_scale-big-800k-antfly-data"}]},"protocol_fingerprint":"a1d468111724a8ce445c63f6860634a6c68867ae4da492d129e9f1c09ce2c8e8","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T06:19:08.489333+00:00"},"trial":2}],"metrics":{"demand_mb":{"max":3938.3,"mean":3701.25,"min":3464.2,"values":[3464.2,3938.3]},"final_allocated_bytes":{"max":4396199936,"mean":4328108032,"min":4260016128,"values":[4260016128,4396199936]},"index_build_seconds":{"max":313.1898,"mean":303.02995,"min":292.8701,"values":[292.8701,313.1898]},"lifecycle_seconds":{"max":992.8572626113892,"mean":962.6957000494003,"min":932.5341374874115,"values":[932.5341374874115,992.8572626113892]},"peak_clients":{"max":30,"mean":25,"min":20,"values":[30,20]},"peak_qps":{"max":823.1555,"mean":810.173,"min":797.1905,"values":[797.1905,823.1555]},"serial_p95_ms":{"max":11.3,"mean":10.45,"min":9.6,"values":[9.6,11.3]}},"profile":"big","qualification":{"ndcg_min":0.9711,"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall_min":0.9667,"request_errors":0,"trials":[{"ndcg":0.9711,"recall":0.9667,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":1},{"ndcg":0.9726,"recall":0.9685,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":2}]},"storage_qualification":{"metric":"final_allocated_bytes","qualified_trials":2,"status":"qualified","total_trials":2,"trials":[{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"aaa511ca0340136a4cc3a811e9712bfba079016d1b7d297c3285328ae9d5a95d","status":"qualified","trial":1},{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"a1d468111724a8ce445c63f6860634a6c68867ae4da492d129e9f1c09ce2c8e8","status":"qualified","trial":2}]},"vectors":800000},{"concurrency_observations":[{"clients":1,"p95_ms":{"max":13.734488691261504,"mean":13.125652672897555,"min":12.516816654533608,"values":[12.516816654533608,13.734488691261504]},"p99_ms":{"max":18.88659154559719,"mean":17.345621941931306,"min":15.804652338265422,"values":[15.804652338265422,18.88659154559719]},"qps":{"max":108.189,"mean":107.89959999999999,"min":107.6102,"values":[108.189,107.6102]}},{"clients":5,"p95_ms":{"max":14.88608621293678,"mean":13.826533305109473,"min":12.766980397282166,"values":[12.766980397282166,14.88608621293678]},"p99_ms":{"max":17.7344299829565,"mean":17.732388165895827,"min":17.730346348835155,"values":[17.730346348835155,17.7344299829565]},"qps":{"max":495.2379,"mean":494.21090000000004,"min":493.1839,"values":[495.2379,493.1839]}},{"clients":10,"p95_ms":{"max":19.147154001984745,"mean":18.944112652388867,"min":18.74107130279299,"values":[19.147154001984745,18.74107130279299]},"p99_ms":{"max":23.149893805384636,"mean":22.876090183272026,"min":22.602286561159417,"values":[23.149893805384636,22.602286561159417]},"qps":{"max":776.576,"mean":769.18055,"min":761.7851,"values":[761.7851,776.576]}},{"clients":20,"p95_ms":{"max":42.14922809769633,"mean":41.469117643282516,"min":40.78900718886871,"values":[42.14922809769633,40.78900718886871]},"p99_ms":{"max":55.31143766856992,"mean":52.77217303606453,"min":50.23290840355913,"values":[55.31143766856992,50.23290840355913]},"qps":{"max":795.1135,"mean":793.0353,"min":790.9571,"values":[790.9571,795.1135]}},{"clients":30,"p95_ms":{"max":68.02451339899564,"mean":67.46256325423019,"min":66.90061310946476,"values":[66.90061310946476,68.02451339899564]},"p99_ms":{"max":90.53567649738392,"mean":86.2968760693911,"min":82.05807564139829,"values":[82.05807564139829,90.53567649738392]},"qps":{"max":798.4651,"mean":790.9596,"min":783.4541,"values":[798.4651,783.4541]}}],"concurrency_trials":[{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p375","ndcg":0.9514,"p95_ms":9.4,"p99_ms":10.3,"parameter":"search_effort","recall":0.945,"status":"ok","value":0.375,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p35","ndcg":0.9297,"p95_ms":31.1,"p99_ms":60.4,"parameter":"search_effort","recall":0.9211,"status":"ok","value":0.35,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p475","ndcg":0.9921,"p95_ms":14.4,"p99_ms":18.5,"parameter":"search_effort","recall":0.9906,"status":"ok","value":0.475,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p6","ndcg":0.9959,"p95_ms":18.9,"p99_ms":19.9,"parameter":"search_effort","recall":0.9946,"status":"ok","value":0.6,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p7","ndcg":0.9961,"p95_ms":22.3,"p99_ms":30.4,"parameter":"search_effort","recall":0.9949,"status":"ok","value":0.7,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p4","ndcg":0.9671,"p95_ms":9.9,"p99_ms":11.4,"parameter":"search_effort","recall":0.9628,"status":"ok","value":0.4,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p5","ndcg":0.9946,"p95_ms":16.2,"p99_ms":16.8,"parameter":"search_effort","recall":0.9934,"status":"ok","value":0.5,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p425","ndcg":0.9789,"p95_ms":10.9,"p99_ms":12.2,"parameter":"search_effort","recall":0.9758,"status":"ok","value":0.425,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p45","ndcg":0.9871,"p95_ms":12.1,"p99_ms":12.9,"parameter":"search_effort","recall":0.9849,"status":"ok","value":0.45,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p55","ndcg":0.9953,"p95_ms":18.3,"p99_ms":25.9,"parameter":"search_effort","recall":0.994,"status":"ok","value":0.55,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-1","ndcg":0.9966,"p95_ms":45.2,"p99_ms":64,"parameter":"search_effort","recall":0.9955,"status":"ok","value":1,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p8","ndcg":0.9964,"p95_ms":25.4,"p99_ms":26.5,"parameter":"search_effort","recall":0.9952,"status":"ok","value":0.8,"workload":"scale-big-1m"}],"cell_sha256":"f9f2f6193d3dced1065049b1cbfd1673e5782e0a87624042cb06dae27582c0e0","index_build":{"insert_duration":290.5409,"optimize_duration":96.1299,"seconds":386.67080000000004},"lifecycle":{"cache_key":"50663c8619d782665c14d153244298835762bab104a843cc723b803eec21af28","duration_seconds":1053.1733465194702,"finished_at":1791423475.0745273,"object_sha256":"8110f196b97920bd84a2d5e12f6580f19e85ed16d2a28e3b4eae1def5f8b6d47","receipt_sha256":"49195761bfb264fd5f226f42e4e35e10b6cfefc51629fb7c939762a00fc9a581","started_at":1791422421.9011807},"memory":{"anon_shmem_peak_mb":3842.2,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":9889.6,"cgroup_current_peak_mb":9889.4,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":3842.2,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":9889390592,"cgroup_kernel_peak_sum_bytes":9889611776,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":3842150400,"ended":1791423441.0960054,"failed_samples":0,"first_sample_at":1791422425.418408,"kind":"container_cgroup_v2","last_sample_at":1791423440.8779397,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":4956,"schema_version":3,"started":1791422425.3948932,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791422425.418408,"index_started_at":1791422425.4526227,"last_sample_at":1791423440.8779397,"max_sample_gap_s":0.269,"publication_finished_at":1791423440.6877925,"sampler_ended_at":1791423441.0960054,"sampler_started_at":1791422425.3948932,"samples":4956,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.009225927728936285,0.010073647493019354,0.013089308067039578,0.02516364892183152,0.037280675270080894],"conc_latency_p95_list":[0.012516816654533608,0.012766980397282166,0.019147154001984745,0.04214922809769633,0.06690061310946475],"conc_latency_p99_list":[0.01580465233826542,0.017730346348835156,0.023149893805384635,0.05531143766856992,0.08205807564139829],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[108.189,495.2379,761.7851,790.9571,798.4651],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9657,"optimize_duration":0,"p99_c30_ms":82.05807564139829,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":30,"peak_qps":798.4651,"qps":798.4651,"qps_c30":798.4651,"recall":0.9608,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0124,"serial_latency_p99":0.0228,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9657,"recall":0.9608,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":1},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":290.5,"load_s":386.7,"source_label":"antfly-qualification-scale-big-1m-0p35"},"ndcg":0.9671,"p95_ms":9.9,"p99_ms":11.4,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9628,"selection_mode":"swept","value":0.4},"status":"ok","storage":{"created_at":"2026-10-08T01:20:22.723622+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-big-1m"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T01:20:22.841239+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T01:20:22.841213+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T01:20:22.762267+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]},"final":{"allocated_bytes":6252322816,"apparent_bytes":6245723599,"completed_at":"2026-10-08T01:37:25.643701+00:00","samples":[{"allocated_bytes":6252322816,"apparent_bytes":6245723599,"captured_at":"2026-10-08T01:37:25.643666+00:00","entries":3351,"volumes":[{"allocated_bytes":6252322816,"apparent_bytes":6245723599,"entries":3351,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T01:37:25.546921+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-big-1m","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":6252322816,"apparent_bytes":6245723599,"entries":3351,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]},"post_workload":{"allocated_bytes":6124666880,"apparent_bytes":6103717783,"completed_at":"2026-10-08T01:37:21.376528+00:00","samples":[{"allocated_bytes":6124666880,"apparent_bytes":6103717783,"captured_at":"2026-10-08T01:37:21.376502+00:00","entries":3350,"volumes":[{"allocated_bytes":6124666880,"apparent_bytes":6103717783,"entries":3350,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T01:37:21.245133+00:00","volumes":[{"allocated_bytes":6124666880,"apparent_bytes":6103717783,"entries":3350,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T01:20:25.310051+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T01:20:25.310025+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T01:20:25.223760+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]},"protocol_fingerprint":"ebddbf03dfd9cec334ee42099099629d98d67c6a8524d7dfc43b69aed7b2dab1","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T01:37:25.643705+00:00"},"trial":1},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p6","ndcg":0.995,"p95_ms":19.1,"p99_ms":21,"parameter":"search_effort","recall":0.9935,"status":"ok","value":0.6,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p8","ndcg":0.9957,"p95_ms":25,"p99_ms":27.9,"parameter":"search_effort","recall":0.9943,"status":"ok","value":0.8,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p425","ndcg":0.9792,"p95_ms":12.1,"p99_ms":13.5,"parameter":"search_effort","recall":0.9764,"status":"ok","value":0.425,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p4","ndcg":0.9682,"p95_ms":9.9,"p99_ms":10.6,"parameter":"search_effort","recall":0.9639,"status":"ok","value":0.4,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p7","ndcg":0.9953,"p95_ms":22,"p99_ms":38.7,"parameter":"search_effort","recall":0.9938,"status":"ok","value":0.7,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p375","ndcg":0.9533,"p95_ms":11,"p99_ms":12.5,"parameter":"search_effort","recall":0.9472,"status":"ok","value":0.375,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p5","ndcg":0.9937,"p95_ms":16.2,"p99_ms":17.2,"parameter":"search_effort","recall":0.992,"status":"ok","value":0.5,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p35","ndcg":0.9336,"p95_ms":29.8,"p99_ms":61.3,"parameter":"search_effort","recall":0.9254,"status":"ok","value":0.35,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p45","ndcg":0.987,"p95_ms":12.4,"p99_ms":20.9,"parameter":"search_effort","recall":0.9846,"status":"ok","value":0.45,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p475","ndcg":0.9921,"p95_ms":13.7,"p99_ms":14.6,"parameter":"search_effort","recall":0.9901,"status":"ok","value":0.475,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p55","ndcg":0.9941,"p95_ms":16.9,"p99_ms":17.1,"parameter":"search_effort","recall":0.9924,"status":"ok","value":0.55,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-1","ndcg":0.9959,"p95_ms":45.5,"p99_ms":57.5,"parameter":"search_effort","recall":0.9946,"status":"ok","value":1,"workload":"scale-big-1m"}],"cell_sha256":"3553086a33c1854b7eaf02bc50d39639332fda6010f8bc40a6bea4030ce3a17f","index_build":{"insert_duration":314.2932,"optimize_duration":106.1593,"seconds":420.4525},"lifecycle":{"cache_key":"24c02999aeb7aa35b9372a189a89654c02005363c63963259873f57abc336c74","duration_seconds":1083.329823732376,"finished_at":1791439394.145658,"object_sha256":"03ccf5abc93a2f69c8fcc833abdb8f7d2a8904afad462a45ba80b6d30d450aeb","receipt_sha256":"fbcd386f3dce645cd71390616a393c29e4a61ded24f6d1734023f99f16dfefb8","started_at":1791438310.8158343},"memory":{"anon_shmem_peak_mb":3981.5,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":9961.8,"cgroup_current_peak_mb":9944.4,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":3981.5,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":9944432640,"cgroup_kernel_peak_sum_bytes":9961762816,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":3981471744,"ended":1791439366.584448,"failed_samples":0,"first_sample_at":1791438314.9032998,"kind":"container_cgroup_v2","last_sample_at":1791439366.3478544,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":5135,"schema_version":3,"started":1791438314.8790112,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791438314.9032998,"index_started_at":1791438314.9202173,"last_sample_at":1791439366.3478544,"max_sample_gap_s":0.28,"publication_finished_at":1791439366.1461642,"sampler_ended_at":1791439366.584448,"sampler_started_at":1791438314.8790112,"samples":5135,"status":"qualified","trial":2,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.00927736837166058,0.010113013584659818,0.012839137165231891,0.025019754433659693,0.03800956070425294],"conc_latency_p95_list":[0.013734488691261504,0.014886086212936779,0.01874107130279299,0.04078900718886871,0.06802451339899564],"conc_latency_p99_list":[0.01888659154559719,0.0177344299829565,0.022602286561159417,0.05023290840355913,0.09053567649738392],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[107.6102,493.1839,776.576,795.1135,783.4541],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9655,"optimize_duration":0,"p99_c30_ms":90.53567649738392,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":20,"peak_qps":795.1135,"qps":795.1135,"qps_c30":783.4541,"recall":0.9606,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0111,"serial_latency_p99":0.0151,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9655,"recall":0.9606,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":2},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":314.3,"load_s":420.5,"source_label":"antfly-qualification-scale-big-1m-0p35"},"ndcg":0.9682,"p95_ms":9.9,"p99_ms":10.6,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9639,"selection_mode":"swept","value":0.4},"status":"ok","storage":{"created_at":"2026-10-08T05:45:11.564130+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"2","workload":"scale-big-1m"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T05:45:11.696683+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T05:45:11.696659+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-1m-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T05:45:11.609556+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-1m-antfly-data"}]},"final":{"allocated_bytes":5936889856,"apparent_bytes":5930224726,"completed_at":"2026-10-08T06:02:47.975375+00:00","samples":[{"allocated_bytes":5936889856,"apparent_bytes":5930224726,"captured_at":"2026-10-08T06:02:47.975350+00:00","entries":3354,"volumes":[{"allocated_bytes":5936889856,"apparent_bytes":5930224726,"entries":3354,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-1m-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T06:02:47.865920+00:00","termination":{"container":"antfly_bench_vdbb_scale_t2_scale-big-1m","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":5936889856,"apparent_bytes":5930224726,"entries":3354,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-1m-antfly-data"}]},"post_workload":{"allocated_bytes":5936885760,"apparent_bytes":5930223051,"completed_at":"2026-10-08T06:02:46.907004+00:00","samples":[{"allocated_bytes":5936885760,"apparent_bytes":5930223051,"captured_at":"2026-10-08T06:02:46.906980+00:00","entries":3352,"volumes":[{"allocated_bytes":5936885760,"apparent_bytes":5930223051,"entries":3352,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-1m-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T06:02:46.740494+00:00","volumes":[{"allocated_bytes":5936885760,"apparent_bytes":5930223051,"entries":3352,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-1m-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T05:45:14.765000+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T05:45:14.764975+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-1m-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T05:45:14.655335+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-1m-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t2_scale-big-1m-antfly-data"}]},"protocol_fingerprint":"59b8bc318517df94635437dc71124724ea2c080efe51530387255d43da68321f","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T06:02:47.975378+00:00"},"trial":2}],"metrics":{"demand_mb":{"max":3981.5,"mean":3911.85,"min":3842.2,"values":[3842.2,3981.5]},"final_allocated_bytes":{"max":6252322816,"mean":6094606336,"min":5936889856,"values":[6252322816,5936889856]},"index_build_seconds":{"max":420.4525,"mean":403.56165,"min":386.67080000000004,"values":[386.67080000000004,420.4525]},"lifecycle_seconds":{"max":1083.329823732376,"mean":1068.2515851259232,"min":1053.1733465194702,"values":[1053.1733465194702,1083.329823732376]},"peak_clients":{"max":30,"mean":25,"min":20,"values":[30,20]},"peak_qps":{"max":798.4651,"mean":796.7893,"min":795.1135,"values":[798.4651,795.1135]},"serial_p95_ms":{"max":12.4,"mean":11.75,"min":11.1,"values":[12.4,11.1]}},"profile":"big","qualification":{"ndcg_min":0.9655,"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall_min":0.9606,"request_errors":0,"trials":[{"ndcg":0.9657,"recall":0.9608,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":1},{"ndcg":0.9655,"recall":0.9606,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.4},"trial":2}]},"storage_qualification":{"metric":"final_allocated_bytes","qualified_trials":2,"status":"qualified","total_trials":2,"trials":[{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"ebddbf03dfd9cec334ee42099099629d98d67c6a8524d7dfc43b69aed7b2dab1","status":"qualified","trial":1},{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"59b8bc318517df94635437dc71124724ea2c080efe51530387255d43da68321f","status":"qualified","trial":2}]},"vectors":1000000},{"concurrency_observations":[{"clients":1,"p95_ms":{"max":86.04053749877494,"mean":69.58425691263982,"min":53.1279763265047,"values":[53.1279763265047,86.04053749877494]},"p99_ms":{"max":103.89080180611921,"mean":83.57787256245497,"min":63.264943318790735,"values":[63.264943318790735,103.89080180611921]},"qps":{"max":31.9989,"mean":25.4898,"min":18.9807,"values":[31.9989,18.9807]}},{"clients":5,"p95_ms":{"max":58.204373568878495,"mean":39.031087405601276,"min":19.857801242324058,"values":[19.857801242324058,58.204373568878495]},"p99_ms":{"max":144.5337368157925,"mean":86.08062938277725,"min":27.62752194976198,"values":[27.62752194976198,144.5337368157925]},"qps":{"max":358.8593,"mean":288.8202,"min":218.7811,"values":[358.8593,218.7811]}},{"clients":10,"p95_ms":{"max":134.59573249565437,"mean":81.26172925403807,"min":27.927726012421772,"values":[27.927726012421772,134.59573249565437]},"p99_ms":{"max":260.6944759900216,"mean":148.03281414642697,"min":35.37115230283232,"values":[35.37115230283232,260.6944759900216]},"qps":{"max":551.1287,"mean":351.0675,"min":151.0063,"values":[551.1287,151.0063]}},{"clients":20,"p95_ms":{"max":2325.619974260917,"mean":1193.2724012323888,"min":60.92482820386066,"values":[60.92482820386066,2325.619974260917]},"p99_ms":{"max":3332.6110555577907,"mean":1712.2845138904813,"min":91.9579722231721,"values":[91.9579722231721,3332.6110555577907]},"qps":{"max":558.4147,"mean":286.98855000000003,"min":15.5624,"values":[558.4147,15.5624]}},{"clients":30,"p95_ms":{"max":215.48077298211865,"mean":185.1868552439555,"min":154.8929375057924,"values":[154.8929375057924,215.48077298211865]},"p99_ms":{"max":645.8046227926382,"mean":465.92348943915687,"min":286.0423560856756,"values":[286.0423560856756,645.8046227926382]},"qps":{"max":337.9328,"mean":334.94960000000003,"min":331.9664,"values":[337.9328,331.9664]}}],"concurrency_trials":[{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-1","ndcg":0.9962,"p95_ms":93.9,"p99_ms":121.6,"parameter":"search_effort","recall":0.995,"status":"ok","value":1,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p4","ndcg":0.9492,"p95_ms":19.5,"p99_ms":24,"parameter":"search_effort","recall":0.942,"status":"ok","value":0.4,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p45","ndcg":0.9764,"p95_ms":20.6,"p99_ms":22.3,"parameter":"search_effort","recall":0.9726,"status":"ok","value":0.45,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p5","ndcg":0.9909,"p95_ms":23.5,"p99_ms":25.5,"parameter":"search_effort","recall":0.9888,"status":"ok","value":0.5,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p55","ndcg":0.9925,"p95_ms":23.1,"p99_ms":26.7,"parameter":"search_effort","recall":0.9907,"status":"ok","value":0.55,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p425","ndcg":0.9641,"p95_ms":21.9,"p99_ms":25.5,"parameter":"search_effort","recall":0.9588,"status":"ok","value":0.425,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p35","ndcg":0.9056,"p95_ms":124.7,"p99_ms":178.4,"parameter":"search_effort","recall":0.8949,"status":"ok","value":0.35,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p6","ndcg":0.9942,"p95_ms":26.5,"p99_ms":28.3,"parameter":"search_effort","recall":0.9927,"status":"ok","value":0.6,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p475","ndcg":0.9852,"p95_ms":21.6,"p99_ms":23.4,"parameter":"search_effort","recall":0.9826,"status":"ok","value":0.475,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p8","ndcg":0.9961,"p95_ms":40.6,"p99_ms":57,"parameter":"search_effort","recall":0.9949,"status":"ok","value":0.8,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p375","ndcg":0.9309,"p95_ms":19.8,"p99_ms":24,"parameter":"search_effort","recall":0.922,"status":"ok","value":0.375,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p7","ndcg":0.9956,"p95_ms":32.1,"p99_ms":34.3,"parameter":"search_effort","recall":0.9942,"status":"ok","value":0.7,"workload":"scale-big-2m"}],"cell_sha256":"c79c3284c23664e2db0063b77ead016f0e09212b8204e6b6db30c94803de3e65","index_build":{"insert_duration":675.1348,"optimize_duration":388.5829,"seconds":1063.7177000000001},"lifecycle":{"cache_key":"20296a5bcf2369ad6b2e881efdc84bb892e8afa09a0b74108833451e5edace01","duration_seconds":1775.2171692848206,"finished_at":1791425250.7145307,"object_sha256":"89b835cc39fd97491eee6b2ce85307bb213b53d26a13ff7c526cf00547ebad97","receipt_sha256":"e18105ff437946f0d4a55f2d546c90c76769398a81ffbd2c5ce0cbe15f72d956","started_at":1791423475.4973614},"memory":{"anon_shmem_peak_mb":6241,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":15839.3,"cgroup_current_peak_mb":15822.7,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":6241,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":15822671872,"cgroup_kernel_peak_sum_bytes":15839285248,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":6240989184,"ended":1791425220.5395293,"failed_samples":0,"first_sample_at":1791423478.9864304,"kind":"container_cgroup_v2","last_sample_at":1791425220.3178105,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":8527,"schema_version":3,"started":1791423478.9566424,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791423478.9864304,"index_started_at":1791423479.0178096,"last_sample_at":1791425220.3178105,"max_sample_gap_s":0.235,"publication_finished_at":1791425220.1625054,"sampler_ended_at":1791425220.5395293,"sampler_started_at":1791423478.9566424,"samples":8527,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.031187941376027883,0.013896902288068709,0.01809079892429866,0.03566283866409256,0.08819627152087649],"conc_latency_p95_list":[0.0531279763265047,0.019857801242324058,0.027927726012421772,0.060924828203860665,0.1548929375057924],"conc_latency_p99_list":[0.06326494331879073,0.02762752194976198,0.035371152302832325,0.0919579722231721,0.2860423560856756],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[31.9989,358.8593,551.1287,558.4147,337.9328],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.965,"optimize_duration":0,"p99_c30_ms":286.0423560856756,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":20,"peak_qps":558.4147,"qps":558.4147,"qps_c30":337.9328,"recall":0.9599,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0298,"serial_latency_p99":0.039,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.965,"recall":0.9599,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.425},"trial":1},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":675.1,"load_s":1063.7,"source_label":"antfly-qualification-scale-big-2m-0p35"},"ndcg":0.9641,"p95_ms":21.9,"p99_ms":25.5,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9588,"selection_mode":"swept","value":0.425},"status":"ok","storage":{"created_at":"2026-10-08T01:37:56.292137+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-big-2m"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T01:37:56.411634+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T01:37:56.411608+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T01:37:56.331755+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]},"final":{"allocated_bytes":15842775040,"apparent_bytes":15831965307,"completed_at":"2026-10-08T02:07:02.261224+00:00","samples":[{"allocated_bytes":15842775040,"apparent_bytes":15831965307,"captured_at":"2026-10-08T02:07:02.261175+00:00","entries":5293,"volumes":[{"allocated_bytes":15842775040,"apparent_bytes":15831965307,"entries":5293,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T02:07:02.112513+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-big-2m","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":15842775040,"apparent_bytes":15831965307,"entries":5293,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]},"post_workload":{"allocated_bytes":15842770944,"apparent_bytes":15831963988,"completed_at":"2026-10-08T02:07:00.915111+00:00","samples":[{"allocated_bytes":15842770944,"apparent_bytes":15831963988,"captured_at":"2026-10-08T02:07:00.915086+00:00","entries":5291,"volumes":[{"allocated_bytes":15842770944,"apparent_bytes":15831963988,"entries":5291,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T02:07:00.763155+00:00","volumes":[{"allocated_bytes":15842770944,"apparent_bytes":15831963988,"entries":5291,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T01:37:58.875375+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T01:37:58.875350+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T01:37:58.794498+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]},"protocol_fingerprint":"b794a709dd620796fea5fc864196f50dd6b31f74d979711e661349d0bb5ba494","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T02:07:02.261228+00:00"},"trial":1},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p6","ndcg":0.9942,"p95_ms":30.7,"p99_ms":42.4,"parameter":"search_effort","recall":0.9926,"status":"ok","value":0.6,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p7","ndcg":0.9956,"p95_ms":33,"p99_ms":41.9,"parameter":"search_effort","recall":0.9942,"status":"ok","value":0.7,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p4","ndcg":0.9496,"p95_ms":22.4,"p99_ms":30.8,"parameter":"search_effort","recall":0.9423,"status":"ok","value":0.4,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p8","ndcg":0.9963,"p95_ms":43,"p99_ms":48.8,"parameter":"search_effort","recall":0.9951,"status":"ok","value":0.8,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p5","ndcg":0.9908,"p95_ms":24.7,"p99_ms":32.2,"parameter":"search_effort","recall":0.9888,"status":"ok","value":0.5,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p475","ndcg":0.9855,"p95_ms":24.9,"p99_ms":29.7,"parameter":"search_effort","recall":0.9826,"status":"ok","value":0.475,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p45","ndcg":0.9773,"p95_ms":21.8,"p99_ms":25.3,"parameter":"search_effort","recall":0.9733,"status":"ok","value":0.45,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p375","ndcg":0.9288,"p95_ms":22.9,"p99_ms":27.2,"parameter":"search_effort","recall":0.9196,"status":"ok","value":0.375,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p55","ndcg":0.9925,"p95_ms":24.7,"p99_ms":28.8,"parameter":"search_effort","recall":0.9905,"status":"ok","value":0.55,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p35","ndcg":0.9023,"p95_ms":124.5,"p99_ms":175.2,"parameter":"search_effort","recall":0.8916,"status":"ok","value":0.35,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-1","ndcg":0.9966,"p95_ms":103.4,"p99_ms":114.9,"parameter":"search_effort","recall":0.9954,"status":"ok","value":1,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p425","ndcg":0.9656,"p95_ms":25.3,"p99_ms":35.1,"parameter":"search_effort","recall":0.9602,"status":"ok","value":0.425,"workload":"scale-big-2m"}],"cell_sha256":"0b801d32954ff8c8ed4cfead158e62803e04fba1c62cdb9b9183e29e09da24c5","index_build":{"insert_duration":724.0682,"optimize_duration":454.5282,"seconds":1178.5964000000001},"lifecycle":{"cache_key":"c10a4dc81f66e8d69e05c615666db95272535542a0eda72cc8839d0140a30751","duration_seconds":1896.1306829452515,"finished_at":1791438310.40242,"object_sha256":"edc3937f9bc8504978594ad004867d95193f3201a4137a47649cb4dcf9412902","receipt_sha256":"5152c7821ee6a56b32ce384a95e6d67f88919ae9caf3dfefc47de721e988dbf9","started_at":1791436414.271737},"memory":{"anon_shmem_peak_mb":6816.4,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":12633.7,"cgroup_current_peak_mb":12613.4,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":6816.4,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":12613369856,"cgroup_kernel_peak_sum_bytes":12633698304,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":6816374784,"ended":1791438279.7950866,"failed_samples":0,"first_sample_at":1791436418.5594873,"kind":"container_cgroup_v2","last_sample_at":1791438279.5770605,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":9110,"schema_version":3,"started":1791436418.527665,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791436418.5594873,"index_started_at":1791436418.5868192,"last_sample_at":1791438279.5770605,"max_sample_gap_s":0.545,"publication_finished_at":1791438279.5485673,"sampler_ended_at":1791438279.7950866,"sampler_started_at":1791436418.527665,"samples":9110,"status":"qualified","trial":2,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.05258789946567333,0.02279921957126859,0.06598242128162264,1.2616741216956084,0.08950241487955064],"conc_latency_p95_list":[0.08604053749877494,0.0582043735688785,0.13459573249565437,2.325619974260917,0.21548077298211865],"conc_latency_p99_list":[0.10389080180611922,0.1445337368157925,0.2606944759900216,3.332611055557791,0.6458046227926382],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[18.9807,218.7811,151.0063,15.5624,331.9664],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9647,"optimize_duration":0,"p99_c30_ms":645.8046227926382,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":30,"peak_qps":331.9664,"qps":331.9664,"qps_c30":331.9664,"recall":0.9596,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0227,"serial_latency_p99":0.0561,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9647,"recall":0.9596,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.425},"trial":2},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":724.1,"load_s":1178.6,"source_label":"antfly-qualification-scale-big-2m-0p35"},"ndcg":0.9656,"p95_ms":25.3,"p99_ms":35.1,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9602,"selection_mode":"swept","value":0.425},"status":"ok","storage":{"created_at":"2026-10-08T05:13:35.188916+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"2","workload":"scale-big-2m"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T05:13:35.371499+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T05:13:35.371469+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-2m-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T05:13:35.254194+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-2m-antfly-data"}]},"final":{"allocated_bytes":15575855104,"apparent_bytes":15565218286,"completed_at":"2026-10-08T05:44:41.314822+00:00","samples":[{"allocated_bytes":15575855104,"apparent_bytes":15565218286,"captured_at":"2026-10-08T05:44:41.314787+00:00","entries":5287,"volumes":[{"allocated_bytes":15575855104,"apparent_bytes":15565218286,"entries":5287,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-2m-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T05:44:41.216694+00:00","termination":{"container":"antfly_bench_vdbb_scale_t2_scale-big-2m","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":15575855104,"apparent_bytes":15565218286,"entries":5287,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-2m-antfly-data"}]},"post_workload":{"allocated_bytes":15575851008,"apparent_bytes":15565217103,"completed_at":"2026-10-08T05:44:40.108338+00:00","samples":[{"allocated_bytes":15575851008,"apparent_bytes":15565217103,"captured_at":"2026-10-08T05:44:40.108317+00:00","entries":5285,"volumes":[{"allocated_bytes":15575851008,"apparent_bytes":15565217103,"entries":5285,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-2m-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T05:44:39.973627+00:00","volumes":[{"allocated_bytes":15575851008,"apparent_bytes":15565217103,"entries":5285,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-2m-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T05:13:38.444555+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T05:13:38.444534+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-2m-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T05:13:38.356800+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-2m-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t2_scale-big-2m-antfly-data"}]},"protocol_fingerprint":"069c805a0d25a700b733bb6c09579aea8535d86436276427f3f1cc9553a4e32b","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T05:44:41.314826+00:00"},"trial":2}],"metrics":{"demand_mb":{"max":6816.4,"mean":6528.7,"min":6241,"values":[6241,6816.4]},"final_allocated_bytes":{"max":15842775040,"mean":15709315072,"min":15575855104,"values":[15842775040,15575855104]},"index_build_seconds":{"max":1178.5964000000001,"mean":1121.1570500000003,"min":1063.7177000000001,"values":[1063.7177000000001,1178.5964000000001]},"lifecycle_seconds":{"max":1896.1306829452515,"mean":1835.673926115036,"min":1775.2171692848206,"values":[1775.2171692848206,1896.1306829452515]},"peak_clients":{"max":30,"mean":25,"min":20,"values":[20,30]},"peak_qps":{"max":558.4147,"mean":445.19055000000003,"min":331.9664,"values":[558.4147,331.9664]},"serial_p95_ms":{"max":29.8,"mean":26.25,"min":22.7,"values":[29.8,22.7]}},"profile":"big","qualification":{"ndcg_min":0.9647,"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall_min":0.9596,"request_errors":0,"trials":[{"ndcg":0.965,"recall":0.9599,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.425},"trial":1},{"ndcg":0.9647,"recall":0.9596,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.425},"trial":2}]},"storage_qualification":{"metric":"final_allocated_bytes","qualified_trials":2,"status":"qualified","total_trials":2,"trials":[{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"b794a709dd620796fea5fc864196f50dd6b31f74d979711e661349d0bb5ba494","status":"qualified","trial":1},{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"069c805a0d25a700b733bb6c09579aea8535d86436276427f3f1cc9553a4e32b","status":"qualified","trial":2}]},"vectors":2000000},{"concurrency_observations":[{"clients":1,"p95_ms":{"max":994.8690574150531,"mean":926.2252212116435,"min":857.581385008234,"values":[994.8690574150531,857.581385008234]},"p99_ms":{"max":1557.3479785979744,"mean":1549.3365743193142,"min":1541.325170040654,"values":[1557.3479785979744,1541.325170040654]},"qps":{"max":1.9084,"mean":1.69115,"min":1.4739,"values":[1.4739,1.9084]}},{"clients":5,"p95_ms":{"max":6434.965849673608,"mean":3628.047610917565,"min":821.1293721615216,"values":[821.1293721615216,6434.965849673608]},"p99_ms":{"max":7781.358001353509,"mean":5233.605729216796,"min":2685.8534570800834,"values":[2685.8534570800834,7781.358001353509]},"qps":{"max":12.8063,"mean":7.0059000000000005,"min":1.2055,"values":[12.8063,1.2055]}},{"clients":10,"p95_ms":{"max":1041.7742813937364,"mean":737.441241199849,"min":433.10820100596163,"values":[1041.7742813937364,433.10820100596163]},"p99_ms":{"max":1859.2564908228824,"mean":1659.2519776249583,"min":1459.2474644270342,"values":[1859.2564908228824,1459.2474644270342]},"qps":{"max":59.2108,"mean":41.17515,"min":23.1395,"values":[23.1395,59.2108]}},{"clients":20,"p95_ms":{"max":9262.034138497253,"mean":4728.638106353172,"min":195.2420742090904,"values":[9262.034138497253,195.2420742090904]},"p99_ms":{"max":10732.493293482092,"mean":5557.592315251666,"min":382.69133702124094,"values":[10732.493293482092,382.69133702124094]},"qps":{"max":293.9966,"mean":149.06815,"min":4.1397,"values":[4.1397,293.9966]}},{"clients":30,"p95_ms":{"max":793.1234508447229,"mean":510.108008301904,"min":227.09256575908512,"values":[793.1234508447229,227.09256575908512]},"p99_ms":{"max":1801.4021865703294,"mean":1131.2389287076023,"min":461.0756708448751,"values":[1801.4021865703294,461.0756708448751]},"qps":{"max":330.0342,"mean":221.96795,"min":113.9017,"values":[113.9017,330.0342]}}],"concurrency_trials":[{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p35","ndcg":0.8841,"p95_ms":626.1,"p99_ms":755.6,"parameter":"search_effort","recall":0.8736,"status":"ok","value":0.35,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p7","ndcg":0.993,"p95_ms":1558.7,"p99_ms":1597.1,"parameter":"search_effort","recall":0.9912,"status":"ok","value":0.7,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p425","ndcg":0.9523,"p95_ms":445,"p99_ms":502.5,"parameter":"search_effort","recall":0.9468,"status":"ok","value":0.425,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-1","ndcg":0.995,"p95_ms":5278.3,"p99_ms":5357.8,"parameter":"search_effort","recall":0.9934,"status":"ok","value":1,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p55","ndcg":0.9876,"p95_ms":682.1,"p99_ms":817.6,"parameter":"search_effort","recall":0.9849,"status":"ok","value":0.55,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p4","ndcg":0.9329,"p95_ms":422.1,"p99_ms":506.3,"parameter":"search_effort","recall":0.926,"status":"ok","value":0.4,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p475","ndcg":0.9765,"p95_ms":498.3,"p99_ms":648.7,"parameter":"search_effort","recall":0.9732,"status":"ok","value":0.475,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p375","ndcg":0.91,"p95_ms":443.9,"p99_ms":669.9,"parameter":"search_effort","recall":0.9013,"status":"ok","value":0.375,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p8","ndcg":0.9946,"p95_ms":1990,"p99_ms":2024.8,"parameter":"search_effort","recall":0.9929,"status":"ok","value":0.8,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p45","ndcg":0.966,"p95_ms":488.4,"p99_ms":564,"parameter":"search_effort","recall":0.9613,"status":"ok","value":0.45,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p6","ndcg":0.9899,"p95_ms":1235.7,"p99_ms":1286.1,"parameter":"search_effort","recall":0.9877,"status":"ok","value":0.6,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p5","ndcg":0.9842,"p95_ms":580.8,"p99_ms":695.2,"parameter":"search_effort","recall":0.9812,"status":"ok","value":0.5,"workload":"scale-big-3m"}],"cell_sha256":"5d266b153c19496c2a2ff89239d6e0bb5adb65348680ecb7e41614914804ea79","index_build":{"insert_duration":1176.9085,"optimize_duration":2032.033,"seconds":3208.9415},"lifecycle":{"cache_key":"acc27006955e15f17b17890051ed7a85659deeba3a0a80bb30b205034ade8ee8","duration_seconds":6197.2556319236755,"finished_at":1791431448.4587076,"object_sha256":"e3665ab53b54f358e38bf0f0f90c13b83b33fa6a1693e0942e2def90e24e8d1d","receipt_sha256":"ce32ba4b731e1469d47c3485fa3a6be2f964d556f99fcdb402a3f2e38ea8de8b","started_at":1791425251.2030756},"memory":{"anon_shmem_peak_mb":9227.4,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":14794.6,"cgroup_current_peak_mb":14787.8,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":9227.4,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":14787837952,"cgroup_kernel_peak_sum_bytes":14794629120,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":9227354112,"ended":1791431408.723988,"failed_samples":0,"first_sample_at":1791425255.0266101,"kind":"container_cgroup_v2","last_sample_at":1791431408.5056643,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":30180,"schema_version":3,"started":1791425254.9994009,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791425255.0266101,"index_started_at":1791425255.0623643,"last_sample_at":1791431408.5056643,"max_sample_gap_s":0.359,"publication_finished_at":1791431408.368993,"sampler_ended_at":1791431408.723988,"sampler_started_at":1791425254.9994009,"samples":30180,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.6772366448001574,0.38808423280985976,0.42741150832355207,4.4036013555124685,0.2602681997045031],"conc_latency_p95_list":[0.9948690574150532,0.8211293721615216,1.0417742813937363,9.262034138497253,0.7931234508447229],"conc_latency_p99_list":[1.5573479785979742,2.6858534570800834,1.8592564908228824,10.732493293482092,1.8014021865703294],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[1.4739,12.8063,23.1395,4.1397,113.9017],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9672,"optimize_duration":0,"p99_c30_ms":1801.4021865703294,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":30,"peak_qps":113.9017,"qps":113.9017,"qps_c30":113.9017,"recall":0.9624,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0346,"serial_latency_p99":0.0678,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9672,"recall":0.9624,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.45},"trial":1},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":1176.9,"load_s":3208.9,"source_label":"antfly-qualification-scale-big-3m-0p35"},"ndcg":0.966,"p95_ms":488.4,"p99_ms":564,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9613,"selection_mode":"swept","value":0.45},"status":"ok","storage":{"created_at":"2026-10-08T02:07:32.166417+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-big-3m"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T02:07:32.373938+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T02:07:32.373902+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T02:07:32.262333+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]},"final":{"allocated_bytes":29578317824,"apparent_bytes":29563447780,"completed_at":"2026-10-08T03:50:10.988706+00:00","samples":[{"allocated_bytes":29578317824,"apparent_bytes":29563447780,"captured_at":"2026-10-08T03:50:10.988683+00:00","entries":7242,"volumes":[{"allocated_bytes":29578317824,"apparent_bytes":29563447780,"entries":7242,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T03:50:10.879836+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-big-3m","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":29578317824,"apparent_bytes":29563447780,"entries":7242,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]},"post_workload":{"allocated_bytes":29584248832,"apparent_bytes":29569378194,"completed_at":"2026-10-08T03:50:09.377489+00:00","samples":[{"allocated_bytes":29584248832,"apparent_bytes":29569378194,"captured_at":"2026-10-08T03:50:09.377463+00:00","entries":7241,"volumes":[{"allocated_bytes":29584248832,"apparent_bytes":29569378194,"entries":7241,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T03:50:09.214562+00:00","volumes":[{"allocated_bytes":29584248832,"apparent_bytes":29569378194,"entries":7241,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T02:07:34.915439+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T02:07:34.915413+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T02:07:34.838404+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]},"protocol_fingerprint":"214efe6e8f8aaa01141ebd4134a5dfea9d115463e469adabd174f5815e837c5a","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T03:50:10.988710+00:00"},"trial":1},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-1","ndcg":0.9955,"p95_ms":4052,"p99_ms":4145.5,"parameter":"search_effort","recall":0.994,"status":"ok","value":1,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p475","ndcg":0.9762,"p95_ms":360.2,"p99_ms":488.2,"parameter":"search_effort","recall":0.9728,"status":"ok","value":0.475,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p5","ndcg":0.985,"p95_ms":352.1,"p99_ms":417,"parameter":"search_effort","recall":0.9824,"status":"ok","value":0.5,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p425","ndcg":0.9527,"p95_ms":283.6,"p99_ms":426.4,"parameter":"search_effort","recall":0.9473,"status":"ok","value":0.425,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p7","ndcg":0.9935,"p95_ms":1061.5,"p99_ms":1166.5,"parameter":"search_effort","recall":0.9918,"status":"ok","value":0.7,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p8","ndcg":0.995,"p95_ms":1453.2,"p99_ms":1525.4,"parameter":"search_effort","recall":0.9935,"status":"ok","value":0.8,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p55","ndcg":0.9882,"p95_ms":494.6,"p99_ms":598.2,"parameter":"search_effort","recall":0.986,"status":"ok","value":0.55,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p6","ndcg":0.9912,"p95_ms":747.3,"p99_ms":1004.8,"parameter":"search_effort","recall":0.9896,"status":"ok","value":0.6,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p35","ndcg":0.8848,"p95_ms":477.1,"p99_ms":951.3,"parameter":"search_effort","recall":0.8734,"status":"ok","value":0.35,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p45","ndcg":0.9654,"p95_ms":359.6,"p99_ms":408.7,"parameter":"search_effort","recall":0.9614,"status":"ok","value":0.45,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p375","ndcg":0.9112,"p95_ms":194.3,"p99_ms":379.2,"parameter":"search_effort","recall":0.9026,"status":"ok","value":0.375,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p4","ndcg":0.935,"p95_ms":250.2,"p99_ms":474.8,"parameter":"search_effort","recall":0.9275,"status":"ok","value":0.4,"workload":"scale-big-3m"}],"cell_sha256":"94d80172d27cd7742aeb338e26e1705969288a3970397b5bd045f4dad396e1dd","index_build":{"insert_duration":1212.976,"optimize_duration":1665.8898,"seconds":2878.8658},"lifecycle":{"cache_key":"cfc537ae9d66eed3b9f520f4a0d61b9fc3ef71bbb3e4558474bb242a3028f277","duration_seconds":4964.792845726013,"finished_at":1791436413.7551668,"object_sha256":"11434bd771c790ec78a3da1328978ecc7c1f3703b695e132a64914d984980b81","receipt_sha256":"e3468ed0b19567eeb959275e7120d5b685ddea932b2655f479ea8869e74240db","started_at":1791431448.962321},"memory":{"anon_shmem_peak_mb":9190.7,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":14083.9,"cgroup_current_peak_mb":14070.6,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":9190.7,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":14070599680,"cgroup_kernel_peak_sum_bytes":14083899392,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":9190682624,"ended":1791436397.268859,"failed_samples":0,"first_sample_at":1791431455.6309288,"kind":"container_cgroup_v2","last_sample_at":1791436397.0465927,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":24226,"schema_version":3,"started":1791431455.604675,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791431455.6309288,"index_started_at":1791431455.6427677,"last_sample_at":1791436397.0465927,"max_sample_gap_s":0.389,"publication_finished_at":1791436396.937895,"sampler_ended_at":1791436397.268859,"sampler_started_at":1791431455.604675,"samples":24226,"status":"qualified","trial":2,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.5229749056567832,3.9186314282509556,0.1683492682403487,0.06769463136542268,0.0894677129341561],"conc_latency_p95_list":[0.857581385008234,6.434965849673608,0.43310820100596165,0.1952420742090904,0.22709256575908512],"conc_latency_p99_list":[1.541325170040654,7.781358001353509,1.4592474644270341,0.3826913370212409,0.4610756708448751],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[1.9084,1.2055,59.2108,293.9966,330.0342],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9677,"optimize_duration":0,"p99_c30_ms":461.0756708448751,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":30,"peak_qps":330.0342,"qps":330.0342,"qps_c30":330.0342,"recall":0.9632,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0193,"serial_latency_p99":0.034,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"qualification":{"ndcg":0.9677,"recall":0.9632,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.45},"trial":2},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":1213,"load_s":2878.9,"source_label":"antfly-qualification-scale-big-3m-0p35"},"ndcg":0.9654,"p95_ms":359.6,"p99_ms":408.7,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9614,"selection_mode":"swept","value":0.45},"status":"ok","storage":{"created_at":"2026-10-08T03:50:49.771605+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"2","workload":"scale-big-3m"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-08T03:50:49.964790+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-08T03:50:49.964759+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-3m-antfly-data"}]}],"stage":"empty","started_at":"2026-10-08T03:50:49.837303+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-3m-antfly-data"}]},"final":{"allocated_bytes":30362574848,"apparent_bytes":30347811544,"completed_at":"2026-10-08T05:13:21.503126+00:00","samples":[{"allocated_bytes":30362574848,"apparent_bytes":30347811544,"captured_at":"2026-10-08T05:13:21.503057+00:00","entries":7238,"volumes":[{"allocated_bytes":30362574848,"apparent_bytes":30347811544,"entries":7238,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-3m-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-08T05:13:21.291546+00:00","termination":{"container":"antfly_bench_vdbb_scale_t2_scale-big-3m","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":30362574848,"apparent_bytes":30347811544,"entries":7238,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-3m-antfly-data"}]},"post_workload":{"allocated_bytes":30464544768,"apparent_bytes":30449785549,"completed_at":"2026-10-08T05:13:17.814533+00:00","samples":[{"allocated_bytes":30464544768,"apparent_bytes":30449785549,"captured_at":"2026-10-08T05:13:17.814493+00:00","entries":7237,"volumes":[{"allocated_bytes":30464544768,"apparent_bytes":30449785549,"entries":7237,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-3m-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-08T05:13:17.620658+00:00","volumes":[{"allocated_bytes":30464544768,"apparent_bytes":30449785549,"entries":7237,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-3m-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-08T03:50:55.494507+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-08T03:50:55.494484+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-3m-antfly-data"}]}],"stage":"ready","started_at":"2026-10-08T03:50:55.371713+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t2_scale-big-3m-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"name":"circus_vdbb_scale_t2_scale-big-3m-antfly-data"}]},"protocol_fingerprint":"b675cbea89c009ce49b1316dc9370d0b5762d79eef9c1787a96746e6ac138b79","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-3"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-08T05:13:21.503134+00:00"},"trial":2}],"metrics":{"demand_mb":{"max":9227.4,"mean":9209.05,"min":9190.7,"values":[9227.4,9190.7]},"final_allocated_bytes":{"max":30362574848,"mean":29970446336,"min":29578317824,"values":[29578317824,30362574848]},"index_build_seconds":{"max":3208.9415,"mean":3043.90365,"min":2878.8658,"values":[3208.9415,2878.8658]},"lifecycle_seconds":{"max":6197.2556319236755,"mean":5581.024238824844,"min":4964.792845726013,"values":[6197.2556319236755,4964.792845726013]},"peak_clients":{"max":30,"mean":30,"min":30,"values":[30,30]},"peak_qps":{"max":330.0342,"mean":221.96795,"min":113.9017,"values":[113.9017,330.0342]},"serial_p95_ms":{"max":34.6,"mean":26.950000000000003,"min":19.3,"values":[34.6,19.3]}},"profile":"big","qualification":{"ndcg_min":0.9672,"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall_min":0.9624,"request_errors":0,"trials":[{"ndcg":0.9672,"recall":0.9624,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.45},"trial":1},{"ndcg":0.9677,"recall":0.9632,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.45},"trial":2}]},"storage_qualification":{"metric":"final_allocated_bytes","qualified_trials":2,"status":"qualified","total_trials":2,"trials":[{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"214efe6e8f8aaa01141ebd4134a5dfea9d115463e469adabd174f5815e837c5a","status":"qualified","trial":1},{"exit_code":0,"forced":false,"oom_killed":false,"protocol_fingerprint":"b675cbea89c009ce49b1316dc9370d0b5762d79eef9c1787a96746e6ac138b79","status":"qualified","trial":2}]},"vectors":3000000}]

Previous-result comparison

Supplementary comparison; source protocols and dates remain separate.

Attachment SHA-256
d263db27d0cc461b26c1cd739b80951181f5b64fe6c93e4a4b5878a51f63deda
{"aggregation":"Arithmetic mean of three individual lifecycle values; min/max retained. Latency means are means of lifecycle percentiles, not pooled percentiles. Standard retained old windows are diagnostic; full old sweeps failed.","caveats":["Not a product speedup: current comparisons use unchanged binary/configuration. Fresh lifecycles restore publication qualification under a prospectively declared lower ceiling; old full sweeps stay failed.","Only three independent lifecycles per workload; no randomized/interleaved controlled intervention. Repeat-run speed/tail movement is observational, not a measured product regression.","No attribution of HTTP429 to CPU worker pools. Controlled prior probe found separate execution admission and incomplete HTTP1 body capacities; original logs cannot classify their exact mix.","Historical official-release and Scale cohorts differ in binary, environment and/or load protocol. Baseline compiler flags are not independently asserted.","September 9 1M final storage was provisional; excluded from comparative storage ratios.","Arithmetic means computed from raw lifecycle observations may differ slightly from rounded report means. Mean of lifecycle maxima differs from maximum of fixed-concurrency means."],"historical_v0_2_1":{"vector-filtered-ann":{"concurrency_caveat":"September 9 immutable aggregate does not retain per-concurrency windows/schedule; peak-to-peak comparison is historical, not a matched-client-count comparison.","demand_peak_mb":{"delta_percent":-90.4748825001526,"new":{"max":747,"mean":728.2333333333333,"min":706.5,"values":[706.5,731.2,747]},"old":{"max":7998.7,"mean":7645.4,"min":7032.8,"values":[7998.7,7904.7,7032.8]}},"environment":{"container_runtime":"rootless Podman 6.1.1","processor":"Apple M4 Max","vm_cpus":10,"vm_memory_gib":24},"immutable_package":".tmp/site-honed-2026-10-06/data/evidence/vector-filtered-ann/df27aa0aeaa6e9556113440c2edeb4ae7d755e0c66571eaf1f2ea5b9d8da5a05.json","peak_p99_ms":{"delta_percent":273.96524412740024,"new":{"max":183.4659408433072,"mean":177.9000697929102,"min":172.52199000460678,"values":[172.52199000460678,183.4659408433072,177.71227853081655]},"old":{"max":48.6166370005958,"mean":47.5712843871406,"min":45.90878302038617,"values":[48.18843314043984,48.6166370005958,45.90878302038617]}},"peak_qps":{"delta_percent":-88.64396193822431,"new":{"max":331.1801,"mean":327.03346666666664,"min":321.5401,"values":[331.1801,328.3802,321.5401]},"old":{"max":2892.3528,"mean":2879.8201,"min":2868.1446,"values":[2878.9629,2868.1446,2892.3528]}},"published_observation":{"below_qualification_floor":false,"cache_inclusive_peak_mb":{"max":8519.4,"mean":8217.1667,"min":7823.4,"trials":[8519.4,8308.7,7823.4]},"cgroup_current_peak_mb":{"max":8489.6,"mean":8142.1667,"min":7729.8,"trials":[8489.6,8207.1,7729.8]},"demand_peak_mb":{"max":7998.7,"mean":7645.4,"min":7032.8,"trials":[7998.7,7904.7,7032.8]},"display_name":"Antfly","engine":"antfly","insert_s":{"max":31.1,"mean":29.1,"min":27.4,"trials":[31.1,28.8,27.4]},"load_s":{"max":33.2,"mean":30.5333,"min":27.5,"trials":[33.2,30.9,27.5]},"ndcg":{"max":1,"mean":1,"min":1,"trials":[1,1,1]},"num_shards":1,"peak_p99_ms":{"max":48.6166,"mean":47.5713,"min":45.9088,"trials":[48.18843314043984,48.6166370005958,45.90878302038617]},"peak_qps":{"max":2892.3528,"mean":2879.8201,"min":2868.1446,"trials":[2878.9629,2868.1446,2892.3528]},"recall":{"max":1,"mean":1,"min":1,"trials":[1,1,1]},"selected_settings":[{"num_shards":1,"parameter":"search_effort","trial":1,"value":0.35},{"num_shards":1,"parameter":"search_effort","trial":2,"value":0.35},{"num_shards":1,"parameter":"search_effort","trial":3,"value":0.35}],"serial_p95_ms":{"max":2.3,"mean":2.3,"min":2.3,"trials":[2.3,2.3,2.3]},"serial_p99_ms":{"max":2.6,"mean":2.5667,"min":2.5,"trials":[2.6,2.5,2.6]},"storage":{"aggregation_protocol_fingerprint":"486e7bc359a920f5b0f16cdf1f6265604cb0f0c53bf13c79140d7375f9945c32","apparent_mean_bytes":356291736,"apparent_values_bytes":[356113906,357062685,355698616],"container_runtimes":["docker","docker","docker"],"engine":"antfly","max_bytes":357232640,"mean_bytes":356463957,"metric":"final_allocated_bytes","min_bytes":355872768,"reasons":[],"receipt_protocol_fingerprints":["0f29d0cc3817926c2789f599c464d8e381569ebf90a860daab7a37606bbf266a","62a42600d314c6a5c41cb4f40b3913d69f26615c54bc4cd0462f6185a8834ef4","073192675209039ea7dc234b246a25c84d6d0fa77429874481d8fa01edbd40bd"],"relative_range":0.003814893405137084,"status":"qualified","trial_count":3,"trial_ids":["1","2","3"],"values_bytes":[356286464,357232640,355872768],"workload":"tenant-scoped-1536d-50K-1pct"},"trial_count":3},"serial_p99_ms":{"delta_percent":803.8961038961038,"new":{"max":25,"mean":23.2,"min":21.5,"values":[21.5,23.099999999999998,25]},"old":{"max":2.6,"mean":2.566666666666667,"min":2.5,"values":[2.6,2.5,2.6]}},"subject":{"binary_bytes":83606232,"binary_sha256":"652ff445479450e753203f6941fc0d5411adfd20d444703de7e76609c909a162","build":{"optimize":"official-release"},"commit":"e5261e9e2937d03943b518974bf8063351ad1449","commit_at":"2026-09-09T00:29:42Z","platform":"linux-arm64","subject_id":"antfly-v0.2.1-release","tag":"v0.2.1"}},"vector-vdbbench-1m":{"demand_peak_mb":{"delta_percent":-73.0075595782908,"new":{"max":4521.2,"mean":4246.666666666667,"min":3837.8,"values":[4381,4521.2,3837.8]},"old":{"max":16455.4,"mean":15732.8,"min":15317.9}},"environment":{"container_runtime":"rootless Podman 6.1.1","processor":"Apple M4 Max","vm_cpus":10,"vm_memory_gib":24},"immutable_package":".tmp/site-honed-2026-10-06/data/evidence/vector-vdbbench-1m/9e08299932507084419ecd84425d631407d81b19c46c38f05f709bff4150cd6c.json","p99_c30_ms":{"delta_percent":-76.65927436659672,"new":{"max":144.23082648427297,"mean":135.50855058808042,"min":119.63342300412474,"values":[144.23082648427297,119.63342300412474,142.6614022758436]},"old":{"max":595.5,"mean":580.567,"min":565.6}},"peak_qps":{"delta_percent":584.0048920475338,"new":{"max":598.2492,"mean":591.9036333333333,"min":587.4441,"values":[587.4441,598.2492,590.0176]},"old":{"max":96.603,"mean":86.535,"min":80.481,"values":[80.481,82.521,96.603]}},"published_observation":{"below_qualification_floor":false,"cache_inclusive_peak_mb":18866.7,"case":"768d-1M","cgroup_current_peak_mb":18813.6,"concurrency_duration_seconds":30,"concurrency_schedule":[1,5,10,20,30],"demand_peak_max_mb":16455.4,"demand_peak_mb":15732.8,"demand_peak_min_mb":15317.9,"insert_s":1937.5,"lifecycle_result_trial_count":3,"lifecycle_search_values":[0.45,0.45,0.425],"lifecycle_selected_settings_compatible":true,"load_s":1949.6,"measurement_source":"fresh","memory_trial_count":3,"ndcg":0.967,"p95_c30_max_ms":519.5,"p95_c30_min_ms":497.1,"p95_c30_ms":510.833,"p95_ms":14.9,"p99_c30_max_ms":595.5,"p99_c30_min_ms":565.6,"p99_c30_ms":580.567,"p99_ms":42.333,"peak_concurrency":null,"peak_concurrency_trials":[30,30,5],"peak_qps":86.533,"qps_by_concurrency":[{"concurrency":1,"max":19.653,"mean":18.621,"min":17.79,"values":[17.79,18.419,19.653]},{"concurrency":5,"max":96.603,"mean":76.091,"min":64.135,"values":[64.135,67.535,96.603]},{"concurrency":10,"max":74.365,"mean":71.663,"min":70.148,"values":[70.476,74.365,70.148]},{"concurrency":20,"max":79.916,"mean":78.101,"min":74.777,"values":[74.777,79.609,79.916]},{"concurrency":30,"max":82.521,"mean":80.537,"min":78.608,"values":[80.481,82.521,78.608]}],"qps_c30":80.533,"qps_c30_max":82.5,"qps_c30_min":78.6,"query_count":800,"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","query_partition_mode":"deterministic_partition","query_partition_role":"publication","recall":0.963,"request_errors":0,"search_parameter":"search_effort","search_selection_mode":"swept","search_value":0.45,"status":"ok","storage":{"aggregation_protocol_fingerprint":"486e7bc359a920f5b0f16cdf1f6265604cb0f0c53bf13c79140d7375f9945c32","apparent_mean_bytes":3831291245,"apparent_values_bytes":[3830876489,3832022634,3830974613],"container_runtimes":["docker","docker","docker"],"engine":"antfly","max_bytes":3832250368,"mean_bytes":3831590912,"metric":"final_allocated_bytes","min_bytes":3831091200,"reasons":[{"detail":"service did not exit cleanly: {\"container\": \"antfly_bench_vdbb_antfly_t1_768d-1M\", \"exit_code\": 1, \"forced\": false, \"oom_killed\": false, \"stop_command_error\": null}","kind":"abnormal_stop","last_observation_retained":true,"limit_seconds":60,"stage":"final","trial":"1"},{"detail":"service did not exit cleanly: {\"container\": \"antfly_bench_vdbb_antfly_t2_768d-1M\", \"exit_code\": 1, \"forced\": false, \"oom_killed\": false, \"stop_command_error\": null}","kind":"abnormal_stop","last_observation_retained":true,"limit_seconds":60,"stage":"final","trial":"2"},{"detail":"service did not exit cleanly: {\"container\": \"antfly_bench_vdbb_antfly_t3_768d-1M\", \"exit_code\": 1, \"forced\": false, \"oom_killed\": false, \"stop_command_error\": null}","kind":"abnormal_stop","last_observation_retained":true,"limit_seconds":60,"stage":"final","trial":"3"}],"receipt_protocol_fingerprints":["abfd3a079d35001f29c97374176672e3130e9e925b677e0d588003a94f54ee06","d4f482d4fc55a8e3f708fb8a77ea058de68856537ea96766d6c775c24b076101","15df7985574b8ef8bb3bb0fe445b0b9a0cfe79ceb8fd530eecdd7f09c7deda08"],"relative_range":0.00030252916520123534,"status":"provisional","trial_count":3,"trial_ids":["1","2","3"],"values_bytes":[3831091200,3832250368,3831431168],"workload":"768d-1M"}},"qps_by_concurrency":[{"concurrency":1,"qps":{"delta_percent":298.2757509577172,"new":{"max":79.4819,"mean":74.16159999999999,"min":70.0526,"values":[70.0526,72.9503,79.4819]},"old":{"max":19.653,"mean":18.620666666666665,"min":17.79,"values":[17.79,18.419,19.653]}}},{"concurrency":5,"qps":{"delta_percent":412.1757281851117,"new":{"max":399.9867,"mean":389.7196333333333,"min":374.9797,"values":[374.9797,394.1925,399.9867]},"old":{"max":96.603,"mean":76.091,"min":64.135,"values":[64.135,67.535,96.603]}}},{"concurrency":10,"qps":{"delta_percent":715.2012428542857,"new":{"max":591.6042,"mean":584.1976666666667,"min":573.5447,"values":[587.4441,591.6042,573.5447]},"old":{"max":74.365,"mean":71.663,"min":70.148,"values":[70.476,74.365,70.148]}}},{"concurrency":20,"qps":{"delta_percent":650.886676170071,"new":{"max":598.2492,"mean":586.4475,"min":571.0757,"values":[571.0757,598.2492,590.0176]},"old":{"max":79.916,"mean":78.10066666666667,"min":74.777,"values":[74.777,79.609,79.916]}}},{"concurrency":30,"qps":{"delta_percent":600.0812466371425,"new":{"max":592.4213,"mean":563.8221,"min":545.9467,"values":[545.9467,592.4213,553.0983]},"old":{"max":82.521,"mean":80.53666666666666,"min":78.608,"values":[80.481,82.521,78.608]}}}],"subject":{"binary_bytes":83606232,"binary_sha256":"652ff445479450e753203f6941fc0d5411adfd20d444703de7e76609c909a162","build":{"optimize":"official-release"},"commit":"e5261e9e2937d03943b518974bf8063351ad1449","commit_at":"2026-09-09T00:29:42Z","platform":"linux-arm64","subject_id":"antfly-v0.2.1-release","tag":"v0.2.1"}},"vector-vdbbench-50k":{"demand_peak_mb":{"delta_percent":-80.71020980221101,"new":{"max":1444.2,"mean":1348.8,"min":1290.7,"values":[1444.2,1311.5,1290.7]},"old":{"max":8908,"mean":6992.3,"min":5551.7}},"environment":{"container_runtime":"rootless Podman 6.1.1","processor":"Apple M4 Max","vm_cpus":10,"vm_memory_gib":24},"immutable_package":".tmp/site-honed-2026-10-06/data/evidence/vector-vdbbench-50k/a3e0521d4e05be5eb713df9fb522a320083a3879cd33abc0052873f662e41bad.json","p99_c30_ms":{"delta_percent":3.035503176633303,"new":{"max":88.24982650476156,"mean":86.13768065566543,"min":84.31326800215172,"values":[88.24982650476156,85.84994746008304,84.31326800215172]},"old":{"max":83.7,"mean":83.6,"min":83.4}},"peak_qps":{"delta_percent":-15.306663055713054,"new":{"max":838.9737,"mean":833.94,"min":830.7566,"values":[838.9737,830.7566,832.0897]},"old":{"max":990.963,"mean":984.6583333333333,"min":975.749,"values":[990.963,975.749,987.263]}},"published_observation":{"below_qualification_floor":false,"cache_inclusive_peak_mb":7746,"case":"1536d-50K","cgroup_current_peak_mb":7710.2,"concurrency_duration_seconds":30,"concurrency_schedule":[1,5,10,20,30],"demand_peak_max_mb":8908,"demand_peak_mb":6992.3,"demand_peak_min_mb":5551.7,"insert_s":29.4,"lifecycle_result_trial_count":3,"lifecycle_search_values":[0.425,0.425,0.425],"lifecycle_selected_settings_compatible":true,"load_s":29.4,"measurement_source":"fresh","memory_trial_count":3,"ndcg":0.963,"p95_c30_max_ms":73.1,"p95_c30_min_ms":72.8,"p95_c30_ms":72.9,"p95_ms":3.533,"p99_c30_max_ms":83.7,"p99_c30_min_ms":83.4,"p99_c30_ms":83.6,"p99_ms":3.867,"peak_concurrency":5,"peak_concurrency_trials":[5,5,5],"peak_qps":984.667,"qps_by_concurrency":[{"concurrency":1,"max":313.036,"mean":310.218,"min":306.337,"values":[313.036,306.337,311.28]},{"concurrency":5,"max":990.963,"mean":984.658,"min":975.749,"values":[990.963,975.749,987.263]},{"concurrency":10,"max":909.823,"mean":893.699,"min":876.875,"values":[894.4,876.875,909.823]},{"concurrency":20,"max":827.84,"mean":817.028,"min":803.934,"values":[827.84,803.934,819.309]},{"concurrency":30,"max":781.775,"mean":776.428,"min":766.606,"values":[781.775,766.606,780.902]}],"qps_c30":776.433,"qps_c30_max":781.8,"qps_c30_min":766.6,"query_count":800,"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","query_partition_mode":"deterministic_partition","query_partition_role":"publication","recall":0.958,"request_errors":0,"search_parameter":"search_effort","search_selection_mode":"swept","search_value":0.425,"status":"ok","storage":{"aggregation_protocol_fingerprint":"486e7bc359a920f5b0f16cdf1f6265604cb0f0c53bf13c79140d7375f9945c32","apparent_mean_bytes":354646602,"apparent_values_bytes":[354754017,354477959,354707830],"container_runtimes":["docker","docker","docker"],"engine":"antfly","max_bytes":354934784,"mean_bytes":354820096,"metric":"final_allocated_bytes","min_bytes":354639872,"reasons":[],"receipt_protocol_fingerprints":["d525b544d2436ccd6cd6ee23216d2aa95b0ea08f5787373182dcd97a6389ed5e","c95ebdb5355dd9e0b619431ab91b6277b3e27583fb2fd9a84e8fab01d92154be","93416401eeb504ba2c358fcc9ea7b5c3daf36e705a9f2b41c1e80c967f1b5ee1"],"relative_range":0.0008311592362570129,"status":"qualified","trial_count":3,"trial_ids":["1","2","3"],"values_bytes":[354934784,354639872,354885632],"workload":"1536d-50K"}},"qps_by_concurrency":[{"concurrency":1,"qps":{"delta_percent":-55.768455052527635,"new":{"max":138.1641,"mean":137.21406666666667,"min":135.781,"values":[137.6971,138.1641,135.781]},"old":{"max":313.036,"mean":310.2176666666667,"min":306.337,"values":[313.036,306.337,311.28]}}},{"concurrency":5,"qps":{"delta_percent":-39.09124484804373,"new":{"max":604.7144,"mean":599.7431333333334,"min":590.1058,"values":[604.7144,590.1058,604.4092]},"old":{"max":990.963,"mean":984.6583333333333,"min":975.749,"values":[990.963,975.749,987.263]}}},{"concurrency":10,"qps":{"delta_percent":-6.686738045382901,"new":{"max":838.9737,"mean":833.94,"min":830.7566,"values":[838.9737,830.7566,832.0897]},"old":{"max":909.823,"mean":893.6993333333334,"min":876.875,"values":[894.4,876.875,909.823]}}},{"concurrency":20,"qps":{"delta_percent":-1.4975788253600575,"new":{"max":817.144,"mean":804.7920333333333,"min":796.694,"values":[800.5381,817.144,796.694]},"old":{"max":827.84,"mean":817.0276666666666,"min":803.934,"values":[827.84,803.934,819.309]}}},{"concurrency":30,"qps":{"delta_percent":0.6628434586952281,"new":{"max":798.2995,"mean":781.5741666666667,"min":771.7946,"values":[774.6284,771.7946,798.2995]},"old":{"max":781.775,"mean":776.4276666666667,"min":766.606,"values":[781.775,766.606,780.902]}}}],"subject":{"binary_bytes":83606232,"binary_sha256":"652ff445479450e753203f6941fc0d5411adfd20d444703de7e76609c909a162","build":{"optimize":"official-release"},"commit":"e5261e9e2937d03943b518974bf8063351ad1449","commit_at":"2026-09-09T00:29:42Z","platform":"linux-arm64","subject_id":"antfly-v0.2.1-release","tag":"v0.2.1"}}},"interpretation":"Previous-result observations only; never selected scale metrics. Old overload sweeps remain failed; unchanged binary comparisons are not causal product speedups.","prior_scale":{"caveat":"Not matched: different commit/build and explicit admission128, sweeps to80 clients, two lifecycles versus current default admission, to30 clients, three honed lifecycles. No ratio interpreted as regression.","immutable_package":".tmp/site-honed-2026-10-06/data/evidence/vector-vdbbench-scale/4416efc22c6a5efd7bab3d4c10cbbff11d0409fe33269a847b33b58fe4302e51.json","protocol":{"calibration_queries":200,"client_import_mode":"selected","concurrency_schedule":[1,5,10,20,30,40,60,80],"dimensions":768,"execution_order":"Fast ascending then descending; Big ascending then descending","memory_yardstick":"cgroup-v2-anon-plus-shmem-full-lifecycle","metric":"cosine","post_load_settle_seconds":300,"publication_queries":800,"query_admission_capacity":128,"query_partition_seed":"antfly-circus-vdbbench-v1","shared_query_storage":true,"storage_metric":"final_allocated_bytes","window_seconds":30},"rows_1m":[{"diagnostic_reason":"Internal scale diagnostic: performance, memory, storage, and build ranges contain two fresh lifecycles rather than the three-lifecycle honed/public cohort.","dimensions":768,"metrics":{"demand_mb":{"max":5025.7,"mean":4584.049999999999,"min":4142.4,"values":[5025.7,4142.4]},"final_allocated_bytes":{"max":5897977856,"mean":5866176512,"min":5834375168,"values":[5834375168,5897977856]},"index_build_seconds":{"max":402.1856,"mean":398.90740000000005,"min":395.6292,"values":[402.1856,395.6292]},"lifecycle_seconds":{"max":1176.0405378341675,"mean":1176.0313367843628,"min":1176.022135734558,"values":[1176.0405378341675,1176.022135734558]},"peak_clients":{"max":20,"mean":15,"min":10,"values":[10,20]},"peak_qps":{"max":918.9153,"mean":907.9707000000001,"min":897.0261,"values":[918.9153,897.0261]},"serial_p95_ms":{"max":9.2,"mean":9.2,"min":9.2,"values":[9.2,9.2]}},"profile":"big","publication_eligible":false,"qualification":{"ndcg_min":0.966,"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall_min":0.9624,"request_errors":0,"trials":[{"ndcg":0.9666,"recall":0.9628,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.425},"trial":1},{"ndcg":0.966,"recall":0.9624,"request_errors":0,"selected_effort":{"parameter":"search_effort","value":0.425},"trial":2}]},"source_cells":[{"cache_key":"a5f16c85ad5aa40a9a2a0b1298b682f0e274305f1b7d06314db950778a79d6f0","duration_seconds":1176.0405378341675,"finished_at":1790058041.8099816,"object_sha256":"55f64a59ef7fa909495e9bbf9439035f43dedeb56a8fcbcf7a53e668e930dae9","receipt_sha256":"a86e37c35e2219e3d555de8e83cad22b41168b7016c758ae12ce550fe58d0007","started_at":1790056865.7694438},{"cache_key":"e30edbe3c8e14f330df5ea67b379753bdbe6aa3d4b50c68ffb4b1352bd8d59df","duration_seconds":1176.022135734558,"finished_at":1790059218.2613435,"object_sha256":"5bb134aeddbdd6f3ed7f7d0a5b880fcede76174bee6dcde84271e683a43db0ef","receipt_sha256":"f619b1cc184ae5d71c0e72fa7a4306f691c5e11d3116975df89437ef1ac55985","started_at":1790058042.2392077}],"status":"ok","storage_qualification":{"qualified_trials":2,"status":"qualified","total_trials":2,"trials":[{"exit_code":0,"forced":false,"oom_killed":false,"status":"qualified","stop_command_error":null,"trial":1},{"exit_code":0,"forced":false,"oom_killed":false,"status":"qualified","stop_command_error":null,"trial":2}]},"trial_ids":[1,2],"vectors":1000000,"workload_id":"scale-big-1m"}],"subject":{"artifacts":[{"platform":"linux-arm64","sha256":"93286b480b0fec7a129e88b48e8b929fe641c214eb71f783ade37bfceba3a546"}],"build_edition":"full","build_mode":"ReleaseFast","commit":"5bb5fb1570f44f11ddf0770e2529df9b419934c5","commit_at":"2026-09-21T18:55:41+00:00","commit_short":"5bb5fb15","subject_id":"antfly-main-5bb5fb1570f4-releasefast","tag":"main-5bb5fb1570f4"}},"protocols":{"new_filtered":{"schedule":[1,8,30],"window_seconds":10},"new_standard":{"publication_status":"qualified three fresh lifecycles per workload","schedule":[1,5,10,20,30],"window_seconds":30},"old_filtered":{"schedule":[1,8,32],"window_seconds":10},"old_standard":{"publication_status":"failed; zero-error windows \u003c=30 diagnostic only","schedule":[1,5,10,20,30,40,60,80],"window_seconds":30},"shared":{"calibration_queries":200,"filtered_index_policy":"retained full_text_index_v0 in all old and new lifecycles","filtered_search_effort":0.35,"filtered_shards":1,"holdout_queries":800,"query_partition_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","server_admission":"unchanged default","standard_search_effort":{"1M":0.425,"50K":0.45},"top_k":100}},"same_binary_filtered":{"c1":{"p99_ms":{"delta_percent":10.183973611159347,"new":{"max":50.28328274522211,"mean":48.95142948376215,"min":47.14279315434395,"values":[47.14279315434395,50.28328274522211,49.42821255172038]},"old":{"max":46.39740000071474,"mean":44.42699594090913,"min":42.1329346395215,"values":[46.39740000071474,42.1329346395215,44.750653182491156]}},"qps":{"delta_percent":-8.701966411236306,"new":{"max":54.6582,"mean":54.1901,"min":53.7744,"values":[54.6582,53.7744,54.1377]},"old":{"max":59.882,"mean":59.35516666666666,"min":59.019,"values":[59.882,59.019,59.1645]}}},"c8":{"p99_ms":{"delta_percent":-2.178535540598092,"new":{"max":46.13987968506989,"mean":45.34417775270413,"min":44.402348555740886,"values":[45.490305017301594,44.402348555740886,46.13987968506989]},"old":{"max":49.04012788159891,"mean":46.35401647613134,"min":44.98217595450115,"values":[45.03974559229397,44.98217595450115,49.04012788159891]}},"qps":{"delta_percent":-0.2588709211829743,"new":{"max":278.1268,"mean":275.84403333333336,"min":272.2499,"values":[277.1554,278.1268,272.2499]},"old":{"max":281.4771,"mean":276.5599666666667,"min":273.8749,"values":[281.4771,273.8749,274.3279]}}},"demand_peak_mb":{"delta_percent":-4.93451111787998,"new":{"max":747,"mean":728.2333333333333,"min":706.5,"values":[706.5,731.2,747]},"old":{"max":797.2,"mean":766.0333333333333,"min":741.4,"values":[797.2,741.4,759.5]}},"peak_concurrency_caveat":"Old peak at 32 clients versus new peak at 30; not matched concurrency.","peak_p99_ms":{"delta_percent":3.119825265418674,"new":{"max":183.4659408433072,"mean":177.9000697929102,"min":172.52199000460678,"values":[172.52199000460678,183.4659408433072,177.71227853081655]},"old":{"max":174.32630562048868,"mean":172.51781540069106,"min":170.66407300429992,"values":[172.5630675772846,174.32630562048868,170.66407300429992]}},"peak_qps":{"delta_percent":-6.223288081062206,"new":{"max":331.1801,"mean":327.03346666666664,"min":321.5401,"values":[331.1801,328.3802,321.5401]},"old":{"max":355.173,"mean":348.73633333333333,"min":343.5001,"values":[355.173,347.5359,343.5001]}},"serial_p99_ms":{"delta_percent":24.508050089445433,"new":{"max":25,"mean":23.2,"min":21.5,"values":[21.5,23.099999999999998,25]},"old":{"max":18.8,"mean":18.633333333333333,"min":18.5,"values":[18.5,18.599999999999998,18.8]}},"storage_mb":{"delta_percent":0.06219342896807145,"new":{"max":369.152,"mean":369.0400426666667,"min":368.832512,"values":[369.152,369.135616,368.832512]},"old":{"max":369.074176,"mean":368.8106666666667,"min":368.521216,"values":[369.074176,368.836608,368.521216]}}},"same_binary_standard":{"1536d-50K":{"demand_peak_mb":{"delta_percent":-35.44043269460888,"new":{"max":1444.2,"mean":1348.8,"min":1290.7,"values":[1444.2,1311.5,1290.7]},"old":{"max":2311.8,"mean":2089.2333333333336,"min":1900.7,"values":[2055.2,1900.7,2311.8]}},"ndcg":{"delta_percent":0.10348752975264386,"new":{"max":0.9677,"mean":0.9672999999999999,"min":0.967,"values":[0.967,0.9677,0.9672]},"old":{"max":0.9669,"mean":0.9663,"min":0.9654,"values":[0.9654,0.9666,0.9669]}},"new_quality_and_settings":{"lifecycle_search_values":[0.45,0.45,0.45],"ndcg":0.967,"recall":0.963},"old_rejections":[387394,364054,387631],"old_selected_settings":[{"below_qualification_floor":false,"parameter":"search_effort","selection_mode":"swept","value":0.45},{"below_qualification_floor":false,"parameter":"search_effort","selection_mode":"swept","value":0.45},{"below_qualification_floor":false,"parameter":"search_effort","selection_mode":"swept","value":0.45}],"old_timestamped_warning_count":1138683,"peak_qps_le30":{"delta_percent":-7.144563379545654,"new":{"max":838.9737,"mean":833.94,"min":830.7566,"values":[838.9737,830.7566,832.0897]},"old":{"max":920.6923,"mean":898.1057333333333,"min":881.7842,"values":[920.6923,881.7842,891.8407]}},"recall":{"delta_percent":0.12478768761481351,"new":{"max":0.9631,"mean":0.9628333333333333,"min":0.9624,"values":[0.9624,0.9631,0.963]},"old":{"max":0.9622,"mean":0.9616333333333333,"min":0.961,"values":[0.961,0.9617,0.9622]}},"resource_caveat":"Old peak demand covers complete rejected 80-client sweep; new peak covers 30-client sweep. Not matched lifecycle exposure; cannot attribute movement to removing overload.","serial_latency_p95":{"delta_percent":9.917355371900838,"new":{"max":9.1,"mean":8.866666666666667,"min":8.7,"values":[9.1,8.7,8.8]},"old":{"max":8.4,"mean":8.066666666666666,"min":7.5,"values":[7.5,8.3,8.4]}},"serial_latency_p99":{"delta_percent":-3.2967032967033183,"new":{"max":13.2,"mean":11.733333333333333,"min":10.8,"values":[13.2,10.8,11.2]},"old":{"max":13.100000000000001,"mean":12.133333333333335,"min":10.4,"values":[10.4,13.100000000000001,12.9]}},"storage_mb":{"delta_percent":-0.0007419223207238979,"new":{"max":368.443392,"mean":368.050176,"min":367.521792,"values":[368.185344,367.521792,368.443392]},"old":{"max":368.160768,"mean":368.0529066666667,"min":367.86176,"values":[368.160768,367.86176,368.136192]}},"windows":[{"concurrency":1,"p95_ms":{"delta_percent":18.936378626302396,"new":{"max":10.355572186381316,"mean":9.834725594312959,"min":9.527644602349028,"values":[9.527644602349028,9.620959994208533,10.355572186381316]},"old":{"max":8.61180200154193,"mean":8.268896117321367,"min":7.960712350177346,"values":[7.960712350177346,8.61180200154193,8.234174000244822]}},"p99_ms":{"delta_percent":21.840132788151646,"new":{"max":15.707831923209602,"mean":14.00973855110351,"min":13.141908237594174,"values":[13.141908237594174,13.179475492506754,15.707831923209602]},"old":{"max":12.480223999154987,"mean":11.498459686893815,"min":10.515562001819498,"values":[10.515562001819498,12.480223999154987,11.499593059706958]}},"qps":{"delta_percent":-9.43222953627939,"new":{"max":138.1641,"mean":137.21406666666667,"min":135.781,"values":[137.6971,138.1641,135.781]},"old":{"max":153.4806,"mean":151.5043,"min":150.0913,"values":[153.4806,150.0913,150.941]}}},{"concurrency":5,"p95_ms":{"delta_percent":14.023488868406787,"new":{"max":10.70558144856477,"mean":10.29188906444081,"min":10.052702200482596,"values":[10.117383544275063,10.70558144856477,10.052702200482596]},"old":{"max":9.175349297220237,"mean":9.026113098783147,"min":8.891620000213152,"values":[8.891620000213152,9.011369998916052,9.175349297220237]}},"p99_ms":{"delta_percent":14.201273670848957,"new":{"max":13.721904493722802,"mean":12.786261459017005,"min":12.259516115882434,"values":[12.377363767445782,13.721904493722802,12.259516115882434]},"old":{"max":11.279778560710831,"mean":11.196251187066077,"min":11.102303399820807,"values":[11.206671600666594,11.102303399820807,11.279778560710831]}},"qps":{"delta_percent":-8.79350201832646,"new":{"max":604.7144,"mean":599.7431333333334,"min":590.1058,"values":[604.7144,590.1058,604.4092]},"old":{"max":660.1792,"mean":657.5662333333333,"min":655.7226,"values":[660.1792,656.7969,655.7226]}}},{"concurrency":10,"p95_ms":{"delta_percent":9.403155322828539,"new":{"max":17.45467324872152,"mean":17.363938900477173,"min":17.194541550998103,"values":[17.194541550998103,17.442601901711896,17.45467324872152]},"old":{"max":16.084463399965898,"mean":15.871515633383144,"min":15.458031002344795,"values":[15.458031002344795,16.07205249783874,16.084463399965898]}},"p99_ms":{"delta_percent":10.435310728038516,"new":{"max":21.32838469915442,"mean":21.139178632001858,"min":20.821255786868278,"values":[20.821255786868278,21.267895409982877,21.32838469915442]},"old":{"max":19.36516962086898,"mean":19.14168438757769,"min":18.709308001853046,"values":[18.709308001853046,19.36516962086898,19.350575540011047]}},"qps":{"delta_percent":-7.144563379545654,"new":{"max":838.9737,"mean":833.94,"min":830.7566,"values":[838.9737,830.7566,832.0897]},"old":{"max":920.6923,"mean":898.1057333333333,"min":881.7842,"values":[920.6923,881.7842,891.8407]}}},{"concurrency":20,"p95_ms":{"delta_percent":8.8984895765857,"new":{"max":42.65877749567153,"mean":42.04954693123,"min":41.11601799668278,"values":[42.37384530133568,41.11601799668278,42.65877749567153]},"old":{"max":38.756289201228356,"mean":38.61352631677922,"min":38.371308999921894,"values":[38.371308999921894,38.756289201228356,38.71298074918741]}},"p99_ms":{"delta_percent":10.986705048892787,"new":{"max":53.682974767434565,"mean":52.741948091764506,"min":51.05894100328442,"values":[53.682974767434565,51.05894100328442,53.48392850457454]},"old":{"max":47.981681289020344,"mean":47.52096034252948,"min":46.97382491867756,"values":[46.97382491867756,47.981681289020344,47.60737481989053]}},"qps":{"delta_percent":-8.021914041620114,"new":{"max":817.144,"mean":804.7920333333333,"min":796.694,"values":[800.5381,817.144,796.694]},"old":{"max":886.3117,"mean":874.9823666666666,"min":868.1874,"values":[886.3117,868.1874,870.448]}}},{"concurrency":30,"p95_ms":{"delta_percent":8.007812967164242,"new":{"max":70.09449950055568,"mean":69.24238104887382,"min":68.47844509320565,"values":[70.09449950055568,69.15419855286014,68.47844509320565]},"old":{"max":66.01288400051997,"mean":64.10867801751009,"min":62.77433509985711,"values":[62.77433509985711,63.53881495215319,66.01288400051997]}},"p99_ms":{"delta_percent":8.499041134855222,"new":{"max":88.24982650476156,"mean":86.13768065566543,"min":84.31326800215172,"values":[88.24982650476156,85.84994746008304,84.31326800215172]},"old":{"max":81.9214506811113,"mean":79.39026903344104,"min":77.97786499704664,"values":[78.27149142216518,77.97786499704664,81.9214506811113]}},"qps":{"delta_percent":-7.406522535200644,"new":{"max":798.2995,"mean":781.5741666666667,"min":771.7946,"values":[774.6284,771.7946,798.2995]},"old":{"max":864.023,"mean":844.0920333333333,"min":824.0512,"values":[864.023,844.2019,824.0512]}}}]},"768d-1M":{"demand_peak_mb":{"delta_percent":-1.5478775607984274,"new":{"max":4521.2,"mean":4246.666666666667,"min":3837.8,"values":[4381,4521.2,3837.8]},"old":{"max":4707.7,"mean":4313.433333333333,"min":3870.2,"values":[4707.7,4362.4,3870.2]}},"ndcg":{"delta_percent":-0.03792188092528459,"new":{"max":0.9667,"mean":0.9665333333333334,"min":0.9664,"values":[0.9667,0.9665,0.9664]},"old":{"max":0.9677,"mean":0.9669,"min":0.9659,"values":[0.9677,0.9659,0.9671]}},"new_quality_and_settings":{"lifecycle_search_values":[0.425,0.425,0.425],"ndcg":0.967,"recall":0.963},"old_rejections":[269554,302460,301507],"old_selected_settings":[{"below_qualification_floor":false,"parameter":"search_effort","selection_mode":"swept","value":0.425},{"below_qualification_floor":false,"parameter":"search_effort","selection_mode":"swept","value":0.425},{"below_qualification_floor":false,"parameter":"search_effort","selection_mode":"swept","value":0.425}],"old_timestamped_warning_count":873117,"peak_qps_le30":{"delta_percent":-13.862941292063468,"new":{"max":598.2492,"mean":591.9036333333333,"min":587.4441,"values":[587.4441,598.2492,590.0176]},"old":{"max":690.9495,"mean":687.1649,"min":682.7628,"values":[690.9495,687.7824,682.7628]}},"recall":{"delta_percent":-0.0449967117787442,"new":{"max":0.9629,"mean":0.9626,"min":0.9623,"values":[0.9629,0.9626,0.9623]},"old":{"max":0.9639,"mean":0.9630333333333333,"min":0.9618,"values":[0.9639,0.9618,0.9634]}},"resource_caveat":"Old peak demand covers complete rejected 80-client sweep; new peak covers 30-client sweep. Not matched lifecycle exposure; cannot attribute movement to removing overload.","serial_latency_p95":{"delta_percent":8.31643002028397,"new":{"max":18.1,"mean":17.8,"min":17.3,"values":[18,18.1,17.3]},"old":{"max":18,"mean":16.433333333333334,"min":14.200000000000001,"values":[14.200000000000001,18,17.1]}},"serial_latency_p99":{"delta_percent":26.61290322580645,"new":{"max":37.199999999999996,"mean":31.4,"min":28,"values":[37.199999999999996,29,28]},"old":{"max":28,"mean":24.8,"min":23.099999999999998,"values":[23.099999999999998,28,23.3]}},"storage_mb":{"delta_percent":0.4530269384812824,"new":{"max":5937.778688,"mean":5928.665088,"min":5918.507008,"values":[5918.507008,5929.709568,5937.778688]},"old":{"max":5914.034176,"mean":5901.927765333334,"min":5882.601472,"values":[5909.147648,5882.601472,5914.034176]}},"windows":[{"concurrency":1,"p95_ms":{"delta_percent":-14.472981916074223,"new":{"max":22.749439792823974,"mean":20.531558943669847,"min":17.273061047308147,"values":[22.749439792823974,21.572175990877422,17.273061047308147]},"old":{"max":44.924752201586664,"mean":24.005933333864956,"min":13.461135001125513,"values":[44.924752201586664,13.631912798882693,13.461135001125513]}},"p99_ms":{"delta_percent":7.302060086975892,"new":{"max":39.02013856277338,"mean":33.12030384273392,"min":23.16300980557575,"values":[39.02013856277338,37.17776315985263,23.16300980557575]},"old":{"max":59.4604325806358,"mean":30.866419354751972,"min":16.455356805236057,"values":[59.4604325806358,16.68346867838406,16.455356805236057]}},"qps":{"delta_percent":-6.574928876617991,"new":{"max":79.4819,"mean":74.16159999999999,"min":70.0526,"values":[70.0526,72.9503,79.4819]},"old":{"max":95.932,"mean":79.38083333333333,"min":48.196,"values":[48.196,94.0145,95.932]}}},{"concurrency":5,"p95_ms":{"delta_percent":51.63074225525794,"new":{"max":20.573338004760437,"mean":19.40580299851717,"min":18.679180000617635,"values":[20.573338004760437,18.964890990173444,18.679180000617635]},"old":{"max":13.09970859729219,"mean":12.79806634847773,"min":12.256715999683365,"values":[13.037774448457634,12.256715999683365,13.09970859729219]}},"p99_ms":{"delta_percent":36.568846614463894,"new":{"max":27.900298917083997,"mean":25.77544226650693,"min":23.911739401228264,"values":[27.900298917083997,25.514288481208528,23.911739401228264]},"old":{"max":19.561691640410555,"mean":18.873588600533054,"min":18.185379250098766,"values":[18.873694911089842,18.185379250098766,19.561691640410555]}},"qps":{"delta_percent":-14.933445013183533,"new":{"max":399.9867,"mean":389.7196333333333,"min":374.9797,"values":[374.9797,394.1925,399.9867]},"old":{"max":463.8188,"mean":458.1349666666667,"min":448.9335,"values":[461.6526,463.8188,448.9335]}}},{"concurrency":10,"p95_ms":{"delta_percent":20.49956169705782,"new":{"max":27.14103540492944,"mean":26.498086322195988,"min":26.110064002568834,"values":[26.110064002568834,26.24315955908969,27.14103540492944]},"old":{"max":22.387037499356666,"mean":21.990193116895774,"min":21.229849600058515,"values":[21.229849600058515,22.387037499356666,22.35369225127214]}},"p99_ms":{"delta_percent":28.793176610702087,"new":{"max":36.27410325803793,"mean":34.808749261962205,"min":33.064714716747396,"values":[33.064714716747396,35.08742981110129,36.27410325803793]},"old":{"max":27.887986999303394,"mean":27.026858237356162,"min":25.819089501164857,"values":[25.819089501164857,27.887986999303394,27.37349821160024]}},"qps":{"delta_percent":-13.120119028787514,"new":{"max":591.6042,"mean":584.1976666666667,"min":573.5447,"values":[587.4441,591.6042,573.5447]},"old":{"max":690.9495,"mean":672.4199666666667,"min":662.7784,"values":[690.9495,663.532,662.7784]}}},{"concurrency":20,"p95_ms":{"delta_percent":18.400954915515143,"new":{"max":59.9860933987656,"mean":57.697782464674646,"min":55.441033998795305,"values":[59.9860933987656,55.441033998795305,57.66621999646304]},"old":{"max":50.24773890181677,"mean":48.7308421674849,"min":47.94750550190656,"values":[50.24773890181677,47.94750550190656,47.99728209873138]}},"p99_ms":{"delta_percent":27.22320624934149,"new":{"max":86.36389499617503,"mean":78.85954750517453,"min":70.93012391938812,"values":[86.36389499617503,70.93012391938812,79.28462359996044]},"old":{"max":63.733802838905866,"mean":61.98519109054659,"min":60.879377929668344,"values":[63.733802838905866,60.879377929668344,61.34239250306556]}},"qps":{"delta_percent":-13.653262198912108,"new":{"max":598.2492,"mean":586.4475,"min":571.0757,"values":[571.0757,598.2492,590.0176]},"old":{"max":687.7824,"mean":679.1773666666667,"min":666.9869,"values":[666.9869,687.7824,682.7628]}}},{"concurrency":30,"p95_ms":{"delta_percent":22.632540756221143,"new":{"max":98.36990069961757,"mean":95.44283083208332,"min":90.79821870545857,"values":[98.36990069961757,90.79821870545857,97.16037309117382]},"old":{"max":80.44058554969524,"mean":77.82830743253724,"min":75.22579665055672,"values":[80.44058554969524,75.22579665055672,77.81854009735979]}},"p99_ms":{"delta_percent":36.93460990514738,"new":{"max":144.23082648427297,"mean":135.50855058808042,"min":119.63342300412474,"values":[144.23082648427297,119.63342300412474,142.6614022758436]},"old":{"max":102.0939341376652,"mean":98.95858372251196,"min":94.21069469906803,"values":[100.57112233080264,94.21069469906803,102.0939341376652]}},"qps":{"delta_percent":-15.703594477321726,"new":{"max":592.4213,"mean":563.8221,"min":545.9467,"values":[545.9467,592.4213,553.0983]},"old":{"max":680.5248,"mean":668.8566333333333,"min":653.1581,"values":[653.1581,680.5248,672.887]}}}]}},"schema_version":1,"source_analysis_sha256":"1102770a130d33ac19c9dfc98e8897ec4bf699acf83fb5e24f2bc163cec0fad1","sources":[{"path":"MEASURING_ANTFLY.md","sha256":"045e504074faaf63153fcb9ccbea4524e5f475413a50f8505cbdf9940066547a"},{"path":"bin/antfly-main-09b78df97-releasefast-linux-arm64/subject.json","sha256":"d6c6cdb17545b214793b1f5e623ad7577bb943f2d37f565ffd390fc71a010f49"},{"path":"results/honed-2026-10-06/vector-investigation/retained-windows.json","sha256":"53c266501436c0e26863a8dad0d4800e2a1218cbdbd23970410ec6cf2dbbae27"},{"path":"results/honed-2026-10-06/vector-investigation/retained-summary.json","sha256":"b07ebe20699aafc45273e1e855e0af0d7cb987fbc3b2e3391e9c3f9a8b466898"},{"path":"results/honed-2026-10-06/run/benchmarks/vector-vdbbench/result.json","sha256":"da3cbce0807e0e9c95e4e2ab5304a4b61dba320c3e468e9e549eb587c39fc0f5"},{"path":"results/honed-2026-10-06/run/benchmarks/vector-filtered-ann/result.json","sha256":"bd43356ec6650766cf24708122cbb9c43c76da6c529f325f2f112af5dad954a6"},{"path":"results/honed-2026-10-06-vector-c30/run/benchmarks/vector-vdbbench/result.json","sha256":"bd8ee60aaf048deaa1b6925b871b7e5cab72c478c025ac7f014f94de155a3988"},{"path":"results/honed-2026-10-06-vector-c30/run/benchmarks/vector-filtered-ann/result.json","sha256":"3be3674cdf6759965b9c45515965d63278e2764c9e2acfdadea54d9e7b7b39ef"},{"path":".tmp/site-honed-2026-10-06/data/publication_plan.json","sha256":"2c39dee69fd738d65434d0d22dea82c69058621d5948d88ebc9e306071f86c4e"},{"path":".tmp/site-honed-2026-10-06/data/evidence/vector-vdbbench-scale/4416efc22c6a5efd7bab3d4c10cbbff11d0409fe33269a847b33b58fe4302e51.json","sha256":"4416efc22c6a5efd7bab3d4c10cbbff11d0409fe33269a847b33b58fe4302e51"},{"path":"results/honed-2026-10-06-vector-c30/run/benchmarks/vector-vdbbench/logs/antfly-1536d-50K-trial-1/cell-result.json","sha256":"7c221e4e16ee85cfdbdfe22ca8ee0a5e25e1100bc3b77e643dba9df6ebb31d23"},{"path":"results/honed-2026-10-06-vector-c30/run/benchmarks/vector-vdbbench/logs/antfly-1536d-50K-trial-2/cell-result.json","sha256":"658c9551fecec7f8dfddd5ca6d9198aa3f2b2fb7440580c80445f38702bfc8d4"},{"path":"results/honed-2026-10-06-vector-c30/run/benchmarks/vector-vdbbench/logs/antfly-1536d-50K-trial-3/cell-result.json","sha256":"ec3cbb8ceb5a059488b308d9300a3e18a5028dcf61b3e46bc8a11161fd2be376"},{"path":"results/honed-2026-10-06-vector-c30/run/benchmarks/vector-vdbbench/logs/antfly-768d-1M-trial-1/cell-result.json","sha256":"85d16466b92b65fe2ed74014b20a979298dc2eb42164db3975a279b37d7f331a"},{"path":"results/honed-2026-10-06-vector-c30/run/benchmarks/vector-vdbbench/logs/antfly-768d-1M-trial-2/cell-result.json","sha256":"b5417206ce99bca3cc157397b215bb30c3e1d20e7c3dde14537ed6533a22f0df"},{"path":"results/honed-2026-10-06-vector-c30/run/benchmarks/vector-vdbbench/logs/antfly-768d-1M-trial-3/cell-result.json","sha256":"92998bf4948a89cacd9a55f613cf6c435dfd0189929cb7a37d2bac87c42a963a"},{"path":".tmp/site-honed-2026-10-06/data/evidence/vector-vdbbench-50k/a3e0521d4e05be5eb713df9fb522a320083a3879cd33abc0052873f662e41bad.json","sha256":"a3e0521d4e05be5eb713df9fb522a320083a3879cd33abc0052873f662e41bad"},{"path":".tmp/site-honed-2026-10-06/data/evidence/vector-vdbbench-1m/9e08299932507084419ecd84425d631407d81b19c46c38f05f709bff4150cd6c.json","sha256":"9e08299932507084419ecd84425d631407d81b19c46c38f05f709bff4150cd6c"},{"path":".tmp/site-honed-2026-10-06/data/evidence/vector-filtered-ann/df27aa0aeaa6e9556113440c2edeb4ae7d755e0c66571eaf1f2ea5b9d8da5a05.json","sha256":"df27aa0aeaa6e9556113440c2edeb4ae7d755e0c66571eaf1f2ea5b9d8da5a05"},{"path":"results/honed-2026-10-06-vector-c30/handoff/vector-vdbbench-50k/summary.json","sha256":"0349cf53351b72af9d3e6b8b1296b2a68987060cf4e186f71d105573eeafd065"},{"path":"results/honed-2026-10-06-vector-c30/handoff/vector-vdbbench-1m/summary.json","sha256":"15c0f5c09b43c79611ddbadf40f16e829f99d32c85873b47d336be08ad4c47ab"},{"path":"results/honed-2026-10-06-vector-c30/handoff/vector-filtered-ann/summary.json","sha256":"53ad272473dd9b610a969e80835f5d59b0e7a97d05afff2ec7ec48360812839f"},{"path":"results/honed-2026-10-06/run/scratch/vector-vdbbench/cache-cells/antfly-1536d-50K-trial-1/cell-result.json","sha256":"de9739fc20233d225f4aaf90ab47cb1189d122034bd62ba4597e911be4100488"},{"path":"results/honed-2026-10-06/run/scratch/vector-vdbbench/cache-cells/antfly-1536d-50K-trial-2/cell-result.json","sha256":"8413d2e30a8f54cd7cde39a585cd160953bf597cadd337b63588c0eaa70f9c09"},{"path":"results/honed-2026-10-06/run/scratch/vector-vdbbench/cache-cells/antfly-1536d-50K-trial-3/cell-result.json","sha256":"a5ab108b0f63cd8d6b21f64edbd1fdad8729b14aec2f75dacba190156101fa93"},{"path":"results/honed-2026-10-06/run/scratch/vector-vdbbench/cache-cells/antfly-768d-1M-trial-1/cell-result.json","sha256":"8919b60497791fd9bf64c6bbf6d3bd58a9e1307d9b169bb9330da385c7cd48f9"},{"path":"results/honed-2026-10-06/run/scratch/vector-vdbbench/cache-cells/antfly-768d-1M-trial-2/cell-result.json","sha256":"6824dcaccf32561fe6a2d2c5f922e5dc100b71b93a9d8a5807d5a582e4c0eade"},{"path":"results/honed-2026-10-06/run/scratch/vector-vdbbench/cache-cells/antfly-768d-1M-trial-3/cell-result.json","sha256":"f1c709c4692340f7d989c41868f187579d1126e1fc088787fa00da79fab848c0"}],"subject":{"artifacts":{"linux-arm64":{"archive":"antfly-main-09b78df97-releasefast-linux-arm64.tar.gz","archive_path":"bin/antfly-main-09b78df97-releasefast-linux-arm64.tar.gz","archive_sha256":"48d07c80b7977d8c17ee4ab6bee68100a2c71aefe41e41a92def32985f1c20ce","build":"Zig 0.17.0; ReleaseFast; aarch64-linux-musl; baseline CPU; stripped; onnx=false; metal=false; system-blas=false; -j1; scheduler maxrss 25769803776 bytes","bytes":142212224,"file":"ELF 64-bit LSB executable, ARM aarch64, version 1 (SYSV), statically linked, stripped","path":"bin/antfly-main-09b78df97-releasefast-linux-arm64/bin/antfly","runtime_assets":"bin/antfly-main-09b78df97-releasefast-linux-arm64/share/antfly","sha256":"6366535c49a75b8c4da691096b0cb7799daa6968f68e5a45377f20e6a321c470"}},"commit":"09b78df97ec69e020a56110a684b46fce9d4a511","release":null,"schema_version":1,"subject_id":"antfly-main-09b78df97-releasefast","tag":"main-09b78df97"},"upcoming_scale":{"fixture":"common pinned Cohere10M-source corpus and test-embedding fixture across every size","interpretation":"Within-run scaling knee only; no causal cross-run speed regression claim","maximum_vectors":3000000,"provenance":"Parent-directed coherent fixture contract; not a matched rerun of older1M-sourceScale or honedCohere1M","sizes":12,"status_at_post":"preparing; launch/completion not claimed"},"verification":{"raw_comparison_checks":"passed: three trials per fixed point, exact arithmetic mean and min/max reproduction, zero rejections in old \u003c=30 windows, zero fresh cell request errors","runtime_change":"none; analysis-only, no product changes","source_identity":"sha256 recorded for every analyzed source"}}

Superseded scale observations

Superseded diagnostic evidence, not selected headline results. Failed memory captures remain unqualified.

Attachment SHA-256
c431b0f6e3c4f4e3a5d3b87450ecbe33a0981e75499b71dda2b2b2d581b9689c
{"failed_observations":[{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p45","ndcg":0.9698,"p95_ms":103.9,"p99_ms":124.4,"parameter":"search_effort","recall":0.9656,"status":"ok","value":0.45,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p4","ndcg":0.9362,"p95_ms":85.7,"p99_ms":110.7,"parameter":"search_effort","recall":0.9289,"status":"ok","value":0.4,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p7","ndcg":0.994,"p95_ms":152.1,"p99_ms":197,"parameter":"search_effort","recall":0.9924,"status":"ok","value":0.7,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p425","ndcg":0.9552,"p95_ms":156.7,"p99_ms":180.6,"parameter":"search_effort","recall":0.95,"status":"ok","value":0.425,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p5","ndcg":0.9859,"p95_ms":103.2,"p99_ms":120.4,"parameter":"search_effort","recall":0.9832,"status":"ok","value":0.5,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p375","ndcg":0.9124,"p95_ms":187.6,"p99_ms":221,"parameter":"search_effort","recall":0.9041,"status":"ok","value":0.375,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p6","ndcg":0.9914,"p95_ms":127.3,"p99_ms":157.6,"parameter":"search_effort","recall":0.9896,"status":"ok","value":0.6,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p55","ndcg":0.9885,"p95_ms":133.3,"p99_ms":162.4,"parameter":"search_effort","recall":0.9862,"status":"ok","value":0.55,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p35","ndcg":0.8863,"p95_ms":430.1,"p99_ms":857.1,"parameter":"search_effort","recall":0.8748,"status":"ok","value":0.35,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-1","ndcg":0.9955,"p95_ms":322.8,"p99_ms":471.1,"parameter":"search_effort","recall":0.9941,"status":"ok","value":1,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p475","ndcg":0.9797,"p95_ms":140.2,"p99_ms":175.3,"parameter":"search_effort","recall":0.9766,"status":"ok","value":0.475,"workload":"scale-big-3m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-3m-0p8","ndcg":0.9951,"p95_ms":166.2,"p99_ms":196.9,"parameter":"search_effort","recall":0.9936,"status":"ok","value":0.8,"workload":"scale-big-3m"}],"lifecycle":{"attempt":2,"elapsed_seconds":5647.307,"finished_at":1791414342.5107663,"reason":"command_failed","returncode":1,"started_at":1791408695.2036736,"status":"failed","trial":1},"memory":{"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":13748469760,"cgroup_kernel_peak_sum_bytes":13748568064,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":9844404224,"ended":1791414325.24257,"failed_samples":3,"first_sample_at":1791408701.952897,"kind":"container_cgroup_v2","last_sample_at":1791414325.0407884,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":16270,"schema_version":3,"started":1791408701.8863516,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"largest_gaps":[{"from":1020.564,"gap":92.90999999999997,"to":1113.474},{"from":1016.097,"gap":4.4669999999999845,"to":1020.564},{"from":1540.355,"gap":3.0019999999999527,"to":1543.357},{"from":1483.321,"gap":2.8659999999999854,"to":1486.187},{"from":968.462,"gap":2.632000000000062,"to":971.094},{"from":467.08,"gap":2.5920000000000414,"to":469.672},{"from":2220.752,"gap":2.5419999999999163,"to":2223.294},{"from":1599.435,"gap":2.5060000000000855,"to":1601.941},{"from":976.764,"gap":2.4320000000000164,"to":979.196},{"from":442.378,"gap":2.4080000000000155,"to":444.786},{"from":921.453,"gap":2.3780000000000427,"to":923.831},{"from":979.532,"gap":2.2269999999999754,"to":981.759},{"from":881.314,"gap":2.1720000000000255,"to":883.486},{"from":1479.599,"gap":2.1359999999999673,"to":1481.735},{"from":1613.515,"gap":2.071999999999889,"to":1615.587},{"from":464.748,"gap":1.8480000000000132,"to":466.596},{"from":1010.209,"gap":1.7390000000000327,"to":1011.948},{"from":1820.86,"gap":1.734000000000151,"to":1822.594},{"from":1734.293,"gap":1.7210000000000036,"to":1736.014},{"from":438.572,"gap":1.6899999999999977,"to":440.262}],"reason":"Three failed samples and 92.91-second maximum gap; observed peak is not a qualified memory demand.","status":"unqualified"},"publication_eligible":false,"publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.2210751226328498,0.9665379472615221,2.589927790781137,0.1674468148846701,0.0823519681963965],"conc_latency_p95_list":[0.3183211362484144,1.6969145994109567,4.602956537983846,0.4727455165120773,0.14975746614800284],"conc_latency_p99_list":[0.3614035007078202,2.3358560107636728,4.995302128549663,1.455971075447451,0.2798938849344269],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[4.5174,5.1169,3.7408,118.7694,360.4031],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9676,"optimize_duration":0,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","qps":360.4031,"recall":0.9632,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0302,"serial_latency_p99":0.039,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"publication_source_sha256":"e0e27840870cd64ae867e0429e0594756658eb7f630e55d9b52d2e72f7afeb86","qualification_status":"unqualified","query_metrics_status":"passed-query-observations-not-a-qualified-lifecycle","serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":1809.9,"load_s":4726.3,"source_label":"antfly-qualification-scale-big-3m-0p35"},"ndcg":0.9698,"p95_ms":103.9,"p99_ms":124.4,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9656,"selection_mode":"swept","value":0.45},"status":"failed","storage":{"created_at":"2026-10-07T21:31:36.483707+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-big-3m"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-07T21:31:36.741917+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-07T21:31:36.741890+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]}],"stage":"empty","started_at":"2026-10-07T21:31:36.523728+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]},"final":{"allocated_bytes":28994842624,"apparent_bytes":28980177653,"completed_at":"2026-10-07T23:05:31.031122+00:00","samples":[{"allocated_bytes":28994842624,"apparent_bytes":28980177653,"captured_at":"2026-10-07T23:05:31.031031+00:00","entries":7237,"volumes":[{"allocated_bytes":28994842624,"apparent_bytes":28980177653,"entries":7237,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-07T23:05:30.862103+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-big-3m","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":28994842624,"apparent_bytes":28980177653,"entries":7237,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]},"post_workload":{"allocated_bytes":29011378176,"apparent_bytes":28996724481,"completed_at":"2026-10-07T23:05:25.508712+00:00","samples":[{"allocated_bytes":29011378176,"apparent_bytes":28996724481,"captured_at":"2026-10-07T23:05:25.508673+00:00","entries":7235,"volumes":[{"allocated_bytes":29011378176,"apparent_bytes":28996724481,"entries":7235,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-07T23:05:25.345625+00:00","volumes":[{"allocated_bytes":29011378176,"apparent_bytes":28996724481,"entries":7235,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-07T21:31:41.740531+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-07T21:31:41.740506+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]}],"stage":"ready","started_at":"2026-10-07T21:31:41.461347+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"name":"circus_vdbb_scale_t1_scale-big-3m-antfly-data"}]},"protocol_fingerprint":"2768c4fe5b053412b4c3b6c18def129374a7b7082c2ca92f789327781f35bf93","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-07T23:05:31.031140+00:00"},"trial":1,"vectors":3000000,"workload_id":"scale-big-3m"}],"interpretation":"Not pooled with the final uniform-collector curve. Eleven qualified trial-1 observations are retained separately; the 3M lifecycle is unqualified.","memory_capture_transport":"one-shot-exec","qualified_observations":[{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p45","ndcg":0.9818,"p95_ms":6.4,"p99_ms":7,"parameter":"search_effort","recall":0.9784,"status":"ok","value":0.45,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p55","ndcg":0.9955,"p95_ms":6.2,"p99_ms":6.5,"parameter":"search_effort","recall":0.9942,"status":"ok","value":0.55,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p6","ndcg":0.9959,"p95_ms":6.6,"p99_ms":7.8,"parameter":"search_effort","recall":0.9946,"status":"ok","value":0.6,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p375","ndcg":0.9301,"p95_ms":6.7,"p99_ms":7.5,"parameter":"search_effort","recall":0.921,"status":"ok","value":0.375,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p475","ndcg":0.991,"p95_ms":6.2,"p99_ms":6.8,"parameter":"search_effort","recall":0.989,"status":"ok","value":0.475,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p7","ndcg":0.9961,"p95_ms":6.3,"p99_ms":7.5,"parameter":"search_effort","recall":0.9948,"status":"ok","value":0.7,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p35","ndcg":0.9029,"p95_ms":23,"p99_ms":42,"parameter":"search_effort","recall":0.8914,"status":"ok","value":0.35,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p425","ndcg":0.9706,"p95_ms":6.4,"p99_ms":6.8,"parameter":"search_effort","recall":0.966,"status":"ok","value":0.425,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p4","ndcg":0.9505,"p95_ms":6.1,"p99_ms":6.8,"parameter":"search_effort","recall":0.9437,"status":"ok","value":0.4,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-1","ndcg":0.9961,"p95_ms":7.5,"p99_ms":8.6,"parameter":"search_effort","recall":0.9948,"status":"ok","value":1,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p5","ndcg":0.9948,"p95_ms":6.6,"p99_ms":7.1,"parameter":"search_effort","recall":0.9934,"status":"ok","value":0.5,"workload":"scale-fast-20k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-20k-0p8","ndcg":0.9961,"p95_ms":6.8,"p99_ms":7.2,"parameter":"search_effort","recall":0.9948,"status":"ok","value":0.8,"workload":"scale-fast-20k"}],"cell_sha256":"a8a0a7d695218970e8a0c38d8eb83dbb896df12bf3500a2800d23b3a890411c7","index_build":{"insert_duration":5.833,"optimize_duration":4.0494,"seconds":9.8824},"lifecycle":{"attempt":1,"elapsed_seconds":633.443,"finished_at":1791392108.8877373,"returncode":0,"started_at":1791391475.4445853,"status":"ok","trial":1},"memory":{"anon_shmem_peak_mb":1609.7,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":1768.7,"cgroup_current_peak_mb":1767.7,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":1609.7,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":1767723008,"cgroup_kernel_peak_sum_bytes":1768706048,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":1609658368,"ended":1791392096.5356352,"failed_samples":0,"first_sample_at":1791391480.7171044,"kind":"container_cgroup_v2","last_sample_at":1791392096.3340602,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":1959,"schema_version":3,"started":1791391480.650949,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791391480.7171044,"index_started_at":1791391480.8157282,"last_sample_at":1791392096.3340602,"max_sample_gap_s":0.716,"publication_finished_at":1791392096.3084035,"sampler_ended_at":1791392096.5356352,"sampler_started_at":1791391480.650949,"samples":1959,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"profile":"fast","publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.004971230873608825,0.005832618237109089,0.008385639992283362,0.017724147180808596,0.02643286415273111],"conc_latency_p95_list":[0.006074974527291486,0.007276461410219781,0.012379157997202128,0.03067093494464643,0.049283213140734],"conc_latency_p99_list":[0.006943303977022879,0.008844233771087603,0.015012709110160343,0.03970617191633211,0.06253615875088142],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[200.8338,855.499,1189.1419,1122.9675,1127.7031],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9681,"optimize_duration":0,"p99_c30_ms":62.53615875088142,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":10,"peak_qps":1189.1419,"qps":1189.1419,"qps_c30":1127.7031,"recall":0.9634,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0059,"serial_latency_p99":0.0069,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"selection_status":"superseded","serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":5.8,"load_s":9.9,"source_label":"antfly-qualification-scale-fast-20k-0p35"},"ndcg":0.9706,"p95_ms":6.4,"p99_ms":6.8,"parameter":"search_effort","qualification_floor":0.955,"recall":0.966,"selection_mode":"swept","value":0.425},"source":{"cache_key":"dd59b15c1d656cddc983f92cb862c6d6ae13d9b76eeb83761b60d1962ae8a0ae","finished_at":1791392108.8877373,"object_sha256":"0f1fa6ebc0e31c017fa98d07d9eef7ec321ae3dc5fd63b3961f66d97b7db6a79","receipt_sha256":"546ddb4bb5f3b3319c40a01cda45222609e6479ba1564c343ab254ac901f5799","started_at":1791391475.4445853},"source_receipt":{"benchmark_id":"vector-vdbbench-scale","files":[{"bytes":12494,"media_type":"application/json","path":"cell-result.json","retention":"evidence","role":"normalized-result","schema_version":1,"sha256":"a8a0a7d695218970e8a0c38d8eb83dbb896df12bf3500a2800d23b3a890411c7"},{"bytes":8262,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-20k-0p35.log","retention":"evidence","role":"log","schema_version":null,"sha256":"c79ad82e0f7959400c590aee7a727bb60ff8ea95ca86f20c925d3ec0e0db08b0"},{"bytes":9277,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-20k-0p35_load.log","retention":"evidence","role":"log","schema_version":null,"sha256":"cea50166f159eba6050958b80622e03571fa0c12b20bf30c03dccc3cc1fb4cd8"},{"bytes":8271,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-20k-0p375.log","retention":"evidence","role":"log","schema_version":null,"sha256":"8d46d60acb32f1940be94bf21e60240d1a6f75b0901863087b13d3befd31ba2f"},{"bytes":8260,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-20k-0p4.log","retention":"evidence","role":"log","schema_version":null,"sha256":"a12745ede792e806150adc2dec5b152eecfb27e723f4f90375cd9c010f9350b2"},{"bytes":8273,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-20k-0p425.log","retention":"evidence","role":"log","schema_version":null,"sha256":"ea53831fd0bc5745ed8a4649ff78d15fe26a21459baca5dbeeb43d89c2167db9"},{"bytes":8265,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-20k-0p45.log","retention":"evidence","role":"log","schema_version":null,"sha256":"b8c403f7a4c15f5fc31fce2850a33fc259c979d7429d61566ce81b5cc1274ac7"},{"bytes":8270,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-20k-0p475.log","retention":"evidence","role":"log","schema_version":null,"sha256":"784e0a2c8749c6d679b217de2c9991d3f36c07edf599fca322312508ce9e7ef7"},{"bytes":8259,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-20k-0p5.log","retention":"evidence","role":"log","schema_version":null,"sha256":"d2ea9af1ae4bbd5408e1b935d862e338448c3e48ea89640dde41ed1b2b83ddea"},{"bytes":8268,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-20k-0p55.log","retention":"evidence","role":"log","schema_version":null,"sha256":"18534f312a156b76ed3548981ed7165992846b61414e9c7a489b51a7ba533183"},{"bytes":8259,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-20k-0p6.log","retention":"evidence","role":"log","schema_version":null,"sha256":"08d7ebf664c3fdd491e8de15167a67237795aac407c53fccc7d0dda78aa12118"},{"bytes":8260,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-20k-0p7.log","retention":"evidence","role":"log","schema_version":null,"sha256":"404699b4b09f49823e5ef816cb2609d961df3d1a6be97e217ca790ef02151ace"},{"bytes":8260,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-20k-0p8.log","retention":"evidence","role":"log","schema_version":null,"sha256":"36c8816b86fd3912eec9b9885c83cc321c305e4076809e99ab91377ea779644e"},{"bytes":8246,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-20k-1.log","retention":"evidence","role":"log","schema_version":null,"sha256":"39590bb282ac41dd1f7a999c88ba003978c1ee5891fba440ecca168d9ce8cbd3"},{"bytes":23386,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"5fdd4780ae1b747f70d4e6065d848bd8041da2f92769d8793d215cb7c7ba3622"},{"bytes":986,"media_type":"application/json","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.json","retention":"evidence","role":"log","schema_version":1,"sha256":"62818cdb16e648eba23582c8d4c76a0d90a4ddf5d33c8f5feb3bc8bc989cf720"},{"bytes":500585,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.jsonl","retention":"evidence","role":"memory-timeline","schema_version":null,"sha256":"0f1c8bf9ac5b5e8277ebd2a77a0800be6460673140826bcb9bceb723c5684bd3"},{"bytes":0,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"},{"bytes":136988,"media_type":"application/octet-stream","path":"logs/supervisor.log","retention":"evidence","role":"log","schema_version":null,"sha256":"c3812fad19767ab0d23ab1144c5b3ab759383b5d31ef5fa0fe7690bb21634ee7"},{"bytes":2585,"media_type":"application/json","path":"memory.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"5021fc29a076ce0d7669741557b181fea1ed15a6a338d1a045ff12034c0ea443"},{"bytes":87,"media_type":"application/json","path":"quiet-host.json","retention":"evidence","role":"quiet-host","schema_version":1,"sha256":"b6fd71707081f58326be630e9872b9fbf258639be433d6e87cff9e4021ea5bd2"},{"bytes":3725,"media_type":"application/json","path":"results/Antfly/result_20261007_163ea28049fe4a56b95852a190a5b331_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"1e3a47c8b92ab23758a685825fb7879f221bda115582506635dae7d9cfc811a5"},{"bytes":4419,"media_type":"application/json","path":"results/Antfly/result_20261007_43b0180fa5354c209486e88daf10db30_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"8f0eba40dd8cb3f57aff1a081332e0e6042e64797ade0f7bd537dc6121703ae5"},{"bytes":3323,"media_type":"application/json","path":"results/Antfly/result_20261007_686a33f4db6146758a9c0fa1aca79653_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"a0ea1b86292e8db15068de8dfc6ed4bc37114ff72d83680810ffec72527fd4bb"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_73e3745d59d94d2c8d81c21b3ac808e5_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"c2cb957006af9e1de59a5f7618198feb2f49d2d88f46fae3c7761d62dd96f9a4"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_7540c2ea78b4479f844004f8eedb018f_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"91d74cc28e78df39a6a74f83c6ea2c682c5a52c76625505663592c17a1f3b54e"},{"bytes":3727,"media_type":"application/json","path":"results/Antfly/result_20261007_97323fe2ca3c437ca4f37661d20df01e_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"e722c86dd26794edcf287743878d1cbe36d37a36659cd39fbc8c77a3a8661212"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_9e3e32218f45472d9f661e1dcef23be5_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"ae044425f9b019021173b9c77d489cbde6aa28d5fd7cebbe45d854741cde1410"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_c0e205cf854f47978d3d6e6eeeb29fc4_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"45e936d8ab0c1633227a3750618d8effe2e27172c051ccf45339851bf6f4a0fd"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_c738c71192bb4bf98a1540a6c8262b17_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"19a269727ad5ae32f830c6aed3916858954e76bd47c7c1a1c8667908374e3091"},{"bytes":3727,"media_type":"application/json","path":"results/Antfly/result_20261007_cc2bc35f9d044935b15491dde729e634_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"dc7033d91c80d7589a71d84c1f1e78aa9a0295823f79183d4783774a2f0a0fec"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_e3e02085631a4e07be63800651c43700_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"b5695171700031c1515b59edf362ade6933c9531863d568f775eacbb8716ab53"},{"bytes":3722,"media_type":"application/json","path":"results/Antfly/result_20261007_e5e969d411d94e72881a7f961643a187_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"2a8f7215a26a14aaa210891044cf48bc31ed51fb7c284e413eac58b57bda3221"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_eb6697e357e5418282be4a548e072e52_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"b6ff5c85eb46ef0d0df90b13a1021d82d18652dc97327604e79f67da8a8465a5"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_fb0b7b75c55a4bc1b5f0c3e2e7aff880_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"bd22b9fb6827f7e8d587ff6f5c3dcac7dd30025d396e60e937541bffcbe8f374"},{"bytes":634,"media_type":"application/json","path":"results/publication-protocol.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"8a91260633bc8e26d26d7777e650c95756cbb7cf077fe5028077ef8461928692"},{"bytes":5642,"media_type":"application/json","path":"selected-config.json","retention":"evidence","role":"qualification","schema_version":1,"sha256":"14af401c1b550c8f201e0963ba50eebe082d97a0d35855eb05aec53e437cf614"},{"bytes":3,"media_type":"application/json","path":"status.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570"},{"bytes":6990,"media_type":"application/json","path":"storage.json","retention":"evidence","role":"storage","schema_version":1,"sha256":"514653081bf2d3b1bc80664a46111e6ea66192b29c1007e0920938a5bb107691"},{"bytes":885,"media_type":"application/json","path":"supervisor-result.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"da03ec83d6cc301e3b5ec1321b8742ee827a1c2fd9c370349d70115a4c1948d3"}],"generated_at":"1791392108.8877373","kind":"publication-lifecycle","retained_bytes":852134,"schema_version":1},"status":"ok","storage":{"created_at":"2026-10-07T16:44:37.738928+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-fast-20k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-07T16:44:37.923386+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-07T16:44:37.923359+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-07T16:44:37.781199+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]},"final":{"allocated_bytes":84439040,"apparent_bytes":83741995,"completed_at":"2026-10-07T16:54:57.240514+00:00","samples":[{"allocated_bytes":84439040,"apparent_bytes":83741995,"captured_at":"2026-10-07T16:54:57.240487+00:00","entries":387,"volumes":[{"allocated_bytes":84439040,"apparent_bytes":83741995,"entries":387,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-07T16:54:57.146431+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-fast-20k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":84439040,"apparent_bytes":83741995,"entries":387,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]},"post_workload":{"allocated_bytes":84430848,"apparent_bytes":83741104,"completed_at":"2026-10-07T16:54:56.755212+00:00","samples":[{"allocated_bytes":84430848,"apparent_bytes":83741104,"captured_at":"2026-10-07T16:54:56.755180+00:00","entries":384,"volumes":[{"allocated_bytes":84430848,"apparent_bytes":83741104,"entries":384,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-07T16:54:56.643143+00:00","volumes":[{"allocated_bytes":84430848,"apparent_bytes":83741104,"entries":384,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-07T16:44:40.554706+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-07T16:44:40.554682+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-07T16:44:40.453505+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"name":"circus_vdbb_scale_t1_scale-fast-20k-antfly-data"}]},"protocol_fingerprint":"480231e3c08b56bba96be13ee9d9951eadbf710989705824134176257f67ee5c","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-07T16:54:57.240517+00:00"},"trial":1,"vectors":20000,"workload_id":"scale-fast-20k"},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p5","ndcg":0.9966,"p95_ms":7.4,"p99_ms":8.2,"parameter":"search_effort","recall":0.9955,"status":"ok","value":0.5,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p7","ndcg":0.9967,"p95_ms":7.2,"p99_ms":8,"parameter":"search_effort","recall":0.9956,"status":"ok","value":0.7,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p55","ndcg":0.9966,"p95_ms":7.1,"p99_ms":7.7,"parameter":"search_effort","recall":0.9956,"status":"ok","value":0.55,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p8","ndcg":0.9968,"p95_ms":7.6,"p99_ms":8.1,"parameter":"search_effort","recall":0.9957,"status":"ok","value":0.8,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p6","ndcg":0.9967,"p95_ms":7.3,"p99_ms":7.9,"parameter":"search_effort","recall":0.9956,"status":"ok","value":0.6,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p475","ndcg":0.9942,"p95_ms":10.2,"p99_ms":11.1,"parameter":"search_effort","recall":0.9928,"status":"ok","value":0.475,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p375","ndcg":0.942,"p95_ms":6.3,"p99_ms":7,"parameter":"search_effort","recall":0.9332,"status":"ok","value":0.375,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p4","ndcg":0.9632,"p95_ms":6.8,"p99_ms":7.6,"parameter":"search_effort","recall":0.957,"status":"ok","value":0.4,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p45","ndcg":0.9881,"p95_ms":7,"p99_ms":7.4,"parameter":"search_effort","recall":0.9856,"status":"ok","value":0.45,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p425","ndcg":0.9784,"p95_ms":6.7,"p99_ms":8,"parameter":"search_effort","recall":0.9743,"status":"ok","value":0.425,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-1","ndcg":0.9968,"p95_ms":9.1,"p99_ms":9.6,"parameter":"search_effort","recall":0.9957,"status":"ok","value":1,"workload":"scale-fast-40k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-40k-0p35","ndcg":0.917,"p95_ms":31.8,"p99_ms":47.1,"parameter":"search_effort","recall":0.9062,"status":"ok","value":0.35,"workload":"scale-fast-40k"}],"cell_sha256":"b9138b21b645d2a5847a15286f1b22eeafb48a8c690e036bea0a61cfdb405df7","index_build":{"insert_duration":9.6001,"optimize_duration":4.0446,"seconds":13.6447},"lifecycle":{"attempt":1,"elapsed_seconds":663.122,"finished_at":1791392772.4326513,"returncode":0,"started_at":1791392109.3104432,"status":"ok","trial":1},"memory":{"anon_shmem_peak_mb":1890.1,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":2129.2,"cgroup_current_peak_mb":2128.4,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":1890.1,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":2128412672,"cgroup_kernel_peak_sum_bytes":2129248256,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":1890058240,"ended":1791392736.8738115,"failed_samples":0,"first_sample_at":1791392112.7572238,"kind":"container_cgroup_v2","last_sample_at":1791392736.6723065,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":1989,"schema_version":3,"started":1791392112.6969924,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791392112.7572238,"index_started_at":1791392112.87397,"last_sample_at":1791392736.6723065,"max_sample_gap_s":0.62,"publication_finished_at":1791392736.4623,"sampler_ended_at":1791392736.8738115,"sampler_started_at":1791392112.6969924,"samples":1989,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"profile":"fast","publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.0053795074672909875,0.0061108514646584,0.008706126127585036,0.016951269651801187,0.025824660386345906],"conc_latency_p95_list":[0.0067347475051064976,0.007659437859547325,0.012965327012352645,0.030031777205294936,0.04757863729610109],"conc_latency_p99_list":[0.008117011995636858,0.009406362367153634,0.015812792803626508,0.03782601764891301,0.061080250958912057],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[185.5704,816.4907,1145.6695,1174.1274,1152.4723],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9576,"optimize_duration":0,"p99_c30_ms":61.08025095891205,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":20,"peak_qps":1174.1274,"qps":1174.1274,"qps_c30":1152.4723,"recall":0.9517,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0067,"serial_latency_p99":0.0076,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"selection_status":"superseded","serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":9.6,"load_s":13.6,"source_label":"antfly-qualification-scale-fast-40k-0p35"},"ndcg":0.9632,"p95_ms":6.8,"p99_ms":7.6,"parameter":"search_effort","qualification_floor":0.955,"recall":0.957,"selection_mode":"swept","value":0.4},"source":{"cache_key":"6ab90fb36ba4cab3f68bf7321e3203a76a55875f77aad1e92332bbb734b20cda","finished_at":1791392772.4326513,"object_sha256":"031250d59e7143e472257e2a96bb1f00f4766fc467157f8a8903efbf3e95862b","receipt_sha256":"5a9246ce44619c2f361860bb947fb43c41325df3eff99c54504b4cc91361d008","started_at":1791392109.3104432},"source_receipt":{"benchmark_id":"vector-vdbbench-scale","files":[{"bytes":12512,"media_type":"application/json","path":"cell-result.json","retention":"evidence","role":"normalized-result","schema_version":1,"sha256":"b9138b21b645d2a5847a15286f1b22eeafb48a8c690e036bea0a61cfdb405df7"},{"bytes":8265,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-40k-0p35.log","retention":"evidence","role":"log","schema_version":null,"sha256":"81919c7556ef5c5b38ba3ca2ee2fcb22022b7f184bdfbb067638a9314b3efd0f"},{"bytes":9331,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-40k-0p35_load.log","retention":"evidence","role":"log","schema_version":null,"sha256":"c9fc00f2d2db1c35704fc0109602b28cf7b3ff6e0969ec836edd1f70edb6301c"},{"bytes":8270,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-40k-0p375.log","retention":"evidence","role":"log","schema_version":null,"sha256":"8cc6f8aca7910949c323bc6af9907a73d7f937226e71646311007cebdf927d1e"},{"bytes":8257,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-40k-0p4.log","retention":"evidence","role":"log","schema_version":null,"sha256":"c507173516f8e38e3115a0eab737134e8a3fca240594bc2789f7d7c348d6943f"},{"bytes":8273,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-40k-0p425.log","retention":"evidence","role":"log","schema_version":null,"sha256":"a0523f6b88836adb9a395089b5b4858ffaecad0eaf927fe370a45ef10168def3"},{"bytes":8265,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-40k-0p45.log","retention":"evidence","role":"log","schema_version":null,"sha256":"9dbf9d2fcddd1d0276f5502221db71d4dd999ee4bcc6ef35a08f4230a1d230cd"},{"bytes":8276,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-40k-0p475.log","retention":"evidence","role":"log","schema_version":null,"sha256":"5a4c9a2483b044152f934c842f8fa5b92c8e064e789373ffa421a0a538835218"},{"bytes":8259,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-40k-0p5.log","retention":"evidence","role":"log","schema_version":null,"sha256":"a014ba8216308233095c36b6bf6802a9ae4b68ce61cdb05c9619a0ab5cbf8bb2"},{"bytes":8268,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-40k-0p55.log","retention":"evidence","role":"log","schema_version":null,"sha256":"fc23c50f8703b5cd37399f1ec0fa0aa4031b8e6f402214acb894cfb002796586"},{"bytes":8259,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-40k-0p6.log","retention":"evidence","role":"log","schema_version":null,"sha256":"5954ab0839776799b17471218bd05d04386c7dfabb1fe19e8eda6ec4d9d27787"},{"bytes":8256,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-40k-0p7.log","retention":"evidence","role":"log","schema_version":null,"sha256":"26970d2668b768a204f97b34ad9d23abcf70f79d5218532d9aea3ed78b57612e"},{"bytes":8260,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-40k-0p8.log","retention":"evidence","role":"log","schema_version":null,"sha256":"0a14570054fd9922e0b699edd178de4358cd1bed6a4b9e42b1804ff9fff17ce5"},{"bytes":8245,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-40k-1.log","retention":"evidence","role":"log","schema_version":null,"sha256":"7d6737eb09d4e1494b00b5598c62c18fd01be4588609c0a540b1f6dab87ff6cb"},{"bytes":23544,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"6cf711a07814a58cca56cb77383c22661a0bc97554572a2d21bd9cc286d8b53a"},{"bytes":987,"media_type":"application/json","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.json","retention":"evidence","role":"log","schema_version":1,"sha256":"a971527f48b2c75299e910239208e68c4a1f1988b5a810cf7014cc42231291d2"},{"bytes":508764,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.jsonl","retention":"evidence","role":"memory-timeline","schema_version":null,"sha256":"8c276097526939d16cee28e3810241ecd91ed8b94d6aa9aab849cc753c55135c"},{"bytes":0,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"},{"bytes":137200,"media_type":"application/octet-stream","path":"logs/supervisor.log","retention":"evidence","role":"log","schema_version":null,"sha256":"6b38813e7f7684fab5c6b5f3436e39f328c8aa12333be9257c1c942a70059bb4"},{"bytes":2580,"media_type":"application/json","path":"memory.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"122403320c3f5c17dbcaad55986ba1a1245c8f4a024e96e7c2db0d15e49e50d4"},{"bytes":87,"media_type":"application/json","path":"quiet-host.json","retention":"evidence","role":"quiet-host","schema_version":1,"sha256":"b6fd71707081f58326be630e9872b9fbf258639be433d6e87cff9e4021ea5bd2"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_02b87dfdc84a40c59e5d89a99af8c4a0_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"57bae7620eac5bca329ca11d38788d322a5eb517b82f897b8e551ded719f1f48"},{"bytes":3723,"media_type":"application/json","path":"results/Antfly/result_20261007_02c0035ec2d245bb9d904c59c2a78e76_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"014e58693ec0f08be87663f7c8b174e474d82056c591538013e3a06eec648df2"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_0b0fa01ee2934e73a01aa746990cb0df_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"27408f876cb6dee79651aeb39ad918e714d934a05b719a0d3c8f45c9890cd162"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_3c5e7d14b7d64492849e8bd3d70594b8_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"bc80e419d552373bd4ed5722e687435f1692e1582e3cdaef29e7898a9aef76ca"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_5551165e28d74f6caf45b73b35a2a5d4_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"79c7dafc56f0bf17d167be4dedc8da6ebae727bc25df5538d532abe4fea60d86"},{"bytes":4423,"media_type":"application/json","path":"results/Antfly/result_20261007_59f9b7278dd5415eaf56b643c82d451b_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"6d9219ef7aee7d0bac9644342c60c6b9435dbe8336136a4a45581da916df9ac6"},{"bytes":3728,"media_type":"application/json","path":"results/Antfly/result_20261007_5bc1ab7294e84de5a93482d356ef8567_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"372cc5598c95f2ddc392e400d7c645c6f27ab9ba415fd05ff3196f2b354a1cf6"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_64d85eb72c0545008cfff5c0c09aa18e_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"66fec1af45f02f3b0e11da197aa5e90820d2b8a032286bd5c04a59002ed43fb3"},{"bytes":3325,"media_type":"application/json","path":"results/Antfly/result_20261007_699b797e68e64e618fe44c3b1c57b950_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"2757f45707788fb130c5174d41a2972580d83aee1d61f73df92387f17ab790a2"},{"bytes":3723,"media_type":"application/json","path":"results/Antfly/result_20261007_78421713e5b84a03800caa3cbea2177e_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"4b8d6c380fe9cbce7f4e4de48d38952142369b0bf18b5c1b535b1749a775f400"},{"bytes":3725,"media_type":"application/json","path":"results/Antfly/result_20261007_7ab50563ff934e3d9b074dac34b1913e_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"168130e940b9b6807771878ac6424ad5e8619dc337d283d8cea4ecfc074c6ca9"},{"bytes":3727,"media_type":"application/json","path":"results/Antfly/result_20261007_853dea7ef6764057bf46ef014a060d42_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"1e14e06498f78993e030685fe8f68f06da2fc4b07f4f8a8b8e80d0506d17309b"},{"bytes":3722,"media_type":"application/json","path":"results/Antfly/result_20261007_a7a73079ac6d479baa35f578fbc76221_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"01b8c02f4477dc84113739e5b142eda175b8e5c465dd115c273407984fca3984"},{"bytes":3725,"media_type":"application/json","path":"results/Antfly/result_20261007_db56beb5766d4a1abf2b4b57f13e7bd1_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"6cbe4c9a919f5ae68603b9acdebe36f55955b53826b30a62e101f6dbdd01d8af"},{"bytes":634,"media_type":"application/json","path":"results/publication-protocol.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"8a91260633bc8e26d26d7777e650c95756cbb7cf077fe5028077ef8461928692"},{"bytes":5644,"media_type":"application/json","path":"selected-config.json","retention":"evidence","role":"qualification","schema_version":1,"sha256":"e6f554bb33d85286bc16e3199a15a800357990e766ed00c0cca480f8ce7e0a98"},{"bytes":3,"media_type":"application/json","path":"status.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570"},{"bytes":7006,"media_type":"application/json","path":"storage.json","retention":"evidence","role":"storage","schema_version":1,"sha256":"e9b720d186e58ddeb563bddaa407561d2e3069313000867b47799ceff5a68fc6"},{"bytes":885,"media_type":"application/json","path":"supervisor-result.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"c4dd9f68530d52a16b9e970f074cdfa963db2190e39de0e6c542b18ecc25a195"}],"generated_at":"1791392772.4326513","kind":"publication-lifecycle","retained_bytes":860775,"schema_version":1},"status":"ok","storage":{"created_at":"2026-10-07T16:55:09.973090+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-fast-40k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-07T16:55:10.106917+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-07T16:55:10.106893+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-07T16:55:10.012180+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]},"final":{"allocated_bytes":166244352,"apparent_bytes":165547117,"completed_at":"2026-10-07T17:05:37.588593+00:00","samples":[{"allocated_bytes":166244352,"apparent_bytes":165547117,"captured_at":"2026-10-07T17:05:37.588566+00:00","entries":388,"volumes":[{"allocated_bytes":166244352,"apparent_bytes":165547117,"entries":388,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-07T17:05:37.494146+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-fast-40k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":166244352,"apparent_bytes":165547117,"entries":388,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]},"post_workload":{"allocated_bytes":166244352,"apparent_bytes":165546240,"completed_at":"2026-10-07T17:05:37.083052+00:00","samples":[{"allocated_bytes":166244352,"apparent_bytes":165546240,"captured_at":"2026-10-07T17:05:37.083021+00:00","entries":387,"volumes":[{"allocated_bytes":166244352,"apparent_bytes":165546240,"entries":387,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-07T17:05:36.995206+00:00","volumes":[{"allocated_bytes":166244352,"apparent_bytes":165546240,"entries":387,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-07T16:55:12.611434+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-07T16:55:12.611410+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-07T16:55:12.529020+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"name":"circus_vdbb_scale_t1_scale-fast-40k-antfly-data"}]},"protocol_fingerprint":"cb3681dd78bccc6cce383688d3272d84adbd75b61ce8346437c17febed0e3247","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-07T17:05:37.588596+00:00"},"trial":1,"vectors":40000,"workload_id":"scale-fast-40k"},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p55","ndcg":0.9964,"p95_ms":8,"p99_ms":9.1,"parameter":"search_effort","recall":0.9952,"status":"ok","value":0.55,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p35","ndcg":0.9128,"p95_ms":37.6,"p99_ms":49.8,"parameter":"search_effort","recall":0.9026,"status":"ok","value":0.35,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p6","ndcg":0.9965,"p95_ms":8.1,"p99_ms":8.9,"parameter":"search_effort","recall":0.9953,"status":"ok","value":0.6,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p475","ndcg":0.9944,"p95_ms":8.3,"p99_ms":9.2,"parameter":"search_effort","recall":0.9933,"status":"ok","value":0.475,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p5","ndcg":0.9963,"p95_ms":8.2,"p99_ms":9,"parameter":"search_effort","recall":0.9951,"status":"ok","value":0.5,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p4","ndcg":0.962,"p95_ms":7.2,"p99_ms":8.3,"parameter":"search_effort","recall":0.9568,"status":"ok","value":0.4,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-1","ndcg":0.9964,"p95_ms":10.5,"p99_ms":11.6,"parameter":"search_effort","recall":0.9952,"status":"ok","value":1,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p425","ndcg":0.9781,"p95_ms":7.4,"p99_ms":7.9,"parameter":"search_effort","recall":0.9748,"status":"ok","value":0.425,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p375","ndcg":0.9402,"p95_ms":7.1,"p99_ms":7.7,"parameter":"search_effort","recall":0.9329,"status":"ok","value":0.375,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p45","ndcg":0.9889,"p95_ms":7.7,"p99_ms":8.6,"parameter":"search_effort","recall":0.987,"status":"ok","value":0.45,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p7","ndcg":0.9965,"p95_ms":9.2,"p99_ms":10.7,"parameter":"search_effort","recall":0.9953,"status":"ok","value":0.7,"workload":"scale-fast-60k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-60k-0p8","ndcg":0.9964,"p95_ms":8.2,"p99_ms":9.1,"parameter":"search_effort","recall":0.9952,"status":"ok","value":0.8,"workload":"scale-fast-60k"}],"cell_sha256":"cd92955ceab92fdd3c9c939bae283165cd0aa3a83b74c1d755b8e85d44a58b71","index_build":{"insert_duration":13.4033,"optimize_duration":6.0577,"seconds":19.461},"lifecycle":{"attempt":1,"elapsed_seconds":663.335,"finished_at":1791393436.1859303,"returncode":0,"started_at":1791392772.8506975,"status":"ok","trial":1},"memory":{"anon_shmem_peak_mb":1859.1,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":2177.5,"cgroup_current_peak_mb":2175.3,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":1859.1,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":2175344640,"cgroup_kernel_peak_sum_bytes":2177470464,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":1859121152,"ended":1791393412.1553743,"failed_samples":0,"first_sample_at":1791392776.2802422,"kind":"container_cgroup_v2","last_sample_at":1791393411.953725,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":2023,"schema_version":3,"started":1791392776.2198243,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791392776.2802422,"index_started_at":1791392776.3957317,"last_sample_at":1791393411.953725,"max_sample_gap_s":0.822,"publication_finished_at":1791393411.8037803,"sampler_ended_at":1791393412.1553743,"sampler_started_at":1791392776.2198243,"samples":2023,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"profile":"fast","publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.005712961935757421,0.006331669071583133,0.008729942473344009,0.017784542891131485,0.02770316450165833],"conc_latency_p95_list":[0.007410998485283926,0.007974574957916047,0.012973079501534812,0.03110674410418141,0.0515028852460091],"conc_latency_p99_list":[0.009357420494779944,0.009891135083453276,0.01597278805391397,0.03881054171652069,0.06615641771350053],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[174.7509,787.9524,1142.477,1118.1661,1074.1618],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9593,"optimize_duration":0,"p99_c30_ms":66.15641771350053,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":10,"peak_qps":1142.477,"qps":1142.477,"qps_c30":1074.1618,"recall":0.9534,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0073,"serial_latency_p99":0.0091,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"selection_status":"superseded","serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":13.4,"load_s":19.5,"source_label":"antfly-qualification-scale-fast-60k-0p35"},"ndcg":0.962,"p95_ms":7.2,"p99_ms":8.3,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9568,"selection_mode":"swept","value":0.4},"source":{"cache_key":"5b149022770774bdbb55aa8c181de3662872332049e5032654209fd977e0c8e2","finished_at":1791393436.1859303,"object_sha256":"11a2f3ee4095cf2a66ad38b2af7ac7786a68d4fb35b28b11a73936ab00c266f7","receipt_sha256":"0c1b70807601e709627518be3c398ff975318f3deb0a294b4a537bcab24f59a6","started_at":1791392772.8506975},"source_receipt":{"benchmark_id":"vector-vdbbench-scale","files":[{"bytes":12510,"media_type":"application/json","path":"cell-result.json","retention":"evidence","role":"normalized-result","schema_version":1,"sha256":"cd92955ceab92fdd3c9c939bae283165cd0aa3a83b74c1d755b8e85d44a58b71"},{"bytes":8268,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-60k-0p35.log","retention":"evidence","role":"log","schema_version":null,"sha256":"d04fb19a849a27e8ee2535ee4a40a1144da62583cda25df8ff6bf0296050f12a"},{"bytes":9332,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-60k-0p35_load.log","retention":"evidence","role":"log","schema_version":null,"sha256":"4ee168f2ba2815a5d7e58ed5de11624b4af6c4dc03a8dc31bea1e8d54c2740bd"},{"bytes":8276,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-60k-0p375.log","retention":"evidence","role":"log","schema_version":null,"sha256":"0ed70a348d45141ef490ba150770afde1bcacb82b3ca124d6810d3fb01315b7f"},{"bytes":8257,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-60k-0p4.log","retention":"evidence","role":"log","schema_version":null,"sha256":"b7eb19959e4ebdb53663cdcc65d98c7326238778639445a4f0af112f48aed74c"},{"bytes":8275,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-60k-0p425.log","retention":"evidence","role":"log","schema_version":null,"sha256":"489f3158787510d9dfa6f4382c0595a789e0e60cbcda4d88f347f98e03ac21f1"},{"bytes":8265,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-60k-0p45.log","retention":"evidence","role":"log","schema_version":null,"sha256":"6f1266caee52725ebdb8c6ce8c0d0d7377a7f381300703810c706c4f9fcd6a9c"},{"bytes":8276,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-60k-0p475.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e7452cbcc3dc44fc8d8a018dbd99a0473359ce46b4ba5a313ce9a77969c6230d"},{"bytes":8257,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-60k-0p5.log","retention":"evidence","role":"log","schema_version":null,"sha256":"3a1fbdc7f129ed54780a072dfc218b74183e6f9d8b9a7a2b3ac99e855c4fc1bf"},{"bytes":8265,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-60k-0p55.log","retention":"evidence","role":"log","schema_version":null,"sha256":"af9c464215f2d6294dc800a410b00d2bbde9fcd1b449a2bdf916e3d232c20d41"},{"bytes":8260,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-60k-0p6.log","retention":"evidence","role":"log","schema_version":null,"sha256":"9649e8df59c679abc789c4a458fffb7f33587ff5c7ccefc455e314d50db1df4b"},{"bytes":8260,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-60k-0p7.log","retention":"evidence","role":"log","schema_version":null,"sha256":"c63271acc4645b3ba584bc59b8e6ee33ac8f8ecb0c35be626234f77534cfa2d0"},{"bytes":8259,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-60k-0p8.log","retention":"evidence","role":"log","schema_version":null,"sha256":"169139b6d3f4dd75d3247f59c1b3b03de119a5e29fb464b62eea1c294c7051e8"},{"bytes":8245,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-60k-1.log","retention":"evidence","role":"log","schema_version":null,"sha256":"96e63df966d196dedb4845f2aab429a45f2a10c0b3d6186995d97126a2977bf6"},{"bytes":23383,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"1fc1852c9f76fec884c50eac3e7425b638dd5d3d0b180d37a1d3c2eb1ecda07d"},{"bytes":986,"media_type":"application/json","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.json","retention":"evidence","role":"log","schema_version":1,"sha256":"aafc07cdedbf77435bbac120d90bff30dbd3bbb54074884af8bb8073748784e5"},{"bytes":520432,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.jsonl","retention":"evidence","role":"memory-timeline","schema_version":null,"sha256":"30ee01e5425d1bb90b34b1a16cb10b45418f4048432873f4be5b42bdc10d3f9d"},{"bytes":0,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"},{"bytes":137050,"media_type":"application/octet-stream","path":"logs/supervisor.log","retention":"evidence","role":"log","schema_version":null,"sha256":"0bcc9e68d6d0d918b6fbe6aa62b82a7af92b08b44b7aaa6b7afe49b4ed1de27c"},{"bytes":2585,"media_type":"application/json","path":"memory.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"fd9cb7faa98185cf70015bcf8f81f4a128415ef43c05c98b8974e23bbc5811e5"},{"bytes":87,"media_type":"application/json","path":"quiet-host.json","retention":"evidence","role":"quiet-host","schema_version":1,"sha256":"b6fd71707081f58326be630e9872b9fbf258639be433d6e87cff9e4021ea5bd2"},{"bytes":3725,"media_type":"application/json","path":"results/Antfly/result_20261007_1c608a6c8a194021a8f1b5a4f9d02acd_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"b68c874d83e6e9563675702c59ba7f5d3dc1790929c90c62315bfd695e7f8894"},{"bytes":3325,"media_type":"application/json","path":"results/Antfly/result_20261007_1d896c02e4aa4c57b05c8d9d29e26a95_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"ed5361b14c9dd78ae3aa8ffb4df291d1229182446826970b6390d7cad5c4410a"},{"bytes":4416,"media_type":"application/json","path":"results/Antfly/result_20261007_24762456f10e4aff8623894d955bea2d_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"3b2984291432f3e493d8b0f9214ec1f604aa89dede6a3114891b345a25bebd60"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_4b152eddb577430d99a5a63b72718f9a_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"725fb27d07c2b252b4971b7e6063cc88c4cbcf52cdfef1c63106228ca49a07bd"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_5826f81be29342df9cf602f0424ce067_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"37d3d22033a9319bbaf40a69999a4bcd0c841331b1099ce76b04e5d4d9ffb090"},{"bytes":3728,"media_type":"application/json","path":"results/Antfly/result_20261007_5860ab83575b4c3e9661a580136d1749_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"0d463dbef90dc2ecd94d8d7642f2295928e84cd61f98cc0d147da7e413120d98"},{"bytes":3723,"media_type":"application/json","path":"results/Antfly/result_20261007_7ec72172fa034163a3ed7cb3b7bb9d22_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"5a6a19ba93e68aea6fc16233a66af812d406ffaf489743af2800ded176351485"},{"bytes":3723,"media_type":"application/json","path":"results/Antfly/result_20261007_99eb6c2b3d804ee1906fb3afbd6cc48c_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"3f7713bc2e54e4cb022c163b39ef9d916dc5ca257cd46018beef78c9ab4eb0d0"},{"bytes":3722,"media_type":"application/json","path":"results/Antfly/result_20261007_ac9cc5d5b38b4998a3ec0932d2d16047_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"c9fd309215350a1ca336ee5784c3fee48fcefd526572281559a6a824f182dedf"},{"bytes":3728,"media_type":"application/json","path":"results/Antfly/result_20261007_b901483338d445c790a834d419f09117_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"2dfe059263e617bdb07563bf1873359bca1abbf393713f1055062924658c4f12"},{"bytes":3728,"media_type":"application/json","path":"results/Antfly/result_20261007_bca44ff262cf43d9b5f3e83fe6f3571b_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"1bdf0b48c49abc1af849e64e9ff560c9595c0027b1795bcc48dc9b731c019a3c"},{"bytes":3725,"media_type":"application/json","path":"results/Antfly/result_20261007_dbd6dc3d2a654ce48f0c9965df786954_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"970508eb1611c453bbf59b7d30dfa9089b5bade61a16671c4b92647b68c26339"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_f0a76c0fba0e46288e2ce81dc1a5299c_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"fcc1bb1fa786ee9e898a4c1fa3b2e72d84b88d6d55f9cf8e327a5672591abb32"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_fec35bf9db4448f0b9fa4afecfbcaf5a_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"1f54a2a8cef50d2cfc9a6552145f99aca38a8fdfe8eb5e1efea4077f50d10b14"},{"bytes":634,"media_type":"application/json","path":"results/publication-protocol.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"8a91260633bc8e26d26d7777e650c95756cbb7cf077fe5028077ef8461928692"},{"bytes":5647,"media_type":"application/json","path":"selected-config.json","retention":"evidence","role":"qualification","schema_version":1,"sha256":"83d8da4449798bcf7ccd895eaadcd7cf443fe15f5ad9441f482d2890633ad7aa"},{"bytes":3,"media_type":"application/json","path":"status.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570"},{"bytes":7006,"media_type":"application/json","path":"storage.json","retention":"evidence","role":"storage","schema_version":1,"sha256":"e22c7f006c5075c5df3a50e008167886caddb8e31c9b0fae44576b29a7e47d75"},{"bytes":885,"media_type":"application/json","path":"supervisor-result.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"c84ef01b296f832f22d5f8d4234f063e9afa83e97469cd1608a58e3a543ecdfc"}],"generated_at":"1791393436.1859303","kind":"publication-lifecycle","retained_bytes":872144,"schema_version":1},"status":"ok","storage":{"created_at":"2026-10-07T17:06:13.522183+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-fast-60k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-07T17:06:13.652954+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-07T17:06:13.652913+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-07T17:06:13.565105+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]},"final":{"allocated_bytes":249348096,"apparent_bytes":248622565,"completed_at":"2026-10-07T17:16:52.930108+00:00","samples":[{"allocated_bytes":249348096,"apparent_bytes":248622565,"captured_at":"2026-10-07T17:16:52.930081+00:00","entries":390,"volumes":[{"allocated_bytes":249348096,"apparent_bytes":248622565,"entries":390,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-07T17:16:52.830970+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-fast-60k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":249348096,"apparent_bytes":248622565,"entries":390,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]},"post_workload":{"allocated_bytes":249348096,"apparent_bytes":248621687,"completed_at":"2026-10-07T17:16:52.368939+00:00","samples":[{"allocated_bytes":249348096,"apparent_bytes":248621687,"captured_at":"2026-10-07T17:16:52.368908+00:00","entries":389,"volumes":[{"allocated_bytes":249348096,"apparent_bytes":248621687,"entries":389,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-07T17:16:52.267402+00:00","volumes":[{"allocated_bytes":249348096,"apparent_bytes":248621687,"entries":389,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-07T17:06:16.125814+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-07T17:06:16.125790+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-07T17:06:16.035428+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"name":"circus_vdbb_scale_t1_scale-fast-60k-antfly-data"}]},"protocol_fingerprint":"304fae3f58fdf0141e64c800e8dcefa834bde02450800919d75fe2bee35a0164","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-07T17:16:52.930111+00:00"},"trial":1,"vectors":60000,"workload_id":"scale-fast-60k"},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p475","ndcg":0.9959,"p95_ms":9.7,"p99_ms":10.9,"parameter":"search_effort","recall":0.9946,"status":"ok","value":0.475,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p375","ndcg":0.9433,"p95_ms":7.5,"p99_ms":8.4,"parameter":"search_effort","recall":0.9351,"status":"ok","value":0.375,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p8","ndcg":0.9971,"p95_ms":9.4,"p99_ms":10.7,"parameter":"search_effort","recall":0.9961,"status":"ok","value":0.8,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p55","ndcg":0.997,"p95_ms":8.9,"p99_ms":9.8,"parameter":"search_effort","recall":0.996,"status":"ok","value":0.55,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p45","ndcg":0.991,"p95_ms":8.4,"p99_ms":10.9,"parameter":"search_effort","recall":0.989,"status":"ok","value":0.45,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p35","ndcg":0.9123,"p95_ms":38.3,"p99_ms":55.3,"parameter":"search_effort","recall":0.9015,"status":"ok","value":0.35,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p7","ndcg":0.9971,"p95_ms":9.1,"p99_ms":9.9,"parameter":"search_effort","recall":0.9961,"status":"ok","value":0.7,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p4","ndcg":0.9652,"p95_ms":7.8,"p99_ms":8.6,"parameter":"search_effort","recall":0.9594,"status":"ok","value":0.4,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p6","ndcg":0.9971,"p95_ms":9.4,"p99_ms":10.6,"parameter":"search_effort","recall":0.9961,"status":"ok","value":0.6,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p425","ndcg":0.98,"p95_ms":8.2,"p99_ms":9.6,"parameter":"search_effort","recall":0.9764,"status":"ok","value":0.425,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-1","ndcg":0.9971,"p95_ms":11.6,"p99_ms":12.5,"parameter":"search_effort","recall":0.9961,"status":"ok","value":1,"workload":"scale-fast-80k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-80k-0p5","ndcg":0.9969,"p95_ms":8.9,"p99_ms":11.4,"parameter":"search_effort","recall":0.9959,"status":"ok","value":0.5,"workload":"scale-fast-80k"}],"cell_sha256":"8a50ad1669377bb5a38c37be2edb92feb7fbebd2ed36fbe06e1b119432cf5433","index_build":{"insert_duration":17.1292,"optimize_duration":8.0543,"seconds":25.183500000000002},"lifecycle":{"attempt":1,"elapsed_seconds":663.174,"finished_at":1791394099.7750978,"returncode":0,"started_at":1791393436.600652,"status":"ok","trial":1},"memory":{"anon_shmem_peak_mb":1912.3,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":2304.3,"cgroup_current_peak_mb":2302.9,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":1912.3,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":2302898176,"cgroup_kernel_peak_sum_bytes":2304323584,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":1912348672,"ended":1791394084.7164,"failed_samples":0,"first_sample_at":1791393440.0162761,"kind":"container_cgroup_v2","last_sample_at":1791394084.5149417,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":2050,"schema_version":3,"started":1791393439.9595969,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791393440.0162761,"index_started_at":1791393440.1418748,"last_sample_at":1791394084.5149417,"max_sample_gap_s":0.858,"publication_finished_at":1791394084.368711,"sampler_ended_at":1791394084.7164,"sampler_started_at":1791393439.9595969,"samples":2050,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"profile":"fast","publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.006134187805243522,0.006733386289787863,0.009255861558430787,0.019335377537476755,0.029202407255419546],"conc_latency_p95_list":[0.0082256434019655,0.008703146409243346,0.01372635130683193,0.03367236576741561,0.053353467134002096],"conc_latency_p99_list":[0.01091935547767205,0.010600490074139095,0.016935507122252596,0.04241576904023533,0.06724793516157661],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[162.7531,741.0482,1077.3348,1025.9766,1018.8384],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9625,"optimize_duration":0,"p99_c30_ms":67.2479351615766,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":10,"peak_qps":1077.3348,"qps":1077.3348,"qps_c30":1018.8384,"recall":0.9575,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0083,"serial_latency_p99":0.0115,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"selection_status":"superseded","serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":17.1,"load_s":25.2,"source_label":"antfly-qualification-scale-fast-80k-0p35"},"ndcg":0.9652,"p95_ms":7.8,"p99_ms":8.6,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9594,"selection_mode":"swept","value":0.4},"source":{"cache_key":"6f98d012b1c5761ce1c56754f4836c1f2e6edd12717989e97093f4de4b756f00","finished_at":1791394099.7750978,"object_sha256":"776f56bea3eecf451ab6d2516a6139c66ad7db75205d2c03a89367234ff98656","receipt_sha256":"f57be5a4f96ba5b4dd11dafc63f1e3b3d11fd03518f5023ba97469d97e521401","started_at":1791393436.600652},"source_receipt":{"benchmark_id":"vector-vdbbench-scale","files":[{"bytes":12522,"media_type":"application/json","path":"cell-result.json","retention":"evidence","role":"normalized-result","schema_version":1,"sha256":"8a50ad1669377bb5a38c37be2edb92feb7fbebd2ed36fbe06e1b119432cf5433"},{"bytes":8268,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-80k-0p35.log","retention":"evidence","role":"log","schema_version":null,"sha256":"19324f3f8fc48680321626f3a35d36f99dc3cff077be5e7615fc2229f1c4c733"},{"bytes":9336,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-80k-0p35_load.log","retention":"evidence","role":"log","schema_version":null,"sha256":"231666f4e02ce40201218747cb72ccac3c7a737db0939093da2807ec4c7a8ed5"},{"bytes":8275,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-80k-0p375.log","retention":"evidence","role":"log","schema_version":null,"sha256":"37a0d085ecfe0e503a418a698f82b7c5598828fb7562283ac8ab6cb8e649aab5"},{"bytes":8260,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-80k-0p4.log","retention":"evidence","role":"log","schema_version":null,"sha256":"2d0b5944be5a53272b1e1f034aacc933f7eb7c390179228ab2b0f6a3bafbf9f5"},{"bytes":8270,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-80k-0p425.log","retention":"evidence","role":"log","schema_version":null,"sha256":"88c74c8ba0fdfb7556523f586be70e90d2f51cb613a875f2f4a0d40e690abf09"},{"bytes":8261,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-80k-0p45.log","retention":"evidence","role":"log","schema_version":null,"sha256":"a5537caf34a023c08b9dd5c107dbb77ac36577a64523c633ca7e19c63bd9e19b"},{"bytes":8276,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-80k-0p475.log","retention":"evidence","role":"log","schema_version":null,"sha256":"94733a87e266346cfbfd1411482e3e7d36fc7849edafddf266e0de575414501b"},{"bytes":8260,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-80k-0p5.log","retention":"evidence","role":"log","schema_version":null,"sha256":"f455c79f7c38bd0b5138f84518076c8fb3cfd8dd343b8f0c4216835ec5677d8e"},{"bytes":8262,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-80k-0p55.log","retention":"evidence","role":"log","schema_version":null,"sha256":"839d43a5a7c63165b33c2130005fc1132a741dfd5603c4698933e1e9c739605f"},{"bytes":8260,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-80k-0p6.log","retention":"evidence","role":"log","schema_version":null,"sha256":"f2fa0cdf163fc2f92e1c4f90bb4f1949c6470014df47b651fdfdecc7761cc4e0"},{"bytes":8260,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-80k-0p7.log","retention":"evidence","role":"log","schema_version":null,"sha256":"80c7b84b48b251249d8b382142b7ef35375dd9571cecaba4c161c2c585c7797b"},{"bytes":8260,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-80k-0p8.log","retention":"evidence","role":"log","schema_version":null,"sha256":"6b601456de0dae5bb82e0cd2189aa0280ea1e06c45901356e9309d54156818e1"},{"bytes":8244,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-80k-1.log","retention":"evidence","role":"log","schema_version":null,"sha256":"8843944c556e329afa944ce44913cfc5b043d3e1ef3419f002b1462c47c5ea6f"},{"bytes":23391,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"ad579e42e149a4625fe3cfcd85f0ee937fc60a4fb35a88ebfede81427898cc25"},{"bytes":984,"media_type":"application/json","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.json","retention":"evidence","role":"log","schema_version":1,"sha256":"d64d98264b7458742f04880cc329526563eba8a197f440f68c02de7e1ba7feb5"},{"bytes":527974,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.jsonl","retention":"evidence","role":"memory-timeline","schema_version":null,"sha256":"abef257af8c572116d355c1af78ea81eecdbb68df71094da7bc4c991eaed60c4"},{"bytes":0,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"},{"bytes":137055,"media_type":"application/octet-stream","path":"logs/supervisor.log","retention":"evidence","role":"log","schema_version":null,"sha256":"07ae26532369c2032105580d6f1d954b0fb5410593e7c68d5e687dcfe83aa6cc"},{"bytes":2582,"media_type":"application/json","path":"memory.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"dc8dd106721430094eba8aeea2cb1f4efb573b20f54511c28a19f7b945d1ddde"},{"bytes":87,"media_type":"application/json","path":"quiet-host.json","retention":"evidence","role":"quiet-host","schema_version":1,"sha256":"b6fd71707081f58326be630e9872b9fbf258639be433d6e87cff9e4021ea5bd2"},{"bytes":3728,"media_type":"application/json","path":"results/Antfly/result_20261007_0b59937f339b4b2783ca241d6e60c4fa_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"9dbe80e6ddb01e6aabde74e45d93e899396e0e75e548f0a03946a61d71df0986"},{"bytes":4418,"media_type":"application/json","path":"results/Antfly/result_20261007_0e269fd7747143dc91f95bf8d0faff35_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"064fb1c37acc8fe9af5282f497ff1044407c3cadcd4f9850f14a419defbf447b"},{"bytes":3728,"media_type":"application/json","path":"results/Antfly/result_20261007_42bf8f0499fe4823abd81e9ec2a3d7f2_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"936af6127e661d78c7bd56057089aa46f093896f533e6b5cf7a7921bb706fff9"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_52e0cb76a154480296e9d50e57c6dee2_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"7d5b3d7681b18ff2bd7cd1beccbd26ab635e852d9165016fd9330776e2def4ea"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_5ad291eb5441434f88add00544b00076_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"3a802bb1a21faa4789cc0807cd304df4a8f5c0c4da66d01697dc1324b826d431"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_6dadd2923cf04e35bf173d7c500558a4_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"43ba29d078e477f593a6651b04b7f4cb27226d34b6e0d34cdeb5459e86a8c479"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_71809cdfbb22494f99e6938f4b304c16_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"ef092fae84523038f230b8f24a18279a31d0e2e0631ff98d16780196371ec546"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_934ec4bd2db343af9a315b93a01259a4_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"b81dd16998174135446632704e9eae8b1794531c18178e4b5288c09b0a7a3ab0"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_aca334efdfc543bcabd3cbe48b87ff0f_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"a429aff722c38ce85a678fa78e0c5df6fc61a521e28c0f35e9fae8b8094ce4fa"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_b459c43da83a4f0b9d2e11425490a7f6_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"48045615493376672fe0139d3db7dce00e8f0450a8fc46d95465715ffa3343a4"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_b7b5cb82f716466e86c1189ee4039740_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"35801642821a48d3a403d10e0485fdd3f67e852bdbb9d5a9b7e9efe52fbb9603"},{"bytes":3326,"media_type":"application/json","path":"results/Antfly/result_20261007_b7e877c3c7784f3ca0d71931a61f82ae_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"46f7828dbc2e14362a7f3d123085979892fceef94a64c58a4fca2bed7f05f918"},{"bytes":3722,"media_type":"application/json","path":"results/Antfly/result_20261007_d815fe8ce77b4be8a71673e6bac058dc_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"eac7c56709afadf46fa7ce80a68e4317ef6a511d4aaa7a14d92ea8a2bf4e1e70"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_f4f4aaf63704481491222d7189bba828_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"485d87bca4ccf54a311b0860f9f673200382a478a3b243255a0f34896efe960a"},{"bytes":634,"media_type":"application/json","path":"results/publication-protocol.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"8a91260633bc8e26d26d7777e650c95756cbb7cf077fe5028077ef8461928692"},{"bytes":5648,"media_type":"application/json","path":"selected-config.json","retention":"evidence","role":"qualification","schema_version":1,"sha256":"9418baf556417e53574dbaaac096225348e26c19b589b37e2b68bc42053c75cf"},{"bytes":3,"media_type":"application/json","path":"status.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570"},{"bytes":7006,"media_type":"application/json","path":"storage.json","retention":"evidence","role":"storage","schema_version":1,"sha256":"4cb6a4c86b51ebeceabb560de950b6ebbbd7ffae5b9eb9f53f17d787f292dc3a"},{"bytes":884,"media_type":"application/json","path":"supervisor-result.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"d859c5202d6d32892c391ffa6c50d97414ed2618c42c198d7392f06669c1f0c4"}],"generated_at":"1791394099.7750978","kind":"publication-lifecycle","retained_bytes":879704,"schema_version":1},"status":"ok","storage":{"created_at":"2026-10-07T17:17:17.270072+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-fast-80k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-07T17:17:17.398104+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-07T17:17:17.398075+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-07T17:17:17.311634+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]},"final":{"allocated_bytes":330293248,"apparent_bytes":329577370,"completed_at":"2026-10-07T17:28:05.459545+00:00","samples":[{"allocated_bytes":330293248,"apparent_bytes":329577370,"captured_at":"2026-10-07T17:28:05.459519+00:00","entries":392,"volumes":[{"allocated_bytes":330293248,"apparent_bytes":329577370,"entries":392,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-07T17:28:05.380540+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-fast-80k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":330293248,"apparent_bytes":329577370,"entries":392,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]},"post_workload":{"allocated_bytes":330289152,"apparent_bytes":329575548,"completed_at":"2026-10-07T17:28:04.953810+00:00","samples":[{"allocated_bytes":330289152,"apparent_bytes":329575548,"captured_at":"2026-10-07T17:28:04.953782+00:00","entries":390,"volumes":[{"allocated_bytes":330289152,"apparent_bytes":329575548,"entries":390,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-07T17:28:04.853705+00:00","volumes":[{"allocated_bytes":330289152,"apparent_bytes":329575548,"entries":390,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-07T17:17:19.875432+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-07T17:17:19.875407+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-07T17:17:19.778329+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"name":"circus_vdbb_scale_t1_scale-fast-80k-antfly-data"}]},"protocol_fingerprint":"2fa14fec9f6afb33a807e12785dd75274aaa92bf7e83fc257a09b893b73e9711","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-07T17:28:05.459548+00:00"},"trial":1,"vectors":80000,"workload_id":"scale-fast-80k"},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p425","ndcg":0.9815,"p95_ms":9,"p99_ms":9.8,"parameter":"search_effort","recall":0.9783,"status":"ok","value":0.425,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p4","ndcg":0.9652,"p95_ms":8.4,"p99_ms":9.2,"parameter":"search_effort","recall":0.9596,"status":"ok","value":0.4,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p6","ndcg":0.9969,"p95_ms":9.8,"p99_ms":11,"parameter":"search_effort","recall":0.9958,"status":"ok","value":0.6,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p45","ndcg":0.9911,"p95_ms":8.9,"p99_ms":10.6,"parameter":"search_effort","recall":0.9895,"status":"ok","value":0.45,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-1","ndcg":0.9969,"p95_ms":13.4,"p99_ms":15.5,"parameter":"search_effort","recall":0.9959,"status":"ok","value":1,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p375","ndcg":0.9447,"p95_ms":8.2,"p99_ms":9.7,"parameter":"search_effort","recall":0.9374,"status":"ok","value":0.375,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p35","ndcg":0.9164,"p95_ms":44.4,"p99_ms":58.3,"parameter":"search_effort","recall":0.9066,"status":"ok","value":0.35,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p8","ndcg":0.9969,"p95_ms":10,"p99_ms":11.2,"parameter":"search_effort","recall":0.9959,"status":"ok","value":0.8,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p475","ndcg":0.9956,"p95_ms":9.4,"p99_ms":10.3,"parameter":"search_effort","recall":0.9942,"status":"ok","value":0.475,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p7","ndcg":0.9969,"p95_ms":9.6,"p99_ms":10.8,"parameter":"search_effort","recall":0.9959,"status":"ok","value":0.7,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p55","ndcg":0.9968,"p95_ms":9.4,"p99_ms":10.4,"parameter":"search_effort","recall":0.9958,"status":"ok","value":0.55,"workload":"scale-fast-100k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-fast-100k-0p5","ndcg":0.9968,"p95_ms":9.9,"p99_ms":10.8,"parameter":"search_effort","recall":0.9957,"status":"ok","value":0.5,"workload":"scale-fast-100k"}],"cell_sha256":"648f7c2d1363a923fda4c62ff06d7df317f60a7922f81b94c9db3a8bfc83f695","index_build":{"insert_duration":21.6147,"optimize_duration":8.0535,"seconds":29.6682},"lifecycle":{"attempt":1,"elapsed_seconds":693.284,"finished_at":1791394793.4761393,"returncode":0,"started_at":1791394100.1923747,"status":"ok","trial":1},"memory":{"anon_shmem_peak_mb":1664.4,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":2128.1,"cgroup_current_peak_mb":2127.3,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":1664.4,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":2127331328,"cgroup_kernel_peak_sum_bytes":2128113664,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":1664430080,"ended":1791394753.1582177,"failed_samples":0,"first_sample_at":1791394103.6462748,"kind":"container_cgroup_v2","last_sample_at":1791394752.9513495,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":2056,"schema_version":3,"started":1791394103.5894787,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791394103.6462748,"index_started_at":1791394103.771547,"last_sample_at":1791394752.9513495,"max_sample_gap_s":0.748,"publication_finished_at":1791394752.8230686,"sampler_ended_at":1791394753.1582177,"sampler_started_at":1791394103.5894787,"samples":2056,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"profile":"fast","publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.006574967972234785,0.007057986870306607,0.009477089852210794,0.018906990398224275,0.029746895001605326],"conc_latency_p95_list":[0.009096376624074764,0.009119970814208499,0.014042564478586421,0.03265504084702116,0.054395028410363],"conc_latency_p99_list":[0.014224948930204859,0.011261997514811812,0.01717294850590406,0.041497003677068274,0.0716167918645079],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[151.8348,706.999,1051.898,1052.3701,1001.2801],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9629,"optimize_duration":0,"p99_c30_ms":71.61679186450789,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":20,"peak_qps":1052.3701,"qps":1052.3701,"qps_c30":1001.2801,"recall":0.9579,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0078,"serial_latency_p99":0.0105,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"selection_status":"superseded","serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":21.6,"load_s":29.7,"source_label":"antfly-qualification-scale-fast-100k-0p35"},"ndcg":0.9652,"p95_ms":8.4,"p99_ms":9.2,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9596,"selection_mode":"swept","value":0.4},"source":{"cache_key":"589936f94a64672406de34b07e4b04657b02372e5d3bf16170e4af51a8011e64","finished_at":1791394793.4761393,"object_sha256":"752ed3c50b1fb5f0acf2db8a2d09e3b01d35eb6e7412f9daa3423392fdff7bd6","receipt_sha256":"58a2c9d649b35a6a59d22bab9d80fc009a7bc094497447feba4f24b4e5cc9bfd","started_at":1791394100.1923747},"source_receipt":{"benchmark_id":"vector-vdbbench-scale","files":[{"bytes":12529,"media_type":"application/json","path":"cell-result.json","retention":"evidence","role":"normalized-result","schema_version":1,"sha256":"648f7c2d1363a923fda4c62ff06d7df317f60a7922f81b94c9db3a8bfc83f695"},{"bytes":8307,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-100k-0p35.log","retention":"evidence","role":"log","schema_version":null,"sha256":"a79fdb8456af63595f7d04f4cc8b6c78fbb8b2ffc17e55e66dc87ea727606500"},{"bytes":9366,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-100k-0p35_load.log","retention":"evidence","role":"log","schema_version":null,"sha256":"dca0aed118221d44d3b73d6196bb919ef6052ff41d24d30618e014a4ab1fc5bf"},{"bytes":8315,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-100k-0p375.log","retention":"evidence","role":"log","schema_version":null,"sha256":"20bf1fdb651905b2d94cec10141505569ede156e4ef0bf046e62cc029fdec3ee"},{"bytes":8299,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-100k-0p4.log","retention":"evidence","role":"log","schema_version":null,"sha256":"a723652294863d619bda774e53a10d6db6b01425afecb1615ffc2e4eb4bde689"},{"bytes":8311,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-100k-0p425.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e6dec6b3d1d3c6c21e8ddfdf8e0bc06996f0fa065a1962f7d017c0a47eaf188e"},{"bytes":8307,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-100k-0p45.log","retention":"evidence","role":"log","schema_version":null,"sha256":"5accbdf820dd541c92cf9e9715b82db4942aef49f3b27c02fb90b5e6ef214297"},{"bytes":8315,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-100k-0p475.log","retention":"evidence","role":"log","schema_version":null,"sha256":"6bbaf2b156dbcbd6de159da5729245180e877dd810df23555d8fcf5387d55756"},{"bytes":8298,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-100k-0p5.log","retention":"evidence","role":"log","schema_version":null,"sha256":"5935137eee4f8fe37326b51f6c5678d06933ee5039427d3de263b58325bfc70a"},{"bytes":8306,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-100k-0p55.log","retention":"evidence","role":"log","schema_version":null,"sha256":"652df425d1b20b814900a8266464b04d895e03258547e37c819099e65e0e3e4a"},{"bytes":8296,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-100k-0p6.log","retention":"evidence","role":"log","schema_version":null,"sha256":"93dba6f68ff8abb770b3378e513e0fc15079ae077821dc54837ca80068e968b6"},{"bytes":8298,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-100k-0p7.log","retention":"evidence","role":"log","schema_version":null,"sha256":"9f5ebeff2aabf8dfa564d6abbdd7cfa152d5ad5fef6f53dff35c9eb3f82d23f0"},{"bytes":8293,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-100k-0p8.log","retention":"evidence","role":"log","schema_version":null,"sha256":"2d2c1ebd0860e492c08f083b340a5851a9e63c5a820c2295889a32e36adb1721"},{"bytes":8284,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-fast-100k-1.log","retention":"evidence","role":"log","schema_version":null,"sha256":"7a999eb0b15250ee6da56e4489e5de1acc5cdeae350825b3b38dc16d3a4b275e"},{"bytes":23633,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"b51f6724f1ceb6a5db2f88c82fea5bed4068f7f97eca731eee3afaaff1bb518c"},{"bytes":988,"media_type":"application/json","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.json","retention":"evidence","role":"log","schema_version":1,"sha256":"122505e3c1557f903b3eb1e45bfbbc3879a0c7ea716862e63b23683adf2c87e2"},{"bytes":532052,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.jsonl","retention":"evidence","role":"memory-timeline","schema_version":null,"sha256":"cb31743b574bbaa56698d63aacf65e69d9470c710a76333a04c3cd23b3d241eb"},{"bytes":0,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"},{"bytes":137827,"media_type":"application/octet-stream","path":"logs/supervisor.log","retention":"evidence","role":"log","schema_version":null,"sha256":"942988e89b48e5c888d1cf8d401452b30237c360ed46cdefa276804f2643ee4b"},{"bytes":2588,"media_type":"application/json","path":"memory.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"8c81d69739bc779b5a117bae806464e9fe7f335ac6c0e5a6a036658d238701c5"},{"bytes":87,"media_type":"application/json","path":"quiet-host.json","retention":"evidence","role":"quiet-host","schema_version":1,"sha256":"b6fd71707081f58326be630e9872b9fbf258639be433d6e87cff9e4021ea5bd2"},{"bytes":3732,"media_type":"application/json","path":"results/Antfly/result_20261007_0ffa7948294e4508815ea389ae0f2f98_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"dfad9007365038f3313c4121507ac225710b7a9174a8080a3fc8e2caf833e25c"},{"bytes":3729,"media_type":"application/json","path":"results/Antfly/result_20261007_15eb16b611a44f178c225c106a84491b_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"3e2c2e174084a9b371e6be63d3a71dbab7f2cbcc28fbcb8bf6e18fd7bcdf857b"},{"bytes":3728,"media_type":"application/json","path":"results/Antfly/result_20261007_17e2273acb5a4dd2a7ff0e7f9b4be3ef_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"270cc73d3807eafc34647fa2d1ac0e67754630188a95945b2a27bc60f4fc9bd7"},{"bytes":4420,"media_type":"application/json","path":"results/Antfly/result_20261007_2219c94b9f9b4a07b7f1225204096964_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"1753073effe391f63085f3f46f8ff0e8890bef879602bd7efe8a9f1bcd4a15db"},{"bytes":3731,"media_type":"application/json","path":"results/Antfly/result_20261007_28cfa98f96d648529de99ef61a08819c_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"925c7013aa033d23be878d315825b95797d97c8b13b235698c3913bd575021e0"},{"bytes":3727,"media_type":"application/json","path":"results/Antfly/result_20261007_3bc0aa0763cb499babb1cc6c2586c5b3_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"77f495c5ce75f195cdcfb9e5d15778d8f184ab85b906c83877141f109ecb81cc"},{"bytes":3733,"media_type":"application/json","path":"results/Antfly/result_20261007_4d2eadbd3c944794bd35960302fef743_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"fac73a635ea3d04e511f235b4e39961152e96876a6a2f2eae2083f02b2003208"},{"bytes":3731,"media_type":"application/json","path":"results/Antfly/result_20261007_5e2ce2ad62af4390a1cfff82374b0e69_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"83a1fdce98dccf34ec5f28e1d5d3699d260e74035fda8582097453f10f1c995b"},{"bytes":3332,"media_type":"application/json","path":"results/Antfly/result_20261007_6fa36dde49914f9e961e12df4fd0fd43_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"44a01144ff621e0b6e7892503f461418b631ecc2636ae8bad2fd7fd1d55e05da"},{"bytes":3727,"media_type":"application/json","path":"results/Antfly/result_20261007_79bd92d4f5054d89a5987e21f3fe5e62_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"9912a5261c040858dfa630b56070129111882ef9f8de60b9b079e4a44e155140"},{"bytes":3733,"media_type":"application/json","path":"results/Antfly/result_20261007_7cd941751f464b039bc271b5f26d9585_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"dd749f9adb3f2f8de7ead933622858c206fc7c69152aa7ec9b34a0235c9e5173"},{"bytes":3729,"media_type":"application/json","path":"results/Antfly/result_20261007_801cb76b16f246bbbbab16708ab7012a_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"0f70fbffeda4b743dd7d088c9b6e0d74bf342a1f522f433c93014695f6286317"},{"bytes":3731,"media_type":"application/json","path":"results/Antfly/result_20261007_8c60e2c37b0a44f1b501a81ef4d59344_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"51b929a16b2e9699a0fd2f82e5b82264b60be21407ae3fb0e87f8248e260edde"},{"bytes":3729,"media_type":"application/json","path":"results/Antfly/result_20261007_aa8f3e2496554a819ebc87aa7e226294_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"2b1848f3f8cb954553810cdf171cf8a574040ba665c0ea597b8dfe1d0ce24274"},{"bytes":634,"media_type":"application/json","path":"results/publication-protocol.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"8a91260633bc8e26d26d7777e650c95756cbb7cf077fe5028077ef8461928692"},{"bytes":5685,"media_type":"application/json","path":"selected-config.json","retention":"evidence","role":"qualification","schema_version":1,"sha256":"b598f71d616b4901721611baeaf6e2cf228d1daec4d05d52bcf1b923ab5ccd49"},{"bytes":3,"media_type":"application/json","path":"status.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570"},{"bytes":7017,"media_type":"application/json","path":"storage.json","retention":"evidence","role":"storage","schema_version":1,"sha256":"a76f5702a6ba520d31dbbdb5253be92004c5d4db67aa0b4a5d1e1963402ecec4"},{"bytes":888,"media_type":"application/json","path":"supervisor-result.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"770e0cbae4d0b6d61776f11fa61dad83d9146e3726b99da850fb0d4267bf89f1"}],"generated_at":"1791394793.4761393","kind":"publication-lifecycle","retained_bytes":885438,"schema_version":1},"status":"ok","storage":{"created_at":"2026-10-07T17:28:20.901234+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-fast-100k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-07T17:28:21.030830+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-07T17:28:21.030807+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-07T17:28:20.949893+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]},"final":{"allocated_bytes":414031872,"apparent_bytes":413336902,"completed_at":"2026-10-07T17:39:13.950034+00:00","samples":[{"allocated_bytes":414031872,"apparent_bytes":413336902,"captured_at":"2026-10-07T17:39:13.950007+00:00","entries":393,"volumes":[{"allocated_bytes":414031872,"apparent_bytes":413336902,"entries":393,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-07T17:39:13.829940+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-fast-100k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":414031872,"apparent_bytes":413336902,"entries":393,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]},"post_workload":{"allocated_bytes":414027776,"apparent_bytes":413335078,"completed_at":"2026-10-07T17:39:13.369876+00:00","samples":[{"allocated_bytes":414027776,"apparent_bytes":413335078,"captured_at":"2026-10-07T17:39:13.369852+00:00","entries":391,"volumes":[{"allocated_bytes":414027776,"apparent_bytes":413335078,"entries":391,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-07T17:39:13.272636+00:00","volumes":[{"allocated_bytes":414027776,"apparent_bytes":413335078,"entries":391,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-07T17:28:23.505323+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-07T17:28:23.505263+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-07T17:28:23.402783+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"name":"circus_vdbb_scale_t1_scale-fast-100k-antfly-data"}]},"protocol_fingerprint":"a260d1a8843fac5e960f86b7b99054180f28c9b182503a4ca98d05531ad6fe3e","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-07T17:39:13.950037+00:00"},"trial":1,"vectors":100000,"workload_id":"scale-fast-100k"},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p45","ndcg":0.9937,"p95_ms":11.3,"p99_ms":13.9,"parameter":"search_effort","recall":0.9922,"status":"ok","value":0.45,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p5","ndcg":0.9969,"p95_ms":12.6,"p99_ms":13.7,"parameter":"search_effort","recall":0.9959,"status":"ok","value":0.5,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p55","ndcg":0.9969,"p95_ms":12.1,"p99_ms":13.3,"parameter":"search_effort","recall":0.9959,"status":"ok","value":0.55,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p8","ndcg":0.9969,"p95_ms":13.3,"p99_ms":15.7,"parameter":"search_effort","recall":0.9959,"status":"ok","value":0.8,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p425","ndcg":0.9874,"p95_ms":11.8,"p99_ms":14.2,"parameter":"search_effort","recall":0.9849,"status":"ok","value":0.425,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p7","ndcg":0.9969,"p95_ms":12.5,"p99_ms":13.3,"parameter":"search_effort","recall":0.9959,"status":"ok","value":0.7,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-1","ndcg":0.9969,"p95_ms":17.4,"p99_ms":18.8,"parameter":"search_effort","recall":0.9959,"status":"ok","value":1,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p4","ndcg":0.9774,"p95_ms":11.8,"p99_ms":14.4,"parameter":"search_effort","recall":0.9739,"status":"ok","value":0.4,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p35","ndcg":0.9417,"p95_ms":69.9,"p99_ms":100.3,"parameter":"search_effort","recall":0.9338,"status":"ok","value":0.35,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p6","ndcg":0.9969,"p95_ms":12.4,"p99_ms":13.9,"parameter":"search_effort","recall":0.9959,"status":"ok","value":0.6,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p375","ndcg":0.9634,"p95_ms":11.7,"p99_ms":19.6,"parameter":"search_effort","recall":0.9579,"status":"ok","value":0.375,"workload":"scale-big-200k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-200k-0p475","ndcg":0.9962,"p95_ms":12.1,"p99_ms":12.7,"parameter":"search_effort","recall":0.9952,"status":"ok","value":0.475,"workload":"scale-big-200k"}],"cell_sha256":"a10d36337cf3181c2e9201d2f4675f4a8d299db25a34e38e50db8080615fed50","index_build":{"insert_duration":47.9387,"optimize_duration":14.0556,"seconds":61.994299999999996},"lifecycle":{"attempt":1,"elapsed_seconds":723.877,"finished_at":1791395517.7772086,"returncode":0,"started_at":1791394793.8997998,"status":"ok","trial":1},"memory":{"anon_shmem_peak_mb":1811.2,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":2697.3,"cgroup_current_peak_mb":2696.2,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":1811.2,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":2696159232,"cgroup_kernel_peak_sum_bytes":2697293824,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":1811238912,"ended":1791395486.477663,"failed_samples":0,"first_sample_at":1791394797.3035111,"kind":"container_cgroup_v2","last_sample_at":1791395486.272483,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":2170,"schema_version":3,"started":1791394797.2739418,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791394797.3035111,"index_started_at":1791394797.3291538,"last_sample_at":1791395486.272483,"max_sample_gap_s":0.945,"publication_finished_at":1791395486.231683,"sampler_ended_at":1791395486.477663,"sampler_started_at":1791394797.2739418,"samples":2170,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"profile":"big","publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.007340562573457144,0.007159717428059283,0.009904851759834271,0.01977549033902413,0.03020140743153502],"conc_latency_p95_list":[0.012973360586329355,0.009186722000595176,0.015138027853390667,0.03435564960236661,0.05447942373575643],"conc_latency_p99_list":[0.020117259152466364,0.011619443156523631,0.01887668363313424,0.044158187004504766,0.06976977846497903],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[135.9996,696.6977,1006.0772,1005.373,985.1461],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9605,"optimize_duration":0,"p99_c30_ms":69.76977846497903,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":10,"peak_qps":1006.0772,"qps":1006.0772,"qps_c30":985.1461,"recall":0.9547,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0096,"serial_latency_p99":0.0147,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"selection_status":"superseded","serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":47.9,"load_s":62,"source_label":"antfly-qualification-scale-big-200k-0p35"},"ndcg":0.9634,"p95_ms":11.7,"p99_ms":19.6,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9579,"selection_mode":"swept","value":0.375},"source":{"cache_key":"88c31dc495287e0b2a2afac263c0b585fee6a527da89e8e7b58df833dc354d35","finished_at":1791395517.7772086,"object_sha256":"b85f8ed9a4d7097fcee66fba57a1315c766b56b93b27fc69ff310da141c5860a","receipt_sha256":"058c2b58e7784f38499d9b630466514bb1d8c277a474329c60878f4ea242d449","started_at":1791394793.8997998},"source_receipt":{"benchmark_id":"vector-vdbbench-scale","files":[{"bytes":12527,"media_type":"application/json","path":"cell-result.json","retention":"evidence","role":"normalized-result","schema_version":1,"sha256":"a10d36337cf3181c2e9201d2f4675f4a8d299db25a34e38e50db8080615fed50"},{"bytes":8291,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-200k-0p35.log","retention":"evidence","role":"log","schema_version":null,"sha256":"945f2aeb8e96611e9b82dd9e70c15e9d59c34cfa73d08843cb9728abc2f2345c"},{"bytes":9379,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-200k-0p35_load.log","retention":"evidence","role":"log","schema_version":null,"sha256":"9beeee73c86b6bf90c2486b774b2d318ab3beb4b41a963e7501b1fb0e217712c"},{"bytes":8300,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-200k-0p375.log","retention":"evidence","role":"log","schema_version":null,"sha256":"b681da64adf5a435b83e3a31f7be7739f311be2aa6304ea0f7839d535931b829"},{"bytes":8284,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-200k-0p4.log","retention":"evidence","role":"log","schema_version":null,"sha256":"70e3feaf3dcf625015e51f73ec346197ac7d3d24e85bac954b5252e9706126a8"},{"bytes":8300,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-200k-0p425.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e05b725b8a3833a961f4e250939a5a2f465efd782261476bc281111759038618"},{"bytes":8292,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-200k-0p45.log","retention":"evidence","role":"log","schema_version":null,"sha256":"4119a860eeab168048d6306a8f0d0a58ab4c1c4fbc7ef86d96974cbd1e27631c"},{"bytes":8300,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-200k-0p475.log","retention":"evidence","role":"log","schema_version":null,"sha256":"c656126e76618c5d1fde64fda67c022c57efd4b4475b166516320bf111f13c7e"},{"bytes":8282,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-200k-0p5.log","retention":"evidence","role":"log","schema_version":null,"sha256":"68dd48e60748f25c5660c77028d485ab69e7dab9f112195f0a4861da9d54fa17"},{"bytes":8290,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-200k-0p55.log","retention":"evidence","role":"log","schema_version":null,"sha256":"a253d654c15025f78fd1e6fbdededa7f08c689105ece82f9160bd2ad41f5d3ed"},{"bytes":8284,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-200k-0p6.log","retention":"evidence","role":"log","schema_version":null,"sha256":"33b43ea4a5b10a7597a280a1a7c50cb2e228ac3442130989e755badd10a846e7"},{"bytes":8284,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-200k-0p7.log","retention":"evidence","role":"log","schema_version":null,"sha256":"9898e5d701c7d134a1103528a453391259be18b50c3dc70ae24bd65681a9a5a2"},{"bytes":8283,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-200k-0p8.log","retention":"evidence","role":"log","schema_version":null,"sha256":"2989e64804df6fdb6404603d7147c4cc730a4db9732e2876d14a1158b156a405"},{"bytes":8270,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-200k-1.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e20231c4913b4efe75fc515384b2c938314fbd83aa399dc9e4875c627edf0465"},{"bytes":23472,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"cb1256183e2b16c9cbaf54afe80875d4f1c87f445b54cd619c63927558b30dc3"},{"bytes":985,"media_type":"application/json","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.json","retention":"evidence","role":"log","schema_version":1,"sha256":"e3c198f77472a7d48e01413c355109286312f3c9dac1b4205b021b082c63bde4"},{"bytes":561828,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.jsonl","retention":"evidence","role":"memory-timeline","schema_version":null,"sha256":"6ec59944b100ca235bfa334c44b9df0e4593c2bed335cabb066a932bd6c4d6ae"},{"bytes":0,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"},{"bytes":137483,"media_type":"application/octet-stream","path":"logs/supervisor.log","retention":"evidence","role":"log","schema_version":null,"sha256":"4560535583d6bd6ddde395b20ace74481786490aa71d809a05689aef13ab39d9"},{"bytes":2583,"media_type":"application/json","path":"memory.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"b93987dfc752b2b3a3fb18bca26bca29c1c2acd38c52cad1b344ddf7882b1c89"},{"bytes":87,"media_type":"application/json","path":"quiet-host.json","retention":"evidence","role":"quiet-host","schema_version":1,"sha256":"b6fd71707081f58326be630e9872b9fbf258639be433d6e87cff9e4021ea5bd2"},{"bytes":4421,"media_type":"application/json","path":"results/Antfly/result_20261007_009733a32d7d4c11b214bbf35a0a9b2a_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"4d2c7dc3adbefb4cfbc667adeb0c536f1b73a99cd21c8ee7c1b8173ba7151f8b"},{"bytes":3728,"media_type":"application/json","path":"results/Antfly/result_20261007_031f6d980e9e4a0f82af760e62f2f116_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"0dd383a4ef6021982aa8aebce22bc2b46114a52eb503fa9288d14ee382df3501"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_0520e36ef5f5406ea70aaf9a22a80ab8_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"351572ec6d03d57edc5fdc2667490630a4531c50c907cddb065a7d0840dd7632"},{"bytes":3728,"media_type":"application/json","path":"results/Antfly/result_20261007_416bd00735fa46e8b5f462e98a112038_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"3e53982fe5b126b97bb4015db86d76c97ac87786739619f585171cd61ab57959"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_56df85e769f84d4fbb3f04d3293308b0_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"a94fe1346f59d85b1674f128708565198ab67fdf53d2a3e65364068c40d6b3d1"},{"bytes":3330,"media_type":"application/json","path":"results/Antfly/result_20261007_5b55d412267b47fe8c8b75cafdf6d7dd_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"d73bfd0167139bd2e45c9dda8d8fe411f7f4c5c960debb975f969f17fbc5e303"},{"bytes":3730,"media_type":"application/json","path":"results/Antfly/result_20261007_63a050f60c6649f9adaf7f2fe470b7c2_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"b3c8392fd73e5fae64dfba335cfd2e31c58dd5e06fef779e5109e03a7568fe19"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_7d716f7baa4f45b3a8926a83981c2ba1_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"3a16aebd479f241fcbddc8ca957a785460d8ddfe5e1d3a4be57e6be5198e0bb7"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_9b4389f03a9146cabe34f15e92a70d1a_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"86f76ca8ca7239b32792c4a146b70ecd0ab9632139c64a115404af0b2352bd48"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_a84d8428212545e58ddbab488988446e_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"0e9fde5981c559263a90470f2d9a8a95a7ac92a7a6f2cad8661b78df874646e1"},{"bytes":3728,"media_type":"application/json","path":"results/Antfly/result_20261007_ab4e3abc67dc42d6a2c6630ce952b338_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"4476469d89d016a727cf861187b10e0fb2feba5f021e70aaa9d468a83bd23e22"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_b3a9e16bbd014b11951d5dba4336b22f_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"2870991e3c1572afe8cb2d806d616f65eb8a7048790a2ae2d8bfdd80f17bd494"},{"bytes":3730,"media_type":"application/json","path":"results/Antfly/result_20261007_df730dcbbcc34cce92e7c16c773e6946_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"79e7340f28f7dcfd2f913b0e52d4f87b4b06d1be61bd1896c91187e9a5447734"},{"bytes":3730,"media_type":"application/json","path":"results/Antfly/result_20261007_ff29dd15f55a4ec6932818c5500c5add_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"57ef521e0a9cb42935836bfc9d3fff438afc39a2b469a723dbb96b71cb8538f5"},{"bytes":634,"media_type":"application/json","path":"results/publication-protocol.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"8a91260633bc8e26d26d7777e650c95756cbb7cf077fe5028077ef8461928692"},{"bytes":5674,"media_type":"application/json","path":"selected-config.json","retention":"evidence","role":"qualification","schema_version":1,"sha256":"93f432eb65fcb028e7b79e5804d76a4de6582fe933d11e05669064d1b8ef5c7c"},{"bytes":3,"media_type":"application/json","path":"status.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570"},{"bytes":7006,"media_type":"application/json","path":"storage.json","retention":"evidence","role":"storage","schema_version":1,"sha256":"c4f1f09055d44888d22afb43d4b4caeca3f787c47450bda5357ee2c07ff4e401"},{"bytes":885,"media_type":"application/json","path":"supervisor-result.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"dd150a09880d53b598d41237303cda470e6c6486fb805f8da174a7724bfd34ab"}],"generated_at":"1791395517.7772086","kind":"publication-lifecycle","retained_bytes":914485,"schema_version":1},"status":"ok","storage":{"created_at":"2026-10-07T17:39:54.572244+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-big-200k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-07T17:39:54.711504+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-07T17:39:54.711477+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-07T17:39:54.630680+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]},"final":{"allocated_bytes":909643776,"apparent_bytes":908966352,"completed_at":"2026-10-07T17:51:27.349647+00:00","samples":[{"allocated_bytes":909643776,"apparent_bytes":908966352,"captured_at":"2026-10-07T17:51:27.349563+00:00","entries":391,"volumes":[{"allocated_bytes":909643776,"apparent_bytes":908966352,"entries":391,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-07T17:51:27.255322+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-big-200k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":909643776,"apparent_bytes":908966352,"entries":391,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]},"post_workload":{"allocated_bytes":909639680,"apparent_bytes":908964679,"completed_at":"2026-10-07T17:51:26.704890+00:00","samples":[{"allocated_bytes":909639680,"apparent_bytes":908964679,"captured_at":"2026-10-07T17:51:26.704862+00:00","entries":389,"volumes":[{"allocated_bytes":909639680,"apparent_bytes":908964679,"entries":389,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-07T17:51:26.593780+00:00","volumes":[{"allocated_bytes":909639680,"apparent_bytes":908964679,"entries":389,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-07T17:39:57.183415+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-07T17:39:57.183390+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-07T17:39:57.094425+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"name":"circus_vdbb_scale_t1_scale-big-200k-antfly-data"}]},"protocol_fingerprint":"99029d2e86acf6a3b9ea3e3311832f10490cc2165ca97207edb90e517876fc9b","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-07T17:51:27.349650+00:00"},"trial":1,"vectors":200000,"workload_id":"scale-big-200k"},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p4","ndcg":0.9818,"p95_ms":14,"p99_ms":17.9,"parameter":"search_effort","recall":0.9783,"status":"ok","value":0.4,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p35","ndcg":0.9533,"p95_ms":92.5,"p99_ms":101.9,"parameter":"search_effort","recall":0.9458,"status":"ok","value":0.35,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-1","ndcg":0.9963,"p95_ms":27.9,"p99_ms":39.1,"parameter":"search_effort","recall":0.995,"status":"ok","value":1,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p6","ndcg":0.9962,"p95_ms":20.3,"p99_ms":24.6,"parameter":"search_effort","recall":0.9949,"status":"ok","value":0.6,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p7","ndcg":0.9962,"p95_ms":18.7,"p99_ms":21,"parameter":"search_effort","recall":0.9949,"status":"ok","value":0.7,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p375","ndcg":0.9709,"p95_ms":14.7,"p99_ms":19,"parameter":"search_effort","recall":0.9659,"status":"ok","value":0.375,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p5","ndcg":0.9959,"p95_ms":17.3,"p99_ms":20.2,"parameter":"search_effort","recall":0.9946,"status":"ok","value":0.5,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p425","ndcg":0.9905,"p95_ms":14.7,"p99_ms":16.8,"parameter":"search_effort","recall":0.9884,"status":"ok","value":0.425,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p45","ndcg":0.9946,"p95_ms":14.2,"p99_ms":15.9,"parameter":"search_effort","recall":0.993,"status":"ok","value":0.45,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p8","ndcg":0.9963,"p95_ms":20.4,"p99_ms":21.8,"parameter":"search_effort","recall":0.995,"status":"ok","value":0.8,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p475","ndcg":0.9956,"p95_ms":16,"p99_ms":19.5,"parameter":"search_effort","recall":0.9942,"status":"ok","value":0.475,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p55","ndcg":0.996,"p95_ms":17.6,"p99_ms":19,"parameter":"search_effort","recall":0.9946,"status":"ok","value":0.55,"workload":"scale-big-400k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-400k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-400k"}],"cell_sha256":"6cb73253c58b2bfcd4d1dba6ae5dc95c44b130af3f1a998e16bfdc23c96ba2e7","index_build":{"insert_duration":108.6286,"optimize_duration":36.0781,"seconds":144.7067},"lifecycle":{"attempt":1,"elapsed_seconds":814.356,"finished_at":1791396332.5565193,"returncode":0,"started_at":1791395518.2001057,"status":"ok","trial":1},"memory":{"anon_shmem_peak_mb":2376.2,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":4070,"cgroup_current_peak_mb":4069.4,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":2376.2,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":4069371904,"cgroup_kernel_peak_sum_bytes":4069957632,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":2376171520,"ended":1791396311.2031531,"failed_samples":0,"first_sample_at":1791395521.709873,"kind":"container_cgroup_v2","last_sample_at":1791396311.0017536,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":2486,"schema_version":3,"started":1791395521.6529262,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791395521.709873,"index_started_at":1791395521.8346655,"last_sample_at":1791396311.0017536,"max_sample_gap_s":0.694,"publication_finished_at":1791396310.7175193,"sampler_ended_at":1791396311.2031531,"sampler_started_at":1791395521.6529262,"samples":2486,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"profile":"big","publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.011274097086996913,0.008739164802908381,0.011800874803748624,0.024258779986889967,0.03587392737808827],"conc_latency_p95_list":[0.025598970998544246,0.011791535452357482,0.018134142307098953,0.04192828360537532,0.06486452468379865],"conc_latency_p99_list":[0.03824679500539791,0.015027461040008341,0.022848556991084464,0.05582184458558912,0.08231669627915834],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[88.5437,570.9964,844.3287,819.474,828.3417],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9686,"optimize_duration":0,"p99_c30_ms":82.31669627915835,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":10,"peak_qps":844.3287,"qps":844.3287,"qps_c30":828.3417,"recall":0.964,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0126,"serial_latency_p99":0.0218,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"selection_status":"superseded","serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":108.6,"load_s":144.7,"source_label":"antfly-qualification-scale-big-400k-0p35"},"ndcg":0.9709,"p95_ms":14.7,"p99_ms":19,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9659,"selection_mode":"swept","value":0.375},"source":{"cache_key":"f0dd077b5d68b97a4d415fbc57dbaf8510b74e2da791d6af460b3431eef0c1b4","finished_at":1791396332.5565193,"object_sha256":"c43b90a1045bf13a1332e22d4efd7389513c9e2548d51fdfb0b60bcafe486fa2","receipt_sha256":"67cd210986ffd87694d65846181b158e0a8d3812c9868fd5704fcca15155818d","started_at":1791395518.2001057},"source_receipt":{"benchmark_id":"vector-vdbbench-scale","files":[{"bytes":12532,"media_type":"application/json","path":"cell-result.json","retention":"evidence","role":"normalized-result","schema_version":1,"sha256":"6cb73253c58b2bfcd4d1dba6ae5dc95c44b130af3f1a998e16bfdc23c96ba2e7"},{"bytes":8292,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-400k-0p35.log","retention":"evidence","role":"log","schema_version":null,"sha256":"2612671841596234cd11ba67a488d9e2bfbff0eb1648fbd3f5a872e086032336"},{"bytes":9389,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-400k-0p35_load.log","retention":"evidence","role":"log","schema_version":null,"sha256":"d4cd4cabf1461ad02320a933d843d1a3bdd5e037d34c11bea59492e504fa3da4"},{"bytes":8297,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-400k-0p375.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e18b1ce557b53a2f857d6bdc1b49811c05f3a398e3aa34c0a32b065dd702e142"},{"bytes":8281,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-400k-0p4.log","retention":"evidence","role":"log","schema_version":null,"sha256":"5cb46476f5118f8350309335177a9c2dcbeff8a457f4563af6f2475b26a418d0"},{"bytes":8300,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-400k-0p425.log","retention":"evidence","role":"log","schema_version":null,"sha256":"63e67655acffdf586e0a866b4ed371e4acf83d2d56ca4cdc5a1b58e862cd41b9"},{"bytes":8289,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-400k-0p45.log","retention":"evidence","role":"log","schema_version":null,"sha256":"edca66108c4e000194b2424683efc5182a5a9b1a27471bcdea2748d4665093ac"},{"bytes":8297,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-400k-0p475.log","retention":"evidence","role":"log","schema_version":null,"sha256":"ee0381e94b1e2f631d004d2151001974ce478bd3a607a0471b15d7ffbbb33c75"},{"bytes":8284,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-400k-0p5.log","retention":"evidence","role":"log","schema_version":null,"sha256":"45544217defb4ae48ffce9a76c0d5af2115a884cac7f3d83537b8f21b2600c87"},{"bytes":8286,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-400k-0p55.log","retention":"evidence","role":"log","schema_version":null,"sha256":"4aa100485cb882c71185a6ec41497e04a0ff24dfbbf3d7ab730e7dbae0ac285c"},{"bytes":8283,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-400k-0p6.log","retention":"evidence","role":"log","schema_version":null,"sha256":"0812c9a45c6674331c03c8f61c77b643812b4c32e6927c093c2d13c72a1414ab"},{"bytes":8280,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-400k-0p7.log","retention":"evidence","role":"log","schema_version":null,"sha256":"62ea29f1c4772ea9434bf1bc3113693f1e5be9f204d74970cf6766eebdf6b1e1"},{"bytes":8281,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-400k-0p8.log","retention":"evidence","role":"log","schema_version":null,"sha256":"afd7eff4e1337f79d438e12c8734346997094a670ef60298a535ce36abeff8d2"},{"bytes":8267,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-400k-1.log","retention":"evidence","role":"log","schema_version":null,"sha256":"b2e23d0906a45360482980ccb93e0517749f6326f2153d831cdd39db678045b4"},{"bytes":23431,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"9550a8fff8d67d546f6e3b6b6fb21cade34f1bcfb00279d982bf8f0648ba3cff"},{"bytes":986,"media_type":"application/json","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.json","retention":"evidence","role":"log","schema_version":1,"sha256":"394e11a0059e02d1a4c347571dc8f41c07f9e24a07ed9921c2d3629951f7bb5c"},{"bytes":647359,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.jsonl","retention":"evidence","role":"memory-timeline","schema_version":null,"sha256":"bf5600584e2ec7085c85596e4988506b99835008a8cbfaac56592066e9bf3088"},{"bytes":0,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"},{"bytes":137429,"media_type":"application/octet-stream","path":"logs/supervisor.log","retention":"evidence","role":"log","schema_version":null,"sha256":"75920b7124522cc26896ce37c17d1df496bd1c86e193c5ddfea17ff2ed577edb"},{"bytes":2585,"media_type":"application/json","path":"memory.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"443372206c17ea56500c2d7d8fc4c02b7ad3c2c9b43c87e84e9d282bc39ad2ef"},{"bytes":87,"media_type":"application/json","path":"quiet-host.json","retention":"evidence","role":"quiet-host","schema_version":1,"sha256":"b6fd71707081f58326be630e9872b9fbf258639be433d6e87cff9e4021ea5bd2"},{"bytes":3725,"media_type":"application/json","path":"results/Antfly/result_20261007_11c9f5874e2e4709a8501aeabd19a788_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"e036e44f508f84b2542ee506a9076bf8e1d2a76d04d975947f4a8de97198098d"},{"bytes":3728,"media_type":"application/json","path":"results/Antfly/result_20261007_1d155facf1644905969475268cdee9bb_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"ca12acdfe240d4777729df9b84f49ddba19b8e736c40f701cee965801ac5ee83"},{"bytes":3723,"media_type":"application/json","path":"results/Antfly/result_20261007_2296c61e2c894389a0359f90d0713219_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"1b9cdd71da58f470e849045989bdfe4b2c629977b80d793022982c8e47f30a05"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_2837d3b2b736494ba9c9a8c80ff93d19_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"53914084e60ac64bd4000e7c2a7564392a99f4c8ed00f469dace6ab7394a9db5"},{"bytes":3725,"media_type":"application/json","path":"results/Antfly/result_20261007_4df76390dcb24ea8949a5120bc07e9bf_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"0524158d4c48a8e87892cf78b35577ae8e31d670948a5301aa540cd4a1b24965"},{"bytes":3729,"media_type":"application/json","path":"results/Antfly/result_20261007_4f6c628e24194333a93a83c52f055744_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"b810896909d6134c9a3d706856fbe68fabf2947a108235a1e074a214fce72a2d"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_597d00306e774cb08cf6b90188869701_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"5e67824fde621847f6b0a0f683f1f508d5193173a11dd7879046c4fb4bbf00b5"},{"bytes":3730,"media_type":"application/json","path":"results/Antfly/result_20261007_68d1e9afe9d0443782a0db6cd40e3bea_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"7bcac6e8c1d1df6a2e7daba01a7c3fc64f3de5dc94ad4484cb4af22b3a76bb04"},{"bytes":3727,"media_type":"application/json","path":"results/Antfly/result_20261007_8d321d77403d44b79e716b61f7e93cb2_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"08b5b28cf8bc7a342b1c3a1602d65251643e8a7b418cb605423b2350db913d67"},{"bytes":3725,"media_type":"application/json","path":"results/Antfly/result_20261007_95f2d01115fb4e15842a454ef3ea9007_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"5b44b0ac5238c2ec4068e69fc0a00d5e4f791a8746d0eea1dbeec954cec18726"},{"bytes":3729,"media_type":"application/json","path":"results/Antfly/result_20261007_a1065788269f42e0b4fa2ab87607cdc0_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"975537e8e9117cdf4edfcfd83b7006b97e2a23a54d415afcd5e8ea22eae83a3a"},{"bytes":4416,"media_type":"application/json","path":"results/Antfly/result_20261007_d0486cecc72e436686f0a9da90b5d978_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"389f128ee8eccded2e826db20e8a9787c348d7d36f1c5aff6c7440c87648e6a1"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_eb1280bc5736417489142710cab385df_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"7e2ae1f9f59bbe0c8850e3fc2907659ddccf62045a42a3f983d03eb752d6e557"},{"bytes":3332,"media_type":"application/json","path":"results/Antfly/result_20261007_f86262a009014a388e7376357df7e6e7_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"a40fa776c17d66ae8c481e77d111cd180a13a195ea182f69c653134159297420"},{"bytes":634,"media_type":"application/json","path":"results/publication-protocol.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"8a91260633bc8e26d26d7777e650c95756cbb7cf077fe5028077ef8461928692"},{"bytes":5672,"media_type":"application/json","path":"selected-config.json","retention":"evidence","role":"qualification","schema_version":1,"sha256":"cfc7c89312cff8e94688b1c920553e3335ad03511406d3e613973f09d19fa386"},{"bytes":3,"media_type":"application/json","path":"status.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570"},{"bytes":7022,"media_type":"application/json","path":"storage.json","retention":"evidence","role":"storage","schema_version":1,"sha256":"e2b80f65892cbbd0bd9eae5309a0de79c0ae5469cc7422e583665fe25cb3acfd"},{"bytes":885,"media_type":"application/json","path":"supervisor-result.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"fcd94a223e1144317002a5a5bf1e438971659ff5976afe155d4d426c3aeaa212"}],"generated_at":"1791396332.5565193","kind":"publication-lifecycle","retained_bytes":999918,"schema_version":1},"status":"ok","storage":{"created_at":"2026-10-07T17:51:58.877907+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-big-400k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-07T17:51:59.011470+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-07T17:51:59.011443+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-07T17:51:58.917145+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]},"final":{"allocated_bytes":1970135040,"apparent_bytes":1969423493,"completed_at":"2026-10-07T18:05:12.176903+00:00","samples":[{"allocated_bytes":1970135040,"apparent_bytes":1969423493,"captured_at":"2026-10-07T18:05:12.176880+00:00","entries":393,"volumes":[{"allocated_bytes":1970135040,"apparent_bytes":1969423493,"entries":393,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-07T18:05:12.065713+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-big-400k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":1970135040,"apparent_bytes":1969423493,"entries":393,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]},"post_workload":{"allocated_bytes":1970126848,"apparent_bytes":1969422026,"completed_at":"2026-10-07T18:05:11.468100+00:00","samples":[{"allocated_bytes":1970126848,"apparent_bytes":1969422026,"captured_at":"2026-10-07T18:05:11.468070+00:00","entries":391,"volumes":[{"allocated_bytes":1970126848,"apparent_bytes":1969422026,"entries":391,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-07T18:05:11.341029+00:00","volumes":[{"allocated_bytes":1970126848,"apparent_bytes":1969422026,"entries":391,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-07T17:52:01.563648+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-07T17:52:01.563622+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-07T17:52:01.462473+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"name":"circus_vdbb_scale_t1_scale-big-400k-antfly-data"}]},"protocol_fingerprint":"1d2481ec5d4a568af1c301a7281a4d98d060c99d3a809c6b6846771adf2edcc8","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-07T18:05:12.176907+00:00"},"trial":1,"vectors":400000,"workload_id":"scale-big-400k"},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p475","ndcg":0.9949,"p95_ms":18.9,"p99_ms":21.1,"parameter":"search_effort","recall":0.9934,"status":"ok","value":0.475,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p4","ndcg":0.9806,"p95_ms":16.1,"p99_ms":19.8,"parameter":"search_effort","recall":0.9768,"status":"ok","value":0.4,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p5","ndcg":0.9954,"p95_ms":26,"p99_ms":59.6,"parameter":"search_effort","recall":0.994,"status":"ok","value":0.5,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p7","ndcg":0.9956,"p95_ms":23.6,"p99_ms":31.4,"parameter":"search_effort","recall":0.9942,"status":"ok","value":0.7,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p6","ndcg":0.9956,"p95_ms":23.7,"p99_ms":25.1,"parameter":"search_effort","recall":0.9941,"status":"ok","value":0.6,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p35","ndcg":0.9517,"p95_ms":101.1,"p99_ms":135.8,"parameter":"search_effort","recall":0.9446,"status":"ok","value":0.35,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p375","ndcg":0.9685,"p95_ms":16.8,"p99_ms":24.3,"parameter":"search_effort","recall":0.9632,"status":"ok","value":0.375,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p425","ndcg":0.9881,"p95_ms":17.4,"p99_ms":22,"parameter":"search_effort","recall":0.9856,"status":"ok","value":0.425,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p45","ndcg":0.9931,"p95_ms":16.8,"p99_ms":20.2,"parameter":"search_effort","recall":0.9912,"status":"ok","value":0.45,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p8","ndcg":0.9957,"p95_ms":26,"p99_ms":28.2,"parameter":"search_effort","recall":0.9942,"status":"ok","value":0.8,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-0p55","ndcg":0.9954,"p95_ms":21.3,"p99_ms":24.4,"parameter":"search_effort","recall":0.994,"status":"ok","value":0.55,"workload":"scale-big-600k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-600k-1","ndcg":0.9957,"p95_ms":38.3,"p99_ms":44.1,"parameter":"search_effort","recall":0.9944,"status":"ok","value":1,"workload":"scale-big-600k"}],"cell_sha256":"44e7414e3bcbcf6cf6a34bda0066dba7ffa7b8366b770547ba75bc87435b5d14","index_build":{"insert_duration":178.3884,"optimize_duration":68.1451,"seconds":246.5335},"lifecycle":{"attempt":1,"elapsed_seconds":934.783,"finished_at":1791397267.7499914,"returncode":0,"started_at":1791396332.9672976,"status":"ok","trial":1},"memory":{"anon_shmem_peak_mb":2808.6,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":5515.7,"cgroup_current_peak_mb":5480.9,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":2808.6,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":5480919040,"cgroup_kernel_peak_sum_bytes":5515714560,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":2808631296,"ended":1791397241.2174096,"failed_samples":0,"first_sample_at":1791396336.4607246,"kind":"container_cgroup_v2","last_sample_at":1791397241.0106385,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":2837,"schema_version":3,"started":1791396336.3989556,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791396336.4607246,"index_started_at":1791396336.4741585,"last_sample_at":1791397241.0106385,"max_sample_gap_s":0.588,"publication_finished_at":1791397240.862289,"sampler_ended_at":1791397241.2174096,"sampler_started_at":1791396336.3989556,"samples":2837,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"profile":"big","publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.01460663068325675,0.009724086081998564,0.013445043625408819,0.02528479625512014,0.03793844778639762],"conc_latency_p95_list":[0.0339502578921383,0.013124334189342331,0.020373056002426893,0.04325633859552908,0.06778442563954737],"conc_latency_p99_list":[0.05013867403118639,0.017029286068864165,0.026057829737546865,0.0560456750105368,0.08794292236183533],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[68.3651,513.1105,741.3973,785.8316,784.1097],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9636,"optimize_duration":0,"p99_c30_ms":87.94292236183533,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":20,"peak_qps":785.8316,"qps":785.8316,"qps_c30":784.1097,"recall":0.9589,"searchable_after_insert_seconds":0,"serial_latency_p95":0.012,"serial_latency_p99":0.0187,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"selection_status":"superseded","serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":178.4,"load_s":246.5,"source_label":"antfly-qualification-scale-big-600k-0p35"},"ndcg":0.9685,"p95_ms":16.8,"p99_ms":24.3,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9632,"selection_mode":"swept","value":0.375},"source":{"cache_key":"d376c53d5a7a221a1aba0d117b90a936dd87dea5fe9239bc6537bba01dc3cb5a","finished_at":1791397267.7499914,"object_sha256":"9196b8ec335b81f1d9dad77df416bfbdf238782abcfce1cf13e7ca0d250dbcc5","receipt_sha256":"c1f84f6d7f1cedf06fe215d33198fd69593e395e1f381466c39401eb42d7da69","started_at":1791396332.9672976},"source_receipt":{"benchmark_id":"vector-vdbbench-scale","files":[{"bytes":12528,"media_type":"application/json","path":"cell-result.json","retention":"evidence","role":"normalized-result","schema_version":1,"sha256":"44e7414e3bcbcf6cf6a34bda0066dba7ffa7b8366b770547ba75bc87435b5d14"},{"bytes":8293,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-600k-0p35.log","retention":"evidence","role":"log","schema_version":null,"sha256":"da4739d65301478b7f07ca98d0c3f122737d052d6c6379d34321f3d7bac47ff3"},{"bytes":9388,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-600k-0p35_load.log","retention":"evidence","role":"log","schema_version":null,"sha256":"86cc8fbb394945a90edc408ae82598d6247ca650c90f6c61a263befa468d1e42"},{"bytes":8300,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-600k-0p375.log","retention":"evidence","role":"log","schema_version":null,"sha256":"fd2da0239b1632c30b35b5e741ffaad820c21171738ef21c4efe39829b2155b4"},{"bytes":8284,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-600k-0p4.log","retention":"evidence","role":"log","schema_version":null,"sha256":"536a3bb90670dc46b2e592417fc7a6fa5d7b8b34442c2a98206c8da9ee55bdde"},{"bytes":8297,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-600k-0p425.log","retention":"evidence","role":"log","schema_version":null,"sha256":"359cf0b66f73a58213101064f9327c0eb5dfb7bc6944c11975e5b227ce74bcac"},{"bytes":8292,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-600k-0p45.log","retention":"evidence","role":"log","schema_version":null,"sha256":"2c905843c12516b54e090f9cd56f574ad11752b02ffe16927272c2126023717b"},{"bytes":8300,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-600k-0p475.log","retention":"evidence","role":"log","schema_version":null,"sha256":"88e96021c09e0921f07dfd77c115b39d1586817422c62e31c4a465bd04a533e1"},{"bytes":8278,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-600k-0p5.log","retention":"evidence","role":"log","schema_version":null,"sha256":"d5982c450fdf432e1e6ac07d76f7c81eebc9396da03786cd20a898fe6b93d082"},{"bytes":8289,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-600k-0p55.log","retention":"evidence","role":"log","schema_version":null,"sha256":"c6771c12c704166ac40fe1289c1b84a71d990931ec59a3035e92cc49d4ec399a"},{"bytes":8284,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-600k-0p6.log","retention":"evidence","role":"log","schema_version":null,"sha256":"16fd484ef81d669b303ffcff7b7a64f1517e6c9fb2398d1ecb473ec6bec256bd"},{"bytes":8284,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-600k-0p7.log","retention":"evidence","role":"log","schema_version":null,"sha256":"bda076e91377a275397b52d681501a9cf840e8ed599da2ec1da60c548c7e1c29"},{"bytes":8281,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-600k-0p8.log","retention":"evidence","role":"log","schema_version":null,"sha256":"cbf5900996d9f58757458fa4c6f8b1ed835cb584fc2282a4fb0e6a7fa73e5e47"},{"bytes":8270,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-600k-1.log","retention":"evidence","role":"log","schema_version":null,"sha256":"68c5d111ab70704cb897a9de2ef50903925b0596571cdac08c5401ea0f83e95c"},{"bytes":23565,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"9921fd95fae4e05896b85048062d554f91340357c720703be499df0e19d01eec"},{"bytes":987,"media_type":"application/json","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.json","retention":"evidence","role":"log","schema_version":1,"sha256":"dae6b1230c895e84125d44e6891ab06e76322acc75800c7e5df6e24047381f6c"},{"bytes":738879,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.jsonl","retention":"evidence","role":"memory-timeline","schema_version":null,"sha256":"46d4a15e80da3dad1aae5d4599d5980fad752546b2a9ae46f78a57287606b0d8"},{"bytes":0,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"},{"bytes":137577,"media_type":"application/octet-stream","path":"logs/supervisor.log","retention":"evidence","role":"log","schema_version":null,"sha256":"4000a0ef52c8dffeae3b790af61dba9c3872e0dfe8f7f1263bf1109b491d3cc5"},{"bytes":2585,"media_type":"application/json","path":"memory.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"99b0471e5ee6d4572ed2274349f8f4a7403cd21a2f2f6592c16d92e01f38f78e"},{"bytes":87,"media_type":"application/json","path":"quiet-host.json","retention":"evidence","role":"quiet-host","schema_version":1,"sha256":"b6fd71707081f58326be630e9872b9fbf258639be433d6e87cff9e4021ea5bd2"},{"bytes":3730,"media_type":"application/json","path":"results/Antfly/result_20261007_01d3109fddae48e29d677c06d13bce32_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"d01525fa06f6153fccba821c54f78d71b5a25c17072a3a456e9c9e26934b6c5e"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_06a1402bc11b4c75a9ae043861e1050d_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"4a9375e839e78cf4b09aaa576e5227fc23a68a01b0bc6df8c12e6048f43a140b"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_1bd1f7de9def444d8412d66fa2df2348_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"301d39fd6e826b4a52b928d9b2e6dc6fa35562befa9f393b4f81b5fb9c042b8e"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_411aaa9567f54cbb8eb635544532434d_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"70d504564572e176e1f2dc6316f79fa05a3eb5ba1bd19e6cf47269fb9310edab"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_41361675a95e419b92fbeab1804e79e3_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"c74480e55f04ae09d86ffca1d05a92fe94f5d4b84f274b42399b361698f94f6d"},{"bytes":3728,"media_type":"application/json","path":"results/Antfly/result_20261007_43ea8eb27aec4d3b86a833a46354d78e_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"1711f0dd9e08e9ed338ceaef54c19197406f341b65faa0d88d6d19fa10b9b89d"},{"bytes":3332,"media_type":"application/json","path":"results/Antfly/result_20261007_50dd6eea7473462b94e6eb440676c560_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"69b6dd25002969c041cad03e53e6dc5c42e74cd1d15f5727b51933c20b386ebc"},{"bytes":3730,"media_type":"application/json","path":"results/Antfly/result_20261007_75d4314736344956b2b28976e792c33d_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"675d52580f9797b27efcabbc20a0d93179c132f8a527774969f16f88c4976bce"},{"bytes":3729,"media_type":"application/json","path":"results/Antfly/result_20261007_83c713af749e48bcb18da6a0503487d6_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"82bbbb38161b9b39cdefb1570d22dc0aab16b4c408a511fe5181984ab90f12ce"},{"bytes":4412,"media_type":"application/json","path":"results/Antfly/result_20261007_85fcff41f3a0437ea2cca3aef11954b1_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"08a3d0c71704d35d9071d77030f97521542251bdbbc915f9636269e86b124c07"},{"bytes":3728,"media_type":"application/json","path":"results/Antfly/result_20261007_94e90f8f467f425d9bce388bdc4a9c8f_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"006ad8a98f70f03d8c8e21e751bfffc23fe9d7a6c443e68cb1fbe57d880d9ab3"},{"bytes":3725,"media_type":"application/json","path":"results/Antfly/result_20261007_a55058853afe4e5ea1219b9e72b98f1b_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"74cc281651c70b63606ddc683aa92a005c7d14712bf0418addbcbdcce505ffb1"},{"bytes":3727,"media_type":"application/json","path":"results/Antfly/result_20261007_b429a1d5bc294f21912b12ed6b8183f1_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"f4cbcd6f91f77451c0c9dcca284e993ed10046cc1164b2c0f1a2f4255bb44d37"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_efcce79ca8ea49d5b7c31bd01f4012ad_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"4a73e6c6b775a9aadf02a52b6b7e4d1a6be5f5b793d799af81ec2872fda02272"},{"bytes":634,"media_type":"application/json","path":"results/publication-protocol.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"8a91260633bc8e26d26d7777e650c95756cbb7cf077fe5028077ef8461928692"},{"bytes":5675,"media_type":"application/json","path":"selected-config.json","retention":"evidence","role":"qualification","schema_version":1,"sha256":"50270dc82c6bda26dc042a5c78eb88aea4cb2a0d80155f4cb7283bba46a6afdf"},{"bytes":3,"media_type":"application/json","path":"status.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570"},{"bytes":7022,"media_type":"application/json","path":"storage.json","retention":"evidence","role":"storage","schema_version":1,"sha256":"64ac5ec9a44ae342cee668afe0bbbfa7337feb5f779f3ae8513bf0cd4c8540e4"},{"bytes":885,"media_type":"application/json","path":"supervisor-result.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"8b403a02495a1f1c1a701a5ae9391b36dfeea55b79cd1f411c7d3b7310f8669b"}],"generated_at":"1791397267.7499914","kind":"publication-lifecycle","retained_bytes":1091734,"schema_version":1},"status":"ok","storage":{"created_at":"2026-10-07T18:05:33.688337+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-big-600k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-07T18:05:33.815084+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-07T18:05:33.815057+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-07T18:05:33.731392+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]},"final":{"allocated_bytes":3096936448,"apparent_bytes":3096289340,"completed_at":"2026-10-07T18:20:42.229321+00:00","samples":[{"allocated_bytes":3096936448,"apparent_bytes":3096289340,"captured_at":"2026-10-07T18:20:42.229291+00:00","entries":401,"volumes":[{"allocated_bytes":3096936448,"apparent_bytes":3096289340,"entries":401,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-07T18:20:42.142092+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-big-600k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":3096936448,"apparent_bytes":3096289340,"entries":401,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]},"post_workload":{"allocated_bytes":3096932352,"apparent_bytes":3096287817,"completed_at":"2026-10-07T18:20:41.454149+00:00","samples":[{"allocated_bytes":3096932352,"apparent_bytes":3096287817,"captured_at":"2026-10-07T18:20:41.454125+00:00","entries":399,"volumes":[{"allocated_bytes":3096932352,"apparent_bytes":3096287817,"entries":399,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-07T18:20:41.348990+00:00","volumes":[{"allocated_bytes":3096932352,"apparent_bytes":3096287817,"entries":399,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-07T18:05:36.305285+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-07T18:05:36.305261+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-07T18:05:36.208181+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"name":"circus_vdbb_scale_t1_scale-big-600k-antfly-data"}]},"protocol_fingerprint":"e81ca7128c81972079e3c58fc9e4248b8f4ef0da3ab6ab68673b8dee5f4083b9","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-07T18:20:42.229323+00:00"},"trial":1,"vectors":600000,"workload_id":"scale-big-600k"},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p7","ndcg":0.996,"p95_ms":26.8,"p99_ms":30.5,"parameter":"search_effort","recall":0.9948,"status":"ok","value":0.7,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p45","ndcg":0.9902,"p95_ms":16.4,"p99_ms":20.7,"parameter":"search_effort","recall":0.9884,"status":"ok","value":0.45,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p475","ndcg":0.9937,"p95_ms":18.8,"p99_ms":23.4,"parameter":"search_effort","recall":0.9923,"status":"ok","value":0.475,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p4","ndcg":0.9735,"p95_ms":13.3,"p99_ms":16.2,"parameter":"search_effort","recall":0.9696,"status":"ok","value":0.4,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p6","ndcg":0.9957,"p95_ms":24.4,"p99_ms":27.3,"parameter":"search_effort","recall":0.9945,"status":"ok","value":0.6,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-1","ndcg":0.9963,"p95_ms":49.5,"p99_ms":53.5,"parameter":"search_effort","recall":0.9952,"status":"ok","value":1,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p35","ndcg":0.9414,"p95_ms":26.8,"p99_ms":47.8,"parameter":"search_effort","recall":0.9353,"status":"ok","value":0.35,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p375","ndcg":0.9601,"p95_ms":12.7,"p99_ms":14.4,"parameter":"search_effort","recall":0.9552,"status":"ok","value":0.375,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p55","ndcg":0.9951,"p95_ms":22.5,"p99_ms":24.5,"parameter":"search_effort","recall":0.9938,"status":"ok","value":0.55,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p425","ndcg":0.9838,"p95_ms":15,"p99_ms":16.6,"parameter":"search_effort","recall":0.9814,"status":"ok","value":0.425,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p5","ndcg":0.9951,"p95_ms":22.5,"p99_ms":24.6,"parameter":"search_effort","recall":0.9937,"status":"ok","value":0.5,"workload":"scale-big-800k"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-800k-0p8","ndcg":0.9963,"p95_ms":30.1,"p99_ms":34.6,"parameter":"search_effort","recall":0.9951,"status":"ok","value":0.8,"workload":"scale-big-800k"}],"cell_sha256":"53fecfe9bf8ec06f5f8c3f2d94fd8bf92fcc579aace69752e7abb048eed57010","index_build":{"insert_duration":257.2659,"optimize_duration":86.1566,"seconds":343.4225},"lifecycle":{"attempt":1,"elapsed_seconds":1025.431,"finished_at":1791398293.6047776,"returncode":0,"started_at":1791397268.1738331,"status":"ok","trial":1},"memory":{"anon_shmem_peak_mb":3570.3,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":7897.5,"cgroup_current_peak_mb":7895.7,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":3570.3,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":7895744512,"cgroup_kernel_peak_sum_bytes":7897526272,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":3570327552,"ended":1791398273.9036868,"failed_samples":0,"first_sample_at":1791397271.6820438,"kind":"container_cgroup_v2","last_sample_at":1791398273.6923916,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":3125,"schema_version":3,"started":1791397271.626083,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791397271.6820438,"index_started_at":1791397271.8036387,"last_sample_at":1791398273.6923916,"max_sample_gap_s":0.877,"publication_finished_at":1791398273.5559666,"sampler_ended_at":1791398273.9036868,"sampler_started_at":1791397271.626083,"samples":3125,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"profile":"big","publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.010715138035260939,0.0106591132666454,0.015394743626682876,0.02861894670343072,0.0451616799451967],"conc_latency_p95_list":[0.01472325160721083,0.015190113004064186,0.024085714861575975,0.049193995895620894,0.08341564919392114],"conc_latency_p99_list":[0.019274500765604816,0.018983388006454348,0.03220422248414252,0.06514399028295895,0.11915574293496321],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[93.1829,468.0595,647.2057,694.0998,658.3946],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9579,"optimize_duration":0,"p99_c30_ms":119.15574293496321,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":20,"peak_qps":694.0998,"qps":694.0998,"qps_c30":658.3946,"recall":0.9523,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0162,"serial_latency_p99":0.0358,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"selection_status":"superseded","serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":257.3,"load_s":343.4,"source_label":"antfly-qualification-scale-big-800k-0p35"},"ndcg":0.9601,"p95_ms":12.7,"p99_ms":14.4,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9552,"selection_mode":"swept","value":0.375},"source":{"cache_key":"e7a5323774e31f4ec6eddb7a21e8249ee676fce2cd20279827ed4b4508828522","finished_at":1791398293.6047776,"object_sha256":"bae3e18a7a8cee56a946c3c80e46a3ec1e4c5b0cc41216fd894cd979b974696d","receipt_sha256":"e9bb4641d3c803915a0ea90970f25c8509a2f746747fb3c3cb5f79671e3b17d7","started_at":1791397268.1738331},"source_receipt":{"benchmark_id":"vector-vdbbench-scale","files":[{"bytes":12537,"media_type":"application/json","path":"cell-result.json","retention":"evidence","role":"normalized-result","schema_version":1,"sha256":"53fecfe9bf8ec06f5f8c3f2d94fd8bf92fcc579aace69752e7abb048eed57010"},{"bytes":8292,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-800k-0p35.log","retention":"evidence","role":"log","schema_version":null,"sha256":"16958ed2402503feeb5915a83f23d3c7c40b65ec8b190942bcb282bf8c0a0c05"},{"bytes":9387,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-800k-0p35_load.log","retention":"evidence","role":"log","schema_version":null,"sha256":"443f1c5f51a5f6a130ddffaf1b7cebe09960a26abb8a74ed459e9bb333f5aba5"},{"bytes":8300,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-800k-0p375.log","retention":"evidence","role":"log","schema_version":null,"sha256":"491caea23d8e497d275138134489609fbc0f1ae170cce022d2734dacdff1c782"},{"bytes":8284,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-800k-0p4.log","retention":"evidence","role":"log","schema_version":null,"sha256":"528aac24f0ab2f32537882180888e260d996771ba30c72336dd9f67118e52d14"},{"bytes":8296,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-800k-0p425.log","retention":"evidence","role":"log","schema_version":null,"sha256":"d3466efd3f52385aaac66317cf12b50a6d617a7dea8eac3a5bf98bfe87fa5bba"},{"bytes":8292,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-800k-0p45.log","retention":"evidence","role":"log","schema_version":null,"sha256":"a5e3dbb33d3152a05747a4b1216be90db074e7e02da09770abff67c0f1898b24"},{"bytes":8300,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-800k-0p475.log","retention":"evidence","role":"log","schema_version":null,"sha256":"febf64d90800194a7a6a72b51e8f2737a8c0e1dd999f5061dbbfd997e388ec8a"},{"bytes":8284,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-800k-0p5.log","retention":"evidence","role":"log","schema_version":null,"sha256":"921bd414257392f1d469574f965a227f40d6b799a36ad22bf9989605c911ab60"},{"bytes":8292,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-800k-0p55.log","retention":"evidence","role":"log","schema_version":null,"sha256":"857a156f6a5344a3eeba77a1446e38ac002a385144592a2010b02ce9419a8ca6"},{"bytes":8284,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-800k-0p6.log","retention":"evidence","role":"log","schema_version":null,"sha256":"981b6075581224327fb352e8c19ae25cbaaaf5d208a21d5e0c88a09e14aa702d"},{"bytes":8281,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-800k-0p7.log","retention":"evidence","role":"log","schema_version":null,"sha256":"d9dc217bc2cce474acebb485104745d7883d7dd0573217b8fb2312acc7631b0c"},{"bytes":8284,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-800k-0p8.log","retention":"evidence","role":"log","schema_version":null,"sha256":"d672a0ed7069c95f5cc7ea7161661010b5142e5710c5a3f27bee3ce13d9d94a8"},{"bytes":8270,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-800k-1.log","retention":"evidence","role":"log","schema_version":null,"sha256":"f6c21d06015d968ff47ed96773febec98d497b99978db9f97209053ecafe07a1"},{"bytes":23574,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"be489dcdf79d6d46647ebced535a16d8f45ef68c19c762d1d569fbbc767bb841"},{"bytes":986,"media_type":"application/json","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.json","retention":"evidence","role":"log","schema_version":1,"sha256":"32d6eb515d22b04b5f54df18f52f37e47ca6b508faf6a4e85ff375f0580ba892"},{"bytes":814090,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.jsonl","retention":"evidence","role":"memory-timeline","schema_version":null,"sha256":"2935b342ae9f01d7173754cfc024eb8e16717e2ea82ba8800618a2b4b39df3e3"},{"bytes":0,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"},{"bytes":137592,"media_type":"application/octet-stream","path":"logs/supervisor.log","retention":"evidence","role":"log","schema_version":null,"sha256":"ea3fbb1a0bb668689ecf09d4de1f2605a9f34c33814c38845d0dd788962be996"},{"bytes":2585,"media_type":"application/json","path":"memory.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"22281220406be68accde5f694276ecbc2dc645536aafce513ec45030fca41021"},{"bytes":87,"media_type":"application/json","path":"quiet-host.json","retention":"evidence","role":"quiet-host","schema_version":1,"sha256":"b6fd71707081f58326be630e9872b9fbf258639be433d6e87cff9e4021ea5bd2"},{"bytes":3725,"media_type":"application/json","path":"results/Antfly/result_20261007_015a68a0044d4acf92dcf70d095cb2ee_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"443ed8e603b6a5c3cf3a7a09b25d04e67c3115b4d0627cfa834543cf5de177d1"},{"bytes":3728,"media_type":"application/json","path":"results/Antfly/result_20261007_204973261f1743c6bd108b83c8107195_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"ec8e91237dea39ceae158993d5f6c962a01a56b9917ecadb8d103ff4b5a56953"},{"bytes":3332,"media_type":"application/json","path":"results/Antfly/result_20261007_21227e7abe664bd797baa2d8e843e52e_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"a64e38f3416edd2794652bf09ebf6258ea0861a833cdf3aac5997c53f80161d9"},{"bytes":3730,"media_type":"application/json","path":"results/Antfly/result_20261007_318a1d339d194f43b57c041a6e779238_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"7b9d75fadd1d67b4300553df4337e2d2563d8ff10b198dfbf5995ac79fa31f3f"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_3ab0606d9555433e8dff9823b45e4037_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"99086aa36e3f46f460806a397541eaaba942f0b106476cfe949af10f9591d5b0"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_46370d6ee1fa4e54a185088a2415d149_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"eb80d14015ac179defaa25e9845d026998633f5e79b90b027509a2cd49735165"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_4e3e9b74fb9345dfa118cd4ef2fba393_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"b80692f5ebe3bda9eaf9b8664d4b1e288816312e5c8ee42e304776e927ad9b56"},{"bytes":4414,"media_type":"application/json","path":"results/Antfly/result_20261007_5b888f495e1947fba211cfb9e720a48d_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"30d8d7a617e2d0706022bc6b36e839cce319abc5a97a14688f715313cfe2ac89"},{"bytes":3728,"media_type":"application/json","path":"results/Antfly/result_20261007_6e66590e689a488f9eff331907f90cb6_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"4fbfb9d9226d5b54712d180833d9d941f4048c4375346d4948b6ef5e727f59ee"},{"bytes":3730,"media_type":"application/json","path":"results/Antfly/result_20261007_7a211d31201c49d38cc6fe90ec79e1d4_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"781bc7c2220a421ab243065f215fdefb271ba13963cfaa012c01dd023692cb36"},{"bytes":3728,"media_type":"application/json","path":"results/Antfly/result_20261007_96b16f887fa0464abdc65142b2ca2463_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"1149691e22a3057f91cf08ea85da5cedffe0c3bd9213d0813fc4c21be32db500"},{"bytes":3729,"media_type":"application/json","path":"results/Antfly/result_20261007_b04cc6dee84948eb82c61f677e330b1b_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"1108f03e42b2019eaf7f1b150ef500e24dbe8b95bee0df928fb24830a6cccb70"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_ee4b1d15239848e49facf447f2d7b59f_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"08a0abd00cec54682aeadea17b307e83f2b641ad72555b18dd1b38649059e925"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_f31e7397bc0346d58775f0da660009c9_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"c1fd0580abe6710a84275f245f5980d60a7b401136c626597981fda9cf2e12a3"},{"bytes":634,"media_type":"application/json","path":"results/publication-protocol.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"8a91260633bc8e26d26d7777e650c95756cbb7cf077fe5028077ef8461928692"},{"bytes":5674,"media_type":"application/json","path":"selected-config.json","retention":"evidence","role":"qualification","schema_version":1,"sha256":"78139ec8058afaf8803c1df688a5e5f03b7447493ad2a9d09581307b51d89958"},{"bytes":3,"media_type":"application/json","path":"status.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570"},{"bytes":7028,"media_type":"application/json","path":"storage.json","retention":"evidence","role":"storage","schema_version":1,"sha256":"f0a19e6e7b01adf40acb84ecd7ba25f328053c5f78c3fcd55f7638fe3abd6e18"},{"bytes":886,"media_type":"application/json","path":"supervisor-result.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"1d86f784bc02faa5ab2c0ec260d5c2debf7899cd6d2d45732ec9a8dda32f23f6"}],"generated_at":"1791398293.6047776","kind":"publication-lifecycle","retained_bytes":1166994,"schema_version":1},"status":"ok","storage":{"created_at":"2026-10-07T18:21:08.868321+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-big-800k"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-07T18:21:08.989811+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-07T18:21:08.989780+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]}],"stage":"empty","started_at":"2026-10-07T18:21:08.908352+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]},"final":{"allocated_bytes":4235501568,"apparent_bytes":4229610154,"completed_at":"2026-10-07T18:37:55.227756+00:00","samples":[{"allocated_bytes":4235501568,"apparent_bytes":4229610154,"captured_at":"2026-10-07T18:37:55.227727+00:00","entries":2963,"volumes":[{"allocated_bytes":4235501568,"apparent_bytes":4229610154,"entries":2963,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-07T18:37:55.122415+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-big-800k","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":4235501568,"apparent_bytes":4229610154,"entries":2963,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]},"post_workload":{"allocated_bytes":4235497472,"apparent_bytes":4229608631,"completed_at":"2026-10-07T18:37:54.242003+00:00","samples":[{"allocated_bytes":4235497472,"apparent_bytes":4229608631,"captured_at":"2026-10-07T18:37:54.241979+00:00","entries":2961,"volumes":[{"allocated_bytes":4235497472,"apparent_bytes":4229608631,"entries":2961,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-07T18:37:54.093381+00:00","volumes":[{"allocated_bytes":4235497472,"apparent_bytes":4229608631,"entries":2961,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-07T18:21:11.540277+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-07T18:21:11.540250+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]}],"stage":"ready","started_at":"2026-10-07T18:21:11.460456+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"name":"circus_vdbb_scale_t1_scale-big-800k-antfly-data"}]},"protocol_fingerprint":"b2c1dee7d43ceaf8ab91b8e54050e9ed0a3ba730680c1c61f017de1366d9498a","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-07T18:37:55.227759+00:00"},"trial":1,"vectors":800000,"workload_id":"scale-big-800k"},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p5","ndcg":0.9947,"p95_ms":27.7,"p99_ms":39.9,"parameter":"search_effort","recall":0.9932,"status":"ok","value":0.5,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p55","ndcg":0.9952,"p95_ms":23.1,"p99_ms":25.8,"parameter":"search_effort","recall":0.9938,"status":"ok","value":0.55,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p475","ndcg":0.9928,"p95_ms":21.3,"p99_ms":27.8,"parameter":"search_effort","recall":0.9914,"status":"ok","value":0.475,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-1","ndcg":0.9962,"p95_ms":58.9,"p99_ms":73.2,"parameter":"search_effort","recall":0.995,"status":"ok","value":1,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p425","ndcg":0.9808,"p95_ms":16.4,"p99_ms":23.4,"parameter":"search_effort","recall":0.9779,"status":"ok","value":0.425,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p45","ndcg":0.9881,"p95_ms":18.7,"p99_ms":26.3,"parameter":"search_effort","recall":0.9862,"status":"ok","value":0.45,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p375","ndcg":0.9543,"p95_ms":13.8,"p99_ms":16.7,"parameter":"search_effort","recall":0.9484,"status":"ok","value":0.375,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p8","ndcg":0.9959,"p95_ms":34.7,"p99_ms":58,"parameter":"search_effort","recall":0.9948,"status":"ok","value":0.8,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p35","ndcg":0.9342,"p95_ms":53.8,"p99_ms":107.5,"parameter":"search_effort","recall":0.9262,"status":"ok","value":0.35,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p6","ndcg":0.9955,"p95_ms":24.6,"p99_ms":29.1,"parameter":"search_effort","recall":0.9942,"status":"ok","value":0.6,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p7","ndcg":0.9957,"p95_ms":27.9,"p99_ms":30.6,"parameter":"search_effort","recall":0.9944,"status":"ok","value":0.7,"workload":"scale-big-1m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-1m-0p4","ndcg":0.9702,"p95_ms":13.3,"p99_ms":15.8,"parameter":"search_effort","recall":0.9662,"status":"ok","value":0.4,"workload":"scale-big-1m"}],"cell_sha256":"beed7e6d69374573b4b9da50e5cb675c172477fcbb40915d29131fd9694b638d","index_build":{"insert_duration":371.333,"optimize_duration":138.323,"seconds":509.65600000000006},"lifecycle":{"attempt":1,"elapsed_seconds":1206.953,"finished_at":1791399501.0166483,"returncode":0,"started_at":1791398294.0628188,"status":"ok","trial":1},"memory":{"anon_shmem_peak_mb":4717.9,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":10704.6,"cgroup_current_peak_mb":10703.4,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":4717.9,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":10703409152,"cgroup_kernel_peak_sum_bytes":10704601088,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":4717891584,"ended":1791399473.3927126,"failed_samples":0,"first_sample_at":1791398298.0176492,"kind":"container_cgroup_v2","last_sample_at":1791399473.1904955,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":3584,"schema_version":3,"started":1791398297.9602928,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791398298.0176492,"index_started_at":1791398298.1385334,"last_sample_at":1791399473.1904955,"max_sample_gap_s":1.225,"publication_finished_at":1791399473.0976768,"sampler_ended_at":1791399473.3927126,"sampler_started_at":1791398297.9602928,"samples":3584,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"profile":"big","publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.013770856417271259,0.01165101909257521,0.014748323974478342,0.029281768992317568,0.046786783151077135],"conc_latency_p95_list":[0.024250779181602407,0.016754773751017638,0.02265596080978865,0.05039757270133122,0.08545301810518141],"conc_latency_p99_list":[0.041765583966625504,0.022200740000698715,0.030543791776872237,0.06815200899960472,0.12773292549332893],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[72.4981,428.0395,675.4045,678.8913,635.8068],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9658,"optimize_duration":0,"p99_c30_ms":127.73292549332893,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":20,"peak_qps":678.8913,"qps":678.8913,"qps_c30":635.8068,"recall":0.9615,"searchable_after_insert_seconds":0,"serial_latency_p95":0.0175,"serial_latency_p99":0.0318,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"selection_status":"superseded","serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":371.3,"load_s":509.7,"source_label":"antfly-qualification-scale-big-1m-0p35"},"ndcg":0.9702,"p95_ms":13.3,"p99_ms":15.8,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9662,"selection_mode":"swept","value":0.4},"source":{"cache_key":"50663c8619d782665c14d153244298835762bab104a843cc723b803eec21af28","finished_at":1791399501.0166483,"object_sha256":"fd2c339c720e2311159bee8a774562a81daaecbf359419a89344895cbf433605","receipt_sha256":"03d1fbeef7915cfaf09bf417fb500d481a812649de2e0d50bf04f983f65d93e9","started_at":1791398294.0628188},"source_receipt":{"benchmark_id":"vector-vdbbench-scale","files":[{"bytes":12519,"media_type":"application/json","path":"cell-result.json","retention":"evidence","role":"normalized-result","schema_version":1,"sha256":"beed7e6d69374573b4b9da50e5cb675c172477fcbb40915d29131fd9694b638d"},{"bytes":8266,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-1m-0p35.log","retention":"evidence","role":"log","schema_version":null,"sha256":"34bfbe8bebcb964a3e2247f43ee0e48204f7e24f9f9f70ec6ed3dd49b5be8778"},{"bytes":9366,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-1m-0p35_load.log","retention":"evidence","role":"log","schema_version":null,"sha256":"448c01a203f7361b7b3a906bfd76f2a72380bde880296d1d715f3e0c2467bc91"},{"bytes":8273,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-1m-0p375.log","retention":"evidence","role":"log","schema_version":null,"sha256":"922e550fd24a123025f3e89a58885f0eacf75c8477528d352c6d7c07c8b4da0e"},{"bytes":8258,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-1m-0p4.log","retention":"evidence","role":"log","schema_version":null,"sha256":"8b7c9ddd11bd02c048a2bf3647846336c6181a8841cfd303154b3b8c7debc439"},{"bytes":8274,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-1m-0p425.log","retention":"evidence","role":"log","schema_version":null,"sha256":"32a6f980c1742b7de38868080c8c2b578194f8923657b791c5ec9e42d13a04a0"},{"bytes":8266,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-1m-0p45.log","retention":"evidence","role":"log","schema_version":null,"sha256":"f028c7cbe5075b1ddd13ac2dca04f58398a93061dbe1f4c742026ce5b23a74bf"},{"bytes":8274,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-1m-0p475.log","retention":"evidence","role":"log","schema_version":null,"sha256":"10c73f54f17ccbcf87e520f15c31a62f6b11b913c61368915cc5e0f3a402f907"},{"bytes":8256,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-1m-0p5.log","retention":"evidence","role":"log","schema_version":null,"sha256":"d3477c0dfd11ddaa0f1cf420fcbfb9b95c9e598ea8716d0ad15ef4ae1b1a4e2f"},{"bytes":8266,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-1m-0p55.log","retention":"evidence","role":"log","schema_version":null,"sha256":"c56cebee6cd9343488fb4aac3714af8c556611ca863c1826e8d84506b822d936"},{"bytes":8258,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-1m-0p6.log","retention":"evidence","role":"log","schema_version":null,"sha256":"5521c6396dea7c1242301bbf10288cd8e3c53f16b10fa1028273d38750224011"},{"bytes":8258,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-1m-0p7.log","retention":"evidence","role":"log","schema_version":null,"sha256":"8b8b1d312fd3cf4539bab92f3e0fc43f84293141d567c07dbd58368d8415eecd"},{"bytes":8255,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-1m-0p8.log","retention":"evidence","role":"log","schema_version":null,"sha256":"a19a686c3125ce4190910101d5acf3b3b25032b08dcf559b6b0860bd0e934cba"},{"bytes":8242,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-1m-1.log","retention":"evidence","role":"log","schema_version":null,"sha256":"f40e771fee450df2e7c16f5282bb7333971117f5b4b7ee40b627d3032c4da89e"},{"bytes":23569,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"9fd2cce771586f164e614c41aee17bd72015142af512da094f61cac8cf959320"},{"bytes":987,"media_type":"application/json","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.json","retention":"evidence","role":"log","schema_version":1,"sha256":"c2b1f1f8449fd6a497bd8c8a1028dfc55b873fad03b98dc7a5cce76c337936c9"},{"bytes":932748,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.jsonl","retention":"evidence","role":"memory-timeline","schema_version":null,"sha256":"94200e947930b2e690e01464cf09098f13c285722e49343d1ea159422d690347"},{"bytes":0,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"},{"bytes":137199,"media_type":"application/octet-stream","path":"logs/supervisor.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e7304d60b3bff3c1f0fe2cbc6cc01bd5611a87ed0b2813ffce19d05025e95516"},{"bytes":2586,"media_type":"application/json","path":"memory.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"a36fcca831f98d8789bc887826123e3335420528e808afccee1ad466916508c0"},{"bytes":87,"media_type":"application/json","path":"quiet-host.json","retention":"evidence","role":"quiet-host","schema_version":1,"sha256":"b6fd71707081f58326be630e9872b9fbf258639be433d6e87cff9e4021ea5bd2"},{"bytes":3722,"media_type":"application/json","path":"results/Antfly/result_20261007_02fcbe6c7b4c42e2a01f44e77446cab7_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"140afd562779600790db65416c47bb19b011d441b350ab138b9526e58a011c15"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_1e559b4e64864d7a8ce34ad1bfc21be4_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"9999aacb92743c85a5fdd6e5e999f0c5e15932ff8af0f7841ff4ce96c5a42555"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_2df0652c41e34138a5495c8c58034cef_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"f5f5f7c7ecb9cc3fb3c006eba041d9d2a4117db605f865bd454ea5c3ad506c49"},{"bytes":3719,"media_type":"application/json","path":"results/Antfly/result_20261007_37f533ee41f54304be6cd813e6428ec0_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"7f8fee2c2186d371c559049476fa069b42d6d8880ffcb84cc850ce9740fb9094"},{"bytes":3327,"media_type":"application/json","path":"results/Antfly/result_20261007_7e5d4e5551354560ac041e010c807c3b_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"66796768b72ad8fbcf8610ea90f5533ea95aa76dc80428dcacdc65a5f7437dbb"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_99c469f807d043d4964cd7ac62e70d75_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"0ae3ee9fda1077d5d6d9af10bf550c1cd188481013bbb68570cf6a00df943347"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_a28e117a89de4a5e9dd5d03a39f18049_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"30a7387633fc74f6f404fb7d89d1a294a65c9bcc59f571a73705a661b1823bf4"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_aa671d2ec3bc488fb86590e122ea17d2_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"c2c058a5c011f6dbdb1884b817fbeb07c837df228a85d6a26c69926b19e484ce"},{"bytes":3721,"media_type":"application/json","path":"results/Antfly/result_20261007_aeebc9aa4c8d4f1398e66716a8bf9dab_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"3563e9b62d1d641c91b2cc3d7364dbf5a7c0f2dc9755508abca9e263cb8a932c"},{"bytes":4414,"media_type":"application/json","path":"results/Antfly/result_20261007_b7fcbee375b443189c8e9528533180ad_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"265cbd6e98c79edd401bdb3d9412049b46d3ba0b7c66fda476856371d6e05ab2"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_d34aa012a7454c33a0e6d3e1a6023614_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"17246582e023acbe35e4c1aa2072751e555d25cf37f39caff6e4e8da5f779cd5"},{"bytes":3722,"media_type":"application/json","path":"results/Antfly/result_20261007_d6a154af95e24466b05c474664d44822_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"1623b139dda387054f1ba7f246d50efd4107f3ec45a06e4f818152098014e227"},{"bytes":3722,"media_type":"application/json","path":"results/Antfly/result_20261007_e8d36f98181049a4972f00b4243bc65f_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"c190acd9254bf7efe8c88c8a60c49d59f51d88357713f642fcec870aeccf4c66"},{"bytes":3722,"media_type":"application/json","path":"results/Antfly/result_20261007_f163467c8f044a2cb91321e7ec929598_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"b261e398e812b16437fab508cb0911ae0ed7099386a1b795b916c2a994097ac1"},{"bytes":634,"media_type":"application/json","path":"results/publication-protocol.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"8a91260633bc8e26d26d7777e650c95756cbb7cf077fe5028077ef8461928692"},{"bytes":5617,"media_type":"application/json","path":"selected-config.json","retention":"evidence","role":"qualification","schema_version":1,"sha256":"d92b04e506d20b8124dc00f9a2c5de244884115b17a1ef1ec7b12d0ae45bbdfa"},{"bytes":3,"media_type":"application/json","path":"status.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570"},{"bytes":7006,"media_type":"application/json","path":"storage.json","retention":"evidence","role":"storage","schema_version":1,"sha256":"0e93966ed01f1fece078a2f7fd00356e0000c557b32c51acf35a6e6a59b79c7a"},{"bytes":880,"media_type":"application/json","path":"supervisor-result.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"3bfdbcf377f26696379aa252449dec9cdf5c82b3fb601cdbc7f0e9a310a829a4"}],"generated_at":"1791399501.0166483","kind":"publication-lifecycle","retained_bytes":1284766,"schema_version":1},"status":"ok","storage":{"created_at":"2026-10-07T18:38:15.209399+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-big-1m"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-07T18:38:15.327636+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-07T18:38:15.327611+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]}],"stage":"empty","started_at":"2026-10-07T18:38:15.247922+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]},"final":{"allocated_bytes":5935198208,"apparent_bytes":5928524593,"completed_at":"2026-10-07T18:57:55.135712+00:00","samples":[{"allocated_bytes":5935198208,"apparent_bytes":5928524593,"captured_at":"2026-10-07T18:57:55.135686+00:00","entries":3351,"volumes":[{"allocated_bytes":5935198208,"apparent_bytes":5928524593,"entries":3351,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-07T18:57:55.009053+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-big-1m","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":5935198208,"apparent_bytes":5928524593,"entries":3351,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]},"post_workload":{"allocated_bytes":5935190016,"apparent_bytes":5928523220,"completed_at":"2026-10-07T18:57:53.777817+00:00","samples":[{"allocated_bytes":5935190016,"apparent_bytes":5928523220,"captured_at":"2026-10-07T18:57:53.777789+00:00","entries":3349,"volumes":[{"allocated_bytes":5935190016,"apparent_bytes":5928523220,"entries":3349,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-07T18:57:53.618632+00:00","volumes":[{"allocated_bytes":5935190016,"apparent_bytes":5928523220,"entries":3349,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-07T18:38:17.872223+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-07T18:38:17.872197+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]}],"stage":"ready","started_at":"2026-10-07T18:38:17.784767+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"name":"circus_vdbb_scale_t1_scale-big-1m-antfly-data"}]},"protocol_fingerprint":"61434338bfd0ba2f6efe596803748432bb05e33f469e753e7a58466d00b2bfd2","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-07T18:57:55.135715+00:00"},"trial":1,"vectors":1000000,"workload_id":"scale-big-1m"},{"calibration_candidates":[{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p375","ndcg":0.9273,"p95_ms":33.4,"p99_ms":45.3,"parameter":"search_effort","recall":0.9194,"status":"ok","value":0.375,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p425","ndcg":0.9646,"p95_ms":35.3,"p99_ms":110.9,"parameter":"search_effort","recall":0.9599,"status":"ok","value":0.425,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p5","ndcg":0.9895,"p95_ms":33.5,"p99_ms":46.2,"parameter":"search_effort","recall":0.9875,"status":"ok","value":0.5,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p45","ndcg":0.9763,"p95_ms":33.9,"p99_ms":44.8,"parameter":"search_effort","recall":0.973,"status":"ok","value":0.45,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p35","ndcg":0.9011,"p95_ms":262.8,"p99_ms":411.2,"parameter":"search_effort","recall":0.8913,"status":"ok","value":0.35,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p35","ndcg":0,"p95_ms":null,"p99_ms":null,"parameter":"search_effort","recall":0,"status":"ok","value":0.35,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p55","ndcg":0.9911,"p95_ms":39,"p99_ms":100.1,"parameter":"search_effort","recall":0.9894,"status":"ok","value":0.55,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p475","ndcg":0.9844,"p95_ms":31.9,"p99_ms":35.2,"parameter":"search_effort","recall":0.9819,"status":"ok","value":0.475,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p8","ndcg":0.9955,"p95_ms":58.7,"p99_ms":86.7,"parameter":"search_effort","recall":0.9942,"status":"ok","value":0.8,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p6","ndcg":0.9932,"p95_ms":42.2,"p99_ms":63,"parameter":"search_effort","recall":0.9917,"status":"ok","value":0.6,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p7","ndcg":0.9948,"p95_ms":66.8,"p99_ms":135.9,"parameter":"search_effort","recall":0.9933,"status":"ok","value":0.7,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-1","ndcg":0.9957,"p95_ms":180,"p99_ms":257.9,"parameter":"search_effort","recall":0.9944,"status":"ok","value":1,"workload":"scale-big-2m"},{"case_id":101,"engine":"antfly","label":"antfly-qualification-scale-big-2m-0p4","ndcg":0.9479,"p95_ms":29.2,"p99_ms":35.6,"parameter":"search_effort","recall":0.9416,"status":"ok","value":0.4,"workload":"scale-big-2m"}],"cell_sha256":"6a59394d8921e7be29aab82716b06dfd382e92bec641b86764675af15ccc0bfb","index_build":{"insert_duration":931.1325,"optimize_duration":926.9938,"seconds":1858.1263},"lifecycle":{"attempt":1,"elapsed_seconds":2690.344,"finished_at":1791402191.910954,"returncode":0,"started_at":1791399501.566736,"status":"ok","trial":1},"memory":{"anon_shmem_peak_mb":6975.2,"cache_inclusive_peak_kind":"single_cgroup_memory_peak","cache_inclusive_peak_mb":12999.8,"cgroup_current_peak_mb":12989.6,"container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_mb":6975.2,"exact_summary":{"baseline_source":"not_applicable","cache_inclusive_peak_bytes":12989550592,"cgroup_kernel_peak_sum_bytes":12999794688,"contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","demand_peak_bytes":6975164416,"ended":1791402163.2147017,"failed_samples":0,"first_sample_at":1791399504.1030898,"kind":"container_cgroup_v2","last_sample_at":1791402163.0116303,"metric":"swap_backed_demand_excluding_reclaimable_file_cache","sample_interval_seconds":0.2,"samples":7674,"schema_version":3,"started":1791399504.0469205,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"failed_samples":0,"first_sample_at":1791399504.1030898,"index_started_at":1791399504.2183409,"last_sample_at":1791402163.0116303,"max_sample_gap_s":1.54,"publication_finished_at":1791402162.7197132,"sampler_ended_at":1791402163.2147017,"sampler_started_at":1791399504.0469205,"samples":7674,"status":"qualified","trial":1,"yardstick":"linux_cgroup_v2_anon_plus_shmem.v1"},"profile":"big","publication_metrics":{"additional_parameters":{"query_selection":{"calibration_queries":200,"exact_overlap":0,"indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","mode":"deterministic_partition","publication_queries":800,"queries":800,"role":"publication","schema_version":1,"seed":"antfly-circus-vdbbench-v1","source_queries":1000}},"conc_latency_avg_list":[0.07618123532918773,0.034207894898875886,0.0410539561331511,0.17370477604955326,0.8876809526370907],"conc_latency_p95_list":[0.14812149424978996,0.08756759949028492,0.0828242428964581,0.4306896999842136,1.9706757719977759],"conc_latency_p99_list":[0.20962114844587618,0.1738265156047415,0.4234155904842191,0.7298248005364433,3.0176897606113924],"conc_num_list":[1,5,10,20,30],"conc_qps_list":[13.1022,145.815,242.5212,113.9526,33.3684],"indexed_after_searchable_seconds":0,"insert_completion_seconds":0,"insert_duration":0,"insert_rows_per_second":0,"inserted_count":0,"load_duration":0,"max_load_count":0,"mrr":0,"ndcg":0.9637,"optimize_duration":0,"p99_c30_ms":3017.6897606113926,"payload_estimated_bytes_per_query":2000,"payload_profile":"ids_only","peak_concurrency":10,"peak_qps":242.5212,"qps":242.5212,"qps_c30":33.3684,"recall":0.9587,"searchable_after_insert_seconds":0,"serial_latency_p95":0.1334,"serial_latency_p99":0.1842,"st_conc_failed_rate_list":[],"st_conc_latency_avg_list_list":[],"st_conc_latency_p95_list_list":[],"st_conc_latency_p99_list_list":[],"st_conc_num_list_list":[],"st_conc_qps_list_list":[],"st_ideal_insert_duration":0,"st_max_qps_list_list":[],"st_ndcg_list":[],"st_recall_list":[],"st_search_stage_list":[],"st_search_time_list":[],"st_serial_latency_p95_list":[],"st_serial_latency_p99_list":[]},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","request_errors":0,"selection_status":"superseded","serial_qualification":{"below_qualification_floor":false,"load_metrics":{"insert_s":931.1,"load_s":1858.1,"source_label":"antfly-qualification-scale-big-2m-0p35"},"ndcg":0.9646,"p95_ms":35.3,"p99_ms":110.9,"parameter":"search_effort","qualification_floor":0.955,"recall":0.9599,"selection_mode":"swept","value":0.425},"source":{"cache_key":"20296a5bcf2369ad6b2e881efdc84bb892e8afa09a0b74108833451e5edace01","finished_at":1791402191.910954,"object_sha256":"7b0e96d68ac970fbf1e3053ca3efc2a765619aa764d11f658b41540340be4ed4","receipt_sha256":"42343e6efad02ce4802692a3f3dd090d1751dbf8b7fcabb84324cd4ca7eba432","started_at":1791399501.566736},"source_receipt":{"benchmark_id":"vector-vdbbench-scale","files":[{"bytes":12505,"media_type":"application/json","path":"cell-result.json","retention":"evidence","role":"normalized-result","schema_version":1,"sha256":"6a59394d8921e7be29aab82716b06dfd382e92bec641b86764675af15ccc0bfb"},{"bytes":8267,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-2m-0p35.log","retention":"evidence","role":"log","schema_version":null,"sha256":"031c9f048ce095b4f6f9ec5f10aabe63cda059f9d2992a3290504dc760cb9513"},{"bytes":9506,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-2m-0p35_load.log","retention":"evidence","role":"log","schema_version":null,"sha256":"6d6867cc7c7de4a83221bd4b88022ef660a325a001ed6f0f924bc35aae4f0d7e"},{"bytes":8274,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-2m-0p375.log","retention":"evidence","role":"log","schema_version":null,"sha256":"675e2a8b212c0b8e9720efc13919d26ed984373abf6d0dd62f167ad5c1dcd3da"},{"bytes":8258,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-2m-0p4.log","retention":"evidence","role":"log","schema_version":null,"sha256":"ec23dcd6974f89e52fcdcfbd2e575363e84afa6a222ad0d536654bde1801a61b"},{"bytes":8274,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-2m-0p425.log","retention":"evidence","role":"log","schema_version":null,"sha256":"cfe89f80f3b2be9084038e899598746cd7e4ba487a43ac737af053001a4e32c0"},{"bytes":8263,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-2m-0p45.log","retention":"evidence","role":"log","schema_version":null,"sha256":"c894ab40640991a24f16a08b3d8ae2315eeec21e316b2d2c62bf17e56b90b19d"},{"bytes":8274,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-2m-0p475.log","retention":"evidence","role":"log","schema_version":null,"sha256":"cb2c59115b7ff92be0f8e461654ec9d354603165207ca37dd70c8abd5224df76"},{"bytes":8258,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-2m-0p5.log","retention":"evidence","role":"log","schema_version":null,"sha256":"f8dc85cd706ee7251ba3e5cbf1e8881d189157e9125d3a825d4582f6c4409204"},{"bytes":8263,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-2m-0p55.log","retention":"evidence","role":"log","schema_version":null,"sha256":"a1ed66225aca443b179c583115e18000d77307f701e686eafbacaa6f2bc94fa8"},{"bytes":8255,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-2m-0p6.log","retention":"evidence","role":"log","schema_version":null,"sha256":"549d9c490efd8c5b2d7cbfb215fb2750bf12a22b2177423f62d5c33b0b6e1e2d"},{"bytes":8258,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-2m-0p7.log","retention":"evidence","role":"log","schema_version":null,"sha256":"38a16f8e64235394ec8b9a998e3e887064b5a89a10d1d1113273b6b17dea4495"},{"bytes":8258,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-2m-0p8.log","retention":"evidence","role":"log","schema_version":null,"sha256":"9ad3377b490ef996d4a65fd188516ab9c9c645d40f204aae71a2aef6ac239569"},{"bytes":8237,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-qualification-scale-big-2m-1.log","retention":"evidence","role":"log","schema_version":null,"sha256":"44781bd9175ed0dcb3f521e0ddf5e31e1c3ed04a3e2b4a55f6a5f9f12b94d11b"},{"bytes":23265,"media_type":"application/octet-stream","path":"logs/PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"d13286a7e10666ce2ca891648a58d2f296a4a79f8af19c11371dffcda1762742"},{"bytes":987,"media_type":"application/json","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.json","retention":"evidence","role":"log","schema_version":1,"sha256":"13d525b06ab253032fbd7f00019ac929ae65784062be8eac54cd47bc681f24a8"},{"bytes":2009114,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.jsonl","retention":"evidence","role":"memory-timeline","schema_version":null,"sha256":"f28b158e585a41bbac074b0cd0bbc815cf2ce2f27259103e2c36f12af6c6b657"},{"bytes":0,"media_type":"application/octet-stream","path":"logs/mem-lifecycle-trial1-PerformanceCustomDataset_antfly-scale.log","retention":"evidence","role":"log","schema_version":null,"sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"},{"bytes":137028,"media_type":"application/octet-stream","path":"logs/supervisor.log","retention":"evidence","role":"log","schema_version":null,"sha256":"8e3814ff9cc4585a6f4f6290aed3d50acc5099a44c7dba0809896a1c3e70ddc5"},{"bytes":2585,"media_type":"application/json","path":"memory.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"098f5692f258a1b92754a99def764df5dea1bdf6925bb5adb6edfa6353f8ab6e"},{"bytes":87,"media_type":"application/json","path":"quiet-host.json","retention":"evidence","role":"quiet-host","schema_version":1,"sha256":"b6fd71707081f58326be630e9872b9fbf258639be433d6e87cff9e4021ea5bd2"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_00f6f01857ff41b9b9e779dc844d65d3_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"61fc70120c74b0d9420969e5b067b59f45a0eb8216dceb58f7ed26999f377169"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_0af78e28350d4a6a8bc03dca7ea3d727_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"28eec6eab6a01a851031b02e95d000e253a85c444c98a37d33c93d581df711c2"},{"bytes":4397,"media_type":"application/json","path":"results/Antfly/result_20261007_10fa45502863405eb0c9f35877ee121a_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"4e422bac47b82495ff8cc8b0232b688daed720ee5170f74df8ab95d0ce627fbb"},{"bytes":3722,"media_type":"application/json","path":"results/Antfly/result_20261007_1a2514f770e74158b383d52de0189503_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"3516289b162ebb954eb6bd9f91aef85f3bbaa948e385dbc649591a38ac12baca"},{"bytes":3723,"media_type":"application/json","path":"results/Antfly/result_20261007_21273eb7a15244a7b0412d8e073b6f23_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"c3f7edf543759aaaf54a97e5ea4c4c0d50406083130ba036883cf93d662aea8b"},{"bytes":3724,"media_type":"application/json","path":"results/Antfly/result_20261007_2e0799010f844ae78b3804f9128b7fde_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"27b13135250a15ce4cddf3e81b8d7fe9b1a9c446c6a3569e6872c9b13f90dccc"},{"bytes":3331,"media_type":"application/json","path":"results/Antfly/result_20261007_3389fdf90c80449e8f406d0d203cb902_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"a51a7c6525d1cafd0b642e7794f1c0ec1e46680fba06cebc2f4eaaed63ded6d7"},{"bytes":3723,"media_type":"application/json","path":"results/Antfly/result_20261007_868ff35bbbf3476386791d774623bbf6_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"ab48fdadfb51281c65bd53d033ab980d576747d22db8ecdd2e96ff078c19ab3c"},{"bytes":3726,"media_type":"application/json","path":"results/Antfly/result_20261007_8b7c154e11e549799d3c75d87501bf8b_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"434e33f58635fa723750b678dab811d94a9423a4b47105454425fef7f97d5891"},{"bytes":3722,"media_type":"application/json","path":"results/Antfly/result_20261007_a234fd2c85b045d0b7a3f6f297e934f3_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"cc81ded2bfd4566d05cce7899af0acb9c4cea37db1c045cd09f7b6602b6fc43b"},{"bytes":3721,"media_type":"application/json","path":"results/Antfly/result_20261007_b07168ed3d9f4f8b8cd85c32ad641fa9_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"a4fd88119f42e0d77de019688c3518e0307a59a35b6ad4fa98088a966bbfd744"},{"bytes":3722,"media_type":"application/json","path":"results/Antfly/result_20261007_cfd0bef9e8ab4db9bf493b62abe7d1a7_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"cf058562bae3268684fb9493c2069b5efa05f8160b85cb9810230480244abd08"},{"bytes":3718,"media_type":"application/json","path":"results/Antfly/result_20261007_db8dfd64f96346a5b81b9bbe507ca312_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"28e4eb17375ec56ebc14be1085bac3bb7e9429ac6cc4c771bb827342b2dba5eb"},{"bytes":3722,"media_type":"application/json","path":"results/Antfly/result_20261007_f0eda42e96e74c92ae40be8c96353e9a_antfly.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"1978f047a26e20d72a3373c9e15ef341c27a807bad9bb7dade4b287e3759599e"},{"bytes":634,"media_type":"application/json","path":"results/publication-protocol.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"8a91260633bc8e26d26d7777e650c95756cbb7cf077fe5028077ef8461928692"},{"bytes":5627,"media_type":"application/json","path":"selected-config.json","retention":"evidence","role":"qualification","schema_version":1,"sha256":"f5895b6cfe4ad4a8a6cfe89f5a2ff24e9d36acaba7ed62acf274fad17d0c8dc5"},{"bytes":3,"media_type":"application/json","path":"status.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"37517e5f3dc66819f61f5a7bb8ace1921282415f10551d2defa5c3eb0985b570"},{"bytes":7016,"media_type":"application/json","path":"storage.json","retention":"evidence","role":"storage","schema_version":1,"sha256":"8cbdf68e60080f409e0d31cb4c7e2c7cb29f1b62eb8d63d672131d72472a1ba2"},{"bytes":878,"media_type":"application/json","path":"supervisor-result.json","retention":"evidence","role":"raw","schema_version":1,"sha256":"0ccd78277125b3de2172908d96e087c2bb5494696cd2aca06866816c4876cdac"}],"generated_at":"1791402191.910954","kind":"publication-lifecycle","retained_bytes":2360777,"schema_version":1},"status":"ok","storage":{"created_at":"2026-10-07T18:58:22.922495+00:00","headline_metric":"final_allocated_bytes","identity":{"engine":"antfly","trial":"1","workload":"scale-big-2m"},"metric_version":"linux-local-volume-final-allocated-bytes.v2","observations":{"empty":{"allocated_bytes":0,"apparent_bytes":6,"completed_at":"2026-10-07T18:58:23.295008+00:00","samples":[{"allocated_bytes":0,"apparent_bytes":6,"captured_at":"2026-10-07T18:58:23.294977+00:00","entries":0,"volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]}],"stage":"empty","started_at":"2026-10-07T18:58:23.166277+00:00","volumes":[{"allocated_bytes":0,"apparent_bytes":6,"entries":0,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]},"final":{"allocated_bytes":15659958272,"apparent_bytes":15659349184,"completed_at":"2026-10-07T19:42:48.510042+00:00","samples":[{"allocated_bytes":15659958272,"apparent_bytes":15659349184,"captured_at":"2026-10-07T19:42:48.509960+00:00","entries":426,"volumes":[{"allocated_bytes":15659958272,"apparent_bytes":15659349184,"entries":426,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]}],"service_stopped":true,"stage":"final","started_at":"2026-10-07T19:42:48.367961+00:00","termination":{"container":"antfly_bench_vdbb_scale_t1_scale-big-2m","exit_code":0,"forced":false,"oom_killed":false,"stop_command_error":null},"volumes":[{"allocated_bytes":15659958272,"apparent_bytes":15659349184,"entries":426,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]},"post_workload":{"allocated_bytes":15659954176,"apparent_bytes":15659349017,"completed_at":"2026-10-07T19:42:43.997158+00:00","samples":[{"allocated_bytes":15659954176,"apparent_bytes":15659349017,"captured_at":"2026-10-07T19:42:43.997127+00:00","entries":424,"volumes":[{"allocated_bytes":15659954176,"apparent_bytes":15659349017,"entries":424,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]}],"stage":"post_workload","started_at":"2026-10-07T19:42:43.733298+00:00","volumes":[{"allocated_bytes":15659954176,"apparent_bytes":15659349017,"entries":424,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]},"ready":{"allocated_bytes":53248,"apparent_bytes":6548,"completed_at":"2026-10-07T18:58:23.949375+00:00","samples":[{"allocated_bytes":53248,"apparent_bytes":6548,"captured_at":"2026-10-07T18:58:23.949346+00:00","entries":48,"volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]}],"stage":"ready","started_at":"2026-10-07T18:58:23.858065+00:00","volumes":[{"allocated_bytes":53248,"apparent_bytes":6548,"entries":48,"filesystem_block_bytes":4096,"filesystem_type":"xfs","name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]}},"protocol":{"barriers":["empty","ready","post_workload","final"],"comparability":"linux_container_local_volume_allocated_bytes.v2","container_runtime":{"architecture":"arm64","cli":"docker","os_type":"linux","storage_driver":"overlay","version":"6.1.1"},"excluded_roles":["benchmark_inputs","model_and_dataset_caches","client_scratch","logs","read_only_binaries","container_image_layers","dev_shm"],"measurement":{"allocated_bytes":"whole_volume_du_kib_times_1024","apparent_bytes":"whole_volume_du_bytes","entries":"whole_volume_find_mindepth_1","filesystem":"statfs_type_and_fundamental_block_bytes"},"post_workload_samples":1,"probe_image":"alpine@sha256:48b0309ca019d89d40f670aa1bc06e426dc0931948452e8491e3d65087abc07d","required_trials":3,"runtime_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93","sampler_sha256":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","volume_role":"engine-data","volume_scope":[{"driver":"local","labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"name":"circus_vdbb_scale_t1_scale-big-2m-antfly-data"}]},"protocol_fingerprint":"8426b3ca0545987ca186050b383764be76bb64c21e1c81aea169f6cb5f374c34","reasons":[],"required_ownership_labels":{"com.antfly.circus.benchmark":"vector-vdbbench-scale","com.antfly.circus.run":"run-attempt-2"},"schema":"antfly.storage-footprint.v2","status":"qualified","updated_at":"2026-10-07T19:42:48.510048+00:00"},"trial":1,"vectors":2000000,"workload_id":"scale-big-2m"}],"retention_limit":{"first_attempt_detail_status":"overwritten-by-previous-retry-policy","first_attempt_numerical_metrics_available":false,"retained_detailed_attempt":2,"slot_attempts_exhausted":2,"synthesized_observations":0},"run_id":"run-attempt-2","schema_version":1,"selection_status":"superseded"}

Capture recovery

Capture-method recovery evidence; earlier one-shot captures are not mixed into the selected persistent-stdin cohort.

Attachment SHA-256
696f5f055a96085c29ca709c254e0e024a32e63ea22e5a0bba9edd2a8fdd7ef0
{"canonical_checksums":{"provenance.json":"78f0599f754419c5045ec6965cc0de8e99d628cc4fdc49d145d516b93183723d","receipt.json":"653761dc2489ace70b5ccc6ea1087d13f271e65e215c234b854efa03f82e5ae5","report.md":"59f2dec0101a54536bfa0f699724a9910473c1e5e13d2e340c34c4ecdf979ddd","result.json":"af008fde903f4b2c8b8efed622f0a4a792918d85edcc4118931ab6f721534cca"},"capture_recovery_proof":{"after":{"exit_code":0,"failed_samples":0,"new_exec_operations_after_gate":0,"samples":9},"allocation_bytes":67108864,"before":{"exit_code":1,"failed_samples":4},"injected_failure":"new Docker exec operations rejected after collector initialization","results":[{"demand_peak_bytes":70320128,"failed_samples":4,"gate_at":1791415751.9043012,"last_sample_at":1791415751.8795881,"mode":"before","new_exec_operations_after_gate":4,"returncode":1,"samples":3},{"demand_peak_bytes":70320128,"failed_samples":0,"gate_at":1791415754.6205828,"last_sample_at":1791415756.209344,"mode":"after","new_exec_operations_after_gate":0,"returncode":0,"samples":9}],"verified_at":"2026-10-07T23:31:46.032Z"},"collector_change":{"after":"persistent-stdin-exec","before":"one-shot-exec","product_defaults_changed":false,"reason":"Complete all24 fresh lifecycles with one verified collector implementation and the original ascending/descending order; preserve failed attempt2 unchanged.","sampler_sha256":"518378f884e0e729a2533382bb349ca00ab1c667d1282513f9ee8ebbda568117","strict_memory_contract_sha256":"bd8c80526cbebb19ffebfe9d467edddd75450f3aa45a95e589f82d039349df93"},"final_cells":[{"cell_sha256":"b137c15407456cc6652b5cf8a71ec13df94ca59c6cfd3c9179210166aca1ac4e","request_errors":0,"source":{"cache_key":"dd59b15c1d656cddc983f92cb862c6d6ae13d9b76eeb83761b60d1962ae8a0ae","duration_seconds":631.8214304447174,"finished_at":1791416641.9898944,"object_sha256":"feccf73b5c8240eb752af3338cd6e40df3dda43c56df5f88b14b577586f66a1e","receipt_sha256":"bd73162be67c327c17dd551ac416de46ec66ee6110b7d6e319c99b91cdb2ac8d","started_at":1791416010.168464},"status":"ok","storage_status":"qualified","trial":1,"vectors":20000,"workload":"scale-fast-20k"},{"cell_sha256":"dd9fa5838594d991cb43d9024245d769b0ab14052bbad4d03f32acf33d095d88","request_errors":0,"source":{"cache_key":"b5fcfaa257eac98b0c9557ca1e882d4e41cf05b7e77419638f667f63fba0f7f7","duration_seconds":631.7154726982117,"finished_at":1791445926.3475325,"object_sha256":"8d7693c6ce50696192fc0b09437beeb368fcc39902a3ff7f7b5283a9edad79df","receipt_sha256":"80c8199546d702559bf50fccd7eb05647727968270ac8c74536e36d6f4905cd9","started_at":1791445294.6320598},"status":"ok","storage_status":"qualified","trial":2,"vectors":20000,"workload":"scale-fast-20k"},{"cell_sha256":"549c6855fc3bbff5c796dd945433d12067fd19f430d9bcde34a6ef3290731f8a","request_errors":0,"source":{"cache_key":"6ab90fb36ba4cab3f68bf7321e3203a76a55875f77aad1e92332bbb734b20cda","duration_seconds":631.7855544090271,"finished_at":1791417274.1522005,"object_sha256":"0a0aaf778384a1630d40d5e5c52342c1a5a434b374711dab7b843c4f040deea1","receipt_sha256":"2db46e8bd3649a9dcef84d9de7ab929f257fd00385311356cfd80f125e9f8711","started_at":1791416642.366646},"status":"ok","storage_status":"qualified","trial":1,"vectors":40000,"workload":"scale-fast-40k"},{"cell_sha256":"f8f6965b80242d7b74cca2df0ea0e7cc63d4cf45789b62ec0fab06740be2e0d7","request_errors":0,"source":{"cache_key":"4b3210e37ebcc5dffcd3b0f4498f77560cc15863df911ae20cc5a76df3dd9ce4","duration_seconds":631.8831629753113,"finished_at":1791445294.2646887,"object_sha256":"33666f2c8adc28acec98e9d369439cf28ba928f34c70b237a78334b745337744","receipt_sha256":"be30132801c28b50df92ec51f0f92a44ffb13dc4c9770f2e5c9a6dcaa8b66d82","started_at":1791444662.3815258},"status":"ok","storage_status":"qualified","trial":2,"vectors":40000,"workload":"scale-fast-40k"},{"cell_sha256":"b844c468d6610822f7e72eb64786c8eb8821715abf60e98f2b79b0eada6dce84","request_errors":0,"source":{"cache_key":"5b149022770774bdbb55aa8c181de3662872332049e5032654209fd977e0c8e2","duration_seconds":631.8226687908173,"finished_at":1791417906.341576,"object_sha256":"7d32dcc723e4100a42b88de4e5c6439bb9e012c6e783c28d192d815d9ae3e5dc","receipt_sha256":"518ae6fc542e5626b25f211536658710d298ea544c0035f192db689bf5ebbc7f","started_at":1791417274.5189073},"status":"ok","storage_status":"qualified","trial":1,"vectors":60000,"workload":"scale-fast-60k"},{"cell_sha256":"d85638140ec64561ef7d10ae7370228f83d32f6d76dfc72c0a6f73b3b83b0568","request_errors":0,"source":{"cache_key":"8b06e126971df10ce95e3ba74f389a91c64cb428f96681193dec327b2d696c61","duration_seconds":631.8736236095428,"finished_at":1791444661.9872365,"object_sha256":"6550265315541da8b75e5e51e304510770ec7114750293451ae63cd355767373","receipt_sha256":"1f3cedc46e6954265b37dd0fa72981ae3aad171a5f886f0086ecba532bf333a1","started_at":1791444030.113613},"status":"ok","storage_status":"qualified","trial":2,"vectors":60000,"workload":"scale-fast-60k"},{"cell_sha256":"79b423ef96b920f986db3b6557668ed1e94d181f4047131182657e1a46c11c5a","request_errors":0,"source":{"cache_key":"6f98d012b1c5761ce1c56754f4836c1f2e6edd12717989e97093f4de4b756f00","duration_seconds":631.8429760932922,"finished_at":1791418538.566339,"object_sha256":"412991492f2836b25b479586bfdf5cf0806f62df534c799cfcbe79f6f249740f","receipt_sha256":"77b8175de79dd0743faffd425d2b8693c7f480f1999db7fdf8d7a6dea96fe414","started_at":1791417906.723363},"status":"ok","storage_status":"qualified","trial":1,"vectors":80000,"workload":"scale-fast-80k"},{"cell_sha256":"bd7fc43fe6f7843247b49c9857cf40dae403d8a3005b300cf333a0f0e78cc391","request_errors":0,"source":{"cache_key":"394ce38b181b08be162cdb51defd7cf9857067c243c380fe57e0bb04ce625772","duration_seconds":661.9016163349152,"finished_at":1791444029.7363853,"object_sha256":"9dee85f1ec78e126f41e06ae0b75bb52dc3426ef07f59b55b4612627fcdd34f7","receipt_sha256":"a2182611ab852d53a63be2519e569913e273c0a686b1510b258f050231ecccf2","started_at":1791443367.834769},"status":"ok","storage_status":"qualified","trial":2,"vectors":80000,"workload":"scale-fast-80k"},{"cell_sha256":"7fad2ae3a694b8ea3ab32fe1e3bd0e0fac9b5e881059f8200b7af99fcf4a2217","request_errors":0,"source":{"cache_key":"589936f94a64672406de34b07e4b04657b02372e5d3bf16170e4af51a8011e64","duration_seconds":661.9279553890228,"finished_at":1791419200.9026754,"object_sha256":"e707efebd94d502c89a6d1213d0d2802dd294c14275f074bcf8aa5f06888ddd6","receipt_sha256":"0816593f89c7e16a1c9df1bbb41d79205ae7f9e267cb7a13969564eb7937adda","started_at":1791418538.97472},"status":"ok","storage_status":"qualified","trial":1,"vectors":100000,"workload":"scale-fast-100k"},{"cell_sha256":"70d1a5b012bb7be769c704807b888bd6f5f5515f8f31bc8126c66b4d7c911639","request_errors":0,"source":{"cache_key":"224c0d8ff234b49a4adcebb3a9fd76bc5dc4972340fab2d8a6b1ad6721dcf98a","duration_seconds":661.8190445899963,"finished_at":1791443367.4590273,"object_sha256":"e6a73b85ed69a43067203f425d78cad22dcbd20105da313229a752db1208adce","receipt_sha256":"fa5901508a3904d3c9e239c301ae0109721adca04b2f0aab89ecc76b83e51c5d","started_at":1791442705.6399827},"status":"ok","storage_status":"qualified","trial":2,"vectors":100000,"workload":"scale-fast-100k"},{"cell_sha256":"35f168cf89311bc844502bf81ffaedefba77557f8b1a1b1961b5156605baed70","request_errors":0,"source":{"cache_key":"88c31dc495287e0b2a2afac263c0b585fee6a527da89e8e7b58df833dc354d35","duration_seconds":691.938873052597,"finished_at":1791419893.2199633,"object_sha256":"271e7ef35b30d24c1b6964861f75d4378cd1ec2c8d3294d21c8fa3bf140454c7","receipt_sha256":"b45a23281b4afd09c29858c76ad88459a2deea50dada2a0864a5a059c9ee74c5","started_at":1791419201.2810903},"status":"ok","storage_status":"qualified","trial":1,"vectors":200000,"workload":"scale-big-200k"},{"cell_sha256":"b988c45631fdad0296a11efee5a56e55359d5f943c0fc73fa2c51c07d22ad9b0","request_errors":0,"source":{"cache_key":"09edfe53abe854bdcb3a7412749dd169b7e3a0e4f8d525393bd048dcede5564f","duration_seconds":691.9344844818115,"finished_at":1791442705.2534764,"object_sha256":"b748556c86c1589ee534b9ac2196023c707eada1fb2473ffe890af7a15636943","receipt_sha256":"c6b37e9dcc7c4801bf3adffd17dbf4c05c0a52370d3792a294bf81af5a6473bb","started_at":1791442013.318992},"status":"ok","storage_status":"qualified","trial":2,"vectors":200000,"workload":"scale-big-200k"},{"cell_sha256":"133424a1c1b4403687ce2b7e41bdc942e558c1bbe2a3eeba144134658aff1d70","request_errors":0,"source":{"cache_key":"f0dd077b5d68b97a4d415fbc57dbaf8510b74e2da791d6af460b3431eef0c1b4","duration_seconds":752.1534693241119,"finished_at":1791420645.7567644,"object_sha256":"a92bc11ab9af20f15c586994213c845c18937db1215faf61f1b4b9fa98527d57","receipt_sha256":"275cfbec6391ecb42522f443a9ff28d1e8a882e9fe28c579728ab4041c4d7521","started_at":1791419893.603295},"status":"ok","storage_status":"qualified","trial":1,"vectors":400000,"workload":"scale-big-400k"},{"cell_sha256":"2ca2c89155ee96bacf65052c6add924f6f70468de2a21b418f8eb1e84faa6f24","request_errors":0,"source":{"cache_key":"d01524db5436483fc81c91a58efc9b6f28294d9703eb39e0644279ccd4a3e15d","duration_seconds":752.3403947353363,"finished_at":1791442012.922818,"object_sha256":"480a1d15ea3127807d6b3c0c72a1ce21dd76c8134ab5771b18e7e23bb2427d21","receipt_sha256":"8bf24ba6d99b0871355044e5991a0d175f8eafc3f10dcbeaf7c9df52c0b5fd1e","started_at":1791441260.5824232},"status":"ok","storage_status":"qualified","trial":2,"vectors":400000,"workload":"scale-big-400k"},{"cell_sha256":"c43ade8ad87b4a4824eeceae5938c9e501ce6533b3e0177b13af3247e1e2bc53","request_errors":0,"source":{"cache_key":"d376c53d5a7a221a1aba0d117b90a936dd87dea5fe9239bc6537bba01dc3cb5a","duration_seconds":842.3805015087128,"finished_at":1791421488.5272603,"object_sha256":"482b1e6e94ebba198d43f1b993217f2da6e32f1397129766e98ba0492e83a3bf","receipt_sha256":"c318463dddef1c69c3a004c554e343fae20f9887c03b513375a8951202fa473a","started_at":1791420646.1467588},"status":"ok","storage_status":"qualified","trial":1,"vectors":600000,"workload":"scale-big-600k"},{"cell_sha256":"abf49594ce1c03b4fab06389f1d7186ff8e6bdb0199287b91ca8a8e7c9167fd0","request_errors":0,"source":{"cache_key":"d155225af8de459040a3c12bb6eb016d711e18743cce83f59862e1fd52e48b3c","duration_seconds":872.3618550300598,"finished_at":1791441260.2020757,"object_sha256":"a3dd9b23b3d321d7eeb5730e3bc7426b9bc23b48e6fe849be155d0c6540f1ed3","receipt_sha256":"2750feaa8c95d40270d2861365a1fb8f2c613a9b0ac87d7e66083233928ebcc7","started_at":1791440387.8402207},"status":"ok","storage_status":"qualified","trial":2,"vectors":600000,"workload":"scale-big-600k"},{"cell_sha256":"0d1f4850983bc6aa1b63f488c348b074eea04cbbfea5fea8b63c8ff22d9f2388","request_errors":0,"source":{"cache_key":"e7a5323774e31f4ec6eddb7a21e8249ee676fce2cd20279827ed4b4508828522","duration_seconds":932.5341374874115,"finished_at":1791422421.4874156,"object_sha256":"1bee51cd74398c0e2ecdf647d878f7c9c90cccd8fc678fdd6b355aa69310dad9","receipt_sha256":"7d30b032d169fd0b137b1b6068b0f987019755a5da9e008fc9ed35af5e2657f2","started_at":1791421488.953278},"status":"ok","storage_status":"qualified","trial":1,"vectors":800000,"workload":"scale-big-800k"},{"cell_sha256":"fafd1202df81f085f3b3b47233917dd54631682c54bd34043e3e1c75b24de548","request_errors":0,"source":{"cache_key":"dd1d37562482daf137457f6848f1e7bb1fe9505faf0672f0ca5391fdc1b0aae0","duration_seconds":992.8572626113892,"finished_at":1791440387.4037292,"object_sha256":"4afba2d075240f59fc28306a6fbb7eef244c3b50a9f0742464d5fba1aa8e93cc","receipt_sha256":"38f6dcb16c51d3d439a08dfead51bdf29c1f2aed9a4c26700dbbb5ec86a98316","started_at":1791439394.5464666},"status":"ok","storage_status":"qualified","trial":2,"vectors":800000,"workload":"scale-big-800k"},{"cell_sha256":"f9f2f6193d3dced1065049b1cbfd1673e5782e0a87624042cb06dae27582c0e0","request_errors":0,"source":{"cache_key":"50663c8619d782665c14d153244298835762bab104a843cc723b803eec21af28","duration_seconds":1053.1733465194702,"finished_at":1791423475.0745273,"object_sha256":"8110f196b97920bd84a2d5e12f6580f19e85ed16d2a28e3b4eae1def5f8b6d47","receipt_sha256":"49195761bfb264fd5f226f42e4e35e10b6cfefc51629fb7c939762a00fc9a581","started_at":1791422421.9011807},"status":"ok","storage_status":"qualified","trial":1,"vectors":1000000,"workload":"scale-big-1m"},{"cell_sha256":"3553086a33c1854b7eaf02bc50d39639332fda6010f8bc40a6bea4030ce3a17f","request_errors":0,"source":{"cache_key":"24c02999aeb7aa35b9372a189a89654c02005363c63963259873f57abc336c74","duration_seconds":1083.329823732376,"finished_at":1791439394.145658,"object_sha256":"03ccf5abc93a2f69c8fcc833abdb8f7d2a8904afad462a45ba80b6d30d450aeb","receipt_sha256":"fbcd386f3dce645cd71390616a393c29e4a61ded24f6d1734023f99f16dfefb8","started_at":1791438310.8158343},"status":"ok","storage_status":"qualified","trial":2,"vectors":1000000,"workload":"scale-big-1m"},{"cell_sha256":"c79c3284c23664e2db0063b77ead016f0e09212b8204e6b6db30c94803de3e65","request_errors":0,"source":{"cache_key":"20296a5bcf2369ad6b2e881efdc84bb892e8afa09a0b74108833451e5edace01","duration_seconds":1775.2171692848206,"finished_at":1791425250.7145307,"object_sha256":"89b835cc39fd97491eee6b2ce85307bb213b53d26a13ff7c526cf00547ebad97","receipt_sha256":"e18105ff437946f0d4a55f2d546c90c76769398a81ffbd2c5ce0cbe15f72d956","started_at":1791423475.4973614},"status":"ok","storage_status":"qualified","trial":1,"vectors":2000000,"workload":"scale-big-2m"},{"cell_sha256":"0b801d32954ff8c8ed4cfead158e62803e04fba1c62cdb9b9183e29e09da24c5","request_errors":0,"source":{"cache_key":"c10a4dc81f66e8d69e05c615666db95272535542a0eda72cc8839d0140a30751","duration_seconds":1896.1306829452515,"finished_at":1791438310.40242,"object_sha256":"edc3937f9bc8504978594ad004867d95193f3201a4137a47649cb4dcf9412902","receipt_sha256":"5152c7821ee6a56b32ce384a95e6d67f88919ae9caf3dfefc47de721e988dbf9","started_at":1791436414.271737},"status":"ok","storage_status":"qualified","trial":2,"vectors":2000000,"workload":"scale-big-2m"},{"cell_sha256":"5d266b153c19496c2a2ff89239d6e0bb5adb65348680ecb7e41614914804ea79","request_errors":0,"source":{"cache_key":"acc27006955e15f17b17890051ed7a85659deeba3a0a80bb30b205034ade8ee8","duration_seconds":6197.2556319236755,"finished_at":1791431448.4587076,"object_sha256":"e3665ab53b54f358e38bf0f0f90c13b83b33fa6a1693e0942e2def90e24e8d1d","receipt_sha256":"ce32ba4b731e1469d47c3485fa3a6be2f964d556f99fcdb402a3f2e38ea8de8b","started_at":1791425251.2030756},"status":"ok","storage_status":"qualified","trial":1,"vectors":3000000,"workload":"scale-big-3m"},{"cell_sha256":"94d80172d27cd7742aeb338e26e1705969288a3970397b5bd045f4dad396e1dd","request_errors":0,"source":{"cache_key":"cfc537ae9d66eed3b9f520f4a0d61b9fc3ef71bbb3e4558474bb242a3028f277","duration_seconds":4964.792845726013,"finished_at":1791436413.7551668,"object_sha256":"11434bd771c790ec78a3da1328978ecc7c1f3703b695e132a64914d984980b81","receipt_sha256":"e3468ed0b19567eeb959275e7120d5b685ddea932b2655f479ea8869e74240db","started_at":1791431448.962321},"status":"ok","storage_status":"qualified","trial":2,"vectors":3000000,"workload":"scale-big-3m"}],"final_curve_statistics":[{"concurrency_observations":[{"clients":1,"p95_ms":{"mean":4.661173721251544,"values":[4.698534976341762,4.623812466161326]},"p99_ms":{"mean":4.959379016218007,"values":[4.995431527495381,4.923326504940632]},"qps":{"mean":234.9839,"values":[233.4934,236.4744]}},{"clients":5,"p95_ms":{"mean":5.863387954013887,"values":[5.880510911811142,5.8462649962166315]},"p99_ms":{"mean":7.5601884382194875,"values":[7.591670435504064,7.528706440934911]},"qps":{"mean":956.5594000000001,"values":[957.6334,955.4854]}},{"clients":10,"p95_ms":{"mean":9.544054901925847,"values":[9.551274206023663,9.53683559782803]},"p99_ms":{"mean":11.151206890499456,"values":[11.11458803876304,11.187825742235873]},"qps":{"mean":1422.6637,"values":[1420.9966,1424.3308]}},{"clients":20,"p95_ms":{"mean":24.540354941564146,"values":[24.92757159052417,24.153138292604126]},"p99_ms":{"mean":30.228271528903853,"values":[30.749195839744075,29.70734721806363]},"qps":{"mean":1383.7641,"values":[1362.4118,1405.1164]}},{"clients":30,"p95_ms":{"mean":40.5086591556028,"values":[40.65867779572727,40.35864051547833]},"p99_ms":{"mean":50.969483983353726,"values":[51.317565254867084,50.62140271184036]},"qps":{"mean":1352.9421,"values":[1343.2672,1362.617]}}],"effort_trials":[0.425,0.425],"metrics":{"demand_mb":{"max":1825.8,"mean":1825.6,"min":1825.4,"values":[1825.8,1825.4]},"final_allocated_bytes":{"max":84410368,"mean":84391936,"min":84373504,"values":[84373504,84410368]},"index_build_seconds":{"max":6.604100000000001,"mean":6.3875,"min":6.1709,"values":[6.604100000000001,6.1709]},"lifecycle_seconds":{"max":631.8214304447174,"mean":631.7684515714645,"min":631.7154726982117,"values":[631.8214304447174,631.7154726982117]},"peak_clients":{"max":10,"mean":10,"min":10,"values":[10,10]},"peak_qps":{"max":1424.3308,"mean":1422.6637,"min":1420.9966,"values":[1420.9966,1424.3308]},"serial_p95_ms":{"max":4.7,"mean":4.65,"min":4.6,"values":[4.7,4.6]}},"recall_min":0.9626,"status":"ok","vectors":20000},{"concurrency_observations":[{"clients":1,"p95_ms":{"mean":5.106477878143777,"values":[5.137695989105849,5.075259767181706]},"p99_ms":{"mean":5.741350265452638,"values":[5.914607335580514,5.568093195324762]},"qps":{"mean":219.2285,"values":[218.7411,219.7159]}},{"clients":5,"p95_ms":{"mean":6.380773153068731,"values":[6.25778281246312,6.503763493674341]},"p99_ms":{"mean":8.45490059975418,"values":[8.438370315125212,8.47143088438315]},"qps":{"mean":901.1397,"values":[907.5931,894.6863]}},{"clients":10,"p95_ms":{"mean":10.145554147311486,"values":[9.872654793434778,10.418453501188193]},"p99_ms":{"mean":11.937663474236613,"values":[11.662173520307984,12.213153428165242]},"qps":{"mean":1349.5454,"values":[1391.2341,1307.8567]}},{"clients":20,"p95_ms":{"mean":24.717363055970047,"values":[23.919540698989294,25.515185412950803]},"p99_ms":{"mean":30.606799828528906,"values":[29.915532142040345,31.298067515017472]},"qps":{"mean":1347.1723499999998,"values":[1394.9858,1299.3589]}},{"clients":30,"p95_ms":{"mean":41.08512926177354,"values":[39.971047503058784,42.19921102048829]},"p99_ms":{"mean":51.32851518719694,"values":[50.00916198187046,52.64786839252343]},"qps":{"mean":1320.6316000000002,"values":[1368.2315,1273.0317]}}],"effort_trials":[0.4,0.4],"metrics":{"demand_mb":{"max":2132.5,"mean":1746.75,"min":1361,"values":[2132.5,1361]},"final_allocated_bytes":{"max":166739968,"mean":166193152,"min":165646336,"values":[165646336,166739968]},"index_build_seconds":{"max":13.565000000000001,"mean":12.71995,"min":11.8749,"values":[11.8749,13.565000000000001]},"lifecycle_seconds":{"max":631.8831629753113,"mean":631.8343586921692,"min":631.7855544090271,"values":[631.7855544090271,631.8831629753113]},"peak_clients":{"max":20,"mean":15,"min":10,"values":[20,10]},"peak_qps":{"max":1394.9858,"mean":1351.4212499999999,"min":1307.8567,"values":[1394.9858,1307.8567]},"serial_p95_ms":{"max":4.9,"mean":4.9,"min":4.9,"values":[4.9,4.9]}},"recall_min":0.951,"status":"ok","vectors":40000},{"concurrency_observations":[{"clients":1,"p95_ms":{"mean":5.71654450322967,"values":[5.850485002156347,5.582604004302993]},"p99_ms":{"mean":7.075612110202199,"values":[7.2553824051283256,6.895841815276073]},"qps":{"mean":204.6538,"values":[199.009,210.2986]}},{"clients":5,"p95_ms":{"mean":6.981946396263083,"values":[6.86365779110929,7.100235001416877]},"p99_ms":{"mean":9.048141822568143,"values":[9.12540478835581,8.970878856780475]},"qps":{"mean":851.9593,"values":[835.923,867.9956]}},{"clients":10,"p95_ms":{"mean":10.628231344890082,"values":[10.832840707735159,10.423621982045006]},"p99_ms":{"mean":12.609311399864968,"values":[12.81956848746632,12.399054312263617]},"qps":{"mean":1291.1150499999999,"values":[1263.2745,1318.9556]}},{"clients":20,"p95_ms":{"mean":26.111312720604467,"values":[27.181605389341705,25.04102005186723]},"p99_ms":{"mean":32.48159254362686,"values":[33.8121365522965,31.151048534957212]},"qps":{"mean":1288.2192,"values":[1241.7475,1334.6909]}},{"clients":30,"p95_ms":{"mean":42.54762761775055,"values":[44.03656224167207,41.05869299382903]},"p99_ms":{"mean":54.02131137889228,"values":[56.26031476276694,51.78230799501762]},"qps":{"mean":1263.5173,"values":[1222.4172,1304.6174]}}],"effort_trials":[0.425,0.4],"metrics":{"demand_mb":{"max":2150.9,"mean":2052.05,"min":1953.2,"values":[2150.9,1953.2]},"final_allocated_bytes":{"max":249368576,"mean":249094144,"min":248819712,"values":[248819712,249368576]},"index_build_seconds":{"max":15.590399999999999,"mean":15.57505,"min":15.5597,"values":[15.590399999999999,15.5597]},"lifecycle_seconds":{"max":631.8736236095428,"mean":631.84814620018,"min":631.8226687908173,"values":[631.8226687908173,631.8736236095428]},"peak_clients":{"max":20,"mean":15,"min":10,"values":[10,20]},"peak_qps":{"max":1334.6909,"mean":1298.9827,"min":1263.2745,"values":[1263.2745,1334.6909]},"serial_p95_ms":{"max":5.5,"mean":5.35,"min":5.2,"values":[5.5,5.2]}},"recall_min":0.9552,"status":"ok","vectors":60000},{"concurrency_observations":[{"clients":1,"p95_ms":{"mean":6.153598881792277,"values":[6.117802666267381,6.189395097317173]},"p99_ms":{"mean":8.41385880601593,"values":[8.201263988448783,8.626453623583076]},"qps":{"mean":196.8731,"values":[196.921,196.8252]}},{"clients":5,"p95_ms":{"mean":6.95902276856941,"values":[6.8930641893530264,7.024981347785794]},"p99_ms":{"mean":9.277892812824575,"values":[9.28470050857868,9.271085117070468]},"qps":{"mean":830.0101,"values":[833.0406,826.9796]}},{"clients":10,"p95_ms":{"mean":11.269993865425931,"values":[11.264050990575925,11.275936740275938]},"p99_ms":{"mean":13.429033722059105,"values":[13.480745238484818,13.37732220563339]},"qps":{"mean":1235.6032,"values":[1235.1452,1236.0612]}},{"clients":20,"p95_ms":{"mean":27.029516131733544,"values":[26.75322425784543,27.305808005621657]},"p99_ms":{"mean":33.106747276906354,"values":[32.862543198280015,33.35095135553269]},"qps":{"mean":1241.48585,"values":[1257.4715,1225.5002]}},{"clients":30,"p95_ms":{"mean":43.59650657279414,"values":[44.491865998133996,42.701147147454286]},"p99_ms":{"mean":55.16282164346191,"values":[56.92263799021019,53.40300529671364]},"qps":{"mean":1237.00865,"values":[1232.5447,1241.4726]}}],"effort_trials":[0.4,0.4],"metrics":{"demand_mb":{"max":2296.9,"mean":2261.65,"min":2226.4,"values":[2226.4,2296.9]},"final_allocated_bytes":{"max":330031104,"mean":329957376,"min":329883648,"values":[330031104,329883648]},"index_build_seconds":{"max":23.431800000000003,"mean":22.44245,"min":21.4531,"values":[21.4531,23.431800000000003]},"lifecycle_seconds":{"max":661.9016163349152,"mean":646.8722962141037,"min":631.8429760932922,"values":[631.8429760932922,661.9016163349152]},"peak_clients":{"max":30,"mean":25,"min":20,"values":[20,30]},"peak_qps":{"max":1257.4715,"mean":1249.47205,"min":1241.4726,"values":[1257.4715,1241.4726]},"serial_p95_ms":{"max":5.6,"mean":5.5,"min":5.4,"values":[5.6,5.4]}},"recall_min":0.9542,"status":"ok","vectors":80000},{"concurrency_observations":[{"clients":1,"p95_ms":{"mean":6.875583274813834,"values":[6.816064103622919,6.935102446004748]},"p99_ms":{"mean":9.66354054267867,"values":[9.528121991897933,9.798959093459406]},"qps":{"mean":185.79305,"values":[186.9016,184.6845]}},{"clients":5,"p95_ms":{"mean":7.2964673985552455,"values":[7.11112250428414,7.48181229282635]},"p99_ms":{"mean":9.902998765755918,"values":[9.86241701757537,9.943580513936467]},"qps":{"mean":798.6107999999999,"values":[804.7051,792.5165]}},{"clients":10,"p95_ms":{"mean":11.29972832932253,"values":[11.165935154713221,11.433521503931841]},"p99_ms":{"mean":13.344277588039407,"values":[13.217537777090916,13.471017398987897]},"qps":{"mean":1218.42105,"values":[1230.8279,1206.0142]}},{"clients":20,"p95_ms":{"mean":27.22398136756965,"values":[26.766601038980298,27.681361696159005]},"p99_ms":{"mean":33.70088863768618,"values":[33.054636531451315,34.34714074392103]},"qps":{"mean":1222.93665,"values":[1238.0174,1207.8559]}},{"clients":30,"p95_ms":{"mean":43.552087128773564,"values":[43.0469927523518,44.05718150519533]},"p99_ms":{"mean":55.15628138164175,"values":[54.073370303376585,56.23919245990691]},"qps":{"mean":1211.1403500000001,"values":[1215.3696,1206.9111]}}],"effort_trials":[0.4,0.4],"metrics":{"demand_mb":{"max":2275.8,"mean":2229.4,"min":2183,"values":[2183,2275.8]},"final_allocated_bytes":{"max":413728768,"mean":412934144,"min":412139520,"values":[413728768,412139520]},"index_build_seconds":{"max":27.0779,"mean":26.8668,"min":26.655700000000003,"values":[26.655700000000003,27.0779]},"lifecycle_seconds":{"max":661.9279553890228,"mean":661.8734999895096,"min":661.8190445899963,"values":[661.9279553890228,661.8190445899963]},"peak_clients":{"max":20,"mean":20,"min":20,"values":[20,20]},"peak_qps":{"max":1238.0174,"mean":1222.93665,"min":1207.8559,"values":[1238.0174,1207.8559]},"serial_p95_ms":{"max":5.8,"mean":5.75,"min":5.7,"values":[5.8,5.7]}},"recall_min":0.9584,"status":"ok","vectors":100000},{"concurrency_observations":[{"clients":1,"p95_ms":{"mean":9.192660709959453,"values":[9.443339199060574,8.941982220858332]},"p99_ms":{"mean":13.309118360339202,"values":[13.832073475350628,12.786163245327776]},"qps":{"mean":169.77134999999998,"values":[168.9495,170.5932]}},{"clients":5,"p95_ms":{"mean":8.45173158377292,"values":[8.63692078419262,8.26654238335322]},"p99_ms":{"mean":10.408303725998856,"values":[10.44013331527822,10.376474136719489]},"qps":{"mean":767.8467499999999,"values":[770.5304,765.1631]}},{"clients":10,"p95_ms":{"mean":11.84015105245635,"values":[11.923250494874083,11.757051610038614]},"p99_ms":{"mean":14.117505678441374,"values":[14.289082486066034,13.945928870816713]},"qps":{"mean":1172.2310499999999,"values":[1170.6196,1173.8425]}},{"clients":20,"p95_ms":{"mean":28.318191149446655,"values":[28.03496150590945,28.601420792983856]},"p99_ms":{"mean":35.17389472282957,"values":[35.12588999001309,35.22189945564606]},"qps":{"mean":1184.6480000000001,"values":[1192.5346,1176.7614]}},{"clients":30,"p95_ms":{"mean":45.153333896450945,"values":[44.157693593297154,46.14897419960473]},"p99_ms":{"mean":57.40693545245455,"values":[55.497009992832396,59.3168609120767]},"qps":{"mean":1171.9021,"values":[1190.7989,1153.0053]}}],"effort_trials":[0.375,0.375],"metrics":{"demand_mb":{"max":2676.4,"mean":2391.9,"min":2107.4,"values":[2676.4,2107.4]},"final_allocated_bytes":{"max":909885440,"mean":907712512,"min":905539584,"values":[909885440,905539584]},"index_build_seconds":{"max":55.1361,"mean":54.67575,"min":54.2154,"values":[54.2154,55.1361]},"lifecycle_seconds":{"max":691.938873052597,"mean":691.9366787672043,"min":691.9344844818115,"values":[691.938873052597,691.9344844818115]},"peak_clients":{"max":20,"mean":20,"min":20,"values":[20,20]},"peak_qps":{"max":1192.5346,"mean":1184.6480000000001,"min":1176.7614,"values":[1192.5346,1176.7614]},"serial_p95_ms":{"max":6.4,"mean":6.300000000000001,"min":6.2,"values":[6.2,6.4]}},"recall_min":0.9548,"status":"ok","vectors":200000},{"concurrency_observations":[{"clients":1,"p95_ms":{"mean":11.904845926619599,"values":[16.4955613494385,7.314130503800698]},"p99_ms":{"mean":15.723775062942881,"values":[23.54924621875399,7.898303907131773]},"qps":{"mean":138.40625,"values":[122.766,154.0465]}},{"clients":5,"p95_ms":{"mean":8.489288548298644,"values":[8.528496095095758,8.45008100150153]},"p99_ms":{"mean":12.052408246381667,"values":[12.172227436094545,11.932589056668787]},"qps":{"mean":661.24235,"values":[661.2561,661.2286]}},{"clients":10,"p95_ms":{"mean":14.052975583763324,"values":[13.9260877011111,14.179863466415549]},"p99_ms":{"mean":16.88533398613799,"values":[16.800593446241695,16.970074526034285]},"qps":{"mean":1004.4911,"values":[1015.3511,993.6311]}},{"clients":20,"p95_ms":{"mean":31.956241589796264,"values":[32.74188018986024,31.170602989732288]},"p99_ms":{"mean":39.53032603778409,"values":[40.59205516590736,38.46859690966082]},"qps":{"mean":1036.66735,"values":[1019.3353,1053.9994]}},{"clients":30,"p95_ms":{"mean":49.15984509789267,"values":[48.78591019951272,49.53377999627263]},"p99_ms":{"mean":63.086573681357535,"values":[62.28749421134124,63.88565315137383]},"qps":{"mean":1030.2276000000002,"values":[1040.7036,1019.7516]}}],"effort_trials":[0.375,0.375],"metrics":{"demand_mb":{"max":2829.8,"mean":2621.3500000000004,"min":2412.9,"values":[2829.8,2412.9]},"final_allocated_bytes":{"max":1974374400,"mean":1972830208,"min":1971286016,"values":[1971286016,1974374400]},"index_build_seconds":{"max":120.68740000000001,"mean":119.74100000000001,"min":118.7946,"values":[118.7946,120.68740000000001]},"lifecycle_seconds":{"max":752.3403947353363,"mean":752.2469320297241,"min":752.1534693241119,"values":[752.1534693241119,752.3403947353363]},"peak_clients":{"max":30,"mean":25,"min":20,"values":[30,20]},"peak_qps":{"max":1053.9994,"mean":1047.3515,"min":1040.7036,"values":[1040.7036,1053.9994]},"serial_p95_ms":{"max":7.3,"mean":7.25,"min":7.2,"values":[7.2,7.3]}},"recall_min":0.9636,"status":"ok","vectors":400000},{"concurrency_observations":[{"clients":1,"p95_ms":{"mean":16.46920655330177,"values":[8.442130897310562,24.49628220929298]},"p99_ms":{"mean":21.44386877873331,"values":[9.482965565985072,33.404771991481546]},"qps":{"mean":118.1057,"values":[138.5968,97.6146]}},{"clients":5,"p95_ms":{"mean":12.5157746966579,"values":[12.634504385641774,12.397045007674024]},"p99_ms":{"mean":14.523745599435642,"values":[14.574428186169825,14.47306301270146]},"qps":{"mean":578.26655,"values":[582.0172,574.5159]}},{"clients":10,"p95_ms":{"mean":15.972759446594862,"values":[15.86340699577704,16.082111897412684]},"p99_ms":{"mean":18.90655634051653,"values":[18.714019699837067,19.09909298119599]},"qps":{"mean":887.22555,"values":[892.9995,881.4516]}},{"clients":20,"p95_ms":{"mean":36.86396074772347,"values":[36.47314124827972,37.25478024716722]},"p99_ms":{"mean":46.05892521241912,"values":[44.77492762729525,47.34292279754299]},"qps":{"mean":898.0235,"values":[908.7505,887.2965]}},{"clients":30,"p95_ms":{"mean":58.04842084835397,"values":[57.76541679806542,58.33142489864252]},"p99_ms":{"mean":71.56903785740724,"values":[72.2786308953073,70.85944481950719]},"qps":{"mean":905.482,"values":[909.5705,901.3935]}}],"effort_trials":[0.375,0.375],"metrics":{"demand_mb":{"max":2870.5,"mean":2845.25,"min":2820,"values":[2870.5,2820]},"final_allocated_bytes":{"max":3117531136,"mean":3107805184,"min":3098079232,"values":[3117531136,3098079232]},"index_build_seconds":{"max":212.3114,"mean":211.00099999999998,"min":209.6906,"values":[209.6906,212.3114]},"lifecycle_seconds":{"max":872.3618550300598,"mean":857.3711782693863,"min":842.3805015087128,"values":[842.3805015087128,872.3618550300598]},"peak_clients":{"max":30,"mean":30,"min":30,"values":[30,30]},"peak_qps":{"max":909.5705,"mean":905.482,"min":901.3935,"values":[909.5705,901.3935]},"serial_p95_ms":{"max":9.4,"mean":8.65,"min":7.9,"values":[9.4,7.9]}},"recall_min":0.9592,"status":"ok","vectors":600000},{"concurrency_observations":[{"clients":1,"p95_ms":{"mean":22.768509072921,"values":[11.033178705838509,34.50383944000349]},"p99_ms":{"mean":30.214550701930428,"values":[12.332687735615766,48.09641366824509]},"qps":{"mean":88.604,"values":[109.5893,67.6187]}},{"clients":5,"p95_ms":{"mean":13.07895390491467,"values":[11.0181457886938,15.139762021135539]},"p99_ms":{"mean":17.458573729381897,"values":[17.078716850373894,17.838430608389896]},"qps":{"mean":498.55100000000004,"values":[504.3763,492.7257]}},{"clients":10,"p95_ms":{"mean":18.32058244908694,"values":[18.42472940334119,18.216435494832687]},"p99_ms":{"mean":22.084768628410522,"values":[21.876613468048156,22.29292378877289]},"qps":{"mean":788.38985,"values":[784.5069,792.2728]}},{"clients":20,"p95_ms":{"mean":40.50416521713487,"values":[41.11130424280418,39.89702619146555]},"p99_ms":{"mean":50.993815043475465,"values":[51.64103236165826,50.34659772529267]},"qps":{"mean":810.0417,"values":[796.9279,823.1555]}},{"clients":30,"p95_ms":{"mean":64.96812358454915,"values":[66.79442840977568,63.141818759322604]},"p99_ms":{"mean":80.71953435864995,"values":[84.09385485574597,77.34521386155393]},"qps":{"mean":806.26565,"values":[797.1905,815.3408]}}],"effort_trials":[0.4,0.4],"metrics":{"demand_mb":{"max":3938.3,"mean":3701.25,"min":3464.2,"values":[3464.2,3938.3]},"final_allocated_bytes":{"max":4396199936,"mean":4328108032,"min":4260016128,"values":[4260016128,4396199936]},"index_build_seconds":{"max":313.1898,"mean":303.02995,"min":292.8701,"values":[292.8701,313.1898]},"lifecycle_seconds":{"max":992.8572626113892,"mean":962.6957000494003,"min":932.5341374874115,"values":[932.5341374874115,992.8572626113892]},"peak_clients":{"max":30,"mean":25,"min":20,"values":[30,20]},"peak_qps":{"max":823.1555,"mean":810.173,"min":797.1905,"values":[797.1905,823.1555]},"serial_p95_ms":{"max":11.3,"mean":10.45,"min":9.6,"values":[9.6,11.3]}},"recall_min":0.9667,"status":"ok","vectors":800000},{"concurrency_observations":[{"clients":1,"p95_ms":{"mean":13.125652672897555,"values":[12.516816654533608,13.734488691261504]},"p99_ms":{"mean":17.345621941931306,"values":[15.804652338265422,18.88659154559719]},"qps":{"mean":107.89959999999999,"values":[108.189,107.6102]}},{"clients":5,"p95_ms":{"mean":13.826533305109473,"values":[12.766980397282166,14.88608621293678]},"p99_ms":{"mean":17.732388165895827,"values":[17.730346348835155,17.7344299829565]},"qps":{"mean":494.21090000000004,"values":[495.2379,493.1839]}},{"clients":10,"p95_ms":{"mean":18.944112652388867,"values":[19.147154001984745,18.74107130279299]},"p99_ms":{"mean":22.876090183272026,"values":[23.149893805384636,22.602286561159417]},"qps":{"mean":769.18055,"values":[761.7851,776.576]}},{"clients":20,"p95_ms":{"mean":41.469117643282516,"values":[42.14922809769633,40.78900718886871]},"p99_ms":{"mean":52.77217303606453,"values":[55.31143766856992,50.23290840355913]},"qps":{"mean":793.0353,"values":[790.9571,795.1135]}},{"clients":30,"p95_ms":{"mean":67.46256325423019,"values":[66.90061310946476,68.02451339899564]},"p99_ms":{"mean":86.2968760693911,"values":[82.05807564139829,90.53567649738392]},"qps":{"mean":790.9596,"values":[798.4651,783.4541]}}],"effort_trials":[0.4,0.4],"metrics":{"demand_mb":{"max":3981.5,"mean":3911.85,"min":3842.2,"values":[3842.2,3981.5]},"final_allocated_bytes":{"max":6252322816,"mean":6094606336,"min":5936889856,"values":[6252322816,5936889856]},"index_build_seconds":{"max":420.4525,"mean":403.56165,"min":386.67080000000004,"values":[386.67080000000004,420.4525]},"lifecycle_seconds":{"max":1083.329823732376,"mean":1068.2515851259232,"min":1053.1733465194702,"values":[1053.1733465194702,1083.329823732376]},"peak_clients":{"max":30,"mean":25,"min":20,"values":[30,20]},"peak_qps":{"max":798.4651,"mean":796.7893,"min":795.1135,"values":[798.4651,795.1135]},"serial_p95_ms":{"max":12.4,"mean":11.75,"min":11.1,"values":[12.4,11.1]}},"recall_min":0.9606,"status":"ok","vectors":1000000},{"concurrency_observations":[{"clients":1,"p95_ms":{"mean":69.58425691263982,"values":[53.1279763265047,86.04053749877494]},"p99_ms":{"mean":83.57787256245497,"values":[63.264943318790735,103.89080180611921]},"qps":{"mean":25.4898,"values":[31.9989,18.9807]}},{"clients":5,"p95_ms":{"mean":39.031087405601276,"values":[19.857801242324058,58.204373568878495]},"p99_ms":{"mean":86.08062938277725,"values":[27.62752194976198,144.5337368157925]},"qps":{"mean":288.8202,"values":[358.8593,218.7811]}},{"clients":10,"p95_ms":{"mean":81.26172925403807,"values":[27.927726012421772,134.59573249565437]},"p99_ms":{"mean":148.03281414642697,"values":[35.37115230283232,260.6944759900216]},"qps":{"mean":351.0675,"values":[551.1287,151.0063]}},{"clients":20,"p95_ms":{"mean":1193.2724012323888,"values":[60.92482820386066,2325.619974260917]},"p99_ms":{"mean":1712.2845138904813,"values":[91.9579722231721,3332.6110555577907]},"qps":{"mean":286.98855000000003,"values":[558.4147,15.5624]}},{"clients":30,"p95_ms":{"mean":185.1868552439555,"values":[154.8929375057924,215.48077298211865]},"p99_ms":{"mean":465.92348943915687,"values":[286.0423560856756,645.8046227926382]},"qps":{"mean":334.94960000000003,"values":[337.9328,331.9664]}}],"effort_trials":[0.425,0.425],"metrics":{"demand_mb":{"max":6816.4,"mean":6528.7,"min":6241,"values":[6241,6816.4]},"final_allocated_bytes":{"max":15842775040,"mean":15709315072,"min":15575855104,"values":[15842775040,15575855104]},"index_build_seconds":{"max":1178.5964000000001,"mean":1121.1570500000003,"min":1063.7177000000001,"values":[1063.7177000000001,1178.5964000000001]},"lifecycle_seconds":{"max":1896.1306829452515,"mean":1835.673926115036,"min":1775.2171692848206,"values":[1775.2171692848206,1896.1306829452515]},"peak_clients":{"max":30,"mean":25,"min":20,"values":[20,30]},"peak_qps":{"max":558.4147,"mean":445.19055000000003,"min":331.9664,"values":[558.4147,331.9664]},"serial_p95_ms":{"max":29.8,"mean":26.25,"min":22.7,"values":[29.8,22.7]}},"recall_min":0.9596,"status":"ok","vectors":2000000},{"concurrency_observations":[{"clients":1,"p95_ms":{"mean":926.2252212116435,"values":[994.8690574150531,857.581385008234]},"p99_ms":{"mean":1549.3365743193142,"values":[1557.3479785979744,1541.325170040654]},"qps":{"mean":1.69115,"values":[1.4739,1.9084]}},{"clients":5,"p95_ms":{"mean":3628.047610917565,"values":[821.1293721615216,6434.965849673608]},"p99_ms":{"mean":5233.605729216796,"values":[2685.8534570800834,7781.358001353509]},"qps":{"mean":7.0059000000000005,"values":[12.8063,1.2055]}},{"clients":10,"p95_ms":{"mean":737.441241199849,"values":[1041.7742813937364,433.10820100596163]},"p99_ms":{"mean":1659.2519776249583,"values":[1859.2564908228824,1459.2474644270342]},"qps":{"mean":41.17515,"values":[23.1395,59.2108]}},{"clients":20,"p95_ms":{"mean":4728.638106353172,"values":[9262.034138497253,195.2420742090904]},"p99_ms":{"mean":5557.592315251666,"values":[10732.493293482092,382.69133702124094]},"qps":{"mean":149.06815,"values":[4.1397,293.9966]}},{"clients":30,"p95_ms":{"mean":510.108008301904,"values":[793.1234508447229,227.09256575908512]},"p99_ms":{"mean":1131.2389287076023,"values":[1801.4021865703294,461.0756708448751]},"qps":{"mean":221.96795,"values":[113.9017,330.0342]}}],"effort_trials":[0.45,0.45],"metrics":{"demand_mb":{"max":9227.4,"mean":9209.05,"min":9190.7,"values":[9227.4,9190.7]},"final_allocated_bytes":{"max":30362574848,"mean":29970446336,"min":29578317824,"values":[29578317824,30362574848]},"index_build_seconds":{"max":3208.9415,"mean":3043.90365,"min":2878.8658,"values":[3208.9415,2878.8658]},"lifecycle_seconds":{"max":6197.2556319236755,"mean":5581.024238824844,"min":4964.792845726013,"values":[6197.2556319236755,4964.792845726013]},"peak_clients":{"max":30,"mean":30,"min":30,"values":[30,30]},"peak_qps":{"max":330.0342,"mean":221.96795,"min":113.9017,"values":[113.9017,330.0342]},"serial_p95_ms":{"max":34.6,"mean":26.950000000000003,"min":19.3,"values":[34.6,19.3]}},"recall_min":0.9624,"status":"ok","vectors":3000000}],"first_attempt_terminal_events":[{"action":"die","exit_code":"0","time":1791408670,"time_nanoseconds":1791408670130119400},{"action":"cleanup","exit_code":null,"time":1791408670,"time_nanoseconds":1791408670293393400},{"action":"remove","exit_code":null,"time":1791408670,"time_nanoseconds":1791408670863895800}],"interpretation_limits":["Two lifecycles; means and ranges are descriptive, not stable-capacity confidence bounds.","Fixed ascending client sweeps confound client count with elapsed lifecycle time; large-window variation has no isolated cause.","Earlier honed/scale fixtures and old one-shot sampling are not matched with this curve; same Antfly binary does not establish a product speedup."],"memory_capture":{"all_captures":[{"demand_mb":1825.8,"failed_samples":0,"max_sample_gap_s":0.296,"samples":2911,"service_containers":["antfly_bench_vdbb_scale_t1_scale-fast-20k"],"trial":1,"vectors":20000},{"demand_mb":1825.4,"failed_samples":0,"max_sample_gap_s":0.244,"samples":2890,"service_containers":["antfly_bench_vdbb_scale_t2_scale-fast-20k"],"trial":2,"vectors":20000},{"demand_mb":2132.5,"failed_samples":0,"max_sample_gap_s":0.256,"samples":2938,"service_containers":["antfly_bench_vdbb_scale_t1_scale-fast-40k"],"trial":1,"vectors":40000},{"demand_mb":1361,"failed_samples":0,"max_sample_gap_s":0.255,"samples":2944,"service_containers":["antfly_bench_vdbb_scale_t2_scale-fast-40k"],"trial":2,"vectors":40000},{"demand_mb":2150.9,"failed_samples":0,"max_sample_gap_s":0.234,"samples":2962,"service_containers":["antfly_bench_vdbb_scale_t1_scale-fast-60k"],"trial":1,"vectors":60000},{"demand_mb":1953.2,"failed_samples":0,"max_sample_gap_s":0.242,"samples":2955,"service_containers":["antfly_bench_vdbb_scale_t2_scale-fast-60k"],"trial":2,"vectors":60000},{"demand_mb":2226.4,"failed_samples":0,"max_sample_gap_s":0.229,"samples":2985,"service_containers":["antfly_bench_vdbb_scale_t1_scale-fast-80k"],"trial":1,"vectors":80000},{"demand_mb":2296.9,"failed_samples":0,"max_sample_gap_s":0.227,"samples":2996,"service_containers":["antfly_bench_vdbb_scale_t2_scale-fast-80k"],"trial":2,"vectors":80000},{"demand_mb":2183,"failed_samples":0,"max_sample_gap_s":0.264,"samples":3019,"service_containers":["antfly_bench_vdbb_scale_t1_scale-fast-100k"],"trial":1,"vectors":100000},{"demand_mb":2275.8,"failed_samples":0,"max_sample_gap_s":0.28,"samples":3027,"service_containers":["antfly_bench_vdbb_scale_t2_scale-fast-100k"],"trial":2,"vectors":100000},{"demand_mb":2676.4,"failed_samples":0,"max_sample_gap_s":0.44,"samples":3182,"service_containers":["antfly_bench_vdbb_scale_t1_scale-big-200k"],"trial":1,"vectors":200000},{"demand_mb":2107.4,"failed_samples":0,"max_sample_gap_s":0.229,"samples":3192,"service_containers":["antfly_bench_vdbb_scale_t2_scale-big-200k"],"trial":2,"vectors":200000},{"demand_mb":2829.8,"failed_samples":0,"max_sample_gap_s":0.23,"samples":3567,"service_containers":["antfly_bench_vdbb_scale_t1_scale-big-400k"],"trial":1,"vectors":400000},{"demand_mb":2412.9,"failed_samples":0,"max_sample_gap_s":0.249,"samples":3538,"service_containers":["antfly_bench_vdbb_scale_t2_scale-big-400k"],"trial":2,"vectors":400000},{"demand_mb":2870.5,"failed_samples":0,"max_sample_gap_s":0.322,"samples":4023,"service_containers":["antfly_bench_vdbb_scale_t1_scale-big-600k"],"trial":1,"vectors":600000},{"demand_mb":2820,"failed_samples":0,"max_sample_gap_s":0.226,"samples":4078,"service_containers":["antfly_bench_vdbb_scale_t2_scale-big-600k"],"trial":2,"vectors":600000},{"demand_mb":3464.2,"failed_samples":0,"max_sample_gap_s":0.238,"samples":4474,"service_containers":["antfly_bench_vdbb_scale_t1_scale-big-800k"],"trial":1,"vectors":800000},{"demand_mb":3938.3,"failed_samples":0,"max_sample_gap_s":0.341,"samples":4630,"service_containers":["antfly_bench_vdbb_scale_t2_scale-big-800k"],"trial":2,"vectors":800000},{"demand_mb":3842.2,"failed_samples":0,"max_sample_gap_s":0.269,"samples":4956,"service_containers":["antfly_bench_vdbb_scale_t1_scale-big-1m"],"trial":1,"vectors":1000000},{"demand_mb":3981.5,"failed_samples":0,"max_sample_gap_s":0.28,"samples":5135,"service_containers":["antfly_bench_vdbb_scale_t2_scale-big-1m"],"trial":2,"vectors":1000000},{"demand_mb":6241,"failed_samples":0,"max_sample_gap_s":0.235,"samples":8527,"service_containers":["antfly_bench_vdbb_scale_t1_scale-big-2m"],"trial":1,"vectors":2000000},{"demand_mb":6816.4,"failed_samples":0,"max_sample_gap_s":0.545,"samples":9110,"service_containers":["antfly_bench_vdbb_scale_t2_scale-big-2m"],"trial":2,"vectors":2000000},{"demand_mb":9227.4,"failed_samples":0,"max_sample_gap_s":0.359,"samples":30180,"service_containers":["antfly_bench_vdbb_scale_t1_scale-big-3m"],"trial":1,"vectors":3000000},{"demand_mb":9190.7,"failed_samples":0,"max_sample_gap_s":0.389,"samples":24226,"service_containers":["antfly_bench_vdbb_scale_t2_scale-big-3m"],"trial":2,"vectors":3000000}],"failed_samples":0,"large_captures":[{"demand_mb":6241,"failed_samples":0,"max_sample_gap_s":0.235,"samples":8527,"service_containers":["antfly_bench_vdbb_scale_t1_scale-big-2m"],"trial":1,"vectors":2000000},{"demand_mb":6816.4,"failed_samples":0,"max_sample_gap_s":0.545,"samples":9110,"service_containers":["antfly_bench_vdbb_scale_t2_scale-big-2m"],"trial":2,"vectors":2000000},{"demand_mb":9227.4,"failed_samples":0,"max_sample_gap_s":0.359,"samples":30180,"service_containers":["antfly_bench_vdbb_scale_t1_scale-big-3m"],"trial":1,"vectors":3000000},{"demand_mb":9190.7,"failed_samples":0,"max_sample_gap_s":0.389,"samples":24226,"service_containers":["antfly_bench_vdbb_scale_t2_scale-big-3m"],"trial":2,"vectors":3000000}],"max_sample_gap_s":0.545},"receipt_files_verified":1014,"retention_limit":{"first_attempt_detail_status":"overwritten-by-previous-retry-policy","first_attempt_numerical_metrics_available":false,"retained_detailed_attempt":2,"slot_attempts_exhausted":2,"synthesized_observations":0},"scale_changes":[{"demand_ratio":1.6689545867045004,"from_vectors":1000000,"index_build_ratio":2.778155580442295,"peak_qps_change_pct":-44.12694171470425,"storage_ratio":2.577576664666139,"to_vectors":2000000},{"demand_ratio":1.4105488075727173,"from_vectors":2000000,"index_build_ratio":2.7149663376776694,"peak_qps_change_pct":-50.14091157146081,"storage_ratio":1.9078136887978512,"to_vectors":3000000}],"schema_version":1,"source_final_analysis_sha256":"135ec7c4ccd12df2c5e955bb61f90db5a1b000c7c5b9c4b0994c3dbe3ad0ac68","source_verification_sha256":"386d7aaf78bb71f0d4e2430001c3dfefbe7435f70f08b0f8131375a7b8b3ae69","status":"verified"}

Peer versions

Peer versions were not recorded in the published result fields.

Evidence digests

Receipt
17a259d149aa430a00cb3509b479651351b6566e626fe4e20fc0cf8d6a2a9d47
Aggregate
2fead3b8a6a4640e1877ac0cf3a07c2f2a51444fe5c681d7ba9dedbc052116f8
Provenance
af008fde903f4b2c8b8efed622f0a4a792918d85edcc4118931ab6f721534cca
Harness commit
b3ae41f
Selected measurement
Completed
Antfly
main-09b78df97
Runtime
8h 19m 12s
Platform
linux · arm64
Machine
Apple M4 Max
Build
ReleaseFast

Measurement group

Fast scale

Runtime: 1h 46m 48s across 10 fresh lifecycles; cache-only publication assembly excluded.

Two-lifecycle mean, range, and raw trial values

Antfly main-09b78df97 · 09b78df9

VectorsQuery statusClean stops / totalSerial p95 msPeak QPS queries/sPeak clientsC30 QPS queries/sC30 p99 msDemand anon + shmem MBFinal volume MBBuild sRecall minSelected effortRequest errors
20,000ok2 / 24.65 [4.60–4.70]; trials 4.70, 4.601,422.66 [1,421.00–1,424.33]; trials 1,421.00, 1,424.3310, 101,352.94 [1,343.27–1,362.62]; trials 1,343.27, 1,362.6250.97 [50.62–51.32]; trials 51.32, 50.621,825.60 [1,825.40–1,825.80]; trials 1,825.80, 1,825.4084.39 [84.37–84.41]; trials 84.37, 84.416.39 [6.17–6.60]; trials 6.60, 6.170.96260.425, 0.4250
40,000ok2 / 24.90 [4.90–4.90]; trials 4.90, 4.901,351.42 [1,307.86–1,394.99]; trials 1,394.99, 1,307.8620, 101,320.63 [1,273.03–1,368.23]; trials 1,368.23, 1,273.0351.33 [50.01–52.65]; trials 50.01, 52.651,746.75 [1,361.00–2,132.50]; trials 2,132.50, 1,361.00166.19 [165.65–166.74]; trials 165.65, 166.7412.72 [11.87–13.57]; trials 11.87, 13.570.95100.4, 0.40
60,000ok2 / 25.35 [5.20–5.50]; trials 5.50, 5.201,298.98 [1,263.27–1,334.69]; trials 1,263.27, 1,334.6910, 201,263.52 [1,222.42–1,304.62]; trials 1,222.42, 1,304.6254.02 [51.78–56.26]; trials 56.26, 51.782,052.05 [1,953.20–2,150.90]; trials 2,150.90, 1,953.20249.09 [248.82–249.37]; trials 248.82, 249.3715.58 [15.56–15.59]; trials 15.59, 15.560.95520.425, 0.40
80,000ok2 / 25.50 [5.40–5.60]; trials 5.60, 5.401,249.47 [1,241.47–1,257.47]; trials 1,257.47, 1,241.4720, 301,237.01 [1,232.54–1,241.47]; trials 1,232.54, 1,241.4755.16 [53.40–56.92]; trials 56.92, 53.402,261.65 [2,226.40–2,296.90]; trials 2,226.40, 2,296.90329.96 [329.88–330.03]; trials 330.03, 329.8822.44 [21.45–23.43]; trials 21.45, 23.430.95420.4, 0.40
100,000ok2 / 25.75 [5.70–5.80]; trials 5.80, 5.701,222.94 [1,207.86–1,238.02]; trials 1,238.02, 1,207.8620, 201,211.14 [1,206.91–1,215.37]; trials 1,215.37, 1,206.9155.16 [54.07–56.24]; trials 54.07, 56.242,229.40 [2,183.00–2,275.80]; trials 2,183.00, 2,275.80412.93 [412.14–413.73]; trials 413.73, 412.1426.87 [26.66–27.08]; trials 26.66, 27.080.95840.4, 0.40

Serial query p95 (1 client)

Antfly main-09b78df97 (09b78df97ec69e020a56110a684b46fce9d4a511) · full ReleaseFast · Zig 0.17.0 · aarch64-linux-musl · baseline CPU · stripped · static · ONNX disabled · Metal disabled · system BLAS disabled · Platform: linux-arm64 · Processor: Apple M4 Max · 20,000–100,000 vectors · 768d · serial after client sweep · seed antfly-circus-vdbbench-v1 · 200 calibration / 800 held-out · 1/5/10/20/30 clients × 30 s · Lower is better

Peak throughput (best client count)

Antfly main-09b78df97 (09b78df97ec69e020a56110a684b46fce9d4a511) · full ReleaseFast · Zig 0.17.0 · aarch64-linux-musl · baseline CPU · stripped · static · ONNX disabled · Metal disabled · system BLAS disabled · Platform: linux-arm64 · Processor: Apple M4 Max · 20,000–100,000 vectors · 768d · best measured client count · seed antfly-circus-vdbbench-v1 · 200 calibration / 800 held-out · 1/5/10/20/30 clients × 30 s · Higher is better

Lifecycle demand (anon + shmem)

Antfly main-09b78df97 (09b78df97ec69e020a56110a684b46fce9d4a511) · full ReleaseFast · Zig 0.17.0 · aarch64-linux-musl · baseline CPU · stripped · static · ONNX disabled · Metal disabled · system BLAS disabled · Platform: linux-arm64 · Processor: Apple M4 Max · 20,000–100,000 vectors · 768d · cgroup anon + shmem peak from pre-index through 1/5/10/20/30-client sweep · seed antfly-circus-vdbbench-v1 · 200 calibration / 800 held-out · 1/5/10/20/30 clients × 30 s · Lower is better

Final database volume

Antfly main-09b78df97 (09b78df97ec69e020a56110a684b46fce9d4a511) · full ReleaseFast · Zig 0.17.0 · aarch64-linux-musl · baseline CPU · stripped · static · ONNX disabled · Metal disabled · system BLAS disabled · Platform: linux-arm64 · Processor: Apple M4 Max · 20,000–100,000 vectors · 768d · post-stop allocated bytes · seed antfly-circus-vdbbench-v1 · 200 calibration / 800 held-out · 1/5/10/20/30 clients × 30 s · Lower is better

Index build time

Antfly main-09b78df97 (09b78df97ec69e020a56110a684b46fce9d4a511) · full ReleaseFast · Zig 0.17.0 · aarch64-linux-musl · baseline CPU · stripped · static · ONNX disabled · Metal disabled · system BLAS disabled · Platform: linux-arm64 · Processor: Apple M4 Max · 20,000–100,000 vectors · 768d · insert + optimize · seed antfly-circus-vdbbench-v1 · 200 calibration / 800 held-out · 1/5/10/20/30 clients × 30 s · Lower is better

Measurement group

Big scale

Runtime: 6h 31m 38s across 14 fresh lifecycles; cache-only publication assembly excluded.

Two-lifecycle mean, range, and raw trial values

Antfly main-09b78df97 · 09b78df9

VectorsQuery statusClean stops / totalSerial p95 msPeak QPS queries/sPeak clientsC30 QPS queries/sC30 p99 msDemand anon + shmem MBFinal volume MBBuild sRecall minSelected effortRequest errors
200,000ok2 / 26.30 [6.20–6.40]; trials 6.20, 6.401,184.65 [1,176.76–1,192.53]; trials 1,192.53, 1,176.7620, 201,171.90 [1,153.01–1,190.80]; trials 1,190.80, 1,153.0157.41 [55.50–59.32]; trials 55.50, 59.322,391.90 [2,107.40–2,676.40]; trials 2,676.40, 2,107.40907.71 [905.54–909.89]; trials 909.89, 905.5454.68 [54.22–55.14]; trials 54.22, 55.140.95480.375, 0.3750
400,000ok2 / 27.25 [7.20–7.30]; trials 7.20, 7.301,047.35 [1,040.70–1,054.00]; trials 1,040.70, 1,054.0030, 201,030.23 [1,019.75–1,040.70]; trials 1,040.70, 1,019.7563.09 [62.29–63.89]; trials 62.29, 63.892,621.35 [2,412.90–2,829.80]; trials 2,829.80, 2,412.901,972.83 [1,971.29–1,974.37]; trials 1,971.29, 1,974.37119.74 [118.79–120.69]; trials 118.79, 120.690.96360.375, 0.3750
600,000ok2 / 28.65 [7.90–9.40]; trials 9.40, 7.90905.48 [901.39–909.57]; trials 909.57, 901.3930, 30905.48 [901.39–909.57]; trials 909.57, 901.3971.57 [70.86–72.28]; trials 72.28, 70.862,845.25 [2,820.00–2,870.50]; trials 2,870.50, 2,820.003,107.81 [3,098.08–3,117.53]; trials 3,117.53, 3,098.08211.00 [209.69–212.31]; trials 209.69, 212.310.95920.375, 0.3750
800,000ok2 / 210.45 [9.60–11.30]; trials 9.60, 11.30810.17 [797.19–823.16]; trials 797.19, 823.1630, 20806.27 [797.19–815.34]; trials 797.19, 815.3480.72 [77.35–84.09]; trials 84.09, 77.353,701.25 [3,464.20–3,938.30]; trials 3,464.20, 3,938.304,328.11 [4,260.02–4,396.20]; trials 4,260.02, 4,396.20303.03 [292.87–313.19]; trials 292.87, 313.190.96670.4, 0.40
1,000,000ok2 / 211.75 [11.10–12.40]; trials 12.40, 11.10796.79 [795.11–798.47]; trials 798.47, 795.1130, 20790.96 [783.45–798.47]; trials 798.47, 783.4586.30 [82.06–90.54]; trials 82.06, 90.543,911.85 [3,842.20–3,981.50]; trials 3,842.20, 3,981.506,094.61 [5,936.89–6,252.32]; trials 6,252.32, 5,936.89403.56 [386.67–420.45]; trials 386.67, 420.450.96060.4, 0.40
2,000,000ok2 / 226.25 [22.70–29.80]; trials 29.80, 22.70445.19 [331.97–558.41]; trials 558.41, 331.9720, 30334.95 [331.97–337.93]; trials 337.93, 331.97465.92 [286.04–645.80]; trials 286.04, 645.806,528.70 [6,241.00–6,816.40]; trials 6,241.00, 6,816.4015,709.32 [15,575.86–15,842.78]; trials 15,842.78, 15,575.861,121.16 [1,063.72–1,178.60]; trials 1,063.72, 1,178.600.95960.425, 0.4250
3,000,000ok2 / 226.95 [19.30–34.60]; trials 34.60, 19.30221.97 [113.90–330.03]; trials 113.90, 330.0330, 30221.97 [113.90–330.03]; trials 113.90, 330.031,131.24 [461.08–1,801.40]; trials 1,801.40, 461.089,209.05 [9,190.70–9,227.40]; trials 9,227.40, 9,190.7029,970.45 [29,578.32–30,362.57]; trials 29,578.32, 30,362.573,043.90 [2,878.87–3,208.94]; trials 3,208.94, 2,878.870.96240.45, 0.450

Serial query p95 (1 client)

Antfly main-09b78df97 (09b78df97ec69e020a56110a684b46fce9d4a511) · full ReleaseFast · Zig 0.17.0 · aarch64-linux-musl · baseline CPU · stripped · static · ONNX disabled · Metal disabled · system BLAS disabled · Platform: linux-arm64 · Processor: Apple M4 Max · 200,000–3,000,000 vectors · 768d · serial after client sweep · seed antfly-circus-vdbbench-v1 · 200 calibration / 800 held-out · 1/5/10/20/30 clients × 30 s · Lower is better

Peak throughput (best client count)

Antfly main-09b78df97 (09b78df97ec69e020a56110a684b46fce9d4a511) · full ReleaseFast · Zig 0.17.0 · aarch64-linux-musl · baseline CPU · stripped · static · ONNX disabled · Metal disabled · system BLAS disabled · Platform: linux-arm64 · Processor: Apple M4 Max · 200,000–3,000,000 vectors · 768d · best measured client count · seed antfly-circus-vdbbench-v1 · 200 calibration / 800 held-out · 1/5/10/20/30 clients × 30 s · Higher is better

Lifecycle demand (anon + shmem)

Antfly main-09b78df97 (09b78df97ec69e020a56110a684b46fce9d4a511) · full ReleaseFast · Zig 0.17.0 · aarch64-linux-musl · baseline CPU · stripped · static · ONNX disabled · Metal disabled · system BLAS disabled · Platform: linux-arm64 · Processor: Apple M4 Max · 200,000–3,000,000 vectors · 768d · cgroup anon + shmem peak from pre-index through 1/5/10/20/30-client sweep · seed antfly-circus-vdbbench-v1 · 200 calibration / 800 held-out · 1/5/10/20/30 clients × 30 s · Lower is better

Final database volume

Antfly main-09b78df97 (09b78df97ec69e020a56110a684b46fce9d4a511) · full ReleaseFast · Zig 0.17.0 · aarch64-linux-musl · baseline CPU · stripped · static · ONNX disabled · Metal disabled · system BLAS disabled · Platform: linux-arm64 · Processor: Apple M4 Max · 200,000–3,000,000 vectors · 768d · post-stop allocated bytes · seed antfly-circus-vdbbench-v1 · 200 calibration / 800 held-out · 1/5/10/20/30 clients × 30 s · Lower is better

Index build time

Antfly main-09b78df97 (09b78df97ec69e020a56110a684b46fce9d4a511) · full ReleaseFast · Zig 0.17.0 · aarch64-linux-musl · baseline CPU · stripped · static · ONNX disabled · Metal disabled · system BLAS disabled · Platform: linux-arm64 · Processor: Apple M4 Max · 200,000–3,000,000 vectors · 768d · insert + optimize · seed antfly-circus-vdbbench-v1 · 200 calibration / 800 held-out · 1/5/10/20/30 clients × 30 s · Lower is better

II

vector-filtered-ann

complete

Filtered ANN

Antfly main-09b78df97, stripped ReleaseFast, passed three fresh tenant-scoped filtered ANN lifecycles at a 30-client ceiling with zero request errors: recall 1.000, mean peak throughput 327.03 QPS, and mean service memory demand 728.2 MB.

Methodology scope · protocol · interpretation

Tenant-scoped filtered ANN publication protocol

The workload contains 50,000 1,536-dimensional cosine vectors in 100 equal tenant buckets. Each top-100 query searches one rotating 500-vector tenant. Each of three fresh Linux ARM64 lifecycles builds one index, tunes only on 200 deterministic calibration queries, and measures the disjoint 800-query publication holdout without rebuilding. The complete publication sweep uses 1, 8, and 30 clients for 10 seconds per point, plus a serial pass. Every lifecycle must complete the declared sweep with zero request errors; the default full-text index is retained and verified through the public API.

Performance and resource values are arithmetic means with three-trial ranges. Database-service memory demand is concurrent cgroup anon + shmem sampled from before indexing through publication, excluding the benchmark client. Final database volume is checksum-verified post-stop allocated bytes across the complete declared volume. Results do not establish capacity above 30 clients.

Peer rows retain their historical identities and measurement dates; they are references, not fresh matched comparisons.

Run evidence parameters · variation · provenance

Benchmark parameters

{"calibration_queries":200,"concurrency_schedule":[1,8,30],"execution_environment":{"container_runtime":"podman podman version 6.1.1","controller_platform":"darwin-arm64","processor":"Apple M4 Max","service_platform":"linux-arm64","vm_cpus":10,"vm_memory_bytes":29347610624,"vm_memory_gib":27.3},"implementation_files_sha256":{"benchmarks/VectorDBBench-harness/filtered_publication.py":"faffeccefea387fd723491028c386cb42d1ec8a5aeaa138daea1079507de5d70","benchmarks/VectorDBBench-harness/filtered_topology.py":"84e064bcf47274e9757f61b86df7f8d6b62655398ce07975e5704d9fced9a9b7","benchmarks/VectorDBBench-harness/lifecycle_supervisor.py":"2b2bc792eef9855aea3e5dd4aa50103f68b4b859a1f660786ed350760de5a7c6","benchmarks/VectorDBBench-harness/protocol.py":"f90e57543396bc1191bee5816b4a5c39bf1571cc4625d8ed1ff957e5c0b11491","benchmarks/VectorDBBench-harness/rotating_filter.py":"07e8681645e87d87c81aa97bc7a663f2116e05685a5c38635b016c1be2969681","benchmarks/VectorDBBench-harness/shared_queries.py":"ae711ad089f6edc1f0ccdcb20e117e16c7a5ec7a2761634449e869593822f673","benchmarks/VectorDBBench-harness/sitecustomize.py":"2fb6dad65897eec236d189735b5666403aef1b220e7266b3ed057d6f8c9d94dc","benchmarks/VectorDBBench/install/requirements_py3.11.txt":"cd0c3dc7c6f7594d0c523f69505cad2acb5bf28e00b966190b2ddfeae5a67e91","benchmarks/VectorDBBench/pyproject.toml":"17fcbc17a76e814782881fd2e888b3dc495af696fd3ed5780a0d6fd62d6c8bd9","benchmarks/adapters/vector/vdbbench/generate_filtered_groundtruth.py":"3ea2cc218bb94cd11e76487d774135a7b8ad3cf5c39710f43d53a75188c93584","benchmarks/run_vdbbench_filtered_publication.sh":"e1e6de15e3b149df77f2165df4131e416aa6a01902cb3c639dd537f9e8547eb2","benchmarks/run_vdbbench_filtered_topology_qualification.sh":"57f2cfbe69ad1acb2e26ac7d2d03f0acc47473ca2033dde0e2c47299a6857e71","benchmarks/run_vdbbench_honed.sh":"6d0d4bcd642efb18df241356a7c2c81f2f7a0dfc626620dc4e6bedaed16b049f","benchmarks/storage_footprint.py":"99cb131d8f52eac54d487ad406361ced6c784260270516b90364a31388429856","benchmarks/vdbbench_honed_pipeline.py":"07e598991e9c8a257fcc41aa3ef9433b8f9b8aaee3f8fe037f1d155ddc322029"},"num_shards":1,"publication_queries":800,"publication_query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","quality_floor_passed":true,"query_partition_seed":"antfly-circus-vdbbench-v1","selected_settings":[{"num_shards":1,"parameter":"search_effort","trial":1,"value":0.35},{"num_shards":1,"parameter":"search_effort","trial":2,"value":0.35},{"num_shards":1,"parameter":"search_effort","trial":3,"value":0.35}],"window_seconds":10,"workload":"tenant-scoped-1536d-50K-1pct"}

Trial variation

[{"below_qualification_floor":false,"cache_inclusive_peak_mb":{"max":1746.4,"mean":1652.0333,"min":1586.7,"trials":[1746.4,1586.7,1623]},"cgroup_current_peak_mb":{"max":1744.7,"mean":1647.0667,"min":1575.3,"trials":[1744.7,1575.3,1621.2]},"demand_peak_mb":{"max":977.9,"mean":962.6,"min":942.7,"trials":[977.9,967.2,942.7]},"display_name":"Weaviate","engine":"weaviate","engine_version":"1.39.2","images":["cr.weaviate.io/semitechnologies/weaviate:1.39.2@sha256:5c62e5cbce4c48fc770abcee71099d9de32aad3b44d12299611f8135ee412362"],"insert_s":{"max":57.3,"mean":56.9,"min":56.4,"trials":[56.4,57.3,57]},"load_s":{"max":57.3,"mean":56.9333,"min":56.5,"trials":[56.5,57.3,57]},"ndcg":{"max":1,"mean":1,"min":1,"trials":[1,1,1]},"peak_p99_ms":{"max":11.937,"mean":11.7119,"min":11.4516,"trials":[11.451609040009306,11.747034159616303,11.936994999414313]},"peak_qps":{"max":1154.1408,"mean":1143.9375,"min":1129.6205,"trials":[1154.1408,1148.0512,1129.6205]},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall":{"max":1,"mean":1,"min":1,"trials":[1,1,1]},"request_errors":0,"selected_settings":[{"parameter":"ef","trial":1,"value":64},{"parameter":"ef","trial":2,"value":64},{"parameter":"ef","trial":3,"value":64}],"serial_p95_ms":{"max":5.9,"mean":5.8667,"min":5.8,"trials":[5.8999999999999995,5.8999999999999995,5.8]},"serial_p99_ms":{"max":6.9,"mean":6.7333,"min":6.6,"trials":[6.7,6.6,6.8999999999999995]},"storage":{"aggregation_protocol_fingerprint":"ea275ea5ccbda1ec0de40401b1294b82af6ff50c8ab742670ad542995d1ba957","apparent_mean_bytes":392665790,"apparent_values_bytes":[392614606,392813351,392569414],"engine":"weaviate","max_bytes":392814592,"mean_bytes":392669867,"metric":"final_allocated_bytes","min_bytes":392572928,"reasons":[],"receipt_protocol_fingerprints":["197ff7a2f59206ab08da22e17085c8769e6df7314f808a85e13d476d7bbb4ac9","a7a4704672c308b64e8264b7617da187447b0e252ee95badeb70752aaf427f94","1d70071cef9e57b4494d01e1a15f9f270bfdaa102f41251cdbf8767bfe706469"],"relative_range":0.0006154381084840056,"status":"qualified","trial_count":3,"trial_ids":["1","2","3"],"values_bytes":[392622080,392814592,392572928],"workload":"tenant-scoped-1536d-50K-1pct"},"trial_count":3},{"below_qualification_floor":false,"cache_inclusive_peak_mb":{"max":4023.2,"mean":3866.8667,"min":3749.8,"trials":[4023.2,3749.8,3827.6]},"cgroup_current_peak_mb":{"max":3951.9,"mean":3796.7667,"min":3684.8,"trials":[3951.9,3684.8,3753.6]},"demand_peak_mb":{"max":1951.6,"mean":1912.8333,"min":1858,"trials":[1951.6,1858,1928.9]},"display_name":"Elasticsearch","engine":"elasticsearch","engine_version":"9.5.2","images":["docker.elastic.co/elasticsearch/elasticsearch:9.5.2@sha256:9c1e1afc2bda921b35025e21c72ec6e392266995aa35ad6a47887363592718be"],"insert_s":{"max":26.1,"mean":26.0333,"min":26,"trials":[26,26,26.1]},"load_s":{"max":26.2,"mean":26.1333,"min":26.1,"trials":[26.1,26.1,26.2]},"ndcg":{"max":1,"mean":1,"min":1,"trials":[1,1,1]},"peak_p99_ms":{"max":14.358,"mean":13.5081,"min":12.8423,"trials":[13.3240393799656,12.842340830211468,14.357986519808037]},"peak_qps":{"max":5893.4067,"mean":5810.7257,"min":5670.9428,"trials":[5867.8277,5893.4067,5670.9428]},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall":{"max":1,"mean":1,"min":1,"trials":[1,1,1]},"request_errors":0,"selected_settings":[{"parameter":"num_candidates","trial":1,"value":128},{"parameter":"num_candidates","trial":2,"value":128},{"parameter":"num_candidates","trial":3,"value":128}],"serial_p95_ms":{"max":1.5,"mean":1.5,"min":1.5,"trials":[1.5,1.5,1.5]},"serial_p99_ms":{"max":1.8,"mean":1.8,"min":1.8,"trials":[1.8,1.8,1.8]},"storage":{"aggregation_protocol_fingerprint":"e732be26c67ae8214d7b4d520ce0600f718aa964f033df134d7eb16ae1edbb24","apparent_mean_bytes":312139626,"apparent_values_bytes":[312156451,312116394,312146033],"engine":"elasticsearch","max_bytes":312373248,"mean_bytes":312359595,"metric":"final_allocated_bytes","min_bytes":312340480,"reasons":[],"receipt_protocol_fingerprints":["2a2599c1202fa1cda60d720c6cc8e8082643a012b317595599335a394e5e765e","b2f306b562646df562499643123c2dcfa6f0b97ae2cbba25a8128d18f6f30782","58b18aa47d8b9d2c810518873441111a7aa9eb9f226aae32c0fe82fd30c30a86"],"relative_range":0.00010490473338899112,"status":"qualified","trial_count":3,"trial_ids":["1","2","3"],"values_bytes":[312373248,312340480,312365056],"workload":"tenant-scoped-1536d-50K-1pct"},"trial_count":3},{"below_qualification_floor":false,"cache_inclusive_peak_mb":{"max":5760,"mean":5485.7333,"min":5052.2,"trials":[5760,5645,5052.2]},"cgroup_current_peak_mb":{"max":5608.1,"mean":5284.5667,"min":4846.1,"trials":[5608.1,5399.5,4846.1]},"demand_peak_mb":{"max":3038.8,"mean":2980.7667,"min":2942.6,"trials":[2960.9,3038.8,2942.6]},"display_name":"Milvus","engine":"milvus","engine_version":"v2.6.22","images":["milvusdb/milvus:v2.6.22@sha256:a8ac051e59eb084d41bd317ec51aac28553d664e91c43a806ccd6a1538abc1df"],"insert_s":{"max":4,"mean":3.7333,"min":3.6,"trials":[3.6,3.6,4]},"load_s":{"max":51.2,"mean":44.2667,"min":40.5,"trials":[51.2,40.5,41.1]},"ndcg":{"max":1,"mean":1,"min":1,"trials":[1,1,1]},"peak_p99_ms":{"max":9.6052,"mean":9.163,"min":8.8996,"trials":[8.89960063977469,8.984309360421321,9.605236999559574]},"peak_qps":{"max":6925.8747,"mean":6789.2853,"min":6564.5179,"trials":[6925.8747,6877.4633,6564.5179]},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall":{"max":1,"mean":1,"min":1,"trials":[1,1,1]},"request_errors":0,"selected_settings":[{"parameter":"ef_search","trial":1,"value":100},{"parameter":"ef_search","trial":2,"value":100},{"parameter":"ef_search","trial":3,"value":100}],"serial_p95_ms":{"max":1.3,"mean":1.2667,"min":1.2,"trials":[1.2,1.3,1.3]},"serial_p99_ms":{"max":1.5,"mean":1.5,"min":1.5,"trials":[1.5,1.5,1.5]},"storage":{"aggregation_protocol_fingerprint":"111f529febc3e0471dff12b6f3cca736bfdbebc83effe035b42e196666c87a65","apparent_mean_bytes":2393476179,"apparent_values_bytes":[2393471634,2393481213,2393475690],"engine":"milvus","max_bytes":2394193920,"mean_bytes":2394193920,"metric":"final_allocated_bytes","min_bytes":2394193920,"reasons":[],"receipt_protocol_fingerprints":["008d4446ef82b56a8fe5ae2e57039d1f0f565bbd5635570bac1d4f6aab57bc77","ecebc9003fbc200dda6984ef8c80f21525d37dba8d6683c3f5aeb319ebe553c3","1fe4ef93612ee35620b31a1465bf4a079fddd695d8ee17d86869e475e1d37682"],"relative_range":0,"status":"qualified","trial_count":3,"trial_ids":["1","2","3"],"values_bytes":[2394193920,2394193920,2394193920],"workload":"tenant-scoped-1536d-50K-1pct"},"trial_count":3},{"below_qualification_floor":false,"cache_inclusive_peak_mb":{"max":3570.5,"mean":3545.6,"min":3532.3,"trials":[3570.5,3532.3,3534]},"cgroup_current_peak_mb":{"max":3533,"mean":3270.7667,"min":3126.3,"trials":[3153,3126.3,3533]},"demand_peak_mb":{"max":2303.8,"mean":2303.6667,"min":2303.6,"trials":[2303.6,2303.8,2303.6]},"display_name":"pgvector","engine":"pgvector","engine_version":"0.8.6-pg16","images":["pgvector/pgvector:0.8.6-pg16@sha256:ccc6e83d6e35e931dc7c5def2022729d5a6c370318d099181995567ff1fb4d6b"],"insert_s":{"max":4.9,"mean":4.8,"min":4.7,"trials":[4.9,4.8,4.7]},"load_s":{"max":20.4,"mean":20.3,"min":20.2,"trials":[20.4,20.2,20.3]},"ndcg":{"max":0.9662,"mean":0.9661,"min":0.9661,"trials":[0.9661,0.9661,0.9662]},"peak_p99_ms":{"max":228.1445,"mean":224.4917,"min":221.6439,"trials":[223.68666072001358,221.64391372021782,228.14453434006282]},"peak_qps":{"max":170.4544,"mean":167.6261,"min":165.3733,"trials":[167.0507,170.4544,165.3733]},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall":{"max":0.9574,"mean":0.9573,"min":0.9573,"trials":[0.9573,0.9573,0.9574]},"request_errors":0,"selected_settings":[{"parameter":"ef_search","trial":1,"value":64},{"parameter":"ef_search","trial":2,"value":64},{"parameter":"ef_search","trial":3,"value":64}],"serial_p95_ms":{"max":53.2,"mean":52.9333,"min":52.4,"trials":[52.400000000000006,53.199999999999996,53.199999999999996]},"serial_p99_ms":{"max":56.4,"mean":56.0667,"min":55.8,"trials":[56,55.800000000000004,56.4]},"storage":{"aggregation_protocol_fingerprint":"5bd5eec398e2a4331074e1c5b70954eb4b35b184ec21ad674304add90fee2c42","apparent_mean_bytes":1523896040,"apparent_values_bytes":[1523896040,1523896040,1523896040],"engine":"pgvector","max_bytes":1523974144,"mean_bytes":1523972779,"metric":"final_allocated_bytes","min_bytes":1523970048,"reasons":[],"receipt_protocol_fingerprints":["b215304569a34e3c9a5029b2499e743c3c360d6cf4048b65869b9447c0a98098","79a5600ae276ddc97e36adeb9a74a3951b164581b47050a0e370e2f2b3792856","332ca12a96fb884d59a84fb2c5a80aafb8450c8a55fb071bab593c75088901f6"],"relative_range":0.000002687712049281888,"status":"qualified","trial_count":3,"trial_ids":["1","2","3"],"values_bytes":[1523970048,1523974144,1523974144],"workload":"tenant-scoped-1536d-50K-1pct"},"trial_count":3},{"below_qualification_floor":false,"cache_inclusive_peak_mb":{"max":882.2,"mean":862.0333,"min":850.7,"trials":[882.2,850.7,853.2]},"cgroup_current_peak_mb":{"max":881.1,"mean":860.4333,"min":848,"trials":[881.1,848,852.2]},"demand_peak_mb":{"max":502.9,"mean":499.9,"min":496.5,"trials":[500.3,496.5,502.9]},"display_name":"Chroma","engine":"chroma","engine_version":"1.5.9","images":["chromadb/chroma:1.5.9@sha256:1e0b73a187a28757c572acba508c46f48c9e8b0acaf5c20e6d95cdedce1acdf6"],"insert_s":{"max":45,"mean":44.8333,"min":44.5,"trials":[45,45,44.5]},"load_s":{"max":45.2,"mean":45,"min":44.6,"trials":[45.2,45.2,44.6]},"ndcg":{"max":0.9999,"mean":0.9999,"min":0.9999,"trials":[0.9999,0.9999,0.9999]},"peak_p99_ms":{"max":581.5998,"mean":573.4335,"min":562.5068,"trials":[581.5997719297643,562.5068286099986,576.1939451607034]},"peak_qps":{"max":111.6785,"mean":111.5999,"min":111.5605,"trials":[111.5606,111.5605,111.6785]},"query_indices_sha256":"7be5c5f24dfa31b66c5dfc3280c8f1bc5c1c8db3a35046a1a1ab9d50a0d232f7","recall":{"max":0.9999,"mean":0.9999,"min":0.9999,"trials":[0.9999,0.9999,0.9999]},"request_errors":0,"selected_settings":[{"parameter":"ef_search","trial":1,"value":256},{"parameter":"ef_search","trial":2,"value":256},{"parameter":"ef_search","trial":3,"value":256}],"serial_p95_ms":{"max":78.9,"mean":78.5333,"min":78.2,"trials":[78.2,78.5,78.89999999999999]},"serial_p99_ms":{"max":80.8,"mean":79.9667,"min":79.3,"trials":[79.8,79.3,80.8]},"storage":{"aggregation_protocol_fingerprint":"e7b2b75a3aebddfdf2974e664eb58fe9b6557eac089395de53a54c6cb663802e","apparent_mean_bytes":336122824,"apparent_values_bytes":[336812844,336689896,334865732],"engine":"chroma","max_bytes":336818176,"mean_bytes":336131413,"metric":"final_allocated_bytes","min_bytes":334880768,"reasons":[],"receipt_protocol_fingerprints":["5a5b6124abe744abc0730121250f99efd3a41a5ffe5ec59ff8fe9c7c80b54a7a","63979eedbce3ea1b3b7818eedb15452a384d7cc4a3ad348a869e8719382c9234","1e0ccdc987a18862bfda60391f36e086c8d99191e76f02263f33b5971dbfa28e"],"relative_range":0.0057638409358625456,"status":"qualified","trial_count":3,"trial_ids":["1","2","3"],"values_bytes":[336818176,336695296,334880768],"workload":"tenant-scoped-1536d-50K-1pct"},"trial_count":3}]

Peer versions

  • 1.39.2
  • 9.5.2
  • v2.6.22
  • 0.8.6-pg16
  • 1.5.9

Evidence digests

Receipt
a85438092e7cca9d7461ef2f1adf5901a131586c057b5e78ae909da688d5883a
Aggregate
53ad272473dd9b610a969e80835f5d59b0e7a97d05afff2ec7ec48360812839f
Provenance
53ad272473dd9b610a969e80835f5d59b0e7a97d05afff2ec7ec48360812839f
Harness commit
82c699bb7a687b65efc691ec329368494ce8499e

Peer cohort evidence · 1536d-50K-tenant-scoped-1pct

Completed
Fresh lifecycles
15
Peer variants
5
Receipt
069d2e8eb1e613e4c513af08320564af81dd4a41d8991adddcd7064db043f85b
Aggregate
04d4f8a9071bf1fd4abf048b985f02d332a6eefa68560aaea086f67568f43c96
Provenance
04d4f8a9071bf1fd4abf048b985f02d332a6eefa68560aaea086f67568f43c96
Selected measurement
Completed
Antfly
main-09b78df97 ·
Runtime
28m 50s
Platform
linux · arm64
Machine
Apple M4 Max
Build
ReleaseFast

Peer cohort · 1536d-50K-tenant-scoped-1pct

Completed
Variants
5 independently executed peers
Lifecycles
15 fresh
Compatibility
Historical reference · not a matched runtime

Peak filtered throughput

Antfly main-09b78df97 (09b78df9, ReleaseFast/stripped) · linux-arm64 · tenant-scoped 1536d/50K · 3 fresh lifecycles · 1/8/30 clients · 10 s/point · partition seed antfly-circus-vdbbench-v1 · Higher is better · Apple M4 Max · podman podman version 6.1.1 · 10 VM CPUs / 27.3 GiB · Historical peers, not a matched run

Peak-concurrency p99

Antfly main-09b78df97 (09b78df9, ReleaseFast/stripped) · linux-arm64 · tenant-scoped 1536d/50K · 3 fresh lifecycles · 1/8/30 clients · 10 s/point · partition seed antfly-circus-vdbbench-v1 · Lower is better · Apple M4 Max · podman podman version 6.1.1 · 10 VM CPUs / 27.3 GiB · Historical peers, not a matched run

Demand working set

Antfly main-09b78df97 (09b78df9, ReleaseFast/stripped) · linux-arm64 · tenant-scoped 1536d/50K · 3 fresh lifecycles · 1/8/30 clients · 10 s/point · partition seed antfly-circus-vdbbench-v1 · Lower is better · Apple M4 Max · podman podman version 6.1.1 · 10 VM CPUs / 27.3 GiB · Historical peers, not a matched run

Tenant-scoped filtered ANN

Antfly main-09b78df97 · 09b78df9

EngineRecall@100nDCGPeak QPS queries/sPeak p99 msSerial p99 msDemand MBFinal volume MBTrials
Antfly1.00001.0000327.0177.9023.20728.2369.03
Weaviate1.00001.00001,143.911.716.73962.6392.73
Elasticsearch1.00001.00005,810.713.511.801,912.8312.43
Milvus1.00001.00006,789.39.161.502,980.82,394.23
pgvector0.95730.9661167.6224.4956.072,303.71,524.03
Chroma0.99990.9999111.6573.4379.97499.9336.13
III

fulltext-search-benchmark-game

partial

Search Benchmark Game

Retained August 27 Antfly v0.2.1-rc1 results over 250,000 Wikipedia documents, four query classes, two result windows, and two concurrency levels.

Methodology scope · protocol · interpretation

Search Benchmark Game Methodology

What this lane measures

This is an end-to-end, self-hosted database comparison over the first 250,000 documents in the Search Benchmark Game Wikipedia corpus. Every timed adapter uses a persistent database connection and requests ranked document IDs without stored document bodies. Tantivy is deliberately absent: it is an embedded search library, while every measured row here is a database service.

The run uses the 902 upstream term, union, intersection, and phrase queries. The 60 mixed required/optional and negated Lucene-syntax queries remain excluded because Antfly cannot represent their matching and scoring semantics directly. If the remaining workload proves too Lucene-oriented for database comparison, that will motivate a separate benchmark rather than further changing this one.

Database matrix and capability policy

  • Antfly 0.2.0-rc.18: term, union, intersection, phrase
  • Elasticsearch 8.15.3: term, union, intersection, phrase
  • Weaviate 1.38.2: term, union, intersection; exact phrase unsupported
  • Quickwit 0.8.2: term, union, intersection, phrase
  • PostgreSQL 16 from the pgvector image: term, union, intersection, phrase; pgvector is not involved in lexical execution
  • Milvus 2.5.8: retained as unsupported because its BM25 raw-text input is a VARCHAR capped at 65,535 bytes, while 20 corpus documents exceed that limit and the maximum is 202,798 bytes
  • Chroma self-hosted: retained as unsupported because its text surface provides containment/regex filtering rather than ranked lexical top-k retrieval; the richer Chroma Search API is cloud-only

Missing capabilities are never emulated client-side. Public output uses —* for a product limitation and failed† for a setup or execution failure, with the reason preserved in JSON and rendered beside the table.

Execution protocol

The benchmark runs TOP_10 and TOP_100 at concurrency 1 and 8. Each cell has a five-second warmup followed by two measured rounds. Concurrency uses one persistent connection per worker; individual request latency and aggregate QPS are both recorded. Only one database is timed at once. Indexing is sequential, uses the unchanged corpus, and uses native bulk paths (COPY for PostgreSQL, bulk APIs elsewhere).

Antfly uses a prebuilt release binary; the benchmark never builds Zig. It runs one shard and sends fields: []. Elasticsearch uses one primary shard, zero replicas, a 1 GiB heap, and a one-segment force merge. Weaviate runs one node with vectorization disabled. Quickwit runs one node with a positional, fieldnorm-enabled text index and BM25 score ordering; only external IDs are stored. PostgreSQL uses a stored tsvector, GIN index, and ts_rank_cd ordering.

Where configurable, adapters approximate Antfly’s fixed Bleve analyzer with standard/word tokenization, lowercase normalization, and English stopwords. Quickwit’s built-in default tokenizer lowercases but does not expose a matching stop-word filter. Residual analyzer and scoring differences are reported through an untimed top-10 ID/count diagnostic; exact cross-engine ranking is not a pass condition.

Interpretation

The headline table shows TOP_10 concurrency-8 p95 latency by query class so partial capability is visible. Full artifacts retain p50/p95/p99, QPS, sample counts, status, and reasons for TOP_10/TOP_100 at both concurrency levels. This benchmark has no relevance judgments, so it supports performance and capability claims only—not claims that one engine ranks documents more correctly.

Run evidence parameters · variation · provenance

Benchmark parameters

{"concurrency":[1,8],"corpus_documents":250000,"engine_details":{},"query_classes":["term","union","intersection","phrase"],"result_windows":["TOP_10","TOP_100"]}

Peer versions

  • Elasticsearch8.15.3
  • Weaviate1.38.2
  • Quickwit0.8.2
  • PostgreSQL16
  • Milvus2.5.8

Evidence digests

Receipt
497cd5bb71933a4870d77594d3a9077af7a3a873d7c1b03e20ab84c8f0a9fb66
Aggregate
0d60283a261325d0d59a95e51fb47259572da07982813583531dc65b75607a17
Provenance
121237470c0ad51498a070266c901994203dde752a1344072f5ce967c4f25514
Harness commit
099cb05da1d0503fcd47ee5f454b0bde617b5529
Selected partial evidence
Completed
Antfly
v0.2.1-rc1 ·
Runtime
2m 54s
Platform
darwin · arm64
Machine
Apple M4 Max
Build
ReleaseFast

Top 10 · concurrency 1

Antfly v0.2.1-rc1 (279381f7, ReleaseFast/full) · darwin-arm64 · Apple M4 Max · 250,000 documents · 902-query workload · QPS, higher is better

Top 10 · concurrency 8

Antfly v0.2.1-rc1 (279381f7, ReleaseFast/full) · darwin-arm64 · Apple M4 Max · 250,000 documents · 902-query workload · QPS, higher is better

Top 100 · concurrency 1

Antfly v0.2.1-rc1 (279381f7, ReleaseFast/full) · darwin-arm64 · Apple M4 Max · 250,000 documents · 902-query workload · QPS, higher is better

Top 100 · concurrency 8

Antfly v0.2.1-rc1 (279381f7, ReleaseFast/full) · darwin-arm64 · Apple M4 Max · 250,000 documents · 902-query workload · QPS, higher is better

Search behavior by query class and result window

Antfly v0.2.1-rc1 · 279381f7

EngineQuery classResult windowConcurrencyQueriesQPSp95 msStatus
AntflytermTOP_10115,972.40.121measured
AntflyunionTOP_1013011,369.62.739measured
AntflyintersectionTOP_1013002,174.51.482measured
AntflyphraseTOP_1013003,940.10.465measured
AntflytermTOP_10816,111.50.124measured
AntflyunionTOP_1083018,039.73.478measured
AntflyintersectionTOP_10830012,925.11.655measured
AntflyphraseTOP_10830021,324.50.720measured
AntflytermTOP_100116,149.10.123measured
AntflyunionTOP_10013011,164.73.057measured
AntflyintersectionTOP_10013002,049.71.675measured
AntflyphraseTOP_10013003,618.40.507measured
AntflytermTOP_100814,417.00.221measured
AntflyunionTOP_10083017,020.03.605measured
AntflyintersectionTOP_100830012,444.21.736measured
AntflyphraseTOP_100830020,502.30.722measured
weaviate-1.38.2termTOP_1011586.61.829measured
weaviate-1.38.2unionTOP_1013011,151.51.177measured
weaviate-1.38.2intersectionTOP_1013001,103.31.196measured
weaviate-1.38.2phraseTOP_101300UnsupportedUnsupportedunsupported
quickwit-0.8.2termTOP_1011318.33.104measured
quickwit-0.8.2unionTOP_101301326.73.357measured
quickwit-0.8.2intersectionTOP_101300381.93.282measured
quickwit-0.8.2phraseTOP_101300586.33.037measured
postgresql-16termTOP_10113,472.50.240measured
postgresql-16unionTOP_10130113.8215.429measured
postgresql-16intersectionTOP_101300511.46.565measured
postgresql-16phraseTOP_101300534.65.612measured
milvus-2.5.8termTOP_1011UnsupportedUnsupportedunsupported
milvus-2.5.8unionTOP_101301UnsupportedUnsupportedunsupported
milvus-2.5.8intersectionTOP_101300UnsupportedUnsupportedunsupported
milvus-2.5.8phraseTOP_101300UnsupportedUnsupportedunsupported
chroma-self-hostedtermTOP_1011UnsupportedUnsupportedunsupported
chroma-self-hostedunionTOP_101301UnsupportedUnsupportedunsupported
chroma-self-hostedintersectionTOP_101300UnsupportedUnsupportedunsupported
chroma-self-hostedphraseTOP_101300UnsupportedUnsupportedunsupported
weaviate-1.38.2termTOP_1081905.60.909measured
weaviate-1.38.2unionTOP_1083016,874.61.537measured
weaviate-1.38.2intersectionTOP_1083006,955.81.690measured
weaviate-1.38.2phraseTOP_108300UnsupportedUnsupportedunsupported
quickwit-0.8.2termTOP_10812963.286measured
quickwit-0.8.2unionTOP_1083011,7625.956measured
quickwit-0.8.2intersectionTOP_1083002,0195.318measured
quickwit-0.8.2phraseTOP_1083002,460.85.227measured
postgresql-16termTOP_10813,4810.239measured
postgresql-16unionTOP_10830176.2311.210measured
postgresql-16intersectionTOP_1083002,268.710.292measured
postgresql-16phraseTOP_1083002,411.98.667measured
milvus-2.5.8termTOP_1081UnsupportedUnsupportedunsupported
milvus-2.5.8unionTOP_108301UnsupportedUnsupportedunsupported
milvus-2.5.8intersectionTOP_108300UnsupportedUnsupportedunsupported
milvus-2.5.8phraseTOP_108300UnsupportedUnsupportedunsupported
chroma-self-hostedtermTOP_1081UnsupportedUnsupportedunsupported
chroma-self-hostedunionTOP_108301UnsupportedUnsupportedunsupported
chroma-self-hostedintersectionTOP_108300UnsupportedUnsupportedunsupported
chroma-self-hostedphraseTOP_108300UnsupportedUnsupportedunsupported
weaviate-1.38.2termTOP_100118370.963measured
weaviate-1.38.2unionTOP_1001301621.52.115measured
weaviate-1.38.2intersectionTOP_1001300797.21.984measured
weaviate-1.38.2phraseTOP_1001300UnsupportedUnsupportedunsupported
quickwit-0.8.2termTOP_1001149.220.797measured
quickwit-0.8.2unionTOP_100130153.421.169measured
quickwit-0.8.2intersectionTOP_1001300111.519.710measured
quickwit-0.8.2phraseTOP_1001300327.414.740measured
postgresql-16termTOP_100113,519.60.236measured
postgresql-16unionTOP_100130113.6220.023measured
postgresql-16intersectionTOP_1001300482.56.983measured
postgresql-16phraseTOP_1001300529.35.977measured
milvus-2.5.8termTOP_10011UnsupportedUnsupportedunsupported
milvus-2.5.8unionTOP_1001301UnsupportedUnsupportedunsupported
milvus-2.5.8intersectionTOP_1001300UnsupportedUnsupportedunsupported
milvus-2.5.8phraseTOP_1001300UnsupportedUnsupportedunsupported
chroma-self-hostedtermTOP_10011UnsupportedUnsupportedunsupported
chroma-self-hostedunionTOP_1001301UnsupportedUnsupportedunsupported
chroma-self-hostedintersectionTOP_1001300UnsupportedUnsupportedunsupported
chroma-self-hostedphraseTOP_1001300UnsupportedUnsupportedunsupported
weaviate-1.38.2termTOP_100812,046.70.448measured
weaviate-1.38.2unionTOP_10083013,145.74.015measured
weaviate-1.38.2intersectionTOP_10083004,033.23.467measured
weaviate-1.38.2phraseTOP_1008300UnsupportedUnsupportedunsupported
quickwit-0.8.2termTOP_1008150.719.463measured
quickwit-0.8.2unionTOP_100830137324.984measured
quickwit-0.8.2intersectionTOP_1008300749.421.959measured
quickwit-0.8.2phraseTOP_10083001,783.117.652measured
postgresql-16termTOP_100813,2850.265measured
postgresql-16unionTOP_100830173.9322.166measured
postgresql-16intersectionTOP_10083002,309.410.066measured
postgresql-16phraseTOP_10083002,328.88.822measured
milvus-2.5.8termTOP_10081UnsupportedUnsupportedunsupported
milvus-2.5.8unionTOP_1008301UnsupportedUnsupportedunsupported
milvus-2.5.8intersectionTOP_1008300UnsupportedUnsupportedunsupported
milvus-2.5.8phraseTOP_1008300UnsupportedUnsupportedunsupported
chroma-self-hostedtermTOP_10081UnsupportedUnsupportedunsupported
chroma-self-hostedunionTOP_1008301UnsupportedUnsupportedunsupported
chroma-self-hostedintersectionTOP_1008300UnsupportedUnsupportedunsupported
chroma-self-hostedphraseTOP_1008300UnsupportedUnsupportedunsupported
IV

inference-termite-circus

complete

Inference

Antfly v0.2.1-rc.3 passed all seven requested inference workloads across 21 fresh lifecycles.

Methodology scope · protocol · interpretation

Antfly Inference Methodology

Subject contract

Inference is delegated to ../termite-circus. Each campaign receives exactly one explicit ANTFLY_BIN from the antfly-circus subject manifest. The harness records the executable’s version, architecture, and SHA-256; it does not fetch, install, update, or build Antfly. Comparing Antfly releases means comparing separate campaign bundles.

The rc.24 acceptance matrix covers generation, dense/sparse/multimodal embedding, reranking, chunking, GLiNER2 extraction, OCR/readers, and transcription. Rewriters are reported as known-incompatible rather than timed.

Profiles

  • smoke runs only the supplied Antfly binary, one lifecycle and one measured request, against one certified representative per working category. It is a compatibility gate, not publication evidence.
  • full adds category-appropriate local reference runtimes and certified model alternates. Each provider/model cell uses three fresh lifecycles, one warmup per lifecycle, and the tracked request count from matrix.json. Provider order alternates to reduce order bias.

Reference runtimes are local only: llama.cpp, Ollama, and vLLM-Metal for generation; ONNX Runtime and Sentence Transformers for embedding/reranking; GLiNER2 for extraction; Transformers for Florence-2; and faster-whisper plus whisper.cpp for transcription.

Provider-native formats are permitted when a runtime cannot load an identical artifact. Every result retains the logical model, exact artifact/revision, variant or quantization, and checksum. Such rows are not described as byte-identical comparisons.

Validity and metrics

Every cell must pass a deterministic category-specific quality gate before its latency or throughput is valid. The gates check semantic ordering, sparse output, cross-modal output, relevant-document ordering, valid chunk coverage, expected extraction fields, OCR/transcription word recovery, or a nonempty constrained completion. These fixtures detect broken inference; they are not a general model-quality leaderboard.

Warm request latency is reported as p50 and p95 within measured requests. Throughput uses successful measured requests only. Cold model-load/readiness time and raw provider output remain in the campaign artifacts rather than being mixed into warm latency.

Peak inference memory is the maximum of two concurrently sampled views:

  1. rooted process-tree RSS, including provider helpers and model servers;
  2. positive growth in system anonymous + compressor-occupied + wired memory from the pre-launch baseline.

Samples are retained every 200 ms. System growth is publishable only when the operator sets QUIET_HOST_ACK=1 on a quiet host; otherwise the memory value is diagnostic. Full reports retain each lifecycle and report the arithmetic mean and range rather than selecting the best trial.

Artifacts

The full antfly-circus command writes directly into $BASTILLE_OUT/data/inference-termite-circus/:

  • report.md: compact per-category tables;
  • result.json: canonical normalized rows consumed by antfly-circus;
  • provenance.json: subject, host, model, provider, and input fingerprints;
  • receipt.json: completeness, failures, and quality-gate status;
  • raw/: provider logs and memory timelines.

A failed campaign still retains the bundle and failed rows. Publication reads result.json and the receipt; Markdown is derived output and is never parsed as the source of truth.

Run evidence parameters · variation · provenance

Benchmark parameters

{"completed_workloads":7,"failed_workloads":0,"memory_metric":"max-rooted-RSS-and-positive-system-anonymous-compressor-wired-growth","memory_unit":"MB","model_artifacts":[{"artifact_sha256":"676c35070db6dbe52f93e9c864ee0fba4eddea94b9c875d9cb10daff453fbaee","benchmark_id":"generation-gemma4-e4b-qat","model":"google/gemma-4-E4B-it-qat-q4_0-gguf","variant":"QAT q4_0"},{"artifact_sha256":"449c8a2f7115155ad21291a887c8c7a136b0642f598a910018a37978c167d934","benchmark_id":"dense-bge-small","model":"BAAI/bge-small-en-v1.5","variant":"f32"},{"artifact_sha256":"a00e24a8e937f7f25434403396a3ac7ba76ffb4917b7403f629007168dbe611c","benchmark_id":"sparse-splade-tiny","model":"sparse-encoder-testing/splade-bert-tiny-nq-onnx","variant":"onnx"},{"artifact_sha256":"e27744c7a1716a21a6652de9b17d01b8773e782230faeefaae7947f7b7c7961a","benchmark_id":"rerank-mxbai-base","model":"mixedbread-ai/mxbai-rerank-base-v1","variant":"f32"},{"artifact_sha256":null,"benchmark_id":"chunk-fixed-bert","model":"fixed_bert","variant":"built-in"},{"artifact_sha256":"0eb40d545ed9a3849d76e49104ae6f3e1b4702bb96394ab1afff6b641dd9477b","benchmark_id":"extract-gliner2-base","model":"antflydb/gliner2-base-v1","variant":"f32"},{"artifact_sha256":"868e1ad35ae82615228c7d3503c9ed1e7310804b72b9a85ddc604af546ca5958","benchmark_id":"transcribe-whisper-tiny","model":"openai/whisper-tiny","variant":"f32"}],"planned_workloads":7,"source_memory_unit":"MiB","trials_per_workload":3,"workloads":[{"chat_template_kwargs":{"enable_thinking":false},"host_budget_mb":8192,"id":"generation-gemma4-e4b-qat","model":"google/gemma-4-E4B-it-qat-q4_0-gguf","variant":"QAT q4_0"},{"id":"dense-bge-small","model":"BAAI/bge-small-en-v1.5","variant":"f32"},{"id":"sparse-splade-tiny","model":"sparse-encoder-testing/splade-bert-tiny-nq-onnx","variant":"onnx"},{"id":"rerank-mxbai-base","model":"mixedbread-ai/mxbai-rerank-base-v1","variant":"f32"},{"id":"chunk-fixed-bert","model":"fixed_bert","variant":"built-in"},{"id":"extract-gliner2-base","model":"antflydb/gliner2-base-v1","variant":"f32"},{"id":"transcribe-whisper-tiny","model":"openai/whisper-tiny","variant":"f32"}]}

Trial variation

[{"model":"ggml-org/gemma-4-E4B-it-GGUF","peak_memory":{"maximum":7726.65625,"mean":7434.364583333333,"minimum":7111,"unit":"MB"},"provider":"llama.cpp","variant":"Q4_0"},{"model":"ggml-org/gemma-4-E4B-it-GGUF","peak_memory":{"maximum":11632.296875,"mean":10929.015625,"minimum":10415.78125,"unit":"MB"},"provider":"ollama","variant":"Q4_0"},{"model":"ggml-org/gemma-4-E4B-it-GGUF","peak_memory":{"maximum":27998.640625,"mean":25524.130208333332,"minimum":20975.46875,"unit":"MB"},"provider":"vllm-metal","variant":"Q4_0"},{"model":"google/gemma-4-E4B-it-qat-q4_0-gguf","peak_memory":{"maximum":8404.0625,"mean":7605.09375,"minimum":7201.640625,"unit":"MB"},"provider":"llama.cpp","variant":"QAT q4_0"},{"model":"google/gemma-4-E4B-it-qat-q4_0-gguf","peak_memory":{"maximum":7804.75,"mean":7387.28125,"minimum":6806.921875,"unit":"MB"},"provider":"ollama","variant":"QAT q4_0"},{"model":"google/gemma-4-E4B-it-qat-q4_0-gguf","peak_memory":{"maximum":28953.59375,"mean":28351.203125,"minimum":28043.796875,"unit":"MB"},"provider":"vllm-metal","variant":"QAT q4_0"},{"model":"unsloth/Qwen3-1.7B-GGUF","peak_memory":{"maximum":5665.421875,"mean":5665.348958333333,"minimum":5665.25,"unit":"MB"},"provider":"llama.cpp","variant":"Q4_K_M"},{"model":"unsloth/Qwen3-1.7B-GGUF","peak_memory":{"maximum":5348.796875,"mean":5162.703125,"minimum":5059.1875,"unit":"MB"},"provider":"ollama","variant":"Q4_K_M"},{"model":"unsloth/Qwen3-1.7B-GGUF","peak_memory":{"maximum":28489.640625,"mean":25832.145833333332,"minimum":24216.65625,"unit":"MB"},"provider":"vllm-metal","variant":"Q4_K_M"},{"model":"BAAI/bge-small-en-v1.5","peak_memory":{"maximum":1027.65625,"mean":1024.2864583333333,"minimum":1022.125,"unit":"MB"},"provider":"onnxruntime","variant":"f32"},{"model":"BAAI/bge-small-en-v1.5","peak_memory":{"maximum":1734.4375,"mean":1296.7708333333333,"minimum":531.328125,"unit":"MB"},"provider":"sentence-transformers","variant":"f32"},{"model":"BAAI/bge-large-en-v1.5","peak_memory":{"maximum":3448.859375,"mean":3448.4322916666665,"minimum":3448.21875,"unit":"MB"},"provider":"onnxruntime","variant":"f32"},{"model":"BAAI/bge-large-en-v1.5","peak_memory":{"maximum":3779.78125,"mean":2297.2447916666665,"minimum":534.21875,"unit":"MB"},"provider":"sentence-transformers","variant":"f32"},{"model":"mixedbread-ai/mxbai-embed-large-v1","peak_memory":{"maximum":3447.1875,"mean":3446.8854166666665,"minimum":3446.671875,"unit":"MB"},"provider":"onnxruntime","variant":"f32"},{"model":"mixedbread-ai/mxbai-embed-large-v1","peak_memory":{"maximum":3188.9375,"mean":2633.1770833333335,"minimum":1609.125,"unit":"MB"},"provider":"sentence-transformers","variant":"f32"},{"model":"sparse-encoder-testing/splade-bert-tiny-nq-onnx","peak_memory":{"maximum":630.59375,"mean":628.4947916666666,"minimum":626.75,"unit":"MB"},"provider":"onnxruntime","variant":"onnx"},{"model":"sparse-encoder-testing/splade-bert-tiny-nq-onnx","peak_memory":{"maximum":1570.609375,"mean":1275.5416666666667,"minimum":707,"unit":"MB"},"provider":"sentence-transformers","variant":"onnx"},{"model":"mixedbread-ai/mxbai-rerank-base-v1","peak_memory":{"maximum":4774.015625,"mean":4766.505208333333,"minimum":4760.4375,"unit":"MB"},"provider":"onnxruntime","variant":"f32"},{"model":"mixedbread-ai/mxbai-rerank-base-v1","peak_memory":{"maximum":2340.1875,"mean":1827.171875,"minimum":1177.53125,"unit":"MB"},"provider":"sentence-transformers","variant":"f32"},{"model":"cross-encoder/ms-marco-MiniLM-L6-v2","peak_memory":{"maximum":962.453125,"mean":960.0885416666666,"minimum":958.375,"unit":"MB"},"provider":"onnxruntime","variant":"f32"},{"model":"cross-encoder/ms-marco-MiniLM-L6-v2","peak_memory":{"maximum":1560.453125,"mean":886.6770833333334,"minimum":521.984375,"unit":"MB"},"provider":"sentence-transformers","variant":"f32"},{"model":"fixed_bert","peak_memory":{"maximum":205.90625,"mean":205.58854166666666,"minimum":205.328125,"unit":"MB"},"provider":"tokenizers","variant":"built-in"},{"model":"fixed_bpe","peak_memory":{"maximum":206.234375,"mean":205.75,"minimum":205.5,"unit":"MB"},"provider":"tokenizers","variant":"built-in"},{"model":"mirth/chonky_mmbert_small_multilingual_1","peak_memory":{"maximum":635.234375,"mean":623.4427083333334,"minimum":600.0625,"unit":"MB"},"provider":"tokenizers","variant":"f32"},{"model":"antflydb/gliner2-base-v1","peak_memory":{"maximum":1779.546875,"mean":1401.1354166666667,"minimum":1211.796875,"unit":"MB"},"provider":"gliner2","variant":"f32"},{"model":"openai/whisper-tiny","peak_memory":{"maximum":498.125,"mean":394.1822916666667,"minimum":188.6875,"unit":"MB"},"provider":"whisper.cpp","variant":"f32"}]

Peer versions

  • llama.cppb9870 (2d973636e)
  • Ollama0.31.1
  • vLLM-Metal0.3.0.dev20260811042359 (vLLM 0.27.0+cpu)
  • ONNX Runtime1.28.0
  • Sentence Transformers5.6.1
  • Transformers tokenizer4.45.2
  • GLiNER21.3.2
  • Transformers4.45.2
  • faster-whisper1.2.1
  • whisper.cpp1.9.2

Evidence digests

Receipt
30b6bfe680483a57b338b4f29496a03ad7d403df37675515cf220a4b79e53fd3
Aggregate
2cf17806a20af41156fb7fbba9c2c9451ccfe43bec22c54cdf762c4df5a1a216
Provenance
0b01470e5f95f0b5fce5c47c9f0702fbe874add2488f029ee9cbcd1e72c20b0b
Harness commit
f4d6b06ddd7ede36a27827d11d653f939a3a2fdb
Selected measurement
Completed
Antfly
v0.2.1-rc.3 ·
Runtime
1m 17s
Platform
darwin · arm64
Machine
Apple M4 Max
Build
ReleaseFast

Measurement group

complete

Generation

Three fresh Antfly lifecycles. Reference providers: 2026-08-13, not rerun.

Generation result

Antfly v0.2.1-rc.3 · bb8a284d

ModelVariantProviderp95 msThroughput ops/sQualityPeak memory MBValid / total
google/gemma-4-E4B-it-qat-q4_0-ggufQAT q4_0antfly837.21.221.000 pass6,129.63/3
ggml-org/gemma-4-E4B-it-GGUFQ4_0llama.cpp1,809.90.561.000 pass7,795.53/3
ggml-org/gemma-4-E4B-it-GGUFQ4_0ollama995.21.021.000 pass11,459.93/3
ggml-org/gemma-4-E4B-it-GGUFQ4_0vllm-metal801.81.261.000 pass26,764.03/3
google/gemma-4-E4B-it-qat-q4_0-ggufQAT q4_0llama.cpp1,870.70.561.000 pass7,974.53/3
google/gemma-4-E4B-it-qat-q4_0-ggufQAT q4_0ollama913.61.131.000 pass7,746.13/3
google/gemma-4-E4B-it-qat-q4_0-ggufQAT q4_0vllm-metal1,082.20.931.000 pass29,728.43/3
unsloth/Qwen3-1.7B-GGUFQ4_K_Mllama.cpp897.71.141.000 pass5,940.53/3
unsloth/Qwen3-1.7B-GGUFQ4_K_Mollama412.12.551.000 pass5,413.53/3
unsloth/Qwen3-1.7B-GGUFQ4_K_Mvllm-metal318.53.161.000 pass27,087.03/3

Throughput

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast/full) · darwin-arm64 · google/gemma-4-E4B-it-qat-q4_0-gguf · three fresh lifecycles · Higher is better

Peak memory

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast/full) · darwin-arm64 · google/gemma-4-E4B-it-qat-q4_0-gguf · three fresh lifecycles · Lower is better

Measurement group

complete

Dense Embedding

Three fresh Antfly lifecycles. Reference providers: 2026-08-13, not rerun.

Dense Embedding result

Antfly v0.2.1-rc.3 · bb8a284d

ModelVariantProviderp95 msThroughput ops/sQualityPeak memory MBValid / total
BAAI/bge-small-en-v1.5f32antfly130.68.260.251 cosine863.03/3
BAAI/bge-small-en-v1.5f32onnxruntime13.480.000.207 cosine1,074.03/3
BAAI/bge-small-en-v1.5f32sentence-transformers8.8141.590.207 cosine1,359.83/3
BAAI/bge-large-en-v1.5f32onnxruntime58.518.560.192 cosine3,615.93/3
BAAI/bge-large-en-v1.5f32sentence-transformers20.964.920.192 cosine2,408.83/3
mixedbread-ai/mxbai-embed-large-v1f32onnxruntime58.618.690.271 cosine3,614.33/3
mixedbread-ai/mxbai-embed-large-v1f32sentence-transformers20.265.970.271 cosine2,761.13/3

Throughput

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast/full) · darwin-arm64 · BAAI/bge-small-en-v1.5 · three fresh lifecycles · Higher is better

Peak memory

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast/full) · darwin-arm64 · BAAI/bge-small-en-v1.5 · three fresh lifecycles · Lower is better

Measurement group

complete

Sparse Embedding

Three fresh Antfly lifecycles. Reference providers: 2026-08-13, not rerun.

Sparse Embedding result

Antfly v0.2.1-rc.3 · bb8a284d

ModelVariantProviderp95 msThroughput ops/sQualityPeak memory MBValid / total
sparse-encoder-testing/splade-bert-tiny-nq-onnxonnxantfly12.685.87204.000 entries402.33/3
sparse-encoder-testing/splade-bert-tiny-nq-onnxonnxonnxruntime4.4253.38334.000 entries659.03/3
sparse-encoder-testing/splade-bert-tiny-nq-onnxonnxsentence-transformers10.5130.63334.000 entries1,337.53/3

Throughput

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast/full) · darwin-arm64 · sparse-encoder-testing/splade-bert-tiny-nq-onnx · three fresh lifecycles · Higher is better

Peak memory

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast/full) · darwin-arm64 · sparse-encoder-testing/splade-bert-tiny-nq-onnx · three fresh lifecycles · Lower is better

Measurement group

complete

Reranking

Three fresh Antfly lifecycles. Reference providers: 2026-08-13, not rerun.

Reranking result

Antfly v0.2.1-rc.3 · bb8a284d

ModelVariantProviderp95 msThroughput ops/sQualityPeak memory MBValid / total
mixedbread-ai/mxbai-rerank-base-v1f32antfly110.610.521.000 pass1,899.23/3
mixedbread-ai/mxbai-rerank-base-v1f32onnxruntime52.519.391.000 pass4,998.03/3
mixedbread-ai/mxbai-rerank-base-v1f32sentence-transformers16.791.241.000 pass1,915.93/3
cross-encoder/ms-marco-MiniLM-L6-v2f32onnxruntime10.5102.111.000 pass1,006.73/3
cross-encoder/ms-marco-MiniLM-L6-v2f32sentence-transformers6.8199.591.000 pass929.73/3

Throughput

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast/full) · darwin-arm64 · mixedbread-ai/mxbai-rerank-base-v1 · three fresh lifecycles · Higher is better

Peak memory

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast/full) · darwin-arm64 · mixedbread-ai/mxbai-rerank-base-v1 · three fresh lifecycles · Lower is better

Measurement group

complete

Chunking

Three fresh Antfly lifecycles. Reference providers: 2026-08-13, not rerun.

Chunking result

Antfly v0.2.1-rc.3 · bb8a284d

ModelVariantProviderp95 msThroughput ops/sQualityPeak memory MBValid / total
fixed_bertbuilt-inantfly7.5193.393.000 chunks383.63/3
fixed_bertbuilt-intokenizers0.121,789.553.000 chunks215.63/3
fixed_bpebuilt-intokenizers0.123,741.613.000 chunks215.73/3
mirth/chonky_mmbert_small_multilingual_1f32tokenizers0.128,908.903.000 chunks653.73/3

Throughput

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast/full) · darwin-arm64 · fixed_bert · three fresh lifecycles · Higher is better

Peak memory

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast/full) · darwin-arm64 · fixed_bert · three fresh lifecycles · Lower is better

Measurement group

complete

Extraction

Three fresh Antfly lifecycles. Reference providers: 2026-08-13, not rerun.

Extraction result

Antfly v0.2.1-rc.3 · bb8a284d

ModelVariantProviderp95 msThroughput ops/sQualityPeak memory MBValid / total
antflydb/gliner2-base-v1f32antfly37.227.481.000 recall1,091.23/3
antflydb/gliner2-base-v1f32gliner229.035.481.000 recall1,469.23/3

Throughput

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast/full) · darwin-arm64 · antflydb/gliner2-base-v1 · three fresh lifecycles · Higher is better

Peak memory

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast/full) · darwin-arm64 · antflydb/gliner2-base-v1 · three fresh lifecycles · Lower is better

Measurement group

complete

Transcription

Three fresh Antfly lifecycles. Reference providers: 2026-08-13, not rerun.

Transcription result

Antfly v0.2.1-rc.3 · bb8a284d

ModelVariantProviderp95 msThroughput ops/sQualityPeak memory MBValid / total
openai/whisper-tinyf32antfly1,649.60.611.000 word recall1,333.93/3
openai/whisper-tinyf32faster-whisper——0.600 word recall—0/3
openai/whisper-tinyf32whisper.cpp124.08.610.800 word recall413.33/3

Throughput

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast/full) · darwin-arm64 · openai/whisper-tiny · three fresh lifecycles · Higher is better

Peak memory

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast/full) · darwin-arm64 · openai/whisper-tiny · three fresh lifecycles · Lower is better

V

document-ohr-bench

partial

OHR-Bench · controlled extraction

Controlled OHR extraction retrieval over all 8,498 questions in each paired input: Antfly v0.2.1 scored 44.33% mean word-LCS versus 70.44% for matched ground-truth text; 73 of 8,561 retained pages had OCR failures.

Methodology scope · protocol · interpretation

Controlled extraction measurement

This lane compares two document-text inputs under one controlled retrieval protocol: text extracted by the official Antfly v0.2.1 ReleaseFast Darwin ARM64 binary and matched OHR ground-truth text. Both use the same fixed 1,261-document candidate manifest, canonical logical paths, tokenizer/model sources, 1,024-token SimpleNodeParser/SentenceSplitter chunks without overlap, and deterministic UUID5 node IDs. Scores are percentage mean word-level evidence LCS at top-2, averaged across all 8,498 questions and both independent BM25 and exact full-precision BGE-M3 lanes. Every question stays in the denominator; unavailable evidence scores zero. There is no RRF or evidence-type reweighting.

Extraction quality

Antfly loaded all 1,261 PDFs and retained page arrays for all 8,561 pages. Seventy-three page OCR outcomes failed across 35 PDFs (0.85% of pages); these are extraction failures, not PDF or page-load failures, and a failed OCR page can retain native text. Two corpus-only PDFs produced no retrievable chunks. The native structural gate therefore remains failed, while the paired controlled scores remain valid descriptive measurements over the full question denominator.

Interpretation

The controlled Antfly and matched-ground-truth rows are directly comparable only to each other. This is not an exact reproduction of the published OHR ranking: the fixed corpus excludes one published ground-truth-only distractor, canonical paths and UUID5 IDs remove filesystem and UUID4 variation, and 42 strict filename-mismatch QA rows remain zero rather than receiving alias repair. Published rows retain their upstream labels and values as a visibly separate reference group. Native Antfly analyzer and BGE-small retrieval metrics are separate diagnostics, not substitutes for the controlled scores. Concurrent workloads make retained timing non-comparable.

Run evidence parameters · variation · provenance

Benchmark parameters

{"controlled_measurement":{"candidate_documents":1261,"chunks":27592,"failures_kept_in_denominator":true,"lane_scores_per_input":16996,"metric":"mean word-level evidence LCS at top-2","questions":8498,"retained_pages":8561},"extraction_quality":{"loaded_pdfs":1261,"ocr_attempt_failure_rate":0.04694533762057878,"ocr_attempted_pages":1555,"ocr_failed_documents":35,"ocr_failed_pages":73,"ocr_failed_rate_all_pages":0.00852704123350076,"pages_without_ocr_failure":8488,"retained_pages":8561,"status":"failed","zero_chunk_documents":2},"native_retrieval_diagnostic":{"classification":"separate Antfly analyzer and BGE-small diagnostic; not a controlled score","lanes":{"dense":{"empty_queries":0,"mean_latency_seconds":0.036739,"questions":8498,"top1_mean_lcs":0.262424,"top1_page_recall":0.454931,"top1_questions":8498,"top2_mean_lcs":0.341372,"top2_page_recall":0.566016,"top2_questions":8498,"top5_mean_lcs":0.413611,"top5_page_recall":0.667804,"top5_questions":8498},"hybrid":{"empty_queries":0,"mean_latency_seconds":0.001878,"questions":8498,"top1_mean_lcs":0.302222,"top1_page_recall":0.50153,"top1_questions":8498,"top2_mean_lcs":0.383135,"top2_page_recall":0.607908,"top2_questions":8498,"top5_mean_lcs":0.454335,"top5_page_recall":0.701459,"top5_questions":8498},"lexical":{"empty_queries":948,"mean_latency_seconds":0.001371,"questions":8498,"top1_mean_lcs":0.317588,"top1_page_recall":0.501059,"top1_questions":8498,"top2_mean_lcs":0.386779,"top2_page_recall":0.583549,"top2_questions":8498,"top5_mean_lcs":0.446812,"top5_page_recall":0.659096,"top5_questions":8498}},"missing_provenance":0,"quality_status":"passed","query_errors":0,"structural_status":"failed"},"paired_validation":{"official-antfly":{"lane_scores":16996,"questions":8498,"recomputed_mean":0.44326071858099025,"unique_questions":8498,"verified_domain_artifacts":49},"official-gt":{"lane_scores":16996,"questions":8498,"recomputed_mean":0.7044283388810646,"unique_questions":8498,"verified_domain_artifacts":49},"paired_controls":{"candidate_documents":1261,"identical_candidate_names_and_logical_paths":true,"identical_protocol_environment_model_sources_tokenizers":true,"identical_qa_order":true,"native_declared_failure_documents":35}},"protocol_controls":{"canonical_logical_paths":"data/retrieval_base/evaluation","chunk_overlap":0,"chunk_size":1024,"chunker":"llama_index.node_parser.SimpleNodeParser/SentenceSplitter","deterministic_node_ids":"UUID5(NAMESPACE_URL, logical_file_path + NUL + zero_based_page_idx + NUL + chunk_ordinal); document ordinal=-1","embedding_model":"BAAI/bge-m3","embedding_revision":"5617a9f61b028005a4858fdac845db406aefb181","fixed_corpus_difference":"one published GT-only distractor excluded","published_ranking_claim":false,"retrieval_lanes":["bm25","dense_bge_m3"],"strict_filename_mismatch_qa_rows":42,"top_k":2},"timing":{"comparable":false,"concurrent_workloads":true,"native_setup_wall_seconds":11737.516}}

Retrieval systems

  • Antfly extraction · BM25 controlled top-2 word-LCS 45.19% mean 8,498 queries
  • Antfly extraction · BGE-M3 dense controlled top-2 word-LCS 43.46% mean 8,498 queries
  • Matched ground truth · BM25 controlled top-2 word-LCS 71.34% mean 8,498 queries
  • Matched ground truth · BGE-M3 dense controlled top-2 word-LCS 69.54% mean 8,498 queries

Published comparison sources

  • Published OHR evaluation table Upstream reference values; not rerun in the controlled pair Different corpus and identity controls; no ranking claim Source

Peer versions

Peer versions were not recorded in the published result fields.

Evidence digests

Receipt
b749fd8d782fdd7b4adddd679f880ba465b41b1c203a48088f8f252043fd89b2
Aggregate
a47315641ace8ffd8d415fcfed93e11a6c9797300f4461c6bd577a25a804c435
Provenance
f4d505e6547ba01e8d779919b3c356bcbb6b0ae58186c30c3841e4b29d9cecfe
Harness commit
f7c4024229d4f597430f2389950961638a8116ca
Selected partial evidence
Completed
Antfly
v0.2.1
Runtime
—
Platform
darwin · arm64
Machine
Apple M5 Pro
Build
ReleaseFast

Overall duration is omitted because controlled and diagnostic workloads overlapped; completion marks the evidence seal.

Controlled extraction scores · published references kept separate

Antfly v0.2.1 · e5261e9e

Evidence groupDocument sourceTXTTABFORCHAROMULALL %OCR-failed pages
Controlled paired runAntfly v0.2.1 extraction58.7945.2436.9023.446.8940.8844.3373 / 8,561 (0.85%)
Controlled paired runMatched OHR ground truth81.7570.1075.9168.2410.0562.6870.44—
Published upstream tableGround Truth81.669.875.270.39.8—70.4—
Published upstream tableMinerU 0.9.368.148.651.316.55.9—50.5—
Published upstream tableMarker 1.2.375.558.255.520.05.9—57.0—
Published upstream tableAzure Document Intelligence78.059.455.245.25.8—60.6—
Published upstream tableGOT62.541.149.017.43.7—45.8—
Published upstream tableNougat59.532.844.311.34.4—41.2—
Published upstream tableQwen2.5-VL-72B75.160.060.038.25.3—59.6—
Published upstream tableInternVL2.5-78B68.657.955.645.12.7—56.2—
Published upstream tableolmOCR-7B-0225-preview72.558.455.424.85.0—56.6—
Published upstream tableMonkeyOCR74.656.555.516.55.7—55.9—
Published upstream tableNanonets-OCR-s71.859.857.443.74.4—58.3—

Extraction quality and corpus retention

Antfly v0.2.1 · e5261e9e

OutcomeValid / totalObserved boundaryFailure rate %
PDF loading1,261 / 1,2610 load failures0.00%
Page retention8,561 / 8,5610 dropped pages0.00%
Pages without OCR failure8,488 / 8,56173 failures across 35 PDFs0.85%
Retrievable chunks1,259 / 1,2612 zero-chunk PDFs0.16%
VI

1 of 3 lanes measured

CRAG

Retrieval, ranking, and evaluation lanes over the CRAG corpus and query set.

i

fulltext-crag-footprint

complete

Full-text search

Full-text query behavior and quality across increasing CRAG corpus sizes, paired with swap-backed serving demand and complete post-stop database volume.

Methodology scope · protocol · interpretation

CRAG full-text search

Scope

This lane compares Antfly, Elasticsearch, and Quickwit as full-text retrieval services over the same CRAG Task 1/2 corpus and query sample. At 2,000, 5,000, 9,000, and 13,530 documents it measures cache-excluded working set, cache-inclusive memory, final complete database volume, query p95, QPS, and normalized gold-answer evidence in the top one and top five results.

The main report repeats the honed publication charts for working set, final database volume, and query p95 by corpus size. The tables retain QPS and quality beside those plots. This is a full-text search comparison, not merely a footprint measurement.

Publication protocol

  • Run every engine in a Linux cgroup v2 container on the shared Circus Linux/arm64 lane.
  • Use the same immutable CRAG corpus and query set for all engines.
  • Give Elasticsearch a fixed 1 GiB heap and record that setting.
  • Run three fresh alternating lifecycles, rather than reusing an index or container between repetitions.
  • For each lifecycle, run one deterministic 200-query sample at concurrency 1 after ten warmup queries; require zero query errors.
  • Use product-default full-text analyzers and resolve returned IDs through the same canonical CRAG document map before calculating top-one and top-five gold-answer evidence.
  • Treat sampled cgroup memory.current as cache-inclusive memory and anon + shmem as the cache-excluded working-set comparison.
  • Give every engine one newly created, run-labeled Docker local volume at its complete persistence root: /data, /usr/share/elasticsearch/data, or /quickwit/qwdata. The same digest-pinned Alpine probe measures each whole volume on the shared Linux Docker engine; APFS bind mounts are ineligible.
  • Give every engine the same fixed 30-second post-workload persistence window, then capture allocated and apparent integer bytes once at post_workload. Also capture once at empty and ready, then at the post-stop final barrier. empty permits root directory-block overhead but no entries. Verify graceful stop before the headline final capture; neither the delay nor qualification depends on an engine’s observed bytes.
  • Publish final allocated bytes as the arithmetic mean, every value, and the full range of the three independent construction lifecycles. Retain apparent bytes, lifecycle samples, per-volume manifests, and engine index APIs only as diagnostics. The legacy index_disk_mb field is not comparable.
  • Require storage.json and its validation receipt, which ties the measurement to the sampler hash, probe digest, declared scope, lifecycle barriers, environment identity, and fresh or materialized cell sums.
  • Require the quiet-host gate for latency publication. Memory and storage remain valid only when all engine cells passed their lifecycle and cgroup checks.

The v0.2.0 honed page describes the host as Linux/aarch64 containers under Docker Desktop on Apple Silicon. It does not describe this as bare-metal Linux.

Run evidence parameters · variation · provenance

Benchmark parameters

{"document_counts":[2000,5000,9000,13530],"trial_count":3}

Trial variation

[{"document_count":2000,"engine":"antfly","ranges":{"demand_working_set":{"maximum":182.837248,"mean":179.8554,"minimum":167.006208,"unit":"MB"},"final_database_volume":{"maximum":28.07808,"mean":28.07808,"minimum":28.07808,"unit":"MB"},"query_p95":{"maximum":0.7512,"mean":0.7486,"minimum":0.6019,"unit":"ms"}}},{"document_count":5000,"engine":"antfly","ranges":{"demand_working_set":{"maximum":232.620032,"mean":203.8907,"minimum":194.62144,"unit":"MB"},"final_database_volume":{"maximum":77.807616,"mean":77.80352,"minimum":77.799424,"unit":"MB"},"query_p95":{"maximum":0.9326,"mean":0.7722,"minimum":0.7256,"unit":"ms"}}},{"document_count":9000,"engine":"antfly","ranges":{"demand_working_set":{"maximum":348.274688,"mean":327.2827,"minimum":308.277248,"unit":"MB"},"final_database_volume":{"maximum":116.81792,"mean":116.81792,"minimum":116.81792,"unit":"MB"},"query_p95":{"maximum":1.0176,"mean":0.9798,"minimum":0.831,"unit":"ms"}}},{"document_count":13530,"engine":"antfly","ranges":{"demand_working_set":{"maximum":463.740928,"mean":429.3673,"minimum":375.11168,"unit":"MB"},"final_database_volume":{"maximum":191.320064,"mean":178.120021,"minimum":171.52,"unit":"MB"},"query_p95":{"maximum":1.0528,"mean":0.9679,"minimum":0.8714,"unit":"ms"}}},{"document_count":2000,"engine":"elasticsearch","ranges":{"demand_working_set":{"maximum":1563.168768,"mean":1561.5468,"minimum":1550.176256,"unit":"MB"},"final_database_volume":{"maximum":28.176384,"mean":28.176384,"minimum":28.176384,"unit":"MB"},"query_p95":{"maximum":3.1022,"mean":3.0962,"minimum":2.9788,"unit":"ms"}}},{"document_count":2000,"engine":"quickwit","ranges":{"demand_working_set":{"maximum":342.7328,"mean":326.5659,"minimum":320.233472,"unit":"MB"},"final_database_volume":{"maximum":62.17728,"mean":62.17728,"minimum":62.17728,"unit":"MB"},"query_p95":{"maximum":2.4123,"mean":2.3783,"minimum":2.1956,"unit":"ms"}}},{"document_count":5000,"engine":"elasticsearch","ranges":{"demand_working_set":{"maximum":1592.815616,"mean":1578.7663,"minimum":1568.456704,"unit":"MB"},"final_database_volume":{"maximum":68.071424,"mean":68.065963,"minimum":68.05504,"unit":"MB"},"query_p95":{"maximum":3.1904,"mean":3.1856,"minimum":3.0442,"unit":"ms"}}},{"document_count":5000,"engine":"quickwit","ranges":{"demand_working_set":{"maximum":437.26848,"mean":431.4522,"minimum":428.675072,"unit":"MB"},"final_database_volume":{"maximum":153.464832,"mean":153.464832,"minimum":153.464832,"unit":"MB"},"query_p95":{"maximum":2.8585,"mean":2.7023,"minimum":2.674,"unit":"ms"}}},{"document_count":9000,"engine":"elasticsearch","ranges":{"demand_working_set":{"maximum":1625.956352,"mean":1603.6454,"minimum":1601.2288,"unit":"MB"},"final_database_volume":{"maximum":121.38496,"mean":121.379499,"minimum":121.368576,"unit":"MB"},"query_p95":{"maximum":3.3096,"mean":3.1342,"minimum":3.1236,"unit":"ms"}}},{"document_count":9000,"engine":"quickwit","ranges":{"demand_working_set":{"maximum":590.016512,"mean":575.1603,"minimum":566.632448,"unit":"MB"},"final_database_volume":{"maximum":140.92288,"mean":140.92288,"minimum":140.92288,"unit":"MB"},"query_p95":{"maximum":3.3839,"mean":3.3089,"minimum":2.9987,"unit":"ms"}}},{"document_count":13530,"engine":"elasticsearch","ranges":{"demand_working_set":{"maximum":1637.146624,"mean":1634.689,"minimum":1626.558464,"unit":"MB"},"final_database_volume":{"maximum":181.444608,"mean":181.444608,"minimum":181.444608,"unit":"MB"},"query_p95":{"maximum":3.4245,"mean":3.2994,"minimum":3.2854,"unit":"ms"}}},{"document_count":13530,"engine":"quickwit","ranges":{"demand_working_set":{"maximum":701.820928,"mean":684.7078,"minimum":650.620928,"unit":"MB"},"final_database_volume":{"maximum":278.646784,"mean":278.644053,"minimum":278.642688,"unit":"MB"},"query_p95":{"maximum":3.9363,"mean":3.7102,"minimum":3.7017,"unit":"ms"}}}]

Peer versions

Peer versions were not recorded in the published result fields.

Evidence digests

Receipt
448ebca5a6af2d2f24c1798a0445ea03a8d7dbf9d544bd19772e53efbf4a06dd
Aggregate
204890e6d564ab1b728f0b52c67dc19a771b2c5b7e9dcc19930fdc0a2bf1e692
Provenance
48fdc7b3bd7bb17cbf3b30983f7fb6886531f931e0586c58153530f86fd549d3
Harness commit
059cc9cfa10a2e76d7d4e7c518044c9327215473
Selected measurement
Completed
Antfly
46b702a8 ·
Runtime
28m 51s
Platform
linux · arm64
Machine
Docker Desktop VM on Apple M4 Max · 10 CPU · 27.3 GB
Build
ReleaseFast · Zig compiler version not captured

Query p95

Antfly development build (46b702a8) · Platform: linux-arm64 · Processor: Docker Desktop VM on Apple M4 Max · 2,000–13,530 documents · 3 trials · Lower is better

Demand working set

Antfly development build (46b702a8) · Platform: linux-arm64 · Processor: Docker Desktop VM on Apple M4 Max · 2,000–13,530 documents · 3 trials · Lower is better

Final database volume

Antfly development build (46b702a8) · Platform: linux-arm64 · Processor: Docker Desktop VM on Apple M4 Max · 2,000–13,530 documents · 3 trials · Lower is better

Resource footprint

Antfly development build · 46b702a8

EngineDocumentsDemand working set MBFinal database volume MBTrials
antfly2,000179.9 MB28.1 MB3
antfly5,000203.9 MB77.8 MB3
antfly9,000327.3 MB116.8 MB3
antfly13,530429.4 MB178.1 MB3
elasticsearch2,0001,561.5 MB28.2 MB3
quickwit2,000326.6 MB62.2 MB3
elasticsearch5,0001,578.8 MB68.1 MB3
quickwit5,000431.5 MB153.5 MB3
elasticsearch9,0001,603.6 MB121.4 MB3
quickwit9,000575.2 MB140.9 MB3
elasticsearch13,5301,634.7 MB181.4 MB3
quickwit13,530684.7 MB278.6 MB3

Query behavior and ranking quality

Antfly development build · 46b702a8

EngineDocumentsQPSp95 msTop-1Top-5
antfly2,0001,824.30.750.2200.295
antfly5,0001,877.60.770.2300.290
antfly9,0001,441.60.980.2300.285
antfly13,5301,578.70.970.2350.290
elasticsearch2,000486.93.100.2000.285
quickwit2,000525.12.380.2150.290
elasticsearch5,000488.53.190.2100.280
quickwit5,000444.02.700.2150.295
elasticsearch9,000465.03.130.2100.285
quickwit9,000374.53.310.2200.295
elasticsearch13,530460.23.300.2150.280
quickwit13,530313.73.710.2200.295
ii

rag-crag

missing

Dense retrieval diagnostic

Controlled dense-retrieval diagnostics over the CRAG corpus and query set.

Methodology scope · protocol · interpretation

CRAG dense retrieval diagnostic

What this lane measures

This is a retrieval-only diagnostic over the official CRAG Task 1/2 v4 development data. It compares how six vector databases retrieve answer-bearing passages from the same corpus. It is not an official CRAG Task 1/2 score: it stops before answer generation and does not run the official CRAG judge.

Upstream CRAG evaluates generated answers to questions whose relevant context may change over time. The full upstream workflow supplies retrieved context to an answer model and evaluates the answer. This Circus lane uses CRAG only as a fixed real-world question and web-page source so that database retrieval can be measured separately from model quality, provider latency, and judge behavior.

Retrieval protocol

  • Dataset: official Task 1/2 v4 development split, 2,706 questions and 13,530 provided web-result pages.
  • Dataset SHA-256: afa29f2b3facfb5d15aa9cded00d5ec90ff76f3e67279e7b99cfe86659a641ca.
  • Documents: normalize each source page, cap it at 20,000 characters, then form deterministic 384-token passages with 64-token overlap.
  • Embeddings: normalized 384-dimensional BAAI/bge-small-en-v1.5 vectors, computed once and loaded unchanged into every engine.
  • Search: identical query vectors, fixed query order, cosine distance, and the top five complete passages.
  • Engines: Antfly, Milvus, Chroma, pgvector, Weaviate, and Elasticsearch.
  • Evidence: service version, image identity, effective index settings, subject version and SHA-256, and per-query retrieval rows are retained before the aggregate is accepted.

The gauntlet adds retrieval-only lexical, hybrid, and local agentic/KG rows. Those rows are diagnostics, not substitutes for the six-engine dense cohort. Paid answer generation and judging require the separately guarded full CRAG command and are not part of this Circus benchmark lane.

Metrics and publication status

The harness records retrieval latency and whether any normalized gold-answer string appears in the top-one or top-five retrieved context. These are local retrieval sanity metrics, not the official CRAG judge score.

This lane is excluded from the honed publication profile. Its current adapters use unequal client transports: Antfly and Elasticsearch open a new HTTP connection and serialize JSON inside each timed request, while other engines use persistent native clients. The ANN settings also were not calibrated to a common recall floor. Those differences confound both latency and hit-at-five rankings, so the Circus profile retains the lane only as a diagnostic and must not present a cross-engine leaderboard from it.

Evidence status availability · expected contract

Why this lane has no selected measurement

No reviewed benchmark result is selected for this subject.

Expected
Reviewed aggregate with a validation receipt
Observed
No result selected for this subject
iii

ragas-crag-eval

missing

RAGAS evaluation

RAG answer and retrieval quality measured with the RAGAS evaluation surface.

Methodology scope · protocol · interpretation

RAGAS CRAG Evaluation Methodology

Scope

This benchmark evaluates the CRAG RAG artifacts generated by the rag-crag benchmark entry. It does not run a separate retrieval stack; it consumes the saved CRAG retrieval and answer JSONL files so the RAGAS row describes the same RAG behavior shown in the CRAG table.

Current Metrics

The initial adapter reports RAGAS-shaped proxy metrics from CRAG artifacts:

  • context_recall_proxy: whether the gold answer appears in top-k context
  • context_precision_proxy: whether the gold answer appears in top-one context
  • answer_correctness_proxy: whether the generated answer contains the gold answer
  • missing_rate: how often the answer generator returned no answer or unknown

If the ragas Python package is installed, the adapter records that fact, but the current row still uses CRAG artifact proxies. A follow-up should add the true RAGAS metric calls after the exact LLM and embedding provider choices are settled.

Inputs

  • Retrieval artifacts: rag-crag/*-retrieval.jsonl
  • Answer artifacts: rag-crag/*-answers.jsonl
  • Summary files: rag-crag/retrieval-summary.json and rag-crag/answer-summary.json

The row is provisional until true RAGAS package metrics are enabled.

Evidence status availability · expected contract

Why this lane has no selected measurement

No reviewed benchmark result is selected for this subject.

Expected
Reviewed aggregate with a validation receipt
Observed
No result selected for this subject
VII

fulltext-miracl-scale

partial

MIRACL full-text scale

Retained September 2 Antfly v0.2.1-rc2 MIRACL evidence, using 799 public development queries and 8,350 human relevance judgments.

Methodology scope · protocol · interpretation

Full-text MIRACL scale methodology

Scope

fulltext-miracl-scale measures full-text operational cost with retrieval-quality guardrails as a judged English passage field grows. Antfly, Elasticsearch, Quickwit, and PostgreSQL built-in full-text search index identical nested fixtures and answer the same MIRACL English development queries. The lane reports complete service memory demand, final allocated database-volume bytes, index duration, query p95/QPS, and judged ranking metrics.

This lane supplies million-scale lexical operational evidence. Search Benchmark Game owns query-class throughput, BEIR owns native-hybrid uplift, and STaRK owns structured retrieval. No service-count, round-trip consolidation, or official MIRACL leaderboard claim follows from this lane.

Source and license

The corpus is the English portion of MIRACL v1.0: 32,893,221 passages from 5,758,285 English Wikipedia articles. The public development panel contains 799 queries and 8,350 human positive and negative judgments. Corpus repository revision d921ec7e349ce0d28daf30b2da9da5ee698bef0d and judgment repository revision 5be20db9509754dadad47689368639fcec739c00 are immutable cache identities. Every corpus shard is pinned by its Hugging Face LFS SHA-256; topics and qrels are pinned by observed SHA-256.

The MIRACL dataset cards declare Apache-2.0. The corpus is derived from English Wikipedia, so applicable Wikipedia attribution and share-alike obligations are retained rather than treating the text as newly permissive content.

Citation:

Xinyu Zhang, Nandan Thakur, Odunayo Ogundepo, Ehsan Kamalloo, David Alfonso-Hermelo, Xiaoguang Li, Qun Liu, Mehdi Rezagholizadeh, and Jimmy Lin. “MIRACL: A Multilingual Retrieval Dataset Covering 18 Diverse Languages.” Transactions of the Association for Computational Linguistics 11, 2023. DOI 10.1162/tacl_a_00595.

Deterministic nested fixtures

Each source passage becomes one canonical UTF-8 JSONL record with MIRACL docid as id and title + U+000A + text as the searchable text. Source strings are not normalized, truncated, or analyzer-normalized.

Every document appearing in a development qrel is placed first, ordered by UTF-8 document ID. Natural distractors are ordered by SHA-256 of the UTF-8 document ID. The implementation scans every pinned corpus shard, retains low SHA-256 prefix buckets, externally sorts only the retained candidate set under LC_ALL=C, and writes exact nested prefixes of 250,000, 1,000,000, 2,000,000, 3,000,000, and 5,000,000 passages. Every judged document must occur in every prefix. Selection does not inspect relevance grade.

Queries are exact MIRACL development topic text in UTF-8 query-ID order. Qrels are canonical four-column TREC rows in query-ID/document-ID order. Preparation rejects duplicate judgments, missing positive queries, missing judged documents, malformed rows, source count drift, and digest drift. preparation-receipt.json binds every source asset, full-corpus canonical digest, prefix identity, query order, qrels, grade histogram, judged-document counts, and selection algorithm.

Engine and query protocol

All engines receive one text field with product-default English lexical analysis. Antfly retains bounded ingest retries, a 900-second request timeout required by observed 5M-pass compaction stalls, and its searchable-readiness gate. Elasticsearch uses one primary shard, no replicas, a 1 GiB heap, refresh, and force merge. Quickwit uses its default tokenizer with positions and field norms; startup ingest retries tolerate the temporary no-shard gate, and publication waits up to 900 seconds for the exact indexed count. PostgreSQL 16 uses a generated English tsvector, a GIN index, and ts_rank_cd, with otherwise default server settings.

The runner streams the declared fixture and requires the indexed count to match. The first ten ordered queries are warmups. The measured pass includes all 799 queries once at concurrency one with top_k=100. Per-query latency spans request dispatch through complete response decoding; QPS is query count divided by measured wall time. Raw evidence contains only query ID, one-based ranked IDs, latency, and normalized error status.

Quality metrics

MIRACL English dev judgments are binary. The lane macro-averages:

  • nDCG@10;
  • MRR@10;
  • Recall@100;
  • Judged@100, the fraction of returned unique IDs having either a positive or negative human judgment.

MIRACL uses pooled judgments: an unjudged passage is not proven irrelevant. Judged@100 exposes assessment coverage, while nDCG, MRR, and Recall act as consistent cross-engine guardrails. Verification recomputes every metric from retained ranked IDs and rejects request errors, unknown IDs, duplicates, more than 100 hits, query-order drift, and summary disagreement.

Resource lifecycle and failures

The canonical publication cohort is four engines by four common prefix sizes (250K, 1M, 2M, and 3M) by three fresh trials. The retained 5M fixture is a diagnostic boundary: exploratory evidence showed PostgreSQL ranking would consume roughly another half day and Antfly entered sustained full-text merge backpressure, while Elasticsearch and Quickwit completed. Odd canonical trials run Antfly, Elasticsearch, Quickwit, PostgreSQL; even trials reverse the order. Cgroup v2 sampling begins before indexing and continues through all queries at 300 ms. Every engine is measured as one complete service container, and PostgreSQL shmem is included. Headline demand is peak concurrent anon + shmem; memory.current and kernel peaks remain diagnostics.

Fresh labeled Docker volumes capture empty, ready, post_workload, and stopped final barriers. post_workload follows a fixed 30-second settlement. Final allocated and apparent bytes use arithmetic mean plus every value/range; demand, index duration, p95, QPS, and judged metrics use median plus every value/range.

Every planned cell writes normalized status and a digest-bound receipt. All cells are attempted once. Aggregate status is ok for complete success, failed for a repeated uniform terminal gate across a complete engine/size group, and partial for every other fully accounted mix. Unaccounted cells invalidate finalization.

Circus packages presentation-neutral aggregate, source receipt, summary, methodology, input manifest, and preparation receipt through evidence_handoff.py; the site repository owns evidence selection and presentation.

Run evidence parameters · variation · provenance

Benchmark parameters

{"common_complete_through_passages":3000000,"corpus_passages":32893221,"corpus_sizes":[250000,1000000,2000000,3000000,5000000],"dataset":"MIRACL v1.0 English development split","evidence_class":"1-trial descriptive scaling evidence","fresh_lifecycles_per_point":1,"judgments":8350,"memory_metric":"cgroup v2 anon + shmem","omissions":[{"engine":"postgresql","passages":5000000,"reason":"The complete 3M query pass took 4.45 hours at 0.0499 QPS. A full 5M pass was projected to consume substantially more than the remaining useful overnight window; the query panel was not narrowed and no timeout value was presented as latency."}],"queries":799,"storage_metric":"final allocated database-volume bytes"}

Peer versions

Peer versions were not recorded in the published result fields.

Evidence digests

Receipt
0e9849866c690064980eef699805cb5123c4b19ea3979f02fd20995036488c95
Aggregate
4069aa330155db2450d71df331764658fb9e7bdacfd3c4c8962e5c0fb105e162
Provenance
b89529140dde5c5556f0e7c32839ec62b59266fcde0e20a7d664c52636aef0ee
Harness commit
d400ffc1eb4e70beca97983aaec2abeccba9c7a3
Selected partial evidence
Completed
Antfly
v0.2.1-rc2 ·
Runtime
12h 11m
Platform
linux · arm64
Machine
Apple M4 Max
Build
ReleaseFast

Query p95

Antfly v0.2.1-rc2 (4be5a0e9, ReleaseFast) · Linux/arm64 containers on Apple M4 Max · MIRACL English dev · 1 fresh lifecycles planned per point · Log scale · lower is better

Demand working set

Antfly v0.2.1-rc2 (4be5a0e9, ReleaseFast) · Linux/arm64 containers on Apple M4 Max · MIRACL English dev · 1 fresh lifecycles planned per point · Lower is better

Final database volume

Antfly v0.2.1-rc2 (4be5a0e9, ReleaseFast) · Linux/arm64 containers on Apple M4 Max · MIRACL English dev · 1 fresh lifecycles planned per point · Lower is better

Working set and complete post-stop volume

Antfly v0.2.1-rc2 · 4be5a0e9

EnginePassagesDemand MBCache + memory MBFinal volume MBValid / total
Antfly250,000469.5 MB795.9 MB157.4 MB1 / 1
Elasticsearch250,0001,712.7 MB2,305.5 MB123.3 MB1 / 1
PostgreSQL250,000207.6 MB901.3 MB665.9 MB1 / 1
Quickwit250,000547.4 MB767.7 MB202.7 MB1 / 1
Antfly1,000,0001,811.9 MB2,669.0 MB596.3 MB1 / 1
Elasticsearch1,000,0001,801.2 MB2,886.6 MB477.4 MB1 / 1
PostgreSQL1,000,000293.1 MB2,758.3 MB2,322.6 MB1 / 1
Quickwit1,000,0001,102.4 MB1,725.0 MB390.6 MB1 / 1
Antfly2,000,0005,207.8 MB6,747.4 MB1,137.8 MB1 / 1
Elasticsearch2,000,0001,881.6 MB5,001.3 MB947.0 MB1 / 1
PostgreSQL2,000,000327.0 MB3,936.5 MB3,495.2 MB1 / 1
Quickwit2,000,0001,827.8 MB2,936.2 MB773.4 MB1 / 1
Antfly3,000,0008,279.2 MB10,501.1 MB1,721.4 MB1 / 1
Elasticsearch3,000,0001,880.9 MB4,903.8 MB1,416.2 MB1 / 1
PostgreSQL3,000,000321.3 MB5,114.4 MB4,645.2 MB1 / 1
Quickwit3,000,0002,210.9 MB3,818.9 MB1,029.1 MB1 / 1
Elasticsearch5,000,0001,881.5 MB7,694.0 MB2,352.8 MB1 / 1
Quickwit5,000,0002,154.3 MB4,785.5 MB2,212.5 MB1 / 1

Query and judged retrieval evidence

Antfly v0.2.1-rc2 · 4be5a0e9

EnginePassagesQPSp95 msnDCG@10Recall@100Judged@100Errors
Antfly250,000788.2892.280.5760.9420.0980
Elasticsearch250,000363.6653.440.5520.9300.0940
PostgreSQL250,0002.7191,081.780.2390.7910.0830
Quickwit250,00047.02422.800.5550.9390.0950
Antfly1,000,000405.9045.920.5320.9280.0940
Elasticsearch1,000,000302.6054.360.4930.8920.0900
PostgreSQL1,000,0000.35012,385.260.1430.6300.0610
Quickwit1,000,00043.01425.660.4980.9030.0910
Antfly2,000,000249.99810.420.4590.8440.0860
Elasticsearch2,000,000258.1065.620.4530.8660.0870
PostgreSQL2,000,0000.09137,382.050.0970.5080.0480
Quickwit2,000,00040.32027.820.4580.8770.0880
Antfly3,000,000182.20115.010.4620.8590.0870
Elasticsearch3,000,000195.8617.150.4250.8490.0850
PostgreSQL3,000,0000.05061,861.820.0760.4320.0410
Quickwit3,000,00038.80529.290.4270.8560.0860
Elasticsearch5,000,000168.8568.730.3900.8250.0820
Quickwit5,000,00027.45246.300.3910.8290.0830
VIII

deployment-artifacts

complete

Deployment artifacts

Antfly main-09b78df97 stripped ReleaseFast has a 142.2 MB static Linux ARM64 executable and a 63.0 MB operator-created gzip archive. Peer rows retain their original registry metadata.

Methodology scope · protocol · interpretation

Deployment artifacts

This lane establishes packaging and transfer facts for the exact Linux/arm64 artifacts represented by the honed benchmark review. It does not start a database, measure runtime resource use, or assign a composite score.

Cohort and identity

The cohort is Antfly plus the five peers in the honed VectorDBBench publication matrix: Weaviate, pgvector, Chroma, Milvus, and Elasticsearch. Antfly is bound to the exact archive and executable in the honed subject manifest. A published subject resolves its archive through the GitHub Releases API. An operator-built subject instead names its retained local archive explicitly; the collector verifies the file name and SHA-256 before measuring it. Each peer is bound to the exact digest-pinned image reference declared by this lane and uses the same image environment overrides as VectorDBBench.

Every engine/artifact pair is one portable publication-cache cell. A cache hit requires the same subject archive identity or peer image reference, platform, collector protocol, and workload identity. Cache objects retain normalized facts, source metadata, logs, and a lifecycle receipt. Cache identity excludes timing because the lane performs no timed work.

Download payload

Antfly’s download payload is the byte size of the exact Linux/arm64 subject archive. For a published release, the collector requires the GitHub Releases API asset digest to match the archive SHA-256 in the honed subject manifest. For an operator build, it requires an explicit retained archive path and verifies the local file’s name and SHA-256 against the same manifest fields. The result identifies whether the archive came from an official release or an operator build. It separately retains the executable byte size, executable SHA-256, and static-linkage identification from that subject manifest.

A peer’s download payload is the sum of the compressed layer sizes in the one os=linux, architecture=arm64 child selected from docker manifest inspect --verbose. The collector retains the configured index reference, resolved child digest, selected descriptor, config digest, layer count, and selected manifest. Missing or ambiguous platform selection fails the lane.

The image total sums every compressed layer in the selected manifest without credit for layers already cached on an operator’s machine. A machine with shared layers may therefore transfer less. Registry transfer overhead and expanded filesystem size are excluded. This is a reproducible artifact comparison, not an estimate of every installation path.

Deployment vocabulary

“Separately managed prerequisites” means software an operator must install, launch, upgrade, and coordinate separately from the displayed server artifact. None excludes operating-system kernel, storage, and networking. Peer container rows therefore name an OCI-compatible container runtime. Components packaged inside an image, such as Elasticsearch’s JVM or Milvus’s embedded etcd/local-storage topology, are bundle components rather than separately managed prerequisites.

The compact review table describes only the exact artifacts used by the publication matrix. It does not claim that these are the only installation forms supported by each project.

Run evidence parameters · variation · provenance

Benchmark parameters

{"artifacts":[{"archive_name":"antfly-main-09b78df97-releasefast-linux-arm64.tar.gz","archive_sha256":"48d07c80b7977d8c17ee4ab6bee68100a2c71aefe41e41a92def32985f1c20ce","bundle_components":[],"engine":"antfly","executable_sha256":"6366535c49a75b8c4da691096b0cb7799daa6968f68e5a45377f20e6a321c470","linkage":"static","prerequisites":[]}],"execution_environment":{"container_runtime":"Podman podman version 6.1.1","controller_platform":"darwin-arm64","processor":"Apple M4 Max","service_platform":"linux-arm64","vm_cpus":10,"vm_memory_bytes":29347610624,"vm_memory_gib":27.3},"platform":"linux-arm64"}

Peer versions

  • Weaviate1.39.2
  • pgvector0.8.6
  • Chroma1.5.9
  • Milvus2.6.22
  • Elasticsearch9.5.2

Evidence digests

Receipt
a94808d04ac92280a4628b69b9aa2475fd610729c1515c6adbb38b0327756a64
Aggregate
0d9d8eec8fc01f1273c7b71ca2c21720517782cdc18f49e6f0228a1f4de93877
Provenance
0d9d8eec8fc01f1273c7b71ca2c21720517782cdc18f49e6f0228a1f4de93877
Harness commit
82c699bb7a687b65efc691ec329368494ce8499e
Selected measurement
Completed
Antfly
main-09b78df97 ·
Runtime
0.1s
Platform
linux · arm64
Machine
Apple M4 Max
Build
ReleaseFast

Linux/arm64 deployable artifacts

Antfly main-09b78df97 · 09b78df9

EngineDeployable formArtifact originDownload MBExecutable MBStatusSource date
antflyStatic executableoperator supplied archive63.0142.2ok2026-10-06
weaviateWeaviate server container imageOCI registry manifest88.2—ok2026-08-31
pgvectorPostgreSQL + pgvector container imageOCI registry manifest154.1—ok2026-08-31
chromaChroma server container imageOCI registry manifest165.2—ok2026-08-31
milvusStandalone container imageOCI registry manifest363.6—ok2026-08-31
elasticsearchContainer image with JVMOCI registry manifest758.8—ok2026-08-31
IX

3 of 3 lanes measured

STaRK

Official retrieval quality over textual and relational knowledge bases, with exact candidate, query, metric, and lifecycle provenance.

i

retrieval-stark-prime

complete

Prime

Antfly v0.2.1-rc.3 completed two fresh 2,801-query lifecycles. Peer database rows retain August 29 observations; published baselines retain their own protocols. Storage is provisional after abnormal shutdowns.

Methodology scope · protocol · interpretation

STaRK-Prime in Antfly Circus

This lane evaluates entity retrieval over the pinned official STaRK-Prime corpus of 129,375 records and the complete official 2801-query test split. Candidate identity uses stable official numeric candidate IDs; quality uses the official STaRK evaluator with official text-embedding-ada-002 vectors. The benchmark definition follows the STaRK paper, arXiv 2504.05478v2.

Terms

  • Lexical: full-text ranking over serialized entity text.
  • Dense: nearest-neighbor search over the official embeddings.
  • RRF: reciprocal-rank fusion of lexical and dense rankings.
  • Relation-expanded: STaRK’s flattened relation-context serialization.
  • Recall@20: mean fraction of gold entity IDs returned in the first 20 results.

Container memory

The retained metric is concurrent cgroup-v2 anon plus shmem peak, sampled every 0.2 seconds before readiness through the final query. This cgroup-v2 anon + shmem metric is the same under Docker and Podman; the runtime does not change its memory definition.

Storage observation

Storage covers the whole writable database persistence volume at the empty, ready, post_workload, final barriers. Antfly storage uses Linux-volume schema v2 but remains provisional after abnormal service shutdowns. Archival peers predate the filesystem-identity contract. Retain observations only; no qualified storage headline or cross-engine ratios.

Run evidence parameters · variation · provenance

Benchmark parameters

{"candidate_identity_sha256":"6052523f61b8939595a1c0a98eb951529b7f469585edd0b69c1d706533014e6d","dataset":"snap-stanford/stark","dataset_revision":"88269e23e90587f99476c5dd74e235a0877e69be","queries":2801,"records":129375,"vector_dimensions":1536,"vector_model":"text-embedding-ada-002","vector_score":"inner_product"}

Trial variation

[{"lifecycles":2,"recall_at_20_range":[0.335447,0.335447],"variant":"Antfly lexical · default text"},{"lifecycles":2,"recall_at_20_range":[0.359294,0.359738],"variant":"Antfly dense · official vectors"},{"lifecycles":2,"recall_at_20_range":[0.403483,0.404468],"variant":"Antfly built-in RRF · default text"},{"lifecycles":2,"recall_at_20_range":[0.45382,0.45382],"variant":"Antfly lexical · relation-expanded text"},{"lifecycles":2,"recall_at_20_range":[0.488264,0.49273],"variant":"Antfly built-in RRF · relation-expanded text"}]

Retrieval systems

  • Antfly lexical · default text Native lexical retrieval measured
  • Antfly dense · official vectors Native ANN over official vectors measured
  • Antfly built-in RRF · default text Native lexical+dense fusion · built-in RRF measured
  • Antfly lexical · relation-expanded text Native lexical retrieval measured
  • Antfly built-in RRF · relation-expanded text Native lexical+dense fusion · built-in RRF measured
  • Upstream exact VSS Exact official-vector baseline measured
  • Upstream BM25 Upstream lexical baseline measured
  • Chroma lexical · default text Native database retrieval unsupported
  • Chroma dense · official vectors Native database retrieval measured
  • Chroma hybrid · default text Native database retrieval unsupported
  • Chroma lexical · relation-expanded text Native database retrieval unsupported
  • Chroma hybrid · relation-expanded text Native database retrieval unsupported
  • Elasticsearch lexical · default text Native database retrieval measured
  • Elasticsearch dense · official vectors Native database retrieval measured
  • Elasticsearch hybrid · default text Native database retrieval · built-in score sum measured
  • Elasticsearch lexical · relation-expanded text Native database retrieval measured
  • Elasticsearch hybrid · relation-expanded text Native database retrieval · built-in score sum measured
  • Neo4J lexical · default text Native database retrieval measured
  • Neo4J dense · official vectors Native database retrieval measured
  • Neo4J hybrid · default text Native database retrieval · in-database query measured
  • Neo4J lexical · relation-expanded text Native database retrieval measured
  • Neo4J hybrid · relation-expanded text Native database retrieval · in-database query measured
  • Pgvector lexical · default text Native database retrieval measured
  • Pgvector dense · official vectors Native database retrieval measured
  • Pgvector hybrid · default text Native database retrieval · in-database query measured
  • Pgvector lexical · relation-expanded text Native database retrieval measured
  • Pgvector hybrid · relation-expanded text Native database retrieval · in-database query measured
  • Weaviate lexical · default text Native database retrieval measured
  • Weaviate dense · official vectors Native database retrieval measured
  • Weaviate hybrid · default text Native database retrieval · built-in RRF measured
  • Weaviate lexical · relation-expanded text Native database retrieval measured
  • Weaviate hybrid · relation-expanded text Native database retrieval · built-in RRF measured
  • Published · GraphRAFT dataset-trained LLMs, Cypher templates, graph retrieval, reranking full synthetic test; Recall@20 not reported
  • Published · AF-Retriever zero-shot LLM, graph retrieval, vector search, pairwise reranking full synthetic test; Recall@20 not reported
  • Published · HybGRAG LLM-assisted hybrid graph and text retrieval full synthetic test; Recall@20 not reported
  • Published · GritLM-7B original STaRK dense baseline full synthetic test
  • Published · multi-ada-002 original STaRK multivector baseline full synthetic test

Published comparison sources

  • GraphRAFT full synthetic test; Recall@20 not reported dataset-trained LLMs, Cypher templates, graph retrieval, reranking Source
  • AF-Retriever full synthetic test; Recall@20 not reported zero-shot LLM, graph retrieval, vector search, pairwise reranking Source
  • HybGRAG full synthetic test; Recall@20 not reported LLM-assisted hybrid graph and text retrieval Source
  • GritLM-7B full synthetic test original STaRK dense baseline Source
  • multi-ada-002 full synthetic test original STaRK multivector baseline Source

Peer versions

  • Chroma1.0.0
  • Elasticsearch9.4.1
  • Neo4J5.26.29
  • PgvectorPostgreSQL 16.14 (Debian 16.14-1.pgdg12+1); pgvector 0.8.5
  • Weaviate1.38.2

Evidence digests

Receipt
a694c48716a2328d5adffbc75ef7f5f96ee8d9e405ae1b9d261a0325784d4bfa
Aggregate
9d258c5649d8341f20a147ea432d30d4af3eebbfe2b091aa0ef0a6fec20619e7
Provenance
3136ce666957fd8600a7ee5d692a63cc724d9f4dad06052163e531fb10b37814
Harness commit
f4d6b06ddd7ede36a27827d11d653f939a3a2fdb
Selected measurement
Completed
Antfly
v0.2.1-rc.3 ·
Runtime
41.7 min
Platform
Linux · arm64
Machine
Apple M4 Max · 10 CPU · 27.3 GB
Build
ReleaseFast

STaRK-Prime Recall@20

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast) · linux-arm64 · Apple M4 Max · Official 2,801-query split · Higher is better

STaRK-Prime retrieval quality

Antfly v0.2.1-rc.3 · bb8a284d

MethodHit@1 %Hit@5 %Recall@20 %MRR %
Antfly built-in RRF · relation-expanded text16.12%39.41%49.05%26.79%
Neo4J hybrid · relation-expanded text17.35%38.52%48.40%27.16%
Weaviate hybrid · relation-expanded text18.03%39.13%48.19%27.73%
Antfly lexical · relation-expanded text19.81%40.41%45.38%28.72%
Elasticsearch hybrid · relation-expanded text18.39%38.13%43.91%27.11%
Weaviate lexical · relation-expanded text17.99%37.45%43.80%26.69%
Elasticsearch lexical · relation-expanded text17.78%36.99%43.06%26.34%
Neo4J lexical · relation-expanded text17.78%36.99%43.06%26.34%
Antfly built-in RRF · default text13.69%35.40%40.40%23.26%
Weaviate hybrid · default text14.10%34.59%39.24%23.26%
Neo4J hybrid · default text13.53%34.52%39.21%22.82%
Published · GritLM-7B15.57%33.42%39.09%24.11%
Published · multi-ada-00215.10%33.56%38.05%23.49%
Upstream exact VSS12.64%31.49%36.00%20.99%
Antfly dense · official vectors12.05%30.72%35.95%20.43%
Elasticsearch dense · official vectors12.64%31.42%35.78%20.96%
Pgvector dense · official vectors12.57%31.10%35.55%20.79%
Weaviate dense · official vectors12.89%31.49%35.34%21.08%
Chroma dense · official vectors12.75%30.95%34.94%20.76%
Neo4J dense · official vectors12.35%30.74%34.42%20.46%
Antfly lexical · default text14.64%29.61%33.54%21.39%
Elasticsearch hybrid · default text12.89%28.24%32.66%19.81%
Weaviate lexical · default text12.78%27.35%31.77%19.48%
Neo4J lexical · default text12.78%27.28%31.64%19.31%
Elasticsearch lexical · default text12.78%27.28%31.58%19.31%
Upstream BM2512.75%27.92%31.25%19.52%
Pgvector hybrid · relation-expanded text6.50%21.92%30.43%13.51%
Pgvector hybrid · default text7.64%21.60%29.35%13.86%
Pgvector lexical · relation-expanded text0.68%2.28%3.60%1.49%
Pgvector lexical · default text0.57%2.07%3.07%1.28%
Chroma lexical · default text————
Chroma hybrid · default text————
Chroma lexical · relation-expanded text————
Chroma hybrid · relation-expanded text————
Published · GraphRAFT63.70%75.40%—69.00%
Published · AF-Retriever46.20%63.70%—54.00%
Published · HybGRAG28.60%41.40%—34.50%

Container memory observations

Antfly v0.2.1-rc.3 · bb8a284d

EngineLifecycle evidenceDemand memory MBObserved range MB
AntflyTwo fresh lifecycles · exploratory9,810.9 MB9,732.8 MB–9,889.0 MB
ChromaOne retained lifecycle · 2026-08-29999.9 MBOne lifecycle
ElasticsearchOne retained lifecycle · 2026-08-295,090.5 MBOne lifecycle
Neo4JOne retained lifecycle · 2026-08-297,090.5 MBOne lifecycle
PgvectorOne retained lifecycle · 2026-08-29258.0 MBOne lifecycle
WeaviateOne retained lifecycle · 2026-08-293,456.9 MBOne lifecycle
ii

retrieval-stark-mag

complete

MAG

Official 2,665-query STaRK-MAG retrieval quality over 700,244 paper candidates, with one fresh rc2 Antfly container-footprint observation.

Methodology scope · protocol · interpretation

STaRK-MAG in Antfly Circus

This lane evaluates paper retrieval over 700,244 official candidates and the complete official 2,665-query test split. Candidate identity uses stable official numeric paper candidate IDs; quality uses the official STaRK evaluator with official text-embedding-ada-002 vectors.

Terms

  • Lexical: full-text ranking over serialized paper text.
  • Dense: nearest-neighbor search over the official embeddings.
  • RRF: reciprocal-rank fusion of lexical and dense rankings.
  • Relation-expanded: paper text with flattened graph-relation context.
  • Recall@20: mean fraction of gold paper IDs returned in the first 20 results.

Evidence scope

Quality covers the complete official split. Published reference rows retain their reported metric coverage and execution setting; LLM-assisted systems are not database-native equivalents. Memory and qualified Docker storage are individual observations from one fresh lifecycle; no variance, ratio, or comparative footprint claim is selected. Latency is a local diagnostic.

Run evidence parameters · variation · provenance

Benchmark parameters

{"candidate_identity_sha256":"584ec028e9c92616f44e0a462f0c2d088af138a0e40ff7f3c50f6deab8eb060b","dataset":"snap-stanford/stark","dataset_revision":"88269e23e90587f99476c5dd74e235a0877e69be","queries":2665,"records":700244,"vector_dimensions":1536,"vector_model":"text-embedding-ada-002","vector_score":"inner_product"}

Retrieval systems

  • Antfly lexical · default text Native lexical retrieval 2,665 queries 373.79 ms mean
  • Antfly dense · official vectors Native dense retrieval 2,665 queries 106.89 ms mean
  • Antfly built-in RRF · default text One native hybrid request 2,665 queries 576.41 ms mean
  • Antfly lexical · relation-expanded text Native lexical retrieval 2,665 queries 442.60 ms mean
  • Antfly built-in RRF · relation-expanded text One native hybrid request 2,665 queries 729.27 ms mean
  • Upstream exact VSS Exact official-vector baseline 2,665 queries 21.20 ms mean
  • Upstream BM25 Pinned upstream lexical baseline 2,665 queries 4.40 ms mean

Published comparison sources

  • AF-Retriever full synthetic test; Recall@20 not reported zero-shot LLM, graph retrieval, vector search, pairwise reranking Source
  • GraphRAFT full synthetic test; Recall@20 not reported dataset-trained LLMs, Cypher templates, graph retrieval, reranking Source
  • HybGRAG full synthetic test; Recall@20 not reported LLM-assisted hybrid graph and text retrieval Source
  • multi-ada-002 full synthetic test original STaRK multivector baseline Source
  • voyage-large-2-instruct full synthetic test original STaRK dense baseline Source

Peer versions

Peer versions were not recorded in the published result fields.

Evidence digests

Receipt
6fe666a90ec3a2fbdc6ff4100fcec2fe97b8b35fca27309ab3e01a30ffa29d2f
Aggregate
e0134c6b4b67c8e540bc0d4eb6561af0fbfdc0e27fc4281e5932b65ac7478498
Provenance
a858d3d5fa807f829772d390593a208923a4b59fa5cfe29505ad2a3964ee7353
Harness commit
598cdd0483de5b51ea562f8ff11dc9ca2ae9d4a3
Selected measurement
Completed
Antfly
v0.2.1-rc2 ·
Runtime
263.4 min
Platform
Linux · ELF 64-bit LSB executable, ARM aarch64, version 1 (SYSV), statically linked, stripped
Machine
Apple M5 Pro · 8 CPU · 25.2 GB
Build
ReleaseFast · Zig antfly 0.2.1-rc2 (zig runtime)

STaRK-MAG Recall@20

Official full synthetic test · Antfly rc2 and original-paper full-test baselines · Higher is better

STaRK-MAG retrieval quality

Antfly v0.2.1-rc2 · 4be5a0e9

MethodHit@1 %Hit@5 %Recall@20 %MRR %
Antfly lexical · relation-expanded text52.76%72.61%72.18%61.69%
Antfly built-in RRF · relation-expanded text42.89%68.82%70.38%54.44%
Antfly built-in RRF · default text32.53%52.83%52.76%41.72%
Published · multi-ada-00225.92%50.43%50.80%36.94%
Published · voyage-large-2-instruct30.06%50.58%50.49%39.66%
Upstream exact VSS29.08%49.61%48.36%38.23%
Antfly dense · official vectors27.73%48.89%48.36%37.26%
Antfly lexical · default text27.92%45.55%46.11%35.91%
Upstream BM2525.85%45.25%45.69%34.56%
Published · AF-Retriever78.60%91.40%—84.00%
Published · GraphRAFT71.10%85.30%—76.90%
Published · HybGRAG65.40%75.30%—69.80%

Container footprint observation

Antfly v0.2.1-rc2 · 4be5a0e9

EngineLifecycle evidenceDemand memory GiBCache-inclusive GiBFinal allocated storage GiB
AntflyOne fresh lifecycle · descriptive observation17.018 GiB21.264 GiB12.080 GiB
iii

retrieval-stark-amazon

partial

Amazon

Complete 1,642-query STaRK-Amazon default-text adapter study over 957,192 product candidates, with relation-expanded construction retained as unavailable scale evidence.

Methodology scope · protocol · interpretation

STaRK-Amazon default-text adapter study

Scope

This exploratory lane evaluates six Antfly query formulations over 957,192 official product candidates and all 1,642 synthesized test queries. Default documents contain upstream product title, description, review, and customer Q&A text. Every lexical row is one Antfly request; hybrid rows add the official ada-002 query vector in the same request and use built-in RRF.

The all-term formulation retains every unique lowercase ASCII-alphanumeric query term and joins them by OR without the legacy stopword, minimum-length, or first-20 filters. IDF top-20 selects terms using document frequency without qrels. Metrics are recomputed from returned top-20 IDs and official qrels.

Evidence quality

Default text has six of six valid rows from one complete lifecycle. Memory and storage are descriptive single observations. Latency is a local diagnostic and is kept in Run details. Published BM25 and ada-002 values are external Table 6 references, not same-run controls.

Relation-expanded coverage is zero of six: No relation-expanded quality row was accepted because no attempted lifecycle ingested all official candidates and reached the final visibility barrier. No partial relation index was scored. Relation expansion means STaRK’s application-side brand, color, category, also-bought, and also-viewed graph context flattened into text; it is not native graph traversal.

Run evidence parameters · variation · provenance

Benchmark parameters

{"candidate_id_sha256":"c15dbc912e6494145295c9178e2848374b23b2291bf201c961b03f7b36edef8b","candidates":957192,"corpus_sha256":"aa52c91035b4aef826bf1e9ab70c3c9d264b0d949e08e349423bcab56996b832","dataset_revision":"88269e23e90587f99476c5dd74e235a0877e69be","name":"amazon","queries":1642}

Peer versions

Peer versions were not recorded in the published result fields.

Evidence digests

Receipt
00d56bdfef2a36b31d0c256d4201210c63da0ed9a46a7fd6bae42d881d37656f
Aggregate
a2c587a79c8b1e60dd18677a33d3c4512d3970d69cdcabb2a1ea8184e45b4436
Provenance
9536848b7e88b248ef41fee2bc710fdc41423eafff0b6eb76a8274cc128806f8
Harness commit
3d85a0a6ab985ad3f6a6abf9281c927cc8277ee6aa986cabc55ed3dcc1f514e0
Selected partial evidence
Completed
Antfly
v0.2.1-rc2 ·
Runtime
4.1 h
Platform
darwin · arm64
Machine
Apple M5 Pro · 8 CPU · 35.2 GiB Docker VM
Build
ReleaseFast · Zig antfly 0.2.1-rc2 (zig runtime)

STaRK-Amazon default-text Recall@20

Antfly v0.2.1-rc2 · Docker Desktop Linux/arm64 on Apple M5 Pro · 957,192 products · 1,642 test queries · Higher is better

Default-text query formulation

Antfly v0.2.1-rc2 · 4be5a0e9

MethodHit@1 %Hit@5 %Recall@20 %MRR@20 %Official queries
Built-in RRF · all-term OR49.70%74.06%60.75%60.10%1,642 / 1,642
Built-in RRF · first-20 OR48.54%72.90%59.95%59.26%1,642 / 1,642
Lexical · all-term OR, uncapped47.93%68.70%55.85%57.28%1,642 / 1,642
Lexical · IDF top-20 OR48.23%68.94%55.48%57.38%1,642 / 1,642
Lexical · filtered OR, uncapped46.53%68.27%54.96%56.00%1,642 / 1,642
Lexical · first-20 filtered OR46.35%67.66%54.44%55.81%1,642 / 1,642
Published · BM2544.94%67.42%53.77%55.30%Published full test
Published · ada-00239.16%62.73%53.29%50.35%Published full test

Representation coverage and default footprint

Antfly v0.2.1-rc2 · 4be5a0e9

RepresentationValid rowsEvidenceDemand memory GiBCache-inclusive peak GiBFinal allocated storage GiB
Default text6 / 6 validOne complete lifecycle · descriptive22.985 GiB32.069 GiB8.689 GiB
Relation-expanded0 / 6 validUnavailable · construction did not reach full visibility———
X

agent-effort-quickstart

complete

Agent implementation effort

Implementation effort for agents completing equivalent Antfly and peer integration tasks.

Methodology scope · protocol · interpretation

Agent Access Effort

Question

Given a raw corpus and a named access system, how much agent work is required to make the corpus usable and complete grounded retrieval tasks?

This is an end-to-end product-choice benchmark. Grep is a first-class subject, not merely an engine-quality baseline: it has almost no activation cost and is how coding agents commonly search local data. Antfly, Chroma, and Milvus must earn their indexing and setup cost through easier or more effective retrieval.

Clean pilot protocol

The checked result is the one-trial-per-system clean-20260821 internal pilot. A fresh pi session using openrouter/deepseek/deepseek-v4-flash ran each subject sequentially:

  • grep (ripgrep from the Debian bookworm image),
  • Antfly v0.2.0, commit 56a1b1a591f5db0b80017e425ad0c449f52f38fe,
  • Chroma 1.5.9,
  • Pymilvus 3.0.0 with Milvus Lite 3.0.

Each task image contained 240 synthetic JSONL documents. Eight documents held fictional facts; 232 deterministic distractors shared vocabulary but not the answer-bearing entities. Every document also carried a precomputed 256-dimensional deterministic token-hash vector. This avoids model-download and embedding-runtime differences in the activation measurement. The questions, answers, and evidence document IDs are fixed by the harness.

Software was preinstalled but not configured. Environment image builds and software installation were excluded. The agent received one concise subject usage guide, the raw corpus, and helper commands for producing compatible query vectors and recording milestones.

Trial sequence

  1. Configure the assigned system and load/index all 240 documents.
  2. Verify its retrieval surface is usable. Queries while an index is still building do not qualify.
  3. Record the ready milestone.
  4. Reveal the eight questions only after readiness.
  5. Retrieve each answer through the assigned system and record the answer plus its evidence document ID.

After a database subject records readiness, the harness removes the raw corpus. This prevents the question-answering phase from silently falling back to grep. The grep row retains the corpus because the file is its retrieval surface.

The verifier requires:

  • all eight exact answers,
  • all eight expected evidence document IDs,
  • a ready marker before every grounded milestone,
  • the expected live or persistent system artifact,
  • no post-readiness raw-corpus access for database rows.

The clean pilot did not independently execute a subject-specific readiness probe at the instant of the marker. Trajectory review found that Milvus marked ready while its collection was released; its first post-ready query failed and the agent loaded the collection afterward. The Milvus ready time is therefore invalid and is not published.

Metrics

  • Ready seconds: agent-start to the ready marker, retained only when the trajectory shows the assigned retrieval surface was usable at that point.
  • All grounded seconds: agent-start to completion of all eight grounded answers. Agents recorded the answers as a batch in this pilot, so this is a panel-completion metric, not steady-state per-query latency.
  • Work tool calls: pi tool calls excluding direct effort-mark and effort-questions bookkeeping calls.
  • Failure-bearing calls: calls whose tool result was an error or whose retained output contained a concrete traceback, HTTP/API failure, invalid vector dimensions, or failed command. This catches curl pipelines that returned exit zero despite an API failure.
  • Gross tokens: ordinary input, cache-read input, and output tokens summed.
  • Agent cost: Harbor/pi provider accounting.
  • Success rate: grounded answers divided by eight; correctness is a bar.

Checked result

SystemValid readyAll 8 groundedWork tool callsFailure-bearing callsGross tokensAgent cost
grep16.3 s42.6 s180152,279$0.0046
Chroma35.2 s65.3 s180168,956$0.0066
Milvus Liteinvalid127.9 s337328,205$0.0064
Antfly211.9 s272.7 s5361,581,093$0.0248

All four rows grounded 8/8 answers. Milvus violated the readiness protocol. On this small exact-entity workload, grep completed the grounded panel fastest; no indexed subject recovered its activation cost.

Trajectory audit

Raw tool-call totals were 28 grep, 28 Chroma, 35 Milvus, and 63 Antfly, but they are not directly comparable. Grep, Chroma, and Antfly each spent ten separate calls on benchmark markers; the Milvus agent invoked its eight grounded markers from inside one generated Python script. The checked table therefore reports direct work calls after removing only explicit marker calls.

Antfly used 43 calls before its ready marker. Its first table, external-vector index, and batch load were substantially complete by call 13. A malformed manual vector probe then returned InvalidVectorDimensions; the agent misdiagnosed that query error as broken ingestion, restarted Antfly, reloaded without the vector index, investigated zero coverage, and finally dropped/recreated/reloaded the table in the correct order. That diagnostic spiral accounts for most of the 211.9-second activation time.

Antfly also emitted a 42,783-character unprojected index-status response early in the session. Replaying that result through the remaining turns contributed to 1.45 million cache-read tokens. Gross traffic is intentionally retained, but uncached input was 122,875 tokens; the gross-token ratio should not be read as an equivalent billing ratio.

The one-page subject guides were not equally executable. Chroma received a working client/collection snippet and had no failure-bearing call. Milvus received prose describing the desired schema, then spent ten introspection calls reconciling post-training Pymilvus 3.0 schema and index APIs. The Antfly guide incorrectly instructed the agent to create a redundant full-text index even though v0.2.0 created full_text_index_v0 with the table; that caused one of its six failure-bearing calls.

Finally, the exact-entity questions were answered through Antfly full-text search, while the task still required Antfly’s vector index to be ready. The vector setup was therefore pure activation tax in this workload. A successor should either let each system choose the minimum sufficient retrieval path or separate exact and semantic panels.

Scope and interpretation

This is intentionally an internal pilot, not a honed publication result:

  • one trial per system,
  • one agent/model,
  • small synthetic corpus,
  • exact entity anchors favor grep,
  • deterministic hash vectors rather than a production embedding model,
  • software acquisition and live website UX excluded,
  • no memory, storage, or backend request-latency claim.

The result validates the benchmark shape and exposes onboarding friction. It does not estimate model variance or the query-count break-even point. A later campaign can reuse the same phase boundaries on larger semantic and long-document corpora without expanding this pilot’s claims.

Reproduction and retained evidence

  • Harness: benchmarks/agent-access-effort-harness/access_effort.py
  • Checked aggregate: benchmarks/agent-access-effort-harness/result.json
  • Deterministic contract: make agent-access-effort-smoke
  • Paid run: make agent-access-effort-run AAE_RUN_ID=<id>
  • Reprojection: make agent-access-effort-report AAE_RUN_ID=<id>

Raw Harbor trajectories remain local under results/agent-access-effort/<run-id>/jobs/; they are excluded from the site snapshot because they contain large model transcripts and task data.

Run evidence parameters · variation · provenance

Benchmark parameters

{"result_rows":4}

Peer versions

Peer versions were not recorded in the published result fields.

Evidence digests

Receipt
e2ff2133c13b55f60b080aa7a37ef41d575a44144482c85415c98ace9ecf01b2
Aggregate
f6082996bae217f899bd77f8316af8544d5fe3578157d65ba4810f4245e9435d
Provenance
fdd85399dfdc6529020b385940c29077d99c68bffaa217eb29e9b1e3501bd772
Harness commit
96db7cdd5f0e6743c4c6b86d4af7c85e43502a8d

Scope notes

  • Internal one-trial pilot on a 240-document synthetic exact-entity workload; software installation, live website UX, and model variance are out of scope.
  • Milvus grounded 8/8 but violated the readiness protocol; its ready time is not published. Work tool calls exclude direct benchmark marker calls.
  • Latest fallback: newest reviewed tagged evidence from v0.2.0.
Selected measurement
Completed
Antfly
v0.2.0 ·
Runtime
0s
Platform
darwin · arm64
Machine
Apple M5 Pro · 15 CPU · 51.5 GB
Build
optimization mode not captured · Zig compiler version not captured

Internal one-trial pilot on a 240-document synthetic exact-entity workload; software installation, live website UX, and model variance are out of scope.

Milvus grounded 8/8 but violated the readiness protocol; its ready time is not published. Work tool calls exclude direct benchmark marker calls.

Latest fallback: newest reviewed tagged evidence from v0.2.0.

Result summary

Antfly v0.2.0 · 56a1b1a5

SystemGroundedReady sAll grounded sWork tool callsFailure-bearing callsGross tokensAgent cost USDStatus
grep116.3 s42.6 s180152,2790.005 USDpassed
antfly1211.9 s272.7 s5361,581,0930.025 USDpassed
chroma135.2 s65.3 s180168,9560.007 USDpassed
milvus1—127.9 s337328,2050.006 USDreadiness protocol violation
XI

graph-benchmark

complete

Graph

Graph query performance, Pokec-small cross-engine diagnostics, official LSQB capability, and bounded SNB Interactive qualification.

Methodology scope · protocol · interpretation

Graph Database Benchmark v2 Methodology

Scope and provenance

This benchmark has two lanes and does not calculate a composite winner. LSQB-derived is an Antfly-owned anchored microbenchmark over LSQB data. The Pokec suite is a clean-room implementation informed by the public categories and workload ratios described by Memgraph’s Benchgraph material. It reuses the public Pokec import files, not Benchgraph implementation code. Neither lane is an audited LDBC result.

The scorecard keeps these measurements separate:

LaneScorecard metricsDirection
LSQB-derived F2warm serial p50, warm serial p99latency lower
Pokec W1completed QPS, peak process RSSQPS higher; RSS lower

Full statistics, errors, run ranges, and raw samples remain mandatory even when the scorecard is used.

Engines and equal client work

The comparison is Antfly, Neo4j 5.26.29, and Memgraph 3.12.0. Kuzu is excluded because it is not exercised through a comparable network service. Every timed throughput cell uses the same Go executable, deterministic schedule, quantile implementation, response-consumption rule, worker count, and wall-clock. Antfly is accessed over persistent HTTP/1.1; both peers use the same official Neo4j Go Bolt driver. Transport is part of observed client latency and is reported, not hidden.

Only equivalent User(id) and benchmark-namespace ID indexes are created. There is no engine-specific query tuning. Each run starts from a fresh database and performs complete correctness checks before timing. Mutating cells use a reserved BenchUser namespace so source reads cannot change; that namespace is restored to its 1,024-node ring baseline after every mutating cell. Timed requests are never retried. Errors are retained and exclude a run from the publication gate.

LSQB-derived lane

The pinned source, data loading, parameter selection, BLAKE3 result oracle, and N1/P2/F2 definitions are specified in graph-lsqb-derived.md. The public LSQB-derived metric is warmed serial latency for this exact endpoint-filtered lookup, returning matching Post IDs:

(Forum)-[:CONTAINER_OF]->(Post)-[:HAS_TAG]->(Tag {id: $tag_id})

Unfiltered P2 C12 throughput remains a retained diagnostic. It is not part of the graph scorecard or public filtered-lookup claim. Default, medium, and full use LSQB SF0.003, SF0.1, and SF1 respectively.

Pokec data and parameter oracle

Profiles use the public Memgraph Pokec import files:

ProfileDatasetUsersDirected FRIEND edgesAnchors
quickPokec-small10,000121,71612
mediumPokec-medium100,0001,768,51548
fullPokec-large1,632,80330,622,564128

The harness records the downloaded source SHA-256 and refuses unexpected node or edge counts. Anchors are selected deterministically across out-degree deciles with seed 0xB37C4. Every selected anchor must return its complete result below 900 rows through four hops; this stays below rc18’s 1,000 pattern match ceiling rather than comparing truncated results.

Expansion semantics are one endpoint result per directed walk. Antfly uses a chain of fixed one-hop pattern steps. Cypher uses one fixed MATCH clause per hop, avoiding vendor differences in variable-length path uniqueness. The offline SQLite oracle stores the exact result count and canonical BLAKE3 digest including multiplicity for every parameter. Aggregates and shortest path have exact scalar oracles. All 101 quick-profile checks per engine/run must pass before timing. Writes are executed and verified in the isolated benchmark namespace.

Pokec operations

IDOperation
R1exact indexed node lookup
WNinsert a new benchmark node
U1increment one benchmark-node property
WEinsert one directed benchmark edge
AG1age buckets and counts
AG2age count/min/max/sum/average
E1–E4exact fixed 1-, 2-, 3-, or 4-hop directed expansion
E2Fexact 2-hop expansion with endpoint age >= 18
N2concatenated exact 1-hop and exact 2-hop neighborhood
SPdirected unweighted shortest path, maximum depth 8

Every operation has an unwarmed serial observation and a prewarmed serial distribution. Isolated throughput uses 12 clients. Each non-mutating operation also receives a 70% operation / 30% write cell, split evenly between node and edge insert. The deterministic realistic workloads are:

  • W1: 20% analytical, 40% point read, 10% update, 30% write;
  • W2: 70% point read, 30% write;
  • W3: 50% point read, 50% write;
  • W4: 30% point read, 70% write.

The quick profile uses one-second isolated/mixed cells and two-second W1–W4 cells. Medium uses 5/10 seconds; full uses 15/30 seconds. Warmup is untimed. Every successful timed request is retained in JSONL. Reports contain completed QPS, error counts, p50/p95/p99, per-operation statistics, and peak PID RSS.

Persistent database volume

The honed LSQB SF0.1 F2 lane creates a new, run-labeled Docker local volume for every engine and repetition. Only the complete writable database root is measured (/data for Antfly and Neo4j, /var/lib/memgraph for Memgraph); read-only dataset/tool volumes and client scratch are excluded. A digest-pinned Alpine probe captures whole-volume allocated and apparent bytes once at empty, service-ready-before-ingestion, and post-workload, then at the verified post-stop final barrier. Final allocated bytes are the headline.

All three storage values, their arithmetic mean and range, apparent-byte diagnostics, barrier samples, volume manifests, and lifecycle receipts are retained. A provisional stop timeout remains visible but cannot support a comparative ratio.

Runs, ordering, and reporting

Each profile requires three clean process runs. Engine order rotates by run and uses a different rotation between lanes. Public serial point estimates are the medians of the three run-level p50, p95, and p99 values. Every result row also retains the three run-level percentile records, their min–max ranges, pooled sample percentiles as diagnostics, and all raw samples. Load/index readiness is diagnostic and is never included in query metrics.

summary.json is the machine-readable source of truth. The Markdown report contains the full cell table; scorecard.svg is only the compact two-panel view. There is deliberately no geometric mean or composite rank.

The honed LSQB SF0.1 F2 lane caches only the complete three-engine cohort. Promotion requires Antfly, Neo4j, and Memgraph to each retain three fresh database constructions and process runs, 15,000 timed samples, all three run-level percentile records and ranges, three complete storage receipts and their allocated-byte mean/range, 1,000/1,000 correctness, a valid canonical receipt, and the quiet-host record. The cache identity binds the Antfly subject, both peer image digests, the Linux client and storage-probe image, dataset manifest, harness sources, and protocol. A hit materializes the entire cohort; per-engine cache mixing is not permitted.

Internal fresh-service F2 readiness and convergence

The honed and Circus profiles retain a fresh-service diagnostic that measures how quickly a preloaded graph service becomes useful and settles into its warm filtered-two-hop behavior. It is graph-specific: readiness is followed immediately by the same exact LSQB SF0.1 F2 request used by the warm latency lane. It is not a general process-startup or system-wide Antfly claim.

This cohort is deliberately internal. It is attached to the canonical graph run report and structured result, but the public benchmark-page renderer does not render its table. It is never eligible for the honed publication cache: each honed or gauntlet graph invocation collects it afresh with make graph-f2-warmup-run. The retained diagnostic contract requires:

  • the same Antfly binary, pinned Neo4j and Memgraph images, official LSQB SF0.1 dataset, and Linux/arm64 Docker environment as the primary graph lane;
  • a recorded physical-host state, including whether the honed quiet-host assertion was active, without treating a diagnostic run as publication data;
  • one database construction followed by five fresh service lifecycles per engine, with balanced engine ordering;
  • restart-to-ready measured from immediately before service launch through the first successful engine-native probe: Antfly GET /readyz, Neo4j cypher-shell RETURN 1 plus the pinned-version check, and Memgraph autocommit SHOW VERSION over Bolt;
  • the first F2 latency and first-100 p50/p95 from a fixed 100-anchor panel selected by SHA-256 rank independently of result cardinality;
  • convergence at the first point where three consecutive adjacent 100-query window p50 changes are each within 5%, with a 10,000-query ceiling;
  • steady-state p50/p95 from five deterministic sweeps over all 1,000 anchors after convergence;
  • every timed result checked against the independent count+BLAKE3 oracle, with all 1,000 anchors covered in every engine/lifecycle; and
  • median-of-five run metrics with complete run ranges, raw timestamped samples, lifecycle logs, host evidence, exact schedules, and a canonical receipt.

These seven values are an indivisible internal reporting family: restart-to-ready, first-query, first-100 p50, first-100 p95, queries-to-stable-p50, steady p50, and steady p95. The retained report must show all seven for all three engines; it must not headline convergence while omitting the steady-state latency guardrail or Memgraph.

Qualification and publication

The default command is a small, complete optimization loop with a target wall time below 15 minutes. Medium and full are explicit diagnostic commands. A mixed native-macOS/container run is qualification-only because its process RSS views are not comparable across engines.

The release-facing honed F2 lane is a separate, environment-qualified publication protocol. Antfly, Neo4j, and Memgraph all run sequentially inside the same Docker Desktop Linux/arm64 VM on an explicitly quiescent Apple Silicon host. The published claim must name that environment and is limited to warm serial filtered two-hop latency; it is not a bare-metal Linux result or a claim about general graph-database performance. Publication requires:

  • the exact v0.2.0 Linux/arm64 binary and expected SHA-256;
  • the pinned Neo4j 5.26.29, Memgraph 3.12.0, and Linux client image digests;
  • official LSQB SF0.1 with 432,235 nodes and 1,827,523 relationships;
  • three fresh database constructions and process runs per engine, each on a newly created labeled database volume;
  • five warmed serial sweeps per run over 1,000 deterministic anchors;
  • 1,000/1,000 count+BLAKE3 correctness in every engine/run and zero timed errors;
  • median run-level p50/p95/p99 with all run ranges, pooled diagnostics, raw samples, lifecycle logs, and the physical-host record retained; and
  • a canonical receipt for the indivisible three-engine cohort.

The broader graph-v2/Pokec publication gate remains native-Linux-only and is not satisfied by this bounded F2 artifact.

Run evidence parameters · variation · provenance

Benchmark parameters

{"execution_environment":{"container_runtime":"Podman podman version 6.1.1","controller_platform":"darwin-arm64","processor":"Apple M4 Max","service_platform":"linux-arm64","vm_cpus":10,"vm_memory_bytes":29347610624,"vm_memory_gib":27.3},"historical_peer_trial_variation":[{"engine":"memgraph","ranges":{"demand_working_set":{"maximum":438.550528,"mean":435.0102186666667,"minimum":433.000448,"unit":"MB"},"final_database_volume":{"maximum":311.88992,"mean":311.887189,"minimum":311.885824,"unit":"MB"},"query_p95":{"maximum":0.15475835000000002,"mean":0.15450830000000002,"minimum":0.1530902,"unit":"ms"}}},{"engine":"neo4j","ranges":{"demand_working_set":{"maximum":4937.388032,"mean":4928.65536,"minimum":4922.712064,"unit":"MB"},"final_database_volume":{"maximum":635.6992,"mean":635.674624,"minimum":635.654144,"unit":"MB"},"query_p95":{"maximum":0.8094312500000002,"mean":0.7950937500000004,"minimum":0.7930104000000001,"unit":"ms"}}}],"peers_not_run":["memgraph","neo4j"],"query":"F2","runs":3,"samples":15000}

Peer versions

  • Memgraph3.12.0
  • Neo4j5.26.29

Evidence digests

Receipt
8757aa2d6333d09eb55a800d0f738347e70c8251fb5f805aa5366c09ab26dc92
Aggregate
36ba4361fd2de7dcb3bb32dd5b5b8c25cd5f7fd68a467cba60b0c387c6cee109
Provenance
36ba4361fd2de7dcb3bb32dd5b5b8c25cd5f7fd68a467cba60b0c387c6cee109
Harness commit
82c699bb7a687b65efc691ec329368494ce8499e
Selected measurement
Completed
Antfly
main-09b78df97 ·
Runtime
48m 54s
Platform
linux · arm64
Machine
Apple M4 Max
Build
ReleaseFast

Warm serial p95

Antfly main-09b78df97 (09b78df9, ReleaseFast) · linux-arm64 · LSQB-derived SF0.1 F2 · 15,000 samples / three runs · Lower is better · Apple M4 Max · Podman podman version 6.1.1 · 10 VM CPUs / 27.3 GiB · Historical peers, not a matched run

Demand working set

Antfly main-09b78df97 (09b78df9, ReleaseFast) · linux-arm64 · LSQB-derived SF0.1 F2 · 15,000 samples / three runs · Lower is better · Apple M4 Max · Podman podman version 6.1.1 · 10 VM CPUs / 27.3 GiB · Historical peers, not a matched run

Final database volume

Antfly main-09b78df97 (09b78df9, ReleaseFast) · linux-arm64 · LSQB-derived SF0.1 F2 · 15,000 samples / three runs · Lower is better · Apple M4 Max · Podman podman version 6.1.1 · 10 VM CPUs / 27.3 GiB · Historical peers, not a matched run

Latency, resources, and served samples

Antfly main-09b78df97 · 09b78df9

EngineVersionQueryp50 msp95 msp99 msDemand working set MBFinal database volume MBServed samples
antflyantfly main-09b78df97 (zig runtime)F21.73214.99958.6082,337.9 MB405.1 MB15,000
memgraph3.12.0F20.1150.1550.226435.0 MB311.9 MB15,000
neo4j5.26.29F20.4070.7951.2914,928.7 MB635.7 MB15,000
i

graph-diagnostics

partial

Pokec-small

Same-host Pokec-small coverage across Antfly, Neo4j, and Memgraph over 29 operation and workload cells.

Methodology scope · protocol · interpretation

Graph Database Benchmark v2 Methodology

Scope and provenance

This benchmark has two lanes and does not calculate a composite winner. LSQB-derived is an Antfly-owned anchored microbenchmark over LSQB data. The Pokec suite is a clean-room implementation informed by the public categories and workload ratios described by Memgraph’s Benchgraph material. It reuses the public Pokec import files, not Benchgraph implementation code. Neither lane is an audited LDBC result.

The scorecard keeps these measurements separate:

LaneScorecard metricsDirection
LSQB-derived F2warm serial p50, warm serial p99latency lower
Pokec W1completed QPS, peak process RSSQPS higher; RSS lower

Full statistics, errors, run ranges, and raw samples remain mandatory even when the scorecard is used.

Engines and equal client work

The comparison is Antfly, Neo4j 5.26.29, and Memgraph 3.12.0. Kuzu is excluded because it is not exercised through a comparable network service. Every timed throughput cell uses the same Go executable, deterministic schedule, quantile implementation, response-consumption rule, worker count, and wall-clock. Antfly is accessed over persistent HTTP/1.1; both peers use the same official Neo4j Go Bolt driver. Transport is part of observed client latency and is reported, not hidden.

Only equivalent User(id) and benchmark-namespace ID indexes are created. There is no engine-specific query tuning. Each run starts from a fresh database and performs complete correctness checks before timing. Mutating cells use a reserved BenchUser namespace so source reads cannot change; that namespace is restored to its 1,024-node ring baseline after every mutating cell. Timed requests are never retried. Errors are retained and exclude a run from the publication gate.

LSQB-derived lane

The pinned source, data loading, parameter selection, BLAKE3 result oracle, and N1/P2/F2 definitions are specified in graph-lsqb-derived.md. The public LSQB-derived metric is warmed serial latency for this exact endpoint-filtered lookup, returning matching Post IDs:

(Forum)-[:CONTAINER_OF]->(Post)-[:HAS_TAG]->(Tag {id: $tag_id})

Unfiltered P2 C12 throughput remains a retained diagnostic. It is not part of the graph scorecard or public filtered-lookup claim. Default, medium, and full use LSQB SF0.003, SF0.1, and SF1 respectively.

Pokec data and parameter oracle

Profiles use the public Memgraph Pokec import files:

ProfileDatasetUsersDirected FRIEND edgesAnchors
quickPokec-small10,000121,71612
mediumPokec-medium100,0001,768,51548
fullPokec-large1,632,80330,622,564128

The harness records the downloaded source SHA-256 and refuses unexpected node or edge counts. Anchors are selected deterministically across out-degree deciles with seed 0xB37C4. Every selected anchor must return its complete result below 900 rows through four hops; this stays below rc18’s 1,000 pattern match ceiling rather than comparing truncated results.

Expansion semantics are one endpoint result per directed walk. Antfly uses a chain of fixed one-hop pattern steps. Cypher uses one fixed MATCH clause per hop, avoiding vendor differences in variable-length path uniqueness. The offline SQLite oracle stores the exact result count and canonical BLAKE3 digest including multiplicity for every parameter. Aggregates and shortest path have exact scalar oracles. All 101 quick-profile checks per engine/run must pass before timing. Writes are executed and verified in the isolated benchmark namespace.

Pokec operations

Cell identifierFull operation name
R1exact indexed user lookup returning the stored user document
WNinsert a new benchmark user node
U1increment one benchmark-user property
WEadd one directed benchmark friendship edge
AG1whole-table age buckets and counts
AG2whole-table age count/min/max/sum/average
E1–E4exact fixed 1-, 2-, 3-, or 4-hop directed expansion
E2Fexact 2-hop expansion with endpoint age >= 18
N2concatenated exact 1-hop and exact 2-hop neighborhood
SPdirected unweighted shortest path, maximum depth 8

Four-hop expansion (E4) returns endpoints reached by exactly four directed hops; one-plus-two-hop neighborhood (N2) concatenates the exact one-hop and exact two-hop neighborhoods (including walk multiplicity). They measure different work and remain separate rows.

Every operation has an unwarmed serial observation and a prewarmed serial distribution. Isolated throughput uses 12 clients. Each non-mutating operation also receives a 70% operation / 30% write cell, split evenly between node and edge insert. The deterministic realistic workloads are:

  • Mixed analytical/read/update/write workload (W1): 20% analytical (AG1/AG2), 40% exact indexed user lookup, 10% property update, and 30% write split evenly between node and edge mutation;
  • Read-heavy mixed workload (W2): 70% exact indexed user lookup and 30% write;
  • Balanced read/write workload (W3): 50% exact indexed user lookup and 50% write;
  • Write-heavy mixed workload (W4): 30% exact indexed user lookup and 70% write.

How to interpret representative cells

Within one cell, higher completed QPS and lower p50/p95/p99 indicate better serving performance. QPS values across different cells do not compare equal amounts of work.

Exact indexed user lookup (R1) fetches one known user and returns the stored document. Its isolated cell measures focused point-read behavior with 12 clients and thousands of served samples per run.

Directed unweighted shortest path (SP) invokes each engine’s shortest-path primitive with a maximum depth of eight. The deterministic quick-profile parameters select targets one or two hops away, so this cell demonstrates short bounded pathfinding rather than long-path or high-diameter behavior.

Mixed analytical/read/update/write workload (W1) supplies the broadest database-behavior signal. Twelve clients concurrently issue 20% whole-table age analytics, 40% exact user lookups, 10% property increments, and 30% node or edge writes. Slow analytics or mutation maintenance can therefore delay otherwise-fast reads; the cell intentionally captures this cross-operation interference. Low completion counts make its tail percentiles directional, so reports retain counts and every raw response alongside QPS and latency.

Current Antfly rejects transforms against reserved _edges paths. Its WE compatibility request replaces the complete deterministic benchmark edge set through a whole-document upsert, while Neo4j and Memgraph create one edge. Diagnostic presentations disclose that difference and make no publication or apples-to-apples write-throughput claim.

The quick profile uses one-second isolated/mixed cells and two-second W1–W4 cells. Medium uses 5/10 seconds; full uses 15/30 seconds. Warmup is untimed. Every successful timed request is retained in JSONL. Reports contain completed QPS, error counts, p50/p95/p99, per-operation statistics, and peak PID RSS.

Persistent database volume

The honed LSQB SF0.1 F2 lane creates a new, run-labeled Docker local volume for every engine and repetition. Only the complete writable database root is measured (/data for Antfly and Neo4j, /var/lib/memgraph for Memgraph); read-only dataset/tool volumes and client scratch are excluded. A digest-pinned Alpine probe captures whole-volume allocated and apparent bytes once at empty, service-ready-before-ingestion, and post-workload, then at the verified post-stop final barrier. Final allocated bytes are the headline.

All three storage values, their arithmetic mean and range, apparent-byte diagnostics, barrier samples, volume manifests, and lifecycle receipts are retained. A provisional stop timeout remains visible but cannot support a comparative ratio.

Runs, ordering, and reporting

Each profile requires three clean process runs. Engine order rotates by run and uses a different rotation between lanes. Public serial point estimates are the medians of the three run-level p50, p95, and p99 values. Every result row also retains the three run-level percentile records, their min–max ranges, pooled sample percentiles as diagnostics, and all raw samples. Load/index readiness is diagnostic and is never included in query metrics.

summary.json is the machine-readable source of truth. The Markdown report contains the full cell table; scorecard.svg is only the compact two-panel view. There is deliberately no geometric mean or composite rank.

The honed LSQB SF0.1 F2 lane caches only the complete three-engine cohort. Promotion requires Antfly, Neo4j, and Memgraph to each retain three fresh database constructions and process runs, 15,000 timed samples, all three run-level percentile records and ranges, three complete storage receipts and their allocated-byte mean/range, 1,000/1,000 correctness, a valid canonical receipt, and the quiet-host record. The cache identity binds the Antfly subject, both peer image digests, the Linux client and storage-probe image, dataset manifest, harness sources, and protocol. A hit materializes the entire cohort; per-engine cache mixing is not permitted.

Internal fresh-service F2 readiness and convergence

The honed and Circus profiles retain a fresh-service diagnostic that measures how quickly a preloaded graph service becomes useful and settles into its warm filtered-two-hop behavior. It is graph-specific: readiness is followed immediately by the same exact LSQB SF0.1 F2 request used by the warm latency lane. It is not a general process-startup or system-wide Antfly claim.

This cohort is deliberately internal. It is attached to the canonical graph run report and structured result, but the public benchmark-page renderer does not render its table. It is never eligible for the honed publication cache: each honed or gauntlet graph invocation collects it afresh with make graph-f2-warmup-run. The retained diagnostic contract requires:

  • the same Antfly binary, pinned Neo4j and Memgraph images, official LSQB SF0.1 dataset, and Linux/arm64 Docker environment as the primary graph lane;
  • a recorded physical-host state, including whether the honed quiet-host assertion was active, without treating a diagnostic run as publication data;
  • one database construction followed by five fresh service lifecycles per engine, with balanced engine ordering;
  • restart-to-ready measured from immediately before service launch through the first successful engine-native probe: Antfly GET /readyz, Neo4j cypher-shell RETURN 1 plus the pinned-version check, and Memgraph autocommit SHOW VERSION over Bolt;
  • the first F2 latency and first-100 p50/p95 from a fixed 100-anchor panel selected by SHA-256 rank independently of result cardinality;
  • convergence at the first point where three consecutive adjacent 100-query window p50 changes are each within 5%, with a 10,000-query ceiling;
  • steady-state p50/p95 from five deterministic sweeps over all 1,000 anchors after convergence;
  • every timed result checked against the independent count+BLAKE3 oracle, with all 1,000 anchors covered in every engine/lifecycle; and
  • median-of-five run metrics with complete run ranges, raw timestamped samples, lifecycle logs, host evidence, exact schedules, and a canonical receipt.

These seven values are an indivisible internal reporting family: restart-to-ready, first-query, first-100 p50, first-100 p95, queries-to-stable-p50, steady p50, and steady p95. The retained report must show all seven for all three engines; it must not headline convergence while omitting the steady-state latency guardrail or Memgraph.

Bounded internal Maxi diagnostic source

graph-diagnostics canonicalizes medium Pokec and LSQB-derived SF0.1 instrumentation without changing the honed F2 publication protocol. One balanced three-engine collection produces two independent sub-lanes:

  • lsqb-derived-anchored-n1-p2-f2-v1 retains separate warm-serial N1, P2, and F2 median-of-three run percentiles, ranges, result-count buckets, served sample counts, and every count+BLAKE3 parameter oracle; and
  • pokec-graph-operations-v1 retains R1, E1–E4, E2F, N2, SP, AG1, AG2, WN, U1, WE, W1–W4, exact mutation-state checks, and raw schedules on the Pokec-medium corpus.

The default runner passes zero throughput seconds, so it never starts the P2 concurrency workload. It also never starts the five-lifecycle fresh-service cohort. graph-p2-c12-sf01-run and graph-f2-warmup-run retain those protocols as explicit opt-in diagnostics. SF1 and SF10 likewise require explicit scale targets and never enter the default gauntlet.

The finalizer rejects timed errors, missing runs, failed count/hash/state oracles, and any result-budget contact. The canonical result uses graph-diagnostics-v2 with classification internal_diagnostic. PID RSS remains under diagnostic_process_rss; the source declares comparable_resource_metrics: false, emits no memory or storage chart, and defines no composite winner. This source enters the gauntlet and Maxi incubation views only, never the honed allowlist or public graph section.

Qualification and publication

The default command is a small, complete optimization loop with a target wall time below 15 minutes. Medium and full are explicit diagnostic commands. A mixed native-macOS/container run is qualification-only because its process RSS views are not comparable across engines.

The release-facing honed F2 lane is a separate, environment-qualified publication protocol. Antfly, Neo4j, and Memgraph all run sequentially inside the same Docker Desktop Linux/arm64 VM on an explicitly quiescent Apple Silicon host. The published claim must name that environment and is limited to warm serial filtered two-hop latency; it is not a bare-metal Linux result or a claim about general graph-database performance. Publication requires:

  • the exact v0.2.0 Linux/arm64 binary and expected SHA-256;
  • the pinned Neo4j 5.26.29, Memgraph 3.12.0, and Linux client image digests;
  • official LSQB SF0.1 with 432,235 nodes and 1,827,523 relationships;
  • three fresh database constructions and process runs per engine, each on a newly created labeled database volume;
  • five warmed serial sweeps per run over 1,000 deterministic anchors;
  • 1,000/1,000 count+BLAKE3 correctness in every engine/run and zero timed errors;
  • median run-level p50/p95/p99 with all run ranges, pooled diagnostics, raw samples, lifecycle logs, and the physical-host record retained; and
  • a canonical receipt for the indivisible three-engine cohort.

The broader graph-v2/Pokec publication gate remains native-Linux-only and is not satisfied by this bounded F2 artifact.

Run evidence parameters · variation · provenance

Benchmark parameters

{"correctness":{"antfly-1":{"failed":0,"oracle":"complete result multiset/count or exact aggregate/path value","passed":101,"rate":1},"antfly-2":{"failed":0,"oracle":"complete result multiset/count or exact aggregate/path value","passed":101,"rate":1},"antfly-3":{"failed":0,"oracle":"complete result multiset/count or exact aggregate/path value","passed":101,"rate":1},"memgraph-1":{"failed":0,"oracle":"complete result multiset/count or exact aggregate/path value","passed":101,"rate":1},"memgraph-2":{"failed":0,"oracle":"complete result multiset/count or exact aggregate/path value","passed":101,"rate":1},"memgraph-3":{"failed":0,"oracle":"complete result multiset/count or exact aggregate/path value","passed":101,"rate":1},"neo4j-1":{"failed":0,"oracle":"complete result multiset/count or exact aggregate/path value","passed":101,"rate":1},"neo4j-2":{"failed":0,"oracle":"complete result multiset/count or exact aggregate/path value","passed":101,"rate":1},"neo4j-3":{"failed":0,"oracle":"complete result multiset/count or exact aggregate/path value","passed":101,"rate":1}},"dataset":{"dataset":"pokec-small","edges":121716,"nodes":10000,"source_sha256":"3e64bffd118c18a23342233f30fc710b753f4ea173a2d166351a28b44976c308","source_url":"https://s3.eu-west-1.amazonaws.com/deps.memgraph.io/dataset/pokec/benchmark/pokec_small_import.cypher"},"total_cells":29,"valid_cells":26}

Peer versions

  • Memgraph3.12.0
  • Neo4j5.26.29

Evidence digests

Receipt
5706f0a25f0eed6d191218ceebaeb2e4c8d74f6e55e055ad3d621c3bf5e138ae
Aggregate
054c24de6dff36de12b5e605a351d1882943f1fc2c50870fae3284e336305d35
Provenance
723ed4b22e9ca9fc7505d363c5d9c7a099963bf55c8ee5a118525215d6b8c4a2
Harness commit
f4d6b06ddd7ede36a27827d11d653f939a3a2fdb
Selected partial evidence
Completed
Antfly
v0.2.1-rc.3 ·
Runtime
8m 16s
Platform
darwin · arm64
Machine
Apple M4 Max
Build
ReleaseFast

Pokec-small throughput by task and engine

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast/full) · Apple M4 Max physical host · Antfly native Darwin/arm64 · Neo4j Linux/arm64 Docker · Memgraph Linux/arm64 Docker · Pokec-small · three runs · errorful cells excluded · Each task resets red→yellow→green from lowest to highest QPS; compare within the same task/row only

Pokec-small graph operations

Antfly v0.2.1-rc.3 · bb8a284d

TaskAntflyNeo4jMemgraph
Serial read sweep (unwarmed)QPS 39.8 · p50 0.717 / p95 148.937 / p99 155.431 msQPS 58.4 · p50 19.6 / p95 33.8 / p99 37.1 msQPS 988.6 · p50 0.3 / p95 4.1 / p99 5.2 ms
Serial read sweep (prewarmed)QPS 37.1 · p50 0.352 / p95 136.195 / p99 139.711 msQPS 580.6 · p50 1.5 / p95 3.6 / p99 4.2 msQPS 807.1 · p50 0.3 / p95 5.2 / p99 5.4 ms
Isolated · exact lookup (R1)QPS 31,530.3 · p50 0.261 / p95 0.956 / p99 1.528 msQPS 12,669.9 · p50 0.9 / p95 1.6 / p99 2.4 msQPS 25,920.4 · p50 0.4 / p95 0.8 / p99 1.1 ms
Isolated · age buckets (AG1)QPS 18.6 · p50 634.829 / p95 659.726 / p99 669.917 msQPS 5,042.6 · p50 2.1 / p95 3.8 / p99 5.4 msQPS 5,775.7 · p50 1.9 / p95 3.3 / p99 4.0 ms
Isolated · age stats (AG2)QPS 19.1 · p50 616.413 / p95 650.392 / p99 687.198 msQPS 4,772.2 · p50 2.1 / p95 4.2 / p99 5.4 msQPS 2,935.5 · p50 3.8 / p95 5.5 / p99 6.5 ms
Isolated · 1-hop expansion (E1)QPS 36,929.5 · p50 0.225 / p95 0.751 / p99 1.196 msQPS 7,865.9 · p50 1.2 / p95 2.6 / p99 4.1 msQPS 25,184.7 · p50 0.4 / p95 0.8 / p99 1.1 ms
Isolated · 2-hop expansion (E2)QPS 25,189.7 · p50 0.333 / p95 1.164 / p99 1.791 msQPS 7,962.1 · p50 1.3 / p95 2.6 / p99 3.3 msQPS 21,020.8 · p50 0.5 / p95 1.1 / p99 1.4 ms
Isolated · 2-hop age filter (E2F)QPS 9,033.1 · p50 1.011 / p95 3.331 / p99 5.136 msQPS 8,342.8 · p50 1.2 / p95 2.5 / p99 3.2 msQPS 23,145.7 · p50 0.5 / p95 0.9 / p99 1.3 ms
Isolated · 3-hop expansion (E3)QPS 9,496.9 · p50 0.877 / p95 3.443 / p99 5.272 msQPS 6,183.9 · p50 1.8 / p95 3.0 / p99 3.7 msQPS 12,517.3 · p50 0.9 / p95 1.5 / p99 1.9 ms
Isolated · 4-hop expansion (E4)QPS 2,010.0 · p50 5.270 / p95 12.743 / p99 17.025 msQPS 2,013.0 · p50 5.9 / p95 7.4 / p99 8.1 msQPS 3,184.0 · p50 3.7 / p95 5.2 / p99 5.9 ms
Isolated · 1+2-hop neighborhood (N2)QPS 20,524.4 · p50 0.463 / p95 1.339 / p99 2.035 msQPS 14,050.0 · p50 0.8 / p95 1.4 / p99 1.8 msQPS 19,369.2 · p50 0.5 / p95 1.2 / p99 1.5 ms
Isolated · shortest path ≤8 (SP)QPS 25,224.1 · p50 0.314 / p95 1.217 / p99 1.927 msQPS 17,338.5 · p50 0.6 / p95 1.1 / p99 1.6 msQPS 1,567.8 · p50 7.2 / p95 10.3 / p99 11.7 ms
Isolated · node insert (WN)QPS 371.1 · p50 18.971 / p95 84.977 / p99 196.899 msQPS 8,168.2 · p50 1.4 / p95 2.3 / p99 3.0 msQPS 23,875.1 · p50 0.5 / p95 0.8 / p99 1.2 ms
Isolated · property update (U1)QPS 581.2 · p50 10.021 / p95 89.600 / p99 173.824 msQPS 10,563.8 · p50 1.0 / p95 1.9 / p99 2.5 msQPS 24,015.9 · p50 0.5 / p95 0.8 / p99 1.2 ms
Isolated · edge mutation (WE)QPS 310.5 · p50 25.137 / p95 103.591 / p99 262.276 msQPS 7,279.8 · p50 1.4 / p95 2.7 / p99 3.4 msQPS 24,411.2 · p50 0.4 / p95 0.8 / p99 1.1 ms
30% writes · exact lookup (R1)QPS 497.1 · p50 1.859 / p95 136.983 / p99 262.718 msQPS 13,760.2 · p50 0.6 / p95 2.1 / p99 2.8 msQPS 25,644.3 · p50 0.4 / p95 0.8 / p99 1.0 ms
30% writes · age buckets (AG1)failed · 12 timed errorsQPS 6,124.9 · p50 1.9 / p95 3.3 / p99 4.2 msQPS 5,043.2 · p50 2.7 / p95 4.3 / p99 5.7 ms
30% writes · age stats (AG2)failed · 5 timed errorsQPS 5,712.3 · p50 1.9 / p95 3.7 / p99 4.8 msQPS 3,134.0 · p50 4.5 / p95 6.6 / p99 7.7 ms
30% writes · 1-hop expansion (E1)QPS 628.9 · p50 1.092 / p95 111.119 / p99 206.851 msQPS 13,730.3 · p50 0.6 / p95 2.1 / p99 2.8 msQPS 24,520.0 · p50 0.4 / p95 0.8 / p99 1.2 ms
30% writes · 2-hop expansion (E2)QPS 585.5 · p50 1.739 / p95 123.584 / p99 213.858 msQPS 12,803.2 · p50 0.7 / p95 2.1 / p99 2.7 msQPS 23,270.4 · p50 0.5 / p95 1.0 / p99 1.3 ms
30% writes · 2-hop age filter (E2F)QPS 562.3 · p50 2.229 / p95 132.204 / p99 174.920 msQPS 13,075.3 · p50 0.7 / p95 2.1 / p99 2.7 msQPS 23,264.0 · p50 0.5 / p95 0.9 / p99 1.3 ms
30% writes · 3-hop expansion (E3)QPS 592.0 · p50 2.144 / p95 125.847 / p99 209.276 msQPS 10,028.0 · p50 1.2 / p95 1.9 / p99 2.4 msQPS 15,912.3 · p50 0.7 / p95 1.4 / p99 1.8 ms
30% writes · 4-hop expansion (E4)QPS 351.0 · p50 8.038 / p95 146.091 / p99 242.958 msQPS 2,741.5 · p50 4.9 / p95 8.8 / p99 10.1 msQPS 4,349.5 · p50 3.0 / p95 5.8 / p99 6.9 ms
30% writes · 1+2-hop neighborhood (N2)QPS 601.1 · p50 1.674 / p95 123.263 / p99 218.567 msQPS 12,541.6 · p50 0.7 / p95 2.0 / p99 2.9 msQPS 21,662.5 · p50 0.5 / p95 1.1 / p99 1.4 ms
30% writes · shortest path ≤8 (SP)QPS 578.3 · p50 1.922 / p95 124.862 / p99 208.327 msQPS 13,418.7 · p50 0.6 / p95 2.1 / p99 2.8 msQPS 2,245.5 · p50 6.4 / p95 8.9 / p99 10.5 ms

Pokec-small read/write mixes

Antfly v0.2.1-rc.3 · bb8a284d

TaskAntflyNeo4jMemgraph
Mixed workload · 20/40/10/30 (W1)failed · 12 timed errorsQPS 9,793.5 · p50 1.0 / p95 2.5 / p99 4.2 msQPS 10,980.7 · p50 0.5 / p95 4.1 / p99 5.3 ms
Read-heavy mix · 70/30 (W2)QPS 672.9 · p50 1.286 / p95 116.357 / p99 223.363 msQPS 13,526.5 · p50 0.6 / p95 2.2 / p99 2.9 msQPS 25,112.5 · p50 0.4 / p95 0.8 / p99 1.1 ms
Balanced mix · 50/50 (W3)QPS 528.4 · p50 5.983 / p95 123.558 / p99 229.695 msQPS 11,475.3 · p50 0.8 / p95 2.3 / p99 3.1 msQPS 24,792.3 · p50 0.4 / p95 0.8 / p99 1.1 ms
Write-heavy mix · 30/70 (W4)QPS 507.9 · p50 8.695 / p95 120.980 / p99 257.318 msQPS 9,782.4 · p50 1.2 / p95 2.4 / p99 3.0 msQPS 24,330.4 · p50 0.4 / p95 0.8 / p99 1.1 ms
ii

graph-lsqb-official

partial

Official LSQB

Antfly v0.2.1-rc.3 returned zero q1 matches against eight expected; q2–q9 remain unsupported. Neo4j and Memgraph rows retain earlier correctness results and were not rerun.

Methodology scope · protocol · interpretation

Official LSQB capability and correctness lane

This lane wraps the unmodified LSQB source at commit 62136445b6bc0be8a0ad60ea008b5faa16e34546. It runs the upstream example dataset and hashes the exact cypher/q1.cypher through cypher/q9.cypher files.

Neo4j 5.26.29 and Memgraph 3.12.0 execute each upstream scalar count(*) query. Antfly receives only representable requests. Q1 permits one correctness-only materialization with a preregistered max_results value of 900 when the upstream count falls below that cap. Q2–Q9 receive explicit unsupported classifications; the adapter performs no client-side joins, filtering, or aggregation.

The canonical artifact uses schema graph-lsqb-official-v1, classification capability_matrix, and a complete 27-cell engine/query matrix. It reports no latency, throughput, resource point, or audited LSQB score. Missing cells, upstream validation failures, unexpected unsupported-query requests, or query-file drift fail the artifact. Unsupported cells alone preserve a complete capability result.

Reason provenance is deterministic and requires no agent during a run. Neo4j and Memgraph receive official_scalar_count or upstream_validation_mismatch from direct comparison of the observed count with upstream expected-output.csv. Antfly q2–q9 use the source-controlled UNSUPPORTED mapping in run.py; each entry names the unsupported Cypher shape and the missing scalar aggregation capability, and the harness verifies that no request was issued. That mapping is manually maintained when either the pinned queries or Antfly API capabilities change. A reason entry alone is not sufficient to implement new adapter support: the hashed upstream query and the current Antfly graph API must also be reviewed.

Canonical runs provision their own label-owned dataset volume, Neo4j volume and service, and Memgraph volume and service on the run’s private Docker network. Operator-supplied peer endpoints are not accepted. The official mapping is copied from the unmodified upstream loaders: Comment.csv is labeled Message:Comment, Post.csv is labeled Message:Post, and all 25 relationship files are loaded. The pinned peers are neo4j@sha256:d9dd3dc7d1c78fa959191ff02dbdcbefadceaf83eee23428fb92a58cac8ad3fe (5.26.29) and memgraph/memgraph@sha256:c162cb9a6f76dac6080119da919d9b36e69c8b982af7bf34dd7df2b3723bd69c (3.12.0). Linux/arm64 execution uses the pinned CIRCUS_LINUX_IMAGE runtime.

Every live run retains the asserted Antfly tag, commit, executable SHA-256, query hashes, dataset file hashes and row counts, inspected peer image IDs and repository digests, observed peer versions, exact peer counts, validator output, import logs, query evidence, and service logs. Cleanup stops and removes only containers and volumes carrying both run and benchmark ownership labels, including after import, readiness, validation, or Antfly failure. None of this evidence is a timing sample or resource measurement, and it does not make the lane eligible for an official LSQB score.

Run evidence parameters · variation · provenance

Benchmark parameters

{"official_score_eligible":false,"operations":[{"correctness":{"actual_count":0,"expected_count":8,"status":"failed"},"engine":"antfly","query_id":"q1","query_sha256":"e08571bf8c877508cd3745ee7dcc8c061259c3b4d5a3fb17a952fbac4f9145ed","reason":"Antfly materialized q1 did not match the upstream scalar count.","reason_code":"upstream_validation_mismatch","request_issued":true,"status":"failed"},{"correctness":{"actual_count":null,"expected_count":3,"status":"not_applicable"},"engine":"antfly","query_id":"q2","query_sha256":"49df895df6b98037f6ce5972d9113ae7a3f263ec009e4fece9ec75bb47410b32","reason":"branch joins and graph_binding_aggregation lack an exact Antfly request","reason_code":"branch_join","request_issued":false,"status":"unsupported"},{"correctness":{"actual_count":null,"expected_count":6,"status":"not_applicable"},"engine":"antfly","query_id":"q3","query_sha256":"5eb0a515fb894e91ecbc1f40656e757884a234953bf87565aec5fcc85007e5be","reason":"multi-pattern cycle joins and graph_binding_aggregation lack an exact Antfly request","reason_code":"multi_pattern_cycle_join","request_issued":false,"status":"unsupported"},{"correctness":{"actual_count":null,"expected_count":8,"status":"not_applicable"},"engine":"antfly","query_id":"q4","query_sha256":"1675c38f7cc117ba9be4de8fc0c1d7073901a03cfc5a174f2241e14c602c9a9f","reason":"branch joins and graph_binding_aggregation lack an exact Antfly request","reason_code":"branch_join","request_issued":false,"status":"unsupported"},{"correctness":{"actual_count":null,"expected_count":3,"status":"not_applicable"},"engine":"antfly","query_id":"q5","query_sha256":"d836a819c7c96819f5dfa14d4e0097bcfb2222eb1561d3ffda22f15067cd8179","reason":"cross-alias predicates and graph_binding_aggregation lack an exact Antfly request","reason_code":"cross_alias_predicate","request_issued":false,"status":"unsupported"},{"correctness":{"actual_count":null,"expected_count":8,"status":"not_applicable"},"engine":"antfly","query_id":"q6","query_sha256":"b8c550aa3c452a99fe65d22ae23e7461ee2705b8be45e96a1d2d1d6143880c93","reason":"cross-alias predicates and graph_binding_aggregation lack an exact Antfly request","reason_code":"cross_alias_predicate","request_issued":false,"status":"unsupported"},{"correctness":{"actual_count":null,"expected_count":11,"status":"not_applicable"},"engine":"antfly","query_id":"q7","query_sha256":"3cb1b31a3f2d05efcaaebaea5ef70231bff30dcfe85aca21cb011ee99175ef0f","reason":"optional matches and graph_binding_aggregation lack an exact Antfly request","reason_code":"optional_match","request_issued":false,"status":"unsupported"},{"correctness":{"actual_count":null,"expected_count":2,"status":"not_applicable"},"engine":"antfly","query_id":"q8","query_sha256":"73fbce9474f0059cfc620c17c5016d19b0974cdbbc8f26637f51b86ea4f24b91","reason":"negative edge predicates and graph_binding_aggregation lack an exact Antfly request","reason_code":"negative_edge_predicate","request_issued":false,"status":"unsupported"},{"correctness":{"actual_count":null,"expected_count":4,"status":"not_applicable"},"engine":"antfly","query_id":"q9","query_sha256":"f0e3402d9bf03cf2e01bf5d812399a4a2f2d40d4558a6ac04d09f0a77afbc8e4","reason":"negative edge predicates and graph_binding_aggregation lack an exact Antfly request","reason_code":"negative_edge_predicate","request_issued":false,"status":"unsupported"}],"scope":"official-query-capability-correctness-only","source_provenance":null,"throughput_score":null}

Peer versions

Peer versions were not recorded in the published result fields.

Evidence digests

Receipt
4063a2f1deb0f17de5f0444934c35a217b61cd9411bd7932fc37d56d73200419
Aggregate
95e6c5aca7a38dfbafd071ba9b948dc12d5ddbcb8d4574e51e0f9df743a6bf4a
Provenance
28a217b486f15bfe36e43c451d283055f1a49aaad705f4e80a29b9e306be4d5f
Harness commit
f4d6b06ddd7ede36a27827d11d653f939a3a2fdb
Selected partial evidence
Completed
Antfly
v0.2.1-rc.3 ·
Runtime
5.7s
Platform
darwin · arm64
Machine
Apple M4 Max
Build
ReleaseFast

Official query correctness

Antfly v0.2.1-rc.3 · bb8a284d

QueryEngineStatusCorrectnessRequest issuedExpected countObserved countReason
q1antflyfailedfailedyes80Antfly materialized q1 did not match the upstream scalar count.
q2antflyunsupportednot_applicableno3—branch joins and graph_binding_aggregation lack an exact Antfly request
q3antflyunsupportednot_applicableno6—multi-pattern cycle joins and graph_binding_aggregation lack an exact Antfly request
q4antflyunsupportednot_applicableno8—branch joins and graph_binding_aggregation lack an exact Antfly request
q5antflyunsupportednot_applicableno3—cross-alias predicates and graph_binding_aggregation lack an exact Antfly request
q6antflyunsupportednot_applicableno8—cross-alias predicates and graph_binding_aggregation lack an exact Antfly request
q7antflyunsupportednot_applicableno11—optional matches and graph_binding_aggregation lack an exact Antfly request
q8antflyunsupportednot_applicableno2—negative edge predicates and graph_binding_aggregation lack an exact Antfly request
q9antflyunsupportednot_applicableno4—negative edge predicates and graph_binding_aggregation lack an exact Antfly request
q1memgraphcorrectness_onlypassedyes88official_scalar_count: Exact upstream scalar count matched.
q1neo4jcorrectness_onlypassedyes88official_scalar_count: Exact upstream scalar count matched.
q2memgraphcorrectness_onlypassedyes33official_scalar_count: Exact upstream scalar count matched.
q2neo4jcorrectness_onlypassedyes33official_scalar_count: Exact upstream scalar count matched.
q3memgraphcorrectness_onlypassedyes66official_scalar_count: Exact upstream scalar count matched.
q3neo4jcorrectness_onlypassedyes66official_scalar_count: Exact upstream scalar count matched.
q4memgraphcorrectness_onlypassedyes88official_scalar_count: Exact upstream scalar count matched.
q4neo4jcorrectness_onlypassedyes88official_scalar_count: Exact upstream scalar count matched.
q5memgraphcorrectness_onlypassedyes33official_scalar_count: Exact upstream scalar count matched.
q5neo4jcorrectness_onlypassedyes33official_scalar_count: Exact upstream scalar count matched.
q6memgraphcorrectness_onlypassedyes88official_scalar_count: Exact upstream scalar count matched.
q6neo4jcorrectness_onlypassedyes88official_scalar_count: Exact upstream scalar count matched.
q7memgraphcorrectness_onlypassedyes1111official_scalar_count: Exact upstream scalar count matched.
q7neo4jcorrectness_onlypassedyes1111official_scalar_count: Exact upstream scalar count matched.
q8memgraphcorrectness_onlypassedyes22official_scalar_count: Exact upstream scalar count matched.
q8neo4jcorrectness_onlypassedyes22official_scalar_count: Exact upstream scalar count matched.
q9memgraphcorrectness_onlypassedyes44official_scalar_count: Exact upstream scalar count matched.
q9neo4jcorrectness_onlypassedyes44official_scalar_count: Exact upstream scalar count matched.
iii

graph-snb-interactive

partial

SNB Interactive

Antfly v0.2.1-rc.3 qualified four exact read operations; the remaining 25 operations stay unsupported.

Methodology scope · protocol · interpretation

LDBC SNB Interactive v1 bounded read qualification

This incubation lane pins the official Interactive v1.2.0 driver at 4cd13735f964406ad34f34ccd5bef4d6e6c284d0 and Hadoop datagen v1.0.0 at 37d35f40f5023fcf1afd3b6d0984f71c202f4bca. Upstream submodules remain unmodified.

The default gauntlet uses official SF0.1 CsvCompositeMergeForeign-LongDateFormatter data and one fresh Antfly lifecycle. SF1 and SF10 require explicit scale targets. Downloaded or generated data stays under .data/; provenance retains the source URL, archive SHA-256, extracted file manifest, staged node/edge counts, and parameter digest.

The exact qualified subset contains four read operations:

  • LdbcShortQuery1PersonProfile: versioned Person lookup returning first name, last name, birthday, location IP, browser, city, gender, and creation date;
  • LdbcShortQuery4MessageContent: versioned Post/Comment lookup returning content-or-image and creation date;
  • LdbcShortQuery5MessageCreator: exact Message lookup followed by the exact creator Person lookup; both keyed reads contribute to the timed operation; and
  • LdbcQuery13: unweighted shortest path over KNOWS, returning the path length.

The harness selects deterministic parameters by SHA-256 rank and constructs independent SQLite oracles from the retained CSV files. Every parameter passes exact correctness before timing. Timed records include served-only p50/p95/p99, sample counts, and zero request errors. Result-budget contact, missing parameters, response errors, or oracle mismatches fail the artifact.

All 29 Interactive v1 operations remain visible. Unsupported operations receive explicit semantic reason codes, no request, no fallback, no client-side join/filter/order/aggregation, and no timing. The qualified creator operation uses only its official immutable foreign key for an exact two-key chase. Updates remain unsupported because each official update changes related graph entities or edges atomically.

The canonical artifact uses graph-snb-interactive-v1-qualification-v1, classification partial_read_qualification, and official_score_eligible: false. It does not run the official mixed workload, use official frequencies, report throughput, claim complete conformance, or qualify for public publication. Pinned Neo4j and Memgraph comparison support may follow in a later protocol; this bounded default currently qualifies Antfly against exact official operation semantics.

Run evidence parameters · variation · provenance

Benchmark parameters

{"official_score_eligible":false,"operations":[{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcQuery1","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"multi_entity_join_and_order","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcQuery2","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"multi_entity_join_and_order","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcQuery3","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"temporal_join_and_aggregation","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcQuery4","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"temporal_join_and_grouping","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcQuery5","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"multi_hop_join_and_grouping","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcQuery6","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"multi_hop_tag_join","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcQuery7","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"negative_edge_predicate_and_order","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcQuery8","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"ordered_reply_join","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcQuery9","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"multi_hop_temporal_order","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcQuery10","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"multi_hop_scoring_and_order","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcQuery11","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"multi_hop_organisation_join","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcQuery12","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"multi_hop_tagclass_join","request_issued":false,"status":"unsupported"},{"correctness":{"exact_parameters":100,"status":"passed"},"engine":"antfly","operation_id":"LdbcQuery13","reason":"Every deterministic parameter matched the independent SQLite oracle.","reason_code":"exact_read_semantics","request_issued":true,"status":"qualified","timing":{"errors":0,"p50_ms":{"median":0.452125,"range":[0.312209,1.617708]},"p95_ms":{"median":1.144167,"range":[0.312209,1.617708]},"p99_ms":{"median":1.523458,"range":[0.312209,1.617708]},"runs":1,"samples":300}},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcQuery14","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"all_shortest_paths_weighted_aggregation","request_issued":false,"status":"unsupported"},{"correctness":{"exact_parameters":100,"status":"passed"},"engine":"antfly","operation_id":"LdbcShortQuery1PersonProfile","reason":"Every deterministic parameter matched the independent SQLite oracle.","reason_code":"exact_read_semantics","request_issued":true,"status":"qualified","timing":{"errors":0,"p50_ms":{"median":0.121667,"range":[0.09175,0.251208]},"p95_ms":{"median":0.1815,"range":[0.09175,0.251208]},"p99_ms":{"median":0.194125,"range":[0.09175,0.251208]},"runs":1,"samples":300}},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcShortQuery2PersonPosts","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"cross_type_union_and_order","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcShortQuery3PersonFriends","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"edge_property_order","request_issued":false,"status":"unsupported"},{"correctness":{"exact_parameters":100,"status":"passed"},"engine":"antfly","operation_id":"LdbcShortQuery4MessageContent","reason":"Every deterministic parameter matched the independent SQLite oracle.","reason_code":"exact_read_semantics","request_issued":true,"status":"qualified","timing":{"errors":0,"p50_ms":{"median":0.3623125,"range":[0.1705,13.980917]},"p95_ms":{"median":0.441167,"range":[0.1705,13.980917]},"p99_ms":{"median":1.196667,"range":[0.1705,13.980917]},"runs":1,"samples":300}},{"correctness":{"exact_parameters":100,"status":"passed"},"engine":"antfly","operation_id":"LdbcShortQuery5MessageCreator","reason":"Every deterministic parameter matched the independent SQLite oracle.","reason_code":"exact_read_semantics","request_issued":true,"status":"qualified","timing":{"errors":0,"p50_ms":{"median":0.5314375,"range":[0.363375,1.756167]},"p95_ms":{"median":0.641208,"range":[0.363375,1.756167]},"p99_ms":{"median":0.773834,"range":[0.363375,1.756167]},"runs":1,"samples":300}},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcShortQuery6MessageForum","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"reply_chain_and_multi_entity_join","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcShortQuery7MessageReplies","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"cross_alias_knows_predicate_and_order","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcUpdate1AddPerson","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"multi_entity_graph_transaction","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcUpdate2AddPostLike","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"edge_transaction","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcUpdate3AddCommentLike","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"edge_transaction","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcUpdate4AddForum","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"multi_entity_graph_transaction","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcUpdate5AddForumMembership","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"edge_transaction","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcUpdate6AddPost","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"multi_entity_graph_transaction","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcUpdate7AddComment","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"multi_entity_graph_transaction","request_issued":false,"status":"unsupported"},{"correctness":{"status":"not_applicable"},"engine":"antfly","operation_id":"LdbcUpdate8AddFriendship","reason":"The exact official operation requires unsupported graph or transaction semantics.","reason_code":"edge_transaction","request_issued":false,"status":"unsupported"}],"scope":"partial_read_qualification","source_provenance":{"datagen":{"commit":"37d35f40f5023fcf1afd3b6d0984f71c202f4bca","serializer":"CsvCompositeMergeForeign-LongDateFormatter","tag":"v1.0.0"},"driver":{"commit":"4cd13735f964406ad34f34ccd5bef4d6e6c284d0","tag":"v1.2.0"},"operation_sha256":{"LdbcQuery13":"8bf956c889992c7508a01196effa2b4eba864421141a99227f384240daffc134","LdbcQuery13Result":"d4cf3752c8639bcffdcdd01a38a9ed8af3ed7cfa5f81792080333f6f5ec5ef26","LdbcShortQuery1PersonProfile":"54e2ace370fbb2f0215b0394e92fcbb3056025fba02f1e25080219d586c913a3","LdbcShortQuery1PersonProfileResult":"f6b7ec32cae1b79bbb538d40a0d8b961729f058b2b6c61d1f08f9ce755544ec0","LdbcShortQuery4MessageContent":"1f544490b719eeddd8f22f264bec82c001c2119ede2a53dd4e1ccbbb5782d2c5","LdbcShortQuery4MessageContentResult":"1a2e471c29d606f7312a7b46e962b28d00dafb3bb6865d14faafc67f419193ba","LdbcShortQuery5MessageCreator":"bc89858d05e70ffbd2719f5ef1518c42d244d89f08459e700d6b6bb51c274a51","LdbcShortQuery5MessageCreatorResult":"97d5d28bf08eb19e684eafe3a785acc8419c487b54aef8c41bbd8078d0f03e4b"},"platform":{"machine":"arm64","system":"darwin"}},"throughput_score":null}

Peer versions

Peer versions were not recorded in the published result fields.

Evidence digests

Receipt
aad504a3743927afb65ad6fe48dd40ca233ecd27b601a5d067249d97226c0111
Aggregate
ef99e7ca0057435ec927d82c63b8e8605df209820b8eb0b270d05a9e23f77786
Provenance
1e95f32cc4a19ad589a6f43d614902ca645ae182468b2292a775df53531cbbde
Harness commit
f4d6b06ddd7ede36a27827d11d653f939a3a2fdb
Selected partial evidence
Completed
Antfly
v0.2.1-rc.3 ·
Runtime
1m 01s
Platform
darwin · arm64
Machine
Apple M4 Max
Build
ReleaseFast

Qualified read operations · p95

Antfly v0.2.1-rc.3 (bb8a284d, ReleaseFast/full) · darwin-arm64 · Apple M4 Max · SF0.1 · one lifecycle · zero-error qualified reads

Operation qualification

Antfly v0.2.1-rc.3 · bb8a284d

OperationEngineStatusCorrectnessRequest issuedReason
LdbcQuery1antflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcQuery2antflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcQuery3antflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcQuery4antflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcQuery5antflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcQuery6antflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcQuery7antflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcQuery8antflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcQuery9antflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcQuery10antflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcQuery11antflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcQuery12antflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcQuery13antflyqualifiedpassedyesEvery deterministic parameter matched the independent SQLite oracle.
LdbcQuery14antflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcShortQuery1PersonProfileantflyqualifiedpassedyesEvery deterministic parameter matched the independent SQLite oracle.
LdbcShortQuery2PersonPostsantflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcShortQuery3PersonFriendsantflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcShortQuery4MessageContentantflyqualifiedpassedyesEvery deterministic parameter matched the independent SQLite oracle.
LdbcShortQuery5MessageCreatorantflyqualifiedpassedyesEvery deterministic parameter matched the independent SQLite oracle.
LdbcShortQuery6MessageForumantflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcShortQuery7MessageRepliesantflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcUpdate1AddPersonantflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcUpdate2AddPostLikeantflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcUpdate3AddCommentLikeantflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcUpdate4AddForumantflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcUpdate5AddForumMembershipantflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcUpdate6AddPostantflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcUpdate7AddCommentantflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
LdbcUpdate8AddFriendshipantflyunsupportednot_applicablenoThe exact official operation requires unsupported graph or transaction semantics.
XII

5 lanes without selected evidence

Missing evidence

i

document-omnidocbench

missing

OmniDocBench

Document parsing and structure-recovery quality across the OmniDocBench evaluation surface.

Methodology scope · protocol · interpretation

OmniDocBench Methodology

benchmarks/OmniDocBench is the raw benchmark checkout and stays pointed at the Antfly-owned OmniDocBench origin. This harness directory contains antfly-circus-specific adapter code, methodology notes, generated prediction directories, and OmniDocBench evaluator outputs.

Measurement surface

OmniDocBench measures document parsing quality, not plain OCR alone. Each engine must produce one markdown prediction per page; OmniDocBench then scores text recognition, table reconstruction, formula rendering, and reading order.

Antfly is invoked through the central Bastille handoff: antfly-circus passes the exact benchmark binary as ANTFLY_BIN, and the adapter only consumes that binary. It does not discover or substitute another Antfly executable.

Default smoke profile

  • Dataset: OmniDocBench demo data
  • Prediction format: one markdown file per page
  • Evaluation: OmniDocBench end2end config shape
  • Smoke behavior: verify adapter wiring and output paths without claiming full OmniDocBench leaderboard coverage

Full benchmark profile

The default full profile runs --engine antfly --protocol page-image over the bundled OmniDocBench demo subset: 18 page images. It writes one Antfly-generated markdown prediction per page, evaluates with OmniDocBench, and reports quality metrics first: Overall, text edit distance, table TEDS, formula CDM, and reading-order edit distance. Prediction throughput is reported separately as pages/s.

Set ANTFLY_DOC_MODEL_DIR to the explicit reader model directory and ANTFLY_BIN to the exact Antfly binary under test. The adapter intentionally does not substitute bundled demo predictions for missing Antfly output.

Protocols and peers

  • page-image: runnable with the bundled demo data. Engines receive raster page images and must emit markdown files whose names match the OmniDocBench image stems.
  • native-pdf: dataset/API-gated. It is blocked unless PDF inputs and a compatible native-PDF engine path are configured. The adapter does not silently rasterize PDFs and call that native PDF parsing.

Open-source peer rows are wrapper-based. Configure command templates with OMNIDOCBENCH_MINERU_CMD, OMNIDOCBENCH_MARKER_CMD, OMNIDOCBENCH_DOCLING_CMD, or OMNIDOCBENCH_OCR_BASELINE_CMD. Templates may use {input}, {output}, {output_dir}, and {stem} placeholders. The OCR-only baseline can also use TESSERACT_BIN or tesseract on PATH.

Record the exact image/PDF input set, command template or Antfly command, model directory/backend selected, protocol, worker counts, whether CDM is enabled, and all generated OmniDocBench result JSON files under benchmarks/OmniDocBench-harness/result. The full 1651-page OmniDocBench dataset is not bundled in this checkout; pull it from the upstream Hugging Face/OpenDataLab dataset before reporting full benchmark coverage.

Evidence status availability · expected contract

Why this lane has no selected measurement

No reviewed benchmark result is selected for this subject.

Expected
Reviewed aggregate with a validation receipt
Observed
No result selected for this subject
ii

rag-mtcb

missing

MTCB

Chunking and retrieval behavior measured through the MTCB Antfly benchmark.

Methodology scope · protocol · interpretation

MTCB Antfly Benchmark

MTCB evaluates retrieval quality for chunked RAG corpora. The upstream harness chunks documents, embeds chunks and questions, retrieves top-k chunks, and scores whether the gold passage appears in the retrieved chunk set.

Antfly Surface

This adapter keeps MTCB’s evaluator and metric calculations, but replaces the in-memory vector store with Antfly external-vector retrieval:

  • one Antfly table per MTCB dataset evaluator;
  • one external aknn_v0 cosine vector index named vec;
  • chunk text is stored as table metadata and the vector is inserted in _embeddings.vec;
  • queries use /api/v1/query with embeddings.vec and the requested limit.

The adapter uses local deterministic lexical hashing embeddings by default. This keeps the benchmark self-contained and avoids depending on hosted embedding APIs. The result is therefore a benchmark of Antfly storage/index/query behavior inside MTCB’s scoring loop, not a claim about a production embedding model.

Profiles

  • smoke: one nano dataset, currently nano-macha, intended to validate adapter wiring and artifact shape.
  • nano / honed: three nano datasets, currently nano-macha, nano-sencha, and nano-hojicha, intended to produce a small but real retrieval result.

The adapter reports Recall@k, Precision@k, MRR@k, and NDCG@k for each dataset, plus mean metrics across datasets. It also recomputes mean Recall@k from the per-dataset rows and marks the run failed if the recomputed value diverges from MTCB’s BenchmarkResult.

Runtime Pin

The benchmark should be run against Antfly 0.2.0-rc.17 for the current Bastille result. The run artifact records the Antfly URL and best-effort runtime version endpoint response. The local harness can use ANTFLY_BIN to point at a specific prebuilt runtime; no Zig build should be triggered by this benchmark.

Caveats

MTCB’s public examples usually use neural embedding models such as Voyage. The current Antfly adapter deliberately uses local hashing embeddings to make the benchmark repeatable without credentials or model downloads. Before making a leaderboard-style quality claim, rerun the adapter with a documented production embedding model and compare against MTCB’s original in-memory vector store using the same chunks and embeddings.

Evidence status availability · expected contract

Why this lane has no selected measurement

No reviewed benchmark result is selected for this subject.

Expected
Reviewed aggregate with a validation receipt
Observed
No result selected for this subject
iii

rag-browsecomp-plus

missing

BrowseComp Plus

Fixed-budget native-hybrid retrieval over the BrowseComp-Plus evaluation set.

Methodology scope · protocol · interpretation

Agent Retrieval Cost harness

Measures what it actually costs an agent to answer questions over a large fixed corpus with different retrieval tooling. Quality (answer accuracy) is reported alongside cost; cost is the story: total LLM tokens, USD, wall time, and tool calls per query.

BrowseComp-Plus native-hybrid honed lane

bcp_native_hybrid/ is the publication lane for the four existing products that expose a genuinely native hybrid request: Antfly, Elasticsearch, Weaviate, and Milvus. PgVector and Chroma are excluded because their current harness paths are dense-only; adding those paths would change the retrieval contract. The separate lexical/TREC adapter is diagnostic and is not consumed by the publication page.

The checked bcp_native_hybrid/panel.json freezes 50 seed-17 development queries and their disjoint 780-query complement. The development panel is used only to warm memory lifecycles. Luna, through pinned pi 0.73.1, answers every held-out query against every backend: 3,120 evaluated query cells. Each cell uses the official Qwen3-Embedding-8B vectors and query prefix, the upstream QUERY_TEMPLATE_NO_GET_DOCUMENT, one search(query) tool, top five results, 512 Qwen3-0.6B snippet tokens, and the checked turn/token ceilings. Harbor supervises the Luna process without adding shell, filesystem, browser, or document-fetch tools.

Query publication evidence is resumed one backend/query cell at a time through the generic Circus publication cache. An exact hit includes the normalized trajectory, raw pi trajectory and stderr, Luna final record, Harbor result, complete Qwen3-32B judgement, original timestamps, and receipt. Corpus, vector, prompt, client, model, judge, backend, and Antfly-subject identities are part of the key. Incorrect answers and complete no-search outcomes are measured evidence; no-search always forces protocol correctness false. Crashes, partial trajectories, missing or unparseable judgements, and setup failures never hit. Database volumes, indexes, downloads, and memory measurements are never cached. First qualifying cache evidence wins under the generic cache policy. Fresh promotion also requires the operator’s explicit CIRCUS_QUIET_HOST_READY=1 assertion, retained as quiet-host.json.

The checked four-shard Latin-square schedule gives each backend every execution position once while still running all 780 held-out queries per backend. Only one backend stack is resident at a time. Every backend also receives exactly three deliberately fresh cgroup-v2 whole-stack memory lifecycles. Sampling starts before launch and covers prelaunch, service-launch, ingest, readiness, warm-query, and post-warm-idle. Publication memory is the warm-query anon + shmem peak mean and range; lifecycle demand, memory.current, kernel peaks, disk, events, images, logs, and raw timelines remain retained diagnostics. Swap, failed samples, incomplete phases, reused storage, or fewer than three trials rejects the report.

The report publishes per-backend correct count, accuracy with Wilson 95% interval, evidence recall, search/input/total-token distributions, completion, zero-search, and cached/fresh counts. Antfly-minus-peer paired accuracy and evidence-recall differences use the named paired-score mean ± 1.959963984540054 standard-error interval. These intervals are descriptive; no comparative acceptance threshold or automatic editorial selection is applied. Agent and judge wall time is network-bound diagnostic telemetry, not a latency claim.

From the repository root:

make browsecomp-native-hybrid-prepare
make browsecomp-native-hybrid-smoke
make browsecomp-native-hybrid-honed
make browsecomp-native-hybrid-report

The honed command writes strict summary.json, summary.md, detailed.json, raw runs/evals, cache references, memory timelines, and receipt.json to $BASTILLE_OUT/data/rag-browsecomp-plus/.

Design: trust through off-the-shelf parts

  • Agent: pi, an independent off-the-shelf coding agent (tools: read/write/edit/bash), run headless.
  • Orchestration: Harbor (the Terminal-Bench 2.0 harness, pinned version in the root Makefile) using Harbor’s first-party pi agent adapter (harbor run -a pi).
  • Antfly authors only the environments and the report. There is no bespoke agent loop; per-query tokens and USD cost come from pi’s own session accounting (message_end usage events in /logs/agent/pi.txt), parsed the same way Harbor itself does, not from our instrumentation.

One Harbor task per (tooling x question); one pi session per question; session totals are the per-query metrics.

Dataset

BrowseComp-Plus (Tevatron/browsecomp-plus): 100,195-document corpus, 830 queries with gold answers, cached at .data/browsecomp-plus/ by the BrowseComp-Plus harness. Questions are deliberately hard deep-research puzzles; absolute accuracy is expected to be low for every tooling. v1 applies no quality bar — accuracy is reported next to cost.

Fairness rules

  • Same questions for every tooling: one seed-17 pool of 200 query ids, sampled once; every run size is a prefix (probe 10 ⊂ default 50 ⊂ publish 200).
  • Same corpus surface: identical document text, capped at ARC_DOC_CHARS (default 20,000 chars/doc), in every store.
  • Same agent, same model (default openai-codex/gpt-5.6-luna, run on a ChatGPT subscription), same instruction contract; only the tooling cheat-sheet section differs.
  • Setup is performed by the harness, deterministically, before agent runs; setup wall time is reported in its own table and never billed to per-query cost. (Agent-performed setup is the separate agent-effort suite.)
  • The judge (default openai/gpt-4.1, same prompt as the BrowseComp-Plus answer eval) grades answers offline; judge spend is reported separately and never added to a row’s cost. Failed/unanswered queries count as incorrect.
  • Egress is audited, not firewalled: pi needs openrouter.ai, so containers have network access. The instruction forbids internet use, pi has no web tool, and the harvester scans every bash tool call for non-local hosts and flags suspect_egress per record (surfaced in the run-health table). A proxy allowlist is future work.

Toolings

RowSurface in the container
grepraw corpus as 100 JSONL shards at /corpus/, ripgrep installed
sqliteprebuilt FTS5 database at /corpus/corpus.fts5.db, sqlite3 CLI
antflyHTTP endpoint (host make start-zig, port 28080), BM25 full-text table
elasticsearchHTTP endpoint (elasticsearch_bench container), BM25 index
pgvector / milvus / weaviate / chromavector search over shared bge-small-en-v1.5 embeddings + a query-time embed endpoint (phase 3)

Running

Everything is driven from the repo root Makefile:

make agent-retrieval-cost-setup    # venv + harbor patch + base images + ingest (timed)
make agent-retrieval-cost-smoke    # free, offline: templates + parser fixture + report
make agent-retrieval-cost-probe    # paid: 10 questions x grep,sqlite,antfly
make agent-retrieval-cost-honed    # paid: ARC_SAMPLE (50) x ARC_TOOLINGS
make agent-retrieval-cost-judge    # paid: offline judge pass over harvested records
make agent-retrieval-cost-report   # free: agent-summary.json + summary.md

Knobs: ARC_MODEL, ARC_JUDGE_MODEL, ARC_SAMPLE, ARC_TOOLINGS, ARC_CONCURRENCY, ARC_ROW_CONCURRENCY, ARC_DOC_CHARS, ARC_AGENT_TIMEOUT (uniform per-task agent timeout, default 1800 s — the same for every tooling so wall/cost comparisons stay fair), ARC_RUN_ID. The OpenRouter key (used by the offline judge) is read from the process environment, the legacy agent_retrieval_cost.env, or pi’s private ~/.pi/agent/auth.json. The key is never copied into the repository.

Full 830-question checkpointed run

The full lane uses the seven validated surfaces (grep, sqlite, antfly, elasticsearch, pgvector, chroma, and antfly_hybrid) and the pinned v0.2.0-rc.20 ReleaseFast subject manifest. It is cohort-driven: 33 cohorts contain 25 questions and the final cohort contains five. Every cohort is paired across all seven rows, and one command invocation runs at most one cohort.

make agent-retrieval-cost-full-prepare  # dataset, stores, immutable manifest
make agent-retrieval-cost-full-canary   # one question x seven rows
make agent-retrieval-cost-full-next     # one 25-question paired cohort
make agent-retrieval-cost-full-drain    # repeat cohorts; stop on first safety pause
make agent-retrieval-cost-full-status   # no model calls

full-drain is only a checkpoint supervisor: it invokes the same one-cohort lane repeatedly, reruns every preflight before advancing, and exits immediately if an attempt is paused or fails. It does not weaken the per-cohort cost, auth, disk, service, or retry protections.

full-run-manifest.json freezes question order, cohort boundaries, models, toolings, and subject hashes. full-run-ledger.json records immutable attempts. Harvest merges by (tooling, query_id), refuses to overwrite a final cell, and only replaces explicit authentication, rate-limit, or infrastructure failures. Completed cells therefore survive an outage and are skipped on resume.

The preflight requires all stores to report 100,195 indexed documents, a ready and fully query-visible Antfly vector index, at least 30 GB free, and at least two hours of OAuth validity. It warns at $550 and refuses to launch a new cohort at $650 of API-equivalent Luna usage. The incremental OpenRouter judge has a separate $5 actual-spend hard cap. Subscription agent spend remains $0 incremental; equivalent cost is an analysis yardstick, not a cash charge.

Partial reports contain only fully paired questions. Reports include the accuracy-vs-budget curve with bootstrap intervals, a cost-vs-quality scatter/Pareto chart, cost per correct answer, payload volume, command errors, and evidence-to-first-hit diagnostics. Raw de-obfuscated questions and document content remain local and must not be pasted into public summaries.

Rows run through a bounded scheduler. The default is two Harbor rows in parallel (ARC_ROW_CONCURRENCY=2), with four concurrent trials in each row (ARC_CONCURRENCY=4): at most eight subscription agents at once. The 50×7 RF335 run’s observed row durations project to roughly 95 minutes of inference at this setting instead of 172 minutes sequentially. Parallel rows share host resources, so wall-time comparisons should be treated as contention-sensitive; token, cost, and accuracy metrics remain per isolated trial. Set ARC_ROW_CONCURRENCY=1 to reproduce the old sequential schedule.

Model auth

The agent model defaults to openai-codex/gpt-5.6-luna — GPT-5.6 Luna run on a ChatGPT Plus/Pro subscription via pi’s Codex OAuth provider. One-time setup: run pi interactively, /login, and pick “ChatGPT Plus/Pro (Codex)” to complete the browser OAuth. That writes ~/.pi/agent/auth.json, which the harness bind-mounts read-only into every trial container (--mounts). The run preflight refuses to start if that file is empty.

Because a subscription is flat-rate, pi reports token counts but $0 cost, so $/query is computed from token counts at published Luna rates ($1/$6/$0.10 per 1M in/out/cached-read) and each record is tagged cost_source: price_table_estimate. See arc/pricing.py. Pass a different ARC_MODEL (e.g. openai/gpt-5.6-luna with OPENAI_API_KEY, or openrouter/...) to use real per-token billing instead; pi’s own cost_usd is then used and tagged pi_usage.

Note: Codex OAuth access tokens expire in hours. For long matrix runs, log in (or refresh) shortly before starting; the read-only mount can’t refresh mid-run.

Outputs

Under $BASTILLE_OUT/data/agent-retrieval-cost/:

  • <tooling>/records.jsonl — one record per (tooling, query): status, answer, gold, tokens {input, output, cache_read, cache_write, total}, cost_usd (pi’s own accounting), wall_seconds (first-to-last session event; excludes image build and pi install), tool_calls, suspect_egress, judge verdict.
  • agent-summary.json, setup-summary.json, judge-summary.json, summary.md (per-query means, setup table, cumulative cost, run health).

Caveats

  • Wall/query depends on host load and provider latency at run time; treat it as indicative, not a latency benchmark.
  • Timed-out and provider-errored trials (e.g. OpenRouter routes occasionally return content_filter mid-run) count as incorrect and stay in the denominator; the run-health table reports them per row.
  • pi is installed per trial by Harbor’s adapter (npm install -g ...@latest); the base image pre-installs node+pi so this is fast, but pi’s version floats with the run date and is recorded in /etc/arc-pi-version in the image.
  • Harbor’s old upload_dir docker-cp bug (verifier tests landing at /tests/tests/) is fixed upstream in the pinned version; patches/apply_harbor_upload_dir_patch.py verifies this and can patch the legacy layout if the pin ever moves backwards.
  • Vector rows share one embedding model and code path (ingest == query-time); engines’ native embedding pipelines are intentionally not used.
Evidence status availability · expected contract

Why this lane has no selected measurement

No reviewed benchmark result is selected for this subject.

Expected
Reviewed aggregate with a validation receipt
Observed
No result selected for this subject
iv

agent-retrieval-cost

missing

Agent retrieval cost

Retrieval quality and resource cost for agent-oriented search workflows.

Methodology scope · protocol · interpretation

Agent Retrieval Cost harness

Measures what it actually costs an agent to answer questions over a large fixed corpus with different retrieval tooling. Quality (answer accuracy) is reported alongside cost; cost is the story: total LLM tokens, USD, wall time, and tool calls per query.

BrowseComp-Plus native-hybrid honed lane

bcp_native_hybrid/ is the publication lane for the four existing products that expose a genuinely native hybrid request: Antfly, Elasticsearch, Weaviate, and Milvus. PgVector and Chroma are excluded because their current harness paths are dense-only; adding those paths would change the retrieval contract. The separate lexical/TREC adapter is diagnostic and is not consumed by the publication page.

The checked bcp_native_hybrid/panel.json freezes 50 seed-17 development queries and their disjoint 780-query complement. The development panel is used only to warm memory lifecycles. Luna, through pinned pi 0.73.1, answers every held-out query against every backend: 3,120 evaluated query cells. Each cell uses the official Qwen3-Embedding-8B vectors and query prefix, the upstream QUERY_TEMPLATE_NO_GET_DOCUMENT, one search(query) tool, top five results, 512 Qwen3-0.6B snippet tokens, and the checked turn/token ceilings. Harbor supervises the Luna process without adding shell, filesystem, browser, or document-fetch tools.

Query publication evidence is resumed one backend/query cell at a time through the generic Circus publication cache. An exact hit includes the normalized trajectory, raw pi trajectory and stderr, Luna final record, Harbor result, complete Qwen3-32B judgement, original timestamps, and receipt. Corpus, vector, prompt, client, model, judge, backend, and Antfly-subject identities are part of the key. Incorrect answers and complete no-search outcomes are measured evidence; no-search always forces protocol correctness false. Crashes, partial trajectories, missing or unparseable judgements, and setup failures never hit. Database volumes, indexes, downloads, and memory measurements are never cached. First qualifying cache evidence wins under the generic cache policy. Fresh promotion also requires the operator’s explicit CIRCUS_QUIET_HOST_READY=1 assertion, retained as quiet-host.json.

The checked four-shard Latin-square schedule gives each backend every execution position once while still running all 780 held-out queries per backend. Only one backend stack is resident at a time. Every backend also receives exactly three deliberately fresh cgroup-v2 whole-stack memory lifecycles. Sampling starts before launch and covers prelaunch, service-launch, ingest, readiness, warm-query, and post-warm-idle. Publication memory is the warm-query anon + shmem peak mean and range; lifecycle demand, memory.current, kernel peaks, disk, events, images, logs, and raw timelines remain retained diagnostics. Swap, failed samples, incomplete phases, reused storage, or fewer than three trials rejects the report.

The report publishes per-backend correct count, accuracy with Wilson 95% interval, evidence recall, search/input/total-token distributions, completion, zero-search, and cached/fresh counts. Antfly-minus-peer paired accuracy and evidence-recall differences use the named paired-score mean ± 1.959963984540054 standard-error interval. These intervals are descriptive; no comparative acceptance threshold or automatic editorial selection is applied. Agent and judge wall time is network-bound diagnostic telemetry, not a latency claim.

From the repository root:

make browsecomp-native-hybrid-prepare
make browsecomp-native-hybrid-smoke
make browsecomp-native-hybrid-honed
make browsecomp-native-hybrid-report

The honed command writes strict summary.json, summary.md, detailed.json, raw runs/evals, cache references, memory timelines, and receipt.json to $BASTILLE_OUT/data/rag-browsecomp-plus/.

Design: trust through off-the-shelf parts

  • Agent: pi, an independent off-the-shelf coding agent (tools: read/write/edit/bash), run headless.
  • Orchestration: Harbor (the Terminal-Bench 2.0 harness, pinned version in the root Makefile) using Harbor’s first-party pi agent adapter (harbor run -a pi).
  • Antfly authors only the environments and the report. There is no bespoke agent loop; per-query tokens and USD cost come from pi’s own session accounting (message_end usage events in /logs/agent/pi.txt), parsed the same way Harbor itself does, not from our instrumentation.

One Harbor task per (tooling x question); one pi session per question; session totals are the per-query metrics.

Dataset

BrowseComp-Plus (Tevatron/browsecomp-plus): 100,195-document corpus, 830 queries with gold answers, cached at .data/browsecomp-plus/ by the BrowseComp-Plus harness. Questions are deliberately hard deep-research puzzles; absolute accuracy is expected to be low for every tooling. v1 applies no quality bar — accuracy is reported next to cost.

Fairness rules

  • Same questions for every tooling: one seed-17 pool of 200 query ids, sampled once; every run size is a prefix (probe 10 ⊂ default 50 ⊂ publish 200).
  • Same corpus surface: identical document text, capped at ARC_DOC_CHARS (default 20,000 chars/doc), in every store.
  • Same agent, same model (default openai-codex/gpt-5.6-luna, run on a ChatGPT subscription), same instruction contract; only the tooling cheat-sheet section differs.
  • Setup is performed by the harness, deterministically, before agent runs; setup wall time is reported in its own table and never billed to per-query cost. (Agent-performed setup is the separate agent-effort suite.)
  • The judge (default openai/gpt-4.1, same prompt as the BrowseComp-Plus answer eval) grades answers offline; judge spend is reported separately and never added to a row’s cost. Failed/unanswered queries count as incorrect.
  • Egress is audited, not firewalled: pi needs openrouter.ai, so containers have network access. The instruction forbids internet use, pi has no web tool, and the harvester scans every bash tool call for non-local hosts and flags suspect_egress per record (surfaced in the run-health table). A proxy allowlist is future work.

Toolings

RowSurface in the container
grepraw corpus as 100 JSONL shards at /corpus/, ripgrep installed
sqliteprebuilt FTS5 database at /corpus/corpus.fts5.db, sqlite3 CLI
antflyHTTP endpoint (host make start-zig, port 28080), BM25 full-text table
elasticsearchHTTP endpoint (elasticsearch_bench container), BM25 index
pgvector / milvus / weaviate / chromavector search over shared bge-small-en-v1.5 embeddings + a query-time embed endpoint (phase 3)

Running

Everything is driven from the repo root Makefile:

make agent-retrieval-cost-setup    # venv + harbor patch + base images + ingest (timed)
make agent-retrieval-cost-smoke    # free, offline: templates + parser fixture + report
make agent-retrieval-cost-probe    # paid: 10 questions x grep,sqlite,antfly
make agent-retrieval-cost-honed    # paid: ARC_SAMPLE (50) x ARC_TOOLINGS
make agent-retrieval-cost-judge    # paid: offline judge pass over harvested records
make agent-retrieval-cost-report   # free: agent-summary.json + summary.md

Knobs: ARC_MODEL, ARC_JUDGE_MODEL, ARC_SAMPLE, ARC_TOOLINGS, ARC_CONCURRENCY, ARC_ROW_CONCURRENCY, ARC_DOC_CHARS, ARC_AGENT_TIMEOUT (uniform per-task agent timeout, default 1800 s — the same for every tooling so wall/cost comparisons stay fair), ARC_RUN_ID. The OpenRouter key (used by the offline judge) is read from the process environment, the legacy agent_retrieval_cost.env, or pi’s private ~/.pi/agent/auth.json. The key is never copied into the repository.

Full 830-question checkpointed run

The full lane uses the seven validated surfaces (grep, sqlite, antfly, elasticsearch, pgvector, chroma, and antfly_hybrid) and the pinned v0.2.0-rc.20 ReleaseFast subject manifest. It is cohort-driven: 33 cohorts contain 25 questions and the final cohort contains five. Every cohort is paired across all seven rows, and one command invocation runs at most one cohort.

make agent-retrieval-cost-full-prepare  # dataset, stores, immutable manifest
make agent-retrieval-cost-full-canary   # one question x seven rows
make agent-retrieval-cost-full-next     # one 25-question paired cohort
make agent-retrieval-cost-full-drain    # repeat cohorts; stop on first safety pause
make agent-retrieval-cost-full-status   # no model calls

full-drain is only a checkpoint supervisor: it invokes the same one-cohort lane repeatedly, reruns every preflight before advancing, and exits immediately if an attempt is paused or fails. It does not weaken the per-cohort cost, auth, disk, service, or retry protections.

full-run-manifest.json freezes question order, cohort boundaries, models, toolings, and subject hashes. full-run-ledger.json records immutable attempts. Harvest merges by (tooling, query_id), refuses to overwrite a final cell, and only replaces explicit authentication, rate-limit, or infrastructure failures. Completed cells therefore survive an outage and are skipped on resume.

The preflight requires all stores to report 100,195 indexed documents, a ready and fully query-visible Antfly vector index, at least 30 GB free, and at least two hours of OAuth validity. It warns at $550 and refuses to launch a new cohort at $650 of API-equivalent Luna usage. The incremental OpenRouter judge has a separate $5 actual-spend hard cap. Subscription agent spend remains $0 incremental; equivalent cost is an analysis yardstick, not a cash charge.

Partial reports contain only fully paired questions. Reports include the accuracy-vs-budget curve with bootstrap intervals, a cost-vs-quality scatter/Pareto chart, cost per correct answer, payload volume, command errors, and evidence-to-first-hit diagnostics. Raw de-obfuscated questions and document content remain local and must not be pasted into public summaries.

Rows run through a bounded scheduler. The default is two Harbor rows in parallel (ARC_ROW_CONCURRENCY=2), with four concurrent trials in each row (ARC_CONCURRENCY=4): at most eight subscription agents at once. The 50×7 RF335 run’s observed row durations project to roughly 95 minutes of inference at this setting instead of 172 minutes sequentially. Parallel rows share host resources, so wall-time comparisons should be treated as contention-sensitive; token, cost, and accuracy metrics remain per isolated trial. Set ARC_ROW_CONCURRENCY=1 to reproduce the old sequential schedule.

Model auth

The agent model defaults to openai-codex/gpt-5.6-luna — GPT-5.6 Luna run on a ChatGPT Plus/Pro subscription via pi’s Codex OAuth provider. One-time setup: run pi interactively, /login, and pick “ChatGPT Plus/Pro (Codex)” to complete the browser OAuth. That writes ~/.pi/agent/auth.json, which the harness bind-mounts read-only into every trial container (--mounts). The run preflight refuses to start if that file is empty.

Because a subscription is flat-rate, pi reports token counts but $0 cost, so $/query is computed from token counts at published Luna rates ($1/$6/$0.10 per 1M in/out/cached-read) and each record is tagged cost_source: price_table_estimate. See arc/pricing.py. Pass a different ARC_MODEL (e.g. openai/gpt-5.6-luna with OPENAI_API_KEY, or openrouter/...) to use real per-token billing instead; pi’s own cost_usd is then used and tagged pi_usage.

Note: Codex OAuth access tokens expire in hours. For long matrix runs, log in (or refresh) shortly before starting; the read-only mount can’t refresh mid-run.

Outputs

Under $BASTILLE_OUT/data/agent-retrieval-cost/:

  • <tooling>/records.jsonl — one record per (tooling, query): status, answer, gold, tokens {input, output, cache_read, cache_write, total}, cost_usd (pi’s own accounting), wall_seconds (first-to-last session event; excludes image build and pi install), tool_calls, suspect_egress, judge verdict.
  • agent-summary.json, setup-summary.json, judge-summary.json, summary.md (per-query means, setup table, cumulative cost, run health).

Caveats

  • Wall/query depends on host load and provider latency at run time; treat it as indicative, not a latency benchmark.
  • Timed-out and provider-errored trials (e.g. OpenRouter routes occasionally return content_filter mid-run) count as incorrect and stay in the denominator; the run-health table reports them per row.
  • pi is installed per trial by Harbor’s adapter (npm install -g ...@latest); the base image pre-installs node+pi so this is fast, but pi’s version floats with the run date and is recorded in /etc/arc-pi-version in the image.
  • Harbor’s old upload_dir docker-cp bug (verifier tests landing at /tests/tests/) is fixed upstream in the pinned version; patches/apply_harbor_upload_dir_patch.py verifies this and can patch the legacy layout if the pin ever moves backwards.
  • Vector rows share one embedding model and code path (ingest == query-time); engines’ native embedding pipelines are intentionally not used.
Evidence status availability · expected contract

Why this lane has no selected measurement

No reviewed benchmark result is selected for this subject.

Expected
Reviewed aggregate with a validation receipt
Observed
No result selected for this subject
v

office-qa-pro

missing

OfficeQA Pro

Raw-document ingestion, retrieval, and question answering over the OfficeQA-Pro corpus.

Methodology scope · protocol · interpretation

OfficeQA-Pro raw-PDF benchmark

This harness measures the complete path from 697 Treasury Bulletin PDFs to an agent’s final answer. The headline comparison is ingestion complexity and cold setup time; answer accuracy and agent cost are measured on the same seeded OfficeQA-Pro questions after each index is ready.

The default matrix is 133 questions per row with seed 17:

RowSourceExtraction and retrieval
antfly_native_hybridRaw PDFsAntfly PDF extraction/OCR, chunking, embedding, lexical + vector index
docling_pgvectorRaw PDFsDocling standard OCR + accurate tables, BGE chunks/embeddings, pgvector HNSW
docling_elasticsearchRaw PDFsThe same Docling chunks, Elasticsearch BM25
docling_sqliteRaw PDFsThe same Docling chunks, SQLite FTS5
oracle_pgvectorPublisher transformed textClearly labeled extraction ceiling, BGE + pgvector HNSW

The three Docling rows share one extraction pass. The oracle files never enter a raw-PDF row. Questions given to agents contain neither source_files hints nor gold answers.

Prerequisites

  • Docker, uv, Go, and enough disk for the 4 GB corpus plus derived indexes.
  • Hugging Face access accepted for the gated databricks/officeqa dataset and HF_TOKEN exported for the explicit download step.
  • pi logged into ChatGPT (pi, then /login) for the default openai-codex/gpt-5.6-luna agent.
  • A ReleaseFast Antfly binary. Override the suite default with ANTFLY_BIN=/absolute/path/to/antfly.

The Antfly qualification deliberately includes one scanned and one born-digital PDF. Run it before committing to the corpus-wide ingest. Current Antfly source needs to render the requested PDF page to PNG before sending it to the local Florence reader; passing the PDF URL directly is not supported by that reader. docsaf sync --help also needs to show the --ocr* options.

Only rebuild Antfly after checking those help texts and qualifying the binary. On this machine a full Zig build may run out of memory, so warn and get explicit approval first, then constrain parallelism:

cd /path/to/antfly/zig
zig build lib-pdf-test -j1
zig build lib-db-test -j1 -- --test-filter 'document OCR media parts'
zig build install -Dedition=full -Doptimize=ReleaseFast -j1

Run sequence

make targets live at the antfly-circus repository root.

make office-qa-pro-smoke
make office-qa-pro-setup
make office-qa-pro-download

# Before the large ingest:
ANTFLY_BIN=/path/to/antfly make office-qa-pro-qualify-antfly

# Paid 10-question, three-row end-to-end probe:
ANTFLY_BIN=/path/to/antfly make office-qa-pro-probe

# Paid Pro-133, five-row matrix:
ANTFLY_BIN=/path/to/antfly make office-qa-pro-honed

office-qa-pro-honed refuses to download data implicitly. It starts only the services selected by OQA_TOOLINGS, performs a cold setup, generates identical seeded tasks, runs Harbor/pi at OQA_CONCURRENCY=4, harvests, deterministically scores, and writes the report. Useful overrides include:

make office-qa-pro-honed \
  OQA_SAMPLE=20 \
  OQA_TOOLINGS=docling_pgvector,docling_sqlite \
  OQA_CONCURRENCY=2

Measurement and scoring

Downloads and model-cache warmup are excluded from setup timing. Setup begins with local source files and cached models; each recorded stage and total wall time is written to setup-summary.json. The raw-PDF rows include extraction, OCR, chunking, embedding where applicable, and indexing.

The scorer is reward.py pinned to OfficeQA commit 86753108d69e149cc28abd346bb8c3ca1cbfc7cf. It is applied to the final answer and every running best guess at exact, 0.1%, 1%, and 5% relative tolerance. The primary metric is accuracy at 1%; no LLM judge is used.

Agent accounting is inherited from the ARC harness: input/cache/output tokens, price-table-equivalent USD, wall time, tool calls, answer trajectory, and cost to the first answer that remains correct. Results land under results/benchmark-page/manual/data/office-qa-pro/ by default.

Planning estimate

The full default run is 665 trials (133 questions × 5 rows). Existing local ARC Luna trials average about $0.42 price-table-equivalent and 138 seconds of total trial wall time. That gives a lower-bound query phase of roughly $280 and 6.4 hours at concurrency four. OfficeQA is likely to require longer investigation, so budget approximately $300–$600 equivalent and 7–12 hours for agent trials. The default model uses a ChatGPT subscription, so this is benchmark accounting, not necessarily an incremental API invoice, but it will consume subscription capacity.

The larger uncertainty is cold ingestion of about 89,000 PDF pages with CPU/local ML OCR. Until the two-PDF qualification and a small corpus timing are measured, allow roughly 2–6 elapsed days end to end, of which most is Antfly and Docling extraction/OCR. The 10-question probe should be used to replace this range with measured throughput before launching Pro-133.

Evidence status availability · expected contract

Why this lane has no selected measurement

No reviewed benchmark result is selected for this subject.

Expected
Reviewed aggregate with a validation receipt
Observed
No result selected for this subject
VIII

1 of 1 lane measured

End-to-end

Agent-facing product activation and first retrieval from clean interactive Pi sessions.

i

quickstart-first-retrieval

partial

Quickstart

11 database-version rows retain every recording. Median time summarizes observed retrievals; validation reports which sessions completed cleanly.

DatabaseVersionMedian timeValidationSessions
Antflyv0.1.3228.554 spassed
Antflyv0.2.0228.262 spassed
Antflyv0.2.1-rc1111.846 spassed
Chromav1.5.979.072 spassed
Elasticsearchv9.5.2445.708 spassed
Memgraphv3.12.067.161 spassed
Milvus Litev3.0.1198.412 spassed
Neo4jv2026.07.160.369 spassed
Quickwitv0.9.061.978 spassed
Weaviatev1.39.2228.033 spassed
Antflyv0.2.132.093 spartial · 2/3 valid
Methodology Timing · grouping · validation

Timing boundary

Time to first retrieval runs from PTY capture start through the first successful qualifying search result observed in the Pi session. Acquisition, installation, setup, retries, and agent reasoning all contribute to elapsed time.

Grouping and median

Each row groups retained sessions by database and exact observed version. The median includes every observed qualifying retrieval, including a retrieval followed by failed post-session verification. Validation remains separate. Models and task boundaries can differ between cohorts; these rows are not controlled product-speed comparisons.

Protocol history

Historical Antfly recordings use protocol 3 and its qualifying retrieval command. New natural recordings use protocol 4 passive Pi result correlation, without an agent-visible marker. Container-dependent sessions substitute rootless Podman for Docker and retain that runtime choice in provenance. Numbered session links preserve the full trajectory and protocol evidence behind every row.

Container boundary

Container-dependent sessions use an operator-approved rootless Podman host-user API. Bubblewrap limits the agent shell but does not constrain bind mounts requested through that API. The runner snapshots preexisting Podman resources, restricts verification to containers created by the attempt, removes attempt-owned resources afterward, scans published transcripts for credentials, and records the socket scope in provenance.

Validation states

Passed
Every included session produced a qualifying retrieval and passed its retained verifier.
Partial
At least one included session passed while another lacked complete valid evidence.
Failed
Included sessions completed without a qualifying verified retrieval.
Unverified
Retained evidence lacks a terminal verifier result.

Three fresh sequential v0.2.1 sessions used OpenRouter GLM-5.3 Flash with high thinking, host CPUs, and an explicit hello/first stopping objective. All three produced the expected retrieval; two passed post-session verification. Trial 2 shut down Antfly afterward, causing ConnectionRefused. Median includes all three observed retrievals, not just verified sessions. Release and prompt differ from earlier cohorts; this is not an isolated product speed comparison. Model installation, semantic search and RAG were not exercised.