diff --git a/benchmark/results/2026-11-04-followup/README.md b/benchmark/results/2026-11-04-followup/README.md index 2183fe4..a855e7d 100644 --- a/benchmark/results/2026-11-04-followup/README.md +++ b/benchmark/results/2026-11-04-followup/README.md @@ -1,106 +1,184 @@ # Benchmark continuation — 4 November 2026 -## Published checkpoint - -This follows the original benchmark report in `../2026-11-04-null/README.md`. -The original measurements and source remain intact. The production label-membership -experiment remains separate from the benchmark foundation. - -The retained-binary comparison reproduces the conservative no-text slowdown: -**all eight paired runs are slower, with a +5.45% median paired change**. -The identical-binary control has a +0.71% median change on that workload, with -mixed signs. This supports investigating a difference between these particular -binaries; it does not identify the cause or qualify the production experiment. - -The stable no-text identical-binary comparison has a +5.72% median change, -showing that small changes in this very short workload are unresolved on this host. -No general speedup is inferred from those timings. - -## Fixed initial experiment - -Before running, `initial-plan.json` specified eight alternating A/B and B/A pairs, -100 warmup frames and 1,000 measured frames per process, CPU 8 affinity, explicit -QRhi Null, and reduced internal profiling. There were 32 A/A and 48 A/B processes. -All 80 invocations completed and passed the existing workload-v2 validator. -No repetitions were discarded or added after seeing the outcome. - -The A/A labels refer to the same baseline executable; they do not represent -changed code. Mean columns below are medians of per-process means. Changes are -medians of within-pair percentages; min–max is descriptive spread, not a confidence -interval. Positive means more time. IQRs, per-process metrics and exact order are -retained in `measurements.json`. - -| Experiment | Case | Baseline mean ms | Candidate mean ms | Paired change | Paired min–max | Slower pairs | -|---|---|---:|---:|---:|---:|---:| -| retained-aa | `warm-line-8-conservative-no-text` | 2.6358 | 2.6464 | +0.71% | -2.20 to +8.47% | 5/8 | -| retained-aa | `warm-line-8-no-text` | 0.0111 | 0.0117 | +5.72% | -2.18 to +21.36% | 5/8 | -| retained-ab | `warm-line-8-conservative` | 2.7276 | 2.9174 | +7.25% | -13.17 to +16.16% | 7/8 | -| retained-ab | `warm-line-8-conservative-no-text` | 2.7849 | 2.8971 | +5.45% | +0.49 to +17.45% | 8/8 | -| retained-ab | `warm-line-8-no-text` | 0.0115 | 0.0109 | -2.36% | -14.40 to +0.16% | 1/8 | - -The conservative text case retains the exact allocation reduction, 206 to 168 -allocations/frame. Both conservative no-text variants retain 130 allocations/frame; -both stable no-text variants retain 114. Timing and allocation conclusions are -kept separate. - -## Inputs and measurement boundary - -- Baseline executable SHA-256: `a421c9d8832519110d6bc0eb2253916798eef0d30512f5359f46673c51f29f5d`. -- Candidate executable SHA-256: `77cfcf554e536ae0adfb4575ae8e7cf89623aa13fa99003e7df5088b96b21c9d`. -- Original compiled revisions: baseline `88d459dbbad9cff1a292b3ffa87be97970d371e6`, candidate `70638b6e65103b657daaa16e00bcea7fe8daf800`. -- Runner: foundation revision `a15293f39b52bbee54e129d59e6739e74a2970e6`. -- Qt 6.12, GCC 13.3 Release, original dependencies and settings; executable hashes - were checked before use. Owned dependency default heads still match the retained - inputs when checked at continuation start. - -These are QRhi Null CPU-preparation wall times and render-thread C++ allocation -traffic. They do not establish hardware GPU cost, application FPS, presentation -latency or pixel equivalence. The short settled control is particularly sensitive -to observed host variation. Internal profiling is reduced, not zero-overhead. - -## Concrete benchmark defect found - -The workload-v2 `--frame-timing-only` path still emits `renderer.frame.finish`, -reads the preparation profiler through its mutex, and stores submission/finish -observations before capturing the total-frame timestamp. This violates the stated -absence of internal renderer scopes and includes avoidable measurement bookkeeping -inside the frame total. Existing tests check only the exact `renderer.frame` scope -and miss the finish scope. - -A bounded benchmark-only correction is being prepared: guard the remaining -internal profiler work, record durations locally, stop the timing/allocation -boundary before storing observations, and reject every `renderer.` scope or -observation in frame-only validation. The workload contract will advance to v3, -so v2 and v3 timings cannot silently be mixed. The v2 evidence above remains -historical and is not relabeled after the correction. - -This bookkeeping discrepancy is far too small to explain the millisecond-scale -conservative slowdown. It is an independent measurement-quality issue. - -## Native-rendering limit - -One fresh SDK Xvfb startup attempt exited 1 because local/unix sockets could not -be opened. A minimal AF_UNIX capability check returned EPERM. The display process -is finished. The previous EGL and Vulkan platform-initialization limitations remain -recorded; no permission or syscall workaround was attempted. - -The maintained `FontRendererDrawRanges` and `SampleUploadReuse` raster/readback -gates still require a supported native display. They have not passed in this -continuation. Null is not substituted into those raster gates. - -## Next bounded diagnostic - -Read-only disassembly inspection finds the same range-scan, sample-reader, -callback and frame-renderer instructions after relocation normalization, at -different code addresses. The additional label-state flag fits the existing map -node allocation size. The changed label algorithm is skipped with text disabled. -This supports code placement as a hypothesis, not a proven cache mechanism. - -One diagnostic executable will contain both exact label implementations, selected -before measured work. Keeping a single executable holds code placement constant -while varying the label algorithm. The no-text control must not consult the switch. -Its source and switch will remain diagnostic-only. The corrected benchmark harness -will be used on both modes; source, binary and mode identities will be retained. - -The production experiment remains unpromoted while this question and native -rendering qualification are open. +## Outcome + +This continuation fixes the frame-only measurement boundary and completes **144 additional measured processes**. The original evidence remains in [the first report](../2026-11-04-null/README.md). All new process-level results, plans, paired summaries and source identities are in [measurements.json](measurements.json). The accompanying follow-up archive contains full raw reports, commands, phase traces, assembly analysis and validation logs. + +The label-membership experiment consistently removes **38 render-thread C++ allocations and 896 requested bytes per frame** in the measured text workloads. Timing does not establish a general speedup. The retained two-binary comparison reproduces a conservative no-text slowdown, whereas the same-executable diagnostic does not show a consistent penalty on that control. This narrows the investigation without identifying a hardware-level cause. + +The benchmark correction is on [PR #30](https://github.com/Varinomics/vnm_plot/pull/30). The production optimization remains separate. The diagnostic dispatch exists only on a reproduction branch; it is not a proposed production setting. Native raster qualification remains outstanding. + +## Measurement correction: workload contract v3 + +The old `--frame-timing-only` path still created `renderer.frame.finish`, read the preparation profiler through its mutex, and recorded submission/finish observations before stopping the frame timer. Its cold preparation observation also reported zero when internal profiling was disabled. Existing validation rejected only the exact `renderer.frame` scope and missed the finish scope. + +The corrected benchmark now: + +- Uses the snapshot's disabled profiler for the finish scope and skips the internal preparation query when profiling is off. +- Holds submission and finish durations in local variables, then records observations after the frame timestamp and allocation boundary have ended. +- Omits unavailable cold preparation timing instead of reporting a synthetic zero. +- Rejects every `renderer.*` scope or observation, internal planning timing and internal cold preparation timing in a frame-only report. +- Requires workload contract **3**, with tests rejecting historical contract 2. + +Optional pixel readback and pixel validation retain their previous position inside the measurement boundary. They were disabled in these timing campaigns. Diagnostic profiling remains available as a separate mode. Frame-only measurement still has clock and allocation-observer overhead. + +The new validator rejects the original retained raw finish scope and, independently, the unavailable cold preparation metric. The archive preserves both reproductions. The correction addresses the measurement contract; no isolated measurement attributes the original two-binary slowdown to this bookkeeping defect. + +**Historical v2 and corrected v3 timings must not be directly compared.** Both variants in each new diagnostic campaign use exactly the same corrected harness. + +## Fixed experiments and interpretation + +Two plans were recorded before their respective campaigns. Each case uses eight pairs of fresh processes, alternating A/B and B/A order, CPU 8 affinity, explicit QRhi Null and frame-only timing. No measured repetition was discarded or added after inspecting its outcome. + +| Campaign | Comparison | Cases | Warmup / measured frames per process | Processes | Contract | +|---|---|---:|---:|---:|---:| +| `retained-aa` | Original baseline executable against itself | 2 | 100 / 1,000 | 32 | 2 | +| `retained-ab` | Original baseline and candidate executables | 3 | 100 / 1,000 | 48 | 2 | +| `same-image-aa` | One diagnostic executable, original algorithm in both variants | 1 | 20,000 / 50,000 | 16 | 3 | +| `same-image-ab-settled` | One diagnostic executable, original versus candidate algorithm | 1 | 20,000 / 50,000 | 16 | 3 | +| `same-image-ab-conservative` | Same executable and algorithm selection, text and no-text controls | 2 | 100 / 1,000 | 32 | 3 | + +Mean columns below are medians of per-process means. Percentage changes are medians of **within-pair** percentages, not ratios of the displayed medians. Positive means more time. Ranges and IQRs describe observed variation; they are not confidence intervals. Each fresh process is the replicate. Frames are not pooled as independent replicates, and no significance threshold was selected after viewing results. + +Per-process means, counts, minima and maxima include all measured observations. The existing deterministic reservoir retains up to 8,192 samples per metric for percentiles. Thus the 50,000-frame runs' p95 values are reservoir estimates. Full paired p95 results and IQRs remain in `measurements.json`. + +These are offscreen CPU-preparation-path wall times, including QRhi completion with `--finish`, and observed render-thread C++ allocation traffic. They do not measure hardware GPU throughput, application FPS, presentation latency or pixel equivalence. Allocation observations exclude malloc-only traffic and other threads. Synthetic producer input generation is outside the render timer and reported separately. + +## Retained binaries: the original penalty reproduces + +| Case and comparison | Baseline mean ms | Candidate mean ms | Paired change | Paired min–max | Slower pairs | +|---|---:|---:|---:|---:|---:| +| A/A conservative, no text | 2.6358 | 2.6464 | +0.71% | -2.20 to +8.47% | 5/8 | +| A/A stable, no text | 0.0111 | 0.0117 | +5.72% | -2.18 to +21.36% | 5/8 | +| A/B conservative, text | 2.7276 | 2.9174 | +7.25% | -13.17 to +16.16% | 7/8 | +| A/B conservative, no text | 2.7849 | 2.8971 | **+5.45%** | +0.49 to +17.45% | **8/8** | +| A/B stable, no text | 0.0115 | 0.0109 | -2.36% | -14.40 to +0.16% | 1/8 | + +The conservative no-text penalty occurs in all eight pairs despite balanced process order. The same-baseline-executable control has mixed signs and a much smaller median on that workload. A simple assumption that the second process is always slower does not explain this observation. + +The roughly 11-microsecond stable no-text A/A control varies substantially in relative terms. This motivated longer measurement and warmup windows for the settled-text same-executable diagnostic. The two A/A workloads are different; their percentage ranges are not interchangeable noise estimates. + +The retained conservative text case still has exactly 206 versus 168 allocations per frame. Conservative no-text remains 130 in both binaries; stable no-text remains 114 in both. Allocation and timing evidence support different levels of certainty. + +## One executable: algorithm comparison and controls + +The diagnostic executable contains both original helper definitions, copied exactly apart from their function names. A cached environment selection is initialized on the first text-helper call during warmup. Mode `0` selects the original temporary set; mode `1` selects the state flag. A single stderr marker records the actual selection. With text disabled, the helper never reads the switch and emits no marker. + +All 64 diagnostic processes use the same executable path and SHA-256. Text runs have the expected marker, no-text runs have none, and source and mode identities are retained. Both modes share the candidate state structure. The additional flag fits existing padding: the retained binaries both allocate 120-byte label-map nodes. The six corrected benchmark files are identical between the foundation and diagnostic source trees. + +| Case and comparison | Original-mode mean ms | Other-mode mean ms | Paired change | Paired min–max | Slower pairs | +|---|---:|---:|---:|---:|---:| +| A/A stable text, original mode twice | 0.03440 | 0.03411 | -1.42% | -10.27 to +6.72% | 3/8 | +| A/B stable text | 0.03508 | 0.03352 | **-4.24%** | -24.07 to +6.97% | 1/8 | +| A/B conservative text | 2.81591 | 2.75131 | -2.22% | -3.78 to +10.79% | 2/8 | +| A/B conservative, no text | 2.75946 | 2.73162 | **-0.71%** | -3.83 to +5.55% | **4/8** | + +The stable-text algorithm comparison is faster in seven of eight pairs, but its range overlaps the identical-mode control and includes a slower result. The paired p95 median change is +0.47%, versus +0.34% for the identical-mode control. These observations do not justify a general frame-time or tail-latency improvement claim. + +The conservative no-text comparison is evenly split in sign. It does not reproduce the consistent retained-binary penalty. Conservative text also has mixed outcomes; the large range relative to its small median limits timing conclusions. + +Allocation results are exact across the measured frames: + +| Same-executable workload | Original count/frame | Candidate count/frame | Original requested bytes/frame | Candidate requested bytes/frame | +|---|---:|---:|---:|---:| +| Stable text | 190 | 152 | 13,952 | 13,056 | +| Conservative text | 206 | 168 | 14,464 | 13,568 | +| Conservative, no text | 130 | 130 | 9,824 | 9,824 | + +Every v3 process has identical allocation minimum and maximum throughout its measurement window. The 20,000-frame warmups last 641–971 ms; the conservative 100-frame warmups last 265–392 ms (299–392 ms for the text cases). All text warmups exceed the configured 180 ms label-fade interval, and measured allocation traffic remains constant throughout each process. + +### What this narrows down + +Inspection of the original binaries finds identical normalized instruction sequences for the range scan, sample reader, callbacks and frame renderer, at different code addresses. Relocation normalization is documented in the archived analysis helper; this does not mean their raw instruction bytes are all identical. The inspected dependencies and RUNPATH agree, and plot code is statically linked into each binary. + +The changed label algorithm is skipped by the no-text workload. Holding the executable fixed removes build-to-build relative code placement as a difference between modes; the resulting control has no consistent penalty. Code placement remains a plausible explanation for the retained-binary behavior, but no instruction-cache, branch-predictor or other hardware mechanism was measured. Process ASLR and host variation remain. + +The diagnostic also uses v3 while the retained binaries use v2. Consequently these campaigns cannot isolate code placement as the cause. The supported conclusion is that the allocation reduction is repeatable and the original slowdown is not a consistent consequence of selecting the candidate helper in this diagnostic build. + +## Build identity and validation + +Both fresh builds use Linux development SDK `2026.10.23.1`: GCC 13.3.0, Qt 6.12.0, CMake 3.31.10, Ninja 1.13.2, Release `-O3 -DNDEBUG`, text enabled, and the same explicit dependency source overrides. Configuration uses one queued slot and builds use four slots with matching parallelism. + +Owned dependency default heads were checked at continuation start and still match the retained inputs. Full dependency revisions are: + +| Dependency | Revision | +|---|---| +| `vnm_msdf_text` | `3e89f1358c88b46f7c68b99dd9bf76003b5a3db3` | +| `vnm_fonts` | `c9adbd52cd3bc983d313993436381522e15864e1` | +| `vnm_cmake` | `66d5ee14f4f69c952daa58a95a4759ad77a636f4` | +| `glm` | `8d1fd52e5ab5590e2c81768ace50c72bae28f2ed` | +| `msdfgen` | `1874bcf7d9624ccc85b4bc9a85d78116f690f35b` | + +The selected FreeType is the SDK's 2.13.2. Source inventories covering the project and dependencies matched after builds and focused tests: 2,101 files for the foundation and 2,100 for the diagnostic. Executable hashes remained unchanged after all campaigns. + +| Built source | Published commit with identical Git tree | Local compiled revision | +|---|---|---| +| Corrected benchmark foundation | [`ca15d8c`](https://github.com/Varinomics/vnm_plot/commit/ca15d8cea331fb70a923bcb1a8c75ede3493882f) | `043e0a61d6e0a4127399aa341c397249634e4791` | +| Diagnostic-only reproduction | [`94a3d43`](https://github.com/Varinomics/vnm_plot/commit/94a3d43388f91ea5213c2057c3f5f20fad2091a2) | `41a0088fe1faf4a85b21638631e32b80501c6c70` | + +The API-created publication commits have new identifiers; the Git tree IDs match exactly. Later foundation commits update only the continuation report and measurements. The diagnostic source is on `diagnostic/label-membership-same-image-20261104`. + +Executable SHA-256 values: + +```text +retained baseline a421c9d8832519110d6bc0eb2253916798eef0d30512f5359f46673c51f29f5d +retained candidate 77cfcf554e536ae0adfb4575ae8e7cf89623aa13fa99003e7df5088b96b21c9d +v3 foundation 7eb10990e79e5215968eb14e546b799c20d5dac605ab922481c1fd2478ea477b +v3 diagnostic 4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473 +``` + +The historical compiled revisions are baseline `88d459d` and candidate `70638b6`, preserved in the original recovery bundle. The v2 continuation runner is published initial foundation `a15293f`. + +Validation completed: + +- **10/10 selected foundation CTest registrations:** ring buffer, Brownian generator, profiler, data source, phase-trace flush, shared frame pipeline, workload contracts, suite validation, `CoreAlgo` and `LayoutCalculator`. +- **3/3 diagnostic registrations in each mode:** `CoreAlgo`, workload contracts and suite validation, for six successful mode-specific registrations. +- The runner's **10 Python tests** pass, including frame-only and v2-rejection coverage. These are included in the suite-validation registrations above. +- All 144 measured processes complete their workload and phase checks. All 64 v3 reports satisfy the corrected frame-only contract and constant allocation bounds. +- An independent read-only review recomputed paired results and checked all raw reports, mode markers, hashes, allocation bounds and warmup phases. Its script and JSON results are included in the archive. + +An early build command used CTest name `ring_buffer_tests` as a Ninja target; it failed before compilation. The corrected target names built successfully. The failed invocation and successful build/test logs are both preserved. This was a command-name error, not a compiler or test failure. + +## Native rendering and remaining qualification + +One bounded SDK Xvfb startup attempt exited 1 because local/unix sockets could not be opened. A minimal AF_UNIX capability check returned EPERM. The display process ended. Previous EGL and Vulkan initialization failures remain recorded in the first report. No permission or syscall workaround was attempted. + +`FontRendererDrawRanges` and `SampleUploadReuse` still require a supported native display and have not passed in this continuation. Null is not substituted into these raster/readback gates. Hosted native CI was not dispatched. + +The next production decision requires these native gates and a corrected-v3 comparison of separately built production baseline/candidate executables on a supported rendering host, retaining text and no-text controls. The same-executable diagnostic can help interpret that comparison, but does not replace it. The current foundation is useful for further measurements while the production experiment remains unpromoted. + +## Reproduction + +Use the published source revisions above with the repository's [Linux SDK instructions](https://github.com/Varinomics/logonomic/blob/master/docs/linux_assistant_sdk.md). The archive retains full configure/build logs, source inventories and both fixed plans. Build both revisions with the recorded dependency overrides and Release configuration. Do not combine a v2 executable with the v3 suite. + +After activating the SDK, set paths for the diagnostic checkout and its built executable. CPU 8 must be available; record any changed affinity. + +```bash +export QT_QPA_PLATFORM=offscreen +VNM_DIAGNOSTIC_SOURCE=/absolute/path/to/diagnostic-checkout +VNM_DIAGNOSTIC_BIN=/absolute/path/to/build/benchmark/vnm_plot_benchmark + +# Identical-mode control. +VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0 taskset -c 8 python3 \ + "$VNM_DIAGNOSTIC_SOURCE/benchmark/tools/run_suite.py" \ + --baseline "$VNM_DIAGNOSTIC_BIN" --candidate "$VNM_DIAGNOSTIC_BIN" \ + --graphics-backend null --repetitions 8 --warmup-frames 20000 --frames 50000 \ + --frame-timing-only --cases warm-line-8 --output-dir same-image-aa + +# The diagnostic driver sets and verifies the mode for each variant. +taskset -c 8 python3 \ + "$VNM_DIAGNOSTIC_SOURCE/benchmark/tools/run_same_image_diagnostic.py" \ + --baseline "$VNM_DIAGNOSTIC_BIN" --candidate "$VNM_DIAGNOSTIC_BIN" \ + --graphics-backend null --repetitions 8 --warmup-frames 20000 --frames 50000 \ + --frame-timing-only --cases warm-line-8 --output-dir same-image-ab-settled + +taskset -c 8 python3 \ + "$VNM_DIAGNOSTIC_SOURCE/benchmark/tools/run_same_image_diagnostic.py" \ + --baseline "$VNM_DIAGNOSTIC_BIN" --candidate "$VNM_DIAGNOSTIC_BIN" \ + --graphics-backend null --repetitions 8 --warmup-frames 100 --frames 1000 \ + --frame-timing-only \ + --cases warm-line-8-conservative warm-line-8-conservative-no-text \ + --output-dir same-image-ab-conservative +``` + +For the diagnostic CTest runs, set `VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC` to `0` and then `1`, running `CoreAlgo`, `benchmark_workload_contracts` and `benchmark_suite_validation` in each mode. The ordinary foundation has no mode environment variable. Retained v2 comparison commands are in the original manifests; their executable files and original Git objects remain in the original recovery archive. The new archive excludes SDKs, dependency checkouts and duplicated binaries. diff --git a/benchmark/results/2026-11-04-followup/measurements.json b/benchmark/results/2026-11-04-followup/measurements.json index 0770b26..8bcd5f2 100644 --- a/benchmark/results/2026-11-04-followup/measurements.json +++ b/benchmark/results/2026-11-04-followup/measurements.json @@ -1,4 +1,34 @@ { + "build_provenance": { + "binaries": { + "foundation": { + "bytes": 2058480, + "path": "/workspace/scratch/2a7852710aa2/build-foundation/benchmark/vnm_plot_benchmark", + "sha256": "7eb10990e79e5215968eb14e546b799c20d5dac605ab922481c1fd2478ea477b" + }, + "same-image": { + "bytes": 2074680, + "path": "/workspace/scratch/2a7852710aa2/build-same-image/benchmark/vnm_plot_benchmark", + "sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473" + } + }, + "build_type": "Release", + "compiler": "GCC13.3.0", + "created_at": "2026-11-04T01:46:00.791787+00:00", + "cxx_release_flags": "-O3 -DNDEBUG", + "diagnostic_local_source": "41a0088fe1faf4a85b21638631e32b80501c6c70", + "foundation_local_source": "043e0a61d6e0a4127399aa341c397249634e4791", + "notes": [ + "Source hashes matched after both builds and focused tests.", + "Both diagnostic modes use exactly the same binary; maintained foundation excludes diagnostic dispatch and candidate optimization." + ], + "qt": "6.12.0", + "source_inventory_files": [ + "foundation-final-source-inventory-before.json", + "same-image-source-inventory-before.json" + ], + "workload_contract_version": 3 + }, "experiments": { "retained-aa": { "created_at": "2026-11-04T01:32:16.120516+00:00", @@ -5875,64 +5905,8829 @@ "schema_version": 1 }, "warmup_frames": 100 - } - }, - "initial_plan": { - "backend": "null", - "binary_sha256": { - "baseline": "a421c9d8832519110d6bc0eb2253916798eef0d30512f5359f46673c51f29f5d", - "candidate": "77cfcf554e536ae0adfb4575ae8e7cf89623aa13fa99003e7df5088b96b21c9d" }, - "campaigns": [ - { - "baseline": "baseline", - "candidate": "baseline", - "cases": [ - "warm-line-8-no-text", - "warm-line-8-conservative-no-text" - ], - "name": "retained-aa", - "repetitions": 8 + "same-image-aa": { + "created_at": "2026-11-04T01:46:12.024817+00:00", + "ended_at": "2026-11-04T01:46:53.668544+00:00", + "executables": { + "baseline": { + "bytes": 2074680, + "git_at_binary_location": null, + "path": "/workspace/scratch/2a7852710aa2/build-same-image/benchmark/vnm_plot_benchmark", + "sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473" + }, + "candidate": { + "bytes": 2074680, + "git_at_binary_location": null, + "path": "/workspace/scratch/2a7852710aa2/build-same-image/benchmark/vnm_plot_benchmark", + "sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473" + } }, - { - "baseline": "baseline", - "candidate": "candidate", - "cases": [ - "warm-line-8-no-text", - "warm-line-8-conservative", - "warm-line-8-conservative-no-text" + "frames": 50000, + "graphics_backend": "null", + "host": { + "cpu_affinity": [ + 8 ], - "name": "retained-ab", - "repetitions": 8 - } - ], - "cpu_affinity": [ - 8 - ], - "created_at": "2026-11-04T01:32:15.682916+00:00", - "decision_rules": [ - "Retain all observations and failed invocations; no favorable-result retries.", - "If identical-binary variation is comparable to the effect, timing remains unresolved.", - "If no-text slowdown reproduces, inspect source-independent binary/layout effects and do one causally motivated follow-up.", - "Allocation and timing findings remain separate; native pixel/render tests required before promotion.", - "Do not repeat the full original campaign or rebuild unchanged dependencies without a concrete reason." - ], - "frame_timing_only": true, - "frames": 1000, - "original_affinity": [ - 0, - 1, - 2, - 3, - 4, - 5, - 6, - 7, - 8 - ], - "purpose": "Continue PR30; assess reproducibility of conservative/no-text slowdown before promoting label optimization", - "warmup_frames": 100 + "cpu_count": 9, + "cpu_model": "AMD EPYC 9V74 80-Core Processor", + "machine": "x86_64", + "platform": "Linux-6.18.57-x86_64-with-glibc2.39", + "python": "3.12.3", + "renderer_environment": { + "GALLIUM_DRIVER": null, + "LIBGL_ALWAYS_SOFTWARE": null, + "LP_NUM_THREADS": null, + "MESA_LOADER_DRIVER_OVERRIDE": null, + "QSG_RENDER_LOOP": null, + "QSG_RHI_BACKEND": null, + "QT_FONT_DPI": null, + "QT_QPA_PLATFORM": "offscreen", + "QT_SCALE_FACTOR": null, + "QT_SCREEN_SCALE_FACTORS": null, + "XDG_CACHE_HOME": null + } + }, + "internal_profiling": false, + "repetitions": 8, + "run_order": [ + { + "case": "warm-line-8", + "repetition": 0, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "repetition": 0, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "repetition": 1, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "repetition": 1, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "repetition": 2, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "repetition": 2, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "repetition": 3, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "repetition": 3, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "repetition": 4, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "repetition": 4, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "repetition": 5, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "repetition": 5, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "repetition": 6, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "repetition": 6, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "repetition": 7, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "repetition": 7, + "variant": "baseline" + } + ], + "runs": [ + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.575045999998761e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03476828570000054, + "p95": 0.056831949999999964 + }, + "benchmark.frame.total_ms": { + "mean": 0.03487101952000048, + "p95": 0.05949854999999996 + } + }, + "raw_report": "warm-line-8/01-baseline/inspector_benchmark_20261104_014612_810_SIM_Bars.json", + "repetition": 0, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.5480879999988034e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03474048705999944, + "p95": 0.05944399999999998 + }, + "benchmark.frame.total_ms": { + "mean": 0.0348409084999996, + "p95": 0.05762499999999999 + } + }, + "raw_report": "warm-line-8/01-candidate/inspector_benchmark_20261104_014615_447_SIM_Bars.json", + "repetition": 0, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.5403799999990167e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03309181926000006, + "p95": 0.044918 + }, + "benchmark.frame.total_ms": { + "mean": 0.03317909769999972, + "p95": 0.044405999999999994 + } + }, + "raw_report": "warm-line-8/02-candidate/inspector_benchmark_20261104_014618_058_SIM_Bars.json", + "repetition": 1, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.5895799999988918e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.036868497980000706, + "p95": 0.06167044999999999 + }, + "benchmark.frame.total_ms": { + "mean": 0.03697536422000054, + "p95": 0.060847999999999985 + } + }, + "raw_report": "warm-line-8/02-baseline/inspector_benchmark_20261104_014620_679_SIM_Bars.json", + "repetition": 1, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 3.0505699999976458e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03707218178000058, + "p95": 0.08103650000000001 + }, + "benchmark.frame.total_ms": { + "mean": 0.037172767700000525, + "p95": 0.07176954999999997 + } + }, + "raw_report": "warm-line-8/03-baseline/inspector_benchmark_20261104_014623_499_SIM_Bars.json", + "repetition": 2, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.8384599999980623e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03605309919999842, + "p95": 0.063024 + }, + "benchmark.frame.total_ms": { + "mean": 0.036151700799998604, + "p95": 0.06142899999999995 + } + }, + "raw_report": "warm-line-8/03-candidate/inspector_benchmark_20261104_014626_345_SIM_Bars.json", + "repetition": 2, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.594059999998806e-05, + "p95": 3.1e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03612125017999934, + "p95": 0.06524099999999997 + }, + "benchmark.frame.total_ms": { + "mean": 0.03621503087999965, + "p95": 0.06624399999999997 + } + }, + "raw_report": "warm-line-8/04-candidate/inspector_benchmark_20261104_014629_119_SIM_Bars.json", + "repetition": 3, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.5836919999985625e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03383922454000067, + "p95": 0.04615744999999999 + }, + "benchmark.frame.total_ms": { + "mean": 0.03393395162000063, + "p95": 0.046308 + } + }, + "raw_report": "warm-line-8/04-baseline/inspector_benchmark_20261104_014631_798_SIM_Bars.json", + "repetition": 3, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.4491819999990055e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.0314070691199997, + "p95": 0.04310299999999999 + }, + "benchmark.frame.total_ms": { + "mean": 0.03149445577999961, + "p95": 0.042844 + } + }, + "raw_report": "warm-line-8/05-baseline/inspector_benchmark_20261104_014634_339_SIM_Bars.json", + "repetition": 4, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.465615999998899e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.02939632504000113, + "p95": 0.04041045 + }, + "benchmark.frame.total_ms": { + "mean": 0.029483749740001043, + "p95": 0.038481499999999995 + } + }, + "raw_report": "warm-line-8/05-candidate/inspector_benchmark_20261104_014636_728_SIM_Bars.json", + "repetition": 4, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 3.179933999997185e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03329067298000084, + "p95": 0.05281554999999999 + }, + "benchmark.frame.total_ms": { + "mean": 0.03338808248000105, + "p95": 0.04979099999999999 + } + }, + "raw_report": "warm-line-8/06-candidate/inspector_benchmark_20261104_014639_034_SIM_Bars.json", + "repetition": 5, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.618183999998543e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03143926576000092, + "p95": 0.04198144999999999 + }, + "benchmark.frame.total_ms": { + "mean": 0.03152924166000102, + "p95": 0.044187 + } + }, + "raw_report": "warm-line-8/06-baseline/inspector_benchmark_20261104_014641_584_SIM_Bars.json", + "repetition": 5, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.6092919999986685e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03252235642000132, + "p95": 0.04682394999999999 + }, + "benchmark.frame.total_ms": { + "mean": 0.03261189298000091, + "p95": 0.04952649999999999 + } + }, + "raw_report": "warm-line-8/07-baseline/inspector_benchmark_20261104_014644_020_SIM_Bars.json", + "repetition": 6, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.6214619999988612e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03279787695999941, + "p95": 0.051807999999999965 + }, + "benchmark.frame.total_ms": { + "mean": 0.03289037467999915, + "p95": 0.05287094999999991 + } + }, + "raw_report": "warm-line-8/07-candidate/inspector_benchmark_20261104_014646_520_SIM_Bars.json", + "repetition": 6, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 3.320037999998538e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03490792070000066, + "p95": 0.05692149999999996 + }, + "benchmark.frame.total_ms": { + "mean": 0.035003895220000907, + "p95": 0.06077 + } + }, + "raw_report": "warm-line-8/08-candidate/inspector_benchmark_20261104_014649_081_SIM_Bars.json", + "repetition": 7, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.9013919999982044e-05, + "p95": 3.1e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03615977661999947, + "p95": 0.06032 + }, + "benchmark.frame.total_ms": { + "mean": 0.036252302559999575, + "p95": 0.05853205 + } + }, + "raw_report": "warm-line-8/08-baseline/inspector_benchmark_20261104_014651_716_SIM_Bars.json", + "repetition": 7, + "variant": "baseline" + } + ], + "status": "complete", + "summary": { + "cases": { + "warm-line-8": { + "counter_totals": { + "benchmark.frame.output_count": { + "baseline": { + "iqr": 0.0, + "max": 50000.0, + "median": 50000.0, + "min": 50000.0, + "n": 8, + "q25": 50000.0, + "q75": 50000.0 + }, + "candidate": { + "iqr": 0.0, + "max": 50000.0, + "median": 50000.0, + "min": 50000.0, + "n": 8, + "q25": 50000.0, + "q75": 50000.0 + } + }, + "benchmark.ring.occupancy": { + "baseline": { + "iqr": 0.0, + "max": 80000.0, + "median": 80000.0, + "min": 80000.0, + "n": 8, + "q25": 80000.0, + "q75": 80000.0 + }, + "candidate": { + "iqr": 0.0, + "max": 80000.0, + "median": 80000.0, + "min": 80000.0, + "n": 8, + "q25": 80000.0, + "q75": 80000.0 + } + }, + "benchmark.ring.overwritten_samples": { + "baseline": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "candidate": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + }, + "benchmark.ring.published_samples": { + "baseline": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "candidate": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + } + }, + "inclusive_scope_costs": {}, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "baseline": { + "run_means": { + "iqr": 0.0, + "max": 13952, + "median": 13952.0, + "min": 13952, + "n": 8, + "q25": 13952.0, + "q75": 13952.0 + }, + "run_p95s": { + "iqr": 0.0, + "max": 13952.0, + "median": 13952.0, + "min": 13952.0, + "n": 8, + "q25": 13952.0, + "q75": 13952.0 + } + }, + "candidate": { + "run_means": { + "iqr": 0.0, + "max": 13952, + "median": 13952.0, + "min": 13952, + "n": 8, + "q25": 13952.0, + "q75": 13952.0 + }, + "run_p95s": { + "iqr": 0.0, + "max": 13952.0, + "median": 13952.0, + "min": 13952.0, + "n": 8, + "q25": 13952.0, + "q75": 13952.0 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 0.0, + "max": 0, + "median": 0.0, + "min": 0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "percent_change": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "percent_change": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + } + }, + "benchmark.frame.cpu_allocation_count": { + "baseline": { + "run_means": { + "iqr": 0.0, + "max": 190, + "median": 190.0, + "min": 190, + "n": 8, + "q25": 190.0, + "q75": 190.0 + }, + "run_p95s": { + "iqr": 0.0, + "max": 190.0, + "median": 190.0, + "min": 190.0, + "n": 8, + "q25": 190.0, + "q75": 190.0 + } + }, + "candidate": { + "run_means": { + "iqr": 0.0, + "max": 190, + "median": 190.0, + "min": 190, + "n": 8, + "q25": 190.0, + "q75": 190.0 + }, + "run_p95s": { + "iqr": 0.0, + "max": 190.0, + "median": 190.0, + "min": 190.0, + "n": 8, + "q25": 190.0, + "q75": 190.0 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 0.0, + "max": 0, + "median": 0.0, + "min": 0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "percent_change": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "percent_change": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + } + }, + "benchmark.frame.gpu_finish_ms": { + "baseline": { + "run_means": { + "iqr": 1.0745549999984602e-06, + "max": 3.0505699999976458e-05, + "median": 2.5994359999987803e-05, + "min": 2.4491819999990055e-05, + "n": 8, + "q25": 2.5815304999986123e-05, + "q75": 2.6889859999984583e-05 + }, + "run_p95s": { + "iqr": 0.0, + "max": 3.1e-05, + "median": 2.9999999999999997e-05, + "min": 2.9999999999999997e-05, + "n": 8, + "q25": 2.9999999999999997e-05, + "q75": 2.9999999999999997e-05 + } + }, + "candidate": { + "run_means": { + "iqr": 3.776674999989865e-06, + "max": 3.320037999998538e-05, + "median": 2.6077609999988335e-05, + "min": 2.465615999998899e-05, + "n": 8, + "q25": 2.5461609999988566e-05, + "q75": 2.923828499997843e-05 + }, + "run_p95s": { + "iqr": 0.0, + "max": 3.1e-05, + "median": 2.9999999999999997e-05, + "min": 2.9999999999999997e-05, + "n": 8, + "q25": 2.9999999999999997e-05, + "q75": 2.9999999999999997e-05 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 1.4950549999994034e-06, + "max": 5.617499999986422e-06, + "median": 1.1269000000218104e-07, + "min": -2.121099999995835e-06, + "n": 8, + "q25": -3.251849999993703e-07, + "q75": 1.169870000000033e-06 + }, + "percent_change": { + "iqr": 5.370686339080017, + "max": 21.45571128686734, + "median": 0.4338481333851174, + "min": -6.953126792689468, + "n": 8, + "q25": -1.2601509384399856, + "q75": 4.110535400640031 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.0, + "max": 1.000000000000004e-06, + "median": 0.0, + "min": -1.000000000000004e-06, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "percent_change": { + "iqr": 0.0, + "max": 3.3333333333333437, + "median": 0.0, + "min": -3.2258064516129115, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + } + }, + "benchmark.frame.submission_ms": { + "baseline": { + "run_means": { + "iqr": 0.004085373204998556, + "max": 0.03707218178000058, + "median": 0.034303755120000605, + "min": 0.0314070691199997, + "n": 8, + "q25": 0.03225158375500122, + "q75": 0.03633695695999978 + }, + "run_p95s": { + "iqr": 0.015263775000000007, + "max": 0.08103650000000001, + "median": 0.05182794999999998, + "min": 0.04198144999999999, + "n": 8, + "q25": 0.04539383749999999, + "q75": 0.0606576125 + } + }, + "candidate": { + "run_means": { + "iqr": 0.002175881640000203, + "max": 0.03612125017999934, + "median": 0.034015580020000144, + "min": 0.02939632504000113, + "n": 8, + "q25": 0.033018333684999894, + "q75": 0.0351942153250001 + }, + "run_p95s": { + "iqr": 0.010253500000000013, + "max": 0.06524099999999997, + "median": 0.054868524999999974, + "min": 0.04041045, + "n": 8, + "q25": 0.05008549999999998, + "q75": 0.06033899999999999 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 0.0021110701699973023, + "max": 0.002282025639998672, + "median": -0.0005234406100016291, + "min": -0.003776678720000648, + "n": 8, + "q25": -0.0014415779599987553, + "q75": 0.000669492209998547 + }, + "percent_change": { + "iqr": 6.304648688212517, + "max": 6.743729122105435, + "median": -1.4144342564191448, + "min": -10.243646817533236, + "n": 8, + "q25": -4.197059794785502, + "q75": 2.107588893427015 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.01318355000000001, + "max": 0.019083549999999977, + "median": -4.024999999998474e-05, + "min": -0.018012500000000015, + "n": 8, + "q25": -0.006736987500000027, + "q75": 0.006446562499999982 + }, + "percent_change": { + "iqr": 24.676888031227346, + "max": 41.34446335315314, + "median": -0.5190118813499458, + "min": -27.16446855828033, + "n": 8, + "q25": -10.241995265654019, + "q75": 14.434892765573327 + } + } + }, + "benchmark.frame.total_ms": { + "baseline": { + "run_means": { + "iqr": 0.004091837824998876, + "max": 0.037172767700000525, + "median": 0.03440248557000056, + "min": 0.03149445577999961, + "n": 8, + "q25": 0.03234123015000094, + "q75": 0.036433067974999817 + }, + "run_p95s": { + "iqr": 0.014058162499999971, + "max": 0.07176954999999997, + "median": 0.054029274999999995, + "min": 0.042844, + "n": 8, + "q25": 0.04577775, + "q75": 0.05983591249999997 + } + }, + "candidate": { + "run_means": { + "iqr": 0.0021839296700007504, + "max": 0.03621503087999965, + "median": 0.03411449549000033, + "min": 0.029483749740001043, + "n": 8, + "q25": 0.03310691694499958, + "q75": 0.03529084661500033 + }, + "run_p95s": { + "iqr": 0.012489999999999994, + "max": 0.06624399999999997, + "median": 0.05524797499999995, + "min": 0.038481499999999995, + "n": 8, + "q25": 0.04844474999999999, + "q75": 0.06093474999999998 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 0.0021125534949973292, + "max": 0.0022810792599990207, + "median": -0.0005255889600014017, + "min": -0.0037962665200008197, + "n": 8, + "q25": -0.001438982014998643, + "q75": 0.0006735714799986862 + }, + "percent_change": { + "iqr": 6.293174422439299, + "max": 6.722115023746755, + "median": -1.4165820004331087, + "min": -10.267015890400232, + "n": 8, + "q25": -4.1788270502041955, + "q75": 2.1143473722351036 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.00976634999999995, + "max": 0.019935999999999968, + "median": 0.00018220000000001083, + "min": -0.01644199999999999, + "n": 8, + "q25": -0.00585701250000001, + "q75": 0.00390933749999994 + }, + "percent_change": { + "iqr": 19.47396747581112, + "max": 43.05087673836048, + "median": 0.33728027728708865, + "min": -27.021430449645013, + "n": 8, + "q25": -11.23871457037172, + "q75": 8.235252905439399 + } + } + } + } + } + }, + "frames_per_process": 50000, + "interpretation": { + "access_semantics": "Stable access identifies immutable benchmark callbacks so production caches can be exercised. The conservative control preserves uncached callback semantics; this workload correction is not a production optimization.", + "allocations": "C++ allocations observed on the render thread; excludes profiler storage, malloc-only and other-thread allocations.", + "cold": "Setup and cold observations remain in raw reports and are not mixed into warm-frame statistics.", + "frame_total": "Wall time for offscreen frame work, including QRhi completion with --finish; not application FPS or CPU time.", + "percent_change": "100 * (candidate / paired baseline - 1); negative means lower cost.", + "replicate": "One fresh process. No pooling of frames as independent replicates.", + "scope_costs": "Inclusive instrumented CPU-side scope wall times; nested scopes must not be added.", + "spread": "IQR and min/max describe process-to-process variation, not a confidence interval.", + "submission": "Includes begin/endOffscreenFrame and any backend synchronization they perform.", + "validation": "Timing runs exclude pixel readback. Validate pixels/semantics separately before accepting an optimization." + }, + "repetitions": 8, + "schema_version": 1 + }, + "warmup_frames": 20000 + }, + "same-image-ab-conservative": { + "created_at": "2026-11-04T01:48:19.622087+00:00", + "ended_at": "2026-11-04T01:50:00.204025+00:00", + "executables": { + "baseline": { + "bytes": 2074680, + "git_at_binary_location": null, + "path": "/workspace/scratch/2a7852710aa2/build-same-image/benchmark/vnm_plot_benchmark", + "sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473" + }, + "candidate": { + "bytes": 2074680, + "git_at_binary_location": null, + "path": "/workspace/scratch/2a7852710aa2/build-same-image/benchmark/vnm_plot_benchmark", + "sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473" + } + }, + "frames": 1000, + "graphics_backend": "null", + "host": { + "cpu_affinity": [ + 8 + ], + "cpu_count": 9, + "cpu_model": "AMD EPYC 9V74 80-Core Processor", + "machine": "x86_64", + "platform": "Linux-6.18.57-x86_64-with-glibc2.39", + "python": "3.12.3", + "renderer_environment": { + "GALLIUM_DRIVER": null, + "LIBGL_ALWAYS_SOFTWARE": null, + "LP_NUM_THREADS": null, + "MESA_LOADER_DRIVER_OVERRIDE": null, + "QSG_RENDER_LOOP": null, + "QSG_RHI_BACKEND": null, + "QT_FONT_DPI": null, + "QT_QPA_PLATFORM": "offscreen", + "QT_SCALE_FACTOR": null, + "QT_SCREEN_SCALE_FACTORS": null, + "XDG_CACHE_HOME": null + } + }, + "internal_profiling": false, + "repetitions": 8, + "run_order": [ + { + "case": "warm-line-8-conservative", + "repetition": 0, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative", + "repetition": 0, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative-no-text", + "repetition": 0, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative-no-text", + "repetition": 0, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative", + "repetition": 1, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative", + "repetition": 1, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative-no-text", + "repetition": 1, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative-no-text", + "repetition": 1, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative", + "repetition": 2, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative", + "repetition": 2, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative-no-text", + "repetition": 2, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative-no-text", + "repetition": 2, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative", + "repetition": 3, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative", + "repetition": 3, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative-no-text", + "repetition": 3, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative-no-text", + "repetition": 3, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative", + "repetition": 4, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative", + "repetition": 4, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative-no-text", + "repetition": 4, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative-no-text", + "repetition": 4, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative", + "repetition": 5, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative", + "repetition": 5, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative-no-text", + "repetition": 5, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative-no-text", + "repetition": 5, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative", + "repetition": 6, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative", + "repetition": 6, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative-no-text", + "repetition": 6, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative-no-text", + "repetition": 6, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative", + "repetition": 7, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative", + "repetition": 7, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative-no-text", + "repetition": 7, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative-no-text", + "repetition": 7, + "variant": "baseline" + } + ], + "runs": [ + { + "case": "warm-line-8-conservative", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 14464, + "p95": 14464.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 206, + "p95": 206.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 4.165999999999964e-05, + "p95": 6e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 2.839009578000003, + "p95": 4.36599205 + }, + "benchmark.frame.total_ms": { + "mean": 2.839146009999996, + "p95": 4.36635905 + } + }, + "raw_report": "warm-line-8-conservative/01-baseline/inspector_benchmark_20261104_014820_009_SIM_Bars.json", + "repetition": 0, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13568, + "p95": 13568.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 168, + "p95": 168.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 4.171099999999971e-05, + "p95": 6e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 2.7846627669999986, + "p95": 3.976896149999999 + }, + "benchmark.frame.total_ms": { + "mean": 2.7848021300000005, + "p95": 3.977025649999999 + } + }, + "raw_report": "warm-line-8-conservative/01-candidate/inspector_benchmark_20261104_014823_253_SIM_Bars.json", + "repetition": 0, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=1" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative-no-text", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 9824, + "p95": 9824.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 130, + "p95": 130.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 5.0212999999999995e-05, + "p95": 0.00015 + }, + "benchmark.frame.submission_ms": { + "mean": 3.0354408630000034, + "p95": 4.63606825 + }, + "benchmark.frame.total_ms": { + "mean": 3.0355859729999977, + "p95": 4.636519749999999 + } + }, + "raw_report": "warm-line-8-conservative-no-text/01-baseline/inspector_benchmark_20261104_014826_389_SIM_Bars.json", + "repetition": 0, + "same_image_diagnostic": { + "actual_mode_markers": [], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": false, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative-no-text", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 9824, + "p95": 9824.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 130, + "p95": 130.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 6.527600000000018e-05, + "p95": 0.00018 + }, + "benchmark.frame.submission_ms": { + "mean": 2.976196915, + "p95": 4.468894399999998 + }, + "benchmark.frame.total_ms": { + "mean": 2.976346758000004, + "p95": 4.469033949999998 + } + }, + "raw_report": "warm-line-8-conservative-no-text/01-candidate/inspector_benchmark_20261104_014829_839_SIM_Bars.json", + "repetition": 0, + "same_image_diagnostic": { + "actual_mode_markers": [], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": false, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13568, + "p95": 13568.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 168, + "p95": 168.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 6.549899999999995e-05, + "p95": 7e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 3.1206705810000006, + "p95": 4.49194725 + }, + "benchmark.frame.total_ms": { + "mean": 3.1208258159999986, + "p95": 4.492083249999999 + } + }, + "raw_report": "warm-line-8-conservative/02-candidate/inspector_benchmark_20261104_014833_282_SIM_Bars.json", + "repetition": 1, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=1" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 14464, + "p95": 14464.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 206, + "p95": 206.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 5.131599999999996e-05, + "p95": 7e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 2.816829316, + "p95": 3.9835818499999998 + }, + "benchmark.frame.total_ms": { + "mean": 2.8169622560000005, + "p95": 3.9837113499999997 + } + }, + "raw_report": "warm-line-8-conservative/02-baseline/inspector_benchmark_20261104_014836_756_SIM_Bars.json", + "repetition": 1, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative-no-text", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 9824, + "p95": 9824.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 130, + "p95": 130.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 4.524099999999987e-05, + "p95": 0.00013004999999999994 + }, + "benchmark.frame.submission_ms": { + "mean": 2.765617240000003, + "p95": 3.8216942499999997 + }, + "benchmark.frame.total_ms": { + "mean": 2.7657680589999973, + "p95": 3.82183325 + } + }, + "raw_report": "warm-line-8-conservative-no-text/02-candidate/inspector_benchmark_20261104_014839_913_SIM_Bars.json", + "repetition": 1, + "same_image_diagnostic": { + "actual_mode_markers": [], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": false, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative-no-text", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 9824, + "p95": 9824.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 130, + "p95": 130.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 4.411599999999997e-05, + "p95": 0.00014 + }, + "benchmark.frame.submission_ms": { + "mean": 2.734344196, + "p95": 3.268976899999999 + }, + "benchmark.frame.total_ms": { + "mean": 2.7344712180000004, + "p95": 3.2692398999999988 + } + }, + "raw_report": "warm-line-8-conservative-no-text/02-baseline/inspector_benchmark_20261104_014843_044_SIM_Bars.json", + "repetition": 1, + "same_image_diagnostic": { + "actual_mode_markers": [], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": false, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 14464, + "p95": 14464.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 206, + "p95": 206.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 3.685099999999972e-05, + "p95": 6e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 2.670643056999997, + "p95": 3.1474296499999994 + }, + "benchmark.frame.total_ms": { + "mean": 2.670757102000004, + "p95": 3.1475776499999997 + } + }, + "raw_report": "warm-line-8-conservative/03-baseline/inspector_benchmark_20261104_014846_145_SIM_Bars.json", + "repetition": 2, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13568, + "p95": 13568.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 168, + "p95": 168.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 4.5084999999999817e-05, + "p95": 6e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 2.7752663170000034, + "p95": 3.642663699999998 + }, + "benchmark.frame.total_ms": { + "mean": 2.7754022769999995, + "p95": 3.642783199999998 + } + }, + "raw_report": "warm-line-8-conservative/03-candidate/inspector_benchmark_20261104_014849_176_SIM_Bars.json", + "repetition": 2, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=1" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative-no-text", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 9824, + "p95": 9824.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 130, + "p95": 130.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 9.164400000000052e-05, + "p95": 0.00017 + }, + "benchmark.frame.submission_ms": { + "mean": 2.7842676490000016, + "p95": 4.186261999999999 + }, + "benchmark.frame.total_ms": { + "mean": 2.784450827000003, + "p95": 4.186419 + } + }, + "raw_report": "warm-line-8-conservative-no-text/03-baseline/inspector_benchmark_20261104_014852_299_SIM_Bars.json", + "repetition": 2, + "same_image_diagnostic": { + "actual_mode_markers": [], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": false, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative-no-text", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 9824, + "p95": 9824.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 130, + "p95": 130.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 5.498500000000016e-05, + "p95": 9.999999999999999e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 2.6777249799999985, + "p95": 3.2407028999999996 + }, + "benchmark.frame.total_ms": { + "mean": 2.677886324999995, + "p95": 3.2409673999999997 + } + }, + "raw_report": "warm-line-8-conservative-no-text/03-candidate/inspector_benchmark_20261104_014855_432_SIM_Bars.json", + "repetition": 2, + "same_image_diagnostic": { + "actual_mode_markers": [], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": false, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13568, + "p95": 13568.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 168, + "p95": 168.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 4.5768999999999887e-05, + "p95": 6.1e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 2.6971865880000023, + "p95": 3.2292914999999995 + }, + "benchmark.frame.total_ms": { + "mean": 2.697316848000001, + "p95": 3.2294159499999995 + } + }, + "raw_report": "warm-line-8-conservative/04-candidate/inspector_benchmark_20261104_014858_489_SIM_Bars.json", + "repetition": 3, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=1" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 14464, + "p95": 14464.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 206, + "p95": 206.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 3.878699999999988e-05, + "p95": 6e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 2.7445578330000004, + "p95": 3.3114465999999996 + }, + "benchmark.frame.total_ms": { + "mean": 2.744677782000003, + "p95": 3.3116811 + } + }, + "raw_report": "warm-line-8-conservative/04-baseline/inspector_benchmark_20261104_014901_578_SIM_Bars.json", + "repetition": 3, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative-no-text", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 9824, + "p95": 9824.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 130, + "p95": 130.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 5.5168000000000025e-05, + "p95": 0.0001614499999999996 + }, + "benchmark.frame.submission_ms": { + "mean": 2.8162486630000028, + "p95": 4.270547699999999 + }, + "benchmark.frame.total_ms": { + "mean": 2.816387717999996, + "p95": 4.270831149999999 + } + }, + "raw_report": "warm-line-8-conservative-no-text/04-candidate/inspector_benchmark_20261104_014904_668_SIM_Bars.json", + "repetition": 3, + "same_image_diagnostic": { + "actual_mode_markers": [], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": false, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative-no-text", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 9824, + "p95": 9824.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 130, + "p95": 130.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 5.8008000000000086e-05, + "p95": 0.00017 + }, + "benchmark.frame.submission_ms": { + "mean": 2.8012677280000013, + "p95": 4.17549055 + }, + "benchmark.frame.total_ms": { + "mean": 2.8014086830000013, + "p95": 4.1756096000000005 + } + }, + "raw_report": "warm-line-8-conservative-no-text/04-baseline/inspector_benchmark_20261104_014907_826_SIM_Bars.json", + "repetition": 3, + "same_image_diagnostic": { + "actual_mode_markers": [], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": false, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 14464, + "p95": 14464.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 206, + "p95": 206.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 0.00012013099999999991, + "p95": 6e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 2.815571426, + "p95": 4.15613555 + }, + "benchmark.frame.total_ms": { + "mean": 2.8157753720000014, + "p95": 4.156275049999999 + } + }, + "raw_report": "warm-line-8-conservative/05-baseline/inspector_benchmark_20261104_014910_990_SIM_Bars.json", + "repetition": 4, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13568, + "p95": 13568.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 168, + "p95": 168.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 5.1570999999999666e-05, + "p95": 6.1e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 2.7385521180000008, + "p95": 3.2207875 + }, + "benchmark.frame.total_ms": { + "mean": 2.7386963070000023, + "p95": 3.22091 + } + }, + "raw_report": "warm-line-8-conservative/05-candidate/inspector_benchmark_20261104_014914_167_SIM_Bars.json", + "repetition": 4, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=1" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative-no-text", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 9824, + "p95": 9824.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 130, + "p95": 130.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 7.008900000000027e-05, + "p95": 0.00017 + }, + "benchmark.frame.submission_ms": { + "mean": 2.791025090000003, + "p95": 4.12393605 + }, + "benchmark.frame.total_ms": { + "mean": 2.7911886540000017, + "p95": 4.1240865499999995 + } + }, + "raw_report": "warm-line-8-conservative-no-text/05-baseline/inspector_benchmark_20261104_014917_267_SIM_Bars.json", + "repetition": 4, + "same_image_diagnostic": { + "actual_mode_markers": [], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": false, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative-no-text", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 9824, + "p95": 9824.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 130, + "p95": 130.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 4.446099999999975e-05, + "p95": 0.00014 + }, + "benchmark.frame.submission_ms": { + "mean": 2.6972875290000022, + "p95": 3.3533792999999994 + }, + "benchmark.frame.total_ms": { + "mean": 2.697477883999999, + "p95": 3.3536302499999993 + } + }, + "raw_report": "warm-line-8-conservative-no-text/05-candidate/inspector_benchmark_20261104_014920_423_SIM_Bars.json", + "repetition": 4, + "same_image_diagnostic": { + "actual_mode_markers": [], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": false, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13568, + "p95": 13568.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 168, + "p95": 168.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 4.3666999999999926e-05, + "p95": 7e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 2.6178543309999953, + "p95": 3.02087705 + }, + "benchmark.frame.total_ms": { + "mean": 2.6179868479999997, + "p95": 3.0209885 + } + }, + "raw_report": "warm-line-8-conservative/06-candidate/inspector_benchmark_20261104_014923_512_SIM_Bars.json", + "repetition": 5, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=1" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 14464, + "p95": 14464.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 206, + "p95": 206.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 4.255499999999981e-05, + "p95": 6.0049999999999955e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 2.720609961, + "p95": 4.171997699999999 + }, + "benchmark.frame.total_ms": { + "mean": 2.7207280030000036, + "p95": 4.172128149999999 + } + }, + "raw_report": "warm-line-8-conservative/06-baseline/inspector_benchmark_20261104_014926_520_SIM_Bars.json", + "repetition": 5, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative-no-text", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 9824, + "p95": 9824.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 130, + "p95": 130.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 5.613199999999999e-05, + "p95": 0.000141 + }, + "benchmark.frame.submission_ms": { + "mean": 2.6214961509999997, + "p95": 3.0206138000000005 + }, + "benchmark.frame.total_ms": { + "mean": 2.6216400609999977, + "p95": 3.0207443 + } + }, + "raw_report": "warm-line-8-conservative-no-text/06-candidate/inspector_benchmark_20261104_014929_563_SIM_Bars.json", + "repetition": 5, + "same_image_diagnostic": { + "actual_mode_markers": [], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": false, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative-no-text", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 9824, + "p95": 9824.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 130, + "p95": 130.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 5.4383000000000194e-05, + "p95": 0.000141 + }, + "benchmark.frame.submission_ms": { + "mean": 2.6913073979999993, + "p95": 3.25294035 + }, + "benchmark.frame.total_ms": { + "mean": 2.6914495839999995, + "p95": 3.2530707999999997 + } + }, + "raw_report": "warm-line-8-conservative-no-text/06-baseline/inspector_benchmark_20261104_014932_511_SIM_Bars.json", + "repetition": 5, + "same_image_diagnostic": { + "actual_mode_markers": [], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": false, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 14464, + "p95": 14464.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 206, + "p95": 206.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 4.319499999999966e-05, + "p95": 7e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 2.832335125000002, + "p95": 4.19851055 + }, + "benchmark.frame.total_ms": { + "mean": 2.8324728270000024, + "p95": 4.19865055 + } + }, + "raw_report": "warm-line-8-conservative/07-baseline/inspector_benchmark_20261104_014935_614_SIM_Bars.json", + "repetition": 6, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13568, + "p95": 13568.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 168, + "p95": 168.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 4.983599999999993e-05, + "p95": 7e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 2.757757156999995, + "p95": 3.3184055500000005 + }, + "benchmark.frame.total_ms": { + "mean": 2.757896297000001, + "p95": 3.3187575000000002 + } + }, + "raw_report": "warm-line-8-conservative/07-candidate/inspector_benchmark_20261104_014938_833_SIM_Bars.json", + "repetition": 6, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=1" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative-no-text", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 9824, + "p95": 9824.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 130, + "p95": 130.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 5.385600000000011e-05, + "p95": 0.00016 + }, + "benchmark.frame.submission_ms": { + "mean": 2.6855076499999995, + "p95": 3.2383423 + }, + "benchmark.frame.total_ms": { + "mean": 2.6856435059999963, + "p95": 3.2386158000000003 + } + }, + "raw_report": "warm-line-8-conservative-no-text/07-baseline/inspector_benchmark_20261104_014941_935_SIM_Bars.json", + "repetition": 6, + "same_image_diagnostic": { + "actual_mode_markers": [], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": false, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative-no-text", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 9824, + "p95": 9824.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 130, + "p95": 130.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 7.04920000000002e-05, + "p95": 0.00018 + }, + "benchmark.frame.submission_ms": { + "mean": 2.834454635, + "p95": 4.40567395 + }, + "benchmark.frame.total_ms": { + "mean": 2.834619846000003, + "p95": 4.4059549 + } + }, + "raw_report": "warm-line-8-conservative-no-text/07-candidate/inspector_benchmark_20261104_014944_986_SIM_Bars.json", + "repetition": 6, + "same_image_diagnostic": { + "actual_mode_markers": [], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": false, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13568, + "p95": 13568.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 168, + "p95": 168.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 5.07349999999997e-05, + "p95": 7e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 2.7445692119999987, + "p95": 3.4177365999999996 + }, + "benchmark.frame.total_ms": { + "mean": 2.744731778000003, + "p95": 3.4178615999999997 + } + }, + "raw_report": "warm-line-8-conservative/08-candidate/inspector_benchmark_20261104_014948_192_SIM_Bars.json", + "repetition": 7, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=1" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 14464, + "p95": 14464.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 206, + "p95": 206.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 6.931099999999984e-05, + "p95": 6.1e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 2.815903496, + "p95": 4.18845155 + }, + "benchmark.frame.total_ms": { + "mean": 2.8160530950000022, + "p95": 4.18858205 + } + }, + "raw_report": "warm-line-8-conservative/08-baseline/inspector_benchmark_20261104_014951_317_SIM_Bars.json", + "repetition": 7, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8-conservative-no-text", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 9824, + "p95": 9824.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 130, + "p95": 130.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 4.678599999999989e-05, + "p95": 0.00013 + }, + "benchmark.frame.submission_ms": { + "mean": 2.6593254490000033, + "p95": 3.1093869499999998 + }, + "benchmark.frame.total_ms": { + "mean": 2.6594610299999952, + "p95": 3.1095184 + } + }, + "raw_report": "warm-line-8-conservative-no-text/08-candidate/inspector_benchmark_20261104_014954_497_SIM_Bars.json", + "repetition": 7, + "same_image_diagnostic": { + "actual_mode_markers": [], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": false, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8-conservative-no-text", + "counters": { + "benchmark.frame.output_count": 1000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 9824, + "p95": 9824.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 130, + "p95": 130.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 6.105999999999989e-05, + "p95": 0.00013049999999999954 + }, + "benchmark.frame.submission_ms": { + "mean": 2.634589445000001, + "p95": 3.0125372999999995 + }, + "benchmark.frame.total_ms": { + "mean": 2.634729146000002, + "p95": 3.01266825 + } + }, + "raw_report": "warm-line-8-conservative-no-text/08-baseline/inspector_benchmark_20261104_014957_522_SIM_Bars.json", + "repetition": 7, + "same_image_diagnostic": { + "actual_mode_markers": [], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": false, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + } + ], + "status": "complete", + "summary": { + "cases": { + "warm-line-8-conservative": { + "counter_totals": { + "benchmark.frame.output_count": { + "baseline": { + "iqr": 0.0, + "max": 1000.0, + "median": 1000.0, + "min": 1000.0, + "n": 8, + "q25": 1000.0, + "q75": 1000.0 + }, + "candidate": { + "iqr": 0.0, + "max": 1000.0, + "median": 1000.0, + "min": 1000.0, + "n": 8, + "q25": 1000.0, + "q75": 1000.0 + } + }, + "benchmark.ring.occupancy": { + "baseline": { + "iqr": 0.0, + "max": 80000.0, + "median": 80000.0, + "min": 80000.0, + "n": 8, + "q25": 80000.0, + "q75": 80000.0 + }, + "candidate": { + "iqr": 0.0, + "max": 80000.0, + "median": 80000.0, + "min": 80000.0, + "n": 8, + "q25": 80000.0, + "q75": 80000.0 + } + }, + "benchmark.ring.overwritten_samples": { + "baseline": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "candidate": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + }, + "benchmark.ring.published_samples": { + "baseline": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "candidate": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + } + }, + "inclusive_scope_costs": {}, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "baseline": { + "run_means": { + "iqr": 0.0, + "max": 14464, + "median": 14464.0, + "min": 14464, + "n": 8, + "q25": 14464.0, + "q75": 14464.0 + }, + "run_p95s": { + "iqr": 0.0, + "max": 14464.0, + "median": 14464.0, + "min": 14464.0, + "n": 8, + "q25": 14464.0, + "q75": 14464.0 + } + }, + "candidate": { + "run_means": { + "iqr": 0.0, + "max": 13568, + "median": 13568.0, + "min": 13568, + "n": 8, + "q25": 13568.0, + "q75": 13568.0 + }, + "run_p95s": { + "iqr": 0.0, + "max": 13568.0, + "median": 13568.0, + "min": 13568.0, + "n": 8, + "q25": 13568.0, + "q75": 13568.0 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 0.0, + "max": -896, + "median": -896.0, + "min": -896, + "n": 8, + "q25": -896.0, + "q75": -896.0 + }, + "percent_change": { + "iqr": 0.0, + "max": -6.194690265486724, + "median": -6.194690265486724, + "min": -6.194690265486724, + "n": 8, + "q25": -6.194690265486724, + "q75": -6.194690265486724 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.0, + "max": -896.0, + "median": -896.0, + "min": -896.0, + "n": 8, + "q25": -896.0, + "q75": -896.0 + }, + "percent_change": { + "iqr": 0.0, + "max": -6.194690265486724, + "median": -6.194690265486724, + "min": -6.194690265486724, + "n": 8, + "q25": -6.194690265486724, + "q75": -6.194690265486724 + } + } + }, + "benchmark.frame.cpu_allocation_count": { + "baseline": { + "run_means": { + "iqr": 0.0, + "max": 206, + "median": 206.0, + "min": 206, + "n": 8, + "q25": 206.0, + "q75": 206.0 + }, + "run_p95s": { + "iqr": 0.0, + "max": 206.0, + "median": 206.0, + "min": 206.0, + "n": 8, + "q25": 206.0, + "q75": 206.0 + } + }, + "candidate": { + "run_means": { + "iqr": 0.0, + "max": 168, + "median": 168.0, + "min": 168, + "n": 8, + "q25": 168.0, + "q75": 168.0 + }, + "run_p95s": { + "iqr": 0.0, + "max": 168.0, + "median": 168.0, + "min": 168.0, + "n": 8, + "q25": 168.0, + "q75": 168.0 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 0.0, + "max": -38, + "median": -38.0, + "min": -38, + "n": 8, + "q25": -38.0, + "q75": -38.0 + }, + "percent_change": { + "iqr": 0.0, + "max": -18.446601941747577, + "median": -18.446601941747577, + "min": -18.446601941747577, + "n": 8, + "q25": -18.446601941747577, + "q75": -18.446601941747577 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.0, + "max": -38.0, + "median": -38.0, + "min": -38.0, + "n": 8, + "q25": -38.0, + "q75": -38.0 + }, + "percent_change": { + "iqr": 0.0, + "max": -18.446601941747577, + "median": -18.446601941747577, + "min": -18.446601941747577, + "n": 8, + "q25": -18.446601941747577, + "q75": -18.446601941747577 + } + } + }, + "benchmark.frame.gpu_finish_ms": { + "baseline": { + "run_means": { + "iqr": 1.4873000000000228e-05, + "max": 0.00012013099999999991, + "median": 4.2874999999999734e-05, + "min": 3.685099999999972e-05, + "n": 8, + "q25": 4.09417499999997e-05, + "q75": 5.581474999999993e-05 + }, + "run_p95s": { + "iqr": 3.249999999999991e-06, + "max": 7e-05, + "median": 6.002499999999998e-05, + "min": 6e-05, + "n": 8, + "q25": 6e-05, + "q75": 6.324999999999999e-05 + } + }, + "candidate": { + "run_means": { + "iqr": 6.213499999999848e-06, + "max": 6.549899999999995e-05, + "median": 4.780249999999991e-05, + "min": 4.171099999999971e-05, + "n": 8, + "q25": 4.4730499999999846e-05, + "q75": 5.0943999999999694e-05 + }, + "run_p95s": { + "iqr": 9.249999999999994e-06, + "max": 7e-05, + "median": 6.549999999999999e-05, + "min": 6e-05, + "n": 8, + "q25": 6.075e-05, + "q75": 7e-05 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 1.1900750000000011e-05, + "max": 1.418299999999999e-05, + "median": 3.876500000000192e-06, + "min": -6.856000000000025e-05, + "n": 8, + "q25": -4.6057499999999804e-06, + "q75": 7.295000000000031e-06 + }, + "percent_change": { + "iqr": 25.695086439126033, + "max": 27.63855327773015, + "median": 8.993776790415842, + "min": -57.07103079138631, + "n": 8, + "q25": -6.608420481555822, + "q75": 19.08666595757021 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 2.9999999999999967e-06, + "max": 9.950000000000039e-06, + "median": 4.999999999999986e-07, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 2.9999999999999967e-06 + }, + "percent_change": { + "iqr": 4.9385245901639285, + "max": 16.569525395503824, + "median": 0.8333333333333304, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 4.9385245901639285 + } + } + }, + "benchmark.frame.submission_ms": { + "baseline": { + "run_means": { + "iqr": 0.0821349032500005, + "max": 2.839009578000003, + "median": 2.815737461, + "min": 2.670643056999997, + "n": 8, + "q25": 2.7385708650000002, + "q75": 2.8207057682500007 + }, + "run_p95s": { + "iqr": 0.37541826249999977, + "max": 4.36599205, + "median": 4.164066624999999, + "min": 3.1474296499999994, + "n": 8, + "q25": 3.8155480374999997, + "q75": 4.1909662999999995 + } + }, + "candidate": { + "run_means": { + "iqr": 0.049404694000001026, + "max": 3.1206705810000006, + "median": 2.7511631844999966, + "min": 2.6178543309999953, + "n": 8, + "q25": 2.728210735500001, + "q75": 2.777615429500002 + }, + "run_p95s": { + "iqr": 0.4990563124999987, + "max": 4.49194725, + "median": 3.368071075, + "min": 3.02087705, + "n": 8, + "q25": 3.2271655, + "q75": 3.7262218124999986 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 0.06581568425000806, + "max": 0.3038412650000004, + "median": -0.06284054750000267, + "min": -0.10275563000000476, + "n": 8, + "q25": -0.07518830300000501, + "q75": -0.009372618749996953 + }, + "percent_change": { + "iqr": 2.3435654995649537, + "max": 10.786640968060723, + "median": -2.2237761040724333, + "min": -3.776933535972038, + "n": 8, + "q25": -2.6586876714129017, + "q75": -0.315122171847948 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.9561079499999993, + "max": 0.5083654000000002, + "median": -0.5799054250000006, + "min": -1.1511206499999984, + "n": 8, + "q25": -0.8939157624999996, + "q75": 0.06219218749999966 + }, + "percent_change": { + "iqr": 22.67771633223574, + "max": 15.734555020157437, + "median": -13.656460870022658, + "min": -27.591593590763452, + "n": 8, + "q25": -21.348044743524547, + "q75": 1.329671588711193 + } + } + }, + "benchmark.frame.total_ms": { + "baseline": { + "run_means": { + "iqr": 0.08214956149999786, + "max": 2.839146009999996, + "median": 2.815914233500002, + "min": 2.670757102000004, + "n": 8, + "q25": 2.738690337250003, + "q75": 2.820839898750001 + }, + "run_p95s": { + "iqr": 0.37539538750000023, + "max": 4.36635905, + "median": 4.164201599999998, + "min": 3.1475776499999997, + "n": 8, + "q25": 3.8157037874999995, + "q75": 4.191099175 + } + }, + "candidate": { + "run_means": { + "iqr": 0.04940079799999797, + "max": 3.1208258159999986, + "median": 2.751314037500002, + "min": 2.6179868479999997, + "n": 8, + "q25": 2.728351442250002, + "q75": 2.77775224025 + }, + "run_p95s": { + "iqr": 0.49905434999999887, + "max": 4.492083249999999, + "median": 3.36830955, + "min": 3.0209885, + "n": 8, + "q25": 3.2272894624999995, + "q75": 3.7263438124999984 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 0.06584275699999831, + "max": 0.30386355999999815, + "median": -0.06283259849999734, + "min": -0.10274115500000391, + "n": 8, + "q25": -0.07520216375000066, + "q75": -0.009359406750002353 + }, + "percent_change": { + "iqr": 2.344414084350921, + "max": 10.786923372962587, + "median": -2.223380970251071, + "min": -3.776237642524971, + "n": 8, + "q25": -2.6590346113748886, + "q75": -0.3146205270239677 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.9558635749999987, + "max": 0.5083718999999998, + "median": -0.5800269250000005, + "min": -1.1511396499999988, + "n": 8, + "q25": -0.8937610499999995, + "q75": 0.06210252499999924 + }, + "percent_change": { + "iqr": 22.670896005919804, + "max": 15.732909718684729, + "median": -13.658584997516993, + "min": -27.591186287027135, + "n": 8, + "q25": -21.34364789459364, + "q75": 1.3272481113261625 + } + } + } + } + }, + "warm-line-8-conservative-no-text": { + "counter_totals": { + "benchmark.frame.output_count": { + "baseline": { + "iqr": 0.0, + "max": 1000.0, + "median": 1000.0, + "min": 1000.0, + "n": 8, + "q25": 1000.0, + "q75": 1000.0 + }, + "candidate": { + "iqr": 0.0, + "max": 1000.0, + "median": 1000.0, + "min": 1000.0, + "n": 8, + "q25": 1000.0, + "q75": 1000.0 + } + }, + "benchmark.ring.occupancy": { + "baseline": { + "iqr": 0.0, + "max": 80000.0, + "median": 80000.0, + "min": 80000.0, + "n": 8, + "q25": 80000.0, + "q75": 80000.0 + }, + "candidate": { + "iqr": 0.0, + "max": 80000.0, + "median": 80000.0, + "min": 80000.0, + "n": 8, + "q25": 80000.0, + "q75": 80000.0 + } + }, + "benchmark.ring.overwritten_samples": { + "baseline": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "candidate": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + }, + "benchmark.ring.published_samples": { + "baseline": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "candidate": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + } + }, + "inclusive_scope_costs": {}, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "baseline": { + "run_means": { + "iqr": 0.0, + "max": 9824, + "median": 9824.0, + "min": 9824, + "n": 8, + "q25": 9824.0, + "q75": 9824.0 + }, + "run_p95s": { + "iqr": 0.0, + "max": 9824.0, + "median": 9824.0, + "min": 9824.0, + "n": 8, + "q25": 9824.0, + "q75": 9824.0 + } + }, + "candidate": { + "run_means": { + "iqr": 0.0, + "max": 9824, + "median": 9824.0, + "min": 9824, + "n": 8, + "q25": 9824.0, + "q75": 9824.0 + }, + "run_p95s": { + "iqr": 0.0, + "max": 9824.0, + "median": 9824.0, + "min": 9824.0, + "n": 8, + "q25": 9824.0, + "q75": 9824.0 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 0.0, + "max": 0, + "median": 0.0, + "min": 0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "percent_change": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "percent_change": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + } + }, + "benchmark.frame.cpu_allocation_count": { + "baseline": { + "run_means": { + "iqr": 0.0, + "max": 130, + "median": 130.0, + "min": 130, + "n": 8, + "q25": 130.0, + "q75": 130.0 + }, + "run_p95s": { + "iqr": 0.0, + "max": 130.0, + "median": 130.0, + "min": 130.0, + "n": 8, + "q25": 130.0, + "q75": 130.0 + } + }, + "candidate": { + "run_means": { + "iqr": 0.0, + "max": 130, + "median": 130.0, + "min": 130, + "n": 8, + "q25": 130.0, + "q75": 130.0 + }, + "run_p95s": { + "iqr": 0.0, + "max": 130.0, + "median": 130.0, + "min": 130.0, + "n": 8, + "q25": 130.0, + "q75": 130.0 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 0.0, + "max": 0, + "median": 0.0, + "min": 0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "percent_change": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "percent_change": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + } + }, + "benchmark.frame.gpu_finish_ms": { + "baseline": { + "run_means": { + "iqr": 1.0371999999999914e-05, + "max": 9.164400000000052e-05, + "median": 5.619550000000014e-05, + "min": 4.411599999999997e-05, + "n": 8, + "q25": 5.294525000000008e-05, + "q75": 6.331725e-05 + }, + "run_p95s": { + "iqr": 2.9250000000000006e-05, + "max": 0.00017, + "median": 0.000155, + "min": 0.00013049999999999954, + "n": 8, + "q25": 0.00014075, + "q75": 0.00017 + } + }, + "candidate": { + "run_means": { + "iqr": 1.2018250000000152e-05, + "max": 7.04920000000002e-05, + "median": 5.507650000000009e-05, + "min": 4.446099999999975e-05, + "n": 8, + "q25": 4.6399749999999884e-05, + "q75": 5.8418000000000036e-05 + }, + "run_p95s": { + "iqr": 3.604999999999974e-05, + "max": 0.00018, + "median": 0.0001405, + "min": 9.999999999999999e-05, + "n": 8, + "q25": 0.00013003749999999996, + "q75": 0.0001660874999999997 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 2.219000000000003e-05, + "max": 1.6636000000000096e-05, + "median": -8.575000000000812e-07, + "min": -3.665900000000036e-05, + "n": 8, + "q25": -1.7112500000000135e-05, + "q75": 5.077499999999893e-06 + }, + "percent_change": { + "iqr": 36.5856002077395, + "max": 30.889780154486157, + "median": -1.1728906136415862, + "min": -40.00152765047373, + "n": 8, + "q25": -26.673989383401576, + "q75": 9.911610824337929 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 1.9962500000000045e-05, + "max": 3.0000000000000024e-05, + "median": -4.524999999999988e-06, + "min": -7.000000000000002e-05, + "n": 8, + "q25": -1.4962500000000045e-05, + "q75": 4.9999999999999996e-06 + }, + "percent_change": { + "iqr": 12.867121848739524, + "max": 20.000000000000018, + "median": -2.7062767635789466, + "min": -41.176470588235304, + "n": 8, + "q25": -9.742121848739524, + "q75": 3.125 + } + } + }, + "benchmark.frame.submission_ms": { + "baseline": { + "run_means": { + "iqr": 0.10372828850000326, + "max": 3.0354408630000034, + "median": 2.7593059225000007, + "min": 2.634589445000001, + "n": 8, + "q25": 2.6898574609999995, + "q75": 2.7935857495000027 + }, + "run_p95s": { + "iqr": 0.9288925750000003, + "max": 4.63606825, + "median": 3.6964564749999997, + "min": 3.0125372999999995, + "n": 8, + "q25": 3.2492908375, + "q75": 4.1781834125 + } + }, + "candidate": { + "run_means": { + "iqr": 0.1476750587500022, + "max": 2.976196915, + "median": 2.7314523845000025, + "min": 2.6214961509999997, + "n": 8, + "q25": 2.67312509725, + "q75": 2.820800156000002 + }, + "run_p95s": { + "iqr": 1.0964553499999998, + "max": 4.468894399999998, + "median": 3.5875367749999993, + "min": 3.0206138000000005, + "n": 8, + "q25": 3.2078739124999998, + "q75": 4.3043292625 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 0.10216308950000252, + "max": 0.1489469850000007, + "median": -0.022131506500000953, + "min": -0.10654266900000309, + "n": 8, + "q25": -0.07579282549999988, + "q75": 0.02637026400000264 + }, + "percent_change": { + "iqr": 3.775197248111814, + "max": 5.5463251054228335, + "median": -0.7084749379115185, + "min": -3.8265958029670366, + "n": 8, + "q25": -2.7850985027183555, + "q75": 0.9900987453934584 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.5777006750000001, + "max": 1.16733165, + "median": -0.03605835000000157, + "min": -0.9455590999999997, + "n": 8, + "q25": -0.3668840999999997, + "q75": 0.2108165750000004 + }, + "percent_change": { + "iqr": 16.665936575174072, + "max": 36.0471976665345, + "median": -0.6646948756346527, + "min": -22.58719353924814, + "n": 8, + "q25": -10.027781492346788, + "q75": 6.638155082827286 + } + } + }, + "benchmark.frame.total_ms": { + "baseline": { + "run_means": { + "iqr": 0.10374559675000272, + "max": 3.0355859729999977, + "median": 2.759461022500002, + "min": 2.634729146000002, + "n": 8, + "q25": 2.689998064499999, + "q75": 2.7937436612500015 + }, + "run_p95s": { + "iqr": 0.9288549000000006, + "max": 4.636519749999999, + "median": 3.696663224999999, + "min": 3.01266825, + "n": 8, + "q25": 3.2494570499999997, + "q75": 4.17831195 + } + }, + "candidate": { + "run_means": { + "iqr": 0.14766574875000282, + "max": 2.976346758000004, + "median": 2.7316229714999984, + "min": 2.6216400609999977, + "n": 8, + "q25": 2.673280001249995, + "q75": 2.8209457499999977 + }, + "run_p95s": { + "iqr": 1.0965069375, + "max": 4.469033949999998, + "median": 3.5877317499999997, + "min": 3.0207443, + "n": 8, + "q25": 3.2081051499999997, + "q75": 4.3046120875 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 0.10215795799999616, + "max": 0.1489763400000066, + "median": -0.022130089999999436, + "min": -0.10656450200000789, + "n": 8, + "q25": -0.07578483475000197, + "q75": 0.02637312324999419 + }, + "percent_change": { + "iqr": 3.774806933587432, + "max": 5.54713757306875, + "median": -0.7083976955430449, + "min": -3.8271281707216054, + "n": 8, + "q25": -2.7846585220284603, + "q75": 0.990148411558972 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.5776449, + "max": 1.1673391, + "median": -0.03613212500000085, + "min": -0.9454516000000002, + "n": 8, + "q25": -0.3668589499999998, + "q75": 0.21078595000000022 + }, + "percent_change": { + "iqr": 16.663560594132058, + "max": 36.044383529531345, + "median": -0.6659472357740059, + "min": -22.583778642319373, + "n": 8, + "q25": -10.026786149280097, + "q75": 6.636774444851961 + } + } + } + } + } + }, + "frames_per_process": 1000, + "interpretation": { + "access_semantics": "Stable access identifies immutable benchmark callbacks so production caches can be exercised. The conservative control preserves uncached callback semantics; this workload correction is not a production optimization.", + "allocations": "C++ allocations observed on the render thread; excludes profiler storage, malloc-only and other-thread allocations.", + "cold": "Setup and cold observations remain in raw reports and are not mixed into warm-frame statistics.", + "frame_total": "Wall time for offscreen frame work, including QRhi completion with --finish; not application FPS or CPU time.", + "percent_change": "100 * (candidate / paired baseline - 1); negative means lower cost.", + "replicate": "One fresh process. No pooling of frames as independent replicates.", + "scope_costs": "Inclusive instrumented CPU-side scope wall times; nested scopes must not be added.", + "spread": "IQR and min/max describe process-to-process variation, not a confidence interval.", + "submission": "Includes begin/endOffscreenFrame and any backend synchronization they perform.", + "validation": "Timing runs exclude pixel readback. Validate pixels/semantics separately before accepting an optimization." + }, + "repetitions": 8, + "schema_version": 1 + }, + "warmup_frames": 100 + }, + "same-image-ab-settled": { + "created_at": "2026-11-04T01:47:18.780775+00:00", + "ended_at": "2026-11-04T01:48:01.989657+00:00", + "executables": { + "baseline": { + "bytes": 2074680, + "git_at_binary_location": null, + "path": "/workspace/scratch/2a7852710aa2/build-same-image/benchmark/vnm_plot_benchmark", + "sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473" + }, + "candidate": { + "bytes": 2074680, + "git_at_binary_location": null, + "path": "/workspace/scratch/2a7852710aa2/build-same-image/benchmark/vnm_plot_benchmark", + "sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473" + } + }, + "frames": 50000, + "graphics_backend": "null", + "host": { + "cpu_affinity": [ + 8 + ], + "cpu_count": 9, + "cpu_model": "AMD EPYC 9V74 80-Core Processor", + "machine": "x86_64", + "platform": "Linux-6.18.57-x86_64-with-glibc2.39", + "python": "3.12.3", + "renderer_environment": { + "GALLIUM_DRIVER": null, + "LIBGL_ALWAYS_SOFTWARE": null, + "LP_NUM_THREADS": null, + "MESA_LOADER_DRIVER_OVERRIDE": null, + "QSG_RENDER_LOOP": null, + "QSG_RHI_BACKEND": null, + "QT_FONT_DPI": null, + "QT_QPA_PLATFORM": "offscreen", + "QT_SCALE_FACTOR": null, + "QT_SCREEN_SCALE_FACTORS": null, + "XDG_CACHE_HOME": null + } + }, + "internal_profiling": false, + "repetitions": 8, + "run_order": [ + { + "case": "warm-line-8", + "repetition": 0, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "repetition": 0, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "repetition": 1, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "repetition": 1, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "repetition": 2, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "repetition": 2, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "repetition": 3, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "repetition": 3, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "repetition": 4, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "repetition": 4, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "repetition": 5, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "repetition": 5, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "repetition": 6, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "repetition": 6, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "repetition": 7, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "repetition": 7, + "variant": "baseline" + } + ], + "runs": [ + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.4930399999986862e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.034745819020000686, + "p95": 0.058192049999999995 + }, + "benchmark.frame.total_ms": { + "mean": 0.03483721394000098, + "p95": 0.0563795 + } + }, + "raw_report": "warm-line-8/01-baseline/inspector_benchmark_20261104_014719_542_SIM_Bars.json", + "repetition": 0, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13056, + "p95": 13056.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 152, + "p95": 152.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.7393719999984563e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.033489749840000506, + "p95": 0.062905 + }, + "benchmark.frame.total_ms": { + "mean": 0.03358132602000036, + "p95": 0.060806449999999984 + } + }, + "raw_report": "warm-line-8/01-candidate/inspector_benchmark_20261104_014722_088_SIM_Bars.json", + "repetition": 0, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=1" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13056, + "p95": 13056.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 152, + "p95": 152.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.666351999998793e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03327475932000017, + "p95": 0.06137044999999999 + }, + "benchmark.frame.total_ms": { + "mean": 0.03337307257999999, + "p95": 0.059329449999999964 + } + }, + "raw_report": "warm-line-8/02-candidate/inspector_benchmark_20261104_014724_673_SIM_Bars.json", + "repetition": 1, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=1" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.5685519999987303e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03498023019999926, + "p95": 0.05895094999999999 + }, + "benchmark.frame.total_ms": { + "mean": 0.03508072933999905, + "p95": 0.060971949999999914 + } + }, + "raw_report": "warm-line-8/02-baseline/inspector_benchmark_20261104_014727_290_SIM_Bars.json", + "repetition": 1, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.7435899999983496e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.037521391479999784, + "p95": 0.06492549999999994 + }, + "benchmark.frame.total_ms": { + "mean": 0.037617136999999516, + "p95": 0.0688365 + } + }, + "raw_report": "warm-line-8/03-baseline/inspector_benchmark_20261104_014729_976_SIM_Bars.json", + "repetition": 2, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13056, + "p95": 13056.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 152, + "p95": 152.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.7089299999984853e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03695496941999978, + "p95": 0.08046404999999998 + }, + "benchmark.frame.total_ms": { + "mean": 0.03704698034000024, + "p95": 0.079118 + } + }, + "raw_report": "warm-line-8/03-candidate/inspector_benchmark_20261104_014732_737_SIM_Bars.json", + "repetition": 2, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=1" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13056, + "p95": 13056.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 152, + "p95": 152.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.8136859999984166e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.033886389620000526, + "p95": 0.07030244999999981 + }, + "benchmark.frame.total_ms": { + "mean": 0.03398288536000013, + "p95": 0.06281999999999999 + } + }, + "raw_report": "warm-line-8/04-candidate/inspector_benchmark_20261104_014735_520_SIM_Bars.json", + "repetition": 3, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=1" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.6820179999984597e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03498939602000036, + "p95": 0.06331049999999996 + }, + "benchmark.frame.total_ms": { + "mean": 0.03508229749999975, + "p95": 0.06061299999999997 + } + }, + "raw_report": "warm-line-8/04-baseline/inspector_benchmark_20261104_014738_126_SIM_Bars.json", + "repetition": 3, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 3.070329999998398e-05, + "p95": 3.1e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.037707175640000604, + "p95": 0.0687565 + }, + "benchmark.frame.total_ms": { + "mean": 0.03780597986000031, + "p95": 0.06542299999999998 + } + }, + "raw_report": "warm-line-8/05-baseline/inspector_benchmark_20261104_014740_859_SIM_Bars.json", + "repetition": 4, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13056, + "p95": 13056.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 152, + "p95": 152.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.546899999998948e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.0333526085399999, + "p95": 0.06186999999999999 + }, + "benchmark.frame.total_ms": { + "mean": 0.03345216297999967, + "p95": 0.06020994999999994 + } + }, + "raw_report": "warm-line-8/05-candidate/inspector_benchmark_20261104_014743_648_SIM_Bars.json", + "repetition": 4, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=1" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13056, + "p95": 13056.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 152, + "p95": 152.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.7884499999983358e-05, + "p95": 3.1e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03233208006000051, + "p95": 0.0517425 + }, + "benchmark.frame.total_ms": { + "mean": 0.03242391166000049, + "p95": 0.05172749999999998 + } + }, + "raw_report": "warm-line-8/06-candidate/inspector_benchmark_20261104_014746_200_SIM_Bars.json", + "repetition": 5, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=1" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.6985359999988475e-05, + "p95": 3.1e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.034105242620000635, + "p95": 0.0574205 + }, + "benchmark.frame.total_ms": { + "mean": 0.03420741880000048, + "p95": 0.05948594999999997 + } + }, + "raw_report": "warm-line-8/06-baseline/inspector_benchmark_20261104_014748_650_SIM_Bars.json", + "repetition": 5, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.732583999998861e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03352152301999914, + "p95": 0.045536999999999994 + }, + "benchmark.frame.total_ms": { + "mean": 0.0336219821599992, + "p95": 0.047337049999999964 + } + }, + "raw_report": "warm-line-8/07-baseline/inspector_benchmark_20261104_014751_327_SIM_Bars.json", + "repetition": 6, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13056, + "p95": 13056.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 152, + "p95": 152.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.5981239999989792e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.035869976459999904, + "p95": 0.050556449999999996 + }, + "benchmark.frame.total_ms": { + "mean": 0.035963933520000026, + "p95": 0.051379499999999995 + } + }, + "raw_report": "warm-line-8/07-candidate/inspector_benchmark_20261104_014754_041_SIM_Bars.json", + "repetition": 6, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=1" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13056, + "p95": 13056.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 152, + "p95": 152.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 2.7662999999984885e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.03320437392000015, + "p95": 0.047568999999999986 + }, + "benchmark.frame.total_ms": { + "mean": 0.03330071591999986, + "p95": 0.04790444999999997 + } + }, + "raw_report": "warm-line-8/08-candidate/inspector_benchmark_20261104_014756_790_SIM_Bars.json", + "repetition": 7, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=1" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "1" + }, + "validation": "valid" + }, + "variant": "candidate" + }, + { + "case": "warm-line-8", + "counters": { + "benchmark.frame.output_count": 50000.0, + "benchmark.ring.occupancy": 80000.0, + "benchmark.ring.overwritten_samples": 0.0, + "benchmark.ring.published_samples": 0.0 + }, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "mean": 13952, + "p95": 13952.0 + }, + "benchmark.frame.cpu_allocation_count": { + "mean": 190, + "p95": 190.0 + }, + "benchmark.frame.gpu_finish_ms": { + "mean": 3.7642539999983466e-05, + "p95": 2.9999999999999997e-05 + }, + "benchmark.frame.submission_ms": { + "mean": 0.04375156137999995, + "p95": 0.0796035 + }, + "benchmark.frame.total_ms": { + "mean": 0.043854263380000064, + "p95": 0.08447799999999997 + } + }, + "raw_report": "warm-line-8/08-baseline/inspector_benchmark_20261104_014759_632_SIM_Bars.json", + "repetition": 7, + "same_image_diagnostic": { + "actual_mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ], + "executable_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "mode_read_expected": true, + "requested_environment": { + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC": "0" + }, + "validation": "valid" + }, + "variant": "baseline" + } + ], + "status": "complete", + "summary": { + "cases": { + "warm-line-8": { + "counter_totals": { + "benchmark.frame.output_count": { + "baseline": { + "iqr": 0.0, + "max": 50000.0, + "median": 50000.0, + "min": 50000.0, + "n": 8, + "q25": 50000.0, + "q75": 50000.0 + }, + "candidate": { + "iqr": 0.0, + "max": 50000.0, + "median": 50000.0, + "min": 50000.0, + "n": 8, + "q25": 50000.0, + "q75": 50000.0 + } + }, + "benchmark.ring.occupancy": { + "baseline": { + "iqr": 0.0, + "max": 80000.0, + "median": 80000.0, + "min": 80000.0, + "n": 8, + "q25": 80000.0, + "q75": 80000.0 + }, + "candidate": { + "iqr": 0.0, + "max": 80000.0, + "median": 80000.0, + "min": 80000.0, + "n": 8, + "q25": 80000.0, + "q75": 80000.0 + } + }, + "benchmark.ring.overwritten_samples": { + "baseline": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "candidate": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + }, + "benchmark.ring.published_samples": { + "baseline": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "candidate": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": 0.0, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + } + }, + "inclusive_scope_costs": {}, + "metrics": { + "benchmark.frame.cpu_allocation_bytes": { + "baseline": { + "run_means": { + "iqr": 0.0, + "max": 13952, + "median": 13952.0, + "min": 13952, + "n": 8, + "q25": 13952.0, + "q75": 13952.0 + }, + "run_p95s": { + "iqr": 0.0, + "max": 13952.0, + "median": 13952.0, + "min": 13952.0, + "n": 8, + "q25": 13952.0, + "q75": 13952.0 + } + }, + "candidate": { + "run_means": { + "iqr": 0.0, + "max": 13056, + "median": 13056.0, + "min": 13056, + "n": 8, + "q25": 13056.0, + "q75": 13056.0 + }, + "run_p95s": { + "iqr": 0.0, + "max": 13056.0, + "median": 13056.0, + "min": 13056.0, + "n": 8, + "q25": 13056.0, + "q75": 13056.0 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 0.0, + "max": -896, + "median": -896.0, + "min": -896, + "n": 8, + "q25": -896.0, + "q75": -896.0 + }, + "percent_change": { + "iqr": 0.0, + "max": -6.422018348623848, + "median": -6.422018348623848, + "min": -6.422018348623848, + "n": 8, + "q25": -6.422018348623848, + "q75": -6.422018348623848 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.0, + "max": -896.0, + "median": -896.0, + "min": -896.0, + "n": 8, + "q25": -896.0, + "q75": -896.0 + }, + "percent_change": { + "iqr": 0.0, + "max": -6.422018348623848, + "median": -6.422018348623848, + "min": -6.422018348623848, + "n": 8, + "q25": -6.422018348623848, + "q75": -6.422018348623848 + } + } + }, + "benchmark.frame.cpu_allocation_count": { + "baseline": { + "run_means": { + "iqr": 0.0, + "max": 190, + "median": 190.0, + "min": 190, + "n": 8, + "q25": 190.0, + "q75": 190.0 + }, + "run_p95s": { + "iqr": 0.0, + "max": 190.0, + "median": 190.0, + "min": 190.0, + "n": 8, + "q25": 190.0, + "q75": 190.0 + } + }, + "candidate": { + "run_means": { + "iqr": 0.0, + "max": 152, + "median": 152.0, + "min": 152, + "n": 8, + "q25": 152.0, + "q75": 152.0 + }, + "run_p95s": { + "iqr": 0.0, + "max": 152.0, + "median": 152.0, + "min": 152.0, + "n": 8, + "q25": 152.0, + "q75": 152.0 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 0.0, + "max": -38, + "median": -38.0, + "min": -38, + "n": 8, + "q25": -38.0, + "q75": -38.0 + }, + "percent_change": { + "iqr": 0.0, + "max": -19.999999999999996, + "median": -19.999999999999996, + "min": -19.999999999999996, + "n": 8, + "q25": -19.999999999999996, + "q75": -19.999999999999996 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.0, + "max": -38.0, + "median": -38.0, + "min": -38.0, + "n": 8, + "q25": -38.0, + "q75": -38.0 + }, + "percent_change": { + "iqr": 0.0, + "max": -19.999999999999996, + "median": -19.999999999999996, + "min": -19.999999999999996, + "n": 8, + "q25": -19.999999999999996, + "q75": -19.999999999999996 + } + } + }, + "benchmark.frame.gpu_finish_ms": { + "baseline": { + "run_means": { + "iqr": 1.7162349999983412e-06, + "max": 3.7642539999983466e-05, + "median": 2.7155599999988543e-05, + "min": 2.4930399999986862e-05, + "n": 8, + "q25": 2.6536514999985275e-05, + "q75": 2.8252749999983617e-05 + }, + "run_p95s": { + "iqr": 2.499999999999993e-07, + "max": 3.1e-05, + "median": 2.9999999999999997e-05, + "min": 2.9999999999999997e-05, + "n": 8, + "q25": 2.9999999999999997e-05, + "q75": 3.0249999999999997e-05 + } + }, + "candidate": { + "run_means": { + "iqr": 1.225424999996109e-06, + "max": 2.8136859999984166e-05, + "median": 2.7241509999984707e-05, + "min": 2.546899999998948e-05, + "n": 8, + "q25": 2.6492949999988394e-05, + "q75": 2.7718374999984503e-05 + }, + "run_p95s": { + "iqr": 0.0, + "max": 3.1e-05, + "median": 2.9999999999999997e-05, + "min": 2.9999999999999997e-05, + "n": 8, + "q25": 2.9999999999999997e-05, + "q75": 2.9999999999999997e-05 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 3.3796949999981015e-06, + "max": 2.4633199999977015e-06, + "median": 2.7626999999812025e-07, + "min": -9.979539999998581e-06, + "n": 8, + "q25": -2.3170249999977393e-06, + "q75": 1.0626700000003621e-06 + }, + "percent_change": { + "iqr": 12.035480783146943, + "max": 9.880788114105666, + "median": 1.0343232574632155, + "min": -26.51133531372475, + "n": 8, + "q25": -7.952464099393838, + "q75": 4.083016683753105 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": -1.000000000000004e-06, + "n": 8, + "q25": 0.0, + "q75": 0.0 + }, + "percent_change": { + "iqr": 0.0, + "max": 0.0, + "median": 0.0, + "min": -3.2258064516129115, + "n": 8, + "q25": 0.0, + "q75": 0.0 + } + } + }, + "benchmark.frame.submission_ms": { + "baseline": { + "run_means": { + "iqr": 0.0029821625999993176, + "max": 0.04375156137999995, + "median": 0.03498481310999981, + "min": 0.03352152301999914, + "n": 8, + "q25": 0.03458567492000067, + "q75": 0.03756783751999999 + }, + "run_p95s": { + "iqr": 0.007884087499999956, + "max": 0.0796035, + "median": 0.061130724999999976, + "min": 0.045536999999999994, + "n": 8, + "q25": 0.05799916249999999, + "q75": 0.06588324999999995 + } + }, + "candidate": { + "run_means": { + "iqr": 0.001125123360000202, + "max": 0.03695496941999978, + "median": 0.033421179190000205, + "min": 0.03233208006000051, + "n": 8, + "q25": 0.03325716297000017, + "q75": 0.03438228633000037 + }, + "run_p95s": { + "iqr": 0.013308374999999956, + "max": 0.08046404999999998, + "median": 0.06162022499999999, + "min": 0.047568999999999986, + "n": 8, + "q25": 0.0514459875, + "q75": 0.06475436249999995 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 0.0014496533800003927, + "max": 0.0023484534400007653, + "median": -0.001480770029999634, + "min": -0.010547187459999802, + "n": 8, + "q25": -0.0024185136950002697, + "q75": -0.0009688603149998771 + }, + "percent_change": { + "iqr": 4.044711732105377, + "max": 7.005807697340205, + "median": -4.245275202519888, + "min": -24.106996704399254, + "n": 8, + "q25": -6.786412612542216, + "q75": -2.7417008804368397 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.011492699999999967, + "max": 0.01553855000000004, + "median": 0.003566225000000006, + "min": -0.03203450000000001, + "n": 8, + "q25": -0.0059801250000000045, + "q75": 0.005512574999999962 + }, + "percent_change": { + "iqr": 20.94835759085339, + "max": 23.932892315038078, + "median": 6.101609046436018, + "min": -40.242577273612355, + "n": 8, + "q25": -9.92028593543216, + "q75": 11.028071655421233 + } + } + }, + "benchmark.frame.total_ms": { + "baseline": { + "run_means": { + "iqr": 0.0029845825599988593, + "max": 0.043854263380000064, + "median": 0.0350815134199994, + "min": 0.0336219821599992, + "n": 8, + "q25": 0.034679765155000854, + "q75": 0.03766434771499971 + }, + "run_p95s": { + "iqr": 0.007567037500000012, + "max": 0.08447799999999997, + "median": 0.06079247499999994, + "min": 0.047337049999999964, + "n": 8, + "q25": 0.05870933749999997, + "q75": 0.06627637499999998 + } + }, + "candidate": { + "run_means": { + "iqr": 0.0011231639850001474, + "max": 0.03704698034000024, + "median": 0.033516744500000015, + "min": 0.03242391166000049, + "n": 8, + "q25": 0.033354983414999956, + "q75": 0.0344781474000001 + }, + "run_p95s": { + "iqr": 0.0096693375, + "max": 0.079118, + "median": 0.05976969999999995, + "min": 0.04790444999999997, + "n": 8, + "q25": 0.051640499999999985, + "q75": 0.061309837499999985 + } + }, + "paired_means": { + "absolute_change": { + "iqr": 0.0014589863050006192, + "max": 0.0023419513600008227, + "median": -0.00148177233999984, + "min": -0.010553547460000201, + "n": 8, + "q25": -0.00242608457500015, + "q75": -0.000967098269999531 + }, + "percent_change": { + "iqr": 4.060127227337027, + "max": 6.965536263912164, + "median": -4.236404873173255, + "min": -24.06504327424912, + "n": 8, + "q25": -6.789404679339128, + "q75": -2.7292774520021017 + } + }, + "paired_p95s": { + "absolute_change": { + "iqr": 0.009987975000000045, + "max": 0.010281499999999999, + "median": 0.0002822500000000325, + "min": -0.036573549999999996, + "n": 8, + "q25": -0.005849400000000025, + "q75": 0.004138575000000019 + }, + "percent_change": { + "iqr": 17.260760835536864, + "max": 14.93611674039208, + "median": 0.4736357023414517, + "min": -43.293579393451566, + "n": 8, + "q25": -9.236789525224726, + "q75": 8.023971310312138 + } + } + } + } + } + }, + "frames_per_process": 50000, + "interpretation": { + "access_semantics": "Stable access identifies immutable benchmark callbacks so production caches can be exercised. The conservative control preserves uncached callback semantics; this workload correction is not a production optimization.", + "allocations": "C++ allocations observed on the render thread; excludes profiler storage, malloc-only and other-thread allocations.", + "cold": "Setup and cold observations remain in raw reports and are not mixed into warm-frame statistics.", + "frame_total": "Wall time for offscreen frame work, including QRhi completion with --finish; not application FPS or CPU time.", + "percent_change": "100 * (candidate / paired baseline - 1); negative means lower cost.", + "replicate": "One fresh process. No pooling of frames as independent replicates.", + "scope_costs": "Inclusive instrumented CPU-side scope wall times; nested scopes must not be added.", + "spread": "IQR and min/max describe process-to-process variation, not a confidence interval.", + "submission": "Includes begin/endOffscreenFrame and any backend synchronization they perform.", + "validation": "Timing runs exclude pixel readback. Validate pixels/semantics separately before accepting an optimization." + }, + "repetitions": 8, + "schema_version": 1 + }, + "warmup_frames": 20000 + } + }, + "initial_plan": { + "backend": "null", + "binary_sha256": { + "baseline": "a421c9d8832519110d6bc0eb2253916798eef0d30512f5359f46673c51f29f5d", + "candidate": "77cfcf554e536ae0adfb4575ae8e7cf89623aa13fa99003e7df5088b96b21c9d" + }, + "campaigns": [ + { + "baseline": "baseline", + "candidate": "baseline", + "cases": [ + "warm-line-8-no-text", + "warm-line-8-conservative-no-text" + ], + "name": "retained-aa", + "repetitions": 8 + }, + { + "baseline": "baseline", + "candidate": "candidate", + "cases": [ + "warm-line-8-no-text", + "warm-line-8-conservative", + "warm-line-8-conservative-no-text" + ], + "name": "retained-ab", + "repetitions": 8 + } + ], + "cpu_affinity": [ + 8 + ], + "created_at": "2026-11-04T01:32:15.682916+00:00", + "decision_rules": [ + "Retain all observations and failed invocations; no favorable-result retries.", + "If identical-binary variation is comparable to the effect, timing remains unresolved.", + "If no-text slowdown reproduces, inspect source-independent binary/layout effects and do one causally motivated follow-up.", + "Allocation and timing findings remain separate; native pixel/render tests required before promotion.", + "Do not repeat the full original campaign or rebuild unchanged dependencies without a concrete reason." + ], + "frame_timing_only": true, + "frames": 1000, + "original_affinity": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8 + ], + "purpose": "Continue PR30; assess reproducibility of conservative/no-text slowdown before promoting label optimization", + "warmup_frames": 100 + }, + "publication": { + "foundation_compiled_source": { + "branch": "perf/benchmark-foundation-20261104", + "local_commit": "043e0a61d6e0a4127399aa341c397249634e4791", + "published_commit": "ca15d8cea331fb70a923bcb1a8c75ede3493882f", + "tree": "3de490e5f6e139ec3d82e6b56d8cad31dba2a16c" + }, + "note": "API-created commits have different identifiers; published Git tree IDs match the compiled local source trees exactly. Final report-only commits may follow the compiled foundation revision.", + "pr": "https://github.com/Varinomics/vnm_plot/pull/30", + "same_image_compiled_source": { + "branch": "diagnostic/label-membership-same-image-20261104", + "local_commit": "41a0088fe1faf4a85b21638631e32b80501c6c70", + "published_commit": "94a3d43388f91ea5213c2057c3f5f20fad2091a2", + "tree": "589e8d34144d80a04b5b338cadb7bc4acc6a1a28" + } + }, + "raw_validation": { + "notes": [ + "All campaign manifests completed; frame observation counts match requested frames.", + "All workload-v3 reports contain no renderer scopes/observations or disabled internal preparation metrics.", + "Allocation minimum and maximum match for every workload-v3 measured process.", + "Duration percentiles on 50000-frame runs use the existing deterministic reservoir of 8192 retained samples; count, total, mean, minimum and maximum cover every observed frame." + ], + "records": [ + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-aa", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.622670999999997, + "raw_report": "warm-line-8-no-text/01-baseline/inspector_benchmark_20261104_013216_181_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 16.276029 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-aa", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.941831999999998, + "raw_report": "warm-line-8-no-text/01-candidate/inspector_benchmark_20261104_013216_245_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 14.813303000000001 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-aa", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2611.485979, + "raw_report": "warm-line-8-conservative-no-text/01-baseline/inspector_benchmark_20261104_013216_571_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 272.935429 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-aa", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2610.8618039999997, + "raw_report": "warm-line-8-conservative-no-text/01-candidate/inspector_benchmark_20261104_013219_535_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 301.591974 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-aa", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.001002999999997, + "raw_report": "warm-line-8-no-text/02-candidate/inspector_benchmark_20261104_013222_229_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 17.512686 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-aa", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.363201, + "raw_report": "warm-line-8-no-text/02-baseline/inspector_benchmark_20261104_013222_295_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 14.7445 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-aa", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2687.2051460000002, + "raw_report": "warm-line-8-conservative-no-text/02-candidate/inspector_benchmark_20261104_013222_611_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 264.28283899999997 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-aa", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2620.3144890000003, + "raw_report": "warm-line-8-conservative-no-text/02-baseline/inspector_benchmark_20261104_013225_638_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 260.121699 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-aa", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.591173000000001, + "raw_report": "warm-line-8-no-text/03-baseline/inspector_benchmark_20261104_013228_325_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 16.146414 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-aa", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 12.492642, + "raw_report": "warm-line-8-no-text/03-candidate/inspector_benchmark_20261104_013228_401_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 16.508468999999998 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-aa", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2643.529308, + "raw_report": "warm-line-8-conservative-no-text/03-baseline/inspector_benchmark_20261104_013228_778_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 275.409247 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-aa", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2638.0571330000002, + "raw_report": "warm-line-8-conservative-no-text/03-candidate/inspector_benchmark_20261104_013231_743_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 262.61589999999995 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-aa", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 14.335400999999997, + "raw_report": "warm-line-8-no-text/04-candidate/inspector_benchmark_20261104_013234_487_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 18.912323 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-aa", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.878764999999998, + "raw_report": "warm-line-8-no-text/04-baseline/inspector_benchmark_20261104_013234_606_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 15.978898999999998 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-aa", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2629.0080439999997, + "raw_report": "warm-line-8-conservative-no-text/04-candidate/inspector_benchmark_20261104_013234_937_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 279.70839900000004 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-aa", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2687.987228, + "raw_report": "warm-line-8-conservative-no-text/04-baseline/inspector_benchmark_20261104_013237_913_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 274.29014700000005 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-aa", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.105611000000003, + "raw_report": "warm-line-8-no-text/05-baseline/inspector_benchmark_20261104_013240_687_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 15.504014999999999 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-aa", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 12.108263, + "raw_report": "warm-line-8-no-text/05-candidate/inspector_benchmark_20261104_013240_762_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 17.291271000000002 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-aa", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2630.223418, + "raw_report": "warm-line-8-conservative-no-text/05-baseline/inspector_benchmark_20261104_013241_070_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 257.212415 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-aa", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2656.923625, + "raw_report": "warm-line-8-conservative-no-text/05-candidate/inspector_benchmark_20261104_013244_016_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 268.345547 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-aa", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 12.175934999999999, + "raw_report": "warm-line-8-no-text/06-candidate/inspector_benchmark_20261104_013246_743_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 17.670341999999998 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-aa", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 12.277138000000004, + "raw_report": "warm-line-8-no-text/06-baseline/inspector_benchmark_20261104_013246_813_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 14.372218000000002 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-aa", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2577.19962, + "raw_report": "warm-line-8-conservative-no-text/06-candidate/inspector_benchmark_20261104_013247_141_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 269.684387 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-aa", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2566.498671, + "raw_report": "warm-line-8-conservative-no-text/06-baseline/inspector_benchmark_20261104_013250_067_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 265.162754 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-aa", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.526055000000003, + "raw_report": "warm-line-8-no-text/07-baseline/inspector_benchmark_20261104_013252_709_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 17.226533 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-aa", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 12.301143, + "raw_report": "warm-line-8-no-text/07-candidate/inspector_benchmark_20261104_013252_780_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 16.040153000000004 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-aa", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2749.715381, + "raw_report": "warm-line-8-conservative-no-text/07-baseline/inspector_benchmark_20261104_013253_175_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 336.425095 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-aa", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2828.135533, + "raw_report": "warm-line-8-conservative-no-text/07-candidate/inspector_benchmark_20261104_013256_273_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 281.700478 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-aa", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 12.472863, + "raw_report": "warm-line-8-no-text/08-candidate/inspector_benchmark_20261104_013259_197_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 17.639885 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-aa", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 12.581675999999998, + "raw_report": "warm-line-8-no-text/08-baseline/inspector_benchmark_20261104_013259_269_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 16.393757 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-aa", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2919.080993, + "raw_report": "warm-line-8-conservative-no-text/08-candidate/inspector_benchmark_20261104_013259_643_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 309.079443 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-aa", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2691.063169, + "raw_report": "warm-line-8-conservative-no-text/08-baseline/inspector_benchmark_20261104_013302_955_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 322.271164 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-ab", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.172511999999998, + "raw_report": "warm-line-8-no-text/01-baseline/inspector_benchmark_20261104_013321_487_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 15.676483999999999 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-ab", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.141223999999998, + "raw_report": "warm-line-8-no-text/01-candidate/inspector_benchmark_20261104_013321_553_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 14.639741 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 14464, + "mean": 14464, + "min": 14464 + }, + "allocation_count": { + "count": 1000, + "max": 206, + "mean": 206, + "min": 206 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2616.073996, + "raw_report": "warm-line-8-conservative/01-baseline/inspector_benchmark_20261104_013323_398_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 1791.5069349999999 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 13568, + "mean": 13568, + "min": 13568 + }, + "allocation_count": { + "count": 1000, + "max": 168, + "mean": 168, + "min": 168 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2841.8078339999993, + "raw_report": "warm-line-8-conservative/01-candidate/inspector_benchmark_20261104_013327_959_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 1863.328708 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2618.162047, + "raw_report": "warm-line-8-conservative-no-text/01-baseline/inspector_benchmark_20261104_013331_176_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 286.572872 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2729.39647, + "raw_report": "warm-line-8-conservative-no-text/01-candidate/inspector_benchmark_20261104_013334_110_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 272.743835 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-ab", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.214244, + "raw_report": "warm-line-8-no-text/02-candidate/inspector_benchmark_20261104_013336_931_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 16.1636 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-ab", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 12.989872999999996, + "raw_report": "warm-line-8-no-text/02-baseline/inspector_benchmark_20261104_013336_999_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 15.979101000000002 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 13568, + "mean": 13568, + "min": 13568 + }, + "allocation_count": { + "count": 1000, + "max": 168, + "mean": 168, + "min": 168 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2758.4626710000002, + "raw_report": "warm-line-8-conservative/02-candidate/inspector_benchmark_20261104_013337_359_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 308.11656700000003 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 14464, + "mean": 14464, + "min": 14464 + }, + "allocation_count": { + "count": 1000, + "max": 206, + "mean": 206, + "min": 206 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2704.4763940000003, + "raw_report": "warm-line-8-conservative/02-baseline/inspector_benchmark_20261104_013340_512_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 327.04034 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2792.065562, + "raw_report": "warm-line-8-conservative-no-text/02-candidate/inspector_benchmark_20261104_013343_537_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 274.52271800000005 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2597.016045, + "raw_report": "warm-line-8-conservative-no-text/02-baseline/inspector_benchmark_20261104_013346_653_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 258.507053 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-ab", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.434807, + "raw_report": "warm-line-8-no-text/03-baseline/inspector_benchmark_20261104_013349_346_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 17.221366 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-ab", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.191059, + "raw_report": "warm-line-8-no-text/03-candidate/inspector_benchmark_20261104_013349_425_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 16.456180000000003 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 14464, + "mean": 14464, + "min": 14464 + }, + "allocation_count": { + "count": 1000, + "max": 206, + "mean": 206, + "min": 206 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 3375.302628, + "raw_report": "warm-line-8-conservative/03-baseline/inspector_benchmark_20261104_013349_851_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 370.84020300000003 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 13568, + "mean": 13568, + "min": 13568 + }, + "allocation_count": { + "count": 1000, + "max": 168, + "mean": 168, + "min": 168 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2930.62711, + "raw_report": "warm-line-8-conservative/03-candidate/inspector_benchmark_20261104_013353_608_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 340.216883 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2918.037502, + "raw_report": "warm-line-8-conservative-no-text/03-baseline/inspector_benchmark_20261104_013356_872_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 269.21269900000004 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2932.184042, + "raw_report": "warm-line-8-conservative-no-text/03-candidate/inspector_benchmark_20261104_013400_156_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 301.827202 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-ab", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.627890000000004, + "raw_report": "warm-line-8-no-text/04-candidate/inspector_benchmark_20261104_013403_161_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 16.335286 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-ab", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.967131999999996, + "raw_report": "warm-line-8-no-text/04-baseline/inspector_benchmark_20261104_013403_231_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 17.438609 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 13568, + "mean": 13568, + "min": 13568 + }, + "allocation_count": { + "count": 1000, + "max": 168, + "mean": 168, + "min": 168 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2946.614982, + "raw_report": "warm-line-8-conservative/04-candidate/inspector_benchmark_20261104_013403_675_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 336.77459 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 14464, + "mean": 14464, + "min": 14464 + }, + "allocation_count": { + "count": 1000, + "max": 206, + "mean": 206, + "min": 206 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2748.647011, + "raw_report": "warm-line-8-conservative/04-baseline/inspector_benchmark_20261104_013406_974_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 297.674548 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2864.448273, + "raw_report": "warm-line-8-conservative-no-text/04-candidate/inspector_benchmark_20261104_013410_117_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 304.800856 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2725.453222, + "raw_report": "warm-line-8-conservative-no-text/04-baseline/inspector_benchmark_20261104_013413_329_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 285.558686 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-ab", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.932417999999998, + "raw_report": "warm-line-8-no-text/05-baseline/inspector_benchmark_20261104_013416_155_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 18.807456000000002 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-ab", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.751584000000001, + "raw_report": "warm-line-8-no-text/05-candidate/inspector_benchmark_20261104_013416_221_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 15.338474999999999 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 14464, + "mean": 14464, + "min": 14464 + }, + "allocation_count": { + "count": 1000, + "max": 206, + "mean": 206, + "min": 206 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2515.647294, + "raw_report": "warm-line-8-conservative/05-baseline/inspector_benchmark_20261104_013416_577_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 299.735385 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 13568, + "mean": 13568, + "min": 13568 + }, + "allocation_count": { + "count": 1000, + "max": 168, + "mean": 168, + "min": 168 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2707.4657770000003, + "raw_report": "warm-line-8-conservative/05-candidate/inspector_benchmark_20261104_013419_461_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 303.60522000000003 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2799.219347, + "raw_report": "warm-line-8-conservative-no-text/05-baseline/inspector_benchmark_20261104_013422_537_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 291.98199200000005 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2829.7391159999997, + "raw_report": "warm-line-8-conservative-no-text/05-candidate/inspector_benchmark_20261104_013425_670_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 292.22249800000003 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-ab", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 12.885863999999998, + "raw_report": "warm-line-8-no-text/06-candidate/inspector_benchmark_20261104_013428_590_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 17.678731999999997 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-ab", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 13.173838, + "raw_report": "warm-line-8-no-text/06-baseline/inspector_benchmark_20261104_013428_709_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 16.188024 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 13568, + "mean": 13568, + "min": 13568 + }, + "allocation_count": { + "count": 1000, + "max": 168, + "mean": 168, + "min": 168 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2983.0252360000004, + "raw_report": "warm-line-8-conservative/06-candidate/inspector_benchmark_20261104_013429_128_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 310.397619 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 14464, + "mean": 14464, + "min": 14464 + }, + "allocation_count": { + "count": 1000, + "max": 206, + "mean": 206, + "min": 206 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2877.517409, + "raw_report": "warm-line-8-conservative/06-baseline/inspector_benchmark_20261104_013432_552_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 348.87253400000003 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2933.9457949999996, + "raw_report": "warm-line-8-conservative-no-text/06-candidate/inspector_benchmark_20261104_013435_783_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 288.508301 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2773.434593, + "raw_report": "warm-line-8-conservative-no-text/06-baseline/inspector_benchmark_20261104_013439_061_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 278.602341 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-ab", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.137084000000002, + "raw_report": "warm-line-8-no-text/07-baseline/inspector_benchmark_20261104_013441_938_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 15.309196 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-ab", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 11.099016999999996, + "raw_report": "warm-line-8-no-text/07-candidate/inspector_benchmark_20261104_013442_012_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 14.945697999999998 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 14464, + "mean": 14464, + "min": 14464 + }, + "allocation_count": { + "count": 1000, + "max": 206, + "mean": 206, + "min": 206 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2709.243576, + "raw_report": "warm-line-8-conservative/07-baseline/inspector_benchmark_20261104_013442_387_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 310.049504 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 13568, + "mean": 13568, + "min": 13568 + }, + "allocation_count": { + "count": 1000, + "max": 168, + "mean": 168, + "min": 168 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2906.89473, + "raw_report": "warm-line-8-conservative/07-candidate/inspector_benchmark_20261104_013445_465_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 303.87833900000004 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2830.543658, + "raw_report": "warm-line-8-conservative-no-text/07-baseline/inspector_benchmark_20261104_013448_761_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 285.488532 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 3325.657134, + "raw_report": "warm-line-8-conservative-no-text/07-candidate/inspector_benchmark_20261104_013451_929_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 280.278023 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-ab", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 12.965965999999998, + "raw_report": "warm-line-8-no-text/08-candidate/inspector_benchmark_20261104_013455_369_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 18.244906999999998 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9312, + "mean": 9312, + "min": 9312 + }, + "allocation_count": { + "count": 1000, + "max": 114, + "mean": 114, + "min": 114 + }, + "campaign": "retained-ab", + "case": "warm-line-8-no-text", + "measured_elapsed_ms": 14.889966999999999, + "raw_report": "warm-line-8-no-text/08-baseline/inspector_benchmark_20261104_013455_503_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 19.623907 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 13568, + "mean": 13568, + "min": 13568 + }, + "allocation_count": { + "count": 1000, + "max": 168, + "mean": 168, + "min": 168 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 3277.51584, + "raw_report": "warm-line-8-conservative/08-candidate/inspector_benchmark_20261104_013455_996_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 387.385456 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 14464, + "mean": 14464, + "min": 14464 + }, + "allocation_count": { + "count": 1000, + "max": 206, + "mean": 206, + "min": 206 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2821.7386079999997, + "raw_report": "warm-line-8-conservative/08-baseline/inspector_benchmark_20261104_013459_707_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 339.858513 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 3346.125217, + "raw_report": "warm-line-8-conservative-no-text/08-candidate/inspector_benchmark_20261104_013502_935_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 325.26835200000005 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "retained-ab", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 3093.301006, + "raw_report": "warm-line-8-conservative-no-text/08-baseline/inspector_benchmark_20261104_013506_654_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 301.167849 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-aa", + "case": "warm-line-8", + "measured_elapsed_ms": 1802.4651440000002, + "raw_report": "warm-line-8/01-baseline/inspector_benchmark_20261104_014612_810_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "baseline", + "warmup_elapsed_ms": 720.726228 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-aa", + "case": "warm-line-8", + "measured_elapsed_ms": 1803.283793, + "raw_report": "warm-line-8/01-candidate/inspector_benchmark_20261104_014615_447_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "candidate", + "warmup_elapsed_ms": 721.501447 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-aa", + "case": "warm-line-8", + "measured_elapsed_ms": 1711.7283970000003, + "raw_report": "warm-line-8/02-candidate/inspector_benchmark_20261104_014618_058_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "candidate", + "warmup_elapsed_ms": 687.539551 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-aa", + "case": "warm-line-8", + "measured_elapsed_ms": 1907.3971950000002, + "raw_report": "warm-line-8/02-baseline/inspector_benchmark_20261104_014620_679_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "baseline", + "warmup_elapsed_ms": 806.0849129999999 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-aa", + "case": "warm-line-8", + "measured_elapsed_ms": 1921.259819, + "raw_report": "warm-line-8/03-baseline/inspector_benchmark_20261104_014623_499_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "baseline", + "warmup_elapsed_ms": 787.2998120000001 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-aa", + "case": "warm-line-8", + "measured_elapsed_ms": 1867.9491159999998, + "raw_report": "warm-line-8/03-candidate/inspector_benchmark_20261104_014626_345_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "candidate", + "warmup_elapsed_ms": 782.6900089999999 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-aa", + "case": "warm-line-8", + "measured_elapsed_ms": 1872.8644530000001, + "raw_report": "warm-line-8/04-candidate/inspector_benchmark_20261104_014629_119_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "candidate", + "warmup_elapsed_ms": 740.393421 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-aa", + "case": "warm-line-8", + "measured_elapsed_ms": 1751.7318599999999, + "raw_report": "warm-line-8/04-baseline/inspector_benchmark_20261104_014631_798_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "baseline", + "warmup_elapsed_ms": 698.2269160000001 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-aa", + "case": "warm-line-8", + "measured_elapsed_ms": 1632.615376, + "raw_report": "warm-line-8/05-baseline/inspector_benchmark_20261104_014634_339_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "baseline", + "warmup_elapsed_ms": 691.984655 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-aa", + "case": "warm-line-8", + "measured_elapsed_ms": 1520.0906300000001, + "raw_report": "warm-line-8/05-candidate/inspector_benchmark_20261104_014636_728_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "candidate", + "warmup_elapsed_ms": 641.016255 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-aa", + "case": "warm-line-8", + "measured_elapsed_ms": 1722.5668959999998, + "raw_report": "warm-line-8/06-candidate/inspector_benchmark_20261104_014639_034_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "candidate", + "warmup_elapsed_ms": 711.553658 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-aa", + "case": "warm-line-8", + "measured_elapsed_ms": 1625.1553490000001, + "raw_report": "warm-line-8/06-baseline/inspector_benchmark_20261104_014641_584_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "baseline", + "warmup_elapsed_ms": 723.655211 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-aa", + "case": "warm-line-8", + "measured_elapsed_ms": 1680.931294, + "raw_report": "warm-line-8/07-baseline/inspector_benchmark_20261104_014644_020_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "baseline", + "warmup_elapsed_ms": 709.297435 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-aa", + "case": "warm-line-8", + "measured_elapsed_ms": 1697.407203, + "raw_report": "warm-line-8/07-candidate/inspector_benchmark_20261104_014646_520_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "candidate", + "warmup_elapsed_ms": 721.1346490000001 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-aa", + "case": "warm-line-8", + "measured_elapsed_ms": 1814.1832929999998, + "raw_report": "warm-line-8/08-candidate/inspector_benchmark_20261104_014649_081_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "candidate", + "warmup_elapsed_ms": 736.627466 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-aa", + "case": "warm-line-8", + "measured_elapsed_ms": 1869.208261, + "raw_report": "warm-line-8/08-baseline/inspector_benchmark_20261104_014651_716_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "baseline", + "warmup_elapsed_ms": 717.528025 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-ab-settled", + "case": "warm-line-8", + "measured_elapsed_ms": 1797.65426, + "raw_report": "warm-line-8/01-baseline/inspector_benchmark_20261104_014719_542_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "baseline", + "warmup_elapsed_ms": 713.28123 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13056, + "mean": 13056, + "min": 13056 + }, + "allocation_count": { + "count": 50000, + "max": 152, + "mean": 152, + "min": 152 + }, + "campaign": "same-image-ab-settled", + "case": "warm-line-8", + "measured_elapsed_ms": 1738.8353189999998, + "raw_report": "warm-line-8/01-candidate/inspector_benchmark_20261104_014722_088_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "candidate", + "warmup_elapsed_ms": 662.104247 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13056, + "mean": 13056, + "min": 13056 + }, + "allocation_count": { + "count": 50000, + "max": 152, + "mean": 152, + "min": 152 + }, + "campaign": "same-image-ab-settled", + "case": "warm-line-8", + "measured_elapsed_ms": 1727.8231110000002, + "raw_report": "warm-line-8/02-candidate/inspector_benchmark_20261104_014724_673_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "candidate", + "warmup_elapsed_ms": 697.370645 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-ab-settled", + "case": "warm-line-8", + "measured_elapsed_ms": 1810.9860090000002, + "raw_report": "warm-line-8/02-baseline/inspector_benchmark_20261104_014727_290_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "baseline", + "warmup_elapsed_ms": 759.815463 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-ab-settled", + "case": "warm-line-8", + "measured_elapsed_ms": 1946.9511579999999, + "raw_report": "warm-line-8/03-baseline/inspector_benchmark_20261104_014729_976_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "baseline", + "warmup_elapsed_ms": 749.578917 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13056, + "mean": 13056, + "min": 13056 + }, + "allocation_count": { + "count": 50000, + "max": 152, + "mean": 152, + "min": 152 + }, + "campaign": "same-image-ab-settled", + "case": "warm-line-8", + "measured_elapsed_ms": 1919.745257, + "raw_report": "warm-line-8/03-candidate/inspector_benchmark_20261104_014732_737_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "candidate", + "warmup_elapsed_ms": 712.217246 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13056, + "mean": 13056, + "min": 13056 + }, + "allocation_count": { + "count": 50000, + "max": 152, + "mean": 152, + "min": 152 + }, + "campaign": "same-image-ab-settled", + "case": "warm-line-8", + "measured_elapsed_ms": 1755.1522209999998, + "raw_report": "warm-line-8/04-candidate/inspector_benchmark_20261104_014735_520_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "candidate", + "warmup_elapsed_ms": 727.987273 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-ab-settled", + "case": "warm-line-8", + "measured_elapsed_ms": 1817.3314349999998, + "raw_report": "warm-line-8/04-baseline/inspector_benchmark_20261104_014738_126_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "baseline", + "warmup_elapsed_ms": 743.502501 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-ab-settled", + "case": "warm-line-8", + "measured_elapsed_ms": 1958.6198830000003, + "raw_report": "warm-line-8/05-baseline/inspector_benchmark_20261104_014740_859_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "baseline", + "warmup_elapsed_ms": 770.06084 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13056, + "mean": 13056, + "min": 13056 + }, + "allocation_count": { + "count": 50000, + "max": 152, + "mean": 152, + "min": 152 + }, + "campaign": "same-image-ab-settled", + "case": "warm-line-8", + "measured_elapsed_ms": 1730.424371, + "raw_report": "warm-line-8/05-candidate/inspector_benchmark_20261104_014743_648_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "candidate", + "warmup_elapsed_ms": 699.114173 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13056, + "mean": 13056, + "min": 13056 + }, + "allocation_count": { + "count": 50000, + "max": 152, + "mean": 152, + "min": 152 + }, + "campaign": "same-image-ab-settled", + "case": "warm-line-8", + "measured_elapsed_ms": 1676.8437940000001, + "raw_report": "warm-line-8/06-candidate/inspector_benchmark_20261104_014746_200_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "candidate", + "warmup_elapsed_ms": 700.367048 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-ab-settled", + "case": "warm-line-8", + "measured_elapsed_ms": 1769.2717469999998, + "raw_report": "warm-line-8/06-baseline/inspector_benchmark_20261104_014748_650_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "baseline", + "warmup_elapsed_ms": 659.935019 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-ab-settled", + "case": "warm-line-8", + "measured_elapsed_ms": 1740.3603550000003, + "raw_report": "warm-line-8/07-baseline/inspector_benchmark_20261104_014751_327_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "baseline", + "warmup_elapsed_ms": 783.072669 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13056, + "mean": 13056, + "min": 13056 + }, + "allocation_count": { + "count": 50000, + "max": 152, + "mean": 152, + "min": 152 + }, + "campaign": "same-image-ab-settled", + "case": "warm-line-8", + "measured_elapsed_ms": 1861.293941, + "raw_report": "warm-line-8/07-candidate/inspector_benchmark_20261104_014754_041_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "candidate", + "warmup_elapsed_ms": 826.134425 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13056, + "mean": 13056, + "min": 13056 + }, + "allocation_count": { + "count": 50000, + "max": 152, + "mean": 152, + "min": 152 + }, + "campaign": "same-image-ab-settled", + "case": "warm-line-8", + "measured_elapsed_ms": 1725.6636799999999, + "raw_report": "warm-line-8/08-candidate/inspector_benchmark_20261104_014756_790_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "candidate", + "warmup_elapsed_ms": 755.40647 + }, + { + "allocation_bytes": { + "count": 50000, + "max": 13952, + "mean": 13952, + "min": 13952 + }, + "allocation_count": { + "count": 50000, + "max": 190, + "mean": 190, + "min": 190 + }, + "campaign": "same-image-ab-settled", + "case": "warm-line-8", + "measured_elapsed_ms": 2273.0546790000003, + "raw_report": "warm-line-8/08-baseline/inspector_benchmark_20261104_014759_632_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 8192, + "total_frame_sample_count": 50000, + "variant": "baseline", + "warmup_elapsed_ms": 971.49182 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 14464, + "mean": 14464, + "min": 14464 + }, + "allocation_count": { + "count": 1000, + "max": 206, + "mean": 206, + "min": 206 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2841.461144, + "raw_report": "warm-line-8-conservative/01-baseline/inspector_benchmark_20261104_014820_009_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 324.972695 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 13568, + "mean": 13568, + "min": 13568 + }, + "allocation_count": { + "count": 1000, + "max": 168, + "mean": 168, + "min": 168 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2786.996429, + "raw_report": "warm-line-8-conservative/01-candidate/inspector_benchmark_20261104_014823_253_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 334.487879 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 3037.8864759999997, + "raw_report": "warm-line-8-conservative-no-text/01-baseline/inspector_benchmark_20261104_014826_389_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 281.63635 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2979.274467, + "raw_report": "warm-line-8-conservative-no-text/01-candidate/inspector_benchmark_20261104_014829_839_SIM_Bars.json", + "repetition": 0, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 332.977671 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 13568, + "mean": 13568, + "min": 13568 + }, + "allocation_count": { + "count": 1000, + "max": 168, + "mean": 168, + "min": 168 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 3123.255314, + "raw_report": "warm-line-8-conservative/02-candidate/inspector_benchmark_20261104_014833_282_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 391.571335 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 14464, + "mean": 14464, + "min": 14464 + }, + "allocation_count": { + "count": 1000, + "max": 206, + "mean": 206, + "min": 206 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2818.903229, + "raw_report": "warm-line-8-conservative/02-baseline/inspector_benchmark_20261104_014836_756_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 305.61044 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2768.1221149999997, + "raw_report": "warm-line-8-conservative-no-text/02-candidate/inspector_benchmark_20261104_014839_913_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 279.940386 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2736.190028, + "raw_report": "warm-line-8-conservative-no-text/02-baseline/inspector_benchmark_20261104_014843_044_SIM_Bars.json", + "repetition": 1, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 272.089767 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 14464, + "mean": 14464, + "min": 14464 + }, + "allocation_count": { + "count": 1000, + "max": 206, + "mean": 206, + "min": 206 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2672.5623579999997, + "raw_report": "warm-line-8-conservative/03-baseline/inspector_benchmark_20261104_014846_145_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 299.447821 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 13568, + "mean": 13568, + "min": 13568 + }, + "allocation_count": { + "count": 1000, + "max": 168, + "mean": 168, + "min": 168 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2777.4413379999996, + "raw_report": "warm-line-8-conservative/03-candidate/inspector_benchmark_20261104_014849_176_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 302.024947 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2786.9081069999997, + "raw_report": "warm-line-8-conservative-no-text/03-baseline/inspector_benchmark_20261104_014852_299_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 283.555099 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2679.779188, + "raw_report": "warm-line-8-conservative-no-text/03-candidate/inspector_benchmark_20261104_014855_432_SIM_Bars.json", + "repetition": 2, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 281.9771 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 13568, + "mean": 13568, + "min": 13568 + }, + "allocation_count": { + "count": 1000, + "max": 168, + "mean": 168, + "min": 168 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2699.49147, + "raw_report": "warm-line-8-conservative/04-candidate/inspector_benchmark_20261104_014858_489_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 309.36859499999997 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 14464, + "mean": 14464, + "min": 14464 + }, + "allocation_count": { + "count": 1000, + "max": 206, + "mean": 206, + "min": 206 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2746.608776, + "raw_report": "warm-line-8-conservative/04-baseline/inspector_benchmark_20261104_014901_578_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 312.912466 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2818.9497760000004, + "raw_report": "warm-line-8-conservative-no-text/04-candidate/inspector_benchmark_20261104_014904_668_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 269.914172 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2803.875409, + "raw_report": "warm-line-8-conservative-no-text/04-baseline/inspector_benchmark_20261104_014907_826_SIM_Bars.json", + "repetition": 3, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 291.47390299999995 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 14464, + "mean": 14464, + "min": 14464 + }, + "allocation_count": { + "count": 1000, + "max": 206, + "mean": 206, + "min": 206 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2818.1034449999997, + "raw_report": "warm-line-8-conservative/05-baseline/inspector_benchmark_20261104_014910_990_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 316.21270899999996 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 13568, + "mean": 13568, + "min": 13568 + }, + "allocation_count": { + "count": 1000, + "max": 168, + "mean": 168, + "min": 168 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2741.106053, + "raw_report": "warm-line-8-conservative/05-candidate/inspector_benchmark_20261104_014914_167_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 310.02806300000003 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2793.53923, + "raw_report": "warm-line-8-conservative-no-text/05-baseline/inspector_benchmark_20261104_014917_267_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 272.084294 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2699.548385, + "raw_report": "warm-line-8-conservative-no-text/05-candidate/inspector_benchmark_20261104_014920_423_SIM_Bars.json", + "repetition": 4, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 280.143186 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 13568, + "mean": 13568, + "min": 13568 + }, + "allocation_count": { + "count": 1000, + "max": 168, + "mean": 168, + "min": 168 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2619.825185, + "raw_report": "warm-line-8-conservative/06-candidate/inspector_benchmark_20261104_014923_512_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 328.347542 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 14464, + "mean": 14464, + "min": 14464 + }, + "allocation_count": { + "count": 1000, + "max": 206, + "mean": 206, + "min": 206 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2722.868519, + "raw_report": "warm-line-8-conservative/06-baseline/inspector_benchmark_20261104_014926_520_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 305.964048 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2623.4815759999997, + "raw_report": "warm-line-8-conservative-no-text/06-candidate/inspector_benchmark_20261104_014929_563_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 264.525351 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2693.50059, + "raw_report": "warm-line-8-conservative-no-text/06-baseline/inspector_benchmark_20261104_014932_511_SIM_Bars.json", + "repetition": 5, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 274.27636 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 14464, + "mean": 14464, + "min": 14464 + }, + "allocation_count": { + "count": 1000, + "max": 206, + "mean": 206, + "min": 206 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2834.624263, + "raw_report": "warm-line-8-conservative/07-baseline/inspector_benchmark_20261104_014935_614_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 334.950397 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 13568, + "mean": 13568, + "min": 13568 + }, + "allocation_count": { + "count": 1000, + "max": 168, + "mean": 168, + "min": 168 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2759.983392, + "raw_report": "warm-line-8-conservative/07-candidate/inspector_benchmark_20261104_014938_833_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 318.479355 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2687.799888, + "raw_report": "warm-line-8-conservative-no-text/07-baseline/inspector_benchmark_20261104_014941_935_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 277.217283 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2836.970503, + "raw_report": "warm-line-8-conservative-no-text/07-candidate/inspector_benchmark_20261104_014944_986_SIM_Bars.json", + "repetition": 6, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 290.642507 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 13568, + "mean": 13568, + "min": 13568 + }, + "allocation_count": { + "count": 1000, + "max": 168, + "mean": 168, + "min": 168 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2746.922544, + "raw_report": "warm-line-8-conservative/08-candidate/inspector_benchmark_20261104_014948_192_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 312.34539299999994 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 14464, + "mean": 14464, + "min": 14464 + }, + "allocation_count": { + "count": 1000, + "max": 206, + "mean": 206, + "min": 206 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative", + "measured_elapsed_ms": 2818.4645800000003, + "raw_report": "warm-line-8-conservative/08-baseline/inspector_benchmark_20261104_014951_317_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 300.826875 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2661.3208489999997, + "raw_report": "warm-line-8-conservative-no-text/08-candidate/inspector_benchmark_20261104_014954_497_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "candidate", + "warmup_elapsed_ms": 291.22713899999997 + }, + { + "allocation_bytes": { + "count": 1000, + "max": 9824, + "mean": 9824, + "min": 9824 + }, + "allocation_count": { + "count": 1000, + "max": 130, + "mean": 130, + "min": 130 + }, + "campaign": "same-image-ab-conservative", + "case": "warm-line-8-conservative-no-text", + "measured_elapsed_ms": 2636.5728520000002, + "raw_report": "warm-line-8-conservative-no-text/08-baseline/inspector_benchmark_20261104_014957_522_SIM_Bars.json", + "repetition": 7, + "retained_timing_sample_count": 1000, + "total_frame_sample_count": 1000, + "variant": "baseline", + "warmup_elapsed_ms": 282.699435 + } + ], + "status": "passed", + "total_processes": 144 + }, + "same_image_aa_mode_verification": { + "binary_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "candidate_binary_sha256": "4e5c71ad16441df5337e5dfd28b5fda018cc9cb5848beca4bf68c12893189473", + "checks": [ + { + "allocations_max": 190, + "allocations_min": 190, + "directory": "warm-line-8/01-baseline", + "mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ] + }, + { + "allocations_max": 190, + "allocations_min": 190, + "directory": "warm-line-8/01-candidate", + "mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ] + }, + { + "allocations_max": 190, + "allocations_min": 190, + "directory": "warm-line-8/02-candidate", + "mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ] + }, + { + "allocations_max": 190, + "allocations_min": 190, + "directory": "warm-line-8/02-baseline", + "mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ] + }, + { + "allocations_max": 190, + "allocations_min": 190, + "directory": "warm-line-8/03-baseline", + "mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ] + }, + { + "allocations_max": 190, + "allocations_min": 190, + "directory": "warm-line-8/03-candidate", + "mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ] + }, + { + "allocations_max": 190, + "allocations_min": 190, + "directory": "warm-line-8/04-candidate", + "mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ] + }, + { + "allocations_max": 190, + "allocations_min": 190, + "directory": "warm-line-8/04-baseline", + "mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ] + }, + { + "allocations_max": 190, + "allocations_min": 190, + "directory": "warm-line-8/05-baseline", + "mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ] + }, + { + "allocations_max": 190, + "allocations_min": 190, + "directory": "warm-line-8/05-candidate", + "mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ] + }, + { + "allocations_max": 190, + "allocations_min": 190, + "directory": "warm-line-8/06-candidate", + "mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ] + }, + { + "allocations_max": 190, + "allocations_min": 190, + "directory": "warm-line-8/06-baseline", + "mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ] + }, + { + "allocations_max": 190, + "allocations_min": 190, + "directory": "warm-line-8/07-baseline", + "mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ] + }, + { + "allocations_max": 190, + "allocations_min": 190, + "directory": "warm-line-8/07-candidate", + "mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ] + }, + { + "allocations_max": 190, + "allocations_min": 190, + "directory": "warm-line-8/08-candidate", + "mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ] + }, + { + "allocations_max": 190, + "allocations_min": 190, + "directory": "warm-line-8/08-baseline", + "mode_markers": [ + "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC=0" + ] + } + ], + "status": "complete" + }, + "same_image_plan": { + "backend": "null", + "campaigns": [ + { + "baseline_mode": "0", + "candidate_mode": "0", + "cases": [ + "warm-line-8" + ], + "driver": "run_suite.py", + "frames": 50000, + "name": "same-image-aa", + "reason": "Longer settled-text control because the original11microsecond same-binary control had substantial relative variation.", + "warmup_frames": 20000 + }, + { + "baseline_mode": "0", + "candidate_mode": "1", + "cases": [ + "warm-line-8" + ], + "driver": "run_same_image_diagnostic.py", + "frames": 50000, + "name": "same-image-ab-settled", + "warmup_frames": 20000 + }, + { + "baseline_mode": "0", + "candidate_mode": "1", + "cases": [ + "warm-line-8-conservative", + "warm-line-8-conservative-no-text" + ], + "driver": "run_same_image_diagnostic.py", + "frames": 1000, + "name": "same-image-ab-conservative", + "warmup_frames": 100 + } + ], + "cpu_affinity": [ + 8 + ], + "created_at": "2026-11-04T01:43:40.285248+00:00", + "frame_timing_only": true, + "purpose": "Separate runtime label membership work from unrelated code placement in the two retained binaries", + "repetitions": 8, + "validation": [ + "Verify corrected harness source equality between foundation and diagnostic.", + "Both complete helper definitions must match original baseline/candidate exceptfunctionname; one identical executable path and hash for all modes.", + "Run maintainedCoreAlgo with both diagnostic modes before timings.", + "Require actual selected-mode marker for text, none for no-text.", + "Require all workload-v3 and phase checks; verify measured allocation min/max for settled cases.", + "Retain both unfavorable and favorable outcomes; no extra timing repetitions afterinspection.", + "Compare same-image stable effect against its own identical-mode control; no formal significance threshold.", + "If no-text keeps an appreciable penalty, stop and retain experiment as unresolved.", + "If no-text is near its control and label allocations fall, labelalgorithmalone is not necessary for originalpenalty; codeplacementremains hypothesis, not hardwareproof.", + "No productionpromotion or nativepixelclaim fromNull results." + ], + "workload_contract": 3 + }, + "same_image_source_validation": { + "definitions": { + "baseline": { + "definition_equal_after_function_name_restoration": true, + "diagnostic_definition_sha256": "6e0aaf5a9147a219d499e98bd890b40d6ea48595e26d7dbb9b95e4854895f077", + "original_definition_sha256": "6fa3aaaf2cabbb1443a74dfc98fc0b985f40d56cf50a21d123a5af2277ea574f", + "original_file_sha256": "34c3047dbb7a0b991b383d264554f547b0be944c18e32fc8d6082ff3ddf1ae7b", + "restored_definition_sha256": "6fa3aaaf2cabbb1443a74dfc98fc0b985f40d56cf50a21d123a5af2277ea574f", + "revision": "88d459dbbad9cff1a292b3ffa87be97970d371e6" + }, + "candidate": { + "definition_equal_after_function_name_restoration": true, + "diagnostic_definition_sha256": "410813f59668fb1e99f418bbf59f75405ef35e385d0e3f253e48539a274d85e4", + "original_definition_sha256": "75773b9d5dfa733668c3c3f3ab4f3cf67d344f394663929143f2a9766747555e", + "original_file_sha256": "d5916b1d0edbb89917f2c368cd59e8ea2fdb190b300c470bca9a46da424c0260", + "restored_definition_sha256": "75773b9d5dfa733668c3c3f3ab4f3cf67d344f394663929143f2a9766747555e", + "revision": "70638b6e65103b657daaa16e00bcea7fe8daf800" + } + }, + "diagnostic_worktree": "/workspace/scratch/2a7852710aa2/vnm_plot-same-image", + "generated_header": "/workspace/scratch/2a7852710aa2/vnm_plot-same-image/src/core/label_fade_tracker.h", + "generated_header_sha256": "5eaea4d2b390dc036ecf22119c3f50db62c8d7673a929efbcb7ac74ea257b263", + "generator_sha256": "468dfb7396c88d0dac34de4ee2cd92359fa993b61f21ca21512febd4690467aa", + "original_repository": "/workspace/scratch/09f16afbdc00/vnm_plot", + "purpose": "temporary same-executable causal diagnostic, not production code", + "schema_version": 1, + "selection": { + "baseline": "0", + "candidate": "1", + "environment": "VNM_PLOT_LABEL_MEMBERSHIP_DIAGNOSTIC", + "no_text": "mode is not consulted; selected-algorithm marker must be absent", + "read_boundary": "first text helper call during warmup, once per process" + }, + "state_header_sha256": "f61ef2a979a156e7b31ff20e6b3a3f7b0196a52b3da86d84e41c08ea49220544" + }, + "schema_version": 2, + "scope": { + "native_raster_validated": false, + "production_promotion": false, + "workload_versions": "Retained binaries use historical v2; freshly built same-image diagnostics use corrected v3. Compare variants only within their campaign, never across workload contracts." }, - "schema_version": 1, - "status": "checkpoint" + "status": "complete" }