Skip to content

ci: overlap locked shell-source prefetch with devenv resolution - #2290

Merged
schickling-assistant merged 4 commits into
mainfrom
schickling-assistant/2026-11-03-locked-input-prefetch
Nov 3, 2026
Merged

schickling-assistant merged 4 commits into
mainfrom
schickling-assistant/2026-11-03-locked-input-prefetch

Conversation

@schickling-assistant

Copy link
Copy Markdown
Collaborator

Problem

The first shell configuration fetches immutable locked sources after executable resolution, leaving source-download work on the bootstrap critical path.

Goal

Overlap source prefetch with the existing Resolve devenv operation without adding jobs or checks or bypassing native integrity validation.

Decisions

  • Traverse the checkout lock directly, resolve follows edges, exclude the executable-only branch, and deduplicate full locked identities.
  • Use two workers and native Nix GitHub prefetch with the exact locked revision and narHash. Unsupported or local inputs remain with the authoritative resolver.
  • Join fetches and workers on success, failure, and termination. Retain job-local diagnostics; optional warming never authorizes stale source data.
  • Add the deterministic no-network fake-fetch regression to the existing CI runtime regression step.

Verification

  • PASS: CI=1 bash genie/ci-scripts/prefetch-locked-inputs.test.sh (lock parsing, selection, follows, deduplication, concurrency bound, failure joining and cancellation cleanup).
  • PASS: scoped oxlint, zero diagnostics.
  • PASS: oxfmt --check on changed TypeScript and specification files.
  • N/A: nixfmt 1.5.0 --check; no changed Nix files.
  • BLOCKED: Genie generation and check encounter accepted source-view dependency blockers (redis and @overeng/otel-contract).
  • Needs genie regeneration (ci.yml / generated scripts). Run bun packages/@overeng/genie/bin/genie.tsx --output ci-plain in the admitted development environment before measuring.
  • 184 handwritten added lines; no generated files hand-edited.

The gain is to be measured from this PRs pr/quality run against baseline quality job 125740942271: compare the shell-configuration interval and setup+bootstrap. No gain is claimed here. Existing step durations and timestamps provide the measurement.

Complexity

One small shell helper with two fixed workers; no dependency, cache service, retry subsystem, or extra evaluation.

Concerns

Prefetch is useful only if the normal shell backend consumes warmed native fetch state; contention or incompatible fetch caches may erase the overlap benefit. Keep this PR draft until regeneration and measured evidence are available.

Friction & bottlenecks

The source-view dependency graph prevents the required Genie command from starting. Generated outputs will be emitted in the admitted environment, not manually patched.

Follow-ups

None outside the regeneration and measurement gates for this draft.

References

Baseline quality job 125740942271.

Posted on behalf of @schickling
field value
agent_identity agent/effect-utils/buck-toolchain
session 01a16011
agent_persona generalist
agent_supervisor unavailable
agent_tool OMP
agent_tool_version 18.10.2
agent_runtime OMP 18.10.2
agent_model anthropic/claude-opus-5-5
worktree effect-utils/2026-11-03-locked-input-prefetch

@schickling-assistant schickling-assistant added the origin:agent Filed or primarily produced by an AI agent · Set: AI agent or manual label Nov 3, 2026
@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Pipeline traces

24 jobs; 7 successful, 0 failed, 0 cancelled, 17 skipped

Pipeline jobs and steps waterfall

Job Status Wall time Delta vs main p50 Trace
test-megarepo-store-gc success 6m 00s no main baseline Explore
pr-buck2-tools success 6m 13s no main baseline Explore
default-ref-policy success 0m 49s +0.0s (0.0%; n=7) not instrumented
quality success 12m 00s no main baseline Explore
source-shape success 0m 50s no main baseline not instrumented
All other jobs (19)
Job Status Wall time Delta vs main p50 Trace
pr-reviews-resolved success 0m 05s +1.0s (25.0%; n=7) not instrumented
tested-tree success 0m 04s -6.0s (-60.0%; n=7) not instrumented
publish-products skipped unavailable duration unavailable unavailable
trusted-buck2-remote-cache-proof skipped unavailable duration unavailable unavailable
promote-published skipped unavailable duration unavailable unavailable
test-integration-notion skipped unavailable duration unavailable unavailable
deploy-storybooks skipped unavailable duration unavailable unavailable
consumer-smoke skipped unavailable duration unavailable unavailable
test[runner=namespace-profile-linux-x86-64] skipped unavailable duration unavailable unavailable
weaver skipped unavailable duration unavailable unavailable
cargo skipped unavailable duration unavailable unavailable
test-playwright-tui-react skipped unavailable duration unavailable unavailable
pr-a-inert-buck skipped unavailable duration unavailable unavailable
test-integration-restate skipped unavailable duration unavailable unavailable
test-playwright-utils skipped unavailable duration unavailable unavailable
build-products skipped unavailable duration unavailable unavailable
test[runner=namespace-profile-macos-arm64] skipped unavailable duration unavailable unavailable
test-live-deploy-ci-tools skipped unavailable duration unavailable unavailable
notify-alignment skipped unavailable duration unavailable unavailable

Main baseline samples (by job): test-megarepo-store-gc n=0, pr-buck2-tools n=0, pr-reviews-resolved n=7, tested-tree n=7, default-ref-policy n=7, publish-products n=7, trusted-buck2-remote-cache-proof n=7, promote-published n=7, test-integration-notion n=7, deploy-storybooks n=7, consumer-smoke n=7, quality n=0, test[runner=namespace-profile-linux-x86-64] n=0, weaver n=0, cargo n=0, test-playwright-tui-react n=0, pr-a-inert-buck n=0, test-integration-restate n=0, test-playwright-utils n=0, build-products n=0, test[runner=namespace-profile-macos-arm64] n=0, test-live-deploy-ci-tools n=7, source-shape n=0, notify-alignment n=7.
Selected main run IDs: 41592509695, 41578249550, 41576405668, 41562937006, 41553095319, 41530939005, 41517480317, 41425546624, 41407774253, 41367940679, 41365767770, 41360433876, 41355035143, 41351722692, 41342714443, 41341266910, 41337853204, 41334466707, 41277009116, 41262535058.
Task-level durations are not included. Trace links may be empty while export, indexing, or retention is pending.

17 job(s) without a start time are omitted from the timeline, not measured as zero.

@github-actions

github-actions Bot commented Nov 3, 2026 •

Copy link
Copy Markdown
Contributor

Storybook Previews

Subject Status Report Details Updated
devbar success devbar preview deployed Preview is ready 2026-11-03 10:18 UTC
effect-react success effect-react preview deployed Preview is ready 2026-11-03 10:18 UTC
effect-rpc-explorer-react success effect-rpc-explorer-react preview deployed Preview is ready 2026-11-03 10:18 UTC
effect-schema-form-aria success effect-schema-form-aria preview deployed Preview is ready 2026-11-03 10:18 UTC
genie success genie preview deployed Preview is ready 2026-11-03 10:18 UTC
gh-ci-utils success gh-ci-utils preview deployed Preview is ready 2026-11-03 10:18 UTC
megarepo success megarepo preview deployed Preview is ready 2026-11-03 10:18 UTC
meters success meters preview deployed Preview is ready 2026-11-03 10:18 UTC
notion-cli success notion-cli preview deployed Preview is ready 2026-11-03 10:18 UTC
notion-md success notion-md preview deployed Preview is ready 2026-11-03 10:18 UTC
notion-react success notion-react preview deployed Preview is ready 2026-11-03 10:18 UTC
react-inspector success react-inspector preview deployed Preview is ready 2026-11-03 10:18 UTC
tui-react success tui-react preview deployed Preview is ready 2026-11-03 10:19 UTC
Report history

PR 2290 · 2026-11-03 10:19 UTC

Subject Status Report Details Updated
devbar success devbar preview deployed Preview is ready 2026-11-03 10:18 UTC
effect-react success effect-react preview deployed Preview is ready 2026-11-03 10:18 UTC
effect-rpc-explorer-react success effect-rpc-explorer-react preview deployed Preview is ready 2026-11-03 10:18 UTC
effect-schema-form-aria success effect-schema-form-aria preview deployed Preview is ready 2026-11-03 10:18 UTC
genie success genie preview deployed Preview is ready 2026-11-03 10:18 UTC
gh-ci-utils success gh-ci-utils preview deployed Preview is ready 2026-11-03 10:18 UTC
megarepo success megarepo preview deployed Preview is ready 2026-11-03 10:18 UTC
meters success meters preview deployed Preview is ready 2026-11-03 10:18 UTC
notion-cli success notion-cli preview deployed Preview is ready 2026-11-03 10:18 UTC
notion-md success notion-md preview deployed Preview is ready 2026-11-03 10:18 UTC
notion-react success notion-react preview deployed Preview is ready 2026-11-03 10:18 UTC
react-inspector success react-inspector preview deployed Preview is ready 2026-11-03 10:18 UTC
tui-react success tui-react preview deployed Preview is ready 2026-11-03 10:19 UTC

PR 2290 · 2026-11-03 09:57 UTC

Subject Status Report Details Updated
devbar success devbar preview deployed Preview is ready 2026-11-03 09:57 UTC
effect-react success effect-react preview deployed Preview is ready 2026-11-03 09:57 UTC
effect-rpc-explorer-react success effect-rpc-explorer-react preview deployed Preview is ready 2026-11-03 09:57 UTC
effect-schema-form-aria success effect-schema-form-aria preview deployed Preview is ready 2026-11-03 09:57 UTC
genie success genie preview deployed Preview is ready 2026-11-03 09:57 UTC
gh-ci-utils success gh-ci-utils preview deployed Preview is ready 2026-11-03 09:57 UTC
megarepo success megarepo preview deployed Preview is ready 2026-11-03 09:57 UTC
meters success meters preview deployed Preview is ready 2026-11-03 09:57 UTC
notion-cli success notion-cli preview deployed Preview is ready 2026-11-03 09:57 UTC
notion-md success notion-md preview deployed Preview is ready 2026-11-03 09:57 UTC
notion-react success notion-react preview deployed Preview is ready 2026-11-03 09:57 UTC
react-inspector success react-inspector preview deployed Preview is ready 2026-11-03 09:57 UTC
tui-react success tui-react preview deployed Preview is ready 2026-11-03 09:57 UTC

PR 2290 · 2026-11-03 08:11 UTC

Subject Status Report Details Updated
devbar success devbar preview deployed Preview is ready 2026-11-03 08:10 UTC
effect-react success effect-react preview deployed Preview is ready 2026-11-03 08:10 UTC
effect-rpc-explorer-react success effect-rpc-explorer-react preview deployed Preview is ready 2026-11-03 08:10 UTC
effect-schema-form-aria success effect-schema-form-aria preview deployed Preview is ready 2026-11-03 08:10 UTC
genie success genie preview deployed Preview is ready 2026-11-03 08:10 UTC
gh-ci-utils success gh-ci-utils preview deployed Preview is ready 2026-11-03 08:10 UTC
megarepo success megarepo preview deployed Preview is ready 2026-11-03 08:10 UTC
meters success meters preview deployed Preview is ready 2026-11-03 08:10 UTC
notion-cli success notion-cli preview deployed Preview is ready 2026-11-03 08:10 UTC
notion-md success notion-md preview deployed Preview is ready 2026-11-03 08:10 UTC
notion-react success notion-react preview deployed Preview is ready 2026-11-03 08:10 UTC
react-inspector success react-inspector preview deployed Preview is ready 2026-11-03 08:11 UTC
tui-react success tui-react preview deployed Preview is ready 2026-11-03 08:11 UTC

@schickling-assistant

Copy link
Copy Markdown
Collaborator Author

GO at exact head 463badf. Delta 71daf6b..463badf reviewed. Cancellation: brace bodies give the backgrounded PID ownership of the traps; worker cleanup kills and waits for the real fetch child; traps are cleared on normal return (independent review at eb7cfa3). Test permits: single-byte permits read with read -r -n 1 cannot be split between concurrent FIFO readers.

Posted on behalf of @schickling
field value
agent_identity agent/effect-utils/effect-utils-manager
session 01a1b244
agent_persona generalist
agent_supervisor unavailable
agent_tool OMP
agent_tool_version 18.10.2
agent_runtime OMP 18.10.2
agent_model anthropic/claude-opus-5-5
worktree effect-utils/main

@schickling-assistant

Copy link
Copy Markdown
Collaborator Author

Merge record (effect-utils-manager): head 463badf, CI green (35 checks), independent review GO at this head, no Hypermerge label. Enqueuing.

Posted on behalf of @schickling
field value
agent_identity agent/effect-utils/effect-utils-manager
session 01a1b244
agent_persona generalist
agent_supervisor unavailable
agent_tool OMP
agent_tool_version 18.10.2
agent_runtime OMP 18.10.2
agent_model anthropic/claude-opus-5-5
worktree effect-utils/main

@schickling-assistant
schickling-assistant added this pull request to the merge queue Nov 3, 2026
Merged via the queue into main with commit 2d29fc5 Nov 3, 2026
35 checks passed
@schickling-assistant
schickling-assistant deleted the schickling-assistant/2026-11-03-locked-input-prefetch branch November 3, 2026 10:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

origin:agent Filed or primarily produced by an AI agent · Set: AI agent or manual

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant