Skip to content

test: prove pg-erd runtime isolation under real traffic - #16

Draft
seonghobae wants to merge 19 commits into
fix/generic-forwarding-header-sanitization-v1from
test/pg-erd-runtime-isolation-traffic-v1
Draft

test: prove pg-erd runtime isolation under real traffic#16
seonghobae wants to merge 19 commits into
fix/generic-forwarding-header-sanitization-v1from
test/pg-erd-runtime-isolation-traffic-v1

Conversation

@seonghobae

@seonghobae seonghobae commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Dedicated runtime-isolation traffic evidence

This Draft owns only the cwl-pingora-pg-erd-migration real-listener runtime-isolation acceptance that does not transfer from the generic gateway. It adds no product authentication/business logic, retry/failover policy, Keyverse identity, or Wardnet/EgressWeave authority.

Exact base is #15 bb65f2810b178bda46ed7eb5c6a62aae9fe36403; exact head is 356f3f250043d71c9bb1c0655481cd6984f3ae57. The effective child scope remains five paths: CHANGELOG.md, CLAUDE.md, TEST_STRATEGY.md, docs/product-technical-gap-baseline.md, and tests/pg_erd_runtime_isolation_traffic.rs.

The compiled migration process is exercised over real loopback listeners. A 9-byte chunked body against an 8-byte budget must return HTTP 413 while /readyz stays 200. With max_in_flight_requests=1, one routed backend request holds the sole admission lease; the next routed request must return HTTP 503 in <1 s, materially before the configured 2 s upstream read budget; /readyz stays 200; metrics must contain the exact Prometheus sample cwl_pingora_gateway_backpressure_rejections_total 1; releasing the held request must restore routed capacity.

The <1 s assertion is the causal repair for the valid predecessor finding that only eventual 503 had been proved. Exact-line metric matching is the causal repair for the prefix false-pass class (10/11 matching 1). Neither repair weakens traffic volume, timeout budgets or the gateway admission policy.

Exact-head evidence

CI 34168471195 is terminal GREEN on exact 356f3f25...: load, formatting/locked compile/test/strict Clippy/warning-denied rustdoc/100% owned-production coverage/dependency-lock, and dual-profile OCI runtime all passed. The exact generic k6 artifact records 400 requests, 800/800 checks, zero HTTP failures and p95 about 0.919 ms against the unchanged <20 ms loopback threshold. This remains controlled generic loopback evidence, not routed pg-erd or production SLO proof.

Supply Chain 34168471176 is terminal GREEN on the same exact SHA: committed dependency audit, both admitted image builds, SPDX dependency SBOM, generic and pg-erd vulnerability scans, exact-source binding and success evidence upload all completed successfully.

Fresh exact-range CodeRabbit review of bb65f281...356f3f25 reports no actionable issue and confirms the fail-fast and exact-metric findings are closed; that is technical review, not independent human approval.

Keep Draft. Supplier promotion remains independently blocked by #54's intentional derivative 2.2.0 RED and #56's independent approval gate. No protected merge, immutable release, shadow/canary, cutover, rollback or legacy-removal credit is claimed. Child #17 may ordinary/non-force adopt this exact GREEN parent, but #16 evidence does not transfer to the changed child head.

@coderabbitai

coderabbitai Bot commented Sep 2, 2026

Copy link
Copy Markdown

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

  • Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

Copy link
Copy Markdown
Contributor Author

@coderabbitai review

Please review exact current parent e249c1312cdb7f746eec6780742c3707fff69591 through head 49d3fb5d89bf15543c7df8b433809acb8fac88eb. Treat historical #16 review/evidence as stale. Focus on the non-force restack preserving current #15 and on the real-listener pg-erd streamed-body / in-flight saturation-recovery acceptance without widening product-domain authority.

@coderabbitai

coderabbitai Bot commented Sep 7, 2026

Copy link
Copy Markdown

@seonghobae I will review #16 against exact parent e249c1312cdb7f746eec6780742c3707fff69591 and head 49d3fb5d89bf15543c7df8b433809acb8fac88eb.

I will treat prior #16 evidence as stale. I will focus on the restack, pg-erd real-listener traffic acceptance, and authority boundaries.

⚠️ Action not completed

Review rate limited.

Note: CodeRabbit is an incremental review system and does not re-review already reviewed commits. This command is applicable only when automatic reviews are paused.

Copy link
Copy Markdown
Contributor Author

@coderabbitai review

Fresh exact-head review requested for f3dbe7afe1fa945d74145bb7852ae77882145b0a...d16f1440a05ca92a2acacd247ae2e62644df4f22. Exact current #15 is now the merge base; #16 is ahead 14 / behind 0 with only five effective paths. Please verify the ordinary two-parent adoption preserved the complete parent edge/Admin Config/forwarding/OCI/workflow tree and retained only the dedicated compiled pg-erd runtime-isolation traffic acceptance plus code-current docs. Current CI 34165572648 and Supply Chain 34165572650 are queued. Predecessor review/execution is historical only; do not infer human approval or release/cutover credit.

@coderabbitai

coderabbitai Bot commented Sep 7, 2026

Copy link
Copy Markdown

Tip

For best results, initiate chat on the files or code changes.

🧩 Analysis chain

🏁 Script executed:

#!/bin/bash
set -euo pipefail

base="f3dbe7afe1fa945d74145bb7852ae77882145b0a"
head="d16f1440a05ca92a2acacd247ae2e62644df4f22"

echo "== Exact commit topology =="
git show -s --format='commit=%H%nparents=%P%nsubject=%s' "$head"
git merge-base "$base" "$head"
git rev-list --left-right --count "$base...$head"
git log --format='%H %P %s' --ancestry-path "$base..$head"

echo
echo "== Exact effective paths and summary =="
git diff --name-status "$base" "$head"
git diff --stat "$base" "$head"

echo
echo "== Changed-file structure =="
for path in $(git diff --name-only "$base" "$head"); do
  echo "--- $path ---"
  case "$path" in
    *.rs) ast-grep outline "$path" --items all --view expanded || true ;;
    *) sed -n '1,260p' "$path" ;;
  esac
done

echo
echo "== Relevant production and test symbols =="
rg -n -C 3 --glob '*.rs' \
  'MigrationGatewayProxy|cwl-pingora-pg-erd-migration|max_in_flight_requests|backpressure_rejections_total|readyz|body.*budget|Body.*Limit|413|503' \
  . || true

Length of output: 87559


🏁 Script executed:

#!/bin/bash
set -euo pipefail

base="f3dbe7afe1fa945d74145bb7852ae77882145b0a"
merge="e087639ad2e03d36acdcb634d5081bd0b6cab343"
head="d16f1440a05ca92a2acacd247ae2e62644df4f22"

echo "== Two-parent adoption verification =="
git show -s --format='merge=%H%nparents=%P%ntree=%T%nsubject=%s' "$merge"
echo "base tree: $(git rev-parse "$base^{tree}")"
echo "merge tree: $(git rev-parse "$merge^{tree}")"
echo "Differences: exact parent -> adoption merge tree"
git diff --name-status "$base" "$merge"
echo "Differences: adoption merge tree -> exact head"
git diff --name-status "$merge" "$head"

echo
echo "== Full new traffic acceptance =="
cat -n tests/pg_erd_runtime_isolation_traffic.rs

echo
echo "== Migration callback lifecycle =="
sed -n '105,270p' src/migration_proxy.rs

echo
echo "== Existing compiled pg-erd fixture synchronization reference =="
sed -n '1,430p' tests/pg_erd_production_path.rs

echo
echo "== Exact diff for the added test =="
git diff --no-ext-diff --unified=80 "$base" "$head" -- tests/pg_erd_runtime_isolation_traffic.rs

Length of output: 43078


@seonghobae I verified the restack topology and effective scope.

e087639ad2e03d36acdcb634d5081bd0b6cab343 is an ordinary two-parent merge. Its first parent is historical #16 49d3fb…. Its second parent is exact current #15 f3dbe7…. The exact head d16f144… is ahead 14 and behind 0 from #15.

The effective diff has only the five stated paths. The adoption merge changes only the dedicated traffic test and three code-current documents. The head commit then changes only docs/product-technical-gap-baseline.md. The parent edge, Admin Config, forwarding, OCI, and workflow trees are not changed in the exact effective diff.

I found one acceptance-test gap:

  • Medium — The saturation test does not prove “fail fast.”
    tests/pg_erd_runtime_isolation_traffic.rs, Line 207 checks only that the overloaded request eventually returns HTTP 503. It has no elapsed-time bound. The held upstream request uses a 2-second read budget. Therefore, an implementation that waits for an upstream/runtime timeout before returning 503 can pass this test, despite violating the required local fail-fast admission behavior. Record Instant::now() immediately before get(gateway_address, "/api/over-capacity") and assert that the response arrives within a bounded interval that is materially below the configured upstream timeout.

The test keeps product authentication, business behavior, Keyverse identity, and Wardnet/EgressWeave policy outside the gateway boundary.

CI 34165572648 and Supply Chain 34165572650 remain queued. They do not provide exact-head execution evidence yet.

You are interacting with an AI system.

Copy link
Copy Markdown
Contributor Author

@coderabbitai review

Please review exact current head 4e6376404986cd9c94a0894c5d5e5ba51aeb9f9c against exact parent bb65f2810b178bda46ed7eb5c6a62aae9fe36403. Verify the ordinary two-parent succession preserves only the five intended #16 child paths, the hosted-rustfmt repair changes no runtime-isolation traffic semantics, and the chunked-body / in-flight saturation / recovery acceptance does not widen product auth, identity, routing, or retry authority. Treat all predecessor review evidence as historical.

@coderabbitai

coderabbitai Bot commented Sep 7, 2026

Copy link
Copy Markdown

Tip

For best results, initiate chat on the files or code changes.

🧩 Analysis chain

🏁 Script executed:

#!/bin/bash
set -euo pipefail

base="bb65f2810b178bda46ed7eb5c6a62aae9fe36403"
head="4e6376404986cd9c94a0894c5d5e5ba51aeb9f9c"
red="d16f1440a05ca92a2acacd247ae2e62644df4f22"
repair="abee6af1ecfc1d2f44de1dc25917c2eb84a6bb38"

echo "== Exact topology =="
git show -s --format='head=%H%nparents=%P%ntree=%T%nsubject=%s' "$head"
echo "base_tree=$(git rev-parse "$base^{tree}")"
echo "merge_base=$(git merge-base "$base" "$head")"
echo "range_count=$(git rev-list --left-right --count "$base...$head")"
git log --format='%H %P %s' --ancestry-path "$base..$head"

echo
echo "== Effective paths: exact parent -> exact head =="
git diff --name-status "$base" "$head"
git diff --stat "$base" "$head"

echo
echo "== Repair-only comparison =="
git diff --no-ext-diff --stat "$red" "$repair"
git diff --no-ext-diff --word-diff=porcelain "$red" "$repair" -- tests/pg_erd_runtime_isolation_traffic.rs

echo
echo "== Changed Rust test outline and contents =="
ast-grep outline tests/pg_erd_runtime_isolation_traffic.rs --items all --view expanded || true
cat -n tests/pg_erd_runtime_isolation_traffic.rs

echo
echo "== Relevant production/test references =="
rg -n -C 4 --glob '*.rs' \
  'cwl-pingora-pg-erd-migration|MigrationGatewayProxy|max_in_flight_requests|backpressure_rejections_total|readyz|body.*limit|body.*budget|413|503|retry' \
  src tests || true

echo
echo "== Relevant migration proxy implementation =="
if [ -f src/migration_proxy.rs ]; then
  ast-grep outline src/migration_proxy.rs --items all --view expanded || true
  sed -n '1,360p' src/migration_proxy.rs
fi

echo
echo "== Exact test diff =="
git diff --no-ext-diff --unified=100 "$base" "$head" -- tests/pg_erd_runtime_isolation_traffic.rs

Length of output: 104552


@seonghobae I reviewed exact head 4e6376404986cd9c94a0894c5d5e5ba51aeb9f9c against exact parent bb65f2810b178bda46ed7eb5c6a62aae9fe36403.

The head is an ordinary two-parent merge. Its first parent is abee6af1ecfc1d2f44de1dc25917c2eb84a6bb38. Its second parent is the requested current #15 parent. The range is ahead 16 and behind 0.

The effective diff contains only these five paths:

  • CHANGELOG.md
  • CLAUDE.md
  • TEST_STRATEGY.md
  • docs/product-technical-gap-baseline.md
  • tests/pg_erd_runtime_isolation_traffic.rs

The repair from d16f1440a05ca92a2acacd247ae2e62644df4f22 to abee6af1ecfc1d2f44de1dc25917c2eb84a6bb38 changes only Rust formatting in tests/pg_erd_runtime_isolation_traffic.rs. It does not change the body budget, in-flight limit, traffic sequence, timing configuration, requests, status checks, telemetry check, or recovery condition.

I found one issue:

  • Medium — The saturation test does not prove fail-fast rejection.
    In tests/pg_erd_runtime_isolation_traffic.rs, Line 217 sends the overloaded request and Line 218 checks only for HTTP 503. The configured upstream read timeout is 2 seconds. A faulty implementation could wait for that timeout before returning 503 and still pass the test. Record Instant::now() immediately before get(gateway_address, "/api/over-capacity"). Then assert that the response time is below a bounded interval that is materially less than the 2-second upstream read timeout.

The test starts cwl-pingora-pg-erd-migration as a compiled process. It verifies the 9-byte chunked body rejection under the 8-byte limit, /readyz availability, admission rejection telemetry, and post-release recovery. The added test does not add product authentication, identity, route selection, or retry authority.

You are interacting with an AI system.

Copy link
Copy Markdown
Contributor Author

@coderabbitai review

현재 exact head 4e6376404986cd9c94a0894c5d5e5ba51aeb9f9c만 새로 검토해 주세요. Base는 bb65f2810b178bda46ed7eb5c6a62aae9fe36403이며 predecessor review credit은 승계하지 않습니다. 특히 real-listener chunked 413, in-flight saturation/recovery, health-control-plane availability, telemetry non-vacuity, fixture liveness/timeout cleanup, inherited-parent drift 여부를 확인해 주세요.

@coderabbitai

coderabbitai Bot commented Sep 7, 2026

Copy link
Copy Markdown

Tip

For best results, initiate chat on the files or code changes.

🧩 Analysis chain

🏁 Script executed:

#!/bin/bash
set -euo pipefail

base="bb65f2810b178bda46ed7eb5c6a62aae9fe36403"
head="4e6376404986cd9c94a0894c5d5e5ba51aeb9f9c"

echo "== Exact topology and range =="
git show -s --format='head=%H%nparents=%P%ntree=%T%nsubject=%s' "$head"
printf 'base_tree='
git rev-parse "$base^{tree}"
printf 'merge_base='
git merge-base "$base" "$head"
printf 'left_right_count='
git rev-list --left-right --count "$base...$head"
git log --format='%H %P %s' --ancestry-path "$base..$head"

echo
echo "== Effective paths and patch summary =="
git diff --name-status "$base" "$head"
git diff --stat "$base" "$head"
git diff --check "$base" "$head"

echo
echo "== Traffic acceptance test =="
ast-grep outline tests/pg_erd_runtime_isolation_traffic.rs --items all --view expanded || true
cat -n tests/pg_erd_runtime_isolation_traffic.rs

echo
echo "== Exact test delta =="
git diff --no-ext-diff --unified=120 "$base" "$head" -- tests/pg_erd_runtime_isolation_traffic.rs

echo
echo "== Relevant Rust symbols and call contexts =="
rg -n -C 5 --glob '*.rs' \
  'cwl-pingora-pg-erd-migration|MigrationGatewayProxy|max_in_flight_requests|backpressure_rejections_total|readyz|Body.*[Ll]imit|body.*[Bb]udget|413|503|timeout|Timeout|retry|Retry' \
  src tests || true

echo
echo "== Candidate implementation outlines =="
for f in $(fd -t f -e rs . src tests | sort); do
  if rg -q 'MigrationGatewayProxy|backpressure_rejections_total|max_in_flight_requests|readyz' "$f"; then
    echo "--- $f ---"
    ast-grep outline "$f" --items all --view expanded || true
  fi
done

Length of output: 164780


🏁 Script executed:

#!/bin/bash
set -euo pipefail

echo "== Migration proxy callbacks =="
sed -n '105,270p' src/migration_proxy.rs

echo
echo "== Fixed pg-erd routing plan and delivery lookup =="
ast-grep outline src/migration_plan.rs src/migration_delivery.rs --items all --view expanded || true
sed -n '1,280p' src/migration_plan.rs
sed -n '1,260p' src/migration_delivery.rs

echo
echo "== pg-erd production fixture lifecycle reference =="
sed -n '1,430p' tests/pg_erd_production_path.rs

echo
echo "== Exact inherited-parent drift checks =="
base="bb65f2810b178bda46ed7eb5c6a62aae9fe36403"
head="4e6376404986cd9c94a0894c5d5e5ba51aeb9f9c"
git diff --name-only "$base" "$head" | while IFS= read -r path; do
  printf '%s: ' "$path"
  git diff --quiet "$base" "$head" -- "$path" || echo changed
done
git diff --name-status "$base" "$head" -- src .github Dockerfile Cargo.toml Cargo.lock 2>/dev/null || true

Length of output: 34762


@seonghobae 검토를 완료했습니다. 대상은 정확히 base bb65f2810b178bda46ed7eb5c6a62aae9fe36403부터 head 4e6376404986cd9c94a0894c5d5e5ba51aeb9f9c까지입니다. 이전 검토 또는 실행 결과는 근거로 사용하지 않았습니다.

범위는 ahead 16 / behind 0입니다. head는 일반적인 두 부모 merge입니다. 유효 변경 경로는 다음 다섯 개뿐입니다.

  • CHANGELOG.md
  • CLAUDE.md
  • TEST_STRATEGY.md
  • docs/product-technical-gap-baseline.md
  • tests/pg_erd_runtime_isolation_traffic.rs

상속된 src, workflow, OCI, Admin Config, 고정 라우팅, 인증, identity, 재시도 정책에는 이 범위의 변경이 없습니다. 테스트는 cwl-pingora-pg-erd-migration 컴파일 바이너리를 loopback listener로 시작합니다. 8-byte 예산에 대한 9-byte chunked body의 413, saturation 중 /readyz의 200, backpressure metric 값, held 요청 해제 후 recovery 요청의 200을 확인합니다. /readyz는 admission 이전에 로컬 처리되므로 control plane 분리도 코드와 일치합니다.

한 가지 문제를 확인했습니다.

  • Medium — saturation 거부가 “fail fast”인지 검증하지 않습니다.
    tests/pg_erd_runtime_isolation_traffic.rs Line 217은 overloaded 요청을 전송하고, Line 218에서 503만 확인합니다. 테스트 config의 upstream read_ms는 2000입니다. 잘못된 구현이 local admission 단계에서 즉시 503을 반환하지 않고 upstream 또는 runtime timeout까지 기다린 후 503을 반환해도 이 테스트를 통과할 수 있습니다. get(gateway_address, "/api/over-capacity") 직전에 Instant::now()를 기록하십시오. 그 후 응답 시간이 2초보다 충분히 작은 고정 상한 이내인지 확인하십시오.

fixture는 시작 대기, channel 대기, downstream read에 timeout을 사용합니다. 다만 recovery fixture의 accept()와 header read에는 별도 socket deadline이 없습니다. 정상 경로에서는 recovery 요청이 이를 완료합니다. 실패 경로의 fixture 진단성과 정리 보장은 더 약합니다. 이는 현재 수용 조건의 직접 차단 항목으로 분류하지 않았습니다.

You are interacting with an AI system.

Copy link
Copy Markdown
Contributor Author

@coderabbitai review

Fresh exact-head review for bb65f2810b178bda46ed7eb5c6a62aae9fe36403...356f3f250043d71c9bb1c0655481cd6984f3ae57. Treat all predecessor review/execution as historical. Verify the prior fail-fast finding is now causally closed by the <1 s local 503 bound against the configured 2 s upstream read budget; verify the exact Prometheus sample assertion cannot false-pass on 10/11; recheck fixture liveness, streamed 413, saturation/recovery, authority boundaries, and that effective scope remains only the five #16 child paths.

@coderabbitai

coderabbitai Bot commented Sep 7, 2026

Copy link
Copy Markdown

Tip

For best results, initiate chat on the files or code changes.

🧩 Analysis chain

🏁 Script executed:

#!/bin/bash
set -euo pipefail

base="bb65f2810b178bda46ed7eb5c6a62aae9fe36403"
head="356f3f250043d71c9bb1c0655481cd6984f3ae57"

echo "== Exact topology =="
git show -s --format='head=%H%nparents=%P%ntree=%T%nsubject=%s' "$head"
printf 'base_tree='; git rev-parse "$base^{tree}"
printf 'merge_base='; git merge-base "$base" "$head"
printf 'ahead_behind='; git rev-list --left-right --count "$base...$head"
git log --format='%H %P %s' --ancestry-path "$base..$head"

echo
echo "== Effective paths and diff hygiene =="
git diff --name-status "$base" "$head"
git diff --stat "$base" "$head"
git diff --check "$base" "$head"

echo
echo "== Changed Rust test outline and complete source =="
ast-grep outline tests/pg_erd_runtime_isolation_traffic.rs --items all --view expanded
cat -n tests/pg_erd_runtime_isolation_traffic.rs

echo
echo "== Exact test and docs deltas =="
git diff --no-ext-diff --unified=120 "$base" "$head" -- \
  tests/pg_erd_runtime_isolation_traffic.rs \
  docs/product-technical-gap-baseline.md \
  CHANGELOG.md CLAUDE.md TEST_STRATEGY.md

echo
echo "== Relevant implementation map =="
for file in src/migration_proxy.rs src/migration_plan.rs src/migration_delivery.rs; do
  if [ -f "$file" ]; then
    echo "--- $file ---"
    ast-grep outline "$file" --items all --view expanded
  fi
done

echo
echo "== Relevant implementation and fixture contexts =="
rg -n -C 8 --glob '*.rs' \
  'cwl-pingora-pg-erd-migration|MigrationGatewayProxy|max_in_flight_requests|backpressure_rejections_total|readyz|read_ms|body.*[Bb]udget|[Bb]ody.*[Ll]imit|413|503|Instant::now|timeout\(|accept\(|retry' \
  src tests

echo
echo "== Exact metric assertion forms =="
rg -n -C 4 --glob '*.rs' \
  'cwl_pingora_gateway_backpressure_rejections_total|metrics_body|metrics.*contains|lines\(\)' \
  tests src

Length of output: 231936


🏁 Script executed:

#!/bin/bash
set -euo pipefail

echo "== Migration callback ordering and lease lifetime =="
sed -n '169,268p' src/migration_proxy.rs

echo
echo "== Request admission release implementation =="
sed -n '74,116p' src/runtime_isolation.rs

echo
echo "== Compiled pg-erd entry point and metrics listener setup =="
fd -t f -e rs . src | sort | while IFS= read -r file; do
  if rg -q 'cwl-pingora-pg-erd-migration|metrics_listener|build_proxy\(\)' "$file"; then
    echo "--- $file ---"
    rg -n -C 6 'cwl-pingora-pg-erd-migration|metrics_listener|build_proxy\(\)' "$file"
  fi
done

Length of output: 13289


@seonghobae I reviewed exact range bb65f2810b178bda46ed7eb5c6a62aae9fe36403...356f3f250043d71c9bb1c0655481cd6984f3ae57.

I found no actionable issue.

The merge base is the requested #15 head. The range is 19 commits ahead and 0 commits behind. The effective diff changes only these five #16 child paths:

  • CHANGELOG.md
  • CLAUDE.md
  • TEST_STRATEGY.md
  • docs/product-technical-gap-baseline.md
  • tests/pg_erd_runtime_isolation_traffic.rs

The prior fail-fast finding is closed. tests/pg_erd_runtime_isolation_traffic.rs records Instant::now() immediately before the over-capacity request. It requires HTTP 503 in less than one second. The generated pg-erd configuration sets the upstream read_ms budget to 2,000 ms. This test now rejects an implementation that delays saturation handling until the upstream read timeout.

The metrics assertion is non-vacuous. It splits the metrics response into complete lines and compares each line for exact equality with:

cwl_pingora_gateway_backpressure_rejections_total 1

Therefore, samples with values such as 10 or 11 do not pass this assertion.

The compiled cwl-pingora-pg-erd-migration process receives real loopback traffic. The tests verify:

  • A 9-byte chunked request exceeds the 8-byte body limit and returns HTTP 413.
  • /readyz returns HTTP 200 after the streamed-body rejection.
  • One admitted routed backend request holds the only in-flight lease.
  • The next routed request receives bounded HTTP 503.
  • /readyz remains available during saturation.
  • The backpressure counter exposes the exact single-rejection sample.
  • Releasing the held request permits a later routed request to reach the backend and return HTTP 200.

MigrationGatewayProxy::request_filter serves /livez and /readyz before admission. It applies admission before upstream selection for non-health traffic. RequestAdmission::drop releases the atomic admission count after request completion or failure.

The fixture has bounded process startup, downstream read, and synchronization waits. The backend header read and recovery accept() do not have individual socket deadlines. However, the main test reaches origin.join() only after bounded client operations complete. A failed fixture sequence fails the test without indefinitely waiting to join the fixture thread.

The changed test and documentation do not add product authentication, product business logic, Keyverse identity authority, Wardnet/EgressWeave authority, arbitrary route configuration, or retry authority. The exact head still requires its own hosted execution evidence.

You are interacting with an AI system.

Copy link
Copy Markdown
Contributor Author

@coderabbitai review

Fresh exact-head review requested for current parent bb65f2810b178bda46ed7eb5c6a62aae9fe36403...356f3f250043d71c9bb1c0655481cd6984f3ae57. Treat all predecessor review/check evidence as historical. Please verify the ordinary non-force succession, the <1 s saturation fail-fast oracle versus the configured 2 s upstream read budget, exact Prometheus sample matching for cwl_pingora_gateway_backpressure_rejections_total 1, the real-listener 9-byte chunked body rejection under an 8-byte budget, readiness during saturation, post-release capacity recovery, and unchanged product-domain/Keyverse/Wardnet/EgressWeave authority boundaries. Current CI 34168471195 is terminal success on this exact SHA; Supply Chain 34168471176 is still executing, so do not infer release/cutover or human-approval credit.

@coderabbitai

coderabbitai Bot commented Sep 7, 2026

Copy link
Copy Markdown

Tip

For best results, initiate chat on the files or code changes.

🧩 Analysis chain

🏁 Script executed:

#!/bin/bash
set -euo pipefail

base="bb65f2810b178bda46ed7eb5c6a62aae9fe36403"
head="356f3f250043d71c9bb1c0655481cd6984f3ae57"

echo "== Topology and range =="
git show -s --format='head=%H%nparents=%P%ntree=%T%nsubject=%s' "$head"
printf 'merge_base='; git merge-base "$base" "$head"
printf 'ahead_behind='; git rev-list --left-right --count "$base...$head"
git log --format='%H %P %s' --ancestry-path "$base..$head"

echo "== Exact effective scope =="
git diff --name-status "$base" "$head"
git diff --stat "$base" "$head"
git diff --check "$base" "$head"
echo "== Protected inherited paths changed in exact range (should be empty) =="
git diff --name-status "$base" "$head" -- src .github Dockerfile Cargo.toml Cargo.lock || true

echo "== Changed test structure and contents =="
ast-grep outline tests/pg_erd_runtime_isolation_traffic.rs --items all --view expanded
cat -n tests/pg_erd_runtime_isolation_traffic.rs

echo "== Exact test patch =="
git diff --no-ext-diff --unified=100 "$base" "$head" -- tests/pg_erd_runtime_isolation_traffic.rs

echo "== Relevant implementation maps =="
for file in src/migration_proxy.rs src/runtime_isolation.rs src/migration_plan.rs src/migration_delivery.rs; do
  if [ -f "$file" ]; then
    echo "--- $file ---"
    ast-grep outline "$file" --items all --view expanded
  fi
done

echo "== Admission, health, routing, and timeout contexts =="
rg -n -C 10 --glob '*.rs' \
  'cwl-pingora-pg-erd-migration|MigrationGatewayProxy|max_in_flight_requests|backpressure_rejections_total|/readyz|read_ms|body.*[Bb]udget|[Bb]ody.*[Ll]imit|Instant::now|timeout\(|accept\(|RequestAdmission|retry' \
  src tests

echo "== Relevant implementations =="
sed -n '150,290p' src/migration_proxy.rs
sed -n '1,160p' src/runtime_isolation.rs

echo "== Named GitHub Actions runs =="
gh run view 34168471195 --json databaseId,status,conclusion,headSha,name,url 2>&1 || true
gh run view 34168471176 --json databaseId,status,conclusion,headSha,name,url 2>&1 || true

Length of output: 218151


@seonghobae I reviewed the exact range bb65f2810b178bda46ed7eb5c6a62aae9fe36403...356f3f250043d71c9bb1c0655481cd6984f3ae57.

I found no actionable issue.

The merge base is the requested parent. The head is 19 commits ahead and 0 commits behind. The ancestry retains the ordinary two-parent adoption at 4e6376404986cd9c94a0894c5d5e5ba51aeb9f9c. Its parents are abee6af1ecfc1d2f44de1dc25917c2eb84a6bb38 and bb65f2810b178bda46ed7eb5c6a62aae9fe36403. The requested head is its linear descendant.

The effective diff changes only these five paths:

  • CHANGELOG.md
  • CLAUDE.md
  • TEST_STRATEGY.md
  • docs/product-technical-gap-baseline.md
  • tests/pg_erd_runtime_isolation_traffic.rs

The exact range does not change src, workflow files, OCI files, Cargo.toml, or Cargo.lock. It does not introduce inherited-parent drift.

tests/pg_erd_runtime_isolation_traffic.rs starts the compiled cwl-pingora-pg-erd-migration process and uses loopback listeners. The test config sets max_request_body_bytes: 8, max_in_flight_requests: 1, and read_ms: 2000.

The streamed-body test sends two chunked body fragments of 4 and 5 bytes. It requires HTTP 413 for the 9-byte body. It then requires HTTP 200 from /readyz.

The saturation test holds the only admitted routed request at the backend. It measures the overloaded request from immediately before get(gateway_address, "/api/over-capacity"). It requires HTTP 503 in less than one second. This bound is materially below the configured 2-second upstream read budget. The prior fail-fast acceptance gap is closed.

The telemetry assertion splits the metrics response into lines. It compares each line exactly with:

cwl_pingora_gateway_backpressure_rejections_total 1

Values such as 10 and 11 cannot satisfy this assertion.

The test requires /readyz to return HTTP 200 during saturation. It releases the held backend response. It then requires the held request and a later routed request to return HTTP 200. This proves admission-capacity recovery.

MigrationGatewayProxy::request_filter serves /livez and /readyz before admission. It acquires admission before upstream selection for other traffic. RequestAdmission::drop releases the in-flight count when the request context ends. The fixture bounds process startup, downstream reads, and channel synchronization. The fixture has no separate deadline on backend accept() or header reads. The tested client operations have deadlines, and failure exits the test rather than waiting for the fixture join path.

The changed test adds no product authentication, business logic, Keyverse identity authority, Wardnet/EgressWeave authority, arbitrary route authority, or retry authority.

CI run 34168471195 completed successfully on 356f3f250043d71c9bb1c0655481cd6984f3ae57. Supply Chain run 34168471176 remains in progress on the same SHA. Neither result provides release, cutover, or human-approval credit.

You are interacting with an AI system.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant