Skip to content

Look up the publisher once per run, not per message - #421

Draft
radiken wants to merge 1 commit into
masterfrom
alan/publish-rate
Draft

radiken wants to merge 1 commit into
masterfrom
alan/publish-rate

Conversation

@radiken

@radiken radiken commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

Resolves the pod-api-requester address once before the publish loop. The per-message lookup blocked the event loop, so a slow k8s API stretched the publish period (the v2.3.0 matrix ran at 0.48 msg/s instead of 1).

pod_api_request resolved the pod-api-requester (list pods, read node, read
service) with the blocking k8s client on every publish. That stalls the event
loop, so the publish period became max(delay_after_publish, lookup time). Over
the Rancher proxy the lookup took 2.08 s on 2026-08-15, and the whole v2.3.0
matrix published at 0.48 msg/s instead of 1.

The run now resolves the address once before the publish loop and passes it
down; pod_api_request keeps the lookup for callers that do not pass one.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant