chore(aeval): bump to v0.3.1 (binary + aeval-data pin) - #125
Conversation
Bumps both halves per the CI contract: AEVAL_VERSION selects the binary, the aeval-data submodule pins the corpus/config baked into the image. v0.3.1 carries an updated elevenlabs platform config (new agent_url) plus refreshed examples/corpus. Verified with a real local image build (repo-root context, --target base, the stage that downloads aeval): build succeeds and the baked binary's sha256 + size match the published v0.3.1 checksum exactly (57c70374…b711 / 441515480). UPSTREAM BUG FOUND: that verified-genuine v0.3.1 binary self-reports "aeval 0.3.0" from `--version`. Consequences are cosmetic today — daemons report frameworkVersion v0.3.0 (unchanged from before, so no regression), and the aeval-seed auto-seeder that would stamp the release-notes version (v0.3.1) onto built-in eval sets has no live call site, so no job can be created that the version gate would hide from the fleet. Worth fixing upstream before that seeder is ever wired up. 🤖 Built with SMT <smt@agora.build>
🤖 Codex Code ReviewNo findings in the two-line PR diff. Residual risk: I couldn’t inspect the |
🤖 Claude Code ReviewReviewThe change itself is minimal and mechanically correct: No security concerns. Nothing here touches credentials, secrets, or request handling. One thing worth confirming before merge: the two version sources must agreeThere are two independent version knobs, and this PR moves both — but nothing enforces that they land on the same version:
If commit I could not verify this locally — the submodule is not initialized in this checkout, and remote lookups weren't available to me. Two things that are fine, for the record:
Pre-existing, not introduced here
|
Summary
Bumps aeval to v0.3.1, both halves per the contract documented in
.github/workflows/docker.yml—AEVAL_VERSIONselects the binary, theaeval-datasubmodule pins the corpus/config baked into the image:vox_eval_agentd/Dockerfile:ARG AEVAL_VERSION=v0.3.0→v0.3.1vox_eval_agentd/aeval-data:4ffb306(v0.3.0) →cfc2b28(v0.3.1)Release content: updated elevenlabs platform config (new
agent_url) plus refreshedexamples/,corpus/, and release notes.Verification
The image build only runs post-merge on main (no PR gate), so this was verified with a real local build — repo-root context,
-f vox_eval_agentd/Dockerfile --target base(the stage that downloads aeval):sha256 57c70374…05b711,441515480bytes.npm run checkclean;tests/aeval-seed.test.ts27/27.That verified-genuine v0.3.1 binary self-reports
aeval 0.3.0from--version. Traced the blast radius:--versionfor theirframeworkVersionmetadata → they'll reportv0.3.0. That's unchanged from today, so no regression.aeval-seed, which stamps the release-notes version (now v0.3.1) onto built-in eval sets, while the job version gate (routes.ts) hides any job whoseframeworkVersionexceeds the agent's — v0.3.1-stamped jobs would be invisible to the whole fleet. However, both seed triggers (seedFromLocalAevalData,seedAevalVersion) currently have no live call site (routes.tsimports onlycompareVersions), so nothing creates such jobs.Net: cosmetic/observability only today — but worth fixing upstream before that seeder is ever wired up, and worth knowing that operators' agent listings will read
v0.3.0while the image actually contains v0.3.1.Generated with SMT smt@agora.build