ci: add harness integration CI for the four agent CLIs - #596

Open

omkargaikwad23 wants to merge 24 commits into

mainfrom

feat/ci-harness-smoke

Commits on Sep 10, 2026

feat: add CI harness smoke test pipeline with automated result verification
omkargaikwad23
committed
b08b5d8

Commits on Sep 11, 2026

Merge branch 'main' into feat/ci-harness-smoke
omkargaikwad23
committed
0d032bf
Merge branch 'main' into feat/ci-harness-smoke
omkargaikwad23
committed
b977e23
feat: centralize model configurations in .ci/ directory and update model versions and environment settings
omkargaikwad23
committed
f9f17b4
chore: update gemini-cli version, improve CI build caching, and remove redundant config comments
omkargaikwad23
committed
f8082d5
chore: update EVAL_GCP_PROJECT_REGION to global in cloudbuild configuration
omkargaikwad23
committed
9f478d0
chore: parameterize secret project ID and update Gemini cloud location to global
omkargaikwad23
committed
8dbd976
feat: add step to fetch service account key from Secret Manager and mount it to harness containers
omkargaikwad23
committed
ffb7f7f
refactor: clarify cloudbuild steps and optimize volume mounts for individual harness tasks
omkargaikwad23
committed
4a78c93
feat: capture and log probe process output and exit code in agy_cli error messages
omkargaikwad23
committed
d65ff56
refactor: remove trajectory_matcher threshold gating and update CI cache strategy to push on failure
omkargaikwad23
committed
b59399c
feat: update secret key name to be consistent with other key names
omkargaikwad23
committed
455462d
ci: llm key name
omkargaikwad23
committed
9765893
Change OpenAI API key secret version to latest
omkargaikwad23
authored
ec1a392
Change OpenAI API key secret version to 2
omkargaikwad23
authored
b41f45e
refactor: remove inline comments from CI configuration and update cloud SQL smoke test conversation plan
omkargaikwad23
committed
2c6ef86

Commits on Sep 14, 2026

Commits on Sep 15, 2026

Update vertex_region to 'global' in model config
omkargaikwad23
authored
7f08d5d

Navigation Menu

Uh oh!

ci: add harness integration CI for the four agent CLIs - #596

ci: add harness integration CI for the four agent CLIs#596
omkargaikwad23 wants to merge 24 commits into
mainfrom
feat/ci-harness-smoke

Commits on Sep 10, 2026

feat: add CI harness smoke test pipeline with automated result verification

Commits on Sep 11, 2026

Merge branch 'main' into feat/ci-harness-smoke

Merge branch 'main' into feat/ci-harness-smoke

feat: centralize model configurations in .ci/ directory and update model versions and environment settings

chore: update gemini-cli version, improve CI build caching, and remove redundant config comments

chore: update EVAL_GCP_PROJECT_REGION to global in cloudbuild configuration

chore: parameterize secret project ID and update Gemini cloud location to global

feat: add step to fetch service account key from Secret Manager and mount it to harness containers

refactor: clarify cloudbuild steps and optimize volume mounts for individual harness tasks

feat: capture and log probe process output and exit code in agy_cli error messages

refactor: remove trajectory_matcher threshold gating and update CI cache strategy to push on failure

feat: update secret key name to be consistent with other key names

ci: llm key name

Change OpenAI API key secret version to latest

Change OpenAI API key secret version to 2

refactor: remove inline comments from CI configuration and update cloud SQL smoke test conversation plan

Commits on Sep 14, 2026

Merge branch 'main' into feat/ci-harness-smoke

revert: drop agy_cli probe output logging

fix: enforce non-zero trajectory_matcher scores and handle non-finite telemetry values in verify_harness.py

feat: add agy_cli model configuration and update run config path

refactor: consolidate individual harness run configs into a single parameterized YAML file using environment variables

Merge branch 'main' into feat/ci-harness-smoke

chore: update model versions and reduce max turns for smoke harness

Commits on Sep 15, 2026

Update vertex_region to 'global' in model config