Skip to content

Default BrowserCode evaluations to 100 concurrent tasks - #43

Merged
MagMueller merged 2 commits into
mainfrom
codex/benchmark-parallel-100
Sep 25, 2026
Merged

MagMueller merged 2 commits into
mainfrom
codex/benchmark-parallel-100

Conversation

@MagMueller

@MagMueller MagMueller commented Sep 25, 2026 •

Copy link
Copy Markdown
Contributor

BrowserCode V2 runs now default to up to 100 concurrent tasks in both run_eval.py and GitHub Actions. The workflow accepts concurrency values from 1 to 200, and the README documents overrides and GitHub account limits. The benchmark still selects all 200 tasks; legacy V1/Stealth concurrency is unchanged.

Validation: 66 unittest cases completed successfully (two optional binary checks skipped), Ruff, actionlint, and diff checks passed. Verified CLI overrides and workflow concurrency boundaries. This changes configuration defaults; no new 100-concurrent live benchmark was dispatched.


Summary by cubic

Defaults BrowserCode V2 evaluations to up to 100 concurrent tasks in both run_eval.py and the GitHub Actions workflow, while keeping the benchmark set at all 200 tasks. Legacy V1 and stealth concurrency defaults are unchanged.

  • The bcode executor now defaults to 100 concurrent tasks; other executors keep the prior default of 3.
  • The workflow's max_parallel input now defaults to 100 (was 12) and accepts values from 1 to 200 (was 1 to 50).
  • README documents the new default and how to override it with --parallel or max_parallel.

Written for commit 66aec34. Summary will update on new commits.

Review in cubic

@cubic-dev-ai cubic-dev-ai Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All reported issues were addressed across 4 files

Heads up: you’re close to your flex budget. Increase your flex budget so reviews don’t pause.

Fix all with cubic | Re-trigger cubic

Comment thread README.md Outdated
@MagMueller
MagMueller merged commit 2ba9806 into main Sep 25, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant