Skip to content

build(deps): bump inspect-ai from 0.3.276 to 0.3.277 - #118

Merged
amrit110 merged 1 commit into
mainfrom
dependabot/uv/inspect-ai-0.3.277
Oct 10, 2026
Merged

amrit110 merged 1 commit into
mainfrom
dependabot/uv/inspect-ai-0.3.277

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Oct 9, 2026

Copy link
Copy Markdown
Contributor

Bumps inspect-ai from 0.3.276 to 0.3.277.

Changelog

Sourced from inspect-ai's changelog.

0.3.277 (06 October 2026)

  • Fixed trace logs growing to many gigabytes when model output caching is enabled.
  • Fixed model calls and token counting in multiprocess Scout scans using the default model configuration.
  • Bugfix: Interrupting after scoring no longer drops the scored sample from a cancelled evaluation log while its sandbox is being cleaned up.
  • Bugfix: Overflow recovery no longer drops the sample's input from the recorded conversation, so scorers and the viewer still see the task after a forced compaction.
  • Sample sources: enqueue_sample(samples, epoch=N) runs each sample once as epoch N, so a source can run one sample repeatedly under its own id.
  • Run config: eval_config.token_limit_type from an exported or handwritten run config is applied as the token-limit metering type instead of being rejected as an unknown generate option.
  • Fixed model calls failing before the first sample on Windows systems with a CJK ANSI code page (cp932/936/949/950).
  • Realtime logging: Fixed live sample reads occasionally showing model calls with empty inputs when the sample finished while being read.
  • Meta: Muse models not yet in the model database (new versions or codenames) now use the current frontier model's context window and max reasoning effort support.
  • Bedrock: Unsupported Amazon Nova models now ignore reasoning effort with a warning instead of failing every request.
  • Timestamps and times ending in a lowercase z are now parsed as UTC on Python 3.11 and later, as they already were on Python 3.10.
  • Model API: Model events log provider request ids (including for retried requests) and response ids, even when raw model API calls are not logged.
  • Datasets: shuffle on csv_dataset(), json_dataset(), file_dataset() and hf_dataset() now treats an integer as a seed, so shuffle=0 shuffles with seed 0.
  • Fixed exact() and f1() scorers awarding a perfect score when a target normalizes to an empty string.
  • Security: Text-editor undo history uses non-executable data stored privately per OS account; old pickle history is ignored.
  • Sandbox tools: killing an exec_remote job that has already exited now guards against signalling unrelated processes that reused its PID.
  • Sandbox: exec_remote() and sandbox_agent_bridge() take a new opt-in poll_timeout_recovery that keeps polling a running command through a temporary sandbox stall instead of failing.
  • Docker: Sandboxes with healthchecks now allow 60 s of startup beyond the healthcheck estimate; a start that hangs, or a service still starting after that, can take up to about 150 s longer to fail (more on a loaded host).
  • Docker: --no-sandbox-cleanup now lists each environment's cleanup command, and inspect sandbox cleanup docker <project> now removes custom networks declared in a ComposeConfig.
  • Eval Set: retry_cleanup now also removes the older interrupted (started) logs its own attempts left behind, and their sample buffers, once those buffers have shut down.
  • Images in tool results recorded in the transcript now follow log_images like images in messages: stored as attachments when enabled, removed when disabled.
  • Eval Logs: Fewer redundant log writes when samples complete during a slow log flush.
  • Model providers: Failed and cancelled requests no longer leave tracking entries that grow memory use over a long evaluation.
  • Google: Fixed audio, video and document content being sent with the MIME type of an earlier upload of the same bytes; uploads are now reused only for the same MIME type and account.
  • Limits: A model call is now refused before it is sent when a token or cost limit is already reached, including when usage exactly equals the limit.
  • Core data types (ChatMessage, ModelOutput, ToolInfo, GenerateConfig and the types they use) moved to the new inspect_ai.core package; existing import paths still work.
  • ModelOutput.from_message() takes an optional model argument.
  • Bugfix: Cost tracking and cost_limit now price a request at the rates of the model that served it (refusal fallbacks, Azure deployments, and routers on OpenRouter, Bedrock, Fireworks and LiteLLM proxies); providers report it with the new ModelAPI.served_model_usage().
  • Batch mode: Requests with different HTTP headers, such as extra_headers or Anthropic beta headers, are now sent in separate batches, so one request's headers no longer apply to others.
  • Mistral: Image URLs in model output are no longer downloaded from any host; they are recorded as text with the URL. Inline images are unchanged.
  • Bugfix: The model output cache no longer reads, writes or deletes files outside the cache directory; unsafe model names are not cached, and cache_path(model) rejects them with ValueError.
  • Bugfix: Remote MCP servers are now refused while an approval policy is active, rather than having their tools run by the model provider without approval.
  • Bugfix: Results of sandbox_agent_bridge() bridged tools are now truncated at max_tool_output (or the tool's max_output), as other tool results are.
  • Eval Set: Fixed logging with S3 credentials restricted to the log directory's prefix, and reading and writing eval-set.json for Azure log directories with a trailing slash or an account in the URL.
  • Analysis: Type checkers now accept column extract functions that take a specific event, message or sample type, or return a precise JSON type such as list[dict[str, int]].
  • Hugging Face: Concurrent requests for different models or generation settings are now generated with their own model and settings, not the first request's.
  • OpenAI and Anthropic: Fixed concurrent requests failing or restarting when another sample's request triggers a credential refresh (e.g. on an expired API key).
  • OpenAI: OpenAI: The OpenAI providers, message and output converters, and agent bridge now require openai >= 3.4.0.
  • Bugfix: Tool events now record the arguments an approver's modify decision substituted, and a modify that changes the function now fails the sample instead of running the wrong call.
  • Agent Bridge: sandbox_agent_bridge() now serves a request for an unknown model name with the eval's model and logs a warning; add the name to model_aliases to send it to another model.
  • Agent Bridge: Fixed a bridge filter sometimes receiving the model name instead of a Model (or the reverse) when filters of both signatures were used in one process.
  • Perplexity: Each response now gets only its own citations and usage when one model handles concurrent requests, and a failed request no longer reuses an earlier response's.
  • Agent Bridge: For both agent_bridge() and sandbox_agent_bridge(), the eval's configuration now governs service_tier, store, truncation and provider tool options such as web search domains, which the agent's requests no longer override; requests with previous_response_id are refused.
Commits
  • aa20052 update changelog for release
  • ca24407 Fix trace log growing to many GB when generate caching is enabled (#5730)
  • 5d97e38 Agent bridge follows the eval's configuration for service tier, storage, trun...
  • b3b2f62 Fix Perplexity responses picking up another request's citations and usage (#5...
  • 00de28b Fix bridge filters receiving the wrong first argument after id reuse (#5724)
  • afdc20a Pin GitHub Actions to commit SHAs and wait 7 days before Dependabot proposes ...
  • 38779d1 Stop Meta mock tests leaking a dummy-key model into get_model's cache (#5706)
  • 8379140 Sandbox agent bridge: serve unknown model names with the eval's model (#5701)
  • f4a5483 Fix approvers' modify decisions running the wrong call or logging the wrong a...
  • ced73bc Fix OpenAI and Anthropic requests failing during credential refresh (#5679)
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Bumps [inspect-ai](https://github.com/UKGovernmentBEIS/inspect_ai) from 0.3.276 to 0.3.277.
- [Release notes](https://github.com/UKGovernmentBEIS/inspect_ai/releases)
- [Changelog](https://github.com/UKGovernmentBEIS/inspect_ai/blob/main/CHANGELOG.md)
- [Commits](UKGovernmentBEIS/inspect_ai@0.3.276...0.3.277)

---
updated-dependencies:
- dependency-name: inspect-ai
  dependency-version: 0.3.277
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot Bot added dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code labels Oct 9, 2026
@amrit110
amrit110 merged commit b57040e into main Oct 10, 2026
1 check passed
@amrit110
amrit110 deleted the dependabot/uv/inspect-ai-0.3.277 branch October 10, 2026 00:48
@amrit110

Copy link
Copy Markdown
Member

Automated fix applied and PR merged

The agentic fix loop successfully fixed this PR and merged it.

✓ Successfully fixed merge_only failures - Modified 0 files - Executed 155 agent actions - (111 info, 21 tool_call, 3 error, 16 tool_result, 4 reasoning)

View PR history on dashboard

AI Engineering Maintenance Bot

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant