Skip to content

build(deps): bump inspect-ai from 0.3.277 to 0.3.278 - #120

Merged
amrit110 merged 1 commit into
mainfrom
dependabot/uv/inspect-ai-0.3.278
Oct 15, 2026
Merged

amrit110 merged 1 commit into
mainfrom
dependabot/uv/inspect-ai-0.3.278

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Oct 14, 2026

Copy link
Copy Markdown
Contributor

Bumps inspect-ai from 0.3.277 to 0.3.278.

Release notes

Sourced from inspect-ai's releases.

0.3.278

  • Tasks and samples can carry a description of what they ask of the agent, recorded in the eval log and in evals_df() and samples_df().
  • Tool review now also reviews handoff() calls, as approval does.
  • Compaction: Fixed compaction triggering early and reporting inflated token counts on OpenAI reasoning models, which counted replayed reasoning twice.
  • Compaction: Removed ModelAPI.apply_redacted_reasoning_tokens_to_input() and stopped adding redacted_reasoning_tokens to assistant message metadata.
  • Compaction: Overflow recovery in react() no longer forces compaction again when the retry after a forced compaction also overflows, which could resend the same request indefinitely.
  • Grok: Fixed batch mode failing after a credential refresh (e.g. on an expired API key), including batches already in progress.
  • Models: Setting text on a ChatMessage with a list of content now replaces the existing text in place instead of moving it after images and other media; a message with no text still gets the new text appended. prompt_template(), chain_of_thought() and multiple_choice() set text, so multimodal evals that put text before media now send the prompt in the order they wrote it, and their baselines may shift on rerun. (#4770)
  • Solver: TaskState.input_text no longer raises when the last user message has no text; image-only and other non-text messages return placeholders such as [image], and an empty message returns "".
  • Bugfix: Hugging Face task loading reads the Hub-delivered eval.yaml in UTF-8 rather than the locale default, so task configs with non-ASCII characters no longer crash or silently corrupt on Windows with a non-UTF-8 code page (or on a C-locale system).
  • Anthropic: Support for Claude Haiku 5.5 (claude-haiku-5-5): reasoning_effort="none" disables thinking, computer use uses the computer toolset on the Claude API and Vertex, and fallback_models is ignored with a warning.
  • Anthropic: With reasoning_effort on Claude 4.6+, forced tool choice (except on Fable/Mythos 5.1, Opus 5.5, Sonnet 5.5), tool_choice="none" and parallel_tool_calls=False are now honored; forced turns skip thinking.
  • Bugfix: inspect log convert --stream (and convert_eval_logs(stream=...)) no longer drops the error message and traceback from logs of failed evals.
  • Fixed StoreModel skipping field validation when constructed with an empty instance string.
  • Fixed the human reviewer filling in tool arguments inside tool output that contains {{{...}}} (three or more braces).
  • Tools: Tools with *args or **kwargs no longer advertise required args/kwargs parameters to models; declare model-chosen arguments with an explicit ToolParams schema instead.
  • Control Channel: inspect ctl model throughput now reports each model's input, output and cache read/write tokens per minute, in the table and in --json output; the table's output column is now per minute instead of per second.
  • Bugfix: An approver's modify decision with no modified call now rejects the tool call instead of running the original, and the human approver no longer offers Modify.
  • Deep Agent: deepagent(background=True) run from a scorer can now dispatch background subagents instead of failing.
  • Anthropic: Forced web searches now work on Claude 4.6+, and web_search() now honors allowed_callers and type in its anthropic options.
  • Agent Bridge: Web search from a bridged Anthropic client, such as Claude Code's WebSearch, now uses the tool version the client declared unless the eval sets one.
  • Agent Bridge: A provider error delivered during a streamed response now reaches the bridged agent as an error instead of a malformed HTTP 200 success.
  • Agent Bridge: A bridged Anthropic client now sees conflict, timeout, and billing errors as such instead of as generic server errors.
  • Agent Bridge: Sandboxed agents now receive exhausted provider errors with their original status and error details.
  • Dependencies: Require nest_asyncio2 >= 1.7.4, fixing cancel scope errors (e.g. from Mistral streaming) after Inspect is called synchronously from a notebook or another running event loop.
Changelog

Sourced from inspect-ai's changelog.

0.3.278 (09 October 2026)

  • Tasks and samples can carry a description of what they ask of the agent, recorded in the eval log and in evals_df() and samples_df().
  • Tool review now also reviews handoff() calls, as approval does.
  • Compaction: Fixed compaction triggering early and reporting inflated token counts on OpenAI reasoning models, which counted replayed reasoning twice.
  • Compaction: Removed ModelAPI.apply_redacted_reasoning_tokens_to_input() and stopped adding redacted_reasoning_tokens to assistant message metadata.
  • Compaction: Overflow recovery in react() no longer forces compaction again when the retry after a forced compaction also overflows, which could resend the same request indefinitely.
  • Grok: Fixed batch mode failing after a credential refresh (e.g. on an expired API key), including batches already in progress.
  • Models: Setting text on a ChatMessage with a list of content now replaces the existing text in place instead of moving it after images and other media; a message with no text still gets the new text appended. prompt_template(), chain_of_thought() and multiple_choice() set text, so multimodal evals that put text before media now send the prompt in the order they wrote it, and their baselines may shift on rerun. (#4770)
  • Solver: TaskState.input_text no longer raises when the last user message has no text; image-only and other non-text messages return placeholders such as [image], and an empty message returns "".
  • Bugfix: Hugging Face task loading reads the Hub-delivered eval.yaml in UTF-8 rather than the locale default, so task configs with non-ASCII characters no longer crash or silently corrupt on Windows with a non-UTF-8 code page (or on a C-locale system).
  • Anthropic: Support for Claude Haiku 5.5 (claude-haiku-5-5): reasoning_effort="none" disables thinking, computer use uses the computer toolset on the Claude API and Vertex, and fallback_models is ignored with a warning.
  • Anthropic: With reasoning_effort on Claude 4.6+, forced tool choice (except on Fable/Mythos 5.1, Opus 5.5, Sonnet 5.5), tool_choice="none" and parallel_tool_calls=False are now honored; forced turns skip thinking.
  • Bugfix: inspect log convert --stream (and convert_eval_logs(stream=...)) no longer drops the error message and traceback from logs of failed evals.
  • Fixed StoreModel skipping field validation when constructed with an empty instance string.
  • Fixed the human reviewer filling in tool arguments inside tool output that contains {{{...}}} (three or more braces).
  • Tools: Tools with *args or **kwargs no longer advertise required args/kwargs parameters to models; declare model-chosen arguments with an explicit ToolParams schema instead.
  • Control Channel: inspect ctl model throughput now reports each model's input, output and cache read/write tokens per minute, in the table and in --json output; the table's output column is now per minute instead of per second.
  • Bugfix: An approver's modify decision with no modified call now rejects the tool call instead of running the original, and the human approver no longer offers Modify.
  • Deep Agent: deepagent(background=True) run from a scorer can now dispatch background subagents instead of failing.
  • Anthropic: Forced web searches now work on Claude 4.6+, and web_search() now honors allowed_callers and type in its anthropic options.
  • Agent Bridge: Web search from a bridged Anthropic client, such as Claude Code's WebSearch, now uses the tool version the client declared unless the eval sets one.
  • Agent Bridge: A provider error delivered during a streamed response now reaches the bridged agent as an error instead of a malformed HTTP 200 success.
  • Agent Bridge: A bridged Anthropic client now sees conflict, timeout, and billing errors as such instead of as generic server errors.
  • Agent Bridge: Sandboxed agents now receive exhausted provider errors with their original status and error details.
  • Dependencies: Require nest_asyncio2 >= 1.7.4, fixing cancel scope errors (e.g. from Mistral streaming) after Inspect is called synchronously from a notebook or another running event loop.
Commits
  • b93e704 Release 0.3.278: date the CHANGELOG section (#5800)
  • bd96694 Publish to PyPI automatically when a GitHub Release is published (#5785)
  • 7de3f8f test: skip sentinel human tests cleanly when inspect_sentinel is absent (#5794)
  • ba238b0 Let tasks and samples carry a description, recorded in the log and dataframes...
  • 82c7cf8 Keep Task, eval and eval_set positional arguments in place by moving sentinel...
  • 2c00282 Add experimental sentinel monitors and protocols for tool calls (#5514)
  • 26b16e8 Fix StoreModel empty-instance validation and reviewer brace escaping (#5760)
  • 36b8e87 Fix forced tool choice being ignored on Claude when reasoning_effort is set (...
  • 0eeb778 Return early when a StoreModel field has no annotation (#5779)
  • 7823135 Require nest_asyncio2 1.7.4 to fix cancel scope errors from abandoned streams...
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Bumps [inspect-ai](https://github.com/UKGovernmentBEIS/inspect_ai) from 0.3.277 to 0.3.278.
- [Release notes](https://github.com/UKGovernmentBEIS/inspect_ai/releases)
- [Changelog](https://github.com/UKGovernmentBEIS/inspect_ai/blob/main/CHANGELOG.md)
- [Commits](UKGovernmentBEIS/inspect_ai@0.3.277...0.3.278)

---
updated-dependencies:
- dependency-name: inspect-ai
  dependency-version: 0.3.278
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot Bot added dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code labels Oct 14, 2026
@amrit110
amrit110 merged commit f91cce8 into main Oct 15, 2026
1 check passed
@amrit110
amrit110 deleted the dependabot/uv/inspect-ai-0.3.278 branch October 15, 2026 00:40
@amrit110

Copy link
Copy Markdown
Member

Automated fix applied and PR merged

The agentic fix loop successfully fixed this PR and merged it.

✓ Successfully fixed merge_only failures - Modified 0 files - Executed 117 agent actions - (79 info, 18 tool_call, 3 error, 13 tool_result, 4 reasoning)

View PR history on dashboard

AI Engineering Maintenance Bot

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant