Repository navigation
.NET: Remove deprecated Azure Persistent v1 integration tests #9587
Description
Category
Build or CI
Problem
The live AzureAIAgentsPersistent.IntegrationTests suite repeatedly fails on both .NET 10/Linux and .NET Framework 4.7.2/Windows. Tests spend approximately 10–40 minutes waiting before reporting streaming errors, network timeouts, or prematurely closed responses. Integration jobs can exceed the merge queue's check-wait window, removing otherwise eligible PRs with checks_timed_out.
This is not specific to the OAuth consent changes in #9565: matching failures occur in merge groups without that patch and before that PR entered the queue. The underlying cause of the service failures is not established. The affected code belongs to the legacy Azure Persistent/v1 integration: its framework adapter methods are already marked Obsolete and direct consumers to Microsoft.Agents.AI.AzureAI. The reporter has changed the requested resolution to removing this legacy integration-test suite, rather than adding temporary skips or attempting a permanent service/SDK fix.
Evidence
Latest affected merge group for #9565, commit 1d3be33248c3f0349424a838ea09523060986679:
- Linux integration job: 6 failures.
- Windows integration job: 5 failures.
- All four builds, both unit-test jobs, and the dedicated Foundry Hosted integration job passed in that run. The PR was removed from the queue at
2026-10-21T22:23:36Zwith reasonchecks_timed_out.
Independent evidence:
- Merge group for #9585 without the #9565 patch reports the same Azure Persistent streaming errors.
- Earlier merge group for #8801 already failed before .NET: Preserve toolbox OAuth consent context #9565 entered the queue.
- Scheduled main run also failed both integration matrix jobs.
- Additional affected runs: 39650963370 and 39660301675.
Observed failing tests across these captured runs, all under dotnet/tests/AzureAIAgentsPersistent.IntegrationTests/:
| Test class | Test method / observed case |
|---|---|
AzureAIAgentsPersistentCreateTests |
CreateAgent_CreatesAgentWithAIFunctionToolsAsync(createMechanism: "CreateWithChatClientAgentOptionsAsync") |
AzureAIAgentsChatClientAgentRunTests |
RunWithFunctionsInvokesFunctionsAndReturnsExpectedResultsAsync |
AzureAIAgentsChatClientAgentRunTests |
RunWithInstructionsAndNoMessageReturnsExpectedResultAsync |
AzureAIAgentsChatClientAgentRunStreamingTests |
RunWithFunctionsInvokesFunctionsAndReturnsExpectedResultsAsync |
AzureAIAgentsChatClientAgentRunStreamingTests |
RunWithInstructionsAndNoMessageReturnsExpectedResultAsync |
AzureAIAgentsPersistentRunTests |
SessionMaintainsHistoryAsync |
AzureAIAgentsPersistentRunTests |
RunWithStringReturnsExpectedResultAsync |
AzureAIAgentsPersistentRunTests |
RunWithNoMessageDoesNotFailAsync |
AzureAIAgentsPersistentRunStreamingTests |
SessionMaintainsHistoryAsync |
AzureAIAgentsPersistentRunStreamingTests |
RunWithStringReturnsExpectedResultAsync |
AzureAIAgentsPersistentRunStreamingTests |
RunWithChatMessageReturnsExpectedResultAsync |
AzureAIAgentsPersistentRunStreamingTests |
RunWithChatMessagesReturnsExpectedResultAsync |
AzureAIAgentsPersistentRunStreamingTests |
RunWithNoMessageDoesNotFailAsync |
Representative sanitized errors:
System.InvalidOperationException : Unknown streaming update reason Error
at Azure.AI.Agents.Persistent.AsyncStreamingUpdateCollection.AsyncStreamingUpdateEnumerator...MoveNextAsync()
System.Threading.Tasks.TaskCanceledException : The operation was cancelled because it exceeded the configured timeout of 0:01:40. Network timeout can be adjusted in ClientOptions.Retry.NetworkTimeout.
System.Net.Http.HttpIOException : The response ended prematurely. (ResponseEnded)
System.IO.IOException : Unable to read data from the transport connection: The connection was closed.
Reproduction starting point: run the repository's existing .NET integration workflow against the cited revisions, or the affected test project with its documented live Azure configuration. Failures are demonstrated by repeated CI runs; a minimal deterministic local reproduction has not yet been established. Do not copy credentials or private service endpoints into this issue.
The project currently references Azure.AI.Agents.Persistent 1.2.0-beta.10; confirm the exact dependency versions and live configuration at the revision used for the investigation.
Desired Outcome
The reporter explicitly replaced the earlier two-PR proposal with one PR removing the deprecated Persistent/v1 integration tests. The temporary-skip and root-cause-fix plans are superseded.
- Remove the entire
dotnet/tests/AzureAIAgentsPersistent.IntegrationTestsproject and its test-only fixture files. - Remove references to the deleted project from solutions, test filters, scripts, and directly related documentation as necessary, without breaking other consumers of shared helpers.
- Preserve other integration suites, required CI checks, and the dedicated Foundry Hosted integration job.
- Do not add Skip annotations, extend timeouts, or suppress runtime errors.
- Keep the production
Microsoft.Agents.AI.AzureAI.Persistentpackage and the DeepResearch sample outside this change; this issue authorizes retiring the integration-test suite, not removing public APIs or samples. - Verify that solution/project references remain valid and the remaining tests are still discoverable. No further live Persistent/v1 reproduction or new Azure resources are required for this removal.
The removal PR can close this issue. Closure means the obsolete integration coverage has been retired; it must not be described as fixing the upstream service or SDK.
Previous changes were not fixes for the observed failure mode: #9415 changed CI job selection; #4583 skipped different Code Interpreter scenarios; #4865 re-enabled tests after an SDK compatibility update.
The unrelated telemetry and workflow-recovery unit-test failures observed in individual runs are outside this issue's scope.
Language
.NET
Acknowledgements
- I searched existing issues and did not find a duplicate.
- I will wait for explicit maintainer agreement before starting implementation of a non-trivial change.
The reporter explicitly requested removal of these integration tests, superseding the original two-PR approach. This issue does not assert that a ready-for-implementation label or separate public maintainer approval has already been obtained.
Metadata
Metadata
Assignees
Labels
Type
Projects
- StatusShow more project fieldsDone
Activity
[-].NET: Stabilize Azure Persistent integration tests blocking the merge queue[/-][+].NET: Remove deprecated Azure Persistent v1 integration tests[/+]rogerbarreto commentedon Oct 21, 2026
Closing per the decision to retire the legacy Persistent/v1 integration-test coverage rather than investigate the service/SDK failures. The removal is implemented in #9588, which is currently open and awaiting merge; the production package, offline unit tests, DeepResearch sample, and other CI coverage are preserved. No further root-cause fix or live reproduction is planned for this legacy suite. This closure does not claim that the upstream service/SDK problem was fixed.
test(dotnet): remove legacy persistent tests (microsoft#9588)