Skip to content

.NET: Remove deprecated Azure Persistent v1 integration tests #9587

Closed

Description

Category

Build or CI

Problem

The live AzureAIAgentsPersistent.IntegrationTests suite repeatedly fails on both .NET 10/Linux and .NET Framework 4.7.2/Windows. Tests spend approximately 10–40 minutes waiting before reporting streaming errors, network timeouts, or prematurely closed responses. Integration jobs can exceed the merge queue's check-wait window, removing otherwise eligible PRs with checks_timed_out.

This is not specific to the OAuth consent changes in #9565: matching failures occur in merge groups without that patch and before that PR entered the queue. The underlying cause of the service failures is not established. The affected code belongs to the legacy Azure Persistent/v1 integration: its framework adapter methods are already marked Obsolete and direct consumers to Microsoft.Agents.AI.AzureAI. The reporter has changed the requested resolution to removing this legacy integration-test suite, rather than adding temporary skips or attempting a permanent service/SDK fix.

Evidence

Latest affected merge group for #9565, commit 1d3be33248c3f0349424a838ea09523060986679:

Independent evidence:

Observed failing tests across these captured runs, all under dotnet/tests/AzureAIAgentsPersistent.IntegrationTests/:

Test class Test method / observed case
AzureAIAgentsPersistentCreateTests CreateAgent_CreatesAgentWithAIFunctionToolsAsync(createMechanism: "CreateWithChatClientAgentOptionsAsync")
AzureAIAgentsChatClientAgentRunTests RunWithFunctionsInvokesFunctionsAndReturnsExpectedResultsAsync
AzureAIAgentsChatClientAgentRunTests RunWithInstructionsAndNoMessageReturnsExpectedResultAsync
AzureAIAgentsChatClientAgentRunStreamingTests RunWithFunctionsInvokesFunctionsAndReturnsExpectedResultsAsync
AzureAIAgentsChatClientAgentRunStreamingTests RunWithInstructionsAndNoMessageReturnsExpectedResultAsync
AzureAIAgentsPersistentRunTests SessionMaintainsHistoryAsync
AzureAIAgentsPersistentRunTests RunWithStringReturnsExpectedResultAsync
AzureAIAgentsPersistentRunTests RunWithNoMessageDoesNotFailAsync
AzureAIAgentsPersistentRunStreamingTests SessionMaintainsHistoryAsync
AzureAIAgentsPersistentRunStreamingTests RunWithStringReturnsExpectedResultAsync
AzureAIAgentsPersistentRunStreamingTests RunWithChatMessageReturnsExpectedResultAsync
AzureAIAgentsPersistentRunStreamingTests RunWithChatMessagesReturnsExpectedResultAsync
AzureAIAgentsPersistentRunStreamingTests RunWithNoMessageDoesNotFailAsync

Representative sanitized errors:

System.InvalidOperationException : Unknown streaming update reason Error
  at Azure.AI.Agents.Persistent.AsyncStreamingUpdateCollection.AsyncStreamingUpdateEnumerator...MoveNextAsync()

System.Threading.Tasks.TaskCanceledException : The operation was cancelled because it exceeded the configured timeout of 0:01:40. Network timeout can be adjusted in ClientOptions.Retry.NetworkTimeout.

System.Net.Http.HttpIOException : The response ended prematurely. (ResponseEnded)

System.IO.IOException : Unable to read data from the transport connection: The connection was closed.

Reproduction starting point: run the repository's existing .NET integration workflow against the cited revisions, or the affected test project with its documented live Azure configuration. Failures are demonstrated by repeated CI runs; a minimal deterministic local reproduction has not yet been established. Do not copy credentials or private service endpoints into this issue.

The project currently references Azure.AI.Agents.Persistent 1.2.0-beta.10; confirm the exact dependency versions and live configuration at the revision used for the investigation.

Desired Outcome

The reporter explicitly replaced the earlier two-PR proposal with one PR removing the deprecated Persistent/v1 integration tests. The temporary-skip and root-cause-fix plans are superseded.

  • Remove the entire dotnet/tests/AzureAIAgentsPersistent.IntegrationTests project and its test-only fixture files.
  • Remove references to the deleted project from solutions, test filters, scripts, and directly related documentation as necessary, without breaking other consumers of shared helpers.
  • Preserve other integration suites, required CI checks, and the dedicated Foundry Hosted integration job.
  • Do not add Skip annotations, extend timeouts, or suppress runtime errors.
  • Keep the production Microsoft.Agents.AI.AzureAI.Persistent package and the DeepResearch sample outside this change; this issue authorizes retiring the integration-test suite, not removing public APIs or samples.
  • Verify that solution/project references remain valid and the remaining tests are still discoverable. No further live Persistent/v1 reproduction or new Azure resources are required for this removal.

The removal PR can close this issue. Closure means the obsolete integration coverage has been retired; it must not be described as fixing the upstream service or SDK.

Previous changes were not fixes for the observed failure mode: #9415 changed CI job selection; #4583 skipped different Code Interpreter scenarios; #4865 re-enabled tests after an SDK compatibility update.

The unrelated telemetry and workflow-recovery unit-test failures observed in individual runs are outside this issue's scope.

Language

.NET

Acknowledgements

  • I searched existing issues and did not find a duplicate.
  • I will wait for explicit maintainer agreement before starting implementation of a non-trivial change.

The reporter explicitly requested removal of these integration tests, superseding the original two-PR approach. This issue does not assert that a ready-for-implementation label or separate public maintainer approval has already been obtained.

Activity

  1. changed the title [-].NET: Stabilize Azure Persistent integration tests blocking the merge queue[/-] [+].NET: Remove deprecated Azure Persistent v1 integration tests[/+] on Oct 21, 2026
  2. rogerbarreto commented on Oct 21, 2026

    @rogerbarreto
    MemberAuthor

    Closing per the decision to retire the legacy Persistent/v1 integration-test coverage rather than investigate the service/SDK failures. The removal is implemented in #9588, which is currently open and awaiting merge; the production package, offline unit tests, DeepResearch sample, and other CI coverage are preserved. No further root-cause fix or live reproduction is planned for this legacy suite. This closure does not claim that the upstream service/SDK problem was fixed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    .NETUsage: [Issues, PRs], Target: .Net

    Type

    No type

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions