[vishalmore90]

Fixes #40240

Context
A high volume of unprocessed or duplicate events entering the OrderedEventProcessor loop could previously trigger a CommitTooLargeException in Dataflow, because DLQ emissions were unconditionally appended to the bundle without respecting the maxNumberOfResultsToProduce pagination cap.

Changes

• Tracked duplicate output in ProcessingState.java.
• Augmented ProcessorDoFn.reachedMaxResultCountForBundle to consider duplicate volume.
• Refactored the skipProcessing block inside ProcessorDoFn.processBufferedEventRange to break gracefully on limits instead of continuing infinitely.
• Added validation test testLargeNumberOfDuplicatesPaginatesCorrectly.

Checklist

• Code style follows the repository guidelines
• Automated tests run and pass
• Appropriate comments and documentation updated

[github-actions]

Checks are failing. Will not request review until checks are succeeding. If you'd like to override that behavior, comment assign set of reviewers

[stankiewicz]

R: @slilichenko

[github-actions]

Stopping reviewer notifications for this pull request: review requested by someone other than the bot, ceding control. If you'd like to restart, comment assign set of reviewers