Skip to content

[Feature Request]: Allow disable user metrics in Python SDK #38746

Description

@Abacn

What would you like to happen?

In the case of high throughput jobs, we may want to disable metrics requests that adding pressures to backends. In Java SDK we honor pipeline option experiments "disableCounterMetrics", "disableStringSetMetrics", "disableBoundedTrieMetrics", but not yet in Python.

Issue Priority

Priority: 2 (default / most feature requests should be filed as P2)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Infrastructure
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Prism Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner

Activity

  1. Anuragp22 commented on May 30, 2026

    @Anuragp22
    Contributor

    .take-issue

  2. added this to the 2.75.0 Release milestone on Jun 4, 2026
  3. reopened this on Aug 27, 2026
  4. Abacn commented on Aug 27, 2026

    @Abacn
    ContributorAuthor

    Reopen since last attempt get reverted

  5. removed this from the 2.77.0 Release milestone on Sep 17, 2026
  6. anishmehta24 commented on Sep 17, 2026

    @anishmehta24
    Contributor

    Since the first attempt (#38749) was reverted in #38901 and has been idle since June, I've prepared a re-land that keeps DelegatingCounter.inc / DelegatingStringSet.add / DelegatingBoundedTrie.add as MetricUpdater attributes (so inc(value=...) and pickling behave exactly as before) and gates the update inside MetricUpdater.__call__ instead, mirroring how the Java SDK checks MetricsFlag on every call. @Anuragp22 happy to hand it back if you're still on this — otherwise PR incoming.

  7. added a commit that references this issue on Sep 19, 2026
    050fb02
  8. anishmehta24 commented on Sep 24, 2026

    @anishmehta24
    Contributor

    .take-issue

  9. added a commit that references this issue on Sep 30, 2026
    9f5cd57
  10. added this to the 2.78.0 Release milestone on Sep 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Type

No type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions