Repository navigation

Migrate to Google Cloud Dataflow Client - #37639

Merged

jrmccluskey merged 55 commits into

apache:masterfrom

jrmccluskey:dataflowClientTesting

Jun 2, 2026

Merged

Migrate to Google Cloud Dataflow Client#37639
jrmccluskey merged 55 commits into
apache:masterfrom
jrmccluskey:dataflowClientTesting

Commits on May 26, 2026
- [WIP] Migrate to Google Cloud Dataflow Client
  jrmccluskey
  committed
  5291f9a
- Trigger relevant postcommits
  jrmccluskey
  committed
  e66962e
- base image update
  jrmccluskey
  committed
  533f061
- fix camel case
  jrmccluskey
  committed
  6302b39
- update dataflow runner + tests
  jrmccluskey
  committed
  5944415
- slide import to avoid triggering unit tests
  jrmccluskey
  committed
  7ae8dc3
- yapf stuff
  jrmccluskey
  committed
  7ad855c
- remove extra print
  jrmccluskey
  committed
  d08fcb2
- further spec structs, fix incorrect piplineUrl option, remove old client code
  jrmccluskey
  committed
  94bc621
- suppress line-too-longs
  jrmccluskey
  committed
  9bde92d
- formatting
  jrmccluskey
  committed
  00cf579
- linting, tweak metrics tests
  jrmccluskey
  committed
  164ef09
- Proto-specific changes to metric processing tests
  jrmccluskey
  committed
  716f375
- try to dump logging
  jrmccluskey
  committed
  e1acf9e
- handle more straightforward metrics values
  jrmccluskey
  committed
  d9c37b0
- add skips since the unit tests now depend on the proto library
  jrmccluskey
  committed
  f63bde2
- testing if there's a disconnect between proto behavior locally and in tests
  jrmccluskey
  committed
  92a746f
- correct scalar access
  jrmccluskey
  committed
  9ed32e4
- clean up dist accesses
  jrmccluskey
  committed
  fddb2d2
- linting, various fixes
  jrmccluskey
  committed
  1cbcad2
- fix unit test setup for direct accesses
  jrmccluskey
  committed
  d727e6d
- linting
  jrmccluskey
  committed
  7fbf62f
- more linting
  jrmccluskey
  committed
  4d7b9dc
- re-enable histograms
  jrmccluskey
  committed
  269735a
- Bump dataflow client version, restore pausing/paused concept
  jrmccluskey
  committed
  4ff4f73
- formatting
  jrmccluskey
  committed
  4889b33
- fix enum selection
  jrmccluskey
  committed
  366092d
- handle the proto hash PR
  jrmccluskey
  committed
  41a8871
- remove unnecessary try/except block
  jrmccluskey
  committed
  9c75420
- re-delete old messsages
  jrmccluskey
  committed
  feec693
- fix disk_provisioned_iops/throughput_mibps tests
  jrmccluskey
  committed
  3859d11
- code bot suggestions
  jrmccluskey
  committed
  6a0b9ba
- revert pipeline options interaction
  jrmccluskey
  committed
  c1650ca
- leftover update
  jrmccluskey
  committed
  46c08b6
- yapf
  jrmccluskey
  committed
  e1579e2
- swap credential loading
  jrmccluskey
  committed
  b9e2558
- Fix message importance parsing
  jrmccluskey
  committed
  30882bb
- fix apiclient_test case w/ cloud deps and no auth
  jrmccluskey
  committed
  f794e07
Commits on May 27, 2026
- Local runner SSL fix
  jrmccluskey
  committed
  87abbca
- last local change
  jrmccluskey
  committed
  bfa9e77
- apitools test fix
  jrmccluskey
  committed
  cd83ba3
- yapf
  jrmccluskey
  committed
  08e9194
- Apply suggestions from code review
  
  jrmccluskey
  and
  gemini-code-assist[bot]
  authored
  1966b5b
- gemini suggestions
  jrmccluskey
  committed
  904282a
- fix message importance
  jrmccluskey
  committed
  a44b251
Commits on May 28, 2026
- fix local runner case
  jrmccluskey
  committed
  54268bf
- Merge branch 'master' into dataflowClientTesting
  jrmccluskey
  authored
  5c2cfda
- remove legacy translation maps
  jrmccluskey
  committed
  9f6ed3b
- revert container requirements changes
  jrmccluskey
  committed
  17b303e
- missing import
  jrmccluskey
  committed
  c9c46be
Commits on May 29, 2026
- fix bad trigger file merge
  jrmccluskey
  committed
  b485f72
- Update sdks/python/apache_beam/runners/dataflow/dataflow_metrics.py
  
  jrmccluskey
  and
  damccorm
  authored
  9417b08
- Merge branch 'master' into dataflowClientTesting
  jrmccluskey
  authored
  91963b9
- fix merge problem with runnerv2 disabled tests
  jrmccluskey
  committed
  54d48ac
- fix state breakage
  jrmccluskey
  committed
  7227b4e

Commits

Commits on May 26, 2026

Commits on May 27, 2026

Commits on May 28, 2026

Commits on May 29, 2026