The PostRelease Nightly Snapshot job is flaky

The PostRelease Nightly Snapshot is failing over 50% of the time
Please visit https://github.com/apache/beam/actions/workflows/beam_PostRelease_NightlySnapshot.yml?query=is%3Afailure+branch%3Amaster to see the logs.

Related to ##30447

Still failing:

Container image gcr.io/cloud-dataflow/v1beta3/beam_java8_sdk:beam-master-20240306 not downloaded yet.

It is strange that the container gets resolved to "beam_java8_sdk:beam-master-20240306". What happens is it picks the label for legacy runner but actually trying to pull runner v2 image. This is likely due to Dataflow switched to runner v2 by default in Beam 2.55.0+

beam/runners/google-cloud-dataflow-java/build.gradle

Lines 54 to 55 in ef919e2

    
           ext.dataflowLegacyContainerVersion = 'beam-master-20240306' 
        
           ext.dataflowFnapiContainerVersion = 'beam-master-20240125'

entered #30634

https://github.com/apache/beam/actions/runs/8619063045

java.lang.RuntimeException: com.google.api.client.googleapis.json.GoogleJsonResponseException: 404 Not Found
POST https://bigquery.googleapis.com/bigquery/v2/projects/apache-beam-testing/datasets/beam_postrelease_mobile_gaming/tables/leaderboard_DataflowRunner_team/insertAll?prettyPrint=false
{
  "code" : 404,
  "errors" : [ {
    "domain" : "global",
    "message" : "Not found: Table apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_team",
    "reason" : "notFound"
  } ],
  "message" : "Not found: Table apache-beam-testing:beam_postrelease_mobile_gaming.leaderboard_DataflowRunner_team",
  "status" : "NOT_FOUND"
}

Looks much better. Close this now.

Currently there is a flakiness due to downloading artifacts from maven snapshot repository not get retried. This is a maven tool thing, but probably we can first build (with retry) so the artifacts are get cached in local maven

@shunping

@shunping please check this when you have time.

Reopening since the workflow is still flaky

Error message from worker: java.lang.AbstractMethodError: Receiver class org.apache.beam.runners.dataflow.worker.repackaged.org.apache.beam.runners.core.SimpleDoFnRunner$DoFnProcessContext does not define or inherit an implementation of the resolved method 'abstract void outputWindowedValue(org.apache.beam.sdk.values.TupleTag, org.apache.beam.sdk.values.WindowedValue)' of abstract class org.apache.beam.sdk.transforms.DoFn$WindowedContext.

Stabilized

Reopening since the workflow is still flaky

Navigation Menu

Repository navigation

The PostRelease Nightly Snapshot job is flaky #30505

88 remaining items

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

	ext.dataflowLegacyContainerVersion = 'beam-master-20240306'
	ext.dataflowFnapiContainerVersion = 'beam-master-20240125'

The PostRelease Nightly Snapshot job is flaky #30505

Description

Activity

shunping commented on Mar 11, 2024

Abacn commented on Mar 14, 2024

liferoad commented on Apr 11, 2024

liferoad commented on Apr 13, 2024

Abacn commented on May 21, 2024

liferoad commented on May 21, 2024

88 remaining items

github-actions commented on Apr 7, 2026

Amar3tto commented on Apr 16, 2026

Amar3tto commented on Apr 28, 2026

github-actions commented on May 10, 2026

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions