The PostCommit Java PVR Spark4 StructuredStreaming job is flaky #40256

Activity

1. github-actions

   added

   P1

   bug

   flaky_test

   workflow_id: 364539119

   on Sep 24, 2026
2. Amar3tto

   assigned

   Abacn

   on Sep 24, 2026
3. Abacn commented on Sep 24, 2026

   

   Abacn

   on Sep 24, 2026

   Contributor

   More actions

   java.lang.RuntimeException: The Runner experienced the following error during execution:
   java.nio.file.NoSuchFileException: /tmp/spark-4e5394bc-b050-41c3-a727-93ccf8ef8e25/userFiles-b740363e-1ce1-4359-a385-6cab799e601f/spark-sql_2.13-4.0.2.jar
   	at org.apache.beam.runners.portability.JobServicePipelineResult.propagateErrors(JobServicePipelineResult.java:176)
   	at org.apache.beam.runners.portability.JobServicePipelineResult.waitUntilFinish(JobServicePipelineResult.java:117)
   	at org.apache.beam.runners.portability.testing.TestPortableRunner.run(TestPortableRunner.java:81)
   	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:326)
   	at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:442)
   	at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:381)
   	at org.apache.beam.sdk.transforms.ReshuffleTest.testJustReshuffle(ReshuffleTest.java:114)
   	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   

   Similar to #30512 (comment)
4. Amar3tto

   closed this as completedin #40270on Sep 25, 2026
5. github-actions

   added this to the 2.78.0 Release milestone on Sep 25, 2026