Skip to content

Fix test_pyramids.py little and big_endian - #6464

Merged
pwalczysko merged 4 commits into
ome:developfrom
pwalczysko:pyramid-little-endian-test
Jul 16, 2026
Merged

Fix test_pyramids.py little and big_endian#6464
pwalczysko merged 4 commits into
ome:developfrom
pwalczysko:pyramid-little-endian-test

Conversation

@pwalczysko

@pwalczysko pwalczysko commented Jul 15, 2026

Copy link
Copy Markdown
Member

Fixes the persistent failures of the following 3 tests

  • test/integration/clitest/test_pyramids.py::TestRemovePyramidsFullAdmin::test_remove_pyramids_little_endian.
  • test/integration/clitest/test_pyramids.py::TestRemovePyramidsFullAdmin::test_remove_pyramids_big_endian
  • test/integration/clitest/test_pyramids.py::TestRemovePyramidsFullAdmin::test_remove_pyramids

What this PR does

The test is creating pyramids first, relying on pyramids being written fast and then testing the removal. After move of the devspace testing framework to NFS, the speed of writing pyramid files dropped. This PR adds checks for really checking whether the files have been written to disk first, before the (actually to-be-tested) removal of them starts.
For that purpose, a new helper wait_for_pyramids was introduced in e4565f6

Testing this PR

Jenkins test test/integration/clitest/test_pyramids.py::TestRemovePyramidsFullAdmin::test_remove_pyramids_little_endian should pass.

Related reading

The problematic is similar (definitely not fully identical though) to the already opened #6462. On NFS, the speed of writing and deleting files is simply slower than the tests assume.

ToDo:

Possibly remove the hardcoded pixels_dir = "/home/omero/workspace/OMERO-test-integration/data/Pixels" -> I think I would need another round of investigation to find our how to replace with an env variable (cc @jburel ) .

Thanks for any help. Lets see if it works tomorrow during the build.

cc @sbesson @joshmoore @dominikl

@pwalczysko pwalczysko closed this Jul 15, 2026
@pwalczysko pwalczysko reopened this Jul 15, 2026
@pwalczysko pwalczysko changed the title Fix test_pyramids.py little_endian Fix test_pyramids.py little and big_endian Jul 15, 2026
@dominikl

Copy link
Copy Markdown
Member

👍 Good catch Petr! Sounds like the tests ever only worked by chance, relying on pyramids being generated super fast, because the import process itself doesn't wait for the pyramids.

@pwalczysko
pwalczysko requested a review from dominikl July 16, 2026 12:34

@dominikl dominikl left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Thanks Petr. Looks good to me!

@pwalczysko
pwalczysko merged commit bf5e0bd into ome:develop Jul 16, 2026
4 checks passed
@pwalczysko
pwalczysko deleted the pyramid-little-endian-test branch July 16, 2026 12:41

def wait_for_pyramid_file(self, pixels_id, timeout=120):
pixels_dir = (
"/home/omero/workspace/"

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This means the integration tests will systematically fail in any other environment than https://merge-ci.openmicroscopy.org/jenkins/.

We should review and update this condition, possibly implementing #6470 (comment)

pwalczysko added a commit to pwalczysko/openmicroscopy that referenced this pull request Jul 28, 2026
pwalczysko added a commit to pwalczysko/openmicroscopy that referenced this pull request Jul 28, 2026
pwalczysko added a commit to pwalczysko/openmicroscopy that referenced this pull request Jul 28, 2026
pwalczysko added a commit to pwalczysko/openmicroscopy that referenced this pull request Jul 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants