Skip to content

[Python][Packaging] Nightly wheels fail with segmentation fault on Parquet #50291

Closed
Closed
[Python][Packaging] Nightly wheels fail with segmentation fault on Parquet#50291
Assignees
raulcd
Labels
Component: PackagingComponent: PythonPriority: BlockerMarks a blocker for the releaseType: bug
Milestone
25.0.0

Description

@raulcd
raulcd
opened on Jun 30, 2026

Describe the bug, including details regarding any error messages, version, and platform.

All our nightly wheels have started failing with a segmentation fault on Parquet:

 usr/local/lib/python3.13/site-packages/pyarrow/tests/parquet/test_basic.py . [ 36%]
Fatal Python error: Segmentation fault

Current thread 0x00007f2c097d7380 (most recent call first):
  File "/usr/local/lib/python3.13/site-packages/pandas/core/indexes/datetimes.py", line 1442 in date_range
  File "/usr/local/lib/python3.13/site-packages/pyarrow/tests/parquet/test_basic.py", line 763 in test_write_error_deletes_incomplete_file
  File "/usr/local/lib/python3.13/site-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
  File "/usr/local/lib/python3.13/site-packages/pluggy/_callers.py", line 121 in _multicall
  File "/usr/local/lib/python3.13/site-packages/pluggy/_manager.py", line 120 in _hookexec
  File "/usr/local/lib/python3.13/site-packages/pluggy/_hooks.py", line 512 in __call__
  File "/usr/local/lib/python3.13/site-packages/_pytest/python.py", line 1707 in runtest
  File "/usr/local/lib/python3.13/site-packages/_pytest/runner.py", line 184 in pytest_runtest_call
  File "/usr/local/lib/python3.13/site-packages/pluggy/_callers.py", line 121 in _multicall
  File "/usr/local/lib/python3.13/site-packages/pluggy/_manager.py", line 120 in _hookexec
  File "/usr/local/lib/python3.13/site-packages/pluggy/_hooks.py", line 512 in __call__
  File "/usr/local/lib/python3.13/site-packages/_pytest/runner.py", line 250 in <lambda>
  File "/usr/local/lib/python3.13/site-packages/_pytest/runner.py", line 361 in from_call
  File "/usr/local/lib/python3.13/site-packages/_pytest/runner.py", line 249 in call_and_report
  File "/usr/local/lib/python3.13/site-packages/_pytest/runner.py", line 139 in runtestprotocol
  File "/usr/local/lib/python3.13/site-packages/_pytest/runner.py", line 118 in pytest_runtest_protocol
  File "/usr/local/lib/python3.13/site-packages/pluggy/_callers.py", line 121 in _multicall
  File "/usr/local/lib/python3.13/site-packages/pluggy/_manager.py", line 120 in _hookexec
  File "/usr/local/lib/python3.13/site-packages/pluggy/_hooks.py", line 512 in __call__
  File "/usr/local/lib/python3.13/site-packages/_pytest/main.py", line 408 in pytest_runtestloop
  File "/usr/local/lib/python3.13/site-packages/pluggy/_callers.py", line 121 in _multicall
  File "/usr/local/lib/python3.13/site-packages/pluggy/_manager.py", line 120 in _hookexec
  File "/usr/local/lib/python3.13/site-packages/pluggy/_hooks.py", line 512 in __call__
  File "/usr/local/lib/python3.13/site-packages/_pytest/main.py", line 384 in _main
  File "/usr/local/lib/python3.13/site-packages/_pytest/main.py", line 330 in wrap_session
  File "/usr/local/lib/python3.13/site-packages/_pytest/main.py", line 377 in pytest_cmdline_main
  File "/usr/local/lib/python3.13/site-packages/pluggy/_callers.py", line 121 in _multicall
  File "/usr/local/lib/python3.13/site-packages/pluggy/_manager.py", line 120 in _hookexec
  File "/usr/local/lib/python3.13/site-packages/pluggy/_hooks.py", line 512 in __call__
  File "/usr/local/lib/python3.13/site-packages/_pytest/config/__init__.py", line 229 in _main
  File "/usr/local/lib/python3.13/site-packages/_pytest/config/__init__.py", line 253 in _console_main
  File "/usr/local/lib/python3.13/site-packages/pytest/__main__.py", line 9 in <module>
  File "<frozen runpy>", line 88 in _run_code
  File "<frozen runpy>", line 203 in _run_module_as_main

Extension modules: numpy._core._multiarray_umath, numpy.linalg._umath_linalg, pyarrow.lib, pyarrow._fs, pyarrow._azurefs, pyarrow._hdfs, pyarrow._gcsfs, pyarrow._s3fs, cython.cimports.libc.math, pyarrow._compute, pyarrow._acero, pyarrow._csv, pyarrow._json, pyarrow._substrait, numpy.random._common, numpy.random.bit_generator, numpy.random._bounded_integers, numpy.random._mt19937, numpy.random.mtrand, numpy.random._philox, numpy.random._pcg64, numpy.random._sfc64, numpy.random._generator, _cyutility, pandas._libs._cyutility, pandas._libs.tslibs.ccalendar, pandas._libs.tslibs.np_datetime, pandas._libs.tslibs.dtypes, pandas._libs.tslibs.base, pandas._libs.tslibs.nattype, pandas._libs.tslibs.timezones, pandas._libs.properties, pandas._libs.tslibs.fields, pandas._libs.tslibs.timedeltas, pandas._libs.tslibs.tzconversion, pandas._libs.tslibs.timestamps, pandas._libs.tslibs.offsets, pandas._libs.tslibs.strptime, pandas._libs.tslibs.parsing, pandas._libs.tslibs.conversion, pandas._libs.tslibs.period, pandas._libs.tslibs.vectorized, pandas._libs.ops_dispatch, pandas._libs.missing, pandas._libs.hashtable, pandas._libs.algos, pandas._libs.interval, pandas._libs.lib, pandas._libs.ops, pandas._libs.hashing, pandas._libs.arrays, pandas._libs.tslib, pandas._libs.sparse, pandas._libs.internals, pandas._libs.indexing, pandas._libs.index, pandas._libs.writers, pandas._libs.join, pandas._libs.window.aggregations, pandas._libs.window.indexers, pandas._libs.reshape, pandas._libs.groupby, pandas._libs.json, pandas._libs.parsers, pandas._libs.testing, pyarrow._dataset, pyarrow._dataset_orc, pyarrow._parquet, pyarrow._parquet_encryption, pyarrow._dataset_parquet_encryption, pyarrow._dataset_parquet, pyarrow._orc, pyarrow._flight, _cffi_backend, pyarrow._pyarrow_cpp_tests, pyarrow._feather (total: 76)
/arrow/ci/scripts/python_wheel_unix_test.sh: line 110:    21 Segmentation fault      (core dumped) python -m pytest -r s --pyargs pyarrow

Current failure details:

Component(s)

Python, Packaging

Activity

  1. raulcd
    added
    Type: bug
    Priority: BlockerMarks a blocker for the release
    on Jun 30, 2026
  2. github-actions
    changed the title [-][Python][Packaging] Nightly wheels fail with segmentation fault on Parquet[/-] [+][CI][Integration][Python][Packaging] Nightly wheels fail with segmentation fault on Parquet[/+] on Jun 30, 2026
  3. github-actions
    added
    Component: Continuous Integration
    Component: Integration
    and removed
    Priority: BlockerMarks a blocker for the release
    on Jun 30, 2026
  4. raulcd
    added this to the 25.0.0 milestone on Jun 30, 2026
  5. raulcd
    changed the title [-][CI][Integration][Python][Packaging] Nightly wheels fail with segmentation fault on Parquet[/-] [+][Python][Packaging] Nightly wheels fail with segmentation fault on Parquet[/+] on Jun 30, 2026
  6. raulcd
    added
    Component: Python
    Component: Packaging
    Priority: BlockerMarks a blocker for the release
    and removed
    Component: Continuous Integration
    Component: Integration
    on Jun 30, 2026

  7. raulcd commented on Jun 30, 2026

    @raulcd
    raulcd
    on Jun 30, 2026
    MemberAuthor

    I can't seem to reproduce locally:

    $ ARCHERY_DEBUG=1 ARCH=amd64 PYTHON=3.14 PYTHON_ABI_TAG=cp314 PYTHON_IMAGE_TAG=3.14 archery docker run -e SETUPTOOLS_SCM_PRETEND_VERSION=25.0.0.dev193 python-wheel-manylinux-2-28
...
$ ARCHERY_DEBUG=1 ARCH=amd64 PYTHON=3.14 PYTHON_ABI_TAG=cp314 PYTHON_IMAGE_TAG=3.14 archery docker run -e SETUPTOOLS_SCM_PRETEND_VERSION=25.0.0.dev193 python-wheel-manylinux-test-unittests
...
================== 7576 passed, 667 skipped, 15 xfailed, 2 xpassed, 23 warnings in 153.34s (0:02:33) ==============

  8. raulcd commented on Jun 30, 2026

    @raulcd
    raulcd
    on Jun 30, 2026
    MemberAuthor

    It seems to be working now, I haven't been able to reproduce with archery on a PR, see:
    #50301 (comment)

    I'll keep it open, validate the wheels for the next daily but will close if not reproducible.

  9. raulcd commented on Jul 1, 2026

    @raulcd
    raulcd
    on Jul 1, 2026
    MemberAuthor

    This has been solved, nightlies are all working except one which seems to be triggered by the same issue:

     Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pyarrow\tests\parquet\test_basic.py . [ 36%]
Windows fatal exception: access violation

<Cannot show all threads while the GIL is disabled>
Stack (most recent call first):
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pandas\core\arrays\_ranges.py", line 65 in generate_regular_range
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pandas\core\arrays\datetimes.py", line 456 in _generate_range
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pandas\core\indexes\datetimes.py", line 1751 in date_range
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pyarrow\tests\parquet\test_basic.py", line 763 in test_write_error_deletes_incomplete_file
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\python.py", line 167 in pytest_pyfunc_call
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_callers.py", line 121 in _multicall
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_manager.py", line 120 in _hookexec
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_hooks.py", line 512 in __call__
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\python.py", line 1707 in runtest
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\runner.py", line 184 in pytest_runtest_call
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_callers.py", line 121 in _multicall
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_manager.py", line 120 in _hookexec
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_hooks.py", line 512 in __call__
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\runner.py", line 250 in <lambda>
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\runner.py", line 361 in from_call
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\runner.py", line 249 in call_and_report
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\runner.py", line 139 in runtestprotocol
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\runner.py", line 118 in pytest_runtest_protocol
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_callers.py", line 121 in _multicall
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_manager.py", line 120 in _hookexec
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_hooks.py", line 512 in __call__
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\main.py", line 408 in pytest_runtestloop
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_callers.py", line 121 in _multicall
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_manager.py", line 120 in _hookexec
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_hooks.py", line 512 in __call__
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\main.py", line 384 in _main
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\main.py", line 330 in wrap_session
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\main.py", line 377 in pytest_cmdline_main
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_callers.py", line 121 in _multicall
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_manager.py", line 120 in _hookexec
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pluggy\_hooks.py", line 512 in __call__
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\config\__init__.py", line 229 in _main
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\_pytest\config\__init__.py", line 253 in _console_main
  File "C:\Users\ContainerAdministrator\AppData\Local\Programs\Python\Python314\Lib\site-packages\pytest\__main__.py", line 9 in <module>
  File "<frozen runpy>", line 88 in _run_code
  File "<frozen runpy>", line 203 in _run_module_as_main

Current thread's C stack trace (most recent call first):
  <cannot get C stack on this system>

Error: `docker compose --file=D:\a\crossbow\crossbow\arrow\compose.yaml run --rm python-free-threaded-wheel-windows-test` exited with a non-zero exit code 1, see the process log above.
  10. github-actions
    assigned
    raulcd
    on Jul 1, 2026
  11. raulcd
    added a commit that references this issue on Jul 1, 2026

    GH-50291: [Python][Packaging] Stop using nightly build dependencies f…

    1b6edb8

  12. raulcd commented on Jul 1, 2026

    @raulcd
    raulcd
    on Jul 1, 2026
    MemberAuthor

    Issue resolved by pull request 50315
    #50315

  13. raulcd
    closed this as completedon Jul 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Component: PackagingComponent: PythonPriority: BlockerMarks a blocker for the releaseType: bug

Type

No type

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions