Repository navigation
Backport RustFS for DataFusion CLI S3 tests - #166
Merged
Merged
Conversation
Closes apache#25705 This morning it seems like Minio pulled its images from quay.io, which has caused recent CI runs to start failing, e.g. https://github.com/apache/datafusion/actions/runs/36006680489/job/107657362588 RustFS is a pretty comparable (and more permissively licensed) alternative that provides a suitable S3 interface for integration tests. This was substantially authored by Codex, but reviewed by me and tested locally. Existing integration tests No Signed-off-by: Andrew Duffy <andrew@a10y.dev> (cherry picked from commit e2ca7f3)
(cherry picked from commit 0bc89d6)
(cherry picked from commit 5ddc41bb19e776f2490acae6b95c12ebd3881eac)
(cherry picked from commit 52580648fa40ce24a28b466044872f59615d6a8c)
(cherry picked from commit 69bb1e18cdb5358b3dd776de89c34ec8de8619c5)
osipovartem
merged commit Oct 25, 2026
105819d
into
df55-physical-udf-instance
29 of 38 checks passed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
InformationSchemaConfigtest initializer and SLT expectations, Taplo manifest order, generated config/function docs, a clippy test, and a CSV diagnostic assertion that compared nondeterministic backtraces.Verification
cargo +1.99.0 fmt --all -- --check, Taplo 0.9.3 formatting (51 manifests), andgit diff --check: passed.cargo test datafusion-cli (amd64);cli_integrationpassed 34/34 with no skips, includingtest_cli,test_aws_options,test_s3_url_fallback,test_object_store_profiling, andrustfs_image_matches_ci_prepull.array_reducedocumentation diff. Its generated-docs check now passes; remaining code/test jobs are still running. A full local build was deferred because host free space was below the workspace threshold.security_auditreports existing October 2026 advisories in the unchangedCargo.lock; dependency remediation is outside this test-infrastructure backport.