Skip to content

ci: standardize RustFS setup across Iceberg repos - #2056

Merged
kevinjqliu merged 2 commits into
apache:mainfrom
kevinjqliu:kevinjqliu-rustfs-setup-cleanup
Oct 20, 2026
Merged

kevinjqliu merged 2 commits into
apache:mainfrom
kevinjqliu:kevinjqliu-rustfs-setup-cleanup

Conversation

@kevinjqliu

@kevinjqliu kevinjqliu commented Sep 25, 2026 •

Copy link
Copy Markdown
Contributor

Follow up to #2055 and apache/iceberg#18246. Standardizes the RustFS setup across the Iceberg repos. Same change in:

The setup:

  • rustfs/rustfs:1.0.3, the latest stable.
  • Healthcheck on /health/ready. /health is just liveness and can pass before storage and IAM are ready, so bucket creation can race it.
  • RUSTFS_OBS_LOG_STDOUT_ENABLED=true. Otherwise docker logs is empty.
  • RUSTFS_CONSOLE_ENABLE=false and no port 9001. Nothing uses the console.
  • Nothing else. The rest are defaults, so command: ["/data"] goes too.

Ran docker compose config and started rustfs/rustfs:1.0.3 with the new config: /health/ready returns 200 and logs show up in docker logs.

AI disclosure: Assisted by GitHub Copilot.

The rustfs/rustfs:1.0.0 image sets RUSTFS_VOLUMES=/data and its
entrypoint uses it when no arguments are given, so `command: ["/data"]`
restates the image default. This aligns the object-store service with
the canonical RustFS setup shared across Apache Iceberg repos.

Generated-by: GitHub Copilot
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
@kevinjqliu
kevinjqliu marked this pull request as draft September 25, 2026 04:17
@zeroshade

Copy link
Copy Markdown
Member

@kevinjqliu this looks good and CI (including both integration suites) is green — can you mark it ready for review so I can merge it?

Use the latest stable rustfs/rustfs image and turn off the unused web
console with RUSTFS_CONSOLE_ENABLE=false, dropping the 9001 port
mapping. This matches the RustFS setup shared across Iceberg repos.

Generated-by: GitHub Copilot
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
- RUSTFS_SECRET_KEY=password
- RUSTFS_SERVER_DOMAINS=object-store
- RUSTFS_OBS_LOG_STDOUT_ENABLED=true
- RUSTFS_CONSOLE_ENABLE=false

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

removes console port 9001, we dont need it

ports:
- 9001:9001
- 9000:9000
command: ["/data"]

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is the default, can remove

@kevinjqliu
kevinjqliu marked this pull request as ready for review October 20, 2026 18:20

@zeroshade zeroshade left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good: 1.0.3 with the /health/ready healthcheck, stdout logs on, and the console off with port 9001 gone (nothing in the repo uses it). Dropping command: ["/data"] relies on the image default, and both integration suites starting the stack confirm that, along with curl still being present for the healthcheck. LGTM.

@laskoviymishka laskoviymishka left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@kevinjqliu
kevinjqliu merged commit 893feab into apache:main Oct 20, 2026
16 of 18 checks passed
@kevinjqliu
kevinjqliu deleted the kevinjqliu-rustfs-setup-cleanup branch October 20, 2026 20:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants