Skip to content

feat: expose data_cache_bytes through CompactionOptions - #92

Merged
ilya-zlobintsev merged 1 commit into
release-10.0.0from
expose-data-cache-bytes
Oct 22, 2026
Merged

ilya-zlobintsev merged 1 commit into
release-10.0.0from
expose-data-cache-bytes

Conversation

@ilya-zlobintsev

Copy link
Copy Markdown
Member

Related

This option is settable for normal writes with #89, but not for compaction.

What

Allow data_cache_bytes from FileWriterOptions to also be configured for compaction. The name is not super accurate in that it's more of a write buffer size, and has a big impact on memory usage of compaction on larger tables.

Note: the value is not validated here, it will be in the upstream PR which has validation helpers for FileWriterOptions

@ilya-zlobintsev ilya-zlobintsev added lance fork 10.0.0 Landed on the release-10.0.0 fork line upstreamable change Belongs upstream, but is not there yet labels Oct 22, 2026
@github-actions github-actions Bot added the enhancement New feature or request label Oct 22, 2026
@ilya-zlobintsev
ilya-zlobintsev merged commit 7e387e9 into release-10.0.0 Oct 22, 2026
40 of 41 checks passed
@ilya-zlobintsev
ilya-zlobintsev deleted the expose-data-cache-bytes branch October 22, 2026 12:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request lance fork 10.0.0 Landed on the release-10.0.0 fork line upstreamable change Belongs upstream, but is not there yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants