Commit e5379d5
committed
feat: add SSTable format and S3 persistence (Phase 1c)
Add persistence layer so MemTables flush to immutable SSTable files on
S3-compatible storage. When s3Bucket is not configured the store stays
in pure in-memory mode and all existing tests remain unaffected.
Key additions:
- ObjectStore interface with S3ObjectStore (MinIO) and
FileSystemObjectStore (test double)
- SSTableWriter/SSTable: binary format with block index for range scans
- MergeIterator: K-way merge across MemTable + SSTables with
deduplication and tombstone suppression
- Manifest: versioned JSON manifest tracking SSTables on S3
- S3ValueStore and S3NamespaceStore serialization/deserialization
- S3StoreConfig: S3 connectivity properties (bucket, endpoint, etc.)
- S3SailStore: flush path, merged read path, startup loading
- 29 new tests (unit + persistence); 541 total tests pass1 parent 2b2f929 commit e5379d5
27 files changed
Lines changed: 2876 additions & 30 deletions
File tree
- core/sail/s3
- src
- main/java/org/eclipse/rdf4j/sail/s3
- config
- storage
- test/java/org/eclipse/rdf4j/sail/s3
- storage
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
48 | 48 | | |
49 | 49 | | |
50 | 50 | | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
51 | 55 | | |
52 | 56 | | |
53 | 57 | | |
| |||
71 | 75 | | |
72 | 76 | | |
73 | 77 | | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
74 | 90 | | |
75 | 91 | | |
Lines changed: 39 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
10 | 10 | | |
11 | 11 | | |
12 | 12 | | |
| 13 | + | |
| 14 | + | |
13 | 15 | | |
14 | 16 | | |
| 17 | + | |
15 | 18 | | |
16 | 19 | | |
17 | 20 | | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
18 | 24 | | |
19 | 25 | | |
20 | 26 | | |
| |||
52 | 58 | | |
53 | 59 | | |
54 | 60 | | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
55 | 94 | | |
0 commit comments