🧱 Segment Architecture
This is the central place for segment-specific internals.
What a Segment Contains
- Main SST file:
vNN-index.sst - Sparse (scarce) index:
vNN-scarce.sst - Bloom filter:
vNN-bloom-filter.bin - Manifest:
manifest.txt - Lock file:
.lock - Delta cache files:
vNN-delta-NNNN.cache
Core Segment Structures
- Delta cache: in-memory and on-disk overlay for recent updates.
- Bloom filter: fast negative lookup guard before on-disk scans.
- Sparse/scarce index: maps sampled keys to chunk positions in main SST.
Topics
- Segment Design — segment behavior and implementation notes.
- On-Disk Layout & File Names — naming, directory examples, and transactional file writes.
- Sparse Index — sparse/scarce index structure and lookup role.
- Segment Concurrency — state machine and operation gating.