Storage Engine
/
The Iceberg Engine
The Iceberg Engine
How rastack-store persists every model as an Apache Iceberg table on object storage.
The storage crate, rastack-store, is an Iceberg engine built on two swappable abstractions: an ObjectBackend for where bytes live, and a DataCodec for how rows are encoded.
object_store (LocalFileSystem)
local development on disk
the browser (WASM), dependency-free
Arrow and Parquet compile and run on wasm32, so ParquetCodec is the default in every build — the browser reads and writes the same .parquet files as the server. JsonCodec remains available for portable dumps.
•
Insert appends a new data file to the table.
•
Update / delete rewrite a compacted snapshot.
•
export_warehouse / import_warehouse snapshot a whole warehouse as one blob — this is what powers browser IndexedDB persistence.
› Good to know
The first cut uses an id + JSON encoding in Iceberg layout; typed per-field Arrow columns and the full iceberg crate catalog are documented as deferred work.
Build with AI
Every page is available as clean Markdown for LLMs and coding agents. Point one at the files below to build on top of React API Stack.
React API Stack · alpha · built to scale to millions