slv-jetstreamer

# SLV Jetstreamer Skill `jetstreamer` is anza-xyz's high-throughput Solana ETL engine: it streams the Old Faithful CAR archive directly into a local ClickHouse instance and produces query-ready aggregations (program invocation counts, slot statuses, pubkey mentions, …). Together with the `slv-rpc` of1 rolling cache, it gives a clean separation: | Layer | Component | Role | |---|---|---| | **JSON-RPC** (per-call) | `yellowstone-faithful` (Index RPC) + 30-epoch index cache | `getTransaction` / `getBlock` / `getBlockTime` etc. | | **SQL analytics** (bulk) | `jetstreamer` + ClickHouse | Cross-epoch aggregations, program-level joins, MEV / DEX research | Jetstreamer is **not** a server. It runs as a one-shot ETL per epoch and exits; ClickHouse is the long-running query surface. ## Hardware target | Resource | Recommended | |---|---| | CPU | AMD EPYC 64C+ (jetstreamer hits 2.7 M TPS+ ingest with all cores) | | RAM | 128 GB+ (754 GB optimal for full-fat ClickHouse buffers) | | Disk | 4-8 TB NVMe (RAID0 recommended for max write bandwidth — derived data is rebuildable from Old Faithful) | | Network | 10 Gbps+ (50 Gbps demonstrated to fully saturate ingest path) | | OS | Ubuntu 24.04, kernel 6.14+ | | Toolchain | **Clang 16** (RocksDB compatibility — Clang 17/18 do *not* work), GCC 13, Rust (rustup, toolchain pinned by rust-toolchain.toml in jetstreamer repo) | ## Disk layout The reference layout combines two NVMes into one mdadm RAID0 stripe: ``` /dev/nvme0n1 ─┐ ...