TurboQuant KV Compression and SSD Expert Streaming for M5 Pro and IOS

Build a library that offloads massive KV caches to SSDs with active compression to enable large context windows on consumer hardware. This fills the gap for memory-constrained local inference environments.

Suggested repo: disk-kv

"Run massive LLM context windows on your SSD."

Estimated effort: 80h