WASTE inference engine

Everything FervorAI has published that touches WASTE inference engine — 2 pieces, newest first.

• WASTE Runs Kimi K3's 2.78 Trillion Parameters on a Laptop, and the Bottleneck Moved to Your SSD

  WASTE proves a 2.78-trillion-parameter model no longer has to fit in RAM, but it relocated the constraint rather than removing it, from memory you cannot buy to 982 GiB…

• Briefing · August 2, 2026 · morning

  Streaming experts off disk instead of holding them in RAM went from one clever hack to the default architecture for running open frontier models locally, and the same…