llama.cpp

Everything Fervor AI has published that touches llama.cpp — 4 pieces, newest first.

• Same Bytes, Different Model: What AutoRound's Calibration Corpus Does to a GGUF Quantization

  Two GGUF files with identical size and tensor map can differ by half in KL divergence because AutoRound's rounding search lets the calibration text choose each weight's…

• NVIDIA's Personal AI Router Will Not Pool Your GPUs, and Saying So Out Loud Is the Best Thing in the README

  PAIR solves concurrency across home machines rather than capacity, and the reason it is worth attention is that NVIDIA states that limit in a blockquote instead of…

• Cua's Metal Capability Shim Made llama.cpp 11x Faster by Changing Two Answers

  The GPU inside a macOS VM was never the bottleneck, its self-reported capability profile was, and Cua's shim proves that a capability probe is now part of your local…

• Unsloth Desktop Runs Claude Code on Your Own GPU. Two Defaults Break It First.

  Unsloth Desktop's Anthropic-compatible endpoint makes Claude Code run against a local GGUF in one command, but two defaults sabotage it out of the box: Claude Code's…