vLLM
Everything FervorAI has published that touches vLLM — 1 piece, newest first.
-
Top-1 Token Flips: How Your vLLM Backend and Quantization Choice Change What the Model Says
Identical weights served through different attention backends and quantizations produce measurably different tokens, so the quality you get from a local model is a…