Short answer

Quantization uses fewer bits for model values, often reducing storage or memory traffic. Accuracy, speed, and compatibility are not guaranteed.

Boundary

Compare against a baseline on fixed evals and hardware; retain a rollback artifact.