What Is Model Quantization? How Lower Precision Makes AI Faster and Cheaper
Model quantization represents model weights, activations, or cache values with fewer bits to reduce memory traffic, storage, energy, and often inference latency. This guide explains the mechanism, trade-offs, evaluation, and controls that matter in practice.