LLM Quantization, Simply: FP16, 8-bit, 4-bit, and What Q4_K_M Means
A simple, diagram-first guide to LLM quantization: what rounding a weight actually does, how much memory each bit width saves, how to read names like Q4_K_M, AWQ, and FP8, and a toy script that shows where quality falls off.