Quantization

Use this note for quantization formats, scale granularity, calibration, accumulation precision, accuracy tradeoffs, and the kernels that realize memory or speed gains.