Scaling Laws

10-20-2026

Use this note for empirical relationships among model size, token count, training compute, loss, and the systems constraints that alter those tradeoffs.