https://josedavidbaena.com Production notes and source-backed analysis on distributed systems, messaging infrastructure, open-source internals, and model engineering. en-us josedab@gmail.com (José David Baena) josedab@gmail.com (José David Baena) Wed, 10 Sep 2025 00:00:00 GMT https://josedavidbaena.com/blog/tiny-language-models/tiny-language-models-math-foundations https://josedavidbaena.com/blog/tiny-language-models/tiny-language-models-math-foundations Quantization cuts size 75% at 2% accuracy loss. Distillation transfers soft labels. Pruning exploits the Lottery Ticket Hypothesis. The math behind it. Wed, 10 Sep 2025 00:00:00 GMT josedab@gmail.com (José David Baena) machine-learningdeep-learningmodel-compressionquantizationdistillationmathematics