José David Baena – Software Engineer https://josedavidbaena.com Personal website and blog where I document thoughts, ideas, and interests in software engineering, web performance, and open source technologies. en-us josedab@gmail.com (José David Baena) josedab@gmail.com (José David Baena) Sat, 27 Sep 2025 00:00:00 GMT https://josedavidbaena.com/blog/tiny-language-models/quantization-aware-training-tutorial Quantization-Aware Training: INT8/INT4 Models That Maintain Quality https://josedavidbaena.com/blog/tiny-language-models/quantization-aware-training-tutorial Naive INT8 drops MMLU 24%. QAT drops it 2.4%. Train with fake quantization so the model learns resilience. GPTQ, mixed-precision, deployment recipes. Sat, 27 Sep 2025 00:00:00 GMT josedab@gmail.com (José David Baena) machine-learningquantizationtrainingoptimizationtutorial https://josedavidbaena.com/blog/tiny-language-models/knowledge-distillation-complete-tutorial Knowledge Distillation: How to Train a 1.5B Model That Matches Your 7B https://josedavidbaena.com/blog/tiny-language-models/knowledge-distillation-complete-tutorial Llama-7B to 1.5B. 90% quality at 1/5 the size. 3× inference speed. From temperature-scaled softmax to production deployment—with working PyTorch code. Tue, 23 Sep 2025 00:00:00 GMT josedab@gmail.com (José David Baena) machine-learningdistillationtrainingtutorialpytorch