https://josedavidbaena.com Production notes and source-backed analysis on distributed systems, messaging infrastructure, open-source internals, and model engineering. en-us josedab@gmail.com (José David Baena) josedab@gmail.com (José David Baena) Tue, 14 Oct 2025 00:00:00 GMT https://josedavidbaena.com/blog/nanochat/building-chatgpt-for-100-dollars https://josedavidbaena.com/blog/nanochat/building-chatgpt-for-100-dollars Train a complete ChatGPT-like system from scratch for $100: tokenizer, pretraining, SFT, RL, deployment—the full LLM pipeline for the price of dinner. Tue, 14 Oct 2025 00:00:00 GMT josedab@gmail.com (José David Baena) machine-learningaitutorialllmdeep-learningpytorch https://josedavidbaena.com/blog/tiny-language-models/knowledge-distillation-complete-tutorial https://josedavidbaena.com/blog/tiny-language-models/knowledge-distillation-complete-tutorial Llama-7B to 1.5B. 90% quality at 1/5 the size. 3× inference speed. From temperature-scaled softmax to production deployment—with working PyTorch code. Tue, 23 Sep 2025 00:00:00 GMT josedab@gmail.com (José David Baena) machine-learningdistillationtrainingtutorialpytorch