José David Baena
All Series
NanoChat: Building ChatGPT for $100
🤖

NanoChat: Building ChatGPT for $100

Comprehensive technical analysis of Andrej Karpathy's nanochat project. Deep dives into architecture, training pipeline, optimizers, and proposals for evolving this minimal LLM implementation.

active13 / 13 episodes293 min totalintermediate
Series Progress100%

What You'll Learn

  • Train a complete LLM from scratch in 4 hours
  • Understand the full training pipeline: tokenization to deployment
  • Implement custom optimizers (Muon) and training techniques
  • Deploy a working ChatGPT-like interface

Prerequisites

  • Python
  • PyTorch
  • Transformers
  • Basic ML

Who This Is For

  • ml-engineers
  • ai-developers
  • students