Oct 31, 2025/21 mins readNanoChat·Technical Deep Dives·Part 6/13Training Data Pipeline: Streaming Tokenization at Scale