Oct 17, 2025/20 mins readNanoChat·Technical Deep Dives·Part 3/13Distributed Muon: Custom Gradient Synchronization for Memory-Efficient Training