https://josedavidbaena.com Personal website and blog where I document thoughts, ideas, and interests in software engineering, web performance, and open source technologies. en-us josedab@gmail.com (José David Baena) josedab@gmail.com (José David Baena) Sun, 26 Jul 2026 00:00:00 GMT https://josedavidbaena.com/blog/frontier-model-engineering/04-multi-gpu-inference-first-principles https://josedavidbaena.com/blog/frontier-model-engineering/04-multi-gpu-inference-first-principles Prove every rank's weight and KV placement, map collectives onto physical links, pin runtime behavior, benchmark the workload, and plan rank recovery. Sun, 26 Jul 2026 00:00:00 GMT josedab@gmail.com (José David Baena) multi-gpudistributed-inferencetensor-parallelismexpert-parallelismgpu-topology