https://josedavidbaena.com Personal website and blog where I document thoughts, ideas, and interests in software engineering, web performance, and open source technologies. en-us josedab@gmail.com (José David Baena) josedab@gmail.com (José David Baena) Tue, 28 Jul 2026 00:00:00 GMT https://josedavidbaena.com/blog/kimi-k3/02-architecture-kda-attnres-experts https://josedavidbaena.com/blog/kimi-k3/02-architecture-kda-attnres-experts Trace Kimi K3's 69 KDA layers, 24 gated MLA layers, Attention Residuals, and 896 experts without overstating what released artifacts prove. Tue, 28 Jul 2026 00:00:00 GMT josedab@gmail.com (José David Baena) kimi-k3architectureattentionmixture-of-expertsmachine-learning https://josedavidbaena.com/blog/kimi-k3/01-hardware-requirements https://josedavidbaena.com/blog/kimi-k3/01-hardware-requirements Kimi K3 activates about 104.2B parameters per token, but its 1.561 TB snapshot still needs a multi-GPU memory, cache, storage, and network plan. Mon, 27 Jul 2026 00:00:00 GMT josedab@gmail.com (José David Baena) kimi-k3gpuinferencemixture-of-expertshardware