This page moved to https://slavadubrov.com/fr/blog/2025/05/04/scaling-llms-multi-gpu-multi-node/.