ModelExpress: Distributing Model Artifacts at the Speed of Light - NVIDIA Technical Blog

We cut DeepSeek-V4 Pro startup from 8 minutes to under 2 minutes by moving weights over the fastest path to GPU memory with GPU-to-GPU RDMA.

This was achieved using NVIDIA ModelExpress (MX), the weight distribution and cache management service in NVIDIA Dynamo, and this same approach speeds up both inference and RL post-training too. MX reuses kernel caches, while inference workers fetch updated weights directly from other GPUs over NIXL—avoiding centralized broadcasts and keeping weight movement off the critical path.

Blog Post : https://developer.nvidia.com/blog/modelexpress-distributing-model-artifacts-at-the-speed-of-light/