Nemo Mbridge Mlm Bridge Training

This handles correlation testing between Megatron-LM and Megatron Bridge training runs, which matters when you need to verify that loss curves match after code changes or when translating MLM command-line arguments to Bridge recipe configs. It walks you through running both frameworks with identical hyperparameters (2 layer, 256 hidden, mock data) and checking that BF16 losses agree within rounding error. The multi-GPU examples show tensor parallelism setup for both sides. One thing that will save you time: it front-loads the gotchas like always nuking nemo_experiments before fresh runs because Bridge silently resumes from stale checkpoints, and remembering to set PYTHONPATH for MLM or nothing works.

Install to Claude Code

npx -y skills add nvidia/skills --skill nemo-mbridge-mlm-bridge-training --agent claude-code