Summary
This teaches Claude to correctly implement PyTorch's FSDP2 (the DTensor-based sharding API via fully_shard) in training scripts. It covers the full setup: launching with torchrun, applying bottom-up sharding to submodules before the root, creating optimizers after sharding so they see DTensor parameters, and checkpointing with Distributed Checkpoint or the state dict helpers. The skill is opinionated about the right patterns (use model() not model.forward(), never naively torch.save DTensor state dicts) and includes concrete migration steps from meta device initialization through mixed precision config. Use this when your model won't fit on one GPU or you want cleaner per-parameter sharding than FSDP1.
Install to Claude Code
npx -y skills add orchestra-research/ai-research-skills --skill pytorch-fsdp2 --agent claude-codeInstalls into .claude/skills of the current project.
Plug Mailtrap into your AI workflow and let it handle the email.
Connect Mailtrap MCP →
Agent, run crypto. Access onchain data & trade routes via 1inch.
Install now →
Make coding agent sessions - Searchable, Shareable, Vendor-neutral & Scored.
Try For Free →
Your agent targets a perfect 10 Code Health score. Deterministic. Every commit.
Try For Free →
Integrate web data into your AI product. One API to scrape website & brand data.
Get API Key Now →
belt cli automatically finds the best tools and skills for your agent. image, video, music, tts...
one prompt install →Files
SKILL.md
Select a file.
Featured
Plug Mailtrap into your AI workflow and let it handle the email.
Connect Mailtrap MCP →Agent, run crypto. Access onchain data & trade routes via 1inch.
Install now →Make coding agent sessions - Searchable, Shareable, Vendor-neutral & Scored.
Try For Free →Your agent targets a perfect 10 Code Health score. Deterministic. Every commit.
Try For Free →Integrate web data into your AI product. One API to scrape website & brand data.
Get API Key Now →belt cli automatically finds the best tools and skills for your agent. image, video, music, tts...
one prompt install →
