> ## Documentation Index
> Fetch the complete documentation index at: https://docs.mibyanai.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Pytorch Fsdp — Fully sharded data-parallel training for large models

> Fully sharded data-parallel training for large models

Fully sharded data-parallel training for large models.

## Skill metadata

| | |
| - | - |
| Source | Optional — install with `mibyan skills install official/mlops/pytorch-fsdp` |
| Path | `optional-skills/mlops/pytorch-fsdp` |
| Version | `1.0.0` |
| Author | Orchestra Research |
| License | MIT |
| Dependencies | `torch>=2.0`, `transformers` |
| Platforms | linux, macos |
| Tags | `Distributed Training`, `PyTorch`, `FSDP`, `Data Parallel`, `Sharding`, `Mixed Precision`, `CPU Offloading`, `FSDP2`, `Large-Scale Training` |

## Reference: full SKILL.md

<Info>
  The following is the complete skill definition that Mibyan loads when this skill is triggered. This is what the agent sees as instructions when the skill is active.
</Info>

# Pytorch-Fsdp Skill

Assistance with pytorch-fsdp development, generated from official documentation.

## When to Use This Skill

This skill should be triggered when:

* Working with pytorch-fsdp
* Asking about pytorch-fsdp features or APIs
* Implementing pytorch-fsdp solutions
* Debugging pytorch-fsdp code
* Learning pytorch-fsdp best practices

## Quick Reference

The full common-patterns catalog (\~157k chars of runnable FSDP snippets) lives in
`references/common-patterns.md` — load it with `read_file` when you need wrapping,
sharding-strategy, checkpoint, or mixed-precision examples. Start there rather than
reconstructing FSDP incantations from memory.

## Reference Files

This skill includes comprehensive documentation in `references/`:

* **other.md** - Other documentation

Use `view` to read specific reference files when detailed information is needed.

## Working with This Skill

### For Beginners

Start with the getting\_started or tutorials reference files for foundational concepts.

### For Specific Features

Use the appropriate category reference file (api, guides, etc.) for detailed information.

### For Code Examples

The quick reference section above contains common patterns extracted from the official docs.

## Resources

### references/

Organized documentation extracted from official sources. These files contain:

* Detailed explanations
* Code examples with language annotations
* Links to original documentation
* Table of contents for quick navigation

### scripts/

Add helper scripts here for common automation tasks.

### assets/

Add templates, boilerplate, or example projects here.

## Notes

* This skill was automatically generated from official documentation
* Reference files preserve the structure and examples from source docs
* Code examples include language detection for better syntax highlighting
* Quick reference patterns are extracted from common usage examples in the docs

## Updating

To refresh this skill with updated documentation:

1. Re-run the scraper with the same configuration
2. The skill will be rebuilt with the latest information


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.