Axolotl

If you're fine-tuning LLMs with Axolotl, this skill gives you direct guidance on YAML configs, LoRA/QLoRA setups, and alignment techniques like DPO and ORPO. It covers practical stuff like FSDP configuration, context parallelism settings, and NCCL performance testing. The quick reference includes actual config snippets and the references folder has detailed docs on dataset formats and API usage. Honestly, Axolotl's YAML-based approach is refreshingly straightforward compared to writing training loops from scratch, and having the multimodal support patterns documented here saves you from piecing together examples from GitHub issues.