jmagly avatar

training

Corpus-to-dataset pipeline for AI training data curation. Ingests sources, synthesizes examples, generates DPO/KTO preference pairs, applies decontamination, and exports to Alpaca/ShareGPT/ChatML/JSONL/Parquet with provenance. Optional Python runtime (aiwg-training CLI) for scale.

version
1.0.0
GitHub stars
224

Install

/plugin install training@aiwg

Run it inside Claude Code after adding the marketplace with /plugin marketplace add jmagly/aiwg.

Contents

Discovered from source

Skills 15

Agents 7

Sponsors

Details

Marketplace
jmagly/aiwg
Source
jmagly/aiwg-training
Author
AIWG Contributors
Category
development
License
MIT
Keywords
training-data, fine-tuning, dpo, kto, alpaca, sharegpt, decontamination, synthetic-data, datasheet

More from jmagly/aiwg

All 40