domains / families / research / litgpt

litgpt

separate

Implements and trains LLMs using Lightning AI's LitGPT with 20+ pretrained architectures (Llama, Gemma, Phi, Qwen, Mistral). Use when need clean model implementations, educational understanding of architectures, or production fine-tuning with LoRA/QLoRA. Single-file implementations, no abstraction layers.

When to use

• Want to understand LLM architectures (clean, readable code)
• Need production-ready training recipes
• Educational purposes or research
• Prototyping new model ideas
• Lightning ecosystem user
• **Axolotl/TRL**: More fine-tuning features, YAML configs
• **Megatron-Core**: Maximum performance for >70B models
• **HuggingFace Transformers**: Broadest model support

Skill page

Source