domains / families / devops / llm-fine-tuning

llm-fine-tuning

authentic

Set up infrastructure for fine-tuning LLMs with QLoRA, LoRA, and full fine-tuning using Hugging Face TRL, Axolotl, and distributed training with DeepSpeed or FSDP. Covers dataset prep, training runs, and model export.

When to use

• Fine-tuning an LLM on domain-specific data (legal, medical, code, support)
• Running QLoRA to fine-tune 70B models on consumer GPUs
• Setting up distributed training with DeepSpeed or FSDP
• Exporting fine-tuned adapters for production serving
• Implementing RLHF, DPO, or instruction tuning pipelines

Skill page

Source