unsloth-training

What problem does it solve?

Fine-tune large language models efficiently using Unsloth via GRPO reinforcement learning or supervised fine-tuning, reducing memory and time costs while enabling advanced features like FP8, vision fine-tuning, and mobile deployment.

Core Features & Use Cases

• GRPO RL training with reward design and LoRA adapters
• SFT training with packing and long-context options
• FP8 training for significant VRAM savings
• Vision fine-tuning for VLM tasks
• Docker-based training and reproducible environments
• Mobile deployment support through QAT/ExecuTorch export
• GGUF export options for various serving backends
• End-to-end pipeline from data prep to export and deployment

Quick Start

Run the GRPO training script with a small dataset to start RL fine-tuning.