sft

Configure and execute supervised fine-tuning of LLMs using the Tinker API.

4.0k|507|Updated Jul 14, 2025
One-click install
npx skills add https://github.com/thinking-machines-lab/tinker-cookbook --skill sft-thinking-machines-lab
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: sft
Source: https://github.com/thinking-machines-lab/tinker-cookbook/tree/main/.claude/skills/sft
Command: npx skills add https://github.com/thinking-machines-lab/tinker-cookbook --skill sft-thinking-machines-lab

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Fine-tuning large language models on instruction or chat data is complex, time-consuming, and error-prone; this skill guides users through configuring and running supervised fine-tuning with the Tinker API.

Core Features & Use Cases

  • Guided setup for model, datasets, and training goals.
  • Reference patterns from existing recipes and core training utilities.
  • End-to-end workflow from data preparation to evaluation and export of fine-tuned artifacts.

Quick Start

Run a basic SFT by following the example pattern to fine-tune a model on your dataset.

Frequently Asked Questions about sft

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run supervised fine-tuning on a custom dataset using the Tinker API?▼

Supervised fine-tuning (SFT) with the Tinker API requires coupling your dataset with the appropriate renderer, selecting a learning rate, and applying the guided training configuration to execute the run from model selection to export.

What is the difference between instruction tuning and chat fine-tuning for LLMs?▼

Instruction tuning adapts models to follow specific commands, while chat fine-tuning optimizes for multi-turn conversational dynamics; both supervised learning tasks are supported by configuring the appropriate renderer and dataset.

How do I prepare instruction data for LLM fine-tuning?▼

Preparing instruction data for LLM fine-tuning involves formatting your dataset to match a compatible renderer, ensuring the input aligns with the Tinker API's training configuration requirements for the selected model base.

Can I use the Tinker API for broader machine learning workflows beyond chat data?▼

Yes, the Tinker API supports broader machine learning workflows and supervised learning tasks across different datasets and model bases, extending beyond just chat fine-tuning to general instruction tuning.

What is the best way to configure the learning rate for supervised fine-tuning?▼

Configuring the learning rate for supervised fine-tuning is handled through the guided setup, which helps match the training configuration to your specific model base and dataset to ensure stable learning.