sft

Configure and execute supervised fine-tuning of LLMs using the Tinker API.

4.0k|507|Updated Jul 14, 2025
One-click install
npx skills add https://github.com/thinking-machines-lab/tinker-cookbook --skill sft-thinking-machines-lab
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: sft
Source: https://github.com/thinking-machines-lab/tinker-cookbook/tree/main/.claude/skills/sft
Command: npx skills add https://github.com/thinking-machines-lab/tinker-cookbook --skill sft-thinking-machines-lab

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Fine-tuning large language models on instruction or chat data is complex, time-consuming, and error-prone; this skill guides users through configuring and running supervised fine-tuning with the Tinker API.

Core Features & Use Cases

  • Guided setup for model, datasets, and training goals.
  • Reference patterns from existing recipes and core training utilities.
  • End-to-end workflow from data preparation to evaluation and export of fine-tuned artifacts.

Quick Start

Run a basic SFT by following the example pattern to fine-tune a model on your dataset.

Frequently Asked Questions about sft

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run supervised fine-tuning on a custom dataset using the Tinker API?

Supervised fine-tuning (SFT) with the Tinker API requires coupling your dataset with the appropriate renderer, selecting a learning rate, and applying the guided training configuration to execute the run from model selection to export.

What is the difference between instruction tuning and chat fine-tuning for LLMs?

Instruction tuning adapts models to follow specific commands, while chat fine-tuning optimizes for multi-turn conversational dynamics; both supervised learning tasks are supported by configuring the appropriate renderer and dataset.

How do I prepare instruction data for LLM fine-tuning?

Preparing instruction data for LLM fine-tuning involves formatting your dataset to match a compatible renderer, ensuring the input aligns with the Tinker API's training configuration requirements for the selected model base.

Can I use the Tinker API for broader machine learning workflows beyond chat data?

Yes, the Tinker API supports broader machine learning workflows and supervised learning tasks across different datasets and model bases, extending beyond just chat fine-tuning to general instruction tuning.

What is the best way to configure the learning rate for supervised fine-tuning?

Configuring the learning rate for supervised fine-tuning is handled through the guided setup, which helps match the training configuration to your specific model base and dataset to ensure stable learning.