train-sft

Generate Python scripts for Supervised Fine-Tuning of language models in the ART framework.

10.6k|971|Updated Mar 10, 2025
One-click install
npx skills add https://github.com/OpenPipe/ART --skill train-sft
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: train-sft
Source: https://github.com/OpenPipe/ART/tree/main/.agents/skills/train-sft
Command: npx skills add https://github.com/OpenPipe/ART --skill train-sft

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps users fine-tune language models using Supervised Fine-Tuning (SFT) with the ART framework, enabling them to create custom models for specific tasks.

Core Features & Use Cases

  • SFT Training: Guides users through setting up and generating SFT training scripts.
  • Dataset Handling: Supports training from JSONL files or distillation from a teacher model.
  • Backend Options: Offers both ServerlessBackend (managed GPUs) and LocalBackend (local GPU) training.
  • Use Case: Train a specialized chatbot for customer support by fine-tuning a base model on a dataset of past customer interactions.

Quick Start

Use the train-sft skill to start a new SFT training process.

Frequently Asked Questions about train-sft

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I start supervised fine-tuning for a language model using the ART framework?

To start supervised fine-tuning (SFT) using the ART framework, you select your training data, choose a backend, configure hyperparameters, and generate a runnable Python script. The process guides you through customizing models for specific applications.

Can I train a language model locally and with serverless GPUs?

Yes, you can train using either a ServerlessBackend for managed GPUs or a LocalBackend for your local GPU. Both backend options are supported when configuring your supervised fine-tuning environment.

What data formats are supported for SFT training data?

Supervised fine-tuning supports training directly from JSONL files or using distillation from a teacher model. You can choose either data source when setting up your training script.

What is the best way to create a specialized chatbot from past customer interactions?

The best way to create a specialized chatbot is by fine-tuning a base language model on a dataset of past customer interactions. This supervised fine-tuning process adapts the model specifically for your customer support tasks.

Does this SFT process generate the Python training script for me?

Yes, the supervised fine-tuning process guides you through selecting data and configuring hyperparameters to automatically generate a runnable Python script. This script executes the training using the ART framework.