finetuning

Fine-tune machine learning models on Azure AI Foundry with Python scripts.

12|1|Updated Mar 15, 2026
One-click install
npx skills add https://github.com/jorgeasaurus/agent-skills --skill finetuning-jorgeasaurus
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: finetuning
Source: https://github.com/jorgeasaurus/agent-skills/tree/main/finetuning
Command: npx skills add https://github.com/jorgeasaurus/agent-skills --skill finetuning-jorgeasaurus

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires openai>=1.0, azure-identity, azure-ai-projects, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill streamlines the process of fine-tuning machine learning models, enabling users to quickly adjust models to their specific needs using supervised fine-tuning, preference-based fine-tuning, or reinforcement learning with graders.

Core Features & Use Cases

  • Supervised Fine-Tuning: Customize models with labeled data.
  • Preference-Based Fine-Tuning: Optimize models based on human preferences.
  • Reinforcement Fine-Tuning: Train models through interaction with external tools or feedback from graders.
  • Use Case: Imagine you have a pre-trained model for image classification that you want to fine-tune to better classify specific types of images. Use this Skill to prepare the training data, submit the training job, deploy the fine-tuned model, and evaluate its performance.

Quick Start

Run the following command to start the fine-tuning process for your model: python scripts/submit_training.py --model your-model-id --training-file train-data.jsonl --validation-file validation-data.jsonl --type sft

Frequently Asked Questions about finetuning

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fine-tune a machine learning model using supervised learning?

Fine-tuning a machine learning model with supervised learning requires preparing labeled data, submitting a training job via Python scripts, and evaluating the deployed model's performance using Azure AI Foundry services.

What is the difference between supervised, preference-based, and reinforcement fine-tuning?

Supervised fine-tuning customizes models using labeled data, preference-based fine-tuning optimizes based on human preferences, and reinforcement fine-tuning trains models through interaction with external tools or feedback from graders.

Do I need Azure AI Foundry to run model training jobs?

Yes, model training jobs require Azure AI Foundry because the process utilizes Azure services and dependencies like azure-identity and azure-ai-projects to submit training jobs, deploy models, and evaluate performance.

How do I start a fine-tuning job for a pre-trained model?

You start a fine-tuning job by running the submit_training.py Python script with arguments specifying your model ID, training data file, validation data file, and the fine-tuning type like sft for supervised learning.

What data formats are supported for model training and validation?

Model training and validation support JSONL data formats, requiring you to provide a training file and a validation file, such as train-data.jsonl and validation-data.jsonl, to prepare data for the supervised fine-tuning process.

What Python dependencies are required for model fine-tuning?

Model fine-tuning requires the openai library version 1.0 or higher, azure-identity, and azure-ai-projects Python dependencies to interact with Azure AI Foundry services for training, deployment, and evaluation.