azure-ai-fine-tuning

Automate end-to-end Azure AI Foundry fine-tuning workflows with dataset prep, training, evaluation, and deployment.

56|46|Updated Jun 26, 2025
One-click install
npx skills add https://github.com/microsoft-foundry/fine-tuning --skill azure-ai-fine-tuning
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: azure-ai-fine-tuning
Source: https://github.com/microsoft-foundry/fine-tuning/tree/main/Skills
Command: npx skills add https://github.com/microsoft-foundry/fine-tuning --skill azure-ai-fine-tuning

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires openai, azure-identity, requests, azure-ai-projects, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides a complete, hands-off pipeline to manage fine-tuning tasks on Azure AI Foundry, from data prep and validation to training, evaluation, and deployment, enabling teams to run end-to-end FT workflows with guardrails.

Core Features & Use Cases

  • Dataset creation, validation, and format conversion for SFT, DPO, and RFT pipelines.
  • Submitting, monitoring, and calibrating training jobs across multiple training types.
  • Deployment, evaluation, and cost-aware management of fine-tuned models.
  • Real-world use case: automate a full FT workflow in CI/CD to iterate efficiently on model quality and deployment readiness.

Quick Start

Instruct the agent to begin an Azure AI Foundry fine-tuning workflow end-to-end, including data prep and a mock deployment.

Frequently Asked Questions about azure-ai-fine-tuning

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate a fine-tuning pipeline on Azure AI Foundry end-to-end?

You can automate an Azure AI Foundry fine-tuning pipeline by orchestrating dataset preparation, training job submission, evaluation, and deployment using the provided scripts. This enables hands-off, CI/CD-integrated end-to-end workflows with built-in guardrails.

What is the difference between SFT, DPO, and RFT pipelines for model training?

SFT, DPO, and RFT are distinct training pipelines supported for fine-tuning workflows. The Skill handles dataset creation, validation, and format conversion specific to each pipeline type, ensuring correct data structures for supervised, preference-based, and reinforcement training.

Can I integrate Azure Foundry training jobs into my CI/CD pipelines?

Yes, Azure Foundry training jobs are designed for CI/CD integration. The Skill provides automation-friendly prompts and scripts to submit, monitor, and calibrate training jobs, allowing teams to iterate efficiently on model quality and deployment readiness.

How do I prepare and validate datasets for Azure AI fine-tuning?

Dataset preparation and validation for Azure AI fine-tuning involves format conversion and structural checks for SFT, DPO, and RFT pipelines. The Skill automates this data prep step to ensure training data meets Azure Foundry requirements before job submission.

Do I need the Azure AI Projects package to deploy fine-tuned models?

Yes, the azure-ai-projects package is required. The Skill depends on it alongside openai, azure-identity, and requests to manage the deployment, evaluation, and cost-aware operations of fine-tuned models on Azure resources.

What's the best way to evaluate fine-tuned models after training completes on Azure?

The best way to evaluate fine-tuned models on Azure is to use the built-in evaluation and deployment steps provided. The Skill orchestrates post-training evaluation and cost-aware management to verify model quality and deployment readiness.