huggingface-vision-trainer

Train and fine-tune vision models on Hugging Face Jobs.

1|Updated Jul 12, 2026
One-click install
npx skills add https://github.com/Tyler-R-Kendrick/slm-training --skill huggingface-vision-trainer-tyler-r-kendrick
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: huggingface-vision-trainer
Source: https://github.com/Tyler-R-Kendrick/slm-training/tree/main/.agents/skills/huggingface-vision-trainer
Command: npx skills add https://github.com/Tyler-R-Kendrick/slm-training --skill huggingface-vision-trainer-tyler-r-kendrick

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires transformers, torch, torchvision, datasets, monai, trackio, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This skill removes the complexity of local GPU infrastructure management by providing a streamlined, production-ready pipeline for training and fine-tuning vision models directly on Hugging Face Jobs.

Core Features & Use Cases

  • Multi-Task Training: Supports object detection (D-FINE, RT-DETR, DETR), image classification (timm models), and SAM/SAM2 segmentation.
  • Automated Pipeline: Handles dataset validation, bbox preprocessing, hardware selection, and cost estimation.
  • Use Case: Fine-tune a pre-trained D-FINE model on a custom object detection dataset to detect specific industrial components, ensuring the final model is automatically saved to the Hugging Face Hub.

Quick Start

Use the huggingface-vision-trainer skill to validate my dataset username/my-dataset and then launch a training job for an object detection model using the t4-small hardware flavor.

Frequently Asked Questions about huggingface-vision-trainer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fine-tune a Hugging Face vision model on cloud GPUs without managing local infrastructure?

Fine-tune a Hugging Face vision model on cloud GPUs by using Hugging Face Jobs to launch asynchronous training environments. This removes local infrastructure complexity by providing a streamlined, production-ready pipeline that handles hardware selection and cost estimation automatically.

Can I train object detection models using architectures like D-FINE or RT-DETR on managed GPU infrastructure?

Object detection models including D-FINE, RT-DETR, and DETR are supported for training on managed GPU infrastructure. The pipeline handles dataset validation, bbox preprocessing, and model persistence directly to the Hugging Face Hub after training completes.

What's the best way to validate my custom dataset before launching a vision model training job?

Validate your custom dataset by providing its identifier to trigger automated dataset format validation and bbox preprocessing. This ensures your data is correctly formatted before you launch a training job on your selected cloud GPU hardware flavor.

Does this vision training pipeline support image classification and segmentation models?

Image classification and segmentation models are fully supported alongside object detection. The pipeline handles timm classification models and SAM/SAM2 segmentation networks, allowing you to train diverse vision architectures asynchronously on scalable cloud hardware.

Do I need to manually estimate GPU training costs when fine-tuning computer vision models?

Manual GPU training cost estimation is not required because the pipeline automates it. You simply select your desired hardware flavor, such as t4-small, and the automated workflow calculates the expected costs before launching the asynchronous Hugging Face Jobs environment.

How are trained vision models persisted after fine-tuning completes on the cloud GPU?

Trained vision models are automatically saved and persisted to the Hugging Face Hub after fine-tuning completes. This ensures your trained object detectors, classifiers, and segmentation networks are securely stored and readily accessible for downstream inference.