huggingface-vision-trainer

Fine-tune vision models on Hugging Face Jobs with COCO datasets.

1|Updated Feb 15, 2026
One-click install
npx skills add https://github.com/tripplen23/finetuning-sessions --skill huggingface-vision-trainer-tripplen23
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: huggingface-vision-trainer
Source: https://github.com/tripplen23/finetuning-sessions/tree/main/.kiro/skills/huggingface-vision-trainer
Command: npx skills add https://github.com/tripplen23/finetuning-sessions --skill huggingface-vision-trainer-tripplen23

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires transformers>=5.2.0, accelerate>=1.1.0, albumentations>=1.4.16, timm, datasets>=4.0, torchmetrics, pycocotools, trackio, huggingface_hub, evaluate, scikit-learn, torchvision, monai, and includes scripts (resource) and references (resource) components.

What problem does it solve?

Trains and fine-tunes vision models (object detection, image classification, SAM/SAM2) on Hugging Face Jobs cloud GPUs, eliminating local hardware obstacles and enabling Hub persistence.

Core Features & Use Cases

  • End-to-end vision training on HF Jobs for OD, IC, and SAM/SAM2.
  • Supports common models (DETR, RT-DETR, YOLOS, timm classifiers, SAM2) with COCO formatting, augmentation, and mAP/mAR evaluation.
  • Hub persistence: push trained models to Hugging Face Hub with token-based authentication and Trackio monitoring.

Quick Start

Submit a training job using the included scripts to fine-tune object detection, image classification, or SAM models on Hugging Face Jobs.

Frequently Asked Questions about huggingface-vision-trainer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fine-tune a Hugging Face vision model on cloud GPUs?

Fine-tuning vision models on Hugging Face Jobs uses included scripts to orchestrate end-to-end training for object detection, image classification, and SAM/SAM2 segmentation on cloud GPUs.

Can I train RT-DETR and YOLOS object detection models using COCO formatted datasets?

Yes, training RT-DETR and YOLOS object detection models supports COCO-formatted datasets, applying albumentations augmentation and evaluating results with torchmetrics mAP and mAR scores.

Does this workflow support pushing trained timm classifiers to the Hugging Face Hub?

Yes, pushing trained timm classifiers to the Hugging Face Hub is supported through token-based authentication, ensuring model persistence and experiment monitoring with Trackio.

What dependencies do I need to set up SAM2 segmentation pipelines on HF Jobs?

Setting up SAM2 segmentation pipelines requires dependencies including transformers, accelerate, datasets, timm, pycocotools, and monai to execute end-to-end training workflows on Hugging Face Jobs.

Are there limitations when running D-FINE and DETR training workflows without local hardware?

Running D-FINE and DETR training workflows without local hardware has no limitations here; Hugging Face Jobs cloud GPUs handle the compute entirely, ensuring repeatable and auditable experiments.