huggingface-vision-trainer

Train and fine-tune vision models on Hugging Face Jobs cloud GPUs.

Updated Dec 17, 2024
One-click install
npx skills add https://github.com/LAF-US/IDAHO-VAULT --skill huggingface-vision-trainer
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: huggingface-vision-trainer
Source: https://github.com/LAF-US/IDAHO-VAULT/tree/main/.codex/plugins/cache/openai-curated/hugging-face/314574a046f21938025ae443f9c6dbbd0c2c9b7a/skills/vision-trainer
Command: npx skills add https://github.com/LAF-US/IDAHO-VAULT --skill huggingface-vision-trainer

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires transformers>=5.2.0, accelerate>=1.1.0, albumentations>=1.4.16, timm, datasets>=4.0, torchmetrics, pycocotools, trackio, huggingface_hub, evaluate, scikit-learn, torchvision, monai, and includes scripts (resource) and references (resource) components.

What problem does it solve?

Trains and fine-tunes vision models (object detection, image classification, and SAM/SAM2 segmentation) on Hugging Face Jobs cloud GPUs, with COCO-style dataset preparation, augmentation, evaluation, and Hub persistence.

Core Features & Use Cases

  • Supports object detection (DETR/RT-DETR, YOLOS), image classification (timm/ViT), and SAM/SAM2 segmentation.
  • Provides end-to-end training pipelines with dataset prep, augmentation, evaluation, and Hub persistence to HF Hub.
  • Includes cost estimation and Trackio monitoring for production-grade training workflows.

Quick Start

Submit a vision training job on HF Jobs using the provided scripts and secrets to push results to the Hub.

Frequently Asked Questions about huggingface-vision-trainer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I train vision models on Hugging Face Jobs cloud GPUs?

To train vision models on Hugging Face Jobs, use the provided production-ready scripts for object detection, image classification, and SAM segmentation. You need to authenticate with HF_TOKEN in job secrets to launch the workflows and persist results to the Hub.

Can I fine-tune object detection models like DETR and YOLOS on custom datasets?

Yes, you can fine-tune object detection models including DETR, RT-DETR, and YOLOS on custom datasets. The skill provides dedicated training scripts that handle COCO-style dataset preparation, augmentation, and evaluation for these architectures.

Does Hugging Face Jobs support SAM and SAM2 segmentation training?

Hugging Face Jobs supports SAM and SAM2 segmentation training through dedicated scripts. The skill handles SAM prompts, dataset preparation, and end-to-end training pipelines to fine-tune segmentation models on cloud GPUs.

What's the best way to estimate costs for cloud GPU vision training workflows?

The best way to estimate costs for cloud GPU vision training is using the built-in cost estimation features of the skill. It evaluates various hardware flavors and production-grade workflows before submitting the final Hugging Face Jobs training run.

Do I need to manually upload my fine-tuned image classification models to the Hub?

You do not need to manually upload fine-tuned image classification models, as the skill includes Hub persistence. It automatically pushes your trained ViT and timm models directly to the Hugging Face Hub after the cloud GPU job completes.