sop-cr-finetuning

Launch and monitor Cosmos-Reason2 fine-tuning on augmented video QA datasets.

49|14|Updated Aug 27, 2025
One-click install
npx skills add https://github.com/NVIDIA/sop-monitoring-blueprints --skill sop-cr-finetuning
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: sop-cr-finetuning
Source: https://github.com/NVIDIA/sop-monitoring-blueprints/tree/main/agentic/sop-agentic-ft/plugins/sop-cr-finetuning-plugin/skills/sop-cr-finetuning
Command: npx skills add https://github.com/NVIDIA/sop-monitoring-blueprints --skill sop-cr-finetuning

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill coordinates Cosmos-Reason2 vision-language model fine-tuning for SOP monitoring, replacing manual job launch, progress tracking, anomaly checks, checkpoint handling, and reporting with a structured workflow.

Core Features & Use Cases

  • Pre-flight Validation: Checks service health, GPU availability, and conflicting training jobs before starting.
  • Training Monitoring: Launches fine-tuning through the local API and tracks status, progress, loss, steps, GPU usage, OOM events, NaN losses, and other anomalies.
  • Checkpoint Preparation: Detects LoRA adapters, normalizes adapter configuration, merges adapters with the base model, verifies inference-ready artifacts, and preserves the original adapter.
  • Training Reports: Collects final metrics and anomaly summaries into a report for completed, failed, or cancelled jobs.
  • Use Case: Given an augmented SOP video QA dataset ID, use this Skill to run training through completion and produce a deployable checkpoint and documented results.

Quick Start

Ask the Skill to fine-tune the SOP monitoring VLM using the specified augmented dataset ID and monitor the run through its final report.

Frequently Asked Questions about sop-cr-finetuning

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fine-tune a vision-language model for SOP monitoring using video QA datasets?

To fine-tune a vision-language model for SOP monitoring, launch Cosmos-Reason2 training on augmented video question-answer datasets via the local API, tracking progress and GPU anomalies until completion. The workflow handles job execution and produces deployable artifacts.

What does GPU pre-flight validation check before starting VLM fine-tuning?

GPU pre-flight validation for VLM fine-tuning checks service health, GPU availability, and conflicting training jobs before starting. This ensures the environment is ready and prevents resource contention during the Cosmos-Reason2 training process.

Do I need Docker Compose to run Cosmos-Reason2 training for SOP monitoring?

Yes, Docker Compose services are required to run Cosmos-Reason2 training for SOP monitoring. The workflow leverages the local fine-tuning API and Docker Compose to orchestrate training jobs and monitor GPU usage effectively.

How do I merge LoRA adapters with a base model after VLM fine-tuning?

To merge LoRA adapters with a base model after VLM fine-tuning, the checkpoint preparation process detects adapters, normalizes configuration, and merges them with the base model. It verifies inference-ready artifacts while preserving the original adapter separately.

What anomalies are detected during vision-language model training monitoring?

During vision-language model training monitoring, the system detects out-of-memory events, NaN losses, and abnormal GPU usage. It tracks status, progress, and loss metrics to ensure the SOP monitoring fine-tuning job runs without silent failures or hardware issues.

How do I generate a training report for a completed or failed VLM fine-tuning job?

To generate a training report for a VLM fine-tuning job, the workflow collects final metrics and anomaly summaries into a documented report. This report is produced for completed, failed, or cancelled jobs to provide fully traceable training results.