sop-ft-orchestrate

Automate end-to-end fine-tuning of SOP monitoring pipelines with DDM-Net and Cosmos-Reason.

49|14|Updated Aug 27, 2025
One-click install
npx skills add https://github.com/NVIDIA/sop-monitoring-blueprints --skill sop-ft-orchestrate
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: sop-ft-orchestrate
Source: https://github.com/NVIDIA/sop-monitoring-blueprints/tree/main/agentic/sop-agentic-ft/plugins/sop-ft-orchestrate-plugin/skills/sop-ft-orchestrate
Command: npx skills add https://github.com/NVIDIA/sop-monitoring-blueprints --skill sop-ft-orchestrate

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires PyYAML, asyncpg, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the complex, multi-stage process of fine-tuning SOP monitoring models, reducing the manual effort required to coordinate data preparation, DDM and VLM training, evaluation, diagnosis, and iterative remediation.

Core Features & Use Cases

  • End-to-End Orchestration: Coordinates dataset import, data augmentation, DDM-Net training, Cosmos-Reason VLM fine-tuning, evaluation, root-cause analysis, and corrective iterations.
  • Autonomous Recovery: Applies configuration fixes based on RCA findings, manages independent DDM and VLM retry axes, and uses watchdogs to detect training failures, hangs, timeouts, and resource issues.
  • Reproducible Run Management: Maintains run state, phase status, iteration budgets, configuration snapshots, evaluation outputs, RCA reports, progress files, and safe code overrides.
  • Use Case: Given annotated training and evaluation datasets plus target accuracy thresholds, use this Skill to train an SOP monitoring pipeline and iteratively improve it until the configured success criteria are met or the iteration budget is exhausted.

Quick Start

Use the sop-ft-orchestrate skill with an inputs.yaml path or a natural-language request describing the dataset and desired SOP monitoring accuracy targets.

Frequently Asked Questions about sop-ft-orchestrate

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate SOP monitoring pipeline fine-tuning for vision-language models?

Automate SOP monitoring pipeline fine-tuning by orchestrating end-to-end workflows across data augmentation, DDM temporal segmentation, Cosmos-Reason VLM training, evaluation, and root-cause remediation. Configure YAML inputs with dataset paths and target accuracy thresholds to start autonomous iterative model improvement.

Can I use this orchestration skill to retry DDM-Net and VLM training independently?

Yes, this orchestration skill supports independent DDM-Net and VLM retry axes. It applies configuration fixes from root-cause analysis findings and uses watchdogs to detect training failures, hangs, timeouts, and resource issues for autonomous recovery.

What do I need to set up before running an end-to-end SOP model evaluation workflow?

Before running an SOP model evaluation workflow, you need annotated training and evaluation video datasets, configured training and evaluation services, GPU resources, YAML configuration files, and Python dependencies including PyYAML and asyncpg.

How does the iterative root-cause remediation process work for VLM training failures?

Iterative root-cause remediation works by analyzing evaluation outputs and RCA reports to apply configuration fixes automatically. The pipeline maintains run state and iteration budgets, continuing corrective iterations until target accuracy is met or the budget is exhausted.

What is the best way to manage reproducible run states for DDM temporal segmentation pipelines?

Manage reproducible run states for DDM temporal segmentation pipelines by maintaining configuration snapshots, phase status, evaluation outputs, and progress files. The orchestration skill uses watchdog execution and safe code overrides to ensure reproducible iterative model improvement.

Why does my SOP fine-tuning pipeline stop before reaching the target accuracy threshold?

Your SOP fine-tuning pipeline stops when the configured iteration budget is exhausted. The orchestration skill iteratively applies data augmentation and root-cause remediation until the desired accuracy thresholds are met or the maximum allowed iterations are reached.