monitor

Monitor submitted compute jobs and report their execution status changes.

3.4k|535|Updated Apr 23, 2024
One-click install
npx skills add https://github.com/NVIDIA/Model-Optimizer --skill monitor-nvidia
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: monitor
Source: https://github.com/NVIDIA/Model-Optimizer/tree/main/.agents/skills/monitor
Command: npx skills add https://github.com/NVIDIA/Model-Optimizer --skill monitor-nvidia

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps users track long-running model optimization jobs by monitoring SLURM, NEL, and launcher workflows so they can quickly understand job progress and completion states.

Core Features & Use Cases

  • Job Status Monitoring: Checks submitted PTQ, evaluation, deployment, and raw SLURM jobs using the appropriate status commands and state vocabularies.
  • Persistent Job Tracking: Maintains per-session job registries, monitors state changes, and removes completed jobs automatically.
  • Failure Diagnosis Support: Identifies failed jobs and guides inspection of logs and execution details for troubleshooting optimization workflows.

Quick Start

Ask the monitor skill to check the status of my submitted model optimization job and report any progress changes.

Frequently Asked Questions about monitor

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I track SLURM job progress for long-running model optimization tasks?

Track SLURM job progress by polling execution status commands and maintaining a per-session job registry that detects state changes and reports terminal states for model optimization workflows.

Can I monitor PTQ quantization jobs and evaluation workflows on NEL clusters?

Yes, you can monitor PTQ quantization jobs and evaluation workflows on NEL clusters by checking submitted jobs using appropriate status commands and state vocabularies to identify execution progress and completion states.

What is the best way to check if a submitted deployment job has failed or completed?

Check if a submitted deployment job has failed or completed by detecting terminal states through status polling, which automatically removes completed jobs and identifies failed ones for log inspection and troubleshooting.

How does persistent job tracking work for SLURM evaluation workflows?

Persistent job tracking for SLURM evaluation workflows works by maintaining per-session job registries that monitor state changes, automatically removing completed jobs and guiding inspection of logs for failed optimization tasks.

Why does my SLURM job monitoring not report execution status changes instantly?

SLURM job monitoring might not report execution status changes instantly if status polling intervals are misconfigured or the job registry lacks proper state vocabulary mapping for the specific launcher workflows being tracked.

Do I need a job registry to monitor SLURM deployment tasks?

Yes, you need a job registry to monitor SLURM deployment tasks because it maintains per-session tracking, detects state changes, and enables terminal state detection required for accurate failure reporting and progress monitoring.