vss-summarize-video

Summarize recorded video clips via the LVS microservice with a VLM fallback.

2|Updated Aug 20, 2026
One-click install
npx skills add https://github.com/atomicrajat/industry_safety_monitoring_system --skill vss-summarize-video-atomicrajat
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: vss-summarize-video
Source: https://github.com/atomicrajat/industry_safety_monitoring_system/tree/main/.claude/skills/vss-summarize-video
Command: npx skills add https://github.com/atomicrajat/industry_safety_monitoring_system --skill vss-summarize-video-atomicrajat

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) and assets (resource) components.

What problem does it solve? Turning a recorded video clip into a concise narrative summary with timestamped events normally requires manual review or custom VLM prompting; this Skill routes the request to the NVIDIA VSS long-video-summarization (LVS) microservice with human-in-the-loop scenario/event targeting, or falls back to a direct VLM call when the service is unavailable. ## Core Features & Use Cases - Availability-based routing: Probes /v1/ready on the LVS service (port 38111) and chooses the LVS microservice path or the VLM /v1/chat/completions fallback automatically. - HITL-gated summarization: Collects scenario, events, and optional objects_of_interest from the user before calling POST /v1/summarize, with a sanctioned defaults opt-in for autonomous runs. - Verbatim output rendering: Returns the service's video_summary and timestamped events without paraphrasing, including a fallback warning when only the VLM path was used. - Use Case: An operator asks to summarize an uploaded warehouse video with scenario 'warehouse monitoring' and events like 'boxes falling' and 'forklift stuck'; the Skill fetches the clip URL via VIOS, calls the LVS service once, and renders the summary plus event list. ## Quick Start Ask the agent to summarize a recorded video clip, providing a scenario and the events you want surfaced, and it will probe the LVS service and produce the summary.

Frequently Asked Questions about vss-summarize-video

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I summarize a recorded video with the VSS LVS microservice?

Probe the LVS service readiness endpoint, collect a scenario and events list from the user, then POST to /v1/summarize with the clip URL, model id, and chunking parameters. The response content is a JSON string containing video_summary and timestamped events.

What happens if the video summarization service is not running?

The Skill falls back to calling the VLM directly via /v1/chat/completions with a fixed default prompt, and prepends a warning note to the output. The fallback produces lower-quality summaries without scenario or events targeting.

Can this skill generate incident reports or caption live RTSP streams?

No. Report generation belongs to the vss-generate-video-report skill and live RTSP captioning belongs to vss-deploy-dense-captioning. This skill only summarizes one recorded video clip per request.

Why does /v1/ready return 503 for the video summarization service?

HTTP 503 means the service is still warming up or a dependency such as RT-VLM or Elasticsearch is unreachable. Retry for up to about 30 seconds; readiness is determined solely by the HTTP status code, never the response body.

Why does the LVS summarize request return HTTP 422?

A 422 indicates a schema validation failure, usually a missing required field such as model, scenario, or events, or an extra field not in the OpenAPI schema. Check the request body against the API reference before retrying.

Which VLM model id should I use for video summarization?

Use the exact id advertised by the RT-VLM /v1/models endpoint, by default nim_nvidia_cosmos3-nano-reasoner_bf16-final. Do not substitute the friendly name nvidia/cosmos3-nano-reasoner unless the endpoint advertises it.