skills.rest
NVIDIA-AI-Blueprints
NVIDIA-AI-BlueprintsOFFICIAL
Explore all skills by this author →
WebsiteGitHub

rt-vlm

Deploys the VLM service for real-time video captioning and incident detection.

1.8k|370|Updated Oct 22, 2024
Search Tags:#video#real-time#alerts#captioning#microservice#NVIDIA
One-click install
npx skills add https://github.com/NVIDIA-AI-Blueprints/video-search-and-summarization --skill rt-vlm
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: rt-vlm
Source: https://github.com/NVIDIA-AI-Blueprints/video-search-and-summarization/tree/main/skills/rt-vlm
Command: npx skills add https://github.com/NVIDIA-AI-Blueprints/video-search-and-summarization --skill rt-vlm

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill enables users to generate dense captions and alerts for video streams and stored files, facilitating automated scene understanding and monitoring.

Core Features & Use Cases

  • Dense captioning for stored videos and live RTSP streams to summarize scene content.
  • Alert generation based on prompt design to detect anomalies or specific events in videos.
  • Use Case: Automatically process warehouse surveillance footage to produce real-time summaries and flag incidents such as missing safety gear or safety violations.

Quick Start

Use the rt-vlm skill to upload a video file, generate captions for each 10-second segment, and view streaming results with a natural language instruction.

Frequently Asked Questions about rt-vlm

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate real-time captions for RTSP video streams?▼

Real-time captioning for RTSP streams is generated by deploying the NVIDIA RT-VLM microservice, which processes live video feeds to produce dense scene summaries and automated alerts based on natural language instructions.

Can I use video captioning to detect safety violations in surveillance footage?▼

Yes, video captioning can detect safety violations in surveillance footage by configuring the alert generation feature with specific prompts to flag incidents like missing safety gear in real-time or stored warehouse video files.

How do I set up the NVIDIA RT-VLM microservice for video analysis?▼

Setting up the NVIDIA RT-VLM microservice involves configuring the environment, registering live video streams, and setting up remote model configurations to enable automated scene understanding and dense captioning for stored and streaming videos.

What is the best way to process video files for automated scene understanding?▼

The best way to process video files for automated scene understanding is using the RT-VLM microservice, which segments videos into 10-second intervals to generate dense captions and event-specific alerts based on your defined prompts.

Does the NVIDIA VLM microservice support both stored videos and live streams?▼

Yes, the NVIDIA VLM microservice supports both stored video files and live RTSP streams, allowing users to generate dense captions and real-time alerts for automated monitoring across various surveillance applications.

Related Skills

Explore More Content & Communication Skills→
olibartfastolibartfast

amc-run-rtsp-calibration

Automate camera calibration from live RTSP streams via the AutoMagicCalib REST API.

Community
Advanced
lloydchanglloydchang
2

incident-triage-automator

Aggregate alerts from monitoring systems and compute incident severity.

Community
Advanced
NVIDIANVIDIA
189

deepstream-import-vision-model

Automate object detection model integration into NVIDIA DeepStream pipelines.

Official
Advanced
ragnarokhaaragnarokhaa
4

segment-anything-model

Automate image segmentation and object detection with the Segment Anything Model.

Community
Advanced