deepstream-sop

Builds and debugs the DeepStream SOP inference microservice for VLM-based procedure compliance monitoring.

2|Updated Aug 20, 2026
One-click install
npx skills add https://github.com/atomicrajat/industry_safety_monitoring_system --skill deepstream-sop-atomicrajat
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: deepstream-sop
Source: https://github.com/atomicrajat/industry_safety_monitoring_system/tree/main/.claude/skills/deepstream-sop
Command: npx skills add https://github.com/atomicrajat/industry_safety_monitoring_system --skill deepstream-sop-atomicrajat

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Building a GPU-accelerated SOP compliance microservice involves coordinating DeepStream pipelines, Triton GEBD models, embedded vLLM inference, SSE streaming, Kafka output, and Basler camera support — with dozens of subtle ordering and configuration rules that are easy to get wrong. This Skill encodes the complete architecture, critical rules, and verification workflow so an AI assistant can generate, deploy, evaluate, and debug the service correctly. ## Core Features & Use Cases - Full microservice generation: Produces the FastAPI server, SOPProcessManager wiring, DeepStream pyservicemaker pipeline with DDM event-boundary detection, VLM classification via Cosmos Reason, SOP sequence checker, and Docker build files. - Evaluation and debugging workflow: Guides static validation, Docker build, service launch, API test suites, curl verification, and latency measurement (TTFC, C2C, camera chunk_e2e). - Critical rule enforcement: Encodes hard-won constraints such as VLM warmup before DDM, stream:true for live inputs, named-kwargs factories, and TensorRT stream synchronization. - Use Case: A factory engineer asks the assistant to verify whether operators perform assembly steps in order on a Basler camera feed; the Skill produces the correct chat-completions request and the underlying service configuration. ## Quick Start Ask the assistant to use the deepstream-sop skill to generate the SOP inference microservice scaffold following the example prompt in its references directory.

Frequently Asked Questions about deepstream-sop

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I send a Basler camera feed to the SOP chat-completions API?

Send a POST to /v1/chat/completions with an input_camera content item whose camera_id is the camera serial number, and set stream to true. Live sources return HTTP 400 if stream is false, and a small max_length_sec (under 5 seconds) keeps streaming responsive.

How does the DeepStream SOP microservice detect out-of-order assembly steps?

A DDM event-boundary model running through DeepStream and Triton segments video into chunks, an embedded vLLM instance with Cosmos Reason classifies the action in each chunk, and the SOP checker compares the sequence against the configured action list to flag missing or misordered steps.

Can I swap the VLM or GEBD model in the SOP pipeline?

Yes, both stages are model-agnostic. Set VLLM_MODEL_PATH to any HuggingFace ID or local path for the VLM stage, and replace the Triton model repository directory plus DDM_MODEL_PATH to swap the boundary detection model.

Why does the VLM warmup hang during service startup?

The VLM warmup requires exactly 3 frames passed as torch.zeros; Qwen3VL hangs when fewer than 3 frames are supplied. Warmup must also run before the DDM dummy pipeline, as enforced by the ModelInitializer ordering rule.

When should I not use the deepstream-sop skill?

Do not use it for generic DeepStream pipelines, plain object detection or tracking, NIM imports, or video summarization tasks. It is scoped specifically to the SOP inference microservice with GEBD chunking and VLM-based procedure compliance.