qwen-mm-plugins-omni-skill-creator

Create Agent Skills from teaching videos and screen recordings with timestamped perception and evaluation.

2.9k|185|Updated Jul 29, 2026
One-click install
npx skills add https://github.com/QwenLM/Qwen-MM-Plugins --skill qwen-mm-plugins-omni-skill-creator-qwenlm
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: qwen-mm-plugins-omni-skill-creator
Source: https://github.com/QwenLM/Qwen-MM-Plugins/tree/main/src/capabilities/omni-skill-creator/skill
Command: npx skills add https://github.com/QwenLM/Qwen-MM-Plugins --skill qwen-mm-plugins-omni-skill-creator-qwenlm

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve? Turning a teaching video, tutorial, or screen recording into a reusable Agent Skill normally requires manually transcribing steps, extracting frames and clips, and writing instructions from scratch. This Skill automates that conversion by perceiving the recording as a time-aligned audio-visual timeline and producing a complete SKILL.md with multimodal assets and test cases. ## Core Features & Use Cases - Video Perception: Reads a teaching video as one audio-visual timeline, building a timestamped event log (video_events.md) that captures steps, tools used, and presenter caveats. - Multimodal Asset Management: Plans, extracts, annotates, and registers frames, clips, and audio segments with an asset_manifest.json so consumers can verify their own results against the demonstration. - Three-Layer Verification: Runs structural validation (L1), asset pre-checks like dedup and orphan detection (L2), and single-arm task evaluation with executor and grader subagents (L3), aggregated into benchmark reports. - Description Optimization: Runs an optimization loop that rewrites the skill's description field against labeled trigger queries to improve triggering accuracy. - Use Case: A user records themselves configuring a dashboard in a BI tool and says "turn this tutorial into a skill." The Skill perceives the recording, drafts the SKILL.md, extracts key frames, runs test prompts, and delivers a validated, reusable skill. ## Quick Start Use the omni skill creator to turn this screen recording into a reusable skill with extracted frames and test cases.

Frequently Asked Questions about qwen-mm-plugins-omni-skill-creator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I turn a tutorial video into an Agent Skill?

Provide the teaching video or screen recording and state the intent, such as "turn this tutorial into a skill." The Skill perceives the recording into a timestamped event log, drafts a SKILL.md, extracts multimodal assets, and validates the result with test cases.

What is the three-layer eval verification framework for skills?

L1 runs structural validation via the validate_skill tool, L2 runs asset pre-checks like frame and audio deduplication, and L3 runs task evaluations with executor and grader subagents. L3 can be disabled via run_l3 when executing the task has real consequences.

Can I create a skill from a video without running evaluations?

Yes. Set run_l3 to false in evals/evals.json to stop after L1 and L2 checks, or tell the agent you do not need evaluations. The skill then ships as source-grounded with its own verification steps for the first real run.

How does skill description optimization improve triggering?

The run_loop.py script evaluates the description against 20 labeled trigger queries, splitting them into train and test sets and iterating up to 5 times. It requires API access to the model powering the session through an OpenAI-compatible endpoint.

What are the limitations of video-derived skills?

Skills derived from videos of GUI applications may not be executable in environments lacking that application, and L3 evaluation cannot measure how much the skill adds over a bare model. Such skills ship as source-grounded rather than execution-verified.