qwen-mm-plugins-omni-video2note

Converts local tutorial and screen-recording videos into illustrated PDF notes using Omni audio-video understanding.

2.9k|185|Updated Jul 29, 2026
One-click install
npx skills add https://github.com/QwenLM/Qwen-MM-Plugins --skill qwen-mm-plugins-omni-video2note-qwenlm
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: qwen-mm-plugins-omni-video2note
Source: https://github.com/QwenLM/Qwen-MM-Plugins/tree/main/src/capabilities/omni-video2note/skill
Command: npx skills add https://github.com/QwenLM/Qwen-MM-Plugins --skill qwen-mm-plugins-omni-video2note-qwenlm

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Turning long tutorial videos, lessons, or screen recordings into readable study notes normally requires manual watching, pausing, screenshotting, and writing. This Skill automates that entire pipeline by understanding the video's speech, actions, and on-screen text, then producing a searchable, illustrated PDF note. ## Core Features & Use Cases - Omni-based video understanding: Analyzes actions, speech, visible text, and timestamps across chunked long videos using a single Omni model. - Illustrated PDF generation: Extracts screenshots near step timestamps locally and renders a searchable PDF note with visual evidence. - Configurable quality and budget: quality_profile controls chunk duration and sampling, while time_budget_seconds bounds model request time. - Graceful degradation: Falls back to a simpler document from partial evidence, omits failed screenshots, and returns structured failures instead of fabricated notes. - Use Case: A student records a 40-minute software tutorial and asks the agent to convert it into a PDF note; the tool transcribes key steps, captures screenshots at each step, and outputs a single illustrated document. ## Quick Start Use the omni video2note skill to convert my local file /videos/python-tutorial.mp4 into an illustrated PDF note saved at /notes/python-tutorial.pdf.

Frequently Asked Questions about qwen-mm-plugins-omni-video2note

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert a video tutorial into a PDF note?

Call the omni_video2note_create tool with an absolute local video_path and a .pdf output_path. The tool understands the video with Omni, extracts screenshots near step timestamps, and renders a searchable illustrated PDF.

How to generate notes from long videos with speech?

Long videos are split into chunks and processed by the Omni model, which captures speech, actions, and visible text with timestamps. The quality_profile parameter controls chunk duration and local sampling settings.

Can I process a video without its audio track?

Yes, set no_asr=true to ignore audio entirely. Conversely, require_asr=true mandates an audio track and includes speech in the Omni understanding; the two options are mutually exclusive.

What happens if video understanding fails partway through?

The tool builds a simpler document from successfully understood evidence and omits failed screenshots, with warnings describing degraded results. If all attempts fail, it returns a structured failure instead of inventing a note.

Does the tool need an API key in its arguments?

No, credentials and endpoint come from the shared configuration file or environment variables. You should never place a key in tool arguments, and dry_run=true validates inputs and resolved configuration without model calls.