qwen-mm-plugins-omni-memory

Build and query persistent audio-visual memory for long videos with speaker-attributed dialogue and facts.

2.9k|185|Updated Jul 29, 2026
One-click install
npx skills add https://github.com/QwenLM/Qwen-MM-Plugins --skill qwen-mm-plugins-omni-memory-qwenlm
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: qwen-mm-plugins-omni-memory
Source: https://github.com/QwenLM/Qwen-MM-Plugins/tree/main/src/capabilities/omni-memory/skill
Command: npx skills add https://github.com/QwenLM/Qwen-MM-Plugins --skill qwen-mm-plugins-omni-memory-qwenlm

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires numpy, openai, and includes scripts (resource) components.

What problem does it solve? Long videos exceed what a single model request can hold, and re-watching a video for every question wastes time and API calls. This Skill builds a persistent, queryable memory of a video's people, dialogue, events, and facts so questions are answered in milliseconds without re-uploading. ## Core Features & Use Cases - Stateful memory building: Slice long videos into 30-second windows and extract people, speaker-attributed utterances, paralinguistics, acoustic events, and semantic facts via an omni model, with resumable and appendable builds. - Hybrid retrieval: Query by person, dialogue content, exact fact keys, time ranges, or open-ended hybrid search across episodic and semantic containers. - Selective replay: Re-watch specific source clips with audio when a detail was not captured in the text record. - Use Case: Given a 2-hour meeting recording, build a memory once, then ask "What did David say about the budget?" or "What did they agree on in the end?" and get answers with speaker attribution and timestamps. ## Quick Start Ask the agent to check the memory status of your video file and build a memory for it, then ask your question about the video's content.

Frequently Asked Questions about qwen-mm-plugins-omni-memory

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build a searchable memory for a long video?

Run the build_memory.py script with the video path and an omni model, which slices the video into 30-second windows and extracts people, dialogue, and facts statefully. The memory is saved next to the video and can be resumed or appended to later.

How do I find what a specific person said in a video?

Use get_person_dialogue with the person_id to retrieve every line that person spoke, in order, with timestamps and paralinguistics. If you only know the name, get_memory_overview maps names to person_ids, including heard-as aliases for unnamed speakers.

When should I build a memory instead of just watching the video?

Videos under about 10 minutes are cheaper to answer with a single watch_and_answer call. Build a memory for videos over 30 minutes, or whenever you expect several questions about the same video, since a memory is paid for once and answers for free.

Can I combine multiple video files into one continuous memory?

Yes, pass the same --namespace to multiple videos and they become one continuous memory with stable person_ids, accumulating facts, and a stitched timeline. Segments must be added in chronological order and run serially.

What happens if a memory build is interrupted?

An interrupted build still finalizes the library, so it looks complete but answers from partial data. Run get_memory_status to detect truncation, then rerun the build script with --mode resume to continue from the last ingested clip.

What dependencies does the video memory build require?

The build requires Python 3.10+, pip, ffmpeg and ffprobe on PATH, and a DASHSCOPE_API_KEY. The numpy and openai packages are installed automatically if missing, and the endpoint can be overridden with DASHSCOPE_BASE_URL.