gemini-omni

Generate and conversationally edit short videos with Google Gemini Omni Flash.

55.1k|6.9k|Updated Mar 29, 2026
One-click install
npx skills add https://github.com/calesthio/OpenMontage --skill gemini-omni
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: gemini-omni
Source: https://github.com/calesthio/OpenMontage/tree/main/.agents/skills/gemini-omni
Command: npx skills add https://github.com/calesthio/OpenMontage --skill gemini-omni

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Iterating on AI-generated video normally means regenerating the entire clip from scratch, losing everything that already worked. This Skill wraps Google Gemini Omni Flash so you can generate 3-10 second 720p clips with synthesized audio and then refine them conversationally — editing only what you describe while everything else stays the same.

Core Features & Use Cases

  • Stateful conversational editing: Each generation returns an interaction_id; pass it back as previous_interaction_id with a short edit prompt (e.g., "Make the phone invisible. Keep everything else the same.") to refine the same clip in layers.
  • Reference-image binding: Attach local images and bind them to roles in the prompt with <FIRST_FRAME> and <IMAGE_REF_N> tags for consistent characters, products, or styles.
  • Timecoded beats and on-screen text: Schedule multi-beat scenes with [0-3s]-style timecodes and render timed on-screen text, with automatically synthesized audio directed via the prompt.
  • Use Case: Generate a product demo clip, then in follow-up turns change the lighting, swap the on-screen text, and add a cat jumping onto the sofa — all without regenerating the base footage.

Quick Start

Ask the agent to generate a 6-second 720p clip of your scene using gemini_omni_video, then follow up with a short edit instruction referencing the returned interaction ID to refine it.

Frequently Asked Questions about gemini-omni

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I edit an AI-generated video without regenerating it?

Generate the base clip with gemini_omni_video, which returns an interaction_id. Pass that ID back as previous_interaction_id with operation edit_video and a short prompt describing only the change, ending with "Keep everything else the same."

How do I use reference images in Gemini Omni video generation?

Pass local images via reference_image_paths, then bind them to roles inside the prompt using <IMAGE_REF_N> tags indexed from 0 in the order supplied. Use <FIRST_FRAME> to make an image the opening frame of the clip.

What are the output limits of Gemini Omni Flash?

Output is limited to 3-10 second clips at 720p and 24fps in MP4 format with audio, in 16:9 or 9:16 aspect ratio. There is no seed, negative prompt, temperature, or video extension support, and all output carries a SynthID watermark.

Can I edit an existing uploaded video with Gemini Omni?

Yes, pass input_video_path instead of previous_interaction_id and the tool uploads the video via the Files API for editing. This is unavailable in the EEA, Switzerland, and the UK, though editing generated videos works everywhere.

Why did my conversational edit fail to apply to the previous video?

Editing via previous_interaction_id only works if the prior call stored the interaction server-side, which is the default. If store was set to false on the original generation, the interaction state is gone and the clip cannot be edited.

When should I use Seedance or Veo instead of Gemini Omni?

Use Seedance 2.0 for one-shot cinematic hero clips and veo_video for first/last-frame interpolation. Gemini Omni is the right choice for iterative conversational editing, on-screen text, and reference-image-bound subjects in clips under 10 seconds.