ai-multimodal

Process and generate audio, image, video, and document content via the Google Gemini API.

Updated Jan 21, 2026
One-click install
npx skills add https://github.com/HsnSaboor/open-engineer --skill ai-multimodal-hsnsaboor
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ai-multimodal
Source: https://github.com/HsnSaboor/open-engineer/tree/main/src/skills/bundled/samhvw8-ai-multimodal
Command: npx skills add https://github.com/HsnSaboor/open-engineer --skill ai-multimodal-hsnsaboor

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires google-genai, python-dotenv, pillow, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill provides a unified interface to process and generate content across various media types including audio, images, video, and documents, leveraging the power of Google Gemini's multimodal API.

Core Features & Use Cases

  • Multimedia Understanding: Transcribe audio/video, analyze images, extract data from PDFs, and answer questions about visual content.
  • Content Generation: Create images from text descriptions.
  • Use Case: Automatically transcribe a 2-hour meeting recording, summarize the key discussion points with timestamps, and generate a representative image for the meeting's topic.

Quick Start

Use the ai-multimodal skill to transcribe the attached audio file 'meeting_recording.mp3'.

Frequently Asked Questions about ai-multimodal

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I transcribe audio and extract data from a PDF using a multimodal API?

Audio transcription and PDF data extraction are performed by sending files to the Google Gemini API, which processes cross-media content to generate text outputs from your multimedia inputs.

Can I generate images from text descriptions and analyze video content with the same tool?

Text-to-image generation and video analysis are supported through the multimodal API, enabling you to create images from text descriptions and answer questions about visual content within a single workflow.

Do I need a Google AI Studio API key to process multimedia content?

Yes, an API key is required. You must configure your environment for either Google AI Studio or Vertex AI to authenticate requests before processing audio, images, video, and documents.

What is the best way to analyze images and summarize meeting recordings together?

The best way to analyze images and summarize recordings is using a unified multimodal interface that transcribes audio, extracts key discussion points with timestamps, and generates representative images.

What Python dependencies are required for multimodal video analysis and image generation?

Multimodal video analysis and image generation require specific Python dependencies, including google-genai for API interactions, python-dotenv for environment configuration, and pillow for image processing.