ai-multimodal

Process audio, images, videos, and documents with Gemini API for transcription, analysis, and captioning.

15|27|Updated Dec 4, 2025
One-click install
npx skills add https://github.com/kevinnguyen271090/claudekit-engineering --skill ai-multimodal-kevinnguyen271090
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ai-multimodal
Source: https://github.com/kevinnguyen271090/claudekit-engineering/tree/main/ai-multimodal
Command: npx skills add https://github.com/kevinnguyen271090/claudekit-engineering --skill ai-multimodal-kevinnguyen271090

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solves?

This Skill automates the complex process of processing and analyzing diverse multimodal data (images, video, audio, documents) using the Gemini API and other AI tools. It eliminates manual data extraction, media optimization challenges, and helps users gain deeper insights from complex content for advanced AI applications.

Core Features & Use Cases

  • Vision Understanding: Analyze images and video frames to extract objects, text, sentiment, and other visual insights using Gemini's capabilities.
  • Audio Processing: Transcribe speech, identify speakers, and analyze audio content for key information.
  • Document Conversion & Optimization: Convert various document types for AI consumption and optimize media files (images, video) for efficient processing.
  • Use Case: Analyze a customer feedback video. This Skill can extract key frames for visual analysis, transcribe the audio for sentiment analysis, and then synthesize these multimodal insights to provide a comprehensive report on customer experience.

Quick Start

Analyze the attached image 'product_review.jpg' to extract key objects, text, and overall sentiment using the Gemini API.

Frequently Asked Questions about ai-multimodal

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I transcribe and analyze audio using the Gemini API?

Audio transcription with Gemini API converts speech to text and extracts key information from audio files up to 9.5 hours long. The Skill handles transcription, speaker identification, and content analysis in a single workflow, returning structured text or JSON output for downstream processing.

Can I extract text and objects from images and videos with Gemini?

Yes, Gemini's vision capabilities extract objects, text (OCR), and visual insights from images and video frames. This Skill automates frame extraction, analysis, and synthesis of visual data across batches, supporting sentiment detection and object segmentation in a single workflow.

What document formats can I process for AI analysis?

This Skill converts and optimizes various document types for Gemini API consumption, handling format conversion and media optimization. Outputs are generated in text, JSON, CSV, or Markdown formats, enabling direct ingestion into AI pipelines without manual preprocessing.

How do I analyze multimodal data—combining audio, video, and images—in one workflow?

Multimodal analysis with Gemini processes audio transcription, video frame extraction, and image analysis simultaneously to synthesize cross-modal insights. This Skill enforces media constraints (9.5 hours audio, 6 hours video) and returns integrated reports combining all modalities.

What are the file size and duration limits when processing media with Gemini?

Gemini API enforces media length constraints: audio is limited to 9.5 hours and video to 6 hours. This Skill respects these boundaries during batch processing; exceeding limits requires splitting content before submission to the API.

Can I use the File API and inline inputs together for media processing?

Yes, this Skill supports both File API uploads and inline media inputs for flexible integration. File API suits large batches and persistent storage; inline inputs work for real-time requests, enabling hybrid workflows tailored to your processing scale.