ai-multimodal

Orchestrate multimodal analysis and content generation via Google's Gemini API.

Updated Nov 24, 2025
One-click install
npx skills add https://github.com/tntdev21/3d --skill ai-multimodal-tntdev21
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ai-multimodal
Source: https://github.com/tntdev21/3d/tree/main/.claude/skills/ai-multimodal
Command: npx skills add https://github.com/tntdev21/3d --skill ai-multimodal-tntdev21

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires google-genai, python-dotenv, Pillow, pypdf, python-docx, docx2pdf, markdown, and includes references (resource) and scripts (resource) components.

What problem does it solve?

This Skill enables end-to-end multimodal workflows: analyzing and transcribing audio, understanding and describing images, processing PDFs, extracting structured data, and generating images/videos from prompts using Google Gemini's multimodal models.

Core Features & Use Cases

  • Media Processing: Analyze, transcribe, summarize audio; caption and describe images; perform OCR and document understanding.
  • Content Generation: Generate images with Imagen 4 variants; create videos with Veo 3; leverage Gemini 3/2.5 for advanced reasoning.
  • Model Coverage: Supports Imagen 4 for image generation, Veo 3 for video, Gemini 3/2.5 for analysis.

Quick Start

Set GEMINI_API_KEY, install dependencies, then run:

  • Analyze media: python scripts/gemini_batch_process.py --files <files> --task analyze
  • Generate content: python scripts/gemini_batch_process.py --task generate --prompt "<text>" --model imagen-4.0-generate-001

Frequently Asked Questions about ai-multimodal

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I transcribe and analyze audio files with timestamps using multimodal AI?

Multimodal audio transcription extracts speech with temporal markers and analyzes sound content using Gemini's API. Run `python scripts/gemini_batch_process.py --files <audio> --task analyze` to transcribe with timestamps, extract speaker intent, and perform music or sound analysis in one workflow.

Can I extract text and data from PDFs and Word documents automatically?

Yes. This Skill processes PDFs and DOCX files through OCR, form extraction, and structured data retrieval using Gemini's document understanding. Dependencies include pypdf and python-docx for format handling; run batch processing to extract and convert documents to searchable text.

What's the best way to generate images and videos from text prompts?

Use Imagen 4 for image generation and Veo 3 for video creation via Gemini's multimodal API. Set `IMAGE_GEN_MODEL` and `VIDEO_GEN_MODEL` environment variables, then run `python scripts/gemini_batch_process.py --task generate --prompt "<text>" --model imagen-4.0-generate-001` to create media at scale.

Does this support batch processing of multiple media files?

Yes. The `gemini_batch_process.py` script handles batch analysis and generation across audio, images, video, and documents. It manages token/context limits up to 2M tokens, applies media optimization, and provides error handling for large-scale workflows.

Can I perform object detection, captioning, and visual question answering on images?

Yes. Gemini's multimodal models enable image captioning, object detection, segmentation, and visual question answering. Use batch processing to analyze multiple images, extract visual content, and generate descriptive captions or structured metadata.

What models does this Skill support and how do I choose between them?

Supported models include Imagen 4 for images, Veo 3 for video, and Gemini 3/2.5 for analysis. Set defaults via environment variables (`GEMINI_MODEL`, `IMAGE_GEN_MODEL`, `VIDEO_GEN_MODEL`) for backward compatibility, or specify per-task in batch processing commands.