What problem does it solve?
The ai-multimodal skill provides a unified interface to analyze and generate multimedia content by leveraging Google Gemini's multimodal capabilities, enabling automated workflow tasks across audio, image, video, and document data.
Core Features & Use Cases
- Audio: transcription with timestamps, summarization, speech understanding, and speaker detection.
- Vision: image captioning, object detection, OCR, visual question answering, segmentation, and multi-image comparison.
- Video: scene detection, Q&A, temporal analysis, YouTube URL processing, and long-format processing.
- Documents: PDF table and form extraction, document understanding, and structured data output.
- Image generation and editing: text-to-image generation, style transfer, composition of multiple images, and iterative refinement for polished outputs.
- Use Case: Build AI assistants that analyze media, automate asset generation, and streamline media workflows from raw media to ready-to-use insights.
Quick Start
Set GEMINI_API_KEY and install the google-genai package, then run one of the included scripts (e.g., gemini_batch_process.py or document_converter.py) to process a sample audio, image, video, or PDF file.