gemini-multimodal

Process images, video, audio, and PDFs via the Gemini API.

1|Updated Mar 11, 2026
One-click install
npx skills add https://github.com/FutureAtoms/claude-skills-backup --skill gemini-multimodal
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: gemini-multimodal
Source: https://github.com/FutureAtoms/claude-skills-backup/tree/main/gemini-multimodal
Command: npx skills add https://github.com/FutureAtoms/claude-skills-backup --skill gemini-multimodal

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires google-generativeai, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill streamlines the analysis and processing of various media types (images, video, audio, PDFs) by leveraging the Gemini API, reducing the need for manual inspection and data extraction.

Core Features & Use Cases

  • Multimodal Input: Accepts images, video, audio, and PDF files for analysis.
  • Specific Tasks: Supports object detection, image segmentation, video summarization, audio transcription, and structured data extraction from PDFs.
  • Use Case: Upload a product image and ask the AI to identify all visible products and their bounding boxes, or provide a meeting recording and get a summarized transcript with key discussion points.

Quick Start

Use the gemini-multimodal skill to summarize the key points in the attached document 'report.pdf'.

Frequently Asked Questions about gemini-multimodal

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured data from a PDF using the Gemini API?

To extract structured data from a PDF using the Gemini API, you upload the file via API or inline data, enabling the model to process the document and return organized information without manual inspection.

Can I transcribe audio and summarize video files with multimodal AI?

Yes, you can transcribe audio and summarize video files with multimodal AI by uploading media to the Gemini API, which processes the inputs to generate transcripts and key discussion point summaries.

How do I detect objects and get bounding boxes in an image?

Detecting objects and getting bounding boxes in an image involves uploading the picture to the Gemini API and prompting it to identify visible products, returning their locations within the frame.

Does the google-generativeai dependency support inline data uploads for image analysis?

Yes, the google-generativeai dependency supports inline data and API file uploads for image analysis, allowing you to pass media directly for multimodal processing.

What are the token cost estimations when processing large video and audio files?

Token cost estimations when processing large video and audio files are calculated by the Gemini API based on media type, helping you anticipate resource usage before running extraction tasks.