ai-multimodal

Analyze and generate images, audio, video, and documents via Gemini API and Imagen 4.

54|Updated Jan 21, 2026
One-click install
npx skills add https://github.com/haposoft/cafekit --skill ai-multimodal-haposoft
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ai-multimodal
Source: https://github.com/haposoft/cafekit/tree/main/packages/spec/src/claude/skills/ai-multimodal
Command: npx skills add https://github.com/haposoft/cafekit --skill ai-multimodal-haposoft

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires google-genai, pillow, requests, dotenv, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill solves the challenge of manually analyzing and generating images, audio, videos, and documentation by automating these tasks using AI-powered models.

Core Features & Use Cases

  • Multimodal Analysis: Analyze images, audio, video, and documentation using state-of-the-art models like Gemini.
  • Image Generation: Create high-quality images based on prompts, using models like Imagen 4 or Nano Banana.
  • Audio Analysis and Generation: Extract text from audio files, transcribe speeches, and generate audio using different voices and styles.
  • Video Analysis and Generation: Summarize, transcribe, and analyze videos, and generate videos with custom parameters.
  • Document Conversion: Convert various document formats (PDF, Office, HTML) to Markdown.
  • Use Case: If you have a meeting transcript in audio format and you need to extract key points, this Skill can transcribe the audio and generate a summary.

Quick Start

To analyze an image, run the command: analyze <image-file>.

Frequently Asked Questions about ai-multimodal

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I transcribe audio from a meeting recording and extract key points?

To transcribe audio and extract key points, you can use multimodal analysis to process audio files with the Gemini API. The Skill transcribes the speech content and generates a concise text summary of the extracted key points automatically.

Can I convert PDF and Office documents to Markdown format automatically?

Yes, you can convert PDF, Office, and HTML documents to Markdown format automatically. The document conversion feature processes various file formats and outputs structured Markdown text, simplifying documentation workflows without manual formatting.

How do I generate images from text prompts using Imagen 4?

Generating images from text prompts requires the Imagen 4 or Nano Banana models. The Skill automates image generation by sending your text prompt to the model via the google-genai library, creating high-quality visual outputs based on your description.

Does video analysis support transcription and summarization?

Video analysis fully supports transcription and summarization. Using the Gemini API, the Skill analyzes video content to extract spoken audio into text and generates a concise summary of the visual and audio information contained in the video.

What dependencies do I need to run multimodal image and video analysis?

To run multimodal image and video analysis, you need the google-genai, pillow, requests, and dotenv dependencies. These libraries handle API communication with Gemini, file handling, and environment variable management for processing multimedia content.