whisper

Transcribe spoken audio into text across 99 languages.

247|22|Updated Dec 11, 2024
One-click install
npx skills add https://github.com/graniet/kheish --skill whisper-graniet
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: whisper
Source: https://github.com/graniet/kheish/tree/main/skills/mlops/models/whisper
Command: npx skills add https://github.com/graniet/kheish --skill whisper-graniet

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Manual transcription of audio content is time-consuming, costly, and often fails with multilingual speech, noisy audio, or large volumes of content, making it difficult to turn podcasts, meetings, and interviews into usable, searchable text.

Core Features & Use Cases

  • Multilingual Speech Recognition: Accurately transcribe audio in 99 languages, including low-resource languages, with support for multiple model sizes to balance speed and accuracy.
  • Translation to English: Automatically translate non-English audio recordings into English text for global accessibility.
  • Use Case: A content team can use this skill to transcribe dozens of podcast episodes, generate subtitles, and create meeting notes from recorded calls without manual effort.

Quick Start

Use the whisper skill to transcribe the attached audio file 'team-standup.mp3' into English text with word-level timestamps.

Frequently Asked Questions about whisper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I transcribe audio to text in multiple languages?

Audio transcription to text in multiple languages is handled by converting spoken audio content into accurate text across 99 supported languages. You can transcribe podcasts, meetings, and interviews, with configurable models to balance speed and accuracy.

Can I translate non-English speech to English text automatically?

Yes, translating non-English speech to English text is supported natively. The skill automatically translates non-English audio recordings into English text, enabling global accessibility for multilingual audio processing and translation tasks.

Do I need openai-whisper, transformers, and torch to run speech-to-text transcription?

Yes, you need openai-whisper, transformers, and torch dependencies to run speech-to-text transcription. These libraries power the configurable transcription models that allow adjustable speed, accuracy, and language settings.

What is the best way to generate meeting notes from recorded calls?

Generating meeting notes from recorded calls is done by processing the audio file through the transcription skill. It converts spoken audio content into searchable text, allowing teams to create notes from recorded calls without manual effort.

Does this speech-to-text skill support podcast transcription with word-level timestamps?

Yes, podcast transcription with word-level timestamps is supported. The skill transcribes attached audio files into text with configurable settings, allowing content teams to generate subtitles and transcribe dozens of podcast episodes efficiently.

Are there limitations when transcribing noisy audio in low-resource languages?

Transcription accuracy for noisy audio or low-resource languages depends on the selected model size. The skill offers multiple model sizes to balance speed and accuracy, but users should configure settings appropriately to handle challenging audio conditions.