groq-inference

Run low-latency LLM inference and multimodal processing via the GROQ API.

28|3|Updated Dec 10, 2025
One-click install
npx skills add https://github.com/ScientiaCapital/skills --skill groq-inference
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: groq-inference
Source: https://github.com/ScientiaCapital/skills/tree/main/active/groq-inference-skill
Command: npx skills add https://github.com/ScientiaCapital/skills --skill groq-inference

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

GROQ-based ultra-fast LLM inference enables real-time AI capabilities across chat, vision, and audio workflows without reliance on external OpenAI APIs.

Core Features & Use Cases

  • Real-time chat inference with GROQ models for low latency requirements.
  • Vision, OCR, STT, TTS, and tool-calling workflows in end-to-end pipelines.
  • Reasoning and multi-model orchestration for responsive AI agents.

Quick Start

Configure GROQ_API_KEY in your environment and run a basic chat example to observe near-instant responses.

Frequently Asked Questions about groq-inference

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run ultra-fast LLM inference for real-time chat without OpenAI dependencies?

Ultra-fast LLM inference for real-time chat without OpenAI dependencies is achieved by configuring the GROQ_API_KEY in your environment and executing a basic chat request. This delivers near-instant responses for latency-critical applications.

Can I use GROQ inference for multimodal workflows like vision, OCR, and TTS?

GROQ inference supports multimodal workflows including vision, OCR, STT, and TTS. It processes these inputs in end-to-end pipelines, enabling comprehensive multimodal analysis and voice-enabled agent interactions.

Does GROQ API support tool-calling and multi-model orchestration for responsive AI agents?

GROQ API supports tool-calling and multi-model orchestration to build responsive AI agents. It handles reasoning and tool usage within streaming workflows, satisfying requirements for complex agent interactions.

What is the best way to achieve low-latency streaming responses for AI applications?

Low-latency streaming responses for AI applications are best achieved using GROQ-based LLM inference. It provides ultra-fast processing capabilities specifically designed for latency-critical real-time settings.

Do I need an OpenAI API key to perform GROQ-based multimodal processing?

An OpenAI API key is not needed to perform GROQ-based multimodal processing. You only need to configure your GROQ_API_KEY environment variable to run inference across chat, vision, and audio workflows.