skills.rest
papdawin
papdawinCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

api-gateway

Automate multi-tenant routing and orchestration for voice assistant backends.

Updated May 20, 2025
Search Tags:#multi-tenant#fastapi#rag#orchestration#websocket#gateway#voice-assistant
One-click install
npx skills add https://github.com/papdawin/customer-service-assistant --skill api-gateway
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: api-gateway
Source: https://github.com/papdawin/customer-service-assistant/tree/main/web/backend
Command: npx skills add https://github.com/papdawin/customer-service-assistant --skill api-gateway

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill provides a multi-tenant backend gateway that centralizes orchestration of shared voice-processing services (STT, VAD, TTS) while routing tenant-specific queries to the appropriate RAG service for accurate, company-scoped responses.

Core Features & Use Cases

  • Orchestrated gateway: coordinates STT, VAD, and TTS to deliver end-to-end voice workflows across multiple tenants.
  • Tenant isolation and routing: ensures per-company configuration and directs requests to the correct RAG backend.
  • Lightweight interfaces: exposes health and config endpoints and supports real-time streaming via WebSocket.

Quick Start

Install dependencies from requirements.txt and run the FastAPI server (for example, uvicorn app:app --reload). Configure environment variables such as STT_URL, RAG_URL, TTS_URL, VAD_URL, COMPANY, and HTTPX_TIMEOUT as needed. Start any required per-tenant RAG services and, if present, the frontend UI.

Frequently Asked Questions about api-gateway

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build a multi-tenant voice assistant backend with FastAPI?▼

Build a multi-tenant voice assistant backend with FastAPI by creating a gateway that centralizes shared STT, VAD, and TTS orchestration while routing tenant-specific RAG queries to isolated backends for accurate responses.

What is multi-tenant gateway routing for RAG applications?▼

Multi-tenant gateway routing for RAG applications directs per-company queries to the correct RAG backend, ensuring tenant isolation and accurate, company-scoped responses across shared voice-processing components.

How do I configure WebSocket streaming for a voice assistant gateway?▼

Configure WebSocket streaming for a voice assistant gateway using FastAPI to handle real-time audio processing, coordinating STT, VAD, and TTS services through a single streaming interface.

Do I need separate RAG services for each tenant in a voice assistant deployment?▼

You need separate per-tenant RAG services for each tenant in a voice assistant deployment, while the FastAPI gateway manages shared components like STT, VAD, and TTS centrally.

What environment variables are required to run a FastAPI voice gateway?▼

Required environment variables to run a FastAPI voice gateway include STT_URL, RAG_URL, TTS_URL, VAD_URL, COMPANY, and HTTPX_TIMEOUT for runtime configuration management.

Related Skills

Explore More Software Engineering Skills→
papdawinpapdawin

tts-service

Serve Hungarian text-to-speech via FastAPI endpoints with per-tenant voice configuration.

Community
Intermediate
windmill-labswindmill-labs
17.5k

raw-app

Scaffold raw apps connecting React, Svelte, or Vue frontends to Windmill backends.

Official
Basic
GeorgeKuzoraGeorgeKuzora

asyncio

Coordinate asynchronous I/O operations in Python using async/await and event loops.

Community
Advanced
missBergmissBerg
3

eg-multi-tenant

Provision per-tenant Envoy Gateway isolation and policies in Kubernetes.

Community
Advanced