gem-llm-gateway-debug
CommunityFix GEM-LLM Gateway auth, quota, and streaming
Software Engineering#authentication#troubleshooting#fastapi#api gateway#quota management#streaming sse#vllm proxy
Authorsaintgo7
Version1.0.0
Installs0
System Documentation
What problem does it solve?
GEM-LLM Gateway issues like 401 invalid API keys, unknown_model errors, rate limiting, missing /v1/chat endpoints, and broken streaming responses are hard to diagnose and often caused by misconfigured middleware, environment variables, or upstream model mappings.
Core Features & Use Cases
- Endpoint-first diagnostics: Validates health, readiness, metrics, and model list behavior so you can localize failures quickly.
- Auth, quota, and proxy troubleshooting: Covers API key hashing/salt, admin key management, RPM/concurrency/daily token quota checks, and vLLM upstream routing.
- Streaming reliability checks: Ensures SSE chunk pass-through and proper [DONE] termination while keeping usage logging non-blocking.
- Practical fixes for common failures: Provides specific causes for 401/400/429/500/502 and links remediation paths (e.g., config updates, SQLite WAL recovery, proxy upstream issues).
Quick Start
Run the skill install command: ./install.sh gem-llm-gateway-debug.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: gem-llm-gateway-debug Download link: https://github.com/saintgo7/claude-skills/archive/main.zip#gem-llm-gateway-debug Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.