skills.rest
nist0
nist0COMMUNITY
Explore all skills by this author →
GitHub

llm-integration

Integrate LLMs into production systems with provider abstraction and structured output.

Updated Apr 9, 2026
Search Tags:#rate limiting#LLM#streaming#AI integration#structured output#provider abstraction#prompt discipline
One-click install
npx skills add https://github.com/nist0/CoDev --skill llm-integration-nist0
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: llm-integration
Source: https://github.com/nist0/CoDev/tree/main/.github/skills/llm-integration
Command: npx skills add https://github.com/nist0/CoDev --skill llm-integration-nist0

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill addresses the complexity and challenges of integrating Large Language Models (LLMs) into production systems, providing patterns for reliable, secure, and efficient usage.

Core Features & Use Cases

  • Provider Abstraction: Simplifies switching between LLM providers without code changes.
  • Streaming Completions: Reduces latency and enhances user experience with streaming responses.
  • Retries and Rate Limiting: Implements robust error handling and retry strategies.
  • Token Counting and Context Management: Ensures efficient use of LLM resources and maintains context integrity.
  • Structured Output: Ensures predictable and usable output through JSON formatting.
  • Prompt Template Discipline: Improves safety and predictability by following structured prompts.
  • Observability: Facilitates monitoring and debugging with detailed logging.
  • Use Case: A developer uses this Skill to create a production-ready feature that interacts with an LLM, leveraging its structured output and robust error handling capabilities.

Quick Start

Implement LLM integration with the llm-integration skill by adding it to your project and following the setup instructions provided in the SKILL.md file.

Frequently Asked Questions about llm-integration

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
What is provider abstraction and how does it help with LLM integration?▼

Provider abstraction simplifies LLM integration by allowing you to switch between different AI providers without requiring code changes, ensuring your production system remains flexible and provider-agnostic.

How do I handle rate limiting and retries when integrating an LLM?▼

To handle rate limiting and retries during LLM integration, implement robust error handling strategies that automatically manage failed requests and throttle traffic, ensuring reliable and efficient usage of AI resources.

How do I get structured JSON output from an LLM?▼

You can get structured JSON output from an LLM by applying prompt template discipline, which enforces predictable and usable formatting to ensure the generated responses meet your application's specific data requirements.

Can I use streaming completions to reduce latency in my AI integration?▼

Yes, you can use streaming completions in your AI integration to significantly reduce latency and enhance user experience by delivering model responses incrementally as they are generated.

What is the best way to manage token counting and context for Large Language Models?▼

The best way to manage token counting and context is to use patterns that ensure efficient resource usage and maintain context integrity, preventing unexpected truncation and controlling operational costs.

How do I monitor and debug LLM interactions in a production system?▼

You can monitor and debug LLM interactions in a production system by implementing observability practices with detailed logging, facilitating effective tracking of requests, responses, and error handling.

Related Skills

Explore More Software Engineering Skills→
StarryCodStarryCod
11

serving-llms-vllm

Serve LLMs via vLLM with OpenAI-compatible endpoints and tensor parallelism.

Community
Advanced
daidrdaidr
8

analyze-logs

Parse NDJSON or JSON logs to extract errors, metrics, and request patterns.

Community
Intermediate
markus41markus41
1

llmintegration

Integrate Claude, GPT, Gemini, and Ollama APIs with a pluggable provider abstraction.

Community
Intermediate
yusufcmgyusufcmg
1

multi-cloud-architecture

Design multi-cloud architectures with service selection patterns across AWS, Azure, and GCP.

Community
Advanced