llm-dev

Design and improve large language model systems from architecture to production deployment.

2|1|Updated Apr 22, 2026
One-click install
npx skills add https://github.com/pytholic/claude-skills --skill llm-dev
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: llm-dev
Source: https://github.com/pytholic/claude-skills/tree/main/llm-dev
Command: npx skills add https://github.com/pytholic/claude-skills --skill llm-dev

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you design, evaluate, and ship large language model features without guesswork, covering the full path from model selection to production readiness.

Core Features & Use Cases

  • LLM Architecture Guidance: Understand transformer internals, attention variants, positional encoding, tokenization, and mixture-of-experts tradeoffs.
  • Training and Alignment: Choose and apply pretraining, fine-tuning, and preference optimization methods such as LoRA, QLoRA, DPO, and RLHF.
  • RAG, Agents, and Tool Use: Build retrieval-augmented systems, structured tool workflows, MCP integrations, and agentic patterns with clear failure boundaries.
  • Evaluation and Production: Define eval-driven development plans, measure quality, control latency and cost, and harden systems for observability and safety.

Quick Start

Ask for an end-to-end plan for an LLM feature, including architecture, evaluation strategy, implementation boundaries, and production risks.

Frequently Asked Questions about llm-dev

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build a production-ready LLM system from architecture to deployment?

Build a production-ready LLM system by defining modular architecture, eval-driven development workflows, structured outputs, and safety-aware practices to control latency, cost, and quality. Generate an end-to-end plan covering implementation boundaries and production risks.

What's the best way to evaluate and improve retrieval-augmented generation quality?

Evaluate and improve retrieval-augmented generation by defining eval-driven development plans that measure quality, track metrics, and establish clear failure boundaries for agentic workflows. Apply structured tool workflows and MCP integrations for robust retrieval.

When should I use fine-tuning methods like LoRA or QLoRA for large language models?

Use fine-tuning methods like LoRA or QLoRA when adapting transformer architectures for specific tasks through preference optimization. Apply pretraining, DPO, and RLHF alignment techniques based on tradeoffs between mixture-of-experts configurations and training objectives.

Can I use MCP integrations and agentic patterns for structured tool workflows?

MCP integrations and agentic patterns support structured tool workflows with clear failure boundaries for large language model systems. Build retrieval-augmented systems with modular engineering to handle tool use, structured outputs, and complex agent interactions safely.

How do I control latency and cost when deploying large language model features?

Control latency and cost in large language model deployment through eval-driven development, modular engineering, and safety-aware production practices. Analyze transformer internals, attention variants, and mixture-of-experts tradeoffs to optimize system performance and observability.