ai-llm

Streamline end-to-end LLM development with RAG, agentic workflows, and deployment.

73|16|Updated Nov 14, 2025
One-click install
npx skills add https://github.com/vasilyu1983/AI-Agents-public --skill ai-llm
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ai-llm
Source: https://github.com/vasilyu1983/AI-Agents-public/tree/main/frameworks/claude-code-kit/framework/skills/ai-llm
Command: npx skills add https://github.com/vasilyu1983/AI-Agents-public --skill ai-llm

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Streamlines the full LLM lifecycle from design to production, reducing time-to-value and ensuring robust, observable deployments.

Core Features & Use Cases

  • Lifecycle patterns: Strategy selection (prompting, fine-tuning, RAG).
  • Evaluation & governance: Automated tests, guardrails, and monitoring.
  • Deployment: vLLM-based serving, FP8/FP4 quantization, drift detection.
  • Safety: Multi-layer guardrails and policy evaluation.

Quick Start

Initialize an end-to-end LLM project with a prompt strategy, evaluation harness, and deployment plan.

Frequently Asked Questions about ai-llm

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build and deploy a production-grade LLM end-to-end?

End-to-end LLM deployment spans strategy selection, fine-tuning with PEFT/LoRA, automated evaluation, and serving via quantized models (FP8/FP4). This Skill streamlines the full lifecycle from prompt design through production CI/CD, reducing time-to-value and ensuring robust, observable deployments.

What's the best way to evaluate LLMs before production?

Automated evaluation pipelines test LLM outputs against functional requirements and safety guardrails. This Skill provides governance frameworks, multi-layer guardrails, and monitoring to detect drift and ensure production-grade quality before deployment.

How do I fine-tune LLMs with PEFT and LoRA for my use case?

PEFT and LoRA fine-tuning reduce training cost while adapting models to specific tasks. This Skill guides dataset design, strategy selection between prompting and fine-tuning, and configuration for production deployment across diverse LLM systems.

Can I use RAG and agentic workflows in my LLM architecture?

Yes. This Skill covers RAG pipelines and agentic workflows as core lifecycle patterns, helping you design, evaluate, and deploy them with proper governance, quantization, and safety guardrails integrated into production CI/CD.

What quantization options are available for LLM deployment?

FP8 and FP4 quantization reduce model size and latency for serving. This Skill provides vLLM-based deployment configurations and quantization strategies to optimize production inference while maintaining evaluation and safety standards.

How do I monitor LLM drift and safety in production?

Drift detection and safety guardrails track model behavior shifts and policy violations post-deployment. This Skill integrates monitoring, multi-layer guardrails, and production CI/CD patterns to ensure ongoing operational reliability.