ai-product-dev

Automate end-to-end AI product development with LLM, RAG, and evaluation pipelines.

2|Updated Oct 1, 2024
One-click install
npx skills add https://github.com/ZeiZel/dotfiles --skill ai-product-dev
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ai-product-dev
Source: https://github.com/ZeiZel/dotfiles/tree/main/.claude/skills/ai-product-dev
Command: npx skills add https://github.com/ZeiZel/dotfiles --skill ai-product-dev

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

AI/ML product development often requires integrating LLMs, managing RAG pipelines, and evaluating AI models, which is time-consuming without a cohesive pattern catalog.

Core Features & Use Cases

  • LLM integration patterns with practical best practices for retries, streaming, and cost control.
  • RAG architectures covering embedding, vector search, reranking, and context assembly for reliable question answering.
  • Agent design principles and prompt engineering templates to accelerate product delivery in AI-enabled workflows.
  • Use Case: Build an end-to-end AI feature from model selection to deployment and evaluation.

Quick Start

Give me a starter blueprint to build an AI product using LLMs, RAG, embeddings, and evaluation.

Frequently Asked Questions about ai-product-dev

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
What is the best way to build an end-to-end AI product using LLMs and RAG?

The best way to build an AI product with LLMs and RAG is to use a modular architecture with clear interface contracts for prompt design, data ingestion, vector search, and model evaluation. This approach provides reusable templates to automate workflows from research to production.

How do I design a RAG architecture for reliable question answering?

To design a RAG architecture for question answering, you implement pipelines covering embedding, vector search, reranking, and context assembly. This ensures reliable retrieval and generation by structuring how data is ingested and queried before the LLM generates a response.

What LLM integration patterns should I use for cost control and streaming?

For LLM integration patterns managing cost control and streaming, apply practical best practices for retries and modular API calls. Using reusable templates for LLM calls ensures you handle network failures and token usage efficiently during product development.

Can I use agent design principles to accelerate AI-enabled workflow delivery?

Yes, you can use agent design principles alongside prompt engineering templates to accelerate AI-enabled workflow delivery. These principles structure how agents interact with LLMs, enabling rapid prototyping and deployment of complex AI features.

How do I evaluate AI models within an automated development pipeline?

To evaluate AI models within an automated development pipeline, integrate evaluation pipelines that measure model performance using specific metrics. This requires defining clear evaluation criteria during the prompt design and data ingestion phases to ensure reliable outputs.

What is needed to automate AI product development workflows for my team?

Automating AI product development workflows requires a cohesive pattern catalog integrating LLMs, RAG, and evaluation pipelines. Teams need modular architecture and reusable templates across research, prototyping, and production to streamline prompt design and model evaluation.