ai-engineering-toolkit

Evaluates prompts, plans context budgets, designs RAG pipelines, and audits LLM agent security.

Updated Apr 5, 2026
One-click install
npx skills add https://github.com/RobinMillford/GopherNotebook --skill ai-engineering-toolkit-robinmillford
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ai-engineering-toolkit
Source: https://github.com/RobinMillford/GopherNotebook/tree/main/.claude/skills/ai-engineering-toolkit
Command: npx skills add https://github.com/RobinMillford/GopherNotebook --skill ai-engineering-toolkit-robinmillford

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? LLM application development often relies on ad-hoc prompt tweaks and untested assumptions, leading to weak prompts, truncated context windows, insecure agents, and missing evaluation pipelines. This Skill replaces guesswork with six structured, repeatable AI engineering workflows that produce consistent, quantifiable results. ## Core Features & Use Cases - Prompt Evaluator: Scores prompts across 8 dimensions (Clarity, Specificity, Safety, etc.) on a 0-100 scale, identifies the weakest dimensions, and generates improved rewrites. - Context Budget Planner: Analyzes token allocation across 5 context zones and produces an optimized distribution plan with compression strategies. - RAG Pipeline Architect: Walks through architecture decisions from parsing and chunking to embedding models, retrieval methods, and evaluation metrics. - Agent Safety Guard: Runs a 65-point authorized red-team audit covering prompt injection, information extraction, tool abuse, and goal hijacking, with fix recommendations. - Eval Harness Builder & Product Sense Coach: Designs LLM-as-Judge evaluation pipelines with bias mitigation, and guides product strategy decisions before coding. - Use Case: Before launching a customer support agent, run the prompt evaluator to raise a 28/100 system prompt to 82/100, then run the security audit to catch injection bypasses and path traversal flaws before deployment. ## Quick Start Ask the assistant to evaluate your system prompt or run a security audit on your AI agent using the ai-engineering-toolkit workflows.

Frequently Asked Questions about ai-engineering-toolkit

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate an LLM system prompt before production deployment?

Use the Prompt Evaluator workflow, which scores prompts across 8 dimensions including Clarity, Safety, and Structure on a 0-100 scale. It identifies the three weakest dimensions, generates targeted rewrites, and re-evaluates the improved version.

How to design a RAG pipeline architecture for an LLM application?

The RAG Pipeline Architect walks through a decision tree covering document parsing, chunking strategy (fixed, semantic, or recursive), embedding model selection, retrieval method (vector, keyword, or hybrid), and evaluation metrics like Faithfulness and Context Precision.

How do I run a security audit on an AI agent?

The Agent Safety Guard executes a 65-point red-team audit across prompt injection, information extraction, tool abuse, and goal hijacking categories. It requires explicit authorization, asks for confirmation before each test phase, and outputs pass/fail judgments with fix recommendations.

What is context budget planning for LLM prompts?

Context budget planning analyzes token distribution across five zones: system prompt, few-shot examples, user input, retrieval content, and output. The workflow produces an optimized allocation plan and catches issues like output zones squeezed below 6% before truncation occurs.

Does the agent security audit work without a sandboxed environment?

All adversarial tests are contained within the evaluation context and do not interact with external systems, so a sandbox is not strictly required. However, running audits in a Docker container or VM is recommended as a best practice.

When should I not rely on a single prompt evaluation score?

Avoid judging prompts by the aggregate score alone, since a high total can hide critical weaknesses like a 1/10 Safety rating. Review the full 8-dimension profile and address the weakest dimensions individually before deployment.