promptfoo-ci-lab
CommunityBootstrap and debug promptfoo labs locally.
Authorshichiyou
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Sets up and troubleshoots a promptfoo evaluation pipeline for LLM prompts, covering local execution, Ollama provider configuration, YAML config structure, template variable injection, the prompt×test Cartesian product pitfall, and result inspection.
Core Features & Use Cases
- Local evaluation workflow for promptfoo CI/CD labs, including provider configuration, YAML structures, and result inspection.
- Guidance to prevent the Cartesian product pitfall by organizing tests and prompts, and by validating variable injection.
- Clear troubleshooting guidance for bootstrapping and debugging a promptfoo lab in a dev container or monorepo.
Quick Start
Clone this repository, install dependencies, and open the project in a Dev Container to validate the evaluation workflow.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: promptfoo-ci-lab Download link: https://github.com/shichiyou/hermes-agent-001/archive/main.zip#promptfoo-ci-lab Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.