prompt-version-management
OfficialSafely roll out prompt changes with A/B tests
Software Engineering#version control#canary deployment#experimentation#prompt-management#prompt evaluation#a-b testing#llm-ops
Authorcosmicstack-labs
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill solves the risk of breaking agent behavior by managing prompt versions with auditability, controlled experimentation, and safe production rollouts.
Core Features & Use Cases
- Prompt diffing and semantic versioning: Track changes with a PROMPT_CHANGELOG-style history and apply MAJOR/MINOR/PATCH bumps to keep releases predictable.
- A/B testing for prompt variants: Deterministically assign users to control vs variant groups, record metrics, and analyze outcomes for measurable improvement.
- Canary deploys with automated evaluation and rollback: Gate each rollout stage using an evaluator with thresholds, then rollback if regressions are detected.
- Prompt registry and “active” promotion: Store prompt versions with metadata (including hashes), retrieve the active prompt per agent, and support comparisons between versions.
Quick Start
Ask the AI to create a versioned prompt plan for your agent, run an A/B test between control and variant versions, and canary-deploy the winning prompt with rollback gates.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: prompt-version-management Download link: https://github.com/cosmicstack-labs/mercury-agent-skills/archive/main.zip#prompt-version-management Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.