engineering-manager-agent-prompts-evals

What problem does it solve?

Engineering managers leading teams that own agent prompts, tool schemas, golden eval suites, judge programs, and prompt regression CI face coordination, governance, and scalability gaps. This skill provides a structured framework to organize org design, roles, roadmaps, and release governance so teams can deliver high-quality prompts and evaluations reliably at scale.

Core Features & Use Cases

• Org design for prompt, eval, and judge teams with clear ownership and guardrails.
• Roadmapping and prioritization for eval debt, golden sets, harness, and judge calibration.
• Release governance including gates, waivers, and rollback strategies aligned with risk and operations.
• Hiring, levels, and development plans for prompt engineers, eval engineers, and EMs.
• Cross-functional partnerships with product, risk/compliance, red team, and ops to sustain reliable eval pipelines.

Quick Start

Map governance gaps and assign roles to establish golden sets and release gates.