validate-candidate

Validate PR flight deployments against head SHA and Loki signals.

4|5|Updated Nov 5, 2025
One-click install
npx skills add https://github.com/cogni-dao/cogni --skill validate-candidate
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: validate-candidate
Source: https://github.com/cogni-dao/cogni/tree/main/.claude/skills/validate-candidate
Command: npx skills add https://github.com/cogni-dao/cogni --skill validate-candidate

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Close the deploy_verified loop for a PR flighted to candidate-a. Review the PR, confirm the candidate-a build matches the PR head SHA, enumerate impacted surfaces (API routes, UI pages, graphs), exercise each against the real deployed URL using captured authed Playwright state + agent-api-validation patterns, query Loki for observability signals from the agent's own requests, then post an approve/fail scorecard + matrix as a PR comment. Use this skill whenever the user asks to "validate the candidate-a deploy", "prove this PR on candidate-a", "close the deploy_verified loop", runs "/validate-candidate" (with or without a PR number), or asks to manually E2E-test a flighted PR. Explicitly don't use for pre-merge CI checks or local dev testing — this skill runs after candidate-flight has already succeeded.

Core Features & Use Cases

  • Orchestrates post-deploy validation by simulating the candidate flight against the deployed URL and aggregating observability signals.
  • Enumerates impacted surfaces (API routes, UI pages, graphs), and exercises them via Playwright and agent-api-validation patterns.
  • Generates and posts a PR scorecard matrix with clear pass/fail/notes.
  • Supports prompts like '/validate-candidate' or 'validate the candidate-a deploy' to trigger the validation.
  • Enforces hard rules such as zero artifacts on disk during runs and strict observability verification via Loki.

Quick Start

Invoke the skill on the target PR (e.g., /validate-candidate 1080) to run the end-to-end validation and post the resulting scorecard to the PR.

Frequently Asked Questions about validate-candidate

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate a PR flight deployment against live observability signals?

You can validate a PR flight deployment by automating end-to-end checks against the live candidate URL, querying Loki for observability data, and executing Playwright-driven tests to generate a pass/fail scorecard.

What is the best way to close the deploy_verified loop for a flighted PR?

Closing the deploy_verified loop involves confirming the candidate build matches the PR head SHA, exercising impacted API and UI surfaces, and posting an approve or fail scorecard matrix directly as a PR comment.

When should I run end-to-end PR validation on a candidate deployment?

Run end-to-end PR validation after a candidate-flight has already succeeded and the deployment is live, explicitly avoiding pre-merge CI checks or local development testing scenarios.

Do I need captured authentication state to run Playwright E2E checks on a candidate URL?

Yes, you need captured authentication state, authenticated gh CLI, Loki access, and a live deployed candidate URL per node to successfully execute Playwright checks and verify observability signals.

Does PR validation with observability write artifacts to disk during the run?

No, the PR validation process enforces zero-disk-artifact runs, ensuring the final scorecard and matrix are generated and posted without writing any files to the local disk.

How do I enumerate impacted surfaces like API routes and UI pages during PR validation?

Enumerating impacted surfaces involves analyzing the PR changes to identify affected API routes, UI pages, and graphs, then exercising them via Playwright and agent-api-validation patterns against the deployed URL.