defprod-run-area-tests

Runs e2e tests for a product area and classifies failures as test or production faults.

Updated Apr 4, 2026
One-click install
npx skills add https://github.com/defprod1/defprod-skills --skill defprod-run-area-tests-defprod1
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: defprod-run-area-tests
Source: https://github.com/defprod1/defprod-skills/tree/main/skills/defprod-run-area-tests
Command: npx skills add https://github.com/defprod1/defprod-skills --skill defprod-run-area-tests-defprod1

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? When an end-to-end test suite fails, engineers must manually investigate each failure to determine whether the test itself is broken or the production code has a real bug. This Skill automates that triage by running the tests, analyzing every failure and flaky test against production code and user stories, and producing a structured classification report. ## Core Features & Use Cases - Automated test execution: Locates and runs e2e tests for a product area using the project's test runner (Playwright, Cypress, or custom commands), capturing results, errors, and retry behavior. - Failure classification: Cross-references each failed or flaky test against production code and DefProd user stories to classify it as a test fault or production fault, with a specific recommended fix. - Structured reporting: Saves a Markdown report (e.g. AUTH-test-check.md) summarizing pass/fail/flaky counts and per-test analysis, ready to drive the follow-up fix workflow. - Use Case: After a refactor, run the skill against the BILLING area to discover three failures, learn that two are outdated selectors (test faults) and one is a genuine regression (production fault), and get a report to hand off for fixing. ## Quick Start Ask your AI agent to run the area tests for your product, for example: run the e2e tests for the AUTH area of my product and classify any failures.

Frequently Asked Questions about defprod-run-area-tests

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run e2e tests for a specific product area?

Invoke the skill with a product name and area key, such as /defprod-run-area-tests my-product AUTH. It locates the area's test files via .defprod/defprod.json or common directory patterns, then runs them with the project's test runner.

How to tell if a failing e2e test is a test bug or a production bug?

The skill reads the test file, the error output, and the relevant production code, then cross-references the DefProd user story's acceptance criteria. If the production code matches the criteria, it is a test fault; otherwise it is a production fault.

Does this skill work with Playwright and Cypress?

Yes, it supports Playwright via npx playwright test with JSON reporter and Cypress via npx cypress run with JSON reporter. It also adapts to any custom test command the project defines.

Can this skill fix the failing tests it finds?

No, this skill only analyzes and reports failures. Fixes are intentionally handled by the separate /defprod-fix-test-failures skill, which consumes the saved report.

What happens if no e2e tests exist for an area?

The skill informs the user that no tests were found and suggests running /defprod-create-area-tests first to generate a test suite for that area.