test-validate-loop

Automate closed-loop test plan validation against .NET/Azure code models.

Updated May 7, 2026
One-click install
npx skills add https://github.com/tmalcolm-0607/mad-council-claw --skill test-validate-loop
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: test-validate-loop
Source: https://github.com/tmalcolm-0607/mad-council-claw/tree/main/.claude/skills/test-validate-loop
Command: npx skills add https://github.com/tmalcolm-0607/mad-council-claw --skill test-validate-loop

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill eliminates the manual, error-prone process of coordinating test plan validation, code fixes, quality gates, deployment, and end-to-end testing across complex .NET/Azure codebases. It ensures test plans match actual controller models, fixes are applied and verified automatically, and deployments are validated with real E2E tests—all while providing detailed diagnostics from App Service logs when failures occur.

Core Features & Use Cases

  • Plan Validation: Cross-references test plans against actual controller models to catch field mismatches, wrong HTTP verbs, incorrect required/optional assertions, and wrong enum values before deployment.
  • Automated Fix Loop: Triages issues by severity (Critical/Major/Medium/Low), applies fixes to test plans or source code, and re-runs validation until all quality gates pass or the maximum loop count is reached.
  • Team Mode: Spawns parallel agent teams (researcher, implementer, reviewer, deploy-monitor) for continuous investigate → fix → review → deploy cycling on complex issues requiring multiple specialized agents.
  • Log-Driven Diagnostics: Automatically downloads and greps App Service logs after E2E failures to identify root causes like serialization mismatches, Cosmos DB errors, or DI configuration issues.
  • Use Case: Imagine you have 50 test plans for a .NET API with frequent model changes. Use this Skill to automatically validate every plan against the actual controllers, fix any mismatches, build, deploy to Azure, and run E2E tests—all while analyzing logs for any failures and looping until the system is green.

Quick Start

Run the test-validate-loop skill to automatically validate test plans against code models, fix issues, run quality gates, deploy to an environment, and execute end-to-end tests in a single orchestrated pipeline.

Frequently Asked Questions about test-validate-loop

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate test plan validation against .NET controller models?

Automated test plan validation cross-references your test plans against actual .NET controller models to catch field mismatches, wrong HTTP verbs, and incorrect enum values. It triages issues by severity, applies fixes to code or plans, and re-runs validation until all quality gates pass.

Can I automate Azure deployment and E2E testing in a single pipeline?

Yes, you can orchestrate Azure deployment and E2E testing in a single automated pipeline. The process coordinates test plan verification, code fixes, deployment to Azure App Service, and end-to-end tests, automatically downloading and grepping App Service logs to diagnose E2E failures.

What is severity-based triage for automated code fixes?

Severity-based triage categorizes validation issues into Critical, Major, Medium, and Low levels. This mechanism prioritizes how the automated fix loop addresses mismatches in test plans or source code, re-running validation until all quality gates pass or the maximum loop count is reached.

How do I diagnose E2E test failures using App Service logs?

To diagnose E2E test failures using App Service logs, the automated pipeline downloads and greps the logs after a test failure to identify root causes. This log-driven diagnostic approach detects specific issues like serialization mismatches, Cosmos DB errors, or DI configuration problems.

Does test validation loop work with parallel agent teams for continuous integration?

Yes, test validation loop supports continuous integration through a Team Mode that spawns parallel agent teams. These researcher, implementer, reviewer, and deploy-monitor agents execute continuous investigate, fix, review, and deploy cycling to handle complex issues requiring multiple specialized agents.

What are the limitations of automated test validation loops for complex codebases?

Automated test validation loops for complex codebases are limited by a maximum loop count, meaning the process stops fixing mismatches and deploying if quality gates do not pass within the configured iteration limit. This prevents infinite cycles but requires manual intervention for persistent failures.