test-fix-loop

Automate iterative diagnosis and repair of failing test suites.

12|2|Updated Jan 27, 2026
One-click install
npx skills add https://github.com/jikig-ai/soleur --skill test-fix-loop-jikig-ai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: test-fix-loop
Source: https://github.com/jikig-ai/soleur/tree/main/plugins/soleur/skills/test-fix-loop
Command: npx skills add https://github.com/jikig-ai/soleur --skill test-fix-loop-jikig-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill automates the tedious and error-prone process of repeatedly running a test suite, diagnosing failures, applying minimal implementation fixes, and re-running until the suite is green or a safe termination condition is reached.

Core Features & Use Cases

  • Automated test runner detection: Locates the project test command from common manifests and accepts a custom command when provided.
  • Safe checkpointing and rollback: Creates commit checkpoints before fixes and reverts on regressions, circular fixes, or non-convergence to protect the working tree.
  • Failure clustering and diagnostics: Summarizes failures, clusters by module, reads tests and implementation to identify root causes before changing code.
  • Controlled iterative fixes: Applies changes only to implementation code, never to test files, and enforces a max iteration limit and multiple termination conditions.
  • Use Case: Recover a repository where a recent change caused widespread test failures by automatically diagnosing top failing modules, applying targeted fixes, and stopping if progress stalls.

Quick Start

Run the test-fix-loop skill with the detected test command and an iteration limit to automatically diagnose failures and apply minimal implementation fixes until tests pass.

Frequently Asked Questions about test-fix-loop

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automatically fix failing tests in my repository?

Automated iterative test repair runs your test suite, clusters failures by module, applies minimal implementation fixes, and re-runs until green. It requires a git-accessible repository with an identifiable test command like package.json or Makefile, and never modifies test files.

Can I use automated test repair on a continuous integration pipeline?

Yes, automated test repair supports CI recovery by detecting widespread test failures from recent changes, diagnosing top failing modules, and applying targeted implementation fixes. It requires permission to modify implementation code while preserving tests.

How does an automated test fix loop handle regressions or circular fixes?

An automated test fix loop handles regressions by creating git commit checkpoints before applying fixes. If a fix causes a regression, circular fix, or non-convergence, it reverts to the previous checkpoint to protect the working tree.

What is the best way to diagnose and cluster test failures across modules?

The best way to diagnose and cluster test failures is using an automated loop that summarizes failures, clusters errors by module, and reads both tests and implementation code to identify root causes before applying minimal implementation changes.

Does the test-fix loop modify test files when applying fixes?

No, the test-fix loop strictly preserves test files and applies changes only to implementation code. It enforces a max iteration limit and multiple termination conditions to ensure safe, controlled iterative fixes.

When should I stop an automated test repair loop?

You should stop an automated test repair loop when tests pass, progress stalls, or a safe termination condition is reached. The loop enforces a max iteration limit and stops if it detects regressions, circular fixes, or non-convergence.