skills.rest
vibbs
vibbsCOMMUNITY
Explore all skills by this author →
GitHub

test-intelligence

Analyzes test suite health from runner output, coverage reports, and CI logs.

6|1|Updated Feb 25, 2026
Search Tags:#code quality#testing#ci/cd#test automation#qa#flaky tests#coverage
One-click install
npx skills add https://github.com/vibbs/company-os --skill test-intelligence
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: test-intelligence
Source: https://github.com/vibbs/company-os/tree/main/.claude/skills/test-intelligence
Command: npx skills add https://github.com/vibbs/company-os --skill test-intelligence

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill addresses the silent decay of test suites, which often leads to unreliable CI/CD pipelines, eroded developer trust, and a false sense of security regarding code quality.

Core Features & Use Cases

  • Flaky Test Detection: Identifies and recommends strategies for handling non-deterministic tests.
  • Coverage Analysis: Assesses test coverage beyond simple line counts, focusing on meaningful assertions and branch coverage.
  • Test Pyramid Balancing: Analyzes the distribution of unit, integration, and E2E tests and provides recommendations for optimization.
  • Mutation Testing Guidance: Suggests when and how to apply mutation testing to uncover weaknesses in test effectiveness.
  • Performance Profiling: Identifies slow tests and suggests parallelization strategies.
  • Use Case: A team is experiencing frequent CI failures due to flaky tests and suspects their test coverage is not as robust as reported. This Skill can diagnose the root causes of flakiness, provide a more accurate picture of test effectiveness, and guide improvements to the test suite's structure and balance.

Quick Start

Analyze the current test suite health and generate a report.

Frequently Asked Questions about test-intelligence

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I detect flaky tests causing CI/CD pipeline failures?▼

To detect flaky tests causing CI/CD pipeline failures, analyze test runner output and CI logs to identify non-deterministic tests and recommend strategies for handling them, restoring pipeline reliability.

What is the best way to measure test coverage beyond line counts?▼

Measuring test coverage beyond line counts requires assessing meaningful assertions and branch coverage from coverage reports. This approach provides a more accurate picture of test effectiveness and code quality.

How do I balance the test pyramid for unit, integration, and E2E tests?▼

To balance the test pyramid for unit, integration, and E2E tests, analyze the distribution of your test suite and apply recommendations for optimization to ensure structural balance and reliable execution.

When should I use mutation testing to uncover test weaknesses?▼

You should use mutation testing to uncover test weaknesses when your reported coverage is high but test effectiveness is suspect. It guides the application of mutation testing to expose weaknesses in test assertions.

Can I profile slow test suite performance and parallelize execution?▼

Yes, you can profile slow test suite performance and parallelize execution by processing test runner output to identify slow tests and suggesting parallelization strategies to improve overall suite performance.

Does test automation health analysis work without specialized testing frameworks?▼

Test automation health analysis works by processing standard test runner output, coverage reports, and CI logs, meaning it does not require specialized testing frameworks to generate a comprehensive test health report.

Related Skills

Explore More Software Engineering Skills→
Imad-OuteImad-Oute
2

mh-cto-sdlc-test-health

Measure test suite flakiness, coverage alignment, and maintenance burden.

Community
Advanced
summarybotngsummarybotng
2

test-automation-strategy

Design test automation strategies with test pyramid and CI/CD integration.

Official
Advanced
luokai25luokai25

test-automator

Develop test automation frameworks, scripts, and CI/CD pipeline integrations.

Community
Advanced
rudironsonirudironsoni

dotnet-test-quality

Analyze .NET test quality using Coverlet, ReportGenerator, and Stryker.NET.

Community
Intermediate