analyze-failures

Classify test execution failures into product, automation, or environment categories.

4|Updated Jun 17, 2026
One-click install
npx skills add https://github.com/katalon-labs/true-skills --skill analyze-failures-katalon-labs
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: analyze-failures
Source: https://github.com/katalon-labs/true-skills/tree/main/plugins/katalon-true-platform/skills/analyze-failures
Command: npx skills add https://github.com/katalon-labs/true-skills --skill analyze-failures-katalon-labs

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This skill addresses the noise and manual effort involved in test failure triage by systematically classifying failures and preventing duplicate defect reports.

Core Features & Use Cases

  • Failure Classification: Automatically categorizes test failures into product defects, automation issues, or environment/data problems.
  • Intelligent Clustering: Groups failures by signature to ensure one root cause results in a single, actionable report.
  • Use Case: When a test suite fails overnight, use this skill to quickly identify which failures are genuine product bugs versus flaky tests, and automatically file tickets for the bugs in your ALM system.

Quick Start

Ask the analyze-failures skill to triage the recent execution results and file defects for any confirmed product bugs.

Frequently Asked Questions about analyze-failures

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I triage test failures and distinguish real product bugs from flaky automation issues?

Test failure triage classifies execution results into product defects, automation issues, or environment problems. By clustering failures by signature, you can isolate genuine product bugs from flaky tests to focus debugging efforts on actual software defects.

What is the best way to automate defect filing and prevent duplicate tickets for test failures?

Automated defect filing verifies existing defect status in your ALM system before creating new tickets. By clustering test execution failures by signature, the process ensures one root cause generates a single actionable report, preventing duplicate tickets for the same issue.

How do I group test execution failures by signature to streamline debugging workflows?

Grouping test execution failures by signature clusters identical root causes together. This process operates on test result data to systematically categorize failures into product, automation, or environment buckets, reducing noise and streamlining your debugging workflows.

Do I need Katalon True Platform integration to classify test failures automatically?

Yes, automatic failure classification requires integration with Katalon True Platform via Katalon MCP. This integration fetches test execution data and verifies existing ALM-linked defect status before filing, ensuring accurate triage and categorization of failures.

Can I use this triage approach for overnight test suite failures to identify environment or data problems?

Yes, when a test suite fails overnight, this approach classifies failures into product, automation, or environment/data categories. It quickly identifies which failures are genuine product bugs versus environment issues and automatically files tickets for confirmed bugs in your ALM system.