skills.rest
korchasa
korchasaCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

diagnose-benchmark-failure

Diagnose flowai benchmark failures by comparing run artifacts against a failure taxonomy.

Updated May 16, 2026
Search Tags:#diagnosis#evidence-based#flowai#benchmark failure#run artifacts
One-click install
npx skills add https://github.com/korchasa/flowai-plugins --skill diagnose-benchmark-failure
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: diagnose-benchmark-failure
Source: https://github.com/korchasa/flowai-plugins/tree/main/plugins/flowai-engineering/skills/diagnose-benchmark-failure
Command: npx skills add https://github.com/korchasa/flowai-plugins --skill diagnose-benchmark-failure

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill helps diagnose the root cause of benchmark failures in flowai by analyzing run artifacts and comparing them against known issues.

Core Features & Use Cases

  • Failure Analysis: Identifies the cause of benchmark failures by comparing run artifacts against a known taxonomy of failure modes.
  • Evidence-First: Requires reading evidence files before proposing a cause or fix, ensuring an evidence-based approach.
  • No Fixes: Produces a diagnostic report without modifying any source files, leaving the actual fixes to be addressed by the user.

Quick Start

Run the 'diagnose-benchmark-failure' skill with the scenario ID, e.g., 'diagnose-benchmark-failure --scenario-id plan-interactive'

Frequently Asked Questions about diagnose-benchmark-failure

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I diagnose the root cause of a benchmark failure in flowai?▼

Diagnosing a benchmark failure in flowai requires comparing run artifacts against a known taxonomy of failure modes to pinpoint the root cause and generate a diagnostic report.

What is an evidence-based approach to finding flowai benchmark issues?▼

An evidence-based approach to flowai benchmark issues requires reading run artifact files before proposing any cause, ensuring diagnostic conclusions rely on actual execution data.

Do I need run artifacts and shell access to analyze flowai benchmark failures?▼

Yes, analyzing flowai benchmark failures requires access to run artifacts and the ability to execute shell commands to extract and compare the necessary diagnostic evidence.

Can this diagnostic process automatically fix benchmark failures?▼

No, the diagnostic process produces a report without modifying any source files, leaving the actual benchmark fixes to be addressed by the user based on the identified failure modes.

How do I start diagnosing a specific benchmark scenario in flowai?▼

You start diagnosing a specific scenario by running the diagnostic skill with the scenario ID, such as passing the `--scenario-id` parameter with a value like `plan-interactive`.

Related Skills

Explore More Software Engineering Skills→
raphaelchristiraphaelchristi
43

harness:setup

Configure Harness Evolver, LangSmith, and baseline evaluations for Python projects.

Community
Advanced
darwinboaventuradarwinboaventura

fix-errors

Trace VS Code telemetry data flow to identify and fix unhandled errors.

Community
Intermediate
intel-agencyintel-agency

forensic-analysis-report

Produce structured forensic markdown reports from GitHub Actions workflow evidence.

Official
Advanced
hernamesbarbarahernamesbarbara

categorizing-files

Classify project files into eight standard categories with a CLI script.

Community
Basic