skills.rest
daisyden
daisydenCOMMUNITY
Explore all skills by this author →
GitHub

Test Result Analysis Pipeline

Consolidate test results, CI data, and E2E benchmarks into an Excel workbook.

1|3|Updated Feb 28, 2025
Search Tags:#llm#excel#issue-triage#test-results#ci-data#e2e-benchmarks#torch-ops-extraction
One-click install
npx skills add https://github.com/daisyden/ai_for_validation --skill test-result-analysis-pipeline
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: Test Result Analysis Pipeline
Source: https://github.com/daisyden/ai_for_validation/tree/main/opencode/issue_triage/test_result_analysis
Command: npx skills add https://github.com/daisyden/ai_for_validation --skill test-result-analysis-pipeline

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pandas, openpyxl, requests.

What problem does it solve?

This Skill automates the extraction and organization of test results, CI data, and E2E benchmarks into a unified issue-triage Excel workbook for streamlined analysis and remediation.

Core Features & Use Cases

  • Ingests and harmonizes test results from nightly and stock CI reports, parses XML, and populates Test_Cases and E2E sheets for comprehensive triage.
  • Extracts torch-ops from error messages and test names to populate the torch-ops column for dependency analysis.
  • Performs LLM-based test existence checks, dependency mapping via RAG, and cross-issue duplicate detection to support end-to-end triage workflows.
  • Integrates with issue-basic-info extraction, PR reference collection, and category analysis to maintain a cohesive triage pipeline.

Quick Start

Run the processor from the repository root to execute all steps in sequence.

Frequently Asked Questions about Test Result Analysis Pipeline

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I consolidate CI test results and E2E benchmarks into a single Excel workbook?▼

Consolidating CI test results and E2E benchmarks into a single Excel workbook is automated by a multi-step pipeline that parses XML reports, extracts torch-ops, and populates unified triage sheets for streamlined remediation.

Can I extract torch-ops from test names and error messages for dependency analysis?▼

Extracting torch-ops from test names and error messages is fully supported, populating a dedicated column to enable accurate dependency mapping and RAG-based scoring across the consolidated triage workbook.

How do I deduplicate cross-repo test issues using LLM-based checks?▼

Deduplicating cross-repo test issues is achieved through LLM-based existence checks and cross-issue linking, detecting duplicate failures across repositories to maintain a cohesive end-to-end triage workflow.

Does this test result analysis pipeline require pandas and openpyxl to run?▼

The test result analysis pipeline requires pandas, openpyxl, and requests to run, using them for data harmonization, Excel workbook generation, and CI data ingestion during the automated triage process.

What is the best way to track CI coverage and diagnose failing tests across repositories?▼

Tracking CI coverage and diagnosing failing tests is best handled by ingesting nightly CI reports, performing RAG-based dependency mapping, and integrating PR reference collection to build a comprehensive issue-triage workbook.

Related Skills

Explore More Data & Analytics Skills→
orekyuuorekyuu

junit-report-collector

Collect JUnit XML test reports and summarize pass, fail, and skip results.

Community
Intermediate
adriaanmostert1976-labadriaanmostert1976-lab

problem-to-workplan

Convert issue trees into modular Excel workplans with Gantt charts.

Community
Intermediate
AlamatorAlamator

issue-triage

Audit GitHub issues via gh CLI and draft validated triage actions.

Community
Advanced
felix-howardfelix-howard

ck:worktree

Create isolated Git worktrees with automated branch and dependency setup.

Community
Advanced