skills.rest
dezverev
dezverevCOMMUNITY
Explore all skills by this author →
GitHub

analyze-test-json-claude

Analyze IntegrationTesterApp test-result JSON files for tool-call sequences and assertion outcomes.

Updated Jan 16, 2026
Search Tags:#prompt engineering#JSON#test results#recommendations#analyze#tool calls#flow analysis
One-click install
npx skills add https://github.com/dezverev/AnimalAL-v1 --skill analyze-test-json-claude
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: analyze-test-json-claude
Source: https://github.com/dezverev/AnimalAL-v1/tree/main/.claude/skills/analyze-test-json-claude
Command: npx skills add https://github.com/dezverev/AnimalAL-v1 --skill analyze-test-json-claude

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill analyzes IntegrationTesterApp test-result JSON files (test-results_.json, multi-model-results_.json) and provides in-depth flow, tool-call, and response analysis, plus actionable recommendations to improve test reliability.

Core Features & Use Cases

  • Flow & tooling visibility: maps prompts to actual tool calls and model responses, with assertion outcomes.
  • Cross-test insights: identifies recurring failure patterns across tests and models.
  • Actionable recommendations: suggests concrete changes to tests, test definitions, and plugin routing to prevent regressions.

Quick Start

Use the analyze-test-json command to generate a detailed report for a specific test-results file or for the latest available results in the test-results directory. Provide paths like test-results_20250126_120000.json or multi-model-results_20250126_120000.json to focus analysis on a single run.

Frequently Asked Questions about analyze-test-json-claude

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze JSON test results to find failing tool calls and prompt issues?▼

You can analyze JSON test results by mapping prompts to actual tool calls and model responses, then evaluating assertion outcomes to pinpoint failure points. This Skill processes test-results_*.json and multi-model-results_*.json files to generate in-depth flow analysis.

What are cross-test patterns in JSON test result analysis?▼

Cross-test patterns in JSON test result analysis are recurring failure trends identified across multiple tests and models. The Skill detects these patterns to highlight systemic issues in plugin routing or TestCaseDefinitions rather than isolated anomalies.

How do I get actionable recommendations to fix failing integration tests?▼

To get actionable recommendations for failing integration tests, the Skill analyzes JSON test-result flows and generates concrete changes for TestCaseDefinitions.cs, tests, and plugin routing. This guides targeted improvements to prevent future regressions.

Can I analyze the latest test-results JSON file without specifying the exact filename?▼

Yes, you can analyze the latest test-results JSON file without specifying the exact filename. The Skill supports 'latest' resolution to automatically locate and analyze the most recent test-results_*.json or multi-model-results_*.json run.

Does this tool work with multi-model test results JSON files?▼

Yes, this tool works with multi-model test results JSON files. It explicitly supports multi-model-results_*.json files located under src/IntegrationTesterApp/test-results/ to analyze and compare tool-call sequences across different models.

Related Skills

Explore More Data & Analytics Skills→
dezverevdezverev

check-test-logical-resp-claude

Identify logical inconsistencies in model responses that passed automated tests.

Community
Advanced
ref-docsref-docs

bug-hunter

Reproduce software bugs, analyze causes, and generate fix plans.

Official
Advanced
mpsuessermpsuesser
22

effect-ai-prompt

Constructs TypeDoc-style AI prompts for multi-turn conversations with roles, tools and attachments using Astro's API.

Community
Intermediate
itallstartedwithaideaitallstartedwithaidea
31

continuous-learning

Extracts successful session patterns and converts them into reusable, versioned skills via A/B testing.

Community
Advanced