analyzing-skill-usage

Name: analyzing-skill-usage
Availability: InStock
Author: axiomantic

Analyze session transcripts to extract invocation patterns and per-skill scores.

8|5|Updated Dec 30, 2025

Search Tags:#metrics #reporting #skill #transcripts #analyze #ab-testing

Ready to run

npx skills add https://github.com/axiomantic/spellbook --skill analyzing-skill-usage

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: analyzing-skill-usage
Source: https://github.com/axiomantic/spellbook/tree/main/skills/analyzing-skill-usage
Command: npx skills add https://github.com/axiomantic/spellbook --skill analyzing-skill-usage

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill helps teams evaluate how effectively skills perform across sessions by extracting invocation patterns, completion rates, and correction signals from transcripts.

Core Features & Use Cases

Analyzes session transcripts to extract per-skill invocation patterns, completion rates, correction rates, and efficiency metrics.
Supports version awareness for A/B analysis and produces per-skill performance reports to drive improvements.
Enables data-driven decision making by surfacing weak skills and recommended next steps with actionable insights.

Quick Start

Provide recent session transcripts and request a comparative per-skill performance report.

Frequently Asked Questions about analyzing-skill-usage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I analyze session transcripts to measure skill performance?▼

You can measure skill performance by providing recent session transcripts to extract invocation patterns, completion rates, and correction signals, resulting in a comparative per-skill performance report.

Can I use session transcripts for A/B testing skill variants?▼

Yes, you can A/B test skill variants using session transcripts because the analysis implements version awareness to compare invocation patterns and completion rates across different skill versions.

What is the best way to identify weak skills across user sessions?▼

The best way to identify weak skills across user sessions is to extract correction signals and completion rates from transcripts, surfacing actionable insights and recommended next steps for improvement.

How do I extract skill invocation patterns from chat transcripts?▼

You extract skill invocation patterns from chat transcripts by applying an extraction protocol that detects completion and correction signals, tracks versions, and calculates per-skill scoring metrics.

What metrics are used for evaluating skill performance from transcripts?▼

Metrics for evaluating skill performance from transcripts include per-skill invocation patterns, completion rates, correction rates, and efficiency metrics, which collectively surface weak skills for data-driven decision making.