analyzing-skill-usage

You can measure skill performance by providing recent session transcripts to extract invocation patterns, completion rates, and correction signals, resulting in a comparative per-skill performance report.

Yes, you can A/B test skill variants using session transcripts because the analysis implements version awareness to compare invocation patterns and completion rates across different skill versions.

The best way to identify weak skills across user sessions is to extract correction signals and completion rates from transcripts, surfacing actionable insights and recommended next steps for improvement.

You extract skill invocation patterns from chat transcripts by applying an extraction protocol that detects completion and correction signals, tracks versions, and calculates per-skill scoring metrics.

Metrics for evaluating skill performance from transcripts include per-skill invocation patterns, completion rates, correction rates, and efficiency metrics, which collectively surface weak skills for data-driven decision making.