What problem does it solve?
This Skill provides a comprehensive dashboard for monitoring the health of skills, including invocation counts, success rates, failure patterns, and overall status. It reads JSONL logs and qualitative observations to report on skill performance without modifying them.
Core Features & Use Cases
- Skill Invocation Metrics: Track the number of times a skill is invoked and its success rate.
- Health Status Analysis: Assess the health of skills by analyzing failure patterns and trends over time.
- Qualitative Observations: Review qualitative observations for any issues or concerns.
- Trend Detection: Identify trends such as declining or improving health status over time.
- Label Distribution: Analyze the distribution of labels associated with skills to identify potential issues.
- Failures-Only Mode: Filter and display only error/partial entries in the period, grouped by skill.
- Label Reconciliation: Reconcile logged labels against the on-disk skill list to ensure accurate health reporting.
- Dead Skill Detection: Identify skills with zero invocations over a long period as dormant for further review.
- Weekly Review Trigger: Suggest running the weekly review protocol if it has been more than 7 days since the last review.
Quick Start
Run the skill health assessment and present results for all skills.