skywatch-triage-rule-hits

Sample Osprey rule hits and classify outcomes for health assessment.

6|Updated Feb 21, 2026
One-click install
npx skills add https://github.com/skywatch-bsky/skywatch-agent-skills --skill skywatch-triage-rule-hits
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: skywatch-triage-rule-hits
Source: https://github.com/skywatch-bsky/skywatch-agent-skills/tree/main/polytoken/skills/skywatch-triage-rule-hits
Command: npx skills add https://github.com/skywatch-bsky/skywatch-agent-skills --skill skywatch-triage-rule-hits

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill addresses the manual burden of evaluating Osprey rule performance by automating the sampling, classification, and health assessment of rule hits.

Core Features & Use Cases

  • Stratified Sampling: Automatically pulls representative hit samples across a specified time window to ensure accurate rule behavior analysis.
  • Classification Schema: Provides a structured framework to categorize hits as true positives, false positives, novel patterns, or uncertain, with built-in pattern grouping.
  • Actionable Reporting: Generates a comprehensive triage summary including rule health status and specific recommendations for rule maintenance or evolution.

Quick Start

Use the skywatch-triage-rule-hits skill to analyze the election_misinfo_en rule for the past 30 days with a sample size of 50 hits.

Frequently Asked Questions about skywatch-triage-rule-hits

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate triage and health checks for Osprey rule hits?

Automating Osprey rule triage involves sampling execution data and classifying outcomes to identify rule drift and false positive patterns. This skill streamlines the process by pulling representative hit samples and generating actionable rule maintenance recommendations.

What is the best way to classify false positives during Osprey rule validation?

Classifying false positives during rule validation requires a structured framework to categorize hits as true positives, novel patterns, or uncertain. This skill provides a built-in classification schema with pattern grouping to systematically assess rule behavior over a specified time window.

Do I need osprey_execution_results to analyze rule drift and false positive patterns?

Yes, analyzing rule drift and false positive patterns requires access to osprey_execution_results. The skill uses this execution data to perform aggregate statistical analysis and generate comprehensive triage summaries for ongoing maintenance workflows.

Can I stratify sampling for Osprey rules across a specific time window?

Yes, you can stratify sampling for Osprey rules across a specific time window. The skill automatically pulls representative hit samples to ensure accurate rule behavior analysis, such as analyzing 50 hits over the past 30 days.

Why does my Osprey rule validation workflow need integration with data-analyst dispatch tools?

Osprey rule validation requires integration with data-analyst dispatch tools to perform aggregate statistical analysis on sampled execution data. This integration enables the automated classification of outcomes and the generation of comprehensive rule health status reports.

What recommendations are generated after assessing Osprey rule health status?

After assessing Osprey rule health status, the skill generates a comprehensive triage summary with specific recommendations for rule maintenance or evolution. These actionable reports help identify novel detection opportunities and correct rule drift.