skills.rest
shepard-system
shepard-systemOFFICIAL
Explore all skills by this author →
WebsiteGitHub

obs-tools

Analyze AI tool invocation metrics from Prometheus data over 24 hours.

70|6|Updated Feb 23, 2026
Search Tags:#security audit#observability#prometheus#tool usage#performance monitoring#error rates
One-click install
npx skills add https://github.com/shepard-system/shepard-obs-stack --skill obs-tools
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: obs-tools
Source: https://github.com/shepard-system/shepard-obs-stack/tree/main/.claude/skills/obs-tools
Command: npx skills add https://github.com/shepard-system/shepard-obs-stack --skill obs-tools

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides insights into tool usage, error rates, and sensitive data access, helping you understand and optimize your AI assistant's operations.

Core Features & Use Cases

  • Tool Usage Statistics: View top tools by call count, breakdown by provider, and usage by repository.
  • Error Rate Monitoring: Identify tools with high error percentages.
  • Security Auditing: Track sensitive file access attempts.
  • Use Case: If you notice a dip in productivity or an increase in errors, use this skill to pinpoint which tools are underperforming or causing issues.

Quick Start

Show me the top 15 tools by call count in the last 24 hours.

Frequently Asked Questions about obs-tools

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I monitor AI tool invocation metrics and error rates?▼

Security auditing for AI tools tracks sensitive file access attempts alongside invocation metrics. It analyzes Prometheus data over the last 24 hours to identify repositories with high-risk usage and sensitive data access.

Can I check tool usage statistics by provider and repository?▼

To identify tools with high error percentages, you analyze error rate monitoring data from Prometheus. This process scopes the last 24 hours of data to pinpoint which specific tools are underperforming or causing issues.

What is the best way to audit sensitive file access for AI-driven tool interactions?▼

Yes, Prometheus data is the required source for this operational monitoring. The analysis exclusively scopes to Prometheus data from the last 24 hours to detail tool performance, provider distribution, and repository-specific usage.

Why does tracking tool performance over the last 24 hours help optimize operations?▼

You can view the top 15 tools by call count in the last 24 hours by requesting a tool usage statistics report. This analysis evaluates Prometheus data to rank tools by invocation frequency and provider distribution.

Related Skills

Explore More Software Engineering Skills→
onymchatonymchat

sensorkit

Collect authorized sensor data from iOS and watchOS devices for research studies.

Official
Advanced
kessleriokesslerio
3

fitbit-analytics

Fetch Fitbit metrics and generate automated health reports and alerts.

Community
Advanced
tygwantygwan
1

analytics

Aggregate and visualize CLI tool usage statistics from telemetry metrics.

Community
Intermediate
akashp1712akashp1712
1

prompt-guard

Detect prompt injection patterns and reject them with a fixed block message.

Community
Advanced