aicp-ops-metrics

Provide live and historical AICP metrics for LocalAI, GPU, and per-backend performance.

Updated Mar 26, 2026
One-click install
npx skills add https://github.com/cyberpunk042/devops-expert-local-ai --skill aicp-ops-metrics
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: aicp-ops-metrics
Source: https://github.com/cyberpunk042/devops-expert-local-ai/tree/main/.claude/skills/aicp-ops-metrics
Command: npx skills add https://github.com/cyberpunk042/devops-expert-local-ai --skill aicp-ops-metrics

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill provides both live and historical visibility into AICP performance and resource usage, enabling operators to quickly diagnose health, throughput, and cost implications from the CLI.

Core Features & Use Cases

  • Live snapshot: view LocalAI metrics, GPU utilization, and API call statistics with aicp --metrics.
  • Aggregated history: inspect per-backend task counts, average latency, and token/cost trends via aicp --stats.
  • Health and trending: generate trend analysis with aicp --health-report to spot regressions and verify baseline targets.

Quick Start

Run aicp --metrics to display the current Live metrics (LocalAI, GPU, API) and confirm system health.

Frequently Asked Questions about aicp-ops-metrics

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I monitor LocalAI performance and GPU usage from the CLI?

You can monitor LocalAI performance and GPU usage from the CLI by running aicp --metrics to display a live snapshot of current API call statistics and resource utilization.

Can I check historical API latency and token cost trends for my backends?

Yes, you can check historical API latency and token cost trends by running aicp --stats, which provides aggregated history of per-backend task counts and average latency.

What is the best way to spot health regressions in AICP performance?

The best way to spot health regressions in AICP performance is to generate trend analysis using aicp --health-report, which helps verify baseline targets and identify system anomalies.

Does this tool support telemetry integration with Prometheus?

The tool provides real-time and historical visibility into AICP performance metrics, applicable when assessing LocalAI health and per-backend performance across live and historical views.

How do I diagnose throughput and cost implications for my AI operations?

You diagnose throughput and cost implications by inspecting telemetry data through live snapshots via --metrics and aggregated historical trends via --stats to quickly assess system health.

Can I use this to assess per-backend performance for LocalAI?

Yes, you can assess per-backend performance for LocalAI by viewing aggregated history with aicp --stats to inspect task counts, average latency, and token trends across backends.