kai_measurement
CommunityMeasure and monitor KAI performance metrics
Authorgatovillano
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill provides a pipeline for measuring and monitoring the performance metrics of the KAI system, ensuring the quality and reliability of its responses.
Core Features & Use Cases
- Metric Measurement: Monitors key metrics such as hallucination rate, recall@5, and tool success rate.
- Benchmarking: Executes a suite of benchmarks to evaluate KAI's performance.
- Quick Start: Run the measurement pipeline with a single command to get insights into KAI's performance.
Quick Start
Execute the measurement pipeline using the command: python3 run_measurement_pipeline.py
Dependency Matrix
Required Modules
aiohttpprometheus-clientasynciostatistics
Components
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: kai_measurement Download link: https://github.com/gatovillano/KognitoAI/archive/main.zip#kai-measurement Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.