recall-evals
OfficialEvaluate recall quality of knowledge base
Software Engineering#knowledge base#recall evaluation#precision measurement#memory performance#PHI exclusion
AuthorInnerScopeHearing
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill provides a recall-quality eval harness for the knowledge base, ensuring high precision and recall of durable, non-PHI facts without affecting the ledger or memory.
Core Features & Use Cases
- Evaluation of Recall Quality: Scores precision@k, hit-rate, and MRR for known durable facts.
- Non-PHI ring; PHI-excluded: Operates only in the Non-PHI ring, hard-guarding against PHI content.
- Measurement-based Adjustments: Measures memory/recall changes and suggests improvements based on data.
Quick Start
Use the 'skills/kb-memory/run.sh' script to run the recall-evals skill for measuring recall quality with 'node skills/recall-evals/run-evals.mjs'.
Dependency Matrix
Required Modules
None requiredComponents
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: recall-evals Download link: https://github.com/InnerScopeHearing/otchealth-claude-tools/archive/main.zip#recall-evals Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.