caveman-evidence-review

Review Caveman Cloud cost, trace, and savings evidence read-only.

Updated Aug 20, 2026
One-click install
npx skills add https://github.com/bittlinkm/claude-setup --skill caveman-evidence-review-bittlinkm
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: caveman-evidence-review
Source: https://github.com/bittlinkm/claude-setup/tree/main/skills/caveman-evidence-review
Command: npx skills add https://github.com/bittlinkm/claude-setup --skill caveman-evidence-review-bittlinkm

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? It answers questions about LLM spend, quality changes, and workflow issues using current Caveman Cloud evidence instead of guesses, while keeping measured cost, inferred headroom, and verified savings strictly separate. ## Core Features & Use Cases - Baseline reporting: Loads overview, costs, Cave Score, workflows, and verified savings reports scoped to the selected project. - Trace-based investigation: Searches and inspects bounded trace cohorts by workflow, model, session, latency, errors, and compression to test explanations against control windows. - Structured evidence report: Produces findings with cited trace ids, time windows, unproven hypotheses, and a next read-only check. - Use Case: When LLM costs spike, use it to identify which workflow or model mix drove the change, compare against a control window, and report verified savings separately from inferred headroom. ## Quick Start Ask the assistant to review what Caveman found about this project's LLM costs and failing workflows over the past week.

Frequently Asked Questions about caveman-evidence-review

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I review LLM costs and traces with Caveman Cloud?

Load context with caveman_context, pull baseline reports via caveman_report for costs, score, and workflows, then test explanations with caveman_trace_search and inspect representative traces with caveman_trace_get. CLI fallbacks like caveman cloud costs and traces search work when MCP is unavailable.

What is the difference between measured cost, inferred headroom, and verified savings?

Measured cost is provider-complete list-price spend, inferred headroom is a per-day estimate of possible savings, and verified savings come from the ledger. The skill keeps these buckets separate and never adds or relabels them.

Can this skill start or roll back Caveman experiments?

No. It is strictly read-only and never starts, approves, cancels, or rolls back experiments. Proposed actions are listed as suggestions only and deferred to a separate management skill with a safety gate.

Does the review fetch prompt or completion payloads?

Not by default. It uses metadata, spans, timing, models, token counts, status, and optimizer attribution. Payload retrieval only happens when the user explicitly asks for payload review.

What happens if Caveman login or project selection is missing?

The review stops and asks the user to run caveman login or select a project. It never guesses an organization id and scopes every read to the project selected by Caveman context.