Confidence Honesty

Enforce explicit confidence scoring and evidence audits before presenting conclusions.

Updated Dec 6, 2025
One-click install
npx skills add https://github.com/audunstrand/status-app --skill confidence-honesty
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: Confidence Honesty
Source: https://github.com/audunstrand/status-app/tree/main/.github/skills/confidence-honesty
Command: npx skills add https://github.com/audunstrand/status-app --skill confidence-honesty

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill enforces explicit confidence assessment before presenting conclusions to prevent unverified or overly confident claims.

Core Features & Use Cases

  • Explicit confidence scoring: Always present a percentage with a concise justification.
  • Evidence & assumption audit: Require listing direct evidence, explicit assumptions, and potential falsifiability checks before final output.
  • Falsifiability & validation: Enforce a structured checklist to validate conclusions and identify gaps in reasoning.

Quick Start

Use the skill to require a confidence percentage and explicit justification for any conclusion produced by an AI.

Frequently Asked Questions about Confidence Honesty

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I enforce explicit confidence assessment before an AI presents conclusions?

To enforce explicit confidence assessment, you require the AI to present a confidence percentage with a concise justification before outputting conclusions. This prevents unverified or overly confident claims by mandating structured self-validation checks.

What is falsifiability checking in AI-generated analysis?

Falsifiability checking in AI analysis is a validation step that identifies potential gaps in reasoning and tests if conclusions can be proven false. It enforces a structured checklist to validate outputs and list direct evidence before finalizing results.

How do I audit assumptions and evidence in decision-support prompts?

You audit assumptions and evidence in decision-support prompts by requiring the AI to explicitly list direct evidence, state all assumptions, and perform a self-validation check. This structured audit ensures conclusions are data-backed and honestly evaluated.

Why does my AI output overly confident claims without evidence?

AI outputs overly confident claims without evidence when prompts lack explicit confidence scoring and evidence listing requirements. Forcing a mandatory 'Why not 100%' explanation and structured self-validation prevents unverified assertions in investigative analyses.

Can I apply confidence scoring to investigative analyses?

Yes, you can apply confidence scoring to investigative analyses by enforcing explicit evidence listing, assumption audits, and falsifiability checks across decision-support prompts. This ensures all analytical outputs include a percentage score and a concise justification.