Calibrate AI advice confidence to match evidence quality and recency.
npx skills add https://github.com/fydel-ai/judgment-guard --skill judgment-guard
Please help me install this Agent Skill. Skill: judgment-guard Source: https://github.com/fydel-ai/judgment-guard/tree/main Command: npx skills add https://github.com/fydel-ai/judgment-guard --skill judgment-guard
Judgment-guard prevents AI advice from sounding more certain than the supporting evidence justifies, reducing overconfidence on high-stakes decisions.
Use judgment-guard to rewrite a draft recommendation with confidence matched to evidence for your consequential decision prompt.
High-intent search queries and answers about installing and using this skill.
Calibrating AI advice confidence involves evaluating evidence strength and recency, surfacing hidden assumptions, and rewriting the recommendation so its expressed certainty matches what the supporting evidence actually justifies on consequential decisions.
Evidence-to-confidence calibration is a decision audit mechanism that grades evidence quality on consequential topics like money, health, and legal issues, then adjusts the recommendation's expressed certainty to prevent overconfidence and surfaces hidden assumptions.
You surface hidden assumptions in AI recommendations by mapping fact vs inference, making unspoken premises explicit so users can evaluate the reasoning. This assumption mapping is integrated into a structured decision-audit style output for verification.
Yes, confidence calibration applies to recommendations, comparisons, and prioritization on consequential topics such as money, health, career, legal, safety, and purchases. It applies different rewriting strategies based on whether the evidence scenario is strong, mixed, or weak.
Limitations of evidence grading include its reliance on evaluating epistemic authority and detecting false consensus; the calibrated output remains constrained by available evidence quality and cannot manufacture certainty beyond what the supporting evidence actually justifies.
johngutierrez31Generate persisted Evidence Map records from questionnaire drafts and approved answers.
nguyenpv1980-wqVerify AI factual claims against authoritative sources and citations.
DTMC-marketplaceExtract verifiable claims and generate true/false verdicts using Google Fact Check Tools.
Forexgod21Disclose confidence levels before accepting high-stakes delegated tasks.
