confidence-calibration-check

Compare confidence ratings before and after learning attempts to identify calibration patterns.

583|96|Updated Mar 1, 2026
One-click install
npx skills add https://github.com/GarethManning/education-agent-skills --skill confidence-calibration-check
Or copy as Structured Prompt for Agentβ–Ό
Please help me install this Agent Skill.
Skill: confidence-calibration-check
Source: https://github.com/GarethManning/education-agent-skills/tree/main/skills/student-learning/confidence-calibration-check
Command: npx skills add https://github.com/GarethManning/education-agent-skills --skill confidence-calibration-check

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Many learners feel confident because material feels familiar, even when they cannot accurately recall or apply it, leading to ineffective study choices.

Core Features & Use Cases

  • Before/After Confidence Capture: Records a 0–100 confidence rating prior to a learning attempt and repeats it after feedback.
  • Performance Evaluation and Pattern Naming: Compares confidence to observed accuracy and explicitly labels overconfidence, underconfidence, well-calibration, or large confidence drop.
  • Metacognitive Micro-Goal: Turns the calibration gap into one concrete next action to improve future learning decisions.

Use when a student is practicing explanations, solving problems, or reviewing knowledge and you want them to develop accurate self-monitoring rather than relying on feelings of familiarity.

Quick Start

Ask the learner for a 0–100 confidence estimate before they attempt the topic or question, then have them attempt it and ask for an updated confidence rating after you review how accurate their attempt was.

Frequently Asked Questions about confidence-calibration-check

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fix overconfidence when studying new material?β–Ό

Overconfidence when studying stems from relying on familiarity rather than actual recall. You can address this by capturing a 0–100 confidence rating before a practice attempt and comparing it directly against your observed accuracy to expose the gap.

What is confidence calibration in student self-monitoring?β–Ό

Confidence calibration in student self-monitoring is the process of aligning perceived confidence with actual knowledge. It works by recording confidence ratings before and after a learning attempt to explicitly label patterns like overconfidence or underconfidence.

How do I measure confidence before and after a practice problem?β–Ό

To measure confidence before and after a practice problem, ask the learner for a 0–100 confidence estimate prior to attempting the question, review their accuracy, and then record an updated confidence rating to evaluate the resulting calibration pattern.

Can I use confidence calibration for any study context or subject?β–Ό

Yes, you can use confidence calibration for any study context. It applies broadly to student self-monitoring tasks like explaining concepts from memory, solving practice problems, and responding to feedback, requiring only an input topic and context.

What is the best way to turn a metacognitive gap into a study action?β–Ό

The best way to turn a metacognitive gap into a study action is to generate a concrete micro-goal. By comparing confidence ratings against actual performance to identify overconfidence or underconfidence, you define one specific next action to improve future learning decisions.