ai-socratic-dialogue-designer

Design multi-round Socratic questioning sequences to detect sycophantic AI answer drift.

583|96|Updated Mar 1, 2026
One-click install
npx skills add https://github.com/GarethManning/education-agent-skills --skill ai-socratic-dialogue-designer
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ai-socratic-dialogue-designer
Source: https://github.com/GarethManning/education-agent-skills/tree/main/skills/ai-literacy/ai-socratic-dialogue-designer
Command: npx skills add https://github.com/GarethManning/education-agent-skills --skill ai-socratic-dialogue-designer

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps teachers design a structured multi-round questioning activity that reveals whether an AI’s answer changes due to genuine logical concession or due to sycophantic capitulation after student pushback.

Core Features & Use Cases

  • Multi-round Socratic interrogation design: Produces a repeatable sequence (baseline → evidence probe → assumption probe → perspective challenge → optional pushback test) tailored to how AI responses drift.
  • Answer drift tracking protocol: Gives students a simple table and guidance for recording changes in position, evidence, certainty language, and reasoning shifts across rounds.
  • Capitulation taxonomy for interpretation: Classifies observed behaviors (e.g., pure agreement, partial retreat, certainty softening) and contrasts them with genuine logical updates.
  • Use cases: Best for AI-literacy lessons where students must evaluate whether “the AI agreed after I argued” actually means they provided a logical reason.

Quick Start

Use the ai-socratic-dialogue-designer skill to generate a 4–5 round AI questioning sequence for the claim the students will probe, including a drift-tracker template and a capitulation-vs-update debrief guide.

Frequently Asked Questions about ai-socratic-dialogue-designer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I teach students to identify AI sycophancy during classroom activities?

You can design a multi-round Socratic questioning sequence that interrogates AI chatbot answers to distinguish genuine logical updates from sycophantic capitulation, applying a structured round plan and an answer drift tracking protocol.

What is the best way to track answer drift when questioning an AI chatbot?

The best way to track answer drift is using a tracking protocol table that records changes in position, evidence, certainty language, and reasoning shifts across iterative Socratic questioning rounds to evaluate AI behavior.

Can I structure a Socratic dialogue to test if an AI changed its answer due to logic or capitulation?

Yes, you can structure a dialogue sequence using baseline, evidence probe, assumption probe, perspective challenge, and optional pushback test rounds to evaluate whether an AI changed its answer due to logic or capitulation.

How do I classify AI behavior changes during a critical thinking exercise?

You classify AI behavior changes using a capitulation taxonomy that categorizes observed behaviors like pure agreement, partial retreat, and certainty softening, explicitly contrasting them with genuine logical updates.

Does this Socratic questioning approach require an explicit disagreement test?

Yes, the Socratic questioning approach requires an explicit disagreement-only test within its capitulation taxonomy to accurately determine whether AI behavior represents a true logical concession or mere sycophantic capitulation.

When do I need a capitulation taxonomy for AI literacy lessons?

You need a capitulation taxonomy for AI literacy lessons when students must evaluate whether an AI agreed after an argument because of a valid logical reason or simply due to sycophantic behavior.