conversation-evaluator

What problem does it solve?

Evaluate virtual agent conversations for quality across coherence, accuracy, slot filling, and hallucination detection, enabling teams to identify weaknesses and drive improvements.

Core Features & Use Cases

• Coherence analysis: assess logical flow and context retention across turns.
• Accuracy verification: ensure responses align with ServiceNow data and KBs.
• Slot filling validation: verify mandatory inputs are captured correctly.
• Quality scoring: generate per-dimension and aggregate scores for audits.
• Use case: audit virtual agent performance and guide topic design improvements.

Quick Start

Load this skill and run a quality evaluation on recent conversations.