confidence-aggregator

Orchestrate container-based agent workflows across Loop 3 and Loop 2 with Redis state management.

14|2|Updated Sep 23, 2025
One-click install
npx skills add https://github.com/masharratt/claude-flow-novice --skill confidence-aggregator
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: confidence-aggregator
Source: https://github.com/masharratt/claude-flow-novice/tree/main/.claude/cfn-loop-orchestration-v2/lib/orchestrator/src/helpers/CONFIDENCE_AGGREGATOR.ts
Command: npx skills add https://github.com/masharratt/claude-flow-novice --skill confidence-aggregator

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

Provides aggregation, outlier detection, and confidence scoring for Loop 3 evaluator scores.

Core Features & Use Cases

  • IQR-based outliers: Detect outliers in scores.
  • Weighted averages: Allow weighting by agent importance.
  • Group by type: Analyze by agent type.

Quick Start

aggregateScores([{agentId:'a1',score:0.92,agentType:'backend'}]);

Frequently Asked Questions about confidence-aggregator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I aggregate confidence scores from multiple evaluators?

Aggregation combines scores from multiple agents into a single confidence metric. Pass an array of agent scores with their IDs and types to aggregateScores() to compute weighted averages and detect outliers, producing a unified confidence assessment.

How do I detect outliers in evaluator scores?

Outlier detection uses the interquartile range (IQR) method to identify anomalous scores. The Skill flags scores falling outside typical ranges, helping you exclude erratic evaluations from your final confidence calculation.

Can I weight scores by agent importance?

Yes, weighted averaging lets you assign importance factors to each agent before aggregation. Agents with higher weights contribute more to the final confidence score, letting you prioritize trusted or specialized evaluators.

How do I analyze confidence scores grouped by agent type?

Group-by-type analysis segments aggregated scores by agent category—backend, frontend, validator, etc. This reveals whether specific evaluation types consistently diverge, highlighting systematic biases or expertise gaps across your evaluation team.

What's the best way to handle conflicting scores across evaluators?

Combine outlier detection with weighted averaging to resolve conflicts. Remove statistical outliers first, then compute confidence using importance weights for remaining scores, producing a robust consensus that balances majority opinion with expert credibility.