llm-council

Query multiple LLMs in parallel and synthesize consensus-based answers.

12.6k|1.5k|Updated Feb 3, 2026
One-click install
npx skills add https://github.com/nearai/ironclaw --skill llm-council-nearai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: llm-council
Source: https://github.com/nearai/ironclaw/tree/main/skills/llm-council
Command: npx skills add https://github.com/nearai/ironclaw --skill llm-council-nearai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps reduce uncertainty in AI answers by generating a second opinion from multiple LLMs and cross-referencing their outputs into a more reliable result.

Core Features & Use Cases

  • Parallel multi-model querying: Uses llm_query_batched to run the same prompt across different models concurrently for faster comparative coverage.
  • Backend-aware model routing: Supports true cross-vendor “council” behavior on aggregator backends (notably NEAR AI) while providing guidance when a backend can’t honor per-call model overrides.
  • Disagreement-aware synthesis: Guides you to identify consensus, flag divergences, and produce a unified answer while attributing insights to specific models.
  • Second-opinion research: Useful for evaluation, risk analysis, and any scenario where different reasoning styles improve confidence.

Quick Start

Ask your assistant to run a council for your question by querying the configured default lineup and synthesizing a final answer that highlights consensus and disagreements.

Frequently Asked Questions about llm-council

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I get a consensus answer from multiple LLMs?

Multi-model consensus reduces LLM uncertainty by querying multiple models in parallel and cross-referencing their responses to synthesize a single, more reliable answer. It identifies agreement, flags divergence, and attributes insights to specific models.

Can I compare different LLMs by running parallel inference on the same prompt?

You compare different LLMs by running the same prompt across multiple models concurrently using batched querying. This parallel inference allows you to directly cross-reference outputs for model comparison and second-opinion evaluation.

How do I get a second opinion on an AI-generated answer?

To get a second opinion on an AI answer, you query a council of multiple LLMs with your prompt. The system cross-references the diverse reasoning styles and outputs a synthesized answer with improved confidence.

Does cross-vendor model querying work on all backends?

Cross-vendor model querying works on aggregator backends like NEAR AI that honor per-call model overrides. If a backend lacks this support, the system provides guidance for handling the limitation.

What is the best way to identify disagreements between AI models?

The best way to identify disagreements between AI models is to query them in parallel and apply post-processing to their responses. This flags divergences and attributes specific insights to each model.