llm-council

Query multiple LLMs in parallel and synthesize consensus-based answers.

12.6k|1.5k|Updated Feb 3, 2026
One-click install
npx skills add https://github.com/nearai/ironclaw --skill llm-council-nearai
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: llm-council
Source: https://github.com/nearai/ironclaw/tree/main/skills/llm-council
Command: npx skills add https://github.com/nearai/ironclaw --skill llm-council-nearai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps reduce uncertainty in AI answers by generating a second opinion from multiple LLMs and cross-referencing their outputs into a more reliable result.

Core Features & Use Cases

  • Parallel multi-model querying: Uses llm_query_batched to run the same prompt across different models concurrently for faster comparative coverage.
  • Backend-aware model routing: Supports true cross-vendor “council” behavior on aggregator backends (notably NEAR AI) while providing guidance when a backend can’t honor per-call model overrides.
  • Disagreement-aware synthesis: Guides you to identify consensus, flag divergences, and produce a unified answer while attributing insights to specific models.
  • Second-opinion research: Useful for evaluation, risk analysis, and any scenario where different reasoning styles improve confidence.

Quick Start

Ask your assistant to run a council for your question by querying the configured default lineup and synthesizing a final answer that highlights consensus and disagreements.

Frequently Asked Questions about llm-council

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I get a consensus answer from multiple LLMs?▼

Multi-model consensus reduces LLM uncertainty by querying multiple models in parallel and cross-referencing their responses to synthesize a single, more reliable answer. It identifies agreement, flags divergence, and attributes insights to specific models.

Can I compare different LLMs by running parallel inference on the same prompt?▼

You compare different LLMs by running the same prompt across multiple models concurrently using batched querying. This parallel inference allows you to directly cross-reference outputs for model comparison and second-opinion evaluation.

How do I get a second opinion on an AI-generated answer?▼

To get a second opinion on an AI answer, you query a council of multiple LLMs with your prompt. The system cross-references the diverse reasoning styles and outputs a synthesized answer with improved confidence.

Does cross-vendor model querying work on all backends?▼

Cross-vendor model querying works on aggregator backends like NEAR AI that honor per-call model overrides. If a backend lacks this support, the system provides guidance for handling the limitation.

What is the best way to identify disagreements between AI models?▼

The best way to identify disagreements between AI models is to query them in parallel and apply post-processing to their responses. This flags divergences and attributes specific insights to each model.