delphi-method

Aggregates anonymous expert judgments into consensus estimates using iterated Delphi rounds with median and IQR feedback.

4|1|Updated Jul 30, 2026
One-click install
npx skills add https://github.com/radarist/structured-analytic-skills --skill delphi-method-radarist
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: delphi-method
Source: https://github.com/radarist/structured-analytic-skills/tree/main/skills/delphi-method
Command: npx skills add https://github.com/radarist/structured-analytic-skills --skill delphi-method-radarist

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve? When no dataset can answer a question and judgment is the best evidence available, unstructured group discussion lets seniority and the loudest voice set the number. This Skill runs the RAND Delphi method — anonymous panelists, iterated rounds, controlled feedback of the group median and interquartile range — so expert estimates converge on merit, or the disagreement is honestly mapped instead of averaged away. ## Core Features & Use Cases - Structured panel elicitation: Defines a scoped scalar question, selects a heterogeneous panel of 7–30 experts, and runs blind round-1 elicitation followed by anonymous feedback of the median, IQR, and outlier rationales. - Stability-based stopping rule: Stops rounds when fewer than 15% of panelists revise (Scheibe, Skutsch & Schofer, 1975), never on forced unanimity, and refuses to average a bimodal split. - Deterministic companion tool: scripts/delphi.py (Python 3.9+, standard library only) computes median, Q1/Q3, IQR, outlier flags, inter-round stability verdicts, and Kendall's W for ranked items, with a hand-verified self-test. - Use Case: A leadership team needs a defensible date for when fault-tolerant quantum computing reaches commercial advantage. Convene an eight-expert panel, run three anonymous rounds, and report the 2035.5 median with a 2034.5–2038.5 band plus the unanswered dissenting argument. ## Quick Start Use the delphi-method skill to run an anonymous multi-round expert panel on when our product category reaches maturity, and report the median estimate with its interquartile range and the strongest dissenting view.

Frequently Asked Questions about delphi-method

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run a Delphi study with expert panelists?▼

Scope the question to a single scalar with a unit and date, recruit 7–30 heterogeneous experts, and collect blind round-1 estimates with rationales. Feed back the anonymized median and IQR each round, then stop when fewer than 15% of panelists revise their estimates.

How to compute median, IQR, and stability for Delphi rounds in Python?▼

Run scripts/delphi.py with the aggregate command on a round JSON file to get n, median, Q1, Q3, IQR, and outlier rationales. Use the stability command with two round files to get the percentage of panelists who changed and a STABLE or MOVING verdict at the 15% level.

When should I use Delphi instead of scenario planning or a single forecast?▼

Use Delphi when expert judgment is the best available evidence and you need one aggregated estimate with its spread. Use scenario planning when the question branches into divergent futures, and a single dated forecast when one accountable reasoner should own the prediction.

Does the Delphi method require any external Python packages?▼

No. The companion script delphi.py uses only the Python standard library and runs on Python 3.9 or later. It accepts JSON round files and includes a --selftest flag with hand-verified checks.

What are the limitations of the Delphi method for forecasting?▼

Rowe and Wright's review finds Delphi beats unstructured groups and first-round averages, but the advantage is modest and inconsistent. A misinformed panel aggregates its ignorance, forced consensus manufactures agreement nobody holds, and panels attrit beyond three or four rounds.

Why should a bimodal Delphi panel not be averaged?▼

Averaging two peaks produces a value no expert actually holds, destroying the real finding. Report both positions with their reasoning and hand the split to scenario planning as separate branches instead.