03 · SelectDiverge + converge✦ AI plays: Simulator
Delphi Method
Gather anonymous expert views in rounds, sharing the results each time, until the group converges.
Best for
Building expert consensusforecasts, priorities, guidelines
Time
Days to weekstwo to four rounds, a week or so each
People
Best in a teama panel of experts, often 10–30
Difficulty
Advancedneeds a careful, neutral facilitator
Origin
RAND Corporation, 1950sfirst used for defense forecasting
01 What it is
Expert judgment in rounds, without the loudest voice winning.
1234
Put a group of experts in one room and the result often reflects rank, confidence and who speaks first. The Delphi method avoids the room altogether. A facilitator sends the same questions to each expert, who answers alone and anonymously. The answers are combined into a summary and sent back to everyone, and the experts answer again, now knowing what the group thinks.
Round by round, people reconsider. Some move toward the group view; others hold firm and explain why, which is valuable too. After two to four rounds you usually have either a clear consensus or a well-understood disagreement. Because no one knows who said what, people can change their minds without losing face, and a quiet specialist counts as much as a famous name.
Use it when you need informed judgment where hard data is thin, when experts are spread across places or schedules, or when status and strong personalities would distort a face-to-face meeting.
Where it comes from. The method was developed at the RAND Corporation in the 1950s by Olaf Helmer, Norman Dalkey and colleagues, first to forecast the effects of technology on warfare. It takes its name from the ancient Greek oracle at Delphi.
Each round, experts answer alone, see the group's anonymous summary and reconsider. Two to four rounds is typical.
Choose a part of the diagram or a tab to explore each stage.
1
Send the questions
The same questions to every expert
What exactly do you want the panel to judge, estimate or prioritize this round?
Round 1 can be open: “What are the main factors?”
Later rounds ask people to rate or re-estimate specific items
Keep it short: clear questions get better answers
ER nurse staffingRound 1: “How many ER nurses will our hospital need by 2030, and why?”
2
Experts answer alone
Privately, anonymously, with reasons
What does each expert think before seeing anyone else's view?
Each expert replies separately, in writing
No one sees who said what
Ask for a short reason with every rating or estimate
ER nurse staffingFifteen private replies, ranging from 40 to 85 nurses, each with a reason.
3
Summarize anonymously
The group view, the spread and key reasons
What does the group think, and how far apart are people?
Report the middle value (median) and the spread
Group open answers into themes, with no names
Pull out the strongest reasons on each side
ER nurse staffingMedian: 62 nurses, with the middle half between 55 and 70. Main reasons: older patients, longer stays.
4
Feed back and check
Share the summary; stop when views settle
Seeing the group's view, would anyone change their answer, and has the panel converged?
Send the summary out with the next round's questions
Ask experts far from the group to explain their view
Stop when answers barely move between rounds
ER nurse staffingThe low outlier explains a planned urgent-care center. Several experts revise down; round 3 settles at 58.
02 Why it works
Why anonymous rounds produce better judgment
Delphi was designed to capture a group's knowledge without the usual costs of group meetings.
1
Anonymity removes rank
In a meeting, the most senior or confident person often sets the direction. With anonymous answers, an idea is judged on its reasoning, not on who said it. Junior experts and quiet specialists count as much as anyone.
2
Feedback lets people learn
Seeing the group's view, and the reasons behind it, gives each expert new information. Some update their answer; others hold firm and explain why. Either way, each round is better informed than the last.
3
Changing your mind is safe
Backing down in public is hard. Because no one knows who gave which answer, experts can quietly revise their view without the social cost of admitting they were wrong.
4
Distance is no obstacle
Experts never need to be in the same place at the same time. A panel can include people from different cities, organizations and time zones, bringing in a wider range of knowledge than one meeting room could.
03 How to use it
Run a Delphi study in six steps
Frame the question 1–2 days
Write the problem clearly: a forecast, a set of priorities or a guideline to agree on. Decide in advance what counts as agreement, such as three quarters of the panel rating an item 4 or 5 out of 5.
Recruit the panel 1 week
Invite people with relevant and varied expertise, often 10 to 30 of them. Explain the time commitment, the number of rounds and how anonymity will be protected. Expect some to drop out.
Round 1: gather views 1 week
Send an open question or a first list of items. Ask each expert to answer alone, giving a reason for each point. A sentence or two per point keeps the next round manageable.
Summarize anonymously 2–3 days
Combine the answers into a clear, anonymous summary: themes for open answers, the median and spread for ratings, and the strongest reasons on each side. Take care not to steer the panel with your wording or grouping.
Rounds 2–4: re-rate 1 week each
Send the summary back and ask everyone to rate or re-estimate, explaining any answer far from the group. Repeat until answers stop changing much.
Report the result 2–3 days
Share where the panel agreed, where it didn't, and why. A disagreement with clear reasons on both sides is a useful finding, not a failure.
✓Do
Define what counts as agreement before round 1
Ask for a reason with every rating
Keep each questionnaire short and easy to answer
Report disagreements as clearly as agreements
✕Avoid
Revealing who said what, even by accident
Wording the summary to nudge people your way
Pressuring outliers to conform
Running rounds until people give up from fatigue
What you need
A clear question, a panel of experts, a simple survey tool or email, a spreadsheet for the summaries and a few weeks. With AI, use the prompt below to plan and summarize.
04 Worked example
Delphi in action: safer hospital discharges
The challenge
“Too many patients go home with medication mix-ups, and our experts all have different top priorities.”
Who: a regional health network and a panel of 18 nurses, pharmacists, doctors and patient advocates from four hospitals. Goal: agree on the top priorities for safer discharge. Agreement: 75% rating an item 4 or 5.
18 experts · 3 rounds
1
The question
Round 1 asked one open question: “What changes would most reduce medication errors when patients leave the hospital?”
2
64 answers
Experts replied alone, in writing. Suggestions ranged from pharmacist reviews to large-print medicine charts and follow-up phone calls.
3
The summary
The facilitator merged the 64 suggestions into 22 distinct items, removed every name and turned them into a rating list from 1 to 5.
4
Rounds 2 and 3
Experts rated the items, saw the group's median and spread, then re-rated. One anonymous comment about patients' own medicine lists shifted many ratings.
Stop
Convergence
After round 3 the ratings barely moved, so the panel stopped. Five items passed the 75% bar; two stayed contested, with clear reasons on both sides.
The result
A five-point discharge checklist that all four hospitals adopted, plus two open questions for a pilot study.
Top items: median rating by round
Pharmacist checks every list
ROUND 2ROUND 3
Patient explains plan back
ROUND 2ROUND 3
Follow-up call within 48h
ROUND 2ROUND 3
05 ✦ Go AI
Rehearse your Delphi with a simulated panel
AI fits Delphi in two ways. It can play a mock panel, so you can test your questions and catch confusing items before real experts see them. And it can do the heavy lifting between rounds: merging answers, stripping out names and summarizing neutrally. What it can't do is replace the panel. Real expertise is the whole point.
YouYou bring
The real question and why it matters
A panel of genuine, varied experts
Judgment on what counts as agreement
The final report and what you do with it
⇄
AIAI brings
A simulated panel to rehearse your questions
Fast merging of dozens of open answers
Neutral summaries with identities removed
Spotting leading or confusing wording
MOVE 01
Rehearsal panel
Test your round 1 question on simulated experts before sending it out.
Answer my Delphi question as 5 different experts: a nurse, a pharmacist, a family doctor, a patient and a manager.MOVE 02
Merge the answers
Turn a pile of open answers into a clean list of distinct items.
Merge these 64 anonymous suggestions into distinct items. Keep the panel's own words where you can.MOVE 03
Neutral summary
Summarize a round without steering the panel toward any view.
Summarize these round 2 ratings: the median and spread for each item, plus the strongest reason on each side.MOVE 04
Wording check
Catch leading, vague or double-barreled items before the next round.
Check my rating list for items that are leading, vague or ask two things at once, and suggest fixes.
Watch out for
A simulated panel isn't a panel. Use AI experts to test questions, never as findings.
Strip identities first. Remove names and telling details before you paste answers.
Check every merge. AI can blur two distinct ideas into one. Review its groupings.
Consensus isn't certainty. Agreement shows what experts believe, not what will happen.
06 Your prompt
Your Delphi facilitator, ready to paste
Describe your question and panel, pick a mode, then copy the prompt into Claude, ChatGPT, Gemini or Copilot. In coach mode the AI helps you design each round, waits while your real panel responds, then helps you summarize their answers.