03 · Select Diverge + converge ✦ AI plays: Simulator

Delphi Method

Gather anonymous expert views in rounds, sharing the results each time, until the group converges.

Best for
Building expert consensusforecasts, priorities, guidelines
Time
Days to weekstwo to four rounds, a week or so each
People
Best in a teama panel of experts, often 10–30
Difficulty
Advancedneeds a careful, neutral facilitator
Origin
RAND Corporation, 1950sfirst used for defense forecasting
01 What it is

Expert judgment in rounds, without the loudest voice winning.

Put a group of experts in one room and the result often reflects rank, confidence and who speaks first. The Delphi method avoids the room altogether. A facilitator sends the same questions to each expert, who answers alone and anonymously. The answers are combined into a summary and sent back to everyone, and the experts answer again, now knowing what the group thinks.

Round by round, people reconsider. Some move toward the group view; others hold firm and explain why, which is valuable too. After two to four rounds you usually have either a clear consensus or a well-understood disagreement. Because no one knows who said what, people can change their minds without losing face, and a quiet specialist counts as much as a famous name.

Use it when you need informed judgment where hard data is thin, when experts are spread across places or schedules, or when status and strong personalities would distort a face-to-face meeting.

Where it comes from. The method was developed at the RAND Corporation in the 1950s by Olaf Helmer, Norman Dalkey and colleagues, first to forecast the effects of technology on warfare. It takes its name from the ancient Greek oracle at Delphi.
1Ask2Answer3Summarize4Feed backConsensusrepeat

Each round, experts answer alone, see the group's anonymous summary and reconsider. Two to four rounds is typical.

Choose a part of the diagram or a tab to explore each stage.

1

Send the questions

The same questions to every expert

What exactly do you want the panel to judge, estimate or prioritize this round?

  • Round 1 can be open: “What are the main factors?”
  • Later rounds ask people to rate or re-estimate specific items
  • Keep it short: clear questions get better answers
ER nurse staffingRound 1: “How many ER nurses will our hospital need by 2030, and why?”
2

Experts answer alone

Privately, anonymously, with reasons

What does each expert think before seeing anyone else's view?

  • Each expert replies separately, in writing
  • No one sees who said what
  • Ask for a short reason with every rating or estimate
ER nurse staffingFifteen private replies, ranging from 40 to 85 nurses, each with a reason.
3

Summarize anonymously

The group view, the spread and key reasons

What does the group think, and how far apart are people?

  • Report the middle value (median) and the spread
  • Group open answers into themes, with no names
  • Pull out the strongest reasons on each side
ER nurse staffingMedian: 62 nurses, with the middle half between 55 and 70. Main reasons: older patients, longer stays.
4

Feed back and check

Share the summary; stop when views settle

Seeing the group's view, would anyone change their answer, and has the panel converged?

  • Send the summary out with the next round's questions
  • Ask experts far from the group to explain their view
  • Stop when answers barely move between rounds
ER nurse staffingThe low outlier explains a planned urgent-care center. Several experts revise down; round 3 settles at 58.
02 Why it works

Why anonymous rounds produce better judgment

Delphi was designed to capture a group's knowledge without the usual costs of group meetings.

1

Anonymity removes rank

In a meeting, the most senior or confident person often sets the direction. With anonymous answers, an idea is judged on its reasoning, not on who said it. Junior experts and quiet specialists count as much as anyone.

2

Feedback lets people learn

Seeing the group's view, and the reasons behind it, gives each expert new information. Some update their answer; others hold firm and explain why. Either way, each round is better informed than the last.

3

Changing your mind is safe

Backing down in public is hard. Because no one knows who gave which answer, experts can quietly revise their view without the social cost of admitting they were wrong.

4

Distance is no obstacle

Experts never need to be in the same place at the same time. A panel can include people from different cities, organizations and time zones, bringing in a wider range of knowledge than one meeting room could.

03 How to use it

Run a Delphi study in six steps

  1. Frame the question 1–2 days

    Write the problem clearly: a forecast, a set of priorities or a guideline to agree on. Decide in advance what counts as agreement, such as three quarters of the panel rating an item 4 or 5 out of 5.

  2. Recruit the panel 1 week

    Invite people with relevant and varied expertise, often 10 to 30 of them. Explain the time commitment, the number of rounds and how anonymity will be protected. Expect some to drop out.

  3. Round 1: gather views 1 week

    Send an open question or a first list of items. Ask each expert to answer alone, giving a reason for each point. A sentence or two per point keeps the next round manageable.

  4. Summarize anonymously 2–3 days

    Combine the answers into a clear, anonymous summary: themes for open answers, the median and spread for ratings, and the strongest reasons on each side. Take care not to steer the panel with your wording or grouping.

  5. Rounds 2–4: re-rate 1 week each

    Send the summary back and ask everyone to rate or re-estimate, explaining any answer far from the group. Repeat until answers stop changing much.

  6. Report the result 2–3 days

    Share where the panel agreed, where it didn't, and why. A disagreement with clear reasons on both sides is a useful finding, not a failure.

✓Do

  • Define what counts as agreement before round 1
  • Ask for a reason with every rating
  • Keep each questionnaire short and easy to answer
  • Report disagreements as clearly as agreements

✕Avoid

  • Revealing who said what, even by accident
  • Wording the summary to nudge people your way
  • Pressuring outliers to conform
  • Running rounds until people give up from fatigue

What you need

A clear question, a panel of experts, a simple survey tool or email, a spreadsheet for the summaries and a few weeks. With AI, use the prompt below to plan and summarize.

04 Worked example

Delphi in action: safer hospital discharges

The challenge

“Too many patients go home with medication mix-ups, and our experts all have different top priorities.”

Who: a regional health network and a panel of 18 nurses, pharmacists, doctors and patient advocates from four hospitals. Goal: agree on the top priorities for safer discharge. Agreement: 75% rating an item 4 or 5.

18 experts · 3 rounds
1
The question

Round 1 asked one open question: “What changes would most reduce medication errors when patients leave the hospital?”

2
64 answers

Experts replied alone, in writing. Suggestions ranged from pharmacist reviews to large-print medicine charts and follow-up phone calls.

3
The summary

The facilitator merged the 64 suggestions into 22 distinct items, removed every name and turned them into a rating list from 1 to 5.

4
Rounds 2 and 3

Experts rated the items, saw the group's median and spread, then re-rated. One anonymous comment about patients' own medicine lists shifted many ratings.

Stop
Convergence

After round 3 the ratings barely moved, so the panel stopped. Five items passed the 75% bar; two stayed contested, with clear reasons on both sides.

The result

A five-point discharge checklist that all four hospitals adopted, plus two open questions for a pilot study.

Top items: median rating by round

Pharmacist checks every list
ROUND 2ROUND 3
Patient explains plan back
ROUND 2ROUND 3
Follow-up call within 48h
ROUND 2ROUND 3
05 ✦ Go AI

Rehearse your Delphi with a simulated panel

AI fits Delphi in two ways. It can play a mock panel, so you can test your questions and catch confusing items before real experts see them. And it can do the heavy lifting between rounds: merging answers, stripping out names and summarizing neutrally. What it can't do is replace the panel. Real expertise is the whole point.

YouYou bring

  • The real question and why it matters
  • A panel of genuine, varied experts
  • Judgment on what counts as agreement
  • The final report and what you do with it

AIAI brings

  • A simulated panel to rehearse your questions
  • Fast merging of dozens of open answers
  • Neutral summaries with identities removed
  • Spotting leading or confusing wording
MOVE 01

Rehearsal panel

Test your round 1 question on simulated experts before sending it out.

Answer my Delphi question as 5 different experts: a nurse, a pharmacist, a family doctor, a patient and a manager.
MOVE 02

Merge the answers

Turn a pile of open answers into a clean list of distinct items.

Merge these 64 anonymous suggestions into distinct items. Keep the panel's own words where you can.
MOVE 03

Neutral summary

Summarize a round without steering the panel toward any view.

Summarize these round 2 ratings: the median and spread for each item, plus the strongest reason on each side.
MOVE 04

Wording check

Catch leading, vague or double-barreled items before the next round.

Check my rating list for items that are leading, vague or ask two things at once, and suggest fixes.

Watch out for

  • A simulated panel isn't a panel. Use AI experts to test questions, never as findings.
  • Strip identities first. Remove names and telling details before you paste answers.
  • Check every merge. AI can blur two distinct ideas into one. Review its groupings.
  • Consensus isn't certainty. Agreement shows what experts believe, not what will happen.
06 Your prompt

Your Delphi facilitator, ready to paste

Describe your question and panel, pick a mode, then copy the prompt into Claude, ChatGPT, Gemini or Copilot. In coach mode the AI helps you design each round, waits while your real panel responds, then helps you summarize their answers.

1 · Describe your challenge

The more specific you are, the better the result. The prompt updates as you type.

2 · Choose a mode

delphi.prompt
3 · Paste it into any AI assistant, or open it directly: Open in Claude ↗ Open in ChatGPT ↗

The “Open in” links put the prompt in the web address. If your challenge includes anything sensitive, copy and paste instead.

Keep going: follow-up prompts

After the session, click one to copy it, then paste it into the same chat.

Keep exploring

Tools that pair well with Delphi Method