Peer Rejected

rejections > myth.AP > REJ:2026.07.03.0001

REJ:2026.07.03.0001myth.AP (Applied Mythology)PRJ-2026-0004Vol. 1, No. 1Status: Rejected

Return to Delphi: Structured Expert Elicitation as a Lossy Reconstruction of the Original Instrument

Kassandra E. Voulgaris1, Milo A. Brandt2, P. N. Oikonomides3

1. Institute for Retrospective Forecasting, Delphi · 2. Center for Post-Consensus Studies, Santa Monica · 3. Department of Oracular Engineering, Parnassus Institute of Technology

Submitted and rejected July 3, 2026 · 6 pages · 3 figures · review duration: 9 minutes

[pdf][share on x]

Abstract

The Delphi method is the standard instrument of structured expert elicitation, yet its own literature documents chronic pathologies: overconfident convergence, false precision, and sensitivity to panel composition. We observe that the method’s name is not an homage but an uncited dependency, and we evaluate the hypothesis that RAND’s 1950s protocol is a lossy reconstruction of an earlier forecasting instrument with approximately eight centuries of production uptime. We contribute (i) a theoretical account in which panel consensus performs point-estimate collapse, provably suboptimal under any strictly proper scoring rule, whereas verse-constrained output preserves an ambiguity-calibrated credible set; (ii) a blinded re-scoring of the 214 resolvable responses in the Parke–Wormell corpus (; client-error-adjusted Croesus score ); and (iii) a 24-month preregistered forecasting tournament ( resolved questions) comparing a methodologically reconstructed Pythia against a 17-expert Delphi panel, a subsidized prediction market, and a sham-gas control. The reconstructed instrument achieved versus for the panel (paired , ) with near-nominal calibration (), a monotone ethylene dose–response saturating at ppm, and a advantage in cost per calibrated forecast. Convergence in the panel arm reduced forecast variance by while improving accuracy by , indicating that consensus is social rather than epistemic. We conclude that expert elicitation was not invented in Santa Monica; it was compressed there, with losses.

keywords: Delphi method · structured elicitation · proper scoring rules · oracular engineering · calibration

Cite this rejection

@article{PRJ20260004,
  title   = {Return to Delphi: Structured Expert Elicitation as a Lossy Reconstruction of the Original Instrument},
  author  = {Kassandra E. Voulgaris and Milo A. Brandt and P. N. Oikonomides},
  journal = {Peer Rejected},
  year    = {2026},
  note    = {Rejected manuscript, PRJ-2026-0004},
  url     = {https://peerrejected.com/papers/return-to-delphi}
}

Citing this paper is done at your own professional risk.

The paper, in full

[open in new tab]

Your browser can't display the PDF inline.

[download the PDF]

More from myth.AP

REJ:2026.08.31.0001 myth.AP (Applied Mythology) Rejected

On the Actuarial Value of Cold Feet: A Nuptial Life Table Indexed by Plantar Temperature at the Moment of Consent

Wilhelmina Traquair

Comments: 7 pages, 6 figures, 0 reproducible results. Rejected in 16 minutes on Aug 31, 2026.

Abstract: A person about to make a promise they cannot take back gets cold feet. The feet are genuinely cold, the coldness can be measured at the altar, and what it measures is how long the marriage will last. The sole is one of the few surfaces the body uses to shed heat on demand, and it withdraws its blood within seconds of any call for resolve; the phrase is a description, and English has forgotten that it was ever technical. We instrumented 12,417 ceremonies with a logging thermistor insole, taking as the exposure not temperature — which is largely a thermometer for the room — but thermal reserve: the departure from what that person’s foot should hold, at that ambient, in those shoes, calibrated the week before. The wedding rehearsal supplies a control that no laboratory could build — the same church, the same shoes, the same audience, the same words, and no legal effect — and the rehearsal does not cool the foot. The ceremony cools it by 2.6 , circ mathrm C . Across twenty-nine years of register linkage each degree of deficit multiplies the dissolution hazard by 1.61 (95% CI 1.57 – 1.65 ), and forty-one covariates a demographer would ask for add nothing once the foot is known; they predict the foot instead. We give the nuptial life table and the expectation of marriage at every reserve. We recommend that the thermometer be read before the register is signed.

[abs][pdf][bibtex]

REJ:2026.08.21.0001 myth.AP (Applied Mythology) Rejected

Payroll Dates the Golden Age: A Departure-Fraction Law in 604 Organisations, a Mass-Separation Instrument, and Dated Forecasts of When the Present Becomes the Good Years

Wilhelmina Astrup, Kofi Danquah, Séverine Boulay & Petar Ilievski

Comments: 5 pages, 2 figures, 0 reproducible results. Rejected in 32 minutes on Aug 21, 2026.

Abstract: Every workplace has a golden age, and it ended before you arrived. We report that this is not nostalgia but a dating rule, and that the rule runs on payroll rather than on anything that happened. For any past month, the departure fraction is the proportion of the people who were on the payroll that month who have since left. Across 604 organisations, the terminal boundary that anonymous Delphi panels place on their own organisation’s golden age falls where that fraction reaches 0.861 (95% CI 0.854 – 0.868 ), while a register of everything that occurred — revenue, growth, awards, leadership — explains 3.8% of the same variance. Mass separations forced by lease expiry and statutory transfer move the boundary forward by the amount the rule predicts, and nothing else about those organisations changed. Re-panelled six years later, the same organisations date the golden age one year later per year elapsed: the good years travel at the speed of time. The date is therefore computable in advance. For a median employer the present becomes the good years in twelve years; for a symphony orchestra, in fifty-two. You were never going to be there. Nobody is ever there.

[abs][pdf][bibtex]

REJ:2026.08.12.0001 myth.AP (Applied Mythology) Rejected

Enumerated Failure Modes Are Realised More Often When Spoken Aloud: A Three-Arm Cluster-Randomised Trial of the Pre-Mortem Meeting, with a Sealed Written Control

Ottoline Vasseur & Bertil Haugsrud

Comments: 7 pages, 8 figures, 0 reproducible results. Rejected in 36 minutes on Aug 12, 2026.

Abstract: In every family somebody says: don’t jinx it. They are right, and the risk-management profession has spent forty years doing it on an industrial scale. The pre-mortem meeting asks a delivery team to state aloud, in front of colleagues, every way the plan might fail, and treats the resulting register as a forecast. We randomised 1,148 projects across fourteen organisations to three arms matched on anticipation, on documentation and on meeting burden, and differing only in whether an enumerated failure mode was spoken and heard. Modes spoken aloud in the presence of listeners were realised within twelve months more often than modes written and sealed unread (hazard ratio 1.61, 95% CI 1.34 to 1.94). The hazard rose with the specificity of the wording, by 1.23 per grade on a five-point scale, and with the number of people who demonstrably heard it. Attendance, once audibility was conditioned upon, did nothing. Modes read aloud to an empty room behaved exactly like modes never spoken at all (1.02). Failures that no register had named were unaffected. We propose no mechanism, and we do not think one is required in order to stop. Enumerate in writing. Seal the register. Circulate it as a document and read it to nobody. A risk register is an order form.

[abs][pdf][bibtex]