Skip to main content

Results from a Confirmatory Replication Study of Bem (2011): Precognitive Detection of Erotic Stimuli?

🛡️ Critical replication
Wagenmakers, Eric-Jan, Wetzels, Ruud, Borsboom, Denny, van der Maas, Han L. J, Kievit, Rogier A 2012 Modern Era skeptical

📌 Appears in:

Plain English Summary

This companion study put Daryl Bem's headline-grabbing ESP claim to a rigorous test — and the results were a clean miss for precognition. Bem's original 2011 experiment suggested people could somehow sense erotic images hidden behind digital curtains before they were revealed, which understandably made a huge splash. Here, the researchers replicated that exact experiment with 100 female participants, each doing two sessions of 60 trials (15 with erotic pictures, 45 neutral). The crucial difference: everything was preregistered, meaning every method and statistical test was publicly posted online before a single participant walked through the door. No wiggle room, no after-the-fact tweaking. They ran six different Bayesian tests (a statistical approach that weighs evidence for one explanation against another) covering erotic versus neutral performance, whether erotic detection beat pure chance, personality correlations, and whether results held across sessions. Every single one favored the "nothing going on" explanation. The strongest result was about 17 times more likely under the no-precognition hypothesis. There was a tiny correlation between extraversion and performance, but even that evaporated under proper statistical scrutiny. It stands as one of the earliest and cleanest preregistered rebuttals in the ESP debate.

Research Notes

One of the first pre-registered Bayesian replications in the Bem controversy, central to Controversy #2. Companion paper 'An Agenda for Purely Confirmatory Research' (wagenmakers_2012_agenda) codified the confirmatory approach. All six tests favor the null, providing direct Bayesian evidence against Bem's precognition claims.

Pre-registered confirmatory replication of Bem's (2011) Experiment 1, testing whether participants can detect erotic pictures behind curtains at above-chance rates. One hundred female participants each completed two sessions of 60 trials (15 erotic, 45 neutral). All methods and Bayesian analyses were specified and posted online before data collection. Six pre-specified Bayes factor tests — comparing erotic vs. neutral performance, erotic vs. chance, extraversion correlations, and cross-session consistency — all yielded evidence favoring the null hypothesis. Combined-session Bayes factors reached BF₀₁ = 16.6, providing strong evidence against precognition. A small positive extraversion-performance correlation (r = 0.13) was not supported by Bayesian analysis (BF₀₁ = 3.64).

Related Papers

Also by these authors

More in Skeptical

📋 Cite this paper
APA
Wagenmakers, Eric-Jan, Wetzels, Ruud, Borsboom, Denny, van der Maas, Han L. J, Kievit, Rogier A (2012). Results from a Confirmatory Replication Study of Bem (2011): Precognitive Detection of Erotic Stimuli?. .
BibTeX
@article{wagenmakers_2012_confirmatory_replication_bem,
  title = {Results from a Confirmatory Replication Study of Bem (2011): Precognitive Detection of Erotic Stimuli?},
  author = {Wagenmakers, Eric-Jan and Wetzels, Ruud and Borsboom, Denny and van der Maas, Han L. J and Kievit, Rogier A},
  year = {2012},
  journal = {},
}