Results from a Confirmatory Replication Study of Bem (2011): Precognitive Detection of Erotic Stimuli?
🛡️ Critical replication📌 Appears in:
Plain English Summary
This companion study put Daryl Bem's headline-grabbing ESP claim to a rigorous test — and the results were a clean miss for precognition. Bem's original 2011 experiment suggested people could somehow sense erotic images hidden behind digital curtains before they were revealed, which understandably made a huge splash. Here, the researchers replicated that exact experiment with 100 female participants, each doing two sessions of 60 trials (15 with erotic pictures, 45 neutral). The crucial difference: everything was preregistered, meaning every method and statistical test was publicly posted online before a single participant walked through the door. No wiggle room, no after-the-fact tweaking. They ran six different Bayesian tests (a statistical approach that weighs evidence for one explanation against another) covering erotic versus neutral performance, whether erotic detection beat pure chance, personality correlations, and whether results held across sessions. Every single one favored the "nothing going on" explanation. The strongest result was about 17 times more likely under the no-precognition hypothesis. There was a tiny correlation between extraversion and performance, but even that evaporated under proper statistical scrutiny. It stands as one of the earliest and cleanest preregistered rebuttals in the ESP debate.
Research Notes
One of the first pre-registered Bayesian replications in the Bem controversy, central to Controversy #2. Companion paper 'An Agenda for Purely Confirmatory Research' (wagenmakers_2012_agenda) codified the confirmatory approach. All six tests favor the null, providing direct Bayesian evidence against Bem's precognition claims.
Pre-registered confirmatory replication of Bem's (2011) Experiment 1, testing whether participants can detect erotic pictures behind curtains at above-chance rates. One hundred female participants each completed two sessions of 60 trials (15 erotic, 45 neutral). All methods and Bayesian analyses were specified and posted online before data collection. Six pre-specified Bayes factor tests — comparing erotic vs. neutral performance, erotic vs. chance, extraversion correlations, and cross-session consistency — all yielded evidence favoring the null hypothesis. Combined-session Bayes factors reached BF₀₁ = 16.6, providing strong evidence against precognition. A small positive extraversion-performance correlation (r = 0.13) was not supported by Bayesian analysis (BF₀₁ = 3.64).
Related Papers
Replication Of
Companion
- An Agenda for Purely Confirmatory Research — Wagenmakers, Eric-Jan (2012)
- Why Psychologists Must Change the Way They Analyze Their Data: The Case of Psi — Wagenmakers, Eric-Jan (2011)
- Fearing the Future of Empirical Psychology: Bem's (2011) Evidence of Psi as a Case Study of Deficiencies in Modal Research Practice — LeBel, Etienne P (2011)
- Correcting the Past: Failures to Replicate Psi — Galak, Jeff (2012)
- Bem's 'Feeling the Future' (2011) Five Years Later: Its Impact on Scientific Literature — Silva, Bruno A (2017)
Same Research Program
Cites
Also by these authors
More in Skeptical
Cognitive Styles and Psi: Psi Researchers Are More Similar to Skeptics Than to Lay Believers
Searching for the Impossible: Parapsychology's Elusive Quest
False-Positive Effect in the Radin Double-Slit Experiment on Observer Consciousness as Determined with the Advanced Meta-Experimental Protocol
Cross-Examining the Case for Precognition: Comment on Mossbridge and Radin (2018)
N,N-Dimethyltryptamine and the Pineal Gland: Separating Fact from Myth
📋 Cite this paper
Wagenmakers, Eric-Jan, Wetzels, Ruud, Borsboom, Denny, van der Maas, Han L. J, Kievit, Rogier A (2012). Results from a Confirmatory Replication Study of Bem (2011): Precognitive Detection of Erotic Stimuli?. .
@article{wagenmakers_2012_confirmatory_replication_bem,
title = {Results from a Confirmatory Replication Study of Bem (2011): Precognitive Detection of Erotic Stimuli?},
author = {Wagenmakers, Eric-Jan and Wetzels, Ruud and Borsboom, Denny and van der Maas, Han L. J and Kievit, Rogier A},
year = {2012},
journal = {},
}