Feeling the future: A meta-analysis of 90 experiments on the anomalous anticipation of random future events
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
In 2011, one of the authors (DJB) published a report of nine experiments in the Journal of Personality and Social Psychology purporting to demonstrate that an individual’s cognitive and affective responses can be influenced by randomly selected stimulus events that do not occur until after his or her responses have already been made and recorded, a generalized variant of the phenomenon traditionally denoted by the term precognition. To encourage replications, all materials needed to conduct them were made available on request. We here report a meta-analysis of 90 experiments from 33 laboratories in 14 countries which yielded an overall effect greater than 6 sigma,z= 6.40,p= 1.2 × 10-10 with an effect size (Hedges’g) of 0.09. A Bayesian analysis yielded a Bayes Factor of 5.1 × 10 9, greatly exceeding the criterion value of 100 for “decisive evidence” in support of the experimental hypothesis. When DJB’s original experiments are excluded, the combined effect size for replications by independent investigators is 0.06,z= 4.16,p= 1.1 × 10-5, and the BF value is 3,853, again exceeding the criterion for “decisive evidence.” The number of potentially unretrieved experiments required to reduce the overall effect size of the complete database to a trivial value of 0.01 is 544, and seven of eight additional statistical tests support the conclusion that the database is not significantly compromised by either selection bias or by intense “p-hacking”—the selective suppression of findings or analyses that failed to yield statistical significance.P-curve analysis, a recently introduced statistical technique, estimates the true effect size of the experiments to be 0.20 for the complete database and 0.24 for the independent replications, virtually identical to the effect size of DJB’s original experiments (0.22) and the closely related “presentiment” experiments (0.21). We discuss the controversial status of precognition and other anomalous effects collectively known as psi.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Dual-Processing Accounts of Reasoning, Judgment, and Social Cognition
Evans, J. S. B. T. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093629 · Cited by 5,137
Dual-Process Theories of Higher Cognition: Advancing the Debate
Evans, J. S. B. T., & Stanovich, K. E. (2013) · Perspectives on Psychological Science · doi:10.1177/1745691612460685 · Cited by 4,271
Assessing heterogeneity in meta-analysis: Q statistic or I² index?
Huedo-Medina, T. B., Sánchez-Meca, J., Marín-Martínez, F., & Botella, J. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.2.193 · Cited by 4,256
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
A Fail-Safe N for Effect Size in Meta-Analysis
Orwin, R. G. (1983) · Journal of Educational Statistics · doi:10.2307/1164923 · Cited by 2,064 · cited 2×
“An alternative approach for estimating a Fail-Safe N focuses on the effect size rather than the p value (Orwin, 1983).”
BackgroundExposure and affect: Overview and meta-analysis of research, 1968–1987.
Bornstein, R. F. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.106.2.265 · Cited by 1,970 · cited 2×
“This parallels the finding in conventional psychology that mere exposure effects are most likely to occur when the exposures are subliminal or incidental because the participant is not aware of them and, hence, is not prompted to counter their attitude-inducing effects (Bornstein, 1989).”
BackgroundP-curve: A key to the file-drawer.
Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0033242 · Cited by 1,500 · cited 9×
“If a genuine non-zero effect exists, however, then p-curve’s expected distribution will be right-skewed: We expect to observe more low significant p values (p .01) than high significant p values (.04 p .05) (Simonsohn et al., 2014b, pp. 666–667)...”
BackgroundMethodInfluentialJudd, C. M., Westfall, J., & Kenny, D. A. (2012) · Journal of Personality and Social Psychology · doi:10.1037/a0028347 · Cited by 1,236
Research works printed but not linked: 52
- I *Barušs, 2014, Failure to replicate retrocausal recall., Psychology of Consiousness: Theory, Research, and Practice., 1, 82-91, 10.1037/cns0000005 · doi:10.1037/cns0000005
- A *Batthyany, 2008, A replication of Bem’s retro-priming study., Personal communication.
- A *Batthyany, 2009, Retroactive/Precognitive Priming: The role of attention allocation on time-reversed affective processing., Personal communication.
- A *Batthyany, 2010, Retrocausal Habituation and Induction of Boredom: A Successful Replication of Bem (2010; Studies 5 and 7), 10.2139/ssrn.1715954 · DOI
- A *Batthyany, 2009, Moderating factors in precognitive habituation: the roles of situational vigilance, emotional reactivity, and affect regulation., J Soc Psych Res., 73, 65-82
- A *Batthyany, 2008, The Time-Reversed Mere Exposure Effect: Evidence for Long-Delay, but not Short-Delay Retrocausal Affective Processing., Personal communication.
- M Bayarri, 2007, Extending conventional priors for testing general hypotheses in linear models., Biometrika., 94, 135-152, 10.1093/biomet/asm014 · DOI · Paper page
- D *Bem, 2012, An additional replication of the “precognitive detection of erotic stimuli” experiment., Personal communication.
- D *Bierman, 2011, Anomalous Switching of the Bi-Stable Percept of a Necker Cube: A Preliminary Study., J Sci Explor., 25, 721-733
- D Bierman, 2010, Consciousness induced restoration of time symmetry (CIRTS): A psychophysical theoretical perspective., J Parapsychol., 24, 273-300
- D Bierman, 1997, Anomalous anticipatory response on randomized future conditions., Percept Mot Skills., 84, 689-690, 10.2466/pms.1997.84.2.689 · DOI
- M Borenstein, 2009, Introduction to meta-analysis, 10.1002/9780470743386 · DOI · Paper page
- E *Cardeña, 2009, Hypnotizability and dissociation as predictors of performance in a precognition task: A pilot study., J Parapsychol., 73, 137-158
- A Dijksterhuis, 2002, Affective habituation: subliminal exposure to extreme stimuli decreases their extremity., Emotion., 2, 203-214, 10.1037/1528-3542.2.3.203 · doi:10.1037/1528-3542.2.3.203 · Paper page
- S Duval, 2000, Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis., Biometrics., 56, 455-463, 10.1111/j.0006-341X.2000.00455.x · DOI · Paper page
- M Ferguson, 2009, Automatic evaluation., Curr Dir Psychol Sci., 18, 362-366, 10.1111/j.1467-8721.2009.01668.x · DOI
- K Fiedler, 2012, The Long Way From α-Error Control to Validity Proper: Problems With a Short-Sighted False-Positive Debate., Perspect Psychol Sci., 7, 661-669, 10.1177/1745691612462587 · DOI · Paper page
- G Francis, 2012, Too good to be true: publication bias in two prominent studies from experimental psychology., Psychon Bull Rev., 19, 151-156, 10.3758/s13423-012-0227-9 · DOI · Paper page
- J *Galak, 2012, Correcting the past: failures to replicate ψ., J Pers Soc Psychol., 103, 933-948, 10.1037/a0029709 · DOI
- G *Hitchman, 2012a, A re-examination of non-intentional precognition with openness to experience, creativity, psi beliefs and luck beliefs as predictors of success., J Parapsychol., 76, 109-145
- C Honorton, 1989, “Future telling”: A meta-analysis of forced-choice precognition experiments, 1935–1987., J Parapsychol., 53, 281-308
- H Jeffreys, 1998, Theory of probability, 10.1093/oso/9780198503682.001.0001 · DOI
- Z Jin, 2015, Statistical methods for dealing with publication bias in meta-analysis., Stat Med., 34, 343-360, 10.1002/sim.6342 · DOI · Paper page
- C Judd, 2011, Editorial comment., J Pers Soc Psychol., 100, 406, 10.1037/0022789 · DOI
- E LeBel, 2011, Fearing the future of empirical psychology: Bem’s (2011) evidence of psi as a case study of deficiencies in modal research practice., Review of General Psychology., 15, 371-379, 10.1037/a0025172 · DOI · Paper page
- D *Luke, 2008a, Psi may look like luck: Perceived luckiness and beliefs about luck in relation to precognition., J Soc Psych Res., 72, 193-207
- D *Luke, 2008b, Testing for forced-choice precognition using a hidden task: Two replications., J Parapsychol., 72, 133-154
- M *Maier, 2014, Feeling the future again: Retroactive avoidance of negative stimuli., J Conscious Stud., 21, 121-152
- J Mossbridge, 2012, Predictive physiological anticipation preceding seemingly unpredictable stimuli: a meta-analysis., Front Psychol., 3, 390, 10.3389/fpsyg.2012.00390 · DOI
- J Mossbridge, 2014, Predicting the unpredictable: critical analysis and practical implications of predictive anticipatory activity., Front Hum Neurosci., 8, 146, 10.3389/fnhum.2014.00146 · DOI
- A *Parker, 2010, Do some of us habituate to future emotional events?, J Parapsychol., 74, 99-115
- T *Rabeyron, 2014, Retro-priming, priming, and double testing: psi and replication in a test-retest design., Front Hum Neurosci., 8, 154, 10.3389/fnhum.2014.00154 · DOI
- D Radin, 1997, Unconscious perception of future emotions: An experiment in presentiment., J Sci Explor., 11, 163-180
- S *Ritchie, 2012, Failing the future: three unsuccessful attempts to replicate Bem’s ‘retroactive facilitation of recall’ effect., PLoS One., 7, e33423, 10.1371/journal.pone.0033423 · DOI · Paper page
- E *Robinson, 2011, Not Feeling the Future: A Failed Replication of Retroactive Facilitation of Memory Recall., J Soc Psych Res., 75, 142-147
- R Rosenthal, 1979, The “file drawer problem” and tolerance for null results., Psychol Bull., 86, 638-641, 10.1037/0033-2909.86.3.638 · DOI · Paper page
- J Rouder, 2011, A Bayes factor meta-analysis of Bem’s ESP claim., Psychon Bull Rev., 18, 682-689, 10.3758/s13423-011-0088-7 · DOI · Paper page
- G Rücker, 2011, Treatment-effect estimates adjusted for small-study effects via a limit meta-analysis., Biostatistics., 12, 122-142, 10.1093/biostatistics/kxq046 · DOI · Paper page
- G Schwarzer, 2010, Empirical evaluation suggests Copas selection model preferable to trim-and-fill method for selection bias in meta-analysis., J Clin Epidemiol., 63, 282-288, 10.1016/j.jclinepi.2009.05.008 · DOI
- D Schwarzkopf, 2014, We should have seen this coming., Front Hum Neurosci., 8, 332, 10.3389/fnhum.2014.00332 · DOI
- S Snodgrass, 2011, Examining retroactive facilitation of recall: an adapted replication of Bem (2011, Study 9) and Galak and Nelson (2010), 10.2139/ssrn.1935942 · DOI
- T Stanley, 2015, Neither fixed nor random: weighted least squares meta-analysis., Stat Med., 34, 2116-2127, 10.1002/sim.6481 · DOI · Paper page
- E *Subbotsky, 2013, Sensing the Future: Reversed Causality or a Non-standard Observer Effect?, The Open Psychology Journal., 6, 81-93, 10.2174/1874350101306010081 · DOI
- E Thorndike, 1898, Animal intelligence: An experimental study of the associative processes in animals., Psychol Monogr., 2, i-109, 10.1037/h0092987 · DOI · Paper page
- M *Traxler, 2012, Feeling the past: the absence of experimental evidence for anomalous retroactive influences on text processing., Mem Cognit., 40, 1366-72, 10.3758/s13421-012-0232-2 · DOI
- P Tressoldi, 2015, Dataset 1 in: Feeling the future: A meta-analysis of 90 experiments on the anomalous anticipation of random future events., F1000Research., 10.5256/f1000research.7177.d105136 · doi:10.5256/f1000research.7177.d105136
- E Wagenmakers, 2011, Why psychologists must change the way they analyze their data: the case of psi: comment on Bem (2011)., J Pers Soc Psychol., 100, 426-432, 10.1037/a0022790 · DOI · Paper page
- M Wagner, 1979, Attitudes of college professors toward extra-sensory perception., Zetetic Scholar., 5, 7-17
- H Walach, 2014, Parapsychological phenomena as examples of generalized nonlocal correlations—A theoretical framework., J Sci Explor., 28, 605-631
- C *Watt, 2000, Luck in action? belief in good luck, Psi-mediated instrumental response, and games of chance., J Parapsychol., 64, 33-52
- R Zajonc, 1968, Attitudinal effects of mere exposure., J Pers Soc Psychol., 9, 1-27, 10.1037/h0025848 · DOI · Paper page
- W *Zangari, 2006, Replication of the retro-habituation effect., Personal communication.
Cited by
Nelson, L. D., Simmons, J., & Simonsohn, U. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011836 · Cited by 548
Bias in the evaluation of psychology studies: A comparison of parapsychology versus neuroscience
Butzer, B. (2020) · EXPLORE · doi:10.1016/j.explore.2019.12.010 · Cited by 12
Follow‐up on the U.S. Central Intelligence Agency's (CIA) remote viewing experiments☆
Escolà‐Gascón, Á., Houran, J., Dagnall, N., Drinkwater, K., & Denovan, A. (2023) · Brain and Behavior · doi:10.1002/brb3.3026 · Cited by 6
“The present study focused on RV relative to anomalous information reception , as it is one of the most researched anomalous phenomena showing significant results (see Bem et al., 2016; Tressoldi & Storm, 2021).”
ResultA Train Wreck by Any Other Name
Harris, C., Rohrer, D., & Pashler, H. (2021) · Psychological Inquiry · doi:10.1080/1047840x.2021.1889317 · Cited by 4
Metadata
- Authors
- Bem, D., Tressoldi, P. E., Rabeyron, T., & Duggan, M.
- Venue
- F1000Research
- Publisher
- F1000 Research Ltd
- Published
- 2016-01-29
- Volume
- 4
- Pages
- 1188
- ISSN
- 2046-1402 (ISSN-L)
- OpenAlex
- W3122248511
- Cited by
- 74
- References
- 24
- FWCI
- 1.71
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Feeling the future: A meta-analysis of 90 experiments on the anomalous anticipation of random future events. https://app.cochat.ai/papers/10.12688/f1000research.7177.2
- The paper
- Bem, D., Tressoldi, P. E., Rabeyron, T., & Duggan, M. (2016). Feeling the future: A meta-analysis of 90 experiments on the anomalous anticipation of random future events. F1000Research. https://doi.org/10.12688/f1000research.7177.2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.