CoChat

Feeling the future: A meta-analysis of 90 experiments on the anomalous anticipation of random future events

Open access
Bem, Daryl, Tressoldi, Patrizio E., Rabeyron, Thomas, Duggan, Michael · 2016 · F1000Research
Cited by 74

The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.

Abstract

In 2011, one of the authors (DJB) published a report of nine experiments in the Journal of Personality and Social Psychology purporting to demonstrate that an individual’s cognitive and affective responses can be influenced by randomly selected stimulus events that do not occur until after his or her responses have already been made and recorded, a generalized variant of the phenomenon traditionally denoted by the term precognition. To encourage replications, all materials needed to conduct them were made available on request. We here report a meta-analysis of 90 experiments from 33 laboratories in 14 countries which yielded an overall effect greater than 6 sigma,z= 6.40,p= 1.2 × 10-10 with an effect size (Hedges’g) of 0.09. A Bayesian analysis yielded a Bayes Factor of 5.1 × 10 9, greatly exceeding the criterion value of 100 for “decisive evidence” in support of the experimental hypothesis. When DJB’s original experiments are excluded, the combined effect size for replications by independent investigators is 0.06,z= 4.16,p= 1.1 × 10-5, and the BF value is 3,853, again exceeding the criterion for “decisive evidence.” The number of potentially unretrieved experiments required to reduce the overall effect size of the complete database to a trivial value of 0.01 is 544, and seven of eight additional statistical tests support the conclusion that the database is not significantly compromised by either selection bias or by intense “p-hacking”—the selective suppression of findings or analyses that failed to yield statistical significance.P-curve analysis, a recently introduced statistical technique, estimates the true effect size of the experiments to be 0.20 for the complete database and 0.24 for the independent replications, virtually identical to the effect size of DJB’s original experiments (0.22) and the closely related “presentiment” experiments (0.21). We discuss the controversial status of precognition and other anomalous effects collectively known as psi.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.12688/f1000research.7177.2

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 24 references

Research works printed but not linked: 52

  1. I *Barušs, 2014, Failure to replicate retrocausal recall., Psychology of Consiousness: Theory, Research, and Practice., 1, 82-91, 10.1037/cns0000005 · doi:10.1037/cns0000005
  2. A *Batthyany, 2008, A replication of Bem’s retro-priming study., Personal communication.
  3. A *Batthyany, 2009, Retroactive/Precognitive Priming: The role of attention allocation on time-reversed affective processing., Personal communication.
  4. A *Batthyany, 2010, Retrocausal Habituation and Induction of Boredom: A Successful Replication of Bem (2010; Studies 5 and 7), 10.2139/ssrn.1715954 · DOI
  5. A *Batthyany, 2009, Moderating factors in precognitive habituation: the roles of situational vigilance, emotional reactivity, and affect regulation., J Soc Psych Res., 73, 65-82
  6. A *Batthyany, 2008, The Time-Reversed Mere Exposure Effect: Evidence for Long-Delay, but not Short-Delay Retrocausal Affective Processing., Personal communication.
  7. M Bayarri, 2007, Extending conventional priors for testing general hypotheses in linear models., Biometrika., 94, 135-152, 10.1093/biomet/asm014 · DOI · Paper page
  8. D *Bem, 2012, An additional replication of the “precognitive detection of erotic stimuli” experiment., Personal communication.
  9. D *Bierman, 2011, Anomalous Switching of the Bi-Stable Percept of a Necker Cube: A Preliminary Study., J Sci Explor., 25, 721-733
  10. D Bierman, 2010, Consciousness induced restoration of time symmetry (CIRTS): A psychophysical theoretical perspective., J Parapsychol., 24, 273-300
  11. D Bierman, 1997, Anomalous anticipatory response on randomized future conditions., Percept Mot Skills., 84, 689-690, 10.2466/pms.1997.84.2.689 · DOI
  12. M Borenstein, 2009, Introduction to meta-analysis, 10.1002/9780470743386 · DOI · Paper page
  13. E *Cardeña, 2009, Hypnotizability and dissociation as predictors of performance in a precognition task: A pilot study., J Parapsychol., 73, 137-158
  14. A Dijksterhuis, 2002, Affective habituation: subliminal exposure to extreme stimuli decreases their extremity., Emotion., 2, 203-214, 10.1037/1528-3542.2.3.203 · doi:10.1037/1528-3542.2.3.203 · Paper page
  15. S Duval, 2000, Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis., Biometrics., 56, 455-463, 10.1111/j.0006-341X.2000.00455.x · DOI · Paper page
  16. M Ferguson, 2009, Automatic evaluation., Curr Dir Psychol Sci., 18, 362-366, 10.1111/j.1467-8721.2009.01668.x · DOI
  17. K Fiedler, 2012, The Long Way From α-Error Control to Validity Proper: Problems With a Short-Sighted False-Positive Debate., Perspect Psychol Sci., 7, 661-669, 10.1177/1745691612462587 · DOI · Paper page
  18. G Francis, 2012, Too good to be true: publication bias in two prominent studies from experimental psychology., Psychon Bull Rev., 19, 151-156, 10.3758/s13423-012-0227-9 · DOI · Paper page
  19. J *Galak, 2012, Correcting the past: failures to replicate ψ., J Pers Soc Psychol., 103, 933-948, 10.1037/a0029709 · DOI
  20. G *Hitchman, 2012a, A re-examination of non-intentional precognition with openness to experience, creativity, psi beliefs and luck beliefs as predictors of success., J Parapsychol., 76, 109-145
  21. C Honorton, 1989, “Future telling”: A meta-analysis of forced-choice precognition experiments, 1935–1987., J Parapsychol., 53, 281-308
  22. H Jeffreys, 1998, Theory of probability, 10.1093/oso/9780198503682.001.0001 · DOI
  23. Z Jin, 2015, Statistical methods for dealing with publication bias in meta-analysis., Stat Med., 34, 343-360, 10.1002/sim.6342 · DOI · Paper page
  24. C Judd, 2011, Editorial comment., J Pers Soc Psychol., 100, 406, 10.1037/0022789 · DOI
  25. E LeBel, 2011, Fearing the future of empirical psychology: Bem’s (2011) evidence of psi as a case study of deficiencies in modal research practice., Review of General Psychology., 15, 371-379, 10.1037/a0025172 · DOI · Paper page
  26. D *Luke, 2008a, Psi may look like luck: Perceived luckiness and beliefs about luck in relation to precognition., J Soc Psych Res., 72, 193-207
  27. D *Luke, 2008b, Testing for forced-choice precognition using a hidden task: Two replications., J Parapsychol., 72, 133-154
  28. M *Maier, 2014, Feeling the future again: Retroactive avoidance of negative stimuli., J Conscious Stud., 21, 121-152
  29. J Mossbridge, 2012, Predictive physiological anticipation preceding seemingly unpredictable stimuli: a meta-analysis., Front Psychol., 3, 390, 10.3389/fpsyg.2012.00390 · DOI
  30. J Mossbridge, 2014, Predicting the unpredictable: critical analysis and practical implications of predictive anticipatory activity., Front Hum Neurosci., 8, 146, 10.3389/fnhum.2014.00146 · DOI
  31. A *Parker, 2010, Do some of us habituate to future emotional events?, J Parapsychol., 74, 99-115
  32. T *Rabeyron, 2014, Retro-priming, priming, and double testing: psi and replication in a test-retest design., Front Hum Neurosci., 8, 154, 10.3389/fnhum.2014.00154 · DOI
  33. D Radin, 1997, Unconscious perception of future emotions: An experiment in presentiment., J Sci Explor., 11, 163-180
  34. S *Ritchie, 2012, Failing the future: three unsuccessful attempts to replicate Bem’s ‘retroactive facilitation of recall’ effect., PLoS One., 7, e33423, 10.1371/journal.pone.0033423 · DOI · Paper page
  35. E *Robinson, 2011, Not Feeling the Future: A Failed Replication of Retroactive Facilitation of Memory Recall., J Soc Psych Res., 75, 142-147
  36. R Rosenthal, 1979, The “file drawer problem” and tolerance for null results., Psychol Bull., 86, 638-641, 10.1037/0033-2909.86.3.638 · DOI · Paper page
  37. J Rouder, 2011, A Bayes factor meta-analysis of Bem’s ESP claim., Psychon Bull Rev., 18, 682-689, 10.3758/s13423-011-0088-7 · DOI · Paper page
  38. G Rücker, 2011, Treatment-effect estimates adjusted for small-study effects via a limit meta-analysis., Biostatistics., 12, 122-142, 10.1093/biostatistics/kxq046 · DOI · Paper page
  39. G Schwarzer, 2010, Empirical evaluation suggests Copas selection model preferable to trim-and-fill method for selection bias in meta-analysis., J Clin Epidemiol., 63, 282-288, 10.1016/j.jclinepi.2009.05.008 · DOI
  40. D Schwarzkopf, 2014, We should have seen this coming., Front Hum Neurosci., 8, 332, 10.3389/fnhum.2014.00332 · DOI
  41. S Snodgrass, 2011, Examining retroactive facilitation of recall: an adapted replication of Bem (2011, Study 9) and Galak and Nelson (2010), 10.2139/ssrn.1935942 · DOI
  42. T Stanley, 2015, Neither fixed nor random: weighted least squares meta-analysis., Stat Med., 34, 2116-2127, 10.1002/sim.6481 · DOI · Paper page
  43. E *Subbotsky, 2013, Sensing the Future: Reversed Causality or a Non-standard Observer Effect?, The Open Psychology Journal., 6, 81-93, 10.2174/1874350101306010081 · DOI
  44. E Thorndike, 1898, Animal intelligence: An experimental study of the associative processes in animals., Psychol Monogr., 2, i-109, 10.1037/h0092987 · DOI · Paper page
  45. M *Traxler, 2012, Feeling the past: the absence of experimental evidence for anomalous retroactive influences on text processing., Mem Cognit., 40, 1366-72, 10.3758/s13421-012-0232-2 · DOI
  46. P Tressoldi, 2015, Dataset 1 in: Feeling the future: A meta-analysis of 90 experiments on the anomalous anticipation of random future events., F1000Research., 10.5256/f1000research.7177.d105136 · doi:10.5256/f1000research.7177.d105136
  47. E Wagenmakers, 2011, Why psychologists must change the way they analyze their data: the case of psi: comment on Bem (2011)., J Pers Soc Psychol., 100, 426-432, 10.1037/a0022790 · DOI · Paper page
  48. M Wagner, 1979, Attitudes of college professors toward extra-sensory perception., Zetetic Scholar., 5, 7-17
  49. H Walach, 2014, Parapsychological phenomena as examples of generalized nonlocal correlations—A theoretical framework., J Sci Explor., 28, 605-631
  50. C *Watt, 2000, Luck in action? belief in good luck, Psi-mediated instrumental response, and games of chance., J Parapsychol., 64, 33-52
  51. R Zajonc, 1968, Attitudinal effects of mere exposure., J Pers Soc Psychol., 9, 1-27, 10.1037/h0025848 · DOI · Paper page
  52. W *Zangari, 2006, Replication of the retro-habituation effect., Personal communication.

Cited by

See all 74

Metadata

Authors
Bem, D., Tressoldi, P. E., Rabeyron, T., & Duggan, M.
Venue
F1000Research
Published
2016-01-29
Volume
4
Pages
1188
ISSN
2046-1402 (ISSN-L)
OpenAlex
W3122248511
Cited by
74
References
24
FWCI
1.71
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Feeling the future: A meta-analysis of 90 experiments on the anomalous anticipation of random future events. https://app.cochat.ai/papers/10.12688/f1000research.7177.2
The paper
Bem, D., Tressoldi, P. E., Rabeyron, T., & Duggan, M. (2016). Feeling the future: A meta-analysis of 90 experiments on the anomalous anticipation of random future events. F1000Research. https://doi.org/10.12688/f1000research.7177.2

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.