Small Telescopes: Detectability and the Evaluation of Replication Results
The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
This article introduces a new approach for evaluating replication results. It combines effect-size estimation with hypothesis testing, assessing the extent to which the replication results are consistent with an effect size big enough to have been detectable in the original study. The approach is demonstrated by examining replications of three well-known findings. Its benefits include the following: (a) differentiating “unsuccessful” replication attempts (i.e., studies yielding p > .05) that are too noisy from those that actively indicate the effect is undetectably different from zero, (b) “protecting” true findings from underpowered replications, and (c) arriving at intuitively compelling inferences in general and for the revisited replications in particular.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“our replications employed 2.5 times the sample size of the original paper (8).”
From Empirical audit and review and an assessment of evidentiary value in research on the psychological consequences of scarcity (2021) · cites this paper as [8]
In the citing paper
“Selective reporting of measures, treatments, and analyses, and the p-hacking they enable (7) has been identified as an existential threat to behavioral science (8, 9)”
From Empirical audit and review and an assessment of evidentiary value in research on the psychological consequences of scarcity (2021) · cites this paper as [8]
In the citing paper
“This approach limits the sample size required to test for equivalence to 2.5 times the sample size of the original study.”
From Equivalence Tests: A Practical Primer for t Tests, Correlations, and Meta-Analyses (2017) · cites this paper as Simonsohn (2015)
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“If the original study is powered to 50%, an optimistic scenario (Button et al., 2013; Cohen, 1962; Rossi, 1990; Sedlmeier & Gigerenzer, 1989), the resulting upward bias in effect size would be severe enough that replications with samples sizes set to obtain 80% power, given the reported effects, would on average have…”
Schwarz, N., & Clore, G. L. (1983) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.45.3.513 · Cited by 4,952
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
Experimental Tests of the Endowment Effect and the Coase Theorem
Kahneman, D., Knetsch, J. L., & Thaler, R. H. (1990) · Journal of Political Economy · doi:10.1086/261737 · Cited by 3,194
Research works printed but not linked: 4
- Fisher R. A., 1926, Journal of the Ministry of Agriculture, 33, 503
- Jeffreys H., 1961, Theory of probability
- 10.3102/10769986008002093 · doi:10.3102/10769986008002093 · Paper page
- 10.1037/0003-066X.40.1.73 · doi:10.1037/0003-066x.40.1.73 · Paper page
Cited by
Items 601–700 of 743
Approaches from cognitive neuroscience and comparative cognition
Koushik, C. S. N., Choubey, S. B., & Choubey, A. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-819445-4.00001-1 · Cited by 1
Nástroje na zlepšenie štatistickej inferencie – analýza p-kriviek a ekvivalenčné testovanie
Fico, M. (2020) · Sociológia - Slovak Sociological Review · doi:10.31577/sociologia.2020.52.4.14 · Cited by 1
Held, L., & Pawel, S. (2020) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2020.1828161 · Cited by 2
Pain as Social Glue: A Preregistered Direct Replication of Experiment 2 of Bastian et al. (2014)
Procházka, J., Parilakova, K., Rudolf, P., Bruk, V., Jungwirthová, R., Fejtova, S., Masaryk, R., & Vaculík, M. (2022) · Psychological Science · doi:10.1177/09567976211040745 · Cited by 3
“We estimated the sample size using the small-telescopes approach (Simonsohn, 2015).”
Gerring, J., Mahoney, J., & Elman, C. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.018 · Cited by 2
Gerring, J., & Cojocaru, L. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.005 · Cited by 1
Gerring, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.014 · Cited by 2
Gross, N., & Robertson, C. T. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.017 · Cited by 2
Dirnagl, U. (2016) · Neuromethods · doi:10.1007/978-1-4939-5620-3_19 · Cited by 1
History of Replication Failures in Psychology
Whitt, C. M., Miranda, J. F., & Tullett, A. M. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_4 · Cited by 1
Rethinking Psychological Research Methods From The Seven Deadly Sins of Psychology
KUDO, Y., HAEBARA, T., Murai, J., Okada, K., Kunisato, Y., HIRAISHI, K., & SHIBAYAMA, T. (2022) · The Annual Report of Educational Psychology in Japan · doi:10.5926/arepj.61.291 · Cited by 1
Zhang, Y., Cheung, F. C., Wong, H. T., Yuen, L. Y., Sin, H. C., Chow, H. T. K., & Feldman, G. (2023) · Collabra Psychology · doi:10.1525/collabra.77610 · Cited by 1
Siegelman, M., Mineroff, Z., Blank, I., & Fedorenko, E. (2017) · bioRxiv · doi:10.1101/110791 · Cited by 3
Introduction to the special issue – A replication project in personality psychology
Donnellan, M. B., & Lucas, R. E. (2017) · Journal of Research in Personality · doi:10.1016/j.jrp.2017.11.004 · Cited by 2
Interpersonal Perceptions of Mental Fatigue Vary with Willpower Theories
Francis, Z. L. (2020) · TSpace (University of Toronto) · Cited by 1
Infants’ differentiate between successful and failed communication in a false-belief contextPreprint
Schulze, C., & Buttelmann, D. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/hmtvs · Cited by 1
Bayesian evaluation of replication studiesPreprint
Leplaa, H. J., Rietbergen, C., & Hoijtink, H. J. A. (2020) · doi:10.31234/osf.io/49tbz · Cited by 1
How to Test Replication for Structural Equation ModelsPreprint
Zondervan-Zwijnenburg, M. A. J. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/uvh5s · Cited by 1
Lin, Z., & Wu, Y. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/u5dxn · Cited by 1
Science Needs Systematic Replicability AuditsPreprint
Allard, A., & Vazire, S. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/wusdr · Cited by 1
Fears of Backlash Underlie Gendered Participation in Question-and-Answer SessionsPreprint
Jarvis, S. N., & Kray, L. J. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/7kftn · Cited by 1
Hirschhorn, R., & Schönberg, T. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-820480-1.00014-0 · Cited by 1
Castillo, M. E., & Petrie, R. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4678505 · Cited by 1
The Hungry Lens: Hunger Shifts Attention and Attribute Weighting in Dietary ChoicePreprint
March, J., & Gluth, S. (2025) · eLife · doi:10.7554/elife.103736.2 · Cited by 1
Pfattheicher, S. (2014) · OPen Access Repositorium der Universität Ulm (OPARU) (Ulm University) · doi:10.18725/oparu-3190
An empirical investigation of individual and team contests
Huang, L. (2016) · Nottingham ePrints (University of Nottingham)
Tierney, W., Schweinsberg, M., Jordan, J., Kennedy, D. M., Qureshi, I., Sommer, S. A., Thornley, N., Madan, N., Vianello, M., Awtrey, E. C., et al. (2016) · Kölner Universitäts PublikationsServer (Universität zu Köln)
Causal uncertainty and social rejection
Driver, H. (2017) · QSpace (Queen's University Library)
The nonconscious cessation of affiliative motivation: A replication and extension study
Engeser, S., Hagemeyer, B., & Aarts, H. (2018) · PLoS ONE · doi:10.1371/journal.pone.0198899
Direct replications in the era of open sampling
Paolacci, G., & Chandler, J. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000808
Olsen, J., Kogler, C., Brandt, M. J., Dezső, L., & Kirchler, E. M. (2018) · doi:10.31234/osf.io/ngakx
The Brazilian Reproducibility Initiative: a systematic assessment of Brazilian biomedical sciencePreprint
Amaral, O. B., Neves, K., Wasilewska‐Sampaio, A. P., & Carneiro, C. F. D. (2018) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/ahf7t
Statistical methods for evidence synthesisPreprint
Mathur, M. B., & VanderWeele, T. J. (2018) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/kd6ja
Gallo, S., Thijs, J., Suttrup, J., Fernandes-Henriques, C., Paracampo, R., Keysers, C., & Gazzola, V. (2019) · bioRxiv · doi:10.1101/814780 · Cited by 1
The cognitive effects of a promised bonus do not depend on dopamine synthesis capacityPreprint
Hofmans, L., van den Bosch, R., Määttä, J. I., Verkes, R., Aarts, E., & Cools, R. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.08.26.264168
Understanding Differences in Social Learning
Patenaude, J. (2020) · Scholarship@Western (Western University)
Sjåstad, H. (2019) · Scientific Research of Faculty of Economics Electronic Journal · doi:10.38050/2078-3809-2019-11-4-46-73 · Cited by 2
“To ensure sufficient statistical power, the sample size of Study 3 per cell is more than 2.5 times that of Study 1 — which is a recommended benchmark for high-powered replication studies (Simonsohn, 2015).”
InfluentialSupplemental Material for The Psychological Impact of Digital Signatures: A Multistudy Replication
Tzelios, K., & Williams, L. A. (2020) · Technology Mind and Behavior · doi:10.1037/tmb0000019.supp
Reexamination of the “uneven route” account of loss aversion
Sui, X., Huang, Y., Xu, M., Kuang, Y., & Shen, S. (2021) · Journal of Behavioral Decision Making · doi:10.1002/bdm.2240
“We aimed to collect 300 participants—about 2.5 times the original sample size (Simonsohn, 2015).”
InfluentialThe influence of stress on distractor-response bindings
Singh, T., Domes, G., & Frings, C. (2021) · Stress · doi:10.1080/10253890.2021.1920919
Comparing global reports of subjective well-being to experiential measures
Lucas, R. E. (2021) · Vienna Yearbook of Population Research · doi:10.1553/populationyearbook2021.rev01 · Cited by 2
Lacko, D., & Prošek, . (2021) · TESTFÓRUM · doi:10.5817/tf2021-14-13648
“SESOI je blízké nule; Simonsohn, 2015; Linde a kol., 2020).”
Mazachowsky, T. R., McKenzie, K. N. A., Busseri, M. A., & Mahy, C. E. V. (2021) · PLoS ONE · doi:10.1371/journal.pone.0259424
Liao, T. F. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.004
Kusztor, A., Alemany-González, M., Tsuchiya, N., & Koizumi, A. (2022) · F1000Research · doi:10.12688/f1000research.111280.1
Do red objects enhance sexual attractiveness? No evidence from two large replicationsPreprint
Pollet, T. V., Costello, J., Groeneboom, L., Peperkoorn, L. S., & Wu, J. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/3bfwh
Elman, C., Gerring, J., & Mahoney, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.019
Vize, C. E., & Lynam, D. R. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/w5tvh
Zhang & Smith_Does Power Reduce Temporal DiscountingPreprint
Zhang, M., & Smith, P. K. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/3fv45
Legg, E. W., Farrar, B. G., Lazić, A., Thiele, M., Kampis, D., Mani, N., Sesar, K., Klapwijk, E. T., Schlingloff, L., Reindl, E., et al. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/mxac9 · Cited by 2
Blouin‐Hudon, E. C. (2019) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2019-13813 · Cited by 1
Transfer of Test-Enhanced Learning: Limitations of the Mediator Effectiveness Hypothesis
DiMarco, D., & Marmurek, H. H. C. (2022) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000551 · Cited by 2
Kim, I. K. (2022) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.21220838 · Cited by 1
Incorporating Stability Information into Cross-Sectional EstimatesPreprint
Wysocki, A. C., & Rhemtulla, M. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/vg5as
Andres, E., Chuan-Peng, H., Gerlicher, A. M. V., Meyer, B., Tüscher, O., & Kalisch, R. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.11.12.516261
Zant, A. B. V., Kennedy, J. A., & Kray, L. J. (2022) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000410.supp
[PhD Dissertation] Good Research PracticesPreprint
Sarafoglou, A. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/7aj5h
Castillo, M. E., & Petrie, R. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4261298
Ikeda, S. (2023) · The Japanese journal of psychology · doi:10.4992/jjpsy.94.22317 · Cited by 1
Reexamining Target-Probe Invariance: A Reply to Kellen and Singmann (2022)Preprint
Meyer-Grant, C. G., & Klauer, K. C. (2023) · doi:10.31234/osf.io/qwnhm
Verrina, E. (2023) · Journal of the Economic Science Association · doi:10.1007/s40881-023-00136-4 · Cited by 3
Does listening to music alter prefrontal cortical activity during exercise?
Chambers, C. (2023) · Peer Community In Registered Reports · doi:10.24072/pci.rr.100378
Fidanoski, F., Dixir, V., & Ortmann, A. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/9a5h3
Lai, L. M. H., & Mayiwar, L. (2023) · Collabra Psychology · doi:10.1525/collabra.90195
Can Recalling the 10 Commandments Serve as Honesty Intervention? An Update on the Scientific DebatePreprint
Mažar, N., Amir, O., & Dan Ariely, C. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4666025
Binding the Future: Long-sighted altruism boosts intergenerational sustainabilityPreprint
Halali, E., & Perez, O. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/9szky
Binding the Future: Long-sighted altruism boosts intergenerational sustainabilityPreprint
Perez, O., & Halali, E. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4681907
Hunger shifts attention and attribute weighting in dietary choice
March, J., & Gluth, S. (2025) · eLife · doi:10.7554/elife.103736.3 · Cited by 1
Knowing What We Don't Know: Targeting Overconfidence to Combat MisinformationPreprint
Taavila, S., Amara, M., Draginić, K., Jung, N. S., Li, X., & Sloksnath, P. R. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4872927
Brohmer, H., Hofer, G., Bauch, S. A., Beitner, J., Berkessel, J. B., Corcoran, K., García, D., Gruber, F. M., Giuliani, F., Jauk, E., et al. (2024) · doi:10.31219/osf.io/q56rk
Why are replication rates so low?
Vu, P. (2024) · Journal of Econometrics · doi:10.1016/j.jeconom.2024.105868 · Cited by 3
The Hungry Lens: Hunger Shifts Attention and Attribute Weighting in Dietary ChoicePreprint
March, J., & Gluth, S. (2024) · eLife · doi:10.7554/elife.103736.1
Bayesian Evaluation of Replication Studies
Leplaa, H. J., Rietbergen, C., & Hoijtink, H. (2024) · Meta-Psychology · doi:10.15626/mp.2020.2554 · Cited by 1
Texas attorneys recognize problematic eyewitness procedures, but plea away anyway
Jones, A. M., & Quinby, E. A. (2025) · Journal of Experimental Criminology · doi:10.1007/s11292-025-09668-7
Mental rotation, perspective taking, and performance profiling
Negen, J. (2025) · Cognitive Processing · doi:10.1007/s10339-025-01269-6 · Cited by 4
“This final goal number was based on the small telescopes approach (Simonsohn 2015) which advo-cates replicating an effect with 2.5 × the number of participants.”
InfluentialIp, M. H. C., & Feldman, G. (2025) · Personality and Social Psychology Bulletin · doi:10.1177/01461672251327169 · Cited by 1
“This approach also aligns with the conservative estimate of 460 according to the rule of thumb recommendations by Simonsohn (2015) for a sample size 2.5 times larger than the combined samples in the original article (80 in the original Study 1b and 104 in the original Study 3), though we note that…”
InfluentialHorsham, Z., Haydock-Symonds, A. N., Imada, H., Tai, H. C., Lau, W. L., Shum, T. L., Zeng, Y., Chow, H. T. K., & Feldman, G. (2025) · Royal Society Open Science · doi:10.1098/rsos.250441 · Cited by 1
Fostering transparency and reproducibility in psychological science.
Lindsay, D. S. (2025) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/cep0000381
Brydges, C. R., & Gaeta, L. (2025) · Journal of Speech Language and Hearing Research · doi:10.1044/2025_jslhr-22-00501
Rethinking Type S and M ErrorsPreprint
Lakens, D., Mesquida, C., Xavier-Quintais, G., Rasti, S., Toffalini, E., & Altoè, G. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/2phzb_v1
Does the mere presence of smartphones impact cognition in the high school classroom?
Roux, D., Parry, D. A., & Feldman, J. (2025) · Cyberpsychology Journal of Psychosocial Research on Cyberspace · doi:10.5817/cp2025-4-1 · Cited by 4
Narcissism and the appraisal of status-related social cues
Atkinson, B. E., & Heerey, E. A. (2025) · Journal of Research in Personality · doi:10.1016/j.jrp.2025.104671
Becker, M., Teige‐Mocigemba, S., Sherman, J. W., & Klauer, K. C. (2025) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2025.104842 · Cited by 1
Institutional entrepreneurship among small ventures: Moderating role of institutional environment
Vargas-Zeledón, A. A. (2025) · Journal of the International Council for Small Business · doi:10.1080/26437015.2025.2587071 · Cited by 1
“For instance, a design replication study could use a sample size 2.5 times as large as the original, achieving 80 percent statistical power for an equivalence test relative to an equivalence bound based on the original effect (Simonsohn, 2015).”
InfluentialWho Says Women Shouldn't Network? Mindsets That Predict and Reduce Bias Against Female Networkers
Kuwabara, K., & Martin, A. E. (2025) · Personnel Psychology · doi:10.1111/peps.70016
“This was indeed the case, b = − 0.13, SE = 0.12, p = 0.25, even with a sample of N = 430, triple the size of the original experiment, following current suggestions for replication (Simonsohn 2015).”
InfluentialRunning replicable experiments
Coffman, L. C., & Dreber, A. (2025) · Elsevier eBooks · doi:10.1016/bs.hbem.2025.09.010
Does Your Love Lift Me Higher? A Direct Replication of the Energising Role of Secure Relationships
Cem, A., & Harma, M. (2025) · International Journal of Psychology · doi:10.1002/ijop.70144
Revisiting Emotion-Induced Memory Effects in the Emotional Oddball Paradigm: A Replication Study
Schlüter, H., Hackländer, R. P. M., & Bermeitinger, C. (2026) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218251408811
Askelund, A. D., Wootton, R. E., Torvik, F. A., Lawn, R. B., Ask, H., Corfield, E. C., Magnus, M. C., Reichborn-Kjennerud, T., Magnus, P. M., Andreassen, O. A., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26705883
Askelund, A. D., Wootton, R. E., Torvik, F. A., Lawn, R. B., Ask, H., Corfield, E. C., Magnus, M. C., Reichborn-Kjennerud, T., Magnus, P. M., Andreassen, O. A., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26705886
Askelund, A. D., Wootton, R. E., Torvik, F. A., Lawn, R. B., Ask, H., Corfield, E. C., Magnus, M. C., Reichborn-Kjennerud, T., Magnus, P. M., Andreassen, O. A., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26705895
Askelund, A. D., Wootton, R. E., Torvik, F. A., Lawn, R. B., Ask, H., Corfield, E. C., Magnus, M. C., Reichborn-Kjennerud, T., Magnus, P. M., Andreassen, O. A., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26705889
Askelund, A. D., Wootton, R. E., Torvik, F. A., Lawn, R. B., Ask, H., Corfield, E. C., Magnus, M. C., Reichborn-Kjennerud, T., Magnus, P. M., Andreassen, O. A., et al. (2024) · Figshare · doi:10.6084/m9.figshare.26705892
Utterance ambiguity in uncertainty contexts strengthens scalar implicaturePreprint
Skoczeń, I., & Smywiński-Pohl, A. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/tsbw7
Metadata
- Authors
- Simonsohn, U.
- Affiliations
- University of Pennsylvania (US)
- Corresponding author
- Simonsohn, Uri
- ORCID
- Simonsohn, Uri
- Venue
- Psychological Science
- Publisher
- SAGE Publications
- Published
- 2015-03-23
- Volume
- 26
- Issue
- 5
- Pages
- 559-569
- ISSN
- 0956-7976 (ISSN-L)
- 1467-9280
- OpenAlex
- W2151509224
- Cited by
- 742
- References
- 52
- Citations by year
- 2026: 30 · 2025: 58 · 2024: 59 · 2023: 67 · 2022: 64 · 2021: 66 · 2020: 111 · 2019: 79 · 2018: 76 · 2017: 63 · 2016: 48 · 2015: 16
- FWCI
- 61.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- effect size estimation, hypothesis testing, replication study, statistical power, underpowered studies, small effect sizes
- MeSH terms
- Astronomy, Data Interpretation, Statistical, Research Design, Reproducibility of Results, Models, Statistical, Sample Size, Telescopes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.