Small Telescopes: Detectability and the Evaluation of Replication Results
The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
This article introduces a new approach for evaluating replication results. It combines effect-size estimation with hypothesis testing, assessing the extent to which the replication results are consistent with an effect size big enough to have been detectable in the original study. The approach is demonstrated by examining replications of three well-known findings. Its benefits include the following: (a) differentiating “unsuccessful” replication attempts (i.e., studies yielding p > .05) that are too noisy from those that actively indicate the effect is undetectably different from zero, (b) “protecting” true findings from underpowered replications, and (c) arriving at intuitively compelling inferences in general and for the revisited replications in particular.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“our replications employed 2.5 times the sample size of the original paper (8).”
From Empirical audit and review and an assessment of evidentiary value in research on the psychological consequences of scarcity (2021) · cites this paper as [8]
In the citing paper
“Selective reporting of measures, treatments, and analyses, and the p-hacking they enable (7) has been identified as an existential threat to behavioral science (8, 9)”
From Empirical audit and review and an assessment of evidentiary value in research on the psychological consequences of scarcity (2021) · cites this paper as [8]
In the citing paper
“This approach limits the sample size required to test for equivalence to 2.5 times the sample size of the original study.”
From Equivalence Tests: A Practical Primer for t Tests, Correlations, and Meta-Analyses (2017) · cites this paper as Simonsohn (2015)
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“If the original study is powered to 50%, an optimistic scenario (Button et al., 2013; Cohen, 1962; Rossi, 1990; Sedlmeier & Gigerenzer, 1989), the resulting upward bias in effect size would be severe enough that replications with samples sizes set to obtain 80% power, given the reported effects, would on average have…”
Schwarz, N., & Clore, G. L. (1983) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.45.3.513 · Cited by 4,952
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
Experimental Tests of the Endowment Effect and the Coase Theorem
Kahneman, D., Knetsch, J. L., & Thaler, R. H. (1990) · Journal of Political Economy · doi:10.1086/261737 · Cited by 3,194
Research works printed but not linked: 4
- Fisher R. A., 1926, Journal of the Ministry of Agriculture, 33, 503
- Jeffreys H., 1961, Theory of probability
- 10.3102/10769986008002093 · doi:10.3102/10769986008002093 · Paper page
- 10.1037/0003-066X.40.1.73 · doi:10.1037/0003-066x.40.1.73 · Paper page
Cited by
Items 401–500 of 743
Transaction Frame Determines Preferences: Valuation of Labor by Employee and Contractor
Ritov, I., & Schurr, A. (2020) · Psychological Science · doi:10.1177/0956797620916521 · Cited by 8
“Because of the greater attrition among MTurk workers than among students, and for purposes of replication (Simonsohn, 2015), we roughly doubled the sample size in each cell compared with the sample size in Experiment 1.”
A two-lab direct replication attempt of Southgate, Senju, & Csibra (2007)Preprint
Kampis, D., Karman, P., Csibra, G., Southgate, V., & Hernik, M. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/gzy26 · Cited by 10
Evaluating meta-analysis as a replication success measure
Muradchanian, J., Hoekstra, R., Kiers, H. A. L., & van Ravenzwaaij, D. (2024) · PLoS ONE · doi:10.1371/journal.pone.0308495 · Cited by 9
“In addition, there are statistical methods that have been specifically designed in order to quantify replication success such as the replication Bayes factor [17], the Small Telescopes approach [18], and the sceptical p -value [19].”
Monn, A., de Araujo, T. V., Rüesch, A., Kronenberg, G., Hörmann, C., Adank, A., Roman, Z. J., Schoretsanitis, G., Rufer, M., Seifritz, E., et al. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.04.023 · Cited by 9
A registered report megastudy on the persuasiveness of the most-cited climate messages
Voelkel, J. G., Ashokkumar, A., Abeles, A. T., Crawford, J. T., Fuller, K., Redekopp, C., Bongiorno, R., Campbell, T. H., Ecker, U. K. H., Feinberg, M., et al. (2026) · Nature Climate Change · doi:10.1038/s41558-025-02536-2 · Cited by 15
Infants differentiate between successful and failed communication in a false-belief context
Schulze, C., & Buttelmann, D. (2022) · Infant Behavior and Development · doi:10.1016/j.infbeh.2022.101770 · Cited by 9
Petrov, N. B., Chan, Y. K. M., Lau, C. N., Kwok, T. H., Chow, L. C. E., Lo, W. Y., Song, W., & Feldman, G. (2023) · International Review of Social Psychology · doi:10.5334/irsp.883 · Cited by 9
Weaver, H., Zettersten, M., & Saffran, J. R. (2024) · Child Development · doi:10.1111/cdev.14120 · Cited by 12
“We selected our smallest effect size of interest using the small-telescopes approach (Simonsohn, 2015), according to which the lower bound for equivalence testing is set as the effect size earlier studies would have had 33% power to detect.”
Does it actually feel right? A replication attempt of the rounded price effect
Harms, C., Genau, H. A., Meschede, C., & Beauducel, A. (2018) · Royal Society Open Science · doi:10.1098/rsos.171127 · Cited by 10
Vize, C. E., & Lynam, D. R. (2020) · European Journal of Personality · doi:10.1002/per.2241 · Cited by 8
van der Loo, J., Krahmer, E., & van Amelsvoort, M. (2020) · Journal of Motor Behavior · doi:10.1080/00222895.2020.1732861 · Cited by 8
Does Disgust Increase Unethical Behavior? A Replication of Winterich, Mittal, and Morales (2014)
Kugler, T., NOUSSAIR, C. N., & Hatch, D. (2020) · Social Psychological and Personality Science · doi:10.1177/1948550620944083 · Cited by 8
Kurtz, M., Scherbaum, S., Walser, M., Kanske, P., & Möschl, M. (2022) · Memory & Cognition · doi:10.3758/s13421-022-01289-z · Cited by 7
“(2017) study and aimed to replicate the discrete effects from this experiment, we aimed for a sample size about 2.5 times larger than in their study (N = 16) (Simonsohn, 2015).”
InfluentialHerec, J., Sykora, J., Brahmi, K., Vondracek, D., Dobesova, O., Smelik, M., Vaculík, M., & Procházka, J. (2022) · Cognitive Science · doi:10.1111/cogs.13168 · Cited by 7
Korbmacher, M., Kwan, C., & Feldman, G. (2022) · Judgment and Decision Making · doi:10.1017/s1930297500009189 · Cited by 8
“We tried to exceed this estimate (following replication recommendation such as Simonsohn, 2015) and added extensions thereby leading to the recruitment of 756 Amazon MTurkers.”
Dubèl, R., Schumacher, G., Homan, M. D., Peterson, D., & Bakker, B. N. (2024) · Media and Communication · doi:10.17645/mac.7807 · Cited by 9
“However, we can also use the heuristic by Simonsohn (2015).”
Madurski, C., & LeBel, E. P. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0757-4 · Cited by 9
Klauer, K. C., & Singmann, H. (2015) · PLoS ONE · doi:10.1371/journal.pone.0132885 · Cited by 7
Priming Risky Choice: Do Risk Preferences Need Inferences?
Newell, B. R., & Shaw, B. (2016) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1945 · Cited by 11
Nickel, L. B., Iveniuk, J., & Roberts, B. W. (2016) · Social Psychological and Personality Science · doi:10.1177/1948550616662026 · Cited by 9
Does Power Increase Self-Control? Episodic Priming May Not Provide the Answer
Heller, S., & Ullrich, J. (2017) · Collabra Psychology · doi:10.1525/collabra.48 · Cited by 9
Leal, S., Vrij, A., Vernham, Z., Dalton, G., Jupe, L. M., Nahari, G., & Rozmann, N. (2019) · Applied Cognitive Psychology · doi:10.1002/acp.3536 · Cited by 7
“It has been suggested that an adequately powered replication study should contain a sample size 2.5 times the original sample size (Simonsohn, 2015).”
InfluentialReteig, L. C., Newman, L. A., Ridderinkhof, K. R., & Slagter, H. A. (2022) · PLoS ONE · doi:10.1371/journal.pone.0262718 · Cited by 8
Data from a pre-publication independent replication initiative examining ten moral judgement effects
Tierney, W., Schweinsberg, M., Jordan, J., Kennedy, D. M., Qureshi, I., Sommer, S. A., Thornley, N., Madan, N., Vianello, M., Awtrey, E. C., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.82 · Cited by 7
Chatard, A., Bocage-Barthélémy, Y., Selimbegović, L., & Guimond, S. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/p7kfh · Cited by 6
The effects of facial attractiveness and trustworthiness in online peer-to-peer marketsPreprint
Jaeger, B., Sleegers, W. W. A., Evans, A. M., Stel, M., & van Beest, I. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/37cw4 · Cited by 8
Virtuous victimhood as a Dark Triad resource transfer strategy
Bates, T. C., Grant, C., Hobbs, L., Johnston, C. S., Moghaddam, S., & Sinclair, K. (2024) · Personality and Individual Differences · doi:10.1016/j.paid.2024.112964 · Cited by 8
Ciftci, B. G., Kominsky, J. F., & Csibra, G. (2025) · Royal Society Open Science · doi:10.1098/rsos.240229 · Cited by 6
“The sample size was determined before data collection by multiplying the original study’s sample size by 2.5 [25,26].”
InfluentialRevisiting the effect of discrepant perceptual fluency on truth judgments
Aktepe, S. C., & Heck, D. W. (2025) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2025.104774 · Cited by 7
Hu, C., Song, J., Hong, Y., & Zhou, R. (2023) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2023.03.044 · Cited by 9
Hamada, A., Shimizu, H., Hoshino, Y., Takaki, S., & Ushiro, Y. (2024) · Studies in Second Language Acquisition · doi:10.1017/s0272263124000226 · Cited by 15
“However, Simonsohn (2015) proposed small telescopes that combined null hypothesis significance testing with effect size estimation to examine whether the replicated effect size was significantly smaller than that of the original study.”
Workspace Disorder Does Not Influence Creativity and Executive Functions
Manzi, A., Durmysheva, Y., Pinegar, S. K., Rogers, A., & Ramos, J. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02662 · Cited by 6
“Moreover, in keeping with recent statistical guidelines for sound replication studies (Simonsohn, 2015), we employed a sample twice as large as the one in the study by Vohs et al. (2013).”
Choice behavior in autistic adults: What drives the extreme switching phenomenon?
Zeif, D., Yakobi, O., & Yechiam, E. (2023) · PLoS ONE · doi:10.1371/journal.pone.0282296 · Cited by 8
“We originally aimed for 200 autistic participants (based on the limitation of our resources [25]) but as PLOS ONE Choice behavior in autistic adults”
Sign-Congruence, External Validity, and Replication
Slough, T. L., & Tyson, S. A. (2025) · Political Analysis · doi:10.1017/pan.2024.26 · Cited by 12
“Heuristic versions of the sign-comparison test that differentiate between, for example, a positive (and significant) estimate versus a “null” estimate are prone to exceptionally high rates of Type-I error (incorrect rejections of the null hypothesis of sign congruence) (Simonsohn, 2015).”
Becker, M., Klauer, K. C., & Spruyt, A. (2016) · Attention Perception & Psychophysics · doi:10.3758/s13414-015-1046-7 · Cited by 6
Each Reader Decides if a Replication Counts
Simonsohn, U. (2016) · Psychological Science · doi:10.1177/0956797616665220 · Cited by 6
Self-citationCampbell, L., Balzarini, R. N., Kohut, T., Dobson, K., Hahn, C., Moroz, S. E., & Stanton, S. C. E. (2017) · Journal of Research in Personality · doi:10.1016/j.jrp.2017.04.001 · Cited by 6
Jury instructions and mock-juror sensitivity to confession evidence in a simulated criminal case
O’Donnell, C., & Safer, M. A. (2017) · Psychology Crime and Law · doi:10.1080/1068316x.2017.1351965 · Cited by 4
Crawford, J. T., Fournier, A., & Ruscio, J. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617740941 · Cited by 6
The cognitive effects of a promised bonus do not depend on dopamine synthesis capacity
Hofmans, L., van den Bosch, R., Määttä, J. I., Verkes, R., Aarts, E., & Cools, R. (2020) · Scientific Reports · doi:10.1038/s41598-020-72329-4 · Cited by 7
Lehmann, R., Jahnke, S., Bartels, R. M., Butzek, J., Molitor, A., & Schmidt, A. F. (2023) · The Journal of Sex Research · doi:10.1080/00224499.2023.2198512 · Cited by 8
“%) to be able to detect the expected population effect with a high probability of 95% (e.g., Simonsohn, 2015).”
A note on replication analysis
Hoeppner, S. (2019) · International Review of Law and Economics · doi:10.1016/j.irle.2019.05.004 · Cited by 5
Gyimesi, M. L., Vilsmeier, J. K., Voracek, M., & Tran, U. S. (2019) · Collabra Psychology · doi:10.1525/collabra.227 · Cited by 6
Calin-Jageman, R. J. (2018) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2017.12.008 · Cited by 6
Carruth, N. P., Ramos, J. A., & Miyake, A. (2023) · PLoS ONE · doi:10.1371/journal.pone.0287911 · Cited by 6
Honeycutt, N., Careem, A., Lewis, N. A., & Jussim, L. J. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ezp6d · Cited by 5
Hunger shifts attention and attribute weighting in dietary choicePreprint
March, J., & Gluth, S. (2025) · eLife · doi:10.7554/elife.103736 · Cited by 11
Chen, L., Benjamin, R., Guo, Y., Lai, A., & Heine, S. J. (2023) · Research Square · doi:10.21203/rs.3.rs-1254756/v1 · Cited by 5
Recruitment Strategies Bias Sampling and Shape Replicability
Vaughan‐Johnston, T. I., Imtiaz, F., Patro, G. A., Shang, S. X., Fabrigar, L. R., & Ji, L.-J. (2024) · Personality and Social Psychology Bulletin · doi:10.1177/01461672241293504 · Cited by 7
Faithless Found: Replication and Extension of Gervais (2011)
Mackey, C. D., Gallihugh, B., Morrison, K. R., & Gervais, W. M. (2025) · International Journal for the Psychology of Religion · doi:10.1080/10508619.2025.2491901 · Cited by 4
“…significant results in the same direction as the original findings, b) a “small telescopes” approach for assessing the replicability of effects (Simonsohn, 2015), and c) Bayes Factors comparing a null hypothesis with an alternative hypothesis informed by the original effect size ( d = .41;…”
Validation of an online imitation-inhibition task
Westfal, M., Cracco, E., Crusius, J., & Genschow, O. (2025) · Behavior Research Methods · doi:10.3758/s13428-024-02557-3 · Cited by 10
“Replications sometimes require more participants than were actually included in the original articles, if the original study was not sufficiently powered (Brandt et al., 2014; Simonsohn, 2015).”
Opening the closed mind? Effects of reading literary fiction on need for closure and creativity
Wimmer, L., Currie, G., Friend, S., & Ferguson, H. J. (2022) · Creativity Research Journal · doi:10.1080/10400419.2022.2087309 · Cited by 18
“Since Simonsohn (2015) recommended that replication studies use a sample 2.5 times the size of the original study, and given that Djikic and colleagues (Djikic et al., 2013) recruited N = 100 participants (for a final sample size of N = 87), we targeted an initial sample size of N = 250…”
InfluentialKim, G., Adams, I., Diaw, M., Celly, M., Nelson, L. D., & Jung, M. H. (2022) · PLoS ONE · doi:10.1371/journal.pone.0272434 · Cited by 5
Greitemeyer, T. (2023) · Social Influence · doi:10.1080/15534510.2023.2203947 · Cited by 9
“It is also of note that the number of participants was almost 2.5 times larger than the sample size in the original Piff et al. (2012) study (374 vs. 152), following suggestions by Simonsohn (2015) that the replication sample size should be 2.5 times the original sample size.”
InfluentialBrimbal, L., Jones, A. M., & Quinby, E. A. (2023) · Legal and Criminological Psychology · doi:10.1111/lcrp.12252 · Cited by 8
Mayiwar, L., Wan, K. H., Løhre, E., & Feldman, G. (2024) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218241255916 · Cited by 10
One-HIIT wonder: Can music make high-intensity interval training more pleasant?
Karageorghis, C. I., Guérin, S. M. R., Fessler, L., Howard, L. W., Pinto, C., Ojuri, O., Kuan, J., & Samwell-Nash, K. G. (2024) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2024.102717 · Cited by 7
Blankenberg, A., Binder, M., & Waichman, I. (2025) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2025.107347 · Cited by 4
Rosi, A., Cavallini, E., Gamboz, N., & Russo, R. (2016) · Judgment and Decision Making · doi:10.1017/s1930297500007294 · Cited by 9
“Hence, our overall sample included 2.5 times as many observations as the original sample size, thus providing a suitable size attempt to generalize previous findings (Simonsohn, 2015).”
InfluentialCan gender priming eliminate the effects of stereotype threat? The case of simple dynamic systems
Lungwitz, V., Sedlmeier, P., & Schwarz, M. A. (2018) · Acta Psychologica · doi:10.1016/j.actpsy.2018.05.010 · Cited by 8
Adjusting Sample Sizes for Different Categories of Embodied Cognition Research
Skulmowski, A., & Rey, G. D. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02384 · Cited by 7
“However, we argue that the three aspects discussed in this paper may help to identify potentially problematic study designs; and that using one of the methods described by Perugini et al. (2014) and Simonsohn (2015) could help to improve embodiment research.”
InfluentialSkilled musicians are indeed subject to the McGurk effect
Politzer‐Ahles, S., & Pan, L. (2019) · Royal Society Open Science · doi:10.1098/rsos.181868 · Cited by 5
Berndt, E., Dudschig, C., Miller, J. O., & Kaup, B. (2019) · Acta Psychologica · doi:10.1016/j.actpsy.2019.102871 · Cited by 5
Guo, J., & Luh, W. (2019) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12172 · Cited by 6
Wilde, M. D., Casini, A., Bernard, P., Wollast, R., Klein, O., & Demoulin, S. (2020) · Psychological Science · doi:10.1177/0956797619896273 · Cited by 5
“…and Perugini (2013) to maintain stability in correlational studies and to avoid noisiness in measures (e.g., Schönbrodt, 2013); using the smalltelescopes approach of Simonsohn (2015), we estimated a sample size of at least 2.5 times the one in the original study (i.e., minimum 125 women).”
InfluentialSchlaghecken, F., & Maylor, E. A. (2020) · Journal of Experimental Psychology General · doi:10.1037/xge0000755 · Cited by 6
Reliability of Inference: Analogs of Replication in Qualitative Research
Fairfield, T., & Charman, A. E. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.012 · Cited by 6
Tebbe, J., Humble, E., Stoffel, M. A., Tewes, L. J., Müller, C., Forcada, J., Caspers, B. A., & Hoffman, J. I. (2020) · PeerJ · doi:10.7717/peerj.10131 · Cited by 6
Ward, R. T., Lotfi, S., Stout, D. M., Mattson, S., Lee, H., & Larson, C. L. (2021) · Biological Psychology · doi:10.1016/j.biopsycho.2021.108091 · Cited by 5
Pollet, T. V., Dawson, S., Tovée, M. J., Cornelissen, P. L., & Cornelissen, K. K. (2021) · Body Image · doi:10.1016/j.bodyim.2021.05.005 · Cited by 11
Blanchar, J. C., Alonzo, M., Ayoh, C., Blain, K., Espinoza, L., Estrada, M., Gillen, J., Marquez, A., Miao, J., Overbeck, V., et al. (2021) · Social Psychology · doi:10.1027/1864-9335/a000448 · Cited by 7
Hu, C., Oei, T. P. S., Huang, Q., & Zhou, R. (2021) · Current Psychology · doi:10.1007/s12144-021-02454-4 · Cited by 8
Schumann, S., Salman, N. L., Clemmow, C., & Gill, P. (2021) · Legal and Criminological Psychology · doi:10.1111/lcrp.12201 · Cited by 8
Gerring, J., Mahoney, J., & Elman, C. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.001 · Cited by 6
Prediction scoring of data-driven discoveries for reproducible research
Smith, A. L., Zheng, T., & Gelman, A. (2022) · Statistics and Computing · doi:10.1007/s11222-022-10154-7 · Cited by 8
“6 Other approaches include using Bayes factors or the small-telescopes approach (Simonsohn, 2015), though these methods seem far less popular than traditional NHSTs.”
Huang, C., Butterworth, J. W., Finley, A. J., Angus, D. J., Sedikides, C., & Kelley, N. J. (2023) · Journal of Personality · doi:10.1111/jopy.12876 · Cited by 6
“We selected r = 0.10 as the smallest effect size of interest, as it is considered a small effect size that is potentially consequential (Funder & Ozer, 2019) and a previous study with the same sample size as ours would have less than 33% power to detect that effect (Simonsohn, 2015).”
InfluentialThe Medusa effect: a registered replication report of Will, Merritt, Jenkins and Kingstone (2021)
Han, J., Zhang, M., Liu, J., Song, Y., & Yamada, Y. (2024) · Royal Society Open Science · doi:10.1098/rsos.231802 · Cited by 6
The effect of font readability on the Moses illusion: A replication study
Janouskova, A., Kocyan, J., Simova, M., Uvirova, K., Zahradníčková, K., Vaculík, M., & Procházka, J. (2022) · Consciousness and Cognition · doi:10.1016/j.concog.2022.103284 · Cited by 6
Crawford, J. T., Vodapalli, S., Stingel, R., & Ruscio, J. (2018) · Social Psychological and Personality Science · doi:10.1177/1948550618792057 · Cited by 5
“We supplemented these traditional decisions about replicability (i.e., Is p < .05 in the predicted direction?) with a “small telescopes” approach (Simonsohn, 2015).”
Use of Repeated Within-Subject Measures to Assess Infants’ Preference for Similar Others
Cruz‐Khalili, A., Bettencourt, K., Kohn, C. S., Normand, M. P., & Schlinger, H. D. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02239 · Cited by 6
“We support the call for a priori decisions about sample size (e.g., Simmons et al., 2011; Simonsohn, 2015; Eason et al., 2017) and use of power analyses to help determine this sample size.”
Babcock, S. E., Li, Y., Sinclair, V. M., Thomson, C., & Campbell, L. (2017) · Scientific Data · doi:10.1038/sdata.2016.129 · Cited by 8
Röseler, L., Bögler, H. L., Koßmann, L., Krueger, S., Bickenbach, S., Bühler, R., della Guardia, J., Köppel, L.-M., Ponader, S., Roßmaier, K., et al. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/bgp3m · Cited by 10
McKay, B., Bacelar, M. F. B., Parma, J. O., Miller, M. W., & Carter, M. J. (2022) · doi:10.31234/osf.io/3nhtc · Cited by 5
Equivalence Testing for Psychological Research: A TutorialPreprint
Scheel, A. M., Lakens, D., & Isager, P. M. (2017) · OSF Preprints (OSF Preprints) · doi:10.17605/osf.io/qamc6 · Cited by 10
Aiyer, S., Ching, K. H., Ng, K., Young, N. A., Shi, J., & Feldman, G. (2023) · International Review of Social Psychology · doi:10.5334/irsp.751 · Cited by 7
Prowten, S. D., Walker, E., London, B., Pearce, E., Napoli, A., Chenevert, B., Clevenger, C. T., & Smith, A. R. (2024) · Psychological Science · doi:10.1177/09567976241257255 · Cited by 8
“Detectability Simonsohn (2015) described an alternative method for evaluating replications by examining whether the effects found in the replications were “. . . close enough to zero that the original study would have been unable to mean-ingfully study an effect that small” (p. 560).”
InfluentialWong, C. L., & Feldman, G. (2025) · Royal Society Open Science · doi:10.1098/rsos.240687 · Cited by 5
“Our target sample is over three times larger than any of the of samples reported in the target article (Study 1: 236; Study 2: 112; Study 5: 143; Studies 3, 4, 6 and 7: not reported), meeting and exceeding the Simonsohn [37] small telescopes rule-of-thumb.”
Concerns About Replicability Across Two Crises in Social Psychology
Lakens, D. (2025) · International Review of Social Psychology · doi:10.5334/irsp.1036 · Cited by 8
The psychological impact of digital signatures: A multistudy replication.
Tzelios, K., & Williams, L. A. (2020) · Technology Mind and Behavior · doi:10.1037/tmb0000019 · Cited by 6
Replication for Quantitative Research
Freese, J., & Peterson, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.010 · Cited by 4
Lehmann, R., Schäfer, T., Helmus, L. M., Henniges, J., & Fleischhauer, M. (2023) · Sexual Abuse · doi:10.1177/10790632221148667 · Cited by 5
“%) to be able to detect the expected population effect with a high probability of 95% (e.g., Open Science Collaboration, 2012; Simonsohn, 2015).”
Walker, R. M., Jia-sheng, Z., & Cheng, E. W. (2023) · Political Psychology · doi:10.1111/pops.12938 · Cited by 8
When brokers don’t broker: Mitigating referral aversion in third-party help exchange
Park, Y., Nault, K., & Kuwabara, K. (2023) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2023.104294 · Cited by 5
Bogdanov, B., Corbin, J. C., Dobreva, S., McElroy, T., & Rachev, N. R. (2023) · Judgment and Decision Making · doi:10.1017/jdm.2023.40 · Cited by 8
Cobos, P. L., Quintero, M. J., López, F. J., Luque, D., Ciria, L. F., & Morís, J. (2024) · PLoS ONE · doi:10.1371/journal.pone.0298503 · Cited by 10
“Following the small-telescopes approach proposed by Simonsohn [28], we estimated a target effect size based on the original experiment.”
Li, Y., & Bates, T. C. (2025) · Personality and Individual Differences · doi:10.1016/j.paid.2025.113111 · Cited by 4
Binding the future boosts intergenerational sustainability
Halali, E., & Perez, O. (2025) · npj Climate Action · doi:10.1038/s44168-025-00216-7 · Cited by 6
Transparency and Reproducibility: Conceptualizing the Problem
Christensen, G., & Miguel, E. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.006 · Cited by 4
Measurement Replication in Qualitative and Quantitative Studies
Reiter, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.011 · Cited by 5
Is future self‐relevance necessary to increase saving for retirement? A replication study
Stockdale, E., & Sanders, M. (2020) · Journal of Applied Social Psychology · doi:10.1111/jasp.12673 · Cited by 6
Metadata
- Authors
- Simonsohn, U.
- Affiliations
- University of Pennsylvania (US)
- Corresponding author
- Simonsohn, Uri
- ORCID
- Simonsohn, Uri
- Venue
- Psychological Science
- Publisher
- SAGE Publications
- Published
- 2015-03-23
- Volume
- 26
- Issue
- 5
- Pages
- 559-569
- ISSN
- 0956-7976 (ISSN-L)
- 1467-9280
- OpenAlex
- W2151509224
- Cited by
- 742
- References
- 52
- Citations by year
- 2026: 30 · 2025: 58 · 2024: 59 · 2023: 67 · 2022: 64 · 2021: 66 · 2020: 111 · 2019: 79 · 2018: 76 · 2017: 63 · 2016: 48 · 2015: 16
- FWCI
- 61.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- effect size estimation, hypothesis testing, replication study, statistical power, underpowered studies, small effect sizes
- MeSH terms
- Astronomy, Data Interpretation, Statistical, Research Design, Reproducibility of Results, Models, Statistical, Sample Size, Telescopes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.