Small Telescopes: Detectability and the Evaluation of Replication Results
The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
This article introduces a new approach for evaluating replication results. It combines effect-size estimation with hypothesis testing, assessing the extent to which the replication results are consistent with an effect size big enough to have been detectable in the original study. The approach is demonstrated by examining replications of three well-known findings. Its benefits include the following: (a) differentiating “unsuccessful” replication attempts (i.e., studies yielding p > .05) that are too noisy from those that actively indicate the effect is undetectably different from zero, (b) “protecting” true findings from underpowered replications, and (c) arriving at intuitively compelling inferences in general and for the revisited replications in particular.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“our replications employed 2.5 times the sample size of the original paper (8).”
From Empirical audit and review and an assessment of evidentiary value in research on the psychological consequences of scarcity (2021) · cites this paper as [8]
In the citing paper
“Selective reporting of measures, treatments, and analyses, and the p-hacking they enable (7) has been identified as an existential threat to behavioral science (8, 9)”
From Empirical audit and review and an assessment of evidentiary value in research on the psychological consequences of scarcity (2021) · cites this paper as [8]
In the citing paper
“This approach limits the sample size required to test for equivalence to 2.5 times the sample size of the original study.”
From Equivalence Tests: A Practical Primer for t Tests, Correlations, and Meta-Analyses (2017) · cites this paper as Simonsohn (2015)
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · cited 1×
“If the original study is powered to 50%, an optimistic scenario (Button et al., 2013; Cohen, 1962; Rossi, 1990; Sedlmeier & Gigerenzer, 1989), the resulting upward bias in effect size would be severe enough that replications with samples sizes set to obtain 80% power, given the reported effects, would on average have…”
Schwarz, N., & Clore, G. L. (1983) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.45.3.513 · Cited by 4,952
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
Experimental Tests of the Endowment Effect and the Coase Theorem
Kahneman, D., Knetsch, J. L., & Thaler, R. H. (1990) · Journal of Political Economy · doi:10.1086/261737 · Cited by 3,194
Research works printed but not linked: 4
- Fisher R. A., 1926, Journal of the Ministry of Agriculture, 33, 503
- Jeffreys H., 1961, Theory of probability
- 10.3102/10769986008002093 · doi:10.3102/10769986008002093 · Paper page
- 10.1037/0003-066X.40.1.73 · doi:10.1037/0003-066x.40.1.73 · Paper page
Cited by
Items 501–600 of 743
The interaction game: A reciprocity‐based minimal paradigm for the induction of social distance
Biella, M., Rebholz, T. R., Holthausen, M., & Hütter, M. (2023) · Journal of Applied Social Psychology · doi:10.1111/jasp.12969 · Cited by 7
Sensory augmentation for a rapid motor task in a multisensory environment
Negen, J., Slater, H., & Nardini, M. (2023) · Restorative Neurology and Neuroscience · doi:10.3233/rnn-221279 · Cited by 4
“Thedecisiontotest20adults wasbasedonsignificantpilotresultswith8partici-pantsandthesmalltelescopesapproach(Simonsohn, 2015),whichadvocatesa2.”
A Test of Racial Disparities in Principals’ Disciplinary Decisions in a National Sample
Jarvis, S. N., Ferguson, Z. E., & Okonofua, J. A. (2023) · Collabra Psychology · doi:10.1525/collabra.88326 · Cited by 5
Can simulated experience be harnessed to help people make investment decisions?
Lejarraga, T., Ranganathan, K., & Wulff, D. U. (2024) · Judgment and Decision Making · doi:10.1017/jdm.2024.17 · Cited by 3
Kato, T. (2018) · The Japanese Journal of Personality · doi:10.2132/personality.27.2.11 · Cited by 6
Similar event-related potentials to structural violations in music and language
de Leeuw, J. R. (2019) · Meta-Psychology · doi:10.15626/mp.2018.1481 · Cited by 4
Assessing evidence for replication: A likelihood-based approach
Dixon, P., & Glover, S. (2020) · Behavior Research Methods · doi:10.3758/s13428-020-01403-6 · Cited by 8
““Small telescopes” Simonsohn (2015) described an interesting alternative solution to the question of replication.”
InfluentialAnvari, F., & Marchiori, D. (2021) · Royal Society Open Science · doi:10.1098/rsos.201944 · Cited by 4
Effects of Nature Exposure and Nature Relatedness On Goals: Implications For Materialism
Dopko, R. L. (2017) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2017-12071 · Cited by 4
The organizational principles of de-differentiated topographic maps in somatosensory cortexPreprint
Liu, P., Chrysidou, A., Doehler, J., Hebart, M. N., Wolbers, T., & Kuehn, E. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.07.08.179978 · Cited by 4
Muradchanian, J., Hoekstra, R., Kiers, H. A. L., & van Ravenzwaaij, D. (2020) · doi:10.31222/osf.io/wvdjf · Cited by 4
Replication success under questionable research practices – a simulation studyPreprint
Freuli, F., Held, L., & Heyard, R. (2022) · doi:10.31222/osf.io/s4b65 · Cited by 4
Marshall, B. M., & Duthie, A. B. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.06.19.599733 · Cited by 6
Research into evidence-based psychological interventions needs a stronger focus on replicability
Niemeyer, H., Knaevelsrud, C., van Aert, R. C. M., & Ehring, T. (2023) · Clinical Psychology in Europe · doi:10.32872/cpe.9997 · Cited by 3
“Small telescopes approach (Simonsohn, 2015): Is the replication effect size not significantly smaller than an effect size that would have 33% statistical power based on the sample size of the original study?”
Predicting replication outcomes and generalizability of results
Dreber, A. (2025) · European Review of Agricultural Economics · doi:10.1093/erae/jbaf035 · Cited by 3
Investigating the ease-of-retrieval effect in an eyewitness context
Groncki, R., Beaudry, J. L., & Sauer, J. D. (2021) · Memory · doi:10.1080/09658211.2021.1882502 · Cited by 3
A very public replication of the temporal pattern to people's regrets
Richardson, J., & Gilovich, T. D. (2023) · Royal Society Open Science · doi:10.1098/rsos.221574 · Cited by 4
Costigan, S., Ruscio, J., & Crawford, J. T. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459241227865 · Cited by 4
“Given that the goal is to assess whether power exceeds 33% (following the advice of Simonsohn, 2015), estimation using 10,000 bootstrap samples should provide sufficient precision.”
InfluentialSchwerin, J., Lenhart, J., & Richter, T. (2025) · Scientific Study of Literature · doi:10.61645/ssol.191 · Cited by 3
Emotional interference during conflict resolution depends on task context
Ahmed, S. P., & Sebastian, C. L. (2019) · Cognition & Emotion · doi:10.1080/02699931.2019.1701417 · Cited by 4
“…size was comparable to previous similar studies (38 participants in Sommer et al.’s (2008) study and 26 in Kanske and Kotz (2011b)) and double that of Sebastian et al.’s original study (20 participants), to maximise the chance of detecting the hypothesised effect if present (Simonsohn, 2015).”
McKay, B., Hussien, J., Carter, M. J., Yantha, Z. D., & Ste‐Marie, D. M. (2021) · Communications in Kinesiology · doi:10.51224/cik.v1i2.39 · Cited by 3
Chandrashekar, S. P., Cheng, Y. H., brian, F. C. L., Leung, Y. C., Tung, W. Y., Cheng, B., & Feldman, G. (2021) · Meta-Psychology · doi:10.15626/mp.2020.2474 · Cited by 3
Who's a yea‐sayer? Habitual trust and affirmative response behaviour
Posten, A., & Steinmetz, J. (2022) · European Journal of Social Psychology · doi:10.1002/ejsp.2839 · Cited by 3
Chan, E. W., Wong, J., Chan, C. S., & Cheung, F. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_18 · Cited by 4
Looking guilty: Handcuffing suspects influences judgements of deception
Zloteanu, M., Salman, N. L., Krumhuber, E. G., & Richardson, D. C. (2022) · Journal of Investigative Psychology and Offender Profiling · doi:10.1002/jip.1597 · Cited by 3
“For example, replications can consider the effect sizes reported and their confidence intervals to estimate future results (e.g., prediction intervals; Cumming, 2008), and calculate the statistical power needed to reproduce the effect (e.g., considering ξ 33% ; see, Simonsohn, 2015).”
Auditing the value of empirical audits
Lynch, J. G., Fernbach, P. M., & Kan, C. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2213200120 · Cited by 3
Scheffel, C., Korb, F. M., Dörfel, D., Eder, J., Möschl, M., Schoemann, M., & Scherbaum, S. (2023) · Psychologische Rundschau · doi:10.1026/0033-3042/a000643 · Cited by 4
Meckling, H. I., Nauta, M. H., van Hout, W. J. P. J., & Wessel, I. (2024) · Memory · doi:10.1080/09658211.2024.2307925 · Cited by 8
“Following the recommendations by Simonsohn (2015), we set the equivalence bounds to the smallest e ff ect size of interest, which our previous experiment had 33% power to detect ( d = ± 0.31).”
InfluentialRecovering the Anchoring of Economic Valuations
Guo, L. (2021) · American Economic Journal Microeconomics · doi:10.1257/mic.20200320 · Cited by 5
van Eersel, G. G., Verkoeijen, P. P. J. L., Bouwmeester, S., Tabbers, H. K., & Rikers, R. M. J. P. (2017) · Journal of Cognitive Psychology · doi:10.1080/20445911.2017.1300156 · Cited by 4
The Effect of Thinking about Being Excluded by God on Well-Being: A Replication and Extension
George, A. R., Wesselmann, E. D., Hilgard, J., Young, A. I., & van Beest, I. (2020) · International Journal for the Psychology of Religion · doi:10.1080/10508619.2020.1801228 · Cited by 3
“…smaller than the effect van Beest and Williams (2011) had 33% power to detect (see small-telescopes approach, Lakens, Schell, & Isager, 2018; Simonsohn, 2015), and 3) beyond this point, studies would require more than 300 participants to achieve 80% one-tailed power, which may be…”
Schumann, S., Salman, N. L., Clemmow, C., & Gill, P. (2020) · Legal and Criminological Psychology · doi:10.1111/lcrp.12186 · Cited by 5
A Viable Approach to Mitigating Irreproducibility
Trafimow, D., Wang, T., & Wang, C. (2021) · Stats · doi:10.3390/stats4010015 · Cited by 3
“Simohnson [3] suggested an approach that focusses on the statistical power engendered by the researcher’s sample size; the idea is that if a study with a larger sample was insufficient to obtain statistical significance with a reasonable probability, a study with a smaller sample size is even less trustworthy.”
No Meaningful Difference in Attentional Bias Between Daily and Non-Daily Smokers
Bartlett, J. E., Jenks, R. A., & Wilson, N. (2022) · Journal of Trial and Error · doi:10.36850/e11 · Cited by 4
Illusory inconsistencies in judgment: Stimulus-evoked reference sets and between-subjects designs
Leong, L. M., McKenzie, C. R. M., Sher, S., & Müller‐Trede, J. (2019) · Psychonomic Bulletin & Review · doi:10.3758/s13423-019-01585-x · Cited by 5
Les pratiques de recherche ouvertes en psychologie
Lantian, A. (2020) · Psychologie Française · doi:10.1016/j.psfr.2020.09.001 · Cited by 6
“Pour faire une analogie, cela reviendrait à essayer de détecter une planète d’un autre système solaire avec de simples jumelles (analogie dérivée de celle du « télescope » développée par Simonsohn, 2015).”
Reflections on a registered report replicating a body of dyadic cross‐sectional research
Baker, Z. G., Gentzis, E., Watlington, E. M., Castejon, S., Petit, W. E., Britton, M., Haddad, S., DiBello, A. M., Rodriguez, L. M., Derrick, J. L., et al. (2020) · Personal Relationships · doi:10.1111/pere.12343 · Cited by 3
Partition dependence in financial aid distribution to income categories
Xing, C., Williams, K. N., Hom, J., Kandlur, M., Owoyemi, P., Paul, J., Alexander, R., Shackney, E., & Barth, H. C. (2020) · PLoS ONE · doi:10.1371/journal.pone.0231135 · Cited by 3
“A potential limitation of the present replication work is the relatively small sample size given some recent recommendations [14].”
Pollet, T. V., & Saxton, T. K. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/28yvp · Cited by 3
Equivalence Tests: A Practical Primer for t-Tests, Correlations, and Meta-AnalysesPreprint
Lakens, D. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/97gpc_v1 · Cited by 5
Online Platforms Provide Access to Valid Eastern SamplesPreprint
Wang, L., Gao, R., Jung, M. H., Hung, I. W., & Nelson, L. D. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5488129 · Cited by 3
Quinten, L. K. J. L., Murmann, A. C., Genau, H. A., Warkentin, R., & Banse, R. (2020) · Social Cognition · doi:10.1521/soco.2020.38.6.521 · Cited by 3
Transfer Across Episodes of Analogical Reasoning: The Role of Visuo-Spatial Schemas
Navarrete-Ulloa, J. A., & Trench, M. (2025) · Journal of Cognition · doi:10.5334/joc.408 · Cited by 2
Eales, K., Lipp, O. V., Anderson, J., Jarvis, M. A., & Ney, L. J. (2025) · Behaviour Research and Therapy · doi:10.1016/j.brat.2025.104828 · Cited by 4
Lou, N. M., & Chipongian, K. (2026) · Journal of Community & Applied Social Psychology · doi:10.1002/casp.70227 · Cited by 2
Transparency and Reproducibility: Potential Solutions
Christensen, G., & Miguel, E. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.007 · Cited by 3
Can the color red trick you into drinking less? A replication study
Dolezalova, B., Hubackova, N., Latalova, K., Výborová, E., Žáková, M., Vaculík, M., & Procházka, J. (2021) · Appetite · doi:10.1016/j.appet.2021.105619 · Cited by 2
On the Accuracy of Replication Failure Rates
Schauer, J. M. (2022) · Multivariate Behavioral Research · doi:10.1080/00273171.2022.2066500 · Cited by 3
“To date, several possible analysis procedures have been proposed and used (e.g., Etz & Vandekerckhove, 2016; Hedges & Schauer, 2019b; Simonsohn, 2015; van Aert & van Assen, 2017).”
Orhan, M. A., Collisson, B., Howell, J. L., Kowal, M., & Pollet, T. V. (2023) · Psychological Reports · doi:10.1177/00332941231164079 · Cited by 2
“During pre-registration, we determined the required, highly powered sample size based on the following formula for successful replication: Sample size = 2.5*Original study sample size (678) = 1,695, as suggested by Brandt et al. (2014) and Simonsohn (2015).”
InfluentialThink Once, Think Again: Exploring the Harm-Made Mind Effect Through Dual-Process Theory
Koban, K., & Wieringa, M. S. (2024) · International Journal of Social Robotics · doi:10.1007/s12369-024-01179-1 · Cited by 8
Morris, S. L., & Blakemore, E. T. (2025) · Journal of the Experimental Analysis of Behavior · doi:10.1002/jeab.4242 · Cited by 2
Lee, G. K. (2025) · Strategic Management Review · doi:10.1561/111.00000081 · Cited by 4
No Evidence that People Born to Older Parents Show Weaker Preferences for Younger Adult Faces
Li, J., Lee, P., Rafiee, Y., Jones, B. C., & Shiramizu, V. K. M. (2025) · Adaptive Human Behavior and Physiology · doi:10.1007/s40750-025-00263-8 · Cited by 3
“Simonsohn (2015) recommended replications test 2.5 times the sample size used in the original study (Perrett et al., 2002 tested 35 men and 48 women).”
InfluentialGetting things done: Conscientiousness enables physical effort by reducing frustration
Bates, T. C. (2025) · Personality and Individual Differences · doi:10.1016/j.paid.2025.113367 · Cited by 3
Thomson, J. S. H., & Hedger, S. C. V. (2025) · Psychology International · doi:10.3390/psycholint7030060 · Cited by 6
Gerring, J., Karcher, S., & Apfeld, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.015 · Cited by 3
Replicability and Meta-Analysis
Schauer, J. M. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_14 · Cited by 3
The category size bias: A mere misunderstanding
Perfecto, H., Nelson, L. D., & Moore, D. A. (2018) · Judgment and Decision Making · doi:10.1017/s1930297500007087 · Cited by 2
“We chose this sample size as it is roughly 2.5 times that of the original study (Simonsohn, 2015).”
InfluentialBoch, M., Tran, U. S., & Voracek, M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01601 · Cited by 2
“…death penalty questionnaire sum score, we calculated the effect size for which the original study would have had 33% power to detect it (the so-called r33% in the small-telescopes analysis method, as introduced by Simonsohn, 2015), based on the sample size of the Till et al. (2016) study.”
InfluentialWhat’s Wrong with Replicating the Old Boys’ Networks?
Teele, D. L. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.016 · Cited by 2
Gerring, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.013 · Cited by 2
Lieberman, E. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.003 · Cited by 3
McCarthy, R. J. (2023) · Aggressive Behavior · doi:10.1002/ab.22102 · Cited by 3
The implicit perception of harm following moral violations in autism
Osler, G., Franchin, L., Guglielmetti, G., Calzolari, S., Micciolo, R., & Surian, L. (2023) · Thinking & Reasoning · doi:10.1080/13546783.2023.2259538 · Cited by 2
“…in experiment 1, it is important to keep in mind the problematic nature of replicating previous work with the same size sample. in line with Simonsohn (2015), we would need about 2.5 times the original sample size. thus, experiment 1 could result as an underpowered replication. in the same…”
InfluentialChoosing, rejecting, and closely replicating, 30 years later: A commentary on Chandrashekar et al.
Shafir, E. B., & Cheek, N. N. (2024) · Judgment and Decision Making · doi:10.1017/jdm.2023.48 · Cited by 4
“In Study 1, we aimed to recruit 600 participants through Prolific to ensure that we had more than 2.5 × times (see Simonsohn, 2015 for details) the original sample size of Shafir (1993), along with additional power to further detect potentially smaller effect sizes within our budgetary constraints.”
InfluentialThe sceptical Bayes factor for the assessment of replication successPreprint
Pawel, S., & Held, L. (2020) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-196009 · Cited by 2
From 2D to 3D: enhanced access to human conscious awarenessPreprint
Mudrik, L., & Korisky, U. (2020) · doi:10.31234/osf.io/zpg4x · Cited by 2
Weaver, H., Zettersten, M., & Saffran, J. R. (2022) · doi:10.31234/osf.io/njh38 · Cited by 2
Preregistration: the good, the bad, and the confusingPreprint
de Cheveigné, A. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/bcd9t · Cited by 2
The Role of Trust in the Social Heuristics HypothesisPreprint
Montealegre, A., & Jiménez‐Leal, W. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/d6wkq · Cited by 2
Chandrashekar, S. P., Cheng, Y. H., brian, F. C. L., Chit, L. Y., Tung, W. Y., Cheng, B., & Feldman, G. (2020) · doi:10.31234/osf.io/b9drz · Cited by 2
Bertoldo, G. (2019) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/w63h7 · Cited by 2
Laypeople Can Predict Which Social Science Studies ReplicatePreprint
Hoogeveen, S., Sarafoglou, A., & Wagenmakers, E. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/egw9d · Cited by 2
Koppel, L., Andersson, D., Tinghög, G., Västfjäll, D., & Feldman, G. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/2ewb9 · Cited by 2
Cobos, P. L., Quintero, M. J., López, F. J., Luque, D., Ciria, L. F., & Morís, J. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.01.29.577520 · Cited by 2
Manley, H., Savejnarong, T., Pornsukjantra, P., Bunditanukul, M., & Sasipongsakorn, N. (2022) · European Journal of Sport Science · doi:10.1080/17461391.2022.2152731 · Cited by 1
“Because it is problematic to use e ff ect sizes from previous results to determine the present sample size, the minimum sample size for the replication was justi fi ed based on the proposal that replication studies should use samples that are 2.5 times larger than the original (Simonsohn, 2015).”
InfluentialThe who and the where: Attention to identities and locations in groups
Ma, H. L., Redden, R. S., & Hayward, D. A. (2024) · Attention Perception & Psychophysics · doi:10.3758/s13414-024-02879-6 · Cited by 1
Does Watching Fictional TV Series Increase Social-Cognitive Skills?
Lenhart, J., & Richter, T. (2024) · Scientific Study of Literature · doi:10.61645/ssol.184 · Cited by 1
Chan, C. W., Lim, H. C., Lau, F. Y., Ip, W., Lui, C. F. S., Tam, K. Y. Y., & Feldman, G. (2025) · Royal Society Open Science · doi:10.1098/rsos.250508 · Cited by 2
Higher cognitive ability linked to weaker moral foundations in UK adults
Zakharin, M., & Bates, T. C. (2025) · Intelligence · doi:10.1016/j.intell.2025.101930 · Cited by 7
Dhanda, N., Ziano, I., Ching, K. H., Phuong, A. K. L., Lo, Y. T., Yip, M. K., Shi, B., & Cheng, B. (2025) · Personality and Social Psychology Bulletin · doi:10.1177/01461672251345021 · Cited by 2
“Using the rule of thumb by Simonsohn (2015), the replication study required at least two and a half times more participants than that of the original study, which is 515 participants (262 [Study 2a] × 2.5 = 515).”
InfluentialLee, S. C., & Feldman, G. (2025) · Royal Society Open Science · doi:10.1098/rsos.250908 · Cited by 2
Yu, T., Mao, Y., Qiu, J., Zhang, Y., & Liu, J. (2025) · Personality and Individual Differences · doi:10.1016/j.paid.2025.113403 · Cited by 1
Takahashi, R., Imada, H., & Mifune, N. (2025) · Journal of Social and Political Psychology · doi:10.5964/jspp.16589 · Cited by 1
Comay, N. A., Solovey, G., & Barttfeld, P. (2025) · Royal Society Open Science · doi:10.1098/rsos.231805 · Cited by 2
Assessing the validity evidence for habit measures based on time pressure
Martínez-López, P., Vázquez-Millán, A., Garre-Frutos, F., & Luque, D. (2025) · Behavior Research Methods · doi:10.3758/s13428-025-02865-2 · Cited by 5
“We followed Simonsohn's small telescope approach (Simonsohn, 2015) to estimate the target effect size for the main analyses conducted on the forced-response test data.”
Scerrati, E., & Estes, Z. (2025) · Language and Cognition · doi:10.1017/langcog.2025.10031 · Cited by 1
“Sampling Simonsohn (2015) recommended that replication samples should be about 2.5 times larger than the original sample.”
InfluentialYeo, J., & Stein, J.-P. (2025) · Computers in Human Behavior Artificial Humans · doi:10.1016/j.chbah.2025.100231 · Cited by 3
The limits of moral framing in promoting pro-environmentalism: A preregistered replication of
Voit, M., Twardawski, M., & Fischer, M. V. (2026) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2026.104871 · Cited by 1
Survival Processing Enhances Visual Search Efficiency
Cho, K. W. (2018) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000398 · Cited by 1
Koppel, L., Andersson, D., Tinghög, G., Västfjäll, D., & Feldman, G. (2023) · Meta-Psychology · doi:10.15626/mp.2021.2932 · Cited by 3
McLatchie, N. M., & Thomae, M. (2023) · Humor - International Journal of Humor Research · doi:10.1515/humor-2022-0134 · Cited by 1
Ikeda, S. (2024) · Cognitive Processing · doi:10.1007/s10339-024-01176-2 · Cited by 1
“However, Simonsohn (2015) noted that a sample size 2.5 times larger than that was needed for a follow-up study.”
InfluentialGersten, R. M., Dimino, J., Jayanthi, M., & Taylor, M. J. (2024) · The Elementary School Journal · doi:10.1086/730082 · Cited by 1
“Exact replications are nearly impossible to conduct in education and the social sciences (e.g., Simonsohn, 2015 ), due to the dif fi culties associated with containing the variability present in fi eld research.”
Narcissistic vigilance to status cues
Atkinson, B. E., & Heerey, E. A. (2024) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2024.104688 · Cited by 1
Gender and social belonging predict evaluation of ambiguous academic feedback
Schroeder, Z. J., & Hodges, S. D. (2025) · Social Psychology of Education · doi:10.1007/s11218-024-10003-7 · Cited by 1
“…benchmarks for replication, we used the somewhat conservative method of a simplified version of the small-telescope method wherein we created ranges for successful replication based on the standard errors of the complementary analysis in Study 1 (Schauer & Hedges, 2021; Simonsohn, 2015 ).”
Revisiting the psychology of waste: Replication and extensions Registered Report of Arkes (1996)
Zhu, Z., & Feldman, G. (2025) · Royal Society Open Science · doi:10.1098/rsos.250367
Ding, K., & Feldman, G. (2025) · Royal Society Open Science · doi:10.1098/rsos.250669
Manipulating the reported age in earliest memories in a Dutch community sample
Klusmann, B., & Wessel, I. (2019) · PLoS ONE · doi:10.1371/journal.pone.0217436 · Cited by 1
Processing the Word Red and Intellectual Performance: Four Replication Attempts
Gnambs, T., Kovacs, C., & Stiglbauer, B. (2020) · Collabra Psychology · doi:10.1525/collabra.277 · Cited by 1
Metadata
- Authors
- Simonsohn, U.
- Affiliations
- University of Pennsylvania (US)
- Corresponding author
- Simonsohn, Uri
- ORCID
- Simonsohn, Uri
- Venue
- Psychological Science
- Publisher
- SAGE Publications
- Published
- 2015-03-23
- Volume
- 26
- Issue
- 5
- Pages
- 559-569
- ISSN
- 0956-7976 (ISSN-L)
- 1467-9280
- OpenAlex
- W2151509224
- Cited by
- 742
- References
- 52
- Citations by year
- 2026: 30 · 2025: 58 · 2024: 59 · 2023: 67 · 2022: 64 · 2021: 66 · 2020: 111 · 2019: 79 · 2018: 76 · 2017: 63 · 2016: 48 · 2015: 16
- FWCI
- 61.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- effect size estimation, hypothesis testing, replication study, statistical power, underpowered studies, small effect sizes
- MeSH terms
- Astronomy, Data Interpretation, Statistical, Research Design, Reproducibility of Results, Models, Statistical, Sample Size, Telescopes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.