Shall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences
The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Abstract
Replication is one of the most important tools for the verification of facts within the empirical sciences. A detailed examination of the notion of replication reveals that there are many different meanings to this concept and the relevant procedures, but hardly any systematic literature. This paper analyzes the concept of replication from a theoretical point of view. It demonstrates that the theoretical demands are scarcely met in everyday work within the social sciences. Some demands are just not feasible, whereas others are constricted by restrictions relating to publication. A new classification scheme based on a functional approach that distinguishes between different types of replication is proposed. Next, it will be argued that replication addresses the important connection between existing and new knowledge. To do so it has to be applied explicitly and systematically. The paper ends with a description of procedures how this could be done and a set of recommendations how to handle the concept of replication in the future to exploit its potential to the full.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Novel or innovative results are more likely to be published than replications or incremental extensions of existing findings 13-15 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [14]
In the citing paper
“RRs provide a mechanism for publishing replication research”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [14]
In the citing paper
“which are rarely published in the standard model 13,14 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [14]
In the citing paper
“Although sometimes replication efforts can reveal poorly designed studies and irreproducible results, this is more the exception than the rule [48].”
From The natural selection of bad science (2016) · cites this paper as [48]
Citations
Cites
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
The Logic of Scientific Discovery
(2013) · A Realist Theory of Science · doi:10.4324/9780203090732-9 · Cited by 7,731
Journal of Consciousness Studies
(2022) · Journal of Consciousness Studies · doi:10.53765/20512201 · Cited by 6,832
Journal of social behavior and personality
(1986) · Personality and Individual Differences · doi:10.1016/0191-8869(86)90025-5 · Cited by 6,706
Design and Analysis: A Researcher's Handbook
Beaton, A. E., & Keppel, G. (1975) · American Educational Research Journal · doi:10.2307/1162588 · Cited by 5,822
Scientific Explanation and the Causal Structure of the World
Salmon, W. C. (1985) · Princeton University Press eBooks · doi:10.1515/9780691221489 · Cited by 2,459
Leviathan and the Air-Pump: Hobbes, Boyle, and the Experimental Life
Cohen, I. B., Shapin, S., & Schaffer, S. (1987) · The American Historical Review · doi:10.2307/1869945 · Cited by 2,151
Leviathan and the Air-Pump: Hobbes, Boyle, and the Experimental Life
Cohen, I. B., Shapin, S., & Schaffer, S. (1987) · The American Historical Review · doi:10.1086/ahr/92.3.658 · Cited by 2,151
Leviathan and the Air-Pump: Hobbes, Boyle, and the Experimental Life
Traynham, J. G., Shapin, S., & Schaffer, S. (1987) · Journal of Interdisciplinary History · doi:10.2307/204299 · Cited by 2,045
Design and Analysis: A Researcher's Handbook
Aaker, D. A., & Keppel, G. (1976) · Journal of Marketing Research · doi:10.2307/3150757 · Cited by 2,011
Research works printed but not linked: 12
- American Psychological Association, 2001, Publication Manual of the American Psychological Association
- Beloff J., 1985, The repeatability problem in parapsychology, 1
- Collins H. M., 1985, Changing order
- CookT. D. (1990). Rersearch methodology: Strengthening causal interpretations of nonexperimental data. In SechrestL., PerrinE. & BunkerJ., US Department of health and human services (pp. 9–30). Public Health Service, Agency for Health Care Policy and Research.
- Edge H., 1985, The repeatability problem in parapsychology, 53
- Neuliep J. W., 1993, Journal of Social Behavior and Personality, 8, 21
- Rao K. R., 1981, Journal of Parapsychology, 45, 311
- Rosenthal R., 1991, Replication research in the social sciences, 1
- Sargent C. L., 1981, European Journal of Parapsychology, 3, 423
- Schacter D. L., 2000, Wir sind Erinnerung. Gedächtnis und Persönlichkeit
- Walach H., 2000, Neuroendocrinology Letters, 21, 221
- Weizsäcker E. U. v., 1986, Offene Systeme I: Beiträge zur Zeitstruktur von Information, Entropie und Evolution, 82
Cited by
Items 601–700 of 1,001
Reproducible Analyses in Education Research
LeBeau, B. C., Ellison, S., & Aloe, A. M. (2021) · Review of Research in Education · doi:10.3102/0091732x20985076 · Cited by 9
“R and replication of primary studies has been discussed recently by journalists (Achenbach, 2015; Achenbach & McGinley, 2017; Bavel, 2016; Dominus, 2017; Tucker, 2016) and academics (Aarts et al., 2015; Earp & Trafimow, 2015; Hedges & Schauer, 2019a, 2019b; Hendrick, 1990; Hunt, 1975; Lykken, 1968; Makel et al., 2019;…”
BackgroundMethodInfluentialJournal Editor and Associate Editor Perspectives on Research Reproducibility and Open Science
Maggin, D. M. (2021) · Remedial and special education · doi:10.1177/07419325211017294 · Cited by 5
“The emphasis on repeated, independent investigations provides evidence that the finding is not a special circumstance, but rather, a reliable result that is durable to differences in time, setting, individuals, or investigators (Schmidt, 2009).”
BackgroundA Framework for Classifying Replication Studies in Educational Technologies Research
Christensen, R. W., Hodges, C. B., & Spector, J. M. (2021) · Technology Knowledge and Learning · doi:10.1007/s10758-021-09532-3 · Cited by 8
“For a discipline to be considered scientific, it needs to establish a level of certainty in findings and then build upon those findings (Schmidt, 2009).”
BackgroundInfluentialSignorelli, A., Morganti, A., & Pascoletti, S. (2021) · Form re - Open Journal per la formazione in rete · doi:10.36253/form-12127 · Cited by 14
“Of particular interest in school education could be conceptual replication, where one or more aspects vary from the original study (Schmidt, 2009).”
BackgroundMethodInfluentialTesting ANOVA Replications by Means of the Prior Predictive p-Value
Zondervan-Zwijnenburg, M. A. J., van de Schoot, R., & Hoijtink, H. (2022) · Meta-Psychology · doi:10.15626/mp.2019.1615 · Cited by 10
“…Asendorpf et al., 2013; Cumming, 2014; Earp & Trafimow, 2015; 2 Ledgerwood, 2014; Open Science Collaboration, 2012, 2015; Pashler & Wagenmakers, 2012; Schmidt, 2009; Verhagen & Wagenmakers, 2014), and large replication projects such as the Reproducibility Project Psychology (Open Science…”
BackgroundPlotner, A. J., Walters, C. B., & Gonzalez, S. (2022) · Journal of Disability Policy Studies · doi:10.1177/10442073221131284 · Cited by 9
“As is the case with all empirical research, true confidence in the findings of this study should come from future replication (Schmidt, 2009).”
ResultLuo, Y., Deng, Y., Ma, T., & Jiang, Y. N. (2023) · Psychology in the Schools · doi:10.1002/pits.22867 · Cited by 8
Rainbow, C., Tatnell, R., Blashki, G. A., & Melvin, G. A. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115195 · Cited by 8
A Systematic Review of Replicative Self-Determination Intervention Studies
Luckner, J. L., Banerjee, R., Movahedazarhouligh, S., & Millen, K. (2019) · The Journal of Special Education · doi:10.1177/0022466919850188 · Cited by 7
“Consequently, they are the least common in educational research (Schmidt, 2009).”
BackgroundResultInfluentialHeart rate variability related to season of birth: A replication study
Iseger, T. A., Vollebregt, M. A., Krepel, N., & Arns, M. (2019) · Psychophysiology · doi:10.1111/psyp.13419 · Cited by 7
“The replication was conceptual (Schmidt, 2009) because we studied different and wider geographic areas, and a wider—lifelong—age range.”
BackgroundDaniels, L. M. (2019) · The Journal of Experimental Education · doi:10.1080/00220973.2019.1628692 · Cited by 7
“This study is a conceptual replication (Schmidt, 2009) of Daniels and Gierl (2017).”
BackgroundMethodResultInfluentialJustice, M. F. (2018) · Digital Commons - Gardner-Webb University (Gardner–Webb University) · Cited by 11
How physical cues surrounding foods influence snack consumption: The case of covering foods
Raghoebar, S., van Kleef, E., & de Vet, E. (2021) · Food Quality and Preference · doi:10.1016/j.foodqual.2021.104260 · Cited by 8
“…cues were present, testing the same hypotheses under more complex circumstances attempting to conceptually replicate the effects under different conditions (i.e., seeking to validate the phenomenon under various circumstances) (Earp & Trafimow, 2015; Nosek, Spies, & Motyl, 2012; Schmidt, 2009).”
BackgroundReteig, L. C., Newman, L. A., Ridderinkhof, K. R., & Slagter, H. A. (2022) · PLoS ONE · doi:10.1371/journal.pone.0262718 · Cited by 8
“Replication of findings in general is important to establish credibility of scientific claims [26], and in this specific case, reproduction of our original findings would be informative about the ability of tDCS to modulate the apparent bottleneck in information processing captured by the AB, and about the importance…”
ResultDerbyshire, J., Dhami, M. K., Belton, I., & Önkal, D. (2022) · Futures & Foresight Science · doi:10.1002/ffo2.146 · Cited by 12
“A conceptual replication, by contrast, attempts to establish the same theoretical conclusion as an original study with different experimental manipulations or measures (Gouveia, 2021; Schmidt, 2009).”
BackgroundResultVII. REPLICATION, RESEARCH ACCUMULATION, AND META-ANALYSIS IN DEVELOPMENTAL SCIENCE
Card, N. A. (2017) · Monographs of the Society for Research in Child Development · doi:10.1111/mono.12301 · Cited by 7
Phelps-Gregory, C. M., & Spitzer, S. M. (2017) · Springer eBooks · doi:10.1007/978-3-319-66327-2_12 · Cited by 7
Elaborations in Expository Text Impose a Substantial Time Cost but Do Not Enhance Learning
Daley, N., & Rawson, K. A. (2018) · Educational Psychology Review · doi:10.1007/s10648-018-9451-9 · Cited by 10
Großekathöfer, J. D., Suchotzki, K., & Gamer, M. (2020) · Visual Cognition · doi:10.1080/13506285.2020.1742826 · Cited by 7
“Replication in itself is a core concept of scientific progress (Schmidt, 2009) and thus relevant for assessing the stability of effects.”
Developing and Implementing FBA-BIPs in Elementary Classrooms: A Conceptual Replication.
Hirsch, S. E., Bruhn, A. L., Randall, K. N., Dunn, M., Shelnut, J., & Lloyd, J. W. (2020) · CSUSB ScholarWorks (California State University, San Bernardino) · doi:10.58729/2167-3454.1105 · Cited by 7
Implementation and effects of a school-wide data-based decision making intervention
Keuning&Geel, T. &. (2016) · doi:10.3990/1.9789036541190 · Cited by 7
“spelling) and to strengthen the generalizability of the findings concerning mathematics, we conducted a conceptual replication (Makel & Plucker, 2014; Schmidt, 2009) of the 2011 study.”
BackgroundResultReproducibility in the Era of Big Data
McCoach, D. B., Dineen, J. N., Chafouleas, S. M., & Briesch, A. M. (2020) · Wiley eBooks · doi:10.1002/9781118976357.ch21 · Cited by 7
Estimating the Reproducibility of Experimental PhilosophyPreprint
Cova, F., & Abatista, A. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/hr4zs · Cited by 7
Replicability of Social-Cognitive Priming: The Case of Weight as an Embodiment of ImportancePreprint
IJzerman, H. R., Padiotis, N., & Koole, S. L. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2255726 · Cited by 8
Revisiting Mental Simulation in Language Comprehension: Six Replication AttemptsPreprint
Zwaan, R. A., & Pecher, D. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/fkrxd · Cited by 7
The Effect of Verbal Praise on Maze Completion
Gambino, T. (2016) · Psi Chi Journal of Psychological Research · doi:10.24839/2164-8204.jn21.1.54 · Cited by 7
Replicability in psychological research: a reflection
Leyva, S. B. C., & Domínguez-Lara, S. (2020) · Interacciones Revista de Avances en Psicología · doi:10.24016/2020.v6n3.172 · Cited by 12
ASA 2022 Data-Driven Decision Making: Book of short papers
Edited by: Enrico di Bella, L. F., Fabbris, L., di Bella, E., & Lagazio, C. (2023) · Proceedings e report · doi:10.36253/979-12-215-0106-3 · Cited by 7
Primer on Reproducible Research in R: Enhancing Transparency and Scientific Rigor
Siraji, M. A., & Rahman, M. (2023) · Clocks & Sleep · doi:10.3390/clockssleep6010001 · Cited by 6
“How to attain this balance is an issue of high debate [10,11].”
BackgroundAre MAs profitable to search‐based PLA design?
Neto, J. C., Herculano, C., Colanzi, T. E., & Amaral, A. M. M. M. (2019) · IET Software · doi:10.1049/iet-sen.2018.5318 · Cited by 6
Strupler, N. (2021) · Internet Archaeology · doi:10.11141/ia.56.6 · Cited by 7
“If it is possible to confirm the findings with another experiment in which some external variables (such as time, place, person implementing the experiment) have been changed, this is considered a validation (Schmidt 2009).”
BackgroundEarly Experimental Psychology: How did Replication Work Before P-Hacking?
Mülberger, A. (2022) · Review of General Psychology · doi:10.1177/10892680211066468 · Cited by 7
“Schmidt (2009) introduced the distinction between direct and conceptual replication, which is still widely used although some authors have criticized or modified the distinction (Crandall and Sherman, 2016; Feest, 2019; Radder, 1992; Stroebe & Strack, 2014; Zwaan, Ets, Lucas, & Donnellan, 2018).”
BackgroundFrisch, L. K., Sebben, S., Liekefett, L., Shnabel, N., Visintin, E. P., Ullrich, J., & Häßler, T. (2022) · Personality and Social Psychology Bulletin · doi:10.1177/01461672221086380 · Cited by 8
“In light of the increasing awareness of the importance of replications in the social sciences in general (e.g., Schmidt, 2009) and social psychology in particular (e.g., Nosek et al., 2015), these findings enhance the credibility of two prominent social psychological models.”
BackgroundClarke, B., Turtura, J. E., Lesner, T. A., Cook, M. A., Smolkowski, K., Kosty, D. B., & Doabler, C. T. (2022) · Exceptional Children · doi:10.1177/00144029221088938 · Cited by 7
“Replication research supports the generalizability of hypotheses generated from initial research (Schmidt, 2009) and serves not only to affirm scientific understanding of the findings replicated but also to expose methodological biases and insufficiencies within an initial study (Makel & Plucker,…”
BackgroundInfluentialA replication study on the intuitiveness of programming language syntax
Lappi, V., Tirronen, V., & Itkonen, J. (2023) · Software Quality Journal · doi:10.1007/s11219-023-09631-7 · Cited by 8
“Over time there have been multiple different classification systems for replications, including Lykken (1968) and Schmidt (2009).”
BackgroundMatarese, V. (2023) · Inquiry · doi:10.1080/0020174x.2023.2278032 · Cited by 8
Stengelin, R., Bohn, M., Sánchez-Amaro, A., Haun, D. B. M., Thiele, M., Allritz, M., Daum, M. M., Fong, F. T. K., Gampe, A., Gampe, A., et al. (2024) · Meta-Psychology · doi:10.15626/mp.2023.3695 · Cited by 7
“The replicability and generalizability crisis share some key features: Both became relevant to a broader audience around the same time (Arnett, 2008; Henrich et al., 2010; Schmidt, 2009; Simmons et al., 2011; Syed, 2022), and – in both cases – effective countermeasures have been put forward.”
BackgroundKowitt, J. S., Madaus, J. W., Simonsen, B. M., Freeman, J., Lombardi, A. R., & Ventola, P. E. (2024) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-024-06405-3 · Cited by 6
“The efficacy of evi - dence-based practices must be tested across different condi - tions, including setting, target audience, and implementer (Horner et al., 2005; Schmidt, 2009).”
Direct Replication in Experimental Communication Science: A Conceptual and Practical Exploration
Vermeulen, I., Masur, P. K., Beukeboom, C. J., & Johnson, B. K. (2024) · Media and Communication · doi:10.17645/mac.7971 · Cited by 7
Kotseruba, I., & Tsotsos, J. K. (2025) · Oxford University Press eBooks · doi:10.1093/oso/9780192844835.003.0005 · Cited by 6
Accounting and Public Policy: The Importance of Credible Research
Denison, C. A., Ravenscroft, S., & Williams, P. F. (2014) · Accounting and the Public Interest · doi:10.2308/apin-51158 · Cited by 7
“In addition to valuing results that ‘‘work,’’ journals tend to publish research that is novel, surprising, ‘‘sexy,’’ and ‘‘makes a contribution,’’ or is innovative (Scargle 2000; Hunter 2001; Bartunek, Rynes, and Ireland 2006; Schmidt 2009; Nosek, Spies, and Motyl 2012).”
BackgroundDouglas, E. M., & Gushwa, M. K. (2019) · Journal of Public Child Welfare · doi:10.1080/15548732.2019.1612816 · Cited by 7
“All research is worthy of replication (Good, 1992; Schmidt, 2009) and given the important nature of the child welfare profession’s opportunity to intervene to prevent CMFs, it behooves the field to better understand the set of skills and knowledge that the child welfare workforce possesses with…”
BackgroundTorka, A., Mazei, J., & Hüffmeier, J. (2023) · Social Psychological Bulletin · doi:10.32872/spb.9695 · Cited by 9
“However, historical evidence suggests that social psychology has not (a) valued (Giner-Sorolla, 2012; Hüffmeier et al., 2016), (b) incentivized (Koole & Lakens, 2012), or (c) conducted replications (Makel et al., 2012; Schmidt, 2009).”
BackgroundWissman, K. T., & Rawson, K. A. (2017) · Memory & Cognition · doi:10.3758/s13421-017-0752-x · Cited by 8
“Given that the recent research has emphasized the importance of independent replication for novel findings (e.g., Braver, Thoemmes, & Rosenthal, 2014; Cumming, 2008; Ferguson & Heene, 2012; Francis, 2012; LeBel & Peters, 2011; Maner, 2014; Pashler & Harris, 2012; Roediger, 2012; Schimmack, 2012; Schmidt, 2009; Simmons…”
BackgroundBeauty Is in the Eye of Beholder: Intracultural and Transcultural Heterogeneity of Individuals
Fatehi, K., & Priestley, J. (2017) · Cross-Cultural Research · doi:10.1177/1069397117732749 · Cited by 6
““Replication is one of the most important tools for the verification of facts within the empirical sciences” (Schmidt, 2009, p. 90).”
MethodReproducibility in Biomedical Research
Mullane, K., Curtis, M. J., & Williams, M. J. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-804725-5.00001-x · Cited by 11
Replicating a study about children’s drawings concerning radiation
Plötz, T., & Hollenthoner, F. (2019) · Multidisciplinary Journal for Education Social and Technological Sciences · doi:10.4995/muse.2019.10390 · Cited by 6
“There are many ways to design a replication study (for a good overview, see Schmidt 2009).”
Robb, K. A., Gatting, L., von Wagner, C., & McGregor, L. (2019) · Annals of Behavioral Medicine · doi:10.1093/abm/kaz039 · Cited by 7
“The similarity of the associations between demographic factors and deliberative thinking in Studies 1 and 2 provides support for their reliability (28).”
BackgroundConsidering Generalizability: A Lesson from Auditory Enrichment Research on Zoo Animals
Khan, N. Y., & Wascher, C. A. F. (2021) · Animal Behavior and Cognition · doi:10.26451/abc.08.02.12.2021 · Cited by 6
“Where studies are repeated within the field of ecology and evolution, researchers tend to use a different species or study system, resulting in partial replication, i.e., ‘quasi-replication’ (Palmer, 2000), or a more general conceptual replication (Schmidt, 2009).”
BackgroundThe Philosophical Foundations of Prescriptive Statements and Statistical Inference
Sun, S., & Pan, W. (2011) · Educational Psychology Review · doi:10.1007/s10648-011-9157-8 · Cited by 7
“The necessity of replication was also echoed by many other researchers such as Thompson (1993, 1996, 1997), Kline (2004), and Schmidt (2009) , to name a few.”
BackgroundInfluentialMorales, Ó. O. (2014) · Pensamiento Psicológico · doi:10.11144/javerianacali.ppsi12-2.rcpi · Cited by 16
History and geography matter : The cultural dimension of entrepreneurship
Fredin, S. (2017) · DiVA (Digitala Vetenskapliga Arkivet) · Cited by 17
Tipología de Replicaciones para la Síntesis de Experimentos en Ingeniería del Software
Gómez, O. S. (2012) · UPM Digital Archive (Technical University of Madrid) · doi:10.20868/upm.thesis.11014 · Cited by 6
Chen, L., Benjamin, R., Guo, Y., Lai, A., & Heine, S. J. (2023) · Research Square · doi:10.21203/rs.3.rs-1254756/v1 · Cited by 5
Jansson, A., Sundblad, G. B., Lundvall, S., Bjärsholm, D., & Norberg, J. R. (2022) · Journal of Teaching in Physical Education · doi:10.1123/jtpe.2021-0270 · Cited by 7
Boyd, N. M., Baerdemaeker, S. D., Heng, K., & Matarese, V. (2023) · Synthese Library/Synthese library · doi:10.1007/978-3-031-26618-8 · Cited by 9
Isager, P. M., Lakens, D., van Leeuwen, T. N., & Veer, A. V. '. (2023) · Cortex · doi:10.1016/j.cortex.2023.10.012 · Cited by 8
Characterisation and calibration of multiversal methods
Cantone, G. G., & Tomaselli, V. (2024) · Advances in Data Analysis and Classification · doi:10.1007/s11634-024-00610-9 · Cited by 8
Immersive Virtual Reality for Health Promotion and Primary Prevention in Psychology: Scoping Review
Bonneterre, S., Zerhouni, O., & Boffo, M. (2025) · JMIR XR and spatial computing. · doi:10.2196/49923 · Cited by 7
Critical Appraisal Tool for Homeopathic Intervention Studies: CATHIS
Gaertner, K., Hahn, R. G., Razlog, R., Musial, F., Baumgartner, S., Loef, M., & Walach, H. (2025) · Complementary Medicine Research · doi:10.1159/000542920 · Cited by 5
“This study design incorporates repetition to control for sampling errors, artefacts, and frauds and allows to generalize the results [27].”
James, E., Hatton, C., & Mitchell, R. (2021) · Tizard Learning Disability Review · doi:10.1108/tldr-07-2020-0014 · Cited by 8
Open Science: Recommendations for Research on School Bullying
Noret, N. F., Hunter, S. C., Pimenta, S. M., Taylor, R., & Johnson, R. (2022) · International Journal of Bullying Prevention · doi:10.1007/s42380-022-00130-0 · Cited by 7
“There are different forms of replication that can be broadly categorised into two: those that aim to recreate the exact conditions of an earlier study (exact/direct replication) and those that aim to test the same hypotheses again using a different method (conceptual replication) (Schmidt, 2009).”
van Daal, T., Snajder, M., Nijs, K., & Dyck, H. V. (2023) · Social interaction in learning and development · doi:10.1007/978-3-031-29411-2_4 · Cited by 6
Zimmerman, K. N., Ledford, J. R., & Turner, V. R. (2023) · Journal of Positive Behavior Interventions · doi:10.1177/10983007231200529 · Cited by 7
“…this evaluation of fidget toys will be critical to understanding if the results yielded in this study were the result of chance given the small number of participants and limited number of demonstrations of effect (Schmidt, 2009), despite this study meeting single-case design rigor requirements.”
ResultOpen science practices in the false memory literature
Wiechert, S., Leistra, P., Ben-Shakhar, G., Pertzov, Y., & Verschuere, B. (2024) · Memory · doi:10.1080/09658211.2024.2387108 · Cited by 5
“…role by independently verifying the reliability and validity of original fi ndings, reducing the likelihood of results being due to chance, artifacts, and speci fi c conditions, and enhancing the generalizability of fi ndings across di ff erent samples, settings, and methodologies (Schmidt, 2009).”
Será a psicanálise uma pseudociência? Reavaliando a doutrina utilizando uma lista de multicritérios
Ferreira, C. D. M. C. (2021) · Debates em Psiquiatria · doi:10.25118/2763-9037.2021.v11.58 · Cited by 5
Situating Linguistics in the Social Science Data Movement
Gawne, L., & Styles, S. J. (2022) · The MIT Press eBooks · doi:10.7551/mitpress/12200.003.0006 · Cited by 11
Questionable Research Practices in Clinical Psychology
O’Donohue, W., & Masuda, A. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_1 · Cited by 5
Kiperman, S., Black, M. S., McGill, T. M., Harrell‐Williams, L. M., & Kamphaus, R. W. (2014) · Journal of Psychoeducational Assessment · doi:10.1177/0734282914529200 · Cited by 5
“Furthermore, renewed interest in conducting replication studies exists because they can account for study imperfections, sampling error, lack of internal validity, control for fraud, generalization, and verification of prior study’s hypotheses (Hunter, 2001; Schmidt, 2009).”
BackgroundLatent variable structure and measurement invariance of a modified early literacy assessment
Cimetta, A. D., Marx, R. W., Yaden, D. B., Alkhadim, G. S., & Cutshaw, C. A. (2017) · International Journal of School & Educational Psychology · doi:10.1080/21683603.2017.1322016 · Cited by 6
“Thus, our study is a type of “conceptual replication” not frequently reported in the literature (Schmidt, 2009).”
BackgroundMigratory return rates and breeding fidelity in Eastern Bluebirds ( Sialia sialis )
Coss, D. A., Omland, K. E., & Rose, E. M. (2019) · The Wilson Journal of Ornithology · doi:10.1676/18-181 · Cited by 6
“While scientists agree that all results should be replicable (Schmidt 2009, Crandall and Sherman 2016), we do not always repeat basic studies which leads, in many cases, to misinformation being widely accepted in a field.”
BackgroundTebbe, J., Humble, E., Stoffel, M. A., Tewes, L. J., Müller, C., Forcada, J., Caspers, B. A., & Hoffman, J. I. (2020) · PeerJ · doi:10.7717/peerj.10131 · Cited by 6
Analyzing writing fluency on smartphones by Saudi EFL students
Lee, B., & Khateeb, A. A. (2021) · Computers & composition/Computers and composition · doi:10.1016/j.compcom.2021.102667 · Cited by 5
Jankvist, U. T., Aguilar, M. S., Misfeldt, M., & Koichu, B. (2022) · Implementation and Replication Studies in Mathematics Education · doi:10.1163/26670127-02012020 · Cited by 5
Tressoldi, P. E., Rock, A. J., Pederzoli, L., & Houran, J. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/pr364 · Cited by 6
Gotteland, D. (2018) · Recherche et Applications en Marketing (French Edition) · doi:10.1177/0767370118814317 · Cited by 5
Hartmann, S. (2024) · Studies in corpus linguistics · doi:10.1075/scl.118.06har · Cited by 12
Morgulev, E. (2024) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2024.102759 · Cited by 4
O STATUS CIENTÍFICO DA CONSTELAÇÃO FAMILIAR: Uma análise multicriterial à luz de Hansson
Fretta, G. C., Böger, S. D. S., Ramos, A. C., & Toé, H. C. Z. D. (2025) · Psicologia e Saúde em Debate · doi:10.22289/2446-922x.v11a1a5 · Cited by 5
Probst, T. M., Петитта, Л., Ghezzi, V., Lavaysse, L. M., Bettac, E. L., & Barbaranelli, C. (2025) · Safety Science · doi:10.1016/j.ssci.2025.106783 · Cited by 4
Concerns About Replicability Across Two Crises in Social Psychology
Lakens, D. (2025) · International Review of Social Psychology · doi:10.5334/irsp.1036 · Cited by 8
Hoffmann, J., Twardawski, M., Höhs, J. M., Gast, A., Pohl, S., & Sengewald, M.-A. D.-P. (2025) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459251328273 · Cited by 7
“…replication studies were conducted (Klein et al., 2014; OSC, 2015), after suggestions for systematic replications were proposed (Brandt et al., 2014; Schmidt, 2009), and after unintended differences in direct replications were highlighted (Nosek & Errington, 2017; Van Bavel et al., 2016).”
InfluentialSears, S., Xu, X., & Simonsen, B. M. (2025) · Journal of Positive Behavior Interventions · doi:10.1177/10983007251335351 · Cited by 6
“It also enables generalization to a large or different population, and it helps to verify the underlying hypothesis of an earlier experiment (Schmidt, 2009).”
Mulder, J., & van Aert, R. C. M. (2025) · Research Synthesis Methods · doi:10.1017/rsm.2025.10060 · Cited by 6
“…hold, the conditions under which the data are collected under every study need to be (practically) identical, such as replication studies in psychology 42 or series of randomized clinical trials by the same researchers, for patients from the same population, and testing exactly the same treatment.”
Replicability: 21st Century Crisis of the Positivist Social Sciences
Kalelioğlu, U. B. (2021) · Uluslararası Sosyal Bilgilerde Yeni Yaklaşımlar Dergisi (IJONASS) · doi:10.38015/sbyy.1003103 · Cited by 4
From depressed mice to depressed patients: a less “standardized” approach to improving translation
Piotrowska, M. (2023) · Biology & Philosophy · doi:10.1007/s10539-023-09935-9 · Cited by 4
“With every difference that’s introduced, the confirmatory power of a replication increases (Schmidt 2016).”
Ghosh, A., Phillips, N. L., Sleep, C. E., Lynam, D. R., & Miller, J. D. (2024) · Assessment · doi:10.1177/10731911241301475 · Cited by 5
“Replication demonstrates the extent to which the findings of a previous study hold true across differing circumstances (Schmidt, 2009), and it is understood as foundational to the scientific endeavor (e.g., Popper, 1959).”
Tracing and Pointing Support Multimedia Learning: A Cross-Cultural Replication
Wang, Y., Han, K., & Ginns, P. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10005-7 · Cited by 4
“1 Hypothesised tracing and pointing actions, processes and outcomes Makel, 2021; Schmidt, 2009).”
InfluentialThe Computational Evolution of Cognitive Architectures
Kotseruba, I., & Tsotsos, J. K. (2025) · doi:10.1093/oso/9780192844835.001.0001 · Cited by 7
Wilkowski, B. M., & Leki, E. L. (2019) · Aggressive Behavior · doi:10.1002/ab.21842 · Cited by 4
Schlögl, H., Villringer, A., Miehle, K., Faßhauer, M., Stümvoll, M., & Mueller, K. (2023) · Journal of the Endocrine Society · doi:10.1210/jendso/bvad072 · Cited by 7
Quantifying replicability of multiple studies in a meta-analysis
Xiao, M., Chu, H., Hodges, J. S., & Lin, L. (2024) · The Annals of Applied Statistics · doi:10.1214/23-aoas1806 · Cited by 5
Kato, T. (2018) · The Japanese Journal of Personality · doi:10.2132/personality.27.2.11 · Cited by 6
Krautz, A. E., & Čavar, F. (2019) · Journal of Multilingual and Multicultural Development · doi:10.1080/01434632.2018.1547074 · Cited by 5
“Hendrick (1990), for instance, distinguishes between strict, partial and conceptual replication, whereas Schmidt (2009) talks about direct and conceptual replication.”
BackgroundOpen Science: A Candid Conversation
Smith, K. N., & Makel, M. C. (2019) · Journal of Advanced Academics · doi:10.1177/1932202x19829750 · Cited by 5
Habit Reversal to Decrease Filled Pauses in Public Speaking: A Partial Replication
Bördlein, C., & Sander, A. (2019) · Research on Social Work Practice · doi:10.1177/1049731519894663 · Cited by 5
“Replications are of great value for the scientific community and the education of junior scientists, although they are underused (Collins, 1985; Makel, Plucker, & Hegarty, 2012; Nosek & Lakens, 2014; Schmidt, 2009; Simons, 2014).”
BackgroundGrolleau, G., Ibanez, L., & Mzoughi, N. (2020) · Ecological Economics · doi:10.1016/j.ecolecon.2019.106586 · Cited by 4
“Rather than basing important decisions on results drawn from one-study contributions, we advocate in favor of replications and robustness checks (Hamermesh, 2007; Schmidt, 2009; Clemens, 2017).”
BackgroundReio, T. G. (2020) · Human Resource Development Quarterly · doi:10.1002/hrdq.21409 · Cited by 4
Salience effects in memory-based decisions: an improved replication
Bröder, A., Platzer, C., & Heck, D. W. (2021) · Journal of Cognitive Psychology · doi:10.1080/20445911.2020.1869752 · Cited by 4
The epistemic consequences of pragmatic value-laden scientific inference
Kubiak, A. P., & Kawalec, P. (2021) · European Journal for Philosophy of Science · doi:10.1007/s13194-021-00370-9 · Cited by 5
“But some also propose to distinguish conceptual replication (as opposed to direct replication) when speaking of asking the same type of question but finding a different type of experiment (Schmidt 2009).”
Background
Metadata
- Authors
- Schmidt, S.
- Affiliations
- University Medical Center Freiburg (DE)
- Corresponding author
- Schmidt, Stefan
- ORCID
- Schmidt, Stefan
- Venue
- Review of General Psychology
- Publisher
- SAGE Publications
- Published
- 2009-06
- Volume
- 13
- Issue
- 2
- Pages
- 90-100
- ISSN
- 1089-2680 (ISSN-L)
- 1939-1552
- OpenAlex
- W2021458971
- Cited by
- 1,125
- References
- 55
- Citations by year
- 2026: 42 · 2025: 95 · 2024: 88 · 2023: 85 · 2022: 75 · 2021: 138 · 2020: 94 · 2019: 105 · 2018: 93 · 2017: 74 · 2016: 84 · 2015: 52 · 2014: 35 · 2013: 26 · 2012: 23
- FWCI
- 16.48
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Review of General Psychology (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Keywords
- replication, social sciences, fact-checking, publication practices, research methodology, epistemology of science
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.