Shall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences
The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Abstract
Replication is one of the most important tools for the verification of facts within the empirical sciences. A detailed examination of the notion of replication reveals that there are many different meanings to this concept and the relevant procedures, but hardly any systematic literature. This paper analyzes the concept of replication from a theoretical point of view. It demonstrates that the theoretical demands are scarcely met in everyday work within the social sciences. Some demands are just not feasible, whereas others are constricted by restrictions relating to publication. A new classification scheme based on a functional approach that distinguishes between different types of replication is proposed. Next, it will be argued that replication addresses the important connection between existing and new knowledge. To do so it has to be applied explicitly and systematically. The paper ends with a description of procedures how this could be done and a set of recommendations how to handle the concept of replication in the future to exploit its potential to the full.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Novel or innovative results are more likely to be published than replications or incremental extensions of existing findings 13-15 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [14]
In the citing paper
“RRs provide a mechanism for publishing replication research”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [14]
In the citing paper
“which are rarely published in the standard model 13,14 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [14]
In the citing paper
“Although sometimes replication efforts can reveal poorly designed studies and irreproducible results, this is more the exception than the rule [48].”
From The natural selection of bad science (2016) · cites this paper as [48]
Citations
Cites
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
The Logic of Scientific Discovery
(2013) · A Realist Theory of Science · doi:10.4324/9780203090732-9 · Cited by 7,731
Journal of Consciousness Studies
(2022) · Journal of Consciousness Studies · doi:10.53765/20512201 · Cited by 6,832
Journal of social behavior and personality
(1986) · Personality and Individual Differences · doi:10.1016/0191-8869(86)90025-5 · Cited by 6,706
Design and Analysis: A Researcher's Handbook
Beaton, A. E., & Keppel, G. (1975) · American Educational Research Journal · doi:10.2307/1162588 · Cited by 5,822
Scientific Explanation and the Causal Structure of the World
Salmon, W. C. (1985) · Princeton University Press eBooks · doi:10.1515/9780691221489 · Cited by 2,459
Leviathan and the Air-Pump: Hobbes, Boyle, and the Experimental Life
Cohen, I. B., Shapin, S., & Schaffer, S. (1987) · The American Historical Review · doi:10.2307/1869945 · Cited by 2,151
Leviathan and the Air-Pump: Hobbes, Boyle, and the Experimental Life
Cohen, I. B., Shapin, S., & Schaffer, S. (1987) · The American Historical Review · doi:10.1086/ahr/92.3.658 · Cited by 2,151
Leviathan and the Air-Pump: Hobbes, Boyle, and the Experimental Life
Traynham, J. G., Shapin, S., & Schaffer, S. (1987) · Journal of Interdisciplinary History · doi:10.2307/204299 · Cited by 2,045
Design and Analysis: A Researcher's Handbook
Aaker, D. A., & Keppel, G. (1976) · Journal of Marketing Research · doi:10.2307/3150757 · Cited by 2,011
Research works printed but not linked: 12
- American Psychological Association, 2001, Publication Manual of the American Psychological Association
- Beloff J., 1985, The repeatability problem in parapsychology, 1
- Collins H. M., 1985, Changing order
- CookT. D. (1990). Rersearch methodology: Strengthening causal interpretations of nonexperimental data. In SechrestL., PerrinE. & BunkerJ., US Department of health and human services (pp. 9–30). Public Health Service, Agency for Health Care Policy and Research.
- Edge H., 1985, The repeatability problem in parapsychology, 53
- Neuliep J. W., 1993, Journal of Social Behavior and Personality, 8, 21
- Rao K. R., 1981, Journal of Parapsychology, 45, 311
- Rosenthal R., 1991, Replication research in the social sciences, 1
- Sargent C. L., 1981, European Journal of Parapsychology, 3, 423
- Schacter D. L., 2000, Wir sind Erinnerung. Gedächtnis und Persönlichkeit
- Walach H., 2000, Neuroendocrinology Letters, 21, 221
- Weizsäcker E. U. v., 1986, Offene Systeme I: Beiträge zur Zeitstruktur von Information, Entropie und Evolution, 82
Cited by
Items 701–800 of 1,001
Effects of Amount on Probability Discounting: A Replication and Extension
Anderson, M. A. B., & Dallery, J. (2021) · Behavioural Processes · doi:10.1016/j.beproc.2021.104448 · Cited by 4
Training Computing Educators to Become Computing Education Researchers
Carver, J. C., Heckman, S. S., & Sherriff, M. S. (2022) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3478431.3499297 · Cited by 4
“One goal is to remove some of the perceived stigma of replication studies, as it is important for research to be generalized to multiple environments to establish its actual efficacy [7, 14, 16, 34].”
BackgroundJames, E., Mitchell, R., Reeves, C., & Ali, A. (2023) · The British Journal of Social Work · doi:10.1093/bjsw/bcad188 · Cited by 4
Transfer of an implied incompatible spatial mapping to a Simon task
Luo, C., & Proctor, R. W. (2015) · Acta Psychologica · doi:10.1016/j.actpsy.2015.11.011 · Cited by 4
Suppa, S. (2018) · Mathematics teacher education and development · Cited by 4
Vollmer, H. C., & Domma, J. (2018) · SUCHT - Zeitschrift für Wissenschaft und Praxis / Journal of Addiction Research and Practice · doi:10.1024/0939-5911/a000551 · Cited by 5
Hardwicke, T. E. (2017) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/r4c32 · Cited by 5
“Conceptual replications are most useful when part of a ‘replication battery’ that systematically and explicitly manipulates key theoretically-relevant parameters on a continuum of similarity based on the original study (Rosenthal, 1990; Schmidt, 2009).”
BackgroundMethodResultInfluentialReplication research in education: is the tide turning?
Banerjee, R. (2022) · Educational Research and Evaluation · doi:10.1080/13803611.2021.2022311 · Cited by 4
“Schmidt (2009) noted: To confirm results or hypotheses by a repetition procedure is at the basis of any scientific conception.”
BackgroundEmpirische basis van conclusies: Handvatten voor de empirische taalonderzoekerPreprint
Eerland, A., & van den Bergh, H. (2018) · doi:10.31234/osf.io/82kcy · Cited by 4
Registered Reports: A Method to Increase the Credibility of Published ReportsPreprint
Nosek, B. A., & Lakens, D. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/mgxyg · Cited by 4
Kedron, P., Bardin, S., Holler, J., Gilman, J., Grady, B. W., Seeley, M. M., Wang, X., & Yang, W. (2023) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/7jqtv · Cited by 4
Replication, a Hallmark of Good Science: Unraveling the Factors That Predict Replication Success
Grant, M. J., Snook, B., & Button, C. M. (2025) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.21.1.p024 · Cited by 4
“In other words, direct replications enhance our confidence that others can reproduce the original effect and that the effect accurately reflects an underlying reality when valid measures are employed (Crandall & Sherman, 2016; Ioannidis, 2012; Schmidt, 2009).”
Kojić, F., Šoškić, А., Radin, I. M. S., Mandić, D., Grujić, G., & Đurić, S. (2025) · BMC Pediatrics · doi:10.1186/s12887-025-05799-y · Cited by 3
“To enhance the previously employed methodology and validate the findings of this study, we conducted a replication study, following best practices outlined in prior research [61–63].”
General Cognitive Ability and job performance in personnel selection in Sweden: A meta-analysis
Sjöberg, A., & Sjöberg, S. (2025) · Economic and Industrial Democracy · doi:10.1177/0143831x251338027 · Cited by 5
“Another key motivation for this meta-analysis is the replication crisis in psychology (Schmidt, 2009).”
Matthews, M. S., Wylie, O., & Styles, A. (2023) · journal for the education of the gifted · doi:10.1177/01623532231199265 · Cited by 3
“Study Approvals and Participant Recruitment.”
BackgroundFairness preferences revisited
Zhang, Y., Hoffmann, M., Sara, R., & Eckel, C. C. (2024) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2024.04.033 · Cited by 3
Tiratelli, M. (2024) · The British Journal of Criminology · doi:10.1093/bjc/azae058 · Cited by 4
“This paper therefore sets out to conduct a direct replication of Enns et al. (2022): mirroring their procedures as closely as possible and comparing the two sets of results (Schmidt 2009; Nosek and Errington 2020; Calin-Jageman 2023).”
Lee, D., & Jang, D. (2025) · Journal of Teaching in Physical Education · doi:10.1123/jtpe.2024-0166 · Cited by 3
That’s replicable: building cumulative knowledge in the face of fads, obsessions and malpractices
Gupta, V. K., Mortal, S. C., & Skiadopoulou, A. (2025) · Organization Management Journal · doi:10.1108/omj-11-2024-2382 · Cited by 3
Han, C., & Wang, Y. (2025) · Target International Journal of Translation Studies · doi:10.1075/target.23164.han · Cited by 3
Jenkins, J. S., & Skowronski, J. J. (2016) · Social Psychology · doi:10.1027/1864-9335/a000253 · Cited by 5
Stewart, A., & Cotton, J. L. (2018) · AIS Transactions on Replication Research · doi:10.17705/1atrr.00032 · Cited by 3
Automatic imitation of speech is enhanced for non-native sounds
Wilt, H., Wu, Y., Evans, B. G., & Adank, P. (2023) · Psychonomic Bulletin & Review · doi:10.3758/s13423-023-02394-z · Cited by 7
“Experiment 2 replicated Experiment 1 online, to strengthen our findings through replication (Schmidt, 2009) and to validate that speech SRC tasks can successfully be conducted online (Wilt et al., 2022).”
BackgroundDanish Students’ Understanding of Fractions: A Replication Study
Færch, J. V., & Hodgen, J. (2023) · Implementation and Replication Studies in Mathematics Education · doi:10.1163/26670127-bja10014 · Cited by 3
Li, Y., Tuckey, M. R., Chen, P. Y., & Dollard, M. F. (2024) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2024.2314923 · Cited by 6
“According to Schmidt (2009), a conceptual replication attempts to reproduce prior hypothesized relationships with different procedures, methodologies, contextual backgrounds, participants, and/or outcome variables.”
BackgroundBats, Bacteria, and Bat Smell V.2.0: Repeatable Sex-Specific Differences in Scent Organ Microbiota
Maracı, Ö., Antonatou-Papaioannou, A., Jünemann, S., Schneeberger, K., Schulze, M., Scheffler, I., & Caspers, B. A. (2024) · Microbial Ecology · doi:10.1007/s00248-024-02368-1 · Cited by 3
“Replication studies are the cornerstones of reproducibility in terms of testing robustness and should be considered as the safeguard against errors, biases, and even scientific misconduct [1].”
Seda, L., Martins, I. T. C., Lisbôa, T. L. R. D. C., Batistuzzo, M. C., & Fatori, D. (2024) · Collabra Psychology · doi:10.1525/collabra.122158 · Cited by 4
Bryon, E. (2017) · Connection Science · doi:10.1080/09540091.2016.1273880 · Cited by 5
“It is not (Collins, 1985; Reid, Soley, &Wimmer, 1981; Schmidt, 2009).”
Conoyer, S. J., Ford, J. W., Smith, R. A., Mason, E. N., Lembke, E. S., & Hosp, J. L. (2018) · Journal of Psychoeducational Assessment · doi:10.1177/0734282918803493 · Cited by 3
Testing the effect of cooperative/competitive priming on the Prisoner’s Dilemma. A replication study
Belaus, A., Reyna, C., & Freidín, E. (2018) · PLoS ONE · doi:10.1371/journal.pone.0209263 · Cited by 5
Türkçe öğretmeni adaylarının dijital rozetlere yönelik algıları üzerine bir araştırma
Başal, A., Aytan, T., & Kaynak, N. E. (2019) · RumeliDE Dil ve Edebiyat Araştırmaları Dergisi :/RumeliDe Dil ve Edebiyat Araştırmaları Dergisi · doi:10.29000/rumelide.540989 · Cited by 3
Scharfenberg, F., & Bogner, F. X. (2019) · Research in Science Education · doi:10.1007/s11165-019-09887-9 · Cited by 3
“Confirming results or hypotheses by replications is central in any empirical science (Schmidt 2009).”
BackgroundMethodInfluentialClassroom experiments as a replication device
So, T. (2020) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2020.101525 · Cited by 3
Job crafting among managers. The mediation role of autonomy at work
Minda, M., & Mudło‐Głagolska, K. (2020) · Polish Psychological Bulletin · doi:10.24425/ppb.2019.131315 · Cited by 5
“According to Schmidt (2009), both of these functions fulfill one of the more important replication objectives, apart from the most general one, which is simply the verification of knowledge, hence the decision was made to conceptual replicate the study of Roczniewska and Puchalska-Kamińska (2017).”
BackgroundSarafoglou, A., van der Heijden, A. C., Draws, T., Cornelisse, J., Wagenmakers, E., & Marsman, M. (2022) · Psychology Learning & Teaching · doi:10.1177/14757257221077307 · Cited by 5
“…prevalence of questionable research practices (John et al., 2012), the reluctance to conduct direct replication studies (Pashler & Harris, 2012; Schmidt, 2009), and the poor availability of research data (Houtkoop et al., 2018; Wicherts et al., 2006; for a special issue on data sharing see…”
InfluentialIs the Suppression Effect of the Color Red on Snack Food Consumption Reliable?
Steele, K. M., & Rash, L. L. (2021) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000524 · Cited by 4
Bondyale-Juez, D. R., Romero-Kutzner, V., Purcell, J. E., Martínez, I., Packard, T. T., & Gómez, M. (2022) · Frontiers in Marine Science · doi:10.3389/fmars.2022.817196 · Cited by 5
“…R represents respiration in µL O2 h−1 g WM−1, RQ represents the unitless ratio of CO2-produced to O2-consumed (0.85) (Uye and Shimauchi, 2005); F is the C:CO2 conversion 0.536 µg C (µL CO2)−1, t is 24 to convert hours to days; and AE is the assimilation efficiency described by Schneider (1989).”
BackgroundInfluentialBeste, C. (2022) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2022.1054714 · Cited by 3
“However, the latter is not prominently discussed and rarely conducted because they are deemed riskier and more effortful (Schmidt, 2009).”
BackgroundInfluentialCascella, C., Giberti, C., & Maffia, A. (2023) · Research in Mathematics Education · doi:10.1080/14794802.2022.2154826 · Cited by 3
“The impossibility in reproducing identical conditions of an experiment in the educational fi eld (Schmidt, 2009), is con fi rmed also by Cai et al. (2018) for research in mathematics education, which involves students, teachers, and their interactions in the mathematics classroom.”
BackgroundAn Investigation of Replication Practice in Nursing Education Research
Abbott, M., & Nininger, J. M. (2023) · Nursing Education Perspectives · doi:10.1097/01.nep.0000000000001116 · Cited by 3
Getting seen: Results from an online experiment to draw more attention to replications
Coupé, T., Reed, W. R., & Zimmermann, C. (2023) · Research Policy · doi:10.1016/j.respol.2023.104841 · Cited by 3
Accelerating addiction research via Open Science and Team Science
Dora, J., Piccirillo, M. L., Foster, K. T., & King, K. M. (2023) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/bs.plm.2023.06.004 · Cited by 4
Tufănaru, C., Surian, D., Scott, A. M., Glasziou, P., & Coiera, E. W. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.10.013 · Cited by 4
Growth From Uncertainty: Understanding the Replication ‘Crisis’ in Infant Cognition
Lavelle, J. S. (2023) · Philosophy of Science · doi:10.1017/psa.2023.157 · Cited by 5
Using Experimental Material Management Tools in Experimental Replication: A Systematic Mapping Study
Espinosa, E. G., Ferreira, J. M., & Toapanta, H. M. C. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-73450-7_25 · Cited by 3
Understanding the (perverse) effects of disclosing conflicts of interest: A direct replication study
Sah, S. (2018) · Journal of Economic Psychology · doi:10.1016/j.joep.2018.10.010 · Cited by 5
“…of nutritional information at restaurants report a modest decline in caloric value per transaction (Krieger et al., 2013), while other studies show no change (Downs, Loewenstein, & Wisdom, 2009; Wisdom, Downs, & Loewenstein, 2010) or even increased caloric intake (Seenivasan & Thomas, 2016).”
Pereira, T. S., & Oliveira, A. M. (2021) · European Review of Applied Psychology · doi:10.1016/j.erap.2021.100718 · Cited by 5
Winokur, E. J., Song, C., Leija, E. S., Chen, J., Kross, S., Shamam, D., Aguilar‐Rivera, M., Quinn, L. K., Rossano, F., & Chiba, A. A. (2023) · Animal Behavior and Cognition · doi:10.26451/abc.10.03.01.2023 · Cited by 5
“This conceptual replication (Schmidt, 2009; Stroebe & Strack, 2014) strengthens the notion that rats”
BackgroundInvestigating the replicability and generalizability of the negative testing effect.
Wissman, K. T., & Peterson, D. J. (2018) · Journal of Applied Research in Memory and Cognition · doi:10.1016/j.jarmac.2018.05.002 · Cited by 3
The Significance of Non‐Replication of Gene‐Phenotype Associations
Halpern, C. T. (2010) · Wiley eBooks · doi:10.1002/9781444327632.ch15 · Cited by 3
Editorial Decisions May Perpetuate Belief in Invalid Research Findings
Eriksson, K., & Simpson, B. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073364 · Cited by 4
“We are most interested in the role of journal editors and original authors in cases where the underlying reason for the contradictory evidence is not so ambiguous [17].”
BackgroundDissertation R.C.M. van AertPreprint
van Aert, R. C. M. (2018) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/eqhjd · Cited by 3
Feger, S. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.02570 · Cited by 4
“Definitions, practices, and requirements for reproducible research differ between scientific fields [72, 168].”
BackgroundMcManus, K. (2021) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/hrnwa · Cited by 3
Does she still love and feel hungry? Afterlife continuity beliefs and religion across 24 countriesPreprint
Hoogeveen, S., Altay, S., Bendixen, T., Berniûnas, R., Bulbulia, J. A., Cheshin, A., Gentili, C., Georgescu, R., Haaf, J. M., Hagel, K., et al. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/tvycp · Cited by 4
The Alternative Factors Leading to Replication Crisis: Prediction and Evaluation
Chernov, G. (2024) · Evaluation Review · doi:10.1177/0193841x241229106 · Cited by 3
Flynn, M. K., & Hebert, E. R. (2022) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2021.11.005 · Cited by 2
Wilmore, T., Kriletic, A., Svyantek, D. J., & Donnelly, L. I. (2024) · Management Decision · doi:10.1108/md-03-2023-0370 · Cited by 2
Data sharing in modeling and simulation of biomechanical systems in interdisciplinary environments
Villota‐Narvaez, Y., Bleiler, C., & Röhrle, O. (2024) · GAMM-Mitteilungen · doi:10.1002/gamm.202370006 · Cited by 5
“Based on the concept of “uniformity of nature,” direct replicability is identified as a “reasonable proposition” in certain contexts, or constrained to subjects classified as “interactive” or “indifferent” [35, 11, 32].”
BackgroundSaint or Villain? Perceptions of Stepparenting versus Biological/Adoptive Parenting Familial Roles
Slotter, E. B., & Markey, P. M. (2025) · Family Transitions · doi:10.1080/28375300.2025.2516360 · Cited by 2
Kobayashi, T., Song, J., & Chan, P. (2025) · Journal of Elections Public Opinion and Parties · doi:10.1080/17457289.2025.2581905 · Cited by 2
Langaro, D., Loureiro, S. M. C., & Brântuas, M. (2025) · Journal of Strategic Marketing · doi:10.1080/0965254x.2025.2584043 · Cited by 3
“The second study was intended to ensure the replication of the findings in a different dataset and design, which enhances the reliability and validity of results (Schmidt, 2009).”
Bergh, D. D., Powell, R. G., Zhao, Y., & Schwab, A. (2025) · Strategic Organization · doi:10.1177/14761270251410355 · Cited by 2
Replications as Project‐Based Learning in Geographic Information Science
Kedron, P., Trgovac, A. B., & Holler, J. (2025) · Transactions in GIS · doi:10.1111/tgis.70162 · Cited by 4
“Reproduction attempts are typically used to assess the internal and conclusion validity of a study (Schmidt 2009, NASEM 2019, Kedron et al. 2021).”
Kim, J., Spence, P. R., & Kelly, S. E. (2026) · Interactive Learning Environments · doi:10.1080/10494820.2026.2667455 · Cited by 2
The Link Between the Data Producers’ Knowing-Why and their Intention to Enter Data Correctly
Haegemans, T., Snoeck, M., Lismont, J., & Lemahieu, W. (2017) · IEEE Conference on Business Informatics · doi:10.1109/cbi.2017.20 · Cited by 2
“On the other hand, this research can be considered as a partial conceptual replication [25] of the study that originally proposed the theory of planned behaviour (i.”
BackgroundKelling, N., Ward, C. P., Malin, D. H., Buras, W. R., & Hetherington, S. A. (2017) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931213601633 · Cited by 2
“…grows even larger when considering that the issue of replicability is not unique to drug dependency or medical research, but is prevalent in many fields including psychological sciences (Open Science Collaboration, 2015), social sciences (Schmidt, 2009), and engineering (Louridas & Gousios, 2012).”
BackgroundAutomatic Domain-Specific Corpora Generation from Wikipedia - A Replication Study
Ruwanpura, S., Morash, C., Khan, M. A., Ahmad, A., & Ginde, G. (2023) · IEEE International Requirements Engineering Conference Workshops (REW) · doi:10.1109/rew57809.2023.00022 · Cited by 3
“For Schmidt [6], “replication ex-periment to demonstrate that the same findings can be obtained in any other place by any other researcher is proof that the experiment reflects the knowledge that can be separated from the specific circumstances (such as time, place, or persons) under which it was…”
BackgroundHan, T., Snook, B., & Day, M. V. (2024) · Journal of Criminal Psychology · doi:10.1108/jcp-09-2024-0091 · Cited by 3
Bast, J., & Oschatz, C. (2025) · Communication Research · doi:10.1177/00936502241309957 · Cited by 2
Efficient n-gram analysis in R with cmscu
Vinson, D. W., Davis, J. K., Sindi, S., & Dale, R. A. C. (2016) · Behavior Research Methods · doi:10.3758/s13428-016-0766-5 · Cited by 2
“Indeed, being capable of harnessing large data sets will also help to accommodate the current needs of the behavioral sciences, such as openness and replicability (Nosek et al., 2012; Schmidt, 2009; Pashler & Wagenmakers, 2012; Zwaan & Pecher, 2012), without loss of scientific productivity (Ramscar et al.”
BackgroundLindquist, T. M., & Rausch, A. (2021) · Journal of Management Control · doi:10.1007/s00187-021-00318-3 · Cited by 3
“While there are benefits to this paradigm, it creates the danger of making assumptions based on studies with limited sample sizes or errors (Schmidt 2009).”
BackgroundConceptualizing translation in Poland in 2018
Kuźnik, A. (2021) · STRIDON Studies in Translation and Interpreting · doi:10.4312/stridon.1.2.87-114 · Cited by 2
Madrigal, R., Bee, C. C., & Chen, J. (2022) · Communication Research · doi:10.1177/00936502221074645 · Cited by 2
“Specifically, Study 2 represents a conceptual replication (Schmidt, 2009) that improves on Study 1 in four ways.”
BackgroundStatistical Assumptions and Reproducibility in Psychology: Data Mining Based on Open Science
Zhang, W., Shu, Y., Tian, B., & Fei, D. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.905977 · Cited by 2
“Keywords: reproducibility of psychology, data mining, normality hypothesis, homoscedasticity hypothesis, robust hypothesis INTRODUCTION Whether a particular research study can be reproduced or not, is a vital indicator to evaluate the reliability of scientific research (Schmidt, 2009).”
BackgroundReplicability and Meta-Analysis
Schauer, J. M. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_14 · Cited by 3
When should researchers cite study differences in response to a failure to replicate?
Colaço, D., Bickle, J., & Walters, B. J. (2022) · Biology & Philosophy · doi:10.1007/s10539-022-09873-y · Cited by 2
“While concerns over the requisite degree of “exactness” or “directness” for replications are common in recent literature (Schmidt 2009; Zwaan et al. 2018; Feest 2019; Romero 2019), and study differences are often noted by practicing scientists, there remains a question that has received little explicit discussion: und…”
BackgroundResultOn replication in science: Commentary on Derbyshire et al. (2022)
Rowland, N. J., & Spaniol, M. J. (2023) · Futures & Foresight Science · doi:10.1002/ffo2.147 · Cited by 3
Hernández‐Leo, D., Amarasinghe, I., Beardsley, M., Hakami, E., Ruiz-García, A., & Santos, P. (2023) · Higher education dynamics · doi:10.1007/978-3-031-24193-2_7 · Cited by 5
What drives preventative health behaviors one year into a pandemic? A replication and extension
Disabato, D. J., Foust, J. L., Taber, J. M., Thompson, C. A., Sidney, P. G., & Coifman, K. G. (2024) · Psychology and Health · doi:10.1080/08870446.2024.2372651 · Cited by 3
“The measurement of prevention behaviors was slightly different in the current study compared with the original study (Coifman et al., 2021) due to shifts in recommendations, resulting in a conceptual (rather than exact) replication (Schmidt, 2009).”
On the Significance of Place: Vaccination Refusal as a Situated Phenomenon
van der Meer, M. (2025) · Journal of Trial and Error · doi:10.36850/dfab-4bcf · Cited by 2
Ignorance isn’t bliss: Addressing ageism with formal university education
Strickland-Hughes, C. M., Carmichael, M., & West, R. L. (2025) · Educational Gerontology · doi:10.1080/03601277.2025.2486362 · Cited by 2
“This replication process offered opportunity to enhance the credibility of findings that are evidenced consistently across the studies independent from their different contexts (Schmidt, 2009).”
BRICS' scientific excellence and the search for relevance and replicability
Vílchez‐Román, C. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23654 · Cited by 2
“Requirements for publishing replicable studies are reported in the literature (Fanelli, 2012; Makel & Plucker, 2014; Makel, Plucker, & Hegarty, 2012; Schmidt, 2009).”
BackgroundReplicated results are more trustworthy
Shepperd, M. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-804206-9.00052-0 · Cited by 2
Are you coming on to me? Accuracy and bias in couples' perceptions of sexual advances
Dobson, K., Campbell, L., & Stanton, S. C. E. (2016) · Scholarship@Western (Western University) · Cited by 2
Media Priming Effect: A Preregistered Replication Experiment
Kobayashi, T., Miura, A., & Inamasu, K. (2017) · Journal of Experimental Political Science · doi:10.1017/xps.2017.8 · Cited by 3
“replication refers to the repetition of a test of earlier work using different methods (Schmidt 2009).”
BackgroundMethodInfluentialMax Weber’s ‘Inconvenient Facts’ and Contemporary Studies of Public Science Communication
Shipovalova, L. V. (2019) · Social Epistemology · doi:10.1080/02691728.2019.1695013 · Cited by 2
“Barriers to achieving replicability include the lack of interest on the part of financial backers to support confirmatory studies, and the lack of editors’ desire to publish results of repeated experiments see: (Schmidt 2009; Romero 2017).”
BackgroundMultiplicity Control vs Replication
Hunter, A., Beribisky, N., Farmus, L., & Cribbie, R. A. (2020) · Meta-Psychology · doi:10.15626/mp.2019.1992 · Cited by 3
Auwera, S. V. D., Mathys, L., Smedt, B. D., Torbeyns, J., & Verschaffel, L. (2021) · Implementation and Replication Studies in Mathematics Education · doi:10.1163/26670127-01010005 · Cited by 2
Paiz, J. M., & Coda, J. (2021) · Springer eBooks · doi:10.1007/978-3-030-76779-2_9 · Cited by 3
Examining parental control, parent-adolescent relationship, delinquency, and criminal behavior
Harris‐McKoy, D. (2013) · Cited by 2
The Repeatability in Psychology: A Topic Model Approach
Fei, D. (2018) · Wireless Personal Communications · doi:10.1007/s11277-018-5491-1 · Cited by 2
Conducting Replication Studies With Confidence
Morin, K. H. (2018) · Journal of Nursing Education · doi:10.3928/01484834-20181022-02 · Cited by 2
Long-term effects of first-grade teachers on students’ achievement: a replication study
Vanwynsberghe, G., Vanlaar, G., Damme, J. V., & Fraine, B. D. (2018) · School Effectiveness and School Improvement · doi:10.1080/09243453.2018.1556164 · Cited by 5
“The present study is considered a direct replication, since its goal is to confirm or contradict the results found in the original study, by using the same method (Schmidt, 2009).”
BackgroundResultExperimentalforschung in der politischen Kommunikation
Koch, T. (2020) · Springer eBooks · doi:10.1007/978-3-658-26242-6_49-1 · Cited by 2
Wainer, J. M. G., Fardella, C., & Espinosa‐Cristia, J. F. (2021) · History & Philosophy of the Life Sciences · doi:10.1007/s40656-021-00418-2 · Cited by 8
“2 The literature on experimental reproducibility usually distinguishes between exact or direct replication of an experiment (as close as possible to the original conditions under which it was conducted) and conceptual or indirect replication (which deliberately introduces variations in experimental variables or method…”
BackgroundBullon, P. F. M. (2015) · ScholarWorks - WMU (Western Michigan University) · Cited by 2
Review of Research Methods in Second Language Acquisition: A Practical Guide
Çelik, H. (2015) · Eurasian Journal of Applied Linguistics · doi:10.32601/ejal.460608 · Cited by 3
Obstacles to Building Effective Theory about Attitudes and Behaviours Towards Technology
Tate, M., & Evermann, J. (2012) · ANU Press eBooks · doi:10.22459/isf.10.2012.02 · Cited by 4
“Although direct replications are difficult outside a laboratory setting, the main obstacle to conducting other types of replicatory studies in social science fields seems to be obtaining raw data from previously published studies for reanalysis or meta-analysis, and the perceived difficulty in publishing the studies (…”
InfluentialMuller, A. (2017) · The University of Queensland · doi:10.14264/uql.2018.58 · Cited by 3
Metadata
- Authors
- Schmidt, S.
- Affiliations
- University Medical Center Freiburg (DE)
- Corresponding author
- Schmidt, Stefan
- ORCID
- Schmidt, Stefan
- Venue
- Review of General Psychology
- Publisher
- SAGE Publications
- Published
- 2009-06
- Volume
- 13
- Issue
- 2
- Pages
- 90-100
- ISSN
- 1089-2680 (ISSN-L)
- 1939-1552
- OpenAlex
- W2021458971
- Cited by
- 1,125
- References
- 55
- Citations by year
- 2026: 42 · 2025: 95 · 2024: 88 · 2023: 85 · 2022: 75 · 2021: 138 · 2020: 94 · 2019: 105 · 2018: 93 · 2017: 74 · 2016: 84 · 2015: 52 · 2014: 35 · 2013: 26 · 2012: 23
- FWCI
- 16.48
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Review of General Psychology (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Keywords
- replication, social sciences, fact-checking, publication practices, research methodology, epistemology of science
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.