Shall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences
The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Abstract
Replication is one of the most important tools for the verification of facts within the empirical sciences. A detailed examination of the notion of replication reveals that there are many different meanings to this concept and the relevant procedures, but hardly any systematic literature. This paper analyzes the concept of replication from a theoretical point of view. It demonstrates that the theoretical demands are scarcely met in everyday work within the social sciences. Some demands are just not feasible, whereas others are constricted by restrictions relating to publication. A new classification scheme based on a functional approach that distinguishes between different types of replication is proposed. Next, it will be argued that replication addresses the important connection between existing and new knowledge. To do so it has to be applied explicitly and systematically. The paper ends with a description of procedures how this could be done and a set of recommendations how to handle the concept of replication in the future to exploit its potential to the full.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Novel or innovative results are more likely to be published than replications or incremental extensions of existing findings 13-15 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [14]
In the citing paper
“RRs provide a mechanism for publishing replication research”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [14]
In the citing paper
“which are rarely published in the standard model 13,14 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [14]
In the citing paper
“Although sometimes replication efforts can reveal poorly designed studies and irreproducible results, this is more the exception than the rule [48].”
From The natural selection of bad science (2016) · cites this paper as [48]
Citations
Cites
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
The Logic of Scientific Discovery
(2013) · A Realist Theory of Science · doi:10.4324/9780203090732-9 · Cited by 7,731
Journal of Consciousness Studies
(2022) · Journal of Consciousness Studies · doi:10.53765/20512201 · Cited by 6,832
Journal of social behavior and personality
(1986) · Personality and Individual Differences · doi:10.1016/0191-8869(86)90025-5 · Cited by 6,706
Design and Analysis: A Researcher's Handbook
Beaton, A. E., & Keppel, G. (1975) · American Educational Research Journal · doi:10.2307/1162588 · Cited by 5,822
Scientific Explanation and the Causal Structure of the World
Salmon, W. C. (1985) · Princeton University Press eBooks · doi:10.1515/9780691221489 · Cited by 2,459
Leviathan and the Air-Pump: Hobbes, Boyle, and the Experimental Life
Cohen, I. B., Shapin, S., & Schaffer, S. (1987) · The American Historical Review · doi:10.2307/1869945 · Cited by 2,151
Leviathan and the Air-Pump: Hobbes, Boyle, and the Experimental Life
Cohen, I. B., Shapin, S., & Schaffer, S. (1987) · The American Historical Review · doi:10.1086/ahr/92.3.658 · Cited by 2,151
Leviathan and the Air-Pump: Hobbes, Boyle, and the Experimental Life
Traynham, J. G., Shapin, S., & Schaffer, S. (1987) · Journal of Interdisciplinary History · doi:10.2307/204299 · Cited by 2,045
Design and Analysis: A Researcher's Handbook
Aaker, D. A., & Keppel, G. (1976) · Journal of Marketing Research · doi:10.2307/3150757 · Cited by 2,011
Research works printed but not linked: 12
- American Psychological Association, 2001, Publication Manual of the American Psychological Association
- Beloff J., 1985, The repeatability problem in parapsychology, 1
- Collins H. M., 1985, Changing order
- CookT. D. (1990). Rersearch methodology: Strengthening causal interpretations of nonexperimental data. In SechrestL., PerrinE. & BunkerJ., US Department of health and human services (pp. 9–30). Public Health Service, Agency for Health Care Policy and Research.
- Edge H., 1985, The repeatability problem in parapsychology, 53
- Neuliep J. W., 1993, Journal of Social Behavior and Personality, 8, 21
- Rao K. R., 1981, Journal of Parapsychology, 45, 311
- Rosenthal R., 1991, Replication research in the social sciences, 1
- Sargent C. L., 1981, European Journal of Parapsychology, 3, 423
- Schacter D. L., 2000, Wir sind Erinnerung. Gedächtnis und Persönlichkeit
- Walach H., 2000, Neuroendocrinology Letters, 21, 221
- Weizsäcker E. U. v., 1986, Offene Systeme I: Beiträge zur Zeitstruktur von Information, Entropie und Evolution, 82
Cited by
Items 801–900 of 1,001
Diagnosis threat in a mild traumatic brain injury population
Trontel, H. G. (2012) · The Mathematics Enthusiast · Cited by 2
Ooi, L. L. (2018) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2018-12961 · Cited by 4
“, 2014) will: (a) allow for the removal of potential limitations or confounds in Study 1; and (b) increase the generalizability of the proposed psychological processes (Bonnett, 2012; Schmidt, 2009).”
BackgroundMaking “what works” work: the elusive research butterfly
Morrison, K., & van der Werf, G. P. C. (2019) · Educational Research and Evaluation · doi:10.1080/13803611.2020.1821489 · Cited by 2
Taking a Closer Look at Methodological Quality: JACM Partners with Cochrane Complementary Medicine
Cramer, H., & Wieland, L. S. (2021) · The Journal of Alternative and Complementary Medicine · doi:10.1089/acm.2021.29092.hcr · Cited by 2
“5,6 However, if these supposed breakthrough results are the consequence of a lack of methodological rigor, then an attempt at replication is essential, as it can refute the biased results.”
Australian and Italian Psychologists’ View of ReplicationPreprint
Fidler, F. M., Fraser, H. S., Thorn, F. S., & Agnoli, F. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ks48e · Cited by 2
van Aert, R. C. M., & van Assen, M. A. L. M. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ft3tu · Cited by 2
Syeda, U. H., South, L., Raynor, J., Panavas, L., Saffo, D., Morriss, T., Dunne, C., & Borkin, M. A. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/h2qfn · Cited by 3
Empowerment in Place: The Well-Being and Engagement Equation of Hybrid Work EnvironmentsPreprint
Sharma, S. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5184409 · Cited by 3
Busch, H. (2023) · Europe’s Journal of Psychology · doi:10.5964/ejop.8375 · Cited by 2
“Thus, as its findings are so close to the heart of generativity, the present study is based on the conviction that the results of Peterson et al. (1997) deserve a replication attempt (on the importance of replication as a tool to verify empirical results, see, e.g., Schmidt, 2009).”
Greenfader, C. M., & Miller, E. B. (2024) · Journal of Latinos and Education · doi:10.1080/15348431.2024.2413534 · Cited by 3
“Importantly, the findings replicated across both ECLS-K:2011 and HSIS, lending confidence to the robustness of the results and addressing a longstanding issue of generalizability in social science research (Duncan et al., 2004; Schmidt, 2009).”
Conformity and Competence Frustration: A Self-Determination Theory Perspective
Burkitt, W. T. (2025) · Psychological Reports · doi:10.1177/00332941251351242 · Cited by 1
D’Northwood, G., & Rattray, J. (2025) · Innovations in Education and Teaching International · doi:10.1080/14703297.2025.2521558 · Cited by 1
“Replication occurs much less in social science research, including disciplines such as economics and finance, but is arguably no less important to increasing the confidence in research results (Burman et al., 2010; Schmidt, 2009).”
Guerrero, J. G. (2025) · Nurse Education in Practice · doi:10.1016/j.nepr.2025.104450 · Cited by 1
Why We Disagree About the Success of Replications
Sarisoy, J. (2025) · Journal for General Philosophy of Science · doi:10.1007/s10838-024-09709-1 · Cited by 1
“Some advo - cate for finding ‘facts’ (Schmidt 2009), others for establishing that the effect exists (LeBel et al., 2017), and others for detecting if it is ‘real’ (Simons 2014; Feest 2019 ).”
InfluentialPROTEUS - promoting success in university: a results assessment
Pinto, J. C., Costa-Ramalho, S., & Branquinho, C. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1589030 · Cited by 1
Köcher, S., Köcher, S., Chatterjee, R., & Shukla, Y. S. (2025) · Journal of service management · doi:10.1108/josm-02-2025-0063 · Cited by 3
Wu, Z., & Fricke, M. (2025) · Studies in Second Language Acquisition · doi:10.1017/s0272263125101368 · Cited by 1
“…in nearly every methodological aspect of the original study (McManus, 2023) to ascertain the generalizability and understand the limits of the theory in the original study and to potentially develop or build upon the original theory (Makel & Plucker, 2014; Porte & McManus, 2019; Schmidt, 2009).”
Producing Trustworthiness in Studying What Works in Heterodox Curricular Interventions
Roulston, K., Acheampong, K. O., Callahan, M., King, E., & Nibbelink, N. P. (2025) · Qualitative Inquiry · doi:10.1177/10778004251383518 · Cited by 1
From best practices to severe testing: A methodological response to Büsch and Loffing (2024)
Späth, C. B. (2025) · German Journal of Exercise and Sport Research · doi:10.1007/s12662-025-01072-7 · Cited by 1
“Because error rates are only effective in the long run and individual studies are limited in their informational value, direct replications need to be conducted to show the reliability of an (intervention) effect (Schmidt, 2009).”
Holler, J., Kedron, P., Burt, D., Udoh, K., Roubin, S., & Cordola, B. (2025) · Cartography and Geographic Information Science · doi:10.1080/15230406.2025.2591124 · Cited by 3
“The type of sensitivity check a reanalysis provides depends on what aspects of the procedure are changed by the researcher (Gómez et al., 2010; Schmidt, 2009).”
Koh, Y., & Law, K. K. (2025) · Management Review Quarterly · doi:10.1007/s11301-025-00572-y · Cited by 2
Plant Cognition—A Methodological Primer: Theories, Methods and Challenges
Segundo‐Ortin, M., Ponkshe, A., Lee, J., & Calvo, P. (2025) · Philosophy Compass · doi:10.1111/phc3.70068 · Cited by 2
“…for both direct replications (closely reproducing the original experiment) and conceptual replications (testing the same hypothesis with alternative methods; Schmidt 2009; Romero 2019), in order to determine whether plants can indeed learn by association (Garcia‐Simon 2021; Ponkshe et al. 2024).”
Herman, K., Yang, M., Shifflett, J., & Glaser, N. J. (2026) · Journal of Computing in Higher Education · doi:10.1007/s12528-025-09484-y · Cited by 1
“This study undertakes a conceptual replication (Hudson, 2023; Schmidt, 2009), in which the repetition of a hypothesis is tested in a different scenario.”
Saad, G. (2026) · Theory and Society · doi:10.1007/s11186-025-09674-8 · Cited by 1
“These nomological networks inherently address a fundamental problem in the social sciences, namely the lack reproducible research (Schmidt, 2009; Nosek et al., 2022 ), by providing a cataloguing of conceptual if not direct replications via the triangulation of distinct lines of evidence, hence…”
Krieweth, C., Kruse, S., Short, J. C., Schrameier, L. R. M., & Brettel, M. (2026) · Entrepreneurship Theory and Practice · doi:10.1177/10422587261415935 · Cited by 1
Service robot failure: The interplay of monetary compensation and voice anthropomorphism
Bruder, M., & Paul, M. (2026) · Journal of Business Research · doi:10.1016/j.jbusres.2026.116260 · Cited by 1
A causal framework for explaining effect heterogeneity in conceptual replications.
Pohl, S., Sengewald, M.-A., Kondzic, D., Hoffmann, J., Twardawski, M., & Steiner, P. M. (2026) · Psychological Methods · doi:10.1037/met0000834 · Cited by 2
Miles, A., Samim, Y., & Khan, S. (2026) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2026.104947 · Cited by 1
When agile and non-agile mindsets collide: mastering paradox management to navigate the VUCA
Kucharska, W., Kucharski, M., & Jussila, J. (2026) · Strategy and Leadership · doi:10.1108/sl-04-2026-0201 · Cited by 1
Criminal history's expiration date: Evidence of prediction decay
Hamilton, Z. K., Kigerl, A. C., Tostlebe, J. J., & Ursino, J. (2026) · Criminology · doi:10.1111/1745-9125.70069 · Cited by 1
Marschall, J. C., Toussaint, L. L., Stuart, K. L., & Gates, L. M. (2012) · EXPLORE · doi:10.1016/j.explore.2012.04.001 · Cited by 1
Clohecy, E. D., Standing, L., & McKelvie, S. J. (2015) · Escritos de Psicología / Psychological Writings · doi:10.5231/psy.writ.2015.1512 · Cited by 1
“…contradictory results obtained here suggest the need for further studies, particularly in light of the recent realization that many major findings reported in the peer-reviewed literature in various areas of psychology cannot be replicated by independent investigators (Bonett, 2012; Schmidt, 2009).”
ResultThe Structure of Goal Contents Revisited. A Verification of the Model in Polish Samples
Górnik-Durose, M. E., & Jach, Ł. (2016) · Polish Psychological Bulletin · doi:10.1515/ppb-2016-0053 · Cited by 3
“Conducting and publishing replications as a mean to provide validity, accuracy and reliability of psychological findings has recently received a lot of attention from scholars (Koole, & Lakens, 2012; Makel, Plucker, & Hegarty, 2012; Schmidt, 2009; Stanley & Spence, 2014).”
BackgroundResultPsychological experiment in context of the problem of complexity
Стебаков, Д. А. (2017) · Philosophy of Science and Technology · doi:10.21146/2413-9084-2017-22-1-46-60 · Cited by 1
Dickhäuser, O., Heinze, A., Hamm, M. L., Bales, A. S., Bellmann, S. A., Böger, D., Gagelmann, L. K., Kuhlenkamp, F., Merger, J. K., Viehweger, H., et al. (2020) · Zeitschrift für Pädagogische Psychologie · doi:10.1024/1010-0652/a000263 · Cited by 1
Bustos, C., Canihuante, N. Z., Salcedo, P., & Mújica, A. D. (2020) · Psykhe (Santiago) · doi:10.7764/psykhe.29.2.1498 · Cited by 4
Verification of a measurement of international managers’ mindset
Fatehi, K., & Vaezi, R. (2021) · Review of International Business and Strategy · doi:10.1108/ribs-10-2020-0128 · Cited by 1
Internal and External Validity
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.003 · Cited by 1
Arshan, N., Park, C. J., & Goetz, R. (2023) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2023.2179953 · Cited by 3
“In an overview of the aims and purposes of replication in the applied social sciences, Schmidt (2009) provides five purposes for replication: “ to control for sampling error, to control for interval validity, to control for fraud, to generalize results with a different population, and to verify the…”
BackgroundMethodInfluentialTowards more credible conceptual replications under heteroscedasticity and unbalanced designs
Mateu, P. F., Applegate, B. E., & Coryn, C. L. S. (2023) · Quality & Quantity · doi:10.1007/s11135-023-01657-0 · Cited by 3
“A replication of an original experiment should reflect knowledge consistent with original results independently of specific circumstances such as persons (Schmidt 2009).”
InfluentialHernández, J. H., Xolocotzin, U., & Aguilar, M. S. (2023) · Implementation and Replication Studies in Mathematics Education · doi:10.1163/26670127-bja10016 · Cited by 1
The status quo, challenges, and recommendations of pre-registration in psychological science
Jiawei, Z. H. A. O., Tao, X. I. A., & Chuan-Peng, H. (2024) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2024.00715 · Cited by 3
Gersten, R. M., Dimino, J., Jayanthi, M., & Taylor, M. J. (2024) · The Elementary School Journal · doi:10.1086/730082 · Cited by 1
“Most current initiatives for replication focus on conceptual replications (Schmidt, 2009 ).”
BackgroundReyes, A. D. L. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197686607.003.0023 · Cited by 1
Ma, M. Z., Chen, S. X., & Wang, X. (2024) · Public Health · doi:10.1016/j.puhe.2024.07.022 · Cited by 2
Beyond the Original: Exploring Replication Research in Higher Education
Soppe, K. F. B., & Huisman, J. (2024) · Emerald Group Publishing Limited eBooks · doi:10.1108/s2056-375220240000010007 · Cited by 2
Drageset, D., & Crippen, K. J. (2025) · Journal of Computing in Higher Education · doi:10.1007/s12528-025-09431-x · Cited by 1
“Conceptual replications provide reproducibility evidence (Ioannidis, 2012) and offer the potential to reveal the extent to which previous findings are generalizable and transferable (Coyne et al., 2016; Schmidt, 2009).”
Shek, D. T. L., Tang, Y., Zhu, X., & Gong, Z. (2025) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph22040613 · Cited by 1
“One prominent advantage of a replication study is to increase the generalizability of original findings and establish an accumulative research process whereby results undergo repeated checks and theory modifications [56], thus establishing scientific credibility [57].”
The Prevalence of Replication Studies in Human Factors (2020-2024)
Doane, R., Andrade, F. M. G., Marra-Dotts, J., Li, B., Groetsch, S., Lichter, K. A., Do, A., Hyk, A., Baker, S., Johnson, J. D., et al. (2025) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/10711813251376984 · Cited by 1
“More reassuringly, though, a majority of the published replication efforts we identified were direct—either with or without an extension—providing unequivocal attempts to check the results of the target studies (Schmidt, 2009; Simons, 2014).”
InfluentialPolhill, S. E., Smith, S. K. H., Baughan, E. C., Bunnell, K. L., Bunker, B., Garcia-Prada, D., Ferguson, M. A., Smith, G. S., Smith, B. M., Wang, K. T., et al. (2025) · Journal of Religion and Health · doi:10.1007/s10943-025-02498-x · Cited by 1
Effects of Priming Dialectic Rational Beliefs on Irrational Beliefs
Crum, J. E., II (2016) · Psi Chi Journal of Psychological Research · doi:10.24839/2164-8204.jn21.1.46 · Cited by 1
What Lessons Does the ‘Replication Crisis’ in Psychology Hold for Experimental Economics?
Bardsley, N. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316676349.003 · Cited by 2
“A conceptual replication consists of “repetition of a test of a hypothesis or result of earlier research work with different methods” (Schmidt, 2009 p91).”
BackgroundMethodInfluentialKreibig, S. D. (2017) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2017.06.001 · Cited by 1
“It requires new data collection with new research subjects and identical or similar methods and analyses (Schmidt, 2009).”
MethodAllen, M. S., McRae, K., & Walter, E. E. (2018) · Body Image · doi:10.1016/j.bodyim.2018.12.008 · Cited by 1
Cobern, W. W., Adams, B. A., Pleasants, B. A.-S., Bentley, A. P. K., & Kagumba, R. (2019) · ScholarWorks - WMU (Western Michigan University) · Cited by 1
Koch, T., & Geiß, S. (2019) · Studies in Communication and Media · doi:10.5771/2192-4007-2019-2-203 · Cited by 2
Schuwerk, T., Bätz, J., Träuble, B., Sodian, B., & Paulus, M. (2019) · Psychological Research · doi:10.1007/s00426-019-01223-0 · Cited by 1
Processing the Word Red and Intellectual Performance: Four Replication Attempts
Gnambs, T., Kovacs, C., & Stiglbauer, B. (2020) · Collabra Psychology · doi:10.1525/collabra.277 · Cited by 1
van der Ploeg, M. M., BROSSCHOT, J. F., Quirin, M., Lane, R. D., & Verkuil, B. (2019) · Journal of Psychophysiology · doi:10.1027/0269-8803/a000247 · Cited by 2
Walshe, E. A., Oppenheimer, N., Kandadai, V., & Winston, F. K. (2019) · International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design (Driving Assessment Conference) · doi:10.17077/drivingassessment.1722 · Cited by 1
“Replication is a key tool to verify facts for empirical studies (Schmidt, 2009).”
MethodWatching eyes and partisan mobilization: A rejoinder to Panagopoulos and van der Linden
Murray, G. R. (2019) · Social Influence · doi:10.1080/15534510.2019.1696224 · Cited by 1
“…because many successful voter mobilization techniques identified in field experiments are later used in actual campaigns (e.g., Erkel, 2018; Issenberg, 2013), Matland and Murray intentionally designed their original studies (2016) as conceptual versus exact or direct replications (Schmidt, 2009).”
BackgroundNástroje na zlepšenie štatistickej inferencie – analýza p-kriviek a ekvivalenčné testovanie
Fico, M. (2020) · Sociológia - Slovak Sociological Review · doi:10.31577/sociologia.2020.52.4.14 · Cited by 1
Have changes in audit standards altered client perceptions of auditors?
Doxey, M. M., & Ewing, R. (2020) · American Journal of Business · doi:10.1108/ajb-01-2020-0008 · Cited by 1
The importance of the “so what” factor in educational research
Morrison, K., & van der Werf, G. P. C. (2019) · Educational Research and Evaluation · doi:10.1080/13803611.2019.1863214 · Cited by 1
Bruna, E. M., Chazdon, R. L., Errington, T. M., & Nosek, B. A. (2021) · Biotropica · doi:10.1111/btp.12912 · Cited by 1
“That is why rep - lication is formally defined as attempting to reproduce a previously observed result with procedures that provide no a priori reason to expect a different outcome (Nosek & Errington, 2017; Open Science Collaboration, 2015; Schmidt, 2009).”
ResultA Similarity-Weighted Informative Prior Distribution for Bayesian Multiple Regression Models
König, C. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.614236 · Cited by 1
“When specifying informative prior distributions, researchers are confronted with a body of background knowledge comprised of conceptual replications of studies (Schmidt, 2009).”
BackgroundThe perception of reproducibility in a small cohort of scientists in Europe
Didio, G., & Casarotto, P. C. (2021) · doi:10.23668/psycharchives.4934 · Cited by 1
Replication and Knowledge Production in Empirical Software Engineering Research
Krein, J. L. (2014) · ScholarsArchive (Brigham Young University) · Cited by 3
Case-Control and Cohort Designs
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.008 · Cited by 2
Null Hypothesis Significance Testing
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.014 · Cited by 1
The perception of reproducibility in a small cohort of scientists in Europe
Didio, G., & Casarotto, P. C. (2021) · Neuroanatomy and Behaviour · doi:10.35430/nab.2021.e20 · Cited by 1
“In a more narrow definition, reproducibility refers to precisely obtaining the same result, under the same conditions, and it is usually applied in computer sciences [1],while replicability refers to obtaining similar (or the same) results by repeating the research procedures [2].”
ResultAKI After Type A Dissection Repair: Do We Really Need More Replication Studies?
Hughes, G. C. (2023) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2022.12.034 · Cited by 1
How do psychology researchers interpret the results of multiple replication studies?
van den Akker, O. R., Wicherts, J. M., Alvarez, L. D., Bakker, M., & van Assen, M. A. L. M. (2023) · Psychonomic Bulletin & Review · doi:10.3758/s13423-022-02235-5 · Cited by 4
The replication crisis in science and its overlap into kinantropology: an introduction
Baloun, L., & Mališ, J. (2023) · Tělesná kultura · doi:10.5507/tk.2023.002 · Cited by 1
Good science, bad science: Questioning research practices in psychological research
Bakker, M. (2014) · UvA-DARE (University of Amsterdam) · Cited by 1
Burns, M. J. (2013) · Brock University Digital Repository (Brock University) · Cited by 1
Do executive functions predict change in forms of aggression in middle childhood
Grimstad, K. (2014) · BIBSYS Brage (BIBSYS (Norway)) · Cited by 2
Beyond Probability Sampling: Population Inference in a World without BenchmarksPreprint
Pasek, J. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2804297 · Cited by 1
Optimal design of psychological experiments with multiple random factors
Westfall, J. (2015) · CU Scholar (University of Colorado Boulder) · Cited by 2
Jullien, D., & Vallois, N. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3116245 · Cited by 1
Drivers of International Investment Decisions: The Role of Safety Risk
DeGhetto, K., Lamont, B. T., & Holmes, R. M. (2017) · Academy of Management Proceedings · doi:10.5465/ambpp.2017.17270abstract · Cited by 1
Heterogeneity of research results: New perspectives on psychological science
Linden, A. H. (2019) · Northumbria Research Link (Northumbria University) · Cited by 2
Improving Research in Educational Psychology, Psychology, and the Social SciencesPreprint
Smith, K. N., Makel, M. C., & Plucker, J. A. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ams9e · Cited by 1
Statistical Assessment of Replicability via Bayesian Model CriticismPreprint
Zhao, Y., & Wen, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.03993 · Cited by 3
“Consequently, inconsistent specifications of replication successes and misuses of subjective measures for assessing reproducibility are common in scientific practice [8, 9, 10].”
BackgroundScience Needs Systematic Replicability AuditsPreprint
Allard, A., & Vazire, S. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/wusdr · Cited by 1
JSE 28:4 Winter 2014 Whole Issue PDF
Erickson, K. E. (2014) · Journal of Scientific Exploration · Cited by 1
The Effect of Self-Awareness on the Identification of Goal-Related ObstaclesPreprint
Kreibich, A., Hennecke, M., & Brandstätter, V. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/b5tcp · Cited by 1
Volatility shocks and investment behaviorPreprint
Kirchler, M., Huber, J., & Huber, C. (2021) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/jr4eb · Cited by 1
“In the realm of the present study, this second wave, in principle, acts as a direct replication (Schmidt, 2009) of the original study, which we employ as an additional robustness check for the results and treatment differences reported above.”
ResultJennnings, F. J. (2018) · MOspace Institutional Repository (University of Missouri) · doi:10.32469/10355/68905 · Cited by 1
Bruna, E. M., Chazdon, R. L., Errington, T. M., & Nosek, B. A. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/dbpsz · Cited by 1
Gotteland, D. (2019) · Recherche et Applications en Marketing (English Edition) · doi:10.1177/2051570718818959 · Cited by 1
Koch, T. (2017) · Wiley eBooks · doi:10.1002/9781118901731.iecrm0211 · Cited by 1
Latent Semantic Analysis Applied to Authorship Questions in Textual AnalysisPreprint
Marshall, C. Z., & Buchanan, E. M. (2017) · doi:10.31219/osf.io/zpsd7 · Cited by 1
“…hypotheses that are313 normally subject to only qualitative analyses, which contributes to the scientific literature by314 performing necessary replication and extension studies (Schmidt 2009), while not exclusively315 relying on traditional null hypothesis testing criterion (Cumming 2008, 2014).”
Hirschhorn, R., & Schönberg, T. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-820480-1.00014-0 · Cited by 1
Isager, P. M., Lakens, D., van Leeuwen, T. N., & Veer, A. V. '. (2023) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/3u52w · Cited by 1
Peña, A. R. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5263495 · Cited by 2
Epigenetics and endocrinology: new frontiers in motivational science
Steel, R. P. (2019) · Loughborough University Research Repository (Loughborough University) · doi:10.26174/thesis.lboro.8243258 · Cited by 1
Verbal aggression, physical aggression and inappropriate sexual behaviour following brain injury
James, A. (2012) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York) · Cited by 2
정성은 (2012) · Journal of Public Relations · doi:10.15814/jpr.2012.16.4.213
The perfectly replicable studyPreprint
Tressoldi, P. E. (2016) · doi:10.15200/winn.147193.33670
Metadata
- Authors
- Schmidt, S.
- Affiliations
- University Medical Center Freiburg (DE)
- Corresponding author
- Schmidt, Stefan
- ORCID
- Schmidt, Stefan
- Venue
- Review of General Psychology
- Publisher
- SAGE Publications
- Published
- 2009-06
- Volume
- 13
- Issue
- 2
- Pages
- 90-100
- ISSN
- 1089-2680 (ISSN-L)
- 1939-1552
- OpenAlex
- W2021458971
- Cited by
- 1,125
- References
- 55
- Citations by year
- 2026: 42 · 2025: 95 · 2024: 88 · 2023: 85 · 2022: 75 · 2021: 138 · 2020: 94 · 2019: 105 · 2018: 93 · 2017: 74 · 2016: 84 · 2015: 52 · 2014: 35 · 2013: 26 · 2012: 23
- FWCI
- 16.48
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Review of General Psychology (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Keywords
- replication, social sciences, fact-checking, publication practices, research methodology, epistemology of science
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.