Cited by 609Psychology Research and BibliometricsMeta-analysis and systematic reviewsEducational Research and Methods

The DOI matches its Crossref record; 132 of the 132 references it cites were found in a registry or an index.

Facts Are More Important Than Novelty: Replication in the Education Sciences

Makel, Matthew C., Plucker, Jonathan A.·2014·Educational Researcher

Open this paper in CoChat — free account

Abstract

Despite increased attention to methodological rigor in education research, the field has focused heavily on experimental design and not on the merit of replicating important results. The present study analyzed the complete publication history of the current top 100 education journals ranked by 5-year impact factor and found that only 0.13% of education articles were replications. Contrary to previous findings in medicine, but similar to psychology, the majority of education replications successfully replicated the original studies. However, replications were significantly less likely to be successful when there was no overlap in authorship between the original and replicating articles. The results emphasize the importance of third-party, direct replications in helping education research improve its ability to shape education policy and practice.

Integrity signals

Registry

Crossref · 10.3102/0013189x14545513

Cites

132 of 132 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

2 retracted

RETRACTED: Ileal-lymphoid-nodular hyperplasia, non-specific colitis, and pervasive developmental disorder in children
Wakefield, A., Murch, S., Anthony, A., Linnell, J., Casson, D., Malik, M., Berelowitz, M., Dhillon, A., Thomson, M., Harvey, P., et al. (1998) · The Lancet · doi:10.1016/s0140-6736(97)11096-0 · Cited by 3,006
Retracted
Retraction—Ileal-lymphoid-nodular hyperplasia, non-specific colitis, and pervasive developmental disorder in children
Lancet, T. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60175-4 · Cited by 500
Retracted
Untitled work
(1963) · Medical Entomology and Zoology · Cited by 15,085
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
An Introduction to Categorical Data Analysis
Agresti, A. (2006) · Wiley series in probability and statistics · doi:10.1002/0470114754 · Cited by 6,775
Journal of social behavior and personality
(1986) · Personality and Individual Differences · doi:10.1016/0191-8869(86)90025-5 · Cited by 6,751
False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
American Economic Review
Moffitt, R. (2009) · American Economic Review · doi:10.1257/aer.99.2.660 · Cited by 4,888
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 5×
“Using health care research as an example, Ioannidis (2005a), in a review of highly cited medical publications (i.e., those cited more than 1,000 times), found only 44% of replications produced results similar to the original study.”
ResultInfluential

Show all 131 references

Research works printed but not linked: 14

10.1037//0003–066x.49.12.997 · DOI · Paper page
Collins H. M., 1985, Changing order
Kane E. J., 1984, Quarterly Journal of Business and Economics, 23, 3
Neuliep J. W., 1993, Journal of Social Behavior and Personality, 8, 1
Neuliep J. W., 1993, Journal of Social Behavior and Personality, 8, 21
Perspectives on Psychological Science. (2012). Special section on replicability in psychological science: A crisis of confidence? Retrieved from http://pps.sagepub.com/content/7/6.toc · DOI · Paper page
Powell K., 2007, PLoS Biology, 12, 2748
Rhine J. B., 1997, Extra-sensory perception
Ritchie S. J., 2012, Psychologist, 25, 346
10.1037//0033–2909.86.3.638 · DOI · Paper page
Rotton J., 1995, Journal of Social Behavior and Personality, 10, 1
Simons D. J., 2012, Psychologist, 25, 349
Simons D. J., 2014, Perspectives on Psychological Science. APS Observer, 27, 16
Williams S. N., 2012, Science, 336, 801

Sorted by citations

Items 501–600 of 608

Replication of Quantitative Psychological and Educational Research: A Philosophical Analysis
Cantley, I. (2023) · American Educational Research Association Annual Meeting (AERA) · doi:10.3102/2001119 · Cited by 1
Beyond the Original: Exploring Replication Research in Higher Education
Soppe, K. F. B., & Huisman, J. (2024) · Emerald Group Publishing Limited eBooks · doi:10.1108/s2056-375220240000010007 · Cited by 1
Elementary preservice teachers learn cardiac form and function with virtual reality: using study replication to define features of best practice
Drageset, D., & Crippen, K. J. (2025) · Journal of Computing in Higher Education · doi:10.1007/s12528-025-09431-x · Cited by 1
“Replication is a core component of any empirical science, yet replication studies are under-published in education (Makel & Plucker, 2014) and more generally across fields of science (Ioannidis, 2012).”
Do replications receive fewer citations? A counterfactual approach
Coupé, T., Logchies, T., & Reed, W. R. (2025) · Scientometrics · doi:10.1007/s11192-025-05288-0 · Cited by 1
“Only about 0.13% of studies in education are replicated (Makel & Plucker, 2014), 0.45% in criminology (Pridemore et al., 2018), 0.25% in second language research (Marsden et al., 2018), 1.07% in psychology (Makel et al., 2012), 0.41% in special education research (Lemons et al., 2016), and 0.1% in…”
Influential
Introducing the Journal Editors Discussion Interface
Bottesini, J. G., Silverstein, P., Karcher, S., & Elman, C. (2025) · IASSIST Quarterly · doi:10.29173/iq1146 · Cited by 1
“…al. 2013; Nosek et al., 2015; Levenstein & Lyle, 2018; Nosek et al. 2022), economics (Christensen and Miguel 2018; Miguel et al., 2014), education (Makel & Plucker, 2014; Cook et al., 2018; Gehlbach & Robinson, 2018; McBee et al., 2018; Fleming et al., 2021), political science (Lupia & Elman,…”
A Phenomenology Study of First-~year Teachers Looking at the Shared Lived Experience of Learning to Grade
Yost, B. L. (2020) · Digital Scholarship - UNLV (University of Nevada Reno) · doi:10.34917/8220176 · Cited by 1
Student perceptions of high school theatre programs: An investigation of social issues and call for replication
Omasta, M., & Brandley, A. T. (2016) · Youth Theatre Journal · doi:10.1080/08929092.2016.1160015 · Cited by 1
“In addition to these questions, we set out to create a research instrument that would enable easy replication of this study, given that “the need to increase [replication studies] is apparent and permeates all levels of education research” (Makel and Pucker 2014, 311).”
BackgroundMethod
Effect of Energy Monitoring Activities on Climate Change Beliefs and Intentions: Replication of Findings at Multiple Project Locations
Christensen, R. W., & Knezek, G. (2016) · IEEE International Conference on Advanced Learning Technologies (ICALT) · doi:10.1109/icalt.2016.49 · Cited by 1
“Makel and Plucker [13] define replication as “the purposeful repetition of previous results to corroborate or disconfirm the previous results”.”
Result
Confirming the Prevalence, Characteristics, and Utility of Ecological Theory in Explaining Prescription Stimulant Misuse
Bavarian, N., Sumstine, S., Cruz, S., Mendez, J., Schroeder, C., & Takeda, S. (2017) · Journal of Drug Issues · doi:10.1177/0022042617740910 · Cited by 1
“Thus, it is important for future research teams with non-overlapping authors to attempt to replicate our findings (Makel & Plucker, 2014).”
Background
Investigating the potential for unanticipated consequences of teaching the tentative nature of science
Cobern, W. W., Adams, B. A., Pleasants, B. A.-S., Bentley, A. P. K., & Kagumba, R. (2019) · ScholarWorks - WMU (Western Michigan University) · Cited by 1
Of intersectionality, replicability, and holistic perspectives: Methodological considerations in Spanish sociophonetic perception studies
Mack, S. (2019) · Dialnet (Universidad de la Rioja) · Cited by 1
Zum Nutzen der Meta-Analyse in der Evaluation von Sprachförderkonzepten am Beispiel der phonologischen Bewusstheit
Pfost, M., & Borgstede, M. (2020) · Edition ZfE · doi:10.1007/978-3-658-26438-3_2 · Cited by 1
A Brief History of Meta-analysis
Higgins, S. (2018) · Cambridge University Press eBooks · doi:10.1017/9781139519618.002 · Cited by 2
Upper Elementary School Children’s Adaptive Use of Subtraction by Addition: A Choice/No-Choice Replication Study Involving Two Choice Conditions
Auwera, S. V. D., Mathys, L., Smedt, B. D., Torbeyns, J., & Verschaffel, L. (2021) · Implementation and Replication Studies in Mathematics Education · doi:10.1163/26670127-01010005 · Cited by 2
The Reproducibility Crisis in Science Education Studies: Causes and Solutions
Nakamura, D., HARADA, Y., HISASAKA, T., UNZAI, H., & Matsuura, T. (2021) · Journal of Research in Science Education · doi:10.11639/sjst.sp20016 · Cited by 1
“という質問に対しては，52％が「大いに危機的な状況にある」，38％が「やや危機的な状況にある」と回答した（Baker, 2016）。このような再現性の危機 1）は，自然科学のみならず人文社会科学においても問題視されている。例えば，Open Science Collaboration（2015）の大規模な追試研究では，過去の心理学分野の研究のうち，結果が統計的に再現されたのは全体の 36％であった。また， Makel and Plucker（2014）は教育分野でインパクトファクターが高いトップ 100 誌の追試研究を分析した結果，再現に成功した追試は 70％であるが，その…”
Influential
Issues of Teacher Performance Stability are Not New: Limitations and Possibilities
Good, T. L., & Lavigne, A. L. (2015) · Education Policy Analysis Archives · doi:10.14507/epaa.v22.1916 · Cited by 1
Improving pedagogy through Registered Reports
McAleer, P., & Paterson, H. (2021) · Open Scholarship of Teaching and Learning · doi:10.56230/osotl.13 · Cited by 1
Evidence on evidence-informed policy and practice
Gough, D., Sharples, J., & Maidment, C. (2022) · Educational research and innovation · doi:10.1787/5ee7de7c-en · Cited by 2
Das Provokative Essay: Open Science als Weg zu verlässlicher sonderpädagogischer Forschung
Lüke, T. (2022) · Vierteljahresschrift für Heilpädagogik und ihre Nachbargebiete · doi:10.2378/vhn2022.art33d · Cited by 1
Calling Upon the Community: Gathering Data on Programmatic and Academic Opportunities in Computing Education Research
Lunn, S. J., Samary, M. M., & Peterfreund, A. R. (2023) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3587102.3588813 · Cited by 1
Improving Research in Educational Psychology, Psychology, and the Social SciencesPreprint
Smith, K. N., Makel, M. C., & Plucker, J. A. (2019) · doi:10.31234/osf.io/ams9e · Cited by 1
Self-citation
Low Research Data Availability in Educational Psychology Journals: No Indication of Effective Research Data PoliciesPreprint
Huff, M., & Bongartz, E. C. (2022) · doi:10.31234/osf.io/9yhcz · Cited by 1
Open Science in the Field of Emotional and Behavioral DisordersPreprint
Cook, B. G., Lloyd, J. W., & Therrien, W. J. (2019) · EdArXiv (OSF Preprints) · doi:10.35542/osf.io/duvf8 · Cited by 1
“Given the frequency of questionable research practices and publication bias (e.g., John et al., 2012), as well as the general scarcity of replication studies (Makel & Plucker, 2014), the low rate of reproducing positive findings (e.g., Open Science Collaborative, 2015) is not surprising.”
Background
Proposal to NSF 19-565 to Create a STEM Education Research HubPreprint
Nosek, B. A., Ofiesh, L., Grasty, F. L., Pfeiffer, N., Mellor, D. T., Brooks, R. E., Benjamin, M., Booth, A., Bowman, S. D., Davis, J. C., et al. (2019) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/4mpuc · Cited by 2
Self-citation
Reproducible research practices and transparency across linguisticsPreprint
Bochyńska, A., Keeble, L., Halfacre, C. A. E., Casillas, J. V., Champagne, I.-A., Chen, K., Röthlisberger, M., Buchanan, E. M., & Roettger, T. B. (2023) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/rcews · Cited by 2
Navigating Collective Activity Systems: An Approach Towards Rhetorical Inquiry
Royce, K. J. (2015) · Digital Commons - University of South Florida (University of South Florida)
Privileging language as social semiotic in higher education
Bishop, J. (2015) · Linguistics and Education · doi:10.1016/j.linged.2015.01.004
Incomplete Reporting: Addressing the Prevalence of Outcome-Reporting Bias in Educational Research.
Trainor, B. C., Polanin, J. R., Williams, R. T., & Pigott, T. (2015) · Society for Research on Educational Effectiveness
Being division chairs : a hermeneutic phenomenological investigation into the experiences of academic middle managers in a Canadian college
Denholm, J. E. (2015) · cIRcle (University of British Columbia) · doi:10.14288/1.0166157
PROGRAMA DE PÓS-GRADUAÇÃO EM CIÊNCIAS DA MOTRICIDADE (DOUTORADO EM PEDAGOGIA DA MOTRICIDADE HUMANA) O PROCESSO DE ELABORAÇÃO DE SABERES POR PROFESSORES- PESQUISADORES DE EDUCAÇÃO FÍSICA EM UMA COMUNIDADE COLABORATIVA
Neto, L. S. (2014)
Functional Assessment-based Interventions: Results of a Professional Learning Series to Build Educators’ Knowledge, Confidence, and Perceived Use
Johl, L. E. (2016) · KU ScholarWorks (The University of Kansas)
Panel Session—Scaling Up Learning Analytics Research Innovations: Challenges and Approaches
Whitmer, J., Kennedy, G. E., Ben-Naim, D., & Pardo, A. (2018) · IEEE International Conference on Teaching, Assessment, and Learning for Engineering · doi:10.1109/tale.2018.8615197
Teacher Self-Efficacy for STEM Talent Development
Margot, K. C. (2017) · doi:10.12794/metadc1011775
“Replication is necessary to establish any type of generalizability (Makel & Plucker, 2014).”
Towards an Idiographic EducationPreprint
Savi, A. O. (2019) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/7gqhz
Using Systematic Prompt Fading to Program a Self-Questioning Strategy with Elementary Students with Disabilities
Turner, L. M. (2019) · doi:10.31390/gradschool_dissertations.4967
“There have been a limited number of replication studies in the social sciences and education (Lemon et al., 2016; Makel & Plucker, 2014).”
Background
Replicable services for reproducible research: a model for academic libraries
Sayre, F., & Riegelman, A. (2020) · Bibliosphere · doi:10.20913/1815-3186-2019-4-33-45
Conclusions and Final Reflections
Higgins, S. (2018) · Cambridge University Press eBooks · doi:10.1017/9781139519618.008
Meta-synthesis in Education
Higgins, S. (2018) · Cambridge University Press eBooks · doi:10.1017/9781139519618.003
The impact of procedural and distributive justice on satisfaction and manufacturing performance: a replication of Lindquist (1995) with a focus on the importance of common metrics in experimental design
Lindquist, T. M., & Rausch, A. (2021) · Journal of Management Control · doi:10.1007/s00187-021-00318-3 · Cited by 2
A study of the elementary math program utilized by a mid-Missouri school district
Barabas, L. J. (2020) · doi:10.32469/10355/78149
Why Meta-analysis?
Higgins, S. (2018) · Cambridge University Press eBooks · doi:10.1017/9781139519618.001
Meta-analysis and Pedagogy
Higgins, S. (2018) · Cambridge University Press eBooks · doi:10.1017/9781139519618.005
Medyalararası Gündem Belirleme Çalışmalarında R Stüdyo Kullanımı: Rozelle-Campbell Taban Hizası ile Çapraz Gecikmeli Korelasyonun Bilişimleştirilmesi
ALİKILIÇ, İ., & ALİKILIÇ, Ö. (2020) · Türkiye İletişim Araştırmaları Dergisi · doi:10.17829/turcom.598078 · Cited by 1
Replication crisisPreprint
Quang-Loc, N. (2022) · doi:10.31219/osf.io/4wd5x
Collaborating to Bring the Credibility Revolution to Giftedness and Talent Development ResearchPreprint
Makel, M. C., Smith, K. N., Miller, E. M., Peters, S. J., & McBee, M. T. (2019) · EdArXiv (OSF Preprints) · doi:10.35542/osf.io/ac3h6 · Cited by 1
Self-citation
Limitations and Possibilities
Keefer, J. K. (2001) · BRILL eBooks · doi:10.1163/9789004490710_004
References
(2016) · Elsevier eBooks · doi:10.1016/b978-0-12-799962-3.00008-2
Some of Frontiers Education Articles: Around First to Eleven December 2020Preprint
Sarbunan, T. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3756716
Of intersectionality, replicability, and holistic perspectives
Mack, S. (2019) · Issues in Hispanic and Lusophone linguistics · doi:10.1075/ihll.21.12mac
Perspectives on education research
Bangs, J., Henry, M., Nagy, E. K., Prøitz, T. S., Schneider, M., Tseng, V., Damme, D. V., & Yurita, M. (2022) · Educational research and innovation · doi:10.1787/e83abf22-en · Cited by 1
Facilitating research use: Scary Barriers (and Super Mechanisms)
Torres, J. M. (2022) · Educational research and innovation · doi:10.1787/cd4e8487-en · Cited by 1
Individuals’ extrinsic and intrinsic incentives to produce education research
(2022) · Educational research and innovation · doi:10.1787/a195b515-en
Levels of individuals’ activity reported by systems in research production.
(2022) · Educational research and innovation · doi:10.1787/dc8ed027-en
Presence of mechanisms facilitating the use of educational research, 2021
(2022) · Educational research and innovation · doi:10.1787/901c32b1-en
Size and strength of ministries’ networks
(2022) · Educational research and innovation · doi:10.1787/267b1dd7-en
Executive summary
OECD (2022) · Educational research and innovation · doi:10.1787/e5bf3102-en
Overview of policy makers’ learning opportunities
(2022) · Educational research and innovation · doi:10.1787/911001f0-en
Relevance of ministry connections to organisations active in facilitating research use in policy
(2022) · Educational research and innovation · doi:10.1787/04374594-en
Correspondence Measures for Assessing Replication SuccessPreprint
Steiner, P. M., Sheehan, P., & Wong, V. C. (2022) · doi:10.31234/osf.io/6vy75
Interpreting a ‘Forest Plot’
Higgins, S. (2018) · Cambridge University Press eBooks · doi:10.1017/9781139519618.011
Unpicking the Evidence about Parental Involvement and Engagement
Higgins, S. (2018) · Cambridge University Press eBooks · doi:10.1017/9781139519618.007
Types of Effect Size
Higgins, S. (2018) · Cambridge University Press eBooks · doi:10.1017/9781139519618.010
Meta-analysis and Literacy
Higgins, S. (2018) · Cambridge University Press eBooks · doi:10.1017/9781139519618.006
Glossary
Higgins, S. (2018) · Cambridge University Press eBooks · doi:10.1017/9781139519618.012
Index
Higgins, S. (2018) · Cambridge University Press eBooks · doi:10.1017/9781139519618.013
Details of the Meta-analyses Included
Higgins, S. (2018) · Cambridge University Press eBooks · doi:10.1017/9781139519618.009
Opening knowledge through education and science
OECD (2022) · OECD education spotlights · doi:10.1787/024062b6-en
Weekly Versus Intermittent Progress Monitoring in Mathematics: A Conceptual Replication and Pilot Study
Mason, E. N., & Lembke, E. S. (2022) · Assessment for Effective Intervention · doi:10.1177/15345084221133730
“In replications that have author overlap, it is more likely for findings from the original study to be replicated (i.e., confirmed; Makel & Plucker, 2014).”
Background
Can direct replications save psychology from its conceptual and measurement issues?
Hobma, M. (2022) · doi:10.36850/zm46-2c07
Toward More Rapid Accumulation of Knowledge about What Works in Physics Education: The Role of Replication, Reporting Practices, and Meta-Analysis
Taylor, J. A., & Hedges, L. V. (2023) · doi:10.1063/9780735425514_023
visualizemi: Visualization, Effect Size, and Replication of Measurement Invariance for Registered ReportsPreprint
Buchanan, E. M. (2023) · doi:10.31219/osf.io/9hzfe
Irreplicability in methodology: embracing the historical contingencies of educational technology research during the 2020–2021 United States school year
Lachney, M., & Kuyenga, M. C. A. (2023) · History and Technology · doi:10.1080/07341512.2023.2251212
The Natural Number Bias Hampers Secondary School Students in Different Ways: A Conceptual Replication of Van Hoof et al. (2013)
Hernández, J. H., Xolocotzin, U., & Aguilar, M. S. (2023) · Implementation and Replication Studies in Mathematics Education · doi:10.1163/26670127-bja10016 · Cited by 1
Educational Research
MacKay, J. R. D., & Wu, S. C. (2023) · Wiley eBooks · doi:10.1002/9781119852865.ch17 · Cited by 3
A Pathway to Initiate Engineering Education Research: A First-Year Reflection on Faculty Development
Giancaspro, J. W., Arboleda, D., Heller, A. S., & Ghahremaninezhad, A. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--42456
Investigación educativa: agenda abierta por la construcción de un impacto real en educación
Balbi, A. (2024) · Páginas de Educación · doi:10.22235/pe.v17i1.3924
Comparison of mental disorders between stroke patients and healthy people in Karaj
Imeni, M., Kamkari, K., Taherkhani, K., & Kiomarsi, F. (2024) · Romanian Journal of Medical Practice · doi:10.37897/rjmp.2024.1.6
Trendlines in Research Methodology and Topics in Teacher Education: Big data analysis of theses in Swedish teacher education between 2005–2023Preprint
Skau, S., Börjesson, M., Nyman, R., & Thompson, W. H. (2024) · doi:10.35542/osf.io/g3xcd
Study of Scenario, and Economic Technical Feasibility of Thermal Power Using Statistical ModelingPreprint
Piropo, E. D. S., Ferreira, A. M. S., & Filho, A. P. G. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4870207
Likvärdighet i idrott och hälsa?
Jansson, A. (2024) · doi:10.24834/isbn.9789178774340
Visualizemi: Visualization, Effect Size, and Replication of Measurement Invariance for Registered Reports
Buchanan, E. M. (2024) · Assessment · doi:10.1177/10731911241280763
“Furthermore, the current focus on replication (Makel et al., 2012; Makel & Plucker, 2014; Zwaan et al., 2018), reproducibility (Nelson et al., 2018), and the credibility of our results (Vazire et al., 2022) has demonstrated questionable measurement practices—decisions that researchers make like…”
Conditions Under Which College Students Can be Responsive to Text-based NudgingPreprint
Page, L. C., Meyer, K. E., Lee, J. J., & Gehlbach, H. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5069370
Replication using confirmatory latent class analysis: A school climate example
Romero, L. S., O’Malley, M. D., & Carter, D. B. (2025) · Journal of School Psychology · doi:10.1016/j.jsp.2025.101455 · Cited by 2
Trends of replication studies in Applied Linguistics journals: A systematic review over half a century
Marefat, F., Farahanynia, M., Hamidi, F., Najjarpour, M., Banitalebi, Z., & Alamdar, P. (2025) · Canadian Journal of Applied Linguistics · doi:10.37213/cjal.2024.33477
Research replication can determine how well science is working – but how do scientists replicate studies?
Montoya, A. K. (2025) · doi:10.64628/aai.n6jvhj6nn
Replicating a Middle-School Belonging Intervention: Evidence from a Randomized Trial Within a New School District
Borman, G. D., Borman, T., Park, S. J., & Zhu, B. (2025) · AERA Open · doi:10.1177/23328584251364785 · Cited by 1
A Quasi-Experimental Study of the Achievement Impacts of a Replicable Summer Reading Program
Borman, G. D., & Yang, H. (2025) · Education Sciences · doi:10.3390/educsci15111422 · Cited by 1
Bridging Theory and Simulation: Using ChatGPT for Computational Thinking Scale Replication Study
Cai, Y., Goh, T., Zou, W., Liu, M., & Yang, B. X. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2578402
“Makel and Plucker (2014) analyzed articles in the top 100 education journals and found that only 0.13% were replications study.”
Influential
The reproducibility racket: How industry sloppiness saddled science with bureaucracy when pharma’s corner-cutting became gospel and NIH’s gullibility became policy
Yarmush, M. L. (2025) · Innovation and Emerging Technologies · doi:10.1142/s2737599425300107
The Persistent Honors Student: Intent to Return to College After the First Year
Miller, A. L., & Cognard-Black, A. J. (2025) · Journal of Advanced Academics · doi:10.1177/1932202x251400553
“Honors programs are well positioned to make positive contributions to several important outcomes, including retention and subsequent degree completion, and it is important to demonstrate and replicate these relationships empirically (Cosgrove, 2004; Makel & Plucker, 2014).”
Overall Peer Justice Predicts Inclusion in Student Teams in Biomedical Engineering
Martin, C. C., & Newstetter, W. (2025) · Biomedical Engineering Education · doi:10.1007/s43683-025-00202-9
“Replications are rare in education journals with one estimate showing that only 0.13% of education articles are replications [62].”
Influential
Student Manual Replication Assignment EdPsy 2018-2019.pdf
de Jonge, M. (2019) · Figshare · doi:10.23644/uu.7649072
Should Millions of Students Take a Gap Year? Large Numbers of Students Start the School Year Above Grade LevelPreprint
Rambo-Hernandez, K. E., Makel, M. C., Peters, S. J., Matthews, M. S., & Plucker, J. A. (2017) · OSF Preprints (OSF Preprints)
Self-citation
Enhancing Academic Publication Performance at Higher Education
Laksana, E. P., Masruroh, B., Hariyono, H., Wibawa, A. P., Harianti, L. R., Herdianto, R., Anggoro, B. K., Ningrum, V. S., Anugrah, P., & Oraby, G. A. E. M. (2025) · Jurnal Pembelajaran Bimbingan dan Pengelolaan Pendidikan · doi:10.17977/um065.v6.i2.2026.1
Türkiye'de Eğitimde Ölçme ve Değerlendirme Alanındaki Lisansüstü Tezlerin Eğilimleri (2006-2025): Bir Meta-Sentez Çalışması
Sungur, S., Can, G., Dumlupınar, N., & ÖZDEMİR, A. (2026) · SDU International Journal of Educational Studies · doi:10.33710/sduijes.1771895
Reducing Suicidality Among Black Boys Using Cultural and Environmentally Based Mental Health Counseling Interventions
Bolden, M. A., Williams, O., Humphrey, M., & Dixon, E. C. (2026) · Emerald Group Publishing Limited eBooks · doi:10.1108/s2051-231720260000010011
Optimisation de l’apprentissage par récupération en mémoire pour promouvoir la rétention à long terme de nouvelles connaissances
Latimier, A. (2019) · theses.fr (ABES) · doi:10.70675/d005cf32z3feez45d4z8dd6z5047380d3ff1
The Future of Global Vocational Teacher Education With Technology-Enhanced Learning
Tugwell, O. O. (2026) · IGI Global eBooks · doi:10.4018/979-8-3373-5865-9.ch011
A Replication Study of Non‐Incentivized Scenario‐Based Experiments
Jackson, I., Brooks, L., Eckerd, S., & Carter, C. R. (2026) · Journal of Business Logistics · doi:10.1111/jbl.70067
Better for self or better than others, the secret of relative position in behavior
Celse, J., & Chang, K. (2026) · Review of Behavioral Economics · doi:10.1108/rbe-12-2025-0126

Authors: Makel, M. C., & Plucker, J. A.
Affiliations: Duke University (US)
University of Connecticut (US)
ORCID: Makel, Matthew C.
Plucker, Jonathan A.
Venue: Educational Researcher
Publisher: American Educational Research Association (AERA)
Published: 2014-08
Volume: 43
Issue: 6
Pages: 304-316
ISSN: 0013-189X (ISSN-L)
1935-102X
DOI: 10.3102/0013189x14545513
OpenAlex: W2139319950
Semantic Scholar: 493a2e93117a876871ac446b26acf47c50ea2cef
Cited by: 609
References: 131
Citations by year: 2026: 17 · 2025: 37 · 2024: 40 · 2023: 40 · 2022: 66 · 2021: 47 · 2020: 59 · 2019: 81 · 2018: 73 · 2017: 52 · 2016: 51 · 2015: 37 · 2014: 8
FWCI: 68.61
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Educational Researcher (publishedVersion)
Topics: Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Education › Educational Research and Methods
Keywords: replication, direct replication, educational research, publishing history, research credibility, methodological quality, replication success, educational periodicals

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Facts Are More Important Than Novelty: Replication in the Education Sciences

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks