The DOI matches its Crossref record; 78 of the 78 references it cites were found in a registry or an index.
Systematic Literature Reviews in Engineering Education and Other Developing Interdisciplinary Fields
Abstract
Background: In fields such as medicine, psychology, and education, systematic reviews of the literature critically appraise and summarize research to inform policy and practice. We argue that now is an appropriate time in the development of the field of engineering education to both support systematic reviews and benefit from them. More reviews of prior work conducted more systematically would help advance the field by lowering the barrier for both researchers and practitioners to access the literature, enabling more objective critique of past efforts, identifying gaps, and proposing new directions for research. Purpose: The purpose of this article is to introduce the methodology of systematic reviews to the field of engineering education and to adapt existing resources on systematic reviews to engineering education and other developing interdisciplinary fields. Scope/Method: This article is primarily a narrative review of the literature on conducting systematic reviews. Methods are adapted to engineering education and similar developing interdisciplinary fields. To offer concrete, pertinent examples, we also conducted a systematic review of systematic review articles published on engineering education topics since 1990. Fourteen exemplars are presented in this article and used to illustrate systematic review procedures. Conclusions: Systematic reviews can benefit the field of engineering education by synthesizing prior work, by better informing practice, and by identifying important new directions for research. Engineering education researchers should consider including systematic reviews in their repertoire of methodologies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601
Graneheim, U. H., & Lundman, B. (2004) · Nurse Education Today · doi:10.1016/j.nedt.2003.10.001 · Cited by 20,772
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582
Tranfield, D., Denyer, D., & Smart, P. (2003) · British Journal of Management · doi:10.1111/1467-8551.00375 · Cited by 15,386
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312
Practical Research: Planning and Design
Brent, E., & Leedy, P. D. (1990) · Teaching Sociology · doi:10.2307/1318509 · Cited by 9,309
Does Active Learning Work? A Review of the Research
Prince, M. (2004) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2004.tb00809.x · Cited by 7,334 · cited 1×
“Many reviews in engineering education to date have been intended for this purpose (e.g., Froyd & Ohland, 2005; Litzinger, Lattuca, Hadgraft, & Newstetter, 2011; Prince, 2004; Prince & Felder, 2006; Streveler, Litzinger, Miller, & Steif, 2008).”
BackgroundEducational Research: An Introduction
Dale, R. R., & Borg, W. R. (1965) · British Journal of Educational Studies · doi:10.2307/3119062 · Cited by 7,198
Systematic Reviews in the Social Sciences: A Practical Guide
Petticrew, M., & Roberts, H. (2006) · doi:10.1002/9780470754887 · Cited by 3,586
Cited by
Literature reviews as independent studies: guidelines for academic practice
Kraus, S., Breier, M., Lim, W. M., Dabić, M., Kumar, S., Kanbach, D., Mukherjee, D., Corvello, V., Piñeiro-Chousa, J., Liguori, E., et al. (2022) · Review of Managerial Science · doi:10.1007/s11846-022-00588-8 · Cited by 1,037
Sample Selection in Systematic Literature Reviews of Management Research
Hiebl, M. R. W. (2023) · Organizational Research Methods · doi:10.1177/1094428120986851 · Cited by 635
A systematic review of research on the flipped learning method in engineering education
Karabulut‐Ilgu, A., Jaramillo Cherrez, N., & Jahren, C. T. (2018) · British Journal of Educational Technology · doi:10.1111/bjet.12548 · Cited by 581
A Systematic Review of Studies on Educational Robotics
Anwar, S., Bascou, N. A., Menekse, M., & Kardgar, A. (2019) · Journal of Pre-College Engineering Education Research (J-PEER) · doi:10.7771/2157-9288.1223 · Cited by 419
Forms of implementation and challenges of PBL in engineering education: a review of literature
Chen, J., Kolmos, A., & Du, X. (2021) · European Journal of Engineering Education · doi:10.1080/03043797.2020.1718615 · Cited by 408
Interdisciplinary engineering education: A review of vision, teaching, and support
Van den Beemt, A., MacLeod, M., Van der Veen, J., Van de Ven, A., van Baalen, S., Klaassen, R., & Boon, M. (2020) · Journal of Engineering Education · doi:10.1002/jee.20347 · Cited by 391
Hartikainen, S., Rintala, H., Pylväs, L., & Nokelainen, P. (2019) · Education Sciences · doi:10.3390/educsci9040276 · Cited by 299
Lavado-Anguera, S., Velasco-Quintana, P.-J., & Terrón-López, M.-J. (2024) · Education Sciences · doi:10.3390/educsci14060617 · Cited by 152
A Literature Review of Critical Thinking in Engineering Education
Ahern, A., Dominguez, C., McNally, C., O’Sullivan, J. J., & Pedrosa, D. (2019) · Studies in Higher Education · doi:10.1080/03075079.2019.1586325 · Cited by 127
Borrego, M., Foster, M. J., & Froyd, J. E. (2015) · Journal of Engineering Education · doi:10.1002/jee.20069 · Cited by 124
Self-citationCharacteristics of systematic reviews in the social sciences
Chapman, K. (2021) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2021.102396 · Cited by 93
Funds of Knowledge in STEM Education: A Scoping Review
Denton, M., & Borrego, M. (2021) · Studies in Engineering Education · doi:10.21061/see.19 · Cited by 72
Self-citationLiterature Reviews in HCI: A Review of Reviews
Stefanidi, E., Bentvelzen, M., Woźniak, P. W., Kosch, T., Woźniak, M. P., Mildner, T., Schneegass, S., Müller, H., & Niess, J. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581332 · Cited by 66
Campbell, A. L., & Mogashana, D. (2025) · Innovations in Education and Teaching International · doi:10.1080/14703297.2024.2417173 · Cited by 25
Methodische Ansätze zu Evidenzsynthesen in der Bildungstechnologie: Eine tertiäre Übersichtsarbeit
Buntins, K., Bedenlier, S., Marín, V., Händel, M., & Bond, M. (2023) · MedienPädagogik: Zeitschrift für Theorie und Praxis der Medienbildung · doi:10.21240/mpaed/54/2023.12.20.x · Cited by 13
When Critical Ethnography Leaves the Field and Enters the Engineering Classroom: A Scoping Review
Masta, S., & Secules, S. (2021) · Studies in Engineering Education · doi:10.21061/see.26 · Cited by 8
Computing Education Research Today
Fincher, S. A., Tenenberg, J., Dorn, B., Hundhausen, C., McCartney, R., & Murphy, L. (2019) · The Cambridge Handbook of Computing Education Research · doi:10.1017/9781108654555.003 · Cited by 7
Ghahremani, M., Pereira, N., Ozen, Z., & Gentry, M. (2024) · Roeper Review · doi:10.1080/02783193.2024.2357538 · Cited by 2
Metadata
- Authors
- Borrego, M., Foster, M. J., & Froyd, J. E.
- Venue
- Journal of Engineering Education
- Publisher
- Wiley
- Published
- 2014-01
- Volume
- 103
- Issue
- 1
- Pages
- 45-76
- ISSN
- 1069-4730 (ISSN-L)
- 2168-9830
- OpenAlex
- W1600464274
- Cited by
- 620
- References
- 78
- FWCI
- 4.87
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.