A Guide to Conducting a Standalone Systematic Literature Review
Open accessAbstract
Many scholars are not well trained in conducting a standalone literature review, a scholarly paper that in its entirety summarizes and synthesizes knowledge from a prior body of research. Numerous guides that exist for information systems (IS) research mainly concentrate on only certain parts of the process; few span the entire process. This paper introduces the rigorous, standardized methodology for the systematic literature review (also called systematic review) to IS scholars. This comprehensive guide extends the base methodology from the health sciences and other fields with numerous adaptations to meet the needs of methodologically diverse fields such as IS research, especially those that involve including and synthesizing both quantitative and qualitative studies. Moreover, this guide provides many examples from IS research and provides references to guides with further helpful details for conducting a rigorous and valuable literature review. Although tailored to IS research, it is sufficiently broad to be applicable and valuable to scholars from any social science field.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The guidelines published by Okoli for conducting a systematic literature review for Information Systems Research were adapted for this review.
“For this review, the guidelines published by Okoli to conducting a systematic literature review for Information Systems Research were adapted (Okoli, 2015).”
From A systematic literature review of personalized learning terms (2020) · cites this paper as Okoli, 2015
The systematic literature review followed a structured eight-step guideline developed by Okoli (2015).
“The foundation of our guide was taken from the guideline developed by Okoli (2015).”
From Artificial intelligence in information systems research: A systematic literature review and research agenda (2021) · cites this paper as Okoli (2015)
Okoli (2015) proposes a systematic review process consisting of 8 steps across 4 phases.
“Okoli (2015) propose a systematic review process that consists of 8 steps, namely planning (2 steps), selection (2 steps), extraction (2 steps) and execution (2 steps) that are completed across 4 phases (see Fig. 1.).”
From Artificial intelligence in information systems research: A systematic literature review and research agenda (2021) · cites this paper as Okoli (2015)
Following Okoli's eight-step guideline is attributed to mitigating threats to validity in this systematic study.
“As this systematic study followed the eight-step guideline laid out by (Okoli, 2015), it is attributed to mitigating the threats to validity.”
From Artificial intelligence in information systems research: A systematic literature review and research agenda (2021) · cites this paper as Okoli, 2015
The review followed PRISMA 2020 guidelines and Okoli's steps for conducting a rigorous and transparent systematic review.
“To conduct this study, the authors followed the essential steps of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA 2020) and Okoli’s [54] steps for conducting a systematic review.”
From A systematic literature review of empirical research on ChatGPT in education (2024) · cites this paper as [54]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225 · see citing works
Alavi, M., & Leidner, D. E. (2001) · MIS Quarterly · doi:10.2307/3250961 · Cited by 10,176 · see citing works
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799 · see citing works
Analyzing the Past to Prepare for the Future: Writing a Literature Review
Webster, J., & Watson, R. T. (2002) · MIS Quarterly · doi:10.2307/4132319 · Cited by 7,449 · see citing works
A Set of Principles for Conducting and Evaluating Interpretive Field Studies in Information Systems1
Klein, H. K., & Myers, M. D. (1999) · MIS Quarterly · doi:10.2307/249410 · Cited by 5,263 · see citing works
Meta-Analytic Procedures for Social Research
Rosenthal, R. (1991) · doi:10.4135/9781412984997 · Cited by 4,635 · see citing works
Systematic Literature Reviews in Software Engineering—A Systematic Literature Review
Kitchenham, B., Pearl Brereton, O., Budgen, D., Turner, M., Bailey, J., & Linkman, S. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2008.09.009 · Cited by 4,537 · see citing works
Meta-Analytic Procedures for Social Research.
Metcalfe, A., & Rosenthal, R. (1994) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348600 · Cited by 4,249 · see citing works
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,074 · see citing works
Melville, N. P., Kraemer, K., & Gurbaxani, V. (2004) · MIS Q. · doi:10.2307/25148636 · Cited by 3,896 · see citing works
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · see citing works
Wade, M., & Hulland, J. (2004) · MIS Quarterly · doi:10.2307/25148626 · Cited by 2,822 · see citing works
Checklists for improving rigour in qualitative research: a case of the tail wagging the dog?
Barbour, R. S. (2001) · BMJ · doi:10.1136/bmj.322.7294.1115 · Cited by 2,613 · see citing works
Brereton, P., Kitchenham, B. A., Budgen, D., Turner, M., & Khalil, M. (2007) · Journal of Systems and Software · doi:10.1016/j.jss.2006.07.009 · Cited by 2,394 · see citing works
Organizational Theories: Some Criteria for Evaluation
Bacharach, S. B. (1989) · The Academy of Management Review · doi:10.5465/amr.1989.4308374 · Cited by 2,305 · see citing works
Investigating and dealing with publication and other biases in meta-analysis
Sterne, J. A. C., Egger, M., & Smith, G. D. (2001) · BMJ · doi:10.1136/bmj.323.7304.101 · Cited by 2,225 · see citing works
A Guide to Conducting a Systematic Literature Review of Information Systems Research
Okoli, C., & Schabram, K. (2011) · doi:10.2139/ssrn.1954824 · Cited by 1,849 · see citing works
Self-citationConducting research literature reviews: from the Internet to paper
(2005) · Choice Reviews Online · doi:10.5860/choice.42-6198 · Cited by 1,846 · see citing works
Meta-Analysis: Recent Developments in Quantitative Methods for Literature Reviews
Rosenthal, R., & DiMatteo, M. R. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.59 · Cited by 1,780 · see citing works
Leidner, D. E., & Kayworth, T. R. (2006) · MIS Quarterly · doi:10.2307/25148735 · Cited by 1,614 · see citing works
Levy, Y. M., & Ellis, T. J. (2006) · Informing Science The International Journal of an Emerging Transdiscipline · doi:10.28945/479 · Cited by 1,581 · see citing works
Employee Turnover: A Meta-Analysis and Review with Implications for Research
Cotton, J. L., & Tuttle, J. M. (1986) · Academy of Management Review · doi:10.5465/amr.1986.4282625 · Cited by 1,493 · see citing works
Erduran, S., Simon, S., & Osborne, J. (2004) · Science Education · doi:10.1002/sce.20012 · Cited by 1,408 · see citing works
Reconstructing the Giant: On the Importance of Rigour in Documenting the Literature Search Process
Brocke, J. V., Simons, A., Niehaves, B., Reimer, K., Plattfaut, R., & Cleven, A. (2009) · Alexandria (UniSG) (University of St.Gallen) · Cited by 1,383 · see citing works
Doing a literature review: releasing the social science research imagination.
Hart, C. (1998) · Sage eBooks · Cited by 1,378 · see citing works
Boote, D. N., & Beile, P. (2005) · Educational Researcher · doi:10.3102/0013189x034006003 · Cited by 1,217 · see citing works
Using grounded theory as a method for rigorously reviewing literature
Wolfswinkel, J. F., Furtmueller, E., & Wilderom, C. P. M. (2011) · European Journal of Information Systems · doi:10.1057/ejis.2011.51 · Cited by 1,158 · see citing works
Writing meta-analytic reviews.
Rosenthal, R. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.118.2.183 · Cited by 1,108 · see citing works
Dubé, L., & Paré, G. (2016) · SAGE Publications Ltd eBooks · doi:10.4135/9781473915480.n65 · Cited by 1,076 · see citing works
Rousseau, D. M., Manning, J., & Denyer, D. (2008) · Academy of Management Annals · doi:10.5465/19416520802211651 · Cited by 1,031 · see citing works
Rousseau, D. M., Manning, J., & Denyer, D. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1309606 · Cited by 997 · see citing works
Dubé, L., & Paré, G. (2003) · MIS Quarterly · doi:10.2307/30036550 · Cited by 976 · see citing works
Marakas, G. M., Yi, M. Y., & Johnson, R. D. (1998) · Information Systems Research · doi:10.1287/isre.9.2.126 · Cited by 896 · see citing works
Dead Or Alive? The Development, Trajectory And Future Of Technology Adoption Research.
University of Arkansas, Venkatesh, V., Davis, F., University of Arkansas, Morris, M., & University of Virginia (2007) · Journal of the Association for Information Systems · doi:10.17705/1jais.00120 · Cited by 789 · see citing works
Piccoli, G., & Ives, B. (2005) · MIS Quarterly · doi:10.2307/25148708 · Cited by 665 · see citing works
Brocke, J. V., Simons, A., Riemer, K., Niehaves, B., Plattfaut, R., & Cleven, A. (2015) · Communications of the Association for Information Systems · doi:10.17705/1cais.03709 · Cited by 626 · see citing works
A Meta-Analysis of the Relationships Between Individual Job Satisfaction and Individual Performance
Petty, M. M., McGee, G. W., & Cavender, J. W. (1984) · Academy of Management Review · doi:10.5465/amr.1984.4277608 · Cited by 595 · see citing works
Employee Turnover: A Meta-Analysis and Review with Implications for Research
Cotton, J. L., & Tuttle, J. M. (1986) · Academy of Management Review · doi:10.2307/258331 · Cited by 590 · see citing works
A Review of MIS Research and Disciplinary Development
Alavi, M., & Carlson, P. A. (1992) · Journal of Management Information Systems · doi:10.1080/07421222.1992.11517938 · Cited by 559 · see citing works
Review: A Cognitive-Affective Model of Organizational Communication for Designing IT1,2
Te’eni, D. (2001) · MIS Quarterly · doi:10.2307/3250931 · Cited by 515 · see citing works
Joseph, D., Ng, K.-Y., Koh, C., & Ang, S. (2007) · MIS Quarterly · doi:10.2307/25148807 · Cited by 468 · see citing works
Review : Power and Information Technology Research: A Metatriangulation Review1, 2
Jasperson, J., Carte, T. A., Saunders, C., Butler, B. S., Croes, H. J. P., & Zheng, W. (2002) · MIS Quarterly · doi:10.2307/4132315 · Cited by 407 · see citing works
Alavi, M., & Joachimsthaler, E. A. (1992) · MIS Quarterly · doi:10.2307/249703 · Cited by 362 · see citing works
Synthesizing qualitative and quantitative health evidence: a guide to methods
Pope, C. J., Mays, N., & Popay, J. (2007) · Cited by 340 · see citing works
Impression Management in the Feedback-Seeking Process: A Literaturereview and Research Agenda
Morrison, E. W., & Bies, R. J. (1991) · Academy of Management Review · doi:10.5465/amr.1991.4279472 · Cited by 335 · see citing works
Automatically refining the wikipedia infobox ontology
Wu, F. Q., & Weld, D. S. (2008) · International World Wide Web Conference (WWW) · doi:10.1145/1367497.1367583 · Cited by 305 · see citing works
Self‐citation and self‐reference: Credibility and promotion in academic publication
Hyland, K. (2003) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.10204 · Cited by 303 · see citing works
Achieving Rigor in Literature Reviews: Insights from Qualitative Data Analysis and Tool-Support
Bandara, W., Furtmueller, E., Gorbacheva, E., Miskon, S., & Beekhuyzen, J. (2015) · Communications of the Association for Information Systems · doi:10.17705/1cais.03708 · Cited by 300 · see citing works
The literature review: a step-by-step guide for students
Graham, V. F. (2011) · Evaluation & Research in Education · doi:10.1080/09500790.2011.583140 · Cited by 291 · see citing works
Theory Construction and Model-Building Skills: A Practical Guide for Social Scientists
Jaccard, J. J., & Jacoby, J. (2009) · Cited by 261 · see citing works
Robey, D., Im, G. P., Wareham, J. D., & ESADE (2008) · Journal of the Association for Information Systems · doi:10.17705/1jais.00171 · Cited by 259 · see citing works
Scientific Collaboration Results in Higher Citation Rates of Published Articles
Figg, W. D., Dunn, L. A., Liewehr, D. J., Steinberg, S. M., Thurman, P. W., Barrett, J. C., & Birkinshaw, J. (2006) · Pharmacotherapy The Journal of Human Pharmacology and Drug Therapy · doi:10.1592/phco.26.6.759 · Cited by 242 · see citing works
Writing a review article for Psychological Bulletin.
Bem, D. J. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.118.2.172 · Cited by 214 · see citing works
Quantitative methods for literature reviews
Green, B. F., & Hall, J. A. (1984) · Annual Review of Psychology · doi:10.1146/annurev.ps.35.020184.000345 · Cited by 213 · see citing works
The Literature Review : A Step-by-Step Guide for Students
Ridley, D. (2012) · Cited by 209 · see citing works
A Meta-Analysis of the Relationships between Individual Job Satisfaction and Individual Performance
Petty, M. M., McGee, G. W., & Cavender, J. W. (1984) · Academy of Management Review · doi:10.2307/258493 · Cited by 209 · see citing works
A Theoretical Perspective of Negotiation Support Systems
Lim, L. H., & Benbasat, I. (1992) · Journal of Management Information Systems · doi:10.1080/07421222.1992.11517966 · Cited by 191 · see citing works
Theory Construction and Model-Building Skills: A Practical Guide for Social Scientists
Aducci, C. J., & Johnson, M. D. (2011) · Journal of Family Theory & Review · doi:10.1111/j.1756-2589.2010.00083.x · Cited by 171 · see citing works
Task Design: A Literature Review
Pierce, J. L., & Dunham, R. B. (1976) · Academy of Management Review · doi:10.5465/amr.1976.4396611 · Cited by 166 · see citing works
Human Resources Management in International Joint Ventures: Directions for Research
Shenkar, O., & Zeira, Y. (1987) · Academy of Management Review · doi:10.5465/amr.1987.4306569 · Cited by 163 · see citing works
Beyond synthesis: re-presenting heterogeneous research literature
Sylvester, A., Tate, M., & Johnstone, D. (2011) · Behaviour and Information Technology · doi:10.1080/0144929x.2011.624633 · Cited by 146 · see citing works
Are Articles in “Top” Management Journals Necessarily of Higher Quality?
Singh, G., Haddad, K. M., & Chow, C. W. (2007) · Journal of Management Inquiry · doi:10.1177/1056492607305894 · Cited by 145 · see citing works
Maxwell, J. A. (2006) · Educational Researcher · doi:10.3102/0013189x035009028 · Cited by 131 · see citing works
Melville, N. P., Kraemer, K., & Gurbaxani, V. (2003) · Cited by 127 · see citing works
What Experienced Collaborators Say About Collaborative Writing
Allen, N., Atkinson, D., Morgan, M., Moore, T., & Snow, C. (1987) · Journal of Business and Technical Communication · doi:10.1177/105065198700100206 · Cited by 124 · see citing works
Impression Management in the Feedback-Seeking Process: A Literature Review and Research Agenda
Morrison, E. W., & Bies, R. J. (1991) · Academy of Management Review · doi:10.2307/258916 · Cited by 107 · see citing works
Wade, M., & Hulland, J. S. (2004) · Cited by 90 · see citing works
Perceived Task Characteristics and Employee Performance: A Literature Review,
Griffin, R. W., Welsh, A., & Moorhead, G. (1981) · Academy of Management Review · doi:10.5465/amr.1981.4285726 · Cited by 74 · see citing works
Green, R., & Bowser, M. (2006) · Journal of Library Administration · doi:10.1300/j111v45n01_10 · Cited by 70 · see citing works
Lee, D., Kang, J., Mitra, P., Giles, C. L., & On, B.-W. (2007) · Communications of the ACM · doi:10.1145/1323688.1323690 · Cited by 68 · see citing works
Perceived Task Characteristics and Employee Performance: A Literature Review
Griffin, R. W., Welsh, A., & Moorhead, G. (1981) · Academy of Management Review · doi:10.2307/257645 · Cited by 64 · see citing works
Abstracts, introductions and discussions: How far do they differ in style?
Hartley, J., Pennebaker, J. W., & Fox, C. (2003) · Scientometrics · doi:10.1023/a:1025008802657 · Cited by 63 · see citing works
Finding open access articles using Google, Google Scholar, OAIster and OpenDOAR
Norris, M. W., Oppenheim, C., & Rowland, F. (2008) · Online Information Review · doi:10.1108/14684520810923881 · Cited by 63 · see citing works
Strategies for Disseminating Qualitative Research Findings: Three Exemplars
Keen, S., & Todres, L. (2008) · Forum qualitative Sozialforschung · doi:10.17169/fqs-8.3.285 · Cited by 58 · see citing works
Shift Work: A Review and Theoretical Analysis
Dunham, R. B. (1977) · Academy of Management Review · doi:10.5465/amr.1977.4406742 · Cited by 56 · see citing works
Providing Information Literacy Instruction to Graduate Students through Literature Review Workshops
Rempel, H. G. (2008) · PDXScholar (Portland State University) · doi:10.5062/f44x55rg · Cited by 55 · see citing works
Human Resources Management in International Joint Ventures: Directions for Research
Shenkar, O., & Zeira, Y. (1987) · Academy of Management Review · doi:10.2307/258520 · Cited by 51 · see citing works
A Critical Realist Guide to Developing Theory with Systematic Literature ReviewsPreprint
Okoli, C. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2115818 · Cited by 49 · see citing works
Self-citationWinter, S. J., & Taylor, S. L. (1996) · Information Systems Research · doi:10.1287/isre.7.1.5 · Cited by 47 · see citing works
Leidner, D. E., & Kayworth, T. R. (2006) · Journal of the Association for Information Systems · Cited by 47 · see citing works
Lessons Learnt Undertaking a Large-scale Systematic Literature Review
Turner, M., Kitchenham, B. A., Budgen, D., & Pearl Brereton, A. (2008) · Electronic workshops in computing · doi:10.14236/ewic/ease2008.12 · Cited by 45 · see citing works
Writing a review article for Psychological Bulletin.
Bem, D. J. (1995) · Psychological Bulletin · doi:10.1037//0033-2909.118.2.172 · Cited by 41 · see citing works
Joseph, D., Ng, K.-Y., Koh, C. S. K., & Ang, S. (2007) · Journal of the Association for Information Systems · Cited by 33 · see citing works
The genre(s) of student writing: developing writing models
Hüttner, J. (2008) · International Journal of Applied Linguistics · doi:10.1111/j.1473-4192.2008.00200.x · Cited by 31 · see citing works
Shift Work: A Review and Theoretical Analysis
Dunham, R. B. (1977) · Academy of Management Review · doi:10.2307/257514 · Cited by 29 · see citing works
The Researcher, the Topic, and the Literature: A Procedure for Systematizing Literature Searches
Helmericks, S. G., Nelsen, R. L., & Unnithan, N. P. (1991) · The Journal of Applied Behavioral Science · doi:10.1177/0021886391273004 · Cited by 25 · see citing works
Bragge, J., Relander, S., Sunikka, A., & Mannonen, P. (2007) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2007.209 · Cited by 23 · see citing works
Meaning in philosophy and meaning in information retrieval (IR)
Thornley, C., & Gibb, F. (2009) · Journal of Documentation · doi:10.1108/00220410910926158 · Cited by 22 · see citing works
Dawson, K., & Ferdig, R. E. (2006) · Cited by 17 · see citing works
The Importance of Resubmitting Rejected Papers
Donovan, S. K. (2007) · Journal of Scholarly Publishing · doi:10.3138/w706-5884-kg84-j282 · Cited by 15 · see citing works
The “dos and don'ts” of writing a journal article
Kekäle, T., de Weerd-Nederhof, P. C., Cervai, S., & Borelli, M. (2009) · Journal of Workplace Learning · doi:10.1108/13665620910924925 · Cited by 14 · see citing works
The Discard of Study Evidence by Literature Reviewers
Rodgers, R. C., & Hunter, J. E. (1994) · The Journal of Applied Behavioral Science · doi:10.1177/0021886394303005 · Cited by 14 · see citing works
Quantitative Methods for Literature Reviews
Green, B. (1984) · Annual Review of Psychology · doi:10.1146/annurev.psych.35.1.37 · Cited by 14 · see citing works
The dimensions of cited reference enhanced database subsets
Jacsó, P. (2007) · Online Information Review · doi:10.1108/14684520710832360 · Cited by 11 · see citing works
The Importance of Resubmitting Rejected Papers
Donovan, S. K. (2007) · Journal of Scholarly Publishing · doi:10.1353/scp.2007.0013 · Cited by 5 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Alavi, M., & Leidner, D. E. (2001). Review: Knowledge management and knowledge management systems: Conceptual foundations and research issues. MIS Quarterly, 25(1), 107-136.
- Alias, M., Zurinah, C., Reiska, A. J., Åhlberg, M., & Novak, J. D. (2008). Concept mapping: A tool for creating a literature review. In Proceedings of the 3 rd International Conference on Concept Mapping.
- Anonymous. (1998). "Gray literature" forces new role on librarians (sidebar). Chemical & Engineering News, 76(20), 12.
- Myers, P. M. D. (2008). Qualitative research in business & management (illustrated edition.). Thousand Oaks, CA: Sage.
Cited by
Sorted by citations
The art of crafting a systematic literature review in entrepreneurship research
Kraus, S., Breier, M., & Dasí-Rodríguez, S. (2020) · International Entrepreneurship and Management Journal · doi:10.1007/s11365-020-00635-4 · Cited by 1,319 · see citing works
Collins, C., Dennehy, D., Conboy, K., & Mikalef, P. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2021.102383 · Cited by 783 · see citing works
Hawlitschek, F., Notheisen, B., & Teubner, T. (2018) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2018.03.005 · Cited by 721 · see citing works
Utilising learning analytics to support study success in higher education: a systematic review
Ifenthaler, D., & Yau, J. Y.-K. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-020-09788-z · Cited by 915 · see citing works
The ABC of systematic literature review: the basic methodological guidance for beginners
Mohamed Shaffril, H. A., Samsuddin, S. F., & Abu Samah, A. (2021) · Quality & Quantity · doi:10.1007/s11135-020-01059-6 · Cited by 656 · see citing works
A systematic literature review of personalized learning terms
Shemshack, A., & Spector, J. M. (2020) · Smart Learning Environments · doi:10.1186/s40561-020-00140-9 · Cited by 539 · see citing works
Responsible Artificial Intelligence Governance: A Review and Research Framework
Papagiannidis, E., Mikalef, P., & Conboy, K. (2025) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2024.101885 · Cited by 565 · see citing works
Madan, R., & Ashok, M. (2023) · Government Information Quarterly · doi:10.1016/j.giq.2022.101774 · Cited by 468 · see citing works
A Systematic Literature Review of Student’ Performance Prediction Using Machine Learning Techniques
Albreiki, B., Zaki, N., & Alashwal, H. (2021) · Education Sciences · doi:10.3390/educsci11090552 · Cited by 430 · see citing works
Hofmann, P., Samp, C., & Urbach, N. (2019) · Electronic Markets · doi:10.1007/s12525-019-00365-8 · Cited by 400 · see citing works
Artificial Intelligence in Tactical Human Resource Management: A Systematic Literature Review
Votto, A. M., Valecha, R., Najafirad, P., & Rao, H. R. (2021) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2021.100047 · Cited by 322 · see citing works
The rise of artificial intelligence – understanding the AI identity threat at the workplace
Mirbabaie, M., Brünker, F., Möllmann Frick, N. R. J., & Stieglitz, S. (2022) · Electronic Markets · doi:10.1007/s12525-021-00496-x · Cited by 362 · see citing works
Demystifying blockchain: A critical analysis of challenges, applications and opportunities
Upadhyay, N. (2020) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2020.102120 · Cited by 297 · see citing works
Nicolescu, L., & Tudorache, M. T. (2022) · Electronics · doi:10.3390/electronics11101579 · Cited by 280 · see citing works
Theory of consumption values in consumer behaviour research: A review and future research agenda
Tanrikulu, C. (2021) · International Journal of Consumer Studies · doi:10.1111/ijcs.12687 · Cited by 263 · see citing works
Online Health Information Seeking Behaviors Among Older Adults: Systematic Scoping Review
Zhao, Y. C., Zhao, M., & Song, S. (2022) · Journal of Medical Internet Research · doi:10.2196/34790 · Cited by 267 · see citing works
Artificial Intelligence in Pharmaceutical and Healthcare Research
Bhattamisra, S. K., Banerjee, P., Gupta, P., Mayuren, J., Patra, S., & Candasamy, M. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7010010 · Cited by 283 · see citing works
The Science of Literature Reviews: Searching, Identifying, Selecting, and Synthesising
Chigbu, U. E., Atiku, S. O., & Plessis, C. C. D. (2023) · Publications · doi:10.3390/publications11010002 · Cited by 387 · see citing works
Shaffril, H. A. M., Ahmad, N. B., Samsuddin, S. F., Samah, A. A., & Hamdan, M. E. (2020) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.120595 · Cited by 280 · see citing works
Mirbabaie, M., Stieglitz, S., & Frick, N. (2021) · Health and Technology · doi:10.1007/s12553-021-00555-5 · Cited by 244 · see citing works
Digital transformation and the emergence of the Fintech sector: Systematic literature review
Barroso, M., & Laborda, J. (2022) · Digital Business · doi:10.1016/j.digbus.2022.100028 · Cited by 297 · see citing works
Sustainable Entrepreneurship: A Literature Review
Rosário, A. T., Raimundo, R. J. G., & Cruz, S. P. (2022) · Sustainability · doi:10.3390/su14095556 · Cited by 230 · see citing works
Security Operations Center: A Systematic Study and Open Challenges
Vielberth, M., Böhm, F., Fichtinger, I., & Pernul, G. (2020) · IEEE Access · doi:10.1109/access.2020.3045514 · Cited by 223 · see citing works
Understanding the Relationship between Urban Public Space and Social Cohesion: A Systematic Review
Qi, J., Suvodeep Mazumdar, A., & Vasconcelos, A. C. (2024) · International Journal of Community Well-Being · doi:10.1007/s42413-024-00204-5 · Cited by 278 · see citing works
Mattar, J. (2018) · RIED Revista Iberoamericana de Educación a Distancia · doi:10.5944/ried.21.2.20055 · Cited by 219 · see citing works
Larsen, V. G., Tollin, N., Sattrup, P. A., Birkved, M., & Holmboe, T. (2022) · Journal of Building Engineering · doi:10.1016/j.jobe.2022.104203 · Cited by 201 · see citing works
Electric vehicles’ consumer behaviours: Mapping the field and providing a research agenda
Secinaro, S. F., Calandra, D., Lanzalonga, F., & Ferraris, A. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2022.06.011 · Cited by 198 · see citing works
De Paor, S., & Heravi, B. (2020) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2020.102218 · Cited by 191 · see citing works
Holzmann, P., & Gregori, P. (2022) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2022.102593 · Cited by 187 · see citing works
The implementation of artificial intelligence in organizations: A systematic literature review
Lee, M. C. M., Scheepers, H., Lui, A. K. H., & Ngai, E. W. T. (2023) · Information & Management · doi:10.1016/j.im.2023.103816 · Cited by 225 · see citing works
Consumer behavior in sustainable fashion: A systematic literature review and future research agenda
Busalim, A., Fox, G., & Lynn, T. (2022) · International Journal of Consumer Studies · doi:10.1111/ijcs.12794 · Cited by 197 · see citing works
Kim, M., Zoo, H., Lee, H., & Kang, J. (2018) · Electronic Journal of Information Systems in Developing Countries · doi:10.1002/isd2.12044 · Cited by 164 · see citing works
Paré, G., Tate, M., Johnstone, D., & Kitsiou, S. (2016) · European Journal of Information Systems · doi:10.1057/s41303-016-0020-3 · Cited by 180 · see citing works
A systematic literature review of empirical research on ChatGPT in education
Albadarin, Y., Saqr, M., Pope, N., & Tukiainen, M. (2024) · Discover Education · doi:10.1007/s44217-024-00138-2 · Cited by 191 · see citing works
Singh, J., Sung, K. K., Cooper, T., West, K., & Mont, O. (2019) · Resources Conservation and Recycling · doi:10.1016/j.resconrec.2019.104439 · Cited by 177 · see citing works
The importance of literature reviews in small business and entrepreneurship research
Kraus, S., Mahto, R. V., & Walsh, S. T. (2021) · Journal of Small Business Management · doi:10.1080/00472778.2021.1955128 · Cited by 176 · see citing works
Digital Health Innovation Ecosystems: From Systematic Literature Review to Conceptual Framework
Iyawa, G. E., Herselman, M. E., & Botha, A. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.09.149 · Cited by 175 · see citing works
Gesso, C. D., & Lodhi, R. N. (2024) · Journal of Accounting Literature · doi:10.1108/jal-08-2023-0143 · Cited by 226 · see citing works
Latapí, M., Jóhannsdóttir, L., & Davíðsdóttir, B. (2019) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2019.119094 · Cited by 171 · see citing works
Degirmenci, K., Desouza, K. C., Fieuw, W., Watson, R. T., & Yiğitcanlar, T. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.102873 · Cited by 167 · see citing works
Robotic Process Automation: Systematic Literature Review
Ivančić, L., Vugec, D. S., & Vukšić, V. B. (2019) · Lecture notes in business information processing · doi:10.1007/978-3-030-30429-4_19 · Cited by 164 · see citing works
Immersive technologies for tourism: a systematic review
Pratisto, E. H., Thompson, N., & Potdar, V. M. (2022) · Information Technology & Tourism · doi:10.1007/s40558-022-00228-7 · Cited by 158 · see citing works
Jada, I., & Mayayise, T. O. (2023) · Data and Information Management · doi:10.1016/j.dim.2023.100063 · Cited by 202 · see citing works
Cyber-Security Challenges in Aviation Industry: A Review of Current and Future Trends
Ukwandu, E., Farah, M. A. B., Hindy, H., Bureš, M., Atkinson, R. C., Tachtatzis, C., Andonović, I., & Bellekens, X. (2022) · Information · doi:10.3390/info13030146 · Cited by 151 · see citing works
A Decade of Sustainable HCI: Connecting SHCI to the Sustainable Development Goals
Hansson, L. Å. E. J., Cerratto Pargman, T., & Pargman, D. S. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445069 · Cited by 148 · see citing works
Al-Alimi, S., Yusuf, N. K., Ghaleb, A. M., Lajis, M. A., Shamsudin, S., Zhou, W., Altharan, Y. M., Abdulwahab, H. S., Saif, Y., Didane, D. H., et al. (2024) · Results in Engineering · doi:10.1016/j.rineng.2024.102566 · Cited by 149 · see citing works
What is novel about the Metaverse?
Richter, S., & Richter, A. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102684 · Cited by 153 · see citing works
An overview of unsupervised drift detection methods
Gemaque, R. N., Costa, A. F. J., Giusti, R., & Santos, E. M. D. (2020) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1381 · Cited by 143 · see citing works
The bibliometric analysis of Islamic banking and finance
Biancone, P., Saiti, B., Petricean, D., & Chmet, F. (2020) · Journal of Islamic accounting and business research · doi:10.1108/jiabr-08-2020-0235 · Cited by 138 · see citing works
The impact of digital leadership on sustainable performance: a systematic literature review
Khaw, T. Y., Teoh, A. P., Khalid, S. N. A., & Letchmunan, S. (2022) · Journal of Management Development · doi:10.1108/jmd-03-2022-0070 · Cited by 174 · see citing works
The Research Audit Trail: Methodological Guidance for Application in Practice
Carcary, M. (2021) · The Electronic Journal of Business Research Methods · doi:10.34190/jbrm.18.2.008 · Cited by 132 · see citing works
A comprehensive analysis of personalized learning components
Shemshack, A., Kinshuk, & Spector, J. (2021) · Journal of Computers in Education · doi:10.1007/s40692-021-00188-7 · Cited by 133 · see citing works
XAIR: A Systematic Metareview of Explainable AI (XAI) Aligned to the Software Development Process
Clement, T., Kemmerzell, N., Abdelaal, M., & Amberg, M. (2023) · Machine Learning and Knowledge Extraction · doi:10.3390/make5010006 · Cited by 131 · see citing works
Will artificial intelligence drive the advancements in higher education? A tri-phased exploration
Kumar, S., Rao, P., Singhania, S., Verma, S., & Kheterpal, M. (2024) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2024.123258 · Cited by 131 · see citing works
Zhu, M., Sari, A. R., & Lee, M. M. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-020-09798-x · Cited by 128 · see citing works
Digital transformation leadership competencies: A contingency approach
Müller, S. D., Konzag, H., Nielsen, J. A., & Sandholt, H. B. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102734 · Cited by 169 · see citing works
Artificial intelligence maturity model: A systematic literature review
Sadiq, R. B., Safie, N., Abd Rahman, A. H., & Goudarzi, S. (2021) · PeerJ Computer Science · doi:10.7717/peerj-cs.661 · Cited by 127 · see citing works
A systematic literature review of the role of trust and security on FinTech adoption in banking
Jafri, J. A., Mohd Amin, S. I., Abdul Rahman, A., & Mohd Nor, S. (2024) · Heliyon · doi:10.1016/j.heliyon.2023.e22980 · Cited by 126 · see citing works
Cloud Computing Adoption in Higher Education Institutions: A Systematic Review
Qasem, Y. A. M., Abdullah, R., Jusoh, Y. Y., Atan, R. B., & Asadi, S. (2019) · IEEE Access · doi:10.1109/access.2019.2916234 · Cited by 110 · see citing works
Gamification for climate change engagement: review of corpus and future agenda
Galeote, D. F., Rajanen, M., Rajanen, D., Legaki, N.-Z., Langley, D., & Hamari, J. (2021) · Environmental Research Letters · doi:10.1088/1748-9326/abec05 · Cited by 116 · see citing works
The internet of things and corporate business models: A systematic literature review
Palmaccio, M., Dıcuonzo, G., & Belyaeva, Z. S. (2020) · Journal of Business Research · doi:10.1016/j.jbusres.2020.09.069 · Cited by 107 · see citing works
Learning analytics in virtual laboratories: a systematic literature review of empirical research
Elmoazen, R., Saqr, M., Khalil, M., & Wasson, B. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00244-y · Cited by 150 · see citing works
Shaffril, H. A. M., Samah, A. A., & Samsuddin, S. F. (2021) · Environmental Science and Pollution Research · doi:10.1007/s11356-021-13178-0 · Cited by 105 · see citing works
A Systematic Review on the Local Wisdom of Indigenous People in Nature Conservation
Abas, A., Aziz, A., & Awang, A. (2022) · Sustainability · doi:10.3390/su14063415 · Cited by 105 · see citing works
Review and Theory Symbiosis: An Introspective Retrospective
Baylor University and Lund University, & Leidner, D. (2018) · Journal of the Association for Information Systems · doi:10.17705/1jais.00501 · Cited by 102 · see citing works
Rjab, A. B., Mellouli, S., & Corbett, J. (2023) · Government Information Quarterly · doi:10.1016/j.giq.2023.101814 · Cited by 115 · see citing works
A Systematic Literature Review of Empirical Research on Epistemic Network Analysis in Education
Elmoazen, R., Saqr, M., Tedre, M., & Hirsto, L. (2022) · IEEE Access · doi:10.1109/access.2022.3149812 · Cited by 103 · see citing works
Misaki, E., Apiola, M., Gaiani, S., & Tedre, M. (2018) · The Electronic Journal of Information Systems in Developing Countries · doi:10.1002/isd2.12034 · Cited by 102 · see citing works
Alnasyan, B., Basheri, M., & Alassafi, M. O. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100231 · Cited by 134 · see citing works
A narrative literature review process for an academic business research thesis
Juntunen, M., & Lehenkari, M. (2021) · Studies in Higher Education · doi:10.1080/03075079.2019.1630813 · Cited by 99 · see citing works
Chen, L., Ifenthaler, D., & Yau, J. Y.-K. (2021) · Entrepreneurship Education · doi:10.1007/s41959-021-00047-7 · Cited by 99 · see citing works
Handling Censoring and Censored Data in Survival Analysis: A Standalone Systematic Literature Review
Turkson, A. J., Ayiah-Mensah, F., & Nimoh, V. (2021) · International Journal of Mathematics and Mathematical Sciences · doi:10.1155/2021/9307475 · Cited by 98 · see citing works
Artificial intelligence in safety-critical systems: a systematic review
Wang, Y., & Chung, S. H. (2022) · Industrial Management & Data Systems · doi:10.1108/imds-07-2021-0419 · Cited by 96 · see citing works
Potential of recycled PLA in 3D printing: A review
Hasan, M. R., Davies, I. J., Pramanik, A., John, M. B., & Biswas, W. K. (2024) · Sustainable Manufacturing and Service Economics · doi:10.1016/j.smse.2024.100020 · Cited by 105 · see citing works
Walsh, I., & Renaud, A. (2017) · Systèmes d information & management · doi:10.3917/sim.173.0075 · Cited by 94 · see citing works
Panda, D. K., & Ray, S. (2022) · Journal of Intelligent Information Systems · doi:10.1007/s10844-022-00698-5 · Cited by 98 · see citing works
Machine Learning Techniques to Predict Mental Health Diagnoses: A Systematic Literature Review
Madububambachu, U., Ukpebor, A., & Ihezue, U. (2024) · Clinical Practice and Epidemiology in Mental Health · doi:10.2174/0117450179315688240607052117 · Cited by 109 · see citing works
Abas, A., Arifin, K., Ali, M. A. M., & Khairil, M. (2023) · Environmental Development · doi:10.1016/j.envdev.2023.100853 · Cited by 92 · see citing works
A Survey on Developer-Centred Security
Tahaei, M., & Vaniea, K. E. (2019) · IEEE European Symposium on Security and Privacy Workshops (EuroS&PW) · doi:10.1109/eurospw.2019.00021 · Cited by 89 · see citing works
Transition Paths towards a Sustainable Transportation System: A Literature Review
Jelti, F., Allouhi, A., & Aoul, K. A. T. (2023) · Sustainability · doi:10.3390/su152115457 · Cited by 89 · see citing works
Systematic Literature Review of Industry 4.0 Maturity Model for Manufacturing and Logistics Sectors
Angreani, L. S., Vijaya, A., & Wicaksono, H. (2020) · Procedia Manufacturing · doi:10.1016/j.promfg.2020.11.056 · Cited by 87 · see citing works
Chatterjee, S., Chaudhuri, R., & Vrontis, D. (2022) · EuroMed Journal of Business · doi:10.1108/emjb-07-2021-0105 · Cited by 101 · see citing works
Pooja, K., & Upadhyaya, P. (2022) · Management Review Quarterly · doi:10.1007/s11301-022-00312-6 · Cited by 88 · see citing works
Determinants of circular business model adoption—A systematic literature review
Assmann, I. R., Rosati, F., & Morioka, S. (2023) · Business Strategy and the Environment · doi:10.1002/bse.3470 · Cited by 69 · see citing works
Belahouaoui, R., & Attak, E. H. (2024) · Accounting Research Journal · doi:10.1108/arj-12-2023-0372 · Cited by 146 · see citing works
Ariffin, K. A. Z., & Ahmad, F. H. (2021) · Computers & Security · doi:10.1016/j.cose.2021.102237 · Cited by 83 · see citing works
A systematic review of battery thermal management systems based on heat pipes
Fathoni, A. M., Putra, N. S. D., & Mahlia, T. M. I. (2023) · Journal of Energy Storage · doi:10.1016/j.est.2023.109081 · Cited by 85 · see citing works
Defining digital fashion: Reshaping the field via a systematic review
Baek, E., Haines, S. J., Fares, O. H., Huang, Z., Hong, Y., & Lee, S. H. M. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2022.107407 · Cited by 82 · see citing works
Bevilacqua, S., Masárová, J., Perotti, F. A., & Ferraris, A. (2025) · Review of Managerial Science · doi:10.1007/s11846-025-00836-7 · Cited by 111 · see citing works
Ramalingam, S., Yunus, M. M., & Hashim, H. B. (2022) · Sustainability · doi:10.3390/su14138051 · Cited by 118 · see citing works
Implementing innovations within organizations: a systematic review and research agenda
Kim, J. S., & Chung, G. H. (2017) · Innovation · doi:10.1080/14479338.2017.1335943 · Cited by 81 · see citing works
A systematic literature review of Chinese music education studies during 2007 to 2019
Yang, Y., & Welch, G. (2023) · International Journal of Music Education · doi:10.1177/02557614221096150 · Cited by 108 · see citing works
Ahmad, N. A., Rauf, M. F. A., Zaid, N. N. M., Zainal, A., Shahdan, T. S. T., & Razak, F. H. A. (2022) · SN Computer Science · doi:10.1007/s42979-022-01016-0 · Cited by 89 · see citing works
Data management in digital twins: a systematic literature review
Correia, J. B., Abel, M., & Becker, K. E. (2023) · Knowledge and Information Systems · doi:10.1007/s10115-023-01870-1 · Cited by 79 · see citing works
Automating Research Synthesis with Domain-Specific Large Language Model Fine-Tuning
Sušnjak, T., Hwang, P., Reyes, N. H., Barczak, A. L. C., McIntosh, T. R., & Ranathunga, S. (2025) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3715964 · Cited by 91 · see citing works
Design and simulation of district heating networks: A review of modeling approaches and tools
Kuntuarova, S., Licklederer, T., Huynh, T., Zinsmeister, D., Hamacher, T., & Perić, V. S. (2024) · Energy · doi:10.1016/j.energy.2024.132189 · Cited by 75 · see citing works
Digital authoritarianism: a systematic literature review
Roberts, T., & Oosterom, M. (2025) · Information Technology for Development · doi:10.1080/02681102.2024.2425352 · Cited by 74 · see citing works
Liew, T. W., & Tan, S.-M. (2021) · Telematics and Informatics · doi:10.1016/j.tele.2021.101721 · Cited by 72 · see citing works
Sustainability reporting in the airline industry: Current literature and future research avenues
Zięba, M., & Johansson, E. (2021) · Transportation Research Part D Transport and Environment · doi:10.1016/j.trd.2021.103133 · Cited by 72 · see citing works
Babkin, A. V., Shkarupeta, E., Tashenova, L., Malevskaia-Malevich, E., & Shchegoleva, T. (2023) · Journal of Open Innovation Technology Market and Complexity · doi:10.1016/j.joitmc.2023.100071 · Cited by 71 · see citing works
- Authors
- Okoli, C.
- Affiliations
- Concordia University (CA)
- Corresponding author
- Okoli, Chitu
- ORCID
- Okoli, Chitu
- Venue
- Communications of the Association for Information Systems
- Publisher
- Association for Information Systems
- Published
- 2015
- Volume
- 37
- ISSN
- 1529-3181 (ISSN-L)
- OpenAlex
- W2173536757
- Cited by
- 1,413
- References
- 93
- Citations by year
- 2026: 150 · 2025: 241 · 2024: 250 · 2023: 230 · 2022: 220 · 2021: 162 · 2020: 78 · 2019: 34 · 2018: 30 · 2017: 12 · 2016: 4 · 2015: 2
- FWCI
- 2.63
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- other-oa
- Locations
- Communications of the Association for Information Systems (publishedVersion, other-oa)
- Funders
- Social Sciences and Humanities Research Council of Canada
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Social Sciences › Decision Sciences › Management Science and Operations Research › Business Strategies and Management Research
- Keywords
- systematic reviews, information systems research, research methodology, literature synthesis, mixed methods synthesis, research guidelines, meta-analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
