A Guide to Conducting a Systematic Literature Review of Information Systems Research
Open accessThe DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
Abstract
This working paper has been thoroughly revised and superseded by two distinct articles. The first is a revised and peer-reviewed version of the original article: Okoli, Chitu (2015), A Guide to Conducting a Standalone Systematic Literature Review. Communications of the Association for Information Systems (37:43), November 2015, pp. 879-910. This article presents a methodology for conducting a systematic literature review with many examples from IS research and references to guides with further helpful details. The article is available from Google Scholar or from the author's website. The second extension article focuses on developing theory with literature reviews: Okoli, Chitu (2015), The View from Giants’ Shoulders: Developing Theory with Theory-Mining Systematic Literature Reviews. SSRN Working Paper Series, December 8, 2015. This article identifies theory-mining reviews, which are literature reviews that extract and synthesize theoretical concepts from the source primary studies. The article demonstrates by citation analysis that, in information systems research, this kind of literature review is more highly cited than other kinds of literature review. The article provides detailed guidelines to writing a high-quality theory-mining review.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Alavi, M., & Leidner, D. E. (2001) · MIS Quarterly · doi:10.2307/3250961 · Cited by 10,176
Analyzing the Past to Prepare for the Future: Writing a Literature Review
Webster, J., & Watson, R. T. (2002) · MIS Quarterly · doi:10.2307/4132319 · Cited by 7,449
Systematic Literature Reviews in Software Engineering—A Systematic Literature Review
Kitchenham, B., Pearl Brereton, O., Budgen, D., Turner, M., Bailey, J., & Linkman, S. (2009) · Information and Software Technology · doi:10.1016/j.infsof.2008.09.009 · Cited by 4,537
Meta-Analytic Procedures for Social Research.
Metcalfe, A., & Rosenthal, R. (1994) · The Statistician · doi:10.2307/2348600 · Cited by 4,249
Systematic reviews in the social sciences: a practical guide
(2006) · Choice Reviews Online · doi:10.5860/choice.43-5664 · Cited by 4,089
Melville, N., Kraemer, K., & Gurbaxani, V. (2004) · MIS Quarterly · doi:10.2307/25148636 · Cited by 3,372
Wade, M., & Hulland, J. (2004) · MIS Quarterly · doi:10.2307/25148626 · Cited by 2,822
Checklists for improving rigour in qualitative research: a case of the tail wagging the dog?
Barbour, R. S. (2001) · BMJ · doi:10.1136/bmj.322.7294.1115 · Cited by 2,613
Brereton, P., Kitchenham, B. A., Budgen, D., Turner, M., & Khalil, M. (2007) · Journal of Systems and Software · doi:10.1016/j.jss.2006.07.009 · Cited by 2,394
Organizational Theories: Some Criteria for Evaluation
Bacharach, S. B. (1989) · The Academy of Management Review · doi:10.5465/amr.1989.4308374 · Cited by 2,305
Investigating and dealing with publication and other biases in meta-analysis
Sterne, J. A. C., Egger, M., & Smith, G. D. (2001) · BMJ · doi:10.1136/bmj.323.7304.101 · Cited by 2,225
Conducting research literature reviews: from the Internet to paper
(2005) · Choice Reviews Online · doi:10.5860/choice.42-6198 · Cited by 1,854
Meta-Analysis: Recent Developments in Quantitative Methods for Literature Reviews
Rosenthal, R., & DiMatteo, M. R. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.59 · Cited by 1,780
Levy, Y., & J. Ellis, T. (2006) · Informing Science: The International Journal of an Emerging Transdiscipline · doi:10.28945/479 · Cited by 1,578
Leidner, D. E., & Kayworth, T. (2006) · MIS Quarterly · doi:10.2307/25148735 · Cited by 1,554
Erduran, S., Simon, S., & Osborne, J. (2004) · Science Education · doi:10.1002/sce.20012 · Cited by 1,408
Doing a literature review: releasing the social science research imagination.
Hart, C. (1998) · Sage eBooks · Cited by 1,378
Boote, D. N., & Beile, P. (2005) · Educational Researcher · doi:10.3102/0013189x034006003 · Cited by 1,212
Writing meta-analytic reviews.
Rosenthal, R. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.118.2.183 · Cited by 1,108 · cited 2×
“32 Rousseau et al. (2008) refer to the analysis of qualitative material as synthesis by interpretation and synthesis by explanation.”
Dubé, L., Paré, G., Dubé, L., & Paré, G. (2016) · Case Studies · doi:10.4135/9781473915480.n65 · Cited by 1,071
Rousseau, D. M., Manning, J., & Denyer, D. (2008) · Academy of Management Annals · doi:10.1080/19416520802211651 · Cited by 953
Marakas, G. M., Yi, M. Y., & Johnson, R. D. (1998) · Information Systems Research · doi:10.1287/isre.9.2.126 · Cited by 892
Conducting a literature review
Rowley, J., & Slack, F. (2004) · Management Research News · doi:10.1108/01409170410784185 · Cited by 885
Dead Or Alive? The Development, Trajectory And Future Of Technology Adoption Research.
University of Arkansas, Venkatesh, V., Davis, F., University of Arkansas, Morris, M., & University of Virginia (2007) · Journal of the Association for Information Systems · doi:10.17705/1jais.00120 · Cited by 789 · cited 2×
“To make recommendations for future research (Venkatesh et al., 2007); 3.”
The Literature Review : A Step-by-Step Guide for Students
Ridley, D. (2012) · Cited by 758
Piccoli, G., & Ives, B. (2005) · MIS Quarterly · doi:10.2307/25148708 · Cited by 639
A Meta-Analysis of the Relationships Between Individual Job Satisfaction and Individual Performance
Petty, M. M., McGee, G. W., & Cavender, J. W. (1984) · Academy of Management Review · doi:10.5465/amr.1984.4277608 · Cited by 595
A Review of MIS Research and Disciplinary Development
Alavi, M., & Carlson, P. (1992) · Journal of Management Information Systems · doi:10.1080/07421222.1992.11517938 · Cited by 558
Review: A Cognitive-Affective Model of Organizational Communication for Designing IT1,2
Dov, T. (2001) · MIS Quarterly · doi:10.2307/3250931 · Cited by 512
Joseph, D., Ng, K.-Y., Koh, C., & Ang, S. (2007) · MIS Quarterly · doi:10.2307/25148807 · Cited by 468
Using qualitative research synthesis to build an actionable knowledge base
Denyer, D., & Tranfield, D. (2006) · Management Decision · doi:10.1108/00251740610650201 · Cited by 426
Review : Power and Information Technology Research: A Metatriangulation Review1, 2
Jasperson, J. (., Carte, T. A., Saunders, C. S., Butler, B. S., Croes, H. J. P., & Zheng, W. (2002) · MIS Quarterly · doi:10.2307/4132315 · Cited by 411
Alavi, M., & Joachimsthaler, E. A. (1992) · MIS Quarterly · doi:10.2307/249703 · Cited by 361
Self‐citation and self‐reference: Credibility and promotion in academic publication
Hyland, K. (2003) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.10204 · Cited by 301
The schematic structure of literature reviews in doctoral theses of applied linguistics
Kwan, B. S. C. (2006) · English for Specific Purposes · doi:10.1016/j.esp.2005.06.001 · Cited by 289
Georgia State University, U., Robey, D., Im, G., Clark Atlanta University, Wareham, J., & ESADE (2008) · Journal of the Association for Information Systems · doi:10.17705/1jais.00171 · Cited by 259
Berthon, P., Pitt, L., Ewing, M., & Carr, C. L. (2002) · Information Systems Research · doi:10.1287/isre.13.4.416.71 · Cited by 233
Writing a review article for Psychological Bulletin.
Bem, D. J. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.118.2.172 · Cited by 213
A Theoretical Perspective of Negotiation Support Systems
Lim, L.-H., & Benbasat, I. (1992) · Journal of Management Information Systems · doi:10.1080/07421222.1992.11517966 · Cited by 192
Analyzing the past to prepare for the future
(2002) · MIS Quarterly · doi:10.5555/2017160.2017162 · Cited by 179
Human Resources Management in International Joint Ventures: Directions for Research
Shenkar, O., & Zeira, Y. (1987) · The Academy of Management Review · doi:10.2307/258520 · Cited by 176
Task Design: A Literature Review
Pierce, J. L., & Dunham, R. B. (1976) · Academy of Management Review · doi:10.2307/257727 · Cited by 166
Are Articles in “Top” Management Journals Necessarily of Higher Quality?
Singh, G., Haddad, K. M., & Chow, C. W. (2007) · Journal of Management Inquiry · doi:10.1177/1056492607305894 · Cited by 145
Maxwell, J. A. (2006) · Educational Researcher · doi:10.3102/0013189x035009028 · Cited by 131
What Experienced Collaborators Say About Collaborative Writing
Allen, N., Atkinson, D., Morgan, M., Moore, T., & Snow, C. (1987) · Journal of Business and Technical Communication · doi:10.1177/105065198700100206 · Cited by 124
Perceived Task Characteristics and Employee Performance: A Literature Review
Griffin, R. W., Welsh, A., & Moorhead, G. (1981) · Academy of Management Review · doi:10.5465/amr.1981.4285726 · Cited by 100
Strategies for Disseminating Qualitative Research Findings: Three Exemplars
Keen, S., & Todres, L. (2007) · Forum qualitative Sozialforschung · doi:10.17169/fqs-8.3.285 · Cited by 85
Shift Work: A Review and Theoretical Analysis
Dunham, R. B. (1977) · Academy of Management Review · doi:10.5465/amr.1977.4406742 · Cited by 80
Providing Information Literacy Instruction to Graduate Students through Literature Review.
Rempel, H. G., & Davidson, J. R. (2008) · Issues in Science and Technology Librarianship · doi:10.29173/istl2442 · Cited by 75
Observations from the Field: Sharing a Literature Review Rubric
Green, R., & Bowser, M. (2006) · Journal of Library Administration · doi:10.1300/j111v45n01_10 · Cited by 73
Finding open access articles using Google, Google Scholar, OAIster and OpenDOAR
Norris, M. W., Oppenheim, C., & Rowland, F. (2008) · Online Information Review · doi:10.1108/14684520810923881 · Cited by 69
Lee, D., Kang, J., Mitra, P., Giles, C. L., & On, B.-W. (2007) · Communications of the ACM · doi:10.1145/1323688.1323690 · Cited by 68
Providing Information Literacy Instruction to Graduate Students through Literature Review Workshops
Rempel, H. G. (2008) · PDXScholar (Portland State University) · doi:10.5062/f44x55rg · Cited by 55
Winter, S. J., & Taylor, S. L. (1996) · Information Systems Research · doi:10.1287/isre.7.1.5 · Cited by 47
Lessons Learnt Undertaking a Large-scale Systematic Literature Review
Turner, M., Kitchenham, B. A., Budgen, D., & Pearl Brereton, A. (2008) · Electronic workshops in computing · doi:10.14236/ewic/ease2008.12 · Cited by 46
The Researcher, the Topic, and the Literature: A Procedure for Systematizing Literature Searches
Helmericks, S. G., Nelsen, R. L., & Unnithan, N. P. (1991) · The Journal of Applied Behavioral Science · doi:10.1177/0021886391273004 · Cited by 42
The genre(s) of student writing: developing writing models
Hüttner, J. (2008) · International Journal of Applied Linguistics · doi:10.1111/j.1473-4192.2008.00200.x · Cited by 34
Meaning in philosophy and meaning in information retrieval (IR)
Thornley, C., & Gibb, F. (2009) · Journal of Documentation · doi:10.1108/00220410910926158 · Cited by 25
The Importance of Resubmitting Rejected Papers
Donovan, S. K. (2007) · Journal of Scholarly Publishing · doi:10.3138/w706-5884-kg84-j282 · Cited by 20
Dawson, K., & Ferdig, R. E. (2006) · Contemporary issues in technology and teacher education · Cited by 20
The Discard of Study Evidence by Literature Reviewers
Rodgers, R. C., & Hunter, J. E. (1994) · The Journal of Applied Behavioral Science · doi:10.1177/0021886394303005 · Cited by 16
The “dos and don'ts” of writing a journal article
Kekäle, T., de Weerd-Nederhof, P. C., Cervai, S., & Borelli, M. (2009) · Journal of Workplace Learning · doi:10.1108/13665620910924925 · Cited by 14
The dimensions of cited reference enhanced database subsets
Jacsó, P. (2007) · Online Information Review · doi:10.1108/14684520710832360 · Cited by 11
Cited by
Synthesizing information systems knowledge: A typology of literature reviews
Paré, G., Trudel, M.-C., Jaana, M., & Kitsiou, S. (2015) · Information & Management · doi:10.1016/j.im.2014.08.008 · Cited by 1,987
A Guide to Conducting a Standalone Systematic Literature Review
Okoli, C. (2015) · Communications of the Association for Information Systems · doi:10.17705/1cais.03743 · Cited by 1,413
Self-citationDi Vaio, A., Palladino, R., Hassan, R., & Escobar, O. (2020) · Journal of Business Research · doi:10.1016/j.jbusres.2020.08.019 · Cited by 1,096
A literature review of the history and evolution of corporate social responsibility
Latapí Agudelo, M. A., Jóhannsdóttir, L., & Davídsdóttir, B. (2019) · International Journal of Corporate Social Responsibility · doi:10.1186/s40991-018-0039-y · Cited by 849
Utilising learning analytics to support study success in higher education: a systematic review
Ifenthaler, D., & Yau, J. Y.-K. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-020-09788-z · Cited by 659
Metadata
- Authors
- Okoli, C., & Schabram, K.
- Affiliations
- SKEMA Business School (FR)
- Corresponding author
- Okoli, Chitu
- Venue
- SSRN Electronic Journal
- Publisher
- Elsevier BV
- Published
- 2011
- ISSN
- 1556-5068 (ISSN-L)
- OpenAlex
- W1539987097
- Cited by
- 1,849
- References
- 61
- Citations by year
- 2026: 57 · 2025: 129 · 2024: 222 · 2023: 247 · 2022: 248 · 2021: 231 · 2020: 207 · 2019: 133 · 2018: 86 · 2017: 71 · 2016: 49 · 2015: 69 · 2014: 52 · 2013: 26 · 2012: 14
- Type
- posted content
- Language
- en
- Open access
- green
- doi.org
- Locations
- SSRN Electronic Journal (acceptedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Systems Theories and Implementation
- Social Sciences › Business, Management and Accounting › Strategy and Management › Business Strategies and Management Research
- Keywords
- systematic reviews, information systems research, theory development, literature review methodology, citation analysis, evidence synthesis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.