A Framework for Guiding and Evaluating Literature Reviews
Open accessAbstract
Given that the synthesis of cumulated knowledge is an essential condition for any field to grow and develop, we believe that the enhanced role of IS reviews requires that this expository form be given careful scrutiny. Over the past decade, several senior scholars have made calls for more review papers in our field. While the number of IS review papers has substantially increased in recent years, no prior research has attempted to develop a general framework to conduct and evaluate the rigor of standalone reviews. In this paper, we fill this gap. More precisely, we present a set of guidelines for guiding and evaluating IS literature reviews and specify to which review types they apply. To do so, we first distinguish between four broad categories of review papers and then propose a set of guidelines that are grouped according to the generic phases and steps of the review process. We hope our work will serve as a valuable source for those conducting, evaluating, and/or interpreting reviews in our field.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · see citing works
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048 · see citing works
Scoping studies: advancing the methodology
Levac, D., Colquhoun, H., & O'Brien, K. K. (2010) · Implementation Science · doi:10.1186/1748-5908-5-69 · Cited by 15,268 · see citing works
A typology of reviews: an analysis of 14 review types and associated methodologies
Grant, M. J., & Booth, A. (2009) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00848.x · Cited by 10,817 · see citing works
Information Systems Success: The Quest for the Dependent Variable
DeLone, W. H., & McLean, E. R. (1992) · Information Systems Research · doi:10.1287/isre.3.1.60 · Cited by 10,697 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349 · see citing works
Analyzing the Past to Prepare for the Future: Writing a Literature Review
Webster, J., & Watson, R. T. (2002) · MIS Quarterly · doi:10.2307/4132319 · Cited by 7,449 · see citing works
Cochrane Handbook for Systematic Reviews of Interventions
Higgins, J. P. T., Green, S., & Ben Van Den, A. (2020) · International Coaching Psychology Review · doi:10.53841/bpsicpr.2020.15.2.123 · Cited by 5,670 · see citing works
Verification strategies for establishing reliability and validity in qualitative research
Morse, J. M., Barrett, M., Mayan, M., Olson, K., & Spiers, J. (2002) · International Journal of Qualitative Methods · doi:10.1177/160940690200100202 · Cited by 4,978 · see citing works
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374 · see citing works
Writing Integrative Literature Reviews: Guidelines and Examples
Torraco, R. J. (2005) · Human Resource Development Review · doi:10.1177/1534484305278283 · Cited by 3,534 · cited 6× · see citing works
“According to Torraco (2005), authors of developmental reviews are expected to identify a topic or issue that is appropriate for review, search and retrieve the most significant and relevant literature on that topic, analyze or critique the extant literature, and propose new concepts, theories,…”
InfluentialAssessing Risk of Bias in Included Studies
Higgins, J. P., & Altman, D. G. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch8 · Cited by 3,396 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Italian Journal of Public Health · doi:10.2427/5768 · Cited by 3,374 · see citing works
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309 · see citing works
Systematic Mapping Studies in Software Engineering
Petersen, K., Feldt, R., Mujtaba, S., & Mattsson, M. (2008) · Electronic Workshops in Computing · doi:10.14236/ewic/ease2008.8 · Cited by 3,239 · cited 7× · see citing works
“Therefore, the criteria required for study inclusion are usually based on the study’s content and refer to the research question and/or topic of interest (Cooper, 2009; Kitchenham & Charters, 2007; Liberati et al., 2009; Okoli & Schabram, 2010; Petersen et al., 2008), the theories and constructs included in primary st…”
InfluentialRealist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · see citing works
A meta-analysis of the technology acceptance model
King, W. R., & He, J. (2006) · Information & Management · doi:10.1016/j.im.2006.05.003 · Cited by 2,906 · see citing works
Writing narrative literature reviews for peer-reviewed journals: secrets of the trade
Green, B. N., Johnson, C. D., & Adams, A. (2006) · Journal of Chiropractic Medicine · doi:10.1016/s0899-3467(07)60142-6 · Cited by 2,224 · see citing works
Meta-Ethnography: Synthesizing Qualitative Studies
Noblit, G. W., & Hare, R. D. (1988) · Medical Entomology and Zoology · Cited by 2,191 · see citing works
Synthesizing information systems knowledge: A typology of literature reviews
Paré, G., Trudel, M.-C., Jaana, M., & Kitsiou, S. (2015) · Information & Management · doi:10.1016/j.im.2014.08.008 · Cited by 1,987 · see citing works
Self-citationA Guide to Conducting a Systematic Literature Review of Information Systems Research
Okoli, C., & Schabram, K. (2011) · doi:10.2139/ssrn.1954824 · Cited by 1,849 · see citing works
Research Synthesis and Meta-Analysis: A Step-by-Step Approach
Cooper, H. (2017) · doi:10.4135/9781071878644 · Cited by 1,716 · see citing works
Methodological rigour within a qualitative framework
Tobin, G. A., & Begley, C. M. (2004) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2004.03207.x · Cited by 1,601 · see citing works
Levy, Y. M., & Ellis, T. J. (2006) · Informing Science The International Journal of an Emerging Transdiscipline · doi:10.28945/479 · Cited by 1,581 · see citing works
Writing Narrative Literature Reviews
Baumeister, R. F., & Leary, M. R. (1997) · Review of General Psychology · doi:10.1037/1089-2680.1.3.311 · Cited by 1,482 · see citing works
Undertaking a literature review: a step-by-step approach
Cronin, P., Ryan, F., & Coughlan, M. (2008) · British Journal of Nursing · doi:10.12968/bjon.2008.17.1.28059 · Cited by 1,430 · see citing works
Reconstructing the Giant: On the Importance of Rigour in Documenting the Literature Search Process
Brocke, J. V., Simons, A., Niehaves, B., Reimer, K., Plattfaut, R., & Cleven, A. (2009) · Alexandria (UniSG) (University of St.Gallen) · Cited by 1,383 · see citing works
Doing a literature review: releasing the social science research imagination.
Hart, C. (1998) · Sage eBooks · Cited by 1,378 · see citing works
(2011) · Cited by 1,303 · see citing works
Survey research methodology in management information systems: an assessment
Pinsonneault, A., & Kraemer, K. (1993) · Journal of Management Information Systems · doi:10.1080/07421222.1993.11518001 · Cited by 1,288 · see citing works
Using grounded theory as a method for rigorously reviewing literature
Wolfswinkel, J. F., Furtmueller, E., & Wilderom, C. P. M. (2011) · European Journal of Information Systems · doi:10.1057/ejis.2011.51 · Cited by 1,158 · see citing works
A Review of the Predictors, Linkages, and Biases in IT Innovation Adoption Research
Jeyaraj, A., Rottman, J. W., & Lacity, M. C. (2006) · Journal of Information Technology · doi:10.1057/palgrave.jit.2000056 · Cited by 1,136 · see citing works
Dubé, L., & Paré, G. (2016) · SAGE Publications Ltd eBooks · doi:10.4135/9781473915480.n65 · Cited by 1,076 · see citing works
Self-citationClarifying differences between review designs and methods
Gough, D., Thomas, J., & Oliver, S. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-28 · Cited by 1,063 · see citing works
Rousseau, D. M., Manning, J., & Denyer, D. (2008) · Academy of Management Annals · doi:10.5465/19416520802211651 · Cited by 1,031 · see citing works
Organizing knowledge syntheses: A taxonomy of literature reviews
Cooper, H. M. (1988) · Knowledge in Society · doi:10.1007/bf03177550 · Cited by 1,014 · see citing works
Rousseau, D. M., Manning, J., & Denyer, D. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1309606 · Cited by 997 · see citing works
Dubé, L., & Paré, G. (2003) · MIS Quarterly · doi:10.2307/30036550 · Cited by 976 · see citing works
Self-citationDoes the technology acceptance model predict actual use? A systematic literature review
Turner, M., Kitchenham, B., Brereton, P., Charters, S., & Budgen, D. (2010) · Information and Software Technology · doi:10.1016/j.infsof.2009.11.005 · Cited by 851 · see citing works
Scientific Guidelines for Conducting Integrative Research Reviews
Cooper, H. M. (1982) · Review of Educational Research · doi:10.3102/00346543052002291 · Cited by 785 · see citing works
Doing your literature review: traditional and systematic techniques
Cronin, C. (2011) · Evaluation & Research in Education · doi:10.1080/09500790.2011.581509 · Cited by 754 · see citing works
The Technology Acceptance Model: A Meta-Analysis of Empirical Findings
Ma, Q., & Liu, L. (2004) · Journal of Organizational and End User Computing · doi:10.4018/joeuc.2004010104 · Cited by 660 · cited 2× · see citing works
“For instance, Ma and Liu (2004) report that they “carefully checked the sample (of the included studies) to make sure they were not based on the same data” (p.”
Anderson, S., Allen, P., Peckham, S., & Goodwin, N. (2008) · Health Research Policy and Systems · doi:10.1186/1478-4505-6-7 · Cited by 653 · see citing works
A paradigmatic and methodological examination of information systems research from 1991 to 2001
Chen, W., & Hirschheim, R. (2004) · Information Systems Journal · doi:10.1111/j.1365-2575.2004.00173.x · Cited by 653 · see citing works
Doing Your Literature Review: Traditional and Systematic Techniques
Jesson, J. K., Matheson, L., & Lacey, F. (2011) · Cited by 636 · see citing works
Qualitative Research and the Question of Rigor
Davies, D., & Dodd, J. (2002) · Qualitative Health Research · doi:10.1177/104973230201200211 · Cited by 597 · see citing works
Rousseau, D. M. (2013) · Encyclopedia of Management Theory · doi:10.4135/9781452276090.n91 · Cited by 586 · see citing works
Information technology diffusion: a review of empirical research
Fichman, R. G. (1992) · Cited by 561 · see citing works
What literature review is not: diversity, boundaries and recommendations
Rowe, F. (2014) · European Journal of Information Systems · doi:10.1057/ejis.2014.7 · Cited by 547 · see citing works
Information Systems as a Reference Discipline1
Baskerville, R., & Myers, M. D. (2002) · MIS Quarterly · doi:10.2307/4132338 · Cited by 541 · see citing works
Evidence-Based Management: Concept Cleanup Time?
Briner, R. B., Denyer, D., & Rousseau, D. M. (2009) · Academy of Management Perspectives · doi:10.5465/amp.2009.45590138 · Cited by 539 · see citing works
Guidelines for reading literature reviews.
Oxman, A. D., & Guyatt, G. H. (1988) · Europe PMC (PubMed Central) · Cited by 492 · see citing works
(2006) · PubMed · Cited by 485 · see citing works
Systematic Reviews: Checklists for review articles
Oxman, A. D. (1994) · BMJ · doi:10.1136/bmj.309.6955.648 · Cited by 480 · see citing works
Joseph, D., Ng, K.-Y., Koh, C., & Ang, S. (2007) · MIS Quarterly · doi:10.2307/25148807 · Cited by 468 · see citing works
Meta-Synthesis of Qualitative Case Studies
Hoon, C. (2013) · Organizational Research Methods · doi:10.1177/1094428113484969 · Cited by 426 · see citing works
Contemporary Trends and Issues in it Adoption and Diffusion Research
Williams, M. D., Dwivedi, Y. K., Lal, B., & Schwarz, A. (2009) · Journal of Information Technology · doi:10.1057/jit.2008.30 · Cited by 356 · see citing works
Research synthesis and meta-analysis: A step-by-step approach (4th ed.).
Cooper, H. M. (2010) · Cited by 335 · see citing works
Combining Evidence in Nursing Research
Whittemore, R. (2005) · Nursing Research · doi:10.1097/00006199-200501000-00008 · Cited by 330 · see citing works
Understanding the Role and Methods of Meta-Analysis in IS Research
King, W. R., & He, J. (2005) · Communications of the Association for Information Systems · doi:10.17705/1cais.01632 · Cited by 318 · see citing works
Progress in Evidence-Based Medicine
Montori, V. M. (2008) · JAMA · doi:10.1001/jama.300.15.1814 · Cited by 315 · see citing works
Rundall, T. G. (2007) · PubMed · Cited by 268 · see citing works
Mapping the Mixed Methods–Mixed Research Synthesis Terrain
Sandelowski, M., Voils, C. I., Leeman, J., & Crandell, J. (2011) · Journal of Mixed Methods Research · doi:10.1177/1558689811427913 · Cited by 266 · see citing works
Robey, D., Im, G. P., Wareham, J. D., & ESADE (2008) · Journal of the Association for Information Systems · doi:10.17705/1jais.00171 · Cited by 259 · see citing works
Towards Rigor in Reviews of Multivocal Literatures: Applying the Exploratory Case Study Method
Ogawa, R. T., & Malen, B. (1991) · Review of Educational Research · doi:10.3102/00346543061003265 · Cited by 247 · cited 5× · see citing works
“According to Oxman and Guyatt (1988), “important aspects of the design and conduct of each primary study should be critiqued and the standard used in these critiques made explicit” (p.”
InfluentialA systematic assessment of rigor in information systems ranking-type Delphi studies
Paré, G., Cameron, A., Poba‐Nzaou, P., & Templier, M. (2013) · Information & Management · doi:10.1016/j.im.2013.03.003 · Cited by 245 · see citing works
Self-citationKirkevold, M. (1997) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.1997.1997025977.x · Cited by 243 · see citing works
Hauge, Ø., Ayala, C. P., & Conradi, R. (2010) · Information and Software Technology · doi:10.1016/j.infsof.2010.05.008 · Cited by 238 · see citing works
What's the Evidence on Evidence-Based Management?
Reay, T., Berta, W. B., & Kohn, M. K. (2009) · Academy of Management Perspectives · doi:10.5465/amp.2009.45590137 · Cited by 217 · see citing works
Evidence-Based Management: Concept Cleanup Time?
Briner, R. B., Denyer, D., & Rousseau, D. M. (2009) · Academy of Management Perspectives · doi:10.5465/amp.23.4.19 · Cited by 194 · see citing works
Some Notes on the Terms ‘Validity’ and ‘Reliability’ [1]
Hammersley, M. (1987) · British Educational Research Journal · doi:10.1080/0141192870130107 · Cited by 192 · see citing works
A systematic, tool-supported method for conducting literature reviews in information systems
Bandara, W., Miskon, S., & Fielt, E. (2011) · QUT ePrints (Queensland University of Technology) · Cited by 185 · see citing works
Small firm e‐business adoption: a critical analysis of theory
Parker, C. M., & Castleman, T. (2009) · Journal of Enterprise Information Management · doi:10.1108/17410390910932812 · Cited by 173 · see citing works
Strategies for the construction of a critical review of the literature
Carnwell, R., & Daly, W. M. (2001) · Nurse Education in Practice · doi:10.1054/nepr.2001.0008 · Cited by 151 · see citing works
Tech, V., Bélanger, F., & Carter, L. D. (2012) · Journal of the Association for Information Systems · doi:10.17705/1jais.00295 · Cited by 141 · see citing works
Understanding frameworks and reviews
Schwarz, A., Mehta, M., Johnson, N., & Chin, W. W. (2007) · ACM SIGMIS Database the DATABASE for Advances in Information Systems · doi:10.1145/1278253.1278259 · Cited by 121 · see citing works
Reliability and Validity Issues in Phenomenological Research
Beck, C. T., Keddy, B. A., & Cohen, M. Z. (1994) · Western Journal of Nursing Research · doi:10.1177/019394599401600303 · Cited by 104 · see citing works
Where are we at with Cloud Computing?: A Descriptive Literature Review
Yang, H., & Tate, M. (2009) · Journal of the Association for Information Systems · Cited by 68 · see citing works
A Theoretical Review of Management and Information Systems Using a Critical Communications Theory
Varey, R. J., Wood‐Harper, T., & Wood, B. (2002) · Journal of Information Technology · doi:10.1080/0268396022000017725 · Cited by 57 · see citing works
Meta-Synthesis of Qualitative Case Studies: An Approach to Theory Building
Hoon, C., & Hoon, C. (2016) · SAGE Publications Ltd eBooks · doi:10.4135/9781473915480.n57 · Cited by 48 · see citing works
Towards a Framework of Literature Review Process in Support of Information Systems Research
Levy, Y. M., & Ellis, T. J. (2006) · Informing Science and IT Education Conference · doi:10.28945/2980 · Cited by 39 · see citing works
A Comprehensive Review of Research in IT Adoption
Liu, Z., Min, Q., & Ji, S. (2008) · 2008 4th International Conference on Wireless Communications, Networking and Mobile Computing · doi:10.1109/wicom.2008.2808 · Cited by 30 · see citing works
Introducing MISQ review: a new department in MIS quarterly
Watson, R. T. (2001) · Journal of the Association for Information Systems · Cited by 24 · see citing works
Reclaiming Knowledge: A Case for Evidence Based Information Systems
Atkins, C., & Louw, G. (2000) · Journal of the Association for Information Systems · Cited by 22 · see citing works
EVIDENCE-BASED INFORMATION SYSTEMS: A DECADE LATER
Oates, B. J. (2011) · Journal of the Association for Information Systems · Cited by 21 · see citing works
The 'Holy Trinity' of Methodological Rigor: A Skeptical View
Coryn, C. L. S. (2007) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v4i7.7 · Cited by 21 · see citing works
A MODEL -DRIVEN METHOD FOR THE SYSTEMATIC LITERATURE REVIEW OF QUALITATIVE EMPIRICAL RESEARCH
Oates, B. J., Edwards, H. E., & Wainwright, D. (2012) · Sunderland Repository (University of Sunderland) · Cited by 14 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- Garfield, E. (1982). ISI's "new" index to scientific reviews: Applying Research front specialty searching to the retrieval of the review literature. Current Contents, 39, 5-12.
- Oxman, A. D. (1994). Checklists for review articles. British Medical Journal, 309(6955), 648-651.
- Paré, G., Trudel, M. C., & Jaana, M. (2012). Stand-alone literature reviews in information systems research: Development of a taxonomy of review types and assessment of current practices. Paper presented at the Proceedings of the 2012 ASAC Conference-Information Systems Division, St John's, Canada.
- Wu, J., & Lederer, A. (2009). A meta-analysis of the role of environment-based voluntariness in information technology acceptance. MIS Quarterly, 33(2), 419-432.
Cited by
Sorted by citations
Guidance on Conducting a Systematic Literature Review
Xiao, Y., & Watson, M. (2019) · Journal of Planning Education and Research · doi:10.1177/0739456x17723971 · Cited by 3,467 · see citing works
Artificial Intelligence and Business Value: a Literature Review
Enholm, I. M., Papagiannidis, E., Mikalef, P., & Krogstie, J. (2022) · Information Systems Frontiers · doi:10.1007/s10796-021-10186-w · Cited by 1,046 · see citing works
“We therefore perform a systematic collection of the extant literature, and put forward a narrative review by summarizing the existing body of literature and providing a comprehensive report which guides future studies (Templier & Paré, 2015).”
MethodResponsible Artificial Intelligence Governance: A Review and Research Framework
Papagiannidis, E., Mikalef, P., & Conboy, K. (2025) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2024.101885 · Cited by 565 · see citing works
Responsible AI for Digital Health: a Synthesis and a Research Agenda
Trocin, C., Mikalef, P., Papamitsiou, Z., & Conboy, K. (2023) · Information Systems Frontiers · doi:10.1007/s10796-021-10146-4 · Cited by 205 · see citing works
Templier, M., & Paré, G. (2018) · European Journal of Information Systems · doi:10.1080/0960085x.2017.1398880 · Cited by 180 · see citing works
Self-citationFrom explainable to interactive AI: A literature review on current trends in human-AI interaction
Raees, M., Meijerink, I., Lykourentzou, I., Khan, V.-J., & Papangelis, K. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103301 · Cited by 180 · see citing works
Review and Theory Symbiosis: An Introspective Retrospective
Baylor University and Lund University, & Leidner, D. (2018) · Journal of the Association for Information Systems · doi:10.17705/1jais.00501 · Cited by 102 · see citing works
Leong, L.-Y., Hew, T.-S., Ooi, K.-B., Metri, B., & Dwivedi, Y. K. (2023) · Information Systems Frontiers · doi:10.1007/s10796-022-10337-7 · Cited by 80 · see citing works
“3 was applied in this study to gather the pertinent data (Cram et al., 2020; Templier & Paré, 2015).”
MethodDigital Health Solutions for Weight Loss and Obesity: A Narrative Review
Irvin, L., Madden, L. A., Marshall, P., & Vince, R. V. (2023) · Nutrients · doi:10.3390/nu15081858 · Cited by 34 · see citing works
“We followed previously established frameworks for conducting a narrative literature review [23,24].”
MethodTrojan, M., Koutný, M., Brtnický, M., Holátko, J., Zlámalová Gargošová, H., Fojt, J., Procházková, P., Kalčíková, G., & Kučerík, J. (2024) · Applied Sciences · doi:10.3390/app14114643 · Cited by 23 · see citing works
Arendsen, J. L., Brugman, B. C., van Koningsbruggen, G. M., & Fransen, M. L. (2025) · International Journal of Consumer Studies · doi:10.1111/ijcs.70056 · Cited by 4 · see citing works
“…from as many journals as possible (Paul and Criado 2020) and in the form of other types of publications (i.e., books/book chapters, conference proceedings, dissertations; Xiao and Watson 2019) to minimize publication bias risks (Paul and Criado 2020; Templier and Paré 2015; Xiao and Watson 2019).”
- Authors
- Templier, M., & Paré, G.
- Affiliations
- HEC Montréal (CA)
- Corresponding author
- Templier, Mathieu
- Venue
- Communications of the Association for Information Systems
- Publisher
- Association for Information Systems
- Published
- 2015
- Volume
- 37
- ISSN
- 1529-3181 (ISSN-L)
- OpenAlex
- W1198309811
- Cited by
- 553
- References
- 88
- Citations by year
- 2026: 38 · 2025: 73 · 2024: 98 · 2023: 97 · 2022: 71 · 2021: 75 · 2020: 45 · 2019: 31 · 2018: 13 · 2017: 6 · 2016: 6
- FWCI
- 7.59
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Communications of the Association for Information Systems (publishedVersion)
- Journal of the Association for Information Systems (submittedVersion)
- Corpus Université Laval (Université Laval) (submittedVersion)
- Funders
- Fonds de Recherche du Québec-Société et Culture
- HEC Montréal
- Social Sciences and Humanities Research Council of Canada
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Academic Writing and Publishing
- Social Sciences › Sociology and Political Science › Information Systems Theories and Implementation
- Keywords
- information systems research, review types, research rigor, knowledge synthesis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
