CoChat

Meta-analysis in information systems research: Review and recommendations

Open access
Jeyaraj, Anand, Dwivedi, Yogesh K. · 2020 · International Journal of Information Management
Cited by 105

The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.

Abstract

Abstract Meta-analysis has gained considerable momentum in information systems (IS) research over the last two decades. As the IS discipline has matured and grappled with various applications of information technology (IT) tools, meta-analysis has served as a powerful mechanism to enable the synthesis of prior findings, reconciliation of inconsistent findings, and resolution of relationships. Prior meta-analysis studies in IS have employed derived metrics and reported effect sizes in both exploratory and confirmatory approaches, and also conducted descriptive analysis, comparison of subgroup means, regression, and structural equation modeling methods. This paper conducts a review of prior meta-analysis studies published since 2000 using a 2 × 2 framework and identifies the state of meta-analysis research in IS. The challenges in conducting meta-analysis research and the opportunities for meta-analysis research in IS are also identified. Based on the challenges, several recommendations to handle publication bias, inclusion and exclusion of studies, effect sizes, coding, meta-analysis modeling, and sensitivity analysis are provided. Opportunities for meta-analysis such as clarifying constructs and relationships, identifying contingencies, and testing theories to advance IS research are also identified.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.ijinfomgt.2020.102226

Cites

33 of 33 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 33 references

Research works printed but not linked: 105

  1. Ada, 2012, Impact of meta-analytic decisions on the conclusions drawn on the business value of information technology, Decision Support Systems, 54, 521, 10.1016/j.dss.2012.07.001 · DOI
  2. Adams, 1992, Perceived usefulness, ease of use, and usage of information technology: A replication, MIS Quarterly, 16, 227, 10.2307/249577 · DOI · Paper page
  3. Alaghehband, 2011, An assessment of the use of trasaction cost theory in information technology outsourcing, Journal of Strategic Information Systems, 20, 125, 10.1016/j.jsis.2011.04.003 · DOI
  4. Al-Emran, 2018, The impact of knowledge management processes on information systems: A systematic review, International Journal of Information Management, 43, 173, 10.1016/j.ijinfomgt.2018.08.001 · DOI · Paper page
  5. Asadi, 2017, Organizational research in the field of green IT: A systematic literature review from 2007 to 2016, Telematics and Informatics, 34, 1191, 10.1016/j.tele.2017.05.009 · DOI
  6. Balijepally, 2011, Are we wielding this hammer correctly? A reflective review of the application of cluster analysis in information systems research, Journal of the Association for Information Systems, 12, 375, 10.17705/1jais.00266 · DOI
  7. Baptista, 2016, A weight and a meta-analysis on mobile banking acceptance research, Computers in Human Behavior, 63, 480, 10.1016/j.chb.2016.05.074 · DOI · Paper page
  8. Baptista, 2019, Gamification and serious games: A literature meta-analysis and integrative model, Computers in Human Behavior, 92, 306, 10.1016/j.chb.2018.11.030 · DOI · Paper page
  9. Becker, 2007, The synthesis of regression slopes in meta-analysis, Statistical Science, 22, 414, 10.1214/07-STS243 · DOI · Paper page
  10. Berente, 2019, Institutional logics and pluralistic responses to enterprise system implementation: A qualitative meta-analysis, MIS Quarterly, 43, 873, 10.25300/MISQ/2019/14214 · DOI
  11. Bokhari, 2005, The relationship between system usage and user satisfaction: A meta-analysis, Journal of Enterprise Information Management, 18, 211, 10.1108/17410390510579927 · DOI · Paper page
  12. Burton-Jones, 2006, Reconceptualizing system usage: An approach and empirical test, Information Systems Research, 17, 228, 10.1287/isre.1060.0096 · DOI · Paper page
  13. Cane, 2009, Analyzing the factors that affect information systems use: A task-technology fit meta-analysis, Journal of Computer Information Systems, 50, 108
  14. Chau, 1999, On the use of construct reliability in MIS research: A meta-analysis, Information & Management, 4, 217, 10.1016/S0378-7206(98)00089-5 · DOI
  15. Cho, 2001, Critical factors for assimilation of object-oriented programming languages, Journal of Management Information Systems, 18
  16. Chu, 2019, A systematic review on cross-cultural information systems research: Evidence from the last decade, Information & Management, 56, 403, 10.1016/j.im.2018.08.001 · DOI
  17. Claver, 2000, An analysis of research in information systems (1981-1997), Information & Management, 37, 181, 10.1016/S0378-7206(99)00043-9 · DOI · Paper page
  18. Cognini, 2018, Business process flexibility — a systematic literature review with a software systems perspective, Information Systems Frontiers, 20, 343, 10.1007/s10796-016-9678-2 · DOI
  19. Cram, 2019, Seeing the forest and the trees: A meta-analysis of the antecedents to information security policy compliance, MIS Quarterly, 43, 525, 10.25300/MISQ/2019/15117 · DOI · Paper page
  20. Dennis, 2001, Investigating the moderators of the group support systems use with meta-analysis, Journal of Management Information Systems, 18, 235, 10.1080/07421222.2002.11045696 · DOI · Paper page
  21. Dennis, 2001, Understanding fit and appropriation effects in group support systems via meta-analysis, MIS Quarterly, 25, 167, 10.2307/3250928 · DOI · Paper page
  22. Eisend, 2019, Explaining digital piracy: A meta-analysis, Information Systems Research, 10.1287/isre.2018.0821 · DOI
  23. Evangelopoulos, 2016, Thematic orientation of the ISJ within a semantic space of IS research, Information Systems Journal, 26, 39, 10.1111/isj.12084 · doi:10.1111/isj.12084
  24. Gallivan, 2015, Co-authorship, homophily, and scholarly influence in information systems research, Journal of the Association for Information Systems, 16, 980, 10.17705/1jais.00416 · DOI
  25. Ghasemaghaei, 2015, Online information quality and consumer satisfaction: The moderating roles of contextual factors — A meta-analysis, Information & Management, 52, 965, 10.1016/j.im.2015.07.001 · DOI
  26. Glass, 2004, An analysis of research in computing disciplines, Communications of the ACM, 47, 89, 10.1145/990680.990686 · DOI · Paper page
  27. Guzzo, 1987, Meta-analysis analysis, Research in Organizational Behavior, 9, 407
  28. Hameed, 2012, A meta-analysis of relationships between organizational characteristics and IT innovation adoption in organizations, Information & Management, 49, 218, 10.1016/j.im.2012.05.002 · DOI · Paper page
  29. Hannay, 2009, The effectiveness of pair programming: A meta-analysis, Information and Software Technology, 51, 1110, 10.1016/j.infsof.2009.02.001 · DOI · Paper page
  30. He, 2008, The role of user participation in information systems development: Implications from a meta-analysis, Journal of Management Information Systems, 25, 301, 10.2753/MIS0742-1222250111 · DOI · Paper page
  31. Henningsson, 2018, A review of information system integration in mergers and acquisitions, Journal of Information Technology, 33, 255, 10.1057/s41265-017-0051-9 · DOI
  32. Hess, 2014, Reliability generalization of perceived ease of use, perceived usefulness, and behavioral intentions, MIS Quarterly, 38, 1, 10.25300/MISQ/2014/38.1.01 · DOI · Paper page
  33. Hong, 2017, “Understanding the Determinants of Online Review Helpfulness: A Meta-analytic Investigation,”, Decision Support Systems, 102, 1, 10.1016/j.dss.2017.06.007 · DOI · Paper page
  34. Huang, 2015, A study of research collaboration in the pre-web and post-web stages: A coauthorship analysis of the information systems discipline, Journal of the Association for Information Science and Technology, 66, 778, 10.1002/asi.23196 · DOI
  35. Huffcutt, 1995, Development of new outlier statistic for meta-analytic data, Journal of Applied Psychology, 80, 327, 10.1037/0021-9010.80.2.327 · doi:10.1037/0021-9010.80.2.327 · Paper page
  36. Hwang, 2014, Disentangling the effect of top management support and training on systems implementation success: A meta-analysis, Communications of the Association for Information Systems, 35, 19
  37. Hwang, 2011, Assessing moderating effect in meta-analysis: A re-analysis of top management support studies and suggestions for researchers, European Journal of Information Systems, 20, 693, 10.1057/ejis.2011.12 · DOI
  38. Hwang, 2000, Building a knowledge base for MIS research: A meta-analysis of a systems success model, Information Resources Management Journal, 13, 26, 10.4018/irmj.2000040103 · DOI
  39. Ismagilova, 2019, The effect of electronic word of mouth communications on intention to buy: A meta-analysis, Information Systems Frontiers
  40. Ismagilova, 2020, The effect of characteristics of source credibility on consumer behavior: A meta-analysis, Journal of Retailing and Consumer Services, 10.1016/j.jretconser.2019.01.005 · DOI · Paper page
  41. Jeyaraj, 2020, Variation in the effect of system usage and individual impact: A meta-regression of empirical findings, Information & Management, 10.1016/j.im.2019.103242 · DOI
  42. Jeyaraj, 2020, DeLone & McLean models of information system success: Critical meta-review and research directions, International Journal of Information Management, 10.1016/j.ijinfomgt.2020.102139 · DOI · Paper page
  43. Jeyaraj, 2020, Evolution of information systems research: Insights from topic modeling, Information & Management, 10.1016/j.im.2019.103207 · DOI
  44. Kapoor, 2014, Innovation adoption attributes: A review and synthesis of research findings, European Journal of Innovation Management, 17, 327, 10.1108/EJIM-08-2012-0083 · DOI · Paper page
  45. Kapoor, 2014, Rogers’ innovation adoption attributes: A systematic review and synthesis of existing research, Information Systems Management, 31, 74, 10.1080/10580530.2014.854103 · DOI · Paper page
  46. Kepes, 2018, Assessing the robustness of meta-analytic results in information systems: Publication bias and outliers, European Journal of Information Systems, 27, 90, 10.1080/0960085X.2017.1390188 · DOI
  47. King, 2005, Understanding the role and methods of meta-analysis in IS research, Communications of the Association for Information Systems, 16, 665
  48. Kohli, 2003, Measuring information technology payoff: A meta-analysis of structural variables in firm-level empirical research, Information Systems Research, 14, 127, 10.1287/isre.14.2.127.16019 · DOI · Paper page
  49. Kroenung, 2015, The attitude cube — a three-dimensional model of situational factors in IS adoption and their impact on the attitude-behavior relationship, Information & Management, 52, 611, 10.1016/j.im.2015.05.002 · DOI
  50. Lacity, 2016, Review of the empirical business services outsourcing literature: An update and future directions, Journal of Information Technology, 31, 269, 10.1057/jit.2016.2 · DOI
  51. Lacity, 2010, A review of the IT outsourcing empirical literature and future research directions, Journal of Information Technology, 25, 395, 10.1057/jit.2010.21 · DOI · Paper page
  52. Lacity, 2011, Business process outsourcing studies: A critical review and research directions, Journal of Information Technology, 26, 221, 10.1057/jit.2011.25 · DOI · Paper page
  53. Lamb, 2018, A meta-analysis with examination of moderators of student cognition, affect, and learning outcomes while using serious educational games, serious games, and simulations, Computers in Human Behavior, 80, 158, 10.1016/j.chb.2017.10.040 · DOI · Paper page
  54. Larsen, 2016, A tool for addresing construct identify in literature reviews and meta-analyses, MIS Quarterly, 40, 529, 10.25300/MISQ/2016/40.3.01 · DOI · Paper page
  55. Larsen, 2005, Searching for management information systems: Coherence and change in the discipline, Information Systems Journal, 15, 357, 10.1111/j.1365-2575.2005.00202.x · DOI
  56. Larsen, 2008, Analyzing unstructured text data: Using latent categorization to identify intellectual communities in information systems, Decision Support Systems, 45, 884, 10.1016/j.dss.2008.02.009 · DOI
  57. Lee, 2006, Organizational size and IT innovation adoption: A meta-analysis, Information & Management, 43, 975, 10.1016/j.im.2006.09.003 · DOI · Paper page
  58. Lim, 2011, A meta-analysis of the effects of IT investment on firm financial performance, Journal of Information Systems, 25, 145, 10.2308/isys-10125 · DOI
  59. Love, 2016, Reflections of information system journal’s thematic composition, Information Systems Journal, 26, 21, 10.1111/isj.12085 · doi:10.1111/isj.12085
  60. Lowry, 2013, Evaluating journal quality and the association for information systems senior scholars’ journal basket via bibliometric measures: do expert journal assessments add value?, MIS Quarterly, 37, 993, 10.25300/MISQ/2013/37.4.01 · DOI · Paper page
  61. Lowry, 2017, Nature or nurture? A meta-analysis of the factors that maximize the prediction of digital piracy by social cognitive theory as a framework, Computers in Human Behavior, 68, 104, 10.1016/j.chb.2016.11.015 · DOI
  62. Mahmood, 2001, Factors affecting information technology usage: A meta-analysis of the empirical literature, Journal of Organizational Computing and Electronic Commerce, 11, 107, 10.1207/S15327744JOCE1102_02 · DOI · Paper page
  63. Mandrella, 2020, Synthesizing and integrating research on IT-based value creation: A meta-analysis, Journal of the Association for Information Systems, 21, 388, 10.17705/1jais.00606 · DOI
  64. Mangalaraj, 2020, Differential effects on assimilation stages for supply chain management information systems, Journal of Computer Information Systems, 60, 34, 10.1080/08874417.2017.1392267 · DOI
  65. Moore, 1991, Development of an instrument to measure the perceptions of adopting an information technology innovation, Information Systems Research, 2, 192, 10.1287/isre.2.3.192 · DOI · Paper page
  66. Narayanan, 2009, Electronic data interchange: Research review and future directions, Decision Sciences, 40, 121, 10.1111/j.1540-5915.2008.00218.x · DOI
  67. Ortiz de Guinea, 2012, A meta-analysis of the consequences of virtualness on team functioning, Information & Management, 49, 301, 10.1016/j.im.2012.08.003 · DOI · Paper page
  68. Palvia, 2015, Methodological and topic trends in information systems research: A meta-analysis of IS journals, Communications of the Association for Information Systems, 37, 630
  69. Petter, 2009, A meta-analytics assessment of the DeLone and McLean IS success model: An examination of IS success at the individual level, Information & Management, 46, 159, 10.1016/j.im.2008.12.006 · DOI · Paper page
  70. Petter, 2013, Information system success: The quest for the independent variables, Journal of Management Information Systems, 29, 7, 10.2753/MIS0742-1222290401 · DOI · Paper page
  71. Qahri-Saremi, 2019, Factors affecting the adoption of an electronic word of mouth message: A meta-analysis, Journal of Management Information Systems, 36, 969, 10.1080/07421222.2019.1628936 · DOI
  72. Rai, 2009, “Organizational Assimilation of Electronic Procurement Innovations,”, Journal of Management Information Systems, 26, 257, 10.2753/MIS0742-1222260110 · DOI · Paper page
  73. Rai, 2006, “Assimilation Patterns in the Use of Electronic Procurement Innovations: A Cluster Analysis,”, Information & Management, 43, 336, 10.1016/j.im.2005.08.005 · DOI
  74. Raghuram, 2010, Mapping the field of virtual work: A cocitation analysis, Information Systems Research, 21, 983, 10.1287/isre.1080.0227 · DOI · Paper page
  75. Rana, 2015, A meta-analysis of existing research on citizen adoption of e-Government, Information Systems Frontiers, 17, 547, 10.1007/s10796-013-9431-z · DOI · Paper page
  76. Roberts, 2017, A meta-analysis of organizational learning and IT assimilation, Data Base for Advances in Information Systems, 48, 51, 10.1145/3158421.3158426 · DOI
  77. Rosenthal, 1979, The file drawer problem and tolerance for null results, Psychological Bulletin, 86, 638, 10.1037/0033-2909.86.3.638 · DOI · Paper page
  78. Roth, 2018, Using Beta coefficients to impute missing correlations in meta-analysis research: Reasons for caution, The Journal of Applied Psychology, 103, 644, 10.1037/apl0000293 · DOI · Paper page
  79. Sabherwal, 2001, Alignment between business and IS strategies: A study of prospectors, analyzers, and defenders, Information Systems Research, 12, 11, 10.1287/isre.12.1.11.9714 · DOI · Paper page
  80. Santhanam, 2000, Empirical investigation of ODSS impact on individuals and organizations, Decision Support Systems, 30, 51, 10.1016/S0167-9236(00)00089-0 · DOI
  81. Schepers, 2007, A meta-analysis of the technology acceptance model: Investigating subjective norm and moderation effects, Information & Management, 44, 90, 10.1016/j.im.2006.10.007 · DOI · Paper page
  82. Schermann, 2016, The role of transaction cost economics in information technology outsourcing research: A meta-analysis of the choice of contract type, Journal of Strategic Information Systems, 25, 32, 10.1016/j.jsis.2016.02.004 · DOI
  83. Sethi, 1994, Development of measures to assess the extent to which an information technology application provides competitive advantage, Management Science, 40, 1601, 10.1287/mnsc.40.12.1601 · DOI · Paper page
  84. Sharma, 2011, Top management support and IS implementation: Further support for the moderating role of task interdependence, European Journal of Information Systems, 20, 703, 10.1057/ejis.2011.39 · DOI
  85. Sidorova, 2008, Uncovering the intellectual core of the information systems discipline, MIS Quarterly, 32, 467, 10.2307/25148852 · DOI · Paper page
  86. Swanson, 1994, “Information Systems Innovation among Organizations,”, Management Science, 40, 553, 10.1287/mnsc.40.9.1069 · DOI · Paper page
  87. Tamilmani, 2020, Consumer acceptance and use of information technology: A meta-analytic evaluation of UTAUT2, Information Systems Frontiers
  88. Tamilmani, 2019, The battle of brain vs. heart: a literature review and meta-analysis of "hedonic motivation" use in UTAUT2, International Journal of Information Management, 46, 222, 10.1016/j.ijinfomgt.2019.01.008 · DOI · Paper page
  89. Tao, 2020, A systematic review and meta-analysis of user acceptance of consumer-oriented health information technologies, Computers in Human Behavior, 10.1016/j.chb.2019.09.023 · DOI · Paper page
  90. Taylor, 2010, Focus and diversity in information systems research: Meeting the dual demands of a healthy applied discipline, MIS Quarterly, 34, 647, 10.2307/25750699 · DOI
  91. Trang, 2019, A meta-analysis of deterrence theory in information security policy compliance research, Information Systems Frontiers, 21, 1265, 10.1007/s10796-019-09956-4 · DOI
  92. Venkatesh, 2000, A theoretical extension of the technology acceptance model: Four longitudinal field studies, Management Science, 46, 186, 10.1287/mnsc.46.2.186.11926 · DOI · Paper page
  93. Venkatesh, 2003, User acceptance of information technology: Toward a unified view, MIS Quarterly, 27, 425, 10.2307/30036540 · DOI · Paper page
  94. Venkatesh, 2012, Consumer acceptance and use of information technology: Extending the unified theory of acceptance and use of technology, MIS Quarterly, 36, 157, 10.2307/41410412 · DOI · Paper page
  95. Vessey, 2002, Research in information systems: An empirical study of diversity in the discipline and its journals, Journal of Management Information Systems, 19, 129, 10.1080/07421222.2002.11045721 · DOI · Paper page
  96. Wang, 2007, A meta-analysis comparing the sunk cost effect for IT and non-IT projects, Information Resources Management Journal, 20, 1, 10.4018/irmj.2007070101 · DOI
  97. Weigel, 2014, Diffusion of innovations and the theory of planned behavior in information systems research: A metaanalysis, Communications of the Association for Information Systems, 34, 10.17705/1CAIS.03431 · DOI
  98. Wu, 2009, A meta-analysis of the role of environment-based voluntariness in information technology acceptance, MIS Quarterly, 33, 419, 10.2307/20650298 · DOI · Paper page
  99. Wu, 2013, Effects of extrinsic and intrinsic motivators on using utilitarian, hedonic, and dual-purposed information systems: A meta-analysis, Journal of the Association for Information Systems, 14, 153, 10.17705/1jais.00325 · DOI · Paper page
  100. Wu, 2018, Building up knowledge through meta-analysis: A review and reinterpretation, Journal of Information Technology Theory and Application, 19, 4
  101. Wu, 2011, A meta-analysis of the impact of trust on technology acceptance model: Investigation of moderating influence of subject and context type, International Journal of Information Management, 31, 572, 10.1016/j.ijinfomgt.2011.03.004 · DOI · Paper page
  102. Yu, 2020, A meta-analysis to explore privacy cognition and information disclosure of internet users, International Journal of Information Management, 10.1016/j.ijinfomgt.2019.09.011 · DOI · Paper page
  103. Zhang, 2012, A meta-analysis of mobile commerce adoption and the moderating effect of culture, Computers in Human Behavior, 28, 1902, 10.1016/j.chb.2012.05.008 · DOI · Paper page
  104. Zhang, 2018, The relationships between Electronic Banking Adoption and its antecedents: A Meta-analytic study of the role of National Culture, International Journal of Information Management, 40, 76, 10.1016/j.ijinfomgt.2018.01.015 · DOI · Paper page
  105. Zhao, 2018, What factors influence the mobile health service adoption? A meta-analysis and the moderating role of age, International Journal of Information Management, 43, 342, 10.1016/j.ijinfomgt.2017.08.006 · DOI · Paper page

Cited by

See all 105

Metadata

Authors
Jeyaraj, A., & Dwivedi, Y. K.
Venue
International Journal of Information Management
Publisher
Elsevier BV
Published
2020-12
Volume
55
Pages
102226
ISSN
0268-4012 (ISSN-L)
OpenAlex
W3082582142
Cited by
105
References
33
FWCI
8.83
Type
journal article
Language
en
Open access
green
Licence
  • www.elsevier.com/tdm/userlicense/1.0/ (tdm)
  • www.elsevier.com/legal/tdmrep-license (tdm)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Meta-analysis in information systems research: Review and recommendations. https://app.cochat.ai/papers/10.1016/j.ijinfomgt.2020.102226
The paper
Jeyaraj, A., & Dwivedi, Y. K. (2020). Meta-analysis in information systems research: Review and recommendations. International Journal of Information Management. https://doi.org/10.1016/j.ijinfomgt.2020.102226

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.