The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Common Method Variance in IS Research: A Comparison of Alternative Approaches and a Reanalysis of Past Research
Abstract
Despite recurring concerns about common method variance (CMV) in survey research, the information systems (IS) community remains largely uncertain of the extent of such potential biases. To address this uncertainty, this paper attempts to systematically examine the impact of CMV on the inferences drawn from survey research in the IS area. First, we describe the available approaches for assessing CMV and conduct an empirical study to compare them. From an actual survey involving 227 respondents, we find that although CMV is present in the research areas examined, such biases are not substantial. The results also suggest that few differences exist between the relatively new marker-variable technique and other well-established conventional tools in terms of their ability to detect CMV. Accordingly, the marker-variable technique was employed to infer the effect of CMV on correlations from previously published studies. Our findings, based on the reanalysis of 216 correlations, suggest that the inflated correlation caused by CMV may be expected to be on the order of 0.10 or less, and most of the originally significant correlations remain significant even after controlling for CMV. Finally, by extending the marker-variable technique, we examined the effect of CMV on structural relationships in past literature. Our reanalysis reveals that contrary to the concerns of some skeptics, CMV-adjusted structural relationships not only remain largely significant but also are not statistically differentiable from uncorrected estimates. In summary, this comprehensive and systematic analysis offers initial evidence that (1) the marker-variable technique can serve as a convenient, yet effective, tool for accounting for CMV, and (2) common method biases in the IS domain are not as serious as those found in other disciplines.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evaluating Structural Equation Models with Unobservable Variables and Measurement Error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.2307/3151312 · Cited by 109,314
Evaluating structural equation models with unobservable variables and measurement error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800104 · Cited by 109,190
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
User Acceptance of Information Technology: Toward A Unified View1
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003) · MIS Quarterly · doi:10.2307/30036540 · Cited by 45,035
On the Evaluation of Structural Equation Models
Bagozzi, R. P., & Yi, Y. (1988) · Journal of the Academy of Marketing Science · doi:10.1007/bf02723327 · Cited by 26,163
Statistical Power Analysis for the Behavioral Sciences
Cohen, J. (2013) · doi:10.4324/9780203771587 · Cited by 25,373
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
Self-Reports in Organizational Research: Problems and Prospects
Podsakoff, P. M., & Organ, D. W. (1986) · Journal of Management · doi:10.1177/014920638601200408 · Cited by 17,102
Moore, G. C., & Benbasat, I. (1991) · Information Systems Research · doi:10.1287/isre.2.3.192 · Cited by 9,150
Understanding Information Systems Continuance: An Expectation-Confirmation Model1
Bhattacherjee, A. (2001) · MIS Quarterly · doi:10.2307/3250921 · Cited by 8,767
Trust and TAM in Online Shopping: An Integrated Model1
Gefen, D., Karahanna, E., & Straub, D. W. (2003) · MIS Quarterly · doi:10.2307/30036519 · Cited by 8,635
Venkatesh, V. (2000) · Information Systems Research · doi:10.1287/isre.11.4.342.11872 · Cited by 6,664
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Agarwal, R., & Karahanna, E. (2000) · MIS Quarterly · doi:10.2307/3250951 · Cited by 4,726
Empirical Evaluation of the Revised Technology Acceptance Model
Szajna, B. (1996) · Management Science · doi:10.1287/mnsc.42.1.85 · Cited by 1,656
Lack of method variance in self-reported affect and perceptions at work: reality or artifact?
Williams, L. J., Cote, J. A., & Buckley, M. R. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.3.462 · Cited by 1,616
Venkatesh, V., Morris, M. G., & Ackerman, P. L. (2000) · Organizational Behavior and Human Decision Processes · doi:10.1006/obhd.2000.2896 · Cited by 1,237
Research works printed but not linked: 46
- 10.1177/014920639101700303 · DOI · Paper page
- Bagozzi R. P., 1980, Causal Models in Marketing
- 10.1002/9781118619179 · DOI · Paper page
- 10.1509/jmkr.38.4.494.18901 · DOI · Paper page
- 10.1177/0013164490503001 · DOI · Paper page
- 10.1287/isre.12.3.304.9708 · DOI · Paper page
- 10.2307/3151642 · doi:10.2307/3151642 · Paper page
- 10.1086/209137 · DOI
- 10.1037/0021-9010.79.1.67 · doi:10.1037/0021-9010.79.1.67 · Paper page
- 10.1287/mnsc.35.8.982 · DOI · Paper page
- 10.1037/0021-9010.73.3.421 · doi:10.1037/0021-9010.73.3.421 · Paper page
- 10.2307/255979 · DOI · Paper page
- Gefen D., 2003, Comm. Association Inform. Systems, 12, 1
- Gefen D., 2000, Comm. Association Inform. Systems, 7, 1
- Hair J. F., 1998, Multivariate Data Analysis
- 10.1006/obhd.1996.0103 · DOI · Paper page
- 10.1287/isre.5.1.48 · DOI · Paper page
- Jonsson Y., 1998, Interaction and Nonlinear Effects in Structural Equation Modeling, 17
- Jöreskog K. G., 1998, Interaction and Nonlinear Effects in Structural Equation Modeling, 239
- Jöreskog K., 1996, LISREL8: User’s Reference Guide
- 10.1177/0092070399273001 · DOI · Paper page
- 10.1177/014920638601200407 · DOI
- 10.1287/mnsc.1040.0326 · DOI · Paper page
- 10.1287/isre.13.2.205.83 · DOI · Paper page
- 10.1177/014662168801200205 · DOI · Paper page
- 10.1037/0021-9010.85.3.331 · doi:10.1037/0021-9010.85.3.331 · Paper page
- 10.1037/0021-9010.86.1.114 · DOI · Paper page
- 10.1080/00913367.1982.10672822 · DOI
- Malhotra N. K., 2004, Marketing Research: An Applied Orientation
- 10.1287/isre.1040.0032 · DOI · Paper page
- 10.1037/0021-9010.73.1.107 · DOI · Paper page
- 10.1037/0021-9010.75.3.350 · DOI
- Mossholder K. W., 1998, J. Management, 24, 533
- 10.1086/209204 · DOI · Paper page
- 10.1287/isre.12.2.208.9697 · DOI · Paper page
- 10.1177/014920638501100106 · DOI
- 10.1016/S0305-0483(96)00051-5 · DOI · Paper page
- 10.2307/249477 · DOI · Paper page
- 10.1037/0021-9010.72.3.438 · doi:10.1037/0021-9010.72.3.438 · Paper page
- 10.2307/248922 · DOI · Paper page
- 10.17705/1CAIS.01324 · DOI · Paper page
- 10.1287/mnsc.46.2.186.11926 · DOI · Paper page
- Wells W., 1971, J. Advertising Res., 11, 27
- 10.1037/0021-9010.79.3.323 · doi:10.1037/0021-9010.79.3.323 · Paper page
- 10.1006/obhd.1994.1011 · DOI · Paper page
- Woszczynski A. B., 2001, Proc. 7th Americas Conf. on Inform. Systems, 1643
Cited by
Venkatesh, V., Thong, J. Y. L., & Xu, X. (2012) · MIS Quarterly · doi:10.2307/41410412 · Cited by 15,756
Technology Acceptance Model 3 and a Research Agenda on Interventions
Venkatesh, V., & Bala, H. (2008) · Decision Sciences · doi:10.1111/j.1540-5915.2008.00192.x · Cited by 8,159
Common methods variance detection in business research
Fuller, C. M., Simmering, M. J., Atinc, G., Atinc, Y., & Babin, B. J. (2016) · Journal of Business Research · doi:10.1016/j.jbusres.2015.12.008 · Cited by 3,519
Ragu-Nathan, T. S., Tarafdar, M., Ragu-Nathan, B. S., & Tu, Q. (2008) · Information Systems Research · doi:10.1287/isre.1070.0165 · Cited by 2,060
Cross-Sectional versus longitudinal survey research: concepts, findings, and guidelines
Rindfleisch, A., Malter, A. J., Ganesan, S., & Moorman, C. (2008) · Journal of Marketing Research · doi:10.1509/jmkr.45.3.261 · Cited by 1,305
Metadata
- Authors
- Malhotra, N. K., Kim, S. S., & Patil, A.
- Venue
- Management Science
- Published
- 2006-12
- Volume
- 52
- Issue
- 12
- Pages
- 1865-1883
- ISSN
- 0025-1909 (ISSN-L)
- 1526-5501
- OpenAlex
- W2171515724
- Cited by
- 3,220
- References
- 18
- FWCI
- 115.28
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.