CoChat
Sign Up
Cited by 2,797Information Systems Theories and ImplementationPsychometric Methodologies and TestingBusiness Strategies and Management Research

Validation Guidelines for IS Positivist Research

Open access
Straub, Detmar, Gefen, David·2004·Communications of the Association for Information Systems
DOI 10.17705/1cais.01324
Open this paper in CoChat — free accountOpen PDF

Abstract

The issue of whether IS positivist researchers were sufficiently validating their instruments was initially raised fifteen years ago and rigor in IS research is still one of the most critical scientific issues facing the field. Without solid validation of the instruments that are used to gather data on which findings and interpretations are based, the very scientific basis of the profession is threatened. This study builds on four prior retrospectives of IS research that conclude that IS positivist researchers continue to face major barriers in instrument, statistical, and other forms of validation. It goes beyond these studies by offering analyses of the state-of-the-art of research validities and deriving specific heuristics for research practice in the validities. Some of these heuristics will, no doubt, be controversial. But we believe that it is time for the IS academic profession to bring such issues into the open for community debate. This article is a first step in that direction. Based on our interpretation of the importance of a long list of validities, this paper suggests heuristics for reinvigorating the quest for validation in IS research via content/construct validity, reliability, manipulation validity, and statistical conclusion validity. New guidelines for validation and new research directions are offered.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.17705/1cais.01324

Cites

17 of 17 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Convergent validity was assessed by examining the Cronbach's alpha (>0.7), composite reliability (>0.7), average extracted variance (AVE) (>0.5), and factor analysis.

    “Convergent validity was assessed by examining the Cronbach's alpha ( > 0.7), composite reliability ( > 0.7), average extracted variance (AVE) ( > 0.5), and factor analysis [46].”

    From How Social Interaction Affects Purchase Intention in Social Commerce: A Cultural Perspective (2019) · cites this paper as [46]

    The Guidelines for Research Practice section lists factor analysis as a way to assess convergent validity and recommends Cronbach’s alpha above .70 for confirmatory research. The Reliability sections also discuss SEM composite consistency estimates. However, the cited passages treat alpha and composite reliability as reliability measures, and our copy does not establish the claimed composite-reliability >.7 or AVE >.5 thresholds for convergent validity. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

  • Survey-based research is important in exploratory settings and predictive theory to be able to generalize results.

    “Suggestions by Straub et al. [112] emphasize the importance of survey-based research in exploratory settings and predictive theory to be able to generalize results.”

    From Exploring the relationship between big data analytics capability and competitive performance: The mediating roles of dynamic and operational capabilities (2020) · cites this paper as [112]

    The Contingent Applicability section discusses exploratory research, and the External Validity section describes an instrument judged likely to generalize across sample groups (page numbers unavailable). But the paper does not recommend survey-based research as a way to generalize results in exploratory settings; it says predictive validity is beyond what many readers would require of exploratory work and is useful for mature research streams. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

  • Reliability coefficients were all above the minimum acceptable of 0.60 for exploratory research.

    “Reliability coefficients were all above the minimum acceptable of 0.60 for exploratory research [42].”

    From Evolving Medical Students’ Digital Health Perceptions and Intentions: Insights From a Prepandemic and Postpandemic Survey Study (2025) · cites this paper as [42]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 110

  1. Adams, D. A., R. R. Nelson, and P. A. Todd (1992) "Perceived Usefulness, Ease of Use, and Usage of Information Technology: A Replication," MIS Quarterly (16) 2, June, pp. 227- 248.
  2. Alwin, D. (1973-74) "Approaches to the Interpretation of Relationships in the Multitrait- Multimethod Matrix," Sociological Methodology pp. 79-105.
  3. Anderson, J. C., D. W. Gerbing, and J. E. Hunter (1987) "On the Assessment of Unidimensional Measurement: Internal and External Consistency, and Overall Consistency Criteria," Journal of Marketing Research (24pp. 432-437.
  4. Andrews, F. M. (1984) "Construct Validity and Error Components of Survey Measures: A Structural Modeling Approach," Public Opinion Quarterly (48) 2, Summer, pp. 409-442.
  5. Argyris, C. (1979) "Some Unintended Consequences of Rigorous Research," in R. T. Mowday and R. M. Steers (Eds.) Research in Organizations: Issues and Controversies, Santa Monica, CA: Goodyear, pp. 290-304.
  6. Armstrong, D., A. Gosling, J. Weinman, and T. Marteau (1997) "The Place of Inter-Rater Reliability in Qualitative Research: An Empirical Study," Sociology: The Journal of the British Sociological Association (31) 3, August, pp. 597-606.
  7. Avolio, B. J., F. J. Yammarino, and B. M. Bass (1991) "Unresolved Sticky Issue," Journal of Management (17) 3, September, pp. 571-587.
  8. Bagozzi, R. P. (1977) "Structural Equation Models in Experimental Research," Journal of Marketing Research (14pp. 209-236.
  9. Bagozzi, R. P. (1980) Causal Methods in Marketing. New York: John Wiley and Sons.
  10. C. Fornell (Ed.) A Second Generation of Mulivariate Analysis: Praeger, pp. 5-23.
  11. Bagozzi, R. P. and L. W. Phillips (1982) "Representing and Testing Organizational Theories: A Holistic Construal," Administrative Science Quarterly (27) 3, pp. 459-489.
  12. Bagozzi, R. P., Y. Yi, and L. W. Phillips (1991) "Assessing Construct Validity in Organizational Research," Administrative Science Quarterly (36) 3, September, pp. 421-458.
  13. Barki, H. and J. Hartwick (1994) "User Participation, Conflict, and Conflict Resolution: The Mediating Roles of Influence," Information Systems Research (5) 4, December, pp. 422- 438.
  14. Barrett, R. S. (1980-81) "Is the Test Content-Valid: Or, Does It Really Measure a Construct?," Employee Relations Law Journal (6) 3, Winter, pp. 459-475.
  15. Barrett, R. S. (1981) "Is the Test Content-Valid: Or, Who Killed Cock Robin?," Employee Relations Law Journal (6) 4, Spring, pp. 584-600.
  16. Bottger, P. and P. Yetton (1982) "Student Assessment and GMAT: Quantitative Versus Verbal Components in Performance on Examinations and Assignments," Australian Journal of Management (7) 1, June, pp. 9-18.
  17. Validation Guidelines for IS Positivist Research by D. Straub, M. Boudreau and D. Gefen Boudreau, M., D. Gefen, and D. Straub (2001) "Validation in IS Research: A State-of-the-Art Assessment," MIS Quarterly (25) 1, March, pp. 1-23.
  18. Boudreau, M.-C., T. Ariyachandra, D. Gefen, and D. Straub (2004) "Validating IS Positivist Instrumentation: 1997-2001," in M. E. Whitman and A. B. Woszczynski (Eds.) The Handbook of Information Systems Research, Hershey, PA USA: Idea Group Publishing, pp. 15-26.
  19. Brock, D. B. and L. M. Sulsky (1994) "Attitudes toward Computers: Construct Validation and Relations to Computer Use," Journal of Organizational Behavior (15) 1, January, pp. 17- 35.
  20. Campbell, D. T. (1960) "Recommendations for APA Test Standards Regarding Construct, Trait, Discriminant Validity," American Psychologist (15) August, pp. 546-553.
  21. Campbell, D. T. (1975) "Degrees of Freedom and the Case Study," Comparative Political Studies (8) 2, July, pp. 178-193.
  22. Carrier, M. R., A. T. Dalessio, and S. H. Brown (1990) "Correspondence Between Estimates of Content and Criterion-Related Validity Values," Personnel Psychology (43) 1 (Spring), pp. 85-100.
  23. Chin, W. W. (1998a) "Issues and Opinion on Structural Equation Modeling," MIS Quarterly (22) 1, March, pp. vii-xvi.
  24. Chin, W. W. (1998b) "The Partial Least Squares Approach to Structural Equation Modeling," in G. A. Marcoulides (Ed.) Modern Methods for Business Research, London, pp. 295-336.
  25. Chin, W. W., A. Gopal, and W. D. Salisbury (1997) "Advancing the Theory of Adaptive Structuration: The Development of a Scale to Measure Faithfulness of Appropriation," Information Systems Research (8) 4, pp. 342-367.
  26. Cohen, J. (1977) Statistical Power Analysis for the Behavioral Sciences, Revised Edition edition. New York: Academic Press.
  27. Cohen, J. (1988) Statistical Power Analysis for the Behavioral Sciences, 2nd edition. Hillsdale, NJ: L. Erlbaum Associates.
  28. Collopy, F., M. Adya, and J. S. Armstrong (1994) "Principles for Examining Predictive Validity: The Case of Information Systems Spending Forecasts," Information Systems Research (5) 2, June, pp. 170-179.
  29. Coombs, C. H. (1976) A Theory of Data. Ann Arbor, MI: Mathesis Press.
  30. Cronbach, L. J. (1971) "Test Validation," in 2nd Edition edition R. L. Thorndike (Ed.) Educational Measurement, Washington, D.C.: American Council on Education, pp. 443-507.
  31. Cronbach, L. J. (1990) Essentials of Psychological Testing, 5th edition. New York: Harper-Row.
  32. Denzin, N. K. and Y. S. Lincoln (1994) "Introduction: Entering the Field of Qualitative Research," in N. K. Denzin and Y. S. Lincoln (Eds.) Handbook of Qualitative Research, London: Sage, pp. 1-18.
  33. Dholakia, U. M. and R. P. Bagozzi (2003) "As Time Goes By: How Goal and Implementation Intentions Influence Enactment of Short-Fuse Behaviors," Journal of Applied Social Psychology (33) 5, May, pp. 889-923.
  34. Diamantopoulos, A. and H. M. Winklhofer (2001) "Index Construction with Formative Indicators: An Alternative to Scale Development," Journal of Marketing Research (38) 2, pp. 269- 277.
  35. Doll, W. J. and G. Torkzadeh (1988) "The Measurement of End-User Computing Satisfaction," MIS Quarterly (12) 2, pp. 259-274.
  36. Falk, R. F. and N. B. Miller (1992) A Primer for Soft Modeling. Akron, OH: University of Akron Press.
  37. Gefen, D. (1997) Building Users' Trust in Freeware Providers and the Effects of this Trust on Users' Perceptions of Usefulness, Ease of Use and Intended Use. Dissertation, Georgia State University.
  38. Gefen, D. (2000) "It is Not Enough To Be Responsive: The Role of Cooperative Intentions in MRP II Adoption," DATA BASE for Advances in Information System (31) 2, pp. 65-79.
  39. Gefen, D. (2003) "Unidimensional Validity: An Explanation and Example," CAIS (12) 2, pp. 23-47.
  40. Gefen, D., D. Straub, and M. Boudreau (2000) "Structural Equation Modeling Techniques and Regression: Guidelines for Research Practice," Communications of AIS (7) 7 August,, pp. 1-78.
  41. Gefen, D. and D. W. Straub (1997) "Gender Differences in Perception and Adoption of E-Mail: An Extension to the Technology Acceptance Model," MIS Quarterly (21) 4 (December), pp. 389-400.
  42. Gerbing, D. W. and J. C. Anderson (1988) "An Updated Paradigm for Scale Development Incorporating Unidimensionality and Its Assessment," Journal of Marketing Research (25) May, pp. 186-192.
  43. Grover, V., M. J. Cheon, and J. T. C. Teng (1996) "The Effect of Service Quality and Partnership on the Outsourcing of Information Systems Functions," Journal of Management Information Systems (12) 4, Spring, pp. 89-116.
  44. Guion, R. M. (1977) "Content Validity: Three Years of Talk-What's the Action?," Public Personnel Management (6) 6 (November-December), pp. 407-414.
  45. Hair, J. F., Jr., R. E. Anderson, R. L. Tatham, and W. C. Black (1998) Multivariate Data Analysis with Readings, 5th Edition. Englewood Cliffs, NJ: Prentice Hall.
  46. Hendrickson, A., K. Glorfeld, and T. P. Cronan (1994) "On the Repeated Test-Retest Reliability of the End-User Computing Satisfaction Instrument: A Comment," Decision Sciences (25) 4 (July-August), pp. 655-667.
  47. Hendrickson, A. R., P. D. Massey, and T. P. Cronan (1993) "On the Test-Retest Reliability of Perceived Usefulness and Perceived Ease of Use Scales," MIS Quarterly (17) 2 (June), pp. 227-230.
  48. Igbaria, M. and J. J. Baroudi (1993) "A Short-Form Measure of Career Orientations: A Psychometric Evaluation," Journal of Management Information Systems (10) 2, Fall, pp. 131-154.
  49. Jarvenpaa, S. L., G. W. Dickson, and G. DeSanctis (1985) "Methodological Issues in Experimental IS Research: Experiences and Recommendations," MIS Quarterly (9) 2 (June), pp. 141-156.
  50. Jenkins, A. M. (ed.) (1985) Research Methodologies and MIS Research. Research Methods in Information Systems, Amsterdam, Holland: Elsevier Science Publishers B.V.
  51. Jones, A. P., L. A. Johnson, M. C. Butler, and D. S. Main (1983) "Apples and Oranges: An Empirical Comparison of Commonly Used Indices of Interrater Agreement," Academy of Management Journal (26) 3, September, pp. 507-519.
  52. Validation Guidelines for IS Positivist Research by D. Straub, M. Boudreau and D. Gefen Jöreskog, K. G. and D. Sörbom (1989) LISREL7: A Guide to the Program and Applications, 2nd edition. Chicago: SPSS Inc.
  53. Jöreskog, K. G. and D. Sörbom (1993) LISREL8: Structural Equation Modeling with SIMPLIS Command Language, 2nd edition. Chicago, IL: Scientific Software International.
  54. Karahanna, E., D. W. Straub, and N. L. Chervany (1999) "Information Technology Adoption across Time: A Cross-Sectional Comparison of Pre-Adoption and Post-Adoption Beliefs," MIS Quarterly (23) 2, pp. 183-213.
  55. Keil, M., D. P. Truex, and R. Mixon (1995) "The Effects of Sunk Cost and Project Completion on Information Technology Project Escalation," IEEE Transactions on Engineering Management (42) 4, November, pp. 372-381.
  56. Kuhn, T. S. (1970) The Structure of Scientific Revolutions, 2nd edition. Chicago, IL: The University of Chicago Press.
  57. Lacity, M. C. and M. A. Janson (1994) "Understanding Qualitative Data: A Framework of Text Analysis Methods," Journal of Management Information Systems: JMIS (11) 2 (Fall), pp. 137-155.
  58. Lawther, W. C. (1986) "Content Validation: Conceptual and Methodological Issues," Review of Public Personnel Administration (6) 3 (Summer), pp. 37-49.
  59. Lewis, B. R., C. A. Snyder, and R. K. Rainer, Jr. (1995) "An Empirical Assessment of the Information Resource Management Construct," Journal of Management Information Systems (12) 1, Summer, pp. 199-223.
  60. Lim, K. H., L. M. Ward, and I. Benbasat (1997) "An Empirical Study of Computer System Learning: Comparison of Co-Discovery and Self-Discovery Methods," Information Systems Research (8) 3, September, pp. 254-272.
  61. Loch, K., D. Straub, and S. Kamel (2003) "Diffusing the Internet in the Arab World: The Role of Social Norms and Technological Culturation," IEEE Transactions on Engineering Management (50) 1, February, pp. 45-63.
  62. MacCallum, R. C. and J. T. Austin (2000) "Applications of Structural Equation Modeling in Psychological Research," Annual Review of Psychology (51pp. 201-226.
  63. Marks, R., P. Watt, and P. Yetton (1981) "GMAT Scores and Performance: Selecting Students into a Graduate Management School," Australian Journal of Management (6) 2 (December), pp. 81-102.
  64. Marsh, H. W. and D. Hocevar (1988) "A New, Powerful Approach to Multitrait-Multimethod Analyses: Application of Second Order Confirmatory Factor Analysis," Journal of Applied Psychology (73) 1, pp. 107-117.
  65. Massetti, B. (1996) "An Empirical Examination of the Value of Creativity Support Systems on Idea Generation," MIS Quarterly (20) 1, March, pp. 83-97.
  66. McKnight, D. H., V. Choudhury, and C. Kacmar (2002a) "Developing and Validating Trust Measures for E-Commerce: An Integrative Typology," Information Systems Research (13) 3, September, pp. 334-359.
  67. McKnight, H., V. Choudhury, and C. Kacmar (2002b) "Developing and Validating Trust Measures for E-Commerce: An Integrative Typology," Information Systems Research (13) 3, pp. 334-359.
  68. McLean, E. R., S. J. Smits, and J. R. Tanner (1996) "The Importance of Salary on Job and Career Attitudes of Information Systems Professionals," Information & Management (30) 6 (September), pp. 291-299.
  69. Meehl, P. E. (1967) "Theory-Testing in Psychology and Physics: A Methodological Paradox," Philosophy of Science) June, pp. 103-115.
  70. Miles, M. B. and A. M. Huberman (1994) Qualitative Data Analysis: An Expanded Sourcebook. Thousand Oaks, CA: Sage Publications, Inc.
  71. Millsap, R. E. (1990) "A Cautionary Note on the Detection of Method Variance in Multitrait- Multimethod Data," Journal of Applied Psychology (75) 3 (June), pp. 350-353.
  72. M. D. Dunnette and L. M. Hough (Eds.) Handbook of Industrial and Organizational Psychology, Palo Alto, CA USA: Consulting Psychologists Press, pp. 61-138.
  73. Netemeyer, R. G., S. Durvasula, and D. R. Lichtenstein (1991) "A Cross-National Assessment of the Reliability and Validity of the CETSCALE," Journal of Marketing Research (28) 3, pp. 320-327.
  74. Nielsen, I. K., S. M. Jex, and G. A. Adams (2000) "Development and Validation of Scores on a Two-Dimensional Workplace," Educational & Psychological Measurement (60) 4, August, pp. 628-644.
  75. Nunnally, J. C. (1967) Psychometric Theory. New York: McGraw-Hill.
  76. Nunnally, J. C. (1978) Psychometric Theory, 2nd edition. New York: McGraw-Hill.
  77. Nunnally, J. C. and I. H. Bernstein (1994) Psychometric Theory, 3rd edition. New York: McGraw- Hill.
  78. Orne, M. T. (1962) "On the Social Psychology of the Psychological Experiment: With Particular Reference to Demand Characteristics and Their Implications," American Psychologist (17) 11, pp. 776-783.
  79. Orne, M. T. (1969) "Demand Characteristics and the Concept of Quasi-Controls," in R. Rosenthal and R. L. Rosnow (Eds.) Artifact in Behavioral Research, New York: Academic Press, pp. 143-179.
  80. Parameswaran, R., B. A. Greenberg, D. N. Bellenger, and D. H. Roberson (1979) "Measuring Reliability: A Comparison of Alternative Techniques," Journal of Marketing Research (16) 1, February, pp. 18-25.
  81. Perdue, B. C. and J. O. Summers (1986) "Checking the Success of Manipulations in Marketing Experiments," Journal of Marketing Research (23) 4 (November), pp. 317-326.
  82. Peter, J. P. (1979) "Reliability: A Review of Psychometric Basics and Recent Marketing Practices," Journal of Marketing Research (16) 1 (February), pp. 6-17.
  83. Pinsonneault, A. and N. Heppel (1997/98) "Anonymity in Group Support Systems Research: A New Conceptualization, Measure, and Contingency Framework," Journal of Management Information Systems (14) 3, Winter, pp. 89-108.
  84. Pitt, L. F., R. T. Watson, and C. B. Kavan (1995) "Service Quality: A Measure of Information Systems Effectiveness," MIS Quarterly (19) 2, June, pp. 173-187.
  85. Ravichandran, T. and A. Rai (2000) "Quality Management in Systems Development: An Organizational System Perspective," MIS Quarterly (24) 3, September, pp. 381-415.
  86. Rogers, T. B. (1995) The Psychological Testing Enterprise. Pacific Grove, CA: Brooks/Cole Publishing Company. Validation Guidelines for IS Positivist Research by D. Straub, M. Boudreau and D. Gefen Sambamurthy, V. and W. W. Chin (1994) "The Effects of Group Attitudes toward Alternative GDSS Designs on the Decision-making Performance of Computer-Supported Groups," Decision Science (25) 2, pp. 215-239.
  87. Scandura, T. A. and E. A. Williams (2000) "Research Methodology in Management: Current Practices, Trends, and Implications for Future Research," Academy of Management Journal (43) 6, pp. 1248-1264.
  88. Segars, A. H. (1997) "Assessing the Unidimensionality of Measurement: A Paradigm and Illustration within the Context of Information Systems Research," OMEGA (25) 1, February, pp. 107-121.
  89. Segars, A. H. and V. Grover (1998) "Strategic Information Systems Planning Success: An Investigation of the Construct and its Measurement," MIS Quarterly (22) 2, June, pp. 139- 163.
  90. Sethi, V. and W. R. King (1994) "Development of Measures to Assess the Extent to Which an Information Technology Application Provides Competitive Advantage," Management Science (40) 12, December, pp. 1601-1627.
  91. Simon, H. (1981) The Sciences of the Artificial, 2nd edition. Cambridge, MA: MIT Press.
  92. Simon, S. J., V. Grover, J. T. C. Teng, and K. Whitcomb (1996) "The Relationship of Information System Training Methods and Cognitive Ability to End-user Satisfaction, Comprehension, and Skill Transfer: A Longitudinal Field Study," Information Systems Research (7) 4, pp. 466-490.
  93. Smith, H. J., S. J. Milberg, and S. J. Burke (1996) "Information Privacy: Measuring Individuals' Concerns about Organizational Practices," MIS Quarterly (20) 2, June, pp. 167-196.
  94. Spector, P. E. (1987) "Method Variance as an Artifact in Self-Reported Affect and Perceptions at Work: Myth or Significant Problem?," Journal of Applied Psychology (72) 3 (August), pp. 438-443.
  95. Storey, V., D. Straub, K. Stewart, and R. Welke (2000) "A Conceptual Investigation of the Electronic Commerce Industry," Communications of the ACM (43) 7 (July), pp. 117-123.
  96. Straub, D. W. (1989) "Validating Instruments in MIS Research," MIS Quarterly (13) 2, pp. 147- 169.
  97. Straub, D. W. (1990) "Effective IS Security: An Empirical Study," Information Systems Research (1) 3, pp. 255-276.
  98. Straub, D. W. (1994) "The Effect of Culture on IT Diffusion: E-Mail and FAX in Japan and the U.S.," Information Systems Research (5) 1, March, pp. 23-47.
  99. Straub, D. W. and E. Karahanna (1998) "Knowledge Worker Communications and Recipient Availability: Toward a Task Closure Explanation of Media Choice," Organization Science (9) 2 (March), pp. 160-175.
  100. Straub, D. W., M. Limayem, and E. Karahanna (1995) "Measuring System Usage: Implications for IS Theory Testing," Management Science (41) 8, August, pp. 1328-1342.
  101. Sussmann, M. and D. U. Robertson (1986) "The Validity of Validity: An Analysis of Validation Study Designs," Journal of Applied Psychology (71) 3, pp. 461-468.
  102. Szajna, B. (1994) "Software Evaluation and Choice: Predictive Validation of the Technology Acceptance Instrument," MIS Quarterly (17) 3, pp. 319-324.
  103. Thomas, D. M. and R. T. Watson (2002) "Q-sorting and MIS Research: A Primer," CAIS (8) Article 9, pp. 141-156.
  104. Thompson, R., D. W. Barclay, and C. A. Higgins (1995) "The Partial Least Squares Approach to Causal Modeling: Personal Computer Adoption and Use as an Illustration," Technology Studies: Special Issue on Research Methodology (2) 2, Fall, pp. 284-324.
  105. Torkzadeh, G. and W. J. Doll (1994) "The Test-Retest Reliability of User Involvement Instruments," Information & Management (26) 1, pp. 21-31.
  106. Van Dyke, T. P., L. A. Kappelman, and V. R. Prybutok (1997) "Measuring Information Systems Service Quality: Concerns on the Use of the SERVQUAL Questionnaire," MIS Quarterly (21) 2, June, pp. 195-208.
  107. Venkatraman, N. and V. Ramanujam (1987) "Measurement of Business Economic Performance: An Examination of Method Convergence," Journal of Management (13) 1, Spring, pp. 109-122.
  108. Webster, J. and D. Compeau (1996) "Computer-Assisted versus Paper-and-Pencil Administration of Questionnaires," Behavior Research Methods, Instruments, & Computers (28) 4, November, pp. 567-577.
  109. Westland, J. C. (2004) "The IS Core XII: Authority, Dogma, and Positive Science in Information Systems Research," CAIS (13) 12, February, pp. 136-157.
  110. Woszczynski, A. B. and M. E. Whitman (2004) "The Problem of Common Method Variance in IS Research," in M. E. Whitman and A. B. Woszczynski (Eds.) The Handbook of Information Systems Research, Hershey, PA USA: Idea Group Publishing, pp. 66-77.

Cited by

Sorted by citations

Authors
Straub, D., & Gefen, D.
Affiliations
  • Georgia State University (US)
  • Drexel University (US)
ORCID
Venue
Communications of the Association for Information Systems
Publisher
Association for Information Systems
Published
2004
Volume
13
ISSN
1529-3181 (ISSN-L)
DOI
10.17705/1cais.01324
OpenAlex
W116282327
Cited by
2,797
References
17
Citations by year
2026: 43 · 2025: 135 · 2024: 157 · 2023: 198 · 2022: 194 · 2021: 209 · 2020: 184 · 2019: 170 · 2018: 127 · 2017: 116 · 2016: 154 · 2015: 175 · 2014: 173 · 2013: 155 · 2012: 150
FWCI
104.72
Type
journal article
Language
en
Open access
Locations
  • Communications of the Association for Information Systems (publishedVersion)
  • Journal of the Association for Information Systems (submittedVersion)
Topics
  • Social Sciences › Sociology and Political Science › Information Systems Theories and Implementation
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Business Strategies and Management Research
Keywords
instrument validation, research validity, positivist research, content validity, construct validity, reliability statistics, statistical conclusion validity, research heuristics, research rigor, information systems research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review