The DOI matches its Crossref record; 101 of the 101 references it cites were found in a registry or an index.
Reconceptualizing System Usage: An Approach and Empirical Test
Abstract
Although DeLone, McLean, and others insist that system usage is a key variable in information systems research, the system usage construct has received little theoretical scrutiny, boasts no widely accepted definition, and has been operationalized by a diverse set of unsystematized measures. In this article, we present a systematic approach for reconceptualizing the system usage construct in particular nomological contexts. Comprising two stages, definition and selection, the approach enables researchers to develop clear and valid measures of system usage for a given theoretical and substantive context. The definition stage requires that researchers define system usage and explicate its underlying assumptions. In the selection stage, we suggest that system usage be conceptualized in terms of its structure and function. The structure of system usage is tripartite, comprising a user, system, and task, and researchers need to justify which elements of usage are most relevant for their study. In terms of function, researchers should choose measures for each element (i.e., user, system, and/or task) that tie closely to the other constructs in the researcher's nomological network. To provide evidence of the viability of the approach, we undertook an empirical investigation of the relationship between system usage and short-run task performance in cognitively engaging tasks. The results support the benefits of the approach and show how an inappropriate choice of usage measures can lead researchers to draw opposite conclusions in an empirical study. Together, the approach and the results of the empirical investigation suggest new directions for research into the nature of system usage, its antecedents, and its consequences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evaluating Structural Equation Models with Unobservable Variables and Measurement Error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.2307/3151312 · Cited by 109,314
Evaluating structural equation models with unobservable variables and measurement error
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800104 · Cited by 109,190
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
User Acceptance of Information Technology: Toward A Unified View1
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003) · MIS Quarterly · doi:10.2307/30036540 · Cited by 45,035
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Herne, H., Cooley, W. W., & Lohnes, P. R. (1973) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2344428 · Cited by 35,697
A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies
Venkatesh, V., & Davis, F. D. (2000) · Management Science · doi:10.1287/mnsc.46.2.186.11926 · Cited by 23,066
Exploration and Exploitation in Organizational Learning
March, J. G. (1991) · Organization Science · doi:10.1287/orsc.2.1.71 · Cited by 21,942
(1997) · Chemometrics in Environmental Analysis · doi:10.1002/352760216x.ch5 · Cited by 18,653
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
ASPECTS OF THE THEORY OF SYNTAX
Chomsky, N. (1964) · doi:10.21236/ad0616323 · Cited by 13,587
Flow: the psychology of optimal experience
(1990) · Choice Reviews Online · doi:10.5860/choice.28-0597 · Cited by 12,637
Handbook of Industrial and Organizational Psychology.
Hammer, T. H., Anderson, J., Gurdon, M., Jick, T., Petit, A., Stern, R., Schwartz, H., Vardi, Y., & Dunnette, M. D. (1977) · Administrative Science Quarterly · doi:10.2307/2391755 · Cited by 11,945
The DeLone and McLean Model of Information Systems Success: A Ten-Year Update
(2003) · Journal of Management Information Systems · doi:10.1080/07421222.2003.11045748 · Cited by 11,791
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195
Information Systems Success: The Quest for the Dependent Variable
DeLone, W. H., & McLean, E. R. (1992) · Information Systems Research · doi:10.1287/isre.3.1.60 · Cited by 10,697
Moore, G. C., & Benbasat, I. (1991) · Information Systems Research · doi:10.1287/isre.2.3.192 · Cited by 9,150
Chin, W. W., Marcolin, B. L., & Newsted, P. R. (2003) · Information Systems Research · doi:10.1287/isre.14.2.189.16018 · Cited by 6,479 · cited 2×
“† Each construct’s effect size (f2) can be calculated by the formula ) ( 2 2 partial full R R − / ) 1 ( 2 full R − (Mathieson, et al., 2001; Chin et al., 2003).”
BackgroundMethodStructural Equation Modeling and Regression: Guidelines for Research Practice
Gefen, D., Straub, D., & Boudreau, M.-C. (2000) · Communications of the Association for Information Systems · doi:10.17705/1cais.00407 · Cited by 6,416
Self-citationTask-Technology Fit and Individual Performance
Goodhue, D. L., & Thompson, R. L. (1995) · MIS Quarterly · doi:10.2307/249689 · Cited by 6,006
Jarvis, C. B., MacKenzie, S. B., & Podsakoff, P. M. (2003) · Journal of Consumer Research · doi:10.1086/376806 · Cited by 5,807
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
Handbook of industrial and organizational psychology
(1993) · Choice Reviews Online · doi:10.5860/choice.30-5278 · Cited by 5,339
Agarwal, R., & Karahanna, E. (2000) · MIS Quarterly · doi:10.2307/3250951 · Cited by 4,726
Tosi, H. L. (1991) · Academy of Management Review · doi:10.5465/amr.1991.4278976 · Cited by 4,145
Capturing the Complexity in Advanced Technology Use: Adaptive Structuration Theory
DeSanctis, G., & Poole, M. S. (1994) · Organization Science · doi:10.1287/orsc.5.2.121 · Cited by 3,879
Information Systems Research: Relevant Theory and Informed Practice
(2004) · IFIP International Federation for Information Processing · doi:10.1007/b115738 · Cited by 3,122
Perceived Usefulness, Ease of Use, and Usage of Information Technology: A Replication
Adams, D. A., Nelson, R. R., & Todd, P. A. (1992) · MIS Quarterly · doi:10.2307/249577 · Cited by 3,084
Social Cognitive Theory and Individual Reactions to Computing Technology: A Longitudinal Study1
Compeau, D., Higgins, C. A., & Huff, S. (1999) · MIS Quarterly · doi:10.2307/249749 · Cited by 2,514
A Respecification and Extension of the DeLone and McLean Model of IS Success
Seddon, P. B. (1997) · Information Systems Research · doi:10.1287/isre.8.3.240 · Cited by 2,437
The Measurement of End-User Computing Satisfaction
Doll, W. J., & Torkzadeh, G. (1988) · MIS Quarterly · doi:10.2307/248851 · Cited by 2,412
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings.
Raudenbush, S. W., Hunter, J. E., & Schmidt, F. L. (1991) · Journal of the American Statistical Association · doi:10.2307/2289738 · Cited by 2,327
Douglas, O. B., & Holland, B. F. (2015) · Fundamentals of educational psychology. · doi:10.1037/14910-020 · Cited by 2,272
REVOLUTIONARY CHANGE THEORIES: A MULTILEVEL EXPLORATION OF THE PUNCTUATED EQUILIBRIUM PARADIGM
Gersick, C. J. G. (1991) · The Academy of Management Review · doi:10.5465/amr.1991.4278988 · Cited by 2,183
Latent Variable Path Modeling with Partial Least Squares
Lohmöller, J.-B. (1989) · Physica-Verlag eBooks · doi:10.1007/978-3-642-52512-4 · Cited by 2,136
A theory of goal setting & task performance
Locke, E. A., & Latham, G. P. (1990) · Medical Entomology and Zoology · Cited by 2,022
Designing Research for Application
Calder, B. J., Phillips, L. W., & Tybout, A. M. (1981) · Journal of Consumer Research · doi:10.1086/208856 · Cited by 1,806
Personal Computing Acceptance Factors in Small Firms: A Structural Equation Model1
Igbaria, M., Zinatelli, N., Cragg, P., & Cavaye, A. L. M. (1997) · MIS Quarterly · doi:10.2307/249498 · Cited by 1,667
Generalizing Generalizability in Information Systems Research
Lee, A. S., & Baskerville, R. L. (2003) · Information Systems Research · doi:10.1287/isre.14.3.221.16560 · Cited by 1,551
Explaining the Role of User Participation in Information System Use
Hartwick, J., & Barki, H. (1994) · Management Science · doi:10.1287/mnsc.40.4.440 · Cited by 1,540
Modeling the performance prediction problem in industrial and organizational psychology.
Campbell, J. P. (1990) · Cited by 1,476
Performance Impacts of Information Technology: Is Actual Usage the Missing Link?
Devaraj, S., & Kohli, R. (2003) · Management Science · doi:10.1287/mnsc.49.3.273.12736 · Cited by 1,413
Cohesion and Performance in Groups: A Meta-Analytic Clarification of Construct Relations.
Beal, D. J., Cohen, R. R., Burke, M. J., & McLendon, C. L. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.6.989 · Cited by 1,321
Understanding User Evaluations of Information Systems
Goodhue, D. L. (1995) · Management Science · doi:10.1287/mnsc.41.12.1827 · Cited by 1,217
Toward a Taxonomy of Multidimensional Constructs
Law, K. S., Wong, C.-S., & Mobley, W. H. (1998) · The Academy of Management Review · doi:10.2307/259060 · Cited by 1,139
Multidimensional constructs in organizational behavior research: an integrative analytical framework
Edwards, J. R. (2001) · Organizational Research Methods · doi:10.1177/109442810142004 · Cited by 1,128
Microcomputer Playfulness: Development of a Measure With Workplace Implications
Webster, J., & Martocchio, J. J. (1992) · MIS Quarterly · doi:10.2307/249576 · Cited by 1,106
How Do Suppliers Benefit from Information Technology Use in Supply Chain Relationships?1
Subramani, M. (2004) · MIS Quarterly · doi:10.2307/25148624 · Cited by 1,101
Extending the technology acceptance model: the influence of perceived user resources
Mathieson, K., Peacock, E., & Chin, W. W. (2001) · ACM SIGMIS Database: the DATABASE for Advances in Information Systems · doi:10.1145/506724.506730 · Cited by 1,099 · cited 3×
“Multiplying f2 by (n-k-1), where n is the sample size (171) and k is the number of independent variables, provides a pseudo F test for the change in R2 with 1 and n-k degrees of freedom (Mathieson et al., 2001).”
BackgroundInfluentialChin, W. W., Gopal, A., & Salisbury, W. D. (1997) · Information Systems Research · doi:10.1287/isre.8.4.342 · Cited by 1,045
Jasperson, J., Carter, P. E., & Zmud, R. W. (2005) · MIS Quarterly · doi:10.5555/2017264.2017272 · Cited by 1,034
A Theory of Task/Technology Fit and Group Support Systems Effectiveness1
Zigurs, I., & Buckland, B. K. (1998) · MIS Quarterly · doi:10.2307/249668 · Cited by 1,029
Validation in Information Systems Research: A State-of-the-Art Assessment1
Boudreau, M.-C., Gefen, D., & Straub, D. W. (2001) · MIS Quarterly · doi:10.2307/3250956 · Cited by 959
Self-citationMeasuring System Usage: Implications for IS Theory Testing
Straub, D., Limayem, M., & Karahanna-Evaristo, E. (1995) · Management Science · doi:10.1287/mnsc.41.8.1328 · Cited by 958
Self-citationJasperson, '. (., Carter, P. E., & Zmud, R. W. (2005) · MIS Quarterly · doi:10.2307/25148694 · Cited by 943
Segars, A. H., & Grover, V. (2021) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/3shh-pe41 · Cited by 806
Reconceptualizing Users as Social Actors in Information Systems Research1
Lamb, R., & Kling, R. (2003) · MIS Quarterly · doi:10.2307/30036529 · Cited by 774
Tools for Inventing Organizations: Toward a Handbook of Organizational Processes
Malone, T. W., Crowston, K., Lee, J., Pentland, B., Dellarocas, C., Wyner, G., Quimby, J., Osborn, C. S., Bernstein, A., Herman, G., et al. (1999) · Management Science · doi:10.1287/mnsc.45.3.425 · Cited by 755
A Theoretical Assessment of the User-Satisfaction Construct in Information Systems Research
Melone, N. P. (1990) · Management Science · doi:10.1287/mnsc.36.1.76 · Cited by 711
Heracleous, L., & Barrett, M. (2001) · Academy of Management Journal · doi:10.2307/3069414 · Cited by 671
Group Support Systems: New Perspectives
Jessup, L. M., & Valacich, J. S. (1992) · Medical Entomology and Zoology · Cited by 660
Early Diagnosis of MIS Implementation Failure: Promising Results and Unanswered Questions
Ginzberg, M. J. (1981) · Management Science · doi:10.1287/mnsc.27.4.459 · Cited by 642
Technology use and performance: A field study of broker workstations
Lucas, H. C., & Spitler, V. K. (1999) · Decision Sciences · doi:10.1111/j.1540-5915.1999.tb01611.x · Cited by 561
The changing nature of performance : implications for staffing, motivation, and development
Ilgen, D. R., & Pulakos, E. D. (1999) · Cited by 543
Alternative Measures of System Effectiveness: Associations and Implications
Srinivasan, A. (1985) · MIS Quarterly · doi:10.2307/248951 · Cited by 532
The consequences of information technology acceptance on subsequent individual performance
Igbaria, M., & Tan, M. (1997) · Information & Management · doi:10.1016/s0378-7206(97)00006-2 · Cited by 529
Performance Concepts and Performance Theory
Sonnentag, S., & Frese, M. (2002) · Psychological Management of Individual Performance · doi:10.1002/0470013419.ch1 · Cited by 514
Attention and arousal, cognition and performance
Eysenck, M. W. (1982) · Cited by 501
Extracting usability information from user interface events
Hilbert, D. M., & Redmiles, D. F. (2000) · ACM Computing Surveys · doi:10.1145/371578.371593 · Cited by 477
Development of an Instrument To Measure Hope
MILLER, J. F., & POWERS, M. J. (1988) · Nursing Research · doi:10.1097/00006199-198801000-00002 · Cited by 469
What we know about spreadsheet errors
Panko, R. R. (1998) · Journal of Organizational and End User Computing · doi:10.4018/joeuc.1998040102 · Cited by 464
Technology Features as Triggers for Sensemaking
Griffith, T. L. (1999) · The Academy of Management Review · doi:10.2307/259137 · Cited by 462
Miner, A. S. (2002) · Administrative Science Quarterly · doi:10.2307/3094900 · Cited by 420
Ontological foundations of information systems
Weber, R. (1997) · Medical Entomology and Zoology · Cited by 405
Research Commentary: Diversity in Information Systems Research: Threat, Promise, and Responsibility
Robey, D. (1996) · Information Systems Research · doi:10.1287/isre.7.4.400 · Cited by 345
Skill acquisition and human performance
Proctor, R. W., & Dutta, A. (1995) · Cited by 344
Empirical Evidence For a Descriptive Model of Implementation
Lucas, H. C. (1978) · MIS Quarterly · doi:10.2307/248939 · Cited by 340
Developing a multidimensional measure of system-use in an organizational context
Doll, W. J., & Torkzadeh, G. (1998) · Information & Management · doi:10.1016/s0378-7206(98)00028-7 · Cited by 334
Assessing User Competence: Conceptualization and Measurement
Marcolin, B. L., Compeau, D. R., Munro, M. C., & Huff, S. L. (2000) · Information Systems Research · doi:10.1287/isre.11.1.37.11782 · Cited by 257
When the Muse Takes It All: A Model for the Experience of Timelessness in Organizations
Mainemelis, C. (2001) · The Academy of Management Review · doi:10.2307/3560241 · Cited by 225
Utilization as a dependent variable in MIS research
Trice, A. W., & Treacy, M. E. (1988) · ACM SIGMIS Database: the DATABASE for Advances in Information Systems · doi:10.1145/65766.65771 · Cited by 224
An Evolutionary Strategy for Implementing a Decision Support System
Alavi, M., & Henderson, J. C. (1981) · Management Science · doi:10.1287/mnsc.27.11.1309 · Cited by 224
Psychological Management of Individual Performance
(2002) · Wiley eBooks · doi:10.1002/0470013419 · Cited by 197
Impact of Environmental Uncertainty and Task Characteristics on User Satisfaction with Data
Karimi, J., Somers, T. M., & Gupta, Y. P. (2004) · Information Systems Research · doi:10.1287/isre.1040.0022 · Cited by 190
Lassila, K. S., & Brancheau, J. C. (1999) · Journal of Management Information Systems · doi:10.1080/07421222.1999.11518246 · Cited by 185
A disciplined methodological pluralism for mis research
Landry, M., & Banville, C. (1992) · Accounting, Management and Information Technologies · doi:10.1016/0959-8022(92)90002-a · Cited by 166
Longitudinal Invariance of Self-Esteem and Method Effects Associated With Negatively Worded Items
Motl, R. W., & DiStefano, C. (2002) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1207/s15328007sem0904_6 · Cited by 160
Review of The predictable failure of educational reform
Eddy, W. O. (1994) · New Ideas in Psychology · doi:10.1016/0732-118x(94)90064-7 · Cited by 139
Neal, A. F., & Hesketh, B. L. (1999) · Cited by 138
Griffith, T. L., & Northcraft, G. B. (1994) · Organization Science · doi:10.1287/orsc.5.2.272 · Cited by 121
Determining information system usage: Some issues and examples
Szajna, B. (1993) · Information & Management · doi:10.1016/0378-7206(93)90037-t · Cited by 107
The future of diffusion research
Chin, W. W., & Marcolin, B. L. (2001) · ACM SIGMIS Database the DATABASE for Advances in Information Systems · doi:10.1145/506724.506726 · Cited by 107
Material matters: Assessing the effectiveness of materials management IS
Yuthas, K., & Young, S. T. (1998) · Information & Management · doi:10.1016/s0378-7206(97)00028-1 · Cited by 96
Chin, W. W., & Newsted, P. R. (1995) · Information Systems Research · doi:10.1287/isre.6.1.73 · Cited by 78
An investigation of information system utilization
Barkin, S. R., & Dickson, G. W. (1977) · Information & Management · doi:10.1016/0378-7206(77)90007-6 · Cited by 65
USE AND PRODUCTIVITY IN PERSONAL COMPUTING: AN EMPIRICAL TEST
Pentland, B. T. (1989) · AIS Electronic Library (AISeL) · Cited by 60
Use and productivity in personal computing
Pentland, B. T. (1989) · doi:10.1145/75034.75053 · Cited by 50
New Perspectives on the System Usage Construct
Burton‐Jones, A. (2005) · Digital Archive @ GSU · doi:10.57709/1063232 · Cited by 40
Self-citationAuer, T. (1998) · European Journal of Information Systems · doi:10.1057/palgrave.ejis.3000305 · Cited by 24
Cited by
Venkatesh, V., Thong, J. Y. L., & Xu, X. (2012) · MIS Quarterly · doi:10.2307/41410412 · Cited by 15,756
“…TAM (e.g., van der Heijden 2004), questions and criticisms about TAM (e.g., Benbasat and Barki 2007; Venkatesh et al. 2007), technology use (e.g., Burton-Jones and Straub 2006), and IS continuance (e.g., Bhattacherjee 2001; Hong et al. 2006; Thong et al. 2006) and habit (e.g., Limayem et al.…”
Unified Theory of Acceptance and Use of Technology: A Synthesis and the Road Ahead
University of Arkansas, Venkatesh, V., Thong, J., Hong Kong University of Science and Technology, Xu, X., & The Hong Kong Polytechnic University (2016) · Journal of the Association for Information Systems · doi:10.17705/1jais.00428 · Cited by 2,513
Measuring information systems success: models, dimensions, measures, and interrelationships
Petter, S., DeLone, W., & McLean, E. (2008) · European Journal of Information Systems · doi:10.1057/ejis.2008.15 · Cited by 1,884
University of British Columbia, C., Benbasat, I., Barki, H., & Montréal, H. (2007) · Journal of the Association for Information Systems · doi:10.17705/1jais.00126 · Cited by 1,363
Trust in a specific technology: An investigation of its components and measures
Mcknight, D. H., Carter, M., Thatcher, J. B., & Clay, P. F. (2011) · ACM Transactions on Management Information Systems · doi:10.1145/1985347.1985353 · Cited by 1,185
“To evaluate predictive validity, we reestimated the model to include intention to explore (H3a) [Nambisan et al. 1999] and deep structure use (H3b) [Burton-Jones and Straub 2006] (see Appendix F for scale items).”
BackgroundMethodInfluential
Metadata
- Authors
- Burton-Jones, A., & Straub, D. W.
- Venue
- Information Systems Research
- Published
- 2006-09
- Volume
- 17
- Issue
- 3
- Pages
- 228-246
- ISSN
- 1047-7047 (ISSN-L)
- 1526-5536
- OpenAlex
- W2110799735
- Cited by
- 1,040
- References
- 101
- FWCI
- 68.48
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.