The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Evaluating Information System Effectiveness — Part I: Comparing Evaluation Approaches
Abstract
While the use and costs of Management Information Systems (MIS) have become highly visible, little attention has been paid to assessing and communicating system effectiveness. Evaluation of system effectiveness is difficult due to its multidimensionality, its quantitative and qualitative aspects, and the multiple, and often conflicting, evaluator viewpoints. This article provides an overview of what system effectiveness means and how it should be measured. It is the first of two articles to appear in consecutive issues of the MIS Quarterly. Starting with a definition of system effectiveness, this article examines evaluation of system effectiveness in terms of a conceptual hierarchy of system objectives. The hierarchy is used to discuss problems in, and recommendations for, evaluating system effectiveness, and to compare MIS evaluation approaches. The second article characterizes and compares the evaluator viewpoints on system effectiveness for decision makers in several functional groups involved in MIS implementation — user, MIS, internal audit, and management. The second article recommends several MIS evaluation approaches for incorporating multiple dimensions and multiple evaluator viewpoints into evaluations of information system effectiveness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Decision support systems : an organizational perspective
Keen, P., & Morton, M. S. S. (1978) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 1,673
Characteristics of application software maintenance
Lientz, B. P., Swanson, E. B., & Tompkins, G. E. (1978) · Communications of the ACM · doi:10.1145/359511.359522 · Cited by 431
Performance and the Use of an Information System
Lucas, H. C. (1975) · Management Science · doi:10.1287/mnsc.21.8.908 · Cited by 337
MisProject Management: Myths, Opinions, and Reality
Powers, R. F., & Dickson, G. W. (1973) · California Management Review · doi:10.2307/41164448 · Cited by 252
Perceptions of the Value of a Management Information System.
Gallagher, C. A. (1974) · Academy of Management Journal · doi:10.2307/254770 · Cited by 249
The Study of Organizational Effectiveness
Price, J. L. (1972) · The Sociological Quarterly · doi:10.1111/j.1533-8525.1972.tb02100.x · Cited by 242
Strategic Planning for Management Information Systems
Ein-Dor, P., & Segev, E. (1978) · Management Science · doi:10.1287/mnsc.24.15.1631 · Cited by 128
Measurement of computer user satisfaction
Pearson, S. W., & Bailey, J. E. (1980) · ACM SIGMETRICS Performance Evaluation Review · doi:10.1145/1041872.1041881 · Cited by 100
Cited by
Measuring System Usage: Implications for IS Theory Testing
Straub, D., Limayem, M., & Karahanna-Evaristo, E. (1995) · Management Science · doi:10.1287/mnsc.41.8.1328 · Cited by 958
Bai, B., Law, R., & Wen, I. (2008) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2007.10.008 · Cited by 749
An empirical study on predicting user acceptance of e-shopping on the Web
Shih, H.-P. (2004) · Information & Management · doi:10.1016/s0378-7206(03)00079-x · Cited by 722
Bradford, M., & Florin, J. (2003) · International Journal of Accounting Information Systems · doi:10.1016/s1467-0895(03)00026-5 · Cited by 706
Determinants of success for computer usage in small business
DeLone, W. H. (1988) · MIS Quarterly · doi:10.2307/248803 · Cited by 703
A framework for analysis of data quality research
Wang, R. Y., Storey, V. C., & Firth, C. P. (1995) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.404034 · Cited by 685
Perceived information quality in data exchanges: Effects on risk, trust, and intention to use
Nicolaou, A. I., & McKnight, D. H. (2006) · Information Systems Research · doi:10.1287/isre.1060.0103 · Cited by 682
Information Technology and Corporate Strategy: A Research Perspective
Bakos, J. Y., & Treacy, M. E. (1986) · MIS Quarterly · doi:10.2307/249029 · Cited by 650
The Implementation of Business Process Reengineering
Grover, V., Jeong, S. R., Kettinger, W. J., & Teng, J. T. C. (1995) · Journal of Management Information Systems · doi:10.1080/07421222.1995.11518072 · Cited by 606
Chin, W. W., & Dibbern, J. (2010) · Handbook of Partial Least Squares · doi:10.1007/978-3-540-32827-8_8 · Cited by 588
Sethi, V., & King, W. R. (1994) · Management Science · doi:10.1287/mnsc.40.12.1601 · Cited by 550
The balanced scorecard: a foundation for the strategic management of information systems
Martinsons, M., Davison, R., & Tse, D. (1999) · Decision Support Systems · doi:10.1016/s0167-9236(98)00086-4 · Cited by 535
Alternative Measures of System Effectiveness: Associations and Implications
Srinivasan, A. (1985) · MIS Quarterly · doi:10.2307/248951 · Cited by 532
Organizational Characteristics and MIS Success in the Context of Small Business
Raymond, L. (1985) · MIS Quarterly · doi:10.2307/249272 · Cited by 509
Quality and effectiveness in Web-based customer support systems
Negash, S., Ryan, T., & Igbaria, M. (2003) · Information & Management · doi:10.1016/s0378-7206(02)00101-5 · Cited by 506
Hsu, C.-L., Chang, K.-C., & Chen, M.-C. (2012) · Information Systems and e-Business Management · doi:10.1007/s10257-011-0181-5 · Cited by 451
Quality Management in Systems Development: An Organizational System Perspective1
Ravichandran, T., & Rai, A. (2000) · MIS Quarterly · doi:10.2307/3250967 · Cited by 442
An empirical investigation of decision-making satisfaction in web-based decision support systems
Bharati, P., & Chaudhury, A. (2004) · Decision Support Systems · doi:10.1016/s0167-9236(03)00006-x · Cited by 398
Myers, B. L., Kappelman, L. A., & Prybutok, V. R. (1997) · Information Resources Management Journal · doi:10.4018/irmj.1997010101 · Cited by 369
Decisions to Outsource Information Systems Functions: Testing a Strategy‐Theoretic Discrepancy Model
Teng, J. T. C., Cheon, M. J., & Grover, V. (1995) · Decision Sciences · doi:10.1111/j.1540-5915.1995.tb00838.x · Cited by 359
Developing a multidimensional measure of system-use in an organizational context
Doll, W. J., & Torkzadeh, G. (1998) · Information & Management · doi:10.1016/s0378-7206(98)00028-7 · Cited by 334
Caldeira, M. M., & Ward, J. M. (2002) · Information Systems Journal · doi:10.1046/j.1365-2575.2002.00119.x · Cited by 317
The Updated DeLone and McLean Model of Information Systems Success
Urbach, N., & Müller, B. (2012) · Integrated Series in Information Systems · doi:10.1007/978-1-4419-6108-2_1 · Cited by 307
Public Management Information Systems: Theory and Prescription
Bozeman, B., & Bretschneider, S. (1986) · Public Administration Review · doi:10.2307/975569 · Cited by 306
Is user satisfaction a valid measure of system effectiveness?
Gatian, A. W. (1994) · Information & Management · doi:10.1016/0378-7206(94)90036-1 · Cited by 272
Expert system verification and validation: a survey and tutorial
O'Keefe, R. M., & O'Leary, D. E. (1993) · Artificial Intelligence Review · doi:10.1007/bf00849196 · Cited by 205
Key antecedents of Executive Information System success: a path analytic approach
Bajwa, D. S., Rai, A., & Brennan, I. (1998) · Decision Support Systems · doi:10.1016/s0167-9236(97)00032-8 · Cited by 84
Metadata
- Authors
- Hamilton, S., & Chervany, N. L.
- Venue
- MIS Quarterly
- Publisher
- MIS Quarterly
- Published
- 1980-09-01
- Volume
- 5
- Issue
- 3
- Pages
- 55-69
- ISSN
- 0276-7783 (ISSN-L)
- 2162-9730
- OpenAlex
- W1483468980
- Cited by
- 473
- References
- 8
- FWCI
- 2.34
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.