Early Expert Systems: Where Are They Now?
The DOI matches its Crossref record; 32 of the 34 references it cites were found in a registry or an index.
Abstract
Expert systems (ES) were among the earliest branches of artificial intelligence (Al) to be commercialized. But how successful have they actually been? Many well-publicized applications have proven to be pure hype, numerous Al vendors have failed or been completely reorganized, major companies have reduced or eliminated their commitment to expert systems, and even Wall Street has become disillusioned—a predicted $4 billion market proving to be smaller by an order of magnitude. Yet, in spite of these setbacks, there are many companies who remain enthusiastic proponents of the technology and continue to develop important ES applications. This paper explores how the first wave of commercial expert systems, built during the early and mid-1980s, fared over time. An important subset of these systems, identified in a catalog of commercial applications compiled in 1987, was located through a telephone survey, and detailed information on each system was gathered. The data collected show that most of these systems fell into disuse or were abandoned during a five-year period from 1987 to 1992, while about a third continued to thrive. Quantitative and qualitative analysis of the data further suggests that the short-lived nature of many systems was not attributable to failure to meet technical performance or economic objectives. Instead, managerial issues such as lack of system acceptance by users, inability to retain developers, problems in transitioning from development to maintenance, and shifts in organizational priorities appeared to be the most significant factors resulting in long-term expert system disuse.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“It was noted that systems which were embedded in bigger MIS were more likely to succeed.”
From Technology readiness and the organizational journey towards AI adoption: An empirical study (2023) · cites this paper as Gill (1995)
Citations
Cites
Information Systems Success: The Quest for the Dependent Variable
DeLone, W. H., & McLean, E. R. (1992) · Information Systems Research · doi:10.1287/isre.3.1.60 · Cited by 10,697
Software engineering: A practitioner's approach
(1983) · Advances in Engineering Software (1978) · doi:10.1016/0141-1195(83)90118-3 · Cited by 8,234
(1986) · Zeitschrift für wirtschaftlichen Fabrikbetrieb · doi:10.1515/zwf-1986-811227 · Cited by 1,932
Decision support systems : an organizational perspective
Keen, P., & Morton, M. S. S. (1978) · Addison-Wesley Longman Publishing Co., Inc. eBooks · Cited by 1,673
Introduction to expert systems
(1993) · Computers & Operations Research · doi:10.1016/0305-0548(93)90050-s · Cited by 1,335
Waterman (1986) · Cited by 1,301
WATERMAN, D. A. (1985) · CERN Document Server (European Organization for Nuclear Research) · Cited by 743
Expert Systems: Artificial Intelligence in Business
Jason, G., Harmon, P., & King, D. (1987) · Technology and Culture · doi:10.2307/3105218 · Cited by 471
Integrating Expert Systems and Decision Support Systems
Turban, E., & Watkins, P. R. (1986) · MIS Quarterly · doi:10.2307/249031 · Cited by 322
Expert systems: the next challenge for managers
Luconi, F. L., Malone, T. W., & Morton, M. S. S. (1986) · Sloan management review · doi:10.5555/8991.8992 · Cited by 286
Expert systems and applied artificial intelligence
Turban, E., & Frenzel, L. E. (1992) · Medical Entomology and Zoology · Cited by 259
Expert systems: perils and promise
Bobrow, D. G., Mittal, S., & Stefik, M. J. (1986) · Communications of the ACM · doi:10.1145/6592.6597 · Cited by 237
Gevarter, W. B. (1982) · doi:10.6028/nbs.ir.82-2505 · Cited by 176
Expert systems: tools and applications
Harmon, P., Maus, R., & Morrissey, W. (1988) · John Wiley & Sons, Inc. eBooks · Cited by 154
The Nature and Evaluation of Commercial Expert System Building Tools
Gevarter (1987) · Computer · doi:10.1109/mc.1987.1663561 · Cited by 147
Expert systems: working systems and the research literature
Buchanan, B. G. (1986) · Expert Systems · doi:10.1111/j.1468-0394.1986.tb00192.x · Cited by 145
Applying genetics to fuzzy logic
Karr, C. (1991) · AI Expert archive · Cited by 110
Beaumont, J. R., & Silverman, B. G. (1988) · Journal of the Operational Research Society · doi:10.1057/jors.1988.135 · Cited by 92
Applying machine learning to semiconductor manufacturing
Irani, K. B., Cheng, J., Fayyad, U. M., & Qian, Z. (1993) · IEEE Expert · doi:10.1109/64.193054 · Cited by 84
The implementation of expert systems: a survey of successful implementations
Tyran, C. K., & George, J. F. (1993) · ACM SIGMIS Database the DATABASE for Advances in Information Systems · doi:10.1145/154421.154422 · Cited by 71
(1984) · The MIT Press eBooks · doi:10.7551/mitpress/1165.001.0001 · Cited by 70
Building expert systems: cognitive emulation.
Slatter, P. E. (1987) · Open Research Online (The Open University) · doi:10.21954/ou.ro.0000f7cd · Cited by 63
Selection criteria for expert system shells: a socio-technical framework
Stylianou, A. C., Madey, G. R., & Smith, R. D. (1992) · Communications of the ACM · doi:10.1145/135239.135240 · Cited by 61
Amplifying Expertise with Expert Systems
Davis, R. (1984) · The MIT Press eBooks · doi:10.7551/mitpress/1165.003.0004 · Cited by 50
The architecture of expert systems
Birnbaum, L. A. (1983) · Cited by 45
An Investigation of Tools for Building Expert Systems
(1986) · Telematics and Informatics · doi:10.1016/s0736-5853(86)80086-7 · Cited by 43
D’Agapeyeff, A. (1986) · Journal of Computer Assisted Learning · doi:10.1111/j.1365-2729.1986.tb00061.x · Cited by 36
Transfer Pricing-integrating expert systems in MIS environments
Freundlich, Y. (1990) · IEEE Expert · doi:10.1109/64.50857 · Cited by 14 · cited 1×
“* Integrating AI/ES and conventional technologies (e.g., Freedman, 1987; Freundlich, 1990; Harmon and Sawyer, 1990; Stapleton, 1988; Turban and Watkins, 1986).”
Extending component connection modeling for analyzing complex physical systems
Biswas, G., Manganaris, S., & Yu, X. W. (1993) · IEEE Expert · doi:10.1109/64.193055 · Cited by 10
Expert Systems—Artificial Intelligence
Joseph, B. (1995) · Elsevier eBooks · doi:10.1016/b978-0-7506-2255-4.50013-1 · Cited by 9
Expert systems: a mapping between symbol susceptible tasks and software tools
Gill, T. G. (1991) · Medical Entomology and Zoology · Cited by 2
Self-citationKnowledge-based systems: markets, suppliers, products
Johnson, T., Hewett, J., Guilfoyle, C., Jeffcoate, J., & Goodwin, C. (1990) · Cited by 1
Research works printed but not linked: 17
- Buchanan, 1983, Constructing an Expert System, 127
- Bulkeley, 1990, Technology: Bright Outlook for Artificial Intelligence Yields to Slow Growth and Big Cutbacks, Wall Street Journal
- Coleman, 2000, The Al Marketplace in the Year, Al Expert, 8, 34
- Davis, 1987, Artificial Intelligence Goes to Work, High Technology, 7
- Freedman, 1987, Al Meets the Corporate Mainframe, Infosystems, 34, 32
- Gill, 1988, Texas Instruments: Capital Expert System
- Harmon, 1990, Creating Expert Systems for Business and Industry
- Helton, 1991, The Need for Case Based Reasoning: CBR Express, Al Expert, 6, 55
- Keyes, 1991, Getting Caught in a Neural Network, Al Expert, 6, 44
- O’Brien, 1993, Throwing a Net over Wall Street, Al Expert, 8, 19
- Prereau, 1985, Selection of an Appriopriate Domain for an Expert System, The Al Magazine, 5, 26
- Prietula, 1989, The Experts in Your Midst, Harvard Business Review, 67, 120
- Silverman, 1987, Should a Manager Hire an Expert System, 5
- Stapleton, 1988, Embedding Intelligence: The New Al Paradigm, Computer Language, 5, 97
- Sviokla, J.J. XCON, Planpower and Mudman: An In-Depth Analysis, unpublished Ph.D. dissertation, Harvard Business School, Cambridge, MA, 1986.
- Walker, 1990, Expert Systems
- Winston, 1984, Perspective, The Al Business, 1
Cited by
Bresnahan, T. F., Brynjolfsson, E., & Hitt, L. M. (2002) · The Quarterly Journal of Economics · doi:10.1162/003355302753399526 · Cited by 3,211
Measuring information systems success: models, dimensions, measures, and interrelationships
Petter, S., DeLone, W., & McLean, E. (2008) · European Journal of Information Systems · doi:10.1057/ejis.2008.15 · Cited by 1,884
“…examining factors related to expert system longevity and use in an organization, noted that technical reasons, such as system quality, were not the main consideration for use or discontinuance of use, which offers further support that system quality may not be a good predictor of use (Gill, 1995).”
BackgroundInformation Technology, Workplace Organization and the Demand for Skilled Labor: Firm-Level Evidence
Bresnahan, T., Brynjolfsson, E., & Hitt, L. (1999) · National Bureau of Economic Research · doi:10.3386/w7136 · Cited by 925
Managing artificial intelligence
Berente, N., Gu, B., Recker, J., & Santhanam, R. (2021) · MIS Quarterly · doi:10.25300/misq/2021/16274 · Cited by 898
The promise of artificial intelligence in chemical engineering: Is it here, finally?
Venkatasubramanian, V. (2019) · AIChE Journal · doi:10.1002/aic.16489 · Cited by 664
Metadata
- Authors
- Gill, T. G.
- Affiliations
- Florida Atlantic University (US)
- Corresponding author
- Gill, T. Grandon
- Venue
- MIS Quarterly
- Publisher
- MIS Quarterly
- Published
- 1995-03-01
- Volume
- 19
- Issue
- 1
- Pages
- 51-81
- ISSN
- 0276-7783 (ISSN-L)
- 2162-9730
- OpenAlex
- W2132004346
- Cited by
- 181
- References
- 34
- Citations by year
- 2026: 6 · 2025: 27 · 2024: 8 · 2023: 7 · 2022: 6 · 2021: 4 · 2020: 7 · 2019: 3 · 2018: 2 · 2017: 2 · 2016: 2 · 2015: 5 · 2014: 2 · 2013: 2 · 2012: 2
- FWCI
- 12.34
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- MIS Quarterly (publishedVersion)
- Journal of the Association for Information Systems (submittedVersion)
- Topics
- Social Sciences › Business, Management and Accounting › Management Information Systems › Decision Support System Applications
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Systems Theories and Implementation
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- expert systems, system maintenance, user acceptance, developer retention, organizational priorities
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.