The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
An analysis of expert systems for business decision making at different levels and in different roles
Abstract
This paper begins by analysing decision making activities and information requirements at three organizational levels and the characteristics of expert systems (ESs) intended for the two different roles of supporting and replacing a decision maker. It goes on to review the evidence from many years of commercial use of ESs at different levels and in different roles, and to analyse the evidence obtained from a pilot experiment involving developing ESs to fulfil two different roles in the same domain. The research finds that ESs in a replacement role prove to be effective for operational and tactical decisions, but have limitations at the strategic level. ESs in a support role, as advisory systems, can help to make better decisions, but their effectiveness can only be fulfilled through their users. In the experiments, an expert advisory system did not save a user's time, contrary to the expectations of many of its users, but an ES in a replacement role did improve the efficiency of decision making. In addition, the knowledge bases of the ESs in the different roles need to be different. Finally, the practical implications of the experience gained from developing and testing two types of ESs are discussed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, the potential benefit of human-AI symbiosis in organizational decision-making can only be fully realized if human decision makers accept the use of AI (Edwards et al., 2000; Mathieson, 1991).”
From Understanding managers’ attitudes and behavioral intentions towards using artificial intelligence for organizational decision-making (2021) · cites this paper as Edwards et al., 2000
In the citing paper
“As well as concerns about personal wellbeing, previous relevant studies (e.g. Duan et al., 1995; Edwards et al., 2000) reveal the AI users had concerns regarding how AI may prevent them learning from their own experience in making better decisions.”
From Understanding managers’ attitudes and behavioral intentions towards using artificial intelligence for organizational decision-making (2021) · cites this paper as Edwards et al., 2000
In the citing paper
“Expert systems in a replacement role are effective at the operational and tactical decision levels, but have limitations at the strategic level.”
From Artificial intelligence for decision making in the era of Big Data – evolution, challenges and research agenda (2019) · cites this paper as Edwards et al., 2000
In the citing paper
“Expert systems in a support role can help users make better decisions at all three decision making levels, but their effectiveness can only be fulfilled through their users.”
From Artificial intelligence for decision making in the era of Big Data – evolution, challenges and research agenda (2019) · cites this paper as Edwards et al., 2000
In the citing paper
“The users of expert systems in a support role did not believe that they had learned from using the system.”
From Artificial intelligence for decision making in the era of Big Data – evolution, challenges and research agenda (2019) · cites this paper as Edwards et al., 2000
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The New Science of Management Decision
Hershauer, J. C., & Simon, H. A. (1978) · The Academy of Management Review · doi:10.2307/257591 · Cited by 3,200
Planning and Control Systems: A Framework for Analysis
Anthony, R. N. (1965) · Medical Entomology and Zoology · Cited by 2,226
A framework for management information systems
Gorry, G. A., & Morton, M. S. S. (2011) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 1,464
Knowledge Acquisition for Expert Systems
Hart, A. (1988) · Knowledge, Skill and Artificial Intelligence · doi:10.1007/978-1-4471-1632-5_10 · Cited by 387
Exploring the Factors Associated With Expert Systems Success
Yoon, Y., Guimaraes, T., & O’Neal, Q. (1995) · MIS Quarterly · doi:10.2307/249712 · Cited by 255 · cited 3×
“Much has been written on the importance of user acceptance in ES implementations (Madni, 1988; Rees, 1992; Suh & Suh, 1993; Yoon et al , 1995; Gill, 1996; Yoon et al 1998).”
BackgroundSystems that support decision makers: description and analysis
Silver, M. S. (1991) · Cited by 201
Early expert systems: Where are they now?
Gill, T. G. (1995) · MIS Quarterly · doi:10.2307/249711 · Cited by 181
Expert Systems Usage: Task Change and Intrinsic Motivation1
Gill, T. G. (1996) · MIS Quarterly · doi:10.2307/249658 · Cited by 112 · cited 2×
“Much has been written on the importance of user acceptance in ES implementations (Madni, 1988; Rees, 1992; Suh & Suh, 1993; Yoon et al , 1995; Gill, 1996; Yoon et al 1998).”
BackgroundMethodDecision Support Systems: A summary, problems, and future trends
Er, M. C. (1988) · Decision Support Systems · doi:10.1016/0167-9236(88)90022-x · Cited by 95 · cited 1×
“Gorry and Scott Morton’s framework has been used by a number of authors in the DSS/ES area (e.g. O’Le-ary & Turban, 1987; Doukidis, 1988; Er, 1988; Tur-ban & Aronson 1998), although it is by no means the only framework that has been used to consider organizational implications of ESs.”
MethodOn the application of expert systems
Basden, A. (1983) · International Journal of Man-Machine Studies · doi:10.1016/s0020-7373(83)80066-2 · Cited by 86
Towards a methodology for evaluating expert systems
Preece, A. D. (1990) · Expert Systems · doi:10.1111/j.1468-0394.1990.tb00234.x · Cited by 85 · cited 1×
“It includes within it verifi-cation, validation and user acceptance (Preece, 1990).”
BackgroundExpert process planning system with solid model interface
Joshi, S. B., VISSA, N. N., & Chang, T. (1988) · International Journal of Production Research · doi:10.1080/00207548808947907 · Cited by 71 · cited 1×
“…completely is rare, but a few systems of this type do exist, mostly self-diagnosing machines (Hui et al , 1996; Guan & Graham, 1996), or process planning systems which automatically convert the design specification of a product into a process plan without human intervention (Joshi et al , 1988).”
BackgroundExpert system evaluation techniques: a selected bibliography
Grogono, P. D., Batarekh, A., Preece, A. D., Shinghal, R., & Suen, C. Y. (1991) · Expert Systems · doi:10.1111/j.1468-0394.1991.tb00371.x · Cited by 34 · cited 1×
“Validation checks the correctness of the system with respect to the user’s requirement (Grogono, 1991).”
BackgroundBuilding Knowledge-Based Systems -- Towards a Methodology
Ackermann, F., & Edwards, J. S. (1992) · Journal of the Operational Research Society · doi:10.2307/2583363 · Cited by 33
Self-citationExpert systems: Strategic implications and applications
(1988) · Long Range Planning · doi:10.1016/0024-6301(88)90136-7 · Cited by 32 · cited 5×
“Although decisions can, in principle, appear anywhere in the framework, it has been suggested by Barrett and Beerel (Beerel, 1987; Barrett & Beerel, 1988) and Silver (1991), among others, that they tend to cluster towards the diagonal, i.e. that most strategic planning decisions are unstructured, while most operationa…”
BackgroundInfluentialDecision support system concepts in expert systems: An empirical study
Doukidis, G. I. (1988) · Decision Support Systems · doi:10.1016/0167-9236(88)90021-8 · Cited by 32 · cited 1×
“Gorry and Scott Morton’s framework has been used by a number of authors in the DSS/ES area (e.g. O’Le-ary & Turban, 1987; Doukidis, 1988; Er, 1988; Tur-ban & Aronson 1998), although it is by no means the only framework that has been used to consider organizational implications of ESs.”
MethodA Survey of Operational Expert Systems in Business (1980–1993)
Eom, S. B. (1996) · INFORMS Journal on Applied Analytics · doi:10.1287/inte.26.5.50 · Cited by 28 · cited 1×
“Other surveys (Coakes & Merchant, 1996; Eom, 1996) do not specifically identify percentages, but their results follow a similar pattern.”
ResultExpert systems adoption. An analytical study of managerial issues and concerns
Kunnathur, A. S., Ahmed, M. U., & Charles, R. J. S. (1996) · Information & Management · doi:10.1016/0378-7206(95)00039-9 · Cited by 23 · cited 1×
“Although there have been some failures (O’Keefe & Rebne, 1993; Wong, 1996), recent research (Yoon et al , 1995; Kunnathur et al , 1996) shows that there are many companies who remain enthusiastic proponents of the technology and continue to develop important ES applications.”
BackgroundExpert systems for business applications: Potentials and limitations
Lin, E. (1986) · Journal of systems management · Cited by 23
Intelligent Advisory Systems for Managing and Disseminating Information
Hadden, S. G. (1986) · Public Administration Review · doi:10.2307/975579 · Cited by 22 · cited 1×
“Hadden (1986) suggested that speeding up the decision making process was a typical benefit of an expert advisory system, but Townsend and Feucht (1986) argued that the question-and-answer dialogue used in KBSs/ESs was often slow.”
BackgroundExpert systems: A survey of their use in UK business
Coakes, E. W., & Merchant, K. (1996) · Information & Management · doi:10.1016/s0378-7206(96)01054-3 · Cited by 21 · cited 1×
“Other surveys (Coakes & Merchant, 1996; Eom, 1996) do not specifically identify percentages, but their results follow a similar pattern.”
ResultUsing human factor guidelines for developing expert systems
Suh, C., & Suh, E. (1993) · Expert Systems · doi:10.1111/j.1468-0394.1993.tb00091.x · Cited by 16 · cited 1×
“Much has been written on the importance of user acceptance in ES implementations (Madni, 1988; Rees, 1992; Suh & Suh, 1993; Yoon et al , 1995; Gill, 1996; Yoon et al 1998).”
BackgroundExpert System Technology for Managerial Applications: A Typology
Coursey, D. H., & Shangraw, R. F. (1989) · Public Productivity Review · doi:10.2307/3380116 · Cited by 16 · cited 1×
“All the ESs in a replacement role appear to retain a human user except for the function identified as task automation by Coursey and Shangraw (1989) and automaton by Edwards (1991).”
BackgroundA Comparison of Potential Applications of Expert Systems and Decision Support Systems
Connell, N. A. D., & Powell, P. L. (1990) · Journal of the Operational Research Society · doi:10.1057/jors.1990.68 · Cited by 15 · cited 2×
“However, Connell and Powell (1990) found a pattern in the responses they received from senior management that could be interpreted as ‘if I use it myself, it is a decision support sys-tem; if my subordinates use it, it’s an ES’.”
BackgroundBusiness Strategy Advisor: An Expert Systems Implementation
Schümann, M., Gongla, P., Lee, K.-S., & Sakamoto, J. G. (1989) · Journal of Information Systems Management · doi:10.1080/07399018908960139 · Cited by 12 · cited 2×
“The ES literature agrees (Schumann et al , 1989; Oz et al , 1993) that an expert advisory system is able to improve the effectiveness of the user’s decision making, but some disagreement exists as to whether an ES in a support role should improve the efficiency of decision making or not.”
BackgroundPractical Experience in Building Expert Systems
Bramer, M. (1990) · John Wiley & Sons, Inc. eBooks · Cited by 11
An integrated approach for fault diagnosis with learning
Guan, J., & Graham, J. H. (1996) · Computers in Industry · doi:10.1016/s0166-3615(96)00048-6 · Cited by 11 · cited 1×
“The use of an ES to replace humans completely is rare, but a few systems of this type do exist, mostly self-diagnosing machines (Hui et al , 1996; Guan & Graham, 1996), or process planning systems which automatically convert the design specification of a product into a process plan without human…”
MethodMedical expert systems for developing countries: Evaluation in practice
Doukidis, G., Cornford, T., & Forster, D. (1994) · Expert Systems with Applications · doi:10.1016/0957-4174(94)90039-6 · Cited by 9 · cited 2×
“Neither ADGAME nor the ES reported by Doukidis et al (1994) were tightly integrated, and neither saved time, but the more integrated system reported by Agarwal et al (1994) did save the users’ time.”
BackgroundMethodExpert systems and production/operations management
Cheng, T. C. E., & Bizruchak, D. (1991) · International Journal of Production Economics · doi:10.1016/0925-5273(91)90100-8 · Cited by 8 · cited 1×
“(Hart, 1989); and ‘ESs are not intended to replace the decision maker but to assist people in dealing with various problems’ (Cheng & Bizruchak, 1991).”
BackgroundExperiences with EXGAME: an expert system for playing a competitive business game
Duan, Y., Edwards, J. S., & Robins, P. (1998) · Intelligent systems in accounting, finance and management/Intelligent systems in accounting, finance & management · doi:10.1002/(sici)1099-1174(199803)7:1<1::aid-isaf139>3.0.co;2-w · Cited by 5
Self-citationBusiness policy and strategic action : text, cases, and management game
Broom, H. N. (1969) · Prentice Hall eBooks · Cited by 4
User Evaluation of Expert Systems
Rees, P. L. (1992) · Industrial Management & Data Systems · doi:10.1108/02635579210015392 · Cited by 4 · cited 1×
“Much has been written on the importance of user acceptance in ES implementations (Madni, 1988; Rees, 1992; Suh & Suh, 1993; Yoon et al , 1995; Gill, 1996; Yoon et al 1998).”
BackgroundPerceived Impact and Diffusion of Expert Systems in Banking: An Exploratory Investigation
SHAO, Y. (1998) · International Journal of Information Management · doi:10.1016/s0268-4012(97)00055-8 · Cited by 2 · cited 3×
“Detailed descriptions of EXGAME’s and ADGAME’s development, experiment design, research hypothesis and result analysis are presented elsewhere (Duan et al , 1995, 1998).”
BackgroundMethod
Cited by
Dwivedi, Y. K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, C., Crick, T., Duan, Y., Dwivedi, R., Edwards, J., Eirug, A., et al. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.08.002 · Cited by 4,611
“As the effectiveness of AI systems for decision making can only be realised through its acceptance and use by the end users (Edwards et al., 2000), the system design criteria for AI based systems has been an issue since the early applications of AI.”
BackgroundSelf-citationDuan, Y., Edwards, J. S., & Dwivedi, Y. K. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.01.021 · Cited by 2,628
Self-citationSchultze, U., & Leidner, D. E. (2002) · MIS Quarterly · doi:10.2307/4132331 · Cited by 667
Cao, G., Duan, Y., Edwards, J. S., & Dwivedi, Y. K. (2021) · Technovation · doi:10.1016/j.technovation.2021.102312 · Cited by 571
“Secondly, firms need to develop an effective mechanism through which managers ’ personal concerns could be alleviated as these could negatively influence managers ’ attitudes and behavioral intentions (e.g. Duan et al., 2019; Duan et al., 1995; Edwards et al., 2000; Tambe et al., 2019).”
BackgroundMethodInfluentialSelf-citationKeding, C. (2021) · Management Review Quarterly · doi:10.1007/s11301-020-00181-x · Cited by 231
“…expert knowledge (Ashmore 1989) and guiding organizational action (e.g., Luconi et al. 1986; Merten 1991) with limitations at the strategic level (Edwards and Yanqing 2000), current research streams clarify that the real value of AI is to perform data analysis autonomously across various sorts…”
Background
Metadata
- Authors
- Edwards, J. S., Duan, Y., & Robins, P. C.
- Affiliations
- Aston University (GB)
- Luton Business School, University of Luton LU1 3JU UK
- ORCID
- Venue
- European Journal of Information Systems
- Publisher
- Informa UK Limited
- Published
- 2000-03
- Volume
- 9
- Issue
- 1
- Pages
- 36-46
- ISSN
- 0960-085X (ISSN-L)
- 1476-9344
- OpenAlex
- W1979001454
- Cited by
- 109
- References
- 33
- Citations by year
- 2026: 22 · 2025: 24 · 2024: 17 · 2023: 12 · 2022: 5 · 2021: 7 · 2020: 1 · 2019: 3 · 2016: 1 · 2014: 1 · 2012: 1
- FWCI
- 2.14
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- European Journal of Information Systems (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- University of Bedfordshire Repository (University of Bedfordshire) (submittedVersion)
- Topics
- Social Sciences › Business, Management and Accounting › Management Information Systems › Decision Support System Applications
- Physical Sciences › Computer Science › Artificial Intelligence › AI-based Problem Solving and Planning
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Systems Theories and Implementation
- Keywords
- expert systems, management decision-making, levels of organization, strategic decision-making, advisory systems, decision support, knowledge base, information needs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.