How Much Automation Is Too Much? Keeping the Human Relevant in Knowledge Work
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
With the rapid advances in data analytics, machine learning, and continuous monitoring along with other related advances in artificial intelligence-based technologies, our solution as researchers to many of today's business problems increasingly becomes one of, “Can I fix the problem through automation?” However, as we find that artificial intelligence increasingly provides us with the power to replace knowledge workers with automated systems, rarely is the question asked, “Should we automate knowledge work?” There are a host of questions that should be addressed including (1) whether automation is the most effective solution, (2) if there are ethical dilemmas associated with replacing the human element, and (3) if there are societal implications of displacing large numbers of knowledge workers. The focus of this discussion is on understanding the impact of knowledge-based systems on human users' knowledge acquisition and retention and outlining an alternative research strategy that centers more on transferring knowledge to the user during the work production process in order to maintain human expertise and relevance in professional decision making. Contemporary research still argues that human-computer collaboration may outperform either on their own; but, to limit the deskilling effect of knowledge-based systems and alternatively promote skill development, we call upon academic researchers to seek better ways to keep the human relevant in a broad range of knowledge work fields. Further, we suggest that expanding the philosophical discussions of the ethics of artificial intelligence-based technologies and the corollary impact on the rapid decline of the professions is necessary.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The future of employment: How susceptible are jobs to computerisation?
Frey, C. B., & Osborne, M. A. (2017) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2016.08.019 · Cited by 8,727
Google Effects on Memory: Cognitive Consequences of Having Information at Our Fingertips
Sparrow, B., Liu, J., & Wegner, D. M. (2011) · Science · doi:10.1126/science.1207745 · Cited by 1,762
The process of problem‐based learning: what works and why
Schmidt, H. G., Rotgans, J. I., & Yew, E. H. (2011) · Medical Education · doi:10.1111/j.1365-2923.2011.04035.x · Cited by 855
Research Priorities for Robust and Beneficial Artificial Intelligence
Russell, S., Dewey, D., & Tegmark, M. (2015) · AI Magazine · doi:10.1609/aimag.v36i4.2577 · Cited by 637
Explanations From Intelligent Systems: Theoretical Foundations and Implications for Practice1
Gregor, S., & Benbasat, I. (1999) · MIS Quarterly · doi:10.2307/249487 · Cited by 535
Will Democracy Survive Big Data and Artificial Intelligence?
Helbing, D., Frey, B. S., Gigerenzer, G., Hafen, E., Hagner, M., Hofstetter, Y., van den Hoven, J., Zicari, R. V., & Zwitter, A. (2019) · Towards Digital Enlightenment · doi:10.1007/978-3-319-90869-4_7 · Cited by 355
Automation bias: Empirical results assessing influencing factors
Goddard, K., Roudsari, A., & Wyatt, J. C. (2014) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2014.01.001 · Cited by 163
Research works printed but not linked: 56
- Anderson, J. R. 2000. Learning and Memory. New York, NY: John Wiley & Sons, Inc.
- Arnold, 1997, Toward a philosophical foundation for ethical development of audit expert systems: A contractarian approach, Research on Accounting Ethics, 3, 211
- Arnold, 1998, The theory of technology dominance: Understanding the impact of intelligent decision aids on decision makers' judgments, Advances in Accounting Behavioral Research, 1, 175
- Arnold, 2004, Impact of intelligent decision aids on expert and novice decision-makers' judgments, Accounting & Finance, 44, 1, 10.1111/j.1467-629x.2004.00099.x · DOI
- Arnold, 2006, The differential use and effect of knowledge-based system explanations in novice and expert judgment decisions, MIS Quarterly, 30, 79, 10.2307/25148718 · DOI · Paper page
- Arnold, 2013, INCASE: Simulating experience to accelerate expertise development by knowledge workers, Intelligent Systems in Accounting, Finance & Management, 20, 1, 10.1002/isaf.1337 · DOI
- Balasubramanian, 2017, Towards establishing design principles for balancing usability and maintaining cognitive abilities, Design, User Experience, and Usability: Theory, Methodology, and Management: DUXU 2017: Lecture Notes in Computer Science, Volume 10288, edited by
- Bonner, S. E. 2008. Judgment and Decision Making in Accounting. Upper Saddle River, NJ: Prentice Hall.
- Braverman, H. 1974. Labor and Monopoly Capital: The Degradation of Work in the Twentieth Century. New York, NY: New York University Press.
- Brewster, 2011, How a systems perspective improves knowledge acquisition and performance in analytical procedures, The Accounting Review, 86, 915, 10.2308/accr.00000040 · DOI
- Brynjolfsson, E., and A.McAfee. 2011. Race Against the Machine. Lexington, MA: Digital Frontier Press.
- Cabrera, 2008, Systems thinking, Evaluation and Program Planning, 31, 299, 10.1016/j.evalprogplan.2007.12.001 · DOI
- Cath, 2018, Artificial intelligence and the “good society”: The U.S., EU, and U.K. approach, Science and Engineering Ethics, 24, 505
- Chi, 2012, Seeing deep structure from the interactions of surface features, Educational Psychologist, 47, 177, 10.1080/00461520.2012.695709 · DOI · Paper page
- Davis, 1997, Supporting a complex audit judgment task: An expert network approach, European Journal of Operational Research, 103, 350, 10.1016/S0377-2217(97)00125-2 · DOI
- Day, 2012, The import of knowledge export: Connecting findings and theories of transfer of learning, Educational Psychologist, 47, 153, 10.1080/00461520.2012.696438 · DOI · Paper page
- Dillard, 1997, Fluid structures: A structuration approach to evaluating information technology, Advances in Accounting Information Systems, 5, 247
- Dillard, 2001, A responsibility ethic for audit systems, Journal of Business Ethics, 30, 337, 10.1023/A:1010720630914 · DOI
- Dillard, 2002, Ethics research in AIS, Researching Accounting as an Information Systems Discipline
- Dowling, 2014, A Big 4 firm's use of information technology to control the audit process: How an audit support system is changing auditor behavior, Contemporary Accounting Research, 31, 230, 10.1111/1911-3846.12010 · DOI
- Dowling, 2008, Audit support system design and the declarative knowledge of long-term users, Journal of Emerging Technologies in Accounting, 5, 99, 10.2308/jeta.2008.5.1.99 · DOI
- Dumas, 2013, Relational reasoning and its manifestations in the educational context: A systematic review of the literature, Educational Psychology Review, 25, 391, 10.1007/s10648-013-9224-4 · DOI
- Eining, 1991, The impact of expert systems on experiential learning in an auditing setting, Journal of Information Systems, 1
- Gentner, 2010, Analogical processes in human thinking and learning, Towards a Theory of Thinking, 10.1007/978-3-642-03129-8_3 · DOI
- Goddard, 2011, Automation bias—A hidden issue for clinical intelligence/decision support system use, Studies in Health Technology and Informatics, 164, 17
- Goldwater, 2016, Relational categories as a bridge between cognitive and educational research, Psychological Bulletin, 142, 729, 10.1037/bul0000043 · DOI
- Hmelo, 1998, Problem-based learning: Effects on the early acquisition of cognitive skill in medicine, Journal of the Learning Sciences, 7, 173, 10.1207/s15327809jls0702_2 · DOI · Paper page
- Hmelo-Silver, 2004, Problem-based learning: What and how do students learn?, Educational Psychology Review, 16, 235, 10.1023/B:EDPR.0000034022.16470.f3 · DOI · Paper page
- Hofstadter, 2001, Analogy as the core of cognition, The Analogical Mind: Perspectives from Cognitive Science, 499, 10.7551/mitpress/1251.003.0020 · DOI · Paper page
- Holyoak, 2014, Using analogies as a basis for teaching cognitive readiness, Teaching and Measuring Cognitive Readiness, 10.1007/978-1-4614-7579-8_12 · DOI
- Jonassen, D., J.Howland, J.Marra, and D.Crismond. 2008. Meaningful Learning with Technology. Upper Saddle River, NJ: Prentice Hall.
- Kultgen, J. 1988. Ethics and Professionalism. Philadelphia, PA: University of Pennsylvania Press. · doi:10.9783/9780812202540
- Lampe, 2016, A post-SOX history of U.S. public accountancy. The history of deprofessionalization in U.S. public accountancy: Part III, Research on Professional Responsibility and Ethics in Accounting, 20, 3, 10.1108/S1574-076520160000020001 · doi:10.1108/s1574-076520160000020001
- Libby, 1993, Determinants of judgment performance in accounting settings: Ability, knowledge, motivation, and environment, Accounting, Organizations and Society, 18, 425, 10.1016/0361-3682(93)90040-D · DOI
- Lombardi, 2016, The development of AudEx: An audit data assessment system, Journal of Emerging Technologies in Accounting, 13, 37, 10.2308/jeta-51445 · DOI
- Magro, 2012, Evaluating the strength of evidence: How experience affects the use of analogical reasoning and configural information processing in tax, The Accounting Review, 87, 291, 10.2308/accr-10161 · doi:10.2308/accr-10161
- Martins, 2012, Automation under suspicion—Case: Flight AF-447 Air France, Work (Reading, MA), 41, 222
- Masselli, 2002, The impact of embedded intelligent agents on tax compliance decisions, The Journal of the American Taxation Association, 24, 60, 10.2308/jata.2002.24.2.60 · DOI
- McCall, 2008, Use of knowledge management systems and the impact on the acquisition of explicit knowledge, Journal of Information Systems, 22, 77, 10.2308/jis.2008.22.2.77 · DOI
- Midgley, 2003, Science as systemic intervention: Some implications of systems thinking and complexity for the philosophy of science, Systemic Practice and Action Research, 16, 77, 10.1023/A:1022833409353 · DOI
- Milne, 2001, Problem-based learning: A pedagogy for using case material in accounting education, Accounting Education, 10, 61, 10.1080/09639280122712 · DOI
- Noga, 2002, Do tax decision support systems affect the accuracy of tax compliance decisions?, International Journal of Accounting Information Systems, 3, 125, 10.1016/S1467-0895(02)00034-9 · DOI
- O'Donnell, 2005, Enterprise risk management: A systems-thinking framework for the event identification phase, International Journal of Accounting Information Systems, 6, 177, 10.1016/j.accinf.2005.05.002 · DOI
- Rose, 2007, Measurement of knowledge structures acquired through instruction, experience, and decision aid use, International Journal of Accounting Information Systems, 8, 117, 10.1016/j.accinf.2007.04.002 · DOI
- Rose, 2012, Designing decision aids to promote the development of expertise, Journal of Information Systems, 26, 7, 10.2308/isys-10188 · DOI
- Smedley, 2004, Explanation provision in knowledge-based systems: A theory driven approach for knowledge transfer designs, Journal of Emerging Technologies in Accounting, 1, 41, 10.2308/jeta.2004.1.1.41 · DOI
- Smedley, 2007, The effect of alternative procedural explanation types on procedural knowledge acquisition during knowledge-based systems use, Journal of Information Systems, 21, 27, 10.2308/jis.2007.21.1.27 · DOI
- Suskind, R., and D.Suskind. 2016. The Future of the Professions: How Technology Will Transform the Work of Human Experts. Oxford, U.K.: Oxford University Press.
- Sutton, 1995, Toward an understanding of the philosophical foundations for ethical development of audit expert systems, Research on Accounting Ethics, 1, 61
- Sutton, 1997–1998, Teleological foundations for the ethical implications of expert systems development: Act versus rule based reasoning, Accounting Forum, 21, 463
- Triki, 2014, Lessons learned from the literature on the theory of technology dominance: Possibilities for an extended research framework, Journal of Emerging Technologies in Accounting, 11, 41, 10.2308/jeta-51078 · DOI
- Vasarhelyi, M. A. 2017. Keynote Address: Audit Data Analytics. International Symposium on Accounting Information Systems, Valencia, Spain.
- Wakabayashi, 2017, Meet the people who train robots (to do their jobs), The New York Times, 4
- Ward, 2013, Supernormal: How the Internet is changing our memories and our minds, Psychological Inquiry, 24, 341, 10.1080/1047840X.2013.850148 · DOI · Paper page
- Yampolskiy, 2012, Artificial intelligence safety engineering: Why machine ethics is a wrong approach, Philosophy and Theory of Artificial Intelligence SAPERE 5, 389
- Yuthas, 1996, An integrative model of accounting expert system design and implementation, Advances in Accounting Information Systems, 4, 55
Cited by
Ethical framework for Artificial Intelligence and Digital technologies
Ashok, M., Madan, R., Joha, A., & Sivarajah, U. (2022) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2021.102433 · Cited by 469
Explainable artificial intelligence: Objectives, stakeholders, and future research opportunities
Meske, C., Bunde, E., Schneider, J., & Gersch, M. (2022) · Information Systems Management · doi:10.1080/10580530.2020.1849465 · Cited by 365
Ahmad, S. F., Han, H., Alam, M. M., Rehmat, M. K., Irshad, M., Arraño-Muñoz, M., & Ariza-Montes, A. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-01787-8 · Cited by 338
RetractedTechnology readiness and the organizational journey towards AI adoption: An empirical study
Uren, V., & Edwards, J. S. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2022.102588 · Cited by 335
How can we manage biases in artificial intelligence systems – A systematic literature review
P.S., D. V. (2023) · International Journal of Information Management Data Insights · doi:10.1016/j.jjimei.2023.100165 · Cited by 239
Metadata
- Authors
- Sutton, S. G., Arnold, V., & Holt, M.
- Venue
- Journal of Emerging Technologies in Accounting
- Publisher
- American Accounting Association
- Published
- 2018-09-01
- Volume
- 15
- Issue
- 2
- Pages
- 15-25
- ISSN
- 1554-1908 (ISSN-L)
- 1558-7940
- OpenAlex
- W2898720016
- Cited by
- 123
- References
- 7
- FWCI
- 5.19
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How Much Automation Is Too Much? Keeping the Human Relevant in Knowledge Work. https://app.cochat.ai/papers/10.2308/jeta-52311
- The paper
- Sutton, S. G., Arnold, V., & Holt, M. (2018). How Much Automation Is Too Much? Keeping the Human Relevant in Knowledge Work. Journal of Emerging Technologies in Accounting. https://doi.org/10.2308/jeta-52311
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.