CoChat

How Much Automation Is Too Much? Keeping the Human Relevant in Knowledge Work

Open access
Sutton, Steve G., Arnold, Vicky, Holt, Matthew · 2018 · Journal of Emerging Technologies in Accounting
Cited by 123

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

Abstract

With the rapid advances in data analytics, machine learning, and continuous monitoring along with other related advances in artificial intelligence-based technologies, our solution as researchers to many of today's business problems increasingly becomes one of, “Can I fix the problem through automation?” However, as we find that artificial intelligence increasingly provides us with the power to replace knowledge workers with automated systems, rarely is the question asked, “Should we automate knowledge work?” There are a host of questions that should be addressed including (1) whether automation is the most effective solution, (2) if there are ethical dilemmas associated with replacing the human element, and (3) if there are societal implications of displacing large numbers of knowledge workers. The focus of this discussion is on understanding the impact of knowledge-based systems on human users' knowledge acquisition and retention and outlining an alternative research strategy that centers more on transferring knowledge to the user during the work production process in order to maintain human expertise and relevance in professional decision making. Contemporary research still argues that human-computer collaboration may outperform either on their own; but, to limit the deskilling effect of knowledge-based systems and alternatively promote skill development, we call upon academic researchers to seek better ways to keep the human relevant in a broad range of knowledge work fields. Further, we suggest that expanding the philosophical discussions of the ethics of artificial intelligence-based technologies and the corollary impact on the rapid decline of the professions is necessary.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2308/jeta-52311

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 7 references

Research works printed but not linked: 56

  1. Anderson, J. R. 2000. Learning and Memory. New York, NY: John Wiley & Sons, Inc.
  2. Arnold, 1997, Toward a philosophical foundation for ethical development of audit expert systems: A contractarian approach, Research on Accounting Ethics, 3, 211
  3. Arnold, 1998, The theory of technology dominance: Understanding the impact of intelligent decision aids on decision makers' judgments, Advances in Accounting Behavioral Research, 1, 175
  4. Arnold, 2004, Impact of intelligent decision aids on expert and novice decision-makers' judgments, Accounting & Finance, 44, 1, 10.1111/j.1467-629x.2004.00099.x · DOI
  5. Arnold, 2006, The differential use and effect of knowledge-based system explanations in novice and expert judgment decisions, MIS Quarterly, 30, 79, 10.2307/25148718 · DOI · Paper page
  6. Arnold, 2013, INCASE: Simulating experience to accelerate expertise development by knowledge workers, Intelligent Systems in Accounting, Finance & Management, 20, 1, 10.1002/isaf.1337 · DOI
  7. Balasubramanian, 2017, Towards establishing design principles for balancing usability and maintaining cognitive abilities, Design, User Experience, and Usability: Theory, Methodology, and Management: DUXU 2017: Lecture Notes in Computer Science, Volume 10288, edited by
  8. Bonner, S. E. 2008. Judgment and Decision Making in Accounting. Upper Saddle River, NJ: Prentice Hall.
  9. Braverman, H. 1974. Labor and Monopoly Capital: The Degradation of Work in the Twentieth Century. New York, NY: New York University Press.
  10. Brewster, 2011, How a systems perspective improves knowledge acquisition and performance in analytical procedures, The Accounting Review, 86, 915, 10.2308/accr.00000040 · DOI
  11. Brynjolfsson, E., and A.McAfee. 2011. Race Against the Machine. Lexington, MA: Digital Frontier Press.
  12. Cabrera, 2008, Systems thinking, Evaluation and Program Planning, 31, 299, 10.1016/j.evalprogplan.2007.12.001 · DOI
  13. Cath, 2018, Artificial intelligence and the “good society”: The U.S., EU, and U.K. approach, Science and Engineering Ethics, 24, 505
  14. Chi, 2012, Seeing deep structure from the interactions of surface features, Educational Psychologist, 47, 177, 10.1080/00461520.2012.695709 · DOI · Paper page
  15. Davis, 1997, Supporting a complex audit judgment task: An expert network approach, European Journal of Operational Research, 103, 350, 10.1016/S0377-2217(97)00125-2 · DOI
  16. Day, 2012, The import of knowledge export: Connecting findings and theories of transfer of learning, Educational Psychologist, 47, 153, 10.1080/00461520.2012.696438 · DOI · Paper page
  17. Dillard, 1997, Fluid structures: A structuration approach to evaluating information technology, Advances in Accounting Information Systems, 5, 247
  18. Dillard, 2001, A responsibility ethic for audit systems, Journal of Business Ethics, 30, 337, 10.1023/A:1010720630914 · DOI
  19. Dillard, 2002, Ethics research in AIS, Researching Accounting as an Information Systems Discipline
  20. Dowling, 2014, A Big 4 firm's use of information technology to control the audit process: How an audit support system is changing auditor behavior, Contemporary Accounting Research, 31, 230, 10.1111/1911-3846.12010 · DOI
  21. Dowling, 2008, Audit support system design and the declarative knowledge of long-term users, Journal of Emerging Technologies in Accounting, 5, 99, 10.2308/jeta.2008.5.1.99 · DOI
  22. Dumas, 2013, Relational reasoning and its manifestations in the educational context: A systematic review of the literature, Educational Psychology Review, 25, 391, 10.1007/s10648-013-9224-4 · DOI
  23. Eining, 1991, The impact of expert systems on experiential learning in an auditing setting, Journal of Information Systems, 1
  24. Gentner, 2010, Analogical processes in human thinking and learning, Towards a Theory of Thinking, 10.1007/978-3-642-03129-8_3 · DOI
  25. Goddard, 2011, Automation bias—A hidden issue for clinical intelligence/decision support system use, Studies in Health Technology and Informatics, 164, 17
  26. Goldwater, 2016, Relational categories as a bridge between cognitive and educational research, Psychological Bulletin, 142, 729, 10.1037/bul0000043 · DOI
  27. Hmelo, 1998, Problem-based learning: Effects on the early acquisition of cognitive skill in medicine, Journal of the Learning Sciences, 7, 173, 10.1207/s15327809jls0702_2 · DOI · Paper page
  28. Hmelo-Silver, 2004, Problem-based learning: What and how do students learn?, Educational Psychology Review, 16, 235, 10.1023/B:EDPR.0000034022.16470.f3 · DOI · Paper page
  29. Hofstadter, 2001, Analogy as the core of cognition, The Analogical Mind: Perspectives from Cognitive Science, 499, 10.7551/mitpress/1251.003.0020 · DOI · Paper page
  30. Holyoak, 2014, Using analogies as a basis for teaching cognitive readiness, Teaching and Measuring Cognitive Readiness, 10.1007/978-1-4614-7579-8_12 · DOI
  31. Jonassen, D., J.Howland, J.Marra, and D.Crismond. 2008. Meaningful Learning with Technology. Upper Saddle River, NJ: Prentice Hall.
  32. Kultgen, J. 1988. Ethics and Professionalism. Philadelphia, PA: University of Pennsylvania Press. · doi:10.9783/9780812202540
  33. Lampe, 2016, A post-SOX history of U.S. public accountancy. The history of deprofessionalization in U.S. public accountancy: Part III, Research on Professional Responsibility and Ethics in Accounting, 20, 3, 10.1108/S1574-076520160000020001 · doi:10.1108/s1574-076520160000020001
  34. Libby, 1993, Determinants of judgment performance in accounting settings: Ability, knowledge, motivation, and environment, Accounting, Organizations and Society, 18, 425, 10.1016/0361-3682(93)90040-D · DOI
  35. Lombardi, 2016, The development of AudEx: An audit data assessment system, Journal of Emerging Technologies in Accounting, 13, 37, 10.2308/jeta-51445 · DOI
  36. Magro, 2012, Evaluating the strength of evidence: How experience affects the use of analogical reasoning and configural information processing in tax, The Accounting Review, 87, 291, 10.2308/accr-10161 · doi:10.2308/accr-10161
  37. Martins, 2012, Automation under suspicion—Case: Flight AF-447 Air France, Work (Reading, MA), 41, 222
  38. Masselli, 2002, The impact of embedded intelligent agents on tax compliance decisions, The Journal of the American Taxation Association, 24, 60, 10.2308/jata.2002.24.2.60 · DOI
  39. McCall, 2008, Use of knowledge management systems and the impact on the acquisition of explicit knowledge, Journal of Information Systems, 22, 77, 10.2308/jis.2008.22.2.77 · DOI
  40. Midgley, 2003, Science as systemic intervention: Some implications of systems thinking and complexity for the philosophy of science, Systemic Practice and Action Research, 16, 77, 10.1023/A:1022833409353 · DOI
  41. Milne, 2001, Problem-based learning: A pedagogy for using case material in accounting education, Accounting Education, 10, 61, 10.1080/09639280122712 · DOI
  42. Noga, 2002, Do tax decision support systems affect the accuracy of tax compliance decisions?, International Journal of Accounting Information Systems, 3, 125, 10.1016/S1467-0895(02)00034-9 · DOI
  43. O'Donnell, 2005, Enterprise risk management: A systems-thinking framework for the event identification phase, International Journal of Accounting Information Systems, 6, 177, 10.1016/j.accinf.2005.05.002 · DOI
  44. Rose, 2007, Measurement of knowledge structures acquired through instruction, experience, and decision aid use, International Journal of Accounting Information Systems, 8, 117, 10.1016/j.accinf.2007.04.002 · DOI
  45. Rose, 2012, Designing decision aids to promote the development of expertise, Journal of Information Systems, 26, 7, 10.2308/isys-10188 · DOI
  46. Smedley, 2004, Explanation provision in knowledge-based systems: A theory driven approach for knowledge transfer designs, Journal of Emerging Technologies in Accounting, 1, 41, 10.2308/jeta.2004.1.1.41 · DOI
  47. Smedley, 2007, The effect of alternative procedural explanation types on procedural knowledge acquisition during knowledge-based systems use, Journal of Information Systems, 21, 27, 10.2308/jis.2007.21.1.27 · DOI
  48. Suskind, R., and D.Suskind. 2016. The Future of the Professions: How Technology Will Transform the Work of Human Experts. Oxford, U.K.: Oxford University Press.
  49. Sutton, 1995, Toward an understanding of the philosophical foundations for ethical development of audit expert systems, Research on Accounting Ethics, 1, 61
  50. Sutton, 1997–1998, Teleological foundations for the ethical implications of expert systems development: Act versus rule based reasoning, Accounting Forum, 21, 463
  51. Triki, 2014, Lessons learned from the literature on the theory of technology dominance: Possibilities for an extended research framework, Journal of Emerging Technologies in Accounting, 11, 41, 10.2308/jeta-51078 · DOI
  52. Vasarhelyi, M. A. 2017. Keynote Address: Audit Data Analytics. International Symposium on Accounting Information Systems, Valencia, Spain.
  53. Wakabayashi, 2017, Meet the people who train robots (to do their jobs), The New York Times, 4
  54. Ward, 2013, Supernormal: How the Internet is changing our memories and our minds, Psychological Inquiry, 24, 341, 10.1080/1047840X.2013.850148 · DOI · Paper page
  55. Yampolskiy, 2012, Artificial intelligence safety engineering: Why machine ethics is a wrong approach, Philosophy and Theory of Artificial Intelligence SAPERE 5, 389
  56. Yuthas, 1996, An integrative model of accounting expert system design and implementation, Advances in Accounting Information Systems, 4, 55

Cited by

See all 123

Metadata

Authors
Sutton, S. G., Arnold, V., & Holt, M.
Venue
Journal of Emerging Technologies in Accounting
Published
2018-09-01
Volume
15
Issue
2
Pages
15-25
ISSN
  • 1554-1908 (ISSN-L)
  • 1558-7940
OpenAlex
W2898720016
Cited by
123
References
7
FWCI
5.19
Type
journal article
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: How Much Automation Is Too Much? Keeping the Human Relevant in Knowledge Work. https://app.cochat.ai/papers/10.2308/jeta-52311
The paper
Sutton, S. G., Arnold, V., & Holt, M. (2018). How Much Automation Is Too Much? Keeping the Human Relevant in Knowledge Work. Journal of Emerging Technologies in Accounting. https://doi.org/10.2308/jeta-52311

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.