CoChat
Sign Up
PreprintCited by 7Human-Automation Interaction and SafetyUsability and User Interface DesignInformation Systems Theories and Implementation

Ironies of Generative AI: Understanding and mitigating productivity loss in human-AI interactions

Open access
Simkute, Auste, Tankelevitch, Lev, Kewenig, Viktor, Scott, Ava Elizabeth, Sellen, Abigail, Rintel, Sean·2024·arXiv
DOI 10.48550/arxiv.2402.11364arXiv 2402.11364
Open this paper in CoChat — free accountOpen PDF

Abstract

Generative AI (GenAI) systems offer opportunities to increase user productivity in many tasks, such as programming and writing. However, while they boost productivity in some studies, many others show that users are working ineffectively with GenAI systems and losing productivity. Despite the apparent novelty of these usability challenges, these 'ironies of automation' have been observed for over three decades in Human Factors research on the introduction of automation in domains such as aviation, automated driving, and intelligence. We draw on this extensive research alongside recent GenAI user studies to outline four key reasons for productivity loss with GenAI systems: a shift in users' roles from production to evaluation, unhelpful restructuring of workflows, interruptions, and a tendency for automation to make easy tasks easier and hard tasks harder. We then suggest how Human Factors research can also inform GenAI system design to mitigate productivity loss by using approaches such as continuous feedback, system personalization, ecological interface design, task stabilization, and clear task allocation. Thus, we ground developments in GenAI system usability in decades of Human Factors research, ensuring that the design of human-AI interactions in this rapidly moving field learns from history instead of repeating it.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2402.11364

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • In the context of solving logical puzzles, intelligent tutors should offer backwards-oriented workflows rather than focusing on forward-oriented workflows.

    “For example, [1] and [164] suggest that in the context of solving logical puzzles, intelligent tutors should offer backwards-oriented workflows (e.g., using prompts to encourage thinking about the negation of the actual solution), rather than focusing on forward-oriented workflows.”

    From The Metacognitive Demands and Opportunities of Generative AI (2024) · cites this paper as [164]

    Section 3.3 recommends that AI systems respect a task’s natural sequence and avoid suggestions that interfere with it. The paper discusses this in the context of programming, however; it does not recommend backwards-oriented workflows for logical-puzzle tutors or compare them with forward-oriented workflows. (LLM, conf=0.76)

    Experimental — accuracy not yet measured

  • Research on real-world GenAI workflows, primarily in AI-assisted coding, suggests that tools like GitHub Copilot alter users' workflows in diverse ways.

    “Research on real-world GenAI workflows, primarily in AI-assisted coding, suggests that tools like GitHub Copilot alter users' workflows in diverse ways [166].”

    From The Metacognitive Demands and Opportunities of Generative AI (2024) · cites this paper as [166]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 127

  1. Erik M. Altmann and J. Gregory Trafton. 2002. Memory for goals: an activation-based model. Cognitive Science 26, 1 (2002), 39-83. https: //doi.org/10.1207/s15516709cog2601_2 _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1207/s15516709cog2601_2. · DOI · Paper page
  2. Erik M. Altmann and J. Gregory Trafton. 2015. Brief Lags in Interrupted Sequential Performance: Evaluating a Model and Model Evaluation Method. International Journal of Human-Computer Studies 79 (July 2015), 51-65. https://doi.org/10.1016/j.ijhcs.2014.12.007 · DOI
  3. Erik M. Altmann, J. Gregory Trafton, and David Z. Hambrick. 2014. Momentary interruptions can derail the train of thought. Journal of Experimental Psychology: General 143, 1 (2014), 215-226. https://doi.org/10.1037/a0030986 Place: US Publisher: American Psychological Association. · DOI · Paper page
  4. Alex M. Andrew. 2003. Humans And Automation: System Design And Research Issues, by Thomas B. Sheridan, Wiley, in cooperation with the Human Factors and Ergonomics Society, Santa Barbara, California, 2002, pp. xii, 264. ISBN 0-471-23428-1. Wiley Series in System Engineering and Management HFES Issues in Human Factors and Ergonomics Series, Vol. 3 (Hardback, £37.50). Robotica 21, 3 (June 2003), 345-345. https: //doi.org/10.1017/S0263574702274858 Publisher: Cambridge University Press. · DOI
  5. Kenneth C Arnold, April M Volzer, and Noah G Madrid. 2021. Generative Models can Help Writers without Writing for Them. Joint Proceedings of the ACM IUI 2021 Workshops (2021).
  6. Brian P. Bailey and Shamsi T. Iqbal. 2008. Understanding changes in mental workload during execution of goal-directed tasks and its application for interruption management. ACM Transactions on Computer-Human Interaction 14, 4 (Jan. 2008), 21:1-21:28. https://doi.org/10.1145/1314683.1314689 · DOI · Paper page
  7. Lisanne Bainbridge. 1983. Ironies of automation. Automatica 19, 6 (Nov. 1983), 775-779. https://doi.org/10.1016/0005-1098(83)90046-8 · DOI · Paper page
  8. Shraddha Barke, Michael B. James, and Nadia Polikarpova. 2023. Grounded Copilot: How Programmers Interact with Code-Generating Models. Proceedings of the ACM on Programming Languages 7, OOPSLA1 (April 2023), 78:85-78:111. https://doi.org/10.1145/3586030 · DOI · Paper page
  9. Gordon Baxter, John Rooksby, Yuanzhi Wang, and Ali Khajeh-Hosseini. 2012. The ironies of automation: still going strong at 30?. In Proceedings of the 30th European Conference on Cognitive Ergonomics. ACM, Edinburgh United Kingdom, 65-71. https://doi.org/10.1145/2448136.2448149 · DOI
  10. Advait Bhat, Saaket Agashe, Parth Oberoi, Niharika Mohile, Ravi Jangir, and Anirudha Joshi. 2023. Interacting with Next-Phrase Suggestions: How Suggestion Systems Aid and Influence the Cognitive Processes of Writing. In Proceedings of the 28th International Conference on Intelligent User Interfaces (IUI '23). Association for Computing Machinery, New York, NY, USA, 436-452. https://doi.org/10.1145/3581641.3584060 · DOI · Paper page
  11. Charles E. Billings. 1991. Toward a Human-Centered Aircraft Automation Philosophy. The International Journal of Aviation Psychology 1, 4 (Oct. 1991), 261-270. https://doi.org/10.1207/s15327108ijap0104_1 Publisher: Taylor & Francis _eprint: https://doi.org/10.1207/s15327108ijap0104_1. · DOI
  12. Christian Bird, Denae Ford, Thomas Zimmermann, Nicole Forsgren, Eirini Kalliamvakou, Travis Lowdermilk, and Idan Gazit. 2023. Taking Flight with Copilot: Early insights and opportunities of AI-powered pair-programming tools. Queue 20, 6 (Jan. 2023), Pages 10:35-Pages 10:57. https://doi.org/10.1145/3582083 · DOI · Paper page
  13. Duncan P. Brumby, Anna L. Cox, Jonathan Back, and Sandy J. J. Gould. 2013. Recovering from an interruption: Investigating speed-accuracy trade-offs in task resumption behavior. Journal of Experimental Psychology: Applied 19, 2 (2013), 95-107. https://doi.org/10.1037/a0032696 · DOI · Paper page
  14. Pawan Budhwar, Soumyadeb Chowdhury, Geoffrey Wood, Herman Aguinis, Greg J. Bamber, Jose R. Beltran, Paul Boselie, Fang Lee Cooke, Stephanie Decker, Angelo DeNisi, Prasanta Kumar Dey, David Guest, Andrew J. Knoblich, Ashish Malik, Jaap Paauwe, Savvas Papagiannidis, Charmi Patel, Vijay Pereira, Shuang Ren, Steven Rogelberg, Mark N. K. Saunders, Rosalie L. Tung, and Arup Varma. 2023. Human resource management in the age of generative artificial intelligence: Perspectives and research directions on ChatGPT. Human Resource Management Journal 33, 3 (2023), 606-659. https://doi.org/10.1111/1748-8583.12524 _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/1748-8583.12524. · DOI · Paper page
  15. Alex Calderwood, Vivian Qiu, K. Gero, and Lydia B. Chilton. 2020. How Novelists Use Generative Language Models: An Exploratory User Study. In IUI 2020 Workshops. https://www.semanticscholar.org/paper/How-Novelists-Use-Generative-Language-Models%3A-An-Calderwood- Qiu/8cf1fc0b87dfda2a11bfaaaa3a0bf9f9e069bb0f
  16. Pascale Carayon and Peter Hoonakker. 2019. Human Factors and Usability for Health Information Technology: Old and New Challenges. Yearbook of Medical Informatics 28, 1 (Aug. 2019), 71-77. https://doi.org/10.1055/s-0039-1677907 Publisher: Georg Thieme Verlag KG. · DOI · Paper page
  17. Xiang 'Anthony' Chen, Jeff Burke, Ruofei Du, Matthew K. Hong, Jennifer Jacobs, Philippe Laban, Dingzeyu Li, Nanyun Peng, Karl D. D. Willis, Chien- Sheng Wu, and Bolei Zhou. 2023. Next Steps for Human-Centered Generative AI: A Technical Perspective. https://doi.org/10.48550/arXiv.2306.15774 arXiv:2306.15774 [cs]. · DOI · Paper page
  18. Zenan Chen and Jason Chan. 2023. Large Language Model in Creative Work: The Role of Collaboration Modality and User Expertise. https: //doi.org/10.2139/ssrn.4575598 · DOI
  19. Mark Chignell, Lu Wang, Atefeh Zare, and Jamy Li. 2023. The Evolution of HCI and Human Factors: Integrating Human and Artificial Intelligence. ACM Transactions on Computer-Human Interaction 30, 2 (April 2023), 1-30. https://doi.org/10.1145/3557891 · DOI
  20. Jonathan H. Choi and Daniel Schwarcz. 2023. AI Assistance in Legal Analysis: An Empirical Study. https://doi.org/10.2139/ssrn.4539836 · DOI · Paper page
  21. Yee-Yeen Chu and William B. Rouse. 1979. Adaptive Allocation of Decisionmaking Responsibility between Human and Computer in Multitask Situations. IEEE Transactions on Systems, Man, and Cybernetics 9, 12 (Dec. 1979), 769-778. https://doi.org/10.1109/TSMC.1979.4310128 Conference Name: IEEE Transactions on Systems, Man, and Cybernetics. · DOI
  22. Elizabeth Clark, Anne Spencer Ross, Chenhao Tan, Yangfeng Ji, and Noah A. Smith. 2018. Creative Writing with a Machine in the Loop: Case Studies on Slogans and Stories. In 23rd International Conference on Intelligent User Interfaces (IUI '18). Association for Computing Machinery, New York, NY, USA, 329-340. https://doi.org/10.1145/3172944.3172983 · DOI · Paper page
  23. Richard Cook and David Woods. 1997. Adapting to New Technology in the Operating Room. Human factors 38 (Jan. 1997), 593-613. https: //doi.org/10.1518/001872096778827224 · DOI
  24. Richard I. Cook, David D. Woods, Elizabeth Mccolligan, and Michael B. Howie. 1991. Cognitive consequences of clumsy automation on high workload, high consequence human performance. In NASA, Lyndon B. Johnson Space Center, Fourth Annual Workshop on Space Operations Applications and Research (SOAR 90). https://ntrs.nasa.gov/citations/19910011398 NTRS Author Affiliations: Ohio State Univ. NTRS Document ID: 19910011398 NTRS Research Center: Legacy CDMS (CDMS).
  25. Randy D. Cork, William M. Detmer, and Charles P. Friedman. 1998. Development and Initial Validation of an Instrument to Measure Physicians' Use of, Knowledge about, and Attitudes Toward Computers. Journal of the American Medical Informatics Association 5, 2 (March 1998), 164-176. https://doi.org/10.1136/jamia.1998.0050164 · DOI
  26. Edward Cutrell and Zhiwei Guan. 2007. What are you looking for?: an eye-tracking study of information usage in web search. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, San Jose California USA, 407-416. https://doi.org/10.1145/1240624.1240690 · DOI · Paper page
  27. Edward B. Cutrell, Mary Czerwinski, and Eric Horvitz. 2000. Effects of instant messaging interruptions on computing tasks. In CHI '00 Extended Abstracts on Human Factors in Computing Systems. ACM, The Hague The Netherlands, 99-100. https://doi.org/10.1145/633292.633351 · DOI
  28. Mary Czerwinski, Eric Horvitz, and Susan Wilhite. 2004. A diary study of task switching and interruptions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Vienna Austria, 175-182. https://doi.org/10.1145/985692.985715 · DOI · Paper page
  29. Hai Dang, Sven Goller, Florian Lehmann, and Daniel Buschek. 2023. Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Prompting. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). Association for Computing Machinery, New York, NY, USA, 1-17. https://doi.org/10.1145/3544548.3580969 · DOI · Paper page
  30. Alex J. DeGrave, Zhuo Ran Cai, Joseph D. Janizek, Roxana Daneshjou, and Su-In Lee. 2023. Dissection of medical AI reasoning processes via physician and generative-AI collaboration. medRxiv (May 2023), 2023.05.12.23289878. https://doi.org/10.1101/2023.05.12.23289878 · DOI
  31. Fabrizio Dell'Acqua, Edward McFowland, Ethan R. Mollick, Hila Lifshitz-Assaf, Katherine Kellogg, Saran Rajendran, Lisa Krayer, François Candelon, and Karim R. Lakhani. 2023. Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality. https://doi.org/10.2139/ssrn.4573321 · DOI · Paper page
  32. Stephen R. Dixon, Christopher D. Wickens, and Dervon Chang. 2005. Mission Control of Multiple Unmanned Aerial Vehicles: A Workload Analysis. Human Factors 47, 3 (Sept. 2005), 479-487. https://doi.org/10.1518/001872005774860005 Publisher: SAGE Publications Inc. · DOI
  33. Ian Drosos, Titus Barik, Philip J. Guo, Robert DeLine, and Sumit Gulwani. 2020. Wrex: A Unified Programming-by-Example Interaction for Synthesizing Readable Code for Data Scientists. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1-12. https://doi.org/10.1145/3313831.3376442 · DOI
  34. JUDITH A. EFFKEN, NAM-GYOON KIM, and ROBERT E. SHAW. 1997. Making the constraints visible: testing the ecological approach to interface design. Ergonomics 40, 1 (Jan. 1997), 1-27. https://doi.org/10.1080/001401397188341 Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/001401397188341. · DOI
  35. Mica R. Endsley. 1995. Measurement of Situation Awareness in Dynamic Systems. Human Factors 37, 1 (March 1995), 65-84. https://doi.org/10. 1518/001872095779049499 Publisher: SAGE Publications Inc. · DOI · Paper page
  36. Mica R. Endsley. 2017. From Here to Autonomy: Lessons Learned From Human-Automation Research. Human Factors 59, 1 (Feb. 2017), 5-27. https://doi.org/10.1177/0018720816681350 Publisher: SAGE Publications Inc. · DOI · Paper page
  37. Mica R. Endsley. 2023. Ironies of artificial intelligence. Ergonomics 66, 11 (Nov. 2023), 1656-1668. https://doi.org/10.1080/00140139.2023.2243404 Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/00140139.2023.2243404. · DOI
  38. Mica R. Endsley, Cheryl A. Bolstad, Debra G. Jones, and Jennifer M. Riley. 2003. Situation Awareness Oriented Design: From User's Cognitive Requirements to Creating Effective Supporting Technologies. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 47, 3 (Oct. 2003), 268-272. https://doi.org/10.1177/154193120304700304 Publisher: SAGE Publications Inc. · DOI
  39. Mica R. Endsley and Mark D. Rodgers. 2016. Distribution of Attention, Situation Awareness and Workload in a Passive Air Traffic Control Task: Implications for Operational Errors and Automation. Air Traffic Control Quarterly (Aug. 2016). https://doi.org/10.2514/atcq.6.1.21 Publisher: American Institute of Aeronautics and Astronautics, Inc.. · DOI
  40. Kenneth D. Enstrom and William B. Rouse. 1977. Real-Time Determination of How a Human Has Allocated His Attention between Control and Monitoring Tasks. IEEE Transactions on Systems, Man, and Cybernetics 7, 3 (March 1977), 153-161. https://doi.org/10.1109/TSMC.1977.4309679 Conference Name: IEEE Transactions on Systems, Man, and Cybernetics. · DOI
  41. Carl Benedikt Frey and Michael Osborne. 2023. Generative AI and the Future of Work: A Reappraisal. Brown Journal of World Affairs (2023).
  42. Ken Funk, Beth Lyall, Jennifer Wilson, Rebekah Vint, Mary Niemczyk, Candy Suroteguh, and Griffith Owen. 1999. Flight Deck Automation issues. The International Journal of Aviation Psychology (April 1999). https://doi.org/10.1207/s15327108ijap0902_2 Publisher: Lawrence Erlbaum Associates, Inc.. · DOI
  43. Scott M. Galster, Robert S. Bolia, Merry M. Roe, and Raja Parasuraman. 2001. Effects of Automated Cueing on Decision Implementation in a Visual Search Task. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 45, 4 (Oct. 2001), 321-325. https://doi.org/10.1177/ 154193120104500412 Publisher: SAGE Publications Inc. · DOI
  44. Frederic Gmeiner, Humphrey Yang, Lining Yao, Kenneth Holstein, and Nikolas Martelaro. 2023. Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Tools. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). Association for Computing Machinery, New York, NY, USA, 1-20. https://doi.org/10.1145/3544548.3580999 · DOI · Paper page
  45. M.A. Goodrich and D.R. Olsen. 2003. Seven principles of efficient human robot interaction. In SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme -System Security and Assurance (Cat. No.03CH37483), Vol. 4. IEEE, Washington, DC, USA, 3942-3948. https://doi.org/10.1109/ICSMC.2003.1244504 · DOI
  46. Paula L. Grubb, Joel S. Warm, William N. Dember, and Daniel B. Berch. 1995. Effects of Multiple-Signal Discrimination on Vigilance Performance and Perceived Workload. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 39, 21 (Oct. 1995), 1360-1364. https: //doi.org/10.1177/154193129503902101 Publisher: SAGE Publications Inc. · DOI
  47. Ken Gu, Madeleine Grunde-McLaughlin, Andrew M. McNutt, Jeffrey Heer, and Tim Althoff. 2023. How Do Data Analysts Respond to AI Assistance? A Wizard-of-Oz Study. https://doi.org/10.48550/arXiv.2309.10108 arXiv:2309.10108 [cs]. · DOI
  48. Ken Gu, Ruoxi Shang, Tim Althoff, Chenglong Wang, and Steven M. Drucker. 2023. How Do Analysts Understand and Verify AI-Assisted Data Analyses? https://doi.org/10.48550/arXiv.2309.10947 arXiv:2309.10947 [cs]. · DOI
  49. Andrew G. Haldane and Robert M. May. 2011. Systemic risk in banking ecosystems. Nature 469, 7330 (Jan. 2011), 351-355. https://doi.org/10.1038/ nature09659 Number: 7330 Publisher: Nature Publishing Group. · DOI · Paper page
  50. Jonathan Huang, Luke Neill, Matthew Wittbrodt, David Melnick, Matthew Klug, Michael Thompson, John Bailitz, Timothy Loftus, Sanjeev Malik, Amit Phull, Victoria Weston, J. Alex Heller, and Mozziyar Etemadi. 2023. Generative Artificial Intelligence for Chest Radiograph Interpretation in the Emergency Department. JAMA Network Open 6, 10 (Oct. 2023), e2336100. https://doi.org/10.1001/jamanetworkopen.2023.36100 · DOI · Paper page
  51. Shamsi T. Iqbal and Brian P. Bailey. 2005. Investigating the effectiveness of mental workload as a predictor of opportune moments for interruption. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). Association for Computing Machinery, New York, NY, USA, 1489-1492. https://doi.org/10.1145/1056808.1056948 · DOI · Paper page
  52. Shamsi T. Iqbal and Brian P. Bailey. 2008. Effects of intelligent notification management on users and their tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). Association for Computing Machinery, New York, NY, USA, 93-102. https: //doi.org/10.1145/1357054.1357070 · DOI · Paper page
  53. Christian P. Janssen and Duncan P. Brumby. 2010. Strategic Adaptation to Performance Objectives in a Dual-Task Setting. Cognitive Sci- ence 34, 8 (2010), 1548-1560. https://doi.org/10.1111/j.1551-6709.2010.01124.x _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1551- 6709.2010.01124.x. · DOI
  54. Christian P. Janssen, Duncan P. Brumby, John Dowell, Nick Chater, and Andrew Howes. 2011. Identifying Optimum Performance Trade-Offs Using a Cognitively Bounded Rational Analysis Model of Discretionary Task Interleaving. Topics in Cognitive Science 3, 1 (2011), 123-139. https://doi.org/10.1111/j.1756-8765.2010.01125.x _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1756-8765.2010.01125.x. · DOI
  55. Christian P. Janssen, Sandy J. J. Gould, Simon Y. W. Li, Duncan P. Brumby, and Anna L. Cox. 2015. Integrating knowledge of multitasking and interruptions across different perspectives and research methods. International Journal of Human-Computer Studies 79 (July 2015), 1-5. https://doi.org/10.1016/j.ijhcs.2015.03.002 · DOI
  56. Dhanya Jayagopal, Justin Lubin, and Sarah E. Chasins. 2022. Exploring the Learnability of Program Synthesizers by Novice Programmers. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST '22). Association for Computing Machinery, New York, NY, USA, 1-15. https://doi.org/10.1145/3526113.3545659 · DOI · Paper page
  57. Ellen Jiang, Edwin Toh, Alejandra Molina, Kristen Olson, Claire Kayacik, Aaron Donsbach, Carrie J Cai, and Michael Terry. 2022. Discovering the Syntax and Strategies of Natural Language Programming with Generative Language Models. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22). Association for Computing Machinery, New York, NY, USA, 1-19. https://doi.org/10.1145/3491102.3501870 · DOI · Paper page
  58. Majeed Kazemitabaar, Xinying Hou, Austin Henley, Barbara J. Ericson, David Weintrop, and Tovi Grossman. 2023. How Novices Use LLM-Based Code Generators to Solve CS1 Coding Tasks in a Self-Paced Learning Environment. https://doi.org/10.48550/arXiv.2309.14049 arXiv:2309.14049 [cs]. · DOI
  59. Seohyun Kim, Jinman Zhao, Yuchi Tian, and Satish Chandra. 2021. Code Prediction by Feeding Trees to Transformers. In 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE). IEEE, Madrid, ES, 150-162. https://doi.org/10.1109/ICSE43902.2021.00026 · DOI · Paper page
  60. Brandon J. King, Gemma J.M. Read, and Paul M. Salmon. 2022. Clear and present danger? Applying ecological interface design to develop an aviation risk management interface. Applied Ergonomics 99 (Feb. 2022), 103643. https://doi.org/10.1016/j.apergo.2021.103643 · DOI
  61. G. Klein, B. Moon, and R.R. Hoffman. 2006. Making Sense of Sensemaking 1: Alternative Perspectives. IEEE Intelligent Systems 21, 4 (July 2006), 70-73. https://doi.org/10.1109/MIS.2006.75 · DOI
  62. Chinmay Kulkarni, Stefania Druga, Minsuk Chang, Alex Fiannaca, Carrie Cai, and Michael Terry. 2023. A Word is Worth a Thousand Pictures: Prompts as AI Design Material. https://doi.org/10.48550/arXiv.2303.12647 arXiv:2303.12647 [cs]. · DOI
  63. John Lee and Bobbie Seppelt. 2009. Human Factors in Automation Design. In Springer Handbook of Automation. Springer, 417-436. https: //doi.org/10.1007/978-3-540-78831-7_25 · DOI
  64. Jenny T. Liang, Chenyang Yang, and Brad A. Myers. 2023. Understanding the Usability of AI Programming Assistants. https://doi.org/10.48550/ arXiv.2303.17125 arXiv:2303.17125 [cs]. · DOI · Paper page
  65. Q. Vera Liao, Hariharan Subramonyam, Jennifer Wang, and Jennifer Wortman Vaughan. 2023. Designerly Understanding: Information Needs for Model Transparency to Support Design Ideation for AI-Powered User Experience. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). Association for Computing Machinery, New York, NY, USA, 1-21. https://doi.org/10.1145/3544548.3580652 · DOI
  66. Q. Vera Liao and Jennifer Wortman Vaughan. 2023. AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap. https: //doi.org/10.48550/arXiv.2306.01941 arXiv:2306.01941 [cs]. · DOI · Paper page
  67. Ida Lindgren. 2023. Ironies of Public Service Automation -Bainbridge Revisited. In Proceedings of the 24th Annual International Conference on Digital Government Research. ACM, Gda?sk Poland, 395-404. https://doi.org/10.1145/3598469.3598514 · DOI
  68. Shayne Loft, Penelope Sanderson, Andrew Neal, and Martijn Mooij. 2007. Modeling and Predicting Mental Workload in En Route Air Traffic Control: Critical Review and Broader Implications. Human Factors 49, 3 (June 2007), 376-399. https://doi.org/10.1518/001872007X197017 Publisher: SAGE Publications Inc. · DOI
  69. Brady D. Lund and Ting Wang. 2023. Chatting about ChatGPT: how may AI and GPT impact academia and libraries? Library Hi Tech News 40, 3 (Jan. 2023), 26-29. https://doi.org/10.1108/LHTN-01-2023-0009 Publisher: Emerald Publishing Limited. · DOI · Paper page
  70. Aman Madaan, Shuyan Zhou, Uri Alon, Yiming Yang, and Graham Neubig. 2022. Language Models of Code are Few-Shot Commonsense Learners. https://arxiv.org/abs/2210.07128v3 · arXiv
  71. Dietrich Manzey, J. Elin Bahner, and Anke-Dorothea Hueper. 2006. Misuse of Automated Aids in Process Control: Complacency, Automation Bias and Possible Training Interventions. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50, 3 (Oct. 2006), 220-224. https://doi.org/10.1177/154193120605000303 Publisher: SAGE Publications Inc. · DOI · Paper page
  72. Dietrich Manzey, Juliane Reichenbach, and Linda Onnasch. 2012. Human Performance Consequences of Automated Decision Aids: The Impact of Degree of Automation and System Experience. Journal of Cognitive Engineering and Decision Making 6, 1 (March 2012), 57-87. https: //doi.org/10.1177/1555343411433844 Publisher: SAGE Publications. · DOI · Paper page
  73. Gloria Mark, Daniela Gudith, and Ulrich Klocke. 2008. The cost of interrupted work: more speed and stress. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Florence Italy, 107-110. https://doi.org/10.1145/1357054.1357072 · DOI · Paper page
  74. Gloria Mark, Stephen Voida, and Armand Cardello. 2012. "A pace not dictated by electrons": an empirical study of work without email. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Austin Texas USA, 555-564. https://doi.org/10.1145/2207676.2207754 · DOI · Paper page
  75. Sara E. McBride, Wendy A. Rogers, and Arthur D. Fisk. 2011. Understanding the Effect of Workload on Automation Use for Younger and Older Adults. Human Factors 53, 6 (Dec. 2011), 672-686. https://doi.org/10.1177/0018720811421909 Publisher: SAGE Publications Inc. · DOI
  76. Rich C. McIlroy and Neville A. Stanton. 2015. Ecological Interface Design Two Decades On: Whatever Happened to the SRK Taxonomy? IEEE Transactions on Human-Machine Systems 45, 2 (April 2015), 145-163. https://doi.org/10.1109/THMS.2014.2369372 Conference Name: IEEE Transactions on Human-Machine Systems. · DOI
  77. Andrew M Mcnutt, Chenglong Wang, Robert A Deline, and Steven M. Drucker. 2023. On the Design of AI-powered Code Assistants for Notebooks. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). Association for Computing Machinery, New York, NY, USA, 1-16. https://doi.org/10.1145/3544548.3580940 · DOI
  78. Ulla Metzger and Raja Parasuraman. 2001. The Role of the Air Traffic Controller in Future Air Traffic Management: An Empirical Study of Active Control versus Passive Monitoring. Human Factors 43, 4 (Dec. 2001), 519-528. https://doi.org/10.1518/001872001775870421 Publisher: SAGE Publications Inc. · DOI
  79. Ulla Metzger and Raja Parasuraman. 2005. Automation in Future Air Traffic Management: Effects of Decision Aid Reliability on Controller Performance and Mental Workload. Human Factors 47, 1 (March 2005), 35-49. https://doi.org/10.1518/0018720053653802 Publisher: SAGE Publications Inc. · DOI
  80. Christopher A. Monk, J. Gregory Trafton, and Deborah A. Boehm-Davis. 2008. The effect of interruption duration and demand on resuming suspended goals. Journal of Experimental Psychology: Applied 14, 4 (2008), 299-313. https://doi.org/10.1037/a0014402 Place: US Publisher: American Psychological Association. · DOI · Paper page
  81. Neville Moray, Pam Lootsteen, and Jan Pajak. 1986. Acquisition of Process Control Skills. IEEE Transactions on Systems, Man, and Cybernetics 16, 4 (July 1986), 497-504. https://doi.org/10.1109/TSMC.1986.289252 Conference Name: IEEE Transactions on Systems, Man, and Cybernetics. · DOI
  82. Laura Moreno, Gabriele Bavota, Massimiliano Di Penta, Rocco Oliveto, and Andrian Marcus. 2015. How Can I Use This Method?. In 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering, Vol. 1. 880-890. https://doi.org/10.1109/ICSE.2015.98 ISSN: 1558-1225. · DOI
  83. D. A. Norman, Donald Eric Broadbent, Alan David Baddeley, and J. Reason. 1997. The 'problem ' with automation: inappropriate feedback and interaction, not 'over-automation'. Philosophical Transactions of the Royal Society of London. B, Biological Sciences 327, 1241 (Jan. 1997), 585-593. https://doi.org/10.1098/rstb.1990.0101 Publisher: Royal Society. · DOI
  84. Kannan Nova. 2023. Generative AI in Healthcare: Advancements in Electronic Health Records, facilitating Medical Languages, and Personalized Patient Care. Journal of Advanced Analytics in Healthcare Management 7, 1 (April 2023), 115-131. https://research.tensorgate.org/index.php/ JAAHM/article/view/43 Number: 1.
  85. Shakked Noy and Whitney Zhang. 2023. Experimental Evidence on the Productivity Effects of Generative Artificial Intelligence. https: //doi.org/10.2139/ssrn.4375283 · DOI · Paper page
  86. Jonas Oppenlaender. 2022. The Creativity of Text-to-Image Generation. In Proceedings of the 25th International Academic Mindtrek Conference. 192-202. https://doi.org/10.1145/3569219.3569352 arXiv:2206.02904 [cs]. · DOI
  87. Raja Parasuraman, Robert Molloy, and Indramani L. Singh. 1993. Performance Consequences of Automation-Induced 'Complacency'. The International Journal of Aviation Psychology (Jan. 1993). https://doi.org/10.1207/s15327108ijap0301_1 Publisher: Lawrence Erlbaum Associates, Inc.. · DOI · Paper page
  88. Raja Parasuraman, Mustapha Mouloua, and Robert Molloy. 1997. Effects of Adaptive Task Allocation on Monitoring of Automated Systems. Human factors 38 (Jan. 1997), 665-79. https://doi.org/10.1518/001872096778827279 · DOI
  89. Raja Parasuraman and Victor Riley. 1997. Humans and Automation: Use, Misuse, Disuse, Abuse. Human Factors 39, 2 (June 1997), 230-253. https://doi.org/10.1518/001872097778543886 Publisher: SAGE Publications Inc. · DOI · Paper page
  90. R. Parasuraman, T.B. Sheridan, and C.D. Wickens. 2000. A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics -Part A: Systems and Humans 30, 3 (May 2000), 286-297. https://doi.org/10.1109/3468.844354 Conference Name: IEEE Transactions on Systems, Man, and Cybernetics -Part A: Systems and Humans. · DOI · Paper page
  91. Cecile L. Paris. 1988. Tailoring Object Descriptions to a User's Level of Expertise. Computational Linguistics 14, 3 (1988), 64-78. https: //aclanthology.org/J88-3006
  92. Chris Parnin and Robert DeLine. 2010. Evaluating cues for resuming interrupted programming tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Atlanta Georgia USA, 93-102. https://doi.org/10.1145/1753326.1753342 · DOI · Paper page
  93. Patrick Parra Pennefather. 2023. AI and the Future of Creative Work. In Creative Prototyping with Generative AI: Augmenting Creative Workflows with Generative AI, Patrick Parra Pennefather (Ed.). Apress, Berkeley, CA, 387-410. https://doi.org/10.1007/978-1-4842-9579-3_13 · DOI
  94. Patrick Parra Pennefather. 2023. Use Cases. In Creative Prototyping with Generative AI: Augmenting Creative Workflows with Generative AI, Patrick Parra Pennefather (Ed.). Apress, Berkeley, CA, 339-385. https://doi.org/10.1007/978-1-4842-9579-3_12 · DOI
  95. Celeste Lyn Paul, Anita Komlodi, and Wayne Lutters. 2015. Interruptive notifications in support of task management. International Journal of Human-Computer Studies 79 (July 2015), 20-34. https://doi.org/10.1016/j.ijhcs.2015.02.001 · DOI
  96. Sida Peng, Eirini Kalliamvakou, Peter Cihon, and Mert Demirer. 2023. The Impact of AI on Developer Productivity: Evidence from GitHub Copilot. http://arxiv.org/abs/2302.06590 arXiv:2302.06590 [cs]. · arXiv
  97. James Prather, Brent N. Reeves, Paul Denny, Brett A. Becker, Juho Leinonen, Andrew Luxton-Reilly, Garrett Powell, James Finnie-Ansley, and Eddie Antonio Santos. 2023. "It's Weird That it Knows What I Want": Usability and Interactions with Copilot for Novice Programmers. https://doi.org/10.48550/arXiv.2304.02491 arXiv:2304.02491 [cs]. · DOI · Paper page
  98. Carl Preiksaitis, Christine A. Sinsky, and Christian Rose. 2023. ChatGPT is not the solution to physicians' documentation burden. Nature Medicine 29, 6 (June 2023), 1296-1297. https://doi.org/10.1038/s41591-023-02341-4 Number: 6 Publisher: Nature Publishing Group. · DOI
  99. Haocong Rao, Cyril Leung, and Chunyan Miao. 2023. Can ChatGPT Assess Human Personalities? A General Evaluation Framework. https: //arxiv.org/abs/2303.01248v2
  100. Jens Rasmussen and Kim J. Vicente. 1989. Coping with human errors through system design: implications for ecological interface design. International Journal of Man-Machine Studies 31, 5 (Nov. 1989), 517-534. https://doi.org/10.1016/0020-7373(89)90014-X · DOI · Paper page
  101. J. Reason, Donald Eric Broadbent, Alan David Baddeley, and J. Reason. 1997. The contribution of latent human failures to the breakdown of complex systems. Philosophical Transactions of the Royal Society of London. B, Biological Sciences 327, 1241 (Jan. 1997), 475-484. https: //doi.org/10.1098/rstb.1990.0090 Publisher: Royal Society. · DOI · Paper page
  102. Steven I. Ross, Fernando Martinez, Stephanie Houde, Michael Muller, and Justin D. Weisz. 2023. The Programmer's Assistant: Conversational Interaction with a Large Language Model for Software Development. In Proceedings of the 28th International Conference on Intelligent User Interfaces (IUI '23). Association for Computing Machinery, New York, NY, USA, 491-514. https://doi.org/10.1145/3581641.3584037 · DOI
  103. Dr Marianne Rudisill. 1995. Line Pilots' Attitudes About And Experience With Flight Deck Automation: Results Of An International Survey And Proposed Guidelines. Proceedings of the eighth international symposium on aviation psychology (1995).
  104. Dario D. Salvucci and Niels A. Taatgen. 2011. Toward a Unified View of Cognitive Control. Topics in Cognitive Science 3, 2 (2011), 227-230. https://doi.org/10.1111/j.1756-8765.2011.01134.x _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1111/j.1756-8765.2011.01134.x. · DOI
  105. Advait Sarkar. 2023. Exploring Perspectives on the Impact of Artificial Intelligence on the Creativity of Knowledge Work: Beyond Mechanised Plagiarism and Stochastic Parrots. In Proceedings of the 2nd Annual Meeting of the Symposium on Human-Computer Interaction for Work (CHIWORK '23). Association for Computing Machinery, New York, NY, USA, 1-17. https://doi.org/10.1145/3596671.3597650 · DOI · Paper page
  106. Advait Sarkar, Andrew D. Gordon, Carina Negreanu, Christian Poelitz, Sruti Srinivasa Ragavan, and Ben Zorn. 2022. What is it like to program with artificial intelligence? https://doi.org/10.48550/arXiv.2208.06213 arXiv:2208.06213 [cs]. · DOI · Paper page
  107. Wout Schellaert, Fernando Martínez-Plumed, Karina Vold, John Burden, Pablo A. M. Casares, Bao Sheng Loe, Roi Reichart, Sean Ó hÉigeartaigh, Anna Korhonen, and José Hernández-Orallo. 2023. Your Prompt is My Command: On Assessing the Human-Centred Generality of Multimodal Models. Journal of Artificial Intelligence Research 77 (June 2023), 377-394. https://doi.org/10.1613/jair.1.14157 · DOI · Paper page
  108. Thomas B. Sheridan. 2012. Human Supervisory Control. In Handbook of Human Factors and Ergonomics. John Wiley & Sons, Ltd, 990-1015. https://doi.org/10.1002/9781118131350.ch34 Section: 34 _eprint: https://onlinelibrary.wiley.com/doi/pdf/10.1002/9781118131350.ch34. · DOI
  109. Thomas B. Sheridan and Raja Parasuraman. 2005. Human-Automation Interaction. Reviews of Human Factors and Ergonomics 1, 1 (June 2005), 89-129. https://doi.org/10.1518/155723405783703082 Publisher: SAGE Publications. · DOI
  110. Sruti Srinivasa Ragavan, Zhitao Hou, Yun Wang, Andrew D Gordon, Haidong Zhang, and Dongmei Zhang. 2022. GridBook: Natural Language Formulas for the Spreadsheet Grid. In 27th International Conference on Intelligent User Interfaces (IUI '22). Association for Computing Machinery, New York, NY, USA, 345-368. https://doi.org/10.1145/3490099.3511161 · DOI · Paper page
  111. Heather A. Stoner, Emily E. Wiese, and John D. Lee. 2003. Applying Ecological Interface Design to the Driving Domain: The Results of an Abstraction Hierarchy Analysis. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 47, 3 (Oct. 2003), 444-448. https: //doi.org/10.1177/154193120304700341 Publisher: SAGE Publications Inc. · DOI
  112. Jiao Sun, Q. Vera Liao, Michael Muller, Mayank Agarwal, Stephanie Houde, Kartik Talamadupula, and Justin D. Weisz. 2022. Investigating Explainability of Generative AI for Code through Scenario-based Design. In 27th International Conference on Intelligent User Interfaces (IUI '22). Association for Computing Machinery, New York, NY, USA, 212-228. https://doi.org/10.1145/3490099.3511119 · DOI · Paper page
  113. Jeffrey M. Taekman and Kirk Shelley. 2010. Virtual Environments in Healthcare: Immersion, Disruption, and Flow. International Anesthesiology Clinics 48, 3 (2010), 101. https://doi.org/10.1097/AIA.0b013e3181eace73 · DOI
  114. Priyan Vaithilingam, Tianyi Zhang, and Elena L. Glassman. 2022. Expectation vs. Experience: Evaluating the Usability of Code Generation Tools Powered by Large Language Models. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (CHI EA '22). Association for Computing Machinery, New York, NY, USA, 1-7. https://doi.org/10.1145/3491101.3519665 · DOI · Paper page
  115. Helena Vasconcelos, Gagan Bansal, Adam Fourney, Q. Vera Liao, and Jennifer Wortman Vaughan. 2023. Generation Probabilities Are Not Enough: Exploring the Effectiveness of Uncertainty Highlighting in AI-Powered Code Completions. https://doi.org/10.48550/arXiv.2302.07248 arXiv:2302.07248 [cs]. · DOI · Paper page
  116. H. Wallace Sinaiko. 1972. Human intervention and full automation in control systems. Applied Ergonomics 3, 1 (March 1972), 3-7. https: //doi.org/10.1016/0003-6870(72)90003-8 · DOI
  117. Joel S. Warm, Raja Parasuraman, and Gerald Matthews. 2008. Vigilance requires hard mental work and is stressful. Human Factors 50, 3 (June 2008), 433-441. https://doi.org/10.1518/001872008X312152 · DOI
  118. Justin D. Weisz, Michael Muller, Stephanie Houde, John Richards, Steven I. Ross, Fernando Martinez, Mayank Agarwal, and Kartik Talamadupula. 2021. Perfection Not Required? Human-AI Partnerships in Code Translation. In 26th International Conference on Intelligent User Interfaces (IUI '21). Association for Computing Machinery, New York, NY, USA, 402-412. https://doi.org/10.1145/3397481.3450656 · DOI · Paper page
  119. Justin D. Weisz, Michael Muller, Steven I. Ross, Fernando Martinez, Stephanie Houde, Mayank Agarwal, Kartik Talamadupula, and John T. Richards. 2022. Better Together? An Evaluation of AI-Supported Code Translation. In 27th International Conference on Intelligent User Interfaces (IUI '22). Association for Computing Machinery, New York, NY, USA, 369-391. https://doi.org/10.1145/3490099.3511157 · DOI · Paper page
  120. Christopher D. Wickens, Keith Gempler, and M. Ephimia Morphew. 2000. Workload and Reliability of Predictor Displays in Aircraft Traf- fic Avoidance. Transportation Human Factors 2, 2 (June 2000), 99-126. https://doi.org/10.1207/STHF0202_01 Publisher: Routledge _eprint: https://doi.org/10.1207/STHF0202_01. · DOI
  121. By EARL L. WIENER and RENWICK E. CURRY. 1980. Flight-deck automation: promises and problems. ERGONOMICS (Nov. 1980). https: //doi.org/10.1080/00140138008924809 Publisher: Taylor & Francis Group. · DOI · Paper page
  122. Allison Woodruff, Renee Shelby, Patrick Gage Kelley, Steven Rousso-Schindler, Jamila Smith-Loud, and Lauren Wilcox. 2023. How Knowledge Workers Think Generative AI Will (Not) Transform Their Industries. http://arxiv.org/abs/2310.06778 arXiv:2310.06778 [cs] version: 1. · arXiv
  123. Tongshuang Wu, Michael Terry, and Carrie Jun Cai. 2022. AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Prompts. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22). Association for Computing Machinery, New York, NY, USA, 1-22. https://doi.org/10.1145/3491102.3517582 · DOI
  124. Yiqing Wu, Ruobing Xie, Yongchun Zhu, Fuzhen Zhuang, Xu Zhang, Leyu Lin, and Qing He. 2022. Personalized Prompt for Sequential Recommen- dation. https://arxiv.org/abs/2205.09666v2 · arXiv
  125. Frank F. Xu, Bogdan Vasilescu, and Graham Neubig. 2022. In-IDE Code Generation from Natural Language: Promise and Challenges. ACM Transactions on Software Engineering and Methodology 31, 2 (March 2022), 29:1-29:47. https://doi.org/10.1145/3487569 · DOI · Paper page
  126. Ann Yuan, Andy Coenen, Emily Reif, and Daphne Ippolito. 2022. Wordcraft: Story Writing With Large Language Models. In 27th International Conference on Intelligent User Interfaces. ACM, Helsinki Finland, 841-852. https://doi.org/10.1145/3490099.3511105 · DOI · Paper page
  127. J.D. Zamfirescu-Pereira, Richmond Y. Wong, Bjoern Hartmann, and Qian Yang. 2023. Why Johnny Can't Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, Hamburg Germany, 1-21. https://doi.org/10.1145/3544548.3581388 · DOI · Paper page

Cited by

Sorted by citations

Authors
Simkute, A., Tankelevitch, L., Kewenig, V., Scott, A. E., Sellen, A., & Rintel, S.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2402.11364
arXiv
2402.11364
OpenAlex
W4392012031
Cited by
7
References
0
Citations by year
2026: 1 · 2025: 4 · 2024: 2
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Social Sciences › Psychology › Social Psychology › Human-Automation Interaction and Safety
  • Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
  • Social Sciences › Sociology and Political Science › Information Systems Theories and Implementation
Keywords
generative AI, productivity loss, human-AI interaction, interruptions, task allocation, ecological interface design, continuous feedback, usability

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review