CoChat
Sign Up
Cited by 25Data Visualization and AnalyticsHuman-Automation Interaction and SafetyAI and HR Technologies

Why is AI not a panacea for data workers? an interview study on human-AI collaboration in data storytelling

Open access
Li, Haotian, Wang, Yun, Liao, Q. Vera, Qu, Huamin·2025·IEEE Transactions on Visualization and Computer Graphics
DOI 10.1109/tvcg.2025.3552017
Open this paper in CoChat — free accountOpen PDF

Abstract

This paper explores the potential for human-AI collaboration in the context of data storytelling for data workers. Data storytelling communicates insights and knowledge from data analysis. It plays a vital role in data workers' daily jobs since it boosts team collaboration and public communication. However, to make an appealing data story, data workers need to spend tremendous effort on various tasks, including outlining and styling the story. Recently, a growing research trend has been exploring how to assist data storytelling with advanced artificial intelligence (AI). However, existing studies focus more on individual tasks in the workflow of data storytelling and do not reveal a complete picture of humans' preference for collaborating with AI. To address this gap, we conducted an interview study with 18 data workers to explore their preferences for AI collaboration in the planning, implementation, and communication stages of their workflow. We propose a framework for expected AI collaborators' roles, categorize people's expectations for the level of automation for different tasks, and delve into the reasons behind them. Our research provides insights and suggestions for the design of future AI-powered data storytelling tools.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/tvcg.2025.3552017

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • According to an interview study, data workers often prefer AI not to perform the creator role in communication because it may diminish the underlying value of human-human communication such as building trust.

    “According to an interview study, data workers often prefer AI not to perform the creator role in the communication since they may diminish the underlying value of human-human communication, such as building trust [20].”

    From Reflection on Data Storytelling Tools in the Generative AI Era from the Human-AI Collaboration Perspective (2025) · cites this paper as [20]

    The section ‘AI storytellers can hardly enhance humans’ relationships’ (page unavailable) reports that two participants worried AI-mediated communication could weaken trust and client relationships. This supports the stated reason, but not the broader claim that data workers often reject AI in the creator role throughout communication: the paper also reports participants willing to have AI share stories in one-way communication. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

  • To meet demands of customization and high responsiveness, creation and communication of data stories can hardly be intervened by human-creators or human-assistants, who likely take longer time and higher financial cost.

    “To meet the demands of customization and high responsiveness, the creation and communication of data stories can hardly be intervened by human-creators or human-assistants , who are likely to take longer time and higher financial cost to finish tasks [20].”

    From Reflection on Data Storytelling Tools in the Generative AI Era from the Human-AI Collaboration Perspective (2025) · cites this paper as [20]

    In “Potential benefits” (page not supplied), interviewees describe AI as quicker to respond and potentially cheaper than human collaborators, who might take hours or days. The paper does not say humans can hardly participate in creating or communicating data stories; it describes human involvement and treats the time and cost comparisons as participants’ views. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

  • The framework by Li et al. [21] was summarized based on an interview study [20] that envisions potential AI application.

    “Furthermore, the framework was summarized based on an interview study [20] that envisions potential AI application.”

    From Reflection on Data Storytelling Tools in the Generative AI Era from the Human-AI Collaboration Perspective (2025) · cites this paper as [20]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 72 · Cited by 25

Research works printed but not linked: 71

  1. H. Li, "Bridging data analysis and storytelling with human-ai collabo- rative tools," Ph.D. dissertation, The Hong Kong University of Science and Technology, 2024.
  2. B. Lee, N. H. Riche, P. Isenberg, and S. Carpendale, "More than telling a story: Transforming data into visually shared stories," IEEE Comput. Graph. Appl., vol. 35, no. 5, pp. 84-90, 2015.
  3. M. Brehmer and R. Kosara, "From jam session to recital: Synchronous communication and collaboration around data in organizations," IEEE Trans. Vis. Comput. Graph., vol. 28, no. 1, pp. 1139-1149, 2021.
  4. Y. Mao, D. Wang, M. Muller, K. R. Varshney, I. Baldini, C. Dugan, and A. Mojsilović, "How data scientists work together with domain experts in scientific collaborations: To find the right answer or to ask the right question?" Proc. ACM Hum.-Comput. Interact., vol. 3, no. GROUP, pp. 1-23, 2019.
  5. D. Wang, E. Churchill, P. Maes, X. Fan, B. Shneiderman, Y. Shi, and Q. Wang, "From human-human collaboration to human-ai collaboration: Designing ai systems that can work together with people," in Proc. Extended Abstr. Hum. Factors Comput. Syst., 2020, pp. 1-6.
  6. L.-P. Yuan, Z. Zhou, J. Zhao, Y. Guo, F. Du, and H. Qu, "InfoColorizer: Interactive recommendation of color palettes for infographics," IEEE Trans. Vis. Comput. Graph., vol. 28, no. 12, pp. 4252-4266, 2021.
  7. Y. Shi, S. Chen, P. Liu, J. Long, and N. Cao, "ColorCook: Augmenting color design for dashboarding with domain-associated palettes," Proc. ACM Hum.-Comput. Interact., vol. 6, no. CSCW2, pp. 1-25, 2022.
  8. T. Ge, B. Lee, and Y. Wang, "Cast: Authoring data-driven chart animations," in Proc. Conf. Hum. Factors Comput. Syst., 2021, pp. 1-15.
  9. Y. Kim and J. Heer, "Gemini 2 : Generating keyframe-oriented animated transitions between statistical graphics," in Proc. IEEE Vis. Conf. IEEE, 2021, pp. 201-205.
  10. C. Zheng, D. Wang, A. Y. Wang, and X. Ma, "Telling stories from computational notebooks: Ai-assisted presentation slides creation for presenting data science work," in Proc. Conf. Hum. Factors Comput. Syst., 2022, pp. 1-20.
  11. S. Chen, J. Li, G. Andrienko, N. Andrienko, Y. Wang, P. H. Nguyen, and C. Turkay, "Supporting story synthesis: Bridging the gap between visual analytics and storytelling," IEEE Trans. Vis. Comput. Graph., vol. 26, no. 7, pp. 2499-2516, 2018.
  12. S. Gratzl, A. Lex, N. Gehlenborg, N. Cosgrove, and M. Streit, "From visual exploration to storytelling and back again," Comput. Graph. Forum, vol. 35, no. 3, pp. 491-500, 2016.
  13. M. Cooley, "Human-centered design," in Information Design. MIT Press Cambridge, 2000, pp. 59-81.
  14. A. X. Zhang, M. Muller, and D. Wang, "How do data science workers collaborate? Roles, workflows, and tools," Proc. ACM Hum.-Comput. Interact., vol. 4, no. CSCW1, pp. 1-23, 2020.
  15. M. Muller, I. Lange, D. Wang, D. Piorkowski, J. Tsay, Q. V. Liao, C. Dugan, and T. Erickson, "How data science workers work with data: Discovery, capture, curation, design, creation," in Proc. Conf. Hum. Factors Comput. Syst., 2019, pp. 1-15.
  16. S. Kandel, A. Paepcke, J. M. Hellerstein, and J. Heer, "Enterprise data analysis and visualization: An interview study," IEEE Trans. Vis. Comput. Graph., vol. 18, no. 12, pp. 2917-2926, 2012.
  17. S. Alspaugh, N. Zokaei, A. Liu, C. Jin, and M. A. Hearst, "Futzing and moseying: Interviews with professional data analysts on exploration practices," IEEE Trans. Vis. Comput. Graph., vol. 25, no. 1, pp. 22-31, 2018.
  18. A. Crisan, B. Fiore-Gartland, and M. Tory, "Passing the data baton: A retrospective analysis on data science work and workers," IEEE Trans. Vis. Comput. Graph., vol. 27, no. 2, pp. 1860-1870, 2020.
  19. S. Narkar, Y. Zhang, Q. V. Liao, D. Wang, and J. D. Weisz, "Model LineUpper: Supporting interactive model comparison at multiple levels for AutoML," in Proc. Int. Conf. Intell. User Interfaces, 2021, pp. 170- 174.
  20. D. K. I. Weidele, J. D. Weisz, E. Oduor, M. Muller, J. Andres, A. Gray, and D. Wang, "AutoAIViz: Opening the blackbox of automated artificial intelligence with conditional parallel coordinates," in Proc. Int. Conf. Intell. User Interfaces, 2020, pp. 308-312.
  21. V. Setlur, S. E. Battersby, M. Tory, R. Gossweiler, and A. X. Chang, "Eviza: A natural language interface for visual analysis," in Proc. ACM Symp. User Interface Softw. Technol., 2016, pp. 365-377.
  22. A. Wu, Y. Wang, X. Shu, D. Moritz, W. Cui, H. Zhang, D. Zhang, and H. Qu, "Ai4vis: Survey on artificial intelligence approaches for data visualization," IEEE Trans. Vis. Comput. Graph., 2021.
  23. K. Gu, R. Shang, T. Althoff, C. Wang, and S. M. Drucker, "How do analysts understand and verify ai-assisted data analyses?" in Proc. Conf. Hum. Factors Comput. Syst., 2024, pp. 1-22.
  24. J. Drozdal, J. Weisz, D. Wang, G. Dass, B. Yao, C. Zhao, M. Muller, L. Ju, and H. Su, "Trust in AutoML: exploring information needs for establishing trust in automated machine learning systems," in Proc. Int. Conf. Intell. User Interfaces, 2020, pp. 297-307.
  25. A. Crisan and B. Fiore-Gartland, "Fits and starts: Enterprise use of AutoML and the role of humans in the loop," in Proc. Conf. Hum. Factors Comput. Syst., 2021, pp. 1-15.
  26. A. Y. Wang, A. Mittal, C. Brooks, and S. Oney, "How data scientists use computational notebooks for real-time collaboration," Proc. ACM Hum.-Comput. Interact., vol. 3, no. CSCW, pp. 1-30, 2019.
  27. J. Hullman, S. Drucker, N. H. Riche, B. Lee, D. Fisher, and E. Adar, "A deeper understanding of sequence in narrative visualization," IEEE Trans. Vis. Comput. Graph., vol. 19, no. 12, pp. 2406-2415, 2013.
  28. M. Lu, C. Wang, J. Lanir, N. Zhao, H. Pfister, D. Cohen-Or, and H. Huang, "Exploring visual information flows in infographics," in Proc. Conf. Hum. Factors Comput. Syst., 2020, pp. 1-12.
  29. Y. Wang, Y. Gao, R. Huang, W. Cui, H. Zhang, and D. Zhang, "Animated presentation of static infographics with InfoMotion," Comput. Graph. Forum, vol. 40, no. 3, pp. 507-518, 2021.
  30. C. Qian, S. Sun, W. Cui, J.-G. Lou, H. Zhang, and D. Zhang, "Retrieve- then-Adapt: Example-based automatic generation for proportion-related infographics," IEEE Trans. Vis. Comput. Graph., vol. 27, no. 2, pp. 443-452, 2020.
  31. N. W. Kim, E. Schweickart, Z. Liu, M. Dontcheva, W. Li, J. Popovic, and H. Pfister, "Data-driven guides: Supporting expressive design for information graphics," IEEE Trans. Vis. Comput. Graph., vol. 23, no. 1, pp. 491-500, 2016.
  32. Y. Wang, H. Zhang, H. Huang, X. Chen, Q. Yin, Z. Hou, D. Zhang, Q. Luo, and H. Qu, "InfoNice: Easy creation of information graphics," in Proc. Conf. Hum. Factors Comput. Syst., 2018, pp. 1-12.
  33. W. Cui, X. Zhang, Y. Wang, H. Huang, B. Chen, L. Fang, H. Zhang, J.-G. Lou, and D. Zhang, "Text-to-Viz: Automatic generation of infographics from proportion-related natural language statements," IEEE Trans. Vis. Comput. Graph., vol. 26, no. 1, pp. 906-916, 2019.
  34. D. Shi, F. Sun, X. Xu, X. Lan, D. Gotz, and N. Cao, "AutoClips: An automatic approach to video generation from data facts," Comput. Graph. Forum, vol. 40, no. 3, pp. 495-505, 2021.
  35. M. Shin, J. Kim, Y. Han, L. Xie, M. Whitelaw, B. C. Kwon, S. Ko, and N. Elmqvist, "Roslingifier: Semi-automated storytelling for animated scatterplots," IEEE Trans. Vis. Comput. Graph., 2022.
  36. D. Kang, T. Ho, N. Marquardt, B. Mutlu, and A. Bianchi, "ToonNote: Improving communication in computational notebooks using interactive data comics," in Proc. Conf. Hum. Factors Comput. Syst., 2021, pp. 1-14.
  37. N. Sultanum and A. Srinivasan, "Datatales: Investigating the use of large language models for authoring data-driven articles," in Proc. IEEE Vis. Conf. IEEE, 2023, pp. 231-235.
  38. X. Fu, Y. Wang, H. Dong, W. Cui, and H. Zhang, "Visualization assessment: A machine learning approach," in Proc. IEEE Vis. Conf., 2019, pp. 126-130.
  39. Y. Lin, H. Li, L. Yang, A. Wu, and H. Qu, "Inksight: Leveraging sketch interaction for documenting chart findings in computational notebooks," IEEE Trans. Vis. Comput. Graph., vol. 30, no. 1, pp. 944-954, 2023.
  40. L. Yang, X. Xu, X. Lan, Z. Liu, S. Guo, Y. Shi, H. Qu, and N. Cao, "A design space for applying the Freytag's pyramid structure to data stories," IEEE Trans. Vis. Comput. Graph., vol. 28, no. 1, pp. 922-932, 2021.
  41. S. Hao, Z. Wang, B. Bach, and L. Pschetz, "Design patterns for data- driven news articles," in Proc. Conf. Hum. Factors Comput. Syst., 2024, pp. 1-16.
  42. M. A. Borkin, A. A. Vo, Z. Bylinskii, P. Isola, S. Sunkavalli, A. Oliva, and H. Pfister, "What makes a visualization memorable?" IEEE Trans. Vis. Comput. Graph., vol. 19, no. 12, pp. 2306-2315, 2013.
  43. X. Shu, A. Wu, J. Tang, B. Bach, Y. Wu, and H. Qu, "What makes a data-gif understandable?" IEEE Trans. Vis. Comput. Graph., vol. 27, no. 2, pp. 1492-1502, 2020.
  44. F. Chevalier, M. Tory, B. Lee, J. van Wijk, G. Santucci, M. Dörk, and J. Hullman, "From analysis to communication: Supporting the lifecycle of a story," in Data-Driven Storytelling. AK Peters/CRC Press, 2018, pp. 151-183.
  45. D. Showkat and E. P. Baumer, "Where do stories come from? examining the exploration process in investigative data journalism," Proc. ACM Hum.-Comput. Interact., vol. 5, no. CSCW2, pp. 1-31, 2021.
  46. S. McKenna, D. Mazur, J. Agutter, and M. Meyer, "Design activity framework for visualization design," IEEE Trans. Vis. Comput. Graph., vol. 20, no. 12, pp. 2191-2200, 2014.
  47. OpenAI, "GPT-4 technical report," arXiv preprint arXiv:2303.08774, 2023. · arXiv
  48. N. Boukhelifa, M.-E. Perrin, S. Huron, and J. Eagan, "How data workers cope with uncertainty: A task characterisation study," in Proc. Conf. Hum. Factors Comput. Syst., 2017, pp. 3645-3656.
  49. J. Liu, N. Boukhelifa, and J. R. Eagan, "Understanding the role of alternatives in data analysis practices," IEEE Trans. Vis. Comput. Graph., vol. 26, no. 1, pp. 66-76, 2019.
  50. J. A. Jiang, K. Wade, C. Fiesler, and J. R. Brubaker, "Supporting serendipity: Opportunities and challenges for human-ai collaboration in qualitative analysis," Proc. ACM Hum.-Comput. Interact., vol. 5, no. CSCW1, pp. 1-23, 2021.
  51. A. Dunne and F. Raby, Speculative Everything, With a new preface by the authors: Design, Fiction, and Social Dreaming. MIT press, 2024.
  52. S. Moore, Q. V. Liao, and H. Subramonyam, "failurenotes: Supporting designers in understanding the limits of ai models for computer vision tasks," in Proc. Conf. Hum. Factors Comput. Syst., 2023, pp. 1-19.
  53. A. M. McNutt, C. Wang, R. A. Deline, and S. M. Drucker, "On the design of ai-powered code assistants for notebooks," in Proc. Conf. Hum. Factors Comput. Syst., 2023, pp. 1-16.
  54. H. Li, Y. Wang, and H. Qu, "Where are we so far? understanding data storytelling tools from the perspective of human-ai collaboration," in Proc. Conf. Hum. Factors Comput. Syst., 2024, pp. 1-19.
  55. E. Horvitz, "Principles of mixed-initiative user interfaces," in Proc. Conf. Hum. Factors Comput. Syst., 1999, pp. 159-166.
  56. J. Heer, "Agency plus automation: Designing artificial intelligence into interactive systems," Proc. Natl. Acad. Sci. U. S. A., vol. 116, no. 6, pp. 1844-1850, 2019.
  57. J. T. Hancock, M. Naaman, and K. Levy, "Ai-mediated communication: Definition, research agenda, and ethical considerations," J. Comput.- Mediat. Commun., vol. 25, no. 1, pp. 89-100, 2020.
  58. B. D. Hall, L. Bartram, and M. Brehmer, "Augmented chironomia for presenting data to remote audiences," in Proc. ACM Symp. User Interface Softw. Technol., 2022, pp. 1-14.
  59. S. Amershi, D. Weld, M. Vorvoreanu, A. Fourney, B. Nushi, P. Collisson, J. Suh, S. Iqbal, P. N. Bennett, K. Inkpen et al., "Guidelines for human- ai interaction," in Proc. Conf. Hum. Factors Comput. Syst., 2019, pp. 1-13.
  60. Y. Hou and D. Wang, "Hacking with npos: Collaborative analytics and broker roles in civic data hackathons," Proc. ACM Hum.-Comput. Interact., vol. 1, no. CSCW, pp. 1-16, 2017.
  61. J. Almahmoud, R. DeLine, and S. M. Drucker, "How teams communi- cate about the quality of ml models: A case study at an international technology company," Proc. ACM Hum.-Comput. Interact., vol. 5, no. GROUP, pp. 1-24, 2021.
  62. N. Diakopoulos, "Ethics in data-driven visual storytelling," in Data- Driven Storytelling. AK Peters/CRC Press, 2018, pp. 233-248.
  63. K. McBride and T. Rosenstiel, The new ethics of journalism: Principles for the 21st century. CQ Press, 2013.
  64. B. Bach, M. Stefaner, J. Boy, S. Drucker, L. Bartram, J. Wood, P. Ciuccarelli, Y. Engelhardt, U. Koeppen, and B. Tversky, "Narrative design patterns for data-driven storytelling," in Data-Driven Storytelling. AK Peters/CRC Press, 2018, pp. 107-133.
  65. Q. Chen, F. Sun, X. Xu, Z. Chen, J. Wang, and N. Cao, "Vizlinter: A linter and fixer framework for data visualization," IEEE Trans. Vis. Comput. Graph., vol. 28, no. 1, pp. 206-216, 2021.
  66. Y.-Z. Shi, H. Li, L. Ruan, and H. Qu, "Constraint representation towards precise data-driven storytelling," in Proc. 2024 IEEE VIS Workshop on Data Storytelling in an Era of Generative AI. IEEE, 2024, pp. 4-12.
  67. L. Shen, H. Li, Y. Wang, and H. Qu, "Reflecting on design paradigms of animated data video tools," in Proc. Conf. Hum. Factors Comput. Syst., 2025, pp. 1-21.
  68. Y. Wang, L. Shen, Z. You, X. Shu, B. Lee, J. Thompson, H. Zhang, and D. Zhang, "Wonderflow: Narration-centric design of animated data videos," IEEE Trans. Vis. Comput. Graph., 2024.
  69. A. Srinivasan, B. Lee, and J. Stasko, "Interweaving multimodal interac- tion with flexible unit visualizations for data exploration," IEEE Trans. Vis. Comput. Graph., vol. 27, no. 8, pp. 3519-3533, 2020.
  70. J. Walny, B. Lee, P. Johns, N. H. Riche, and S. Carpendale, "Under- standing pen and touch interaction for data exploration on interactive whiteboards," IEEE Trans. Vis. Comput. Graph., vol. 18, no. 12, pp. 2779-2788, 2012.
  71. D. Shi, X. Xu, F. Sun, Y. Shi, and N. Cao, "Calliope: Automatic visual data story generation from a spreadsheet," IEEE Trans. Vis. Comput. Graph., vol. 27, no. 2, pp. 453-463, 2020.

Authors
Li, H., Wang, Y., Liao, Q. V., & Qu, H.
Affiliations
  • Hong Kong University of Science and Technology (HK)
  • Microsoft Research Asia (China) (CN)
  • Microsoft (Canada) (CA)
ORCID
Venue
IEEE Transactions on Visualization and Computer Graphics
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Published
2025-10
Volume
31
Issue
10
Pages
7598-7613
ISSN
  • 1077-2626 (ISSN-L)
  • 1941-0506
  • 2160-9306
DOI
10.1109/tvcg.2025.3552017
OpenAlex
W4408520883
Cited by
25
References
72
Citations by year
2026: 10 · 2025: 8 · 2024: 4 · 2023: 3
FWCI
6.34
Type
journal article
Language
en
Open access
Licence
Locations
  • IEEE Transactions on Visualization and Computer Graphics (publishedVersion)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • Rare & Special e-Zone (The Hong Kong University of Science and Technology) (submittedVersion)
  • arXiv (Cornell University) (cc-by)
Funders
  • RGC GRF (16210722)
  • Bridging Data Analysis And Storytelling With Human-AI Collaborative Tools
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Data Visualization and Analytics
  • Social Sciences › Psychology › Social Psychology › Human-Automation Interaction and Safety
  • Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › AI and HR Technologies
Keywords
human-AI collaboration, data storytelling, data workers, data transmission
MeSH terms
Adult, Artificial Intelligence, Communication, Computer Graphics, Cooperative Behavior, Female, Humans, Interviews as Topic, Male, Middle Aged, Narration

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review