CoChat

Bridging the Gap Between UX Practitioners’ Work Practices and AI-Enabled Design Support Tools

Lu, Yuwen, Zhang, Chengzhi, Zhang, Iris, Li, Toby Jia-Jun · 2022 · CHI Conference on Human Factors in Computing Systems Extended Abstracts
Cited by 63

The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.

Abstract

User interface (UI) and user experience (UX) design have become an indispensable part of today’s tech industry. Recently, much progress has been made in machine-learning-enabled design support tools for UX designers. However, few of these tools have been adopted by practitioners. To learn the underlying reasons and understand user needs for bridging this gap, we conducted a retrospective analysis with 8 UX professionals to understand their practice and identify opportunities for future research. We found that the current AI-enabled systems to support UX work mainly work on graphical interface elements, while design activities that involve more ‘design thinking” such as user interviews and user testings are more helpful for designers. Many current systems were also designed for overly-simplistic and generic use scenarios. We identified 4 areas in the UX workflow that can benefit from additional AI-enabled assistance: design inspiration search, design alternative exploration, design system customization, and design guideline violation check.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3491101.3519809

Cites

16 of 16 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 37

  1. 10.1145/3419249.3420163 · DOI
  2. 10.1145/3064663.3064667 · DOI · Paper page
  3. 10.1007/978-3-540-74853-3_25 · DOI
  4. 10.1007/978-3-030-86365-4_5 · DOI
  5. Nishit Gajjar , Vinoth Pandian Sermuga Pandian , Sarah Suleri , and Matthias Jarke . 2021 . Akin: Generating UI Wireframes From UI Design Patterns Using Deep Learning. (2021), 40–42. https://doi.org/10.1145/3397482.3450727 Nishit Gajjar, Vinoth Pandian Sermuga Pandian, Sarah Suleri, and Matthias Jarke. 2021. Akin: Generating UI Wireframes From UI Design Patterns Using Deep Learning. (2021), 40–42. https://doi.org/10.1145/3397482.3450727 · DOI
  6. 10.1145/2556288.2557264 · DOI
  7. David Ha and Douglas Eck. 2017. A neural representation of sketch drawings. arXiv preprint arXiv:1704.03477(2017). David Ha and Douglas Eck. 2017. A neural representation of sketch drawings. arXiv preprint arXiv:1704.03477(2017). · arXiv
  8. 10.1145/3290605.3300334 · DOI
  9. Forrest Huang Gang Li Xin Zhou John F Canny and Yang Li. 2021. Creating User Interface Mock-ups from High-Level Text Descriptions with Deep-Learning Models. arXiv preprint arXiv:2110.07775(2021). Forrest Huang Gang Li Xin Zhou John F Canny and Yang Li. 2021. Creating User Interface Mock-ups from High-Level Text Descriptions with Deep-Learning Models. arXiv preprint arXiv:2110.07775(2021). · arXiv
  10. 10.1145/3491101.3504030 · DOI
  11. 10.1145/3377325.3377522 · DOI · Paper page
  12. Diederik P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114(2013). Diederik P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114(2013). · arXiv
  13. 10.1145/257089.257396 · DOI
  14. 10.1016/j.ijhcs.2013.09.006 · DOI · Paper page
  15. Hsin-Ying Lee Lu Jiang Irfan Essa Phuong B Le Haifeng Gong Ming-Hsuan Yang and Weilong Yang. 2020. Neural Design Network: Graphic Layout Generation with Constraints. (2020). https://doi.org/10.1007/978-3-030-58580-8 Hsin-Ying Lee Lu Jiang Irfan Essa Phuong B Le Haifeng Gong Ming-Hsuan Yang and Weilong Yang. 2020. Neural Design Network: Graphic Layout Generation with Constraints. (2020). https://doi.org/10.1007/978-3-030-58580-8 · DOI
  16. Jianan Li , Jimei Yang , Aaron Hertzmann , Jianming Zhang , and Tingfa Xu . 2019 . LayoutGAN: Generating Graphic Layouts with Wireframe Discriminators. 7th International Conference on Learning Representations, ICLR 2019 (jan 2019 ). arxiv:1901.06767 Jianan Li, Jimei Yang, Aaron Hertzmann, Jianming Zhang, and Tingfa Xu. 2019. LayoutGAN: Generating Graphic Layouts with Wireframe Discriminators. 7th International Conference on Learning Representations, ICLR 2019 (jan 2019). arxiv:1901.06767 · arXiv
  17. 10.1109/TSE.2018.2844788 · DOI · Paper page
  18. 10.1145/344949.344959 · DOI · Paper page
  19. 10.1145/200968.200971 · DOI
  20. Brad A Myers , Dario A Giuse , Roger B Dannenberg , Brad Vander Zanden , David S Kosbie , Edward Pervin , Andrew Mickish , and Philippe Marchal . 1995. GARNET comprehensive support for graphical, highly interactive user interfaces . In Readings in Human–Computer Interaction . Elsevier , 357–371. Brad A Myers, Dario A Giuse, Roger B Dannenberg, Brad Vander Zanden, David S Kosbie, Edward Pervin, Andrew Mickish, and Philippe Marchal. 1995. GARNET comprehensive support for graphical, highly interactive user interfaces. In Readings in Human–Computer Interaction. Elsevier, 357–371.
  21. 10.1145/1806491.1806494 · DOI · Paper page
  22. Kara Pernice . 2018 . Affinity Diagramming: Collaboratively Sort UX Findings & Design Ideas. https://www.nngroup.com/articles/affinity-diagram/ Kara Pernice. 2018. Affinity Diagramming: Collaboratively Sort UX Findings & Design Ideas. https://www.nngroup.com/articles/affinity-diagram/
  23. 10.1145/3188173.3188175 · DOI
  24. 10.1145/3090152.3090160 · DOI
  25. Daniel M Russell and Ed H Chi . 2014. Looking back: Retrospective study methods for HCI . In Ways of Knowing in HCI . Springer , 373–393. Daniel M Russell and Ed H Chi. 2014. Looking back: Retrospective study methods for HCI. In Ways of Knowing in HCI. Springer, 373–393.
  26. 10.1145/3411764.3445784 · DOI
  27. Ben Shneiderman , Michael Leavitt , 2006. Research-based web design & usability guidelines. Washington DC , Department of Health and Human Services ( 2006 ). Ben Shneiderman, Michael Leavitt, 2006. Research-based web design & usability guidelines. Washington DC, Department of Health and Human Services (2006).
  28. Erik Stolterman . 2008 . The nature of design practice and implications for interaction design research . International Journal of Design 2 , 1 (2008). Erik Stolterman. 2008. The nature of design practice and implications for interaction design research. International Journal of Design 2, 1 (2008).
  29. Hariharan Subramonyam , Colleen Seifert , and Eytan Adar . 2021 . ProtoAI: Model-Informed Prototyping for AI-Powered Interfaces. In 26th International Conference on Intelligent User Interfaces. Association for Computing Machinery , New York, NY, USA, 48–58. https://doi.org/10.1145/3397481.3450640 Hariharan Subramonyam, Colleen Seifert, and Eytan Adar. 2021. ProtoAI: Model-Informed Prototyping for AI-Powered Interfaces. In 26th International Conference on Intelligent User Interfaces. Association for Computing Machinery, New York, NY, USA, 48–58. https://doi.org/10.1145/3397481.3450640 · DOI
  30. 10.1145/3313831.3376593 · DOI · Paper page
  31. 10.1145/3472749.3474765 · DOI · Paper page
  32. 10.1007/978-3-030-49760-6_12 · DOI
  33. 10.1145/1952383.1952384 · DOI · Paper page
  34. 10.1109/ICSE43902.2021.00075 · DOI
  35. 10.1145/3196709.3196730 · DOI · Paper page
  36. ZiCheng Zhang CongYing Han and TianDe Guo. 2021. ExSinGAN: Learning an Explainable Generative Model from a Single Image. arXiv preprint arXiv:2105.07350(2021). ZiCheng Zhang CongYing Han and TianDe Guo. 2021. ExSinGAN: Learning an Explainable Generative Model from a Single Image. arXiv preprint arXiv:2105.07350(2021). · arXiv
  37. 10.1109/ICSE43902.2021.00074 · DOI

Cited by

See all 63

Metadata

Authors
Lu, Y., Zhang, C., Zhang, I., & Li, T. J.-J.
Venue
CHI Conference on Human Factors in Computing Systems Extended Abstracts
Publisher
ACM
Published
2022-04-27
Pages
1-7
OpenAlex
W4225129570
Cited by
63
References
16
FWCI
10.70
Type
conference paper
Language
en
Open access
closed
Funders
  • Asia Research Collaboration Grant from Notre Dame International
  • Google Cloud Research Credit Grant

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.