The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Investigating How Experienced UX Designers Effectively Work with Machine Learning
Open accessAbstract
Machine learning (ML) plays an increasingly important role in improving a user's experience. However, most UX practitioners face challenges in understanding ML's capabilities or envisioning what it might be. We interviewed 13 designers who had many years of experience designing the UX of ML-enhanced products and services. We probed them to characterize their practices. They shared they do not view themselves as ML experts, nor do they think learning more about ML would make them better designers. Instead, our participants appeared to be the most successful when they engaged in ongoing collaboration with data scientists to help envision what to make and when they embraced a data-centric culture. We discuss the implications of these findings in terms of UX education and as opportunities for additional design research in support of UX designers working with ML.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Technological frames: making sense of information technology in organizations
Orlikowski, W. J., & Gash, D. C. (1994) · ACM Transactions on Information Systems · doi:10.1145/196734.196745 · Cited by 1,736
Why and why not explanations improve the intelligibility of context-aware intelligent systems
Lim, B. Y., Dey, A. K., & Avrahami, D. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1519023 · Cited by 552 · cited 2×
“Other researchers have explored various themes related to the interaction design challenges ML imposes, such as intelligibility [18], animistic design [19], and design for the peace of mind [12].”
Background
Research works printed but not linked: 24
- Christoph Bartneck . 2007 . Design methodology is not design science . In the CHI 2007 workshop: Converging on a" science of design" through the synthesis of design methodologies , San Jose, CA. Christoph Bartneck. 2007. Design methodology is not design science. In the CHI 2007 workshop: Converging on a" science of design" through the synthesis of design methodologies, San Jose, CA.
- 10.1145/2592267 · DOI
- Glenn A Bowen . 2006. Grounded theory and sensitizing concepts . International journal of qualitative methods 5, 3 ( 2006 ), 12--23. Glenn A Bowen. 2006. Grounded theory and sensitizing concepts. International journal of qualitative methods 5, 3 (2006), 12--23.
- Shan Carter and Michael Nielsen . 2017. Using Artificial Intelligence to Augment Human Intelligence. Distill ( 2017 ). https://distill.pub/2017/aia. Shan Carter and Michael Nielsen. 2017. Using Artificial Intelligence to Augment Human Intelligence. Distill (2017). https://distill.pub/2017/aia.
- Amber Cartwright . 2016 . Invisible Design: Co-Designing with Machines. (2016). http://airbnb.design/invisible-design/ Amber Cartwright. 2016. Invisible Design: Co-Designing with Machines. (2016). http://airbnb.design/invisible-design/
- Design Council . 2005. The "double diamond' design process model . Design Council ( 2005 ). Design Council. 2005. The "double diamond' design process model. Design Council (2005).
- 10.1145/3025453.3025739 · DOI · Paper page
- 10.1145/642611.642652 · DOI · Paper page
- 10.1145/2851581.2856492 · DOI
- Patrick Hebron . 2016a. Machine learning for designers . O'Reilly Media . Patrick Hebron. 2016a. Machine learning for designers. O'Reilly Media.
- Bryan Lawson . 2012. What designers know . Routledge . Bryan Lawson. 2012. What designers know. Routledge.
- 10.1080/14626268.2016.1145127 · DOI
- 10.1145/1753326.1753707 · DOI
- Eric Ries . 2011. The lean startup: How today's entrepreneurs use continuous innovation to create radically successful businesses . Crown Books . Eric Ries. 2011. The lean startup: How today's entrepreneurs use continuous innovation to create radically successful businesses. Crown Books.
- Donald A Schon . 1984. The reflective practitioner: How professionals think in action . Vol. 5126 . Basic books. Donald A Schon. 1984. The reflective practitioner: How professionals think in action. Vol. 5126. Basic books.
- Erik Stolterman . 2008 . The nature of design practice and implications for interaction design research . International Journal of Design 2 , 1 (2008). Erik Stolterman. 2008. The nature of design practice and implications for interaction design research. International Journal of Design 2, 1 (2008).
- TensorFlow : Smarter machine learning, for everyone 2017 . (2017). https://www.google.com/intl/en/about/main/tensorflow/ TensorFlow: Smarter machine learning, for everyone 2017. (2017). https://www.google.com/intl/en/about/main/tensorflow/
- 10.1145/503376.503448 · DOI · Paper page
- Mary Treseler . 2017. Designing with Data: Improving the User Experience with A/B Testing . O'Reilly Media , Chapter Designers as data scientists. http://radar. oreilly.com/ 2015 /05/designers-as-data-scientists.html Mary Treseler. 2017. Designing with Data: Improving the User Experience with A/B Testing. O'Reilly Media, Chapter Designers as data scientists. http://radar. oreilly.com/2015/05/designers-as-data-scientists.html
- Udemy Online Course : Applied machine learning for Everyone 2018 . (2018). https://www.udemy.com/ applied-machine-learning-for-everyone/ Udemy Online Course: Applied machine learning for Everyone 2018. (2018). https://www.udemy.com/ applied-machine-learning-for-everyone/
- 10.1007/s00779-013-0686-7 · DOI
- 10.1145/3173574.3173704 · DOI
- 10.1145/2901790.2901858 · DOI · Paper page
- 10.1145/1858171.1858228 · DOI · Paper page
Cited by
Explainable Artificial Intelligence in education
Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., Knight, S., Martinez-Maldonado, R., Sadiq, S., & Gašević, D. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100074 · Cited by 863
Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design
Yang, Q., Steinfeld, A., Rosé, C., & Zimmerman, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376301 · Cited by 622
“The second project focused on experienced UX practitioners [54].”
BackgroundSelf-citationKaur, H., Nori, H., Jenkins, S., Caruana, R., Wallach, H., & Wortman Vaughan, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376219 · Cited by 564
Six Human-Centered Artificial Intelligence Grand Challenges
Ozmen Garibay, O., Winslow, B., Andolina, S., Antona, M., Bodenschatz, A., Coursaris, C., Falco, G., Fiore, S. M., Garibay, I., Grieman, K., et al. (2023) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2022.2153320 · Cited by 501
Madaio, M. A., Stark, L., Wortman Vaughan, J., & Wallach, H. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376445 · Cited by 436
Metadata
- Authors
- Yang, Q., Scuito, A., Zimmerman, J., Forlizzi, J., & Steinfeld, A.
- Venue
- Proceedings of the 2018 Designing Interactive Systems Conference
- Publisher
- ACM
- Published
- 2018-06-08
- Pages
- 585-596
- OpenAlex
- W2808450727
- Cited by
- 226
- References
- 2
- FWCI
- 15.00
- Type
- conference paper
- Language
- en
- Open access
- bronze
- Funders
- National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR 90RE5011)
- the Center for Machine Learning and Health (CMLH) Fellowship in Digital Health
- National Science Foundation (SES 1734456)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Investigating How Experienced UX Designers Effectively Work with Machine Learning. https://app.cochat.ai/papers/10.1145/3196709.3196730
- The paper
- Yang, Q., Scuito, A., Zimmerman, J., Forlizzi, J., & Steinfeld, A. (2018). Investigating How Experienced UX Designers Effectively Work with Machine Learning. Proceedings of the 2018 Designing Interactive Systems Conference. https://doi.org/10.1145/3196709.3196730
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.