Where is the human in human-centered AI? Insights from developer priorities and user experiences
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Human-centered artificial intelligence (HCAI) seeks to shift the focus in AI development from technology to people. However, it is not clear whether existing HCAI principles and practices adequately accomplish this goal. To explore whether HCAI is sufficiently focused on people, we conducted a qualitative survey of AI developers (N = 75) and users (N = 130) and performed a thematic content analysis on their responses to gain insight into their differing priorities and experiences. Through this, we were able to compare HCAI in principle (guidelines and frameworks) and practice (developer priorities) with user experiences. We found that the social impact of AI was a defining feature of positive user experiences, but this was less of a priority for developers. Furthermore, our results indicated that improving AI functionality from the perspective of the user is an important part of making it human-centered. Indeed, users were more concerned about being understood by AI than about understanding AI. In line with HCAI guidelines, developers were concerned with issues such as ethics, privacy, and security, demonstrating an ‘avoidance of harm’ perspective. However, our results suggest that an increased focus on what people need in their lives is required for HCAI to be truly human-centered.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Interrater reliability: The kappa statistic
McHugh, M. L. (2012) · Biochemia Medica · doi:10.11613/bm.2012.031 · Cited by 19,877
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220
Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., et al. (2018) · Minds and Machines · doi:10.1007/s11023-018-9482-5 · Cited by 4,774
Prolific.ac—A subject pool for online experiments
Palan, S., & Schitter, C. (2018) · Journal of Behavioral and Experimental Finance · doi:10.1016/j.jbef.2017.12.004 · Cited by 3,450
Deci, E. L., & Ryan, R. M. (2012) · Handbook of Theories of Social Psychology: Volume 1 · doi:10.4135/9781446249215.n21 · Cited by 3,161
Self-Determination Theory Applied to Health Contexts: A Meta-Analysis
Ng, J. Y. Y., Ntoumanis, N., Thøgersen-Ntoumani, C., Deci, E. L., Ryan, R. M., Duda, J. L., & Williams, G. C. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612447309 · Cited by 1,959
Principles alone cannot guarantee ethical AI
Mittelstadt, B. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0114-4 · Cited by 1,886
Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
(2021) · doi:10.1145/3411764 · Cited by 1,240
A single-item measure of social identification: reliability, validity, and utility
Postmes, T., Haslam, S. A., & Jans, L. (2013) · British Journal of Social Psychology · doi:10.1111/bjso.12006 · Cited by 1,021
Self-citationCustomer experiences in the age of artificial intelligence
Ameen, N., Tarhini, A., Reppel, A., & Anand, A. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106548 · Cited by 833
Guidelines for establishing reliability when coding narrative data
Syed, M., & Nelson, S. C. (2015) · Emerging Adulthood · doi:10.1177/2167696815587648 · Cited by 801
Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need?
Holstein, K., Wortman Vaughan, J., Daumé, H., Dudik, M., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300830 · Cited by 777
Measures of response agreement for qualitative data: Some generalizations and alternatives.
Light, R. J. (1971) · Psychological Bulletin · doi:10.1037/h0031643 · Cited by 747
Cai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359206 · Cited by 594
Ethical governance is essential to building trust in robotics and artificial intelligence systems
Winfield, A. F. T., & Jirotka, M. (2018) · Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences · doi:10.1098/rsta.2018.0085 · Cited by 493
Madaio, M. A., Stark, L., Wortman Vaughan, J., & Wallach, H. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376445 · Cited by 436
AI-Based Digital Assistants: Opportunities, Threats, and Research Perspectives
Maedche, A., Legner, C., Benlian, A., Berger, B., Gimpel, H., Hess, T., Hinz, O., Morana, S., & Söllner, M. (2019) · Business & Information Systems Engineering · doi:10.1007/s12599-019-00600-8 · Cited by 432
Human-centered Artificial Intelligence in education: Seeing the invisible through the visible
Yang, S. J. H., Ogata, H., Matsui, T., & Chen, N.-S. (2021) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2021.100008 · Cited by 379
Beyond the promise: implementing ethical AI
Eitel-Porter, R. (2021) · AI and Ethics · doi:10.1007/s43681-020-00011-6 · Cited by 245
Scheuerman, M. K., Wade, K., Lustig, C., & Brubaker, J. R. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392866 · Cited by 193
Considerations for AI fairness for people with disabilities
Trewin, S., Basson, S., Muller, M., Branham, S., Treviranus, J., Gruen, D., Hebert, D., Lyckowski, N., & Manser, E. (2019) · AI Matters · doi:10.1145/3362077.3362086 · Cited by 143
Beyond checklists: toward an ethical-constructive technology assessment
Kiran, A. H., Oudshoorn, N., & Verbeek, P.-P. (2015) · Journal of Responsible Innovation · doi:10.1080/23299460.2014.992769 · Cited by 124
Trust in artificial Intelligence: a five country study
Gillespie, N., Lockey, S., & Curtis, C. (2021) · doi:10.14264/e34bfa3 · Cited by 104
Self-citationMoore, J. (2019) · Frontiers in Big Data · doi:10.3389/fdata.2019.00032 · Cited by 42
Bellet, T., Banet, A., Petiot, M., Richard, B., & Quick, J. (2020) · Information · doi:10.3390/info12010013 · Cited by 12
Cited by
Artificial intelligence for teaching and learning in schools: The need for pedagogical intelligence
Díaz, B., & Nussbaum, M. (2024) · Computers & Education · doi:10.1016/j.compedu.2024.105071 · Cited by 148
Ma, X., & Huo, Y. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103755 · Cited by 30
Ma, X., & Huo, Y. (2025) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2024.2303554 · Cited by 15
Gautam, S., Chandra, M., De, A., Chakravorti, T., Malik, G., & De Choudhury, M. (2025) · arXiv · doi:10.48550/arxiv.2508.06849 · Cited by 7
Metadata
- Authors
- Bingley, W. J., Curtis, C., Lockey, S., Bialkowski, A., Gillespie, N., Haslam, S. A., Ko, R. K. L., Steffens, N., Wiles, J., & Worthy, P.
- Venue
- Computers in Human Behavior
- Publisher
- Elsevier BV
- Published
- 2023-04
- Volume
- 141
- Pages
- 107617
- ISSN
- 0747-5632 (ISSN-L)
- OpenAlex
- W4311711203
- Cited by
- 135
- References
- 25
- FWCI
- 27.86
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.