The DOI matches its Crossref record; 53 of the 55 references it cites were found in a registry or an index.
Power to the People: The Role of Humans in Interactive Machine Learning
Open accessAbstract
Systems that can learn interactively from their end‐users are quickly becoming widespread. Until recently, this progress has been fueled mostly by advances in machine learning; however, more and more researchers are realizing the importance of studying users of these systems. In this article we promote this approach and demonstrate how it can result in better user experiences and more effective learning systems. We present a number of case studies that demonstrate how interactivity results in a tight coupling between the system and the user, exemplify ways in which some existing systems fail to account for the user, and explore new ways for learning systems to interact with their users. After giving a glimpse of the progress that has been made thus far, we discuss some of the challenges we face in moving the field forward.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The resulting tight coupling between humans and machines, with the two influencing one another, makes it increasingly difficult, or even impossible, to decouple their influence on the resulting model (Amershi et al., 2014).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Amershi et al., 2014
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Owing to their inherent complexity and uncertainty, augmentation efforts often fail (Amershi et al., 2014).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Amershi et al., 2014
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Contrary to automation, augmentation demands continued human involvement and experimentation (Amershi et al., 2014).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Amershi et al., 2014
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Through augmentation, humans and machines become so closely intertwined that they collectively exhibit entirely new, emergent behaviors, which neither show individually (Amershi et al., 2014).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Amershi et al., 2014
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Augmentation is therefore a coevolutionary process during which humans learn from machines and machines learn from humans (Amershi, Cakmak, Knox, & Kulesza, 2014;Rahwan et al., 2019).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Amershi, Cakmak, Knox, & Kulesza, 2014
In the citing paper
“-Data Design: Design issues on data collection, pre-processing, cleaning, labeling and augmentation, including big data challenges [17,23,25-27, 31,33,41,44,74-76,105,114-116].”
From Software engineering challenges for machine learning applications: A literature review (2020) · cites this paper as [25]
In the citing paper
“-Visualization: Technical challenges on visualization techniques for the design of ML applications [25,56,63,122,123].”
From Software engineering challenges for machine learning applications: A literature review (2020) · cites this paper as [25]
In the citing paper
“-Tools: Needs of designing tools for ML applications, such as tools for non-expert ML designers, visualization tools for understanding the relationships between data and the behavior of algorithms, tools for ensuring interoperability with other tools, and domain-specific language (DSL) support [16,25,42,66].”
From Software engineering challenges for machine learning applications: A literature review (2020) · cites this paper as [25]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. (1997) · European Conference on Computational Learning Theory · doi:10.1007/3-540-59119-2_166 · Cited by 23,988
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
Norman, D. A. (2016) · Vahlen eBooks · doi:10.15358/9783800648108 · Cited by 6,415
Designing the user interface: Strategies for effective human-computer interaction
(1993) · Applied Ergonomics · doi:10.1016/0003-6870(93)90471-k · Cited by 5,592
(2009) · Minds at UW (University of Wisconsin) · Cited by 4,791
A Survey of Collaborative Filtering Techniques
Su, X., & Khoshgoftaar, T. M. (2009) · Advances in Artificial Intelligence · doi:10.1155/2009/421425 · Cited by 3,641
Proceedings of the 29th International Conference on Machine Learning (ICML-12)Preprint
Langford, J. C., & Pineau, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1207.4676 · Cited by 1,687
Principles of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490
(2003) · CRC Press eBooks · doi:10.1201/9780367804787 · Cited by 1,227
Flagged first, then by citations
2 of the 55 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Amershi S., 2009, Proceedings of the ACM Symposium on User Interface Software and Technology, 2009 (UIST 2009), 47
- Kamar E., 2012, Proceedings of the International Conference on Autonomous Agents and Multi‐Agent Systems (AAMAS 2012)
Cited by
Sorted by citations
Items 201–300 of 1,004
Pragmatic Frames for Teaching and Learning in Human–Robot Interaction: Review and Challenges
Vollmer, A.-L., Wrede, B., Rohlfing, K. J., & Oudeyer, P. (2016) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2016.00010 · Cited by 44
Observation-Level and Parametric Interaction for High-Dimensional Data Analysis
Self, J. Z., Dowling, M., Wenskovitch, J. E., Crandell, I., Wang, M., House, L., Leman, S. C., & North, C. L. (2018) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3158230 · Cited by 41
NOVA - A tool for eXplainable Cooperative Machine Learning
Heimerl, A., Baur, T., Lingenfelser, F., Wagner, J., & André, E. (2019) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2019.8925519 · Cited by 36
Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A. J. M., & Badia, S. B. I. (2020) · ACM Conference on Health, Inference, and Learning (CHIL) · doi:10.1145/3368555.3384452 · Cited by 38
Millo, Y., Spence, C., & Xu, R. (2024) · Accounting Organizations and Society · doi:10.1016/j.aos.2024.101567 · Cited by 36
Artificial Intelligence in Music and Performance: A Subjective Art-Research Inquiry
Caramiaux, B., & Donnarumma, M. (2021) · Springer eBooks · doi:10.1007/978-3-030-72116-9_4 · Cited by 41
Chowdhury, E. K. (2023) · International series in management science/operations research/International series in operations research & management science · doi:10.1007/978-3-031-18552-6_3 · Cited by 35
Personalized explanation in machine learning: A conceptualizationPreprint
Schneider, J., & Handali, J. P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.00770 · Cited by 69
(2015) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 34
Human-centered machine learning through interactive visualization: review and open challenges.
Sacha, D., Sedlmair, M., Zhang, L., Lee, J. A., Weiskopf, D., North, S. C., & Keim, D. A. (2016) · The European Symposium on Artificial Neural Networks · Cited by 34
Crowdsourcing the Perception of Machine Teaching
Hong, J., Lee, K., Xu, J., & Kacorri, H. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376428 · Cited by 37
Automatic Detection of Usability Problem Encounters in Think-aloud Sessions
Fan, M., Li, Y., & Truong, K. N. (2020) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3385732 · Cited by 34
Encoding Human Domain Knowledge to Warm Start Reinforcement Learning
Silva, A., & Gombolay, M. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i6.16638 · Cited by 51
Social Diversity and Social Preferences in Mixed-Motive Reinforcement Learning
McKee, K. R., Gemp, I., McWilliams, B., Duèñez-Guzmán, E. A., Hughes, E., & Leibo, J. Z. (2020) · International Joint Conference on Autonomous Agents and Multiagent Systems · doi:10.65109/dnuf7773 · Cited by 33
Artinter: AI-powered Boundary Objects for Commissioning Visual Arts
Chung, J. J. Y., & Adar, E. (2023) · Proceedings of the 2023 ACM Designing Interactive Systems Conference · doi:10.1145/3563657.3595961 · Cited by 33
Gourlet, P., Ricci, D., & Crépel, M. (2024) · Big Data & Society · doi:10.1177/20539517241248093 · Cited by 41
Toward User-Driven Sound Recognizer Personalization with People Who Are d/Deaf or Hard of Hearing
Goodman, S. M., Liu, P., Jain, D., McDonnell, E. J., Froehlich, J. E., & Findlater, L. (2021) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3463501 · Cited by 33
Do, H. J., Kong, H.-K., Tetali, P., Lee, J., & Bailey, B. P. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579532 · Cited by 32
NL-EDIT: Correcting Semantic Parse Errors through Natural Language Interaction
Elgohary, A., Meek, C., Richardson, M., Fourney, A., Ramos, G., & Awadallah, A. H. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.444 · Cited by 49
LEADOR: A Method for End-To-End Participatory Design of Autonomous Social Robots
Winkle, K., Senft, E., & Lemaignan, S. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.704119 · Cited by 37
Designing Interactive Transfer Learning Tools for ML Non-Experts
Mishra, S., & Rzeszotarski, J. M. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445096 · Cited by 34
Reliable and Safe Use of Machine Translation in Medical Settings
Mehandru, N., Robertson, S., & Salehi, N. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533244 · Cited by 48
Landscape of R packages for eXplainable Artificial IntelligencePreprint
Maksymiuk, S., Gosiewska, A., & Biecek, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.13248 · Cited by 32
Pearl: A Technology Probe for Machine-Assisted Reflection on Personal Data
Jörke, M., Sefidgar, Y. S., Massachi, T., Suh, J., & Ramos, G. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581641.3584054 · Cited by 34
Calderón, N. A., Fisher, B., Hemsley, J., Ceskavich, B., Jansen, G., Marciano, R. J., & Lemieux, V. L. (2015) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2015.7363939 · Cited by 31
Prototyping Machine Learning Through Diffractive Art Practice
Scurto, H., Caramiaux, B., & Bevilacqua, F. P. (2021) · Designing Interactive Systems Conference · doi:10.1145/3461778.3462163 · Cited by 36
Interactive Machine Learning by Visualization: A Small Data Solution
Li, H., Fang, S., Mukhopadhyay, S., Saykin, A. J., & Shen, L. (2018) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2018.8621952 · Cited by 32
Designing Deep Reinforcement Learning for Human Parameter Exploration
Scurto, H., Kerrebroeck, B. V., Caramiaux, B., & Bevilacqua, F. P. (2021) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3414472 · Cited by 33
How to Support Users in Understanding Intelligent Systems? Structuring the Discussion
Eiband, M., Buschek, D., & Hußmann, H. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397481.3450694 · Cited by 34
Cui, Y., Koppol, P., Admoni, H., Niekum, S., Simmons, R. G., Steinfeld, A. M., & Fitzgerald, T. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/599 · Cited by 33
Machine Learning for Fraud Detection in E-Commerce: A Research Agenda
Tax, N., de Vries, K. J., de Jong, M., Dosoula, N., van den Akker, B., Smith, J., Thuong, O., & Bernardi, L. (2021) · Communications in computer and information science · doi:10.1007/978-3-030-87839-9_2 · Cited by 39
Applying and Augmenting Deep Reinforcement Learning in Serious Games through Interaction
Dobrovsky, A., Borghoff, U. M., & Hofmann, M. A. (2017) · Periodica Polytechnica Electrical Engineering and Computer Science · doi:10.3311/ppee.10313 · Cited by 33
Mao, Y., Rafner, J. F., Wang, Y., & Sherson, J. F. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia230078 · Cited by 33
Using Expert Patterns in Assisted Interactive Machine Learning: A Study in Machine Teaching
Wall, E., Ghorashi, S., & Ramos, G. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-29387-1_34 · Cited by 30
Human-Machine Cooperative Video Anomaly Detection
Yang, F., Yu, Z., Chen, L., Gu, J., Li, Q., & Guo, B. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3434183 · Cited by 28
Explanatory Interactive Machine Learning
Pfeuffer, N., Baum, L., Stammer, W., Abdel-Karim, B. M., Schramowski, P., Bucher, A. M., Hügel, C., Rohde, G. G. U., Kersting, K., & Hinz, O. F. (2023) · Business & Information Systems Engineering · doi:10.1007/s12599-023-00806-x · Cited by 38
Integrating Generative Artificial Intelligence in Intelligent Vehicle Systems
Stappen, L., Dillmann, J., Striegel, S., Vögel, H.-J., Flores-Herr, N., & Schuller, B. W. (2023) · IEEE International Conference on Intelligent Transportation Systems (ITSC) · doi:10.1109/itsc57777.2023.10422003 · Cited by 35
Göndöcs, D., Horváth, S., & Dörfler, V. (2025) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2025.103622 · Cited by 39
Choudhury, M. D., & Kıcıman, E. (2018) · The AI Magazine · doi:10.1609/aimag.v39i3.2815 · Cited by 29
From ”Explainable AI” to ”Graspable AI”
Ghajargar, M., Bardzell, J., Smith-Renner, A., Krogh, P. G., Höök, K., Cuartielles, D. J., Boer, L., & Wiberg, M. (2021) · International Conference on Tangible, Embedded, and Embodied Interaction (TEI) · doi:10.1145/3430524.3442704 · Cited by 29
Spencer, J. C., Choudhury, S., Barnes, M., Schmittle, M., Chiang, M., Ramadge, P. J., & Srinivasa, S. (2021) · Autonomous Robots · doi:10.1007/s10514-021-10006-9 · Cited by 27
A Survey of Domain Knowledge Elicitation in Applied Machine Learning
Kerrigan, D., Hullman, J. R., & Bertini, E. (2021) · Multimodal Technologies and Interaction · doi:10.3390/mti5120073 · Cited by 28
Stawarz, K., Katz, D., Ayobi, A., Marshall, P., Yamagata, T., Santos‐Rodríguez, R., Flach, P. A., & O’Kane, A. A. (2023) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2023.103003 · Cited by 27
Xu, W., & Dainoff, M. J. (2023) · interactions · doi:10.1145/3571883 · Cited by 26
Guesmi, M., Chatti, M. A., Joarder, S., Ain, Q. U., Alatrash, R., Siepmann, C., & Vahidi, T. (2023) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2023.2262797 · Cited by 31
Human–AI Enhancement of Cyber Threat Intelligence
Cohen, D., Te’eni, D., Yahav, I., Zagalsky, A., Schwartz, D. G., Silverman, G., Mann, Y., Elalouf, A., & Makowski, J. (2025) · International Journal of Information Security · doi:10.1007/s10207-025-01004-4 · Cited by 26
AI technology, AI narrative, and firm value
Xing, X., Zhang, Z., & He, W. (2025) · Technovation · doi:10.1016/j.technovation.2025.103349 · Cited by 34
Intelligible Artificial Intelligence
Weld, D. S., & Bansal, G. (2018) · Cited by 26
Why Didn’t You Listen to Me? Comparing User Control of Human-in-the-Loop Topic Models
Kumar, V., Smith, A., Findlater, L., Seppi, K. D., & Boyd-Graber, J. L. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1637 · Cited by 26
Human engagement providing evaluative and informative advice for interactive reinforcement learning
Bignold, A., Cruz, F., Dazeley, R., Vamplew, P. W., & Foale, C. (2022) · Neural Computing and Applications · doi:10.1007/s00521-021-06850-6 · Cited by 25
MIND MELD: Personalized Meta-Learning for Robot-Centric Imitation Learning
Schrum, M., Hedlund-Botti, E., Moorman, N. M., & Gombolay, M. (2022) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri53351.2022.9889616 · Cited by 26
Wang, Q., L’Yi, S., & Gehlenborg, N. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581127 · Cited by 26
Emerging Perspectives in Human-Centered Machine Learning
Ramos, G., Suh, J., Ghorashi, S., Meek, C., Banks, R., Amershi, S., Fiebrink, R. A., Smith, A., & Bansal, G. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3299014 · Cited by 27
Self-citationA Survey on Deep Learning Toolkits and Libraries for Intelligent User InterfacesPreprint
Zacharias, J., Barz, M., & Sonntag, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1803.04818 · Cited by 33
The Role of Partial Automation in Increasing the Accessibility of Digital Games
Cimolino, G., Askari, S., & Graham, T. C. N. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3474693 · Cited by 25
Machine Learning and Knowledge Extraction
Asher, N. M., Paul, S., & Russell, C. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-84060-0 · Cited by 25
Siyan, C., Ting-huai, W., Li, X., Liu, Z., & Dan-ying, W. (2020) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-189557 · Cited by 29
Using a Machine Learning Tool to Support High‐Stakes Decisions in Child Protection
Vaithianathan, R., Benavides‐Prado, D., Dalton, E., Chouldechova, A., & Putnam‐Hornstein, E. (2021) · AI Magazine · doi:10.1002/j.2371-9621.2021.tb00011.x · Cited by 27
An English Network Teaching Method Supported by Artificial Intelligence Technology and WBIETS System
Du, H. (2021) · Scientific Programming · doi:10.1155/2021/8783899 · Cited by 26
ScatterShot: Interactive In-context Example Curation for Text Transformation
Wu, T., Shen, H., Weld, D. S., Heer, J., & Ribeiro, M. T. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581641.3584059 · Cited by 34
Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Design
Lam, M. S., Ma, Z., Li, A., Freitas, I., Wang, D., Landay, J. A., & Bernstein, M. S. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581290 · Cited by 31
Suh, J., Ghorashi, S., Ramos, G., Chen, N.-C., Drucker, S. M., Verwey, J., & Simard, P. (2019) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3241379 · Cited by 29
Modelling serendipity in a computational contextPreprint
Corneli, J., Jordanous, A., Guckelsberger, C., Pease, A., & Colton, S. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1411.0440 · Cited by 31
Interactive NLP in Clinical Care: Identifying Incidental Findings in Radiology Reports
Trivedi, G., Dadashzadeh, E. R., Handzel, R. M., Chapman, W. W., Visweswaran, S., & Hochheiser, H. (2019) · Applied Clinical Informatics · doi:10.1055/s-0039-1695791 · Cited by 26
How Accurate Does It Feel? – Human Perception of Different Types of Classification Mistakes
Papenmeier, A., Kern, D., Hienert, D., Kammerer, Y., & Seifert, C. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501915 · Cited by 29
How Domain Experts Work with Data: Situating Data Science in the Practices and Settings of Craftwork
Jung, J. Y., Steinberger, T., King, J. L., & Ackerman, M. S. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512905 · Cited by 24
An approach to interactive deep reinforcement learning for serious games
Dobrovsky, A., Borghoff, U. M., & Hofmann, M. A. (2016) · IEEE International Conference on Cognitive Infocommunications · doi:10.1109/coginfocom.2016.7804530 · Cited by 25
An Evaluation Methodology for Interactive Reinforcement Learning with Simulated Users
Bignold, A., Cruz, F., Dazeley, R., Vamplew, P. W., & Foale, C. (2021) · Biomimetics · doi:10.3390/biomimetics6010013 · Cited by 24
Towards a Better Understanding of Evaluating Trustworthiness in AI Systems
Kemmerzell, N., Schreiner, A., Khalid, H., Schalk, M., & Bordoli, L. (2025) · ACM Computing Surveys · doi:10.1145/3721976 · Cited by 34
Intelligent sports prediction analysis system based on improved Gaussian fuzzy algorithm
Men, Y. (2021) · Alexandria Engineering Journal · doi:10.1016/j.aej.2021.08.084 · Cited by 25
Brand, N., Odom, W., & Barnett, S. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581336 · Cited by 23
Mosqueira-Rey, E., Hernández-Pereira, E., Bobes-Bascarán, J., Alonso-Ríos, D., Pérez-Sánchez, A., Fernández-Leal, Á., Moret‐Bonillo, V., Vidal-Ínsua, Y., & Vázquez-Rivera, F. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-09197-2 · Cited by 24
Human-centered machine learning through interactive visualization
Sacha, D., Sedlmair, M., Zhang, L., Lee, J. A., Weiskopf, D., North, S. C., & Keim, D. A. (2016) · Middlesex University Research Repository (Middlesex University Of London) · Cited by 23
Augmented Intelligence – Wie Menschen mit KI zusammen arbeiten
Kirste, M. (2018) · Künstliche Intelligenz · doi:10.1007/978-3-662-58042-4_4 · Cited by 27
Shimizu, E., Fisher, M., Paris, S., McCann, J., & Fatahalian, K. (2020) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3379337.3415866 · Cited by 23
HI-TAM, a hybrid intelligence framework for training and adoption of generative design assistants
Mao, Y., Rafner, J. F., Wang, Y., & Sherson, J. F. (2024) · Frontiers in Computer Science · doi:10.3389/fcomp.2024.1460381 · Cited by 31
AI-Driven Assessment of Students: Current Uses and Research Trends
Sánchez‐Prieto, J. C., Gamazo, A., Cruz-Benito, J., Therón, R., & García‐Peñalvo, F. J. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-50513-4_22 · Cited by 22
Design of evaluation system of physical education based on machine learning algorithm and SVM
Jin-feng, L., & Yang, B. (2020) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-189565 · Cited by 23
Shen, H., Liao, K., Liao, Z., Doornberg, J. N., Qiao, M., van den Hengel, A., & Verjans, J. W. H. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3451798 · Cited by 25
Deep Learning Uncertainty in Machine Teaching
Sanchez, T., Caramiaux, B., Thiel, P., & Mackay, W. E. (2022) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3490099.3511117 · Cited by 22
Kleinman, E., Shergadwala, M., & El‐Nasr, M. S. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517654 · Cited by 22
TimberTrek: Exploring and Curating Sparse Decision Trees with Interactive Visualization
Wang, Z. J., Zhong, C., Xin, R., Takagi, T., Chen, Z., Chau, D. H., Rudin, C. D., & Seltzer, M. (2022) · Visualization · doi:10.1109/vis54862.2022.00021 · Cited by 30
Arakawa, R., Yakura, H., Mollyn, V., Nie, S., Russell, E. R., DeMeo, D. P., Reddy, H. A., Maytin, A. K., Carroll, B. T., Lehman, J. F., et al. (2022) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3569504 · Cited by 23
Feng, K. J. K., & McDonald, D. W. (2023) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3581641.3584064 · Cited by 29
A Value Co-Creation Perspective on Data Labeling in Hybrid Intelligence Systems: A Design Study
Li, M. M., Reinhard, P., Peters, C., Oeste-Reiß, S., & Leimeister, J. M. (2023) · Information Systems · doi:10.1016/j.is.2023.102311 · Cited by 30
Integrating Data and Model Space in Ensemble Learning by Visual Analytics
Schneider, B., Jäckle, D., Stoffel, F., Diehl, A., Fuchs, J., & Keim, D. A. (2018) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2018.2877350 · Cited by 25
DesignWeaver: Dimensional Scaffolding for Text-to-Image Product Design
Tao, S., Liang, I., Peng, C., Wang, Z., Palani, S., & Dow, S. P. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714211 · Cited by 21
Khuat, T. T., Kedziora, D. J., & Gabryś, B. (2023) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000091 · Cited by 45
Performance Assessment Technologies for the Support of Musical Instrument Learning
Eremenko, V. E., Morsi, A., Narang, J., & Serra, X. (2020) · International Conference on Computer Supported Education · doi:10.5220/0009817006290640 · Cited by 21
Wiethof, C., Tavanapour, N., & Bittner, E. A. C. (2021) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2021.047 · Cited by 21
Stitzlein, C. A., Fielke, S., Waldner, F., & Sanderson, T. (2021) · Sustainability · doi:10.3390/su13169280 · Cited by 21
Kim, M., Lee, D., Kim, T., Oh, S., & Cho, H. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104642 · Cited by 21
Benhaddou, Y., & Leray, P. (2017) · IEEE/ACS International Conference on Computer Systems and Applications (AICCSA) · doi:10.1109/aiccsa.2017.51 · Cited by 21
Reinforcement learning of motor skills using Policy Search and human corrective advice
Celemin, C. E., Maeda, G. J., Ruíz-del-Solar, J., Peters, J., & Kober, J. (2019) · The International Journal of Robotics Research · doi:10.1177/0278364919871998 · Cited by 24
Xu, W. Z., Dainoff, M. J., Ge, L., & Gao, Z. (2021) · arXiv (Cornell University) · Cited by 21
New research paradigms and agenda of human factors science in the intelligence era
Wei, X. U., Gao, Z., & Ge, L. (2023) · Acta Psychologica Sinica · doi:10.3724/sp.j.1041.2024.00363 · Cited by 28
LanCon-Learn: Learning With Language to Enable Generalization in Multi-Task Manipulation
Silva, A., Moorman, N. M., Silva, W., Zaidi, Z., Gopalan, N., & Gombolay, M. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3139667 · Cited by 22
Rahman, S., & Kandogan, E. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502068 · Cited by 22
Tangible Explainable AI - an Initial Conceptual Framework
Colley, A., Väänänen, K., & Häkkilä, J. (2022) · International Conference on Mobile and Ubiquitous Multimedia (MUM) · doi:10.1145/3568444.3568456 · Cited by 23
Wang, K., Pan, Z., & Lu, Y.-B. (2024) · Kybernetes · doi:10.1108/k-04-2024-0894 · Cited by 17
Metadata
- Authors
- Amershi, S., Cakmak, M., Knox, W. B., & Kulesza, T.
- Affiliations
- Microsoft (United States) (US)
- Massachusetts Institute of Technology (US)
- Oregon State University (US)
- Venue
- AI Magazine
- Publisher
- Wiley
- Published
- 2014-12
- Volume
- 35
- Issue
- 4
- Pages
- 105-120
- ISSN
- 0738-4602 (ISSN-L)
- 2371-9621
- OpenAlex
- W1501005121
- Cited by
- 1,084
- References
- 55
- Citations by year
- 2026: 139 · 2025: 127 · 2024: 106 · 2023: 101 · 2022: 111 · 2021: 172 · 2020: 111 · 2019: 83 · 2018: 63 · 2017: 33 · 2016: 22 · 2015: 14 · 2014: 2
- FWCI
- 23.60
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- AI Magazine (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Keywords
- interactive machine learning, human-in-the-loop learning, user modeling, user experience, human-computer interaction, learning systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
