The DOI matches its Crossref record; 53 of the 55 references it cites were found in a registry or an index.
Power to the People: The Role of Humans in Interactive Machine Learning
Open accessAbstract
Systems that can learn interactively from their end‐users are quickly becoming widespread. Until recently, this progress has been fueled mostly by advances in machine learning; however, more and more researchers are realizing the importance of studying users of these systems. In this article we promote this approach and demonstrate how it can result in better user experiences and more effective learning systems. We present a number of case studies that demonstrate how interactivity results in a tight coupling between the system and the user, exemplify ways in which some existing systems fail to account for the user, and explore new ways for learning systems to interact with their users. After giving a glimpse of the progress that has been made thus far, we discuss some of the challenges we face in moving the field forward.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The resulting tight coupling between humans and machines, with the two influencing one another, makes it increasingly difficult, or even impossible, to decouple their influence on the resulting model (Amershi et al., 2014).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Amershi et al., 2014
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Owing to their inherent complexity and uncertainty, augmentation efforts often fail (Amershi et al., 2014).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Amershi et al., 2014
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Contrary to automation, augmentation demands continued human involvement and experimentation (Amershi et al., 2014).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Amershi et al., 2014
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Through augmentation, humans and machines become so closely intertwined that they collectively exhibit entirely new, emergent behaviors, which neither show individually (Amershi et al., 2014).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Amershi et al., 2014
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Augmentation is therefore a coevolutionary process during which humans learn from machines and machines learn from humans (Amershi, Cakmak, Knox, & Kulesza, 2014;Rahwan et al., 2019).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Amershi, Cakmak, Knox, & Kulesza, 2014
In the citing paper
“-Data Design: Design issues on data collection, pre-processing, cleaning, labeling and augmentation, including big data challenges [17,23,25-27, 31,33,41,44,74-76,105,114-116].”
From Software engineering challenges for machine learning applications: A literature review (2020) · cites this paper as [25]
In the citing paper
“-Visualization: Technical challenges on visualization techniques for the design of ML applications [25,56,63,122,123].”
From Software engineering challenges for machine learning applications: A literature review (2020) · cites this paper as [25]
In the citing paper
“-Tools: Needs of designing tools for ML applications, such as tools for non-expert ML designers, visualization tools for understanding the relationships between data and the behavior of algorithms, tools for ensuring interoperability with other tools, and domain-specific language (DSL) support [16,25,42,66].”
From Software engineering challenges for machine learning applications: A literature review (2020) · cites this paper as [25]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. (1997) · European Conference on Computational Learning Theory · doi:10.1007/3-540-59119-2_166 · Cited by 23,988
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Reinforcement Learning: A Survey
Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.301 · Cited by 8,972
Norman, D. A. (2016) · Vahlen eBooks · doi:10.15358/9783800648108 · Cited by 6,415
Designing the user interface: Strategies for effective human-computer interaction
(1993) · Applied Ergonomics · doi:10.1016/0003-6870(93)90471-k · Cited by 5,592
(2009) · Minds at UW (University of Wisconsin) · Cited by 4,791
A Survey of Collaborative Filtering Techniques
Su, X., & Khoshgoftaar, T. M. (2009) · Advances in Artificial Intelligence · doi:10.1155/2009/421425 · Cited by 3,641
Proceedings of the 29th International Conference on Machine Learning (ICML-12)Preprint
Langford, J. C., & Pineau, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1207.4676 · Cited by 1,687
Principles of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490
(2003) · CRC Press eBooks · doi:10.1201/9780367804787 · Cited by 1,227
Flagged first, then by citations
2 of the 55 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Amershi S., 2009, Proceedings of the ACM Symposium on User Interface Software and Technology, 2009 (UIST 2009), 47
- Kamar E., 2012, Proceedings of the International Conference on Autonomous Agents and Multi‐Agent Systems (AAMAS 2012)
Cited by
Sorted by citations
Items 301–400 of 1,004
Interactive Machine Learning for End-User Innovation
Bernardo, F., Zbyszyński, M., Fiebrink, R. A., & Grierson, M. (2016) · Goldsmiths (University of London) · Cited by 20
Making End User Development More Natural
Myers, B. A., Ko, A. J., Scaffidi, C., Oney, S., Yoon, Y., Chang, K. S.-P., Kery, M. B., & Li, T. J.-J. (2017) · Springer eBooks · doi:10.1007/978-3-319-60291-2_1 · Cited by 20
How and What Can Humans Learn from Being in the Loop?
Abdel-Karim, B. M., Pfeuffer, N., Rohde, G. G. U., & Hinz, O. F. (2020) · Künstliche Intell. · doi:10.1007/s13218-020-00638-x · Cited by 21
de Véricourt, F., & Perakis, G. (2020) · Service Science · doi:10.1287/serv.2020.0262 · Cited by 20
A classification and review of tools for developing and interacting with machine learning systems
Mosqueira-Rey, E., Hernández-Pereira, E., Alonso-Ríos, D., & Bobes-Bascarán, J. (2022) · ACM Symposium on Applied Computing · doi:10.1145/3477314.3507310 · Cited by 22
Preference-based interactive multi-document summarisation
Gao, Y., Meyer, C. M., & Gurevych, I. (2019) · Information Retrieval · doi:10.1007/s10791-019-09367-8 · Cited by 22
Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Bermúdez i Badia, S. (2022) · 27th International Conference on Intelligent User Interfaces · doi:10.1145/3490099.3511112 · Cited by 19
“Human-in-the-loop, interactive ML approaches have been actively explored by researchers to create a better ML model with improved performance and user acceptance [1, 12, 37, 42] and improve the annotations [28, 32, 35].”
BackgroundMerritt, D. C., Jones, J., Ackerman, M. S., & Lasecki, W. S. (2017) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2998181.2998358 · Cited by 19
Understanding and Supporting Knowledge Decomposition for Machine Teaching
Ng, F., Suh, J., & Ramos, G. (2020) · Designing Interactive Systems Conference · doi:10.1145/3357236.3395454 · Cited by 22
Interactive Machine Learning for Data Exfiltration Detection: Active Learning with Human Expertise
Chung, M.-H., Chignell, M., Wang, L., Jovicic, A., & Raman, A. (2020) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc42975.2020.9282831 · Cited by 22
Towards Guidelines for Designing Human-in-the-Loop Machine Training Interfaces
van der Stappen, A., & Funk, M. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397481.3450668 · Cited by 23
Hongmei, W., & Tang, S. (2021) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-219047 · Cited by 19
A Survey of Collaborative Reinforcement Learning: Interactive Methods and Design Patterns
Li, Z., Shi, L., Cristea, A., & Zhou, Y.-Z. (2021) · Conference on Designing Interactive Systems · doi:10.1145/3461778.3462135 · Cited by 20
Music classroom assistant teaching system based on intelligent speech recognition
Long, C., & Wang, S. (2021) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-219154 · Cited by 19
Herde, M., Huseljic, D., Sick, B., & Calma, A. (2021) · IEEE Access · doi:10.1109/access.2021.3135514 · Cited by 21
AI-powered model repair: an experience report—lessons learned, challenges, and opportunities
Barriga, A., Rutle, A., & Heldal, R. (2022) · Software & Systems Modeling · doi:10.1007/s10270-022-00983-5 · Cited by 20
Tongue-able interfaces: Prototyping and evaluating camera based tongue gesture input system
Niu, S., Liu, L., & McCrickard, D. S. (2018) · Smart Health · doi:10.1016/j.smhl.2018.03.001 · Cited by 19
Interactive Ant Colony Optimization to Support Adaptation in Serious Games
Kickmeier-Rust, M., & Holzinger, A. (2019) · International Journal of Serious Games · doi:10.17083/ijsg.v6i3.308 · Cited by 20
Incorporating Humanoid Artificial Intelligence (AI) Robots into Early Childhood Education
Lee, J., Jo, J., Lee, J. O., & Kim, S. H. (2024) · Early Childhood Education Journal · doi:10.1007/s10643-024-01690-0 · Cited by 21
Kim, T., & Im, I. (2024) · Information & Management · doi:10.1016/j.im.2024.104061 · Cited by 21
Machine Learning of Personal Gesture Variation in Music Conducting
Sarasúa, Á., Caramiaux, B., & Tanaka, A. (2016) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858328 · Cited by 18
Active Robot Learning for Temporal Task Models
Racca, M., & Kyrki, V. (2018) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3171221.3171241 · Cited by 18
Lu, S. (2020) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-189532 · Cited by 18
Interaction Considerations in Learning from Humans
Koppol, P., Admoni, H., & Simmons, R. G. (2021) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2021/40 · Cited by 20
Integrating Iterative Machine Teaching and Active Learning into the Machine Learning Loop
Mosqueira-Rey, E., Alonso-Ríos, D., & Baamonde-Lozano, A. (2021) · Procedia Computer Science · doi:10.1016/j.procs.2021.08.057 · Cited by 20
A Survey on Interactive Reinforcement Learning: Design Principles and Open ChallengesPreprint
Cruz, C. A., & Igarashi, T. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.12949 · Cited by 21
Human in the AI Loop via xAI and Active Learning for Visual Inspection
Rožanec, J. M., Montini, E., Cutrona, V., Papamartzivanos, D., Klemenčič, T., Fortuna, B., Mladenić, D., Veliou, E., Giannetsos, T., & Emmanouilidis, C. (2024) · Artificial Intelligence in Manufacturing · doi:10.1007/978-3-031-46452-2_22 · Cited by 17
Towards Ethical AI Moderation in Multiplayer Games
Sparrow, L. A., Galwey, R., Jovic, D., Hardwick, T., & Butt, M.-A. R. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3677109 · Cited by 17
Investigating audio data visualization for interactive sound recognition
Ishibashi, T., Nakao, Y., & Sugano, Y. (2020) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3377325.3377483 · Cited by 22
Ghai, B., Liao, Q. V., Zhang, Y., Bellamy, R., & Mueller, K. D. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.09219 · Cited by 17
Towards AI-Powered Applications: The Development of a Personalised LLM for HRI and HCI
Ghamati, K., Dehkordi, M. B., & Zaraki, A. (2025) · Sensors · doi:10.3390/s25072024 · Cited by 16
Qian, P., & Xie, X.-Z. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2526580 · Cited by 17
Transforming financial decision-making with hybrid artificial intelligence (AI)
Asemi, A., Sebrek, S. S., & Garrido, B. P. (2025) · Management Decision · doi:10.1108/md-05-2025-1403 · Cited by 19
Hughes, K. D., Konnikov, A., Denier, N., & Hu, Y. (2025) · Human relations; studies towards the integration of the social sciences · doi:10.1177/00187267251403902 · Cited by 16
Sevastjanova, R., Jentner, W., Sperrle, F., Kehlbeck, R., Bernard, J., & El‐Assady, M. (2021) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3429448 · Cited by 16
A survey on improving NLP models with human explanations
Hartmann, M., & Sonntag, D. (2022) · doi:10.18653/v1/2022.lnls-1.5 · Cited by 24
IKE - An Interactive Tool for Knowledge Extraction
Dalvi, B. B., Bhakthavatsalam, S., Clark, C., Clark, P. E., Etzioni, O., Fader, A., & Groeneveld, D. (2016) · Automated Knowledge Base Construction · doi:10.18653/v1/w16-1303 · Cited by 16
Socio-Technical Design of Hybrid Intelligence Systems – The Case of Predictive Maintenance
Herrmann, T. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-50334-5_20 · Cited by 16
TissueWand, a Rapid Histopathology Annotation Tool
Lindvall, M., Sanner, A., Petré, F., Lindman, K., Treanor, D. E., Lundstrbm, C., & Ldwgren, J. (2020) · Journal of Pathology Informatics · doi:10.4103/jpi.jpi_5_20 · Cited by 16
Diagnostic visualization for non-expert machine learning practitioners: A design study
Chen, D., Bellamy, R., Malkin, P. K., & Erickson, T. D. (2016) · IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC) · doi:10.1109/vlhcc.2016.7739669 · Cited by 16
Power to the Oracle? Design Principles for Interactive Labeling Systems in Machine Learning
Nadj, M., Knaeble, M., Li, M. X., & Maedche, A. (2020) · Künstliche Intell. · doi:10.1007/s13218-020-00634-1 · Cited by 18
Rehan, S., Al‐Bander, B., & Ahmad, A. A.-S. (2025) · Electronics · doi:10.3390/electronics14071463 · Cited by 19
Buschek, D., Eiband, M., & Hußmann, H. (2022) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3519264 · Cited by 16
Visually-guided motion planning for autonomous driving from interactive demonstrations
Pérez‐Dattari, R., Brito, B., de Groot, O., Kober, J., & Alonso–Mora, J. (2022) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2022.105277 · Cited by 17
Face Work: A Human-Centered Investigation into Facial Verification in Gig Work
Watkins, E. A. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579485 · Cited by 18
Evaluating machine-generated explanations: a “Scorecard” method for XAI measurement science
Hoffman, R. R., Jalaeian, M., Tate, C., Klein, G. A., & Mueller, S. T. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1114806 · Cited by 15
Human-AI Collaboration: Exploring interfaces for interactive Machine Learning
al., G. C. S. E. (2023) · Journal of Propulsion Technology · doi:10.52783/tjjpt.v44.i2.148 · Cited by 17
Muijlwijk, H., Willemsen, M. C., Smyth, B., & IJsselsteijn, W. A. (2024) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3640543.3645205 · Cited by 17
Kaur, H., Conrad, M. R., Rule, D., Lampe, C. A. C., & Gilbert, É. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637354 · Cited by 17
Das, D., Guha, S., Brubaker, J. R., & Semaan, B. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642669 · Cited by 27
A Survey of Semantic Parsing Techniques
Jiang, P., & Cai, X. (2024) · Symmetry · doi:10.3390/sym16091201 · Cited by 18
Effect of Interaction Design on the Human Experience with Interactive Reinforcement Learning
Krening, S., & Feigh, K. M. (2019) · Designing Interactive Systems Conference · doi:10.1145/3322276.3322379 · Cited by 15
Bernardo, F., Zbyszyński, M., Grierson, M., & Fiebrink, R. A. (2020) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2020.00013 · Cited by 19
How Fake News Affect Trust in the Output of a Machine Learning System for News Curation
Heuer, H., & Breiter, A. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-61841-4_2 · Cited by 15
How do People Train a Machine?
Sanchez, T., Caramiaux, B., Françoise, J., Bevilacqua, F. P., & Mackay, W. E. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449236 · Cited by 16
Artificial Intelligence in Organizations: Implications for Information Systems Research
Benbya, H., Pachidi, S., & Järvenpää, S. L. (2021) · Own your potential (DEAKIN) · Cited by 15
A conceptual framework for externally-influenced agents: an assisted reinforcement learning review
Bignold, A., Cruz, F., Taylor, M., Brys, T., Dazeley, R., Vamplew, P., & Foale, C. (2021) · Deakin Research Online (Deakin University) · Cited by 15
Human-in-the-Loop Machine Learning for the Treatment of Pancreatic Cancer
Mosqueira-Rey, E., Pérez-Sánchez, A., Hernández-Pereira, E., Alonso-Ríos, D., Bobes-Bascarán, J., Fernández-Leal, Á., Moret‐Bonillo, V., Vidal-Ínsua, Y., & Vázquez-Rivera, F. (2023) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191456 · Cited by 15
Making Machine-Learning Applications for Time-Series Sensor Data Graphical and Interactive
Kim, S., Tasse, D., & Dey, A. K. (2017) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2983924 · Cited by 16
Interactive dimensionality reduction using similarity projections
Spathis, D., Passalis, N., & Tefas, A. (2018) · Knowledge-Based Systems · doi:10.1016/j.knosys.2018.11.015 · Cited by 16
Vázquez-Lema, D., Mosqueira-Rey, E., Hernández-Pereira, E., Fernandez-Lozano, C., Seara-Romera, F., & Pombo-Otero, J. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-10799-7 · Cited by 14
Approach or avoidance? Relationship between perceived AI explainability and employee job crafting
Huo, W., Xie, J., Yan, J., Long, T., & Liang, B. (2025) · Acta Psychologica · doi:10.1016/j.actpsy.2025.105097 · Cited by 16
Human–AI Interaction and User Satisfaction: Empirical Evidence from Online Reviews of AI Products
Pasch, S., & Ha, S.-Y. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2545463 · Cited by 23
A Data-Driven Air Traffic Sequencing Model Based on Pairwise Preference Learning
Jung, S., Hong, S., & Lee, K. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2829863 · Cited by 14
Improving Automation Transparency: Addressing Some of Machine Learning’s Unique Challenges
Fallon, C. K., & Blaha, L. M. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-91470-1_21 · Cited by 14
Yang, M. (2020) · Journal of Intelligent & Fuzzy Systems · doi:10.3233/jifs-189562 · Cited by 14
Ergodic imitation: Learning from what to do and what not to do
Kalinowska, A., Prabhakar, A., Fitzsimons, K., & Murphey, T. D. (2021) · Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · doi:10.1109/icra48506.2021.9561746 · Cited by 14
Exploring collaborative caption editing to augment video-based learning
Bhavya, B., Chen, S., Zhang, Z., Li, W., Zhai, C., Angrave, L., & Huang, Y. (2022) · Educational Technology Research and Development · doi:10.1007/s11423-022-10137-5 · Cited by 14
Skowron, A., Jankowski, A. W., & Dutta, S. (2015) · Studies in big data · doi:10.1007/978-3-319-26989-4_3 · Cited by 14
Interactive Machine Learning via a GPU-accelerated Toolkit
Jiang, B., & Canny, J. (2017) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3025171.3025172 · Cited by 14
Visual analytics for collaborative human-machine confidence in human-centric active learning tasks
Legg, P., Smith, J., & Downing, A. (2019) · Human-centric Computing and Information Sciences · doi:10.1186/s13673-019-0167-8 · Cited by 14
Teacher-Aware Active Robot Learning
Racca, M., Oulasvirta, A., & Kyrki, V. (2019) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1109/hri.2019.8673300 · Cited by 14
A chatbot response generation system
Feine, J., Morana, S., & Maedche, A. (2020) · Mensch und Computer (MuC) · doi:10.1145/3404983.3405508 · Cited by 14
Using Data to "Git Gud": A Push for a Player-Centric approach tothe Use of Data in EsportsPreprint
Kleinman, E., & El‐Nasr, M. S. (2021) · doi:10.31219/osf.io/v3g79 · Cited by 14
Optimal Sepsis Patient Treatment using Human-in-the-loop Artificial Intelligence
Gupta, A., Lash, M. T., & Nachimuthu, S. K. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114476 · Cited by 13
The challenge of human centric AI
Lukowicz, P. (2019) · Digitale Welt · doi:10.1007/s42354-019-0200-0 · Cited by 13
Artificial Intelligence in Use by Multimodal Fusion
Blasch, E., Majumder, U., Rovito, T. V., & Raz, A. K. (2019) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion43075.2019.9011267 · Cited by 13
More Interpretable Decision Trees
Gilmore, E., Estivill‐Castro, V., & Hexel, R. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86271-8_24 · Cited by 14
Wen, L., Morrison, C. P., Grayson, M., Marques, R. F., Massiceti, D., Longden, C., & Cutrell, E. B. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3648641 · Cited by 15
Zhang, M., Pu, H., Yu, T., & Qu, S. (2024) · Chinese Management Studies · doi:10.1108/cms-09-2023-0476 · Cited by 13
Sharma, S., & Shrestha, S. (2024) · Journal of Future Artificial Intelligence and Technologies · doi:10.62411/faith.3048-3719-47 · Cited by 17
Kahr, P. K., Rooks, G., Snijders, C. C. P., & Willemsen, M. C. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713099 · Cited by 19
Learning from multi-label data with interactivity constraints: An extensive experimental study
Nair-Benrekia, N.-Y., Kuntz, P., & Meyer, F. (2015) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.03.006 · Cited by 14
Li, X., & Huan, J. (2017) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3097983.3097994 · Cited by 13
Interactive Tuning of Robot Program Parameters via Expected Divergence Maximization
Racca, M., Kyrki, V., & Çakmak, M. (2020) · ACM/IEEE International Conference on Human-Robot Interaction (HRI) · doi:10.1145/3319502.3374784 · Cited by 13
Image Captioning using Deep Learning
Aghav, J. V. (2020) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2020.6232 · Cited by 13
Preference-Driven Classification Measure
Kozák, J. T., Probierz, B., Kania, K., & Juszczuk, P. (2022) · Entropy · doi:10.3390/e24040531 · Cited by 20
Forecasting New Product Demand Using Domain Knowledge and Machine Learning
Yamamura, C. L. K., Santana, J. C. C., Masiero, B. S., Quintanilha, J. A., & Berssaneti, F. T. (2022) · Research-Technology Management · doi:10.1080/08956308.2022.2062553 · Cited by 16
Human-in-the-loop machine learning with applications for population health
Chen, L., Wang, J., Guo, B., & Chen, L. (2022) · CCF Transactions on Pervasive Computing and Interaction · doi:10.1007/s42486-022-00115-4 · Cited by 37
User Modelling for Avoiding Overfitting in Interactive Knowledge Elicitation for Prediction
Daee, P., Peltola, T., Vehtari, A., & Samuel Kaski, A. (2018) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3172944.3172989 · Cited by 14
Towards rapid interactive machine learning
Arendt, D., Saldanha, E., Wesslen, R. S., Volkova, S., & Dou, W. (2019) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3301275.3302280 · Cited by 12
DeepSI: Interactive Deep Learning for Semantic Interaction
Bian, Y., & North, C. L. (2021) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3397481.3450670 · Cited by 19
Evaluating Explanations by Cognitive Value
Chander, A., & Srinivasan, R. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-99740-7_23 · Cited by 13
Wagner, J., Baur, T., Zhang, Y., Valstar, M., Schuller, B. W., & André, E. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.02565 · Cited by 17
Algorithm, Human, or the Centaur: How to Enhance Clinical Care?Preprint
Dean, A., Orfanoudaki, A., Saghafian, S., Song, K., Chakkera, H. A., & Cook, C. B. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4302002 · Cited by 27
An Interactive Approach to Bias Mitigation in Machine Learning
Wang, H., Mukhopadhyay, S., Xiao, Y., & Fang, S. (2021) · 2021 IEEE 20th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC) · doi:10.1109/iccicc53683.2021.9811333 · Cited by 12
ML Pro: digital assistance system for interactive machine learning in production
Neunzig, C., Möllensiep, D., Kuhlenkötter, B., & Möller, M. (2023) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-023-02214-0 · Cited by 12
van Veen, L. A., van den Brand, H., van den Oever, A. C. M., Kemp, B., & Youssef, A. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.109755 · Cited by 13
Gazos, A., Kahn, J., Kusche, I., Büscher, C., & Götz, M. (2025) · Safety Science · doi:10.1016/j.ssci.2024.106731 · Cited by 12
Viswanathan, S., Ibrahim, S. B., Shankar, R., Binns, R., Kleek, M. G. V., & Slovák, P. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3714088 · Cited by 20
Metadata
- Authors
- Amershi, S., Cakmak, M., Knox, W. B., & Kulesza, T.
- Affiliations
- Microsoft (United States) (US)
- Massachusetts Institute of Technology (US)
- Oregon State University (US)
- Venue
- AI Magazine
- Publisher
- Wiley
- Published
- 2014-12
- Volume
- 35
- Issue
- 4
- Pages
- 105-120
- ISSN
- 0738-4602 (ISSN-L)
- 2371-9621
- OpenAlex
- W1501005121
- Cited by
- 1,084
- References
- 55
- Citations by year
- 2026: 139 · 2025: 127 · 2024: 106 · 2023: 101 · 2022: 111 · 2021: 172 · 2020: 111 · 2019: 83 · 2018: 63 · 2017: 33 · 2016: 22 · 2015: 14 · 2014: 2
- FWCI
- 23.60
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- AI Magazine (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
- Keywords
- interactive machine learning, human-in-the-loop learning, user modeling, user experience, human-computer interaction, learning systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
