Grounding Interactive Machine Learning Tool Design in How Non-Experts Actually Build Models
The DOI matches its Crossref record; 26 of the 28 references it cites were found in a registry or an index.
Abstract
Machine learning (ML) promises data-driven insights and solutions for people from all walks of life, but the skill of crafting these solutions is possessed by only a few. Emerging research addresses this issue by creating ML tools that are easy and accessible to people who are not formally trained in ML (non-experts). This work investigated how non-experts build ML solutions for themselves in real life. Our interviews and surveys revealed unique potentials of non-expert ML, as well several pitfalls that non-experts are susceptible to. For example, many perceived percentage accuracy as a sole measure of performance, thus problematic models proceeded to deployment. These observations suggested that, while challenging, making ML easy and robust should both be important goals of designing novice-facing ML tools. To advance on this insight, we discuss design implications and created a sensitizing concept to demonstrate how designers might guide non-experts to easily build robust solutions.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Early HCI research tells us that program-authoring interactions that do not require programming are not necessarily accessible to non-programmers; drag-and-drop and interactive machine learning (iML) tools cannot necessarily enable non-ML experts to build models [50], and prompting can be viewed as a programming or iML task.”
From Why Johnny Can’t Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts (2023) · cites this paper as [50]
In the citing paper
“In this”
From Why Johnny Can’t Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts (2023) · cites this paper as [50]
In the citing paper
“Deep learning models for natural language processing (NLP) are increasingly adopted and deployed by analysts without formal training in NLP or machine learning (ML).”
From Interactive Model Cards: A Human-Centered Approach to Model Documentation (2022) · cites this paper as [75]
Citations
Cites
The Reflective Practitioner: How Professionals Think in Action
Checkoway, B., & Schon, D. A. (1985) · Journal of Policy Analysis and Management · doi:10.2307/3324262 · Cited by 21,268
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
The reflective practitioner: How professionals think in action
Bogumil, R. J. (1985) · Proceedings of the IEEE · doi:10.1109/proc.1985.13210 · Cited by 2,323
(2015) · neural information processing systems · Cited by 1,305
Power to the People: The Role of Humans in Interactive Machine Learning
Amershi, S., Cakmak, M., Knox, W. B., & Kulesza, T. (2014) · AI Magazine · doi:10.1609/aimag.v35i4.2513 · Cited by 1,084
Beyer, H. R., & Holtzblatt, K. (1997) · Cited by 704
Fails, J. A., & Olsen, D. R. (2003) · Proceedings of the 8th international conference on Intelligent user interfaces · doi:10.1145/604045.604056 · Cited by 633
Principles of Explanatory Debugging to Personalize Interactive Machine Learning
Kulesza, T., Burnett, M., Wong, W.-K., & Stumpf, S. (2015) · Proceedings of the 20th International Conference on Intelligent User Interfaces · doi:10.1145/2678025.2701399 · Cited by 576
An analysis and critique of Research through Design: towards a formalization of a research approach
Zimmerman, J., Stolterman, E., & Forlizzi, J. (2010) · Proceedings of the 8th ACM Conference on Designing Interactive Systems · doi:10.1145/1858171.1858228 · Cited by 491
Test-driven development concepts, taxonomy, and future direction
Janzen, D., & Saiedian, H. (2005) · Computer · doi:10.1109/mc.2005.314 · Cited by 445
Research works printed but not linked: 5
- Bonsai. 2017 . BONSAI WHITEPAPER: A fundamentally different approach for building intelligent industrial systems. Technical Report. https://bons.ai/resources. Bonsai. 2017. BONSAI WHITEPAPER: A fundamentally different approach for building intelligent industrial systems. Technical Report. https://bons.ai/resources.
- Justin Bozonier . 2015. Test-Driven Machine Learning . Packt Publishing Ltd . Justin Bozonier. 2015. Test-Driven Machine Learning. Packt Publishing Ltd.
- TensorFlow : Smarter machine learning, for everyone 2016 . (2016). https://www.google.com/intl/en/about/main/tensorflow/. TensorFlow: Smarter machine learning, for everyone 2016. (2016). https://www.google.com/intl/en/about/main/tensorflow/.
- Udemy Online Course : Applied machine learning for Everyone 2017 . (2017). https://www.udemy.com/ applied-machine-learning-for-everyone/. Udemy Online Course: Applied machine learning for Everyone 2017. (2017). https://www.udemy.com/ applied-machine-learning-for-everyone/.
- 10.5555/2888116.2888288 · doi:10.5555/2888116.2888288
Cited by
Items 101–188 of 188
Yang, Q. (2021) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3411763.3457783 · Cited by 10
Self-citationZamfirescu-Pereira, J. D., Hartmann, B., & Yang, Q. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2302.03154 · Cited by 10
Self-citationRaees, M., Khan, V.-J., & Papangelis, K. (2025) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3699682.3728320 · Cited by 9
QUESTO: Interactive Construction of Objective Functions for Classification Tasks
Das, S., Xu, S., Gleicher, M. L., Chang, R., & Endert, A. (2020) · Computer Graphics Forum · doi:10.1111/cgf.13970 · Cited by 9
Who's the Leader? Analyzing Novice Workflows in LLM-Assisted Debugging of Machine Learning CodePreprint
Bo, J. Y., Kazemitabaar, M., Zhuang, E., & Anderson, A. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.08063 · Cited by 9
Peek into the `White-Box': A Field Study on Bystander Engagement with Urban Robot Uncertainty
Yu, X., Hoggenmüeller, M., Tran, T. T. M., Wang, Y., Zhang, Q., & Tomitsch, M. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713790 · Cited by 8
Establishing Heuristics for Improving the Usability of GUI Machine Learning Tools for Novice Users
Yamani, A. Z., Al‐Shammare, H., & Baslyman, M. (2024) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642087 · Cited by 8
Bilstrup, K.-E. K., Kaspersen, M. H., Bouvin, N. O., & Petersen, M. G. (2025) · Designing Interactive Systems Conference · doi:10.1145/3715336.3735737 · Cited by 8
Exploring Machine Teaching for Object Recognition with the Crowd
Hong, J., Lee, K., Xu, J., & Kacorri, H. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3312873 · Cited by 8
Tool Support for Improving Software Quality in Machine Learning Programs
Cheng, K. S., Huang, P.-C., Ahn, T.-H., & Song, M. (2023) · Information · doi:10.3390/info14010053 · Cited by 8
Burlin, C. (2023) · DiVA (Luleå University of Technology) · Cited by 8
The Idealized Machine Learning Pipeline (IMLP) for Advancing Reproducibility in Machine Learning
Zheng, Y., & Stodden, V. (2024) · ACM Conference on Reproducibility and Replicability (ACM REP) · doi:10.1145/3641525.3663630 · Cited by 7
ML Tools for the Web: A Way for Rapid Prototyping and HCI Research
Li, N., Mayes, J., & Yu, P. (2021) · Human-computer interaction series · doi:10.1007/978-3-030-82681-9_10 · Cited by 7
Wang, C., & An, P. (2021) · Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play · doi:10.1145/3450337.3483487 · Cited by 6
“Increasingly, researchers point out the necessity of supporting non-experts to practically understand AI models[6][5].”
Background“What are they not telling me?” Learning machine learning: Understanding the challenges for novices
Cinca, R., Costanza, E., Musolesi, M., & Alebri, M. (2024) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2024.103438 · Cited by 6
Simson, J., Draxler, F., Mehr, S. A., & Kern, C. A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713482 · Cited by 6
Preparing Teachers for a ChatGPT-Influenced Workforce
Helvacı, İ. (2025) · Kastamonu Eğitim Dergisi · doi:10.24106/kefdergi.1683517 · Cited by 7
Zhu, Q., Wang, D., Ma, S., Wang, A. Y., Chen, Z., Khurana, U., & Ma, X. (2024) · Designing Interactive Systems Conference · doi:10.1145/3643834.3661517 · Cited by 7
Zhou, Z., Li, Z., Li, W., Fan, Y., & You, W. (2023) · International Association of Societies of Design Research Congress (IASDR) · doi:10.21606/iasdr.2023.168 · Cited by 6
Towards Evaluating Exploratory Model Building Process with AutoML SystemsPreprint
Hong, S.-S., Castelo, S., D'Orazio, V. J., Benthune, C., Santos, A. S. R., Langevin, S., Jonker, D., Bertini, E., & Freire, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.00449 · Cited by 6
Nahar, N., Zhou, S., Lewis, G. A., & Kästner, C. (2021) · arXiv (Cornell University) · Cited by 6
Practitioners and Bias in Machine Learning: A Study
Cinca, R., Costanza, E., & Musolesi, M. (2025) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3733838 · Cited by 5
Milana, F., Costanza, E., Musolesi, M., & Ayobi, A. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3711095 · Cited by 6
Non-expert AI Users Building Machine Learning Models: A Short Survey of AutoML SystemsPreprint
Palazuelos, C., Duque, R., Tîrnȃucȃ, C., Pérez, A., & Casas, A. (2024) · doi:10.36227/techrxiv.170619255.52099254/v1 · Cited by 5
Kaufman, Z., Endres, M., Xiong, C., & Brun, Y. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2025.3634245 · Cited by 4
AI Opportunity Cards: Developing a Toolkit for AI as a Design Material
Lee, K. S., Choi, M., & Asni, E. Y. (2025) · International Conference on Information Technology for Social Good (GoodIT) · doi:10.1145/3748699.3749817 · Cited by 4
A Blockchain-Based Approach for Model Card Accountability and Regulatory Compliance
Lohachab, A., & Urovi, V. (2024) · Lecture notes in business information processing · doi:10.1007/978-3-031-61003-5_4 · Cited by 4
Kim, Y., Lee, K., & Oh, U. (2020) · International journal of advanced smart convergence · doi:10.7236/ijasc.2020.9.2.90 · Cited by 4
Eliciting Model Steering Interactions From Users via Data and Visual Design Probes
Crisan, A., Shang, M., & Brochu, E. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3322898 · Cited by 4
Designing for the Long Tail of Machine LearningPreprint
Lindvall, M., & Molin, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.07455 · Cited by 4
A Game-Based Approach for Helping Designers Learn Machine Learning ConceptsPreprint
Myers, C. M., Xie, J., & Zhu, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.05605 · Cited by 4
Design Methods and Processes for ML/DL models
John, M. M. (2021) · doi:10.24834/isbn.9789178771998 · Cited by 4
Poulter, C., Wang, C., & Gayo, I. D. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-21707-4_35 · Cited by 3
Kowlagi, N., Kemppainen, A., McSweeney, T. P., Saarakkala, S. S., Noailly, J., Williams, F. M. K., Cheung, J. P. Y., Karppinen, J. I., & Tiulpin, A. (2025) · Spine · doi:10.1097/brs.0000000000005462 · Cited by 3
Gesture Me: A Machine Learning Tool for Designers to Train Gesture Classifiers
Winter, M., Jackson, P., & Fallahkhair, S. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-49425-3_21 · Cited by 3
Interactive Online Machine Learning
Tegen, A. (2022) · doi:10.24834/isbn.9789178772810 · Cited by 3
DuetML: Human-LLM Collaborative Machine Learning Framework for Non-Expert UsersPreprint
Kawabe, W., & Sugano, Y. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2411.18908 · Cited by 3
What impacts endure: A technologist’s notes on GPT’s impact on expert work.
Yang, Q. (2024) · Journal of Applied Research in Memory and Cognition · doi:10.1037/mac0000210 · Cited by 2
Self-citationUpreti, D., Maheshwari, A., Tabb, T., Polykretis, I., Gallo, E. M., Stewart, K. M., LaToza, T. D., & Danielescu, A. (2025) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713249 · Cited by 2
Twitch Third-Party Developers’ Support Seeking and Provision Practices on Discord
Cai, J., Zhang, H., Liu, Y., Carroll, J. M., & Yu, C. (2026) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3817021 · Cited by 2
Debugging Support for Machine Learning Applications in Bioengineering Text Corpora
Cheng, K. S., Ahn, T.-H., & Song, M. (2022) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac54236.2022.00166 · Cited by 2
Human-centred design on crowdsourcing annotation towards improving active learning model performance
Dong, J., Kang, Y., Liu, J., Sun, C., Ma, S. F., Jin, H., Wu, D., Jiang, Z., Niu, X., & Liu, X. (2023) · Journal of Information Science · doi:10.1177/01655515231204802 · Cited by 2
Using Visual Analytics to Support Artificial Intelligence Development
Chen, N.-C. (2019) · ResearchWorks at the University of Washington (University of Washington) · Cited by 2
Self-citation"It Was a Magical Box": Understanding Practitioner Workflows and Needs in OptimizationPreprint
Lawless, C., Schoeffer, J., & Udell, M. R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2509.16402 · Cited by 2
The Rise of Data and Ethics: HR Tech Controversies that Will Shape the Future of Work in 2025
Westover, J. (2024) · Human capital leadership. · doi:10.70175/hclreview.2020.14.3.12 · Cited by 1
ElSaid, A. A., Shi, Y., Mkaouer, M. W., Altalouli, M., & Tawfik, A. (2025) · Journal of Information Systems Education · doi:10.62273/qtwe9132 · Cited by 1
Kawabe, W., Fukuda, H., Shitara, A., Nakao, Y., & Sugano, Y. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2619622 · Cited by 1
Tech-savviness: Predicting and measuring learning ability of novel digital platforms
DeCouto, B. S., Treacy, A., McCurdy, Z., Patterson, C. B., Johnson, M., Neubauer, C., Pollard, K., & Perera, I. (2026) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2026.101140 · Cited by 1
Integrating Machine Learning into the UX Design Process
Ahmed, T. (2018) · Maryland Shared Open Access Repository (USMAI Consortium) · doi:10.13016/m2p0ew-6tnl · Cited by 1
Riedel, N., Angeli, A., & Marfia, G. (2019) · EAI International Conference on Smart Objects and Technologies for Social Good (GOODTECHS) · doi:10.1145/3342428.3342671 · Cited by 1
Methods of Co-design Using Machine Learning as Design Materials
Zhao, Y., Tan, H., Gao, W., & Zhang, C. (2021) · Lecture notes in networks and systems · doi:10.1007/978-3-030-79760-7_117 · Cited by 1
Interactive Reinforcement Learning for Autonomous Behavior Design
Cruz, C. A., & Igarashi, T. (2021) · Human-computer interaction series · doi:10.1007/978-3-030-82681-9_11 · Cited by 1
MLTK01: A Prototyping Toolkit for Tangible Learning Things
Lupetti, M. L., & Romagnoli, L. (2022) · [ ] With Design: Reinventing Design Modes · doi:10.1007/978-981-19-4472-7_57 · Cited by 1
Shirazi, M., Safronov, G., & Rizk, A. (2023) · International Conference on Machine Learning and Applications · doi:10.1109/icmla58977.2023.00284 · Cited by 1
Granting Non-AI Experts Creative Control Over AI Systems
Lam, M. S. (2024) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3672539.3686714 · Cited by 1
Mostafa, G. (2018) · Aaltodoc (Aalto University) · Cited by 1
Sathiyanarayanan, M. (2020) · City Research Online (City University London) · Cited by 1
Towards Tool-Support for Interactive-Machine Learning Applications in the Android EcosystemPreprint
Sunny, M. M., Berghofer, M., & Aslan, I. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.14852 · Cited by 1
Smith, M. J., Cito, J., & Veeramachaneni, K. K. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.15787 · Cited by 1
Machine Learning Engineering: An Exploratory Study of Challenges and Practices
Hamidi, A. (2021) · PolyPublie (École Polytechnique de Montréal) · Cited by 1
Eliciting Model Steering Interactions from Users via Data and Visual Design ProbesPreprint
Crisan, A., Shang, M., & Brochu, E. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2310.09314 · Cited by 1
Stadler, P., Lazik, C. K., Katins, C., & Kosch, T. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2506.23694 · Cited by 1
Strategies for Generalisable Machine Learning with Small Data for Exercise Fatigue Detection
Jeworutzki, A. (2025) · REPOSIT (Hamburg University of Applied Sciences (HAW Hamburg)) · doi:10.48441/4427.2383 · Cited by 1
Kleinman, E. (2023) · eScholarship (California Digital Library) · Cited by 1
Crowd ideation of supervised learning problems.Preprint
Bagrow, J. P. (2018) · arXiv (Cornell University)
Better Accessibility Research for the Future (Keynote)
Harper, S. (2019) · International Web for All Conference (W4A) · doi:10.1145/3315002.3332430
Using off-the-shelf data-human interface platforms: traps and tricks
Angeli, A., Marfia, G., & Riedel, N. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-08929-z
Peer Review #2 of "Democratizing AI: non-expert design of prediction tasks (v0.1)"
(2020) · PeerJ Computer Science · doi:10.7287/peerj-cs.296v0.1/reviews/2
Peer Review #3 of "Democratizing AI: non-expert design of prediction tasks (v0.2)"
(2020) · PeerJ Computer Science · doi:10.7287/peerj-cs.296v0.2/reviews/3
CACTUS: Detecting and Resolving Conflicts in Objective FunctionsPreprint
Das, S., & Endert, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.07805
Peer Review #1 of "Democratizing AI: non-expert design of prediction tasks (v0.3)"
(2020) · PeerJ Computer Science · doi:10.7287/peerj-cs.296v0.3/reviews/1
Peer Review #1 of "Democratizing AI: non-expert design of prediction tasks (v0.2)"
(2020) · PeerJ Computer Science · doi:10.7287/peerj-cs.296v0.2/reviews/1
Peer Review #1 of "Democratizing AI: non-expert design of prediction tasks (v0.1)"
(2020) · PeerJ Computer Science · doi:10.7287/peerj-cs.296v0.1/reviews/1
Using Facebook as a Digital Platform During the Covid 19 Pandemic to Support Online Learning
Cahyati, S. S., Wang, Y. Y., & Zou, G. (2024) · International Journal of Educational Narratives · doi:10.70177/ijen.v2i3.1075
Towards continuous development of MLOps practices
John, M. M. (2024) · doi:10.24834/isbn.9789178775637
Towards more Credible Agent-Based Models for Policy Support
Johansson, E. (2025) · doi:10.24834/isbn.9789178775750
Effective Human–AI Collaborative Intelligence
Jiang, Z., & Liu, X. (2025) · Cambridge University Press eBooks · doi:10.1017/9781009587877.009
WilsonIA: Rule Based Framework for Supporting Non-expert Creating Machine Learning Models
Monteagudo, L. I. P., Lorenzo, M. M. G., & Morell, C. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-08203-9_17
Sahidon, M. A. D. (2025) · Nottingham ePrints (University of Nottingham)
Who Leads? Comparing Human-Centric and Model-Centric Strategies for Defining ML Target VariablesPreprint
Guo, M., Gotz, D., & Wang, Y. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2510.25974
Facilitating Human-Machine Teaming in Machine Learning Problem Formulation
Guo, M. (2025) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/f81p-1318
Starkova, V., & Howley, I. K. (2026) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3742413.3789153
Marx, E., Leonhardt, T., & Bergner, N. (2026) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v40i47.41511
CogInstrument: Modeling Cognitive Processes for Bidirectional Human-LLM Alignment in Planning TasksPreprint
Wang, A., Pan, D., Tong, X., & Hui, P. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2604.10587
RuleEdit: Failure-Guided Human-AI Model Editing with Prospective Impact PreviewPreprint
Lee, M. H., & Teo, J. Y. F. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.00011
Guo, M., Gotz, D., & Wang, Y. (2026) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3805689.3806512
Mapping Undergraduates’ Explanations of Data-Model Relationships in Open-Ended Projects
Delaney, V., Jabrael, N., Paras, F., Gonsalves, G. S., & Beiruty, S. (2026) · ACM Conference on International Computing Education Research (ICER) · doi:10.1145/3765965.3816666
Wang, L., Huang, Q., Wang, K., LOU, J., & Yuan, C. (2026) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2026.2728615
Metadata
- Authors
- Yang, Q., Suh, J., Chen, N.-C., & Ramos, G.
- Affiliations
- Carnegie Mellon University (US)
- Microsoft (United States) (US)
- University of Washington (US)
- Venue
- Proceedings of the 2018 Designing Interactive Systems Conference
- Publisher
- ACM
- Published
- 2018-06-08
- Pages
- 573-584
- OpenAlex
- W2807910285
- Semantic Scholar
- 8d4b89081ba250f2e35585af1c5eb8d764b11ab9
- Cited by
- 156
- References
- 28
- Citations by year
- 2026: 7 · 2025: 23 · 2024: 16 · 2023: 21 · 2022: 17 · 2021: 31 · 2020: 24 · 2019: 15 · 2018: 2
- FWCI
- 12.20
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- Designing Interactive Systems Conference (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Spreadsheets and End-User Computing
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Data Visualization and Analytics
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Keywords
- interactive machine learning, model robustness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.