A Human-AI Collaborative Approach for Clinical Decision Making on Rehabilitation Assessment
Open accessThe DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Abstract
Advances in artificial intelligence (AI) have made it increasingly applicable to supplement expert’s decision-making in the form of a decision support system on various tasks. For instance, an AI-based system can provide therapists quantitative analysis on patient’s status to improve practices of rehabilitation assessment. However, there is limited knowledge on the potential of these systems. In this paper, we present the development and evaluation of an interactive AI-based system that supports collaborative decision making with therapists for rehabilitation assessment. This system automatically identifies salient features of assessment to generate patient-specific analysis for therapists, and tunes with their feedback. In two evaluations with therapists, we found that our system supports therapists significantly higher agreement on assessment (0.71 average F1-score) than a traditional system without analysis (0.66 average F1-score, p < 0.05). After tuning with therapist’s feedback, our system significantly improves its performance from 0.8377 to 0.9116 average F1-scores (p < 0.01). This work discusses the potential of a human-AI collaborative system to support more accurate decision making while learning from each other’s strengths.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source doesn’t support the claim as written.
In the citing paper
“researchers have explored the feasibility of human-AI collaborative decision-making, in which an AI model provides humans new data-driven insights on a task for achieving complementary performance, outperforming neither of the AI or the human alone [5, 30, 42, 43].”
From Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making (2023) · cites this paper as [42]
Checked by a reasoning model — may be wrong.
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“In particular, humans can review AI explanations to understand how the AI models generate outputs [61] and identify whether an AI output is right or not [14, 42].”
From Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making (2023) · cites this paper as [42]
The cited source says what the claim attributes to it.
In the citing paper
“Many researchers have discussed that the explainability [61] of a system is critical for humanAI collaborative decision-making [14, 42].”
From Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making (2023) · cites this paper as [42]
The cited source says what the claim attributes to it.
In the citing paper
“researchers have discussed the importance of an AI explanation to communicate an AI output to a user [5, 20, 29] and realize human-AI collaboration [48] for a decision-making task [15, 42].”
From Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making (2023) · cites this paper as [42]
The cited source says what the claim attributes to it.
In the citing paper
“AI explanations have been considered as an important communication medium to realize effective human-AI collaborative decision-making tasks [37, 42].”
From Understanding the Effect of Counterfactual Explanations on Trust and Reliance on AI for Human-AI Collaborative Clinical Decision Making (2023) · cites this paper as [42]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
(2017) · Cited by 11,625
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Parkinson's disease: clinical features and diagnosis
Jankovic, J. (2008) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.2007.131045 · Cited by 5,720
Multimodal Machine Learning: A Survey and Taxonomy
Baltrusaitis, T., Ahuja, C., & Morency, L.-P. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2798607 · Cited by 5,018
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
Guidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 5×
“To follow this practice, “social norms” [2], the interface includes comparison between the affected and unaffected side of a patient to present salient features and trajectory trends of three major joints (e.g. shoulder, elbow, and wrist) for upper-limb exercises [35].”
BackgroundMethodInfluentialFeigin, V. L., Norrving, B., & Mensah, G. A. (2017) · Circulation Research · doi:10.1161/circresaha.116.308413 · Cited by 2,184
Techniques for Interpretable Machine Learning
Du, M., Liu, N., & Hu, X. (2018) · arXiv · doi:10.48550/arxiv.1808.00033 · Cited by 1,261
Effect of Clinical Decision-Support Systems: A Systematic Review
Bright, T. J., Wong, A., Dhurjati, R., Bristow, E., Bastian, L., Coeytaux, R. R., Samsa, G., Hasselblad, V., Williams, J. W., Musty, M. D., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-1-201207030-00450 · Cited by 1,200
Power to the People: The Role of Humans in Interactive Machine Learning
Amershi, S., Cakmak, M., Knox, W. B., & Kulesza, T. (2014) · AI Magazine · doi:10.1609/aimag.v35i4.2513 · Cited by 1,084
Unintended consequences of machine learning in medicine
Cabitza, F., Rasoini, R., & Gensini, G. F. (2017) · JAMA · doi:10.1001/jama.2017.7797 · Cited by 1,066
Human-computer collaboration for skin cancer recognition
Tschandl, P., Rinner, C., Apalla, Z., Argenziano, G., Codella, N., Halpern, A., Janda, M., Lallas, A., Longo, C., Malvehy, J., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0942-0 · Cited by 1,024
Interactive machine learning for health informatics: when do we need the human-in-the-loop?
Holzinger, A. (2016) · Brain Informatics · doi:10.1007/s40708-016-0042-6 · Cited by 906
Mittelstadt, B., Russell, C., & Wachter, S. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287574 · Cited by 794 · cited 2×
“Explainability [8, 15, 16, 40] and interactive machine learning [1, 11, 32, 37] have been actively explored by researchers to create a better machine learning model with improved transparency and user acceptance.”
BackgroundShneiderman, B. (2020) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/3419764 · Cited by 768
Movement Smoothness Changes during Stroke Recovery
Rohrer, B., Fasoli, S., Krebs, H. I., Hughes, R., Volpe, B., Frontera, W. R., Stein, J., & Hogan, N. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-18-08297.2002 · Cited by 767
How Much Information?: Effects of Transparency on Trust in an Algorithmic Interface
Kizilcec, R. F. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858402 · Cited by 615
Beede, E., Baylor, E., Hersch, F., Iurchenko, A., Wilcox, L., Ruamviboonsuk, P., & Vardoulakis, L. M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376718 · Cited by 614 · cited 6×
“…as promising ways that can provide medical practitioners computational information on the status of a patient to improve their decision making on various disciplines (e.g. cancer diagnosis [11, 44], detection of diabetic retinopathy [7], or assessment of rehabilitation therapy [35, 60, 62]).”
BackgroundMethodResultInfluentialCai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359206 · Cited by 594 · cited 10×
“There is still limited knowledge on human-AI collaborations, where both AI-based systems and clinicians collaborate and complement each other on a task [12, 37].”
BackgroundMethodResultInfluentialPrinciples of Explanatory Debugging to Personalize Interactive Machine Learning
Kulesza, T., Burnett, M., Wong, W.-K., & Stumpf, S. (2015) · Proceedings of the 20th International Conference on Intelligent User Interfaces · doi:10.1145/2678025.2701399 · Cited by 576
Krause, J., Gulshan, V., Rahimy, E., Karth, P., Widner, K., Corrado, G. S., Peng, L., & Webster, D. R. (2018) · Ophthalmology · doi:10.1016/j.ophtha.2018.01.034 · Cited by 564
Treatment Techniques and Clinical Guidelines for Photocoagulation of Diabetic Macular Edema
(1987) · Ophthalmology · doi:10.1016/s0161-6420(87)33527-4 · Cited by 544
Ensembles of Deep LSTM Learners for Activity Recognition using Wearables
Guan, Y., & Plötz, T. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3090076 · Cited by 511 · cited 1×
“In contrast to most related work of rehabilitation monitoring systems that focuses on improving the performance of monitoring and understanding an activity with a complex deep learning model [19, 34, 46, 49], our work highlights the importance of creating a human-centered, interactive approach”
BackgroundClinical applications of machine learning algorithms: beyond the black box
Watson, D. S., Krutzinna, J., Bruce, I. N., Griffiths, C. E., McInnes, I. B., Barnes, M. R., & Floridi, L. (2019) · BMJ · doi:10.1136/bmj.l886 · Cited by 450
Sullivan, K. J., Tilson, J. K., Cen, S. Y., Rose, D. K., Hershberg, J., Correa, A., Gallichio, J., McLeod, M., Moore, C., Wu, S. S., et al. (2011) · Stroke · doi:10.1161/strokeaha.110.592766 · Cited by 445
Systematic review of Kinect applications in elderly care and stroke rehabilitation
Webster, D., & Celik, O. (2014) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-11-108 · Cited by 436 · cited 7×
“To address this challenge, researchers explored the feasibility of technology-assisted systems for rehabilitation [35, 62].”
BackgroundInfluentialHuman-Centered Tools for Coping with Imperfect Algorithms During Medical Decision-Making
Cai, C. J., Reif, E., Hegde, N., Hipp, J., Kim, B., Smilkov, D., Wattenberg, M., Viegas, F., Corrado, G. S., Stumpe, M. C., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300234 · Cited by 405
Baig, M. M., GholamHosseini, H., Moqeem, A. A., Mirza, F., & Lindén, M. (2017) · Journal of Medical Systems · doi:10.1007/s10916-017-0760-1 · Cited by 351
Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AI
Wang, D., Weisz, J. D., Muller, M., Ram, P., Geyer, W., Dugan, C., Tausczik, Y., Samulowitz, H., & Gray, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359313 · Cited by 342 · cited 1×
“Instead, the need of involving a human to interact with AI systems has received increasing attention [1, 11, 12, 37, 59].”
BackgroundReasons For Physicians Not Adopting Clinical Decision Support Systems: Critical Analysis
Khairat, S., Marc, D., Crosby, W., & Al Sanousi, A. (2018) · JMIR Medical Informatics · doi:10.2196/medinform.8912 · Cited by 335
Yang, Q., Steinfeld, A., & Zimmerman, J. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300468 · Cited by 247 · cited 2×
“conducted a field evaluation on the design of a decision support tool for cardiologists with synthetic data, and found that clinicians are more likely to embrace a tool that augments their decision making in natural and intuitive ways [64].”
BackgroundLo Piano, S. (2020) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-0501-9 · Cited by 229 · cited 1×
“However, deploying fully autonomous AI systems remains disruptive, dangerous, and unethical in high-stake contexts [50].”
BackgroundClinical Decision Support Systems
(2016) · Health Informatics · doi:10.1007/978-3-319-31913-1 · Cited by 196
Wu, C.-Y., Trombly, C. A., Lin, K.-C., & Tickle-Degnen, L. (2000) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/s0003-9993(00)90228-4 · Cited by 188
Autonomous vehicles: No drivers required
Waldrop, M. M. (2015) · Nature · doi:10.1038/518020a · Cited by 176
Panwar, M., Biswas, D., Bajaj, H., Jobges, M., Turk, R., Maharatna, K., & Acharyya, A. (2019) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2899927 · Cited by 158 · cited 4×
“However, substantial prior work on technology-assisted systems for rehabilitation focuses on demonstrating the feasibility of collecting objective kinematic variables to quantify the performance of rehabilitation exercises [43, 62] and improving the performance of a machine learning model to assess the quality of moti…”
BackgroundMethodInfluentialBarnett, M. L., Boddupalli, D., Nundy, S., & Bates, D. W. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.0096 · Cited by 154 · cited 2×
“In most medical disciplines, experts can be biased in their decision making based on their own experiences and expert disagreement is prevalent [5, 30, 31], even if they rely on standardized guidelines [18, 23, 53].”
BackgroundPeng (2018) · doi:10.1145/3214277 · Cited by 134
Interactive optimization for steering machine classification
Kapoor, A., Lee, B., Tan, D., & Horvitz, E. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753529 · Cited by 133
Algorithms in the Criminal Justice System: Assessing the Use of Risk Assessments in Sentencing
Kehl, D. L., & Kessler, S. A. (2017) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 132
Mind the Gap: a generative approach to interpretable feature selection and extraction
Kim, B., Shah, J., & Doshi‐Velez, F. (2015) · neural information processing systems · Cited by 122
Clinical Applications of Machine Learning Algorithms: Beyond the Black BoxPreprint
Watson, D., Krutzinna, J. I., Bruce, I. N., Griffiths, C. E. M., McInnes, I. B., Barnes, M. R., & Floridi, L. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3352454 · Cited by 95
Machine Learning for Health Informatics: State-of-the-Art and Future Challenges
(2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-50478-0 · Cited by 94
Rehabilitation practice: challenges to effective team working
Long, A. F., Kneafsey, R., & Ryan, J. (2003) · International Journal of Nursing Studies · doi:10.1016/s0020-7489(03)00015-4 · Cited by 78
Why-oriented end-user debugging of naive Bayes text classification
Kulesza, T., Stumpf, S., Wong, W.-K., Burnett, M. M., Perona, S., Ko, A. J., & Oberst, I. (2011) · ACM Transactions on Interactive Intelligent Systems · doi:10.1145/2030365.2030367 · Cited by 71
Learning to assess the quality of stroke rehabilitation exercises
Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Badia, S. B. I. (2019) · Proceedings of the 24th International Conference on Intelligent User Interfaces · doi:10.1145/3301275.3302273 · Cited by 71 · cited 10×
“…of rehabilitation monitoring systems that focuses on improving the performance of monitoring and understanding an activity with a complex deep learning model [19, 34, 46, 49], our work highlights the importance of creating a human-centered, interactive approach for better deployment in practice.”
BackgroundMethodInfluentialSelf-citationChallenges in Applying Best Evidence to Physiotherapy
Jones, M. A., Grimmer, K. A., Edwards, I., Higgs, J., & Trede, F. (2006) · Internet Journal of Allied Health Sciences and Practice · doi:10.46743/1540-580x/2006.1117 · Cited by 70
Yang, Q., Steinfeld, A. M., & Zimmerman, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.09612 · Cited by 68
Impact of Dysphagia Severity on Clinical Decision Making via Telerehabilitation
Ward, E. C., Burns, C. L., Theodoros, D., & Russell, T. G. (2014) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2013.0198 · Cited by 67
Disagreement in Patient and Carer Assessment of Functional Abilities After Stroke
Knapp, P., & Hewison, J. (1999) · Stroke · doi:10.1161/01.str.30.5.934 · Cited by 59
Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Bermúdez i Badia, S. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415227 · Cited by 57 · cited 10×
“…as promising ways that can provide medical practitioners computational information on the status of a patient to improve their decision making on various disciplines (e.g. cancer diagnosis [11, 44], detection of diabetic retinopathy [7], or assessment of rehabilitation therapy [35, 60, 62]).”
BackgroundMethodInfluentialSelf-citationEmbracing Ambiguity: Facing the Challenge of Measurement
Coster, W. J. (2008) · American Journal of Occupational Therapy · doi:10.5014/ajot.62.6.743 · Cited by 52
Clinical decision support systems for addressing information needs of physicians.
Denekamp, Y. (2007) · PubMed · Cited by 49
Developing and testing a telerehabilitation system for people following stroke: issues of usability
Mountain, G., Wilson, S., Eccleston, C., Mawson, S., Hammerton, J., Ware, T., Zheng, H., Davies, R., Black, N., Harris, N., et al. (2010) · Journal of Engineering Design · doi:10.1080/09544820903333792 · Cited by 48
Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Bermúdez i Badia, S. (2020) · Proceedings of the ACM Conference on Health, Inference, and Learning · doi:10.1145/3368555.3384452 · Cited by 35
Self-citationAn Exploratory Study on Techniques for Quantitative Assessment of Stroke Rehabilitation Exercises
Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A. J. M., & Badia, S. B. I. (2020) · ACM Conference on User Modeling, Adaptation and Personalization (UMAP) · doi:10.1145/3340631.3394872 · Cited by 25
Self-citation(2012) · Springer eBooks · doi:10.1007/springerreference_178793 · Cited by 11
Terra, S. M. (2006) · Internet Journal of Allied Health Sciences and Practice · doi:10.46743/1540-580x/2006.1128 · Cited by 3
Research works printed but not linked: 6
- 6. Mark T Bayley, Amanda Hurdowar, Carol L Richards, Nicol Korner-Bitensky, Sharon Wood-Dauphinee, Janice J Eng, Marilyn McKay-Lyons, Edward Harrison, Robert Teasell, Margaret Harrison, et al. 2012. Barriers to implementation of stroke rehabilitation evidence: findings from a multi-site pilot project. Disability and rehabilitation 34, 19 (2012), 1633-1638.
- 8. Or Biran and Courtenay Cotton. 2017. Explanation and justification in machine learning: A survey. In IJCAI-17 workshop on explainable AI (XAI), Vol. 8. 1.
- 20. Isabelle Guyon, Jason Weston, Stephen Barnhill, and Vladimir Vapnik. 2002. Gene selection for cancer classification using support vector machines. Machine learning 46, 1-3 (2002), 389-422.
- 43. Margit Alt Murphy, Carin Willén, and Katharina S Sunnerhagen. 2011. Kinematic variables quantifying upper-extremity performance after stroke during reaching and drinking from a glass. Neurorehabilitation and neural repair 25, 1 (2011), 71-80.
- 54. Jiliang Tang, Salem Alelyani, and Huan Liu. 2014. Feature selection for classifica- tion: A review. Data classification: Algorithms and applications (2014), 37.
- 55. Eric J Topol. 2019. High-performance medicine: the convergence of human and artificial intelligence. Nature medicine 25, 1 (2019), 44-56.
Cited by
When combinations of humans and AI are useful: A systematic review and meta-analysis
Vaccaro, M., Almaatouq, A., & Malone, T. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02024-1 · Cited by 570
Chen, J., Yi, C., Okegbile, S. D., Cai, J., & Shen, X. (2024) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2023.3308717 · Cited by 254
What is Human-Centered about Human-Centered AI? A Map of the Research Landscape
Capel, T., & Brereton, M. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580959 · Cited by 228
“Medical and health research included medical imaging and diagnosis [26, 51, 95, 117, 134, 291], clinical assessment of Multiple Sclerosis [196], care within intensive care units [148], post-operative behavior [206], assessing cognitive health [321], identifying depression through social media [239], emotion recognitio…”
BackgroundMethodGomez, C., Cho, S. M., Ke, S., Huang, C.-M., & Unberath, M. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2024.1521066 · Cited by 209
Lai, V., Chen, C., Smith-Renner, A., Liao, Q. V., & Tan, C. (2023) · 2023 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3593013.3594087 · Cited by 204
“Sample size (per condition) less than equals to 10 [17, 67], less than equals to 50 [5, 9, 13, 34, 35, 46, 55, 56, 58, 70, 87], less than equals to 100 [41, 61, 62], less than equals to 1000 [18, 29].”
BackgroundInfluential
Metadata
- Authors
- Lee, M. H., Siewiorek, D. P., Smailagic, A., Bernardino, A., & Bermúdez i Badia, S. B.
- Affiliations
- Carnegie Mellon University (US)
- University of Lisbon (PT)
- Universidade da Madeira / Madeira-ITI, NOVA-LINCS, Portugal
- Venue
- Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2021-05-06
- Pages
- 1-14
- OpenAlex
- W3161926791
- Cited by
- 137
- References
- 62
- Citations by year
- 2026: 14 · 2025: 47 · 2024: 29 · 2023: 31 · 2022: 15 · 2021: 1
- FWCI
- 17.03
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Singapore Management University Institutional Knowledge (InK) (Singapore Management University) (submittedVersion, other-oa)
- Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, cc-by)
- Funders
- ERDF through the LISBOA 2020 and the FCT (LISBOA-01-0247-FEDER-045948)
- National Science Foundation (CNS-1518865)
- FCT LARSyS - Plurianual funding 2020-2023 (UIDB/50009/2020)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Keywords
- human-AI collaboration, clinical decision support, rehabilitation assessment, therapist feedback, patient-specific analysis, adaptive decision support system
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.