The DOI matches its Crossref record; 103 of the 104 references it cites were found in a registry or an index.
“Brilliant AI Doctor” in Rural Clinics: Challenges in AI-Powered Clinical Decision Support System Deployment
Open accessAbstract
Artificial intelligence (AI) technology has been increasingly used in the implementation of advanced Clinical Decision Support Systems (CDSS). Research demonstrated the potential usefulness of AI-powered CDSS (AI-CDSS) in clinical decision making scenarios. However, post-adoption user perception and experience remain understudied, especially in developing countries. Through observations and interviews with 22 clinicians from 6 rural clinics in China, this paper reports the various tensions between the design of an AI-CDSS system (“Brilliant Doctor”) and the rural clinical context, such as the misalignment with local context and workflow, the technical limitations and usability barriers, as well as issues related to transparency and trustworthiness of AI-CDSS. Despite these tensions, all participants expressed positive attitudes toward the future of AI-CDSS, especially acting as “a doctor’s AI assistant” to realize a Human-AI Collaboration future in clinical settings. Finally we draw on our findings to discuss implications for designing AI-CDSS interventions for rural clinical contexts in developing countries.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Artificial intelligence in healthcare: past, present and future
Jiang, F., Jiang, Y., Zhi, H., Dong, Y., Li, H., Ma, S., Wang, Y., Dong, Q., Shen, H., & Wang, Y. (2017) · Stroke and Vascular Neurology · doi:10.1136/svn-2017-000101 · Cited by 4,837 · cited 1×
“, [10, 10, 11, 14, 38, 71, 76, 91, 95, 96]), very little is published on the usage of AI-CDSS in practice [9, 32].”
BackgroundHansen, L. K., & Salamon, P. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.58871 · Cited by 4,260
Knowledge Graph Embedding by Translating on Hyperplanes
Wang, Z., Zhang, J., Feng, J., & Chen, Z. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.8870 · Cited by 3,915 · cited 1×
“In recent years, with the advent of artificial intelligence techniques, such as neural networkmodels [27] and knowledge graph [85], there has been an explosion in the development of AI technologies to improve CDSS performance and accuracy [56].”
BackgroundEuropean Union Regulations on Algorithmic Decision Making and a “Right to Explanation”
Goodman, B., & Flaxman, S. (2017) · AI Magazine · doi:10.1609/aimag.v38i3.2741 · Cited by 2,131 · cited 1×
“Health policies and initiatives should be enacted to address the accountability issue of AI-CDSS systems [26].”
BackgroundMachine learning for medical imaging
Erickson, B. J., Korfiatis, P., Akkus, Z., & Kline, T. L. (2017) · RadioGraphics · doi:10.1148/rg.2017160130 · Cited by 1,672
Principles of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490 · cited 1×
“This new clinician-AI collaboration paradigm will extend the current human-in-the-loop AI design philosophy [15] and the mixed-initiative design approach [28].”
MethodShared decision making: really putting patients at the centre of healthcare
Stiggelbout, A. M., Weijden, T. V. D., Wit, M. P. T. D., Frosch, D., Legare, F., Montori, V. M., Trevena, L., & Elwyn, G. (2012) · BMJ · doi:10.1136/bmj.e256 · Cited by 1,014 · cited 1×
“Emerging work in the field of shared decision making highlights the importance of considering personal and contextual factors when determining care plans between healthcare providers and patients [73].”
BackgroundClinical decision support in the era of artificial intelligence
Shortliffe, E. H., & Sepúlveda, M. J. (2018) · JAMA · doi:10.1001/jama.2018.17163 · Cited by 920 · cited 3×
“This research gap is critical because researchers need an in-depth understanding of how to appropriately implement AI-CDSS to increase user acceptance [22] and system uptake [69].”
BackgroundFriedberg, M., Chen, P., Van Busum, K., Aunon, F., Pham, C., Caloyeras, J., Mattke, S., Pitchforth, E., Quigley, D., Brook, R., et al. (2014) · RAND Health Quarterly · doi:10.7249/rhq-03-04-01 · Cited by 707 · cited 1×
“Prior work has suggested that the perceived threat of a technology to professional autonomy and the degree to which clinicians consider the use of a particular system decreases their control over decision making are salient factors that could directly affect clinicians’ willingness to use that technology [24, 64, 80].”
Background
Research works printed but not linked: 4
- MIT Technology Review Insights. 2019. AI in health care: Capacity capability and a future of active health in Asia.https://mit-insights.ai/ai-in-health-care/.
- Farah Magrabi, Elske Ammenwerth, Jytte Brender McNair, Nicolet F De Keizer, Hannele Hyppönen, Pirkko Nykänen, Michael Rigby, Philip J Scott, Tuulikki Vehko, Zoie Shui-Yee Wong, 2019. Artificial intelligence in clinical decision support: challenges for evaluating AI and practical implications. Yearbook of medical informatics 28, 01 (2019), 128–134.
- Peter Stone, R Brooks, E Brynjolfsson, R Calo, O Etzioni, G Hager, and A Teller. 2016. One hundred year study on artificial intelligence. Artificial Intelligence and Life in 2030 (2016).
- 10.5555/2893873.2894046 · doi:10.5555/2893873.2894046
Cited by
Challenges in deploying machine learning: A survey of case studies
Paleyes, A., Urma, R.-G., & Lawrence, N. D. (2023) · ACM Computing Surveys · doi:10.1145/3533378 · Cited by 638
“One of the main reasons quoted was the UX design that did not take into account particularities of the environment (screen sizes, interaction with other software in the clinic) where it was installed, often resulting in an unusable software [147].”
BackgroundCiecierski-Holmes, T., Singh, R., Axt, M., Brenner, S., & Barteit, S. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00700-y · Cited by 343
“…radiation treatment plans 17,21 , but also some discordance between clinical decision support systems and the local treatment options available 20,22 . i n d i c a t e t h a t t h e c i t e d a rt i c l e r e p o rt e d a m i x o f s tr e ng t h s a n d w e a k n e ss e s f o r t h a t p a rt i…”
BackgroundMethodInfluentialTun, H. M., Rahman, H. A., Naing, L., & Malik, O. A. (2025) · Journal of Medical Internet Research · doi:10.2196/69678 · Cited by 210
Shaik, T., Tao, X., Li, L., Xie, H., & Velásquez, J. D. (2024) · Information Fusion · doi:10.1016/j.inffus.2023.102040 · Cited by 196
“Integration of multimodal medical data fusion into Clinical Decision Support Systems (CDSS) enhances clinical decision-making and improves patient outcomes [155], [156].”
BackgroundShi, Y., Gao, T., Jiao, X., & Cao, N. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3610217 · Cited by 170
“Regarding the other actor of the interaction, human, researchers have focused on how different user groups interact with AI, such as children [82, 179], clinicians [176, 195], artists [21], and data scientists [63, 177].”
Background
Metadata
- Authors
- Wang, D., Wang, L., Zhang, Z., Wang, D., Zhu, H., Gao, Y., Fan, X., & Tian, F.
- Affiliations
- IBM (United States) (US)
- Chinese Academy of Sciences (CN)
- Pace University (US)
- Carnegie Mellon University (US)
- State University of New York (US)
- Venue
- Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2021-05-06
- Pages
- 1-18
- OpenAlex
- W3120083395
- Cited by
- 209
- References
- 104
- Citations by year
- 2026: 40 · 2025: 55 · 2024: 43 · 2023: 43 · 2022: 22 · 2021: 6
- FWCI
- 25.55
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Keywords
- rural clinics, human-AI collaboration, clinician perceptions, usability barriers, rural health care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: “Brilliant AI Doctor” in Rural Clinics: Challenges in AI-Powered Clinical Decision Support System Deployment. https://app.cochat.ai/papers/10.1145/3411764.3445432
- The paper
- Wang, D., Wang, L., Zhang, Z., Wang, D., Zhu, H., Gao, Y., Fan, X., & Tian, F. (2021). “Brilliant AI Doctor” in Rural Clinics: Challenges in AI-Powered Clinical Decision Support System Deployment. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3411764.3445432
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.