“It cannot do all of my work”: Community Health Worker Perceptions of AI-Enabled Mobile Health Applications in Rural India
The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Recent advances in Artificial Intelligence (AI) suggest that AI applications could transform healthcare delivery in the Global South. However, as researchers and technology companies rush to develop AI applications that aid the health of marginalized communities, it is critical to consider the needs and perceptions of the community health workers (CHWs) who will have to integrate these AI applications into the essential healthcare services they provide to rural communities. We describe a qualitative study examining CHWs’ perceptions of an AI application for automated disease diagnosis. Drawing on data from 21 interviews with CHWs in rural India, we characterize (1) CHWs’ knowledge, perceptions, and understandings of AI; and (2) the benefits and challenges that CHWs anticipate as AI applications are integrated into their workflows, including their opinions on automation of their work, possible misdiagnosis and errors, data access and surveillance issues, security and privacy challenges, and questions concerning trust. We conclude by discussing the implications of our work for HCI and AI research in low-resource environments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
The global landscape of AI ethics guidelines
Jobin, A., Ienca, M., & Vayena, E. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0088-2 · Cited by 6,220 · cited 1×
“We concluded by discussing (1) considerations for AI and HCI researchers interested in deploying AI systems in low-resource contexts, (2) the complexities of making AI systems explainable to novice users, and (3) the need to account for diverse values and ethics within the design of AI…”
BackgroundExplanation in Artificial Intelligence: Insights from the Social Sciences
Miller, T. (2017) · arXiv · doi:10.48550/arxiv.1706.07269 · Cited by 5,338
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041 · cited 1×
“Who should decide the correct course of action?”
BackgroundWhat is AI Literacy? Competencies and Design Considerations
Long, D., & Magerko, B. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376727 · Cited by 3,241 · cited 1×
“Another rapidly growing area of interest focuses on "explainable AI", meaning that the decisions made by AI are understandable to humans [5, 23, 71–73 , 120].”
BackgroundGuidelines for Human-AI Interaction
Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., et al. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300233 · Cited by 2,439 · cited 1×
“Prior research has examined the challenges in designing for human-AI interaction [131], studied the role of humans in interactive machine learning [11], and defned guidelines for efective human-AI interaction [12].”
BackgroundPrivacy in Context: Technology, Policy, and the Integrity of Social Life
Nissenbaum, H. (2009) · doi:10.1515/9780804772891 · Cited by 2,129 · cited 1×
“7”
Technology probes: inspiring design for and with families
Hutchinson, H., Mackay, W., Westerlund, B., Bederson, B. B., Druin, A., Plaisant, C., Beaudouin-Lafon, M., Conversy, S., Evans, H., Hansen, H., et al. (2003) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/642611.642616 · Cited by 1,471 · cited 1×
“…the use of an AI app in their work, including questions of trust and expertise (Section 4.3), dealing with AI failures or errors (Section 4.4), opinions on access to the data collected (Section 4.5), and potential security and privacy implications of using AI in community health work (Section 4.6).”
MethodInfluentialBig data and machine learning algorithms for health-care delivery
Ngiam, K. Y., & Khor, I. W. (2019) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30149-4 · Cited by 1,424
Power to the People: The Role of Humans in Interactive Machine Learning
Amershi, S., Cakmak, M., Knox, W. B., & Kulesza, T. (2014) · AI Magazine · doi:10.1609/aimag.v35i4.2513 · Cited by 1,084
Questioning the AI: Informing Design Practices for Explainable AI User Experiences
Liao, Q. V., Gruen, D., & Miller, S. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376590 · Cited by 925
Zhang, Y., Liao, Q. V., & Bellamy, R. K. E. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372852 · Cited by 895
Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174156 · Cited by 743
Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design
Yang, Q., Steinfeld, A., Rosé, C., & Zimmerman, J. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376301 · Cited by 622 · cited 1×
“Prior research has examined the challenges in designing for human-AI interaction [131], studied the role of humans in interactive machine learning [11], and defined guidelines for effective human-AI interaction [12].”
Beede, E., Baylor, E., Hersch, F., Iurchenko, A., Wilcox, L., Ruamviboonsuk, P., & Vardoulakis, L. M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376718 · Cited by 614 · cited 4×
“This is in line with psychology research, which suggests that in the absence of a clear explanation, people will create their own hypothesis for how something works and act according to this hypothesis [90].”
BackgroundResultInfluentialCai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359206 · Cited by 594 · cited 1×
“Work in clinical settings analyzed the needs of medical practitioners who would use a human-AI collaborative system [24], and enabled physicians to explore AI-aided medical imaging analysis [127].”
BackgroundArtificial intelligence for diabetes management and decision support: Literature review
Contreras, I., & Vehi, J. (2018) · Journal of Medical Internet Research · doi:10.2196/10775 · Cited by 560 · cited 1×
“Popular domains include early detection and prediction of diseases [33, 83, 125, 128], automated diagnosis and medical image analysis [62, 95, 96, 132], personalized treatment and decision support systems [31, 104, 104, 134], and more.”
Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance
Bansal, G., Nushi, B., Kamar, E., Lasecki, W. S., Weld, D. S., & Horvitz, E. (2019) · Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · doi:10.1609/hcomp.v7i1.5285 · Cited by 466
McClure, P. K. (2018) · Social Science Computer Review · doi:10.1177/0894439317698637 · Cited by 367
Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AI
Wang, D., Weisz, J. D., Muller, M., Ram, P., Geyer, W., Dugan, C., Tausczik, Y., Samulowitz, H., & Gray, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359313 · Cited by 342 · cited 1×
“Highly relevant to our research, prior work has studied human perceptions of AI, including among data scientists [119], young children [124], and the public at large [27, 64].”
BackgroundMaking Machine Learning Models Clinically Useful
Shah, N. H., Milstein, A., & Bagley, P. (2019) · JAMA · doi:10.1001/jama.2019.10306 · Cited by 294 · cited 1×
“And in healthcare, there are currently no regulatory requirements for AI systems to be evaluated through observational clinical studies, nor is it a common practice [108].”
Kocielnik, R., Amershi, S., & Bennett, P. N. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300641 · Cited by 277
Brown, A., Chouldechova, A., Putnam-Hornstein, E., Tobin, A., & Vaithianathan, R. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300271 · Cited by 207
Mobile-izing health workers in rural India
Ramachandran, D., Canny, J., Das, P. D., & Cutrell, E. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753610 · Cited by 200
Jakesch, M., French, M., Ma, X., Hancock, J. T., & Naaman, M. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300469 · Cited by 190
Best, M. L., & Kumar, R. (2008) · Information Technologies and International Development · doi:10.1162/itid.2008.00025 · Cited by 157 · cited 1×
“Notable examples include setting up telecenters in rural villages [18], distributing low-cost laptops in an effort to make computers available to all [13], using mobile phones to reduce poverty [32], providing free basic Internet connectivity in an effort to “bring more people online and help…”
Mobile Phones for Maternal Health in Rural India
Kumar, N., & Anderson, R. J. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702258 · Cited by 146 · cited 1×
“For example, Molapo et al. created a mobile phone app as an exploration artifact to get rich feedback from CHWs in Lesotho [79].”
BackgroundXie, Y., Chen, M., Kao, D., Gao, G., & Chen, X. '. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376807 · Cited by 141
Dissecting Racial Bias in an Algorithm that Guides Health Decisions for 70 Million People
Obermeyer, Z., & Mullainathan, S. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287593 · Cited by 124 · cited 1×
“For example, studies have exposed problematic bias in facial recognition algorithms [22], commercial recidivism software [70], and racial bias being perpetuated in healthcare risk algorithms [86].”
BackgroundMental Models of AI Agents in a Cooperative Game Setting
Gero, K. I., Ashktorab, Z., Dugan, C., Pan, Q., Johnson, J., Geyer, W., Ruiz, M., Miller, S., Millen, D. R., Campbell, M., et al. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376316 · Cited by 121 · cited 1×
“Prior research has also looked at people’s mental models of AI, particularly in human-AI collaboration [15, 48].”
MethodFarmChat: A Conversational Agent to Answer Farmer Queries
Jain, M., Kumar, P., Bhansali, I., Liao, Q. V., Truong, K., & Patel, S. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3287048 · Cited by 117
Improving community health worker performance through automated SMS
DeRenzi, B., Findlater, L., Payne, J., Birnbaum, B., Mangilima, J., Parikh, T., Borriello, G., & Lesh, N. (2012) · Proceedings of the Fifth International Conference on Information and Communication Technologies and Development · doi:10.1145/2160673.2160677 · Cited by 105
Feedpal: Understanding Opportunities for Chatbots in Breastfeeding Education of Women in India
Yadav, D., Malik, P., Dabas, K., & Singh, P. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359272 · Cited by 90
Whidden, C., Kayentao, K., Liu, J. X., Lee, S., Keita, Y., Diakité, D., Keita, A., Diarra, S., Edwards, J., Yembrick, A., et al. (2018) · Journal of Global Health · doi:10.7189/jogh.08.020418 · Cited by 88
Engaging Solidarity in Data Collection Practices for Community Health
Ismail, A., & Kumar, N. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274345 · Cited by 78
Santow, E. (2020) · Science · doi:10.1126/science.abb9369 · Cited by 26
Cited by
Perceptions and Needs of Artificial Intelligence in Health Care to Increase Adoption: Scoping Review
Chew, H. S. J., & Achananuparp, P. (2022) · Journal of Medical Internet Research · doi:10.2196/32939 · Cited by 243
Using Thematic Analysis in Healthcare HCI at CHI: A Scoping Review
Bowman, R., Nadal, C., Morrissey, K., Thieme, A., & Doherty, G. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3581203 · Cited by 107
Salwei, M. E., & Carayon, P. (2022) · Journal of Cognitive Engineering and Decision Making · doi:10.1177/15553434221097357 · Cited by 112
”Because AI is 100% right and safe”: User Attitudes and Sources of AI Authority in India
Kapania, S., Siy, O., Clapper, G., SP, A. M., & Sambasivan, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517533 · Cited by 90
“Okolo et al. [92] studied the perceptions of community health workers (CHWs) in rural India towards AI, and find that CHWs considered AI applications trustworthy with expertise greater than their own.”
BackgroundThe Typing Cure: Experiences with Large Language Model Chatbots for Mental Health Support
Song, I., Pendse, S. R., Kumar, N., & De Choudhury, M. (2024) · arXiv · doi:10.48550/arxiv.2401.14362 · Cited by 64
Metadata
- Authors
- Okolo, C. T., Kamath, S., Dell, N., & Vashistha, A.
- Venue
- Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2021-05-06
- Pages
- 1-20
- OpenAlex
- W3160458345
- Cited by
- 90
- References
- 37
- FWCI
- 13.23
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.