Application of Artificial Intelligence in Community-Based Primary Health Care: Systematic Scoping Review and Critical Appraisal
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Background: Research on the integration of artificial intelligence (AI) into community-based primary health care (CBPHC) has highlighted several advantages and disadvantages in practice regarding, for example, facilitating diagnosis and disease management, as well as doubts concerning the unintended harmful effects of this integration. However, there is a lack of evidence about a comprehensive knowledge synthesis that could shed light on AI systems tested or implemented in CBPHC. Objective: We intended to identify and evaluate published studies that have tested or implemented AI in CBPHC settings. Methods: We conducted a systematic scoping review informed by an earlier study and the Joanna Briggs Institute (JBI) scoping review framework and reported the findings according to PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analysis-Scoping Reviews) reporting guidelines. An information specialist performed a comprehensive search from the date of inception until February 2020, in seven bibliographic databases: Cochrane Library, MEDLINE, EMBASE, Web of Science, Cumulative Index to Nursing and Allied Health Literature (CINAHL), ScienceDirect, and IEEE Xplore. The selected studies considered all populations who provide and receive care in CBPHC settings, AI interventions that had been implemented, tested, or both, and assessed outcomes related to patients, health care providers, or CBPHC systems. Risk of bias was assessed using the Prediction Model Risk of Bias Assessment Tool (PROBAST). Two authors independently screened the titles and abstracts of the identified records, read the selected full texts, and extracted data from the included studies using a validated extraction form. Disagreements were resolved by consensus, and if this was not possible, the opinion of a third reviewer was sought. A third reviewer also validated all the extracted data. Results: We retrieved 22,113 documents. After the removal of duplicates, 16,870 documents were screened, and 90 peer-reviewed publications met our inclusion criteria. Machine learning (ML) (41/90, 45%), natural language processing (NLP) (24/90, 27%), and expert systems (17/90, 19%) were the most commonly studied AI interventions. These were primarily implemented for diagnosis, detection, or surveillance purposes. Neural networks (ie, convolutional neural networks and abductive networks) demonstrated the highest accuracy, considering the given database for the given clinical task. The risk of bias in diagnosis or prognosis studies was the lowest in the participant category (4/49, 4%) and the highest in the outcome category (22/49, 45%). Conclusions: We observed variabilities in reporting the participants, types of AI methods, analyses, and outcomes, and highlighted the large gap in the effective development and implementation of AI in CBPHC. Further studies are needed to efficiently guide the development and implementation of AI interventions in CBPHC settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
Scoping studies: advancing the methodology
Levac, D., Colquhoun, H., & O'Brien, K. K. (2010) · Implementation Science · doi:10.1186/1748-5908-5-69 · Cited by 15,268 · cited 1×
“Based on the scoping review methodological framework proposed by Levac et al [27], and the Joanna Briggs Institute (JBI) methodological guidance for scoping reviews [28], we developed a protocol with the following steps: (1) clarifying the purpose of the review and linking it to a research…”
The weirdest people in the world?
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999152x · Cited by 12,641
PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies
Wolff, R. F., Moons, K. G. M., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., Mallett, S., & for the PROBAST Group† (2019) · Annals of Internal Medicine · doi:10.7326/m18-1376 · Cited by 2,984 · cited 3×
“If one or more domains were judged as having high risk of bias, the overall judgment was “high risk” [31].”
InfluentialThe practical implementation of artificial intelligence technologies in medicine
He, J., Baxter, S. L., Xu, J., Xu, J., Zhou, X., & Zhang, K. (2019) · Nature Medicine · doi:10.1038/s41591-018-0307-0 · Cited by 2,246
Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy
Shneiderman, B. (2020) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2020.1741118 · Cited by 1,743 · cited 1×
“Despite the many potential benefits of AI to humans, the development of AI systems is often based on “technology-centered” design approaches instead of "human-centered" approaches [114].”
Abràmoff, M. D., Lavin, P. T., Birch, M., Shah, N., & Folk, J. C. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0040-6 · Cited by 1,638
Artificial intelligence and deep learning in ophthalmology
Ting, D. S. W., Pasquale, L. R., Peng, L., Campbell, J. P., Lee, A. Y., Raman, R., Tan, G. S. W., Schmetterer, L., Keane, P. A., & Wong, T. Y. (2019) · British Journal of Ophthalmology · doi:10.1136/bjophthalmol-2018-313173 · Cited by 1,554
Digital pathology and artificial intelligence
Niazi, M. K. K., Parwani, A. V., & Gurcan, M. N. (2019) · The Lancet Oncology · doi:10.1016/s1470-2045(19)30154-8 · Cited by 1,232 · cited 1×
“Several studies have reported early successes of AI systems for facilitating diagnosis and disease management in different fields, including radiology [19], ophthalmology [20], cardiology [21], orthopedics [22], and pathology [23].”
Artificial intelligence in cardiology
Johnson, K. W., Torres Soto, J., Glicksberg, B. S., Shameer, K., Miotto, R., Ali, M., Ashley, E., & Dudley, J. T. (2018) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2018.03.521 · Cited by 1,202
Ethical and legal challenges of artificial intelligence-driven healthcare
Gerke, S., Minssen, T., & Cohen, G. (2020) · Artificial Intelligence in Healthcare · doi:10.1016/b978-0-12-818438-7.00012-5 · Cited by 1,170
Sun, T. Q., & Medaglia, R. (2019) · Government Information Quarterly · doi:10.1016/j.giq.2018.09.008 · Cited by 948 · cited 1×
“However, the literature also raises doubts about using and implementing AI in health care [24,25].”
The Effectiveness of Artificial Intelligence Conversational Agents in Health Care: Systematic Review
Milne-Ives, M., de Cock, C., Lim, E., Shehadeh, M. H., de Pennington, N., Mole, G., Normando, E., & Meinert, E. (2020) · Journal of Medical Internet Research · doi:10.2196/20346 · Cited by 626 · cited 1×
“This is consistent with other study results showing that the cost-effectiveness of using AI in health care is rarely and inadequately reported [116,117].”
Sex and gender differences in health: Science & Society Series on Sex and Science
Regitz‐Zagrosek, V. (2012) · The EMBO Reports · doi:10.1038/embor.2012.87 · Cited by 572
Sex and gender differences and biases in artificial intelligence for biomedicine and healthcare
Cirillo, D., Catuara-Solarz, S., Morey, C., Guney, E., Subirats, L., Mellino, S., Gigante, A., Valencia, A., Rementeria, M. J., Chadha, A. S., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0288-5 · Cited by 553 · cited 1×
“Furthermore, sex and gender are sources of variations in clinical conditions, affecting different aspects including prognosis, symptomatology manifestation, and treatment effectiveness, among others [110,111].”
Artificial intelligence and the implementation challenge
Shaw, J., Rudzicz, F., Jamieson, T., & Goldfarb, A. (2019) · Journal of Medical Internet Research · doi:10.2196/13659 · Cited by 389 · cited 1×
“However, the literature also raises doubts about using and implementing AI in health care [24,25].”
Ten Ways Artificial Intelligence Will Transform Primary Care
Lin, S. Y., Mahoney, M. R., & Sinsky, C. A. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-019-05035-1 · Cited by 248 · cited 1×
“…primary health care by, for example, improving risk prediction, supporting clinical decision making, increasing the accuracy and timeliness of diagnosis, facilitating chart review and documentation, augmenting patient–physician relationships, and optimizing operations and resource allocation [3].”
Framing the challenges of artificial intelligence in medicine
Yu, K.-H., & Kohane, I. S. (2019) · BMJ Quality & Safety · doi:10.1136/bmjqs-2018-008551 · Cited by 233
Liyanage, H., Liaw, S.-T., Jonnagaddala, J., Schreiber, R., Kuziemsky, C., Terry, A. L., & de Lusignan, S. (2019) · Yearbook of Medical Informatics · doi:10.1055/s-0039-1677901 · Cited by 200 · cited 2×
“The use of artificial intelligence (AI) in primary health care has been widely recommended [1].”
Evaluation of Artificial Intelligence–Based Grading of Diabetic Retinopathy in Primary Care
Kanagasingam, Y., Xiao, D., Vignarajan, J., Preetham, A., Tay-Kearney, M.-L., & Mehrotra, A. (2018) · JAMA Network Open · doi:10.1001/jamanetworkopen.2018.2665 · Cited by 185
Black, R. E., Taylor, C. E., Arole, S., Bang, A., Bhutta, Z. A., Chowdhury, A. M. R., Kirkwood, B. R., Kureshy, N., Lanata, C. F., Phillips, J. F., et al. (2017) · Journal of Global Health · doi:10.7189/jogh.07.010908 · Cited by 182
Lee, S. I., Adans-Dester, C. P., Grimaldi, M., Dowling, A. V., Horak, P. C., Black-Schaffer, R. M., Bonato, P., & Gwin, J. T. (2018) · IEEE Journal of Translational Engineering in Health and Medicine · doi:10.1109/jtehm.2018.2829208 · Cited by 119 · cited 1×
“This included general practitioners and nurses [86], engineers [60], general practitioners [51,81], occupational therapists [74], respirologists [64], and nurses [108].”
Verbraak, F. D., Abramoff, M. D., Bausch, G. C. F., Klaver, C., Nijpels, G., Schlingemann, R. O., & van der Heijden, A. A. (2019) · Diabetes Care · doi:10.2337/dc18-0148 · Cited by 115
Evaluation of the JBI scoping reviews methodology by current users
Khalil, H., Bennett, M., Godfrey, C., McInerney, P., Munn, Z., & Peters, M. (2020) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000202 · Cited by 89
Using an artificial neural network to predict healing times and risk factors for venous leg ulcers
Taylor, R. J., Taylor, A. D., & Smyth, J. V. (2002) · Journal of Wound Care · doi:10.12968/jowc.2002.11.3.26381 · Cited by 82 · cited 1×
“[96,97]; and other health conditions (8/90, 8”
Taati, B., Zhao, S., Ashraf, A. B., Asgarian, A., Browne, M. E., Prkachin, K. M., Mihailidis, A., & Hadjistavropoulos, T. (2019) · IEEE Access · doi:10.1109/access.2019.2900022 · Cited by 70
McFadden, P., & Crim, A. (2016) · Journal of Continuing Education in the Health Professions · doi:10.1097/ceh.0000000000000061 · Cited by 26 · cited 3×
“The second study used a continuing medical education framework [38] and compared traditional expert-led training (control group) with an online multimedia-based training activity supplemented with an AI-driven simulation feedback system (treatment group) [36].”
Turner, N. M., MacRae, J., Nowlan, M. L., McBain, L., Stubbe, M. H., & Dowell, A. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-021241 · Cited by 17
Cited by
Artificial Intelligence Applications in Health Care Practice: Scoping Review
Sharma, M., Savage, C., Nair, M., Larsson, I., Svedberg, P., & Nygren, J. M. (2022) · Journal of Medical Internet Research · doi:10.2196/40238 · Cited by 198
“2011 Dec [cited 2022 May 18];80(12):863–71.”
Tolentino, R., Baradaran, A., Gore, G., Pluye, P., & Abbasgholizadeh-Rahimi, S. (2024) · JMIR Medical Education · doi:10.2196/54793 · Cited by 165
Saif‐Ur‐Rahman, K., Islam, M. S., Alaboson, J., Ola, O., Hasan, I., Islam, N., Mainali, S., Martina, T., Silenga, E., Muyangana, M., et al. (2023) · Journal of Evidence-Based Medicine · doi:10.1111/jebm.12547 · Cited by 56
Bias Mitigation in Primary Health Care Artificial Intelligence Models: Scoping Review
Sasseville, M., Ouellet, S., Rhéaume, C., Sahlia, M., Couture, V., Després, P., Paquette, J.-S., Darmon, D., Bergeron, F., & Gagnon, M.-P. (2025) · Journal of Medical Internet Research · doi:10.2196/60269 · Cited by 38
Self-citationNyariro, M., Emami, E., Caidor, P., & Abbasgholizadeh Rahimi, S. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-072069 · Cited by 25
Metadata
- Authors
- Abbasgholizadeh Rahimi, S., Légaré, F., Sharma, G., Archambault, P., Zomahoun, H. T. V., Chandavong, S., Rheault, N., T Wong, S., Langlois, L., Couturier, Y., Salmeron, J. L., Gagnon, M.-P., & Légaré, J.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-09-03
- Volume
- 23
- Issue
- 9
- Pages
- e29839
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W3196769534
- Cited by
- 146
- References
- 28
- FWCI
- 4.65
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.