The Use of an Artificial Intelligence Platform OpenEvidence to Augment Clinical Decision-Making for Primary Care Physicians
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index; 18 of the 24 sources its claims cite were checked for support.
Abstract
Background: Artificial intelligence (AI) platforms can potentially enhance clinical decision-making (CDM) in primary care settings. OpenEvidence (OE), an AI tool, draws from trusted sources to generate evidence-based medicine (EBM) recommendations to address clinical questions. However, its effectiveness in real-world primary care cases remains unknown. Objective: To evaluate the performance of OE in providing EBM recommendations for five common chronic conditions in primary care: hypertension, hyperlipidemia, diabetes mellitus type 2, depression, and obesity. Methods: Five patient cases were retrospectively analyzed. Physicians posed specific clinical questions, and OE responses were evaluated on clarity, relevance, evidence support, impact on CDM, and overall satisfaction. Four independent physicians provided ratings using a 0 to 4 scale. Results: OE provided accurate, evidence-based recommendations in all cases, aligning with physician plans. OE was scored on a scale of zero to four, where zero was very unclear, and four was very clear. Mean scores across cases were clarity (3.55 ± 0.60), relevance (3.75 ± 0.44), support (3.35 ± 0.49), and satisfaction (3.60 ± 0.60). However, the impact on CDM was limited (1.95 ± 1.05), as OE primarily reinforced rather than modified plans. Conclusion: OE was rated high in clarity, relevance, and evidence-based support, reinforcing physician decisions in common chronic conditions. While the impact on CDM was minimal due to the study’s retrospective nature, OE shows promise in augmenting the primary care physician. Prospective trials are needed to evaluate its utility in complex cases and multidisciplinary settings.
Overview
CoChat Summary
TL;DR
In a retrospective five-case series, OpenEvidence provided accurate, evidence-based recommendations that aligned with physician plans for common chronic conditions in primary care. It was rated high in clarity, relevance, evidence support, and satisfaction, but had limited impact on clinical decision-making because it mainly reinforced rather than modified plans.
Key findings
- Four independent physicians rated OpenEvidence across five cases on a 0–4 scale. In the Results/Table 1, mean scores were clarity 3.55 ± 0.21, relevance 3.75 ± 0.43, evidence support 3.35 ± 0.22, satisfaction 3.60 ± 0.38, and impact on CDM 1.95 ± 0.48. The Abstract reports the same means but different SDs: clarity 3.55 ± 0.60, relevance 3.75 ± 0.44, support 3.35 ± 0.49, satisfaction 3.60 ± 0.60, and impact 1.95 ± 1.05.
- OpenEvidence recommendations aligned with physician plans in all five cases and primarily reinforced rather than modified decisions. Examples included statin initiation for hyperlipidemia, spironolactone for resistant hypertension, sertraline increase or mirtazapine augmentation for depression, SGLT2 inhibitor plus glipizide discontinuation for type 2 diabetes with HFrEF, and switching semaglutide to tirzepatide for obesity plateau.
- The authors conclude OpenEvidence performed comparably to physician CDM for common chronic conditions and may help address primary care knowledge gaps, but its impact was limited in this retrospective design.
Methods
- Retrospective case series of five patients with common chronic conditions—hypertension, hyperlipidemia, type 2 diabetes mellitus, depression, and obesity—identified from internal or family medicine clinics. Cases had initially been managed without AI using usual decision-making tools and physician knowledge.
- For each case, the treating physician retrospectively posed a patient-centric point-of-care question without protected health information to OpenEvidence. Four independent physician authors who had not evaluated the patients reviewed the cases, questions, responses, and ratings using a five-question assessment tool covering clarity, relevance, evidence-based support, impact on CDM, and overall satisfaction on a 0–4 scale.
- Main analysis was descriptive: mean ± SD scores across the five cases. No comparative or inferential statistics were reported.
Limitations
- Stated by the paper: OpenEvidence was used retrospectively days to weeks after patient visits, and the literature access time differed from the time of CDM; the study included only five cases from a single institution using common conditions; accuracy may differ in more complex or undifferentiated cases; prospective trials, diverse presentations of the same diagnosis, and multidisciplinary team members are needed; an additional question rating reference quality was not included.
- Stated by the paper: the small sample and retrospective design limit conclusions about real-world impact and clinical outcomes.
- Evident from the text: there was no control or comparator AI platform or physician-only arm; ratings came from four physicians with no reported blinding or inter-rater reliability metrics; the Abstract and Results/Table 1 report inconsistent SDs for the mean scores; no clinical outcomes were measured.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
14 Valid · 2 Not valid · 4 Not checked · 50 Own results and interpretations
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“There are knowledge gaps in PCPs when compared to specialists in other common conditions, such as sexual dysfunction and HLD management.13,14”
§ The Use of an Artificial Intelligence Platform OpenEvidence to Augment Clinical Decision-Making for Primary Care Physicians > Discussion
What the sources say
- Partly supportedcites [13] Stanley EE Pfoh E Lipold L Martinez K. Gap in sexual dysfunction management between male and female patients seen in primary care: an observational study. J Gen Intern Med. 2025; 40: 847- 853. doi: 10.1007/s11606-024-09004-1 39231849 PMC11914646 sourceExperimental — accuracy not yet measured
The Background says PCPs report feeling underprepared to manage female sexual dysfunction, and the Conclusion reports fewer management orders for those patients when diagnosed by PCPs than by OB/GYNs. The study does not establish that a knowledge gap causes this difference; it also finds that PCPs order erectile-dysfunction management more often than urologists. HLD management appears to be attributed to the other citation and is not assessed here. (LLM, conf=0.85)
- Disputedcites [14] Langer A Tan M Goodman SG, et al. Does management of lipid lowering differ between specialists and primary care: insights from GOAL Canada. Int J Clin Pract. 2021; 75(4): e13861. doi: 10.1111/ijcp.13861 33244861 sourceExperimental — accuracy not yet measured
For lipid-lowering management, the Discussion identifies knowledge or treatment gaps in both PCPs and specialists, rather than a greater knowledge gap in PCPs. The Abstract conclusion says the groups experienced similar care gaps, and recommended LDL-C attainment was similar (44% versus 42%). This paper does not address the sentence’s separate point about sexual dysfunction. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“A recent global survey of Metabolic Dysfunction Associated Steatotic Liver Disease (MASLD) was conducted to assess knowledge among PCPs, hepatologists (HEP), gastroenterologists (GI), and endocrinologists (ENDO). The knowledge scores were significantly higher in HEP, ENDO, and GI physicians in every domain (i.e., diagnosis, epidemiology, and treatment) when compared to PCPs. 12”
§ The Use of an Artificial Intelligence Platform OpenEvidence to Augment Clinical Decision-Making for Primary Care Physicians > Discussion
What the sources say
- Partly supportedcites [12] Younossi ZM Ong JP Takahashi H, et al. A global survey of physicians knowledge about nonalcoholic fatty liver disease. Clin Gastroenterol Hepatol. 2022; 20(6):e1456-e1468. doi: 10.1016/j.cgh.2021.06.048 34229038 sourceExperimental — accuracy not yet measured
The Awareness and Knowledge section (page not specified) reports significantly higher scores for endocrinologists than PCPs in all three domains. It compares hepatologists with gastroenterologists on a separate survey version, not either group with PCPs; the Methods section confirms the two versions differed. The paper describes its subject as NAFLD, rather than MASLD. (LLM, conf=0.91)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The role of AI in augmenting physician CDM in the management of chronic conditions for individual patients in the PCC is still largely unknown. 5”
§ The Use of an Artificial Intelligence Platform OpenEvidence to Augment Clinical Decision-Making for Primary Care Physicians > Introduction
What the sources say
- Partly supportedcites [5] Liu J Wang C Liu S. Utility of ChatGPT in clinical practice. J Med Internet Res. 2023; 25:e48568. doi: 10.2196/48568 PMC10365580 37379067 sourceExperimental — accuracy not yet measured
The Introduction says studies evaluating ChatGPT in clinical practice are lacking, and Possible Risks and Challenges says its recommendations need clinical assessment. That supports uncertainty about its role in physician decision-making, but the paper does not establish the claim specifically for chronic-condition management of individual patients in primary care clinics. Its discussion also concerns ChatGPT rather than AI generally. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Despite these knowledge differences, to date, most AI CDM tools have been focused on specific organ or disease problems because of the narrower data elements (i.e., liver enzymes and imaging) needed for the LLMs compared to the undifferentiated nature of PCC patients. 2”
§ The Use of an Artificial Intelligence Platform OpenEvidence to Augment Clinical Decision-Making for Primary Care Physicians > Discussion
What the sources say
- Partly supportedcites [2] Young RA Martin CM Sturmberg JP, et al. What complexity science predicts about the potential of artificial intelligence/machine learning to improve primary care. J Am Board Fam Med. 2024; 37(2): 332- 345. doi: 10.3122/jabfm.2023.230219R1 38740483 sourceExperimental — accuracy not yet measured
The Background section describes successful AI/ML applications for detecting specific diseases, while the Abstract and Discussion say tools are more likely to work on narrow, well-defined tasks than in complex primary care decision making (page numbers unavailable). The paper does not establish that most clinical decision-making tools target organ- or disease-specific problems, or that LLMs require narrower data elements such as liver enzymes and imaging. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Although the present study demonstrated that OE reinforced the CDM by the PCPs in commonly treated conditions, the sheer volume of medical knowledge makes staying up to date regarding management of chronic medical conditions challenging. 12”
§ The Use of an Artificial Intelligence Platform OpenEvidence to Augment Clinical Decision-Making for Primary Care Physicians > Discussion
What the sources say
- Partly supportedcites [12] Younossi ZM Ong JP Takahashi H, et al. A global survey of physicians knowledge about nonalcoholic fatty liver disease. Clin Gastroenterol Hepatol. 2022; 20(6):e1456-e1468. doi: 10.1016/j.cgh.2021.06.048 34229038 sourceExperimental — accuracy not yet measured
The Discussion (page unavailable) reports knowledge gaps about NAFLD, especially among primary care physicians, and recommends regular webinars on new updates. This supports a narrower point about keeping physicians informed on NAFLD, but the paper does not attribute the difficulty to the sheer volume of medical knowledge or address management of chronic conditions generally. (LLM, conf=0.78)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
39 more claims
Create a free account to see all 70 claims and to verify the 1 reference still open.
- Probably not a substantial claim. 22
- It may state two separate claims as one. 11
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“physicians participating in Hurt et al.’s (2025) study noted that seeing official citations increased their confidence in the AI’s suggestions (Hurt et al., 2025).”
From An auditable and source-verified framework for clinical AI decision support: integrating retrieval-augmented generation with data provenance (2026) · cites this paper as Hurt et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“for example, Hurt et al. (2025) found that providing clear citations in AI-generated answers made them highly credible to physicians (Hurt et al., 2025).”
From An auditable and source-verified framework for clinical AI decision support: integrating retrieval-augmented generation with data provenance (2026) · cites this paper as Hurt et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In practice, clinicians say they prefer recommendations that explicitly cite medical guidelines or high-quality studies (Hurt et al., 2025).”
From An auditable and source-verified framework for clinical AI decision support: integrating retrieval-augmented generation with data provenance (2026) · cites this paper as Hurt et al., 2025
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“OpenEvidence (OpenEvidence, Inc.) is one such platform; it is a clinician-facing LLM that grounds responses in cited, peer-reviewed medical sources, which may improve transparency and reduce hallucinations but does not eliminate them entirely (Hurt et al. 2025).”
From Evidence on Demand: OpenEvidence versus Established LLMs on the Orthopaedic In-Training Examination (2026) · cites this paper as Hurt et al. 2025
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“OpenEvidence is an AI system that answers doctors’ questions by drawing on “trusted sources” in evidence-based medicine (Hurt et al., 2025).”
From An auditable and source-verified framework for clinical AI decision support: integrating retrieval-augmented generation with data provenance (2026) · cites this paper as Hurt et al., 2025
5 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Whelton, P. K., Carey, R. M., Aronow, W. S., Casey, D. E., Collins, K. J., Dennison Himmelfarb, C., DePalma, S. M., Gidding, S., Jamerson, K. A., Jones, D. W., et al. (2018) · Hypertension · doi:10.1161/hyp.0000000000000065 · Cited by 7,391
Grundy, S. M., Stone, N. J., Bailey, A. L., Beam, C., Birtcher, K. K., Blumenthal, R. S., Braun, L. T., de Ferranti, S., Faiella-Tommasino, J., Forman, D. E., et al. (2019) · Circulation · doi:10.1161/cir.0000000000000625 · Cited by 6,185
Tirzepatide Once Weekly for the Treatment of Obesity
Jastreboff, A. M., Aronne, L. J., Ahmad, N. N., Wharton, S., Connery, L., Alves, B., Kiyosue, A., Zhang, S., Liu, B., Bunck, M. C., et al. (2022) · New England Journal of Medicine · doi:10.1056/nejmoa2206038 · Cited by 3,838
Grundy, S. M., Stone, N. J., Bailey, A. L., Beam, C., Birtcher, K. K., Blumenthal, R. S., Braun, L. T., de Ferranti, S., Faiella-Tommasino, J., Forman, D. E., et al. (2019) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2018.11.003 · Cited by 2,691
Davies, M. J., D’Alessio, D. A., Fradkin, J., Kernan, W. N., Mathieu, C., Mingrone, G., Rossing, P., Tsapas, A., Wexler, D. J., & Buse, J. B. (2018) · Diabetologia · doi:10.1007/s00125-018-4729-5 · Cited by 1,455
Williams, B., MacDonald, T. M., Morant, S., Webb, D. J., Sever, P., McInnes, G., Ford, I., Cruickshank, J. K., Caulfield, M. J., Salsbury, J., et al. (2015) · The Lancet · doi:10.1016/s0140-6736(15)00257-3 · Cited by 1,308
Carey, R. M., Calhoun, D. A., Bakris, G. L., Brook, R. D., Daugherty, S. L., Dennison-Himmelfarb, C. R., Egan, B. M., Flack, J. M., Gidding, S. S., Judd, E., et al. (2018) · Hypertension · doi:10.1161/hyp.0000000000000084 · Cited by 1,153
Whelton, P. K., Carey, R. M., Aronow, W. S., Casey, D. E., Collins, K. J., Dennison Himmelfarb, C., DePalma, S. M., Gidding, S., Jamerson, K. A., Jones, D. W., et al. (2018) · Circulation · doi:10.1161/cir.0000000000000596 · Cited by 1,127
Bupropion-SR, Sertraline, or Venlafaxine-XR after Failure of SSRIs for Depression
Rush, A. J., Trivedi, M. H., Wisniewski, S. R., Stewart, J. W., Nierenberg, A. A., Thase, M. E., Ritz, L., Biggs, M. M., Warden, D., Luther, J. F., et al. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa052963 · Cited by 1,033
Dunlay, S. M., Givertz, M. M., Aguilar, D., Allen, L. A., Chan, M., Desai, A. S., Deswal, A., Dickson, V. V., Kosiborod, M. N., Lekavich, C. L., et al. (2019) · Circulation · doi:10.1161/cir.0000000000000691 · Cited by 639
Cited by
Akpınar, H. (2025) · BMC Oral Health · doi:10.1186/s12903-025-06294-7 · Cited by 32
“A study evaluating the use of MediSearch examined its broader implications for the healthcare system, highlighting its potential impact on clinical communication, health literacy, and data governance within digital health infrastructures [53–57].”
Kremer, P., Langballe, E., Haase, I., Bamberger, J., Kuhn, S., Krusche, M., & Knitza, J. (2026) · Rheumatology International · doi:10.1007/s00296-025-06068-y · Cited by 17
“In a small retrospective evaluation, physicians rated its answers highly in terms of clarity, clinical relevance, and evidence-based support [14].”
Alu, F. F., & Oluwadare, S. (2026) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2026.1737532 · Cited by 22
How Physicians Can Prepare for Generative AI
Morgan, D. J., Rodman, A. M., & Goodman, K. E. (2025) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2025.4914 · Cited by 16
Ngo, K., Mekhail, S., Chan, V., Li, X., Yin, A., Choi, H. Y., Allman-Farinelli, M. A., & Chen, J. (2025) · Nutrients · doi:10.3390/nu17223515 · Cited by 19
“…Accelerate Program, OpenEvidence, have been evaluated using primary care cases (hypertension, hyperlipidaemia, type 2 diabetes mellitus, depression, and obesity) to deliver pertinent outputs that support a physician’s clinical judgement in medical decision-making rather than replacing it [137].”
Vladić, N., Nopp, S., Pabinger, I., Ageno, W., Connors, J. M., Eichinger, S., & Ay, C. (2025) · Journal of Thrombosis and Haemostasis · doi:10.1016/j.jtha.2025.09.004 · Cited by 10
Nakaphan, P., Damara, I., Lerttiendamrong, B., Shotelersuk, V., & Chaisrimaneepan, N. (2025) · Rheumatology International · doi:10.1007/s00296-025-06053-5 · Cited by 9
“Developed by researchers at Harvard and MIT through the Mayo Clinic Platform Accelerate program [ 33 ], it integrates search-augmented AI to support clinical decision-making and has demonstrated utility in primary care settings [ 33 ].”
Artificial intelligence (AI) in nutrition: A case‐based comparison of generative AI models
Hurt, R. T., Mundi, M. S., Bonnes, S. L. R., Salonen, B. R., Muthusamy, K., Stephenson, C. R., Croghan, I. T., Fokken, S. C., & Varayil, J. E. (2025) · Nutrition in Clinical Practice · doi:10.1002/ncp.70062 · Cited by 8
“22”
InfluentialSelf-citationPatterns of AI Use in Clinical Work by Hospitalists: Survey Study
Bagla, P., Hanna, J., Marthambadi, B., & Watkins, S. (2026) · Journal of Medical Internet Research · doi:10.2196/85973 · Cited by 10
“Published literature validating OpenEvidence’s capabilities as a clinical decision support tool for use by health care providers remains limited to generating management options for hypothetical primary care scenarios [25]; yet, hospitalists have adopted it widely based on its medical focus alone.”
Hsu, W.-K., Chuang, H., Wang, Y.-Y., Hsu, K., Kuan, F., Su, W., Chang, C.-H., & Hong, C. (2026) · The Knee · doi:10.1016/j.knee.2026.104427 · Cited by 7
Can artificial intelligence (AI)-based software programs generate accurate clinical dictation?
Kazim, S. A., Goodacre, C. J., Kan, J. Y. K., & Goldstein, G. (2025) · Journal of Prosthetic Dentistry · doi:10.1016/j.prosdent.2025.10.051 · Cited by 7
Rivera, L. R. P., Gursky, A. K., Elmer, N. A., Boyd, C. J., & Karp, N. S. (2025) · Aesthetic Surgery Journal · doi:10.1093/asj/sjaf249 · Cited by 9
Artificial intelligence and the future of the pharmacist’s role in drug information
Patel, R., Shirk, R., Advani, A., Kar, I., Munir, F. M., Nelson, S. D., Saad, M., & Aungst, T. D. (2025) · American Journal of Health-System Pharmacy · doi:10.1093/ajhp/zxaf175 · Cited by 5
A context-augmented large language model for accurate precision oncology medicine recommendations
Jun, H., Tanaka, Y., Johri, S., Camp, S. Y., Bao, E. L., Carvalho, F. L. F., Gui, D. Y., Jordan, A. C., Labaki, C., Martin, S. D., et al. (2026) · Cancer Cell · doi:10.1016/j.ccell.2025.12.017 · Cited by 13
Diverging trajectories of trust in healthcare and on-line information seeking: what’s next with LLMs
Heumann, R. A., & Steinhubl, S. R. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02408-9 · Cited by 6
Skaik, K., Omoseni, S., Dagher, D., Shah, D., Fermín, T. M., Agostinone, P., Hantouly, A. T., & Khan, M. (2025) · Knee Surgery Sports Traumatology Arthroscopy · doi:10.1002/ksa.70255 · Cited by 3
Large Language Models and Otolaryngology: A Review
Bao, J. W., Jawad, M., Pavelchek, C., Powell, W. J. B., Oh, I. Y., Gupta, A., & Shew, M. A. (2026) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2025.5335 · Cited by 6
Artificial intelligence in dermatology: Clinical promise and environmental impact
Shen, C. Z., Zhao, A. T., Rotemberg, V. M., Daneshjou, R., Parker, E. R., & Rosenbach, M. A. (2026) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2026.03.039 · Cited by 3
Ahn, M., & Parker, C. H. (2026) · Neurogastroenterology & Motility · doi:10.1111/nmo.70393 · Cited by 4
“Although some studies have demonstrated that special-purpose LLMs have outperformed general-purpose LLMs in answering clinical questions, our findings align with emerging research to suggest that this advantage may not extend to DGBIs [22, 31, 32].”
Jagarapu, J., Babata, K., Chamarthi, S., & Hoyt, R. (2025) · medRxiv · doi:10.64898/2025.11.29.25341091 · Cited by 7
What's Hot in Transplant Infectious Diseases?
Gorsline, C. A., Harris, C. E., Radosta, S., Dong, S. W., Koff, A., Mishkin, A. D., Saharia, K., Sassine, J., Steinbrink, J. M., & Kumar, R. N. (2025) · Transplant Infectious Disease · doi:10.1111/tid.70102 · Cited by 2
“A commonly used tool for clinical care is OpenEvidence, powered by large medical journals like the New England Journal of Medicine and JAMA [20].”
Ben Shitrit, I., Idan, D., Volevich, M., Goldenberg, H. S., Vaknin, D., Degany, O., Abelson, N., Binyamin, Y., Nassar, R., Nassar, M., et al. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001278 · Cited by 2
“Tools such as OpenEvidence [1,2] and Perplexity [3] are being promoted within healthcare settings as healthcare-specific LLMs designed to synthesize evidence-based information to support clinical decision-making with literature-based clinical insights.”
A chat with Hippocrates: the oath in the age of artificial intelligence
Fins, J. J. (2026) · Academic Medicine · doi:10.1093/acamed/wvag096 · Cited by 2
VITO, A. D., Geremia, N., Russo, A., Colpani, A., Vaira, L. A., & Madeddu, G. (2026) · International Journal of Antimicrobial Agents · doi:10.1016/j.ijantimicag.2026.107881 · Cited by 5
Prescribing Caution: A Critique of OpenEvidence to Answer Medication‐Related Questions
Bergsbaken, J. M., Wilson, P., Vandagriff, S., Christensen, L., & Vellardita, L. (2026) · JACCP: JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY · doi:10.1002/jac5.70237 · Cited by 2
“…OpenEvidence in clinical settings and offer suggestions for responsible use of the tool. to different study methods, such as questions derived from clinical guidelines [6, 12, 13, 17, 18], or questions/scenarios based on clinician experiences among disparate subject areas [4–11, 13, 14, 16, 19–21].”
The Hitchhiker’s Guide to Autonomous Research: A Survey of Scientific Agents
Wang, X., Xu, J., Lian, S., Chen, Y., Guo, H., Zhu, F., Shao, Y., Ren, M., Yi, H., Feng, A. H., et al. (2026) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2026.3721500 · Cited by 12
Smith, A. C., Aggarwal, R., Castillo, E. G., Morreale, M. K., Coverdale, J., Seritan, A. L., & Brenner, A. M. (2026) · Academic Psychiatry · doi:10.1007/s40596-026-02326-8 · Cited by 1
“Some LLMs, such as OpenEvidence and Doximity, use AI to synthesize medical literature, and researchers have used these tools to assist in literature searches [23, 24].”
Chuan, A., & Nanda, M. (2026) · Anesthesiology · doi:10.1097/aln.0000000000005933 · Cited by 1
Medical Literature in the Age of Artificial Intelligence
Scott, H. (2026) · iNew Medicine · doi:10.1002/inm3.70046 · Cited by 1
da Silva, R. C., Romano, M., Mendes, T., Isidoro, M., Ravichandran, S., Kumar, S., van der Heijden, M., Fail, O., & Gnanapragasam, V. J. (2026) · Cureus · doi:10.7759/cureus.107449 · Cited by 1
“A recent evaluation of OpenEvidence, another AI clinical decision-support platform, reported physician satisfaction scores of 3.60 ± 0.38 out of 4 across common primary care conditions, with the platform primarily reinforcing rather than modifying clinical plans [21].”
InfluentialNavarra, A., Ikramuddin, S. S., Greenberg, S. M., & Doraiswamy, P. M. (2026) · Cureus · doi:10.7759/cureus.108098 · Cited by 1
“While OE has licensed and curated data from some of the most trusted medical sources [3-5], the practice of medicine has many nuances and may require logic and reasoning that require specialized expertise.”
From bedside queries to complex care: AI for decision-making in infectious diseases
Borgonovo, F., Pennisi, F., Petri, F., Recanatini, C., Gori, A., & Berbari, E. F. (2026) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2026.08.002 · Cited by 4
Johnson, D. A., Feghali, E., Elfadil, O. M., Varayil, J. E., Mundi, M. S., & Hurt, R. T. (2026) · Nutrients · doi:10.3390/nu18162613 · Cited by 1
“…is limited, findings from clinical nutrition, home parenteral nutrition (HPN), telehealth, and chronic disease self-management suggest that these tools may improve workflow efficiency and support functions to usher in workflow efficiency and prompt a shift toward data-informed models of care [10].”
Self-citationDhamsania, I. R., Zhou, A. E., Khalilzadeh, D. M., Vidal, N. Y., Ferris, L. K., & Grant-Kels, J. M. (2026) · Clinics in Dermatology · doi:10.1016/j.clindermatol.2026.09.012 · Cited by 1
Current Trends in AI and Eye Disease Diagnostics
Cruz, M. J., Limaye, S., & Christopher, M. (2026) · Ophthalmic & physiological optics · doi:10.1007/s44402-026-00193-2 · Cited by 1
The role of emerging technology in expanding regional anesthesia education and patient access
Foster, K. E., Hong, H.-J., Kapur, N., & Mariano, E. R. (2026) · Current Opinion in Anaesthesiology · doi:10.1097/aco.0000000000001676 · Cited by 1
“OpenEvidence (Miami, Florida, USA) is an LLM designed for healthcare that synthesizes answers from the scientific literature [9].”
Kazim, S. A., Goodacre, C. J., KAN, J. Y. K., & Goldstein, G. R. (2026) · Journal of Prosthetic Dentistry · doi:10.1016/j.prosdent.2026.04.019 · Cited by 1
Avrumova, F., Cesar, M. D., Loggia, G., Strebel, K., Altorfer, F. C., Castro, R. I., Zhu, J., Abjornson, C., Bono, C. M., & Lebl, D. R. (2026) · The Spine Journal · doi:10.1016/j.spinee.2026.08.002
Stephenson, C. R., Varayil, J. E., Salonen, B. R., Wight, E. C., Sang, P. D., Ghosh, A. K., Shung, D. L., Croghan, I. T., Schroeder, D. R., & Hurt, R. T. (2026) · Mayo Clinic Proceedings: Digital Health · doi:10.1016/j.mcpdig.2026.100404
“12 These responses are structured and often include differential diagnoses, treatment recommendations, and references to guidelines.”
Self-citationEvidence on Demand: OpenEvidence versus Established LLMs on the Orthopaedic In-Training Examination
Khan, A. A., Lalvani, S. S., Pourarbab, S., Hyeamang, L. J., Lew, R. M., Hussain, Z. B., Nicholson, G. P., & Garrigues, G. E. (2026) · Journal of Orthopaedic Experience & Innovation · doi:10.60118/001c.162882
Vladić, N., Nopp, S., Pabinger, I., Ageno, W., Connors, J. M., Eichinger, S., & Ay, C. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5255286
Delayed diagnosis of POEMS syndrome, how AI tools can enhance diagnostic accuracy
Jin, M., Arivazhagan, S., Mewawalla, P., Sadashiv, S. K., & Lakshman, A. (2025) · European Journal of Case Reports in Internal Medicine · doi:10.12890/2025_005504
Sadowsky, S. J. (2025) · Journal of Prosthetic Dentistry · doi:10.1016/j.prosdent.2025.09.002
Emmerson, M. K., Hillier-Smith, R., & Malhas, A. (2025) · Cureus · doi:10.7759/cureus.94699
“Early examples of clinically oriented tools (for example, OpenEvidence) underline the need for rigorous clinical validation before widespread use [29,30].”
Teaching Techniques of the 21st Century: Simulation, Virtual Reality, and Beyond
Elmofty, D. H., Pritzlaff, S. G., Singh, N. S., Anițescu, M., & Guirguis, M. N. (2025) · International Anesthesiology Clinics · doi:10.1097/aia.0000000000000504
Amplifying signal-to-noise: Responsible use of large language models in radiology publishing
Song, A. S., Masutani, E., Tejani, A. S., & Retson, T. (2025) · Clinical Imaging · doi:10.1016/j.clinimag.2025.110679 · Cited by 1
Roach, C. S., Shawwa, J. J., Nee, C. S., & Lu, V. M. (2025) · Neurosurgery · doi:10.1227/neu.0000000000003865 · Cited by 1
Gandhi, S., Cao, A., Balas, M., & Johnson, D. (2026) · AJO International · doi:10.1016/j.ajoint.2025.100223
Lessons we have learned from osseointegration can guide us when using artificial intelligence
Sadowsky, S. J. (2026) · Journal of Prosthetic Dentistry · doi:10.1016/j.prosdent.2026.01.003
eConsult-Integrated Care to Improve Specialty Access
Bergman, J., Giboney, P., Waterman, B., & Yee, H. F. (2026) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2025.8352
Kazim, S. A., Goodacre, C. J., KAN, J. Y. K., & Goldstein, G. (2026) · Journal of Prosthetic Dentistry · doi:10.1016/j.prosdent.2026.02.041
Assessment of Stage Two Hypertension Treatment Plans Written by Generative AI
Metzger, T., Hossain, Z., Park, K., Vu, S., Dixon, S., & Taylor, T. A. H. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15083103
“OpenEvidence and ClinicalKey AI have been studied in the context of aiding primary care physicians in clinical settings [8].”
Psilopatis, I., Emons, J., Vrettou, K., & Zwimpfer, T. A. (2026) · Journal of Clinical Medicine · doi:10.3390/jcm15093234
“Models trained on or with direct access to peer-reviewed medical literature, such as OpenEvidence, possess an inherent advantage in providing evidence-based, clinically nuanced responses [24].”
OpenEvidence errs on the safe side in a structured test of triage recommendations
Jia, E., Omar, M., Barash, Y., Brook, O. R., Ahmed, M., Kruskal, J. B., Gorenshtein, A., & Klang, E. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106687 · Cited by 3
Psilopatis, I., Redling, K., Filippi, V., Kappos, S., Emons, J., Mosimann, B., & Zwimpfer, T. A. (2026) · Archives of Gynecology and Obstetrics · doi:10.1007/s00404-026-08423-1
“1 Mean GQS according to the evaluation of the different LLMs by the obstetricians generate a response that reflects current medical consensus [15].”
Kanev, A. F., Kobyakova, O. S., Kurakova, N. G., & Леонидовна, К. Р. (2026) · Public Health · doi:10.21045/2782-1676-2026-6-1-28-39
El Kayali, M. K., Neumann, E. M., Fahy, S., Bartek, B., Oehme, S., Getgood, A., Jung, T., & Milinkovic, D. D. (2026) · Journal of ISAKOS · doi:10.1016/j.jisako.2026.101160
Minimizing chronic groin pain after inguinal hernia surgery: an augmented evidence review
Alviar-Ortiz, M., Tocci, N. X., Chen, D. C., Jacob, B. P., Blackman, M., & Krpata, D. M. (2026) · Journal of Gastrointestinal Surgery · doi:10.1016/j.gassur.2026.102505
Hurt, S. D., Varayil, J. E., Bowman, J. E., Fischer, K. M., Schroeder, D. R., & Croghan, I. T. (2026) · Journal of Primary Care & Community Health · doi:10.1177/21501319261463381
Self-citationLi, J., Huang, S., Qiu, Y., Chen, W., Zhang, Y., Zhao, X., Qu, G., Bu, Y., Feng, X., Xu, J., et al. (2026) · JMIR Metascience and Research Integrity · doi:10.2196/preprints.105947
Sahasrabudhe, S., Toussaint, E., Herrera, J., & Akré, E.-R. L. (2026) · Journal of Medical Internet Research · doi:10.2196/92355
“It has gained importance in health care research through its inclusion in systematic reviews [34,36, 37] and the growing use of AI-based large language models trained primarily on open-source gray literature [38-40].”
Correct but Incomplete: Limitations of AI-Assisted Decision Support in Rectal Cancer
Meyer, R. J., Bresler, T. E., Makaryan, T., Gheissari, R., Mauch, A., & Fujita, M. (2026) · The American Surgeon · doi:10.1177/00031348261471501
Artificial Intelligence in Psychiatric Graduate Medical Education
Khan, M., Edgcomb, J. B., Heldt, J. P., Yang, Y., DeBonis, K., Richards, M., & Khalsa, S. S. (2026) · Academic Psychiatry · doi:10.1007/s40596-026-02406-9
Shen, C., & Lipoff, J. B. (2026) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2026.07.091
Quality of AI‐Generated Patient Education for Pre‐ and Post‐Operative Tracheostomy Care
Zhang, K., Evans, L. K., Delavary, D., Wooten, C., Kim, M., Shiba, T. L., Kadin, N. E., Feintuch, J., & Chhetri, D. K. (2026) · Otolaryngology · doi:10.1002/ohn.70359
The Promises and Perils of Clinical Decision Support Artificial Intelligence
Cervantes, J., & Vashi, B. (2026) · The Clinical Teacher · doi:10.1111/tct.70498
“Nevertheless, OE was rated high in clarity, relevance and evidence-based support, reinforcing physician decisions in common chronic conditions from real-world primary care cases [24].”
Abuadas, M. H., Albikawi, Z. F., Rumman, R. B. A., Saifan, A. R., Ahmed, F. R., & Abuhammad, S. (2026) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac69091.2026.00337
“Moreover, physicians using the AI platform OpenEvidence for clinical decision-making on common chronic diseases—hypertension, type 2 diabetes, hyperlipidemia, depression, and obesity—reported high satisfaction with the clarity and relevance of its evidence-based support [6].”
Reference quality of OpenEvidence across five medical specialties
Lotan, T. L., Omar, M., Barash, Y., Kruskal, J. B., Ahmed, M., Brook, O. R., Klang, E., & Gorenshtein, A. (2026) · npj Health Systems · doi:10.1038/s44401-026-00142-8 · Cited by 1
Desjardins, G., Jain, V., Simonson, M. G., & McQuade, C. N. (2026) · Journal of General Internal Medicine · doi:10.1007/s11606-026-10777-w
Artificial Intelligence for Clinical Decision Support in Rural Spine Care: A Narrative Review
Soin, A., Odonkor, C. A., Khaira, M. B., & Rodriguez, J. R. (2026) · Healthcare · doi:10.3390/healthcare14182935
“One example is OpenEvidence, which draws on trusted sources to generate evidence-based recommendations and is rated highly for relevance, clarity, and evidentiary support [101].”
Borgonovo, F., Ebbert, J. O., Pourghazi, F., Thompson, C. A., Hurt, R. T., Kashiwagi, D. T., & Berbari, E. F. (2026) · JMIR Formative Research · doi:10.2196/101838
Self-citationShekhawat, M., Nagar, A. K., Gupta, A. A., Koshy, A. R., Naidu, V. S. S., Krishnamurthy, K. P., & Sathyakkagari, N. (2026) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2026.106739
Arries, C., McLaughlin, L., & Walz, M. S. (2026) · doi:10.2196/preprints.112916
Ronicke, M., Sollfrank, L., Sagonas, I., Atreya, R., Grieshaber‐Bouyer, R., Hoerning, A., Jefremow, A., Kowalski, I., Krickau, T., Lermer, J., et al. (2026) · Scientific Reports · doi:10.1038/s41598-026-72397-y
“While OE has shown to reinforce clinical decisions in primary care and in highly circumscribed clinical questions, it has not yet been evaluated in complex or multidisciplinary clinical cases 4 .”
Utility of OpenEvidence and ChatGPT in Selecting Neuroimaging Based on Appropriateness Criteria
Kumarapuram, S., Satti, M., Xu, S., Kavia, J., Bhaskar, A., Azmi, A., Goldszal, A. F., Soliman, A., Sundararajan, S., Gupta, G., et al. (2026) · Academic Radiology · doi:10.1016/j.acra.2026.09.049 · Cited by 1
Ma, R., Wu, G., Solís-Pazmiño, P., Barnajian, M., Nasseri, Y. Y., & Wolf, J. (2026) · Journal of Gastrointestinal Surgery Open · doi:10.1016/j.jogsop.2026.100057
Metadata
- Authors
- Hurt, R. T., Stephenson, C. R., Gilman, E. A., Aakre, C. A., Croghan, I. T., Mundi, M. S., Ghosh, K., & Edakkanambeth Varayil, J.
- Affiliations
- Mayo Clinic (US)
- Mayo Clinic, Rochester, MN, USA
- ORCID
- Venue
- Journal of Primary Care & Community Health
- Publisher
- SAGE Publications
- Published
- 2025-04-16
- Volume
- 16
- Pages
- 21501319251332215-21501319251332215
- ISSN
- 2150-1319 (ISSN-L)
- 2150-1327
- PMC
- PMC12033599
- OpenAlex
- W4409493818
- Cited by
- 78
- References
- 33
- Citations by year
- 2026: 59 · 2025: 19
- FWCI
- 18.61
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- creativecommons.org/licenses/by-nc/4.0/ (unspecified)
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Journal of Primary Care & Community Health (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- OpenEvidence, artificial intelligence in clinical decision-making, primary care physicians, medical question answering, hypertension, hyperlipidemia, type 2 diabetes, depression, obesity, chronic disease, physician satisfaction, clinical decision support
- MeSH terms
- Clinical Decision-Making, Artificial Intelligence, Chronic Disease, Depression, Diabetes Mellitus, Type 2, Female, Humans, Hyperlipidemias, Hypertension, Male, Middle Aged, Obesity, Primary Health Care, Retrospective Studies, Evidence-Based Medicine, Physicians, Primary Care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-30, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-30 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.