Computer-Generated Vs. Physician-Documented History of Present Illness (HPI): Results of a Blinded Comparison
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: Healthcare delivery now mandates shorter visits with higher documentation requirements, undermining the patient-provider interaction. To improve clinic visit efficiency, we developed a patient-provider portal that systematically collects patient symptoms using a computer algorithm called Automated Evaluation of Gastrointestinal Symptoms (AEGIS). AEGIS also automatically "translates" the patient report into a full narrative history of present illness (HPI). We aimed to compare the quality of computer-generated vs. physician-documented HPIs. METHODS: We performed a cross-sectional study with a paired sample design among individuals visiting outpatient adult gastrointestinal (GI) clinics for evaluation of active GI symptoms. Participants first underwent usual care and then subsequently completed AEGIS. Each individual thereby had both a physician-documented and a computer-generated HPI. Forty-eight blinded physicians assessed HPI quality across six domains using 5-point scales: (i) overall impression, (ii) thoroughness, (iii) usefulness, (iv) organization, (v) succinctness, and (vi) comprehensibility. We compared HPI scores within patient using a repeated measures model. RESULTS: Seventy-five patients had both computer-generated and physician-documented HPIs. The mean overall impression score for computer-generated HPIs was higher than physician HPIs (3.68 vs. 2.80; P<0.001), even after adjusting for physician and visit type, location, mode of transcription, and demographics. Computer-generated HPIs were also judged more complete (3.70 vs. 2.73; P<0.001), more useful (3.82 vs. 3.04; P<0.001), better organized (3.66 vs. 2.80; P<0.001), more succinct (3.55 vs. 3.17; P<0.001), and more comprehensible (3.66 vs. 2.97; P<0.001). CONCLUSIONS: Computer-generated HPIs were of higher overall quality, better organized, and more succinct, comprehensible, complete, and useful compared with HPIs written by physicians during usual care in GI clinics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
It's only a computer: virtual humans increase willingness to disclose
Lucas, G. M., Gratch, J., King, A., & Morency, L.-P. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.04.043 · Cited by 977 · cited 1×
“…er initial proof of principle that a computer can create meaningful and clinically relevant HPIs, and the fi ndings are consistent with recent evidence that patients are comfortable disclosing health information to “virtual human” interviewers as supportive and “safe” interaction partners ( 22 ).”
ResultAssessing electronic note quality using the physician documentation quality instrument (PDQI-9)
Bakken, S., Wrenn, J. O., Siegler, E. L., & Stetson, P. D. (2012) · Applied Clinical Informatics · doi:10.4338/aci-2011-11-ra-0070 · Cited by 182 · cited 2×
“We assessed both the computer-generated and physician-documented HPIs using two techniques: blinded assessment by physicians using metrics based on the Physician Documentation Quality Instrument ( 17 ) and blinded evaluation by a billing compliance offi cer.”
Method
Cited by
Harada, Y., Katsukura, S., Kawamura, R., & Shimizu, T. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18042086 · Cited by 44
“The quality of clinical documentation generated by an AI-driven AMHT system was reported to be as high as those of expert physicians [14].”
ResultShah, E. D., Almario, C. V., Spiegel, B. M. R., & Chey, W. D. (2018) · Journal of Neurogastroenterology and Motility · doi:10.5056/jnm17112 · Cited by 27
“We described the AEGIS algorithm in detail elsewhere.(17) Briefly, AEGIS first asked individuals which among 8 GI symptoms they have recently experienced, including: (1) constipation, (2) abdominal pain, (3) bloat/gas, (4) diarrhea, (5) fecal incontinence, (6) heartburn/reflux, (7) dysphagia, and (8) nausea/vomiting.”
Self-citationShapiro, J., & Lyakhovitsky, A. (2024) · Clinics in Dermatology · doi:10.1016/j.clindermatol.2024.06.020 · Cited by 26
Chen, Y., Lin, Q., Chen, X., Liu, T., Ke, Q., Yang, Q., Guan, B., & Ming, W.-K. (2023) · Digital Health · doi:10.1177/20552076231185435 · Cited by 24
“The utilization of other digital tools specifically created for collecting medical history information could simplify and expedite this process, while most of them only focus on some specific patient populations, for example, cardiology and gastroenterology.(32,33) This study has several limitations.”
Method
Metadata
- Authors
- Almario, C. V., Chey, W., Kaung, A., Whitman, C., Fuller, G., Reid, M., Nguyen, K., Bolus, R., Dennis, B., Encarnacion, R., Martinez, B., Talley, J., Modi, R., Agarwal, N., Lee, A., Kubomoto, S., Sharma, G., Bolus, S., Chang, L., & Spiegel, B. M. R.
- Venue
- American Journal of Gastroenterology
- Published
- 2015-01
- Volume
- 110
- Issue
- 1
- Pages
- 170-179
- ISSN
- 0002-9270 (ISSN-L)
- OpenAlex
- W2072963355
- Cited by
- 49
- References
- 3
- FWCI
- 5.09
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Computer-Generated Vs. Physician-Documented History of Present Illness (HPI): Results of a Blinded Comparison. https://app.cochat.ai/papers/10.1038/ajg.2014.356
- The paper
- Almario, C. V., Chey, W., Kaung, A., Whitman, C., Fuller, G., Reid, M., Nguyen, K., Bolus, R., Dennis, B., Encarnacion, R., Martinez, B., Talley, J., Modi, R., Agarwal, N., Lee, A., Kubomoto, S., Sharma, G., Bolus, S., Chang, L., & Spiegel, B. M. R. (2015). Computer-Generated Vs. Physician-Documented History of Present Illness (HPI): Results of a Blinded Comparison. American Journal of Gastroenterology. https://doi.org/10.1038/ajg.2014.356
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.