The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Electronic Patient Portals: Evidence on Health Outcomes, Satisfaction, Efficiency, and Attitudes: A Systematic Review
Abstract
BACKGROUND: Patient portals tied to provider electronic health record (EHR) systems are increasingly popular. PURPOSE: To systematically review the literature reporting the effect of patient portals on clinical care. DATA SOURCES: PubMed and Web of Science searches from 1 January 1990 to 24 January 2013. STUDY SELECTION: Hypothesis-testing or quantitative studies of patient portals tethered to a provider EHR that addressed patient outcomes, satisfaction, adherence, efficiency, utilization, attitudes, and patient characteristics, as well as qualitative studies of barriers or facilitators, were included. DATA EXTRACTION: Two reviewers independently extracted data and addressed discrepancies through consensus discussion. DATA SYNTHESIS: From 6508 titles, 14 randomized, controlled trials; 21 observational, hypothesis-testing studies; 5 quantitative, descriptive studies; and 6 qualitative studies were included. Evidence is mixed about the effect of portals on patient outcomes and satisfaction, although they may be more effective when used with case management. The effect of portals on utilization and efficiency is unclear, although patient race and ethnicity, education level or literacy, and degree of comorbid conditions may influence use. LIMITATION: Limited data for most outcomes and an absence of reporting on organizational and provider context and implementation processes. CONCLUSION: Evidence that patient portals improve health outcomes, cost, or utilization is insufficient. Patient attitudes are generally positive, but more widespread use may require efforts to overcome racial, ethnic, and literacy barriers. Portals represent a new technology with benefits that are still unclear. Better understanding requires studies that include details about context, implementation factors, and cost.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“there is insufficient evidence that such asynchronous care improves health outcomes, cost, and overall health care use. 21,22”
From Tethered to the EHR: primary care physician workload assessment using EHR event log data and time-motion observations (2017) · cites this paper as [21]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & the PRISMA Group* (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00135 · Cited by 37,554
Chaudhry, B., Wang, J., Wu, S., Maglione, M., Mojica, W., Roth, E., Morton, S. C., & Shekelle, P. G. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-144-10-200605160-00125 · Cited by 3,159
Self-citationInviting Patients to Read Their Doctors' Notes: A Quasi-experimental Study and a Look Ahead
Delbanco, T., Walker, J., Bell, S. K., Darer, J. D., Elmore, J. G., Farag, N., Feldman, H. J., Mejilla, R., Ngo, L., Ralston, J. D., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-7-201210020-00002 · Cited by 685
Green, B. B. (2008) · JAMA · doi:10.1001/jama.299.24.2857 · Cited by 659
Hassol, A., Walker, J. M., Kidder, D., Rokita, K., Young, D., Pierdon, S., Deitz, D., Kuck, S., & Ortiz, E. (2004) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1593 · Cited by 430
Sarkar, U., Karter, A. J., Liu, J. Y., Adler, N. E., Nguyen, R., López, A., & Schillinger, D. (2010) · Journal of Health Communication · doi:10.1080/10810730.2010.499988 · Cited by 366
The Impact of Electronic Patient Portals on Patient Care: A Systematic Review of Controlled Trials
Ammenwerth, E., Schnell-Inderst, P., & Hoerbst, A. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2238 · Cited by 364
The digital divide in adoption and use of a personal health record
Yamin, C. K., Emani, S., Williams, D. H., Lipsitz, S. R., Karson, A. S., Wald, J. S., & Bates, D. W. (2011) · Archives of Internal Medicine · doi:10.1001/archinternmed.2011.34 · Cited by 353
Cited by
Ethical and regulatory challenges of AI technologies in healthcare: A narrative review
Mennella, C., Maniscalco, U., De Pietro, G., & Esposito, M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e26297 · Cited by 1,229
Arndt, B. G., Beasley, J. W., Watkinson, M. D., Temte, J. L., Tuan, W.-J., Sinsky, C. A., & Gilchrist, V. J. (2017) · The Annals of Family Medicine · doi:10.1370/afm.2121 · Cited by 972
A Review of the Role of Artificial Intelligence in Healthcare
Al Kuwaiti, A., Nazer, K., Al-Reedy, A., Al-Shehri, S., Al-Muhanna, A., Subbarayalu, A. V., Al Muhanna, D., & Al-Muhanna, F. A. (2023) · Journal of Personalized Medicine · doi:10.3390/jpm13060951 · Cited by 915
Patient Portals and Patient Engagement: A State of the Science Review
Irizarry, T., DeVito Dabbs, A., & Curran, C. R. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4255 · Cited by 732
Kruse, C. S., Argueta, D. A., Lopez, L., & Nair, A. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3703 · Cited by 327
Metadata
- Authors
- Goldzweig, C. L., Orshansky, G., Paige, N. M., Towfigh, A. A., Haggstrom, D. A., Miake-Lye, I., Beroes, J. M., & Shekelle, P. G.
- Venue
- Annals of Internal Medicine
- Publisher
- American College of Physicians
- Published
- 2013-11-19
- Volume
- 159
- Issue
- 10
- Pages
- 677-687
- ISSN
- 0003-4819 (ISSN-L)
- 1539-3704
- OpenAlex
- W1976449159
- Cited by
- 468
- References
- 51
- FWCI
- 69.04
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Electronic Patient Portals: Evidence on Health Outcomes, Satisfaction, Efficiency, and Attitudes: A Systematic Review. https://app.cochat.ai/papers/10.7326/0003-4819-159-10-201311190-00006
- The paper
- Goldzweig, C. L., Orshansky, G., Paige, N. M., Towfigh, A. A., Haggstrom, D. A., Miake-Lye, I., Beroes, J. M., & Shekelle, P. G. (2013). Electronic Patient Portals: Evidence on Health Outcomes, Satisfaction, Efficiency, and Attitudes: A Systematic Review. Annals of Internal Medicine. https://doi.org/10.7326/0003-4819-159-10-201311190-00006
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.