Do Patients Who Access Clinical Information on Patient Internet Portals Have More Primary Care Visits?
Abstract
BACKGROUND: As health care costs alarm the nation and the debate increases about the impact of health information technologies, patients are reviewing their medical records increasingly through secure Internet portals. Important questions remain about the impact of portal use on office visits. OBJECTIVE: To evaluate whether use of patient Internet portals to access records is associated with increased primary care utilization. RESEARCH DESIGN: A prospective cohort study. SUBJECTS: Primary care patients registered on patient Internet portals, within an integrated health system serving rural Pennsylvania and an academic medical center in Boston. MEASURES: Frequency of "clinical portal use" (days/2 mo intervals over 2 y) included secure messaging about clinical issues and viewing laboratory and radiology findings. In year 2, a subset of patients also gained access to their primary care doctor's visit notes. The main outcome was number of primary care office visits. RESULTS: In the first 2 months of the 2-year period, 14% of 44,951 primary care patients engaged in clinical portal use 2 or more days per month, 31% did so 1 day per month, and the remainder had no clinical portal use. Overall, adjusted for age, sex, and chronic conditions, clinical portal use was not associated with subsequent office visits. Fewer than 0.1% of patients engaged in high levels of clinical portal use (31 or more login days in 2 mo) that were associated with 1 or more additional visits in the subsequent 2 months (months 3 and 4). However, the reverse was true: office visits led to subsequent clinical portal use. Similar trends were observed among patients with or without access to visit notes. CONCLUSIONS: Patients turn to their portals following visits, but clinical portal use does not contribute to an increase in primary care visits.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The success of initiatives that provide patients with access to their electronic healthcare records, such as OpenNotes, suggests their potential to improve the quality and efficiency of medical care.
“The success of initiatives that provides patients with the access to their electronic healthcare records, such as OpenNotes, suggests their potential to improve the quality and efficiency of medical care [1, 2].”
From Converging blockchain and next-generation artificial intelligence technologies to decentralize and accelerate biomedical research and healthcare (2018) · cites this paper as [2]
Cites
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,385 · see citing works
Random-Effects Models for Longitudinal Data
Laird, N. M., & Ware, J. H. (1982) · Biometrics · doi:10.2307/2529876 · Cited by 8,923 · see citing works
Newton—Raphson and EM Algorithms for Linear Mixed-Effects Models for Repeated-Measures Data
Lindstrom, M. J., & Bates, D. M. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478693 · Cited by 886 · see citing works
Inviting Patients to Read Their Doctors' Notes: A Quasi-experimental Study and a Look Ahead
Delbanco, T., Walker, J., Bell, S. K., Darer, J. D., Elmore, J. G., Farag, N., Feldman, H. J., Mejilla, R., Ngo, L. H., Ralston, J. D., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-7-201210020-00002 · Cited by 686 · see citing works
Self-citationWeb-Based Collaborative Care for Type 2 Diabetes
Ralston, J. D., Hirsch, I. B., Hoath, J. I., Mullen, M. C., Cheadle, A. D., & Goldberg, H. I. (2008) · Diabetes Care · doi:10.2337/dc08-1220 · Cited by 248 · see citing works
Self-citationWho Uses the Patient Internet Portal? The PatientSite Experience
Weingart, S. N., Rind, D. M., Tofias, Z., & Sands, D. Z. (2005) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1833 · Cited by 244 · see citing works
Inviting Patients to Read Their Doctors' Notes: Patients and Doctors Look Ahead
Walker, J., Leveille, S. G., Ngo, L. H., Vodicka, E. L., Darer, J. D., Dhanireddy, S., Elmore, J. G., Feldman, H. J., Lichtenfeld, M. J., Oster, N. V., et al. (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-12-201112200-00003 · Cited by 208 · see citing works
Self-citationZhou, Y. Y., Garrido, T., Chin, H. L., Wiesenthal, A. M., & Liang, L. (2007) · PubMed · Cited by 207 · see citing works
Association of Online Patient Access to Clinicians and Medical Records With Use of Clinical Services
Palen, T. E., Ross, C. A., Powers, J. D., & Xu, S. (2012) · JAMA · doi:10.1001/jama.2012.14126 · Cited by 193 · see citing works
Bergmo, T. S., Kummervold, P. E., Gammon, D., & Dahl, L. B. (2005) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2005.06.002 · Cited by 124 · see citing works
Impact of Patient Portal Secure Messages and Electronic Visits on Adult Primary Care Office Visits
North, F., Crane, S. J., Chaudhry, R., Ebbert, J. O., Ytterberg, K., Tulledge-Scheitel, S. M., & Stroebel, R. J. (2014) · Telemedicine and e-Health · doi:10.1089/tmj.2013.0097 · Cited by 100 · see citing works
Leveille, S. G., Walker, J., Ralston, J. D., Ross, S. E., Elmore, J. G., & Delbanco, T. (2012) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-12-32 · Cited by 89 · see citing works
Self-citationRace/ethnicity, personal health record access, and quality of care.
Garrido, T., Kanter, M. H., Meng, D., et al. (2015) · PubMed · Cited by 42 · see citing works
Liss, D. T., Reid, R. J., Grembowski, D. E., Rutter, C. M., Ross, T. R., & Fishman, P. A. (2014) · The Annals of Family Medicine · doi:10.1370/afm.1642 · Cited by 31 · see citing works
Zhou, Y., Leith, W. M., Li, H., et al. (2015) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocu018 · Cited by 15 · see citing works
Personal Health Records and Medical Care Use
Koppel, R., & Soumerai, S. B. (2013) · JAMA · doi:10.1001/jama.2013.378 · Cited by 5 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Mamoshina, P., Ojomoko, L., Yanovich, Y., Ostrovski, A., Botezatu, A., Prikhodko, P., Izumchenko, E., Aliper, A., Romantsov, K., Zhebrak, A., et al. (2018) · Oncotarget · doi:10.18632/oncotarget.22345 · Cited by 471 · see citing works
Interventions to increase patient portal use in vulnerable populations: a systematic review
Grossman, L. V., Masterson Creber, R. M., Benda, N. C., Wright, D., Vawdrey, D. K., & Ancker, J. S. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz023 · Cited by 251 · see citing works
- Authors
- Leveille, S. G., Mejilla, R., Ngo, L., Fossa, A., Elmore, J. G., Darer, J., Ralston, J. D., Delbanco, T., & Walker, J.
- Affiliations
- Group Health Cooperative (US)
- Beth Israel Deaconess Medical Center (US)
- University of Washington (US)
- Geisinger Health System (US)
- Corresponding author
- Leveille, Suzanne G.
- Mejilla, Roanne
- Ngo, Long
- Fossa, Alan
- Delbanco, Tom
- Walker, Jan
- ORCID
- Venue
- Medical Care
- Published
- 2016-01
- Volume
- 54
- Issue
- 1
- Pages
- 17-23
- ISSN
- 0025-7079 (ISSN-L)
- OpenAlex
- W2470710810
- Cited by
- 36
- References
- 16
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 2 · 2023: 1 · 2022: 2 · 2021: 4 · 2020: 3 · 2019: 10 · 2018: 6 · 2017: 2 · 2016: 2
- FWCI
- 6.42
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Medical Care (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Healthcare Systems and Technology
- Keywords
- primary care utilization, office visits, health information technology, secure messaging, patient access to medical records
- MeSH terms
- Adult, Boston, Female, Humans, Male, Middle Aged, Office Visits, Patient Education as Topic, Physician-Patient Relations, Primary Health Care, Prospective Studies, Cohort Studies, Internet, Patient Access to Records, Consumer Health Information, Young Adult, Information Seeking Behavior
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
