The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Evaluating the impact of patients' online access to doctors' visit notes: designing and executing the OpenNotes project
Open accessAbstract
BACKGROUND: Providers and policymakers are pursuing strategies to increase patient engagement in health care. Increasingly, online sections of medical records are viewable by patients though seldom are clinicians' visit notes included. We designed a one-year multi-site trial of online patient accessible office visit notes, OpenNotes. We hypothesized that patients and primary care physicians (PCPs) would want it to continue and that OpenNotes would not lead to significant disruptions to doctors' practices. METHODS/DESIGN: Using a mixed methods approach, we designed a quasi-experimental study in 3 diverse healthcare systems in Boston, Pennsylvania, and Seattle. Two sites had existing patient internet portals; the third used an experimental portal. We targeted 3 key areas where we hypothesized the greatest impacts: beliefs and attitudes about OpenNotes, use of the patient internet portals, and patient-doctor communication. PCPs in the 3 sites were invited to participate in the intervention. Patients who were registered portal users of participating PCPs were given access to their PCPs' visit notes for one year. PCPs who declined participation in the intervention and their patients served as the comparison groups for the study. We applied the RE-AIM framework to our design in order to capture as comprehensive a picture as possible of the impact of OpenNotes. We developed pre- and post-intervention surveys for online administration addressing attitudes and experiences based on interviews and focus groups with patients and doctors. In addition, we tracked use of the internet portals before and during the intervention. RESULTS: PCP participation varied from 19% to 87% across the 3 sites; a total of 114 PCPs enrolled in the intervention with their 22,000 patients who were registered portal users. Approximately 40% of intervention and non-intervention patients at the 3 sites responded to the online survey, yielding a total of approximately 38,000 patient surveys. DISCUSSION: Many primary care physicians were willing to participate in this "real world" experiment testing the impact of OpenNotes on their patients and their practices. Results from this trial will inform providers, policy makers, and patients who contemplate such changes at a time of exploding interest in transparency, patient safety, and improving the quality of care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1977) · Psychological Review · doi:10.1037/0033-295x.84.2.191 · Cited by 43,925
(1963) · Medical Entomology and Zoology · Cited by 15,085
Self-efficacy: Toward a unifying theory of behavioral change
Bandura, A. (1978) · Advances in Behaviour Research and Therapy · doi:10.1016/0146-6402(78)90002-4 · Cited by 10,586
Social Foundations of Thought and Action
Bandura, A. (2002) · The Health Psychology Reader · doi:10.4135/9781446221129.n6 · Cited by 9,902
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · cited 2×
“To compare PCP perceptions about anticipated Table 1 Summary of RE-AIM framework [6] for Evaluation of OpenNotes”
Designing A Mixed Methods Study In Primary Care
Creswell, J. W. (2004) · The Annals of Family Medicine · doi:10.1370/afm.104 · Cited by 978
Maly, R. C., Frank, J. C., Marshall, G. N., DiMatteo, M. R., & Reuben, D. B. (1998) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1998.tb02725.x · Cited by 329
Open Notes: Doctors and Patients Signing On
Delbanco, T., Walker, J., Darer, J. D., Elmore, J. G., Feldman, H. J., Leveille, S. G., Ralston, J. D., Ross, S. E., Vodicka, E., & Weber, V. D. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-153-2-201007200-00008 · Cited by 253
Self-citationWeb-Based Collaborative Care for Type 2 Diabetes
Ralston, J. D., Hirsch, I. B., Hoath, J., Mullen, M., Cheadle, A., & Goldberg, H. I. (2009) · Diabetes Care · doi:10.2337/dc08-1220 · Cited by 248
Self-citationSafran, D. G., Karp, M., Coltin, K., Chang, H., Li, A., Ogren, J., & Rogers, W. H. (2006) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2005.00311.x · Cited by 221
Cited by
Inviting Patients to Read Their Doctors' Notes: A Quasi-experimental Study and a Look Ahead
Delbanco, T., Walker, J., Bell, S. K., Darer, J. D., Elmore, J. G., Farag, N., Feldman, H. J., Mejilla, R., Ngo, L., Ralston, J. D., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-7-201210020-00002 · Cited by 685
Self-citationThe Empirical Foundations of Telemedicine Interventions in Primary Care
Bashshur, R. L., Howell, J. D., Krupinski, E. A., Harms, K. M., Bashshur, N., & Doarn, C. R. (2016) · Telemedicine and e-Health · doi:10.1089/tmj.2016.0045 · Cited by 370
Walker, J., Leveille, S., Bell, S., Chimowitz, H., Dong, Z., Elmore, J. G., Fernandez, L., Fossa, A., Gerard, M., Fitzgerald, P., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/13876 · Cited by 309
“This survey draws heavily on questions used in the original demonstration project in primary care; its development has been previously described [19].”
BackgroundSelf-citationPatient engagement in the inpatient setting: a systematic review
Prey, J. E., Woollen, J., Wilcox, L., Sackeim, A. D., Hripcsak, G., Bakken, S., Restaino, S., Feiner, S., & Vawdrey, D. K. (2014) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-002141 · Cited by 261
Bell, S. K., Mejilla, R., Anselmo, M., Darer, J. D., Elmore, J. G., Leveille, S., Ngo, L., Ralston, J. D., Delbanco, T., & Walker, J. (2017) · BMJ Quality & Safety · doi:10.1136/bmjqs-2015-004697 · Cited by 213
Self-citation
Metadata
- Authors
- Leveille, S. G., Walker, J., Ralston, J. D., Ross, S. E., Elmore, J. G., & Delbanco, T.
- Affiliations
- Beth Israel Deaconess Medical Center (US)
- Group Health Cooperative (US)
- University of Colorado Denver (US)
- University of Washington (US)
- Corresponding author
- Leveille, Suzanne G
- Venue
- BMC Medical Informatics and Decision Making
- Published
- 2012-04-13
- Volume
- 12
- Issue
- 1
- Pages
- 32-32
- ISSN
- 1472-6947 (ISSN-L)
- PMC
- PMC3351950
- OpenAlex
- W2145805658
- Semantic Scholar
- f7fd19c0f57204d6f57ee13aa78c4341c0f82e2d
- Cited by
- 89
- References
- 14
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 1 · 2023: 1 · 2022: 6 · 2021: 6 · 2020: 5 · 2019: 6 · 2018: 11 · 2017: 10 · 2016: 16 · 2015: 10 · 2014: 8 · 2013: 5 · 2012: 1
- FWCI
- 12.48
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/2.0 (tdm)
- Locations
- BMC Medical Informatics and Decision Making (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- Robert Wood Johnson Foundation
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Health Sciences › Health Professions › General Health Professions › Patient Satisfaction in Healthcare
- Keywords
- OpenNotes, patient engagement, primary care physicians, patient-doctor communication, online medical records, physician participation, RE-AIM framework, health data transparency
- MeSH terms
- Adult, Attitude of Health Personnel, Attitude to Computers, Boston, Canada, Communication, Female, Humans, Male, Middle Aged, Patients, Pennsylvania, Physician-Patient Relations, Practice Patterns, Physicians', Washington, Computer Peripherals, Medical Records Systems, Computerized, Computer-Aided Design, Internet, Patient Access to Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluating the impact of patients' online access to doctors' visit notes: designing and executing the OpenNotes project. https://app.cochat.ai/papers/10.1186/1472-6947-12-32
- The paper
- Leveille, S. G., Walker, J., Ralston, J. D., Ross, S. E., Elmore, J. G., & Delbanco, T. (2012). Evaluating the impact of patients' online access to doctors' visit notes: designing and executing the OpenNotes project. BMC Medical Informatics and Decision Making. https://doi.org/10.1186/1472-6947-12-32
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.