Applying Multiple Methods to Comprehensively Evaluate a Patient Portal’s Effectiveness to Convey Information to Patients
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Patient portals have yet to achieve their full potential for enhancing health communication and improving health outcomes. Although the Patient Protection and Affordable Care Act in the United States mandates the utilization of patient portals, and usage continues to rise, their impact has not been as profound as anticipated. OBJECTIVE: The objective of our case study was to evaluate how well portals convey information to patients. To demonstrate how multiple methodologies could be used to evaluate and improve the design of patient-centered portals, we conducted an in-depth evaluation of an exemplar patient-centered portal designed to promote preventive care to consumers. METHODS: We used 31 critical incident patient interviews, 2 clinician focus groups, and a thematic content analysis to understand patients' and clinicians' perspectives, as well as theoretical understandings of the portal's use. RESULTS: We gathered over 140 critical incidents, 71.8% (102/142) negative and 28.2% (40/142) positive. Positive incident categories were (1) instant medical information access, (2) clear health information, and (3) patient vigilance. Negative incident categories were (1) standardized content, (2) desire for direct communication, (3) website functionality, and (4) difficulty interpreting laboratory data. Thematic analysis of the portal's immediacy resulted in high scores in the attributes enhances understanding (18/23, 78%), personalization (18/24, 75%), and motivates behavior (17/24, 71%), but low levels of interactivity (7/24, 29%) and engagement (2/24, 8%). Two overarching themes emerged to guide portal refinements: (1) communication can be improved with directness and interactivity and (2) perceived personalization must be greater to engage patients. CONCLUSIONS: Results suggest that simple modifications, such as increased interactivity and personalized messages, can make portals customized, robust, easily accessible, and trusted information sources.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A behavior model for persuasive design
Fogg, B. (2009) · Proceedings of the 4th International Conference on Persuasive Technology · doi:10.1145/1541948.1541999 · Cited by 2,328 · cited 1×
“Motivators are triggers, prompts, cues, or calls to action that encourage a user to take action [39].”
Value from hedonic experience and engagement
Higgins, E. T. (2006) · Psychological Review · doi:10.1037/0033-295x.113.3.439 · Cited by 949 · cited 1×
“Combining definitions from the fields of marketing [36], media [37], and psychology [38], engagement is considered the level of an individual’s physical, cognitive, and emotional involvement or connection with a specific medium.”
Patient Portals and Patient Engagement: A State of the Science Review
Irizarry, T., DeVito Dabbs, A., & Curran, C. R. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4255 · Cited by 732
Greenhalgh, T., Hinder, S., Stramer, K., Bratan, T., & Russell, J. (2010) · BMJ · doi:10.1136/bmj.c5814 · Cited by 343 · cited 1×
“However, thus far there has been little evidence to demonstrate that portals can create a sense of immediacy [16].”
Promise of and potential for patient-facing technologies to enable meaningful use
Ahern, D. K., Woods, S. S., Lightowler, M. C., Finley, S. W., & Houston, T. K. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2011.01.005 · Cited by 189
Cited by
Interventions to increase patient portal use in vulnerable populations: a systematic review
Grossman, L. V., Masterson Creber, R. M., Benda, N. C., Wright, D., Vawdrey, D. K., & Ancker, J. S. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz023 · Cited by 251
Laukka, E., Huhtakangas, M., Heponiemi, T., Kujala, S., Kaihlanen, A.-M., Gluschkoff, K., & Kanste, O. (2020) · Journal of Medical Internet Research · doi:10.2196/21623 · Cited by 65
“Thus, the professionals had to ensure by phone that patients really had received the information [38].”
BackgroundInfluentialThe relevance of health literacy to mHealth
Kreps, G. L. (2017) · Information Services and Use · doi:10.3233/isu-170828 · Cited by 62
Self-citationImpact of Patient Online Record Access on Documentation: Scoping Review
Meier-Diedrich, E., Lyckblad, C., Davidge, G., Hägglund, M., Kharko, A., McMillan, B., Blease, C., & Schwarz, J. (2025) · Journal of Medical Internet Research · doi:10.2196/64762 · Cited by 15
Impact of Patient Online Record Access on Documentation: Scoping Review (Preprint)
Meier-Diedrich, E., Lyckblad, C., Davidge, G., Hägglund, M., Kharko, A., McMillan, B., Blease, C., & Schwarz, J. (2024) · doi:10.2196/preprints.64762 · Cited by 15
Metadata
- Authors
- Alpert, J. M., Krist, A. H., Aycock, R. A., & Kreps, G. L.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2016-05-17
- Volume
- 18
- Issue
- 5
- Pages
- e112
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2401264319
- Cited by
- 61
- References
- 5
- FWCI
- 13.02
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.