Evaluating User Experiences of the Secure Messaging Tool on the Veterans Affairs’ Patient Portal System
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The United States Department of Veterans Affairs has implemented an electronic asynchronous "Secure Messaging" tool within a Web-based patient portal (ie, My HealtheVet) to support patient-provider communication. This electronic resource promotes continuous and coordinated patient-centered care, but to date little research has evaluated patients' experiences and preferences for using Secure Messaging. OBJECTIVE: The objectives of this mixed-methods study were to (1) characterize veterans' experiences using Secure Messaging in the My HealtheVet portal over a 3-month period, including system usability, (2) identify barriers to and facilitators of use, and (3) describe strategies to support veterans' use of Secure Messaging. METHODS: We recruited 33 veterans who had access to and had previously used the portal's Secure Messaging tool. We used a combination of in-depth interviews, face-to-face user-testing, review of transmitted secure messages between veterans and staff, and telephone interviews three months following initial contact. We assessed participants' computer and health literacy during initial and follow-up interviews. We used a content-analysis approach to identify dominant themes in the qualitative data. We compared inferences from each of the data sources (interviews, user-testing, and message review) to identify convergent and divergent data trends. RESULTS: The majority of veterans (27/33, 82%) reported being satisfied with Secure Messaging at initial interview; satisfaction ratings increased to 97% (31/32, 1 missing) during follow-up interviews. Veterans noted Secure Messaging to be useful for communicating with their primary care team to manage health care needs (eg, health-related questions, test requests and results, medication refills and questions, managing appointments). Four domains emerged from interviews: (1) perceived benefits of using Secure Messaging, (2) barriers to using Secure Messaging, (3) facilitators for using Secure Messaging, and (4) suggestions for improving Secure Messaging. Veterans identified and demonstrated impediments to successful system usage that can be addressed with education, skill building, and system modifications. Analysis of secure message content data provided insights to reasons for use that were not disclosed by participants during interviews, specifically sensitive health topics such as erectile dysfunction and sexually transmitted disease inquiries. CONCLUSIONS: Veterans perceive Secure Messaging in the My HealtheVet patient portal as a useful tool for communicating with health care teams. However, to maximize sustained utilization of Secure Messaging, marketing, education, skill building, and system modifications are needed. Data from this study can inform a large-scale quantitative assessment of Secure Messaging users' experiences in a representative sample to validate qualitative findings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
How Many Interviews Are Enough?: An Experiment with Data Saturation and Variability
Guest, G., Bunce, A., & Johnson, L. (2006) · Field Methods · doi:10.1177/1525822x05279903 · Cited by 20,808
Sample size in qualitative research
Sandelowski, M. (1995) · Research in Nursing & Health · doi:10.1002/nur.4770180211 · Cited by 4,372
Mathieson, K. (1991) · Information Systems Research · doi:10.1287/isre.2.3.173 · Cited by 4,216
eHEALS: The eHealth Literacy Scale
Norman, C. D., & Skinner, H. A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e27 · Cited by 2,680 · cited 1×
“The eHEALS is a 10-item measure of eHealth literacy developed to measure consumers’knowledge, comfort, and perceived skills at finding, evaluating, and applying electronic health information to health problems [19].”
Background
Cited by
Patient Portals and Patient Engagement: A State of the Science Review
Irizarry, T., DeVito Dabbs, A., & Curran, C. R. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4255 · Cited by 732
“Four studies [64,85,88,91] identified conceptual knowledge, numeracy, and computer skills as particularly important literacy factors that contributed to successful patient engagement via a patient portal.”
BackgroundInfluentialKruse, C. S., Bolton, K., & Freriks, G. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3171 · Cited by 379
Kruse, C. S., Argueta, D. A., Lopez, L., & Nair, A. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3703 · Cited by 327
Varsi, C., Ekstedt, M., Gammon, D., & Ruland, C. M. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.5091 · Cited by 191
Hoonakker, P. L. T., Carayon, P., & Cartmill, R. S. (2017) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2017.01.004 · Cited by 60
Patient-centered communication in digital medical encounters
Alpert, J. M., Dyer, K. E., & Lafata, J. E. (2017) · Patient Education and Counseling · doi:10.1016/j.pec.2017.04.019 · Cited by 47
“Patients who use online portals enjoy their convenience[20] and report enhanced satisfaction, greater efficiency, and higher-quality face-to-face visits[21].”
BackgroundWhealin, J. M., Jenchura, E. C., Wong, A. C., & Zulman, D. M. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5594 · Cited by 30
“For example, veterans have been reported to access Web-based medical information [29], communicate with providers over secure messaging [30], access personal health records (PHRs) [31], and use Web-based and mobile apps to manage their symptoms [32].”
Haun, J. N., Alman, A. C., Melillo, C., Standifer, M., McMahon-Grenz, J., Shin, M., Lapcevic, W. A., Patel, N., & Elwy, A. R. (2020) · JMIR Medical Informatics · doi:10.2196/15609 · Cited by 22
“This is commensurate with the established expectations of response rates based on our previous work [19,32].”
ResultSelf-citation
Metadata
- Authors
- Haun, J. N., Lind, J. D., Shimada, S. L., Martin, T. L., Gosline, R. M., Antinori, N., Stewart, M., & Simon, S. R.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2014-03-06
- Volume
- 16
- Issue
- 3
- Pages
- e75
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2118836610
- Cited by
- 138
- References
- 4
- FWCI
- 24.30
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.