Usability Study of a Computer-Based Self-Management System for Older Adults with Chronic Diseases
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Usability can influence patients' acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. OBJECTIVE: This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. METHODS: Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants' comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. RESULTS: The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. CONCLUSIONS: This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users' true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
Content Analysis: An Introduction to Its Methodology
Krippendorff, K. (2019) · doi:10.4135/9781071878781 · Cited by 15,448
Nielsen, J. (1994) · Conference companion on Human factors in computing systems - CHI '94 · doi:10.1145/259963.260531 · Cited by 2,759
Stimulus information as a determinant of reaction time.
Hyman, R. (1953) · Journal of Experimental Psychology · doi:10.1037/h0056940 · Cited by 1,443 · cited 1×
“Based on the participants’ comments about the end-user test and our observation, it appeared that the menu offered too many choices that added decision complexity (see the Hick-Hyman Law [46,47]).”
Fisk, A. D., Rogers, W. A., Charness, N., Czaja, S. J., & Sharit, J. (2004) · doi:10.1201/9781420023862 · Cited by 781
Jaspers, M. W. M. (2009) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.10.002 · Cited by 649 · cited 2×
“Our study showed that using multiple evaluation approaches could help identify more potential problems and should be a more reliable practice for conducting usability studies (also noted in the literature; see [30,33]).”
A Systematic Review of Patient Acceptance of Consumer Health Information Technology
Or, C. K. L., & Karsh, B.-T. (2009) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2888 · Cited by 586
Self-citationLow vs. high-fidelity prototyping debate
Rudd, J., Stern, K., & Isensee, S. (1996) · Interactions · doi:10.1145/223500.223514 · Cited by 422
Designing for Older Adults: Principles and Creative Human Factors Approaches, Second Edition
Fisk, A. D., Czaja, S. J., Rogers, W. A., Charness, N., Czaja, S. J., & Sharit, J. (2018) · doi:10.1201/9781420080681 · Cited by 396
Review of health information technology usability study methodologies
Yen, P.-Y., & Bakken, S. (2012) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2010-000020 · Cited by 390 · cited 1×
“Third, one of the main criticisms of previous studies on health IT usability has been the lack of a theoretical basis for the development of the study methodology [50].”
Web evaluation: Heuristic evaluation vs. user testing
Tan, W.-S., Liu, D., & Bishu, R. (2009) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2008.02.012 · Cited by 170 · cited 3×
“Our study showed that using multiple evaluation approaches could help identify more potential problems and should be a more reliable practice for conducting usability studies (also noted in the literature; see [30,33]).”
Applying heuristic evaluation to improve the usability of a telemedicine system
Tang, Z., Johnson, T. R., Tindall, R. D., & Zhang, J. (2006) · Telemedicine and e-Health · doi:10.1089/tmj.2006.12.24 · Cited by 102 · cited 1×
“For example, Tang and colleagues [12] applied the heuristics evaluation, a usability engineering method, to examine the usability of a digital emergency medical service system designed for paramedics to input patient data.”
Cited by
Wildenbos, G. A., Peute, L., & Jaspers, M. (2018) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2018.03.012 · Cited by 495
Bertolazzi, A., Quaglia, V., & Bongelli, R. (2024) · BMC Public Health · doi:10.1186/s12889-024-18036-5 · Cited by 399
Wildenbos, G. A., Jaspers, M. W. M., Schijven, M. P., & Dusseljee- Peute, L. W. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.01.006 · Cited by 245
Georgsson, M., & Staggers, N. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv099 · Cited by 200
“Studies also need to be conducted on the effects of relevant user demographics because they can affect requirements including the design of future decision aids for chronic disease.(15,16) Specific user characteristics can produce differences in task performance, but how and in what way is not completely understood fo…”
BackgroundXie, Z., Liu, K., Or, C., Chen, J., Yan, M., & Wang, H. (2020) · BMC Public Health · doi:10.1186/s12889-020-09274-4 · Cited by 184
Self-citation
Metadata
- Authors
- Or, C., & Tao, D.
- Venue
- JMIR Research Protocols
- Publisher
- JMIR Publications Inc.
- Published
- 2012-11-08
- Volume
- 1
- Issue
- 2
- Pages
- e13
- ISSN
- 1929-0748 (ISSN-L)
- OpenAlex
- W2027368569
- Cited by
- 100
- References
- 12
- FWCI
- 7.25
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.