The design of decisions: Matching clinical decision support recommendations to Nielsen’s design heuristics
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Objective While general design heuristics exist for graphic user interfaces, it remains a challenge to facilitate the implementation of these heuristics for the design of clinical decision support. Our goals were to map a set of recommendations for clinical decision support design found in current literature to Jakob Nielsen’s traditional usability heuristics and to suggest usability areas that need more investigation. Materials and methods Using a modified nominal group process, the research team discussed, classified, and mapped recommendations, organized as interface, information, and interaction, to design heuristics. A previous narrative review identified 42 recommendations from the literature to define the design and functional characteristics that impact the performance of CDS in terms of provider preference, process of care, and patient outcomes. Main findings We matched 20 out of 42 recommendations to heuristics. The mapping reveals gaps in both heuristics and recommendations, identifying a set of Nielsen’s heuristics that are underrepresented in the literature and subsets of recommendations important to design not covered in Nielsen’s heuristics. We attributed this, in part, to the evolution of technology since the inception of Nielsen’s heuristics. The team created a new interaction heuristic: Integration into real-time workflow to consider the needs of the end-user in the clinical space. Discussion Clinical decision support has enabled clinicians to better address arising information needs; however there remains a lack of evidence-based guidelines in terms of functional and design requirements. Conclusion Results from this review suggest that interaction design principles were not fully satisfied by the current literature of clinical decision support.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Garg, A. X., Adhikari, N. K. J., McDonald, H., Rosas-Arellano, M. P., Devereaux, P. J., Beyene, J., Sam, J., & Haynes, R. B. (2005) · JAMA · doi:10.1001/jama.293.10.1223 · Cited by 2,936
Consensus methods: characteristics and guidelines for use
Fink, A., Kosecoff, J., Chassin, M., & Brook, R. H. (1984) · American Journal of Public Health · doi:10.2105/ajph.74.9.979 · Cited by 2,089 · cited 1×
“Recommendations were matched to Nielsen’s heuristics by members of a multi-disciplinary team without prior discussion [24].”
MethodMiddleton, B., Bloomrosen, M., Dente, M. A., Hashmat, B., Koppel, R., Overhage, J. M., Payne, T. H., Rosenbloom, S. T., Weaver, C., & Zhang, J. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001458 · Cited by 618
Using usability heuristics to evaluate patient safety of medical devices
Zhang, J., Johnson, T. R., Patel, V. L., Paige, D. L., & Kubose, T. (2003) · Journal of Biomedical Informatics · doi:10.1016/s1532-0464(03)00060-1 · Cited by 591
Kaplan, B. (2001) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(01)00184-8 · Cited by 380
Phansalkar, S., Edworthy, J., Hellier, E., Seger, D. L., Schedlbauer, A., Avery, A. J., & Bates, D. W. (2010) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.005264 · Cited by 226 · cited 2×
“Much work has been done to identify features critical to success, evaluating clinician performance, workflow, and building frameworks for implementation [14,32,58,61] and yet, there is little consensus on how CDS should be generated and displayed to the user to optimize response [62].”
BackgroundMethodBennett, J. W., & Glasziou, P. P. (2003) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2003.tb05166.x · Cited by 146 · cited 1×
“…status: Interface recommendation to display information in prominent positions to ensure content is seen [14,22,26,27], interaction recommendations to provide timely feedback [10,14,18,19,23,28–35], and to automate alerting and develop automating prompting of users by the CDS [12,13,17,21,36].”
Mollon, B., Chong, J. J., Holbrook, A. M., Sung, M., Thabane, L., & Foster, G. (2009) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-9-11 · Cited by 124
Miller, A., Moon, B., Anders, S., Walden, R., Brown, S., & Montella, D. (2015) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2015.09.005 · Cited by 106
Clinical decision support systems in the pediatric intensive care unit*
Mack, E. H., Wheeler, D. S., & Embi, P. J. (2009) · Pediatric Critical Care Medicine · doi:10.1097/pcc.0b013e3181936b23 · Cited by 76
Cited by
Chaparro, J. D., Beus, J. M., Dziorny, A. C., Hagedorn, P. A., Hernandez, S., Kandaswamy, S., Kirkendall, E. S., McCoy, A. B., Muthu, N., & Orenstein, E. W. (2022) · Applied Clinical Informatics · doi:10.1055/s-0042-1748856 · Cited by 76
Ray, J. M., Ratwani, R. M., Sinsky, C. A., Frankel, R. M., Friedberg, M. W., Powsner, S. M., Rosenthal, D. I., Wachter, R. M., & Melnick, E. R. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz098 · Cited by 34
“37,38 Moreover, the use of smart data entry may aid error prevention by supporting cognitive processing during documentation.”
BackgroundAbdulaal, A., Patel, A., Al-Hindawi, A., Charani, E., Alqahtani, S. A., Davies, G. W., Mughal, N., & Moore, L. S. P. (2021) · JMIR Formative Research · doi:10.2196/27992 · Cited by 13
“Many found it simple to navigate the GUI and input patient data, with the app being “not too wordy, easy to use” [Participant #9, senior house officer].”
MethodInfluential
Metadata
- Authors
- Miller, K., Capan, M., Weldon, D., Noaiseh, Y., Kowalski, R., Kraft, R., Schwartz, S., Weintraub, W. S., & Arnold, R.
- Venue
- International Journal of Medical Informatics
- Publisher
- Elsevier BV
- Published
- 2018-09
- Volume
- 117
- Pages
- 19-25
- ISSN
- 1386-5056 (ISSN-L)
- OpenAlex
- W2803972637
- Cited by
- 50
- References
- 10
- FWCI
- 6.22
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The design of decisions: Matching clinical decision support recommendations to Nielsen’s design heuristics. https://app.cochat.ai/papers/10.1016/j.ijmedinf.2018.05.008
- The paper
- Miller, K., Capan, M., Weldon, D., Noaiseh, Y., Kowalski, R., Kraft, R., Schwartz, S., Weintraub, W. S., & Arnold, R. (2018). The design of decisions: Matching clinical decision support recommendations to Nielsen’s design heuristics. International Journal of Medical Informatics. https://doi.org/10.1016/j.ijmedinf.2018.05.008
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.