User-centered design and the development of patient decision aids: protocol for a systematic review
Open accessThe DOI matches its Crossref record; 41 of the 42 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Providing patient-centered care requires that patients partner in their personal health-care decisions to the full extent desired. Patient decision aids facilitate processes of shared decision-making between patients and their clinicians by presenting relevant scientific information in balanced, understandable ways, helping clarify patients' goals, and guiding decision-making processes. Although international standards stipulate that patients and clinicians should be involved in decision aid development, little is known about how such involvement currently occurs, let alone best practices. This systematic review consisting of three interlinked subreviews seeks to describe current practices of user involvement in the development of patient decision aids, compare these to practices of user-centered design, and identify promising strategies. METHODS/DESIGN: A research team that includes patient and clinician representatives, decision aid developers, and systematic review method experts will guide this review according to the Cochrane Handbook and PRISMA reporting guidelines. A medical librarian will hand search key references and use a peer-reviewed search strategy to search MEDLINE, EMBASE, PubMed, Web of Science, the Cochrane Library, the ACM library, IEEE Xplore, and Google Scholar. We will identify articles across all languages and years describing the development or evaluation of a patient decision aid, or the application of user-centered design or human-centered design to tools intended for patient use. Two independent reviewers will assess article eligibility and extract data into a matrix using a structured pilot-tested form based on a conceptual framework of user-centered design. We will synthesize evidence to describe how research teams have included users in their development process and compare these practices to user-centered design methods. If data permit, we will develop a measure of the user-centeredness of development processes and identify practices that are likely to be optimal. DISCUSSION: This systematic review will provide evidence of current practices to inform approaches for involving patients and other stakeholders in the development of patient decision aids. We anticipate that the results will help move towards the establishment of best practices for the development of patient-centered tools and, in turn, help improve the experiences of people who face difficult health decisions. SYSTEMATIC REVIEW REGISTRATION: PROSPERO CRD42014013241.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“User-centered design is an approach that involves end-users in designing applications, and has been shown to increase the usability of applications [13, 14].”
From Development of a decision guide to support the elderly in decision making about location of care: an iterative, user-centered design (2016) · cites this paper as [14]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Regarding DA development, there is little evidence about effective methods to involve patients [14, 36].”
From Development of a decision guide to support the elderly in decision making about location of care: an iterative, user-centered design (2016) · cites this paper as [14]
The cited source says what the claim attributes to it.
In the citing paper
“Although DA development is often presented as a linear process [19], the separate development phases are better described as an ongoing cyclical process [14, 32].”
From Development of a decision guide to support the elderly in decision making about location of care: an iterative, user-centered design (2016) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Decision aids for people facing health treatment or screening decisions
Stacey, D., Légaré, F., Lewis, K., Barry, M. J., Bennett, C. L., Eden, K. B., Holmes-Rovner, M., Llewellyn-Thomas, H., Lyddiatt, A., Thomson, R., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001431.pub5 · Cited by 6,685
Self-citationNorman, D. (2016) · Vahlen eBooks · doi:10.15358/9783800648108 · Cited by 6,374
Shared decision making — The pinnacle of patient-centered care
Barry, M. J., & Edgman-Levitan, S. (2012) · New England Journal of Medicine · doi:10.1056/nejmp1109283 · Cited by 3,433 · cited 1×
“…from a health-care professional in the process of shared decision-making [8] and provide a means for clinicians and patients to collaboratively incorporate their expertise, insights, and views in order to make evidence-based health decisions that are aligned with patients ’ preferences [9,10].”
BackgroundDesigning for usability: key principles and what designers think
Gould, J. D., & Lewis, C. (1985) · Communications of the ACM · doi:10.1145/3166.3170 · Cited by 2,066 · cited 1×
“Figure 1 shows a visual depiction of user-centered design, distilled from seminal work in the field of Human Factors [18,20,22,31-33].”
MethodElwyn, G. (2006) · BMJ · doi:10.1136/bmj.38926.629329.ae · Cited by 1,824 · cited 1×
“However, due to the lack of a robust evidence base from which to draw conclusions about best practices, practical guidance is minimal and vague [11-14].”
BackgroundAn integrative model of shared decision making in medical encounters
Makoul, G., & Clayman, M. L. (2006) · Patient Education and Counseling · doi:10.1016/j.pec.2005.06.010 · Cited by 1,621 · cited 1×
“…intended to be used by patients to complement information and counseling from a health-care professional in the process of shared decision-making [8] and provide a means for clinicians and patients to collaboratively incorporate their expertise, insights, and views in order to make…”
BackgroundTalking about tactile experiences
Obrist, M., Seah, S. A., & Subramanian, S. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466220 · Cited by 1,613
Brett, J., Staniszewska, S., Mockford, C., Herron‐Marx, S., Hughes, J., Tysall, C., & Suleman, R. (2014) · Health Expectations · doi:10.1111/j.1369-7625.2012.00795.x · Cited by 1,598 · cited 1×
“Patient partnership in research teams is increasingly encouraged or required by funding organizations [3-6].”
Background(1987) · Andalas University Repository (Andalas University) · Cited by 1,584
Decision aids for people facing health treatment or screening decisions
Stacey, D., Légaré, F., Col, N. F., Bennett, C. L., Barry, M. J., Eden, K. B., Holmes-Rovner, M., Llewellyn-Thomas, H., Lyddiatt, A., Thomson, R., et al. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001431.pub4 · Cited by 1,471 · cited 7×
“Patient decision aids are structured tools, often booklets or websites, that aim to provide unbiased, evidence-based information and guidance to patients making health decisions [7].”
BackgroundMethodInfluentialSelf-citationPluye, P., Gagnon, M.-P., Griffiths, F., & Johnson-Lafleur, J. (2009) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2009.01.009 · Cited by 1,119 · cited 1×
“The quality of each article will be appraised by two independent reviewers using adapted established quality criteria for scoring and appraising studies in a mixed method review [38].”
MethodBeyond the five-user assumption: benefits of increased sample sizes in usability testing
Faulkner, L. (2003) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195514 · Cited by 1,053 · cited 1×
“Research in the field of user-centered design in non-health contexts offers some guidance regarding, for example, how many potential users might need to participate in a software development process to ensure that a product is fully usable [34-36].”
BackgroundSystematic review of involving patients in the planning and development of health care
Crawford, M. J., Rutter, D., Manley, C., Weaver, T., Bhui, K., Fulop, N., & Tyrer, P. (2002) · BMJ · doi:10.1136/bmj.325.7375.1263 · Cited by 983 · cited 1×
“…are increasingly becoming involved in health research, not only as research participants but as partners with valuable expertise, perspectives, and insights for setting agendas, planning and carrying out projects, interpreting findings, and translating new knowledge to patient communities [1,2].”
BackgroundThe Art of Innovation: Lessons in Creativity from IDEO, America's Leading Design Firm
Kelley, T. (2001) · Cited by 943
Abras, C. N., Maloney-Krichmar, D., & Preece, J. J. (2004) · Cited by 853
Patient Participation: Current Knowledge and Applicability to Patient Safety
Longtin, Y., Sax, H., Leape, L. L., Sheridan, S. E., Donaldson, L., & Pittet, D. (2010) · Mayo Clinic Proceedings · doi:10.4065/mcp.2009.0248 · Cited by 805
Encyclopedia of Human Computer Interaction
(2006) · IGI Global eBooks · doi:10.4018/978-1-59140-562-7 · Cited by 763
Stop the silent misdiagnosis: patients' preferences matter
Mulley, A. G., Trimble, C., & Elwyn, G. (2012) · BMJ · doi:10.1136/bmj.e6572 · Cited by 638 · cited 1×
“…from a health-care professional in the process of shared decision-making [8] and provide a means for clinicians and patients to collaboratively incorporate their expertise, insights, and views in order to make evidence-based health decisions that are aligned with patients ’ preferences [9,10].”
BackgroundO'Connor, A. M., Tugwell, P., Wells, G. A., Elmslie, T., Jolly, E., Hollingworth, G., McPherson, R., Bunn, H., Graham, I., & Drake, E. (1998) · Patient Education and Counseling · doi:10.1016/s0738-3991(98)00026-3 · Cited by 638
A systematic development process for patient decision aids
Coulter, A., Stilwell, D., Kryworuchko, J., Mullen, P. D., Ng, C. J., & van der Weijden, T. (2013) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-13-s2-s2 · Cited by 615 · cited 2×
“However, due to the lack of a robust evidence base from which to draw conclusions about best practices, practical guidance is minimal and vague [11-14].”
BackgroundSelf-citationThe PCORI Perspective on Patient-Centered Outcomes Research
Frank, L., Basch, E., & Selby, J. V. (2014) · JAMA · doi:10.1001/jama.2014.11100 · Cited by 583 · cited 1×
“Patient partnership in research teams is increasingly encouraged or required by funding organizations [3-6].”
BackgroundThe usability engineering life cycle
Nielsen, J. (1992) · Computer · doi:10.1109/2.121503 · Cited by 577 · cited 1×
“[18,20,22,31-33].”
Elwyn, G., O'Connor, A. M., Bennett, C., Newcombe, R. G., Politi, M., Durand, M.-A., Drake, E., Joseph-Williams, N., Khangura, S., Saarimaki, A., et al. (2009) · PLoS ONE · doi:10.1371/journal.pone.0004705 · Cited by 466 · cited 1×
“However, due to the lack of a robust evidence base from which to draw conclusions about best practices, practical guidance is minimal and vague [11-14].”
BackgroundSelf-citationThe state of user-centered design practice
Mao, J.-Y., Vredenburg, K., Smith, P. W., & Carey, T. (2005) · Communications of the ACM · doi:10.1145/1047671.1047677 · Cited by 465 · cited 1×
“Figure 1 shows a visual depiction of user-centered design, distilled from seminal work in the field of Human Factors [18,20,22,31-33].”
MethodEncyclopedia of Human-Computer Interaction
Baskerville, R., & Stage, J. (2004) · Cited by 403
Usability testing: a review of some methodological and technical aspects of the method
Bastien, J. M. C. (2010) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2008.12.004 · Cited by 388 · cited 1×
“Research in the field of user-centered design in non-health contexts offers some guidance regarding, for example, how many potential users might need to participate in a software development process to ensure that a product is fully usable [34-36].”
Background(2008) · doi:10.1016/b978-0-12-373558-4.x0001-5 · Cited by 287
Designing the user interface: An interview with Robert Graf
Hunter, L. (2003) · Document Design · doi:10.1075/dd.4.1.02hun · Cited by 261
Time to accelerate integration of human factors and ergonomics in patient safety: Table 1
Gurses, A. P., Ozok, A. A., & Pronovost, P. J. (2012) · BMJ Quality & Safety · doi:10.1136/bmjqs-2011-000421 · Cited by 203 · cited 1×
“…our research questions and data extraction plan, we will use a conceptual framework of user-centered design, a longstanding and proven framework and methodology for the development of products, services, and systems [18-22] that has yet to be widely applied in the domain of health care [23-27].”
MethodThe elements of user experience: user-centered design for the Web
Deaton, M. (2003) · Interactions · doi:10.1145/889692.889709 · Cited by 190
Creating a Conversation: Insights from the Development of a Decision Aid
Montori, V. M., Breslin, M., Maleska, M., & Weymiller, A. J. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040233 · Cited by 158 · cited 1×
“Leaders in the field have offered insights based on their experiences of developing decision aids, including the importance of consulting with patients and other stakeholders [15-17], but there is little empirical evidence available about methods for putting patients at the center of the process.”
BackgroundSelf-citationHow to develop web-based decision support interventions for patients: A process map
Elwyn, G. J., Kreuwel, I., Durand, M., Sivell, S., Joseph‐Williams, N., Evans, R. M., & Edwards, A. (2010) · Patient Education and Counseling · doi:10.1016/j.pec.2010.04.034 · Cited by 153 · cited 1×
“stakeholders [15-17], but there is little empirical evidence available about methods for putting patients at the center of the process.”
BackgroundLindgaard, G., & Chattratichart, J. (2007) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.1240839 · Cited by 125 · cited 1×
“offers some guidance regarding, for example, how many potential users might need to participate in a software development process to ensure that a product is fully usable [34-36].”
BackgroundIt is time to talk about people: a human-centered healthcare system
Searl, M. M., Borgi, L., & Chemali, Z. (2010) · Health Research Policy and Systems · doi:10.1186/1478-4505-8-35 · Cited by 88 · cited 1×
“To structure our research questions and data extraction plan, we will use a conceptual framework of user-centered design, a longstanding and proven framework and methodology for the development of products, services, and systems [18-22] that has yet to be widely applied in the domain of health care [23-27].”
MethodObserving the User Experience, Second Edition: A Practitioner's Guide to User Research
Goodman, E., Kuniavsky, M., & Moed, A. (2012) · Morgan Kaufmann Publishers Inc. eBooks · Cited by 59
A Deliberate and Rigorous Approach to Development of Patient-Centered Technologies
Wolpin, S., & Stewart, M. (2011) · Seminars in Oncology Nursing · doi:10.1016/j.soncn.2011.04.003 · Cited by 54 · cited 1×
“To structure our research questions and data extraction plan, we will use a conceptual framework of user-centered design, a longstanding and proven framework and methodology for the development of products, services, and systems [18-22] that has yet to be widely applied in the domain of health care [23-27].”
Method(2012) · Elsevier eBooks · doi:10.1016/c2010-0-64844-9 · Cited by 41
Human Factors Engineering in HI: So What? Who Cares? and What's in It for You?
Elkin, P. L. (2012) · Healthcare Informatics Research · doi:10.4258/hir.2012.18.4.237 · Cited by 28 · cited 1×
“To structure our research questions and data extraction plan, we will use a conceptual framework of user-centered design, a longstanding and proven framework and methodology for the development of products, services, and systems [18-22] that has yet to be widely applied in the domain of health care [23-27].”
MethodFederal government unveils patient-oriented research strategy
Collier, R. (2011) · Canadian Medical Association Journal · doi:10.1503/cmaj.109-3978 · Cited by 23 · cited 1×
“Patient partnership in research teams is increasingly encouraged or required by funding organizations [3-6].”
BackgroundUser-Centered Design: Clothing The EMR Emperor
Schaeffer, M., & MOORE, B. J. (2012) · Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care · doi:10.1518/hcs-2012.945289401.029 · Cited by 2 · cited 1×
“To structure our research questions and data extraction plan, we will use a conceptual framework of user-centered design, a longstanding and proven framework and methodology for the development of products, services, and systems [18-22] that has yet to be widely applied in the domain of health care [23-27].”
Method
Research works printed but not linked: 4
- 3. Topic of conversation. Den Haag. Netherlands: Dutch organization for health and innovation in healthcare; 2010. p. 1-17.
- 13. Coulter A, Kryworuchko J, Mullen PD, Ng CJ, Stillwell D, van der Weijden T. Chapter A: using a systematic development process. In: Volk RJ, Llewellyn-Thomas HA, editors. 2012 update of the international patient decision Aid standards (IPDAS) Collaboration's background document. 2012. p. 1-16. Available at: http://ipdas.ohri.ca/IPDAS-Chapter-A.pdf.
- 22. Iso DIS. 9241-210:2010: ergonomics of human-system interaction-part 210: human-centred design for interactive systems (formerly known as 13407). Switzerland: International Standards Organization; 2010.
- 28. Garrett JJ. Elements of user experience. 2nd ed. New Riders: Berkeley, CA; 2011.
Cited by
Renal Mass and Localized Renal Cancer: AUA Guideline
Campbell, S., Uzzo, R. G., Allaf, M. E., Bass, E. B., Cadeddu, J. A., Chang, A., Clark, P. E., Davis, B. J., Derweesh, I. H., Giambarresi, L., et al. (2017) · Journal of Urology · doi:10.1016/j.juro.2017.04.100 · Cited by 1,242
Increasing Vaccination: Putting Psychological Science Into Action
Brewer, N. T., Chapman, G. B., Rothman, A. J., Leask, J., & Kempe, A. (2017) · Psychological Science in the Public Interest · doi:10.1177/1529100618760521 · Cited by 1,233
Renal Mass and Localized Renal Cancer: Evaluation, Management, and Follow-Up: AUA Guideline: Part I
Campbell, S. C., Clark, P. E., Chang, S. S., Karam, J. A., Souter, L., & Uzzo, R. G. (2021) · Journal of Urology · doi:10.1097/ju.0000000000001911 · Cited by 775
“The development of aids to improve informed medical decision-making is ongoing.(49) Management: Randomized prospective trials comparing PN versus RN,(24,50) PN versus TA, standard PN versus TE, and AS versus intervention, should be prioritized to assess oncologic and functional outcomes and treatment-related morbiditi…”
Design Thinking in Health Care
Altman, M., Huang, T. T. K., & Breland, J. Y. (2018) · Preventing Chronic Disease · doi:10.5888/pcd15.180128 · Cited by 548
Sepucha, K. R., Abhyankar, P., Hoffman, A. S., Bekker, H. L., LeBlanc, A., Levin, C. A., Ropka, M., Shaffer, V. A., Sheridan, S. L., Stacey, D., et al. (2018) · BMJ Quality & Safety · doi:10.1136/bmjqs-2017-006986 · Cited by 204
“…several issues that the IPDAS-RG had also discussed, including the potential overlap with existing guidelines, feasibility of including the information in an evaluation paper, potential overlap with work being done on developing guidelines for PDA development process 28 and relationship to IPDAS.”
MethodSelf-citation
Metadata
- Authors
- Witteman, H. O., Dansokho, S. C., Colquhoun, H., Coulter, A., Dugas, M., Fagerlin, A., Giguere, A. M., Glouberman, S., Haslett, L., Hoffman, A., Ivers, N., Légaré, F., Légaré, J., Levin, C., Lopez, K., Montori, V. M., Provencher, T., Renaud, J.-S., Sparling, K., Stacey, D., Vaisson, G., Volk, R. J., & Witteman, W.
- Affiliations
- Université Laval (CA)
- University of Oxford (GB)
- University of Michigan (US)
- Hôpital du Saint-Sacrement (CA)
- Dartmouth Institute for Health Policy and Clinical Practice (US)
- University of Toronto (CA)
- Centre hospitalier universitaire de Québec (CA)
- Healthwise (US)
- University of Ottawa (CA)
- The University of Texas MD Anderson Cancer Center (US)
- Corresponding author
- Witteman, Holly O
- ORCID
- Venue
- Systematic Reviews
- Published
- 2015-01-26
- Volume
- 4
- Issue
- 1
- Pages
- 11-11
- ISSN
- 2046-4053 (ISSN-L)
- PMC
- PMC4328638
- OpenAlex
- W2117757460
- Semantic Scholar
- dadd30861520033b7f49f7cc9644c21f6d327f7d
- Cited by
- 202
- References
- 42
- Citations by year
- 2026: 9 · 2025: 12 · 2024: 10 · 2023: 22 · 2022: 13 · 2021: 34 · 2020: 22 · 2019: 21 · 2018: 28 · 2017: 13 · 2016: 13 · 2015: 5
- FWCI
- 3.53
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Systematic Reviews (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- TSpace (University of Toronto) (acceptedVersion)
- Funders
- Patient-Centered Outcomes Research Institute (ME-1306-03174)
- University of Ottawa
- University of Toronto
- Canadian Institutes of Health Research
- Department of Family and Community Medicine, University of Toronto
- National Institute on Aging
- Topics
- Health Sciences › Health Professions › General Health Professions › Patient-Provider Communication in Healthcare
- Health Sciences › Health Professions › General Health Professions › Mental Health and Patient Involvement
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- patient decision aids, user-centered design, shared decision-making, human-centered design, patient-centered care, stakeholder engagement, best practices, health decision-making
- MeSH terms
- Systematic Reviews as Topic, Decision Making, Decision Support Techniques, Health Services Research, Humans, Patient Education as Topic, Patient Participation, Patient-Centered Care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

