The DOI matches its Crossref record; 84 of the 84 references it cites were found in a registry or an index.
Leveraging human-centered design to implement modern psychological science: Return on an early investment.
Open accessAbstract
Although classic models of implementation emphasized the importance of innovation characteristics in their adoption and sustained use, contemporary implementation research and practice have deprioritized these variables. Human-centered design (HCD) is an approach that grounds product development in information collected about the people and settings that will ultimately use those products. HCD has strong roots in psychological theory, but its application is typically limited to the development of digital technologies. HCD is rarely applied to the design of psychosocial innovations-including both service-recipient-facing interventions and implementation strategies-within the applied psychological disciplines. The current article reviews the psychological origins of HCD and details pathways through which HCD theories and methods can be leveraged to advance the "core tasks" of contemporary implementation research and practice in psychology. These include (a) identification of multilevel implementation determinants through specification of user needs and contexts; (b) tailoring of implementation strategies, such as contextually driven intervention redesign; and (c) evaluating implementation mechanisms and outcomes, including disentangling how the core HCD focus on usability relates to closely associated implementation variables such as acceptability, feasibility, and appropriateness. Collectively, these applications provide directions through which to leverage the mature field of HCD, maximize psychology's return on its early theoretical investment, and promote the large-scale impact of findings from across the applied fields of psychology. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The project’s approach was grounded in HCD, an iterative approach to problem solving in which stakeholders are involved in all steps, from problem identification through prototype testing and evaluation (7, 8).”
From Cocreating the ICU-PAUSE Tool for Intensive Care Unit–Ward Transitions (2022) · cites this paper as [7]
The cited source says what the claim attributes to it.
In the citing paper
“Accordingly, we used human-centered design methods across multiple internal medicine residency programs to create and iteratively prototype a structured ICU-to-ward transfer tool embedded within the electronic health record (EHR) [11].”
From Improving Communication in Intensive Care Unit to Ward Transitions: Protocol for Multisite National Implementation of the ICU-PAUSE Handoff Tool (2023) · cites this paper as [11]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,670
(1975) · PhilPapers (PhilPapers Foundation) · Cited by 36,737
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 3×
“Cognitive load theory (Sweller, 1988) Error reduction Users can prevent or rapidly recover from misapplications of intervention components.”
BackgroundProctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721
International Organization for Standardization
Gargaud, M., Irvine, W. M., Amils, R., Pinti, D. L., Cernicharo, J., Rouan, D., Spohn, T., Tirard, S., & Viso, M. (2015) · Encyclopedia of Astrobiology · doi:10.1007/978-3-662-44185-5_100574 · Cited by 6,716
Norman, D. A. (2016) · Vahlen eBooks · doi:10.15358/9783800648108 · Cited by 6,415
Baddeley, A. (1992) · Science · doi:10.1126/science.1736359 · Cited by 5,258
Powell, B. J., Waltz, T. J., Chinman, M. J., Damschroder, L. J., Smith, J. L., Matthieu, M. M., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0209-1 · Cited by 4,963
The Psychology of Everyday Things
Massaro, D. W., & Norman, D. A. (1990) · The American Journal of Psychology · doi:10.2307/1423268 · Cited by 3,484
Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0327-7 · Cited by 3,240
A neural system for error detection and compensation
Gehring, W. J., Goss, B., Coles, M. G. H., Meyer, D. E., & Donchin, E. (1993) · Psychological Science · doi:10.1111/j.1467-9280.1993.tb00586.x · Cited by 2,862
Implementation strategies: recommendations for specifying and reporting
Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-139 · Cited by 2,585
A theory of organizational readiness for change
Weiner, B. J. (2009) · Implementation Science · doi:10.1186/1748-5908-4-67 · Cited by 2,268
Welcome to Implementation Science
Eccles, M. P., & Mittman, B. S. (2006) · Implementation Science · doi:10.1186/1748-5908-1-1 · Cited by 2,254
User Centered System Design: New Perspectives on Human-Computer Interaction
Anderson, N. S., Norman, D. A., & Draper, S. W. (1988) · The American Journal of Psychology · doi:10.2307/1422802 · Cited by 1,857
Nielsen, J. (1994) · Cited by 1,778
Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests
Rubin, J. N. (1994) · Cited by 1,740
Ecological Psychology: Concepts and Methods for Studying the Environment of Human Behavior
Barker, R. G. (1968) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 1,721
Activity Theory as a Potential Framework for Human-Computer Interaction Research
Kuurti, K. (1995) · The MIT Press eBooks · doi:10.7551/mitpress/2137.003.0006 · Cited by 1,717
An Evidence-Based Model of Work Engagement
Bakker, A. B. (2011) · Current Directions in Psychological Science · doi:10.1177/0963721411414534 · Cited by 1,381
Mind in society: The development of higher psychological processes. L. S. Vygotsky.
Cole, M., John-Steiner, V. P., Scribner, S., & Souberman, E. (1978) · Cited by 1,309
Waltz, T. J., Powell, B. J., Fernández, M. E., Abadie, B., & Damschroder, L. J. (2019) · Implementation Science · doi:10.1186/s13012-019-0892-4 · Cited by 1,136 · cited 1×
“Furthermore, strategies that directly target the innovation level are far fewer than those at levels such as the inner setting or individual service providers (Waltz et al., 2019).”
BackgroundWaltz, T. J., Powell, B. J., Matthieu, M. M., Damschroder, L. J., Chinman, M. J., Smith, J. L., Proctor, E. K., & Kirchner, J. E. (2015) · Implementation Science · doi:10.1186/s13012-015-0295-0 · Cited by 1,108
Baker, R., Camosso-Stefinovic, J., Gillies, C., Shaw, E. J., Cheater, F., Flottorp, S., & Robertson, N. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005470.pub2 · Cited by 1,003
McHugh, R. K., Whitton, S. W., Peckham, A. D., Welge, J. A., & Otto, M. W. (2013) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.12r07757 · Cited by 800
An approach to the formal analysis of user complexity
Kieras, D. E., & Polson, P. G. (1999) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1983.0317 · Cited by 594
Lewis, C. C., Klasnja, P., Powell, B. J., Lyon, A. R., Tuzzio, L., Jones, S., Walsh-Bailey, C., & Weiner, B. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00136 · Cited by 588
Self-citationChambers, D. A., & Norton, W. E. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.05.011 · Cited by 581
Design Thinking in Health Care
Altman, M., Huang, T. T. K., & Breland, J. Y. (2018) · Preventing Chronic Disease · doi:10.5888/pcd15.180128 · Cited by 548
Moving out from the control room
Hughes, J., King, V., Rodden, T. A., & Andersen, H. (1994) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/192844.193065 · Cited by 545
Improving Patient Care: The Implementation of Change in Health Care
(2013) · doi:10.1002/9781118525975 · Cited by 506
User‐centered design for psychosocial intervention development and implementation.
Lyon, A. R., & Koerner, K. (2016) · Clinical Psychology: Science and Practice · doi:10.1111/cpsp.12154 · Cited by 478
Self-citationPersonas, Participatory Design and Product Development: An Infrastructure for Engagement
Grudin, J. T., & Pruitt, J. (2002) · Cited by 474
Forman, S. G., Olin, S. S., Hoagwood, K. E., Crowe, M., & Saka, N. (2009) · School Mental Health · doi:10.1007/s12310-008-9002-5 · Cited by 471
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015) · Implementation Science · doi:10.1186/s13012-014-0192-y · Cited by 435
HUMAN-COMPUTER INTERACTION: Psychology as a Science of Design
Carroll, J. M. (1997) · Annual Review of Psychology · doi:10.1146/annurev.psych.48.1.61 · Cited by 404
New theoretical approaches for human‐computer interaction
Rogers, Y. (2004) · Annual Review of Information Science and Technology · doi:10.1002/aris.1440380103 · Cited by 386
Youth Psychotherapy Outcome Research: A Review and Critique of the Evidence Base
Weisz, J. R., Doss, A. J., & Hawley, K. M. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.141449 · Cited by 356
State of the Art on the Cognitive Walkthrough Method, Its Variants and Evolutions
Mahatody, T., Sagar, M., & Kolski, C. (2010) · International Journal of Human-Computer Interaction · doi:10.1080/10447311003781409 · Cited by 338
Computer text-editing: An information-processing analysis of a routine cognitive skill
Card, S. K., Moran, T. P., & Newell, A. (1980) · Cognitive Psychology · doi:10.1016/0010-0285(80)90003-1 · Cited by 306
A glossary of user-centered design strategies for implementation experts
Dopp, A. R., Parisi, K. E., Munson, S. A., & Lyon, A. R. (2018) · Translational Behavioral Medicine · doi:10.1093/tbm/iby119 · Cited by 301
Self-citationDeveloping and Testing a Model to Predict Outcomes of Organizational Change
Gustafson, D. H., Sainfort, F., Eichler, M., Adams, L., Bisognano, M. A., & Steudel, H. J. (2003) · Health Services Research · doi:10.1111/1475-6773.00143 · Cited by 298
(2008) · doi:10.1016/b978-0-12-373558-4.x0001-5 · Cited by 287
Human-Computer Interaction: Psychological Aspects of the Human Use of Computing
Olson, G. M., & Olson, J. S. (2002) · Annual Review of Psychology · doi:10.1146/annurev.psych.54.101601.145044 · Cited by 249
Competitor identification and competitor analysis: a broad‐based managerial approach
Bergen, M., & Peteraf, M. A. (2002) · Managerial and Decision Economics · doi:10.1002/mde.1059 · Cited by 234
Williams, N. J., & Beidas, R. S. (2019) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12960 · Cited by 233
Lyon, A. R., Munson, S. A., Renn, B. N., Atkins, D. C., Pullmann, M. D., Friedman, E., & Areán, P. A. (2019) · JMIR Research Protocols · doi:10.2196/14990 · Cited by 194
Self-citationNezu, A. M., Nezu, C. M., & D’Zurilla, T. J. (2012) · Springer Publishing Company eBooks · doi:10.1891/9780826109415 · Cited by 186
Pagoto, S., Spring, B. J., Coups, E. J., Mulvaney, S. A., Coutu, M., & Özakinci, G. (2007) · Journal of Clinical Psychology · doi:10.1002/jclp.20376 · Cited by 183
Human–computer interaction: Interdisciplinary roots and trends
Hartson, H. R. (1998) · Journal of Systems and Software · doi:10.1016/s0164-1212(98)10026-2 · Cited by 182
Dopp, A. R., Parisi, K. E., Munson, S. A., & Lyon, A. R. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00020-w · Cited by 180
Self-citationLyon, A. R., & Bruns, E. J. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.3060 · Cited by 178
Self-citationKrause, J., van Lieshout, J., Klomp, R., Huntink, E. M., Aakhus, E., Flottorp, S. A., Jäger, C., Steinhaeuser, J., Godycki-Ćwirko, M., Kowalczyk, A., et al. (2014) · Implementation Science · doi:10.1186/s13012-014-0102-3 · Cited by 178
Barriers and Facilitators in Scaling up Research-Based Practices
Klingner, J. K., Ahwee, S., Pilonieta, P., & Menendez, R. (2003) · Exceptional Children · doi:10.1177/001440290306900402 · Cited by 176
Lewis, C. C., Stanick, C. F., Martinez, R. G., Weiner, B. J., Kim, M., Barwick, M., & Comtois, K. A. (2016) · Implementation Science · doi:10.1186/s13012-014-0193-x · Cited by 155
Adaptation in Dissemination and Implementation Science
Baumann, A. A., Cabassa, L. J., & Stirman, S. W. (2017) · Oxford Scholarship Online · doi:10.1093/oso/9780190683214.003.0017 · Cited by 151
Comparison of evaluation methods using structured usability problem reports
Lavery, D., Cockton, G., & Atkinson, M. P. (1997) · Behaviour and Information Technology · doi:10.1080/014492997119824 · Cited by 143
von Thiele Schwarz, U., Aarons, G. A., & Hasson, H. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4668-y · Cited by 134
Dopp, A. R., Parisi, K. E., Munson, S. A., & Lyon, A. R. (2019) · Health Research Policy and Systems · doi:10.1186/s12961-018-0403-0 · Cited by 129
Self-citationPiaget and Vygotsky: Many resemblances, and a crucial difference
Lourenço, O. M. (2012) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2011.12.006 · Cited by 126
Designing the Future of Children’s Mental Health Services
Lyon, A. R., Dopp, A. R., Brewer, S. K., Kientz, J. A., & Munson, S. A. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01038-x · Cited by 120
Self-citationAdvancing implementation science through measure development and evaluation: a study protocol
Lewis, C. C., Weiner, B. J., Stanick, C., & Fischer, S. M. (2015) · Implementation Science · doi:10.1186/s13012-015-0287-0 · Cited by 115
PCORI at 3 Years — Progress, Lessons, and Plans
Selby, J. V., & Lipstein, S. H. (2014) · New England Journal of Medicine · doi:10.1056/nejmp1313061 · Cited by 103
Evidence‐based leadership development: the 4L framework
Scott, S., & Webber, C. F. (2008) · Journal of Educational Administration · doi:10.1108/09578230810908343 · Cited by 89
Interface design for health care environments: the role of cognitive science.
Patel, V. L., & Kushniruk, A. W. (1998) · PubMed · Cited by 84
Franks, R. P., & Bory, C. T. (2015) · New Directions for Child and Adolescent Development · doi:10.1002/cad.20112 · Cited by 82
Co-creative approaches to knowledge production: what next for bridging the research to practice gap?
Metz, A. J. R., Boaz, A., & Robert, G. (2019) · Evidence & Policy · doi:10.1332/174426419x15623193264226 · Cited by 74
Revisiting the research–practice gap in HR: A longitudinal analysis
Deadrick, D. L., & Gibson, P. A. (2009) · Human Resource Management Review · doi:10.1016/j.hrmr.2009.01.003 · Cited by 71
Lyon, A. R., Koerner, K., & Chung, J. (2020) · Implementation Research and Practice · doi:10.1177/2633489520932924 · Cited by 68
Self-citationBelling, R., James, K., & Ladkin, D. (2004) · Journal of Management Development · doi:10.1108/02621710410524104 · Cited by 67
Bringing User Experience Design to Bear on STEM Education: A Narrative Literature Review
Minichiello, A., Hood, J. R., & Harkness, D. (2018) · Journal for STEM Education Research · doi:10.1007/s41979-018-0005-3 · Cited by 66
Jones, L., Crabb, S., Turnbull, D., & Oxlad, M. (2014) · Journal of Health Psychology · doi:10.1177/1359105312473786 · Cited by 61
Thinking beyond the cure : a case for human-centered design in cancer care
Mullaney, T., Pettersson, H., Nyholm, T., & Stolterman, E. (2012) · DiVA at Umeå University (Umeå University) · Cited by 61
Closing the Science–Practice Gap in Implementation Before It Widens
Lyon, A. R., Comtois, K. A., Kerns, S. E. U., Landes, S. J., & Lewis, C. C. (2020) · Springer eBooks · doi:10.1007/978-3-030-03874-8_12 · Cited by 57
Self-citationComparing Engage with PST in Late-Life Major Depression: A Preliminary Report
Alexopoulos, G. S., Raue, P. J., Kiosses, D. N., Seirup, J. K., Banerjee, S., & Arean, P. A. (2015) · The American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2014.06.008 · Cited by 51
Self-citationAdvancing the Science of Implementation: A Workshop Summary
Chambers, D. A. (2008) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0146-7 · Cited by 46
de Tribolet‐Hardy, F., Kesic, D., & Thomas, S. D. M. (2014) · Policing & Society · doi:10.1080/10439463.2013.865737 · Cited by 44
Evaluating competency to stand trial with evidence-based practice.
Rogers, R., & Johansson-Love, J. (2009) · PubMed · Cited by 27
Palinkas, L. A., Campbell, M. R., & Saldana, L. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00161 · Cited by 25
Goal Setting and Performance Feedback
Ward, P. (2011) · Springer eBooks · doi:10.1007/978-1-4614-0070-7_6 · Cited by 20
Human-Centered Computing: Defining a Research Agenda
Sears, A., Lazar, J. K., Ozok, A. A., & Meiselwitz, G. (2008) · International Journal of Human-Computer Interaction · doi:10.1080/10447310701771456 · Cited by 7
Beyond Human Factors: The Role of Human Centered Design in Developing a Safety-Critical System
Kasdaglis, N., & Stowers, K. L. (2016) · Communications in computer and information science · doi:10.1007/978-3-319-40548-3_58 · Cited by 6
Flagged first, then by citations
Research works printed but not linked: 8
- Cooper A, Reimann R, & Cronin D (2007). About Face 3: The essentials of interaction design (3rd edition). Indianapolis, IN: Wiley.
- Lund A (2001). Measuring usability with the USE questionnaire. Usability Interface, 8(2), 3– 6.
- Lyon AR, Coifman J, Cook H, Liu F, Ludwig K, Dorsey S, … McCauley E (2018, 12 3). The Cognitive Walk-through for Implementation Strategies (CWIS): A pragmatic methodology for assessing strategy usability. Presented at the 11th Annual Conference on the Science of Dissemination and Implementation, Washington D.C.
- Rogers EM (2010). Diffusion of innovations (5th ed.). New York, NY: Simon and Schuster.
- Rogers EM (1962). Diffusion of innovations. Free Press of Glencoe.
- Shneiderman B (1980). Software psychology. Winthrop, Cambridge, Mass, 48, 161– 172.
- Turns J, Borgford-Parnell J, & Ferro T (2015). Exploring the usefulness of personas in engineering education. 6th Research in Engineering Edu. Symposium, Dublin, Ireland.
- Wensing M, & Grol R (2005). Characteristics of successful interventions In Grol R, Wensing M, & Eccles MP (Eds.), Improving patient care: The implementation of change in clinical practice (pp. 60– 70). Edinburgh, UK: Elsevier/Butterworth Heinemann.
Cited by
Sorted by citations
Digital health interventions to support family caregivers: An updated systematic review
Zhai, S., Chu, F., Tan, M., Chi, N., Ward, T. M., & Yuwen, W. (2023) · Digital Health · doi:10.1177/20552076231171967 · Cited by 193
Assessing the usability of complex psychosocial interventions: The Intervention Usability Scale
Lyon, A. R., Pullmann, M. D., Jacobson, J., Osterhage, K. P., Achkar, M. A., Renn, B. N., Munson, S. A., & Areán, P. A. (2021) · Implementation Research and Practice · doi:10.1177/2633489520987828 · Cited by 89
Self-citationLyon, A. R., Coifman, J., Cook, H., McRee, E., Liu, F. F., Ludwig, K. A., Dorsey, S., Koerner, K., Munson, S. A., & McCauley, E. (2021) · Implementation Science Communications · doi:10.1186/s43058-021-00183-0 · Cited by 94
Self-citationStiles‐Shields, C., Cummings, C., Montague, E. N. H., Plevinsky, J. M., Psihogios, A. M., & Williams, K. D. A. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.848052 · Cited by 79
Cohn, C., Snyder, C., Fonteles, J. H., Ashwin, T. S., Montenegro, J., & Biswas, G. (2024) · British Journal of Educational Technology · doi:10.1111/bjet.13518 · Cited by 81
Metadata
- Authors
- Lyon, A. R., Brewer, S. K., & Areán, P. A.
- Affiliations
- University of Washington (US)
- Venue
- American Psychologist
- Published
- 2020-11
- Volume
- 75
- Issue
- 8
- Pages
- 1067-1079
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- PMC
- PMC7709137
- OpenAlex
- W3110183584
- Cited by
- 152
- References
- 84
- Citations by year
- 2026: 16 · 2025: 26 · 2024: 44 · 2023: 29 · 2022: 19 · 2021: 15 · 2020: 3
- FWCI
- 17.22
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- American Psychologist (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health (R34MH109605, P50MH115837)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- human-centered design, implementation research, implementation strategies, psychosocial interventions, user needs, usability, implementation factors, implementation mechanisms, acceptability, feasibility, appropriateness, applied psychology
- MeSH terms
- Implementation Science, Humans, Psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
