Integrating Evidence From Systematic Reviews, Qualitative Research, and Expert Knowledge Using Co-Design Techniques to Develop a Web-Based Intervention for People in the Retirement Transition
Open accessAbstract
BACKGROUND: Integrating stakeholder involvement in complex health intervention design maximizes acceptability and potential effectiveness. However, there is little methodological guidance about how to integrate evidence systematically from various sources in this process. Scientific evidence derived from different approaches can be difficult to integrate and the problem is compounded when attempting to include diverse, subjective input from stakeholders. OBJECTIVE: The intent of the study was to describe and appraise a systematic, sequential approach to integrate scientific evidence, expert knowledge and experience, and stakeholder involvement in the co-design and development of a complex health intervention. The development of a Web-based lifestyle intervention for people in retirement is used as an example. METHODS: Evidence from three systematic reviews, qualitative research findings, and expert knowledge was compiled to produce evidence statements (stage 1). Face validity of these statements was assessed by key stakeholders in a co-design workshop resulting in a set of intervention principles (stage 2). These principles were assessed for face validity in a second workshop, resulting in core intervention concepts and hand-drawn prototypes (stage 3). The outputs from stages 1-3 were translated into a design brief and specification (stage 4), which guided the building of a functioning prototype, Web-based intervention (stage 5). This prototype was de-risked resulting in an optimized functioning prototype (stage 6), which was subject to iterative testing and optimization (stage 7), prior to formal pilot evaluation. RESULTS: The evidence statements (stage 1) highlighted the effectiveness of physical activity, dietary and social role interventions in retirement; the idiosyncratic nature of retirement and well-being; the value of using specific behavior change techniques including those derived from the Health Action Process Approach; and the need for signposting to local resources. The intervention principles (stage 2) included the need to facilitate self-reflection on available resources, personalization, and promotion of links between key lifestyle behaviors. The core concepts and hand-drawn prototypes (stage 3) had embedded in them the importance of time use and work exit planning, personalized goal setting, and acceptance of a Web-based intervention. The design brief detailed the features and modules required (stage 4), guiding the development of wireframes, module content and functionality, virtual mentors, and intervention branding (stage 5). Following an iterative process of intervention testing and optimization (stage 6), the final Web-based intervention prototype of LEAP (Living, Eating, Activity, and Planning in retirement) was produced (stage 7). The approach was resource intensive and required a multidisciplinary team. The design expert made an invaluable contribution throughout the process. CONCLUSIONS: Our sequential approach fills an important methodological gap in the literature, describing the stages and techniques useful in developing an evidence-based complex health intervention. The systematic and rigorous integration of scientific evidence, expert knowledge and experience, and stakeholder input has resulted in an intervention likely to be acceptable and feasible.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
An iterative, multidisciplinary approach placing the end user at the heart of the system is increasingly seen as crucial to person-centered or person-based intervention development.
“This is increasingly seen as crucial to person-centered or person-based intervention development [48-50].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · cited 1× · see citing works
“The method used to analyze the facilitator notes and workshop materials resembles thematic analysis [54], a technique that allows for the”
Developing and evaluating complex interventions: the new Medical Research Council guidance
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008) · BMJ · doi:10.1136/bmj.a1655 · Cited by 10,995 · cited 4× · see citing works
“Our approach values the role of qualitative research and stakeholder input in intervention development but also details how to integrate systematic review evidence in the process, which is an important component of the MRC guidance [14].”
InfluentialHoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548 · cited 1× · see citing works
“Thus our approach supports researchers to conform to the Template for Intervention Description and Replication (TIDieR) intervention reporting guidelines [69] and to develop an intervention logic model or “theory of change,” which can direct an evaluation of the effectiveness of the intervention as advocated in the MR…”
Lee, I.-M., Shiroma, E. J., Lobelo, F., Puska, P., Blair, S. N., & Katzmarzyk, P. T. (2012) · The Lancet · doi:10.1016/s0140-6736(12)61031-9 · Cited by 8,215 · see citing works
Social Relationships and Mortality Risk: A Meta-analytic Review
Holt-Lunstad, J., Smith, T. B., & Layton, J. B. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000316 · Cited by 7,272 · cited 3× · see citing works
“Table 1 [16,18,19,38,56,59-64] presents a summary of LEAP intervention modules, tools and interactive features, and the evidence on which each element was based.”
Process evaluation of complex interventions: Medical Research Council guidance
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wight, D., et al. (2015) · BMJ · doi:10.1136/bmj.h1258 · Cited by 6,204 · cited 1× · see citing works
“Thus our approach supports researchers to conform to the Template for Intervention Description and Replication (TIDieR) intervention reporting guidelines [69] and to develop an intervention logic model or “theory of change,” which can direct an evaluation of the effectiveness of the intervention as advocated in the MR…”
Fit Yourself and Take Your Lungs to Heart
Palange, P., & Bonini, M. (2013) · Respiration · doi:10.1159/000350831 · Cited by 2,780 · see citing works
Pope, C., & Mays, N. (1995) · BMJ · doi:10.1136/bmj.311.6996.42 · Cited by 2,336 · see citing works
Effective techniques in healthy eating and physical activity interventions: A meta-regression.
Michie, S., Abraham, C., Whittington, C., McAteer, J., & Gupta, S. (2009) · Health Psychology · doi:10.1037/a0016136 · Cited by 2,229 · cited 5× · see citing works
“The systematic review evidence and the theoretical framework of the Health Action Process Approach provided recommendations regarding intervention content, modalities, and timings.”
InfluentialEvidence based medicine: a movement in crisis?
Greenhalgh, T., Howick, J., Maskrey, N., & for the Evidence Based Medicine Renaissance Group (2014) · BMJ · doi:10.1136/bmj.g3725 · Cited by 1,787 · cited 1× · see citing works
“While this approach to evidence synthesis is desirable, in practice it can be challenging because of the absence of established methods to guide the application of evidence to the specific population or clinical context in building a complex intervention [22,23].”
Sofi, F., Abbate, R., Gensini, G. F., & Casini, A. (2010) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.2010.29673 · Cited by 1,605 · cited 1× · see citing works
“The population health and well-being benefits of physical activity, a healthy diet, in particular one based on a Mediterranean dietary pattern, and social engagement are well documented [36-38].”
Three techniques for integrating data in mixed methods studies
O'Cathain, A., Murphy, E., & Nicholl, J. (2010) · BMJ · doi:10.1136/bmj.c4587 · Cited by 1,584 · cited 1× · see citing works
“Mixed-method studies attempt to bridge the epistemological differences between quantitative and qualitative data acquisition approaches [27].”
Yardley, L., Morrison, L., Bradbury, K., & Muller, I. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4055 · Cited by 1,442 · cited 1× · see citing works
“Other approaches have advocated the integration of user perspectives in intervention development, demonstrating the importance of conducting qualitative research with a wide range of people from the target user populations at every stage of intervention development, from planning to feasibility testing and implementat…”
Sniehotta, F. F., Scholz, U., & Schwarzer, R. (2005) · Psychology & Health · doi:10.1080/08870440512331317670 · Cited by 1,350 · cited 4× · see citing works
“The systematic review evidence and the theoretical framework of the Health Action Process Approach provided recommendations regarding intervention content, modalities, and timings.”
InfluentialSelf-citationMatthews, F. E., Arthur, A., Barnes, L. E., Bond, J., Jagger, C., Robinson, L., & Brayne, C. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61570-6 · Cited by 1,155 · cited 1× · see citing works
“Despite recent evidence that today’s older adults are healthier than they were 10-20 years ago [39], with a globally ageing population and the accompanying increase in the prevalence of chronic ill health and morbidity [40], maintaining a healthy lifestyle into later years is vital for individual…”
A taxonomy of behaviour change methods: an Intervention Mapping approach
Kok, G., Gottlieb, N. H., Peters, G.-J. Y., Mullen, P. D., Parcel, G. S., Ruiter, R. A. C., Fernández, M. E., Markham, C., & Bartholomew, L. K. (2016) · Health Psychology Review · doi:10.1080/17437199.2015.1077155 · Cited by 1,137 · cited 1× · see citing works
“These conclusions can then be used to inform the development of novel interventions including the features that are most likely to be effective [20,21].”
Action planning and coping planning for long-term lifestyle change: theory and assessment
Sniehotta, F. F., Schwarzer, R., Scholz, U., & Schüz, B. (2005) · European Journal of Social Psychology · doi:10.1002/ejsp.258 · Cited by 978 · cited 4× · see citing works
“The systematic review evidence and the theoretical framework of the Health Action Process Approach provided recommendations regarding intervention content, modalities, and timings.”
InfluentialSelf-citationSchwarzer, R. (2014) · Taylor & Francis eBooks · doi:10.4324/9781315800820-14 · Cited by 889 · see citing works
The Persona Lifecycle: Keeping People in Mind Throughout Product Design
Pruitt, J., & Adlin, T. (2006) · Cited by 843 · see citing works
Cognitive walkthroughs: a method for theory-based evaluation of user interfaces
Polson, P. G., Lewis, C., Rieman, J., & Wharton, C. (1992) · International Journal of Man-Machine Studies · doi:10.1016/0020-7373(92)90039-n · Cited by 797 · cited 1× · see citing works
“The aim of the third and final co-design workshop was to “de-risk” the prototype [57] through testing intervention functionality and identifying necessary modifications using a cognitive walkthrough activity [58].”
Design Things and Design Thinking: Contemporary Participatory Design Challenges
Bjögvinsson, E., Ehn, P., & Hillgren, P.-A. (2012) · Design Issues · doi:10.1162/desi_a_00165 · Cited by 784 · see citing works
Lewin, S., Glenton, C., & Oxman, A. D. (2009) · BMJ · doi:10.1136/bmj.b3496 · Cited by 678 · cited 1× · see citing works
“Qualitative research methods help inform the development of complex health interventions [24,25].”
Donetto, S., Pierri, P., Tsianakas, V., & Robert, G. (2015) · The Design Journal · doi:10.2752/175630615x14212498964312 · Cited by 647 · cited 3× · see citing works
“Co-design techniques have been used to involve stakeholders as co-designers in health care innovation and intervention development [5-11].”
Dombrowski, S. U., Sniehotta, F. F., Avenell, A., Johnston, M., MacLennan, G., & Araújo-Soares, V. (2012) · Health Psychology Review · doi:10.1080/17437199.2010.513298 · Cited by 504 · cited 1× · see citing works
“For example, the active ingredients or features of interventions, such as behavior change techniques (BCT) associated with more positive behavior change and theory underpinning effective interventions, can be identified [15-19].”
Self-citationSix steps in quality intervention development (6SQuID)
Wight, D., Wimbush, E., Jepson, R., & Doi, L. (2016) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2015-205952 · Cited by 496 · cited 1× · see citing works
“A 6-step guide [68] attempts to fill the methodological gap in the literature by providing a guide of how to develop public health interventions from defining the problem and identifying the modifiable causal and contextual factors through to collecting preliminary evidence of effectiveness.”
Patients and staff as codesigners of healthcare services
Robert, G., Cornwell, J., Locock, L., Purushotham, A., Sturmey, G., & Gager, M. (2015) · BMJ · doi:10.1136/bmj.g7714 · Cited by 427 · cited 4× · see citing works
“Co-design techniques have been used to involve stakeholders as co-designers in health care innovation and intervention development [5-11].”
InfluentialOliver, S., Clarke-Jones, L., Rees, R., Milne, R., Buchanan, P., Gabbay, J., Gyte, G., Oakley, A., & Stein, K. (2004) · Health Technology Assessment · doi:10.3310/hta8150 · Cited by 400 · cited 1× · see citing works
“Leading international bodies in health and social care research and governance advocate the integration of stakeholder involvement in the design and development of novel health interventions [1-3].”
Low vs. high-fidelity prototyping debate
Rudd, J., Stern, K. R., & Isensee, S. (1996) · interactions · doi:10.1145/223500.223514 · Cited by 380 · cited 1× · see citing works
“When testing prototypes, the researchers observed that the level of fidelity of the prototypes was important; sketched ideas were easier for participants to engage with than more detailed mock-ups of one part of the intervention were, which was interpreted as a finished product inviting little useful feedback [66].”
(2007) · International Journal of Health Care Quality Assurance · doi:10.1108/ijhcqa.2007.06220eae.001 · Cited by 270 · see citing works
Hobbs, N., Godfrey, A., Lara, J., Errington, L., Meyer, T. D., Rochester, L., White, M. J., Mathers, J. C., & Sniehotta, F. F. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-75 · Cited by 266 · cited 3× · see citing works
“The systematic reviews, which in part underpinned these statements, have previously been published [18,19,47-49].”
Self-citationClemensen, J., Larsen, S. B., Kyng, M., & Kirkevold, M. (2007) · Qualitative Health Research · doi:10.1177/1049732306293664 · Cited by 265 · cited 3× · see citing works
“Involving relevant stakeholders as co-designers of health interventions allows the stakeholders to help define the health care problem and identify preferred intervention solutions [8-12].”
Moffatt, S., White, M., Mackintosh, J., & Howel, D. (2006) · BMC Health Services Research · doi:10.1186/1472-6963-6-28 · Cited by 239 · cited 1× · see citing works
“Such an inclusive approach to evidence synthesis, integrating different forms of scientific evidence, can be challenging, especially when mixed-method findings conflict [28].”
Self-citationKwasnicka, D., Presseau, J., White, M., & Sniehotta, F. F. (2013) · Health Psychology Review · doi:10.1080/17437199.2013.766832 · Cited by 237 · cited 4× · see citing works
“The systematic review evidence and the theoretical framework of the Health Action Process Approach provided recommendations regarding intervention content, modalities, and timings.”
InfluentialSelf-citationGardner, B., Whittington, C., McAteer, J., Eccles, M. P., & Michie, S. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2010.01.039 · Cited by 225 · cited 1× · see citing works
“For example, the active ingredients or features of interventions, such as behavior change techniques (BCT) associated with more positive behavior change and theory underpinning effective interventions, can be identified [15-19].”
Physical Activity and Transitioning to Retirement
Barnett, I., van Sluijs, E. M. F., & Ogilvie, D. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.05.026 · Cited by 221 · see citing works
Web-Based Interventions for Behavior Change and Self-Management: Potential, Pitfalls, and Progress
Murray, E. (2012) · Medicine 2.0 · doi:10.2196/med20.1741 · Cited by 219 · cited 1× · see citing works
“Although a Web-based intervention was a planned consideration of the research team, we were cognizant of the potential limitations related to the so-called digital divide and subsequent health inequalities in intervention access and use [65].”
Life Events as Windows of Opportunity for Changing Towards Sustainable Consumption Patterns?
Schäfer, M., Jaeger‐Erben, M., & Bamberg, S. (2011) · Journal of Consumer Policy · doi:10.1007/s10603-011-9181-6 · Cited by 213 · cited 1× · see citing works
“As engagement with key health and social behaviors may change in retirement, the retirement transition offers a unique window of opportunity to intervene to improve health and well-being of older adults [41].”
How was it for you? Experiences of participatory design in the UK health service
Bowen, S. J., McSeveny, K., Lockley, E., Wolstenholme, D., Cobb, M., & Dearden, A. (2013) · CoDesign · doi:10.1080/15710882.2013.846384 · Cited by 201 · cited 3× · see citing works
“Involving relevant stakeholders as co-designers of health interventions allows the stakeholders to help define the health care problem and identify preferred intervention solutions [8-12].”
Slingerland, A. S., van Lenthe, F. J., Jukema, J. W., Kamphuis, C. B. M., Looman, C. W. N., Giskes, K., Huisman, M. A., Narayan, K. M. V., Mackenbach, J. P., & Brug, J. (2007) · American Journal of Epidemiology · doi:10.1093/aje/kwm053 · Cited by 172 · cited 1× · see citing works
“However, the evidence is inconsistent and other studies have shown reduced physical activity (PA) [32,33], less healthy dietary behavior [34], and a loss of perceived status and purpose [35].”
Bate, P., & Robert, G. (2007) · The Journal of Applied Behavioral Science · doi:10.1177/0021886306297014 · Cited by 166 · see citing works
Irvine, A. B., Gelatt, V. A., Seeley, J. R., Macfarlane, P. A., & Gau, J. M. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2158 · Cited by 160 · cited 1× · see citing works
“Web-based interventions have significant promise to reach the rapidly expanding older adult population who are increasingly becoming routine Internet users [71] and have been shown to have positive effects on lifestyle behaviors, including PA, in older adults [72-74].”
Prototypes as (Design) Tools for Behavioral and Organizational Change
Coughlan, P., Suri, J. F., & Canales, K. (2007) · The Journal of Applied Behavioral Science · doi:10.1177/0021886306297722 · Cited by 152 · cited 1× · see citing works
““Prototyping” was a key technique used to communicate ideas, which enabled the progression of thinking through physical making, a safe space for failure leading to faster learning, and encouragement and permission to explore new behaviors [55].”
Health technology assessment and its influence on health-care priority setting
Oliver, A., Mossialos, E., & Robinson, R. (2004) · International Journal of Technology Assessment in Health Care · doi:10.1017/s026646230400073x · Cited by 152 · see citing works
BMJ readers choose the “sanitary revolution” as greatest medical advance since 1840
Ferriman, A. (2007) · BMJ · doi:10.1136/bmj.39097.611806.db · Cited by 151 · see citing works
Touvier, M., Bertrais, S., Charreire, H., Vergnaud, A., Herçberg, S., & Oppert, J. (2010) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-7-14 · Cited by 146 · cited 1× · see citing works
“Some cross-sectional and longitudinal studies have shown that people engage in more healthy behaviors with retirement [29-31].”
Glass, T. A. (2004) · Journal of Heredity · doi:10.1093/jurban/jth096 · Cited by 141 · cited 2× · see citing works
“The co-design techniques we employed, namely persona building [56], experience mapping [59], storyboarding [60], and prototyping [43], originate from product and service design adopting a social and user-centered process [4].”
Ruland, C. M., Starren, J. B., & Vatne, T. M. (2007) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2007.10.004 · Cited by 140 · cited 3× · see citing works
“Involving relevant stakeholders as co-designers of health interventions allows the stakeholders to help define the health care problem and identify preferred intervention solutions [8-12].”
HEAVEN, B., BROWN, L. J. E., WHITE, M., ERRINGTON, L., MATHERS, J. C., & MOFFATT, S. (2013) · The Milbank Quarterly · doi:10.1111/milq.12013 · Cited by 135 · cited 4× · see citing works
“The systematic reviews, which in part underpinned these statements, have previously been published [18,19,47-49].”
InfluentialSelf-citationO’Brien, N., McDonald, S., Araújo‐Soares, V., Lara, J., Errington, L., Godfrey, A., Meyer, T. D., Rochester, L., Mathers, J. C., White, M. J., et al. (2015) · Health Psychology Review · doi:10.1080/17437199.2015.1012177 · Cited by 133 · cited 7× · see citing works
“The systematic review evidence and the theoretical framework of the Health Action Process Approach provided recommendations regarding intervention content, modalities, and timings.”
InfluentialSelf-citationAalbers, T., Baars, M. A. E., & Rikkert, M. G. M. O. (2011) · Ageing Research Reviews · doi:10.1016/j.arr.2011.05.001 · Cited by 128 · cited 1× · see citing works
“Web-based interventions have significant promise to reach the rapidly expanding older adult population who are increasingly becoming routine Internet users [71] and have been shown to have positive effects on lifestyle behaviors, including PA, in older adults [72-74].”
Lara, J., Evans, E. H., O’Brien, N., Moynihan, P. J., Meyer, T. D., Adamson, A., Errington, L., Sniehotta, F. F., White, M. J., & Mathers, J. C. (2014) · BMC Medicine · doi:10.1186/s12916-014-0177-3 · Cited by 121 · cited 9× · see citing works
“Co-design workshop 2 confirmed acceptability of the module’s core functions, including personal goal setting, feedback, and follow-up prompts, in line with BCTs identified in systematic review [19].”
InfluentialSelf-citationRetirement and a healthy lifestyle: opportunity or pitfall? A narrative review of the literature
Zantinge, E. M., van den Berg, M., Smit, H. A., & Picavet, H. S. J. (2013) · European Journal of Public Health · doi:10.1093/eurpub/ckt157 · Cited by 120 · cited 1× · see citing works
“Some cross-sectional and longitudinal studies have shown that people engage in more healthy behaviors with retirement [29-31].”
The impact of retirement on physical activity
Berger, U., Der, G., Mutrie, N., & Hannah, M. (2005) · Ageing and Society · doi:10.1017/s0144686x04002739 · Cited by 116 · cited 1× · see citing works
“However, the evidence is inconsistent and other studies have shown reduced physical activity (PA) [32,33], less healthy dietary behavior [34], and a loss of perceived status and purpose [35].”
Nooyens, A. C. J., Visscher, T. L. S., Schuit, A. J., van Rossum, C. T. M., Verschuren, W. M. M., van Mechelen, W., & Seidell, J. C. (2005) · Public Health Nutrition · doi:10.1079/phn2005756 · Cited by 115 · cited 1× · see citing works
“However, the evidence is inconsistent and other studies have shown reduced physical activity (PA) [32,33], less healthy dietary behavior [34], and a loss of perceived status and purpose [35].”
Lara, J., Hobbs, N., Moynihan, P. J., Meyer, T. D., Adamson, A., Errington, L., Rochester, L., Sniehotta, F. F., White, M. J., & Mathers, J. C. (2014) · BMC Medicine · doi:10.1186/1741-7015-12-60 · Cited by 98 · cited 3× · see citing works
“The systematic reviews, which in part underpinned these statements, have previously been published [18,19,47-49].”
Self-citationThe association between retirement and age on physical activity in older adults
Godfrey, A., Lord, S. E., Galna, B., Mathers, J. C., Burn, D. J., & Rochester, L. (2013) · Age and Ageing · doi:10.1093/ageing/aft168 · Cited by 98 · see citing works
Self-citationREPRINTS: Effects of an Intergenerational Health Promotion Program for Older Adults in Japan
Fujiwara, Y., Sakuma, N., Ohba, H., Nishi, M., Lee, S., Watanabe, N., Kousa, Y., Yoshida, H., Fukaya, T., Yajima, S., et al. (2009) · Journal of Intergenerational Relationships · doi:10.1080/15350770802628901 · Cited by 93 · cited 1× · see citing works
“A small number of studies have delivered lifestyle interventions in the retirement transition [42-45], and systematic reviews synthesizing data from this life stage provide support for their effectiveness [46-49].”
Human Centred Design Considerations for Connected Health Devices for the Older Adult
Harte, R., Glynn, L. G., Broderick, B. J., Rodríguez‐Molinero, A., Baker, P. M. A., McGuinness, B., O'Sullivan, L. W., Boladeras, M. D., Quinlan, L. R., & OLaighin, G. M. (2014) · Journal of Personalized Medicine · doi:10.3390/jpm4020245 · Cited by 90 · cited 1× · see citing works
“Web-based interventions have significant promise to reach the rapidly expanding older adult population who are increasingly becoming routine Internet users [71] and have been shown to have positive effects on lifestyle behaviors, including PA, in older adults [72-74].”
‘Planning for uncertainty’: narratives on retirement transition experiences
Moffatt, S., & Heaven, B. (2016) · Ageing and Society · doi:10.1017/s0144686x15001476 · Cited by 77 · cited 4× · see citing works
“The co-design techniques we employed, namely persona building [56], experience mapping [59], storyboarding [60], and prototyping [43], originate from product and service design adopting a social and user-centered process [4].”
InfluentialSelf-citation(2008) · International Journal of Health Care Quality Assurance · doi:10.1108/ijhcqa.2008.06221cae.001 · Cited by 68 · see citing works
Lemmer, B., Grellier, R., & Steven, J. (1999) · Qualitative Health Research · doi:10.1177/104973299129121884 · Cited by 49 · cited 1× · see citing works
“While this approach to evidence synthesis is desirable, in practice it can be challenging because of the absence of established methods to guide the application of evidence to the specific population or clinical context in building a complex intervention [22,23].”
Heaven, B., O'Brien, N., Evans, E., White, M., Meyer, T. D., Mathers, J., & Moffatt, S. (2016) · The gerontologist · doi:10.1093/geront/gnu159 · Cited by 44 · cited 6× · see citing works
“the tailoring of LEAP to address the variable nature of retirement transitions [56,59].”
InfluentialSelf-citationExperience based co-design reduces formal complaints on an acute mental health ward
Springham, N., & Robert, G. (2015) · BMJ Quality Improvement Reports · doi:10.1136/bmjquality.u209153.w3970 · Cited by 41 · cited 1× · see citing works
“Involving relevant stakeholders as co-designers of health interventions allows the stakeholders to help define the health care problem and identify preferred intervention solutions [8-12].”
Integrating user perspectives into the development of a web‐based weight management intervention
Yardley, L., Williams, S., Bradbury, K., Garip, G., Renouf, S., Ware, L., Dorling, H., Smith, E., & Little, P. (2012) · Clinical Obesity · doi:10.1111/cob.12001 · Cited by 39 · cited 2× · see citing works
“Qualitative research methods help inform the development of complex health interventions [24,25].”
Werkman, A. M., Hulshof, P. J. M., Stafleu, A., Kremers, S., Kok, F. J., Schouten, E. G., & Schuit, A. J. (2010) · BMC Public Health · doi:10.1186/1471-2458-10-110 · Cited by 33 · cited 1× · see citing works
“A small number of studies have delivered lifestyle interventions in the retirement transition [42-45], and systematic reviews synthesizing data from this life stage provide support for their effectiveness [46-49].”
Lange, D., Richert, J., Koring, M., Knoll, N., Schwarzer, R., & Lippke, S. (2013) · Psychology & Health · doi:10.1080/08870446.2012.751107 · Cited by 30 · cited 2× · see citing works
“Self-regulation prompts for action control [60] is an effective behavior change strategy [61].”
Mouton, A., & Cloes, M. (2013) · Archives of Public Health · doi:10.1186/0778-7367-71-16 · Cited by 29 · cited 1× · see citing works
“Web-based interventions have significant promise to reach the rapidly expanding older adult population who are increasingly becoming routine Internet users [71] and have been shown to have positive effects on lifestyle behaviors, including PA, in older adults [72-74].”
Saltz, R. (1971) · Aging and Human Development · doi:10.2190/ag.2.4.i · Cited by 26 · cited 1× · see citing works
“A small number of studies have delivered lifestyle interventions in the retirement transition [42-45], and systematic reviews synthesizing data from this life stage provide support for their effectiveness [46-49].”
Sniehotta, F. F., Dombrowski, S. U., Avenell, A., Johnston, M., McDonald, S., Murchie, P., Ramsay, C. R., Robertson, K., & Araújo‐Soares, V. (2011) · PLoS ONE · doi:10.1371/journal.pone.0023040 · Cited by 19 · cited 1× · see citing works
“These conclusions can then be used to inform the development of novel interventions including the features that are most likely to be effective [20,21].”
Self-citationMacdonald, A. S., Teal, G., Bamford, C. H., & Moynihan, P. J. (2012) · PubMed · doi:10.25405/ncl.34189254 · Cited by 17 · see citing works
Self-citationResearch: Retirement and lifestyle behaviours: A thematic analysis of a pilot study
Hobbis, S., Thirlaway, K., Sanders, L. D., & Hendry, L. B. (2011) · Health Psychology Update · doi:10.53841/bpshpu.2011.20.2.2 · Cited by 8 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- [50]National Institute for Health and Care Excellence Methods for the development of NICE public health guidance (third edition) 2012 2016-07-14 https://www.nice.org.uk/article/pmg4/resources/non-guidance-methods-for-the-development-of-nice-public-health-guidance-third-edition-pdf 27905711
- [53]Buchenau M Fulton S Experience prototyping 2000 Third Conference on designing interactive systems: Processes, practices, methods, and techniques Aug. 17-19, 2000 Brooklyn, NY ACM
- [57]Keeley L Pikkel R Quinn B Walters H Ten types of innovationthe discipline of building breakthroughs 2013 New Jersey John Wiley & Sons Inc
Cited by
Sorted by citations
The empirical status of acceptance and commitment therapy: A review of meta-analyses
Gloster, A. T., Walder, N., Levin, M. E., Twohig, M. P., & Karekla, M. (2020) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2020.09.009 · Cited by 622 · see citing works
Personalised nutrition and health
Ordovás, J. M., Ferguson, L. R., Tai, E. S., & Mathers, J. C. (2018) · BMJ · doi:10.1136/bmj.k2173 · Cited by 634 · see citing works
Self-citationDeveloping Behavior Change Interventions for Self-Management in Chronic Illness
Araújo‐Soares, V., Hankonen, N. E., Presseau, J., Rodrigues, A., & Sniehotta, F. F. (2018) · European Psychologist · doi:10.1027/1016-9040/a000330 · Cited by 237 · see citing works
Self-citationMccabe, C., McCann, M., & Brady, A. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011425.pub2 · Cited by 221 · see citing works
Disease management interventions for heart failure
Takeda, A., Martin, N., Taylor, R. S., & Taylor, S. J. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002752.pub4 · Cited by 194 · see citing works
Vandekerckhove, P., de Mul, M., Bramer, W. M., & Bont, A. A. D. (2020) · Journal of Medical Internet Research · doi:10.2196/13780 · Cited by 131 · see citing works
“Facilitation was intended to support creativity and hands-on exercises [37,48].”
BackgroundMethodInfluentialOptimal nutrition and the ever-changing dietary landscape: a conference report
Shao, A., Drewnowski, A., Willcox, D. C., Krämer, L., Lausted, C. G., Eggersdorfer, M. L., Mathers, J. C., Bell, J. D., Randolph, R. K., Witkamp, R. F., et al. (2017) · European Journal of Nutrition · doi:10.1007/s00394-017-1460-9 · Cited by 97 · see citing works
“In respect of healthy aging, retirement is a major intervention opportunity which has been exploited in developing living, easting, activity and planning (LEAP), an internet-based platform designed to deliver personalized advice to help individuals improve diet, physical activity and social roles/connections and so ag…”
BackgroundSelf-citationMoore, G., Wilding, H., Gray, K., & Castle, D. (2019) · Journal of Participatory Medicine · doi:10.2196/11474 · Cited by 95 · see citing works
“[51] Youth, Netherlands Website Website for childhood cancer survivors Peute 2015 [52] Youth, adult, aged, Sweden”
BackgroundMethodFrom lifespan to healthspan: the role of nutrition in healthy ageing
Wickramasinghe, K. K., Mathers, J. C., Wopereis, S., Marsman, D. S., & Griffiths, J. C. (2020) · Journal of Nutritional Science · doi:10.1017/jns.2020.26 · Cited by 90 · see citing works
“LEAP incorporates selected behaviour change techniques and is designed to provide personalised support in making changes to diet (to increase adherence to the Mediterranean dietary pattern), physical activity and social roles/ networks and to enhance healthy ageing((53)).”
BackgroundSelf-citationLi, H., Wong, C. L., Jin, X., Chen, J., Chong, Y. Y., & Bai, Y. (2021) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2021.103876 · Cited by 81 · see citing works
Agnello, D. M., Anand-Kumar, V., An, Q., de Boer, J., Delfmann, L. R., Longworth, G. R., Loisel, Q. E. A., McCaffrey, L., Steiner, A., & CHASTIN, S. F. M. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02514-4 · Cited by 90 · see citing works
“Refugees Forum Theatre [120] and Playback Theatre [120] 33.”
Lara, J., O’Brien, N., Godfrey, A., Heaven, B., Evans, E. H., Lloyd, S., Moffatt, S. M., Moynihan, P. J., Meyer, T. D., Rochester, L., et al. (2016) · PLoS ONE · doi:10.1371/journal.pone.0159703 · Cited by 76 · see citing works
Self-citationRazmak, J., & Bélanger, C. H. (2018) · Information Technology and People · doi:10.1108/itp-07-2016-0160 · Cited by 76 · see citing works
Santin, O., McShane, T., Hudson, P., & Prue, G. (2018) · Psycho-Oncology · doi:10.1002/pon.4969 · Cited by 73 · see citing works
“This process known as co‐design has the potential to increase intervention effectiveness.(21,22) In response to rising carer pressures, the team co‐designed with cancer carers and health care professionals (HCP) a peer‐led web‐based resource (PLWR) to provide cancer carer specific practical and emotional advice on com…”
BackgroundRousseau, N. S., Turner, K. M., Duncan, E., O’Cathain, A., Croot, L., Yardley, L., & Hoddinott, P. (2019) · PLoS ONE · doi:10.1371/journal.pone.0223615 · Cited by 67 · see citing works
Integrating Theory in Co-design: An Abductive Approach
Hurley, E., Dietrich, T., & Rundle-Thiele, S. R. (2021) · Australasian Marketing Journal (AMJ) · doi:10.1177/1839334921998541 · Cited by 69 · see citing works
“…from expert knowledge was summarized by the research team to produce “evidence state-ments” (e.g., providing explicit social roles produces most benefits), which were then presented to participants during co-design sessions to inform the aims and content of the sessions (O’Brien et al., 2016).”
BackgroundMethodInfluentialVirtual Coaches for Older Adults’ Wellbeing: A Systematic Review
Kamali, M. E., Angelini, L., Caon, M., Carrino, F., Röcke, C., Guye, S., Rizzo, G., Mastropietro, A., Sykora, M. D., Elayan, S., et al. (2020) · IEEE Access · doi:10.1109/access.2020.2996404 · Cited by 60 · see citing works
“four [10], [42], [50], [51] presented a field study for deriving the requirements of a coaching system, and nine presented only a proposal of a coaching system or an architectural implementation, without any user study [6], [16], [17], [19], [22], [25], [29], [36], [52].”
BackgroundInfluentialElbers, S., van Gessel, C., Renes, R. J., van der Lugt, R., Wittink, H., & Hermsen, S. (2021) · Journal of Medical Internet Research · doi:10.2196/18462 · Cited by 47 · see citing works
“This study adds to the increasing number of initiatives that use co-design to structurally integrate contextual factors into the development of health care interventions (eg, [21,22,52,53]), which help bridge the gap from development to actual implementation [12,13].”
BackgroundSantillo, M., Sivyer, K., Krusche, A., Mowbray, F., Jones, N., Peto, T., Walker, A. S., Llewelyn, M., Yardley, L., Lee, A., et al. (2019) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkz333 · Cited by 44 · see citing works
Haruna, H., Zainuddin, Z., Mellecker, R. R., Chu, S. K. W., & Hu, X. (2019) · Information and Learning Sciences · doi:10.1108/ils-07-2019-0066 · Cited by 43 · see citing works
Digital chemsex support and care: The potential of just-in-time adaptive interventions
Platteau, T., Herrijgers, C., & de Wit, J. B. F. (2020) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2020.102927 · Cited by 45 · see citing works
Prinjha, S., Ricci-Cabello, I., Newhouse, N., & Farmer, A. (2020) · JMIR mHealth and uHealth · doi:10.2196/15789 · Cited by 34 · see citing works
“This is increasingly seen as crucial to person-centered or person-based intervention development [48-50].”
BackgroundDigital behaviour change interventions to increase vegetable intake in adults: a systematic review
Livingstone, K. M., Rawstorn, J. C., Partridge, S. R., Godrich, S. L., McNaughton, S. A., Hendrie, G. A., Blekkenhorst, L. C., Maddison, R., Zhang, Y., Barnett, S., et al. (2023) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-023-01439-9 · Cited by 36 · see citing works
Self-citationVayro, C., Brownlow, C., Ireland, M., & March, S. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01085-4 · Cited by 33 · see citing works
The effect of the Internet on decision-making during pregnancy: a systematic review
Ouyaba, A. T., & Kesim, S. İ. (2020) · Archives of Women s Mental Health · doi:10.1007/s00737-020-01065-5 · Cited by 33 · see citing works
Wikman, A., Kukkola, L., Börjesson, H., Cernvall, M., Woodford, J., Grönqvist, H., & von Essen, L. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9457 · Cited by 32 · see citing works
“Specifically, as per other studies utilizing PAR [20,21], a thematic analysis approach was adopted [22].”
Influentialden Haan, M. C., Brankaert, R., Kenning, G., & Lü, Y. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.568822 · Cited by 33 · see citing works
Developing an mHealth App for Empowering Cancer Survivors With Disabilities: Co-design Study
Adler, R. F., Morales, P., Sotelo, J., & Magasi, S. R. (2022) · JMIR Formative Research · doi:10.2196/37706 · Cited by 29 · see citing works
“Supplies can be minimal, such as paper, Post-it notes, and posters [45,47,48].”
BackgroundGrynne, A., Browall, M., Fristedt, S., Ahlberg, K., & Smith, F. (2021) · PLoS ONE · doi:10.1371/journal.pone.0253448 · Cited by 29 · see citing works
“Consistent with previous studies [8, 38], we experienced that applying a co-design approach can be time-consuming.”
ResultCo-designing an Integrated Health and Social Care Hub With and for Families Experiencing Adversity
Hall, T., Loveday, S., Pullen, S., Loftus, H., Constable, L. N., Paton, K., & Hiscock, H. (2023) · International Journal of Integrated Care · doi:10.5334/ijic.6975 · Cited by 28 · see citing works
Franco-Trigo, L., Marqués‐Sánchez, P., Tudball, J., Benrimoj, S. I., Martínez‐Martínez, F., & Sabater‐Hernández, D. (2019) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2019.05.008 · Cited by 28 · see citing works
Ogrin, R., Viswanathan, R., Aylen, T., Wallace, F., Scott, J., & Kumar, D. (2018) · Practical Diabetes · doi:10.1002/pdi.2197 · Cited by 27 · see citing works
on behalf of the INSTRUCT project group, Stuij, S. M., Drossaert, C. H. C., Labrie, N., Hulsman, R. L., Kersten, M. J., van Dulmen, S., & Smets, E. M. A. (2020) · BMC Medical Education · doi:10.1186/s12909-020-1985-0 · Cited by 28 · see citing works
Sinha, S., Jawahar, I. M. “., Ghosh, P., & Mishra, A. (2019) · International Journal of Manpower · doi:10.1108/ijm-04-2019-0185 · Cited by 26 · see citing works
Santin, O., Jenkins, C., Nghiem, H. L. P., Prue, G., Reid, J., Lohfeld, L. H., & Ho, H. T. (2020) · Psycho-Oncology · doi:10.1002/pon.5368 · Cited by 26 · see citing works
“Intervention development is best served through codevelopment with multiple stakeholders to draw on their experiences and identify improvements to services.(20,21)”
BackgroundGunn, K. M., Skaczkowski, G., Dollman, J., Vincent, A. D., Short, C. E., Brumby, S. A., Barrett, A., Harrison, N. J., & Turnbull, D. A. (2022) · JMIR Human Factors · doi:10.2196/27631 · Cited by 25 · see citing works
“Methodological guidance and examples such as the studies by O’Brien et al [28] and Short et al [29] and the work outlined in this paper, provide a transparent account of intervention co-design and development upon which other clinicians and researchers can build.”
MethodCurrie, C. C., Araujo‐Soares, V., Stone, S. J., Beyer, F., & Durham, J. (2021) · Journal of Oral Rehabilitation · doi:10.1111/joor.13244 · Cited by 24 · see citing works
Malcomson, F. C., & Mathers, J. C. (2018) · Sub-cellular biochemistry/Subcellular biochemistry · doi:10.1007/978-981-13-2835-0_13 · Cited by 21 · see citing works
Self-citationLewis, C., Sanderson, S. C., Hammond, J., Hill, M. K., Searle, B. A., Hunter, A., Patch, C., & Chitty, L. S. (2020) · European Journal of Human Genetics · doi:10.1038/s41431-019-0564-5 · Cited by 22 · see citing works
Guzman, E. M., Zhang, Z., & Ahmed, W. (2021) · Information Discovery and Delivery · doi:10.1108/idd-08-2020-0106 · Cited by 20 · see citing works
Culinary Nutrition Education Programs in Community-Dwelling Older Adults: A Scoping Review
Alghamdi, M. M., Burrows, T. L., Barclay, B., Baines, S., & Chojenta, C. (2023) · The journal of nutrition health & aging · doi:10.1007/s12603-022-1876-7 · Cited by 20 · see citing works
Angelini, L., Mugellini, E., Khaled, O. A., Röcke, C., Guye, S., Porcelli, S., Mastropietro, A., Rizzo, G., Boqué, N., Bas-Prior, J. M. D., et al. (2019) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/3316782.3322763 · Cited by 20 · see citing works
“Only one study [18] in our systematic review adopted the Health Action Process Approach (HAPA) to design the ecoaching intervention strategy.”
MethodSpaces for Participatory Design Innovation
Teal, G., & French, T. (2020) · Participatory Design Conference · doi:10.1145/3385010.3385026 · Cited by 18 · see citing works
“Participatory and co-design approaches offer a means of mobilising and creatively engaging individuals and communities towards change, however there is no explicit and accepted description of their application [61], nor is there an understanding that the evidence they provide is sufficient to impact policy and practic…”
BackgroundSelf-citationCreaser, A. V., Bingham, D. D., Bennett, H. A. J., Costa, S., & Clemes, S. A. (2023) · Public Health · doi:10.1016/j.puhe.2023.01.018 · Cited by 18 · see citing works
Optimising eHealth tools for older patients: Collaborative redesign of a hospital website
Nguyen, M. H., Bol, N., van Weert, J. C. M., Loos, E. F., Tytgat, K. M. A. J., Geijsen, D. E., Drenth, E., Janse, M., & Smets, E. M. A. (2018) · European Journal of Cancer Care · doi:10.1111/ecc.12882 · Cited by 18 · see citing works
Walburn, J., Sainsbury, K., Foster, L., Weinman, J., Morgan, M., Norton, S., Canfield, M., Chadwick, P., Sarkany, B., & Araújo-Soares, V. (2020) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2020.1819287 · Cited by 10 · see citing works
Brown, M. C., Araújo‐Soares, V., Skinner, R., Glaser, A., Sarwar, N., Saxton, J., Montague, K., Hall, J. M., Burns, O., & Sharp, L. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-041073 · Cited by 17 · see citing works
Lucas, P. J., Ingram, J. C., Redmond, N. M., Cabral, C., Turnbull, S., & Hay, A. D. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0455-9 · Cited by 17 · see citing works
“Our approach is similar to those employed by O’Brien and colleagues to develop a web-based healthy lifestyles intervention for older adults [65] and Salisbury and colleagues to develop a new telehealth intervention for chronic disease in adults using Precede/Proceed [57].”
BackgroundMethodInfluentialSadasivan, C., Cruz, C., Dolgoy, N. D., Hyde, A. M., Campbell, S., McNeely, M. L., Stroulia, E., & Tandon, P. (2023) · Journal of Participatory Medicine · doi:10.2196/45772 · Cited by 16 · see citing works
“Drawing on evidence across other digital health care innovations, the proposed benefits of PPI fundamentally include the development of interventions that are both usable by and relevant to patients [19].”
BackgroundMcKean, C., Watson, R., Charlton, J., Roulstone, S., Holme, C., Gilroy, V., & Law, J. (2022) · Pilot and Feasibility Studies · doi:10.1186/s40814-022-00978-5 · Cited by 16 · see citing works
“The study applied the most recent guidance on best practice in intervention design and co-design [34, 35, 44, 45] and was informed by relevant theory with respect to early language development and disorders [22, 46], behaviour change [41], shared decision-making [53, 55], engagement [36], acceptability [41, 51] and im…”
BackgroundMethodBrown, M. C., Sharp, L., Sniehotta, F. F., Skinner, R., & Araújo‐Soares, V. (2020) · Pediatric Blood & Cancer · doi:10.1002/pbc.28500 · Cited by 15 · see citing works
Self-citationHuh, J., Lee, K. J., Roldan, W., Castro, Y., Kshirsagar, S., Rastogi, P., Kim, I., Miller, K. A., Cockburn, M., & Yip, J. C. (2021) · International Journal of Behavioral Medicine · doi:10.1007/s12529-021-09987-9 · Cited by 14 · see citing works
Factors influencing internet usage for health purposes
Sumaedi, S., & Sumardjo, S. (2020) · International Journal of Health Governance · doi:10.1108/ijhg-01-2020-0002 · Cited by 14 · see citing works
Irvine, L. A., Morris, J. H., Dombrowski, S. U., Breckenridge, J. P., Farré, A., Özakinci, G., Lebedis, T., & Jones, C. (2023) · Pilot and Feasibility Studies · doi:10.1186/s40814-023-01326-x · Cited by 13 · see citing works
A model of digital health communication media use during the Covid-19 pandemic
Sumaedi, S., Sumardjo, S., Saleh, A., & Syukri, A. F. (2021) · Health Education · doi:10.1108/he-03-2021-0040 · Cited by 13 · see citing works
E-book adoption behaviors through an online sharing platform
Wang, X., Wang, W., Chai, Y., Wang, Y., & Zhang, N. (2019) · Information Technology and People · doi:10.1108/itp-10-2018-0482 · Cited by 14 · see citing works
Ogrin, R., Dickins, M., Johnstone, G., Mortimer, D., Iezzi, A., & Lowthian, J. A. (2019) · Health & Social Care in the Community · doi:10.1111/hsc.12882 · Cited by 13 · see citing works
Sumaedi, S., Sumardjo, Saleh, A., & Syukri, A. F. (2021) · British Food Journal · doi:10.1108/bfj-06-2021-0656 · Cited by 13 · see citing works
Rimmer, B., Dutton, L., Lewis, J., Burns, R., Gallagher, P., Williams, S., Araujo-Soares, V., Finch, T., & Sharp, L. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-041465 · Cited by 12 · see citing works
“29 These workshops will integrate evidence, expert knowledge and experience, and stakeholder involvement to develop a prototype for a supported self-management programme.”
Denninger, N.-E., Brefka, S., Skudlik, S., Leinert, C., Mross, T., Meyer, G., Sulmann, D., Dallmeier, D., Denkinger, M. D., & Müller, M. (2023) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2023.104645 · Cited by 11 · see citing works
The NESTORE e-Coach: Designing a Multi-Domain Pathway to Well-Being in Older Age
Angelini, L., Kamali, M. E., Mugellini, E., Khaled, O. A., Röcke, C., Porcelli, S., Mastropietro, A., Rizzo, G., Boqué, N., Bas-Prior, J. M. D., et al. (2022) · Technologies · doi:10.3390/technologies10020050 · Cited by 11 · see citing works
Lee, K. S., & Wei, H. (2022) · Journal of Media Ethics · doi:10.1080/23736992.2022.2107524 · Cited by 13 · see citing works
“The expectation is that people outside a project, with qualified skills and knowledge, bring objective and professional perspectives to validate or improve the quality of the project’s findings (O’Brien et al., 2016; Sandelowski, 1998).”
BackgroundAli, R., Zhang, Z., & Soomro, M. B. (2019) · Current Psychology · doi:10.1007/s12144-019-00479-4 · Cited by 10 · see citing works
I'm no expert, but … ? Consumer use of supportive digital tools in health services
Bocking, H., Russell‐Bennett, R., & Letheren, K. (2021) · Journal of Service Theory and Practice · doi:10.1108/jstp-09-2020-0225 · Cited by 13 · see citing works
Terhorst, Y., Braun, L., Titzler, I., Buntrock, C., Freund, J., Thielecke, J., Ebert, D., & Baumeister, H. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-034271 · Cited by 9 · see citing works
Methods for co‐designing health innovations with older adults: A rapid review
Gagnon, L., Turcotte, S., DeBroux‐Leduc, R., Gauthier, P., & Bier, N. (2025) · Australian Journal on Ageing · doi:10.1111/ajag.70065 · Cited by 8 · see citing works
“Persona-scenarios ( n = 5 23,24,29,32,34 ), focus groups ( n = 6 24–27,29,33 ), individual interviews interviews ( n = Figure 2 shows the frequency of occurrence of each activity across the included studies.”
Deb, S. S., & Limbu, B. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.977442 · Cited by 9 · see citing works
“Other interventions have also been developed using this method but in different fields and targeting various health care services (56, 57).”
MethodLivingstone, K. M., Rawstorn, J. C., Partridge, S. R., Zhang, Y., Eric, O., Godrich, S. L., McNaughton, S. A., Hendrie, G. A., Dullaghan, K., Abbott, G., et al. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-078001 · Cited by 9 · see citing works
Self-citationDevelopment of patient‐centric eating advice for complete denture wearers
Al‐Sultani, H. F. F., Breckons, M., Field, J. C., Thomason, J. M., & Moynihan, P. J. (2022) · Gerodontology · doi:10.1111/ger.12618 · Cited by 8 · see citing works
Self-citationIntegrating and producing evidence through participatory design
Teal, G., Mcara, M., Riddell, J., Flowers, P., Coia, N., & McDaid, L. M. (2022) · CoDesign · doi:10.1080/15710882.2022.2096906 · Cited by 8 · see citing works
Self-citationVinogradov, R., Smith, V., Hiu, S. K. W., McParlin, C., Farnworth, A., & Araújo‐Soares, V. (2023) · Midwifery · doi:10.1016/j.midw.2023.103860 · Cited by 10 · see citing works
McKinney, A., Fitzsimons, D., Blackwood, B., White, M., & McGaughey, J. (2020) · Journal of Advanced Nursing · doi:10.1111/jan.14365 · Cited by 8 · see citing works
“It is argued that involving stakeholders in the design and development of interventions is one of the best ways to ensure that the intervention meets the needs of the target population and also has the potential to increase intervention effectiveness (O'Brien et al., 2016).”
BackgroundSelf-citationMuir, C., Kedzior, S. G. E., Barrett, S., McGovern, R., Kaner, E., Wolfe, I., & Forman, J. (2024) · Research Involvement and Engagement · doi:10.1186/s40900-024-00584-0 · Cited by 7 · see citing works
“The four research streams are: [39, 43].”
BackgroundResultInfluentialCurrie, C. C., Walburn, J., Hackett, K. L., McCabe, R., Sniehotta, F. F., O’Keeffe, S., Jong, N. B.-D., & Araújo‐Soares, V. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-818697-8.00177-1 · Cited by 7 · see citing works
Self-citationPang, P. C., Munsie, M., Chang, S., Tanner, C., & Walker, C. F. (2023) · Journal of Medical Internet Research · doi:10.2196/44733 · Cited by 7 · see citing works
“In participatory design, purposive sampling can generate maximum acceptability and usefulness, and such user sampling is used in the design of web-based interventions [31,32].”
Al-walah, M. A., Donnelly, M., & Heron, N. (2024) · Frontiers in Pediatrics · doi:10.3389/fped.2024.1333173 · Cited by 9 · see citing works
Cox, A. C., & Rhodes, R. E. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17103544 · Cited by 7 · see citing works
“More generally, reviews of technology-based interventions on patient engagement and behavior change found that while IT platform-based interventions had positive effects on health, there are few published reports of the engagement and usability within the interventions [50,55,56].”
BackgroundAzcárate‐Cenoz, N., Alfaro‐Díaz, C., Naef, R., Verweij, L., & Esandi, N. (2025) · Journal of Advanced Nursing · doi:10.1111/jan.70073 · Cited by 6 · see citing works
“By actively involving stakeholders throughout the design process, the intervention achieved greater contextual relevance, acceptability and potential for sustainable implementation in clinical practice (O'Brien et al. 2016; Skivington et al. 2021).”
Tao, G., Singh, G., Simpson, E., Battalova, A., Rash, I., Mohammadi, S., Schmidt, J., Borisoff, J., Mortenson, W. B., & Miller, W. C. (2023) · Canadian Journal of Occupational Therapy · doi:10.1177/00084174231160954 · Cited by 7 · see citing works
Klager, E., Lintschinger, J. M., Teufel, A., Schaden, E., Manschein, V., Reischmann, L., Ulbing, S., Willschke, H., Frimmel, C., Renner, R., et al. (2024) · PLoS ONE · doi:10.1371/journal.pone.0309955 · Cited by 6 · see citing works
Belayneh, Z., Lee, D. A., Haines, T. P., Aluh, D. O., Onu, J. U., Newton‐Howes, G., Masters, K. J., Kohn, Y., Sin, J., Goulet, M., et al. (2024) · International Journal of Mental Health Nursing · doi:10.1111/inm.13479 · Cited by 6 · see citing works
Development of a psychological intervention for people with bipolar disorder in rural Ethiopia
Demissie, M., Hanlon, C., Ng, L. C., Mayston, R., Abayneh, S., & Fekadu, A. (2021) · BJPsych Open · doi:10.1192/bjo.2021.999 · Cited by 6 · see citing works
Ekawati, F. M., Muchlis, M., & Tuteja, A. (2023) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-023-05433-8 · Cited by 5 · see citing works
Babatunde, O. O., Cottrell, E., White, S. J., Chudyk, A., Healey, E. L., Edwards, J., Nicholls, E. E., O’Brien, N., Todd, A., Walker, C., et al. (2024) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-023-07105-2 · Cited by 5 · see citing works
“Up to 5 workshops will be convened, in line with core principles of co-design, including power sharing, and participatory approaches [50, 51].”
BackgroundSelf-citationBaHammam, F. A., Durham, J., Abdulmohsen, B., Wassall, R. R., & McCracken, G. (2024) · Journal of Dentistry · doi:10.1016/j.jdent.2024.104896 · Cited by 5 · see citing works
Oral health decline in patients after stroke: a qualitative study
BaHammam, F. A., Durham, J., Abdulmohsen, B., Wassall, R. R., & McCracken, G. (2023) · BDJ · doi:10.1038/s41415-023-6558-2 · Cited by 4 · see citing works
“40,41,42 While this method requires extensive time, resources and effort to be undertaken, it could maximise the acceptability and potential effectiveness of the oral care protocol.”
BackgroundMethodWeb-Based Structured Education for Type 2 Diabetes: Interdisciplinary User-Centered Design Approach
Poduval, S., Ross, J., Pal, K., Newhouse, N., Hamilton, F. L., & Murray, E. (2021) · JMIR Human Factors · doi:10.2196/31567 · Cited by 5 · see citing works
“There are other examples where the process of combining interdisciplinary methods have been documented [15-19].”
BackgroundEmpowering Ontario’s long-term care residents to shape the place they call home: a codesign protocol
Lee, C., Tripp, D., McVie, M., Fineczko, J., Ramsden, G., Hothi, S., Langston, J., Gilhuly, J., Collingwood, B., McAiney, C. A., et al. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-077791 · Cited by 4 · see citing works
“44 45 The project team and other stakeholders will engage in a series of workshops to codesign the toolkit/ resource prototype(s); participants will include LTC residents, team members and administrators as well as other stakeholders, including OARC team members, researchers and decision-makers…”
BackgroundMental health promotion and prevention interventions for college student athletes: A scoping review
Ollie, A., Bianchi, S., Manos, N., Carter, J., Houle, J. L. W., & Sullivan, L. (2025) · Journal of American College Health · doi:10.1080/07448481.2025.2512964 · Cited by 6 · see citing works
Clegg, H., Dodd, A., Francis, P., & Newham, J. J. (2025) · Perspectives Policy and Practice in Higher Education · doi:10.1080/13603108.2025.2556184 · Cited by 3 · see citing works
“Furthermore, the use of participatory methods, including personas and constructing student time-lines, can assist in directing participants to solving real world issues (O’Brien et al. 2016), therefore better ensuring actionable insights and practical implications from the research.”
Using co-design to identify healthcare priorities for patients with incurable head and neck cancer
Achinanya, A., Bryant, V., Payne, S., Sharp, L., Harrison, M., Hamilton, D. W., Kim, C. M., Offerman, M. P. J., Patterson, J. M., & Mayland, C. R. (2026) · BMC Health Services Research · doi:10.1186/s12913-025-13993-y · Cited by 3 · see citing works
“This study employed the initial four stages of an established seven-stage iterative co-design process (Table 1), with the additional stages representing future work [17].”
Dassel, K. B., Iacob, E., Utz, R., Supiano, K. P., & Furhmann, H. (2023) · OBM Integrative and Complementary Medicine · doi:10.21926/obm.icm.2301004 · Cited by 3 · see citing works
“…advisory board and the Genetic Science and Learning Center at the University of Utah in the development, prototyping, and refinement of the LEAD clinical trial as a comprehensive, interactive, and user-friendly platform for older adults and others with cognitive impairment [63, 107–109, 124, 125].”
Veerhuis, N., Randle, M., & Traynor, V. (2024) · Journal of Safety Research · doi:10.1016/j.jsr.2024.11.006 · Cited by 3 · see citing works
Adverse drug reaction early warning using user search data
Shang, W., Chen, H., & Livoti, C. (2017) · Online Information Review · doi:10.1108/oir-10-2015-0341 · Cited by 3 · see citing works
Larsson, E., Fahlström, G., Bertilsson, G., & Fristedt, S. (2020) · Gerontechnology · doi:10.4017/gt.2020.19.003.02 · Cited by 3 · see citing works
Mazhar, A., & Sylva, Κ. (2025) · Early Childhood Education Journal · doi:10.1007/s10643-025-01863-5 · Cited by 2 · see citing works
“Co-creation workshops, informed by a well-defined theoretical frame - work, will help align the programme design with educators’ needs and priorities (O’Brien et al., 2016), while staying grounded in evidence.”
Reducing patient surge: community based social networks as first responders
Kirschenbaum, A. B. (2021) · Natural Hazards · doi:10.1007/s11069-021-04674-0 · Cited by 2 · see citing works
Brown, M. C., Araújo‐Soares, V., Skinner, R., Brown, J., Glaser, A., Hanratty, H., McCabe, M. G., Amariutei, A. E., Mauri, S., & Sharp, L. (2024) · PLoS ONE · doi:10.1371/journal.pone.0299321 · Cited by 2 · see citing works
Seeking community water fluoridation information on state health department websites
Maybury, C., Jacob, M., Flanders, J. M., & Horowitz, A. M. (2021) · PLoS ONE · doi:10.1371/journal.pone.0251139 · Cited by 1 · see citing works
Faraday, J., Abley, C., Crook, D., Exley, C., Patterson, J. M., & Moynihan, P. J. (2025) · Journal of Long-Term Care · doi:10.31389/jltc.362 · Cited by 1 · see citing works
Self-citation
- Authors
- O'Brien, N., Heaven, B., Teal, G., Evans, E. H., Cleland, C., Moffatt, S., Sniehotta, F. F., White, M., Mathers, J. C., & Moynihan, P.
- Affiliations
- Newcastle University (GB)
- Glasgow School of Art (GB)
- Queen's University Belfast (GB)
- University of Cambridge (GB)
- Corresponding author
- Moynihan, Paula
- ORCID
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2016-08-03
- Volume
- 18
- Issue
- 8
- Pages
- e210
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC4989122
- OpenAlex
- W2497771230
- Cited by
- 135
- References
- 71
- Citations by year
- 2026: 10 · 2025: 11 · 2024: 18 · 2023: 14 · 2022: 11 · 2021: 21 · 2020: 24 · 2019: 11 · 2018: 9 · 2017: 4 · 2016: 2
- FWCI
- 1.65
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Northumbria Research Link (Northumbria University) (acceptedVersion)
- RADAR (Glasgow School of Art) (acceptedVersion)
- Durham Research Online (Durham University) (submittedVersion, cc-by)
- Research Portal (Queen's University Belfast) (submittedVersion, cc-by)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- Apollo (cc-by)
- Funders
- Office of Research and Development
- Wellcome Trust (087636/Z/08/Z)
- United Kingdom Clinical Research Collaboration
- Scottish Government
- Cancer Research UK
- National Institute for Health and Care Research
- British Heart Foundation
- Public Health Agency
- Centre for Diet and Activity Research
- Directorate for Biological Sciences
- Chief Scientist Office, Scottish Government Health and Social Care Directorate
- Medical Research Council (MR/K02325X/1, MR/K006312/1, G0900686, MR/K023187/1)
- Engineering and Physical Sciences Research Council
- Economic and Social Research Council (ES/G007462/1)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Innovative Approaches in Technology and Social Development
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- retirement transition, online intervention, co-design, stakeholder engagement, evidence integration, expert knowledge, lifestyle intervention, physical activity, dietary behavior, social roles, behaviour change techniques, Health Action Process Approach, time use, personalized goal setting, virtual mentors, prototype development, older adults, well-being, de-risking, iterative testing
- MeSH terms
- Humans, Life Style, Retirement, Health Behavior, Knowledge, Internet, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
