Using mixed methods to develop and evaluate an online weight management intervention
Abstract
Purpose: This article illustrates the use of mixed methods in the development and evaluation of the Positive Online Weight Reduction ( POW e R ) programme, an e‐health intervention designed to support sustainable weight loss. The studies outlined also explore how human support might enhance intervention usage and weight loss. Methods: Mixed methods were used to develop and evaluate POW e R . In the development phase, we drew on both quantitative and qualitative findings to plan and gain feedback on the intervention. Next, a feasibility trial, with nested qualitative study, explored what level of human support might lead to the most sustainable weight loss. Finally, a large community‐based trial of POW e R , with nested qualitative study, explored whether the addition of brief telephone coaching enhances usage. Results: Findings suggest that POW e R is acceptable and potentially effective. Providing human support enhanced usage in our trials, but was not unproblematic. Interestingly, there were some indications that more basic (brief) human support may produce more sustainable weight loss outcomes than more regular support. Qualitative interviews suggested that more regular support might foster reliance, meaning patients cannot sustain their weight losses when support ends. Qualitative findings in the community trial also suggested explanations for why many people may not take up the opportunity for human support. Conclusions: Integrating findings from both our qualitative and quantitative studies provided far richer insights than would have been gained using only a single method of inquiry. Further research should investigate the optimum delivery of human support needed to maximize sustainable weight loss in online interventions. Statement of contribution: What is already known on this subject? There is evidence that human support may increase the effectiveness of e‐health interventions. It is unclear what level of human support might be optimal or how human support improves effectiveness. Triangulation of quantitative and qualitative methods can be used to inform the design and implementation of interventions What does this study add? This paper demonstrates the value of a mixed methods approach when developing and evaluating an intervention. Qualitative methods provided complementary insights into the optimal level of human support. Brief human support is valued by some and may enhance usage and outcomes of an e‐health intervention for weight loss
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Adopting a mixed method multidimensional approach will provide a more comprehensive picture of how users are engaging with DBCIs, but can pose problems of resource constraints and user burden, particularly when interventions are implemented 'in the wild'.
“Adopting a mixed method multidimensional approach will provide a more comprehensive picture of how (well) users are engaging with DBCIs 41 , but can pose problems of resource constraints and user burden, particularly when interventions are implemented 'in the wild'.”
From Understanding and Promoting Effective Engagement With Digital Behavior Change Interventions (2016) · cites this paper as [41]
Some POWeR users have indicated in follow-up interviews that they would like to be able to access human support when they feel the need.
“Some POWeR users have indicated in our follow-up interviews that they would like to be able to access human support when they feel the need [19]”
From A Visualization Tool to Analyse Usage of Web-Based Interventions: The Example of Positive Online Weight Reduction (POWeR) (2015) · cites this paper as [19]
Cites
Research Design: Qualitative, Quantitative, and Mixed Method Approaches
อุ่นอารมย์เลิศ, ร. ด. ธ. (2016) · Silpakorn Educational Research Journal · Cited by 4,515 · see citing works
Paradigms Lost and Pragmatism Regained
Morgan, D. L. (2007) · Journal of Mixed Methods Research · doi:10.1177/2345678906292462 · Cited by 2,520 · see citing works
Mohr, D. C., Cuijpers, P., & Lehman, K. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1602 · Cited by 1,097 · see citing works
Active commuting to school: how far is too far?
Nelson, N. M., Foley, E., O’Gorman, D. J., Moyna, N. M., & Woods, C. B. (2008) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-5-1 · Cited by 537 · see citing works
Neve, M., Morgan, P. J., Jones, P. R., & Collins, C. E. (2010) · Obesity Reviews · doi:10.1111/j.1467-789x.2009.00646.x · Cited by 459 · see citing works
Online Prevention Aimed at Lifestyle Behaviors: A Systematic Review of Reviews
Kohl, L. F., Crutzen, R., & de Vries, N. K. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2665 · Cited by 388 · see citing works
Jolly, K., Lewis, A., Beach, J., Denley, J., Adab, P., Deeks, J. J., Daley, A., & Aveyard, P. (2011) · BMJ · doi:10.1136/bmj.d6500 · Cited by 359 · see citing works
Qualitative research in psychology
Giles, D. (2013) · Routledge eBooks · doi:10.4324/9780203759851-20 · Cited by 214 · see citing works
Adriaanse, M. A., de Ridder, D. T. D., & de Wit, J. B. F. (2008) · Personality and Social Psychology Bulletin · doi:10.1177/0146167208325612 · Cited by 195 · see citing works
The Impact of Regular Self-weighing on Weight Management: A Systematic Literature Review
VanWormer, J. J., French, S. A., Pereira, M. A., & Welsh, E. M. (2008) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-5-54 · Cited by 163 · see citing works
Effect of web-based lifestyle modification on weight control: a meta-analysis
Kodama, S., Saito, K., Tanaka, S., Horikawa, C., Fujiwara, K., Hirasawa, R., Yachi, Y., Iida, K., Shimano, H., Ohashi, Y., et al. (2011) · International Journal of Obesity · doi:10.1038/ijo.2011.121 · Cited by 130 · see citing works
Dennison, L., Morrison, L., Lloyd, S., Phillips, D., Stuart, B., Williams, S., Bradbury, K., Roderick, P., Murray, E., Michie, S., et al. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3199 · Cited by 98 · see citing works
Self-citationYardley, L., Ware, L. J., Smith, E. R., Williams, S., Bradbury, K. J., Arden-Close, E. J., Mullee, M. A., Moore, M. V., Peacock, J. L., Lean, M. E., et al. (2014) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-11-67 · Cited by 84 · see citing works
Self-citationGarip, G., & Yardley, L. (2011) · Clinical Obesity · doi:10.1111/j.1758-8111.2011.00021.x · Cited by 80 · see citing works
Self-citationPsychology, Health and Medicine
Knight, S. J. (1997) · JAMA · doi:10.1001/jama.1997.03550060099048 · Cited by 48 · see citing works
Integrating user perspectives into the development of a web‐based weight management intervention
Yardley, L., Williams, S., Bradbury, K., Garip, G., Renouf, S., Ware, L., Dorling, H., Smith, E., & Little, P. (2012) · Clinical Obesity · doi:10.1111/cob.12001 · Cited by 39 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
The person-based approach to enhancing the acceptability and feasibility of interventions
Yardley, L., Ainsworth, B., Arden-Close, E., & Muller, I. (2015) · Pilot and Feasibility Studies · doi:10.1186/s40814-015-0033-z · Cited by 346 · see citing works
Self-citationScholten, M. R., Kelders, S. M., & Van Gemert-Pijnen, J. E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7351 · Cited by 97 · see citing works
“Users coping with experiences of negative affect during their change process [29,30,33,38,39,44-47] Task-related support a can play a positive role by objective goal setting, measuring the goals set, reminding the user of their goal set, and indicating which of these goals have (not yet) been met.”
BackgroundArden-Close, E. J., Smith, E., Bradbury, K., Morrison, L., Dennison, L., Michaelides, D., & Yardley, L. (2015) · JMIR Human Factors · doi:10.2196/humanfactors.4310 · Cited by 32 · see citing works
Self-citation
- Authors
- Bradbury, K., Dennison, L., Little, P., & Yardley, L.
- Affiliations
- University of Southampton (GB)
- Corresponding author
- Bradbury, Katherine
- Venue
- British Journal of Health Psychology
- Publisher
- Wiley
- Published
- 2014-11-19
- Volume
- 20
- Issue
- 1
- Pages
- 45-55
- ISSN
- 1359-107X (ISSN-L)
- 2044-8287
- OpenAlex
- W2094198063
- Cited by
- 34
- References
- 16
- Citations by year
- 2025: 1 · 2024: 1 · 2023: 1 · 2022: 2 · 2021: 3 · 2020: 11 · 2019: 2 · 2018: 3 · 2017: 5 · 2016: 2 · 2015: 3
- FWCI
- 5.97
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- British Journal of Health Psychology (publishedVersion)
- PubMed (publishedVersion)
- ePrints Soton (University of Southampton) (acceptedVersion)
- Bristol Research (University of Bristol) (submittedVersion)
- Explore Bristol Research (submittedVersion)
- Funders
- Research For Patient Benefit (PB-PG-0808–17077)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- e-health, sustainable weight loss, human support, telephone coaching, intervention development, intervention evaluation, mixed methods
- MeSH terms
- Adult, Aged, Counseling, Feasibility Studies, Female, Humans, Male, Middle Aged, Research Design, Social Support, Telephone, Program Evaluation, Internet, Weight Reduction Programs
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
