Improving the Efficacy of Cognitive Training for Digital Mental Health Interventions Through Avatar Customization: Crowdsourced Quasi-Experimental Study
Open accessThe DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Abstract
BACKGROUND The success of internet-based mental health interventions in practice—that is, in the wild—depends on the uptake and retention of the application and the user’s focused attention in the moment of use. Incorporating game-based motivational design into digital interventions delivered in the wild has been shown to increase uptake and retention in internet-based training; however, there are outstanding questions about the potential of game-based motivational strategies to increase engagement with a task in the moment of use and the effect on intervention efficacy. OBJECTIVE Designers of internet-based interventions need to know whether game-based motivational design strategies can increase in-the-moment engagement and thus improve digital interventions. The aim of this study was to investigate the effects of 1 motivational design strategy (avatar customization) in an example mental health intervention (computerized cognitive training for attention bias modification). METHODS We assigned 317 participants to either a customized avatar or an assigned avatar condition. After measuring state anxiety (State-Trait Anxiety Inventory), we randomly assigned half of the participants in each condition to either an attentional retraining condition (Attention Bias Modification Training) or a control condition. After training, participants were exposed to a negative mood induction using images with strong negative valance (International Affective Picture System), after which we measured state anxiety again. RESULTS Avatar customization decreased posttraining state anxiety when controlling for baseline state anxiety for those in the attentional retraining condition; however, those who did not train experienced decreased resilience to the negative mood induction (F1,252=6.86, P=.009, ηp 2=.027). This interaction effect suggests that customization increased task engagement with the intervention in the moment of use. Avatar customization also increased avatar identification (F5,252=12.46, P<.001, R2=.23), regardless of condition (F1,252=.79, P=.38). Avatar identification reduced anxiety after the negative mood induction for participants who underwent training but increased poststimulus anxiety for participants who did not undergo training, further suggesting that customization increases engagement in the task (F1,252=6.19, P=.01). The beneficial effect of avatar customization on training was driven by participants who were low in their basic satisfaction of relatedness (F10,248=18.5, P<.001, R2=.43), which is important because these are the participants who are most likely in need of digital interventions for mental health. CONCLUSIONS Our results suggest that applying motivational design—specifically avatar customization—is a viable strategy to increase engagement and subsequently training efficacy in a computerized cognitive task.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 54,599
Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions
Ryan, R. M., & Deci, E. L. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.1999.1020 · Cited by 18,666 · cited 1×
“Research on motivation [78,79] suggests that invested effort depends on factors related to the experience itself, in particular, whether or not the interaction satisfies our needs for competence (ie, feeling a sense of mastery over challenges), autonomy (ie, experiencing the choice to engage under our own volition), a…”
Measuring emotion: The self-assessment manikin and the semantic differential
Bradley, M. M., & Lang, P. J. (1994) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/0005-7916(94)90063-9 · Cited by 9,538 · cited 1×
“self-assessment manikin [64]—valence and arousal scales were sequential to increase the time spent looking at each image.”
From game design elements to gamefulness: defining "gamification"
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011) · Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments · doi:10.1145/2181037.2181040 · Cited by 8,402 · cited 2×
“For example, gamification—the application of game elements in a nongame context [13]—has successfully been applied to increase volitional engagement in a variety of contexts [43].”
Self‐determination theory and work motivation
Gagné, M., & Deci, E. L. (2005) · Journal of Organizational Behavior · doi:10.1002/job.322 · Cited by 7,757 · cited 1×
“Research on motivation [78,79] suggests that invested effort depends on factors related to the experience itself, in particular, whether or not the interaction satisfies our needs for competence (ie, feeling a sense of mastery over challenges), autonomy (ie, experiencing the choice to engage under our own volition), a…”
Deci, E. L., Koestner, R., & Ryan, R. M. (1999) · Psychological Bulletin · doi:10.1037/0033-2909.125.6.627 · Cited by 7,176 · cited 1×
“Various interaction design strategies have been employed by leisure application designers to improve user engagement, including gamification—that is, the use of game-based elements in nongame contexts [13], the inclusion of extrinsic rewards [14], or leveraging social pressure to engage [15].”
Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012) · Medical Care · doi:10.1097/mlr.0b013e3182408812 · Cited by 4,058 · cited 2×
“However, because these mental health interventions are delivered digitally and often outside a laboratory or clinical context, success is not only defined by efficacy in research but also defined by efficacy in practice, which depends on validated implementation models and a focus on external validity—that is, demonst…”
BackgroundNgandu, T., Lehtisalo, J., Solomon, A., Levälahti, E., Ahtiluoto, S., Antikainen, R., Bäckman, L., Hänninen, T., Jula, A., Laatikainen, T., et al. (2015) · The Lancet · doi:10.1016/s0140-6736(15)60461-5 · Cited by 3,689 · cited 1×
“Feasibility studies on CCT have been shown to improve memory, self-control, reasoning, attention bias, and processing speed [22]; CCT has successfully been applied in clinical research to combat mental illness and cognitive deficits in disorders such as dementia [23], depression [24-26], neurodegenerative diseases [26…”
The motivational pull of video games: a self-determination theory approach
Ryan, R. M., Rigby, C. S., & Przybylski, A. (2006) · Motivation and Emotion · doi:10.1007/s11031-006-9051-8 · Cited by 3,332
Alterations in brain and immune function produced by mindfulness meditation
Davidson, R. J., Kabat-Zinn, J., Schumacher, J., Rosenkranz, M., Muller, D., Santorelli, S. F., Urbanowski, F., Harrington, A., Bonus, K., & Sheridan, J. F. (2003) · Psychosomatic Medicine · doi:10.1097/01.psy.0000077505.67574.e3 · Cited by 2,925 · cited 1×
“” STAI has been successfully been used before in research on resilience to negative affect [70].”
A systematic literature review of empirical evidence on computer games and serious games
Connolly, T. M., Boyle, E. A., MacArthur, E., Hainey, T., & Boyle, J. M. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.03.004 · Cited by 2,890
McAuley, E., Duncan, T., & Tammen, V. V. (1989) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.1989.10607413 · Cited by 2,694
Action video game modifies visual selective attention
Green, C. S., & Bavelier, D. (2003) · Nature · doi:10.1038/nature01647 · Cited by 2,540 · cited 1×
“Game-based training has been shown to improve working memory capacity [44], task switching ability (Ibid), visual short-term memory (Ibid), verbal reasoning (Ibid; [45]), visuospatial reasoning [46,47], response selection [48], visual attention [49,50], reaction time [51,52], and choice reaction time [53,54].”
Computerized training of working memory in children with ADHD – a randomized, controlled trial
Klingberg, T., Fernell, E., Olesen, P. J., Johnson, M., Gustafsson, P., Dahlström, K., Gillberg, C. G., Forssberg, H., & Westerberg, H. (2005) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200502000-00010 · Cited by 1,949 · cited 1×
“The most common CCT tasks are the Go/No-Go task [29], memory training [30], and the Attention Bias Modification Training (ABMT) task [31].”
Evaluating amazon’s mechanical turk as a tool for experimental behavioral research
Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057410 · Cited by 1,617
Persuasive technology: using computers to change what we think and do
Fogg, B. J. (2002) · Ubiquity · doi:10.1145/764008.763957 · Cited by 1,554 · cited 1×
“In a similar vein, persuasive technology uses strategies to bring about change by shaping or reinforcing behaviors or attitudes [55].”
BackgroundScaling-up treatment of depression and anxiety: a global return on investment analysis
Chisholm, D., Sweeny, K., Sheehan, P., Rasmussen, B., Smit, F., Cuijpers, P., & Saxena, S. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)30024-4 · Cited by 1,451
Internet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368 · cited 1×
“Stand-alone internet-based CBT programs [88,89] have also been evaluated in RCTs and have shown promise for the”
MacLeod, C., Rutherford, E., Campbell, L., Ebsworthy, G., & Holker, L. (2002) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.111.1.107 · Cited by 1,334 · cited 1×
“There were no significant interactions with either avatar customization or training, implying that the conditions did not directly influence mood (see [73]).”
Rebooting psychotherapy research and practice to reduce the burden of mental illness
Kazdin, A. E., & Blase, S. L. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393527 · Cited by 1,254 · cited 2×
“It has been argued that internet-based mental health interventions have some benefits over traditional approaches, especially related to the increased accessibility of treatment (eg, because of geographical constraints of living in remote areas with access to clinical treatment), the ability to scale (eg, to seamlessl…”
Using Mechanical Turk to Study Clinical Populations
Shapiro, D. N., Chandler, J., & Mueller, P. A. (2013) · Clinical Psychological Science · doi:10.1177/2167702612469015 · Cited by 1,139 · cited 1×
“Although MTurk has been shown to be reliable as a recruitment tool for research [65-67], we excluded participants from analysis if they were not performing the task with care, which we determined in multiple steps.”
Joosten, E. A. G., DeFuentes-Merillas, L., de Weert, G. H., Sensky, T., van der Staak, C. P. F., & de Jong, C. A. J. (2008) · Psychotherapy and Psychosomatics · doi:10.1159/000126073 · Cited by 1,135 · cited 1×
“Increased volitional engagement has been shown to increase adherence and treatment efficacy [42].”
Mohr, D. C., Cuijpers, P., & Lehman, K. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1602 · Cited by 1,097 · cited 1×
“For example, blended interventions, that is, interventions that blend internet-based forms of therapy with the interleaved presence of a therapist, have been shown to decrease the load on therapists and are similar in effect to traditionally delivered cognitive-behavioral therapy (CBT) programs [86,87].”
Training and transfer effects of executive functions in preschool children
Thorell, L. B., Lindqvist, S., Bergman Nutley, S., Bohlin, G., & Klingberg, T. (2009) · Developmental Science · doi:10.1111/j.1467-7687.2008.00745.x · Cited by 1,041
When small effects are impressive
Prentice, D. A., & Miller, D. T. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.112.1.160 · Cited by 1,008
Parsons, T. D., & Rizzo, A. A. (2008) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2007.07.007 · Cited by 994
Delivering interventions for depression by using the internet: randomised controlled trial
Christensen, H. (2004) · BMJ · doi:10.1136/bmj.37945.566632.ee · Cited by 928 · cited 2×
“For example, modular internet-based CBT programs such as MoodGYM [6], SilverCloud [90], or the mobile-based suite IntelliCare [3] have been shown to successfully improve mental health in cases of depression or anxiety.”
Hakamata, Y., Lissek, S., Bar-Haim, Y., Britton, J. C., Fox, N. A., Leibenluft, E., Ernst, M., & Pine, D. S. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.07.021 · Cited by 869
Can training in a real-time strategy video game attenuate cognitive decline in older adults?
Basak, C., Boot, W. R., Voss, M. W., & Kramer, A. F. (2008) · Psychology and Aging · doi:10.1037/a0013494 · Cited by 855
Van Breukelen, G. J. P. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.02.007 · Cited by 765
Cortese, S., Ferrin, M., Brandeis, D., Buitelaar, J., Daley, D., Dittmann, R. W., Holtmann, M., Santosh, P., Stevenson, J., Stringaris, A., et al. (2015) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2014.12.010 · Cited by 627
Personalization versus Customization: The Importance of Agency, Privacy, and Power Usage
Sundar, S. S., & Marathe, S. S. (2010) · Human Communication Research · doi:10.1111/j.1468-2958.2010.01377.x · Cited by 588 · cited 2×
“Sundar et al [59] argue that although personalization will increase the relevance of content for individuals using an interactive system, customization yields systems and content that are not only relevant but also boost the agency and self-determination of the individual because it is they themselves who perform the…”
Characterizing a psychiatric symptom dimension related to deficits in goal-directed control
Gillan, C. M., Kosinski, M., Whelan, R., Phelps, E. A., & Daw, N. D. (2016) · eLife · doi:10.7554/elife.11305 · Cited by 586 · cited 1×
“Although MTurk has been shown to be reliable as a recruitment tool for research [65-67], we excluded participants from analysis if they were not performing the task with care, which we determined in multiple steps.”
Efficacy of cognitive bias modification interventions in anxiety and depression: Meta-analysis
Cristea, I. A., Kok, R. N., & Cuijpers, P. (2015) · British Journal of Psychiatry · doi:10.1192/bjp.bp.114.146761 · Cited by 553
Evidence-Based Implementation of Evidence-Based Medicine
Grol, R., & Grimshaw, J. (1999) · The Joint Commission Journal on Quality Improvement · doi:10.1016/s1070-3241(16)30464-3 · Cited by 421 · cited 1×
“From the perspective of implementation medicine—the branch of medicine that asks if a research result should be implemented in practice [97]—it is a requirement to have evidence-based proof that a technique is either more effective than prior techniques or at least provides equal effectiveness with a lower investment…”
BackgroundGilbody, S., Littlewood, E., Hewitt, C., Brierley, G., Tharmanathan, P., Araya, R., Barkham, M., Bower, P., Cooper, C., Gask, L., et al. (2015) · BMJ · doi:10.1136/bmj.h5627 · Cited by 409 · cited 2×
“Researchers have recently promoted a need for demonstrated success of treatment efficacy in both research and practice [5,9], and the failure to close the research-practice gap has prompted suggestions that researchers still have a lot to learn about how to implement these types of interventions in the wild [5].”
Mohr, D. C., Weingardt, K. R., Reddy, M., & Schueller, S. M. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600541 · Cited by 365 · cited 5×
“There are several examples of internet-based mental health applications that have demonstrated treatment effects [4,5] in randomized controlled trials (RCTs) [6-8].”
BackgroundInfluentialCognitive bias modification: A review of meta-analyses
Jones, E. B., & Sharpe, L. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.07.034 · Cited by 338 · cited 2×
“ABMT has been shown to be an effective technique to shift a participant’s attention away from negative stimuli, to decrease self-reported anxiety, and to decrease the response to negative stimuli [31,36,37].”
Klinger, E., Bouchard, S., Légeron, P., Roy, S., Lauer, F., Chemin, I., & Nugues, P. (2005) · CyberPsychology & Behavior · doi:10.1089/cpb.2005.8.76 · Cited by 327
Motter, J. N., Pimontel, M. A., Rindskopf, D., Devanand, D. P., Doraiswamy, P. M., & Sneed, J. R. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.09.022 · Cited by 303 · cited 2×
“Feasibility studies on CCT have been shown to improve memory, self-control, reasoning, attention bias, and processing speed [22]; CCT has successfully been applied in clinical research to combat mental illness and cognitive deficits in disorders such as dementia [23], depression [24-26], neurodegenerative diseases [26…”
IntelliCare: An Eclectic, Skills-Based App Suite for the Treatment of Depression and Anxiety
Mohr, D. C., Tomasino, K. N., Lattie, E. G., Palac, H. L., Kwasny, M. J., Weingardt, K., Karr, C. J., Kaiser, S. M., Rossom, R. C., Bardsley, L. R., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6645 · Cited by 301
Coyle, H., Traynor, V., & Solowij, N. (2015) · The American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2014.04.009 · Cited by 274
Prins, P. J. M., Dovis, S., Ponsioen, A., ten Brink, E., & van der Oord, S. (2011) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2009.0206 · Cited by 249 · cited 3×
“of executive function [32], and research suggests that the paradigm can improve hyperactivity symptoms for children with ADHD [33] and reduce undesirable food intake when applied in the context of eating behavior [34].”
Carlbring, P., Apelstrand, M., Sehlin, H., Amir, N., Rousseau, A., Hofmann, S. G., & Andersson, G. (2012) · BMC Psychiatry · doi:10.1186/1471-244x-12-66 · Cited by 215 · cited 1×
“might require adjustment before dissemination over the internet [38].”
Doherty, G., Coyle, D., & Sharry, J. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208602 · Cited by 198 · cited 2×
“Additionally, personalization has been explored as an approach to enhance long-term engagement in the context of digital interventions for mental health [60].”
Dennis, T. A., & O’Toole, L. J. (2014) · Clinical Psychological Science · doi:10.1177/2167702614522228 · Cited by 197
Meyer, B., Bierbrodt, J., Schröder, J., Berger, T., Beevers, C. G., Weiss, M., Jacob, G., Späth, C., Andersson, G., Lutz, W., et al. (2015) · Internet Interventions · doi:10.1016/j.invent.2014.12.003 · Cited by 188 · cited 1×
“There are several examples of internet-based mental health applications that have demonstrated treatment effects [4,5] in randomized controlled trials (RCTs) [6-8].”
Thiart, H., Lehr, D., Ebert, D. D., Berking, M., & Riper, H. (2015) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.3478 · Cited by 168 · cited 1×
“There are several examples of internet-based mental health applications that have demonstrated treatment effects [4,5] in randomized controlled trials (RCTs) [6-8].”
Glenn, D., Golinelli, D., Rose, R. D., Roy-Byrne, P., Stein, M. B., Sullivan, G., Bystritksy, A., Sherbourne, C., & Craske, M. G. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0033403 · Cited by 166 · cited 1×
“Being inattentive, unfocused, or distracted will diminish the efficacy of attention-based training [39,40].”
Grafton, B., MacLeod, C., Rudaizky, D., Holmes, E. A., Salemink, E., Fox, E., & Notebaert, L. (2017) · British Journal of Psychiatry · doi:10.1192/bjp.bp.115.176123 · Cited by 160
Shechner, T., Rimon-Chakir, A., Britton, J. C., Lotan, D., Apter, A., Bliese, P. D., Pine, D. S., & Bar-Haim, Y. (2014) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2013.09.016 · Cited by 118 · cited 1×
“Furthermore, CCTs such as ABMT have been applied adjacent [91] to internet-based CBTs, showing potential in blending approaches.”
Richards, D., Timulak, L., O'Brien, E., Hayes, C., Vigano, N., Sharry, J., & Doherty, G. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2015.10.005 · Cited by 109
An integrative review of attention biases and their contribution to treatment for anxiety disorders
Barry, T. J., Vervliet, B., & Hermans, D. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00968 · Cited by 88
Schueller, S. M., Tomasino, K. N., & Mohr, D. C. (2017) · Clinical Psychology: Science and Practice · doi:10.1037/h0101740 · Cited by 70 · cited 1×
“For example, blended interventions, that is, interventions that blend internet-based forms of therapy with the interleaved presence of a therapist, have been shown to decrease the load on therapists and are similar in effect to traditionally delivered cognitive-behavioral therapy (CBT) programs [86,87].”
Cited by
Adaptive virtual reality-based training: a systematic literature review and framework
Zahabi, M., & Abdul Razak, A. M. (2020) · Virtual Reality · doi:10.1007/s10055-020-00434-w · Cited by 233
Saleem, M., Kühne, L., De Santis, K. K., Christianson, L., Brand, T., & Busse, H. (2021) · JMIR Mental Health · doi:10.2196/30000 · Cited by 199
“Birk and Mandryk [27] reported that avatar personalization for the intervention content greatly improved task-specific user engagement.”
BackgroundMethodInfluentialConnected Mental Health: Systematic Mapping Study
(2020) · doi:10.2196/19950 · Cited by 33
Stawarz, K., Preist, C., Tallon, D., Wiles, N., Kessler, D., Turner, K., Shafran, R., & Coyle, D. (2020) · JMIR Mental Health · doi:10.2196/15972 · Cited by 24
“This finding is also consistent with other recent research on digital mental health outside of the CBT space, which again found that therapist-led [48] and patient-led tailoring [49] can help to increase patient engagement.”
ResultKocur, M., Dechant, M., Wolff, C., Nothdurfter, C., Wetter, T. C., Rupprecht, R., & Shiban, Y. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.608997 · Cited by 15
Metadata
- Authors
- Birk, M. V., & Mandryk, R. L.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-01-08
- Volume
- 21
- Issue
- 1
- Pages
- e10133
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2891789702
- Cited by
- 70
- References
- 54
- FWCI
- 5.62
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.