The Potential of Game-Based Digital Biomarkers for Modeling Mental Health
Open accessThe DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
Background: Assessment for mental health is performed by experts using interview techniques, questionnaires, and test batteries and following standardized manuals; however, there would be myriad benefits if behavioral correlates could predict mental health and be used for population screening or prevalence estimations. A variety of digital sources of data (eg, online search data and social media posts) have been previously proposed as candidates for digital biomarkers in the context of mental health. Playing games on computers, gaming consoles, or mobile devices (ie, digital gaming) has become a leading leisure activity of choice and yields rich data from a variety of sources. Objective: In this paper, we argue that game-based data from commercial off-the-shelf games have the potential to be used as a digital biomarker to assess and model mental health and health decline. Although there is great potential in games developed specifically for mental health assessment (eg, Sea Hero Quest), we focus on data gathered “in-the-wild” from playing commercial off-the-shelf games designed primarily for entertainment. Methods: We argue that the activity traces left behind by natural interactions with digital games can be modeled using computational approaches for big data. To support our argument, we present an investigation of existing data sources, a categorization of observable traits from game data, and examples of potentially useful game-based digital biomarkers derived from activity traces. Results: Our investigation reveals different types of data that are generated from play and the sources from which these data can be accessed. Based on these insights, we describe five categories of digital biomarkers that can be derived from game-based data, including behavior, cognitive performance, motor performance, social behavior, and affect. For each type of biomarker, we describe the data type, the game-based sources from which it can be derived, its importance for mental health modeling, and any existing statistical associations with mental health that have been demonstrated in prior work. We end with a discussion on the limitations and potential of data from commercial off-the-shelf games for use as a digital biomarker of mental health. Conclusions: When people play commercial digital games, they produce significant volumes of high-resolution data that are not only related to play frequency, but also include performance data reflecting low-level cognitive and motor processing; text-based data that are indicative of the affective state; social data that reveal networks of relationships; content choice data that imply preferred genres; and contextual data that divulge where, when, and with whom the players are playing. These data provide a source for digital biomarkers that may indicate mental health. Produced by engaged human behavior, game data have the potential to be leveraged for population screening or prevalence estimations, leading to at-scale, nonintrusive assessment of mental health.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Picard, R. W. (1997) · MIT Press · doi:10.7551/mitpress/1140.001.0001 · Cited by 7,382
The episodic buffer: a new component of working memory?
Baddeley, A. (2000) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(00)01538-2 · Cited by 7,359
Skevington, S. M., Lotfy, M., & O'Connell, K. A. (2004) · Quality of Life Research · doi:10.1023/b:qure.0000018486.91360.00 · Cited by 4,686 · cited 1×
“In addition to these financial costs, people experience costs to their well-being that range from a lower quality of life [107] to a loss of life [108].”
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567 · cited 1×
“The use of data derived from digital sources is part of a larger discussion [97-99]; as with all digital data, game-based biomarkers require consideration for topics such as inferring identity, communicating mental health assessment, privacy of in-game conversations, and legality of gathering data…”
Cognitive impairment in depression: a systematic review and meta-analysis
Rock, P. L., Roiser, J. P., Riedel, W. J., & Blackwell, A. D. (2014) · Psychological Medicine · doi:10.1017/s0033291713002535 · Cited by 2,161 · cited 1×
“People experiencing symptoms of depression, for example, show differences in executive functioning, sustained attention, and memory [61,62], which debilitates a player’s ability to play games that rely on these cognitive systems.”
Depression Is the Leading Cause of Disability Around the World
Friedrich, M. J. (2017) · JAMA · doi:10.1001/jama.2017.3826 · Cited by 1,459
Scaling-up treatment of depression and anxiety: a global return on investment analysis
Chisholm, D., Sweeny, K., Sheehan, P., Rasmussen, B., Smit, F., Cuijpers, P., & Saxena, S. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)30024-4 · Cited by 1,451 · cited 1×
“Untreated mental illness has serious consequences; the estimated US $2.5-8.5 trillion globally in lost output attributed to mental, neurological, and substance use disorders is expected to almost double by 2030 [106].”
InfluentialDevelopment and validation of a Game Addiction Scale for adolescents
Lemmens, J. S., Valkenburg, P. M., & Peter, J. (2009) · Media Psychology · doi:10.1080/15213260802669458 · Cited by 1,428 · cited 1×
“For example, research on pathological gaming has used definitions of addictive behavior to describe problematic or obsessive video game playing [45]; however, associations between excessive play and psychosocial health have not been consistently evident, even among gamers classified as “addicted”…”
Moltu, C., Stefansen, J., Svisdahl, M., & Veseth, M. (2012) · Disability and Rehabilitation · doi:10.3109/09638288.2012.656792 · Cited by 1,247
Eye tracking of attention in the affective disorders: a meta-analytic review and synthesis
Armstrong, T., & Olatunji, B. O. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.09.004 · Cited by 1,049 · cited 1×
“For example, eye gaze patterns have been used to characterize individuals with various depression and anxiety disorders [85].”
Language use of depressed and depression-vulnerable college students
Rude, S., Gortner, E.-M., & Pennebaker, J. (2004) · Cognition & Emotion · doi:10.1080/02699930441000030 · Cited by 1,018
Nock, M. K., Hwang, I., Sampson, N., Kessler, R. C., Angermeyer, M., Beautrais, A., Borges, G., Bromet, E., Bruffaerts, R., de Girolamo, G., et al. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000123 · Cited by 912 · cited 1×
“In addition to these financial costs, people experience costs to their well-being that range from a lower quality of life [107] to a loss of life [108].”
Digital Phenotyping: Technology for a New Science of Behavior
Insel, T. R. (2017) · JAMA · doi:10.1001/jama.2017.11295 · Cited by 833
Trepte, S., Reinecke, L., & Juechems, K. (2012) · Computers in Human Behavior · doi:10.1016/j.chb.2011.12.003 · Cited by 462
Identifying emotional states using keystroke dynamics
Epp, C., Lippold, M., & Mandryk, R. L. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979046 · Cited by 364
Self-citationAhern, E., & Semkovska, M. (2017) · Neuropsychology · doi:10.1037/neu0000319 · Cited by 321 · cited 1×
“People experiencing symptoms of depression, for example, show differences in executive functioning, sustained attention, and memory [61,62], which debilitates a player’s ability to play games that rely on these cognitive systems.”
Effects of Internet use and social resources on changes in depression
Bessière, K., Kiesler, S., Kraut, R., & Boneva, B. S. (2008) · Information, Communication & Society · doi:10.1080/13691180701858851 · Cited by 316 · cited 1×
“Although online communication has been found to negatively affect one’s well-being despite its social nature [76], the issue is more complex and requires nuanced consideration of the usage purpose, context, and individual differences [77,78].”
Real-time assessment of suicidal thoughts and behaviors
Kleiman, E. M., & Nock, M. K. (2018) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2017.07.026 · Cited by 239
Seeing Gray When Feeling Blue? Depression Can Be Measured in the Eye of the Diseased
Bubl, E., Kern, E., Ebert, D., Bach, M., & Tebartz van Elst, L. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.02.009 · Cited by 216 · cited 1×
“…of impulsivity, depressed people in remission are often grouped with control subjects rather than depressed participants [91], whereas in terms of visual acuity, depressed participants, regardless of the pharmaceutical treatment, are differentiated from the control group, but not each other [92].”
Dennis, T. A., & O’Toole, L. J. (2014) · Clinical Psychological Science · doi:10.1177/2167702614522228 · Cited by 197
Coutrot, A., Schmidt, S., Coutrot, L., Pittman, J., Hong, L., Wiener, J. M., Hölscher, C., Dalton, R. C., Hornberger, M., & Spiers, H. J. (2019) · PLOS ONE · doi:10.1371/journal.pone.0213272 · Cited by 177
The Pace of Technologic Change
Patrick, K., Hekler, E. B., Estrin, D., Mohr, D. C., Riper, H., Crane, D., Godino, J., & Riley, W. T. (2016) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.05.001 · Cited by 169
Colder Carras, M., Van Rooij, A. J., Van de Mheen, D., Musci, R., Xue, Q.-L., & Mendelson, T. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2016.11.060 · Cited by 166
Modeling and Understanding Visual Attributes of Mental Health Disclosures in Social Media
Manikonda, L., & De Choudhury, M. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025932 · Cited by 116 · cited 1×
“Digital biomarkers are increasingly being used to indicate potential mental health issues [86-89].”
De Grove, F., Cauberghe, V., & Van Looy, J. (2016) · Media Psychology · doi:10.1080/15213269.2014.902318 · Cited by 98
Snodgrass, J. G., Bagwell, A., Patry, J. M., Dengah, H. J. F., Smarr-Foster, C., Van Oostenburg, M., & Lacy, M. G. (2018) · Computers in Human Behavior · doi:10.1016/j.chb.2017.09.020 · Cited by 82
It's all about me: self-focused attention and depressed mood
Sloan, D. M. (2005) · Cognitive Therapy and Research · doi:10.1007/s10608-005-0511-1 · Cited by 39
Cited by
Gooding, P., & Kariotis, T. (2021) · JMIR Mental Health · doi:10.2196/24668 · Cited by 100
Connected Mental Health: Systematic Mapping Study
(2020) · doi:10.2196/19950 · Cited by 33
Remote Assessment of Depression Using Digital Biomarkers From Cognitive Tasks
Mandryk, R. L., Birk, M. V., Vedress, S., Wiley, K., Reid, E., Berger, P., & Frommel, J. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.767507 · Cited by 23
“However, when behavioral or cognitive correlates of depression are already known, a contrasting approach (Mandryk and Birk, 2019) is to develop custom software tools that monitor people’s responses (e.g., reaction time, performance, decisions), and then use statistical approaches to predict the…”
BackgroundSelf-citation
Metadata
- Authors
- Mandryk, R. L., & Birk, M. V.
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2019-04-23
- Volume
- 6
- Issue
- 4
- Pages
- e13485
- ISSN
- 2368-7959 (ISSN-L)
- OpenAlex
- W2947110395
- Cited by
- 80
- References
- 28
- FWCI
- 13.66
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.