The Relationships of Deteriorating Depression and Anxiety With Longitudinal Behavioral Changes in Google and YouTube Use During COVID-19: Observational Study
Open accessThe DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
Background: Depression and anxiety disorders among the global population have worsened during the COVID-19 pandemic. Yet, current methods for screening these two issues rely on in-person interviews, which can be expensive, time-consuming, and blocked by social stigma and quarantines. Meanwhile, how individuals engage with online platforms such as Google Search and YouTube has undergone drastic shifts due to COVID-19 and subsequent lockdowns. Such ubiquitous daily behaviors on online platforms have the potential to capture and correlate with clinically alarming deteriorations in depression and anxiety profiles of users in a noninvasive manner. Objective: The goal of this study is to examine, among college students in the United States, the relationships of deteriorating depression and anxiety conditions with the changes in user behaviors when engaging with Google Search and YouTube during COVID-19. Methods: This study recruited a cohort of undergraduate students (N=49) from a US college campus during January 2020 (prior to the pandemic) and measured the anxiety and depression levels of each participant. The anxiety level was assessed via the General Anxiety Disorder-7 (GAD-7). The depression level was assessed via the Patient Health Questionnaire-9 (PHQ-9). This study followed up with the same cohort during May 2020 (during the pandemic), and the anxiety and depression levels were assessed again. The longitudinal Google Search and YouTube history data of all participants were anonymized and collected. From individual-level Google Search and YouTube histories, we developed 5 features that can quantify shifts in online behaviors during the pandemic. We then assessed the correlations of deteriorating depression and anxiety profiles with each of these features. We finally demonstrated the feasibility of using the proposed features to build predictive machine learning models. Results: Of the 49 participants, 49% (n=24) of them reported an increase in the PHQ-9 depression scores; 53% (n=26) of them reported an increase in the GAD-7 anxiety scores. The results showed that a number of online behavior features were significantly correlated with deteriorations in the PHQ-9 scores (r ranging between –0.37 and 0.75, all P values less than or equal to .03) and the GAD-7 scores (r ranging between –0.47 and 0.74, all P values less than or equal to .03). Simple machine learning models were shown to be useful in predicting the change in anxiety and depression scores (mean squared error ranging between 2.37 and 4.22, R2 ranging between 0.68 and 0.84) with the proposed features. Conclusions: The results suggested that deteriorating depression and anxiety conditions have strong correlations with behavioral changes in Google Search and YouTube use during the COVID-19 pandemic. Though further studies are required, our results demonstrate the feasibility of using pervasive online data to establish noninvasive surveillance systems for mental health conditions that bypasses many disadvantages of existing screening methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The psychological impact of the COVID-19 epidemic on college students in China
Cao, W., Fang, Z., Hou, G., Han, M., Xu, X., Dong, J., & Zheng, J. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2020.112934 · Cited by 5,843 · cited 1×
“Worldwide mental health problems such as depression, anxiety, and suicidal ideation have severely worsened during the COVID-19 pandemic [1-3], specifically for college students [4-7].”
BackgroundHolmes, E. A., O'Connor, R. C., Perry, V. H., Tracey, I., Wessely, S., Arseneault, L., Ballard, C., Christensen, H., Cohen Silver, R., Everall, I., et al. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30168-1 · Cited by 5,715
Mental health and the COVID-19 pandemic
Pfefferbaum, B., & North, C. S. (2020) · New England Journal of Medicine · doi:10.1056/nejmp2008017 · Cited by 4,378 · cited 2×
“Worldwide mental health problems such as depression, anxiety, and suicidal ideation have severely worsened during the COVID-19 pandemic [1-3], specifically for college students [4-7].”
BackgroundCOVID-19 and mental health: A review of the existing literature
Rajkumar, R. P. (2020) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2020.102066 · Cited by 3,574 · cited 2×
“Worldwide mental health problems such as depression, anxiety, and suicidal ideation have severely worsened during the COVID-19 pandemic [1-3], specifically for college students [4-7].”
BackgroundThe outbreak of COVID-19 coronavirus and its impact on global mental health
Torales, J., O’Higgins, M., Castaldelli-Maia, J. M., & Ventriglio, A. (2020) · International Journal of Social Psychiatry · doi:10.1177/0020764020915212 · Cited by 3,013
Mental health problems and social media exposure during COVID-19 outbreak
Gao, J., Zheng, P., Jia, Y., Chen, H., Mao, Y., Chen, S., Wang, Y., Fu, H., & Dai, J. (2020) · PLoS ONE · doi:10.1371/journal.pone.0231924 · Cited by 2,830
Mental Health Problems and Social Media Exposure During COVID-19 Outbreak
Gao, J., Zheng, P., Jia, Y., Chen, H., Mao, Y., Chen, S., Wang, Y., Fu, H., & Dai, J. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3541120 · Cited by 2,830
Mental health care for medical staff in China during the COVID-19 outbreak
Chen, Q., Liang, M., Li, Y., Guo, J., Fei, D., Wang, L., He, L., Sheng, C., Cai, Y., Li, X., et al. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30078-x · Cited by 2,233
Leigh-Hunt, N., Bagguley, D., Bash, K., Turner, V., Turnbull, S., Valtorta, N., & Caan, W. (2017) · Public Health · doi:10.1016/j.puhe.2017.07.035 · Cited by 2,158 · cited 1×
“This is consistent with studies on patterns of social withdrawal and depression [42,65,66], and social interactions and isolations have been recognized by Leigh-Hunt et al [67] as one of the priorities in mental illness prevention, especially during COVID-19 [30].”
ResultManaging mental health challenges faced by healthcare workers during covid-19 pandemic
Greenberg, N., Docherty, M., Gnanapragasam, S., & Wessely, S. (2020) · BMJ · doi:10.1136/bmj.m1211 · Cited by 2,135
Pennycook, G., McPhetres, J., Zhang, Y., Lu, J. G., & Rand, D. G. (2020) · Psychological Science · doi:10.1177/0956797620939054 · Cited by 1,715
The Development and Psychometric Properties of LIWC2015
Pennebaker, J. W., Boyd, R. L., Jordan, K., & Blackburn, K. (2015) · University of Texas at Austin · doi:10.15781/t25p41 · Cited by 1,674
Elmer, T., Mepham, K., & Stadtfeld, C. (2020) · PLOS ONE · doi:10.1371/journal.pone.0236337 · Cited by 1,658 · cited 1×
“Worldwide mental health problems such as depression, anxiety, and suicidal ideation have severely worsened during the COVID-19 pandemic [1-3], specifically for college students [4-7].”
BackgroundSuicide risk and prevention during the COVID-19 pandemic
Gunnell, D., Appleby, L., Arensman, E., Hawton, K., John, A., Kapur, N., Khan, M., O'Connor, R. C., Pirkis, J., Appleby, L., et al. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30171-1 · Cited by 1,513
Potential Biases in Machine Learning Algorithms Using Electronic Health Record Data
Gianfrancesco, M. A., Tamang, S., Yazdany, J., & Schmajuk, G. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.3763 · Cited by 1,395 · cited 1×
“As an automatic medical screening system based on pervasive data, it has been shown that such frameworks are prone to implicit machine learning bias during data collection or training phases [69-71].”
BackgroundWang, P. S., Berglund, P., Olfson, M., Pincus, H. A., Wells, K. B., & Kessler, R. C. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.603 · Cited by 1,325
Lin, L. Y., Sidani, J. E., Shensa, A., Radovic, A., Miller, E., Colditz, J. B., Hoffman, B. L., Giles, L. M., & Primack, B. A. (2016) · Depression and Anxiety · doi:10.1002/da.22466 · Cited by 1,111
Artificial intelligence, bias and clinical safety
Challen, R., Denny, J., Pitt, M., Gompels, L., Edwards, T., & Tsaneva-Atanasova, K. (2019) · BMJ Quality & Safety · doi:10.1136/bmjqs-2018-008370 · Cited by 956 · cited 1×
“As an automatic medical screening system based on pervasive data, it has been shown that such frameworks are prone to implicit machine learning bias during data collection or training phases [69-71].”
BackgroundLinguistic Markers of Psychological Change Surrounding September 11, 2001
Cohn, M. A., Mehl, M. R., & Pennebaker, J. W. (2004) · Psychological Science · doi:10.1111/j.0956-7976.2004.00741.x · Cited by 808
Saeb, S., Zhang, M., Karr, C. J., Schueller, S. M., Corden, M. E., Kording, K. P., & Mohr, D. C. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4273 · Cited by 782
YouTube as a source of information on COVID-19: a pandemic of misinformation?
Li, H. O.-Y., Bailey, A., Huynh, D., & Chan, J. (2020) · BMJ Global Health · doi:10.1136/bmjgh-2020-002604 · Cited by 781
Social Networking Sites, Depression, and Anxiety: A Systematic Review
Seabrook, E. M., Kern, M. L., & Rickard, N. S. (2016) · JMIR Mental Health · doi:10.2196/mental.5842 · Cited by 763 · cited 1×
“Extensive research has been conducted on a population level, correlating mental health problems with user behaviors on social platforms [15,16], especially among young adolescents.”
BackgroundHuckins, J. F., daSilva, A. W., Wang, W., Hedlund, E., Rogers, C., Nepal, S. K., Wu, J., Obuchi, M., Murphy, E. I., Meyer, M. L., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/20185 · Cited by 759
Sleep in adolescence: Physiology, cognition and mental health
Tarokh, L., Saletin, J. M., & Carskadon, M. A. (2016) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2016.08.008 · Cited by 552 · cited 1×
“Moreover, the increasing activities during late night hours in online activity distributions and the positive shifts of medians of last seen events corresponded with previous studies in sleep deprivation and subsequent positive correlations with mental health deteriorations [60,61].”
ResultSocial media as a measurement tool of depression in populations
De Choudhury, M., Counts, S., & Horvitz, E. (2013) · Proceedings of the 5th Annual ACM Web Science Conference · doi:10.1145/2464464.2464480 · Cited by 497
Rutter, L. A., & Brown, T. A. (2017) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-016-9571-9 · Cited by 402
Pennycook, G., McPhetres, J., Zhang, Y., Lu, J. G., & Rand, D. G. (2020) · doi:10.31234/osf.io/uhbk9 · Cited by 390
Tracking Depression Dynamics in College Students Using Mobile Phone and Wearable Sensing
Wang, R., Wang, W., daSilva, A., Huckins, J. F., Kelley, W. M., Heatherton, T. F., & Campbell, A. T. (2018) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3191775 · Cited by 340 · cited 1×
“Mobile sensor data such as GPS logs [41,42]; electrodermal activity; and sleep behavior, motion, and phone use patterns [43,44] have been applied in investigating depressive symptoms.”
MethodThe relationship between mobile phone location sensor data and depressive symptom severity
Saeb, S., Lattie, E. G., Schueller, S. M., Kording, K. P., & Mohr, D. C. (2016) · PeerJ · doi:10.7717/peerj.2537 · Cited by 313
COVID-19-Related Web Search Behaviors and Infodemic Attitudes in Italy: Infodemiological Study.
Rovetta, A., & Bhagavathula, A. S. (2020) · JMIR Public Health and Surveillance · doi:10.2196/19374 · Cited by 291
Konjarski, M., Murray, G., Lee, V. V., & Jackson, M. L. (2018) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2018.05.005 · Cited by 259 · cited 1×
“Moreover, the increasing activities during late night hours in online activity distributions and the positive shifts of medians of last seen events corresponded with previous studies in sleep deprivation and subsequent positive correlations with mental health deteriorations [60,61].”
ResultNonverbal social withdrawal in depression: Evidence from manual and automatic analyses
Girard, J. M., Cohn, J. F., Mahoor, M. H., Mavadati, S. M., Hammal, Z., & Rosenwald, D. P. (2014) · Image and Vision Computing · doi:10.1016/j.imavis.2013.12.007 · Cited by 255 · cited 1×
“This is consistent with studies on patterns of social withdrawal and depression [42,65,66], and social interactions and isolations have been recognized by Leigh-Hunt et al [67] as one of the priorities in mental illness prevention, especially during COVID-19 [30].”
ResultEnhancing the clinical utility of depression screening
Kroenke, K. (2012) · Canadian Medical Association Journal · doi:10.1503/cmaj.112004 · Cited by 216 · cited 1×
“Similarly, as stated by Kroenke [56], an increase greater than or equal to 5 in the PHQ-9 score may indicate the need for medical interventions.”
BackgroundUse of Google Trends to investigate loss-of-smell-related searches during the COVID-19 outbreak
Walker, A., Hopkins, C., & Surda, P. (2020) · International Forum of Allergy & Rhinology · doi:10.1002/alr.22580 · Cited by 216 · cited 3×
“In addition, online behaviors during COVID-19 have been explored, especially for web searches related to the pandemic [10-12] and abnormal TV consumption during the lockdown [13].”
Backgroundde Bérail, P., Guillon, M., & Bungener, C. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.05.007 · Cited by 191
Psychological State of College Students During COVID-19 Epidemic
Liu, X., Liu, J., & Zhong, X. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3552814 · Cited by 133
Objective assessment of depressive symptoms with machine learning and wearable sensors data
Ghandeharioun, A., Fedor, S., Sangermano, L., Ionescu, D., Alpert, J., Dale, C., Sontag, D., & Picard, R. (2017) · 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII) · doi:10.1109/acii.2017.8273620 · Cited by 116
van Agteren, J., Bartholomaeus, J., Fassnacht, D. B., Iasiello, M., Ali, K., Lo, L., & Kyrios, M. (2020) · JMIR Mental Health · doi:10.2196/20696 · Cited by 66
Cited by
Robinson, E., Sutin, A. R., Daly, M., & Jones, A. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.09.098 · Cited by 1,147
Buizza, C., Bazzoli, L., & Ghilardi, A. (2022) · Adolescent Research Review · doi:10.1007/s40894-022-00192-7 · Cited by 149
“Seven studies were conducted in the USA (Charles et al., 2021; Copeland et al., 2021; Fruehwirth et al., 2021; Huckins et al., 2020; Rettew et al., 2021; Wilson et al., 2021; Zhang et al., 2020), three in China (Dun et al.”
BackgroundInfluentialDraženović, M., Vukušić Rukavina, T., & Machala Poplašen, L. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20043392 · Cited by 50
“Depression [21,24,27,29,31,32], anxiety [22,26,27,29,31,32] and stress [23,27,29] were listed in three or more studies, while panic [33], addictive SM use [23], mental and psychological distress [28,30], worsening of sleep pattern, lack of motivation and family arguments [25] were connected to SM use in two or fewer s…”
BackgroundMethodResultInfluential
Metadata
- Authors
- Zhang, B., Zaman, A., Silenzio, V., Kautz, H., & Hoque, E.
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2020-11-23
- Volume
- 7
- Issue
- 11
- Pages
- e24012
- ISSN
- 2368-7959 (ISSN-L)
- OpenAlex
- W3105033257
- Cited by
- 52
- References
- 38
- FWCI
- 3.25
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.