Findings From a Trial of the Smartphone and OnLine Usage-based eValuation for Depression (SOLVD) Application: What Do Apps Really Tell Us About Patients with Depression? Concordance Between App-Generated Data and Standard Psychiatric Questionnaires for Depression and Anxiety
Abstract
Objective: Depression imposes a notable societal burden, with limited treatment success despite multiple available psychotherapy and medications choices. Potential reasons may include the heterogeneity of depression diagnoses and the presence of comorbid anxiety symptoms. Despite technological advances and the introduction of many mobile phone applications (apps) claiming to relieve depression, major gaps in knowledge still exist regarding what apps truly measure and how they correlate with psychometric questionnaires. The goal of this study was to evaluate whether mobile daily mood self-ratings may be useful in monitoring and classifying depression symptoms in a clinically depressed population compared with standard psychometric instruments including the Patient Health Questionaire-9 (PHQ-9), the Hamilton Rating Scale for Depression (HAM-D), and the Hamilton Anxiety Rating Scale (HAM-A). Method: For this study, 22 patients with major depressive disorder with or without comorbid anxiety disorder were recruited. The diagnosis of depression was confirmed through the Mini International Neuropsychiatric Interview (MINI). Over an 8-week period, daily moods were self-reported through the Smartphone and OnLine Usage-based eValuation for Depression (SOLVD) application, a custom-designed application that was downloaded onto patients’ mobile devices. Depression and anxiety symptoms were also measured biweekly using the HAM-D, HAM-A, and PHQ-9. Results: Significant correlations were observed among self-evaluated mood, daily steps taken, SMS (text) frequency, average call duration, and biweekly psychometric scores (|r|>0.5, P<0.05). The correlation coefficients were higher in individuals with more severe depressive symptoms. Conclusions: Although this study, given its limited sample size, was exploratory in nature, it helps fill a significant gap in our knowledge of the concordance between ratings obtained on the Ham-D, Ham-A, and the PHQ-9 psychometric instruments and data obtained via a smartphone app. These questionnaires represent gold-standard, commonly used psychiatric research/clinical instruments, and, thus, this information can serve as a foundation for digital phenotyping for depression and pave the way for interventional studies using smartphone applications.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Higher degrees of depression are linked to reduced contact with one's social network, shorter text messages, reduced duration of calls, and less variability in geospatial activity.
“Higher degrees of depression are linked to reduced contact with one’s social network, shorter text messages, reduced duration of calls, and less variability in geospatial activity [6-9].”
The SOLVD-Teen study was an extension of the SOLVD pilot trial, which established a correlation between clinician-rated measures, self-rated measures, and sensor-based app measures for depressed adult patients.
“The SOLVD-Teen study was an extension of the SOLVD pilot trial [9], which established a correlation between clinician-rated measures, self-rated measures, and sensor-based app measures for depressed adult patients.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Hamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817 · see citing works
The assessment of anxiety states by rating
HAMILTON, M. (1959) · British Journal of Medical Psychology · doi:10.1111/j.2044-8341.1959.tb00467.x · Cited by 11,455 · see citing works
Spitzer, R. L. (1999) · JAMA · doi:10.1001/jama.282.18.1737 · Cited by 9,802 · see citing works
DIRECT AND INVERSE SOLUTIONS OF GEODESICS ON THE ELLIPSOID WITH APPLICATION OF NESTED EQUATIONS
Vincenty, T. (1975) · Survey Review · doi:10.1179/sre.1975.23.176.88 · Cited by 1,302 · see citing works
Patel, V., Chisholm, D., Parikh, R., Charlson, F. J., Degenhardt, L., Dua, T., Ferrari, A. J., Hyman, S., Laxminarayan, R., Levin, C., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(15)00390-6 · Cited by 889 · see citing works
Ben-Zeev, D., Scherer, E. A., Wang, R., Xie, H., & Campbell, A. T. (2015) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000130 · Cited by 429 · see citing works
Systematic review of smartphone-based passive sensing for health and wellbeing
Cornet, V. P., & Holden, R. J. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.12.008 · Cited by 406 · see citing works
Păsărelu, C. R., Andersson, G., Bergman Nordgren, L., & Dobrean, A. (2017) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2016.1231219 · Cited by 335 · see citing works
aan het Rot, M., Hogenelst, K., & Schoevers, R. A. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.05.007 · Cited by 325 · see citing works
Kaner, E. F., Beyer, F. R., Garnett, C., Crane, D., Brown, J., Muirhead, C., Redmore, J., O'Donnell, A., Newham, J. J., de Vocht, F., et al. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011479.pub2 · Cited by 308 · see citing works
Response and remission criteria in major depression – A validation of current practice
Riedel, M. J., Möller, H., Obermeier, M., Schennach-Wolff, R., Bauer, M., Adli, M., Kronmüller, K., Nickel, T., Brieger, P., Laux, G., et al. (2010) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2010.03.006 · Cited by 289 · see citing works
Torous, J., Friedman, R., & Keshavan, M. (2014) · JMIR mHealth and uHealth · doi:10.2196/mhealth.2994 · Cited by 287 · see citing works
Dalgleish, T., & Werner‐Seidler, A. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.06.010 · Cited by 284 · see citing works
Carlo, V. D., Calati, R., & Serretti, A. (2016) · Psychiatry Research · doi:10.1016/j.psychres.2016.04.034 · Cited by 219 · see citing works
Smart Devices for Older Adults Managing Chronic Disease: A Scoping Review
Kim, B. Y., & Lee, J. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.7141 · Cited by 217 · see citing works
Dogan, E., Sander, C., Wagner, X., Hegerl, U., & Kohls, E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7006 · Cited by 177 · see citing works
Strategies for mHealth Research: Lessons from 3 Mobile Intervention Studies
Ben‐Zeev, D., Schueller, S. M., Begale, M. J., Duffecy, J. L., Kane, J. M., & Mohr, D. C. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0556-2 · Cited by 167 · see citing works
Comorbid “treatable traits” in difficult asthma: Current evidence and clinical evaluation
Tay, T. R., & Hew, M. J. (2017) · Allergy · doi:10.1111/all.13370 · Cited by 157 · see citing works
Braam, A. W., Copeland, J. R. M., Delespaul, P., Beekman, A. T. F., Çomo, A., Dewey, M. E., Fichter, M. M., Holwerda, T. J., LAWLOR, B. A., Lobo, A., et al. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.11.011 · Cited by 146 · see citing works
Health App Use Among US Mobile Phone Users: Analysis of Trends by Chronic Disease Status
Robbins, R., Krebs, P. M., Jagannathan, R., Jean‐Louis, G., & Duncan, D. T. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.7832 · Cited by 144 · see citing works
Polycystic ovary syndrome and mental disorders: a systematic review and exploratory meta-analysis
Blay, S. L., de Aguiar, J. V. N. M., & Passos, I. C. (2016) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s91700 · Cited by 111 · see citing works
Smartphone-based objective monitoring in bipolar disorder: status and considerations
Faurholt‐Jepsen, M., Bauer, M., & Kessing, L. V. (2018) · International Journal of Bipolar Disorders · doi:10.1186/s40345-017-0110-8 · Cited by 100 · see citing works
Assari, S., Burgard, S. A., & Zivin, K. (2015) · Journal of Racial and Ethnic Health Disparities · doi:10.1007/s40615-015-0116-9 · Cited by 94 · see citing works
Phillips, K. T., Phillips, M. M., Lalonde, T. L., & Prince, M. A. (2018) · Addictive Behaviors · doi:10.1016/j.addbeh.2018.01.004 · Cited by 76 · see citing works
Discriminating Between Bipolar Disorder and Major Depressive Disorder
Vöhringer, P. A., & Perlis, R. H. (2016) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2015.10.001 · Cited by 74 · see citing works
Nasrallah, H. A. (2015) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.14016tx2c · Cited by 73 · see citing works
Rubanovich, C. K., Mohr, D. C., & Schueller, S. M. (2017) · JMIR Mental Health · doi:10.2196/mental.7603 · Cited by 63 · see citing works
Treatment-Resistant Depression Increases Health Costs and Resource Utilization
Lepine, B. A., Moreno, R. A., Campos, R. N., & Couttolenc, B. F. (2012) · Brazilian Journal of Psychiatry · doi:10.1016/j.rbp.2012.05.009 · Cited by 54 · see citing works
Torous, J. B., & Keshavan, M. S. (2018) · Schizophrenia Research · doi:10.1016/j.schres.2018.01.005 · Cited by 43 · see citing works
Intermediate phenotypes and biomarkers of treatment outcome in major depressive disorder
Leuchter, A. F., Hunter, A. M., Krantz, D. E., & Cook, I. A. (2014) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2014.16.4/aleuchter · Cited by 42 · see citing works
Psychological Aspects of Heart Failure
Moser, D. K., Arslanian‐Engoren, C., Biddle, M., Chung, M. L., Dekker, R. L., Hammash, M., Mudd‐Martin, G., Alhurani, A. S., & Lennie, T. A. (2016) · Current Cardiology Reports · doi:10.1007/s11886-016-0799-5 · Cited by 39 · see citing works
Understanding Early Age of Onset: a Review of the Last 5 Years
Carlson, G. A., & Pataki, C. S. (2016) · Current Psychiatry Reports · doi:10.1007/s11920-016-0744-8 · Cited by 29 · see citing works
Kedzior, K. K., Gellersen, H. M., Roth, Y., & Zangen, A. (2015) · Psychiatry Research · doi:10.1016/j.psychres.2015.11.032 · Cited by 24 · see citing works
Kirchner, T., Magallón-Neri, E., Ortiz, M. S., Planellas, I., Forns, M., & Calderón, C. (2017) · The Spanish Journal of Psychology · doi:10.1017/sjp.2017.70 · Cited by 17 · see citing works
Accompanying Depression with FINE - A Smartphone-Based Approach.
Dang, M., Mielke, C., Diehl, A., & Haux, R. (2016) · PubMed · Cited by 14 · see citing works
Hogg, S. D., Ansari, S., Masood, Q., Agius, M. A., & Rihmer, Z. (2016) · PubMed · Cited by 7 · see citing works
Truong, A. L., Banu, S., Cao, J. R., Shah, A. A., Moukaddam, N. J., & Sabharwal, A. (2017) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2017.09.187 · Cited by 6 · see citing works
Self-citationDo no harm: a paradigm shift in the unchecked use of antidepressants
Morrissette, D. A. (2017) · CNS Spectrums · doi:10.1017/s1092852917000086 · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Digital Health Tools for the Passive Monitoring of Depression: A Systematic Review of Methods
de Angel, V., Lewis, S., White, K., Oetzmann, C., Leightley, D., Oprea, E., Lavelle, G., Matcham, F., Pace, A., Mohr, D. C., et al. (2021) · doi:10.1101/2021.07.19.21260786 · Cited by 227 · see citing works
Cao, J., Truong, A. L., Banu, S., Shah, A. A., Sabharwal, A., & Moukaddam, N. (2019) · doi:10.2196/preprints.14045 · Cited by 81 · see citing works
Self-citationZarate, D., Stavropoulos, V., Ball, M., Collier, G. D. S., & Jacobson, N. C. (2022) · BMC Psychiatry · doi:10.1186/s12888-022-04013-y · Cited by 79 · see citing works
Engagement with mobile health interventions for depression: A systematic review
Molloy, A. G., & Anderson, P. L. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100454 · Cited by 58 · see citing works
Digital Phenotyping and Feature Extraction on Smartphone Data for Depression Detection
Yang, M., Ngai, E. C. ‐., Hu, X., Hu, B., Liu, J., Erol Gelenbe, A., & Leung, V. C. M. (2024) · Proceedings of the IEEE · doi:10.1109/jproc.2025.3542324 · Cited by 54 · see citing works
Jayakumar, P., Lin, E., Galea, V. P., Mathew, A. J., Panda, N., Vetter, I., & Haynes, A. B. (2020) · Journal of Personalized Medicine · doi:10.3390/jpm10040282 · Cited by 41 · see citing works
Baryshnikov, I., Aledavood, T., Rosenström, T. H., Heikkilä, R., Darst, R. K., Riihimäki, K., Saleva, O., Ekelund, J., & Isometsä, E. T. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.12.127 · Cited by 36 · see citing works
Leong, Q. Y., Sridhar, S., Blasiak, A., Tadeo, X., Yeo, G., Remus, A., & Ho, D. (2021) · Journal of Medical Internet Research · doi:10.2196/27388 · Cited by 34 · see citing works
The Digital Phenotyping Project: A Psychoanalytical and Network Theory Perspective
Potier, R. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01218 · Cited by 22 · see citing works
Amin, R., Schreynemackers, S., Oppenheimer, H., Petrovic, M., Hegerl, U., & Reich, H. (2025) · Journal of Medical Internet Research · doi:10.2196/57418 · Cited by 24 · see citing works
Marin-Dragu, S., Forbes, A., Sheikh, S., Iyer, R. S., dos Santos, D. P., Alda, M., Hájek, T., Uher, R., Wozney, L., Paulovich, F. V., et al. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2023.115298 · Cited by 21 · see citing works
Translating the user-avatar bond into depression risk: A preliminary machine learning study.
Brown, T., Burleigh, T., Schivinski, B., Bennett, S., Gorman-Alesi, A., Blinka, L., & Stavropoulos, V. (2024) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2023.12.038 · Cited by 16 · see citing works
Mood and Activity Measured Using Smartphones in Unipolar Depressive Disorder
Tønning, M. L., Faurholt-Jepsen, M., Frost, M., Bardram, J. E., & Kessing, L. V. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.701360 · Cited by 17 · see citing works
van der Heijden, H. C., Rameh, V., Golden, E., Ronen, I., Sundel, R. P., Knight, A., Chang, J. C. H., & Upadhyay, J. (2023) · Arthritis & Rheumatology · doi:10.1002/art.42736 · Cited by 16 · see citing works
Mollard, E. K., Pedro, S., Schumacher, R., & Michaud, K. D. (2022) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-022-05520-5 · Cited by 15 · see citing works
Turning data into better mental health: Past, present, and future
Moukaddam, N. J., Sano, A., Salas, R., Hammal, Z., & Sabharwal, A. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.916810 · Cited by 12 · see citing works
Self-citationLamichhane, B., Moukaddam, N. J., & Sabharwal, A. (2024) · Scientific Reports · doi:10.1038/s41598-024-69739-z · Cited by 14 · see citing works
Self-citationLim, S., Kim, C., Cho, B. H., Choi, S., Lee, H., & Jang, D. P. (2023) · Biomedical Engineering Letters · doi:10.1007/s13534-023-00337-0 · Cited by 7 · see citing works
Using Mobile Daily Mood and Anxiety Self-ratings to Predict Depression Symptom Improvement
Sahoo, S., Shende, C., Hossain, M. Z., Patel, P. A., Wang, X., Mahmud, M. I., Bi, J., Kamath, J., Russell, A. C., Song, D., et al. (2024) · IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies · doi:10.1109/chase60773.2024.00012 · Cited by 5 · see citing works
Patient electronic communication data in clinical care: what is known and what is needed
Lhaksampa, T. C., Nanavati, J., Chisolm, M. S., & Miller, L. (2021) · International Review of Psychiatry · doi:10.1080/09540261.2020.1856052 · Cited by 3 · see citing works
Smartphone Data Gathered Early in Depression Treatment Predicts Treatment Outcome
Sahoo, S., Hossain, M. Z., Shende, C., Patel, P., Wang, X., Bi, J., Kamath, J., Russell, A. C., Song, D., & Wang, B. (2025) · IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies · doi:10.1145/3721201.3721380 · Cited by 2 · see citing works
Girousse, E., & Vuillerme, N. (2022) · JMIR Research Protocols · doi:10.2196/38785 · Cited by 2 · see citing works
Rahman, A. N., & Riswaya, A. R. (2023) · Electronic Business Management and Technology Journal · doi:10.55208/ebmtj.v1i1.88 · Cited by 1 · see citing works
Bidargaddi, N. P., Leibbrandt, R. E., Paget, T. L., Verjans, J. W. H., Looi, J. C., & Lipschitz, J. M. (2024) · Digital Health · doi:10.1177/20552076241260414 · Cited by 1 · see citing works
Potier, R. (2022) · L Évolution Psychiatrique · doi:10.1016/j.evopsy.2022.09.001 · Cited by 1 · see citing works
Zarate, D., Stavropoulos, V., Ball, M., de Sena Collier, G., & Jacobson, N. C. (2022) · Figshare · doi:10.6084/m9.figshare.20131117
Zarate, D., Stavropoulos, V., Ball, M., de Sena Collier, G., & Jacobson, N. C. (2022) · Figshare · doi:10.6084/m9.figshare.20131114
Aubourg, T. (2020) · doi:10.70675/839b38a4z7123z4a81zb34bz89e057455a67
- Authors
- MOUKADDAM, N., TRUONG, A., CAO, J., SHAH, A., & SABHARWAL, A.
- Affiliations
- Baylor College of Medicine (US)
- Venue
- Journal of Psychiatric Practice
- Published
- 2019-09
- Volume
- 25
- Issue
- 5
- Pages
- 365-373
- ISSN
- 1527-4160 (ISSN-L)
- 1538-1145
- OpenAlex
- W2987725842
- Cited by
- 28
- References
- 38
- Citations by year
- 2025: 2 · 2024: 5 · 2023: 4 · 2022: 9 · 2021: 4 · 2020: 3 · 2019: 1
- FWCI
- 4.80
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Psychiatric Practice (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- depression, mobile application, digital phenotyping, major depressive disorder, anxiety comorbidity, PHQ-9, Hamilton Depression Rating Scale, Hamilton Anxiety Rating Scale, mobile health, physical activity
- MeSH terms
- Smartphone, Adult, Anxiety Disorders, Depression, Depressive Disorder, Major, Major Depressive Disorder, Female, Humans, Male, Psychiatric Status Rating Scales, Psychometrics, Surveys and Questionnaires, Telemedicine, Comparative Effectiveness Research, Self Report, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
