The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Next-generation psychiatric assessment: Using smartphone sensors to monitor behavior and mental health.
Open accessAbstract
OBJECTIVE: Optimal mental health care is dependent upon sensitive and early detection of mental health problems. We have introduced a state-of-the-art method for the current study for remote behavioral monitoring that transports assessment out of the clinic and into the environments in which individuals negotiate their daily lives. The objective of this study was to examine whether the information captured with multimodal smartphone sensors can serve as behavioral markers for one's mental health. We hypothesized that (a) unobtrusively collected smartphone sensor data would be associated with individuals' daily levels of stress, and (b) sensor data would be associated with changes in depression, stress, and subjective loneliness over time. METHOD: A total of 47 young adults (age range: 19-30 years) were recruited for the study. Individuals were enrolled as a single cohort and participated in the study over a 10-week period. Participants were provided with smartphones embedded with a range of sensors and software that enabled continuous tracking of their geospatial activity (using the Global Positioning System and wireless fidelity), kinesthetic activity (using multiaxial accelerometers), sleep duration (modeled using device-usage data, accelerometer inferences, ambient sound features, and ambient light levels), and time spent proximal to human speech (i.e., speech duration using microphone and speech detection algorithms). Participants completed daily ratings of stress, as well as pre- and postmeasures of depression (Patient Health Questionnaire-9; Spitzer, Kroenke, & Williams, 1999), stress (Perceived Stress Scale; Cohen et al., 1983), and loneliness (Revised UCLA Loneliness Scale; Russell, Peplau, & Cutrona, 1980). RESULTS: Mixed-effects linear modeling showed that sensor-derived geospatial activity (p < .05), sleep duration (p < .05), and variability in geospatial activity (p < .05), were associated with daily stress levels. Penalized functional regression showed associations between changes in depression and sensor-derived speech duration (p < .05), geospatial activity (p < .05), and sleep duration (p < .05). Changes in loneliness were associated with sensor-derived kinesthetic activity (p < .01). CONCLUSIONS AND IMPLICATIONS FOR PRACTICE: Smartphones can be harnessed as instruments for unobtrusive monitoring of several behavioral indicators of mental health. Creative leveraging of smartphone sensing could provide novel opportunities for close-to-invisible psychiatric assessment at a scale and efficiency that far exceeds what is currently feasible with existing assessment technologies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, contrary to previous findings (19, 67–69), we did not find a significant relationship between the other smartphone features (total distance, location entropy, normalized location entropy and time spent at home) and mental health measures.”
From Predicting Symptoms of Depression and Anxiety Using Smartphone and Wearable Data (2021) · cites this paper as [69]
Experimental — accuracy not yet measuredIn the citing paper
“Depression, as one of the leading mental disorders, has been studied using audio sounds [76]. Other mental disorders have also been investigated using audio sensing, including bipolar [66], schizophrenia [77], autism [78]. Stress and mood which are highly correlated to mental health have also been studied using audio sounds [67,76].”
From Human-centred artificial intelligence for mobile health sensing: challenges and opportunities (2023) · cites this paper as [76]
In the citing paper
“The same observations were reproduced in younger adults (aged 19-30 years) [10], showing that changes in daily stress levels in young adults aged 19 to 30 years were associated with changes in geospatial activity, sleep duration (obtained by proxy from phone sensors), and sensor-derived speech duration.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. B. (2013) · Oxford University Press eBooks · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,845
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
A Global Measure of Perceived Stress
Cohen, S., Kamarck, T., & Mermelstein, R. (1983) · Journal of Health and Social Behavior · doi:10.2307/2136404 · Cited by 32,807
Spitzer, R. L. (1999) · JAMA · doi:10.1001/jama.282.18.1737 · Cited by 9,802
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
The Revised UCLA Loneliness Scale: concurrent and discriminant validity evidence
Russell, D., Peplau, L. A., & Cutrona, C. E. (1980) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.39.3.472 · Cited by 5,173
Loneliness matters: a theoretical and empirical review of consequences and mechanisms
Hawkley, L. C., & Cacioppo, J. T. (2010) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9210-8 · Cited by 4,782
Physical Activity and the Prevention of Depression
Mammen, G., & Faulkner, G. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.08.001 · Cited by 1,122
Wang, R., Chen, F., Chen, Z., Li, T., Harari, G., Tignor, S., Zhou, X., Ben-Zeev, D., & Campbell, A. T. (2014) · Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2632048.2632054 · Cited by 1,116
Self-citationmHealth for mental health: Integrating smartphone technology in behavioral healthcare.
Luxton, D. D., McCann, R. A., Bush, N. E., Mishkind, M. C., & Reger, G. M. (2011) · Professional Psychology: Research and Practice · doi:10.1037/a0024485 · Cited by 809
Depression as a disease of modernity: explanations for increasing prevalence
Hidaka, B. H. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2011.12.036 · Cited by 769
Trull, T. J., & Ebner-Priemer, U. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185510 · Cited by 761
Swan, M. (2009) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph6020492 · Cited by 730
Harnessing context sensing to develop a mobile intervention for depression
Burns, M. N., Begale, M., Duffecy, J., Gergle, D., Karr, C. J., Giangrande, E., & Mohr, D. C. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1838 · Cited by 646
Sleep disturbances as the hallmark of PTSD: where are we now?
Germain, A. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12040432 · Cited by 634
The Jigsaw continuous sensing engine for mobile phone applications
Lu, H., Yang, J., Liu, Z., Lane, N. D., Choudhury, T., & Campbell, A. T. (2010) · ACM Conference on Embedded Networked Sensor Systems (SenSys) · doi:10.1145/1869983.1869992 · Cited by 561
Self-citationFeasibility, Acceptability, and Preliminary Efficacy of a Smartphone Intervention for Schizophrenia
Ben-Zeev, D., Brenner, C. J., Begale, M., Duffecy, J., Mohr, D. C., & Mueser, K. T. (2014) · Schizophrenia Bulletin · doi:10.1093/schbul/sbu033 · Cited by 493
Self-citationEarly interventions to prevent psychosis: systematic review and meta-analysis
Stafford, M. R., Jackson, H., Mayo-Wilson, E., Morrison, A. P., & Kendall, T. (2013) · BMJ · doi:10.1136/bmj.f185 · Cited by 456
BeWell: A Smartphone Application to Monitor, Model and Promote Wellbeing
Lane, N., Mohammod, M., Lin, M., Yang, X., Lu, H., Ali, S., Doryab, A., Berke, E., Choudhury, T., & Campbell, A. (2011) · Proceedings of the 5th International ICST Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth.2011.246161 · Cited by 409
Self-citationSystematic review of school-based prevention and early intervention programs for depression
Calear, A. L., & Christensen, H. (2010) · Journal of Adolescence · doi:10.1016/j.adolescence.2009.07.004 · Cited by 365
Asmundson, G. J. G., Fetzner, M. G., DeBoer, L. B., Powers, M. B., Otto, M. W., & Smits, J. A. J. (2013) · Depression and Anxiety · doi:10.1002/da.22043 · Cited by 361
aan het Rot, M., Hogenelst, K., & Schoevers, R. A. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.05.007 · Cited by 325
EARLY INTERVENTIONS FOR PTSD: A REVIEW: Review: Early Intervention
Kearns, M. C., Ressler, K. J., Zatzick, D., & Rothbaum, B. O. (2012) · Depression and Anxiety · doi:10.1002/da.21997 · Cited by 310
Penalized Functional Regression
Goldsmith, J., Bobb, J. F., Crainiceanu, C. M., Caffo, B. S., & Reich, D. S. (2011) · Journal of Computational and Graphical Statistics · doi:10.1198/jcgs.2010.10007 · Cited by 289
Proudfoot, J., Clarke, J., Birch, M.-R., Whitton, A. E., Parker, G., Manicavasagar, V., Harrison, V., Christensen, H., & Hadzi-Pavlovic, D. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-312 · Cited by 264
Mobile technologies among people with serious mental illness: Opportunities for future services
Ben-Zeev, D., Davis, K. E., Kaiser, S., Krzsos, I., & Drake, R. E. (2013) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-012-0424-x · Cited by 249
Torous, J., Chan, S. R., Yee-Marie Tan, S., Behrens, J., Mathew, I., Conrad, E. J., Hinton, L., Yellowlees, P., & Keshavan, M. (2014) · JMIR Mental Health · doi:10.2196/mental.4004 · Cited by 228
Periods of Recovery in Deficit Syndrome Schizophrenia: A 20-Year Multi-follow-up Longitudinal Study
Strauss, G. P., Harrow, M., Grossman, L. S., & Rosen, C. (2008) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn167 · Cited by 206
Strategies for mHealth Research: Lessons from 3 Mobile Intervention Studies
Ben‐Zeev, D., Schueller, S. M., Begale, M. J., Duffecy, J. L., Kane, J. M., & Mohr, D. C. (2014) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-014-0556-2 · Cited by 181
Self-citationInterventions for helping people recognise early signs of recurrence in bipolar disorder
Morriss, R., Faizal, M. A., Jones, A. P., Williamson, P. R., Bolton, C. A., & McCarthy, J. P. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004854.pub2 · Cited by 166
Proudfoot, J. (2013) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867412471441 · Cited by 126
Mobile health (mHealth) for mental health in Asia: Objectives, strategies, and limitations
Brian, R. M., & Ben-Zeev, D. (2014) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2014.04.006 · Cited by 121
Self-citationAccuracy of Hospitalized Depressed Patients' and Healthy Controls' Retrospective Symptom Reports
Ben‐Zeev, D., & Young, M. A. (2010) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0b013e3181d6141f · Cited by 117
Self-citationSleep in Psychiatric Disorders: Where are We Now?
Lee, E. K., & Douglass, A. B. (2010) · The Canadian Journal of Psychiatry · doi:10.1177/070674371005500703 · Cited by 69
Objective Measurement of Sociability and Activity: Mobile Sensing in the Community
Berke, E. M., Choudhury, T., Ali, S., & Rabbi, M. (2011) · The Annals of Family Medicine · doi:10.1370/afm.1266 · Cited by 66
Goldberg, J. F., & Harrow, M. (2011) · Bipolar Disorders · doi:10.1111/j.1399-5618.2011.00903.x · Cited by 65
Self-monitoring of panic attacks and retrospective estimates of panic: discordant findings
de Beurs, E., Lange, A., & van Dyck, R. (1992) · Behaviour Research and Therapy · doi:10.1016/0005-7967(92)90054-k · Cited by 60
Gloster, A. T., Richard, D. C. S., Himle, J., Koch, E., Anson, H., Lokers, L., & Thornton, J. (2008) · Behaviour Research and Therapy · doi:10.1016/j.brat.2008.02.010 · Cited by 58
Carras, M. C., Mojtabai, R., Furr-Holden, D., Eaton, W. W., & Cullen, B. (2014) · Journal of Psychiatric Practice · doi:10.1097/01.pra.0000445244.08307.84 · Cited by 45
Detecting improvements in acute psychotic symptoms using experience sampling methodology
So, S. H., PETERS, E. R., Swendsen, J. D., Garety, P. A., & Kapur, S. (2013) · Psychiatry Research · doi:10.1016/j.psychres.2013.05.010 · Cited by 37
Komatsu, H., Sekine, Y., Okamura, N., Kanahara, N., Okita, K., Matsubara, S., Hirata, T., Komiyama, T., Watanabe, H., Minabe, Y., et al. (2013) · Schizophrenia Research · doi:10.1016/j.schres.2013.08.007 · Cited by 37
funreg: Functional Regression for Irregularly Timed Data
Dziak, J. J., & Shiyko, M. P. (2014) · doi:10.32614/cran.package.funreg · Cited by 2
Research works printed but not linked: 2
- Chen Z Lin M Chen F Lane MD Cardone G Wang R Li T Chen Y Choudhury T Campbell AT 2013 Unobtrusive sleep monitoring using Smartphones 7th International ICST Conference on Pervasive Computing Technologies for Healthcare (Pervasive Health) Venice
- Hedeker D Gibbons R 2006 Longitudinal data analysis NJ Wiley-Interscience
Cited by
Sorted by citations
Precision medicine, AI, and the future of personalized health care
Johnson, K. B., Wei, W., Weeraratne, D., Frisse, M. E., Misulis, K., Rhee, K., Zhao, J., & Snowdon, J. L. (2021) · Clinical and Translational Science · doi:10.1111/cts.12884 · Cited by 1,854
Huckins, J. F., daSilva, A. W., Wang, W., Hedlund, E., Rogers, C., Nepal, S. K., Wu, J., Obuchi, M., Murphy, E. I., Meyer, M. L., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/20185 · Cited by 759
Self-citationSmartphone Sensors for Health Monitoring and Diagnosis
Majumder, S., & Deen, M. J. (2019) · Sensors · doi:10.3390/s19092164 · Cited by 455
The Experience Sampling Method on Mobile Devices
van Berkel, N., Ferreira, D., & Kostakos, V. (2018) · ACM Computing Surveys · doi:10.1145/3123988 · Cited by 432
Lee, E., Torous, J. B., Choudhury, M. D., Depp, C. A., Graham, S. A., Kim, H., Paulus, M. P., Krystal, J. H., & Jeste, D. V. (2021) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2021.02.001 · Cited by 523
Metadata
- Authors
- Ben-Zeev, D., Scherer, E. A., Wang, R., Xie, H., & Campbell, A. T.
- Affiliations
- Dartmouth College (US)
- Venue
- Psychiatric Rehabilitation Journal
- Published
- 2015-09
- Volume
- 38
- Issue
- 3
- Pages
- 218-226
- ISSN
- 1095-158X (ISSN-L)
- 1559-3126
- PMC
- PMC4564327
- OpenAlex
- W2093973716
- Cited by
- 429
- References
- 42
- Citations by year
- 2026: 35 · 2025: 33 · 2024: 36 · 2023: 24 · 2022: 54 · 2021: 55 · 2020: 51 · 2019: 50 · 2018: 43 · 2017: 32 · 2016: 13 · 2015: 2
- FWCI
- 45.18
- Type
- journal article
- Language
- en
- Update notices
- correction (2015-12-21)
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Psychiatric Rehabilitation Journal (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health (R01MH103148)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Keywords
- smartphone sensors, mental health assessment, non-intrusive monitoring, daily stress, depression, loneliness, sleep duration, kinesthetic activities, speech duration, young adults, wearable devices, early detection of mental health problems, GPS tracking
- MeSH terms
- Smartphone, Adult, Mental Disorders, Female, Humans, Male, Telemedicine, Monitoring, Ambulatory, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
