Cited by 84Digital Mental Health InterventionsMental Health via WritingEmotion and Mood Recognition

The Effortless Assessment of Risk States (EARS) Tool: An Interpersonal Approach to Mobile Sensing

Open access
Lind, Monika N, Byrne, Michelle L, Wicks, Geordie, Smidt, Alec M, Allen, Nicholas B·2018·JMIR Mental Health

Published version of a preprint

Abstract

Background: To predict and prevent mental health crises, we must develop new approaches that can provide a dramatic advance in the effectiveness, timeliness, and scalability of our interventions. However, current methods of predicting mental health crises (eg, clinical monitoring, screening) usually fail on most, if not all, of these criteria. Luckily for us, 77% of Americans carry with them an unprecedented opportunity to detect risk states and provide precise life-saving interventions. Smartphones present an opportunity to empower individuals to leverage the data they generate through their normal phone use to predict and prevent mental health crises. Objective: To facilitate the collection of high-quality, passive mobile sensing data, we built the Effortless Assessment of Risk States (EARS) tool to enable the generation of predictive machine learning algorithms to solve previously intractable problems and identify risk states before they become crises. Methods: The EARS tool captures multiple indices of a person’s social and affective behavior via their naturalistic use of a smartphone. Although other mobile data collection tools exist, the EARS tool places a unique emphasis on capturing the content as well as the form of social communication on the phone. Signals collected include facial expressions, acoustic vocal quality, natural language use, physical activity, music choice, and geographical location. Critically, the EARS tool collects these data passively, with almost no burden on the user. We programmed the EARS tool in Java for the Android mobile platform. In building the EARS tool, we concentrated on two main considerations: (1) privacy and encryption and (2) phone use impact. Results: In a pilot study (N=24), participants tolerated the EARS tool well, reporting minimal burden. None of the participants who completed the study reported needing to use the provided battery packs. Current testing on a range of phones indicated that the tool consumed approximately 15% of the battery over a 16-hour period. Installation of the EARS tool caused minimal change in the user interface and user experience. Once installation is completed, the only difference the user notices is the custom keyboard. Conclusions: The EARS tool offers an innovative approach to passive mobile sensing by emphasizing the centrality of a person’s social life to their well-being. We built the EARS tool to power cutting-edge research, with the ultimate goal of leveraging individual big data to empower people and enhance mental health.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/10334

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Digital tools offer the promise of taking evidence-based interventions to scale, reducing disparities in access to effective treatments and supports, and removing barriers to treatment resources.

    “Digital tools offer the promise of taking evidence-based interventions to scale, reducing disparities in access to effective treatments and supports, and removing barriers to treatment resources”

    From Annual Research Review: Adolescent mental health in the digital age: facts, fears, and future directions. (2020) · cites this paper as Lind et al., 2018

    The Motivation section (page unavailable) describes mobile interventions as promising and calls for interventions that are scalable and can reach people outside traditional mental health care. It does not say that digital tools reduce disparities in access or remove barriers to treatment resources; its proposed tool primarily assesses risk rather than delivering evidence-based treatment. (LLM, conf=0.83)

    Experimental — accuracy not yet measured
  • Evaluation at the later stage was mostly focused on information available from app providers and app functionalities, such as assessing app quality, intervention relevance, or privacy risks.

    “Evaluation at this stage was mostly focused on the information available from app providers and app functionalities, for instance, to assess app quality [74], intervention relevance [76], [77], or privacy risks speci cally [52].”

    From Security and Privacy of mHealth Applications: A Scoping Review (2020) · cites this paper as [76]

    The citation is attached to the claim about assessing privacy risks. The Considerations section discusses privacy risks, including developers’ terms-of-service agreements and the sale of user data. It does not describe a stage of app evaluation or say that privacy assessments were mostly based on provider information and app functionality. (LLM, conf=0.79)

    Experimental — accuracy not yet measured
  • The application of design guidelines was described in only five papers, which provided design recommendations to be applied during app development and conducted evaluation studies to validate their findings.

    “The application of design guidelines was described in only ve papers, which provided design recommendations to be applied during the process of app development, and conducted evaluation studies to validate their ndings [95], [105], [107] [109].”

    From Security and Privacy of mHealth Applications: A Scoping Review (2020) · cites this paper as [107]

    The EARS Tool Engineering section describes app-design choices to reduce burden, and What the EARS Tool Does reports a 24-person pilot that assessed participants’ experience. The paper does not describe applying design guidelines or validating design recommendations through that pilot. Its own text also cannot establish the citing review’s count of five papers. (LLM, conf=0.84)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 37 · Cited by 84

Research works printed but not linked: 22

  1. [1]Kessler RC Berglund P Demler O Jin R Koretz D Merikangas KR Rush AJ Walters EE Wang PS National Comorbidity Survey Replication The epidemiology of major depressive disorder: results from the National Comorbidity Survey Replication (NCS-R) JAMA 2003 06 18 289 23 3095 105 10.1001/jama.289.23.3095 12813115 289/23/3095 12813115 · DOI · Paper page
  2. [2]Mojtabai R Jorm AF Trends in psychological distress, depressive episodes and mental health treatment-seeking in the United States: 2001-2012 J Affect Disord 2015 03 15 174 556 61 10.1016/j.jad.2014.12.039 25556674 S0165-0327(14)00825-8 25556674 · DOI · Paper page
  3. [3]Reavley NJ Jorm AF Mental health reform: increased resources but limited gains Med J Aust 2014 10 6 201 7 375 376 10.5694/mja13.00198 25296048 25296048 · DOI
  4. [4]Murray CJL Vos T Lozano R Naghavi M Flaxman AD Michaud C Ezzati M Shibuya K Salomon JA Abdalla S Aboyans V Abraham J Ackerman I Aggarwal R Ahn SY Ali MK Alvarado M Anderson HR Anderson LM Andrews KG Atkinson C Baddour LM Bahalim AN Barker-Collo S Barrero LH Bartels DH Basáñez M Baxter A Bell ML Benjamin EJ Bennett D Bernabé E Bhalla K Bhandari B Bikbov B Bin AA Birbeck G Black JA Blencowe H Blore JD Blyth F Bolliger I Bonaventure A Boufous S Bourne R Boussinesq M Braithwaite T Brayne C Bridgett L Brooker S Brooks P Brugha TS Bryan-Hancock C Bucello C Buchbinder R Buckle G Budke CM Burch M Burney P Burstein R Calabria B Campbell B Canter CE Carabin H Carapetis J Carmona L Cella C Charlson F Chen H Cheng AT Chou D Chugh SS Coffeng LE Colan SD Colquhoun S Colson KE Condon J Connor MD Cooper LT Corriere M Cortinovis M de VKC Couser W Cowie BC Criqui MH Cross M Dabhadkar KC Dahiya M Dahodwala N Damsere-Derry J Danaei G Davis A De LD Degenhardt L Dellavalle R Delossantos A Denenberg J Derrett S Des JDC Dharmaratne SD Dherani M Diaz-Torne C Dolk H Dorsey ER Driscoll T Duber H Ebel B Edmond K Elbaz A Ali SE Erskine H Erwin PJ Espindola P Ewoigbokhan SE Farzadfar F Feigin V Felson DT Ferrari A Ferri CP Fèvre EM Finucane MM Flaxman S Flood L Foreman K Forouzanfar MH Fowkes FGR Fransen M Freeman MK Gabbe BJ Gabriel SE Gakidou E Ganatra HA Garcia B Gaspari F Gillum RF Gmel G Gonzalez-Medina D Gosselin R Grainger R Grant B Groeger J Guillemin F Gunnell D Gupta R Haagsma J Hagan H Halasa YA Hall W Haring D Haro JM Harrison JE Havmoeller R Hay RJ Higashi H Hill C Hoen B Hoffman H Hotez PJ Hoy D Huang JJ Ibeanusi SE Jacobsen KH James SL Jarvis D Jasrasaria R Jayaraman S Johns N Jonas JB Karthikeyan G Kassebaum N Kawakami N Keren A Khoo J King CH Knowlton LM Kobusingye O Koranteng A Krishnamurthi R Laden F Lalloo R Laslett LL Lathlean T Leasher JL Lee YY Leigh J Levinson D Lim SS Limb E Lin JK Lipnick M Lipshultz SE Liu W Loane M Ohno SL Lyons R Mabweijano J MacIntyre MF Malekzadeh R Mallinger L Manivannan S Marcenes W March L Margolis DJ Marks GB Marks R Matsumori A Matzopoulos R Mayosi BM McAnulty JH McDermott MM McGill N McGrath J Medina-Mora ME Meltzer M Mensah GA Merriman TR Meyer A Miglioli V Miller M Miller TR Mitchell PB Mock C Mocumbi AO Moffitt TE Mokdad AA Monasta L Montico M Moradi-Lakeh M Moran A Morawska L Mori R Murdoch ME Mwaniki MK Naidoo K Nair MN Naldi L Narayan KMV Nelson PK Nelson RG Nevitt MC Newton CR Nolte S Norman P Norman R O'Donnell M O'Hanlon S Olives C Omer SB Ortblad K Osborne R Ozgediz D Page A Pahari B Pandian JD Rivero AP Patten SB Pearce N Padilla RP Perez-Ruiz F Perico N Pesudovs K Phillips D Phillips MR Pierce K Pion S Polanczyk GV Polinder S Pope CA Popova S Porrini E Pourmalek F Prince M Pullan RL Ramaiah KD Ranganathan D Razavi H Regan M Rehm JT Rein DB Remuzzi G Richardson K Rivara FP Roberts T Robinson C De LFR Ronfani L Room R Rosenfeld LC Rushton L Sacco RL Saha S Sampson U Sanchez-Riera L Sanman E Schwebel DC Scott JG Segui-Gomez M Shahraz S Shepard DS Shin H Shivakoti R Singh D Singh GM Singh JA Singleton J Sleet DA Sliwa K Smith E Smith JL Stapelberg NJC Steer A Steiner T Stolk WA Stovner LJ Sudfeld C Syed S Tamburlini G Tavakkoli M Taylor HR Taylor JA Taylor WJ Thomas B Thomson WM Thurston GD Tleyjeh IM Tonelli M Towbin JA Truelsen T Tsilimbaris MK Ubeda C Undurraga EA van DWMJ van OJ Vavilala MS Venketasubramanian N Wang M Wang W Watt K Weatherall DJ Weinstock MA Weintraub R Weisskopf MG Weissman MM White RA Whiteford H Wiebe N Wiersma ST Wilkinson JD Williams HC Williams SRM Witt E Wolfe F Woolf AD Wulf S Yeh P Zaidi AKM Zheng Z Zonies D Lopez AD AlMazroa MA Memish ZA Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990-2010: a systematic analysis for the Global Burden of Disease Study 2010 Lancet 2012 12 15 380 9859 2197 223 10.1016/S0140-6736(12)61689-4 23245608 S0140-6736(12)61689-4 23245608 · DOI · Paper page
  5. [6][No authors listed] QuickStats: age-adjusted rate* for suicide, by sex - National Vital Statistics System, United States, 1975-2015 MMWR Morb Mortal Wkly Rep 2017 03 17 66 10 285 10.15585/mmwr.mm6610a7 10.15585/mmwr.mm6610a7 28301452 28301452 PMC5657868 · DOI
  6. [7]Yip PSF Caine E Yousuf S Chang S Wu KC Chen Y Means restriction for suicide prevention Lancet 2012 06 23 379 9834 2393 9 10.1016/S0140-6736(12)60521-2 22726520 S0140-6736(12)60521-2 22726520 PMC6191653 · DOI · Paper page
  7. [12]Ten Have M de Graaf R Monshouwer K Physical exercise in adults and mental health status findings from the Netherlands mental health survey and incidence study (NEMESIS) J Psychosom Res 2011 11 71 5 342 8 10.1016/j.jpsychores.2011.04.001 21999978 S0022-3999(11)00112-7 21999978 · DOI
  8. [14]Lederbogen F Kirsch P Haddad L Streit F Tost H Schuch P Wüst S Pruessner JC Rietschel M Deuschle M Meyer-Lindenberg A City living and urban upbringing affect neural social stress processing in humans Nature 2011 06 22 474 7352 498 501 10.1038/nature10190 21697947 nature10190 21697947 · DOI · Paper page
  9. [16]Lopresti AL Hood SD Drummond PD A review of lifestyle factors that contribute to important pathways associated with major depression: diet, sleep and exercise J Affect Disord 2013 05 15 148 1 12 27 10.1016/j.jad.2013.01.014 23415826 S0165-0327(13)00069-4 23415826 · DOI
  10. [17]Wojnar M Ilgen MA Wojnar J McCammon RJ Valenstein M Brower KJ Sleep problems and suicidality in the National Comorbidity Survey Replication J Psychiatr Res 2009 02 43 5 526 31 10.1016/j.jpsychires.2008.07.006 18778837 S0022-3956(08)00156-8 18778837 PMC2728888 · DOI
  11. [19]Thomée S Härenstam A Hagberg M Mobile phone use and stress, sleep disturbances, and symptoms of depression among young adults--a prospective cohort study BMC Public Health 2011 11 66 10.1186/1471-2458-11-66 21281471 1471-2458-11-66 21281471 PMC3042390 · DOI · Paper page
  12. [20]Randall WM Rickard NS Reasons for personal music listening: a mobile experience sampling study of emotional outcomes Psychol Music 2017 45 4 479 495 10.1177/0305735616666939 · DOI
  13. [22]Cohn JF De la Torre F Calvo R D'Mello S S Gratch J Kappas A Automated face analysis for affective computing The Oxford Handbook of Affective Computing 2014 New York, NY Oxford University Press 1 58
  14. [23]Cohn JF Kreuz TS Matthews I Yang Y Nguyen MH Padilla MT Zhou F De la Torre F Detecting depression from facial actions and vocal prosody 2009 Third Annual Conference on Affective Computing and Intelligent Interaction and Workshops Sep 10-12, 2009 Amsterdam, Netherlands 10.1109/ACII.2009.5349358 · DOI · Paper page
  15. [24]Cummins N Scherer S Krajewski J Schnieder S Epps J Quatieri TF A review of depression and suicide risk assessment using speech analysis Speech Commun 2015 07 71 10 49 10.1016/j.specom.2015.03.004 · DOI
  16. [25]Low LA Maddage NC Lech M Sheeber LB Allen NB Detection of clinical depression in adolescents' speech during family interactions IEEE Trans Biomed Eng 2011 03 58 3 574 86 10.1109/TBME.2010.2091640 21075715 21075715 PMC3652557 · DOI
  17. [26]Scherer S Lucas GM Gratch J Rizzo AS Morency LP Self-reported symptoms of depression and PTSD are associated with reduced vowel space in screening interviews IEEE Trans Affect Comput 2016 1 1 7 1 59 73 10.1109/TAFFC.2015.2440264 · DOI
  18. [27]Rude SS Gortner EM Pennebaker JW Language use of depressed and depression-vulnerable college students Cogn Emot 2004 12 18 8 1121 1133 10.1080/02699930441000030 · DOI · Paper page
  19. [28]Jashinsky J Burton SH Hanson CL West J Giraud-Carrier C Barnes MD Argyle T Tracking suicide risk factors through Twitter in the US Crisis 2014 35 1 51 9 10.1027/0227-5910/a000234 24121153 334K5X21L0436430 24121153 · DOI
  20. [29]Coppersmith G Ngo K Leary R Wood A Exploratory analysis of social media prior to a suicide attempt 2016 3rd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality June 16, 2016 San Diego, CA, USA 106 117
  21. [31]Servia-Rodriguez S Rachuri K Mascolo C Rentfrow P Lathia N Sandstrom G Mobile sensing at the service of mental well-being: a large-scale longitudinal study 2017 26th International World Wide Web Conference Apr 3-7, 2017 Perth, Australia 103 112 10.1145/3038912.3052618 · DOI · Paper page
  22. [39]Wahle F Kowatsch T Fleisch E Rufer M Weidt S Mobile sensing and support for people with depression: a pilot trial in the wild JMIR Mhealth Uhealth 2016 09 21 4 3 e111 10.2196/mhealth.5960 27655245 v4i3e111 27655245 PMC5052463 · DOI · Paper page

Authors
Lind, M. N., Byrne, M. L., Wicks, G., Smidt, A. M., & Allen, N. B.
Affiliations
University of Oregon (US)
Corresponding author
Allen, Nicholas B
Venue
JMIR Mental Health
Published
2018-08-28
Volume
5
Issue
3
Pages
e10334
ISSN
2368-7959 (ISSN-L)
OpenAlex
W2886286848
Cited by
84
References
37
Citations by year
2026: 11 · 2025: 9 · 2024: 10 · 2023: 15 · 2022: 13 · 2021: 11 · 2020: 10 · 2019: 5
FWCI
8.20
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Mental Health (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
  • National Institute on Aging (R24AG048024)
  • National Institute of Mental Health (K01MH111951)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Social Sciences › Psychology › Social Psychology › Mental Health via Writing
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Emotion and Mood Recognition
Keywords
smartphones, crisis prevention, social communication, facial expression analysis, voice quality, natural language use, physical activity, music selection, geographic location, user burden, battery consumption, Android, user experience

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review