Using Mobile Phone Sensor Technology for Mental Health Research: Integrated Analysis to Identify Hidden Challenges and Potential Solutions
Open accessPublished version of a preprint
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Mobile phone sensor technology has great potential in providing behavioral markers of mental health. However, this promise has not yet been brought to fruition. OBJECTIVE: The objective of our study was to examine challenges involved in developing an app to extract behavioral markers of mental health from passive sensor data. METHODS: Both technical challenges and acceptability of passive data collection for mental health research were assessed based on literature review and results obtained from a feasibility study. Socialise, a mobile phone app developed at the Black Dog Institute, was used to collect sensor data (Bluetooth, location, and battery status) and investigate views and experiences of a group of people with lived experience of mental health challenges (N=32). RESULTS: On average, sensor data were obtained for 55% (Android) and 45% (iOS) of scheduled scans. Battery life was reduced from 21.3 hours to 18.8 hours when scanning every 5 minutes with a reduction of 2.5 hours or 12%. Despite this relatively small reduction, most participants reported that the app had a noticeable effect on their battery life. In addition to battery life, the purpose of data collection, trust in the organization that collects data, and perceived impact on privacy were identified as main factors for acceptability. CONCLUSIONS: Based on the findings of the feasibility study and literature review, we recommend a commitment to open science and transparent reporting and stronger partnerships and communication with users. Sensing technology has the potential to greatly enhance the delivery and impact of mental health care. Realizing this requires all aspects of mobile phone sensor technology to be rigorously assessed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Limits of Predictability in Human Mobility
Song, C., Qu, Z., Blumm, N., & Barabási, A.-L. (2010) · Science · doi:10.1126/science.1177170 · Cited by 3,234 · cited 1×
“parameters and geographical contexts, such as age and population density, and it should therefore be determined whether behavioral markers extracted from GPS data are universal or context-dependent [50,51].”
BackgroundPromoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708 · cited 1×
“Finally, the data itself should be made available on open data repositories to enable data aggregation across studies to test potential markers in larger samples, resulting in more reproducible results [60].”
BackgroundCacioppo, J. T., Hughes, M. E., Waite, L. J., Hawkley, L. C., & Thisted, R. A. (2006) · Psychology and Aging · doi:10.1037/0882-7974.21.1.140 · Cited by 2,380 · cited 1×
“Social isolation, perceptions of loneliness, lower perceived social support, and fewer close relationships have all been linked to depression [11,12].”
BackgroundInferring friendship network structure by using mobile phone data
Eagle, N., Pentland, A. (., & Lazer, D. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0900282106 · Cited by 1,856
Unique in the Crowd: The privacy bounds of human mobility
de Montjoye, Y.-A., Hidalgo, C. A., Verleysen, M., & Blondel, V. D. (2013) · Scientific Reports · doi:10.1038/srep01376 · Cited by 1,645 · cited 1×
“User perceptions of an app’s confidential handling and use of data, as well as privacy and anonymity, are additional challenges of passive data collection [9,32,33].”
BackgroundDennison, L., Morrison, L., Conway, G., & Yardley, L. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2583 · Cited by 895
Saeb, S., Zhang, M., Karr, C. J., Schueller, S. M., Corden, M. E., Kording, K. P., & Mohr, D. C. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4273 · Cited by 782 · cited 10×
“We also estimated circadian movement, a feature that strongly correlated with self-reported depressive symptom severity [7].”
BackgroundMethodResultInfluentialTorous, J., Kiang, M. V., Lorme, J., & Onnela, J.-P. (2016) · JMIR Mental Health · doi:10.2196/mental.5165 · Cited by 758 · cited 4×
“This is consistent with the views of practitioners who have emphasized the importance of including contacts for medical professionals or other services in case of emergency or the need for immediate help [9].”
BackgroundResultInfluentialHarnessing Smartphone-Based Digital Phenotyping to Enhance Behavioral and Mental Health
Onnela, J.-P., & Rauch, S. L. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.7 · Cited by 726 · cited 2×
“Given that these digital records reflect the lived experiences of people in their natural environments, this technology may enable the development of precise and temporally dynamic behavioral phenotypes and markers to diagnose and treat mental illnesses [5].”
BackgroundMethodRegistered Reports: A Method to Increase the Credibility of Published Results
Nosek, B. A., & Lakens, D. (2014) · Social Psychology · doi:10.1027/1864-9335/a000192 · Cited by 716
Mohr, D. C., Burns, M. N., Schueller, S. M., Clarke, G., & Klinkman, M. (2013) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2013.03.008 · Cited by 693 · cited 1×
“In addition, there are specific challenges for using mobile phone sensor technology for mental health purposes, such as the engagement and retention of users [25].”
BackgroundPhysical activity and likelihood of depression in adults: a review
Teychenne, M., Ball, K., & Salmon, J. (2008) · Preventive Medicine · doi:10.1016/j.ypmed.2008.01.009 · Cited by 677
Harnessing context sensing to develop a mobile intervention for depression
Burns, M. N., Begale, M., Duffecy, J., Gergle, D., Karr, C. J., Giangrande, E., & Mohr, D. C. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1838 · Cited by 646 · cited 1×
“The platform gives access to a range of sensors including device information, battery level, Bluetooth, Wi-Fi, global positioning system (GPS), accelerometer, and communication logs [6] and has been used in research studies on mental health in the general community [7,8].”
MethodHarari, G. M., Lane, N. D., Wang, R., Crosier, B. S., Campbell, A. T., & Gosling, S. D. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616650285 · Cited by 515
mHealth: A Mechanism to Deliver More Accessible, More Effective Mental Health Care
Price, M., Yuen, E. K., Goetter, E. M., Herbert, J. D., Forman, E. M., Acierno, R., & Ruggiero, K. J. (2014) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.1855 · Cited by 488 · cited 1×
“Increasingly, a user-centered design approach is considered an integral part of any mental health app development [26-29].”
BackgroundmHealth Consumer Apps : The Case for User-Centered Design
McCurdie, T., Taneva, S., Casselman, M., Yeung, M., McDaniel, C., Ho, W., & Cafazzo, J. (2012) · Biomedical Instrumentation & Technology · doi:10.2345/0899-8205-46.s2.49 · Cited by 478 · cited 2×
“A user-centric design process [27] and the American Psychiatric Association’s app evaluation model [67] should be followed to provide meaningful user feedback from sensor data.”
BackgroundMethodBen-Zeev, D., Scherer, E. A., Wang, R., Xie, H., & Campbell, A. T. (2015) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000130 · Cited by 429 · cited 1×
“Mobile phone sensor technology has great potential in mental health research, providing the capability to collect objective data on behavioral indicators independent of user input [1-3].”
BackgroundSystematic review of school-based prevention and early intervention programs for depression
Calear, A. L., & Christensen, H. (2010) · Journal of Adolescence · doi:10.1016/j.adolescence.2009.07.004 · Cited by 365 · cited 1×
“Once candidate methods have been identified, it will be important to test these markers in larger longitudinal studies to see whether they predict the development of mental health problems and can be used to support prevention and early intervention programs [65].”
BackgroundSelf-citationProudfoot, J., Parker, G., Hadzi Pavlovic, D., Manicavasagar, V., Adler, E., & Whitton, A. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1475 · Cited by 274 · cited 1×
“Indeed, data privacy and confidentiality are major concerns for the users of mental health apps [36,37], but no consensus has yet been reached on ethical considerations that need to be addressed for the collection of passive sensor data.”
BackgroundDehling, T., Gao, F., Schneider, S., & Sunyaev, A. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3672 · Cited by 243 · cited 1×
“Mental health data are highly sensitive because of the potential negative implications of unwanted disclosure [34]; therefore, uncertainty about whether a service is confidential can be a barrier to care [35].”
BackgroundWho Owns the Data? Open Data for Healthcare
Kostkova, P., Brewer, H., de Lusignan, S., Fottrell, E., Goldacre, B., Hart, G., Koczan, P., Knight, P., Marsolier, C., McKendry, R. A., et al. (2016) · Frontiers in Public Health · doi:10.3389/fpubh.2016.00007 · Cited by 230
Torous, J. B., Chan, S. R., Gipson, S. Y.-M. T., Kim, J. W., Nguyen, T.-Q., Luo, J., & Wang, P. (2018) · Psychiatric Services · doi:10.1176/appi.ps.201700423 · Cited by 184 · cited 1×
“A user-centric design process [27] and the American Psychiatric Association’s app evaluation model [67] should be followed to provide meaningful user feedback from sensor data.”
MethodTorous, J., Staples, P., Barnett, I., Sandoval, L. R., Keshavan, M., & Onnela, J.-P. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0022-8 · Cited by 123 · cited 5×
“Currently, several sensing platforms are open source, such as Purple Robot [6] and recently, Beiwe [52].”
BackgroundMethodInfluentialEthical guidelines for mobile app development within health and mental health fields
Jones, N., & Moffitt, M. (2016) · Professional Psychology Research and Practice · doi:10.1037/pro0000069 · Cited by 70 · cited 1×
“Indeed, data privacy and confidentiality are major concerns for the users of mental health apps [36,37], but no consensus has yet been reached on ethical considerations that need to be addressed for the collection of passive sensor data.”
BackgroundSmartphone app to investigate the relationship between social connectivity and mental health
Boonstra, T. W., Werner-Seidler, A., O'Dea, B., Larsen, M. E., & Christensen, H. (2017) · 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2017.8036818 · Cited by 27 · cited 3×
“Most research using mobile phone Bluetooth to track social interactions has been performed in closed social networks [10,15,43,46].”
BackgroundResultSelf-citation
Research works printed but not linked: 41
- 10.1007/s11920-014-0523-3 · DOI
- 10.1007/s11920-015-0602-0 · DOI · Paper page
- 10.1016/j.cobeha.2017.07.018 · DOI · Paper page
- 10.2196/jmir.3376 · DOI · Paper page
- 10.1371/journal.pone.0095978 · DOI · Paper page
- Barnett, PA, 1988, Psychol Bull, 104, 97, 10.1037/0033-2909.104.1.97 · doi:10.1037/0033-2909.104.1.97 · Paper page
- 10.1016/j.socscimed.2014.04.015 · DOI
- Campbell, K, 1991, Soc Networks, 13, 203, 10.1016/0378-8733(91)90006-F · DOI · Paper page
- 10.1016/j.socscimed.2014.04.015 · DOI
- 10.1002/depr.3050030607 · DOI · Paper page
- 10.1016/j.genhosppsych.2009.04.002 · DOI · Paper page
- 10.1007/s11042-011-0982-z · DOI
- 10.1080/15472450.2013.764796 · DOI
- 10.1145/1555816.1555835 · DOI · Paper page
- 10.1080/17538150802457562 · DOI · Paper page
- 10.2196/jmir.4055 · DOI · Paper page
- 10.7205/MILMED-D-13-00271 · DOI · Paper page
- 10.1145/2110363.2110370 · DOI · Paper page
- 10.1097/01.pra.0000410987.38723.47 · DOI
- 10.1089/cyber.2016.0324 · DOI · Paper page
- 10.1007/978-3-319-09770-1_14 · DOI
- 10.1186/s40345-016-0051-7 · DOI · Paper page
- 10.1001/jamainternmed.2013.9166 · DOI · Paper page
- Andrejevic, M, 2014, Int J Commun. ISSN, 8, 17
- Boonstra, T, 2017, PLoS One, 12, e0189877, 10.1371/journal.pone.0189877 · DOI
- Townsend, S, 2015, arXiv, 150803938
- 10.1007/s00779-011-0489-7 · DOI
- 10.1145/2070481.2070550 · DOI · Paper page
- Press, W, 2007, Numerical recipes 3rd edition: The art of scientific computing
- 10.1080/01621459.1979.10481038 · DOI · Paper page
- Noulas, A, 2012, PloS One, 7, e37027, 10.1371/journal.pone.0037027 · DOI · Paper page
- Boonstra, T, 2015, Heliyon, 1, e00037, 10.1016/j.heliyon.2015.e00037 · DOI
- 10.1109/WMNC.2014.6878874 · doi:10.1109/wmnc.2014.6878874
- 10.1145/2448096.2448106 · DOI · Paper page
- Hogle, LF, 2016, BioSocieties, 11, 372, 10.1057/s41292-016-0004-5 · DOI
- Pentland, A, 2009, Stud Health Technol Inform, 149, 93
- 10.1109/MC.2013.195 · DOI · Paper page
- 10.1145/2968219.2968299 · DOI · Paper page
- 10.2139/ssrn.2924751 · DOI
- 10.1001/jama.2013.5914 · DOI · Paper page
- Rothstein, M, 2015, J Law Med Ethics, 43, 425, 10.1111/jlme.12258 · DOI
Cited by
Odendaal, W. A., Anstey Watkins, J., Leon, N., Goudge, J., Griffiths, F., Tomlinson, M., & Daniels, K. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011942.pub2 · Cited by 289
Digital Mental Health for Young People: A Scoping Review of Ethical Promises and Challenges
Wies, B., Landers, C., & Ienca, M. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.697072 · Cited by 242
“Other repeatedly discussed topics were the unclear efficacy and effectiveness (25, 27, 30, 31, 33, 34, 40), translational challenges and the uncertain feasibility of successful implementation (25) as well as uncertain reliability (19, 27, 28, 43, 50) of these technologies.”
BackgroundInfluentialBauer, M., Glenn, T., Geddes, J., Gitlin, M., Grof, P., Kessing, L. V., Monteith, S., Faurholt-Jepsen, M., Severus, E., & Whybrow, P. C. (2020) · International Journal of Bipolar Disorders · doi:10.1186/s40345-019-0164-x · Cited by 163
Trifan, A., Oliveira, M., & Oliveira, J. L. (2019) · JMIR mHealth and uHealth · doi:10.2196/12649 · Cited by 159
“This sensor was either used alone or along with Wi-Fi, Bluetooth, or accelerometer.”
BackgroundInfluentialSeppälä, J., De Vita, I., Jämsä, T., Miettunen, J., Isohanni, M., Rubinstein, K., Feldman, Y., Grasa, E., Corripio, I., Berdun, J., et al. (2019) · JMIR Mental Health · doi:10.2196/mental.9819 · Cited by 148
“Even if the evidence of association between sensor-based data and psychiatric disorder status and/or severity of psychiatric symptoms is limited and scattered [15-17], it is expected that appropriate management of these data may initiate a new trend in health care provision characterized by tailored and timely interve…”
Metadata
- Authors
- Boonstra, T. W., Nicholas, J., Wong, Q. J., Shaw, F., Townsend, S., & Christensen, H.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2018-07-30
- Volume
- 20
- Issue
- 7
- Pages
- e10131
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2884718929
- Cited by
- 107
- References
- 26
- FWCI
- 14.34
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.