Recommender systems for mental health apps: advantages and ethical challenges
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Recommender systems assist users in receiving preferred or relevant services and information. Using such technology could be instrumental in addressing the lack of relevance digital mental health apps have to the user, a leading cause of low engagement. However, the use of recommender systems for digital mental health apps, particularly those driven by personal data and artificial intelligence, presents a range of ethical considerations. This paper focuses on considerations particular to the juncture of recommender systems and digital mental health technologies. While separate bodies of work have focused on these two areas, to our knowledge, the intersection presented in this paper has not yet been examined. This paper identifies and discusses a set of advantages and ethical concerns related to incorporating recommender systems into the digital mental health (DMH) ecosystem. Advantages of incorporating recommender systems into DMH apps are identified as (1) a reduction in choice overload, (2) improvement to the digital therapeutic alliance, and (3) increased access to personal data & self-management. Ethical challenges identified are (1) lack of explainability, (2) complexities pertaining to the privacy/personalization trade-off and recommendation quality, and (3) the control of app usage history data. These novel considerations will provide a greater understanding of how DMH apps can effectively and ethically implement recommender systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Relation of the therapeutic alliance with outcome and other variables: a meta-analytic review
Martin, D. J., Garske, J. P., & Davis, M. K. (2000) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.68.3.438 · Cited by 3,355
Nahum-Shani, I., Smith, S. N., Spring, B. J., Collins, L. M., Witkiewitz, K., Tewari, A., & Murphy, S. A. (2018) · Annals of Behavioral Medicine · doi:10.1007/s12160-016-9830-8 · Cited by 2,171
The role of the therapeutic alliance in psychotherapy.
Horvath, A. O., & Luborsky, L. (1993) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.61.4.561 · Cited by 1,279
Can There Ever Be Too Many Options? A Meta-Analytic Review of Choice Overload
Scheibehenne, B., Greifeneder, R., & Todd, P. M. (2010) · Journal of Consumer Research · doi:10.1086/651235 · Cited by 1,070 · cited 2×
“…overload hypothesis (Scheibehenne et al. 2010), the experience of choice overload can psychologically overwhelm the user, acting to negatively diminish user autonomy and leading to lower levels of motivation and lower levels of satisfaction with their overall choice (Scheibehenne et al. 2010).”
BackgroundDesigning for Motivation, Engagement and Wellbeing in Digital Experience
Peters, D., Calvo, R. A., & Ryan, R. M. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00797 · Cited by 888
Torous, J., Nicholas, J., Larsen, M. E., Firth, J., & Christensen, H. (2018) · Evidence Based Mental Health · doi:10.1136/eb-2018-102891 · Cited by 790
Explainable Recommendation: A Survey and New Perspectives
Zhang, Y., & Chen, X. (2020) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000066 · Cited by 755
The digitally engaged patient: self-monitoring and self-care in the digital health era
Lupton, D. (2013) · Social Theory & Health · doi:10.1057/sth.2013.10 · Cited by 728
Fleming, T., Bavin, L., Lucassen, M., Stasiak, K., Hopkins, S., & Merry, S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9275 · Cited by 670 · cited 1×
“The struggle to engage users, and sustain engagement over time, is one of the greatest obstacles facing the digital mental health field (de Beurs et al. 2017; Fleming et al. 2018).”
BackgroundArdito, R. B., & Rabellino, D. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00270 · Cited by 647
Cautionary Statement for Forensic Use of DSM-5
(2014) · Diagnostic and Statistical Manual of Mental Disorders, 5th Edition · doi:10.1176/appi.books.9780890425596.744053 · Cited by 624
Recommender systems and their ethical challenges
Milano, S., Taddeo, M., & Floridi, L. (2020) · AI & SOCIETY · doi:10.1007/s00146-020-00950-y · Cited by 556 · cited 4×
“Whilst by now, there is an emerging body of literature considering ethical and socio-technical aspects of recommender systems (Milano et al. 2020; Paraschakis 2017) and similarly, a body of such literature for digital mental health technologies (D’Alfonso et al. 2019; Gooding 2019), the novelty of…”
BackgroundInfluentialPersuasive computers: perspectives and research directions
Fogg, B. (1998) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '98 · doi:10.1145/274644.274677 · Cited by 434
Sharon, T. (2017) · Philosophy & Technology · doi:10.1007/s13347-016-0215-5 · Cited by 428
Systematic review of smartphone-based passive sensing for health and wellbeing
Cornet, V. P., & Holden, R. J. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.12.008 · Cited by 406 · cited 2×
“…(requiring user involvement) and passively (not requiring user involvement), to make personalised recommendations has been an emerging area of interest in the digital health field (Abdullah and Choudhury 2018; Amft 2018; Boonstra et al. 2018; Chancel-lor et al. 2019; Cornet and Holden 2018).”
BackgroundTorous, J., & Roberts, L. W. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0262 · Cited by 362 · cited 2×
“The sale of private information to third parties without the user's knowledge or explicit consent is typical behaviour in the commercial market (Torous and Roberts 2017; Wang et al. 2018).”
BackgroundWang, K., Varma, D. S., & Prosperi, M. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.10.006 · Cited by 308
A Taxonomy of Ethical Tensions in Inferring Mental Health States from Social Media
Chancellor, S., Birnbaum, M. L., Caine, E. D., Silenzio, V. M. B., & De Choudhury, M. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287587 · Cited by 214
Urgent need for improved mental health care and a more collaborative model of care
Lake, J., & Turner, M. S. (2017) · The Permanente Journal · doi:10.7812/tpp/17-024 · Cited by 201 · cited 3×
“To date, mental ill-health accounts for approximately one-third of all years lost to disability globally (Lake and Turner 2017).”
BackgroundTremain, H., McEnery, C., Fletcher, K., & Murray, G. (2020) · JMIR Mental Health · doi:10.2196/17204 · Cited by 193
Alliance structure assessed by the Agnew Relationship Measure (ARM)
Agnew‐Davies, R., Stiles, W. B., Hardy, G. E., Barkham, M., & Shapiro, D. A. (1998) · British Journal of Clinical Psychology · doi:10.1111/j.2044-8260.1998.tb01291.x · Cited by 182
Ecological momentary interventions for depression and anxiety
Schueller, S. M., Aguilera, A., & Mohr, D. C. (2017) · Depression and Anxiety · doi:10.1002/da.22649 · Cited by 168
Alvarez‐Jimenez, M., Koval, P., Schmaal, L., Bendall, S., O'Sullivan, S., Cagliarini, D., D'Alfonso, S., Rice, S., Valentine, L., Penn, D. L., et al. (2021) · World Psychiatry · doi:10.1002/wps.20858 · Cited by 130
Self-citationBerry, K., Salter, A., Morris, R., James, S., & Bucci, S. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.8252 · Cited by 103 · cited 1×
“One preliminary or exploratory attempt to fashion a measure of DTA, the mobile Agnew Relation-ship Measure (Berry et al. 2018), is an adaptation of the Agnew Relationship Measure for the traditional therapeutic alliance (Agnew-Davies et al. 1998).”
BackgroundActive Involvement of End Users When Developing Web-Based Mental Health Interventions
de Beurs, D., van Bruinessen, I., Noordman, J., Friele, R., & van Dulmen, S. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00072 · Cited by 97 · cited 2×
“…paradox of choice theory, a selection of personalised EMR's could be suggested to the user to select from to address health conditions that may otherwise go unattended and does not rely on user engagement with the technology itself, which we already know to be typically low (de Beurs et al. 2017).”
BackgroundThe Digital Therapeutic Alliance and Human-Computer Interaction
D'Alfonso, S., Lederman, R., Bucci, S., & Berry, K. (2020) · JMIR Mental Health · doi:10.2196/21895 · Cited by 90
Self-citationClarke, J., Proudfoot, J., Whitton, A., Birch, M.-R., Boyd, M., Parker, G., Manicavasagar, V., Hadzi-Pavlovic, D., & Fogarty, A. (2016) · JMIR Mental Health · doi:10.2196/mental.4656 · Cited by 86
Lederman, R., Gleeson, J., Wadley, G., D’alfonso, S., Rice, S., Santesteban-Echarri, O., & Alvarez-Jimenez, M. (2019) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3301421 · Cited by 46
Self-citationPrivacy and confidentiality: perspectives of mental health consumers and carers in pharmacy settings
Hattingh, H. L., Knox, K., Fejzic, J., McConnell, D., Fowler, J. L., Mey, A., Kelly, F., & Wheeler, A. J. (2015) · International Journal of Pharmacy Practice · doi:10.1111/ijpp.12114 · Cited by 44 · cited 1×
“An individual's right to privacy and confidentiality regarding their mental health information is grounded in their therapeutic relationship with the health provider in question, for instance, a psychologist, pharmacist, or hospital (Hattingh et al. 2015).”
Background
Cited by
Use of AI in Mental Health Care: Community and Mental Health Professionals Survey
Cross, S., Bell, I., Nicholas, J., Valentine, L., Mangelsdorf, S., Baker, S., Titov, N., & Alvarez-Jimenez, M. (2024) · JMIR Mental Health · doi:10.2196/60589 · Cited by 113
Self-citationHabicht, J., Dina, L.-M., McFadyen, J., Stylianou, M., Harper, R., Hauser, T. U., & Rollwage, M. (2025) · Journal of Medical Internet Research · doi:10.2196/60435 · Cited by 52
“This relationship, also known as therapeutic alliance, has been shown to increase engagement and predict positive clinical change [23].”
Responsible Artificial Intelligence: A Structured Literature Review
Goellner, S., Tropmann-Frick, M., & Brumen, B. (2024) · arXiv · doi:10.48550/arxiv.2403.06910 · Cited by 8
Laure, T., Engels, R. C. M. E., Remmerswaal, D., Spruijt-Metz, D., Konigorski, S., & Boffo, M. (2023) · JMIR Research Protocols · doi:10.2196/46603 · Cited by 4
“…recommendation system introduces a potential solution to the low engagement and impact of the mobile intervention because efficiency, system responsiveness, and content relevance to users’needs are highly valued among this population and have been reported as lacking in available MH apps [18,49].”
Background
Metadata
- Authors
- Valentine, L., D’Alfonso, S., & Lederman, R.
- Venue
- AI & SOCIETY
- Published
- 2022-01-17
- Volume
- 38
- Issue
- 4
- Pages
- 1627-1638
- ISSN
- 0951-5666 (ISSN-L)
- 1435-5655
- OpenAlex
- W4205786352
- Cited by
- 92
- References
- 29
- FWCI
- 15.54
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.