Technology Enabled Clinical Care (TECC): Protocol for a Prospective Longitudinal Cohort Study of Smartphone-Augmented Mental Health Treatment
Open accessPublished version of a preprint
The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index; 23 of the 49 sources its claims cite were checked for support.
Abstract
Background: Even before COVID-19, there has been an urgent need to expand access to and quality of mental health care. This paper introduces an 8-week treatment protocol to realize that vision—Technology Enabled Clinical Care (TECC). TECC offers innovation in clinical assessment, monitoring, and interventions for mental health. TECC uses the mindLAMP app to enable digital phenotyping, clinical communication, and smartphone-based exercises that will augment in-person or telehealth virtual visits. TECC exposes participants to an array of evidence-based treatments (cognitive behavioral therapy, dialectical behavior therapy, acceptance and commitment therapy) introduced through clinical sessions and then practiced through interactive activities provided through a smartphone app called mindLAMP. Objective: TECC will test the feasibility of providing technology-enabled mental health care within an outpatient clinic; explore the practicality for providing this care to individuals with limited English proficiency; and track anxiety, depression, and mood symptoms for participants to measure the effectiveness of the TECC design. Methods: The TECC study will assess the acceptability and efficacy of this care model in 50 participants as compared to an age- and gender-matched cohort of patients presenting with similar clinical severity of depression, anxiety, or psychotic symptoms. Participants will be recruited from clinics in the Metro Boston area. Aspects of TECC will be conducted in both Spanish and English to ensure wide access to care for multiple populations. Results: The results of the TECC study will be used to support or adapt this model of care and create training resources to ensure its dissemination. The study results will be posted on ClinicalTrials.gov, with primary outcomes related to changes in mood, anxiety, and stress, and secondary outcomes related to engagement, alliance, and satisfaction. Conclusions: TECC combines new digital mental health technology with updated clinical protocols and workflows designed to ensure patients can benefit from innovation in digital mental health. Supporting multiple languages, TECC is designed to ensure digital health equity and highlights how mobile health can bridge, not expand, gaps in care for underserved populations. International Registered Report Identifier (IRRID): PRR1-10.2196/23771. © Natali Rauseo-Ricupero, John Torous.
Overview
CoChat Summary
## TL;DR
TECC is an 8-session, smartphone-augmented mental health care protocol using the mindLAMP app to combine clinical sessions with app-based monitoring and exercises. This paper is a study protocol for a prospective longitudinal cohort study, so it reports planned methods and analyses rather than results.
## Key findings
- The study is designed to enroll 50 participants and compare them with an age- and gender-matched cohort of patients with similar clinical severity of depression, anxiety, or psychotic symptoms.
- Primary outcomes are planned as changes in mood, anxiety, and stress; secondary outcomes are engagement, alliance, and satisfaction.
- The authors hypothesize a treatment response rate of 50% symptom reduction in anxiety and depression within the 8 weeks of treatment compared with baseline.
- TECC is intended to be delivered in Spanish and English; the paper notes that the Spanish beta version will be tested for linguistic and cultural appropriateness before use.
## Methods
- Design: Prospective longitudinal cohort study over 1 year, with 8 clinical sessions delivered via telehealth or video platform; all participants receive the same TECC treatment.
- Sample/data: 50 adults (18+ years) from clinics in the Metro Boston area, with mild to moderate depression or anxiety on PHQ-9 or GAD-7; participants must have daily smartphone access and be willing to use the mindLAMP app.
- Main analysis: Planned intent-to-treat analysis using generalized linear models and multiple regression to assess symptom change and associations with baseline factors, race, language, education, working alliance, and technology engagement; dropout will be examined with inverse probability weighting if needed.
## Limitations
- The paper is a protocol, so no outcomes are reported yet; this is inherent in the text rather than stated as a limitation.
- The study is limited to participants who are able to meet the app and visit requirements, including daily smartphone access and, until Spanish is vetted, English literacy at an eighth-grade level; this may restrict generalizability (evident from the text).
- The authors note the need to test the Spanish beta version for cultural and linguistic appropriateness before clinical use, indicating that multilingual implementation is still under development.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures










Verification
Claims the paper makes
16 Valid · 4 Not valid · 18 Not checked · 22 Own results and interpretations
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“rates of psychosocial distress have increased most in the Latino community compared to any other group [17].”
§ Technology Enabled Clinical Care (TECC): Protocol for a Prospective Longitudinal Cohort Study of Smartphone-Augmented Mental Health Treatment > Introduction
What the sources say
- Disputedcites [17] sourceExperimental — accuracy not yet measured
The subgroup results (listed under Methods; page not provided) show serious psychological distress rising among Hispanic adults from 4.4% in 2018 to 18.3% in April 2020. Among adults aged 18–29, it rose from 3.7% to 24.0%—a larger increase both in percentage points and proportionally. The paper therefore does not support the claim that the increase was greatest in the Latino community compared with any other group. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
At least one cited source doesn’t support this claim or points to a different paper, and none confirmed it — see the verdicts below.
In the paper
“with prior barriers toward adoption now largely overcome [12-14].”
§ Technology Enabled Clinical Care (TECC): Protocol for a Prospective Longitudinal Cohort Study of Smartphone-Augmented Mental Health Treatment > Introduction
What the sources say
- Disputedcites [12] sourceExperimental — accuracy not yet measured
The Discussion (Other Social and Organizational Factors; no page supplied) says funding and reimbursement problems usually hinder clinicians’ adoption of mobile health tools. The Conclusions and Implications section calls for resolving interoperability and technical issues, rather than describing adoption barriers as largely overcome. (LLM, conf=0.87)
Checked by a reasoning model — may be wrong.
- Not checked — no full text of the sourcecites [13] source
- Not checked — no full text of the sourcecites [14] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Disputed
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Evidence suggests that short-term therapies—often 8-12 weeks in length—are as effective as longer-term treatments in terms of both immediate and longitudinal outcomes [20].”
§ Technology Enabled Clinical Care (TECC): Protocol for a Prospective Longitudinal Cohort Study of Smartphone-Augmented Mental Health Treatment > Introduction
What the sources say
- Partly supportedcites [20] sourceExperimental — accuracy not yet measured
The Results report no significant difference in depressive symptoms between the three treatments at weeks 36, 52, and 86, supporting comparable outcomes in adolescents with depression. But the paper does not establish that therapies lasting 8–12 weeks generally match longer treatments: its brief intervention was planned for 12 weeks, while the Results report a mean actual treatment duration of 27.5 weeks in that group. (LLM, conf=0.88)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“past research has shown high app engagement can correlate with higher clinical outcomes [55]”
§ Technology Enabled Clinical Care (TECC): Protocol for a Prospective Longitudinal Cohort Study of Smartphone-Augmented Mental Health Treatment > Discussion
What the sources say
- Supportedcites [55] source
The Conclusions and Future Research section reports that active use of the mobile ACT app was associated with improved psychological flexibility, and that intensity-of-use metrics were the strongest predictors of change. This supports the citing sentence’s broad claim that greater app engagement can correlate with better clinical outcomes. (LLM, conf=0.92)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“patients tend to drop out of care less when receiving treatment that matches their personal preferences [56]”
§ Technology Enabled Clinical Care (TECC): Protocol for a Prospective Longitudinal Cohort Study of Smartphone-Augmented Mental Health Treatment > Discussion
What the sources say
- Supportedcites [56] source
The Conclusions state that receiving a preferred treatment is associated with lower dropout rates among patients with mental health diagnoses. The citing sentence presents this as a tendency rather than a causal effect, consistent with the paper’s wording. (LLM, conf=0.94)
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
4 more claims · 1 with their cited sources checked
Create a free account to see all 60 claims and every source verdict.
- Probably not a substantial claim. 47
- It may state two separate claims as one. 18
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 1×
“Specifically, participants will be asked to complete the PHQ-9 (which measures depression rates from minimal depression to severe depression) and the GAD-7 scale (a widely accepted anxiety scale that evaluates scores as either mild, moderate, or severe anxiety) on a daily basis [46,47].”
The WHO-5 well-being index: A systematic review of the literature
Topp, C. W., Østergaard, S. D., Søndergaard, S., & Bech, P. (2015) · Psychotherapy and Psychosomatics · doi:10.1159/000376585 · Cited by 4,708 · cited 1×
“…motivation scale, to asses participants commitment to change through treatment; the World Health Organization Five, a well-being assessment scale [51]; and the Working Alliance Inventory–Short Form, a scale to assess the alliance a patient feels toward the clinician that is known to be a…”
COVID-19 and mental health: A review of the existing literature
Rajkumar, R. P. (2020) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2020.102066 · Cited by 3,574 · cited 1×
“Both the short-and long-term effects of the COVID-19 pandemic are already leading to a paradigm shift across the health care industry [1-3].”
Garnefski, N., Kraaij, V., Schroevers, M. J., & Somsen, G. A. (2008) · Journal of Clinical Psychology in Medical Settings · doi:10.1007/s10880-008-9136-5 · Cited by 2,479
COVID-19 and Racial/Ethnic Disparities
Webb Hooper, M., Nápoles, A. M., & Pérez-Stable, E. J. (2020) · JAMA · doi:10.1001/jama.2020.8598 · Cited by 2,047
Empirical Evaluation of the Revised Technology Acceptance Model
Szajna, B. (1996) · Management Science · doi:10.1287/mnsc.42.1.85 · Cited by 1,656 · cited 1×
“The technology acceptance model, a well-known implementation science framework, will also be used to assess feasibility of technology-infused care [54].”
Supporting the health care workforce during the COVID-19 global epidemic
Adams, J. G., & Walls, R. M. (2020) · JAMA · doi:10.1001/jama.2020.3972 · Cited by 1,498 · cited 1×
“Both the short-and long-term effects of the COVID-19 pandemic are already leading to a paradigm shift across the health care industry [1-3].”
Légaré, F., Ratté, S., Gravel, K., & Graham, I. D. (2008) · Patient Education and Counseling · doi:10.1016/j.pec.2008.07.018 · Cited by 1,321
Prins, A., Bovin, M. J., Smolenski, D. J., Marx, B. P., Kimerling, R., Jenkins-Guarnieri, M. A., Kaloupek, D. G., Schnurr, P. P., Kaiser, A. P., Leyva, Y. E., et al. (2016) · Journal of General Internal Medicine · doi:10.1007/s11606-016-3703-5 · Cited by 1,303
Handbook of Psychiatric Measures
SALZMAN, C. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.8.1343 · Cited by 1,174
Implementing shared decision making in the NHS
Elwyn, G., Laitner, S., Coulter, A., Walker, E., Watson, P., & Thomson, R. (2010) · BMJ · doi:10.1136/bmj.c5146 · Cited by 1,090 · cited 1×
“For the purposes of this study, SDM will be defined as the process when provider and client review available treatment options and when clients are encouraged to select the treatment plan that best fits their personal preferences [27].”
Responding to Covid-19 — A Once-in-a-Century Pandemic?
Gates, B. (2020) · New England Journal of Medicine · doi:10.1056/nejmp2003762 · Cited by 1,076
Behavioral activation treatment for depression: returning to contextual roots
Jacobson, N. S., Martell, C. R., & Dimidjian, S. (2001) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.8.3.255 · Cited by 1,011 · cited 1×
“Modern day behavioral activation techniques include encouraging clients to become aware of avoidance behaviors and places extra emphasis on understanding environmental factors rather than thought patterns [36].”
Psychological distress and loneliness reported by US adults in 2018 and April 2020
McGinty, E. E., Presskreischer, R., Han, H., & Barry, C. L. (2020) · JAMA · doi:10.1001/jama.2020.9740 · Cited by 978 · cited 1×
“…for Disease Control and Prevention recently reported that, regardless of age, Latinos are four times more likely to contract COVID-19 than their non-Latino White counterparts [16], and rates of psychosocial distress have increased most in the Latino community compared to any other group [17].”
Torous, J., Jän Myrick, K., Rauseo-Ricupero, N., & Firth, J. (2020) · JMIR Mental Health · doi:10.2196/18848 · Cited by 946 · cited 1×
“Data suggests the mental health field is now the largest user of telehealth [8], with prior barriers toward adoption now largely overcome [12-14].”
Self-citationm-Health adoption by healthcare professionals: a systematic review
Gagnon, M.-P., Ngangue, P., Payne-Gagnon, J., & Desmartis, M. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv052 · Cited by 622
Munder, T., Wilmers, F., Leonhart, R., Linster, H. W., & Barth, J. (2010) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.658 · Cited by 538 · cited 1×
“…treatment; the World Health Organization Five, a well-being assessment scale [51]; and the Working Alliance Inventory–Short Form, a scale to assess the alliance a patient feels toward the clinician that is known to be a predictor of treatment success (this scale will begin after session one) [52].”
Healthcare professionals’ competence in digitalisation: A systematic review
Konttila, J., Siira, H., Kyngäs, H., Lahtinen, M., Elo, S., Kääriäinen, M., Kaakinen, P., Oikarinen, A., Yamakawa, M., Fukui, S., et al. (2019) · Journal of Clinical Nursing · doi:10.1111/jocn.14710 · Cited by 444
Matters of mind: Mindfulness/mindlessness in perspective
Langer, E. J. (1992) · Consciousness and Cognition · doi:10.1016/1053-8100(92)90066-j · Cited by 443 · cited 1×
“Additionally, practicing mindfulness has been thought to enhance self-awareness, openness to new experiences, and provide users with a deeper understanding of self [38].”
Physician workforce in the United States of America: forecasting nationwide shortages
Zhang, X., Lin, D., Pforsich, H., & Lin, V. W. (2020) · Human Resources for Health · doi:10.1186/s12960-020-0448-3 · Cited by 424 · cited 1×
“The pandemic has underscored systemic health disparities, clinician shortages, and financial strain that highlight the need for new innovation [4-6].”
The Relationship between Health Literacy and Health Disparities: A Systematic Review
Mantwill, S., Monestel-Umaña, S., & Schulz, P. J. (2015) · PLOS ONE · doi:10.1371/journal.pone.0145455 · Cited by 395
COVID-19 and telemedicine: Immediate action required for maintaining healthcare providers well-being
Moazzami, B., Razavi-Khorasani, N., Dooghaie Moghadam, A., Farokhi, E., & Rezaei, N. (2020) · Journal of Clinical Virology · doi:10.1016/j.jcv.2020.104345 · Cited by 388 · cited 1×
“As the field looks toward technology to offer accessible and cost-effective solutions, now is the time to consider how digitally informed care can provide improved outcomes while reducing access inequities for marginalized communities [7-10].”
Selden, T. M., & Berdahl, T. A. (2020) · Health Affairs · doi:10.1377/hlthaff.2020.00897 · Cited by 388
Torous, J., & Roberts, L. W. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0262 · Cited by 362 · cited 1×
“At the time of this writing, there were an estimated 10,000 mental health apps available to consumers [57].”
Self-citationA Scoping Review of Health Disparities in Autism Spectrum Disorder
Bishop-Fitzpatrick, L., & Kind, A. J. H. (2017) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-017-3251-9 · Cited by 351 · cited 1×
“…that contributes to health inequities, and much has been written about these factors that are collectively known as social determinants of health [59-62]; however, before fully incorporating a multi-language app into care, the team will ensure the Spanish Beta version of the app is culturally…”
Powerful Ideas About Empowerment
Staples, L. H. (1990) · Administration in Social Work · doi:10.1300/j147v14n02_03 · Cited by 330
Jacob, C., Sanchez-Vazquez, A., & Ivory, C. (2020) · JMIR mHealth and uHealth · doi:10.2196/15935 · Cited by 292 · cited 1×
“Data suggests the mental health field is now the largest user of telehealth [8], with prior barriers toward adoption now largely overcome [12-14].”
Racial and Ethnic Disparities in Health Care for Adolescents: A Systematic Review of the Literature
Elster, A., Jarosik, J., VanGeest, J., & Fleming, M. (2003) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpedi.157.9.867 · Cited by 279
COVID-19 and the Financial Health of US Hospitals
Khullar, D., Bond, A. M., & Schpero, W. L. (2020) · JAMA · doi:10.1001/jama.2020.6269 · Cited by 272 · cited 1×
“The pandemic has underscored systemic health disparities, clinician shortages, and financial strain that highlight the need for new innovation [4-6].”
The Revised Behavior and Symptom Identification Scale (BASIS-R): Reliability and Validity
Eisen, S. V., Normand, S.-L., Belanger, A. J., Spiro, A., & Esch, D. (2004) · Medical Care · doi:10.1097/00005650-200412000-00010 · Cited by 262 · cited 1×
“…Disorder-5, which assess for posttraumatic stress disorder [49]; the Behavior and Symptom Identification Scale-24, a symptom assessment scale [50]; a patient motivation scale, to asses participants commitment to change through treatment; the World Health Organization Five, a well-being…”
Goodyer, I. M., Reynolds, S., Barrett, B., Byford, S., Dubicka, B., Hill, J., Holland, F., Kelvin, R., Midgley, N., Roberts, C., et al. (2017) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)30378-9 · Cited by 259 · cited 1×
“Evidence suggests that short-term therapies—often 8-12 weeks in length—are as effective as longer-term treatments in terms of both immediate and longitudinal outcomes [20].”
Economides, M., Martman, J., Bell, M. J., & Sanderson, B. (2018) · Mindfulness · doi:10.1007/s12671-018-0905-4 · Cited by 250 · cited 1×
“Mobile technology studies, including a 2018 randomized trial and a separate efficacy-based investigation, found mobile app interventions could reduce stress and irritability, and yielded statistically significant efficacy measures [39,40].”
Torous, J., Wisniewski, H., Bird, B., Carpenter, E., David, G., Elejalde, E., Fulford, D., Guimond, S., Hays, R., Henson, P., et al. (2019) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-019-00095-w · Cited by 202 · cited 1×
“As previously mentioned, the mindLAMP app will be used to provide digitally augmented care [24].”
Self-citationBauer, A. M., Chen, C.-N., & Alegría, M. (2010) · Medical Care · doi:10.1097/mlr.0b013e3181f80749 · Cited by 168 · cited 1×
“Research has shown that individuals with limited English proficiency are less likely to seek out specialty treatment like mental health care and, when diagnosed, have more severe long-term mental health complications [18].”
Torous, J., & Wykes, T. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.1640 · Cited by 167 · cited 1×
“Although concerns around telehealth visits remain, especially around the impact on the therapeutic alliance, research suggests a positive response from both patients and clinicians with no clear harm to alliance documented [15].”
Self-citationWindle, E., Tee, H., Sabitova, A., Jovanovic, N., Priebe, S., & Carr, C. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.3750 · Cited by 162 · cited 1×
“Furthermore, by allowing flexibility and customization of language used during skill-building activities, the study aims to limit dropout rates, as patients tend to drop out of care less when receiving treatment that matches their personal preferences [56].”
Rathbone, A. L., Clarry, L., & Prescott, J. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8598 · Cited by 158 · cited 1×
“Studies have shown that CBT smartphone apps have therapeutic potential [31]; however, like many apps, high user engagement and sufficient long-term outcomes seem to be the top barriers for effective CBT app outcomes [32].”
The Role of Digital Navigators in Promoting Clinical Care and Technology Integration into Practice
Wisniewski, H., Gorrindo, T., Rauseo-Ricupero, N., Hilty, D., & Torous, J. (2020) · Digital Biomarkers · doi:10.1159/000510144 · Cited by 155 · cited 1×
“These modules will teach digital navigators how to perform their main responsibilities of selecting smartphone apps for care, troubleshooting technology issues for both client and clinician, and ensuring app data is understood by all parties [23].”
Self-citationYellowlees, P., Nakagawa, K., Pakyürek, M., Hanson, A., Elder, J., & Kales, H. C. (2020) · Psychiatric Services · doi:10.1176/appi.ps.202000230 · Cited by 137 · cited 1×
“The mental health field has also adopted telehealth quickly with one clinic converting to 100% digital visits within 72 hours [11].”
Blackledge, J. T. (2007) · The Psychological Record · doi:10.1007/bf03395595 · Cited by 136 · cited 1×
“Specifically, they will learn cognitive defusion, an ACT intervention, which asks participants to notice their thoughts (nonjudgmentally and without identifying with them), acknowledge them, and then let those thoughts leave one’s mind [34].”
Patterns of communication through interpreters: A detailed sociolinguistic analysis
Aranguri, C., Davidson, B., & Ramirez, R. (2006) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2006.00451.x · Cited by 114
Efficacy of a Mindfulness-Based Mobile Application: a Randomized Waiting-List Controlled Trial
van Emmerik, A. A. P., Berings, F., & Lancee, J. (2018) · Mindfulness · doi:10.1007/s12671-017-0761-7 · Cited by 101 · cited 1×
“Mobile technology studies, including a 2018 randomized trial and a separate efficacy-based investigation, found mobile app interventions could reduce stress and irritability, and yielded statistically significant efficacy measures [39,40].”
The digital clinic: Implementing technology and augmenting care for mental health
Rodriguez-Villa, E., Rauseo-Ricupero, N., Camacho, E., Wisniewski, H., Keshavan, M., & Torous, J. (2020) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2020.06.009 · Cited by 97 · cited 1×
“As outlined in previous publications, the Digital Clinic is a method of health care treatment that allows providers the ability to use digital technology to augment all aspects of care [22].”
Self-citationLattie, E. G., Nicholas, J., Knapp, A. A., Skerl, J. J., Kaiser, S. M., & Mohr, D. C. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00979-2 · Cited by 95 · cited 1×
“This issue has already been raised by many mental health clinicians who report that some technology-based therapy programs limit the therapeutic approach and flexibility needed to help patients [21].”
Ly, K. H., Janni, E., Wrede, R., Sedem, M., Donker, T., Carlbring, P., & Andersson, G. (2015) · Internet Interventions · doi:10.1016/j.invent.2014.12.002 · Cited by 78 · cited 1×
“Although research on behavioral activation through mobile apps is nascent, one qualitative study found that, when using app interventions, participants felt their treatment was more accessible, were more motivated to engage, and felt security [37].”
Mattila, E., Lappalainen, R., Välkkynen, P., Sairanen, E., Lappalainen, P., Karhunen, L., Peuhkuri, K., Korpela, R., Kolehmainen, M., & Ermes, M. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5241 · Cited by 67 · cited 1×
“The customization and flexibility built into the model will help ensure high app engagement, as past research has shown high app engagement can correlate with higher clinical outcomes [55].”
Levin, M. E., Haeger, J., Pierce, B., & Cruz, R. A. (2017) · Behavior Modification · doi:10.1177/0145445517719661 · Cited by 58 · cited 1×
“In a 2-week trial, Levin et al [35] found that participants who used an app intervention to practice ACT skills believed the method was helpful and accessible; furthermore, participants’ depression, anxiety, and psychological flexibility also showed significant improvement.”
Wisniewski, H., Henson, P., & Torous, J. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00652 · Cited by 58 · cited 1×
“As an example, some patients may wish to track mood and sleep to determine if changing their sleep pattern may improve their mood [26].”
Self-citationKorsbek, L., & Tønder, E. S. (2016) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000173 · Cited by 34 · cited 1×
“Previous studies combining app technology and SDM interventions have been mixed [28], and several limitations have been identified, such as time constraints and provider bias toward which patient could benefit and which situation calls for the intervention [29].”
The feasibility and effectiveness of Catch It, an innovative CBT smartphone app
Kinderman, P., Hagan, P., King, S., Bowman, J., Chahal, J., Gan, L., McKnight, R., Waldon, C., Smith, M., Gilbertson, J., et al. (2016) · BJPsych Open · doi:10.1192/bjpo.bp.115.002436 · Cited by 33 · cited 1×
“Studies have shown that CBT smartphone apps have therapeutic potential [31]; however, like many apps, high user engagement and sufficient long-term outcomes seem to be the top barriers for effective CBT app outcomes [32].”
The financial strain placed on America's hospitals in the wake of the COVID-19 pandemic
Boserup, B., McKenney, M. G., & Elkbuli, A. (2020) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2020.07.007 · Cited by 33 · cited 1×
“As the field looks toward technology to offer accessible and cost-effective solutions, now is the time to consider how digitally informed care can provide improved outcomes while reducing access inequities for marginalized communities [7-10].”
The Spanish Availability and Readability of Diabetes Apps
Rodriguez, J. A., & Singh, K. (2018) · Journal of Diabetes Science and Technology · doi:10.1177/1932296817749610 · Cited by 30 · cited 1×
“A 2018 review of diabetes-related Spanish language apps found only 25% of Android and 19% of IOS apps allowed users to fully interact with the app in Spanish [58].”
Symptom Diary Use and Improved Survival for Patients With Heart Failure
Park, L. G., Dracup, K., Whooley, M. A., McCulloch, C., Jin, C., Moser, D. K., Clark, R. A., Pelter, M. M., Biddle, M., & Howie Esquivel, J. (2017) · Circulation: Heart Failure · doi:10.1161/circheartfailure.117.003874 · Cited by 27 · cited 1×
“Nonetheless, increasing symptom awareness and tracking, via diary cards, have been shown to be helpful for various conditions, including those in jeopardy of heart failure, chronic bronchitis, and pulmonary diseases [43,44].”
Electronic Health Records: Eliciting Behavioral Health Providers’ Beliefs
Shank, N., Willborn, E., PytlikZillig, L., & Noel, H. (2012) · Community Mental Health Journal · doi:10.1007/s10597-011-9409-6 · Cited by 20 · cited 1×
“Data suggests the mental health field is now the largest user of telehealth [8], with prior barriers toward adoption now largely overcome [12-14].”
Llor, C., Moragas, A., Miravitlles, M., & on behalf of the investigators of the ESAB study (2012) · International Journal of Clinical Practice · doi:10.1111/j.1742-1241.2012.02930.x · Cited by 13 · cited 1×
“Nonetheless, increasing symptom awareness and tracking, via diary cards, have been shown to be helpful for various conditions, including those in jeopardy of heart failure, chronic bronchitis, and pulmonary diseases [43,44].”
Vaidyam, A., Roux, S., & Torous, J. (2020) · JMIR Mental Health · doi:10.2196/19778 · Cited by 11 · cited 1×
“To support this flexibility, mindLAMP allows users to create unique surveys specific to their needs and assign a schedule of times to be reminded [25].”
Self-citationDBT Self-Help Application for Mobile Devices
Washburn, M., & Parrish, D. E. (2013) · Journal of Technology in Human Services · doi:10.1080/15228835.2013.775904 · Cited by 10 · cited 1×
“App-related DBT studies have shown potential in allowing users to learn and practice a wide range of skills; however, major barriers include app navigation challenges and difficulties understanding interventions without prior DBT exposure or clinical support [41,42].”
Implementing brief Dynamic Interpersonal Therapy (DIT) in a VA Medical Center
Chen, C. K., Ingenito, C. P., Kehn, M. M., Nehrig, N., & Abraham, K. S. (2019) · Journal of Mental Health · doi:10.1080/09638237.2017.1340602 · Cited by 9 · cited 1×
“Providing short-term psychodynamic treatment presents many challenges (time constraints, adequate provider training, bias toward newer clinical modalities); however, recent studies continue to test new ways psychodynamic practices can be beneficial [33].”
Mittal, V. A. (2019) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.735622208.793567547 · Cited by 6
Suñol, J., María Panisello, J., Castell, E., Juan Tárraga López, P., Sánchez, C., & Pérez, V. (2017) · Universal Journal of Public Health · doi:10.13189/ujph.2017.050305 · Cited by 4
Research works printed but not linked: 2
- Beck, JS, 2011, Cognitive Behavior Therapy, Second Edition: Basics and Beyond, 6
- Finstad, K, 2006, J Usability Stud, 1, 185
Cited by
Human Support in App-Based Cognitive Behavioral Therapies for Emotional Disorders: Scoping Review
Bernstein, E. E., Weingarden, H. M., Wolfe, E. C., Hall, M. D., Snorrason, Í., & Wilhelm, S. (2022) · Journal of Medical Internet Research · doi:10.2196/33307 · Cited by 66
“Yes Yes Rauseo-Ricupero and Torous, 2021 [63] 1 mindLAMP (Division of Digital Psy-”
BackgroundCurrey, D., & Torous, J. B. (2023) · BMJ Mental Health · doi:10.1136/bmjment-2023-300718 · Cited by 52
Self-citationSmartphone app engagement and clinical outcomes in a hybrid clinic
Chang, S., Gray, L., & Torous, J. (2023) · Psychiatry Research · doi:10.1016/j.psychres.2022.115015 · Cited by 21
Self-citationDigital Mental Health Amid COVID-19
Balcombe, L., & Leo, D. D. (2021) · Encyclopedia · doi:10.3390/encyclopedia1040080 · Cited by 22
“Technology Enabled Clinical Care (TECC) was proposed in a protocol for a longitudinal cohort study of smartphone-augmented mental health treatment primarily targeting changes in mood, anxiety, and stress [52].”
BackgroundIncreasing the Value of Digital Phenotyping Through Reducing Missingness: A Retrospective AnalysisPreprint
Currey, D., & Torous, J. B. (2022) · medRxiv · doi:10.1101/2022.05.17.22275182 · Cited by 6
Self-citation
Metadata
- Authors
- Rauseo-Ricupero, N., & Torous, J.
- Affiliations
- Beth Israel Deaconess Medical Center (US)
- Corresponding author
- Torous, John
- Venue
- JMIR Research Protocols
- Publisher
- JMIR Publications Inc.
- Published
- 2021-01-14
- Volume
- 10
- Issue
- 1
- Pages
- e23771
- ISSN
- 1929-0748 (ISSN-L)
- PMC
- PMC7813563
- OpenAlex
- W3113159693
- Cited by
- 9
- References
- 59
- Citations by year
- 2026: 1 · 2025: 1 · 2023: 2 · 2022: 4 · 2021: 1
- FWCI
- 1.58
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Research Protocols (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- digital mental health, mobile application, digital phenotyping, cognitive behavioral therapy, dialectical behavior therapy, acceptance and commitment therapy, depression, anxiety, psychotic symptoms, limited English proficiency, telemedicine, mobile health, digital health equity, outpatient psychiatric care, treatment engagement
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.