Implementing and up-scaling evidence-based eMental health in Europe: The study protocol for the MasterMind project
Open accessAbstract
Background Depressive disorder is a major societal challenge. Despite the availability of clinically and cost-effective treatments including Internet interventions, the number of patients receiving treatment is limited. Evidence-based Internet interventions promise wide availability and high efficiency of treatments. However, these interventions often do not enter routine mental healthcare delivery at a large scale. The MasterMind project aims to provide insight into the factors that promote or hinder the uptake and implementation of evidence-based Internet interventions by mental healthcare practice. Internet-based Cognitive Behaviour Therapy (iCBT) and videoconferencing facilitating collaborative care (ccVC) will be implemented in routine mental healthcare. The services will be offered to 5230 depressed adults in 15 European regions. The current paper describes the evaluation protocol for this large-scale implementation project. Design Current summative evaluation study follows a naturalistic one-group pretest–posttest design and assesses three distinct stakeholders: patients, mental healthcare professionals, and mental healthcare organisations. The Model for Assessment of Telemedicine applications (MAST) will be employed to structure the implementation and evaluation study. The primary focal points of interest are reach, clinical effect, acceptability, appropriateness, implementation costs, and sustainability of the interventions in practice. Mixed-methods are used to provide an understanding of what (quantitative) the implementation projects have achieved and their meaning to various stakeholders (qualitative). Discussion The use of Internet interventions in routine practice is limited. MasterMind attempts to bridge the gap between routine practice and effectiveness research by evaluating the implementation of evidence-based Internet interventions for depressive disorders in routine mental healthcare settings in Europe.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
To date, there have been very few large-scale studies examining the effectiveness of BC-CBT interventions delivered via telehealth on a large scale in real-world settings.
“To date, there have been very few large-scale studies examining the effectiveness of BC-CBT interventions delivered via telehealth on a large scale in real-world settings [20,29].”
From Blended care-cognitive behavioral therapy for depression and anxiety in real-world settings: Pragmatic retrospective study (2020) · cites this paper as [29]
The Background and rationales (p. 3) says that large-scale uptake of eMental health in routine practice is limited, which supports the claim's real-world scale concern. It does not say that very few large-scale studies have examined the effectiveness of BC-CBT delivered via telehealth. The Strengths and limitations (p. 10) also says this implementation study is limited in its ability to determine clinical effectiveness. (LLM, conf=0.78)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · see citing works
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,557 · see citing works
Valente, T. W. (2003) · Genetics in Medicine · doi:10.1097/01.gim.0000061743.67794.c4 · Cited by 20,555 · see citing works
(1963) · Medical Entomology and Zoology · Cited by 15,085 · see citing works
Damschroder, L. J., Aron, D. C., Keith, R. E., Kirsh, S. R., Alexander, J. A., & Lowery, J. C. (2009) · Implementation Science · doi:10.1186/1748-5908-4-50 · Cited by 14,496 · see citing works
Projections of Global Mortality and Burden of Disease from 2002 to 2030
Mathers, C. D., & Loncar, D. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030442 · Cited by 11,386 · see citing works
SUS: A 'Quick and Dirty' Usability Scale
(1996) · Usability Evaluation In Industry · doi:10.1201/9781498710411-35 · Cited by 8,989 · see citing works
Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-010-0319-7 · Cited by 8,721 · see citing works
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · see citing works
Usability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,400 · see citing works
The size and burden of mental disorders and other disorders of the brain in Europe 2010
Wittchen, H. U., Jacobi, F., Rehm, J., Gustavsson, A., Svensson, M., Jönsson, B., Olesen, J., Allgulander, C., Alonso, J., Faravelli, C., et al. (2011) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2011.07.018 · Cited by 3,754 · see citing works
Ferrari, A. J., Charlson, F. J., Norman, R. E., Patten, S. B., Freedman, G., Murray, C. J. L., Vos, T., & Whiteford, H. A. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001547 · Cited by 3,115 · see citing works
Assessment of client/patient satisfaction: development of a general scale
Larsen, D. L., Attkisson, C. C., Hargreaves, W. A., & Nguyen, T. D. (1979) · Evaluation and Program Planning · doi:10.1016/0149-7189(79)90094-6 · Cited by 2,887 · see citing works
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · see citing works
Synthesising qualitative and quantitative evidence: A review of possible methods
Dixon-Woods, M., Agarwal, S., Jones, D., Young, B., & Sutton, A. (2005) · Journal of Health Services Research & Policy · doi:10.1177/135581960501000110 · Cited by 2,132 · see citing works
Implementing, Embedding, and Integrating Practices: An Outline of Normalization Process Theory
May, C., & Finch, T. (2009) · Sociology · doi:10.1177/0038038509103208 · Cited by 2,115 · see citing works
Diffusion of Innovations, 5th Edition
Rogers, E. M., Simon, 。., & Schuster (2003) · Cited by 2,049 · see citing works
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-008-0197-4 · Cited by 1,894 · see citing works
The client satisfaction questionnaire
Attkisson, C. C., & Zwick, R. (1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90074-x · Cited by 1,743 · see citing works
Cost of disorders of the brain in Europe 2010
Gustavsson, A., Svensson, M., Jacobi, F., Allgulander, C., Alonso, J., Beghi, E., Dodel, R., Ekman, M., Faravelli, C., Fratiglioni, L., et al. (2011) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2011.08.008 · Cited by 1,723 · see citing works
Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis
SPEK, V., CUIJPERS, P., NYKLÍČEK, I., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291706008944 · Cited by 1,586 · see citing works
Self-citationInternet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368 · see citing works
(2013) · Journal of Usability Studies archive · Cited by 1,357 · see citing works
Dissemination and Implementation Research in HealthTranslating Science to Practice
Brownson, R. C., Colditz, G. A., & Proctor, E. K. (2012) · doi:10.1093/acprof:oso/9780199751877.001.0001 · Cited by 1,355 · see citing works
Andrews, G., Cuijpers, P., Craske, M. G., McEvoy, P., & Titov, N. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013196 · Cited by 1,311 · see citing works
The Factor Structure of the System Usability Scale
Lewis, J. R., & Sauro, J. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-02806-9_12 · Cited by 1,278 · see citing works
Rebooting psychotherapy research and practice to reduce the burden of mental illness
Kazdin, A. E., & Blase, S. L. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393527 · Cited by 1,254 · see citing works
Cost of disorders of the brain in Europe
Andlin‐Sobocki, P., Jönsson, B., Wïttchen, H., & Olesen, J. (2005) · European Journal of Neurology · doi:10.1111/j.1468-1331.2005.01202.x · Cited by 1,139 · see citing works
Andersson, G., Cuijpers, P., Carlbring, P., Riper, H., & Hedman, E. (2014) · World Psychiatry · doi:10.1002/wps.20151 · Cited by 1,077 · see citing works
Self-citationApplication and Results of the Manchester Short Assessment of Quality of Life (Mansa)
Priebe, S., Huxley, P., Knight, S., & Evans, S. (1999) · International Journal of Social Psychiatry · doi:10.1177/002076409904500102 · Cited by 1,071 · see citing works
Psychotherapy for depression in adults: A meta-analysis of comparative outcome studies.
Cuijpers, P., van Straten, A., Andersson, G., & van Oppen, P. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0013075 · Cited by 1,050 · cited 1× · see citing works
“Clinical outcomes are also found to be comparable with face-to-face interventions when delivered with professional guidance (Cuijpers et al., 2014, 2008a,b; Cuijpers, 2009; Andrews et al., 2010; Spek et al., 2007; Ebert et al., 2015b).”
BackgroundAndrews, G., Henderson, S., & Hall, W. (2001) · British Journal of Psychiatry · doi:10.1192/bjp.178.2.145 · Cited by 933 · cited 1× · see citing works
“Care utilization rates for adults with depression range from 35% to 45% in higher income countries (Andrews et al., 2001; Spijker et al., 2001).”
BackgroundStigma about depression and its impact on help-seeking intentions
Barney, L. J., Griffiths, K. M., Jorm, A. F., & Christensen, H. (2006) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/j.1440-1614.2006.01741.x · Cited by 844 · see citing works
A Behavior Change Model for Internet Interventions
Ritterband, L. M., Thorndike, F. P., Cox, D. J., Kovatchev, B. P., & Gonder-Frederick, L. A. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9133-4 · Cited by 591 · see citing works
Internet-administered cognitive behavior therapy for health problems: a systematic review
Cuijpers, P., van Straten, A., & Andersson, G. (2008) · Journal of Behavioral Medicine · doi:10.1007/s10865-007-9144-1 · Cited by 555 · see citing works
Ebert, D. D., Zarski, A.-C., Christensen, H., Stikkelbroek, Y., Cuijpers, P., Berking, M., & Riper, H. (2015) · PLOS ONE · doi:10.1371/journal.pone.0119895 · Cited by 533 · see citing works
Self-citationProudfoot, J., Ryden, C., Everitt, B., Shapiro, D. A., Goldberg, D., Mann, A., Tylee, A., Marks, I., & Gray, J. A. (2004) · British Journal of Psychiatry · doi:10.1192/bjp.185.1.46 · Cited by 516 · see citing works
Diffusion of Innovations in Health Service Organisations: A Systematic Literature Review
Greenhalgh, T., Robert, G., Bate, P., Macfarlane, F., & Kyriakidou, O. (2007) · Cited by 453 · see citing works
A MODEL FOR ASSESSMENT OF TELEMEDICINE APPLICATIONS: MAST
Kidholm, K., Ekeland, A. G., Jensen, L. K., Rasmussen, J., Pedersen, C. D., Bowes, A. M., Flottorp, S. A., & Bech, M. (2012) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462311000638 · Cited by 392 · see citing works
Consensus statement on defining and measuring negative effects of internet interventions
Rozental, A., Andersson, G., Boettcher, J., Ebert, D. D., Cuijpers, P., Knaevelsrud, C., Ljótsson, B., Kaldo, V., Titov, N., & Carlbring, P. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.02.001 · Cited by 371 · see citing works
Self-citationTowards a measurement instrument for determinants of innovations
Fleuren, M. A. H., Paulussen, T. G. W. M., Van Dommelen, P., & Van Buuren, S. (2014) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzu060 · Cited by 365 · see citing works
A randomized trial of telemedicine-based collaborative care for depression
Fortney, J. C., Pyne, J. M., Edlund, M. J., Williams, D. K., Robinson, D. E., Mittal, D., & Henderson, K. L. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0201-9 · Cited by 315 · see citing works
Christensen, H., Griffiths, K. M., & Korten, A. (2002) · Journal of Medical Internet Research · doi:10.2196/jmir.4.1.e3 · Cited by 292 · cited 2× · see citing works
“MoodGym (Christensen et al., 2002) and Beating the Blues (Proudfoot et al.”
BackgroundEbert, D. D., Berking, M., Cuijpers, P., Lehr, D., Pörtner, M., & Baumeister, H. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.01.056 · Cited by 268 · see citing works
Self-citationBIJL, R. V., & RAVELLI, A. (2000) · Psychological Medicine · doi:10.1017/s0033291799001841 · Cited by 265 · see citing works
Dissemination and Implementation Research in Health
Chambers, D. (2023) · doi:10.1093/oso/9780197660690.001.0001 · Cited by 246 · see citing works
Telepsychiatry: Videoconferencing in the Delivery of Psychiatric Care
Shore, J. H. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12081064 · Cited by 238 · see citing works
Hedman, E., Ljótsson, B., Kaldo, V., Hesser, H., El Alaoui, S., Kraepelien, M., Andersson, E., Rück, C., Svanborg, C., Andersson, G., et al. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.10.023 · Cited by 224 · see citing works
eHealth Evaluation and Dissemination Research
Glasgow, R. E. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.023 · Cited by 220 · see citing works
Gunn, J. M., Diggens, J., Hegarty, K. L., & Blashki, G. A. (2006) · BMC Health Services Research · doi:10.1186/1472-6963-6-88 · Cited by 219 · see citing works
Björkman, T., & Svensson, B. (2005) · Nordic Journal of Psychiatry · doi:10.1080/08039480500213733 · Cited by 216 · see citing works
Dissemination and Implementation of Evidence-Based Psychological Interventions
McHugh, R. K., & Barlow, D. H. (2015) · Oxford University Press eBooks · doi:10.1093/med:psych/9780195389050.003.0013 · Cited by 211 · see citing works
Theme issue on e-mental health: A growing field in internet research
Riper, H., Andersson, G., Christensen, H., Cuijpers, P., Lange, A., & Eysenbach, G. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1713 · Cited by 200 · see citing works
Self-citationConceptualizing changes in behavior in intervention research: the range of possible changes model
De Los Reyes, A., & Kazdin, A. E. (2006) · Psychological Review · doi:10.1037/0033-295x.113.3.554 · Cited by 172 · see citing works
Advancing psychotherapy and evidence‐based psychological interventions
Emmelkamp, P. M. G., David, D., Beckers, T., Muris, P., Cuijpers, P. J., Lutz, W., Andersson, G., Araya, R., Rivera, R. M. B., Barkham, M., et al. (2013) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1411 · Cited by 167 · see citing works
Self-citationInternet-delivered psychotherapy for depression in adults
Titov, N. (2011) · Current Opinion in Psychiatry · doi:10.1097/yco.0b013e32833ed18f · Cited by 158 · see citing works
Warmerdam, L., Smit, F., van Straten, A., Riper, H., & Cuijpers, P. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1436 · Cited by 158 · see citing works
Self-citationGerhards, S. A. H., de Graaf, L. E., Jacobs, L. E., Severens, J. L., Huibers, M. J. H., Arntz, A., Riper, H., Widdershoven, G., Metsemakers, J. F. M., & Evers, S. M. A. A. (2010) · British Journal of Psychiatry · doi:10.1192/bjp.bp.109.065748 · Cited by 135 · cited 1× · see citing works
“Additionally, a number of studies evaluating cost-effectiveness indicate that iCBT might be financially viable for optimising mental healthcare for patients with a depressive disorder (Warmerdam et al., 2010; Gerhards et al., 2010; Hollinghurst et al., 2010; Lokkerbol et al., 2014).”
BackgroundSelf-citationBaumeister, H., Nowoczin, L., Lin, J., Seifferth, H., Seufert, J., Laubner, K., & Ebert, D. D. (2014) · Diabetes Research and Clinical Practice · doi:10.1016/j.diabres.2014.04.031 · Cited by 125 · see citing works
Self-citationWhat About Telepsychiatry?: A Systematic Review
García-Lizana, F., & Muñoz-Mayorga, I. (2010) · The Primary Care Companion to The Journal of Clinical Psychiatry · doi:10.4088/pcc.09m00831whi · Cited by 125 · see citing works
Hollinghurst, S., Peters, T. J., Kaur, S., Wiles, N., Lewisand, G., & Kessler, D. (2010) · British Journal of Psychiatry · doi:10.1192/bjp.bp.109.073080 · Cited by 123 · cited 1× · see citing works
“Additionally, a number of studies evaluating cost-effectiveness indicate that iCBT might be financially viable for optimising mental healthcare for patients with a depressive disorder (Warmerdam et al., 2010; Gerhards et al., 2010; Hollinghurst et al., 2010; Lokkerbol et al., 2014).”
BackgroundChong, J., & Moreno, F. (2012) · Telemedicine and e-Health · doi:10.1089/tmj.2011.0126 · Cited by 107 · see citing works
Moreno, F. A., Chong, J., Dumbauld, J., Humke, M., & Byreddy, S. (2012) · Psychiatric Services · doi:10.1176/appi.ps.201100274 · Cited by 91 · see citing works
Spijker, J., Bijl, R. V., de Graaf, R., & Nolen, W. A. (2001) · Acta Psychiatrica Scandinavica · doi:10.1034/j.1600-0447.2001.00363.x · Cited by 82 · see citing works
Kooistra, L. C., Wiersma, J. E., Ruwaard, J., van Oppen, P., Smit, F., Lokkerbol, J., Cuijpers, P., & Riper, H. (2014) · BMC Psychiatry · doi:10.1186/s12888-014-0290-z · Cited by 82 · see citing works
Self-citationLokkerbol, J., Adema, D., Cuijpers, P. J., Reynolds, C. F., Schulz, R., Weehuizen, R., & Smit, F. (2013) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2013.01.058 · Cited by 76 · see citing works
Evaluation Approaches for Dissemination and Implementation Research
Gaglio, B., & Glasgow, R. E. (2012) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199751877.003.0016 · Cited by 76 · see citing works
Coulthard, K., Patel, D., Brizzolara, C., Morriss, R. K., & Watson, S. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-301 · Cited by 46 · see citing works
A Budget Impact Analysis of Telemedicine-based Collaborative Care for Depression
Fortney, J. C., Maciejewski, M. L., Tripathi, S. P., Deen, T. L., & Pyne, J. M. (2011) · Medical Care · doi:10.1097/mlr.0b013e31821d2b35 · Cited by 43 · see citing works
Public stigmatization of different mental disorders: a comprehensive attitude survey
Hengartner, M. P., Loch, A. A., Lawson, F. L., Guarniero, F. B., Wang, Y., Wulf Rössler, A., & Gattaz, W. F. (2012) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796012000376 · Cited by 39 · see citing works
Chung‐Do, J. J., Helm, S., Fukuda, M. H., Alicata, D., Nishimura, S. T., & Else, I. R. N. (2012) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2011.0107 · Cited by 38 · see citing works
Ebert, D. D., Lehr, D., Baumeister, H., Boß, L., Riper, H. M., Cuijpers, P. J., Reins, J. A., Buntrock, C., & Berking, M. (2014) · Trials · doi:10.1186/1745-6215-15-39 · Cited by 36 · see citing works
Self-citationImplementing video conferencing in mental health practice
de Weger, E., MacInnes, D. L., ENSER, J., FRANCIS, S. J., & Jones, F. W. (2012) · Journal of Psychiatric and Mental Health Nursing · doi:10.1111/j.1365-2850.2012.01947.x · Cited by 30 · see citing works
Pilot study of Internet-based early intervention for combat-related mental distress
Voorhees, B. W. V., Gollan, J. K., & Fogel, J. (2012) · The Journal of Rehabilitation Research and Development · doi:10.1682/jrrd.2011.05.0095 · Cited by 27 · see citing works
Ten-Year Experience of a Private Nonprofit Telepsychiatry Service
Rowe, N., Gibson, S., Morley, S., & Krupinski, E. A. (2008) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2008.0037 · Cited by 23 · see citing works
Checklist determinanten van innovaties in gezondheidszorgorganisaties
Fleuren, M. A. H., Wiefferink, K., & Paulussen, T. G. (2010) · TSG - Tijdschrift voor gezondheidswetenschappen · doi:10.1007/bf03089541 · Cited by 19 · see citing works
Telepsychiatry: new perspectives and open issues
Valdagno, M., Goracci, A., Volo, S. D., & Fagiolini, A. M. (2014) · CNS Spectrums · doi:10.1017/s1092852913000916 · Cited by 18 · see citing works
Kick-off editorial for 2014: Thanks to our reviewers
Stahl, S. M. (2014) · CNS Spectrums · doi:10.1017/s1092852913001028 · Cited by 5 · see citing works
Flagged first, then by citations
1 of the 80 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- Kidholm, K., et al., 2010. MethoTelemed - methodology to assess telemedicine applications - final study report. 2nd ed. MedCom and Norwegian Centre for Integrated Care and Telemedicine. http://refhub.elsevier.com/S2214-7829(1530014-2/rf0235)
Cited by
Sorted by citations
Ebert, D. D., Van Daele, T., Nordgreen, T., Karekla, M., Compare, A., Zarbo, C., Brugnera, A., Øverland, S., Trebbi, G., Jensen, K. L., et al. (2018) · European Psychologist · doi:10.1027/1016-9040/a000318 · Cited by 437 · see citing works
Self-citationLiverpool, S., Mota, C. P., Sales, C. M. D., Čuš, A., Carletto, S., Hancheva, C., Sousa, S., Cerón, S. C., Moreno-Peral, P., Pietrabissa, G., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/16317 · Cited by 408 · see citing works
Attitudes towards digital treatment for depression: A European stakeholder survey
Topooco, N., Riper, H., Araya, R., Berking, M., Brunn, M., Chevreul, K., Cieslak, R., Ebert, D. D., Etchmendy, E., Herrero, R., et al. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.01.001 · Cited by 262 · see citing works
Self-citationVis, C., Mol, M., Kleiboer, A., Bührmann, L., Finch, T., Smit, J., & Riper, H. (2018) · JMIR Mental Health · doi:10.2196/mental.9769 · Cited by 183 · see citing works
Self-citationFeijt, M. A., de Kort, Y. A., Bongers, I. M., & IJsselsteijn, W. A. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9485 · Cited by 134 · see citing works
“Despite these efforts to clarify therapists’ perceptions toward eMental health, the exact nature of therapists’ reluctance to its adoption has remained hard to grasp, and as a result, attempts to increase the uptake and use have not been very successful [26].”
BackgroundEffective strategies for scaling up evidence-based practices in primary care: a systematic review
Charif, A. B., Zomahoun, H. T. V., LeBlanc, A., Langlois, L., Wolfenden, L., Yoong, S. L., Williams, C. M., Lépine, R., & Légaré, F. (2017) · Implementation Science · doi:10.1186/s13012-017-0672-y · Cited by 139 · see citing works
Folker, A. P., Mathiasen, K., Lauridsen, S. M., Stenderup, E., Dozeman, E., & Folker, M. P. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.02.001 · Cited by 116 · see citing works
“Research concerning iCBT has so far primarily focused on efficacy and effectiveness trials, with little attention to the process of implementation (Drozd et al., 2016; Vis et al., 2015).”
BackgroundSelf-citationSchuster, R., Pokorny, R., Berger, T., Topooco, N., & Laireiter, A.-R. (2018) · Journal of Medical Internet Research · doi:10.2196/11007 · Cited by 121 · see citing works
Schröder, J., Berger, T., Meyer, B., Lutz, W., Hautzinger, M., Späth, C., Eichenberg, C., Klein, J. P., & Moritz, S. (2017) · Cognitive Therapy and Research · doi:10.1007/s10608-017-9850-0 · Cited by 113 · see citing works
Davies, F., Shepherd, H. L., Beatty, L., Clark, B., Butow, P., & Shaw, J. (2020) · Journal of Medical Internet Research · doi:10.2196/17362 · Cited by 110 · see citing works
The Model for Assessment of Telemedicine (MAST): A scoping review of empirical studies
Kidholm, K., Clemensen, J., Caffery, L. J., & Smith, A. C. (2017) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x17721815 · Cited by 103 · see citing works
Mol, M., van Schaik, A., Dozeman, E., Ruwaard, J., Vis, C., Ebert, D. D., Etzelmueller, A., Mathiasen, K., Moles, B., Mora, T., et al. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02627-8 · Cited by 92 · see citing works
Self-citationActive Involvement of End Users When Developing Web-Based Mental Health Interventions
de Beurs, D., van Bruinessen, I., Noordman, J., Friele, R., & van Dulmen, S. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00072 · Cited by 97 · see citing works
Kooistra, L. C., Wiersma, J. E., Ruwaard, J., Neijenhuijs, K., Lokkerbol, J., van Oppen, P., Smit, F., & Riper, H. (2019) · Journal of Medical Internet Research · doi:10.2196/14261 · Cited by 84 · see citing works
Self-citationLungu, A., Jun, J. J., Azarmanesh, O., Leykin, Y., & Chen, C. E.-J. (2020) · Journal of Medical Internet Research · doi:10.2196/18723 · Cited by 75 · see citing works
Bennion, M. R., Hardy, G. E., Moore, R. K., Kellett, S., & Millings, A. (2020) · Journal of Medical Internet Research · doi:10.2196/16794 · Cited by 68 · see citing works
“Therefore, despite partially considering aspects of acceptability, usability, and satisfaction, it is rare for e-therapy studies to use the full array of international standards and associated validated instruments of usability, but there are some examples of good practice [17,18].”
BackgroundEtzelmueller, A., Radkovsky, A., Hannig, W., Berking, M., & Ebert, D. D. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.01.003 · Cited by 75 · see citing works
Self-citationMol, M., van Genugten, C., Dozeman, E., van Schaik, D. J. F., Draisma, S., Riper, H., & Smit, J. H. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm9010091 · Cited by 61 · see citing works
Self-citationSprenger, M., Mettler, T., & Osma, J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0180867 · Cited by 63 · see citing works
Assessing Implementation Strategy Reporting in the Mental Health Literature: A Narrative Review
Hooley, C., Amano, T., Markovitz, L., Yaeger, L., & Proctor, E. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00965-8 · Cited by 42 · see citing works
Hvidt, J. C. S., Christensen, L. F., Sibbersen, C., Helweg-Jørgensen, S., Hansen, J. P., & Lichtenstein, M. B. (2019) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2019.1680922 · Cited by 43 · see citing works
Implementation of digital health interventions in rehabilitation: A scoping review
Pearce, L. M. N., Costa, N., Sherrington, C., & Hassett, L. M. (2023) · Clinical Rehabilitation · doi:10.1177/02692155231172299 · Cited by 51 · see citing works
Aboye, G. T., Vande Walle, M., Simegn, G. L., & Aerts, J.-M. (2023) · Digital Health · doi:10.1177/20552076231180972 · Cited by 31 · see citing works
Mol, M., Dozeman, E., Provoost, S., van Schaik, A., Riper, H. M., & Smit, J. H. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9890 · Cited by 29 · see citing works
Self-citationPiera-Jiménez, J., Etzelmueller, A., Kolovos, S., Folkvord, F., & Lupiáñez‐Villanueva, F. (2021) · Journal of Medical Internet Research · doi:10.2196/27410 · Cited by 25 · see citing works
Self-citationFarrand, P. A., Woodford, J., Llewellyn, D. J., Anderson, M. P., Venkatasubramanian, S., Ukoumunne, O. C., Adlam, A., & Dickens, C. M. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0083-x · Cited by 20 · see citing works
Coumoundouros, C., Mårtensson, E., Ferraris, G., Zuidberg, J. M., von Essén, L., Sanderman, R., & Woodford, J. (2022) · JMIR Mental Health · doi:10.2196/41891 · Cited by 20 · see citing works
Christensen, L. F., Gildberg, F. A., Sibbersen, C., Skjøth, M. M., Nielsen, C. T., & Hansen, J. P. (2019) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2019.0055 · Cited by 18 · see citing works
Bagarić, B., & Jokić‐Begić, N. (2020) · Journal of Clinical Psychology · doi:10.1002/jclp.22967 · Cited by 18 · see citing works
Bauer, J. F., Gerczuk, M., Schindler‐Gmelch, L., Amiriparian, S., Ebert, D. D., Krajewski, J., Schuller, B. W., & Berking, M. (2024) · Depression and Anxiety · doi:10.1155/2024/9667377 · Cited by 16 · see citing works
Self-citationIncorporating digital self-services into integrated mental health care: a physician’s perspective
Taiminen, H. M., Saraniemi, S., & Parkinson, J. E. (2018) · European Journal of Marketing · doi:10.1108/ejm-02-2017-0158 · Cited by 15 · see citing works
Christensen, L. F., Gildberg, F. A., Sibbersen, C., Skjøth, M. M., Nielsen, C. T., & Hansen, J. P. (2019) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2019.0129 · Cited by 14 · see citing works
Introduction of e-mental health in national health systems – A health professionals' perspective
Osma, J., Sprenger, M., & Mettler, T. (2017) · Health Policy and Technology · doi:10.1016/j.hlpt.2017.07.001 · Cited by 13 · see citing works
Worm-Smeitink, M., van Dam, A., van Es, S., van der Vaart, R., Evers, A. W. M., Wensing, M., & Knoop, H. (2019) · Journal of Medical Internet Research · doi:10.2196/14037 · Cited by 13 · see citing works
Mol, M., Dozeman, E., van Schaik, A., Vis, C., Riper, H. M., & Smit, J. H. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-1045-9 · Cited by 11 · see citing works
Self-citationKaiser, T., Boschloo, L., Berger, T., Meyer, B., Späth, C., Schröder, J., Hohagen, F., Moritz, S., & Klein, J. P. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.598317 · Cited by 11 · see citing works
Eichenberg, C., Schott, M., Sawyer, A., Aumayr, G., & Ploessnig, M. (2018) · JMIR Aging · doi:10.2196/10973 · Cited by 11 · see citing works
Estado actual de la telemedicina: una revisión de literatura
Castaño, E. Y. P., Carvajal, L. C., García, J. J. B., & Rengifo, Y. S. P. (2016) · INGENIARE · doi:10.18041/1909-2458/ingeniare.20.412 · Cited by 10 · see citing works
Titzler, I., Egle, V., Berking, M., Gumbmann, C., & Ebert, D. D. (2019) · Verhaltenstherapie · doi:10.1159/000503408 · Cited by 9 · see citing works
Self-citationVis, C., Kleiboer, A. M., Mol, M., Pedersen, C. D., Finch, T. L., Smit, J. H., Riper, H. M., Albaina, O., Cavallo, M., Dozeman, E., et al. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08041-y · Cited by 8 · see citing works
Self-citationCientanni, F., Power, K., Sani, F., Wright, C., Baty, F. J., Hustings, K., Morgan, D., & Tanner, G. (2017) · British Journal of Social Psychology · doi:10.1111/bjso.12210 · Cited by 7 · see citing works
Self-citationAttitudes of Mental Health Professionals towards Telepsychology during the Pandemic: A Pilot Study
Cavallo, M., Pedroli, E., Cantoia, M. E. A., McGrath, B., & Cecchetti, S. (2023) · Healthcare · doi:10.3390/healthcare11111542 · Cited by 6 · see citing works
Self-citationCientanni, F., Power, K., Wright, C., Sani, F., Reilly, D., Blake, M.-L., Hustings, K., Morgan, D., & Clark, S. A. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100248 · Cited by 6 · see citing works
Self-citationBierbooms, J. J. P. A., Sluis-Thiescheffer, W. R. J. W., Feijt, M. A., IJsselsteijn, W. A., & Bongers, I. M. B. (2020) · JMIR Research Protocols · doi:10.2196/18815 · Cited by 5 · see citing works
Gerczuk, M., Amiriparian, S., Kathan, A., Bauer, J., Berking, M., & Schuller, B. W. (2023) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc40787.2023.10340985 · Cited by 5 · see citing works
İnce, B. Ü., Gökçay, D., Riper, H. M., & Cuijpers, P. J. (2019) · JMIR Research Protocols · doi:10.2196/13239 · Cited by 5 · see citing works
Self-citationBierbooms, J. J. P. A., Feijt, M. A., IJsselsteijn, W. A., & Bongers, I. M. B. (2022) · JMIR Serious Games · doi:10.2196/34700 · Cited by 6 · see citing works
Castillo, E. F., Montañés, M. C., Martínez, A. C., González, Y. C. R., & García, P. M. (2019) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · doi:10.25057/25005731.1150 · Cited by 4 · see citing works
ASHER, I. B., Ritholz, M. D., Horwitz, D. L., Manejwala, O., Behar, E., & Fundoiano-Hershcovitz, . (2024) · JMIR Formative Research · doi:10.2196/50506 · Cited by 3 · see citing works
Voderholzer, U., Beintner, I., Backes, B., Esguerra, E., & Hessler, J. B. (2021) · Verhaltenstherapie · doi:10.1159/000513643 · Cited by 3 · see citing works
Etzelmueller, A., Heber, E., Horvath, H., Radkovsky, A., Lehr, D., & Ebert, D. D. (2024) · Journal of Medical Internet Research · doi:10.2196/42976 · Cited by 3 · see citing works
Self-citationTitzler, I., Egle, V., Berking, M., Gumbmann, C., & Ebert, D. D. (2019) · Verhaltenstherapie · doi:10.1159/000502390 · Cited by 2 · see citing works
Self-citationStafylas, P., Kidholm, K., & d’Angelantonio, M. (2018) · Presses de l’EHESP eBooks · doi:10.3917/ehesp.miche.2018.01.0319 · Cited by 1 · see citing works
Interoperability in the Context of Integrated Care
Piera-Jiménez, J., Leslie, H., Dunscombe, R., & Pontes, C. (2024) · Springer eBooks · doi:10.1007/978-3-031-25376-8_101-1 · Cited by 2 · see citing works
Kneubühler, A. M., von Känel, E., Grgić, K., Munkovic, E., Berger, T., & Bielinski, L. L. (2026) · JMIR Mental Health · doi:10.2196/78079 · Cited by 1 · see citing works
E-Mental Health Anwendungen für depressive und suizidale Menschen: eine Übersicht
Eichenberg, C. (2019) · Psychotherapie Forum · doi:10.1007/s00729-019-00123-3 · Cited by 1 · see citing works
Bierbooms, J. J. P. A., Sluis-Thiescheffer, W. R. J. W., Feijt, M. A., & Bongers, I. M. B. (2024) · JMIR Formative Research · doi:10.2196/58650 · Cited by 1 · see citing works
Kip, H. (2021) · doi:10.3990/1.9789036551311 · Cited by 1 · see citing works
Vis, C., Kleiboer, A. M., Mol, M., Pedersen, C. D., Finch, T. L., Smit, J. H., & Riper, H. M. (2021) · Research Square · doi:10.21203/rs.3.rs-88101/v2 · Cited by 1 · see citing works
Self-citationHannig, W., Etzelmueller, A., Zarski, A., & Ebert, D. D. (2019) · Zeitschrift für Klinische Psychologie und Psychotherapie · doi:10.1026/1616-3443/a000519
Self-citationPower, K., Cientanni, F., & Wright, C. (2021) · Archives of Suicide Research · doi:10.1080/13811118.2021.1972882
Self-citationBierbooms, J. J. P. A., Feijt, M. A., IJsselsteijn, W. A., & Bongers, I. M. B. (2021) · doi:10.2196/preprints.34700
Vis, C., Kleiboer, A. M., Mol, M., Pedersen, C. D., Finch, T. L., Smit, J. H., & Riper, H. M. (2020) · Research Square · doi:10.21203/rs.3.rs-88101/v1
Self-citationInteroperability in the Context of Integrated Care
Piera-Jiménez, J., Leslie, H., Dunscombe, R., & Pontes, C. (2025) · Springer eBooks · doi:10.1007/978-3-031-96286-8_101
Vis, C., Kleiboer, A. M., Mol, M., Pedersen, C. D., Finch, T. L., Smit, J. H., & Riper, H. M. (2022) · Figshare · doi:10.6084/m9.figshare.19948979
Self-citationMol, M., van Schaik, A., Dozeman, E., Ruwaard, J., Vis, C., Ebert, D. D., Etzelmueller, A., Mathiasen, K., Moles, B., Mora, T., et al. (2020) · Figshare · doi:10.6084/m9.figshare.12291794
Self-citationVis, C., Kleiboer, A. M., Mol, M., Pedersen, C. D., Finch, T. L., Smit, J. H., & Riper, H. M. (2022) · Figshare · doi:10.6084/m9.figshare.19948982
Self-citationCBT mobile apps as a therapeutic intervention for treatment of depression
Szwed, M., & Talewski, M. (2026) · Psychiatria i Psychologia Kliniczna · doi:10.15557/pipk.2025.0029
- Authors
- Vis, C., Kleiboer, A., Prior, R., Bønes, E., Cavallo, M., Clark, S. A., Dozeman, E., Ebert, D., Etzelmueller, A., Favaretto, G., Zabala, A. F., Kolstrup, N., Mancin, S., Mathiassen, K., Myrbakk, V. N., Mol, M., Jimenez, J. P., Power, K., van Schaik, A., Wright, C., Zanalda, E., Pederson, C. D., Smit, J., & Riper, H.
- Affiliations
- Vrije Universiteit Amsterdam (NL)
- Health Information Management (BE)
- University Hospital of North Norway (NO)
- Università degli Studi eCampus (IT)
- NHS Tayside (GB)
- GGZ inGeest (NL)
- Friedrich-Alexander-Universität Erlangen-Nürnberg (DE)
- AULSS 2 Marca Trevigiana (IT)
- University of Stirling (GB)
- National Health Service (GB)
- University of Southern Denmark (DK)
- Corresponding author
- Vis, Christiaan
- ORCID
- Venue
- Internet Interventions
- Publisher
- Elsevier BV
- Published
- 2015-11
- Volume
- 2
- Issue
- 4
- Pages
- 399-409
- ISSN
- 2214-7829 (ISSN-L)
- OpenAlex
- W2189285822
- Cited by
- 71
- References
- 80
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 5 · 2023: 5 · 2022: 5 · 2021: 7 · 2020: 10 · 2019: 14 · 2018: 11 · 2017: 8 · 2016: 3
- FWCI
- 11.87
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Internet Interventions (publishedVersion, cc-by-nc-nd)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion)
- VU Research Portal (publishedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- IRIS eCampus Telematic University (Università degli Studi eCampus) (submittedVersion)
- NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
- University of Southern Denmark Research Portal (University of Southern Denmark) (submittedVersion, cc-by-nc-nd)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- ICT Policy Support Programme (ICT PSP) (621000)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- internet-based cognitive behavioral therapy, depressive disorders, implementation of evidence-based interventions, videoconferencing, collaborative care, telemedicine, implementation costs, sustainability, acceptability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review