Development and initial evaluation of an Internet-based support system for face-to-face cognitive behavior therapy: a proof of concept study
Open accessAbstract
BACKGROUND: Evidence-based psychological treatments, such as cognitive behavior therapy (CBT), have been found to be effective in treating several anxiety and mood disorders. Nevertheless, issues regarding adherence are common, such as poor patient compliance on homework assignments and therapists' drifting from strictly evidence-based CBT. The development of Internet-delivered CBT (ICBT) has been intensive in the past decade and results show that guided ICBT can be as effective as face-to-face CBT but also indicate a need to integrate the two forms of CBT delivery. OBJECTIVE: In this study, we developed and tested a new treatment format in which ICBT and face-to-face therapy were blended. We designed a support system accessible via the Internet (using a computer or an Apple iPad) for patients and therapists delivering CBT face-to-face. The support system included basic CBT components and a library of interventions gathered from existing ICBT manuals. METHODS: The study involved 15 patients with mild to moderate anxiety or depression (or both). Eight therapists conducted the treatments. All participants were interviewed after the nine-week intervention. Further, patients provided self-reports on clinical measures pre- and post-trial, as well as at a 12-month follow-up. RESULTS: A reduction was found in symptom scores across all measures. The reliable change index ranged from 60% to 87% for depression and anxiety. Large effect sizes (Cohen's d) ranging from 1.62 (CI 95% 0.59-2.66) to 2.43 (CI 95% 1.12-3.74) were found. There were no missing data and no treatment dropouts. In addition, the results had been maintained at the 12-month follow-up. Qualitative interviews revealed that the users perceived the support system as beneficial. CONCLUSIONS: The results suggest that modern information technology can effectively blend with face-to-face treatments and be used to facilitate communication and structure in therapy, thus reducing therapist drift.
AI snapshot
Written from the paper’s full text.
TL;DR
This proof-of-concept study developed an Internet-based support system blending ICBT components with face-to-face CBT and tested it in 15 patients with mild to moderate anxiety or depression and 8 therapists. Symptom scores improved significantly with large effect sizes and were maintained at 12-month follow-up, with no dropouts and positive user experiences.
Key findings
- There were no missing data and no treatment dropouts. Statistically significant main effects were found on all clinical outcome measures pre- to post-treatment, t14=4.25 to 7.25, all P<.001, and pre-treatment to long-term follow-up, t14=3.53 to 6.20, all P<.05; post-treatment to follow-up comparisons were nonsignificant, t14=0.73 to 1.55, all P>.142.
- Large within-group effect sizes were observed: pre- to post-treatment Cohen’s d ranged from 1.26 to 2.43, and pre-treatment to long-term follow-up from 1.08 to 1.94. Reliable change ranged from 60% to 87% on depression and anxiety measures at post-treatment and from 53% to 80% at long-term follow-up; reliable change on quality of life was 40% at post-treatment and 60% at 12-month follow-up.
- Qualitative interviews found the support system was perceived as beneficial. Patients reported themes such as memory support, learning, positive implications for homework, overview of treatment, autonomy, and maintenance after therapy; therapists reported increased structure, positive between-session communication, and library support.
- Therapists’ self-reported time spent per therapy and week ranged from 15 to 180 minutes (mean 77, SD 57), and 7 of 8 therapists (87.5%) estimated they spent less or as much time compared with treatments without the platform. Therapists accessed the platform on average seven times per patient per week.
Methods
- Proof-of-concept case series with 15 patients with mild to moderate anxiety or depression (or both) and 8 therapists; treatment duration was eight to nine weeks, with post-treatment interviews and self-reports, plus a 12-month follow-up.
- The Internet-based support system was accessible via computer or Apple iPad and included basic CBT components, a library of text/media resources drawn from prior ICBT manuals, questionnaires/forms, internal messaging, and therapist-controlled patient access.
- Quantitative analyses used SPSS 21, intent-to-treat paired sample t tests, within-group Cohen’s d, and the Jacobson and Truax reliable change index; qualitative data were analyzed with content analysis of patient interviews, a therapist focus group, and one individual therapist interview.
Limitations
- The paper states the sample size was low, reducing statistical power; there was no waitlist or active control group, so there was no control for time and repeated testing, limiting generalizability.
- The paper states the design cannot explore different factors explaining outcome, and it is possible that certain features such as stand-alone SMS communication between sessions could achieve similar results.
- The paper states two therapists were involved in the research process and evaluation, therapists had relatively little CBT experience, patients were recruited via media advertisement, and limited computer experience may reduce efficiency; only two participants reported limited computer experience and no additional evaluative questions were included. Evident from the text, this was an uncontrolled proof-of-concept study with self-report outcomes and qualitative interviews conducted partly by researchers involved in developing the system.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 23 cited sources checked · 0 supported · 0 flagged
- Findingown data
Patients indicated that the availability of assignments on the Internet prevented avoidance of feared situations.
“patients indicated that it prevented avoidance of feared situations (eg, in exposure therapy tasks).”
Quote in the paperNot a substantial claim - Findingnone given
Using the platform contributed to structure in therapy.
“Using the platform also contributed to structure in therapy.”
Quote in the paperNot a substantial claim - Findingown data
Post-treatment and long-term follow-up mean values did not differ significantly.
“Moreover, comparing mean values post-treatment to long-term follow-up were nonsignificant: t 14=0.73 to 1.55, all P’s>.142.”
Quote in the paperSubstantial claim - Findingown data
Qualitative interviews revealed that users perceived the support system as beneficial.
“Qualitative interviews revealed that the users perceived the support system as beneficial.”
Quote in the paperNot a substantial claim - Findingown data
The therapists accessed the platform on average seven times per patient per week.
“The therapists accessed the platform on average seven times per patient per week.”
Quote in the paperNot a substantial claim
- Findingown data
Most patients expressed largely positive opinions about sharing information and homework over the Internet.
“Most of the patients expressed largely positive opinions about sharing information and homework over the Internet.”
Quote in the paperNot a substantial claim - Findingown data
About one-third of the patients expressed ambivalence when it came to continued work on their own.
“About one-third of the patients expressed ambivalence when it came to continued work on their own.”
Quote in the paperNot a substantial claim - Findingown data
Reliable change on depression and anxiety measures was 53% to 80% at long-term follow-up.
“Reliable change as defined by Jacobson and Truax [34] was observed in a majority of the patients, ranging from 60% to 87% on depression and anxiety measures and from 53% to 80% at long-term follow-up (Table 4).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [34] source
Not checked in the free run.
- Findingown data
Seven therapists (87.5%, 7/8) estimated that they spent less or as much time in these treatments, compared to treatments without the platform.
“Seven therapists (87.5%, 7/8) estimated that they spent less or as much time in these treatments, compared to treatments without the platform.”
Quote in the paperNot a substantial claim - Findingreasoning
The use of the platform occurred when therapy sessions were cancelled.
“This resulted in the use of the platform when therapy sessions were cancelled.”
Quote in the paperNot a substantial claim - Findingown data
Statistically significant reductions were found from pre-treatment to long-term follow-up on all clinical outcome measures.
“and pre- to long-term follow-up, t 14=3.53 to 6.20, all P’s<.05”
Quote in the paperSubstantial claim - Findingown data
The platform was perceived as helpful.
“and the platform was perceived as helpful.”
Quote in the paperSubstantial claim - Findingown data
Reliable change was observed in 60% to 87% of patients on depression and anxiety measures at post-treatment.
“The reliable change index ranged from 60% to 87% for depression and anxiety.”
- Also stated in: § Clinical Outcome Measures · plain
“Reliable change as defined by Jacobson and Truax [34] was observed in a majority of the patients, ranging from 60% to 87% on depression and anxiety measures and from 53% to 80% at long-term follow-up (Table 4).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [34] source
Not checked in the free run.
- Also stated in: § Clinical Outcome Measures · plain
- Findingown data
Several patients perceived the treatment duration as longer and more extensive than they had expected a nine-week intervention to be.
“Several patients perceived the treatment duration as longer and more extensive than they had expected a nine-week intervention to be.”
Quote in the paperNot a substantial claim - Findingown data
Patients used various featured components of the support system.
“The patients reported that they had used the various featured components of the support system.”
Quote in the paperNot a substantial claim - Findingown data
Treatment gains were maintained at the 12-month follow-up.
“In addition, the results had been maintained at the 12-month follow-up.”
Quote in the paperSubstantial claim - Findingown data
The structure was obtained when both therapist and patient could agree on and set an agenda, goals, and the central focus of homework assignments.
“The structure was obtained when both therapist and patient could agree on and set an agenda, goals, and the central focus of homework assignments.”
Quote in the paperNot a substantial claim - Findingown data
A few patients indicated that both the therapist and patient collaboratively created the homework assignments with the help of the support system.
“and that both the therapist and patient collaboratively created the homework assignments with the help of the support system.”
Quote in the paperNot a substantial claim - Findingown data
The therapies led to improvements on clinical measures.
“Overall, the therapies led to improvements on clinical measures”
Quote in the paperSubstantial claim - Findingown data
Some patients found the process of writing about their problems to be helpful.
“Some also found the process of writing about their problems to be helpful.”
Quote in the paperNot a substantial claim - Findingnone given
All the therapists had limited clinical experience.
“all the therapists had limited clinical experience”
Quote in the paperSubstantial claim - Findingown data
A majority of patients said that the platform was easy to use.
“A majority said that the platform was easy to use”
Quote in the paperNot a substantial claim - Findingown data
Patients reported that the ability to return to previous assignments and reflect on their experience of change was motivating.
“Another reported advantage of the Internet-based platform was the patients’ ability to return to previous assignments and reflect on their experience of change, which was perceived as motivating.”
Quote in the paperNot a substantial claim - Findingown data
Internal messages and correspondence via SMS were frequently used.
“Internal messages and correspondence via SMS were frequently used.”
Quote in the paperNot a substantial claim - Findingown data
A few patients indicated that the treatment contributed to increased participation and responsibility for their treatment.
“A few patients indicated that the treatment contributed to increased participation and responsibility for their treatment”
Quote in the paperNot a substantial claim - Findingown data
Large effect sizes for depression and anxiety ranged from 1.62 to 2.43.
“Large effect sizes (Cohen’s d) ranging from 1.62 (CI 95% 0.59-2.66) to 2.43 (CI 95% 1.12-3.74) were found.”
Quote in the paperSubstantial claim - Findingown data
Thirteen patients reported that they had carried out all or almost all their homework assignments.
“Thirteen patients reported that they had carried out all or almost all their homework assignments”
Quote in the paperNot a substantial claim - Findingown data
Therapists were able to help the patients relatively rapidly instead of waiting until the next appointment.
“The therapists were able to help the patients relatively rapidly instead of waiting until the next appointment.”
Quote in the paperSubstantial claim - Findingown data
About half the patients appreciated having online feedback between face-to-face sessions.
“About half the patients appreciated having online feedback between face-to-face sessions.”
Quote in the paperNot a substantial claim - Findingown data
The self-reported estimation of time spent with each therapy and week ranged between 15 and 180 minutes (mean 77, SD 57).
“The self-reported estimation of time spent with each therapy and week ranged between 15 and 180 minutes (mean 77, SD 57).”
Quote in the paperNot a substantial claim - Findingown data
A majority of the therapists highlighted these possibilities as major benefits.
“A majority of the therapists highlighted these possibilities as major benefits.”
Quote in the paperNot a substantial claim - Findingown data
No patient regarded the iPad as a disturbing feature of the therapy.
“No patient regarded the iPad as a disturbing feature of the therapy.”
Quote in the paperNot a substantial claim - Findingown data
Statistically significant reductions were found on all clinical outcome measures from pre- to post-treatment.
“Statistically significant main effects were obtained for all clinical outcome measures, pre- to post-treatment, t 14=4.25 to 7.25, all P’s<.001”
- Also stated in: § Results · plain
“A reduction was found in symptom scores across all measures.”
Quote in the paperSubstantial claim - Also stated in: § Results · plain
- Findingreasoning
Not all the patients found the platform very easy to use.
“indeed, not all the patients found the platform very easy to use.”
Quote in the paperNot a substantial claim - Findingnone given
The therapists in this study had relatively little experience delivering CBT.
“The therapists in this study had relatively little experience delivering CBT”
Quote in the paperNot a substantial claim - Premisecitation
Therapist drift from evidence-based CBT toward supportive therapy has been highlighted as a potential obstacle to effective CBT.
“Further, therapist drift from evidence-based CBT (toward supportive therapy) has been highlighted as a potential obstacle to effective CBT [9].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [9] source
Not checked in the free run.
- Premisecitation
Issues regarding adherence to therapy are common.
“Moreover, evidence-based psychological treatments do not help all patients and issues regarding adherence to therapy are common [7].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [7] Haynes, RB, 2002, JAMA source
Not checked in the free run.
- Interpretationown data
The support system can be used to facilitate communication and structure in therapy.
“and be used to facilitate communication and structure in therapy”
Quote in the paperSubstantial claim- Rests on an assumption: The observed symptom improvements and user-reported benefits are attributable to the blended Internet-based support system rather than to face-to-face CBT alone or other factors.
- Rests on an assumption: The support system was used consistently enough by therapists and patients during and between sessions to influence therapy.
- Premisecitation
All clinical measures have established good psychometric properties when administered via the Internet.
“All clinical measures have established good psychometric properties when administered via the Internet [34,35].”
Quote in the paperNot a substantial claim0 of 2 sources checked - Premisereasoning
Guided ICBT is probably less susceptible to therapist drift than face-to-face CBT.
“this treatment format is probably less susceptible to therapist drift.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The support system can reduce therapist drift.
“thus reducing therapist drift.”
Quote in the paperSubstantial claim- Rests on an assumption: The observed symptom improvements and user-reported benefits are attributable to the blended Internet-based support system rather than to face-to-face CBT alone or other factors.
- Rests on an assumption: Therapists' qualitative reports accurately reflect the degree of therapist drift in the face-to-face therapy.
- Premisereasoning
This is the first study to merge ICBT and face-to-face CBT in a system used by both the therapist and the patient.
“To our knowledge, this is the first study to merge ICBT and face-to-face CBT in a system used by both the therapist and the patient.”
Quote in the paperNot a substantial claim - Premisecitation
Therapies with minimal support may lead to increased dropout rates, particularly in unguided ICBT.
“Therapies with minimal support may lead to increased dropout rates (particularly in unguided ICBT) [18]”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [18] source
Not checked in the free run.
- Premisecitation
Clinician-guided Internet-delivered cognitive behavior therapy (ICBT) can be as effective as face-to-face CBT for some diagnoses.
“studies indicate that clinician-guided ICBT can be as effective as face-to-face CBT for some diagnoses [10,11].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [10] Andersson, G, 2012, Stud Health Technol Inform
Not checked in the free run.
- cites [11] source
Not checked in the free run.
- Premisecitation
Some patients probably need more support than ICBT provides in order to adhere to therapy.
“some patients probably need more support than ICBT provides in order to adhere to the therapy [19].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [19] source
Not checked in the free run.
- Interpretationcitation
The findings on the whole align with previous findings regarding computerized support in combination with face-to-face CBT.
“The findings on the whole align with previous findings regarding computerized support in combination with face-to-face CBT [42].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [42] source
Not checked in the free run.
- Premisecitation
Use of text material in face-to-face treatment is common among CBT practitioners.
“Use of text material in face-to-face treatment has been found to be common among CBT practitioners [27]”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [27] source
Not checked in the free run.
- Interpretationown data
Modern information technology can effectively blend with face-to-face treatments.
“The results suggest that modern information technology can effectively blend with face-to-face treatments”
Quote in the paperSubstantial claim- Rests on an assumption: The observed symptom improvements and user-reported benefits are attributable to the blended Internet-based support system rather than to face-to-face CBT alone or other factors.
- Rests on an assumption: The support system was used consistently enough by therapists and patients during and between sessions to influence therapy.
- Interpretationown data
It is plausible that communication via the Internet between therapy sessions mitigates dropout rates.
“Hence, it is plausible that communication via the Internet between therapy sessions mitigates dropout rates.”
Quote in the paperSubstantial claim - Study design and conductnone given
The study design does not allow exploration of different factors that explain the outcome of the study.
“Also, the study design does not allow us to explore different factors that explain the outcome of the study.”
Quote in the paperNot a substantial claim - Interpretationown data
This study indicates that Internet-based support can be used without compromising the effects of CBT.
“In sum, this study indicates that Internet-based support can be used without compromising the effects of CBT”
Quote in the paperSubstantial claim - Interpretationown data
Limited computer experience is likely to make this treatment delivery format less efficient in some situations.
“Limited computer experience is likely to make this treatment delivery format less efficient in some situations”
Quote in the paperNot a substantial claim - Interpretationreasoning
This method might not be equally applicable in a representative clinical setting.
“Therefore, this method might not be equally applicable in a representative clinical setting.”
Quote in the paperSubstantial claim
- Classified as probably not a substantial claim. 27
- May combine two claims. 27
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataThe iPad was used to take notes, to draw, and to take pictures and videos during therapy sessions that could later be shared via the platform.
“The iPad was used to take notes, to draw, and to take pictures and videos during therapy sessions that could later be shared via the platform.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataLarge within-group effect sizes were observed on all clinical outcome measures, with pre- to post-treatment effect sizes ranging from 1.26 to 2.43 and long-term follow-up effect sizes from 1.08 to 1.94.
“Large within-group effect sizes (Cohen’s d) were observed on all clinical outcome measures, with pre- to post-effect sizes ranging from 1.26-2.43 and long-term follow-up between 1.08-1.94 (Table 4).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataClinical outcome data showed significant main effects and reliable changes on all measures and these results had been maintained at 12-month follow-up.
“Clinical outcome data showed significant main effects and reliable changes on all measures and these results had been maintained at 12-month follow-up.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe library was considered a source of knowledge and therapy-skill enhancement; it supported therapists in choosing among interventions and was helpful when therapists presented the treatment rationale.
“The library was considered a source of knowledge and therapy-skill enhancement; it supported therapists in choosing among interventions and was helpful when therapists presented the treatment rationale.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataSeveral patients highlighted the use of the platform as a memory aid.
“Several patients highlighted the use of the platform as a memory aid.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenSeveral patients stated that they gained more from the treatment than they had originally expected to during the nine-week period.
“Several patients stated that they gained more from the treatment than they had originally expected to during the nine-week period.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataMessages contained clarifications and reformulations of homework assignments, providing support, encouragement, and answers to patients' questions.
“Messages contained clarifications and reformulations of homework assignments, providing support, encouragement, and answers to patients’ questions.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataTwo patients reported that they had carried out more than half their homework assignments.
“two patients reported that they had carried out more than half their assignments.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataCorrespondence via the platform was used to remind patients about assignments.
“Correspondence via the platform was also used to remind patients about assignments.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenOne patient had more frequent contact with the therapist during a period of challenging homework assignments.
“One patient had more frequent contact with the therapist during a period of challenging homework assignments.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataEasy access to the library led therapists to rely more on the content of the library material and to seek fewer other sources for help and supervision.
“However, this easy access also led therapists to rely more on the content of the library material and to seek fewer other sources for help and supervision.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenThe therapists confirmed that they had used all the components of the platform.
“The therapists confirmed that they had used all the components of the platform.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataOne therapist highlighted that the platform made it possible to focus more on the relational aspects of treatment during sessions.
“One therapist also highlighted that the platform made it possible to focus more on the relational aspects of treatment during sessions.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataReliable change on quality of life was 40% at post-treatment and 60% at 12-month follow-up.
“Reliable change on quality of life was 40% at post-treatment and 60% at 12-month follow-up.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe patients' user experiences show that the platform and the iPad were regarded as beneficial.
“The patients’ user experiences show that the platform and the iPad were regarded as beneficial.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataThe patients' level of computer experience was mentioned as important by the therapists, even if technology was not seen as a problem for a particular patient.
“The patients’ level of computer experience was mentioned as important by the therapists, even if technology was not seen as a problem for a particular patient.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataOne-third of patients reported spending additional time reading other information on the Internet related to the therapy.
“One-third of the patients also reported that they spent additional time reading other information on the Internet related to the therapy.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataOne patient described the educational advantages of obtaining information through several media, such as speech, writing, and images.
“One patient described the educational advantages of obtaining information through several media, such as speech, writing, and images.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe content in the library was perceived as a supplement to the treatment, promoting theoretical understanding and enhanced knowledge.
“The content in the library was perceived as a supplement to the treatment, promoting theoretical understanding and enhanced knowledge.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenThe treatment was said to facilitate the generalization of treatment to the patients' everyday lives.
“The treatment was said to facilitate the generalization of treatment to the patients’ everyday lives.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataUsing the iPad to take pictures of drawings on the wallboard was highlighted as beneficial.
“But using the iPad to take pictures of drawings on the wallboard was highlighted as beneficial.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataThe availability of assignments on the Internet was described as easy, convenient, and modern.
“The availability of assignments on the Internet was described as easy, convenient, and modern”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataTwo patients with less computer experience had used the platform only sporadically.
“two patients with less computer experience had used the platform only sporadically.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingnone givenTherapists found several major benefits to delivering treatment in this format-for instance, improved between-session communication and ease of sharing treatment-related information.
“Therapists found several major benefits to delivering treatment in this format—for instance, improved between-session communication and ease of sharing treatment-related information.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Findingnone givenThe included patients were recruited via media advertisement.
“the included patients were recruited via media advertisement.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationDropout from treatment, poor engagement, and incomplete adherence to homework assignments can reduce treatment effectiveness.
“Dropout from treatment, poor engagement, and incomplete adherence to homework assignments are all issues that can reduce the treatment’s effectiveness [8].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [8] Burns, DD, 1991, J Consult Clin Psychol source
Not checked in the free run.
May combine two claims.
PremisecitationAccess to CBT is limited, leaving a gap between demand for treatment and actual provision.
“However, access to CBT, often the preferred treatment option [5], is limited; thus, a gap remains between demand for treatment and actual provision [6].”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [5] source
Not checked in the free run.
- cites [6] Kohn, R, 2004, Bull World Health Organ
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationEvidence-based psychological treatments, mainly cognitive behavior therapy (CBT), have established evidence bases for treating several anxiety and mood disorders.
“Evidence-based treatments exist and both pharmacotherapy and psychological treatments (mainly cognitive behavior therapy; CBT) have established evidence bases [4].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [4] source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataFifteen participants fulfilling all inclusion criteria gave written informed consent prior to treatment.
“Fifteen participants fulfilling all inclusion criteria were notified via email of their acceptance and gave written informed consent prior to treatment.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductnone givenThere were no missing data and no treatment dropouts.
“There were no missing data and no treatment dropouts.”
- Also stated in: § Clinical Outcome Measures · plain
“This study had no missing data and no treatment dropouts.”
Quote in the paperNot a substantial claim- Also stated in: § Clinical Outcome Measures · plain
May combine two claims.
InterpretationreasoningThe platform may have contributed to the therapy's continuity, allowing therapists to prepare the face-to-face sessions based on the results of a patient's weekly assignments.
“This may have contributed to the therapy’s continuity, allowing therapists to prepare the face-to-face sessions based on the results of a patient’s weekly assignments.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationLess time is needed when treatment is delivered via the Internet, so more patients can be reached at a lower cost.
“Obviously, less time is needed when the treatment is delivered via the Internet [16]; hence, more patients can be reached at a lower cost.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [16] source
Not checked in the free run.
May combine two claims.
PremisecitationPrevious studies have combined computerized manuals with face-to-face treatment, used technological adjuncts in therapy, or used the Internet after treatment completion to help prevent relapse.
“Previous studies have combined computerized manuals with face-to-face treatment [20,21], used technological adjuncts in therapy [22], or used the Internet after treatment completion to help prevent relapse [23,24].”
Quote in the paperSubstantial claim0 of 5 sources checkedProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningThe patients gaining more from treatment than expected might also be explained by the therapists' level of involvement and may not directly relate to the availability of the platform.
“However, this might also be explained by the therapists’ level of involvement and may not directly relate to the availability of the platform.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductnone givenAll statistical analyses were intent-to-treat.
“All the statistical analyses were intent-to-treat and statistical significance was set at P<.05.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe local ethics committee approved the study.
“The local ethics committee approved the study (ID: 2011/456-31).”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductnone givenThe sample size was low, thus reducing statistical power.
“Among the limitations of the present study is that the sample size was low, thus reducing statistical power.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningThe procedure is more biased than if independent researchers had conducted the interviews.
“Even if our procedure is more biased than if independent researchers had conducted the interviews”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductnone givenThis study had no missing data, nor any dropouts from treatment.
“This study had no missing data, nor any dropouts from treatment.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductreasoningThe study did not include a wait list or an active control group and therefore had no control for time and repeated testing, which limits the generalizability of the findings.
“We did not include a wait list or an active control group and therefore had no control for time and repeated testing, which limits the generalizability of the findings.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningReplacing missed sessions with Internet-delivered interventions adds continuity and the treatment thus becomes less vulnerable to factors such as physical health and logistical problems, such as travel distance.
“Replacing missed sessions with Internet-delivered interventions adds continuity and the treatment thus becomes less vulnerable to factors such as physical health and logistical problems, such as travel distance.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataOnly two participants reported having limited computer experience and we did not include any additional evaluative questions.
“However, only two participants reported having limited computer experience and we did not include any additional evaluative questions.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Interpretationnone givenThis may be important for new therapists in training.
“This may be important for new therapists in training”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenTwo therapists in the study were also involved in the research process and evaluation of the system.
“It is noteworthy that two therapists in the study were also involved in the research process and evaluation of the system.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.
InterpretationreasoningThis may have implications for structuring treatment, for it demonstrates the importance of the therapists being keen to set the agenda and it shows that homework assignments must be formulated clearly to provide clear, educative information.
“Further, this may have implications for structuring treatment, for it demonstrates the importance of the therapists being keen to set the agenda and it shows that homework assignments must be formulated clearly to provide clear, educative information.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationcitationOur results suggest that Internet-based treatment delivery might decrease tendencies toward therapist drift and might increase adherence to CBT treatment manuals.
“Further, our results suggest that Internet-based treatment delivery might decrease tendencies toward therapist drift [9] and might increase adherence to CBT treatment manuals.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [9] source
Not checked in the free run.
Probably not a substantial claim: may not pass S2 (checkable).
InterpretationreasoningIt is also potentially valuable to experienced therapists, who can have a tendency to drift away from the treatment manuals.
“but it is also potentially valuable to experienced therapists, who can have a tendency to drift away from the treatment manuals.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningInternet-based support provides a vehicle for communication and for the structure of the therapy.
“and that it in fact provides a vehicle for communication and for the structure of the therapy.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe qualitative method, content analysis, provided the possibility of reviewing the comments and views of the participants.
“the qualitative method, content analysis, provided us with the possibility of reviewing the comments and views of the participants.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
The observed symptom improvements and user-reported benefits are attributable to the blended Internet-based support system rather than to face-to-face CBT alone or other factors.
“The results suggest that modern information technology can effectively blend with face-to-face treatments and be used to facilitate communication and structure in therapy, thus reducing therapist drift.”
The paper relies on this without support.
The support system was used consistently enough by therapists and patients during and between sessions to influence therapy.
“Each therapist and patient pair individually decided how to use the platform during the treatment—for instance, during therapy sessions and in additional contact between sessions.”
The paper relies on this without support.
Therapists' qualitative reports accurately reflect the degree of therapist drift in the face-to-face therapy.
“The same procedure of qualitative analysis was applied in analyzing both the focus group discussions and the individual therapists’ comments.”
The authors state this as an assumption.
The support system benefitted the delivery of the therapy.
“it is reasonable to assume that the support system benefitted the delivery of the therapy.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
By providing CBT in a web-based format, therapist adherence to evidence-based treatment protocols can potentially be improved.
“By providing CBT in a web-based format, therapist adherence to evidence-based treatment protocols can potentially be improved (Andersson, 2010, Månsson et al., 2013), because the online treatment environment provides all core treatment constructs (Andrews and Williams, 2014).”
From Development and initial evaluation of blended cognitive behavioural treatment for major depression in routine specialized mental health care (2016) · cites this paper as Månsson et al., 2013
Preliminary evidence that a blended treatment format can offer CBT effectively was provided by the uncontrolled study of Månsson and colleagues, focussing on a community-based sample of patients with moderate anxiety or depression (n = 15).
“Although high intensity blended treatment has not yet been studied, preliminary evidence that a blended treatment format can offer CBT effectively was provided by the uncontrolled study of Månsson and colleagues (Månsson et al., 2013), focussing on a community-based sample of patients with moderate anxiety or depression (n = 15).”
From Development and initial evaluation of blended cognitive behavioural treatment for major depression in routine specialized mental health care (2016) · cites this paper as Månsson et al., 2013
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Table 4 footnotes misidentify three outcome measures
MinorThe Table 4 labels for MADRS-S, PHQ-9, and QOLI point to footnotes identifying GAD-7, MADRS-S, and PHQ-9, respectively. The QOLI definition is instead assigned to footnote f, which is not used in the table.
“| QOLI e | QOLI e | QOLI e | QOLI e | QOLI e |”
“ePHQ-9: Patient Health Questionnaire (9-item version). fQOLI: Quality of Life Inventory.”
Conflicting reference numbers for the reliable change method
MinorThe results attribute the Jacobson and Truax reliable change method to reference 34, while the Methods section attributes it to reference 37.
“Reliable change as defined by Jacobson and Truax [34]”
“We used a reliable change index (RC) in accordance with Jacobson and Truax [37]”
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · see citing works
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601 · see citing works
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · see citing works
Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.593 · Cited by 20,391 · see citing works
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139 · see citing works
An inventory for measuring clinical anxiety: Psychometric properties.
Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.6.893 · Cited by 14,407 · see citing works
SAUNDERS, J. B., AASLAND, O. G., BABOR, T. F., DE LA FUENTE, J. R., & GRANT, M. (1993) · Addiction · doi:10.1111/j.1360-0443.1993.tb02093.x · Cited by 13,482 · cited 1× · see citing works
“We also used the Alcohol Use Disorder Identifications Test (AUDIT) [36] for screening purposes but not as an outcome measure.”
(1998) · PubMed · Cited by 10,216 · see citing works
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770 · see citing works
Eysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · see citing works
Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: A meta-analysis
SPEK, V., CUIJPERS, P., NYKLÍČEK, I., RIPER, H., KEYZER, J., & POP, V. (2007) · Psychological Medicine · doi:10.1017/s0033291706008944 · Cited by 1,586 · see citing works
Treatment gap in mental health care.
Abramowitz, M. Z., Greenberg, D., & Levav, I. (2008) · PubMed · Cited by 1,482 · see citing works
The treatment gap in mental health care.
(2004) · Europe PMC (PubMed Central) · Cited by 1,419 · see citing works
Andrews, G., Cuijpers, P., Craske, M. G., McEvoy, P., & Titov, N. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013196 · Cited by 1,311 · see citing works
Frisch, M. B., Cornell, J., Villanueva, M., & Retzlaff, P. J. (1992) · Psychological Assessment · doi:10.1037/1040-3590.4.1.92 · Cited by 1,075 · see citing works
Cuijpers, P., Donker, T., van Straten, A., Li, J., & Andersson, G. (2010) · Psychological Medicine · doi:10.1017/s0033291710000772 · Cited by 832 · see citing works
Self-citationSvanborg, P., & Åsberg, M. (1994) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1994.tb01480.x · Cited by 693 · cited 1× · see citing works
“The Montgomery Åsberg Depression Rating Scale-self-rating version (MADRS-S) [31] and the Patient Health Questionnaire-9 (PHQ-9) [32] were used to measure symptoms of depression.”
Hedman, E., Ljótsson, B., & Lindefors, N. (2012) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/erp.12.67 · Cited by 672 · see citing works
Sholomskas, D. E., Syracuse-Siewert, G., Rounsaville, B. J., Ball, S. A., Nuro, K. F., & Carroll, K. M. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.1.106 · Cited by 628 · see citing works
Psychometric comparison of PHQ-9 and HADS for measuring depression severity in primary care
Cameron, I. M., Crawford, J. R., Lawton, K., & Reid, I. C. (2008) · British Journal of General Practice · doi:10.3399/bjgp08x263794 · Cited by 590 · see citing works
Cuijpers, P., Sijbrandij, M., Koole, S. L., Andersson, G., Beekman, A. T., & Reynolds, C. F. (2013) · World Psychiatry · doi:10.1002/wps.20038 · Cited by 540 · see citing works
Self-citationInternet-based self-help for depression: randomised controlled trial
Andersson, G., Bergström, J., Holländare, F., Carlbring, P., Kaldo, V., & Ekselius, L. (2005) · British Journal of Psychiatry · doi:10.1192/bjp.187.5.456 · Cited by 529 · cited 1× · see citing works
“These resources were compiled primarily from prior studies on ICBT for anxiety [25] and depression [26]; they were presented not as discrete treatments but rather as part of the face-to-face treatment (ie,”
Self-citationRoy-Byrne, P., Craske, M. G., Sullivan, G., Rose, R. D., Edlund, M. J., Lang, A. J., Bystritsky, A., Welch, S. S., Chavira, D. A., Golinelli, D., et al. (2010) · JAMA · doi:10.1001/jama.2010.608 · Cited by 452 · cited 1× · see citing works
“The findings on the whole align with previous findings regarding computerized support in combination with face-to-face CBT [42].”
Patients' preferences in the treatment of depressive disorder in primary care
van Schaik, D. J. F., Klijn, A. F. J., van Hout, H. P. J., van Marwijk, H. W. J., Beekman, A. T. F., de Haan, M., & van Dyck, R. (2004) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2003.12.001 · Cited by 428 · see citing works
Impact of psychiatric disorders on health-related quality of life: general population survey
Saarni, S. I., Suvisaari, J., Sintonen, H., Pirkola, S. P., Koskinen, S. V. P., Aromaa, A., & Lönnqvist, J. K. (2007) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.106.025106 · Cited by 371 · see citing works
Evidence-based treatment and therapist drift
Waller, G. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2008.10.018 · Cited by 359 · cited 2× · see citing works
“Further, therapist drift from evidence-based CBT (toward supportive therapy) has been highlighted as a potential obstacle to effective CBT [9].”
Carlbring, P., Brunt, S., Bohman, S., Austin, D., Richards, J., Öst, L.-G., & Andersson, G. (2007) · Computers in Human Behavior · doi:10.1016/j.chb.2005.05.002 · Cited by 319 · cited 1× · see citing works
“87 for MADRS-S [40]; and Cronbach alpha=.”
Self-citationWright, J. H., Wright, A. S., Albano, A. M., Basco, M. R., Goldsmith, L. J., Raffield, T., & Otto, M. W. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.6.1158 · Cited by 319 · see citing works
Hedman, E., Ljótsson, B., Rück, C., Furmark, T., Carlbring, P., Lindefors, N., & Andersson, G. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.01.010 · Cited by 220 · see citing works
Self-citationCoping styles, homework compliance, and the effectiveness of cognitive-behavioral therapy.
Burns, D. D., & Nolen–Hoeksema, S. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.59.2.305 · Cited by 199 · see citing works
Coping styles, homework compliance, and the effectiveness of cognitive-behavioral therapy.
Burns, D. D., & Nolen-Hoeksema, S. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.2.305 · Cited by 199 · see citing works
Craske, M. G., Rose, R. D., Lang, A., Welch, S. S., Campbell-Sills, L., Sullivan, G., Sherbourne, C., Bystritsky, A., Stein, M. B., & Roy-Byrne, P. P. (2009) · Depression and Anxiety · doi:10.1002/da.20542 · Cited by 170 · cited 1× · see citing works
“Previous studies have combined computerized manuals with face-to-face treatment [20,21], used technological adjuncts in therapy [22], or used the Internet after treatment completion to help prevent relapse [23,24].”
Effectiveness of Guided Internet-Based Cognitive Behavior Therapy in Regular Clinical Settings
Andersson, G., & Hedman, E. (2013) · Verhaltenstherapie · doi:10.1159/000354779 · Cited by 165 · cited 1× · see citing works
“ICBT has been developed for several mood and anxiety disorders [12,13] and has also been implemented in regular clinical psychiatric settings [14].”
Self-citationPaxling, B., Lundgren, S., Norman, A., Almlöv, J., Carlbring, P., Cuijpers, P., & Andersson, G. (2013) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465812000240 · Cited by 162 · see citing works
Self-citationLambert, M. J., & Ogles, B. M. (2009) · Psychotherapy Research · doi:10.1080/10503300902849483 · Cited by 160 · see citing works
Technological adjuncts to increase adherence to therapy: A review
Clough, B. A., & Casey, L. M. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.03.006 · Cited by 125 · see citing works
Guided internet-based CBT for common mental disorders
Andersson, G., Carlbring, P., Ljótsson, B., & Hedman, E. (2013) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-013-9237-9 · Cited by 119 · see citing works
Self-citationThe promise and pitfalls of the internet for cognitive behavioral therapy
Andersson, G. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-82 · Cited by 114 · cited 1× · see citing works
“Several clear advantages can be noted when comparing ICBT with traditional, face-to-face CBT [15].”
Self-citationHolländare, F., Johnsson, S., Randestad, M., Tillfors, M., Carlbring, P., Andersson, G., & Engström, I. (2011) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2011.01698.x · Cited by 111 · see citing works
Self-citationHelping Patients Follow Prescribed Treatment: Clinical Applications
Haynes, R. B., McDonald, H. P., & Garg, A. X. (2002) · JAMA · doi:10.1001/jama.288.22.2880 · Cited by 98 · cited 1× · see citing works
“Moreover, evidence-based psychological treatments do not help all patients and issues regarding adherence to therapy are common [7].”
Ebert, D., Tarnowski, T., Gollwitzer, M., Sieland, B., & Berking, M. (2013) · Psychotherapy and Psychosomatics · doi:10.1159/000345967 · Cited by 93 · see citing works
Web-based measurement: Effect of completing single or multiple items per webpage
Thorndike, F. P., Carlbring, P., Smyth, F. L., Magee, J. C., Gonder-Frederick, L., Ost, L.-G., & Ritterband, L. M. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2008.05.006 · Cited by 83 · see citing works
Keeley, H., Williams, C., & Shapiro, D. A. (2002) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465802002060 · Cited by 52 · see citing works
Web-based therapist training on cognitive behavior therapy for anxiety disorders: A pilot study.
Kobak, K. A., Craske, M. G., Rose, R. D., & Wolitzky-Taylor, K. B. (2013) · Psychotherapy · doi:10.1037/a0030568 · Cited by 52 · see citing works
Guided Internet Treatment for Anxiety Disorders. As Effective As Face-To-Face Therapies?
Andersson, G. (2012) · Studies in health technology and informatics · doi:10.3233/978-1-61499-121-2-3 · Cited by 14 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 4
- Kohn, R, 2004, Bull World Health Organ, 82, 858
- Andersson, G, 2012, Stud Health Technol Inform, 181, 3
- Furmark, T, 2006, Social fobi - Effektiv hjälp med kognitiv beteendeterapi Social Anxiety - Effective treatment using cognitive behavioural therapy. 1st edition
- Sheehan, DV, 1998, J Clin Psychiatry, 59 Suppl 20, 22
Cited by
Sorted by citations
Internet-Delivered Psychological Treatments
Andersson, G. (2016) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-021815-093006 · Cited by 595 · see citing works
Self-citationErbe, D., Eichert, H.-C., Riper, H., & Ebert, D. D. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6588 · Cited by 532 · see citing works
Mixing Online and Face-to-Face Therapy: How to Benefit From Blended Care in Mental Health Care
Wentzel, J., van der Vaart, R., Bohlmeijer, E. T., & van Gemert-Pijnen, J. E. W. C. (2016) · JMIR Mental Health · doi:10.2196/mental.4534 · Cited by 371 · see citing works
Internet interventions: Past, present and future
Andersson, G. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.03.008 · Cited by 315 · see citing works
Self-citationBerger, T., Krieger, T., Sude, K., Meyer, B., & Maercker, A. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.11.021 · Cited by 153 · see citing works
Schuster, R., Pokorny, R., Berger, T., Topooco, N., & Laireiter, A.-R. (2018) · Journal of Medical Internet Research · doi:10.2196/11007 · Cited by 121 · see citing works
Kooistra, L. C., Ruwaard, J., Wiersma, J. E., van Oppen, P., van der Vaart, R., van Gemert-Pijnen, J. E. W. C., & Riper, H. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.01.003 · Cited by 92 · see citing works
Kooistra, L. C., Wiersma, J. E., Ruwaard, J., van Oppen, P., Smit, F., Lokkerbol, J., Cuijpers, P., & Riper, H. (2014) · BMC Psychiatry · doi:10.1186/s12888-014-0290-z · Cited by 82 · see citing works
Mol, M., van Genugten, C., Dozeman, E., van Schaik, D. J. F., Draisma, S., Riper, H., & Smit, J. H. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm9010091 · Cited by 61 · see citing works
Therapists' Experiences of Conducting Cognitive Behavioural Therapy Online vis-à-vis Face-to-Face
Bengtsson, J., Nordin, S., & Carlbring, P. (2015) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2015.1053408 · Cited by 48 · see citing works
Mendes-Santos, C., Nunes, F., Weiderpass, E., Santana, R., & Andersson, G. (2021) · doi:10.2196/preprints.32558 · Cited by 52 · see citing works
Self-citationUrech, A., Krieger, T., Möseneder, L., Biaggi, A., Vincent, A., Poppe, C., Meyer, B., Riper, H., & Berger, T. (2019) · Psychotherapy Research · doi:10.1080/10503307.2018.1430910 · Cited by 43 · see citing works
Schuster, R., Leitner, I., Carlbring, P., & Laireiter, A.-R. (2017) · Internet Interventions · doi:10.1016/j.invent.2017.04.001 · Cited by 42 · see citing works
Kraepelien, M., Schibbye, R., Månsson, K., Sundström, C., Riggare, S., Andersson, G., Lindefors, N., Svenningsson, P., & Kaldo, V. (2020) · Journal of Parkinson's Disease · doi:10.3233/jpd-191894 · Cited by 41 · see citing works
Self-citationLenhard, F., Vigerland, S., Engberg, H., Hallberg, A., Thermaenius, H., & Serlachius, E. (2016) · PLOS ONE · doi:10.1371/journal.pone.0164311 · Cited by 37 · see citing works
Kemmeren, L. L., van Schaik, A., Smit, J. H., Ruwaard, J., Rocha, A., Henriques, M., Ebert, D. D., Titzler, I., Hazo, J.-B., Dorsey, M., et al. (2019) · JMIR Mental Health · doi:10.2196/12707 · Cited by 36 · see citing works
Schuster, R., Sigl, S., Berger, T., & Laireiter, A.-R. (2018) · JMIR Mental Health · doi:10.2196/mental.9613 · Cited by 28 · see citing works
Cerga-Pashoja, A., Doukani, A., Gega, L., Walke, J., & Araya, R. (2020) · Psychotherapy Research · doi:10.1080/10503307.2020.1720932 · Cited by 30 · see citing works
The perception and needs of psychologists toward blended care
Dijksman, I., Dinant, G.-J., & Spigt, M. (2017) · Telemedicine and e-Health · doi:10.1089/tmj.2017.0031 · Cited by 30 · see citing works
Stawarz, K., Preist, C., Tallon, D., Wiles, N., Kessler, D., Turner, K., Shafran, R., & Coyle, D. (2020) · JMIR Mental Health · doi:10.2196/15972 · Cited by 24 · see citing works
Schuster, R., Fichtenbauer, I., Sparr, V. M., Berger, T., & Laireiter, A.-R. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-018412 · Cited by 23 · see citing works
Kemmeren, L. L., van Schaik, A., Draisma, S., Kleiboer, A., Riper, H., & Smit, J. H. (2023) · Cognitive Therapy and Research · doi:10.1007/s10608-023-10363-y · Cited by 22 · see citing works
Atik, E., Schückes, M., & Apolinário-Hagen, J. (2022) · JMIR Mental Health · doi:10.2196/36806 · Cited by 22 · see citing works
Dech, M., Klawohn, J., & Romanczuk-Seiferth, N. (2022) · Verhaltenstherapie · doi:10.1159/000524332 · Cited by 6 · see citing works
- Authors
- Månsson, K. N., Skagius Ruiz, E., Gervind, E., Dahlin, M., & Andersson, G.
- Affiliations
- Linköping University (SE)
- Corresponding author
- Månsson, Kristoffer NT
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2013-12-10
- Volume
- 15
- Issue
- 12
- Pages
- e280
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC3868964
- OpenAlex
- W2065807977
- Semantic Scholar
- eac63e2c5fcd626396d28bde6d3d02d6624373bc
- Cited by
- 102
- References
- 45
- Citations by year
- 2026: 2 · 2025: 10 · 2024: 5 · 2023: 3 · 2022: 6 · 2021: 3 · 2020: 10 · 2019: 6 · 2018: 14 · 2017: 13 · 2016: 11 · 2015: 14 · 2014: 4 · 2012: 1
- FWCI
- 14.77
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- face-to-face therapy, homework adherence, anxiety disorders, depression, medication adherence, maintenance of treatment effects
- MeSH terms
- Adult, Aged, Anxiety Disorders, Depression, Female, Humans, Male, Middle Aged, Pilot Projects, Cognitive Behavioral Therapy, Treatment Outcome, Telemedicine, Internet, Young Adult, Self Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review