Internet-Based Therapy for Mild to Moderate Depression in Swedish Primary Care: Short Term Results from the PRIM-NET Randomized Controlled Trial
Open accessAbstract
Depression presents a serious condition for the individual and a major challenge to health care and society. Internet-based cognitive behavior therapy (ICBT) is a treatment option supported in several trials, but there is as yet a lack of effective studies of ICBT in “real world” primary care settings. We examined whether ICBT differed from treatment-as-usual (TAU) in reducing depressive symptoms after 3 months. TAU comprised of visits to general practitioner, registered nurse, antidepressant drugs, waiting list for, or psychotherapy, or combinations of these alternatives. Patients, aged ≥ 18 years, who tentatively met criteria for mild to moderate depression at 16 primary care centers in the south-western region of Sweden were recruited and then assessed in a diagnostic interview. A total of 90 patients were randomized to either TAU or ICBT. The ICBT treatment included interactive elements online, a workbook, a CD with mindfulness and acceptance exercises, and minimal therapist contact. The treatment period lasted for 12 weeks after which both groups were assessed. The main outcome measure was Beck Depression Inventory-II (BDI-II). Additional measures were Montgomery Åsberg Depression Rating Scale – self rating version (MADRS-S) and Beck Anxiety Inventory (BAI). The analyses revealed no significant difference between the two groups at post treatment, neither on BDI-II, MADRS-S, nor BAI. Twenty patients (56%) in the ICBT treatment completed all seven modules. Our findings suggest that ICBT may be successfully delivered in primary care and that the effectiveness, after 3 months, is at par with TAU. © 2014, © 2014 The Author(s). Published by Taylor & Francis.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
4 of 18 cited sources checked · 1 supported · 0 flagged · accuracy not yet measured
- Interpretationown data
The mean number of completed modules in ICBT (5.1) implies a high adherence rate compared with live CBT in primary care and ICBT in previous efficacy studies.
“The mean number of completed modules in the ICBT treatment was 5.1 which implies that compared with live CBT in primary care and ICBT in previous efficacy studies (Cuijpers, Huibers, Ebert, Koole, & Andersson, 2013; Newby et al., 2013), we found a high adherence rate.”
Quote in the paperSubstantial claim1 of 2 sources checked- cites Cuijpers, Huibers, Ebert, Koole, & Andersson, 2013 source
- cites Newby et al., 2013 source
The Adherence Results report 89% completion of Newby et al.’s six-lesson efficacy trial, while Primary Outcome Measures, Effect Sizes, and Adherence reports an average of 4.21 lessons and 41.2% completion in primary care. These provide benchmarks for the citing authors’ own mean of 5.1 modules, but the paper does not establish that 5.1 represents higher adherence than previous efficacy studies; its discussion describes poorer primary-care adherence to psychological treatments generally, not a direct comparison with live CBT. (LLM, conf=0.79)
Experimental — accuracy not yet measured
- Premisecitation
Previous studies comparing treatments while allowing stable medication find that medication status seems unrelated to change in depth of depression.
“Previous studies comparing treatments while allowing for stable medication find that medication status seem to be unrelated to change in depth of depression (Proudfoot et al., 2004; Vernmark et al., 2010).”
Quote in the paperSubstantial claim1 of 2 sources checked- cites Proudfoot et al., 2004 source
The Beck Depression Inventory score section reports that the computerised therapy’s effect was the same for patients taking and not taking medication, supporting the claim that medication status did not alter the treatment comparison. But it also reports that patients receiving medication were less depressed on average. The Treatment section says drug treatments were not constrained, so the paper does not establish the claim’s stable-medication condition. (LLM, conf=0.86)
Experimental — accuracy not yet measured - cites Vernmark et al., 2010 source
- Findingown data
On the primary outcome measure BDI-II, the mean between-group effect size at post-treatment was d = 0.
“On the primary outcome measure (BDI-II), the mean between group effect size at post was d = 0 with within-group effect size for the ICBT group d = 1.09 (pre vs. post) and for the TAU group d = 1.27 (pre vs. post).”
Quote in the paperSubstantial claim - Findingown data
Within-group effect size for the TAU group on BDI-II from pre- to post-treatment was d = 1.27.
“On the primary outcome measure (BDI-II), the mean between group effect size at post was d = 0 with within-group effect size for the ICBT group d = 1.09 (pre vs. post) and for the TAU group d = 1.27 (pre vs. post).”
Quote in the paperNot a substantial claim - Findingown data
There was no difference between treatment groups in the proportion of recovered patients (BDI-II score ≤ 13) at post-treatment.
“There was no difference between treatment groups concerning the proportion of recovered patients, with a score of ≤ 13, on the BDI-II at post-treatment.”
Quote in the paperSubstantial claim
- Findingown data
At post-treatment, 18 patients in TAU and 8 in ICBT were on pharmacological therapy.
“At post-treatment, 18 in the TAU group and 8 in the ICBT group were on pharmacological therapy.”
Quote in the paperNot a substantial claim - Findingown data
Twenty (56%) of ICBT participants completed all seven modules within the 12-week treatment period.
“Twenty patients (56%) in the ICBT treatment completed all seven modules.”
- Also stated in: § Adherence to ICBT · plain
“Twenty (56%) of the ICBT participants completed the seven modules within the 12-week treatment period.”
- Also stated in: § Discussion · plain
“In fact, 20 (56%), i.e., the majority of the patients receiving ICBT, completed all 7 modules.”
Quote in the paperSubstantial claim - Also stated in: § Adherence to ICBT · plain
- Findingown data
The average number of completed modules in ICBT was 5.1 (range 0-7, SD = 2.6, median = 7).
“The average number of completed modules was 5.1 (range 0–7, SD = 2.6, median = 7).”
Quote in the paperNot a substantial claim - Findingown data
There was no significant difference between ICBT and TAU at post-treatment on BDI-II, MADRS-S, or BAI.
“The analyses revealed no significant difference between the two groups at post treatment, neither on BDI-II, MADRS-S, nor BAI.”
- Also stated in: § Post-treatment outcomes · plain
“Using univariate ANCOVAs controlling for pre-treatment scores, no significant differences were found between the reduction in scores for the ICBT and TAU groups, on MADRS-S scores during treatment, or on post-treatment BDI-II, MADRS-S and BAI scores (Table 2).”
- Also stated in: § Discussion · plain
“Our main finding was that there was no significant difference between the ICBT and TAU in both BDI-II and MADRS-S scores.”
Quote in the paperSubstantial claim - Also stated in: § Post-treatment outcomes · plain
- Findingown data
Within-group effect size for the ICBT group on BDI-II from pre- to post-treatment was d = 1.09.
“On the primary outcome measure (BDI-II), the mean between group effect size at post was d = 0 with within-group effect size for the ICBT group d = 1.09 (pre vs. post) and for the TAU group d = 1.27 (pre vs. post).”
Quote in the paperNot a substantial claim - Findingown data
Among the 65 patients who responded at follow up on BDI-II, four (6%) deteriorated during treatment: one in TAU (3%) and three in ICBT (10%).
“Among the 65 patients who responded at follow up on BDI-II, we found that four patients (6%) deteriorated during treatment, one in TAU (3%) and three in ICBT (10%).”
Quote in the paperNot a substantial claim - Findingown data
In the ICBT group, 42% (15 out of 36) had a BDI-II score ≤ 13 at post-treatment.
“In the TAU group, this was the case for 35% (15 out of 43) and in ICBT for 42% (15 out of 36), (χ2 (1), = .38, ns).”
Quote in the paperSubstantial claim - Findingown data
Eight (19%) of TAU patients received face-to-face treatment by a psychologist/psychotherapist during the study period.
“Eight (19%) of the TAU patients received face-to-face treatment by a psychologist/psychotherapist during the study period; ergo, most patients in TAU (81%) did not receive psychological treatment.”
Quote in the paperNot a substantial claim - Findingown data
In the TAU group, 35% (15 out of 43) had a BDI-II score ≤ 13 at post-treatment.
“In the TAU group, this was the case for 35% (15 out of 43) and in ICBT for 42% (15 out of 36), (χ2 (1), = .38, ns).”
Quote in the paperSubstantial claim - Findingreasoning
Most TAU patients (81%) did not receive psychological treatment.
“Eight (19%) of the TAU patients received face-to-face treatment by a psychologist/psychotherapist during the study period; ergo, most patients in TAU (81%) did not receive psychological treatment.”
Quote in the paperNot a substantial claim - Findingown data
In PRIM-NET, 38 out of 179 (21%) first-time accesses to any Internet modules occurred after the initial 8-week period.
“In PRIM-NET, 38 out of 179 (21%) first time access to any Internet modules were carried out after the initial 8-week period.”
Quote in the paperSubstantial claim - Interpretationown data
ICBT may be successfully delivered in primary care.
“Our findings suggest that ICBT may be successfully delivered in primary care and that the effectiveness, after 3 months, is at par with TAU.”
Quote in the paperSubstantial claim - Interpretationown data
The effectiveness of ICBT after 3 months is at par with TAU.
“Our findings suggest that ICBT may be successfully delivered in primary care and that the effectiveness, after 3 months, is at par with TAU.”
Quote in the paperSubstantial claim - Study design and conductown data
There were no significant between-group differences in demographic characteristics.
“χ2 tests failed to reveal any significant between-group differences in demographic characteristics.”
Quote in the paperNot a substantial claim - Interpretationcitation
These findings accord well with previous efficacy studies showing ICBT to be at least as effective as other treatments for depression.
“These findings accord well with previous efficacy studies showing ICBT to be at least as effective as other treatments for depression (Andersson & Cuijpers, 2009; Cuijpers et al., 2010; Richards & Richardson, 2012).”
Quote in the paperNot a substantial claim0 of 3 sources checked - Interpretationreasoning
One possible reason for the higher adherence in PRIM-NET compared with Carlbring et al.'s trial could be the prolonged treatment period (12 vs 8 weeks).
“One possible reason for the reversed findings in our study could be our prolonged treatment period that allowed patients 50% more time, 12 compared to 8 weeks.”
Quote in the paperSubstantial claim - Premisecitation
In Carlbring et al.'s (2013) trial of the same ICBT program on patients recruited by advertisement with an 8-week treatment period, 11 of 40 patients (28%) completed all 7 modules.
“In Carlbring et al.'s (2013) trial of the same ICBT program on patients recruited by advertisement with a treatment period of 8 weeks, 11 of 40 patients (28 %) completed all 7 modules.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Carlbring et al.'s (2013) source
- Study design and conductcitation
The comprehensive diagnostic interview by experienced psychologists/psychotherapists ensured that patients' needs were likely met by the treatment, a crucial aspect for good ICBT effects.
“Among the strengths of our study is the comprehensive diagnostic interview of the patients performed by experienced psychologists/psychotherapists. This procedure ensured that the patient's needs were likely to be met by the treatment, a crucial aspect in achieving good effects for ICBT (Andersson et al., 2009).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Andersson et al., 2009
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premiseown data
The mean age of included patients (36.6 years) is considerably younger than the mean age of 44 years in Carlbring et al. (2013).
“This is also considerably younger than the mean age of 44 years in the study by Carlbring et al. (2013).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Carlbring et al. (2013) source
- Interpretationreasoning
There is a high probability that when ICBT is introduced into primary care, the same type of patients recruited to this study will be attracted to this type of treatment.
“There is also a high probability that when ICBT is introduced into primary care, the same type of patients that were recruited to this study will be attracted to this type of treatment.”
Quote in the paperNot a substantial claim
- Classified as probably not a substantial claim. 15
- May combine two claims. 18
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationDifficulties in recruiting patients are a well-known problem in clinical trials, and long recruitment periods seem common.
“Finally, difficulties in recruiting patients is a well-known problem in clinical trials (Clarke et al., 2005; De Graaf et al., 2009; Mead et al., 2005) and long recruitment periods seem to be a common problem.”
Quote in the paperNot a substantial claim2 of 3 sources checked- cites Clarke et al., 2005 source
- cites De Graaf et al., 2009 source
The Methodological considerations section (page unavailable) reports that only 0.14% of the original recruitment population entered the trial and describes its low response rate, supporting recruitment difficulty in this study. It does not say that recruitment difficulties are a well-known problem across clinical trials or that long recruitment periods are common. (LLM, conf=0.83)
Experimental — accuracy not yet measured - cites Mead et al., 2005 source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataLogin time ranged from 0 to 868 minutes with a mean of 249 minutes (median 188 minutes).
“The login time ranged from 0 to 868 minutes with a mean time of 249 minutes (median 188 minutes).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown data52 (66%) participants were women.
“The mean age of participants was 36.6 years (SD = 11.3) and 52 (66%) were women.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataA total of 22 patients, 11 in each group, were on pharmacological therapy at inclusion.
“A total of 22 patients, 11 in each group, were on pharmacological therapy when they were included in the study.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe mean age of participants was 36.6 years (SD = 11.3).
“The mean age of participants was 36.6 years (SD = 11.3) and 52 (66%) were women.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataFor ICBT patients, the correlation of reduction in depressive symptoms (BDI-II) with number of accessed modules was r = −.328, p = .072 (ns).
“For the ICBT patients, the correlation of the reduction of depressive symptoms, measured by reduction of BDI-II, to the number of accessed modules was r = − .328, p = .072 (ns).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAt inclusion, 5 (6%) patients had minimal, 15 (19%) mild, 27 (34%) moderate, and 32 (41%) severe depression according to BDI-II cut-off scores.
“At inclusion, 5 (6%) patients suffered from minimal, 15 (19%) from mild, 27 (34%) from moderate, and 32 (41%) from severe depression according to BDI-II cut-off scores.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataA post hoc analysis revealed that effectiveness was similar across age groups, although the sample was younger and more Internet literate than the average primary care patient.
“Although our sample was younger and more Internet literate than the average primary care patient, a post hoc analysis revealed that the effectiveness was in fact similar across age groups.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe mean age among all patients diagnosed with depression at participating primary care centers during PRIM-NET was roughly 53 years, while the mean age of included patients was 36.6 years.
“The mean age among all patients diagnosed with depression at participating primary care centers during PRIM-NET was roughly 53 years while the mean age of our included patients was 36.6 years.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataDuring the PRIM-NET study period, 3603 patients were diagnosed with depression but only 90 (2.5%) were included.
“During the PRIM-NET study period, 3603 patients were diagnosed with depression but only 90, i.e., 2.5% of the diagnosed, were included.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataOf the remaining 90 patients, 11 later withdrew from participation.
“Of the remaining 90 patients, 11 later withdrew from their participation.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataBaseline scores showed no significant difference between treatment groups, and randomization produced a similar distribution across conditions.
“A comparison of baseline scores revealed no significant difference between treatment groups and the randomization as expected produced a similar distribution across conditions (see Table 1).”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataSixty-five of 79 patients (82%) completed post-treatment forms: 30 (83%) in ICBT and 35 (81%) in TAU.
“Sixty-five of the 79 patients (82%) completed the post-treatment forms: 30 (83%) in the ICBT and 35 (81%), in the TAU condition (see Figure 1).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataTwo patients were incorrectly included due to human error and were removed from analyses (1 in ICBT and 1 in TAU).
“The post study assessment of interview protocols identified two patients who had, due to human error, been incorrectly included. They were consequently removed from the analyses (1 in ICBT and 1 in TAU).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationSweden is one of the countries with the highest Internet usage: 84.7% of the population.
“Sweden is one of the countries in the world with the highest Internet usage: 84.7% of the population.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Statistics Sweden, 2013
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Interpretationown dataRecruitment of mild to moderately depressed individuals from the general population or primary health care is a challenge and often attracts interest by more severely depressed patients.
“Recruitment of mild to moderately depressed individuals from the general population or in primary health care is a challenge and often attracts interest by more severely depressed patients.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationnone givenThe recruitment of patients makes this study one of very few RCTs on ICBT in primary care and with results relevant to other primary care patients with mild to moderate depression.
“Furthermore, the recruitment of patients makes our study one of very few RCTs on ICBT accomplished in primary care and with results relevant to other primary care patients with mild to moderate depression.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationnone givenImplementation of ICBT in primary care offers a convenient and effective psychological therapy for patients with mild to moderate depression.
“In conclusion, the implementation of ICBT in primary care offers a convenient and effective psychological therapy in patients affected by mild to moderate depression.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
InterpretationreasoningAs the population grows older, Internet literacy and usage follow individuals into old age, so use of computers/Internet in everyday life will increase for a growing proportion of the population.
“As the population grows older, internet literacy and usage follows individuals into old age and the trend is therefore increased use of computers/Internet in everyday life for a growing proportion of the population.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationcitationOne reason why interventions aimed at mild to moderate depression attract fewer patients than expected based on prevalence rates could be that those with mild to moderate depression are less likely to actively seek treatment.
“One reason why interventions aimed at mild to moderate depression attract fewer patients than expected based on prevalence rates could be that those with mild to moderate depression are less likely to actively seek treatment (Kessler et al., 2003).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Kessler et al., 2003 source
Probably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe younger sample might reflect a more positive attitude to ICBT among younger primary care patients.
“Our younger sample might reflect a more positive attitude to ICBT among younger primary care patients, but there is also a possibility that the primary care center staff selected patients who were believed to be Internet literate and for whom they also, for various reasons, thought the ICBT would be an accurate treatment rather than invite all with suspected depression.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe generalizability of the results to primary care patients might be limited, but time suggests the opposite.
“The generalizability of our results to primary care patients might be limited, but time suggests the opposite.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Interpretationown dataThere is a possibility that primary care center staff selected patients believed to be Internet literate and thought ICBT would be an accurate treatment rather than invite all with suspected depression.
“Our younger sample might reflect a more positive attitude to ICBT among younger primary care patients, but there is also a possibility that the primary care center staff selected patients who were believed to be Internet literate and for whom they also, for various reasons, thought the ICBT would be an accurate treatment rather than invite all with suspected depression.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Study design and conductnone givenPRIM-NET excluded patients with any suicidal ideation, a criterion probably not applied in regular care.
“Third, PRIM-NET excluded patients with any suicidal ideation, a criterion probably not applied in regular care.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationThe young are more Internet literate: 94% of 16-24-year-olds use it daily, compared to 50% of 65-74-year-olds.
“The young are more Internet literate with 94% of 16–24-year-olds using it daily, compared to only 50% of 65–74-year-old (Statistics Sweden, 2013).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Statistics Sweden, 2013
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Study design and conductown dataThe study did not achieve its recruitment goal of 142 patients, leaving it underpowered.
“First, despite an extended study period, we did not achieve our goal of recruiting 142 patients which left the study underpowered.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductreasoningThe inclusion criteria allowed stable medication, and patients might have received other treatments for depression during the study period.
“Second, because the aim of the study was to assess the effectiveness in a real life primary care setting, our inclusion criteria allowed stable medication, which is common in similar studies (e.g., Carlbring et al., 2013; Vernmark et al., 2010) and our patients might have received other treatments for depression during the study period.”
Quote in the paperSubstantial claim0 of 2 sources checkedMay combine two claims.
Interpretationown dataFrom a patient perspective, ICBT might be seen as a new appealing treatment, even though the first PRIM-NET report based on short-term follow-up provides no clear support for superior effectiveness than TAU.
“From a patient perspective, ICBT might be seen as a new appealing treatment even if our first PRIM-NET Study report, based on short-term follow-up data provides no clear support for a superior effectiveness than TAU.”
Quote in the paperSubstantial claim
The paper relies on this without support.
The GPs and nurses invited all patients they met and suspected of mild to moderate depression as instructed.
“The GPs and nurses were instructed to invite all patients they met and suspected for mild to moderate depression.”
The paper relies on this without support.
Missingness at random is unlikely in clinical trials, so complete-case analysis is appropriate.
“The assumption of “missingness” at random in clinical trials is typically unlikely and inferences about treatment effects are in principle valid only for those who actually accept or adhere to treatment.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The intervention used in Carlbring et al has since been utilized in a subsequent RCT but is described predominately as iCBT.
“It is worth noting that the intervention used in Carlbring et al [51] has since been utilized in subsequent RCT [67] but where it is described predominately as iCBT.”
From Effectiveness of Web-Delivered Acceptance and Commitment Therapy in Relation to Mental Health and Well-Being: A Systematic Review and Meta-Analysis. (2016) · cites this paper as [67]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Randomized patient count conflicts with the count after exclusions
MinorThe abstract says 90 patients were randomized. The results say two patients were removed after randomization and that 90 remained, which implies 92 were randomized.
“A total of 90 patients were randomized to either TAU or ICBT.”
“The post study assessment of interview protocols identified two patients who had, due to human error, been incorrectly included. They were consequently removed from the analyses (1 in ICBT and 1 in TAU). Of the remaining 90 patients, 11 later withdrew from their participation.”
Suicidal-ideation exclusion is overstated
MinorThe discussion says any suicidal ideation was excluded, but the stated criteria exclude a prior attempt or a specified medium-to-high current suicide risk. They do not exclude every level of suicidal ideation.
“Third, PRIM-NET excluded patients with any suicidal ideation, a criterion probably not applied in regular care.”
“The exclusion criteria were (e) any prior suicide attempt (no boundary of time) or (f) currently found to be at a medium to high risk of suicide (operationalized by PRIM-NET as MADRS-S, Question 9>3 points and/or MINI Part B – Suicide>9)”
Cites
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139 · see citing works
An inventory for measuring clinical anxiety: Psychometric properties.
Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.56.6.893 · Cited by 14,407 · see citing works
A new depression scale designed to be sensitive to change
Montgomery, S. A., & Åsberg, M. (1979) · British Journal of Psychiatry · doi:10.1192/bjp.134.4.382 · Cited by 13,962 · see citing works
Projections of Global Mortality and Burden of Disease from 2002 to 2030
Mathers, C. D., & Loncar, D. (2006) · PLoS Medicine · doi:10.1371/journal.pmed.0030442 · Cited by 11,386 · cited 2× · see citing works
“Received 30 September 2013; Accepted 3 May 2014 Correspondence address: Marie Kivi, PhD-student, Department of Psychology, University of Gothenburg, PO Box 500, SE 405 30 Gothenburg, Sweden.”
(1998) · PubMed · Cited by 10,216 · see citing works
Kessler, R. C., Berglund, P., Demler, O., Jin, R., Koretz, D., Merikangas, K. R., Rush, A. J., Walters, E. E., & Wang, P. S. (2003) · JAMA · doi:10.1001/jama.289.23.3095 · Cited by 7,988 · see citing works
The mini international neuropsychiatric interview
Lecrubier, Y., Sheehan, D. V., Hergueta, T., & Weiller, E. (1998) · European Psychiatry · doi:10.1016/s0924-9338(99)80239-9 · Cited by 5,882 · see citing works
Lecrubier, Y., Sheehan, D., Weiller, E., Amorim, P., Bonora, I., Sheehan, K. H., Janavs, J., & Dunbar, G. (1997) · European Psychiatry · doi:10.1016/s0924-9338(97)83296-8 · Cited by 3,513 · see citing works
Computer-based psychological treatments for depression: A systematic review and meta-analysis
Richards, D., & Richardson, T. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.02.004 · Cited by 1,442 · cited 3× · see citing works
“(Andersson & Cuijpers, 2009; Cuijpers, Donker, van Straten, Li, & Andersson, 2010; Richards & Richardson, 2012).”
ResultInternet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368 · see citing works
Adherence in Internet Interventions for Anxiety and Depression
Christensen, H., Griffiths, K. M., & Farrer, L. (2009) · Journal of Medical Internet Research · doi:10.2196/jmir.1194 · Cited by 1,133 · see citing works
Cuijpers, P., Donker, T., van Straten, A., Li, J., & Andersson, G. (2010) · Psychological Medicine · doi:10.1017/s0033291710000772 · Cited by 832 · see citing works
Gwaltney, C. J., Shields, A. L., & Shiffman, S. (2008) · Value in Health · doi:10.1111/j.1524-4733.2007.00231.x · Cited by 623 · see citing works
Proudfoot, J., Ryden, C., Everitt, B., Shapiro, D. A., Goldberg, D., Mann, A., Tylee, A., Marks, I., & Gray, J. A. (2004) · British Journal of Psychiatry · doi:10.1192/bjp.185.1.46 · Cited by 516 · see citing works
Internet-based psychological treatments for depression
Johansson, R., & Andersson, G. (2012) · Expert Review of Neurotherapeutics · doi:10.1586/ern.12.63 · Cited by 509 · see citing works
Vickers, A. J. (2005) · BMC Medical Research Methodology · doi:10.1186/1471-2288-5-35 · Cited by 400 · see citing works
PROUDFOOT, J., GOLDBERG, D., MANN, A., EVERITT, B., MARKS, I., & GRAY, J. A. (2003) · Psychological Medicine · doi:10.1017/s0033291702007225 · Cited by 389 · cited 1× · see citing works
“In a British primary care trial (Proudfoot et al., 2003, 2004), effectiveness was examined comparing computer delivered CBT (where the computers and treatment are stationary at the primary care centers) for depression and/or anxiety with TAU.”
BackgroundPriest, R. G., Vize, C., Roberts, A., Roberts, M., & Tylee, A. (1996) · BMJ · doi:10.1136/bmj.313.7061.858 · Cited by 385 · see citing works
Clarke, G., Eubanks, D., Reid, E., Kelleher, C., O'Connor, E., DeBar, L. L., Lynch, F., Nunley, S., & Gullion, C. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.2.e16 · Cited by 372 · cited 2× · see citing works
“Both Clarke et al. (2005) and Mead et al. (2005) found that those accepting participation were older than those declining, the opposite of what seems to be the case for PRIM-NET, and thus supporting this notion.”
BackgroundResultConsensus statement on defining and measuring negative effects of internet interventions
Rozental, A., Andersson, G., Boettcher, J., Ebert, D. D., Cuijpers, P., Knaevelsrud, C., Ljótsson, B., Kaldo, V., Titov, N., & Carlbring, P. (2014) · Internet Interventions · doi:10.1016/j.invent.2014.02.001 · Cited by 371 · see citing works
Carlbring, P., Brunt, S., Bohman, S., Austin, D., Richards, J., Öst, L.-G., & Andersson, G. (2007) · Computers in Human Behavior · doi:10.1016/j.chb.2005.05.002 · Cited by 319 · cited 1× · see citing works
“Carlbring et al. (2007) identified significant effects between Internet- and paper administration of BDI-II and BAI.”
BackgroundJohansson, R., Carlbring, P., Heedman, Å., Paxling, B., & Andersson, G. (2013) · PeerJ · doi:10.7717/peerj.98 · Cited by 309 · see citing works
The Epidemiology of Major Depressive Disorder
Kessler, R. C., Berglund, P. A., Jin, R., Merikangas, K. R., Rush, A. J., Walters, E. E., & Wang, P. S. (2009) · Cited by 289 · see citing works
Behavioural activation for depression
Veale, D. (2008) · Advances in Psychiatric Treatment · doi:10.1192/apt.bp.107.004051 · Cited by 282 · see citing works
How much psychotherapy is needed to treat depression? A metaregression analysis
Cuijpers, P., Huibers, M., Daniel Ebert, D., Koole, S. L., & Andersson, G. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.02.030 · Cited by 258 · see citing works
What Makes Internet Therapy Work?
Andersson, G., Carlbring, P., Berger, T., Almlöv, J., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070902916400 · Cited by 234 · see citing works
Vernmark, K., Lenndin, J., Bjärehed, J., Carlsson, M., Karlsson, J., Öberg, J., Carlbring, P., Eriksson, T., & Andersson, G. (2010) · Behaviour Research and Therapy · doi:10.1016/j.brat.2010.01.005 · Cited by 226 · see citing works
Self-citationAndersson, G., Hesser, H., Veilord, A., Svedling, L., Andersson, F., Sleman, O., Mauritzson, L., Sarkohi, A., Claesson, E., Zetterqvist, V., et al. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.08.022 · Cited by 195 · cited 1× · see citing works
“Internet-based CBT (ICBT) for depression has been evaluated in several studies and ICBT typically has at least as good an effect as more traditional psychological treatments (Andersson, Hesser, Hummerdal, BergmanNordgren, & Carlbring, 2013; Andersson et al., 2013).”
Methodde Graaf, L. E., Gerhards, S. A. H., Arntz, A., Riper, H., Metsemakers, J. F. M., Evers, S. M. A. A., Severens, J. L., Widdershoven, G., & Huibers, M. J. H. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.054429 · Cited by 190 · see citing works
Newby, J. M., Mackenzie, A., Williams, A. D., McIntyre, K., Watts, S., Wong, N., & Andrews, G. (2013) · Psychological Medicine · doi:10.1017/s0033291713000111 · Cited by 181 · see citing works
Carlbring, P., Hägglund, M., Luthström, A., Dahlin, M., Kadowaki, Å., Vernmark, K., & Andersson, G. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.12.020 · Cited by 177 · cited 3× · see citing works
“…to assess the effectiveness in a real life primary care setting, our inclusion criteria allowed stable medication, which is common in similar studies (e.g., Carlbring et al., 2013; Vernmark et al., 2010) and our patients might have received other treatments for depression during the study period.”
BackgroundMethodInfluentialSelf-citationJohnston, L., Titov, N., Andrews, G., Spence, J., & Dear, B. F. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028079 · Cited by 150 · see citing works
Moving Treatment Research From Clinical Trials to the Real World
Roy‐Byrne, P., Sherbourne, C. D., Craske, M. G., Stein, M. B., Katon, W. J., Sullivan, G., Means‐Christensen, A. J., & Bystritsky, A. (2003) · Psychiatric Services · doi:10.1176/appi.ps.54.3.327 · Cited by 106 · cited 1× · see citing works
“This situation renders it difficult to translate efficacy into effectiveness in real life settings (Roy-Byrne et al., 2003).”
BackgroundVickers, A. J. (2005) · Psychosomatic Medicine · doi:10.1097/01.psy.0000172624.52957.a8 · Cited by 100 · cited 2× · see citing works
“Nine of them were also engaged in the support of patients they had assessed and who were randomized to the ICBT condition, i.e., all ICBT patients were supported by the therapist they had met during the initial assessment interview, with the exception of when their therapist was on vacation, etc.”
BackgroundMethodMEAD, N., MacDONALD, W., BOWER, P., LOVELL, K., RICHARDS, D., ROBERTS, C., & BUCKNALL, A. (2005) · Psychological Medicine · doi:10.1017/s003329170500560x · Cited by 86 · cited 2× · see citing works
“Both Clarke et al. (2005) and Mead et al. (2005) found that those accepting participation were older than those declining, the opposite of what seems to be the case for PRIM-NET, and thus supporting this notion.”
BackgroundResultBodlund, S.-O. A. O. (1999) · Scandinavian Journal of Primary Health Care · doi:10.1080/028134399750002566 · Cited by 53 · see citing works
A 3.5-year follow-up of Internet-delivered cognitive behavior therapy for major depression
Andersson, G., Hesser, H., Hummerdal, D. H., Nordgren, L. B., & Carlbring, P. (2011) · Journal of Mental Health · doi:10.3109/09638237.2011.608747 · Cited by 52 · see citing works
Therapist Factors in Internet-Delivered Cognitive Behavioural Therapy for Major Depressive Disorder
Almlöv, J., Carlbring, P., Berger, T., Cuijpers, P., & Andersson, G. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903116935 · Cited by 45 · see citing works
(1944) · BMJ · doi:10.1136/bmj.1.4336.222-a · Cited by 26 · see citing works
(2004) · PubMed · Cited by 2 · see citing works
Flagged first, then by citations
1 of the 41 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- Beck, A. T., Steer, R. A. & Brown, G. K. (2006). BDI-II, Beck Depression Inventory – Second edition. Manual. Svensk version (Swedish version). Stockholm: Psykologiförlaget AB.
- 2014, Internet Interventions
- SBU (2004). Behandling av depressionssjukdomar, En systematisk litteraturöversikt. SBU-rapport nr 166/1 [Treatment of depressive disorders, a systematic literature review. SBU report No. 166/1].Stockholm: Stockholm SBU.
- 10.1016/s0924-9338(97)83296-8 · DOI · Paper page
Cited by
Sorted by citations
Andrews, G., Basu, A., Cuijpers, P., Craske, M. G., McEvoy, P., English, C. L., & Newby, J. M. (2018) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2018.01.001 · Cited by 922 · see citing works
Karyotaki, E., Efthimiou, O., Miguel, C., Maas genannt Bermpohl, F., Furukawa, T. A., Cuijpers, P., Individual Patient Data Meta-Analyses for Depression (IPDMA-DE) Collaboration, Riper, H., Patel, V., Mira, A., et al. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.4364 · Cited by 866 · see citing works
Self-citationCuijpers, P., Cristea, I. A., Karyotaki, E., Reijnders, M., & Huibers, M. J. H. (2016) · World Psychiatry · doi:10.1002/wps.20346 · Cited by 572 · see citing works
Digital interventions for the treatment of depression: a meta-analytic review
Moshe, I., Terhorst, Y., Philippi, P., Domhardt, M., Cuijpers, P., Cristea, I., Pulkki-Råback, L., Baumeister, H., & Sander, L. B. (2021) · Psychological Bulletin · doi:10.1037/bul0000334 · Cited by 390 · see citing works
ICBT in routine care: A descriptive analysis of successful clinics in five countries
Titov, N., Dear, B., Nielssen, O., Staples, L., Hadjistavropoulos, H., Nugent, M., Adlam, K., Nordgreen, T., Bruvik, K. H., Hovland, A., et al. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.07.006 · Cited by 353 · see citing works
Karyotaki, E., Ebert, D. D., Donkin, L., Riper, H., Twisk, J., Burger, S., Rozental, A., Lange, A., Williams, A. D., Zarski, A. C., et al. (2018) · Clinical Psychology Review · doi:10.1016/j.cpr.2018.06.007 · Cited by 303 · see citing works
“Of the 27 studies identified from the search, data were obtained from 24 (Andersson et al., 2005; Berger, Hammerli, Gubser, Andersson, & Caspar, 2011; Buntrock et al., 2015; Carlbring et al., 2013; Choi et al., 2012; Ebert et al., 2014b; Geraedts, Kleiboer, Wiezer, van Mechelen, & Cuijpers, 2014; Hallgren et al., 2015…”
Self-citationBrown, M., Glendenning, A., Hoon, A. E., & John, A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6200 · Cited by 198 · see citing works
Rozental, A., Boettcher, J., Andersson, G., Schmidt, B., & Carlbring, P. (2015) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2015.1008033 · Cited by 189 · see citing works
“Similarly, an effectiveness trial comparing ICBT to treatment as usual for mild to moderate depression in a primary health care setting found that 10% of the patients receiving treatment via the Internet deteriorated, compared to 3% in the treatment-as-usual condition (Kivi et al., 2014).”
BackgroundHallgren, M. Å., Kraepelien, M., Öjehagen, A., Lindefors, N., Zeebari, Z., Kaldo, V., & Forsell, Y. (2015) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.114.160101 · Cited by 163 · see citing works
Web-Based Mindfulness Interventions for Mental Health Treatment: Systematic Review and Meta-Analysis
Sevilla-Llewellyn-Jones, J., Santesteban-Echarri, O., Pryor, I., McGorry, P., & Alvarez-Jimenez, M. (2018) · JMIR Mental Health · doi:10.2196/10278 · Cited by 128 · see citing works
“We found significant effect of WMIs on reducing anxiety when compared to wait list, while there was not a significant difference when compared to TAU or other active control groups.”
BackgroundMethodInfluentialCuijpers, P., Cristea, I. A., Ebert, D. D., Koot, H. M., Auerbach, R. P., Bruffaerts, R., & Kessler, R. C. (2016) · Depression and Anxiety · doi:10.1002/da.22461 · Cited by 137 · see citing works
“Recr Diagn Type Control Format Nsess RoB Countr Dimidjian et al.[16]—ba Comm Mood CBT other ind 16 3 US Dimidjian et al.[16]—ct Comm Mood BAT other ind 16 3 US Dowrick et al.[17]—cwd Comm Mood CBT cau grp 12 4 UK Dowrick et al.[17]—pst Comm Mood PST cau ind 6 4 UK Ekers et al.[18] Comm Mood BAT cau ind 12 4 UK Elkin e…”
BackgroundTwomey, C., O’Reilly, G., & Byrne, M. (2015) · Family Practice · doi:10.1093/fampra/cmu060 · Cited by 123 · see citing works
Cipolletta, S., & Mocellin, D. (2018) · Psychotherapy Research · doi:10.1080/10503307.2016.1259533 · Cited by 122 · see citing works
“Other authors found that online modalities may also be seen as a viable alternative to existing treatments (Kivi et al., 2014).”
BackgroundJannati, N., Mazhari, S., Ahmadian, L., & Mirzaee, M. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104145 · Cited by 124 · see citing works
Massoudi, B., Holvast, F., Bockting, C. L. H., Burger, H., & Blanker, M. H. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.11.050 · Cited by 101 · see citing works
Zhang, A., Borhneimer, L. A., Weaver, A., Franklin, C., Hai, A. H., Guz, S., & Li, S. (2019) · Journal of Behavioral Medicine · doi:10.1007/s10865-019-00046-z · Cited by 122 · see citing works
“…(2010) 1 1 1 1 1 5 Høifødt et al. (2013) 1 1 1 0 1 4 Jones et al. (2018) 1 1 1 1 1 5 Kessler et al. (2009) 1 1 0 0 1 3 King et al. (2014) 1 1 1 0 1 4 Kivi et al. (2014) 1 1 1 0 1 4 Kuyken et al. (2015) 1 1 1 0 1 4 Lagomasino et al. (2016) 1 1 0 0 1 3 Laidlaw et al. (2008) 1 1 1 1 1 5 Lamers et…”
BackgroundInfluentialCognitive behaviour therapy for depression in primary care: systematic review and meta-analysis
Santoft, F., Axelsson, E., Öst, L.-G., Hedman-Lagerlöf, M., Fust, J., & Hedman-Lagerlöf, E. (2019) · Psychological Medicine · doi:10.1017/s0033291718004208 · Cited by 105 · see citing works
“…2011; Joling et al., 2011; Levin et al., 2011; Casañas et al., 2012; Power and Freeman, 2012; Sørensen Høifødt et al., 2013; Wiles et al., 2013; Williams et al., 2013; Husain et al., 2014; Kivi et al., 2014; Gilbody et al., 2015; Kanter et al., 2015; Chowdhary et al., 2016; Gilbody et al., 2017).”
Internet-based cognitive—behavior therapy for procrastination: A randomized controlled trial.
Rozental, A., Forsell, E., Svensson, A., Andersson, G., & Carlbring, P. (2015) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000023 · Cited by 103 · see citing works
Forbes, A., Keleher, M. R., Venditto, M., & DiBiasi, F. (2023) · Journal of Medical Internet Research · doi:10.2196/43727 · Cited by 94 · see citing works
Topooco, N., Berg, M., Johansson, S., Liljethörn, L., Radvogin, E., Vlaescu, G., Nordgren, L. B., Zetterqvist, M., & Andersson, G. (2018) · BJPsych Open · doi:10.1192/bjo.2018.18 · Cited by 90 · see citing works
“47 The intervention did not demonstrate a significant reduction in anxiety symptoms, despite 1 week of treatment addressing anxiety.”
BackgroundZhang, A., Franklin, C., Jing, S., Bornheimer, L. A., Hai, A. H., Himle, J. A., Kong, D., & Ji, Q. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.12.008 · Cited by 83 · see citing works
Hallgren, M., Helgadóttir, B., Herring, M. P., Zeebari, Z., Lindefors, N., Kaldo, V., Öjehagen, A., & Forsell, Y. (2016) · British Journal of Psychiatry · doi:10.1192/bjp.bp.115.177576 · Cited by 78 · see citing works
“34 Currently, ICBT is a treatment option supported primarily by efficacy studies; empirical support based on effectiveness trials conducted in primary care settings remains scarce.”
The effects of psychotherapy for depression on anxiety symptoms: a meta-analysis
Weitz, E., Kleiboer, A., van Straten, A., & Cuijpers, P. (2018) · Psychological Medicine · doi:10.1017/s0033291717003622 · Cited by 77 · see citing works
Ahern, E., Kinsella, S., & Semkovska, M. (2018) · Expert review of pharmacoeconomics & outcomes research · doi:10.1080/14737167.2018.1407245 · Cited by 68 · see citing works
Cromer, J. A., Harel, B. T., Yu, K., Valadka, J. S., Brunwin, J. W., Crawford, C. D., Mayes, L. C., & Maruff, P. T. (2015) · The Clinical Neuropsychologist · doi:10.1080/13854046.2015.1054437 · Cited by 70 · see citing works
“…access to interventions, such as HIV infection risk assessment (Spielberg et al., 2011), cognitive behavior therapy for anxiety disorders (e.g., Kivi et al., 2014; Mayas, Parmentier, Andrés, & Ballesteros, 2014), and the delivery of cognitive rehabilitation in schizophrenia (Dickinson et al.,…”
BackgroundO’Connor, M., Munnelly, A., Whelan, R., & McHugh, L. (2018) · Behavior Therapy · doi:10.1016/j.beth.2017.07.007 · Cited by 62 · see citing works
Rosso, I. M., Killgore, W. D. S., Olson, E. A., Webb, C. A., Fukunaga, R., Auerbach, R. P., Gogel, H., Buchholz, J. L., & Rauch, S. L. (2016) · Depression and Anxiety · doi:10.1002/da.22590 · Cited by 65 · see citing works
“In addition, one effectiveness study found a large, between-group effect when comparing iCBT and treatment as usual (Kivi et al., 2014).”
BackgroundHolst, A., Nejati, S., Björkelund, C., Eriksson, M. C. M., Hange, D., Kivi, M., Wikberg, C., & Petersson, E. (2017) · Scandinavian Journal of Primary Health Care · doi:10.1080/02813432.2017.1288813 · Cited by 63 · see citing works
“the PRIM-NET RCT comparing iCBT to treatment as usual (TAU) as treatment for depression to primary care patients [12], conducted between 2010 and 2014.”
MethodSelf-citationRitvo, P., Knyahnytska, Y., Pirbaglou, M., Wang, W., Tomlinson, G., Zhao, H., Linklater, R., Bai, S., Kirk, M., Katz, J., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/24380 · Cited by 48 · see citing works
“Online CBT-M research with student and adult populations has yielded psychometric and neurophysiological [10-20] benefits in single-arm and randomized controlled trials (RCTs).”
Ambrosi, E., Mezzalira, E., Canzan, F., Leardini, C., Vita, G., Marini, G., & Longhini, J. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.105820 · Cited by 50 · see citing works
Kivi, M., Eriksson, M. C. M., Hange, D., Petersson, E., Björkelund, C., & Johansson, B. (2015) · Internet Interventions · doi:10.1016/j.invent.2015.06.001 · Cited by 47 · see citing works
Self-citationWahle, F., Bollhalder, L., Kowatsch, T., & Fleisch, E. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7381 · Cited by 48 · see citing works
“…older adults (18-75 years) Mild to severe No name 297 UK Kessler [44] Adults (≥16 years) Mild to moderate Depressions-hjälpen 92 Sweden Kivi [45] Adults (≥16 years) Mild to severe Good Life Compass 39 Finland Lappalainen [46] Adults (≥16 years) Mild to severe Good Life Compass 38 Finland…”
BackgroundInternet‐Based Psychotherapy for Adult Depression: What About the Mechanisms of Change?
Mogoaşe, C., Cobeanu, O., David, D., Giosan, C., & Szentágotai, A. (2016) · Journal of Clinical Psychology · doi:10.1002/jclp.22326 · Cited by 45 · see citing works
Sander, L., Gerhardinger, K., Bailey, E., Robinson, J., Lin, J., Cuijpers, P. J., & Mühlmann, C. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.11.045 · Cited by 44 · see citing works
Eriksson, M. C. M., Kivi, M., Hange, D., Petersson, E.-L., Ariai, N., Häggblad, P., Ågren, H., Spak, F., Lindblad, U., Johansson, B., et al. (2017) · Scandinavian Journal of Primary Health Care · doi:10.1080/02813432.2017.1333299 · Cited by 43 · see citing works
“Short-term results (3-month follow-up) concerning outcomes of depressive symptoms have been reported earlier [16].”
BackgroundMethodRozental, A., Forsström, D., Tangen, J. A., & Carlbring, P. (2015) · Internet Interventions · doi:10.1016/j.invent.2015.05.001 · Cited by 39 · see citing works
Wright, J. H., Owen, J. J., Eells, T. D., Antle, B. F., Bishop, L. B., Girdler, R. V., Harris, L. M., Wright, R. B., Wells, M. J., Gopalraj, R. K., et al. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.46716 · Cited by 38 · see citing works
Oehler, C., Scholze, K., Driessen, P., Rummel‐Kluge, C., Görges, F., & Hegerl, U. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100476 · Cited by 36 · see citing works
Niles, A. N., Axelsson, E., Andersson, E., Hedman‐Lagerlöf, E., Carlbring, P., Andersson, G., Johansson, R., Widén, S., Driessen, J., Santoft, F., et al. (2020) · Behaviour Research and Therapy · doi:10.1016/j.brat.2020.103767 · Cited by 35 · see citing works
Tokgöz, P., Hrynyschyn, R., Hafner, J., Schönfeld, S., & Dockweiler, C. (2021) · JMIR Mental Health · doi:10.2196/26268 · Cited by 36 · see citing works
“…studies with a positive effect, 76% (16/21) were transmitted via web-based applications [23,28,39,40,44,46,49,55,57,60-62,67,70-72] In contrast, 6 studies could be identified that showed no or neutral results: 5 were web-based interventions [21,41,43,65,66] and 1 study was designed as an app [47].”
Kraepelien, M., Mattsson, S., Hedman‐Lagerlöf, E., Petersson, I. F., Forsell, Y., Lindefors, N., & Kaldo, V. (2018) · BJPsych Open · doi:10.1192/bjo.2018.38 · Cited by 35 · see citing works
Heterogeneity of Treatment Effects in Internet- and Mobile-Based Interventions for Depression
Terhorst, Y., Kaiser, T., Brakemeier, E., Moshe, I., Philippi, P., Cuijpers, P. J., Baumeister, H., & Sander, L. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.23241 · Cited by 32 · see citing works
Flygare, A.-L., Engström, I., Hasselgren, M., Jansson-Fröjmark, M., Frejgrim, R., Andersson, G., & Holländare, F. (2019) · Internet Interventions · doi:10.1016/j.invent.2019.100303 · Cited by 26 · see citing works
“However, some studies on ICBT in health care settings have been carried out (Ruwaard et al., 2012; Watts et al., 2012; Williams and Andrews, 2013; Kessler et al., 2009; Hedman et al., 2014; Titov et al., 2015; Kivi et al., 2014; Johansson et al., 2019; Mathiasen et al., 2018; Hadjistavropoulos et al., 2016; Nordgreen…”
BackgroundWang, M., Chen, H., Yang, F., Xu, X., & Li, J. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.06.057 · Cited by 25 · see citing works
Wikberg, C., Nejati, S., Larsson, M. E. H., Petersson, E., Westman, J., Ariai, N., Kivi, M., Eriksson, M., Eggertsen, R., Hange, D., et al. (2015) · The Primary Care Companion For CNS Disorders · doi:10.4088/pcc.14m01758 · Cited by 25 · see citing works
Self-citationHange, D., Ariai, N., Kivi, M., Eriksson, M., Nejati, S., & Petersson, E. (2017) · International Journal of General Medicine · doi:10.2147/ijgm.s129710 · Cited by 25 · see citing works
“Information should be given continuously during the study and communication facilitated between different occupational groups working at the PCC. 15 As our aim was to study the effectiveness in an actual PCC setting, our patients might have received other treatments for their depression during the study period.”
InfluentialSelf-citationHolst, A., Björkelund, C., Metsini, A., Madsen, J.-H., Hange, D., Petersson, E., Eriksson, M. C. M., Kivi, M., Andersson, P.-Å., & Svensson, M. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-019716 · Cited by 24 · see citing works
“ObjeCtive The objective of this study was to perform an economic evaluation of ICBT compared with TaU as treatment for mild to moderate depression in the primary care setting, based on an pragmatic effectiveness trial performed in Swedish primary care, initially a 3-month RCT(23) with further 9 months of follow-up as…”
Self-citationPetersson, E., Forsén, E., Björkelund, C., Hammarback, L., Hessman, E., Weineland, S., & Svenningsson, I. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.01.076 · Cited by 23 · see citing works
Self-citationJesús-Romero, R. D., Holder-Dixon, A. R., Buss, J. F., & Lorenzo-Luaces, L. (2023) · Journal of Medical Internet Research · doi:10.2196/50780 · Cited by 36 · see citing works
Evidence on Technology-Based Psychological Interventions in Diagnosed Depression: Systematic Review
Köhnen, M., Dreier, M., Seeralan, T., Kriston, L., Härter, M., Baumeister, H., & Liebherz, S. (2021) · JMIR Mental Health · doi:10.2196/21700 · Cited by 23 · see citing works
How can we estimate QALYs based on PHQ-9 scores? Equipercentile linking analysis of PHQ-9 and EQ-5D
Furukawa, T. A., Levine, S. Z., Buntrock, C., Ebert, D. D., Gilbody, S. M., Brabyn, S., Kessler, D. S., Björkelund, C., Eriksson, M. C. M., Kleiboer, A. M., et al. (2021) · Evidence-Based Mental Health · doi:10.1136/ebmental-2020-300240 · Cited by 21 · see citing works
Self-citationGörges, F., Oehler, C., von Hirschhausen, E., Hegerl, U., & Rummel‐Kluge, C. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.03.001 · Cited by 19 · see citing works
Vernmark, K., Buhrman, M., Carlbring, P., Hedman‐Lagerlöf, E., Kaldo, V., & Andersson, G. (2024) · Digital Health · doi:10.1177/20552076241287059 · Cited by 19 · see citing works
“…One study compared a depression program developed by Psykologpartners against TAU in routine care for 90 patients in 16 primary care centers in Sweden showing that there was no signi fi cant difference in outcome between treatment groups 84 and that results were maintained at long-term follow-up.”
Self-citationTong, A. C. Y., Ho, F. S., Chu, O. H., & Mak, W. W. S. (2023) · Journal of Medical Internet Research · doi:10.2196/39029 · Cited by 19 · see citing works
Jonsson, U., Linton, S. J., Ybrandt, H., Ringborg, A., Leander, L., Moberg, K., Hultcrantz, M., & Arnberg, F. K. (2022) · Journal of Affective Disorders · doi:10.1016/j.jad.2022.11.036 · Cited by 16 · see citing works
“With a few exceptions (Kivi et al., 2014; Milgrom et al., 2016), the proportion receiving pharmacological treatment was similar in both groups.”
BackgroundMethodInfluentialTopooco, N. (2018) · doi:10.3384/diss.diva-148016 · Cited by 15 · see citing works
“6% for standard psychotherapies within the IAPT initiative in England (Gyani, Shafran, Layard & Clark, 2013), and 10% among patients receiving guided ICBT in Swedish routine care settings (Kivi et al., 2014).”
BackgroundGervind, E., Salem, M. B., Svanborg, C., Nyström, M. E., Lilja, J. L., Kaldo, V., & Weineland, S. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100698 · Cited by 14 · see citing works
“The approach of a decentralized organizational structure, delivering all interventions at the local PCCs, has been tested for implementing iCBT in Swedish primary care settings, showing reduced level of symptoms after treatment, but no superiority compared to treatment as usual (Kivi et al., 2014).”
MethodYang, D., Hur, J.-W., Kwak, Y. B., & Choi, S. (2018) · Psychiatry Investigation · doi:10.30773/pi.2018.03.15 · Cited by 10 · see citing works
Massoudi, B., Blanker, M. H., van Valen, E., Wouters, H., Bockting, C., & Burger, H. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1376-1 · Cited by 14 · see citing works
Omylinska‐Thurston, J., Aithal, S., Liverpool, S., Clark, R. D., Moula, Z., Wood, J., Viliardos, L., Rodríguez-Dorans, E., Farish-Edwards, F., Parsons, A. S., et al. (2024) · JMIR Mental Health · doi:10.2196/55500 · Cited by 14 · see citing works
Fuster‐Casanovas, A., Melero, S. M., Cabutto, D., Carrión, C., Vidal‐Alaball, J., Herrera‐Ramos, E., Barcons, C., & Duarte‐Díaz, A. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.03.187 · Cited by 12 · see citing works
Mezzalira, E., Canzan, F., Marini, G. M. F., Longhini, J., Leardini, C., Saiani, L., & Ambrosi, E. (2024) · Health Policy and Technology · doi:10.1016/j.hlpt.2024.100896 · Cited by 16 · see citing works
Dietary advice on prescription: experiences with a weight reduction programme
Ewe, M. B., Lydell, M., Månsson, J., Johansson, G. K., & Hildingh, C. I. (2016) · Journal of Clinical Nursing · doi:10.1111/jocn.13532 · Cited by 10 · see citing works
Schmaling, K. B., Kaplan, R. M., & Porzsolt, F. (2020) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2020-111337 · Cited by 10 · see citing works
Kirk, M. A., Pirbaglou, M., Weerasekera, R., & Ritvo, P. (2022) · International Journal of Mental Health · doi:10.1080/00207411.2021.1959807 · Cited by 10 · see citing works
Guided Internet-Delivered Treatment for Depression: Scoping Review
Børtveit, L., Dechsling, A., Sütterlin, S., Nordgreen, T., & Nordahl‐Hansen, A. (2022) · JMIR Mental Health · doi:10.2196/37342 · Cited by 11 · see citing works
“In Multimedia Appendix 5 [17,73-182], the data charted from and the characteristics of the different sources of evidence are presented.”
BackgroundDissemination of computer-assisted cognitive-behavior therapy for depression in primary care
Antle, B. F., Owen, J. J., Eells, T. D., Wells, M. J., Harris, L. M., Cappiccie, A., Wright, B., Williams, S. M., & Wright, J. H. (2018) · Contemporary Clinical Trials · doi:10.1016/j.cct.2018.11.001 · Cited by 10 · see citing works
Ritvo, P., Daskalakis, Z. J., TOMLINSON, G. A., Ravindran, A. V., Linklater, R., Kirk, M., Knyahnytska, Y., Lee, J. C., Alavi, N., Bai, S., et al. (2018) · JMIR Research Protocols · doi:10.2196/11591 · Cited by 9 · see citing works
“On the basis of a careful review of previously successful studies [38,39,41], we determined a sample size of 42 participants per group in 4 groups (total of n=168).”
BackgroundAli, S., Alemu, F. W., Owen, J. J., Eells, T. D., Antle, B. F., Lee, J. T., & Wright, J. H. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.44599 · Cited by 9 · see citing works
Köhnen, M., Kriston, L., Härter, M. C., Baumeister, H., & Liebherz, S. (2020) · Journal of Medical Internet Research · doi:10.2196/24584 · Cited by 10 · see citing works
“TBIs were delivered either with [39-41,51,63,72,74,92] or without [34,57] guidance or they were therapist-administered [35,64].”
BackgroundMethodInfluentialBuschner, A., Makiol, C., Huang, J., Mauche, N., & Strauß, M. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.02.104 · Cited by 9 · see citing works
Mazza, D., & Chakraborty, S. P. (2019) · Figshare · doi:10.26180/5c9444a4d1475 · Cited by 5 · see citing works
Beno, A., Bertilsson, M., Holmgren, K. E., Glise, K., Pousette, A., Segerfelt, K., & Björk, L. (2023) · BMC Family Practice · doi:10.1186/s12875-023-02151-0 · Cited by 5 · see citing works
“Kivi et al. [48] found no support for the introduction of Internet-based Cognitive Behaviour Therapy (ICBT) beyond TAU as a treatment option in primary health care for patients with mild to moderate depression.”
BackgroundBarriers to Implementation of a Technology-Based Mental Health Intervention in a Rural Setting
Antle, B. F., Harris, L. M., Wright, J. H., Eells, T. D., Cappiccie, A., Williams, S. M., Katz, R., Logsdon, A. R., & Owen, J. J. (2021) · Contemporary Rural Social Work Journal · doi:10.61611/2165-4611.1220 · Cited by 3 · see citing works
“However, the provision of CCBT in primary care without clinical assistance (De Graaf et al., 2009) or with modest amounts of clinician support (Kivi et al., 2014) reported that depression rating scale scores were not significantly better for CCBT than TAU.”
BackgroundSogomonjan, M., Kerikmäe, T., & Ööpik, P. (2018) · TalTech Journal of European Studies · doi:10.1515/bjes-2018-0019 · Cited by 4 · see citing works
“Only a small number of participants in our review completed all sessions of iCBT (Berger et al., 2017; Høifødt et al., 2013; Newby et al., 2013; Rollman et al., 2017; Simblett et al., 2017; Gilbody et al., 2017; Kivi et al., 2014; de Graaf et al., 2009; Levin et al., 2011; de Graaf et al., 2011; Hickie et al., 2010; K…”
BackgroundMethodInfluentialWilliams, M. K., Shell, A. L., Wu, W., MacDonald, K. L., Callahan, C. M., Nürnberger, J. I., Crawford, C. A., Schuiling, M. D., & Stewart, J. C. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.120272 · Cited by 3 · see citing works
Sogomonjan, M., Kerikmäe, T., Ööpik, P., & Ross, P. (2019) · Cogent Psychology · doi:10.1080/23311908.2019.1637623 · Cited by 3 · see citing works
“Psychologists and psychotherapists concluded that iCBT could be suggested only for some primary care patients in conjunction with face to face therapy (Kivi et al., 2014).”
BackgroundNur auf Einladung? Wie die Rekrutierungsstrategie beeinflusst, wer online behandelt wird
Zagorscak, P., Bohn, J., Heinrich, M., Kampisiou, C., & Knaevelsrud, C. (2019) · Verhaltenstherapie · doi:10.1159/000502018 · Cited by 3 · see citing works
“…Teilnehmenden rekrutierten, indem sie Menschen, mit für IBI potentiell geeigneten Symptomen oder Krankheitsbildern, gezielt ansprachen und informierten – sei es durch Praktiker aus der Primärversorgung [z.B. Kivi et al., 2014] oder durch Repräsentanten ihrer Krankenkassen [z.B. Nobis et al., 2015].”
BackgroundRozental, A. (2016) · DiVA (Stockholm University) · Cited by 3 · see citing works
Vernmark, K. (2017) · doi:10.3384/diss.diva-142389 · Cited by 3 · see citing works
Self-citationThe Use of Technology to Augment Clinical Care in Depression and Anxiety Disorders: An Evidence Map
Maher, A. R., Apaydin, E. A., Raaen, L. B., Motala, A., Shanman, R., & Hempel, S. (2019) · RAND Corporation eBooks · doi:10.7249/rr2177 · Cited by 2 · see citing works
Only on Invitation? How the Recruitment Strategy Determines Who Is Treated Online
Zagorscak, P., Bohn, J., Heinrich, M., Kampisiou, C., & Knaevelsrud, C. (2019) · Verhaltenstherapie · doi:10.1159/000503407 · Cited by 2 · see citing works
“…studies that recruited their participants by targeting and informing people with symptoms or pathologies that are potentially appropriate for IBI, whether through primary care practitioners [e.g., Kivi et al., 2014] or representatives of their health insurance companies [e.g., Nobis et al., 2015].”
BackgroundCognitive Behaviour Therapy: 50th anniversary
Rozental, A., & Powers, M. B. (2023) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2023.2189794 · Cited by 1 · see citing works
Wilhelmsen, M. (2015) · NORA - Norwegian Open Research Archives
Vernmark, K. (2016) · Springer eBooks · doi:10.1007/978-3-319-23736-7_6
Self-citationDerguy, C., Foucaud, J., & M’Baïlara, K. (2017) · Journal de Thérapie Comportementale et Cognitive · doi:10.1016/j.jtcc.2017.09.002
Severo, M., Calvio, A., & Guillén, V. (2024) · Rivista di Psicologia Clinica · doi:10.3280/rpc2-2023oa15915
Fuster‐Casanovas, A., Melero, S. M., Cabutto, D., Carrión, C., Vidal‐Alaball, J., Herrera‐Ramos, E., Barcons, C., & Duarte‐Díaz, A. (2024) · doi:10.2196/preprints.68851
- Authors
- Kivi, M., Eriksson, M. C. M., Hange, D., Petersson, E.-L., Vernmark, K., Johansson, B., & Björkelund, C.
- Affiliations
- University of Gothenburg (SE)
- Corresponding author
- Kivi, Marie
- ORCID
- Venue
- Cognitive Behaviour Therapy
- Publisher
- Informa UK Limited
- Published
- 2014-06-09
- Volume
- 43
- Issue
- 4
- Pages
- 289-298
- ISSN
- 1650-6073 (ISSN-L)
- 1651-2316
- PMC
- PMC4260664
- OpenAlex
- W2068639747
- Cited by
- 92
- References
- 41
- Citations by year
- 2025: 4 · 2024: 7 · 2023: 10 · 2022: 3 · 2021: 9 · 2020: 6 · 2019: 9 · 2018: 16 · 2017: 10 · 2016: 8 · 2015: 9 · 2014: 1
- FWCI
- 14.47
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Cognitive Behaviour Therapy (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- internet-based cognitive behavioral therapy, mild to moderate depression, primary care, usual care, depressive symptoms, mindfulness, acceptance and commitment therapy, treatment completion, antidepressants, anxiety
- MeSH terms
- Adolescent, Adult, Depression, Female, Humans, Male, Patient Compliance, Primary Health Care, Sweden, Therapy, Computer-Assisted, Cognitive Behavioral Therapy, Treatment Outcome, Internet, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-12.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-12.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review