The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index; 12 of the 37 sources its claims cite were checked for support.
Web-Based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial
Open accessAbstract
There are significant challenges in addressing the mental health needs of college students. The current study tested an acceptance and commitment therapy (ACT), web-based self-help program to treat a broad range of psychological problems students struggle with. A sample of 79 college students was randomized to web-based ACT or a waitlist condition, with assessments at baseline and posttreatment. Results indicated adequate acceptability and program engagement for the ACT website. Relative to waitlist, participants receiving ACT improved on overall distress, general anxiety, social anxiety, depression, academic concerns, and positive mental health. There were no between-group effects on eating concerns, alcohol use, or hostility, or on some key ACT process of change measures. ACT participants improved more on mindful acceptance and obstruction to valued living, both of which mediated treatment outcomes. Results are discussed in the context of lessons learned with the website prototype, and areas for further research are presented.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
12 of 37 cited sources checked · 8 supported · 0 flagged · accuracy not yet measured
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Further complicating matters, many students who would benefit from treatment choose not to seek it, due to factors such as lack of time and stigma (Blanco et al., 2008;Hunt & Eisenberg, 2010).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Abstract
What the sources say
- Partly supportedcites Blanco et al., 2008 sourceExperimental — accuracy not yet measured
The Results (page unavailable in our copy) say that most college-age people with psychiatric disorders did not seek treatment and suggest stigma as a possible reason for low treatment rates for substance use disorders. They do not identify lack of time as a reason; the passage’s reference to a “time lag” concerns the onset of consequences, not students’ available time. The paper also does not establish that students actively chose to forgo treatment. (LLM, conf=0.87)
- Not checked — no full text of the sourcecites Hunt & Eisenberg, 2010 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Three published studies have been conducted on web-based ACT for college students specifically (Chase et al., 2013;Levin et al., 2014;2015).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Abstract
What the sources say
- Not checked — no full text of the sourcecites Chase et al., 2013 source
- Supportedcites Levin et al., 2014 source
The Methods (ACT-CL) describe a web-based ACT program targeted specifically to incoming college students. The Procedure describes the study testing that program, so this paper supports its inclusion as one of the cited studies. (LLM, conf=0.92)
- Not checked — no full text of the sourcecites Levin et al., 2015 source
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesEvery source the paper cites for this claim was checked and supports it.
In the paper
“The CFQ is a new measure, but the initial validation study found adequate reliability and validity with populations including college students (Gillanders et al., 2014).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Mental Health Continuum -Short Form (MHC-SF; Keyes, 2005).
What the sources say
- Supportedcites Gillanders et al., 2014 source
The Samples section describes a young-adult validation sample made up predominantly of students. The Discussion reports excellent internal consistency, good test–retest reliability, and evidence of validity across the study samples, supporting the claim that the initial validation included students and found adequate reliability and validity. (LLM, conf=0.90)
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Some previous web-based ACT research with college students has similarly found a lack of effect with the AAQ-II suggesting it may be less sensitive to detecting treatment effects in this context (Levin et al., 2014).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Discussion
What the sources say
- Partly supportedcites Levin et al., 2014 sourceExperimental — accuracy not yet measured
The Methods (Measures; page unavailable) identify the AAQ-II as the measure of psychological flexibility and experiential avoidance. The Results (Between Group Analyses; page unavailable) report no significant between-group effect on that measure, but the paper does not suggest that the AAQ-II lacks sensitivity; the Comment instead raises the limited components of the prototype program as a possible explanation. (LLM, conf=0.85)
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Some previous web-based ACT research with college students has similarly found a lack of effect with the AAQ-II suggesting it may be less sensitive to detecting treatment effects in this context (Levin et al., 2014).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Discussion
What the sources say
- Supportedcites Levin et al., 2014 source
The Methods (Measures; page unavailable) identify the AAQ-II as a measure used in this college-student study. The Results (Between Group Analyses; page unavailable) report no significant between-group effect on measures other than those listed, which excludes the AAQ-II. This supports a lack of AAQ-II effect relative to waitlist at post-treatment, though the paper also reports improvement within the ACT group by follow-up. (LLM, conf=0.88)
Load-bearingStrength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“System usability ratings were in the adequate range (M = 71.13,SD = 16.78).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > ACT program usage and satisfaction
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In addition, there were trends for a time by condition interaction on CCAPS depression, F(1, 64.12) = 3.95, p = .051,Cohen's d = .50”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Mental health outcomes
Strength:hedged· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There were no significant time by condition interactions on the AAQ, CFQ, PHLMS awareness or VQ progress subscale (p > .10).”
- Also stated in: § Discussion · plain
“The AAQ-II did not significantly change relative to the waitlist.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Processes of change
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passes- Also stated in: § Discussion · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“CCAPS social anxiety, slope estimate = -.39,t(59.84)= -3.85,p < .001,Cohen's d = .69”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Mental health outcomes
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesA result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The most frequent negative comment was that the program was too long and/or too repetitive (60% reported this).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > ACT program usage and satisfaction
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passes
- Probably not a substantial claim. 22
- It may state two separate claims as one. 34
Every source the paper cites for this claim was checked and supports it.
In the paper
“Epidemiological studies indicate up to almost 50% of students have a diagnosable psychological disorder each year (Blanco et al., 2008).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Abstract
What the sources say
- Supportedcites Blanco et al., 2008 source
The Results state that almost one-half of the college students met DSM-IV criteria for at least one psychiatric disorder in the previous year. That directly supports the claim’s approximate prevalence and annual timeframe for college students. (LLM, conf=0.94)
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Mental health problems are a significant issue among students at universities.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Abstract
What the sources say
- Supportedcites Blanco et al., 2008 source
The Results (Comment) report that almost half of the college students surveyed met criteria for at least one psychiatric disorder in the previous year. The Conclusions also call psychiatric disorders common in the college-age population and emphasize the need for treatment and prevention, supporting the broad claim that mental health problems are a significant issue among university students. (LLM, conf=0.94)
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“These studies found promising results suggesting web-based ACT may be acceptable and helpful to students for improving academic success (Chase et al., 2013), preventing mental health problems (Levin et al., 2014) and as an adjunctive treatment along with counseling (Levin et al., 2015).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Abstract
What the sources say
- Not checked — no full text of the sourcecites Chase et al., 2013 source
- Supportedcites Levin et al., 2014 source
The Comment section describes the web-based ACT program as a prototype prevention program and reports preliminary evidence of reduced depression symptoms, with reductions in depression and anxiety among students who had at least minimal symptoms. Its Conclusions say the approach holds promise for addressing college students’ mental health. The citing sentence attributes only the prevention claim to Levin et al. (2014), and its tentative wording matches the paper’s proof-of-concept findings. (LLM, conf=0.89)
- Not checked — no full text of the sourcecites Levin et al., 2015 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The two studies testing ACT as a transdiagnostic treatment found positive effects on depression and anxiety, but did not assess a broader range of problems (Levin et al., 2014;2015).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Abstract
What the sources say
- Partly supportedcites Levin et al., 2014 sourceExperimental — accuracy not yet measured
The Results (Between Group Analyses; page unavailable) report greater reductions in depression and anxiety for distressed students receiving ACT than for those on the waitlist, but no significant anxiety difference among nondistressed students. The Methods (Measures; page unavailable) show that the study also assessed stress, so it did not restrict assessment to depression and anxiety; it did not assess a wide range of other mental health problems. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites Levin et al., 2015 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The MHC-SF has been found to have adequate reliability and validity in past research (Keyes, 2005) and to be sensitive to detecting the effects of ACT (Bohlmeijer, Lamers & Fledderus, 2015).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Mental Health Continuum -Short Form (MHC-SF; Keyes, 2005).
What the sources say
- Could not verifycites Keyes, 2005 sourceExperimental — accuracy not yet measured
The Keyes (2005) citation is attached to the MHC-SF’s reliability and validity, not to its sensitivity to ACT effects. The Measures section (p. 4) reports internal consistency for other mental-health scales, but the passages found when searching for MHC-SF and reliability do not establish the MHC-SF’s reliability or validity. (LLM, conf=0.76)
- Supportedcites Bohlmeijer, Lamers & Fledderus, 2015 source
The Measures section (page not supplied) identifies the MHC-SF as the measure of flourishing. The Results section (page not supplied) reports significantly more participants flourishing after ACT than in the waiting-list condition, supporting its ability to detect an ACT effect. The reliability and validity clause is attributed to Keyes (2005), not to this source. (LLM, conf=0.91)
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Could not verify
Every source the paper cites for this claim was checked and supports it.
In the paper
“The AAQ-II has been found to have adequate reliability and validity in past studies with college students (Bond et al., 2011).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Mental Health Continuum -Short Form (MHC-SF; Keyes, 2005).
What the sources say
- Supportedcites Bond et al., 2011 source
The Participants sections identify university-student samples, including students at the University of Nevada, Reno, and Northern Illinois University. The Results and Discussion report acceptable AAQ-II reliability across samples that included university students, and the General Discussion describes the studies as providing preliminary evidence of adequate reliability and validity. The source therefore supports the claim, while characterizing its findings as preliminary. (LLM, conf=0.92)
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Other concerns included that they did not have the time or privacy to use the program (7%), that there was inadequate coverage for certain, specific mental health problems (7%) and that they did not like the web-based and self-help format for receiving services (3%).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > ACT program usage and satisfaction
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the participants primarily were recruited through the SONA research platform and participated for extra credit rather than specifically for help with a psychological problem.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Participants
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The sample consisted of 79 college students who were 18 years of age or older and currently enrolled at a mid-size university in the Mountain West region of the US.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Participants
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Of 18 comparisons a statistically significant difference was found on one measure, CCAPS academic concern subscale, t(76) = 2.21, p = .03,such that those in the ACT condition had higher academic concerns at baseline (ACT M = 2.01, ACT SD = 1.00,Waitlist M = 1.57,Waitlist SD = .72).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Preliminary analyses
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“86% reported participating for extra credit, with only 6% participating for help with a psychological problem/personal distress, and 8% for both extra credit and help with distress”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Participants
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The average time spent in each session that a participant completed was 17.19 minutes (SD = 16.20), with the longest time spent in session 1 (M = 24.83,SD = 18.63) and the shortest time spent in session 3 (M = 10.50,SD = 12.10).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > ACT program usage and satisfaction
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Consistent with this, 86% reported learning of the study through the web-based research participant management platform, SONA Systems (for extra credit assignments), and only one participant learned of the study from the counseling or student health center (despite active attempts to recruit in these settings).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Participants
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“slope estimate = -.39,t(59.84)= -3.85,p < .001,Cohen's d = .69,CCAPS academic concern, slope estimate = -.29,t(60.30)= -2.54,p = .014,Cohen's d = .45,MHC total score, slope estimate = 5.90, t(61.67)= 3.45, p = .001,Cohen's d = .60,and MHC social wellbeing, slope estimate = 2.97, t(62.23)= 3.66, p = .001,Cohen's d = .64.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Mental health outcomes
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There were no significant time by condition interactions for CCAPS eating concerns, CCAPS hostility, CCAPS alcohol, MHC emotional wellbeing subscale, or MHC psychological wellbeing (p > .10).”
- Also stated in: § Discussion · plain
“The ACT website was found to improve a range of outcomes relative to a waitlist condition, although significant effects were not found on all outcomes (hostility, eating concerns, alcohol problems).”
- Also stated in: § Discussion · plain
“For example, the current study did find some limiting areas where there were no between group differences: eating concerns, hostility, alcohol, and some aspects of positive mental health.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Mental health outcomes
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Also stated in: § Discussion · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Based on this information at baseline, 87% of participants had at least mildly severe scores on at least one CCAPS subscale and 68% had scores in the range indicating a clinically significant problem on at least one subscale.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Participants
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Participants spent on average 73.58 minutes in the ACT program (SD = 83.28).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > ACT program usage and satisfaction
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The majority of participants completed at least one session (83% completed session 1) and at least half of the ACT program (75% completed session 3).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > ACT program usage and satisfaction
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In both cases, post hoc analyses indicated that ACT processes only improved from pre to posttreatment in the ACT condition: PHLMS acceptance, slope estimate = -3.44,t(64.45)= -3.56,p = .001,Cohen's d = .62,and VQ obstacles, slope estimate = -4.34,t(62.45)= -4.68,p < .001,Cohen's d = .82.”
- Also stated in: § Discussion · plain
“In contrast, the obstruction in valued living and mindful acceptance both improved significantly from ACT.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Processes of change
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Also stated in: § Discussion · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The sample varied in terms of types of clinically significant problems: 45% were in the clinical range for depression, 40% social anxiety, 30% general anxiety, 30% eating problems, 24% academic concerns, 22% hostility, and 14% alcohol problems.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Participants
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“VQ obstacles was also a significant mediator of CCAPS academic concern, MHC total positive mental health and MHC social wellbeing, but PHLMS acceptance did not mediate these outcomes.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Processes of change
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In addition, many participants requested that the intervention be shorter and less repetitive, which if revised may lead to greater program retention.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Discussion
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This study found transdiagnostic effects for the ACT website with improvements relative to waitlist on general distress, social anxiety, academic concerns, positive mental health, depression, and general anxiety.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Discussion
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The main exception was for social anxiety for which VQ obstacles and PHLMS acceptance were both only partial mediators.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Processes of change
Strength:plain· not yet calibratedCausal:direct· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This means that the current study has not yet determined whether college students would be willing to participate in a self-help ACT website for purely mental health reasons, without additional incentives.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Discussion
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
In the paper
“The transdiagnostic focus of ACT fits particularly well for the college setting (Hayes, Pistorello & Levin, 2012).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Abstract
What the sources say
- Not checked — no full text of the sourcecites Hayes, Pistorello & Levin, 2012 source
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
In the paper
“Surveys of counseling center directors indicate that demands for services continue to increase along with growing severity/complexity of cases seen (Gallagher, 2014).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Abstract
What the sources say
- Not matchedcites Gallagher, 2014
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
- Not matched
A claim is checked only against the cited paper’s full text, never its abstract, and none is available for its sources.
In the paper
“For example, RCTs have found ACT to be effective in a web-based self-help format for depression (e.g., Lappalainen et al., 2014), smoking (e.g., Bricker et al., 2013) and chronic pain (e.g., Trompetter et al., 2015).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Abstract
What the sources say
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“Although students are likely to experience specific psychological disorders, counseling centers typically treat a broader range of problems and do not necessarily focus on treating specific diagnoses (AUCCD, 2014;Gallagher, 2014).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Abstract
What the sources say
- Not matchedcites AUCCD, 2014
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Gallagher, 2014
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Not matched
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Missing data was modeled using mixed model repeated measures analyses (MMRM; for between group effects) and maximum likelihood estimation (ML; for mediational analyses).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Analysis plan
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may state two separate claims as one.
- Rests on an assumption: Missing data are missing at random or otherwise appropriately handled by the mixed model repeated measures and maximum likelihood estimation procedures.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The internal consistency of the MHC was adequate in the current study: MCH total score α = .93,MHC Emotional Wellbeing α = .89,MHC Social Wellbeing α = .84,MHC Psychological Wellbeing α = .85.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Mental Health Continuum -Short Form (MHC-SF; Keyes, 2005).
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The internal consistency of the SUS in the current study was α = .84.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Mental Health Continuum -Short Form (MHC-SF; Keyes, 2005).
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The internal consistency of the CFQ in the current study was α =.95.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Mental Health Continuum -Short Form (MHC-SF; Keyes, 2005).
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“After completing the baseline survey, participants were automatically randomized (in blocks of 10) through Qualtrics to either the waitlist or ACT condition.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Procedures
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The CCAPS had adequate internal consistency in the current study: distress total score α = .92,depression α = .91,eating concerns α = .91,alcohol α =.88, social anxiety α = .83,general anxiety α = .79,hostility α = .79,and academic concern, α = .73.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Counseling Center Assessment of Psychological Symptoms (CCAPS-34; CCMH, 2012).
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The internal consistency of the AAQ-II in the current study was α = .93.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Mental Health Continuum -Short Form (MHC-SF; Keyes, 2005).
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Furthermore, all of these studies tested more limited ACT programs that were brief (1-3 sessions) and did not target all of the key components of ACT (particularly leaving out some of the mindfulness-focused components such as cognitive defusion and present moment awareness).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Abstract
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The internal consistency for the VQ was adequate in the current study: VQ Progress α =.89 and VQ Obstruction α = .84.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Mental Health Continuum -Short Form (MHC-SF; Keyes, 2005).
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
In the paper
“Research summarized across 206 studies indicates that the SUS items load onto a single latent factor, have a high level of internal consistency (Cronbach's alpha = .91)and can distinguish between more and less usable programs (Bangor, Kortum & Miller, 2008).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Mental Health Continuum -Short Form (MHC-SF; Keyes, 2005).
What the sources say
- Not checked — no full text of the sourcecites Bangor, Kortum & Miller, 2008 source
Strength:hedged· not yet calibratedCausal:correlational· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“Only the CCAPS alcohol subscale had a notable nonnormal distribution (baseline skewness = 2.34, kurtosis = 5.26; posttreatment skewness = 2.02, kurtosis = 2.86), which was addressed using an exponential transformation.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Preliminary analyses
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“A total of 62 participants completed the posttreatment survey (78%), with 32 (80%) completing posttreatment in the ACT condition and 30 (77%) completing posttreatment in the waitlist condition.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Analysis plan
Strength:plain· not yet calibratedn = 62Tests✓ Asserted: passes✓ Checkable: passes? Load-bearing: unclear✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“The baseline academic concern measure was included as a covariate for MMRM analyses to control for this baseline difference between conditions (of note, results are very similar with or without the inclusion of this covariate).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Preliminary analyses
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim could be matched to a paper in Crossref, so there is nothing to check it against.
In the paper
“ML is preferred over traditional imputation techniques for missing data, such as last observation carried forward or multiple imputation under normal assumptions (Black, Harel, & McCoach, 2010;Enders, 2012).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Analysis plan
What the sources say
- Not matchedcites Black, Harel, & McCoach, 2010
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not matchedcites Enders, 2012
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
- Not matched
In the paper
“The VQ is also a relatively new measure, but initial validation results indicate adequate reliability and validity (Smout et al., 2014).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Mental Health Continuum -Short Form (MHC-SF; Keyes, 2005).
What the sources say
- Not checked — no full text of the sourcecites Smout et al., 2014 source
Strength:hedged· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“An intent to treat approach was taken in which all participants were included in analyses.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Analysis plan
Load-bearingStrength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim.
In the paper
“The PHLMS has been found to have adequate reliability and validity in past studies (Cardaciotto et al., 2008).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Mental Health Continuum -Short Form (MHC-SF; Keyes, 2005).
What the sources say
- Not checked — no full text of the sourcecites Cardaciotto et al., 2008 source
Strength:plain· not yet calibratedTests✓ Asserted: passes✓ Checkable: passes✗ Load-bearing: fails✓ Based: passesProbably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This study demonstrates a more cost effective and efficient method to start testing and refining web-based self-help prototypes much more quickly.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Discussion
Tests✓ Asserted: passes✗ Checkable: fails✓ Load-bearing: passes✓ Based: passesProbably not a substantial claim. It may be too vague to check against evidence.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the fact that acceptance and obstructions in living values both improved and mediated outcomes, suggests the website did have an active impact on at least some aspects of psychological inflexibility which led to improvements on a range of outcomes.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Discussion
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
What the paper did — it cites no source for this, so there is none to check. The quote shows it is in the paper.
In the paper
“This led to some limitations in evaluating efficacy including the lack of follow up assessments and the use of a waitlist control condition.”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Discussion
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
None of the sources cited for this claim have been checked yet.
In the paper
“It is known that research including guided support from a paraprofessional or professional leads to higher engagement rates and treatment effects (Andersson, 2014;Richards & Richardson, 2012).”
§ Web-based Acceptance and Commitment Therapy for Mental Health Problems in College Students: A Randomized Controlled Trial > Discussion
What the sources say
- Not matchedcites Andersson, 2014
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Not checked — no full text of the sourcecites Richards & Richardson, 2012 source
Tests✓ Asserted: passes✓ Checkable: passes✓ Load-bearing: passes✓ Based: passesIt may state two separate claims as one.
- Not matched
The paper relies on this without support.
Web-based self-help interventions can be easily disseminated to an entire student body, providing a practical and cost-effective means to scale up services to help match the rates of problems seen.
“Such interventions can be easily disseminated to an entire student body, providing a practical and cost effective means to scale up services to help match the rates of problems seen.”
The paper relies on this without support.
Web-based self-help may increase access to students in rural settings, students on the waitlist to receive counseling, and students who have completed counseling but want additional support.
“Web-based self-help may also increase access to students in rural settings where services are more limited (e.g., distance education), students on the waitlist to receive counseling, and students who have completed counseling but want additional support.”
The paper relies on this without support.
Missing data are missing at random or otherwise appropriately handled by the mixed model repeated measures and maximum likelihood estimation procedures.
“Missing data was modeled using mixed model repeated measures analyses (MMRM; for between group effects) and maximum likelihood estimation (ML; for mediational analyses).”
The paper relies on this without support.
Psychological inflexibility contributes to a very broad range of problems, and ACT can reduce psychological inflexibility to improve these outcomes.
“The transdiagnostic ACT approach is based on the theory that psychological inflexibility contributes to a very broad range of problems, and that ACT can reduce psychological inflexibility to improve these outcomes.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“However, existing ACT interventions for academic procrastination simply utilize general ACT protocols, without any specific customization to address academic procrastination [10,21,24,35,47].”
From ClearMind Workshop: An ACT-based Intervention Tailored for Academic Procrastination among Computing Students (2024) · cites this paper as [24]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These studies found that ACT significantly reduced math anxiety [47], reduced symptoms of stress and depression [24], and improved psychological/emotional/social well-being [35].”
From ClearMind Workshop: An ACT-based Intervention Tailored for Academic Procrastination among Computing Students (2024) · cites this paper as [24]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Previous research found that university students who received ACT intervention reported less stress, reduced anxiety and depressive symptoms, increased psychological flexibility and general mental health, as well as improved mindful acceptance (Levin et al., 2017; Grégoire et al., 2018).”
From ReStress mindset: An internet-delivered intervention that changes university students’ mindset about stress in the shadow of the COVID-19 pandemic (2022) · cites this paper as Levin et al., 2017
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In yet another ACT web-based intervention for university students,33 six sessions lasting up to 45 min (45 min identified through personal correspondence with the first author of this paper) led to significant reductions in distress (d=0.66), social anxiety (d=0.78), academic concern (d=0.62), social well-being (d=0.69), depression (d=0.50) and general anxiety (d=0.47).”
From Novel ACT-based eHealth psychoeducational intervention for students with mental distress: A study protocol for a mixed-methodology pilot trial (2019) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For ACT-specific studies, longer, intensive online interventions (eg, 45 min each session, 6 sessions) have reported a 45% attrition,33 while shorter ACT online studies (eg, 15 min per session, 3 sessions) have reported as little as 8% attrition.31”
From Novel ACT-based eHealth psychoeducational intervention for students with mental distress: A study protocol for a mixed-methodology pilot trial (2019) · cites this paper as [33]
Experimental — accuracy not yet measured
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Furthermore, RCT studies by Levin et al [47,50] found significant reductions in subclinical anxiety symptoms with unguided iACT.”
From Internet-Delivered Acceptance and Commitment Therapy for Anxiety Treatment: Systematic Review. (2019) · cites this paper as [50]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Several studies indicated that iACT can be efficacious for reducing anxiety symptoms in this population with moderate-to-large effects [46-48,50].”
From Internet-Delivered Acceptance and Commitment Therapy for Anxiety Treatment: Systematic Review. (2019) · cites this paper as [50]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“RCTs focusing on college student samples suggest comparable efficacy [27–31]”
From StudiCare mindfulness-study protocol of a randomized controlled trial evaluating an internet- and mobile-based intervention for college students with no and "on demand" guidance. (2020) · cites this paper as [31]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“For unguided mindfulness IMIs, intervention dropout rates of 40–60% have been reported suggesting that only about half of the participants complete such interventions [29, 31].”
From StudiCare mindfulness-study protocol of a randomized controlled trial evaluating an internet- and mobile-based intervention for college students with no and "on demand" guidance. (2020) · cites this paper as [31]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Initial validation research has indicated acceptable reliability and validity (Smout et al., 2014). The VQ has been found to be sensitive to online self-guided ACT interventions and to mediate treatment outcomes (Levin, Haeger, et al., 2017).”
From A Randomized Controlled Trial of Multiple Versions of an Acceptance and Commitment Therapy Matrix App for Well-Being (2019) · cites this paper as Levin, Haeger, et al., 2017
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“and a web-based self-help programme for college students was found to have positive outcomes on a range of psychological difficulties and positive mental health (Levin, Haeger, et al., 2017).”
From Behind the masks: A cross-sectional study on intolerance of uncertainty, perceived vulnerability to disease and psychological flexibility in relation to state anxiety and wellbeing during the COVID-19 pandemic (2021) · cites this paper as Levin, Haeger, et al., 2017
The cited source says what the claim attributes to it.
In the citing paper
“Additionally, a web-based intervention for college students with mixed issues also showed that ACT successfully reduced anxiety.23”
From Acceptance and Commitment Therapy as a Treatment for Anxiety and Depression (2017) · cites this paper as [23]
The cited source says what the claim attributes to it.
In the citing paper
“These included three articles (Jeffcoat & Hayes, 2012; Kelson et al., 2017; Levin et al., 2017) investigating Acceptance and Commitment Therapy (ACT), a psychological intervention designed to decrease avoidance and increase psychological flexibility in the presence of different private experiences, such as self-stigmatising thoughts (Hayes, Strosahl, & Wilson, 1999), in relation to self-ac”
From Self-help interventions to reduce self-stigma in people with mental health problems: A systematic literature review (2020) · cites this paper as Levin et al., 2017
The cited source says what the claim attributes to it.
In the citing paper
“the evidence suggests that these approaches hold potential to yield reductions in depression and anxiety and improve overall quality of life across various groups of individuals [28–30], including amongst college students [31–33].”
The cited source says what the claim attributes to it.
In the citing paper
“The scale has demonstrated validity [84,85], reliability [85,86], and sensitivity to change in web-based intervention studies [87].”
From Evaluation of an App-Delivered Psychological Flexibility Skill Training Intervention for Medical Student Burnout and Well-being: Randomized Controlled Trial (2023) · cites this paper as [87]
The cited source says what the claim attributes to it.
In the citing paper
“ACT has been usefully applied to many forms of mental health issues and has been applied in many different forms of delivery. This includes web-based interventions,40–42 teleconference43 and a downloadable app for smartphones.44 45”
From A novel ACT-based video game to support mental health through embedded learning: A mixed-methods feasibility study protocol (2020) · cites this paper as [42]
The cited source says what the claim attributes to it.
In the citing paper
“For instance, most participants in the most recent study by Levin et al [50] reportedly sought the incentive of psychology course credits more so than mental health treatment which could have impacted upon observed program engagement, satisfaction, and self-report outcomes.”
From Internet-Delivered Acceptance and Commitment Therapy for Anxiety Treatment: Systematic Review. (2019) · cites this paper as [50]
The cited source says what the claim attributes to it.
In the citing paper
“but are often compromised by methodological limitations such as small sample sizes [29–31] or no long-term follow-up [27–29, 31].”
The cited source says what the claim attributes to it.
In the citing paper
“So far, results concerning ACT-IMIs for college students have been promising but have suffered from limitations such as no long-term follow-up [31, 33] or small sample sizes [30, 31].”
The cited source says what the claim attributes to it.
In the citing paper
“So far, only few studies examined the efficacy of IMIs for college students based on acceptance and commitment therapy (ACT) [30, 31, 33, 102].”
The cited source says what the claim attributes to it.
In the citing paper
“Despite a few notable exceptions (e.g., Forman et al., 2007; Hindman et al., 2015; Levin et al., 2017), most studies only presented results for just one or two dimensions of flexibility, often focusing exclusively on global psychological inflexibility through the use of scales like the AAQII.”
From Examining domains of psychological flexibility and inflexibility as treatment mechanisms in acceptance and commitment therapy: A comprehensive systematic and meta-analytic review (2024) · cites this paper as Levin et al., 2017
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentt(76) = 2.21reported p = .03 · recomputed p = .030
“t(76) = 2.21, p = .03”
- ConsistentF(1, 60.18) = 6.62reported p = .013 · recomputed p = .013
“F(1, 60.18) = 6.62, p = .013”
- ConsistentF(1, 59.79) = 9.12reported p = .004 · recomputed p = .004
“F(1, 59.79) = 9.12, p = .004”
- ConsistentF(1, 60.25) = 5.75reported p = .02 · recomputed p = .020
“F(1, 60.25) = 5.75, p = .020”
- ConsistentF(1, 61.72) = 5.16reported p = .027 · recomputed p = .027
“F(1, 61.72) = 5.16, p = .027”
- ConsistentF(1, 62.27) = 7.36reported p = .009 · recomputed p = .009
“F(1, 62.27) = 7.36, p = .009”
- ConsistentF(1, 64.12) = 3.95reported p = .051 · recomputed p = .051
“F(1, 64.12) = 3.95, p = .051”
- ConsistentF(1, 60.81) = 3.38reported p = .071 · recomputed p = .071
“F(1, 60.81) = 3.38, p = .071”
- Consistentt(60.24) = -2.93reported p = .005 · recomputed p = .005
“t(60.24)= -2.93,p = .005”
- Consistentt(64.29) = -2.32reported p = .024 · recomputed p = .024
“t(64.29)= -2.32,p = .024”
- Consistentt(60.92) = -2.21reported p = .031 · recomputed p = .031
“t(60.92)= -2.21,p = .031”
- Consistentt(59.84) = -3.85reported p < .001 · recomputed p < .001
“t(59.84)= -3.85,p < .001”
- Consistentt(60.3) = -2.54reported p = .014 · recomputed p = .014
“t(60.30)= -2.54,p = .014”
- Consistentt(61.67) = 3.45reported p = .001 · recomputed p = .001
“t(61.67)= 3.45, p = .001”
- Consistentt(62.23) = 3.66reported p = .001 · recomputed p < .001
“t(62.23)= 3.66, p = .001”
- ConsistentF(1, 64.52) = 4.49reported p = .038 · recomputed p = .038
“F(1, 64.52) = 4.49, p = .038”
- ConsistentF(1, 62.5) = 6.64reported p = .012 · recomputed p = .012
“F(1, 62.50) = 6.64, p = .012”
- Consistentt(64.45) = -3.56reported p = .001 · recomputed p < .001
“t(64.45)= -3.56,p = .001”
- Consistentt(62.45) = -4.68reported p < .001 · recomputed p < .001
“t(62.45)= -4.68,p < .001”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Depression and general anxiety are described as between-group improvements despite nonsignificant tests
MinorThe discussion lists depression and general anxiety among outcomes that improved relative to waitlist, but the results report only trends for their time-by-condition interactions (p = .051 and p = .071). The significant within-ACT changes do not establish improvement relative to waitlist.
“This study found transdiagnostic effects for the ACT website with improvements relative to waitlist on general distress, social anxiety, academic concerns, positive mental health, depression, and general anxiety.”
“In addition, there were trends for a time by condition interaction on CCAPS depression, F(1, 64.12) = 3.95, p = .051,Cohen's d = .50,and CCAPS general anxiety, F(1, 60.81) = 3.38, p = .071,Cohen's d = .47.”
ACT source has conflicting publication years
MinorThe in-text citation gives 2011 for Hayes, Strosahl, and Wilson, while the corresponding reference lists 2012.
“One particularly promising approach for providing web-based self-help to college students is acceptance and commitment therapy (ACT; Hayes, Strosahl & Wilson, 2011).”
“18. Hayes, S. C., Strosahl, K., & Wilson, K. G. (2012). Acceptance and commitment therapy: The process and practice of mindful change (2nd ed.). New York: Guilford Press.”
Citations
Cites
An Empirical Evaluation of the System Usability Scale
Bangor, A., Kortum, P. T., & Miller, J. T. (2008) · International Journal of Human–Computer Interaction · doi:10.1080/10447310802205776 · Cited by 5,181
Bond, F. W., Hayes, S. C., Baer, R. A., Carpenter, K. M., Guenole, N., Orcutt, H. K., Waltz, T., & Zettle, R. D. (2011) · Behavior Therapy · doi:10.1016/j.beth.2011.03.007 · Cited by 3,950
Mental illness and/or mental health? Investigating axioms of the complete state model of health
Keyes, C. L. M. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.3.539 · Cited by 3,357
Mental health problems and help-seeking behavior among college students
Hunt, J., & Eisenberg, D. (2010) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2009.08.008 · Cited by 1,949
Blanco, C., Okuda, M., Wright, C., Hasin, D. S., Grant, B. F., Liu, S.-M., & Olfson, M. (2008) · Archives of General Psychiatry · doi:10.1001/archpsyc.65.12.1429 · Cited by 1,582
Acceptance and commitment therapy.
Hayes, S. C., & Lillis, J. (2012) · American Psychological Association eBooks · doi:10.1037/17335-000 · Cited by 1,543
Computer-based psychological treatments for depression: A systematic review and meta-analysis
Richards, D., & Richardson, T. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.02.004 · Cited by 1,442
A-Tjak, J. G. L., Davis, M. L., Morina, N., Powers, M. B., Smits, J. A. J., & Emmelkamp, P. M. G. (2015) · Psychotherapy and Psychosomatics · doi:10.1159/000365764 · Cited by 1,031 · cited 2×
“Consistent with this, ACT has been found in more than 100 randomized controlled trials (RCTs; Hooper & Larsson, 2015) to effectively treat problems relevant to college students, including depression, anxiety, stress, substance abuse, eating disorders, test and public speaking anxiety, obsessive compulsive disorder, an…”
The Assessment of Present-Moment Awareness and Acceptance: The Philadelphia Mindfulness Scale
Cardaciotto, L., Herbert, J. D., Forman, E. M., Moitra, E., & Farrow, V. (2008) · Assessment · doi:10.1177/1073191107311467 · Cited by 940
The development and initial validation of the cognitive fusion questionnaire
Gillanders, D. T., Bolderston, H., Bond, F. W., Dempster, M., Flaxman, P. E., Campbell, L., Kerr, S., Tansey, L., Noel, P., Ferenbach, C., et al. (2014) · Behavior Therapy · doi:10.1016/j.beth.2013.09.001 · Cited by 837
Acceptance and Commitment Therapy as a Unified Model of Behavior Change
Hayes, S. C., Pistorello, J., & Levin, M. E. (2012) · The Counseling Psychologist · doi:10.1177/0011000012460836 · Cited by 718
Self-citationDevelopment of the Valuing Questionnaire (VQ)
Smout, M., Davies, M., Burns, N., & Christie, A. (2014) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2014.06.001 · Cited by 350 · cited 2×
“The VQ is also a relatively new measure, but initial validation results indicate adequate reliability and validity (Smout et al., 2014).”
Dealing With Missing Data in Developmental Research
Enders, C. K. (2013) · Child Development Perspectives · doi:10.1111/cdep.12008 · Cited by 330 · cited 1×
“ML is preferred over traditional imputation techniques for missing data, such as last observation carried forward or multiple imputation under normal assumptions (Black, Harel, & McCoach, 2010; Enders, 2012).”
Calear, A. L., Christensen, H., Mackinnon, A., Griffiths, K. M., & O'Kearney, R. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0017391 · Cited by 327
Acceptance and commitment therapy for anxiety and OCD spectrum disorders: An empirical review
Bluett, E. J., Homan, K. J., Morrison, K. L., Levin, M. E., & Twohig, M. P. (2014) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2014.06.008 · Cited by 306 · cited 1×
“…relevant to college students including depression, anxiety, stress, substance abuse, eating disorders, test and public speaking anxiety, obsessive compulsive disorder, and coping with health-related problems, among many other areas (A-Tjak et al., 2015; Bluett et al., 2014; Lee et al., in press).”
Self-citation(2008) · doi:10.1016/b978-0-12-373558-4.x0001-5 · Cited by 287
An initial meta-analysis of acceptance and commitment therapy for treating substance use disorders
Lee, E. B., An, W., Levin, M. E., & Twohig, M. P. (2015) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2015.08.004 · Cited by 271
Self-citationTrompetter, H. R., Bohlmeijer, E. T., Veehof, M. M., & Schreurs, K. M. G. (2015) · Journal of Behavioral Medicine · doi:10.1007/s10865-014-9579-0 · Cited by 255
Does self-stigma reduce the probability of seeking mental health information?
Lannin, D. G., Vogel, D. L., Brenner, R. E., Abraham, W. T., & Heath, P. J. (2015) · Journal of Counseling Psychology · doi:10.1037/cou0000108 · Cited by 235
Levin, M. E., Pistorello, J., Seeley, J. R., & Hayes, S. C. (2014) · Journal of American College Health · doi:10.1080/07448481.2013.843533 · Cited by 179 · cited 8×
“Additional program satisfaction items were used to assess features such as whether participants liked the program, found it helpful, and would recommend it to others, as well as how to further improve the program, based on items used in previous studies (Levin et al., 2014).”
InfluentialSelf-citationBricker, J., Wyszynski, C., Comstock, B., & Heffner, J. L. (2013) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntt056 · Cited by 170 · cited 1×
“For example, RCTs have found ACT to be effective in a web-based self-help format for depression (e.g., Lappalainen et al., 2014), smoking (e.g., Bricker et al., 2013) and chronic pain (e.g., Trompetter et al., 2015).”
Acceptance and commitment therapy: towards a unified model of behavior change
Hayes, S. C. (2019) · World Psychiatry · doi:10.1002/wps.20626 · Cited by 154
Lappalainen, P., Granlund, A., Siltanen, S., Ahonen, S., Vitikainen, M., Tolvanen, A., & Lappalainen, R. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.07.006 · Cited by 138 · cited 1×
“For example, RCTs have found ACT to be effective in a web-based self-help format for depression (e.g., Lappalainen et al., 2014), smoking (e.g., Bricker et al., 2013) and chronic pain (e.g., Trompetter et al., 2015).”
Chase, J. A., Houmanfar, R., Hayes, S. C., Ward, T. A., Vilardaga, J. P., & Follette, V. (2013) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2013.08.002 · Cited by 135
The Internet and CBT: A Clinical Guide
Andersson, G. (2014) · Cited by 110
Bohlmeijer, E. T., Lamers, S. M. A., & Fledderus, M. (2015) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.12.014 · Cited by 81
The Research Journey of Acceptance and Commitment Therapy (ACT)
Hooper, N., & Larsson, A. (2015) · doi:10.1057/9781137440174 · Cited by 70
The Internet and CBT: A Clinical Guide
Andersson, G. (2014) · doi:10.1201/b13645 · Cited by 63
Missing data techniques for multilevel data: implications of model misspecification
Black, A. C., Harel, O., & Betsy McCoach, D. (2011) · Journal of Applied Statistics · doi:10.1080/02664763.2010.529882 · Cited by 55
Levin, M. E., Pistorello, J., Hayes, S. C., Seeley, J. R., & Levin, C. (2015) · Journal of Counseling Psychology · doi:10.1037/cou0000083 · Cited by 47
Self-citationA-Tjak, J. G. L., Davis, M. L., Nexhmedin Morina, B., et al. (2014) · Figshare · doi:10.6084/m9.figshare.5126893
Tullis, T., & Albert, B. (2008) · Measuring the User Experience · doi:10.1016/b978-0-12-373558-4.00001-7
Flagged first, then by citations
Research works printed but not linked: 3
- Center for Collegiate Mental Health, 2012, CCAPS 2012 technical manual
- Gallagher R., 2014, National survey of counseling centers 2013. Section one: 4-Year directors
- Muthén L. K., 2012, Mplus user’s guide
Cited by
Sorted by citations
Lattie, E. G., Adkins, E. C., Winquist, N., Stiles-Shields, C., Wafford, Q. E., & Graham, A. K. (2019) · Journal of Medical Internet Research · doi:10.2196/12869 · Cited by 843
Acceptance and Commitment Therapy as a Treatment for Anxiety and Depression
Twohig, M. P., & Levin, M. E. (2017) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2017.08.009 · Cited by 268
“Additionally, a web-based intervention for college students with mixed issues also showed that ACT successfully reduced anxiety.(23) Support for”
MethodSelf-citationHuang, J.-P., Nigatu, Y., Smail-Crevier, R., Zhang, X., & Wang, J.-L. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.09.018 · Cited by 223
Sommers-Spijkerman, M., Austin, J., Bohlmeijer, E., & Pots, W. (2021) · JMIR Mental Health · doi:10.2196/28168 · Cited by 179
“Population, intervention, and methodological characteristics (Multimedia Appendix 1; Gao et al, unpublished data, 2021; [32-125]) as well as effect size data were extracted from the full-text papers by 3 raters (ie, MSS, JA, and WP) independently.”
BackgroundMethodThompson, E. M., Destree, L., Albertella, L., & Fontenelle, L. F. (2021) · Behavior Therapy · doi:10.1016/j.beth.2020.07.002 · Cited by 177
Metadata
- Authors
- Levin, M. E., Haeger, J. A., Pierce, B. G., & Twohig, M. P.
- Affiliations
- Utah State University (US)
- Corresponding author
- Levin, Michael E.
- Venue
- Behavior Modification
- Publisher
- SAGE Publications
- Published
- 2016-07-27
- Volume
- 41
- Issue
- 1
- Pages
- 141-162
- ISSN
- 0145-4455 (ISSN-L)
- 1552-4167
- OpenAlex
- W2501085513
- Semantic Scholar
- 52336f14ab0ab24212b0705a68da0527c326bffa
- Cited by
- 207
- References
- 30
- Citations by year
- 2026: 17 · 2025: 18 · 2024: 19 · 2023: 31 · 2022: 29 · 2021: 33 · 2020: 19 · 2019: 21 · 2018: 10 · 2017: 9
- FWCI
- 17.88
- Type
- journal article
- Language
- en
- Open access
- Locations
- Behavior Modification (publishedVersion)
- PubMed (publishedVersion)
- Digital Commons - USU (Utah State University) (submittedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- acceptance and commitment therapy, university students, student mental health, general anxiety, social anxiety, depression, academic concerns, positive mental health, mindful acceptance, valued living, treatment acceptability, program engagement, change processes
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
