Evaluating ADHD medication trial representativeness: a Swedish population-based study comparing hypothetically trial-eligible and trial-ineligible individuals

Classified as probably not a substantial claim.

A washout period of at least 18 months before the first ADHD medication dispensation was used to establish ADHD medication status.

“Jan 1, 2007, was chosen as the start date to allow a washout period of at least 18 months before the first ADHD medication dispensation date to establish ADHD medication status,10 which was defined as no ADHD drug dispensations in the 18 months before treatment initiation.”

• cites [10] Tadrous, 2021, Assessment of stimulant use and cardiovascular event risks among older adults, JAMA Netw Open sourceDisputed

  The Methods (Cohort Definition; page not provided) define treatment initiation as no other stimulant prescription in the previous 365 days, not no ADHD medication dispensation in the previous 18 months. The study’s accrual window also began January 1, 2002, rather than January 1, 2007. (LLM, conf=0.89)

  Checked by a reasoning model — may be wrong.

  Experimental — accuracy not yet measured

May combine two claims.

The cohort was restricted to individuals with at least one dispensed prescription for an ADHD medication, ensuring a confirmed ADHD diagnosis and pharmacological treatment, thereby excluding off-label use.

“To focus on individuals receiving pharmacotherapy, the cohort was restricted to those with at least one dispensed prescription for an ADHD medication during this period. This restriction ensured that our study population consisted of individuals with a confirmed ADHD diagnosis who were receiving pharmacological treatment for this condition, thereby excluding patients who might have been treated”

• cites [9] Bjerkeli, 2018, Overuse of methylphenidate: an analysis of Swedish pharmacy dispensing data, Clin Epidemiol sourceDisputed

  The Study sample section describes a cohort identified through methylphenidate dispensations. But the Results (Bivariate logistic regression) report that 22.3% of that cohort received methylphenidate without a registered ADHD diagnosis, and the Context section notes off-label uses. Dispensing alone therefore did not ensure a confirmed ADHD diagnosis or exclude off-label use in this source. (LLM, conf=0.89)

  Checked by a reasoning model — may be wrong.

  Experimental — accuracy not yet measured

May combine two claims.

Our results highlight important gaps between evidence-based recommendations and guidelines and clinical reality, particularly regarding the limitations of relying solely on RCT evidence to inform clinical decision making and guidelines and policies.

“Overall, in line with previous evidence, our results highlight important gaps between evidence-based recommendations and guidelines and clinical reality,18 particularly regarding the limitations of relying solely on RCT evidence to inform clinical decision making and guidelines and policies.”

• cites [18] Rosenau, 2023, Adherence to clinical guidelines for dose finding and monitoring methylphenidate use: a medical record audit in child and adolescent mental health care and pediatric settings, J Child Adolesc Psychopharmacol sourceSupported

• AssumptionRests on an assumption: The registry-based diagnoses of ADHD and comorbid conditions are accurate enough to classify trial eligibility.
• AssumptionRests on an assumption: Treatment switching and discontinuation are valid indicators of clinical outcomes in ADHD.
• AssumptionRests on an assumption: The registry data accurately capture psychiatric inpatient hospitalisations, injuries, and specialist care visits.

May combine two claims.

Specialist visits for substance use disorders, depression, and anxiety were chosen due to their high comorbidity with ADHD, frequent exclusion from RCTs, and current clinical uncertainty regarding treatment approaches.

“Specialist visits for substance use disorders, depression, and anxiety were chosen due to their high comorbidity with ADHD, frequent exclusion from RCTs, and current clinical uncertainty regarding treatment approaches.13”

• cites [13] Faraone, 2024, Attention-deficit/hyperactivity disorder, Nat Rev Dis Primers sourceCould not verify

  The available passages are bibliographic metadata (the author listing and “5 Citations (Scopus)” section) and an “Abstract” section containing an access link, not discussion of the claim. Searches for comorbidity, substance use disorders, depression and anxiety, RCT exclusions, and treatment uncertainty found no passage addressing those points in our copy. (LLM, conf=0.75)

  Experimental — accuracy not yet measured

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

In RCTs of medications for schizophrenia, 79% of individuals with schizophrenia spectrum disorders would be deemed ineligible, primarily due to exclusion criteria that eliminate many individuals with comorbid conditions and more severe manifestations.

“Research of RCTs on medications for schizophrenia highlights the significant disparity between the broader patient population and those who qualify for trials, primarily due to exclusion criteria that eliminate many individuals with comorbid conditions and more severe manifestations of the disorder: 79% of individuals with schizophrenia spectrum disorders would be deemed ineligible for RCTs.15”

• cites [15] Taipale, 2022, Representation and outcomes of individuals with schizophrenia seen in everyday practice who are ineligible for randomized clinical trials, JAMA Psychiatry sourcePartly supported

  Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

  Experimental — accuracy not yet measured

Probably not a substantial claim: may not pass S3 (load-bearing).

The increased risk of treatment discontinuation among children might be attributed to heightened concerns about medication side-effects in paediatric populations, which could make clinicians and parents more cautious about treatment.

“The increased risk of treatment discontinuation among children might be attributed to several factors. First, there are heightened concerns about medication side-effects16 in paediatric populations, which could make clinicians and parents more cautious about treatment.”

• cites [16] Garcia-Argibay, 2024, Methylphenidate and short-term cardiovascular risk, JAMA Netw Open sourcePartly supported

  The Introduction (page unavailable) describes ongoing debate about methylphenidate safety and evidence of cardiovascular adverse effects, supporting the general concern about side effects. It does not establish that concerns are heightened in paediatric populations or that they make clinicians and parents more cautious. The Strengths and Limitations section (page unavailable) says the study had no information on adherence, so it cannot explain treatment discontinuation. (LLM, conf=0.84)

  Experimental — accuracy not yet measured

• AssumptionRests on an assumption: Treatment switching and discontinuation are valid indicators of clinical outcomes in ADHD.

May combine two claims.

Injuries and accidents are consistently linked to ADHD and shown to be reduced by medication, providing an objective measure of functional impairment.

“Injuries and accidents, consistently linked to ADHD and shown to be reduced by medication,12 provided an objective measure of functional impairment.”

• cites [12] Chang, 2019, Risks and benefits of attention-deficit/hyperactivity disorder medication on behavioral and neuropsychiatric outcomes: a qualitative review of pharmacoepidemiology studies using linked prescription databases, Biol Psychiatry sourcePartly supported

  The Injuries and traumas and Motor vehicle accidents sections (page unavailable) report lower risks associated with ADHD medication, supporting the reduction part of the cited clause. They describe associations rather than establishing that medication causes the reductions, and the accident findings differ by sex. The paper does not establish the separate assertion that injuries and accidents are consistently linked to ADHD; the objective-measure framing appears to be the citing authors’ own. (LLM, conf=0.82)

  Experimental — accuracy not yet measured

Classified as probably not a substantial claim. May combine two claims.

These findings are based on one RCT in a specific country and refer to adults only.

“However, these findings are based on one RCT in a specific country and refer to adults only.”

• cites [8] Surman, 2010, Representativeness of participants in a clinical trial for attention-deficit/hyperactivity disorder? Comparison with adults from a large observational study, J Clin Psychiatry sourceSupported

May combine two claims.

Sweden has a universal, publicly funded health-care system and has some of the highest rates of prescription of ADHD medication globally.

“The generalisability of findings to countries with different health systems and access should be investigated because Sweden has a universal, publicly funded health-care system and has some of the highest rates of prescription of ADHD medication globally.22”

• cites [22] Chan, 2023, Attention-deficit/hyperactivity disorder medication consumption in 64 countries and regions from 2015 to 2019: a longitudinal study, EClinicalMedicine sourcePartly supported

  The Results table reports high ADHD-medication consumption in Sweden (71.72 in 2015 and 99.27 in 2019), supporting the claim that it is among the higher-consuming countries studied. The paper measures consumption rather than prescription rates, and its Discussion says it did not investigate healthcare-system differences; our copy does not establish that Sweden’s system is universal and publicly funded. No page number is available for these passages. (LLM, conf=0.86)

  Experimental — accuracy not yet measured

May combine two claims.

Ineligible individuals had a significantly higher risk of treatment switching and a slightly decreased risk of early medication discontinuation compared with eligible individuals, except children, who showed an increased risk for treatment discontinuation.

“We also found that individuals ineligible for RCTs had a significantly higher risk of treatment switching with a slightly decreased risk of early medication discontinuation compared with eligible individuals, except in children, who showed an increased risk for treatment discon­ tinuation.”

• AssumptionRests on an assumption: Treatment switching and discontinuation are valid indicators of clinical outcomes in ADHD.

May combine two claims.

After adjusting for baseline severity scores, incidence rate ratios decreased substantially and remained consistent with the primary analysis, except for injuries or accidents in children or adolescents, where estimates showed no increased rates.

“After adjusting for baseline severity scores, we observed a substantial decrease in IRRs, with results consistent with those in the primary analysis, except for injuries or accidents for children or adolescents, where estimates showed no increased rates (tables 3, 4).”

• AssumptionRests on an assumption: The latent baseline severity scores adequately control for confounding by indication.

May combine two claims.

The study cohort comprised 189,699 individuals with ADHD initiating pharmacological treatment in Sweden, with a mean age of 21.52 years (SD 12.83; range 4-68).

“Of 189 699 individuals included in the study cohort (112 153 men and boys [59%] and 77 546 women and girls [41%]; mean age 21·52 years [SD 12·83; range 4–68]) initiating ADHD medication”

May combine two claims.

Among individuals with ADHD, 21% of children, 35% of adolescents, and 74% of adults would be deemed ineligible for typical RCTs on the basis of common exclusion criteria.

“We found that a substantial proportion of children (21%), of adolescents (35%), and most adults (74%) with ADHD would be deemed ineligible for typical RCTs on the basis of common exclusion criteria.”

• AssumptionRests on an assumption: The registry-based diagnoses of ADHD and comorbid conditions are accurate enough to classify trial eligibility.

May combine two claims.

Ineligible individuals had a history of antidepressant use (68%), anxiety disorder (47%), substance use disorder (27%), and autism spectrum disorder (21%) within 1 year before starting ADHD medication.

“Individuals who were ineligible for the RCTs had a history of antidepressant use (67 824 [68%]), anxiety disorder (47 157 [47%]), substance use disorder (27 258 [27%]), and autism spectrum disorder (20 471 [21%]) within 1 year before the start of ADHD pharmacological treatment.”

May combine two claims.

The ineligible group had nearly ten times the rate of psychiatric inpatient hospitalisations within 1 year after treatment initiation, and higher rates of specialty care visits: approximately 14 times higher for substance use disorder, approximately six times higher for depression, and approximately 11 times higher for anxiety.

“Notably, we also found that the ineligible group had nearly ten times the rate of psychiatric inpatient hospitalisations within 1 year after treatment initiation, along with markedly higher rates of specialty care visits: approximately 14 times higher for substance use disorder, approximately six times higher for depression, and approximately 11 times higher for anxiety.”

• AssumptionRests on an assumption: The registry data accurately capture psychiatric inpatient hospitalisations, injuries, and specialist care visits.

The quote only partly states this claim.

Ineligible individuals have higher rates of adverse clinical outcomes compared with their eligible counterparts.

“Our study showed that a substantial portion of individuals with ADHD, in particular adults, are ineligible for standard RCTs, and these individuals have higher rates of adverse clinical outcomes compared with their eligible counterparts.”

• AssumptionRests on an assumption: The registry-based diagnoses of ADHD and comorbid conditions are accurate enough to classify trial eligibility.
• AssumptionRests on an assumption: Treatment switching and discontinuation are valid indicators of clinical outcomes in ADHD.
• AssumptionRests on an assumption: The registry data accurately capture psychiatric inpatient hospitalisations, injuries, and specialist care visits.

Probably not a substantial claim: may not pass S3 (load-bearing).

The study cohort included 112,153 men and boys (59%) and 77,546 women and girls (41%).

“Of 189 699 individuals included in the study cohort (112 153 men and boys [59%] and 77 546 women and girls [41%]; mean age 21·52 years [SD 12·83; range 4–68]) initiating ADHD medication”

May combine two claims. The quote only partly states this claim.

Stratified analyses indicated similar risks of treatment switching and discontinuation across age groups, except children had a higher risk for treatment discontinuation (HR 1.17, 95% CI 1.12-1.22).

“Stratified analyses indicated similar risks across different age groups, except for children who had a higher risk for treatment discontinuation (1·17 [1·12–1·22]; table 3).”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The funders had no role in study design, data collection, data analysis, data interpretation, or writing of the report.

“The funders of the study had no role in study design, data collection, data analysis, data interpretation, or writing of the report.”

May combine two claims.

The study highlights different treatment patterns and less favourable clinical and functional outcomes in ineligible individuals.

“Our study also highlights different treatment patterns and less favourable clinical and functional outcomes in ineligible individuals.”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).

The increased risk of treatment switching among ineligible individuals might suggest a more complex clinical profile, requiring multiple adjustments of medication type to produce optimal outcomes.

“The increased risk of treatment switching among individuals who were ineligible might suggest a more complex clinical profile, requiring multiple adjustments of medication type to produce optimal outcomes.”

• AssumptionRests on an assumption: Treatment switching and discontinuation are valid indicators of clinical outcomes in ADHD.

Classified as probably not a substantial claim.

These outcomes allow for the investigation of treatment response in patient populations typically under-represented in clinical trials.

“These outcomes allow for the investigation of treatment response in patient populations typically under-represented in clinical trials.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Cluster-robust standard errors were used to account for non-independence of observations within families.

“Cluster-robust standard errors were used to account for the non-independence of observations within families.”

Classified as probably not a substantial claim.

Estimates were adjusted for potential confounders including sex, age, and calendar year.

“Estimates were adjusted for potential confounders, including sex, age in years (continuous), and calendar year, based on their potential influence on both eligibility status and treatment outcomes.”

Classified as probably not a substantial claim.

Secondary outcomes were selected based on established clinical relevance in ADHD and supporting evidence.

“These secondary outcomes were selected on the basis of established clinical relevance in ADHD and supporting evidence.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Quasi-Poisson regression was chosen to address violations of the equidispersion assumption, providing adjusted SEs when variance exceeds the mean.

“Quasi-Poisson regression was chosen to address violations of the equidispersion assumption, because it provides adjusted SEs when the variance exceeds the mean.14”

• cites [14] Ver Hoef, 2007, Quasi-Poisson vs. negative binomial regression: how should we model overdispersed count data?, Ecology sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S4 (based).

No study comprehensively examined differences in multiple clinical and functional outcomes between RCT-eligible and RCT-ineligible populations in a large, real-world cohort.

“Furthermore, no study comprehensively examined differences in multiple clinical and functional outcomes between RCT-eligible and RCT-ineligible populations in a large, real-world cohort.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Sensitivity analyses adjusted for individual latent severity factor scores measured 1 year before ADHD treatment initiation to account for baseline severity differences.

“Lastly, to account for variations in outcome counts potentially influenced by baseline severity, we adjusted for individual latent severity factor scores measured 1 year before ADHD treatment initiation.”

• Also stated in: § Methods · plain

  “The resulting individual factor scores, representing each person’s estimated severity level, were then included as a covariate in sensitivity analyses to adjust for baseline severity differences between RCT-eligible and RCT-ineligible groups.”

• AssumptionRests on an assumption: Individual latent severity factor scores estimated from psychiatric hospitalisations, injuries or accidents, and substance use disorders serve as a valid proxy for baseline severity.

May combine two claims.

Individuals meeting RCT eligibility criteria typically have a less complicated course of ADHD, potentially reflecting, in part, a more favourable response to medication.

“Individuals meeting RCT eligibility criteria typically have a less complicated course of ADHD, potentially reflecting, in part, a more favourable response to medication.”

May combine two claims.

This study provides the first empirical evidence for the limited generalisability of ADHD RCTs to real-world clinical populations, by applying eligibility criteria extracted from a comprehensive dataset of RCTs to a large real-world cohort.

“This study provides the first empirical evidence for the limited generalisability of ADHD RCTs to real-world clinical populations, by applying eligibility criteria extracted from a comprehensive dataset of RCTs to a large real-world cohort.”

• Also stated in: § Research in context · plain

  “This is the first study to assess the representativeness of RCTs on ADHD medications in a real-world large nationwide cohort (189 699 children, adolescents, and adults in Sweden) based on inclusion and exclusion criteria gathered from a comprehensive international database of 164 RCTs.”

Probably not a substantial claim: may not pass S4 (based).

Psychiatric hospitalisations served as a broad measure of severe psychiatric episodes requiring intensive care, reflecting overall psychiatric burden.

“Psychiatric hospitalisations served as a broad measure of severe psychiatric episodes requiring intensive care, reflecting overall psychiatric burden.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The higher switching rate coupled with a decreased risk of treatment discontinuation among ineligible individuals might suggest that switching facilitates finding more effective medications, potentially mitigating discontinuation risk.

“Furthermore, the higher switching rate coupled with a decreased risk of treatment discontinuation among individuals ineligible for RCTs might suggest that switching facilitates finding more effective medications, potentially mitigating discontinuation risk.”

• AssumptionRests on an assumption: Treatment switching and discontinuation are valid indicators of clinical outcomes in ADHD.

Classified as probably not a substantial claim.

Additional less frequent RCT inclusion and exclusion criteria, such as baseline symptom severity thresholds, could not be extracted from the registers due to unavailability of such measures.

“Additional, less frequent RCT inclusion and exclusion criteria, such as baseline symptom severity thresholds, could not be extracted from the registers due to the unavailability of such measures.”

May combine two claims.

The study used multiple Swedish national registries (National Patient Register, Prescribed Drug Register, Cause of Death Register) covering all specialised inpatient and outpatient care and pharmacy-dispensed medications for the total population in Sweden.

“This cohort study used data from multiple Swedish national registries including the National Patient Register, Prescribed Drug Register (initiated in July, 2005), and the Cause of Death Register. These registries contain data on all specialised inpatient and outpatient care centres with diagnoses recorded according to the ICD system, as well as pharmacy-dispensed medications based on the Anatomic”

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.

These adverse outcomes might be indicative of more severe or complex ADHD symptoms, comorbid psychiatric conditions, or other psychosocial factors that are often excluded from RCTs but prevalent in real-world clinical settings.

“These adverse outcomes might be indicative of more severe or complex ADHD symptoms, comorbid psychiatric conditions, or other psychosocial factors that are often excluded from RCTs but prevalent in real-world clinical settings.”

• AssumptionRests on an assumption: The registry data accurately capture psychiatric inpatient hospitalisations, injuries, and specialist care visits.

Probably not a substantial claim: may not pass S3 (load-bearing).

Sensitivity analyses for treatment switching and discontinuation yielded consistent results across age groups.

“Sensitivity analyses for treatment switching and discontinuation yielded consistent results across age groups.”

• AssumptionRests on an assumption: Treatment switching and discontinuation are valid indicators of clinical outcomes in ADHD.

May combine two claims.

The discontinuation date was estimated as the midpoint between prescription date and expected end of medication supply, minimizing maximum error and providing a conservative estimate of time to discontinuation.

“We estimated the discontinuation date as the midpoint between the prescription date and the expected end of the medication supply (using the defined daily doses per dispensed packages). By choosing the midpoint, we minimised the maximum error in our estimation, assuming discontinuation times are uniformly distributed within the interval. This approach reduces the potential overestimation of”

• AssumptionThe authors state this as an assumption: Discontinuation times are uniformly distributed within the interval between prescription date and expected end of medication supply.

Probably not a substantial claim: may not pass S3 (load-bearing).

The STROBE reporting guidelines were followed.

“The Strengthening the Reporting of Observational studies in Epidemiology reporting guidelines were followed (appendix pp 37–42).”

Probably not a substantial claim: may not pass S3 (load-bearing).

There was a challenge in operationalising specific exclusion criteria within registry data.

“Another limitation was the challenge in operationalising specific exclusion criteria within registry data.”

May combine two claims.

Viloxazine, approved for ADHD by the US Food and Drug Administration in 2021, is not available in Sweden.

“For instance, viloxazine, which was approved for ADHD by the US Food and Drug Administration in 2021,23 is not available in Sweden.”

• cites [23] Maletic, 2024, Viloxazine extended-release capsules as an emerging treatment for attention-deficit/hyperactivity disorder in children and adolescents, Expert Rev Neurother sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

Although narrow entry criteria in traditional RCTs provide a cost-effective approach for establishing the efficacy and safety of a medication for regulatory authorities, they limit generalisability to real-world, heterogeneous populations.

“Although the narrow entry criteria in traditional RCTs provide a cost-effective approach for establishing the efficacy and safety of a medication that is useful for regulatory authorities, they limit generalisability to real-world, heterogeneous populations.”

May combine two claims.

The study applied common but not universal RCT exclusion criteria; some trials might be more inclusive.

“We applied common but not universal RCT exclusion criteria; some trials might be more inclusive.”

May combine two claims.

The pharmacological options for ADHD treatment in Sweden represent a subset of those available in countries such as the USA, potentially limiting the generalisability of the findings to other countries.

“The pharmacological options for ADHD treatment in Sweden represent a subset of those available in countries such as the USA, potentially limiting the generalisability of our findings to other countries.”