Emulating real-world GLP-1 efficacy in type 2 diabetes through causal learning and virtual patients
Open accessAbstract
Randomized controlled trials (RCTs) remain the benchmark for assessing treatment effects but are limited to phenotypically narrow populations by design. We introduce a novel generative artificial intelligence (AI) driven emulation method that infers effect size through virtual clinical trials, which can emulate the RCT process and potentially extrapolate into wider populations. We validate the virtual trials by comparing the predicted impact of glucagon-like peptide-1 (GLP-1) agonists on HbA1c in type-2 diabetes (T2DM) with its true efficacy established in the LEAD-5 trial. Our emulation model learns treatment effects from real-world evidence data by a combined generative AI and causal learning approach. Training data comprised pre- and post-treatment outcomes for 5,476 people with T2DM. We considered three treatment arms: GLP-1 (Liraglutide), basal insulin (glargine), and placebo. After training, virtual trials were conducted by sampling 232 virtual patients per arm (according to the LEAD-5 inclusion criteria) and predicting post-treatment outcomes. We used difference-in-differences (DiD) for pairwise comparisons between arms. Our goal was to emulate LEAD-5 by demonstrating a significant DiD in post-treatment HbA1c reduction for GLP-1 compared to basal insulin and placebo. We found significant differences in HbA1c reduction for GLP-1 vs basal insulin (-1.21 mmol/mol (-0.11%); p < 0.001) and GLP-1 vs placebo (-2.58 mmol/mol (-0.24%); p < 0.001) in our virtual populations, consistent with LEAD-5 (Liraglutide vs glargine: -2.62mmol/mol (-0.24%); p = 0.0015, Liraglutide vs placebo: -11.91 mmol/mol (-1.09%); p < 0.0001). The causal AI-powered clinical trials can emulate LEAD-5 in important measurements for T2DM. Our algorithm is specialty agnostic and can explore counterfactual questions, making it suitable for further study in the generalizability of RCT results in real-world populations to support clinical decision-making and policy recommendations.
AI snapshot
Written from the paper’s full text.
TL;DR
A generative AI plus causal learning model learned treatment effects from real-world type 2 diabetes data and emulated the LEAD-5 trial by generating virtual patients and estimating post-treatment outcomes. The virtual trials reproduced the directional ranking of GLP-1 vs basal insulin and placebo for HbA1c and BMI, but effect sizes differed and counterfactual simulations showed GLP-1 was not always the most effective treatment outside LEAD-5 criteria.
Key findings
- For HbA1c, virtual trials found significant GLP-1 reductions vs basal insulin (-1.21 mmol/mol (-0.11%); p < 0.001) and vs placebo (-2.58 mmol/mol (-0.24%); p < 0.001), matching the direction of LEAD-5 (liraglutide vs glargine: -2.62 mmol/mol (-0.24%); p = 0.0015; liraglutide vs placebo: -11.91 mmol/mol (-1.09%); p < 0.0001).
- For BMI, virtual GLP-1 reduced BMI significantly vs basal insulin (-0.79 kg/m²; p < 0.001) and placebo (-0.61 kg/m²; p < 0.001), although BMI increased in all virtual arms; LEAD-5 reported weight reductions of -3.43 kg vs glargine and -1.39 kg vs placebo.
- For systolic blood pressure, virtual GLP-1 reduced SBP significantly vs basal insulin (-2.99 mmHg; p < 0.001) and placebo (-2.38 mmHg; p < 0.001); LEAD-5 found a significant reduction vs glargine (-4.51 mmHg; p = 0.0001) but not vs placebo (-2.53 mmHg; p = 0.0791).
- In counterfactual simulations on real SCI-Diabetes patients, among those who actually received basal insulin, GLP-1 was significantly less effective for HbA1c than basal insulin (+1.10 mmol/mol; p < 0.001); among those who actually received GLP-1, GLP-1 was also less effective than basal insulin (+0.64 mmol/mol; p < 0.001).
Methods
- The emulation model combined a Wasserstein GAN with gradient penalty (WGAN-GP) and NOTEARS-MLP to learn a directed acyclic graph and structural causal model from real-world observational data, then generated virtual patients satisfying LEAD-5 inclusion criteria.
- Training data comprised pre- and post-treatment outcomes for 5,476 people with T2DM (abstract); the dataset section describes SCI-Diabetes as containing 56,476 unique patients with T2DM. Pre-features were collected from 9 months before treatment and post-features within 12 months after, using median values if multiple measurements existed.
- Virtual trials sampled 232 virtual patients per arm (placebo, basal insulin/glargine, GLP-1/liraglutide), predicted post-treatment outcomes, and used difference-in-differences for pairwise comparisons, with results computed over 60 random seeds and 95% confidence intervals obtained by bootstrapping.
Limitations
- The paper states that virtual patients were sampled with a random-based approach according to inclusion criteria, and that sampling covariates independently may overlook real-world correlations, potentially undermining ecological validity; future work could use causal-preserving generative models or Bayesian bootstrapping.
- The paper states that pre- and post-treatment features were based on yearly median values, which may obscure fine-grained treatment effects; the emulation assumes causal sufficiency, and unmeasured confounding remains possible during model training.
- The paper states that SCI-Diabetes uses GLP-1 as a general drug category rather than the specific liraglutide tested in LEAD-5, that basal insulin and placebo categories are not identical to the original trial drugs, and that different units (HbA1c mmol/mol vs %, BMI vs bodyweight) and inability to replicate an identical cohort contributed to discrepancies; it also notes complete-case analysis reduced the training set. Evident from the text: the abstract and dataset section report different T2DM cohort sizes (5,476 vs 56,476), which is not reconciled.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
12 of 14 cited sources checked · 8 supported · 0 flagged · accuracy not yet measured
- Premisecitation
LEAD-5 established that Liraglutide reduced HbA1c significantly compared with glargine (difference -2.62 mmol/mol (-0.24%), p = 0.0015).
“LEAD-5 established that Liraglutide reduced HbA1c significantly compared with both glargine (-2.62mmol/mol (−0.24%) difference; p = 0.0015)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [9] D Russell-Jones, 2009, Liraglutide vs insulin glargine and placebo in combination with metformin and sulfonylurea therapy in type 2 diabetes mellitus (LEAD-5 met+SU): a randomised controlled trial, Diabetologia source
- Premisecitation
LEAD-5 established that Liraglutide reduced HbA1c significantly compared with placebo (difference -11.91 mmol/mol (-1.09%), p < 0.0001).
“and placebo (-11.91mmol/mol(−1.09%) difference; p < 0.0001)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [9] D Russell-Jones, 2009, Liraglutide vs insulin glargine and placebo in combination with metformin and sulfonylurea therapy in type 2 diabetes mellitus (LEAD-5 met+SU): a randomised controlled trial, Diabetologia source
- Premisecitation
LEAD-5 demonstrated a significant reduction in SBP with GLP-1 compared with glargine (difference -4.51 mmHg, p = 0.0001).
“LEAD-5 demonstrated a significant reduction in SBP compared with glargine (−4.51 mmHg difference; p = 0.0001)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [9] D Russell-Jones, 2009, Liraglutide vs insulin glargine and placebo in combination with metformin and sulfonylurea therapy in type 2 diabetes mellitus (LEAD-5 met+SU): a randomised controlled trial, Diabetologia source
- Premisecitation
LEAD-5 demonstrated that Liraglutide produced significantly greater weight loss compared with glargine (difference -3.43 kg, p < 0.0001).
“LEAD-5 also demonstrated that Liraglutide produced significantly greater weight loss compared with both glargine (−3.43 kg difference; p < 0.0001)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [9] D Russell-Jones, 2009, Liraglutide vs insulin glargine and placebo in combination with metformin and sulfonylurea therapy in type 2 diabetes mellitus (LEAD-5 met+SU): a randomised controlled trial, Diabetologia source
- Premisecitation
LEAD-5 demonstrated that Liraglutide produced significantly greater weight loss compared with placebo (difference -1.39 kg, p = 0.0001).
“and placebo (–1.39 kg difference; p = 0.0001)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [9] D Russell-Jones, 2009, Liraglutide vs insulin glargine and placebo in combination with metformin and sulfonylurea therapy in type 2 diabetes mellitus (LEAD-5 met+SU): a randomised controlled trial, Diabetologia source
- Premisecitation
LEAD-5 did not demonstrate a significant reduction in SBP with GLP-1 compared with placebo (difference -2.53 mmHg, p = 0.0791).
“but not with placebo (−2.53 mmHg difference; p = 0.0791)”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [9] D Russell-Jones, 2009, Liraglutide vs insulin glargine and placebo in combination with metformin and sulfonylurea therapy in type 2 diabetes mellitus (LEAD-5 met+SU): a randomised controlled trial, Diabetologia source
- Interpretationcitation
The virtual trial emulations produced the same ranking between the three treatment arms in LEAD-5 for HbA1c, BMI, and SBP reduction.
“the virtual trial emulations produced the same ranking between the three treatment arms in LEAD-5 [9], suggesting that GLP-1 produces more favourable patient outcomes in terms of HbA1c, BMI, and SBP reduction (Table 2).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites [9] D Russell-Jones, 2009, Liraglutide vs insulin glargine and placebo in combination with metformin and sulfonylurea therapy in type 2 diabetes mellitus (LEAD-5 met+SU): a randomised controlled trial, Diabetologia source
The Results > Efficacy passages report three-arm rankings for HbA1c and systolic blood pressure, and bodyweight changes consistent with the stated BMI ranking. The paper reports bodyweight change rather than BMI change, so it does not directly establish that ranking for BMI. The virtual emulations are the citing authors’ own work, not a result attributed to LEAD-5. (LLM, conf=0.82)
Experimental — accuracy not yet measured
- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
- The authors state this as an assumption: Treatment groups are exchangeable conditional on inclusion criteria, and marginal balance is sufficient to estimate the average treatment effect.
- Interpretationreasoning
By involving the causal dependencies between the data variables from NOTEARS-MLP within the WGAN-GP architecture, the model learns to simulate the true generative process underpinning the real-world data.
“By involving the causal dependencies between the data variables from NOTEARS-MLP within the WGAN-GP architecture, we learn how to simulate the true generative process underpinning the real-world data.”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [11] I Gulrajani, 2017, Improved training of Wasserstein GANs, In: Advances in Neural Information Processing Systems source
The Introduction (p. 1) identifies this paper as proposing WGAN-GP, and Section 4 (p. 4) describes its gradient-penalty method. The paper does not describe incorporating NOTEARS-MLP causal dependencies or show that WGAN-GP learns the true generative process underlying real-world data. (LLM, conf=0.86)
Experimental — accuracy not yet measured - cites [12] X Zheng, 2020, Learning sparse nonparametric DAGs., In: Proc Int Conf Artif Intell Stat source
- Findingown data
In virtual populations, GLP-1 produced a significant HbA1c reduction compared to basal insulin (difference -1.21 mmol/mol (-0.11%), p < 0.001).
“We found significant differences in HbA1c reduction for GLP-1 vs basal insulin (-1.21 mmol/mol (-0.11%); p < 0.001)”
- Also stated in: § Virtual trial emulations on LEAD-5 · plain
“our emulation model predicted GLP-1 to produce a significant HbA1c reduction compared to both basal insulin (-1.21 mmol/mol (-0.11%) difference; p < 0.001)”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
- The authors state this as an assumption: Treatment groups are exchangeable conditional on inclusion criteria, and marginal balance is sufficient to estimate the average treatment effect.
- Also stated in: § Virtual trial emulations on LEAD-5 · plain
- Findingown data
In virtual populations, GLP-1 produced a significant HbA1c reduction compared to placebo (difference -2.58 mmol/mol (-0.24%), p < 0.001).
“and GLP-1 vs placebo (-2.58 mmol/mol (-0.24%); p < 0.001) in our virtual populations”
- Also stated in: § Virtual trial emulations on LEAD-5 · plain
“and placebo (-2.58 mmol/mol (-0.24%) difference; p < 0.001)”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
- The authors state this as an assumption: Treatment groups are exchangeable conditional on inclusion criteria, and marginal balance is sufficient to estimate the average treatment effect.
- Also stated in: § Virtual trial emulations on LEAD-5 · plain
- Findingown data
In virtual trials, GLP-1 reduced BMI significantly compared to placebo (difference -0.61 kg/m2, p < 0.001).
“and placebo (-0.61 kg/m2 difference; p < 0.001)”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
- The authors state this as an assumption: Treatment groups are exchangeable conditional on inclusion criteria, and marginal balance is sufficient to estimate the average treatment effect.
- Findingown data
In virtual trials, GLP-1 produced a significantly smaller weight gain compared with glargine and placebo.
“GLP-1 produced a significantly smaller weight gain compared with glargine and placebo.”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
- The authors state this as an assumption: Treatment groups are exchangeable conditional on inclusion criteria, and marginal balance is sufficient to estimate the average treatment effect.
- Findingown data
In counterfactual experiments with real patients who did not fall into the baseline characteristics of LEAD-5, different performance rankings between the drugs were observed.
“the counterfactual experiments with real patients who did not fall into the baseline characteristics of LEAD-5 presented different performance rankings between the drugs (Table 3).”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
- Findingown data
In virtual trials, GLP-1 reduced SBP significantly more than basal insulin (difference -2.99 mmHg, p < 0.001).
“Our simulations suggest GLP-1 reduces SBP significantly more than basal insulin (-2.99 mmHg difference; p < 0.001)”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
- The authors state this as an assumption: Treatment groups are exchangeable conditional on inclusion criteria, and marginal balance is sufficient to estimate the average treatment effect.
- Findingown data
Amongst patients who received basal insulin in practice, simulations revealed GLP-1 to be significantly less effective than basal insulin for reducing HbA1c (GLP-1 vs insulin: +1.10 mmol/mol difference; p < 0.001).
“patients belonging to the real basal insulin group (Table 3, Insulin column) benefit more from both placebo (GLP-1 vs placebo: + 0.10 mmol/mol difference) and basal insulin (GLP-1 vs insulin: + 1.10 mmol/mol difference; p < 0.001) than GLP-1, in terms of lower HbA1c”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
- Findingown data
When treating SCI-Diabetes patients belonging to the GLP-1 group with basal insulin, GLP-1 is significantly less effective for HbA1c reduction (GLP-1 vs insulin: +0.64 mmol/mol difference; p < 0.001).
“when we treat SCI-Diabetes patients belonging to the GLP-1 group with basal insulin (Table 3, GLP-1 column), we find that GLP-1 is significantly less effective for HbA1c reduction (GLP-1 vs insulin: + 0.64 mmol/mol difference; p < 0.001)”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
- Findingown data
In virtual trials, GLP-1 reduced SBP significantly more than placebo (difference -2.38 mmHg, p < 0.001).
“and with GLP-1 vs placebo (-2.38 mmHg difference; p < 0.001)”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
- The authors state this as an assumption: Treatment groups are exchangeable conditional on inclusion criteria, and marginal balance is sufficient to estimate the average treatment effect.
- Findingown data
In virtual trials, GLP-1 reduced BMI significantly compared to basal insulin (difference -0.79 kg/m2, p < 0.001).
“GLP-1 reduced BMI significantly compared to both basal insulin (-0.79 kg/m2 difference; p < 0.001)”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
- The authors state this as an assumption: Treatment groups are exchangeable conditional on inclusion criteria, and marginal balance is sufficient to estimate the average treatment effect.
- Findingown data
The marginal distributions of key clinical variables remained stable after excluding incomplete records.
“we verified that the marginal distributions of key clinical variables remained stable after excluding incomplete records”
Quote in the paperSubstantial claim - Findingown data
There are statistically significant differences between the SCI-Diabetes and LEAD-5 features.
“recall the statistically significant differences between the SCI-Diabetes and LEAD-5 features (Table 1)”
Quote in the paperSubstantial claim - Findingreasoning
Coupling constraint tightening with learning rate restart significantly improved the convergence of the model toward valid causal graphs.
“This coupling of constraint tightening and learning rate restart was found to significantly improve the convergence of the model toward valid causal graphs.”
Quote in the paperNot a substantial claim - Findingown data
Synthetic and real distributions for creatinine, eGFR, and urinary albumin concentration (UACR) show particularly close alignment.
“variables such as creatinine, eGFR, and urinary albumin concentration (UACR) show particularly close alignment (i.e. the synthetic and real distributions for these features overlap well, including both the peak and the distribution tails)”
Quote in the paperNot a substantial claim - Findingown data
The synthetic data replicates the central tendencies of the real-world distributions well, as reflected by low MMD scores across all variables and modest Wasserstein distances.
“Overall, the synthetic data replicates the central tendencies of the real-world distributions well, as reflected by low MMD scores across all variables and modest Wasserstein distances.”
Quote in the paperSubstantial claim - Findingown data
Synthetic data shows divergence from real data in variables with greater biological variability, such as HbA1c, BMI, and blood pressure (SBP/DBP), appearing more sharply peaked and less dispersed.
“However, some divergence is observed in variables with greater biological variability, such as HbA1c, BMI, and blood pressure (SBP/DBP). In these cases, the synthetic data appears more sharply peaked and less dispersed than the real data, indicating an underrepresentation of the natural variation and extremes found in real populations.”
Quote in the paperNot a substantial claim - Interpretationown data
Although the effect sizes are different compared to LEAD-5, the emulation model identifies the correct ranking amongst the treatment arms for HbA1c.
“Although the effect sizes are different compared to LEAD-5, our model identifies the correct ranking amongst the treatment arms.”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
- The authors state this as an assumption: Treatment groups are exchangeable conditional on inclusion criteria, and marginal balance is sufficient to estimate the average treatment effect.
- Interpretationown data
The causal AI-powered clinical trials can emulate LEAD-5 in important measurements for T2DM.
“The causal AI-powered clinical trials can emulate LEAD-5 in important measurements for T2DM.”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
- The authors state this as an assumption: Treatment groups are exchangeable conditional on inclusion criteria, and marginal balance is sufficient to estimate the average treatment effect.
- Interpretationreasoning
The causal AI-powered trial emulation framework proposed is generalisable across therapeutic domains.
“the causal AI-powered trial emulation framework we propose is generalisable across therapeutic domains.”
Quote in the paperNot a substantial claim - Interpretationreasoning
During training, the emulation model learns to represent the causal structure as a directed acyclic graph (DAG), which maps out the treatment effect while adjusting for known confounders.
“During training, the emulation model learns to represent the causal structure as a directed acyclic graph (DAG), which maps out the treatment effect while adjusting for known confounders (i.e., common causes, such as age and medical history) that influence both treatment assignment and outcomes.”
Quote in the paperSubstantial claim - Premisecitation
The SCI-Diabetes dataset hosted on the Glasgow Safe Haven platform comprises an inclusive regional cohort of individuals with diabetes containing a broad range of longitudinal demographic, phenotypic, biochemical and screening data.
“For training, we used the SCI-Diabetes dataset hosted on the Glasgow Safe Haven platform [10], which comprises an inclusive regional cohort of individuals with diabetes containing a broad range of longitudinal demographic, phenotypic, biochemical and screening data.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [10]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Interpretationown data
Removal of missing data did not meaningfully alter the underlying population characteristics.
“suggesting that the removal of missing data did not meaningfully alter the underlying population characteristics.”
Quote in the paperSubstantial claim - Interpretationreasoning
The resulting framework allows us to generate synthetic (virtual) patients from the causal mechanisms among treatments, patient data, and known confounders to simulate the effect of treatment in a purely virtual manner.
“The resulting framework allows us to generate synthetic (virtual) patients from the causal mechanisms among treatments, patient data, and known confounders to simulate the effect of treatment in a purely virtual manner (Fig 2).”
Quote in the paperSubstantial claim - Interpretationown data
The generative model captures key renal function markers effectively.
“which suggests that the generative model captures key renal function markers effectively.”
Quote in the paperSubstantial claim - Interpretationreasoning
We should expect changes in effect size between the SCI-Diabetes patient cohorts and those satisfying the LEAD-5 criteria.
“which imply that we should expect changes in effect size between the SCI-Diabetes patient cohorts compared to those satisfying the LEAD-5 criteria.”
Quote in the paperSubstantial claim
- Classified as probably not a substantial claim. 12
- May combine two claims. 17
Probably not a substantial claim: may not pass S1 (asserted).
PremisecitationThe goal in LEAD-5 was to confirm whether liraglutide, a GLP-1 receptor agonist, caused a greater reduction in HbA1c and bodyweight compared to insulin glargine and placebo in people with T2DM.
“The goal in LEAD-5 was to confirm whether liraglutide, a glucagon-like peptide-1 (GLP-1) receptor agonist, caused a greater reduction in HbA1c and bodyweight compared to insulin glargine and placebo in people with T2DM.”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites [9] D Russell-Jones, 2009, Liraglutide vs insulin glargine and placebo in combination with metformin and sulfonylurea therapy in type 2 diabetes mellitus (LEAD-5 met+SU): a randomised controlled trial, Diabetologia source
Classified as probably not a substantial claim.
Study design and conductreasoningWe designed our emulation model to unify recent developments in machine learning-based generative modelling and causal structure (DAG) learning within a single framework.
“we designed our emulation model to unify recent developments in machine learning-based generative modelling and causal structure (DAG) learning within a single framework.”
Quote in the paperSubstantial claim2 of 2 sources checked- cites [11] I Gulrajani, 2017, Improved training of Wasserstein GANs, In: Advances in Neural Information Processing Systems source
The Introduction (p. 1) describes GAN training and proposes a gradient penalty, but it does not describe an emulation model combining generative modelling with causal structure learning. Searches for DAG and causal structure learning found no passage addressing that proposed unification; the sentence appears to describe the citing authors’ own model. (LLM, conf=0.76)
Experimental — accuracy not yet measured - cites [12] X Zheng, 2020, Learning sparse nonparametric DAGs., In: Proc Int Conf Artif Intell Stat source
The Introduction (p. 1) describes a general framework for learning DAG models, supporting the causal-structure-learning component. The cited paper does not say that this framework unifies generative modelling with DAG learning, or describe the citing authors’ emulation model. (LLM, conf=0.82)
Experimental — accuracy not yet measured
May combine two claims.
Findingown dataAmongst patients who received basal insulin in practice, simulations revealed GLP-1 to be less effective than placebo for reducing HbA1c, but the result was not significant (GLP-1 vs placebo: +0.10 mmol/mol difference; p = 0.472).
“patients belonging to the real basal insulin group (Table 3, Insulin column) benefit more from both placebo (GLP-1 vs placebo: + 0.10 mmol/mol difference) and basal insulin (GLP-1 vs insulin: + 1.10 mmol/mol difference; p < 0.001) than GLP-1, in terms of lower HbA1c, though the result with placebo is not significant (p = 0.472).”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
May combine two claims.
Findingown dataIn virtual trials, BMI increased in all treatment arms, unlike LEAD-5 where bodyweight reduced.
“BMI increased in all treatment arms, instead of reducing bodyweight as in LEAD-5.”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
- The authors state this as an assumption: Treatment groups are exchangeable conditional on inclusion criteria, and marginal balance is sufficient to estimate the average treatment effect.
May combine two claims.
Findingown dataThe SCI-Diabetes dataset contains approximately 300K individuals with diabetes, including 3K individuals with MODY recorded with certainty, and an array of variables for 56,476 unique patients with T2DM.
“There are approximately 300K individuals with diabetes, where 3K individuals with MODY (Maturity-onset diabetes of the young) are recorded with certainty (genetic information) along with records of individuals with negative genetic test results. The dataset consists of an array of variables for clinical measurements, drug prescriptions, and demographics for 56,476 unique patients with T2DM.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataWasserstein distances are slightly elevated for HbA1c (8.29) and BMI (1.57).
“This trend aligns with slightly elevated Wasserstein distances in Table S for these variables (e.g., 8.29 for HbA1c and 1.57 for BMI).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe relative ordering of treatment effects is preserved, and the synthetic data falls within plausible physiological ranges for all variables examined.
“Despite these limitations, the relative ordering of treatment effects is preserved, and the synthetic data falls within plausible physiological ranges for all variables examined.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningSampling covariates independently may overlook real-world correlations among variables, potentially undermining ecological validity.
“We acknowledge that sampling covariates independently may overlook the real-world correlations among variables, potentially undermining ecological validity.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe main finding of LEAD-5 did not translate into phenotypically diverse populations, where Liraglutide was not the most effective choice in all patient cases.
“the main finding of LEAD-5 did not translate into phenotypically diverse populations, where the key investigative drug (Liraglutide) was not the most effective choice in all patient cases.”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
May combine two claims.
Interpretationown dataThe model's predictions match the LEAD-5 conclusions for the GLP-1 and basal insulin comparison on SBP, but not between GLP-1 and placebo.
“Our model’s predictions therefore match the LEAD-5 conclusions for the GLP-1 and basal insulin comparison, but not between GLP-1 and placebo.”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
- The authors state this as an assumption: Treatment groups are exchangeable conditional on inclusion criteria, and marginal balance is sufficient to estimate the average treatment effect.
May combine two claims.
Interpretationown dataThe benefits of GLP-1 are only clear when intervening on phenotypically narrow cohorts; when conditions are relaxed, the conclusions can change.
“The benefits of GLP-1 are therefore only clear when we intervene on phenotypically narrow cohorts: when we relax these conditions (as we do here), the conclusions are free to change.”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
Classified as probably not a substantial claim.
Study design and conductreasoningOur model was designed to isolate causal effects by controlling for known covariates and enforcing d-separation in the DAG.
“Our model was designed to isolate causal effects by controlling for known covariates and enforcing d-separation in the DAG.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningThe preserved dataset is sufficient for training the structural model and conducting virtual trial emulation across the three main comparators relevant to the LEAD-5 replication.
“We therefore consider the preserved dataset sufficient for training the structural model and conducting virtual trial emulation across the three main comparators relevant to the LEAD-5 replication.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductreasoningTo match the group sizes in LEAD-5, 232 virtual patients were randomly assigned to one of three intervention groups (placebo, glargine, or GLP-1).
“To match the group sizes in LEAD-5, we randomly assigned n = 232 virtual patients to one of our three intervention groups (i.e., placebo, glargine, or GLP-1).”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductreasoningIt is not possible to replicate a completely identical cohort due to different settings between the trial and real-world clinical practice.
“it is not possible to replicate a completely identical cohort due to different settings between the trial and real-world clinical practice.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductreasoningMonitoring diagnostic metrics ensured that the model learned a plausible causal structure and generated realistic virtual patient data suitable for downstream trial emulation.
“These diagnostics ensured that the model not only learned a plausible causal structure but also generated realistic virtual patient data suitable for downstream trial emulation.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenPre- and post-treatment features were based on yearly median values, which may have obscured fine-grained treatment effects and introduced errors into the learning process.
“Our pre- and post-treatment features were based on yearly median values, which may have obscured fine-grained treatment effects and introduced errors into the learning process.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductreasoningVirtual populations were randomly assigned to one of three LEAD-5 treatment arms: placebo, basal insulin (glargine), or GLP-1 (liraglutide).
“the virtual populations were first generated according to the trial inclusion criteria of LEAD-5, and then randomly assigned to one of three LEAD-5 treatment arms: placebo, basal insulin (glargine), or GLP-1 (liraglutide).”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningRandom sampling of virtual patients eliminates confounding and prevents bias in the estimation of drug effects, enabling meaningful group comparisons.
“As with treatment assignment in an RCT, our sampling ensures that we eliminate any confounding and thus prevent bias in the estimation of the drug effects (since all virtual patients have similar conditions prior to treatment), enabling meaningful group comparisons.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe relative treatment effects were preserved, with GLP-1 showing more favourable outcomes than basal insulin and placebo, consistent with the directional findings of LEAD-5.
“the relative treatment effects were preserved, with GLP-1 showing more favourable outcomes than basal insulin and placebo, consistent with the directional findings of LEAD-5.”
Quote in the paperSubstantial claim- The authors state this as an assumption: All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
- The authors state this as an assumption: Treatment groups are exchangeable conditional on inclusion criteria, and marginal balance is sufficient to estimate the average treatment effect.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductcitationThis study (ID: GSH22DI002) was approved by the Research and Innovation Peer Review Committee and the Local Privacy Advisory Committee at NHS Greater Glasgow and Clyde, UK, together with the Safe Haven platform team that provided access to the retrospective data.
“This study (ID: GSH22DI002) was approved by the Research and Innovation Peer Review Committee and the Local Privacy Advisory Committee at NHS Greater Glasgow and Clyde, UK, together with the Safe Haven platform team that provided access to the retrospective data [10].”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [10]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
Study design and conductreasoningWe employed a causal structure learning approach to adjust for observed confounders and simulate treatment assignment under randomized conditions.
“To mitigate these, we employed a causal structure learning approach to adjust for observed confounders and simulate treatment assignment under randomized conditions.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningWe used d-separation on the DAG to identify confounders and adjust for them, mimicking the balance achieved in randomized trials.
“Using d-separation on the DAG, we identify confounders (common causes of treatment and outcome) that must be controlled.”
- Also stated in: § Background in causal learning · plain
“This adjustment mimics the balance achieved in randomized trials, making treatment and control groups comparable.”
Quote in the paperSubstantial claim- Also stated in: § Background in causal learning · plain
Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.
InterpretationreasoningOur method provides a flexible and scalable framework to explore efficacy, safety, and heterogeneity of treatment effects beyond diabetes, potentially accelerating evidence generation in a wide range of clinical areas.
“By enabling counterfactual reasoning and treatment effect estimation in synthetic populations, our method provides a flexible and scalable framework to explore efficacy, safety, and heterogeneity of treatment effects beyond diabetes, potentially accelerating evidence generation in a wide range of clinical areas.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe observed discrepancies likely stem from the model's tendency to regularise around typical values, possibly limiting its capacity to capture outlier cases.
“These discrepancies likely stem from the model’s tendency to regularise around typical values, possibly limiting its capacity to capture outlier cases.”
Quote in the paperNot a substantial claim
The authors state this as an assumption.
All relevant confounders have been measured (causal sufficiency), and no hidden confounding applies to the model training phase.
“Our emulation assumes causal sufficiency, where all relevant confounders have been measured.”
“we acknowledge that the assumption of no hidden confounding applies to the model training phase, where causal structure and parameters are learned from observational data.”
The authors state this as an assumption.
Treatment groups are exchangeable conditional on inclusion criteria, and marginal balance is sufficient to estimate the average treatment effect.
“where treatment groups are assumed to be exchangeable conditional on inclusion criteria, and marginal balance is sufficient to estimate the average treatment effect.”
The paper relies on this without support.
Proton pump inhibitors (PPIs) and statins do not directly affect glycemic outcomes such as HbA1c.
“These medications are commonly prescribed in the T2DM population but are not known to directly affect glycemic outcomes such as HbA1c.”
The authors state this as an assumption.
All drugs within each class cause similar effects to a given patient's features.
“under the assumption that all drugs within each class cause similar effects to a given patients’ features.”
The authors state this as an assumption.
Demographic variables and pre-features follow independent normal distributions.
“We assume independent normal distributions for the demographic variable and pre-features”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Virtual SBP estimate falls outside its reported 95% confidence interval
MajorFor GLP-1 versus glargine, the virtual SBP difference is −2.99 mmHg, but its reported 95% confidence interval runs from −2.62 to −1.89 mmHg and excludes that estimate.
“-2.99”
“(-2.62, -1.89)”
Counterfactual HbA1c confidence interval conflicts with significance claim
MajorFor the placebo patient group's GLP-1-versus-insulin comparison, the reported 95% confidence interval extends from −2.92 to +2.42 and includes zero, yet the same comparison is reported as p < 0.001.
“-2.67(-2.92, 2.42)”
“| GLP-1 vs insulin | 0.64(0.34, 0.94) | <0.001 | 1.10(0.83, 1.36) | <0.001 | -2.67(-2.92, 2.42) | <0.001 |”
Virtual effect sizes are described as exaggerated despite smaller reported differences
MinorThe discussion says virtual effect sizes were exaggerated in most cases, but both HbA1c comparisons shown in Table 2 are smaller in magnitude than their LEAD-5 counterparts. Both directly comparable SBP differences in the same table are also smaller in magnitude.
“The specific effect size among individual drugs was also exaggerated in most cases.”
“| GLP-1 vs glargine | -2.62 (-4.26, -0.87) | 0.0015 | -1.21 (-1.42, -1.00) | <.001 | | GLP-1 vs placebo | -11.91 (-13.99, -9.84) | <.0001 | -2.58 (-2.78, -2.37) | <.001 |”
Cites
Empagliflozin, Cardiovascular Outcomes, and Mortality in Type 2 Diabetes
Zinman, B., Wanner, C., Lachin, J. M., Fitchett, D., Bluhmki, E., Hantel, S., Mattheus, M., Devins, T., Johansen, O. E., Woerle, H. J., et al. (2015) · New England Journal of Medicine · doi:10.1056/nejmoa1504720 · Cited by 12,315 · see citing works
Liraglutide and Cardiovascular Outcomes in Type 2 Diabetes
Marso, S. P., Daniels, G. H., Brown-Frandsen, K., Kristensen, P., Mann, J. F. E., Nauck, M. A., Nissen, S. E., Pocock, S., Poulter, N. R., Ravn, L. S., et al. (2016) · New England Journal of Medicine · doi:10.1056/nejmoa1603827 · Cited by 7,629 · see citing works
Semaglutide and Cardiovascular Outcomes in Patients with Type 2 Diabetes
Marso, S. P., Bain, S. C., Consoli, A., Eliaschewitz, F. G., Jódar, E., Leiter, L. A., Lingvay, I., Rosenstock, J., Seufert, J., Warren, M. L., et al. (2016) · New England Journal of Medicine · doi:10.1056/nejmoa1607141 · Cited by 6,900 · see citing works
Improved training of Wasserstein GANs
Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., & Courville, A. (2017) · arXiv · doi:10.48550/arxiv.1704.00028 · Cited by 6,800 · see citing works
Using Big Data to Emulate a Target Trial When a Randomized Trial Is Not Available: Table 1.
Hernán, M. A., & Robins, J. M. (2016) · American Journal of Epidemiology · doi:10.1093/aje/kwv254 · Cited by 3,115 · see citing works
Causality: models, reasoning, and inference
(2000) · Choice Reviews Online · doi:10.5860/choice.38-1494a · Cited by 2,969 · see citing works
Semiparametric Difference-in-Differences Estimators
Abadie, A. (2005) · The Review of Economic Studies · doi:10.1111/0034-6527.00321 · Cited by 2,286 · see citing works
Evidence-Based Public Health: Moving Beyond Randomized Trials
Victora, C. G., Habicht, J.-P., & Bryce, J. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.400 · Cited by 1,056 · see citing works
on behalf of the Liraglutide Effect and Action in Diabetes 5 (LEAD-5) met+SU Study Group, Russell-Jones, D., Vaag, A., Schmitz, O., Sethi, B. K., Lalic, N., Antic, S., Zdravkovic, M., Ravn, G. M., & Simó, R. (2009) · Diabetologia · doi:10.1007/s00125-009-1472-y · Cited by 835 · cited 3× · see citing works
“The resulting algorithm constitutes our trial emulation model, and we demonstrate its effectiveness to perform virtual targeted trials by emulating the findings of an established RCT in diabetes research, namely, the LEAD-5 trial (Lira-glutide Effect and Action in Diabetes) [9].”
InfluentialNowakowska, M., Zghebi, S. S., Ashcroft, D. M., Buchan, I. E., Chew-Graham, C. A., Holt, T., Mallen, C. D., van Marwijk, H., Peek, N. B., Perera, R., et al. (2019) · BMC Medicine · doi:10.1186/s12916-019-1373-y · Cited by 336 · see citing works
Learning sparse nonparametric DAGs.
Zheng, X., Dan, C., Aragam, B., Ravikumar, P., & Xing, E. P. (2019) · arXiv · doi:10.48550/arxiv.1909.13189 · Cited by 103 · see citing works
Beyond RCTs: Innovations in research design and methods to advance implementation science
Schliep, M. E., Alonzo, C. N., & Morris, M. A. (2017) · Evidence-Based Communication Assessment and Intervention · doi:10.1080/17489539.2017.1394807 · Cited by 55 · see citing works
Flagged first, then by citations
3 of the 15 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- I Goodfellow, 2014, Generative adversarial nets, 27
Cited by
Sorted by citations
The skeletal connectome: From molecular circuitry to systemic network medicine
Liu, W., Liu, D., Liu, Q., & Sun, Y. (2026) · Pharmacological Reviews · doi:10.1016/j.pharmr.2026.100154
- Authors
- MacLellan, C. R., Petkov, H., McKeag, C., Dong, F., Lowe, D. J., Maguire, R., Moschoyiannis, S., Armes, J., Skene, S., Finlinson, A., & Sainsbury, C.
- Affiliations
- University of Strathclyde (GB)
- NHS Greater Glasgow and Clyde (GB)
- Queen Elizabeth University Hospital (GB)
- University of Surrey (GB)
- Corresponding author
- Dong, Feng
- ORCID
- Venue
- PLOS Digital Health
- Publisher
- Public Library of Science (PLoS)
- Published
- 2025-07-21
- Volume
- 4
- Issue
- 7
- Pages
- e0000927
- ISSN
- 2767-3170 (ISSN-L)
- PMC
- PMC12279107
- OpenAlex
- W4412530564
- Semantic Scholar
- 6165ee6e4fdb36d306ce28d5c4d4bb39a4d166c9
- Cited by
- 1
- References
- 15
- Citations by year
- 2026: 1
- FWCI
- 0.61
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLOS Digital Health (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Strathprints: The University of Strathclyde institutional repository (University of Strathclyde) (acceptedVersion)
- PubMed Central (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Medical Research Council (MR/X005925/1)
- Topics
- Health Sciences › Medicine › Endocrinology, Diabetes and Metabolism › Diabetes Treatment and Management
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Keywords
- GLP-1 receptor agonists, liraglutide, type 2 diabetes, HbA1c reduction, virtual clinical trials, generative AI, causal inference, real-world evidence, basal insulin, virtual patients
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-13.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-13.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review