Per-Protocol Analyses of Pragmatic Trials
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Pragmatic trials are designed to address real-world questions about care options. This article addresses issues that may arise from per-protocol and intention-to-treat analyses of such trials, outlines alternative analytic approaches, and provides guidance on how to choose among them.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We developed a revised risk-of-bias assessment tool to address these issues, incorporate advances in assessment of risk of bias used in other recently developed tools, 9 10 and integrate recent developments in estimation of intervention effects from randomised trials. 11”
From RoB 2: a revised tool for assessing risk of bias in randomised trials (2019) · cites this paper as [11]
In the citing paper
“For trials comparing interventions that are sustained over time, appropriate methods also require measurement of and adjustment for the values of prognostic factors, both before and after randomisation, that predict deviations from intervention. 11”
From RoB 2: a revised tool for assessing risk of bias in randomised trials (2019) · cites this paper as [11]
In the citing paper
“Each effect might be of interest. 11”
From RoB 2: a revised tool for assessing risk of bias in randomised trials (2019) · cites this paper as [11]
In the citing paper
“RoB 2 also incorporates recent developments in estimation of intervention effects from randomised trials: we distinguish bias in the effect of assignment to interventions from bias in the effect of adhering to intervention as specified in the trial protocol.”
From RoB 2: a revised tool for assessing risk of bias in randomised trials (2019) · cites this paper as [11]
Citations
Cites
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
Self-citationRobins, J. (1986) · Mathematical Modelling · doi:10.1016/0270-0255(86)90088-6 · Cited by 2,451
Self-citationRosenbaum, P. R. (2002) · Springer Series in Statistics · doi:10.1007/978-1-4757-3692-2 · Cited by 2,394
Doubly robust estimation in missing data and causal inference models
Bang, H., & Robins, J. M. (2005) · Biometrics · doi:10.1111/j.1541-0420.2005.00377.x · Cited by 1,998
Self-citationIntention-to-treat concept: A review
Gupta, S. (2011) · Perspectives in Clinical Research · doi:10.4103/2229-3485.83221 · Cited by 1,921
The prevention and treatment of missing data in clinical trials
Little, R. J., D'Agostino, R., Cohen, M. L., Dickersin, K., Emerson, S. S., Farrar, J. T., Frangakis, C., Hogan, J. W., Molenberghs, G., Murphy, S. A., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmsr1203730 · Cited by 1,884
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
An introduction to instrumental variables for epidemiologists
Greenland, S. (2000) · International Journal of Epidemiology · doi:10.1093/ije/29.4.722 · Cited by 1,156
Instruments for Causal Inference: An Epidemiologist's Dream?
Hernán, M. A., & Robins, J. M. (2006) · Epidemiology · doi:10.1097/01.ede.0000222409.00878.37 · Cited by 961
Self-citationRobins, J. M., & Finkelstein, D. M. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00779.x · Cited by 877
Self-citation
Cited by
Items 401–500 of 661
Ranzani, O., Pereira, A. J., dos Santos, M. C., Corrêa, T. D., Ferraz, L. J. R., Cordioli, E., Morbeck, R. A., Berwanger, O. B., de Morais, L. C., Schettino, G. D. P. P., et al. (2022) · Revista Brasileira de Terapia Intensiva · doi:10.5935/0103-507x.20220003-pt · Cited by 7
Cáceres, N. A., Yu, Q., Capaldi, J. M., Diniz, M. A., Raynor, H. A., Foster, G. D., Seitz, A. R., & Salvy, S. (2022) · Contemporary Clinical Trials · doi:10.1016/j.cct.2022.106844 · Cited by 4
Wilson, M. G., Palmer, E., Asselbergs, F. W., & Harris, S. K. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2022.104273 · Cited by 4
“Although this may be countered by an intention to treat approach to the analysis, when it comes to discerning individual treatment effects, this may not be the ideal approach [10].”
BackgroundSurgical interventions for presbyopia
Alvarado-Villacorta, R., Hernández-Quíntela, E., la Torre-González, E. D., Munarriz, C. A. L., & Martínez‐Zapata, M. J. (2023) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015711 · Cited by 3
Soo, V. P., Baker, F. A., Sousa, T. V., Odell‐Miller, H., Stensæth, K. A., Wosch, T., Bukowska, A. A., Tamplin, J., Lautenschlager, N. T., Braat, S., et al. (2023) · Trials · doi:10.1186/s13063-023-07327-8 · Cited by 4
Common misunderstandings of evidence-based medicine
Semrau, F., Aidelsburger, P., & Israel, C. W. (2023) · Herzschrittmachertherapie + Elektrophysiologie · doi:10.1007/s00399-023-00957-0 · Cited by 3
“Here, the PPA would be more helpful [7].”
Addressing the longitudinal components of surgical treatments
Messinger, C. J., Madenci, A. L., & Wanis, K. N. (2023) · European Journal of Epidemiology · doi:10.1007/s10654-023-01045-w · Cited by 3
“If adherence to both surgical and longitudinal components of treatment would be expected in actual clinical practice, investigators may consider estimating the effect under hypothetical perfect adherence (the usual per-protocol effect) [11].”
Hunkering Down or Catching Up? No Long-Term Effect of Ethnic Minority Share on Neighborhood Contacts
Dochow-Sondershaus, S. (2024) · Sociological Science · doi:10.15195/v11.a35 · Cited by 3
“I address this by using an approach designed to estimate per-protocol effects in randomized trials (Hernán and Robins 2017).”
MethodDziura, J. D., Gilstad‐Hayden, K., Coffman, C. J., Long, C. R., Yu, Q., Buta, E., Coggeshall, S. S., Geda, M. E., Peduzzi, P. N., & Kyriakides, T. C. (2024) · Pain Medicine · doi:10.1093/pm/pnae080 · Cited by 3
Fadrigon, B. H., Tseng, A., Weisenburger, R. L., Levihn‐Coon, A., McNamara, M. E., Shumake, J., Smits, J. A. J., Dennis‐Tiwary, T. A., & Beevers, C. G. (2024) · Contemporary Clinical Trials · doi:10.1016/j.cct.2024.107797 · Cited by 3
Data monitoring committees and stopping trials—Giving participants a voice
Trachtman, H., & Caplan, A. L. (2018) · Contemporary Clinical Trials · doi:10.1016/j.cct.2018.03.009 · Cited by 3
A clinician’s primer on epidemiology for COVID-19
Rashid, A., Sy, K. T. L., Cabrejas, J. M., Nichols, B. E., Bhadelia, N., & Murray, E. J. (2021) · Med · doi:10.1016/j.medj.2021.02.007 · Cited by 3
Uemura, Y., Shinozaki, T., Nomura, S., & Shibata, T. (2021) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2021.1974537 · Cited by 3
Emulating target trials of postexposure vaccines using observational data
Boyer, C., & Lipsitch, M. (2024) · American Journal of Epidemiology · doi:10.1093/aje/kwae350 · Cited by 10
Hsu, G. G., MacKay, E., Scheuer, N., & Ramagopalan, S. V. (2021) · Immunotherapy · doi:10.2217/imt-2021-0237 · Cited by 3
Zomar, B. O., Bone, J. N., Nguyen, V., Mulpuri, K., Kelley, S. P., GHD Study Group, & Schaeffer, E. K. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-084738 · Cited by 2
“36 Observational data Those patients choosing not to enrol in the trial will still be followed up for the outcomes listed above where possible and be included as an observational cohort.”
BackgroundEnhancing knowledge of treatment effects by analysing observational data as a randomised trial
Diong, J. H. L., Kwok, W. S., & Sherrington, C. (2025) · Disability and Rehabilitation · doi:10.1080/09638288.2025.2487560 · Cited by 2
“…may be more useful to inform clinical decisions on causal effects of sustained treatments, but must account for bias before and after randomisation [27,28]. in other words, analysis by intention-to-treat provides effects of randomisation , whereas causal per-protocol analysis provides effects of…”
Nkfusai, J. F., Manga, S. M., Nulah, K. L., Ngalla, C., Ngwayu, C. N., Bongfen, M. C., Tendongfor, N., Ekane, E. G. H., & Domgue, J. F. (2025) · Gynecologic Oncology Reports · doi:10.1016/j.gore.2025.101745 · Cited by 3
Werneck, A. O., Rezende, L. F. M., & Stubbs, B. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.119633 · Cited by 2
Davila-Garcia, D. M., Falconer, T., Pratt, N. L., Natarajan, K., & Hripcsak, G. M. (2025) · Journal of Diabetes and its Complications · doi:10.1016/j.jdiacomp.2025.109114 · Cited by 2
Chemoprevention of Barrett’s Esophagus: a Systematic Review and Comprehensive Assessment of Bias
Ko, M. T., Rizwanullah, A., Jafri, Z., Fung, A., & Alexandre, L. (2025) · Diseases of the Esophagus · doi:10.1093/dote/doaf062 · Cited by 2
Piltch-Loeb, R. N., Shen, Y., Fleary, S. A., Robertson, M. M., Sahr, J. N., Penrose, K., Sanborn, J., Yadav, S., Srivastava, A., Nash, D., et al. (2025) · Journal of Medical Internet Research · doi:10.2196/79228 · Cited by 3
“The validity of an ITT effect estimate requires correct adjustment for selection bias due to differential loss to follow-up and missing outcome data [21,23,24].”
Liu, F., Schrack, J. A., Walker, K. A., Walston, J. D., Mathias, R. A., Griswold, M. E., Palta, P., Windham, B. G., & Jackson, J. W. (2025) · European Journal of Epidemiology · doi:10.1007/s10654-025-01282-1 · Cited by 2
“The effect of long-term adherence to the recommendation is a per-protocol effect [ 35 ]”
Xuan, J., Mt‐Isa, S., Latimer, N. R., Bell‐Gorrod, H., Malbecq, W., Vandormael, K., Yorke-Edwards, V., & White, I. R. (2025) · Statistical Methods in Medical Research · doi:10.1177/09622802251387456 · Cited by 4
“6 An extension to PP is to include the baseline covariates causing the ICEs in the substantive outcome model and we can obtain unbiased estimates when the ICEs are only caused by baseline confounders.”
Ong, S. W. X., Pinto, R. L., Mahar, R. K., Rishu, A. H., Davis, J. S., Fowler, R., Tong, S. Y. C., Daneman, N., Rogers, B. A., Shehabi, Y., et al. (2025) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(25)00592-4 · Cited by 2
Leão, E. I., da Rocha, A. P., Pinto, A. C. P. N., Adão, D., & Saconato, H. (2025) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd016158 · Cited by 5
Sullivan, K., Angelotti, G., Zhang, F., Kim, S., Wortham, W. K., Lindsey, M. A., Jaccard, J. J., Cloître, M., Timmer, S. G., Linkh, D. J., et al. (2026) · Trials · doi:10.1186/s13063-025-09369-6 · Cited by 2
“The PP analyses will adjust for possible condition imbalance as a result of noncompliance using either direct covariate adjustments or inverse probability treatment weighting depending on data patterning [43].”
Implementation first: lessons from the TRICORDER trial in UK primary care
Cinza‐Sanjurjo, S., & González‐Juanatey, J. R. (2026) · The Lancet · doi:10.1016/s0140-6736(25)02584-x · Cited by 2
Extension Reports in Clinical Trials
Rosselló, X., Pocock, S., Taylor, D., Bhatt, D. L., Hameed, I., Rockhold, F. W., Skoza, W. A., & Gaudino, M. F. L. (2026) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2025.12.012 · Cited by 2
How to Read Non-Inferiority Trials
Redfors, B. (2026) · European Journal of Cardio-Thoracic Surgery · doi:10.1093/ejcts/ezag082 · Cited by 2
Early intervention for high-risk smoldering multiple myeloma (SMM)
Chen, P., Jhou, H., Ho, C., Huang, H.-L., & Lee, C.-H. (2026) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015494.pub2 · Cited by 3
Fourati, A., Vergonjeanne, M., Gellé, T., & Magné, J. (2026) · European Journal of Preventive Cardiology · doi:10.1093/eurjpc/zwag267 · Cited by 2
Curtis, L. H., Arterburn, D. E., Toh, S., Guo, J. S., Hernán, M. Á., Iturralde, E., Jastreboff, A. M., Lewis, K. H., Lund, J. L., Maciejewski, M. L., et al. (2026) · Annals of Internal Medicine · doi:10.7326/annals-26-00202 · Cited by 2
Self-citationMycophenolate and azathioprine in fibrotic interstitial lung disease
Pugashetti, J. V., Jee, A. S., Yu, A. R. M., Hammoud, N., Chua, F., Yazbeck, L., Lee, C. T., Liu, G. Y., Adams, T. N., Adegunsoye, A., et al. (2026) · American Journal of Respiratory and Critical Care Medicine · doi:10.1093/ajrccm/aamag362 · Cited by 3
Ueda, P., Svanström, H., Söderling, J. K., Pazzagli, L., Wintzell, V., Eliasson, B., Hviid, A. P., & Pasternak, B. (2026) · Annals of Internal Medicine · doi:10.7326/annals-25-02096 · Cited by 2
Lv, H., & Yu, W. (2026) · Alimentary Pharmacology & Therapeutics · doi:10.1111/apt.70929 · Cited by 2
Methodology and reporting guidelines
Caffrey, A. R., Borrelli, E. P., Alamri, K., & Gatto, N. M. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-817663-4.00007-6 · Cited by 2
The estimand framework and its application in substance use disorder clinical trials: a case study
Roydhouse, J. K., Floden, L. L., Tomko, R. L., Gray, K. M., & Bell, M. L. (2021) · The American Journal of Drug and Alcohol Abuse · doi:10.1080/00952990.2021.1976199 · Cited by 2
“Importantly, ITT analyses often provide estimates of the effect of assignment and may be challenging to interpret when nonadherence is high (10).”
BackgroundDesign considerations for observational studies of drugs for advanced cancer
García‐Albéniz, X., Stattin, P. E., Westerberg, M., Weinrib, R., Sandström, P., & Vassilev, Z. P. (2023) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.5612 · Cited by 2
“which include inverse probability weighting, g-estimation of structural nested models, and the g-formula, rather than with conventional statistical methods.(5)”
MethodTawil, A. A., McGrath, S., Ristl, R., & Mansmann, U. (2024) · BMC Medical Research Methodology · doi:10.1186/s12874-024-02437-6 · Cited by 3
“However, when the experimental treatment is superior to the control, the potential benefits received by those who switched to the experimental treatment are not properly accounted for, typically resulting in an underestimation of the treatment effect [6, 7].”
Medcalf, E., Stanaway, F., Turner, R. M., Espinoza, D., & Bell, K. (2025) · Contemporary Clinical Trials · doi:10.1016/j.cct.2025.107912 · Cited by 5
Estimating the Effect of Treatment Duration Using Observational Data in Practice
van Geloven, N., Dekkers, O. M., & le Cessie, S. (2018) · Epidemiology · doi:10.1097/ede.0000000000000943 · Cited by 2
Individual Treatment Prescription Effect Estimation in a Low Compliance Setting
Rahier, T., Héliou, A., Martin, M., Renaudin, C., & Diemert, E. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3467343 · Cited by 3
“Our work however focuses on estimating the effect of the treatment prescription P on the variable Y , taking advantage of the observed treatment intake T , in the spirit of individual intention-to-treat (ITT) analysis (Montori & Guyatt, 2001; Gupta, 2011) or per-protocol effect (Hernán et al., 2017).”
BackgroundPhillips, P. P. J., & Glidden, D. V. (2021) · Springer eBooks · doi:10.1007/978-3-319-52677-5_98-1 · Cited by 2
Topical antibiotics for treating bacterial keratitis: a network meta-analysis
Ting, D. S. J., Henein, C., Bunce, C., & Qureshı, R. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015350 · Cited by 2
Holmes‐Truscott, E., Holloway, E. E., Lam, B., Baptista, S. N., Furler, J., Hagger, V. L., Skinner, T. C., & Speight, J. (2023) · Diabetic Medicine · doi:10.1111/dme.15117 · Cited by 2
Mosquera, L., Karim, M. E., & Hossain, M. B. (2023) · Journal of Statistical Research · doi:10.3329/jsr.v56i2.67467 · Cited by 2
Totton, N., Julious, S. A., Walters, S. J., & Coates, E. (2024) · Trials · doi:10.1186/s13063-024-08651-3 · Cited by 4
Whitten, D., & Went, C. (2025) · The Police Journal Theory Practice and Principles · doi:10.1177/0032258x251318212 · Cited by 2
“Hern´an and Robins (2017) discuss the risk of failing to identify signi fi cant effects by over-reliance on ITT in pragmatic trials when poor adherence to treatment condition is attributable to a factor that could be readily controlled in a clinical setting for example easily treatable side-effects.”
An Example to Illustrate Randomized Trial Estimands and Estimators
Harrison, L. J., & Brummel, S. S. (2025) · The American Statistician · doi:10.1080/00031305.2025.2468399 · Cited by 3
“An intention-to-treat analysis style corresponds to a policy to treat as randomized (Hernán et al. 2017; Hernán and Scharfstein 2018).”
de Klerk, N. D., Berben, P. B. Q., van der Ven, M., Fransen, A. F., der Jagt, M. B. V. D. H., Oei, S. G., van Laar, J. O. E. H., & van den Heuvel, E. R. (2025) · Journal of Comparative Effectiveness Research · doi:10.57264/cer-2024-0168 · Cited by 3
Er det intensjonen som teller?
Stensrud, M. J. (2019) · Tidsskrift for Den norske legeforening · doi:10.4045/tidsskr.18.0956 · Cited by 2
Practical Guide to Statistical Considerations in Clinical Trials in Surgery
de Jonge, S. W., Kaji, A. H., & Itani, K. M. F. (2022) · JAMA Surgery · doi:10.1001/jamasurg.2022.4892 · Cited by 2
Analyzing Pragmatic Trials to Inform Cost-Effectiveness Analyses
Dowdy, D. W., Thompson, R. R., Kityamuwesi, A., Crowder, R., Cattamanchi, A., Katamba, A., & Sohn, H. (2022) · Value in Health · doi:10.1016/j.jval.2022.09.2479 · Cited by 2
Aguado, J., Gutiérrez, L., Forns, J., Vila-Guilera, J., Rothman, K. J., & García‐Albéniz, X. (2024) · American Journal of Epidemiology · doi:10.1093/aje/kwae263 · Cited by 3
Ablación de fibrilación auricular tras el estudio CABANA: más allá del dogmatismo estadístico
Roca‐Luque, I., Tolosana, J. M., & Brugada, J. (2020) · Revista Española de Cardiología · doi:10.1016/j.recesp.2020.07.025 · Cited by 2
Dyspnoea in the GLOBAL LEADERS trial – Authors' reply
Jüni, P., Vranckx, P., Valgimgli, M., Serruys, P. W. J. C., & Windecker, S. (2019) · The Lancet · doi:10.1016/s0140-6736(19)30685-3 · Cited by 2
Bråten, L. C. H., & Storheim, K. (2021) · The Spine Journal · doi:10.1016/j.spinee.2021.03.034 · Cited by 2
Martínez, F. J., Anstrom, K. J., & Noth, I. (2021) · JAMA · doi:10.1001/jama.2021.11813 · Cited by 2
Scheim, D. E., & Aldous, C. M. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/9yrfp · Cited by 2
Angrist, J. D., & Hull, P. (2023) · National Bureau of Economic Research · doi:10.3386/w31443 · Cited by 3
Morán, J., Duarte, J., Alkabes-Esquenazi, L., Solervicens, P., García, F., Marcelo Arancibia, M., Díaz, F., & Ávalos, N. (2024) · medRxiv · doi:10.1101/2024.10.15.24315540 · Cited by 2
Colonoscopy versus faecal immunochemical testing in COLONPREV – Authors' reply
Castells, A., Quintero, E., & Serra‐Burriel, M. (2025) · The Lancet · doi:10.1016/s0140-6736(25)01589-2 · Cited by 2
Assessing the Benefit of Specialist Palliative Care in Oncology: Rethinking Clinical Trial Design
Hui, D., Davis, M. P., Temel, J. S., Rabideau, D. J., & Zimmermann, C. (2025) · Journal of Clinical Oncology · doi:10.1200/jco-25-02206 · Cited by 3
Unmeasured confounding with and without randomization
Htoo, P. T., & Stürmer, T. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-817663-4.00016-7 · Cited by 1
Abera, S. F., Robers, G., Kästner, A., Stentzel, U., Weitmann, K., & Hoffmann, W. (2025) · Journal of Cancer Research and Clinical Oncology · doi:10.1007/s00432-024-06057-x · Cited by 3
“In this context, it is important to determine the time period in which treat-ment strategies can be implemented to reflect local clinical practice and minimize patient heterogeneity (Hernan and Robins 2017).”
Szmulewicz, A., Martínez‐Alés, G., Logan, R. W., Joober, R., Ferrara, M., Kelly, C., Fredrikson, D. H., Thorpe, L. E., Conderino, S. E., Díaz‐Caneja, C. M., et al. (2025) · Nature Mental Health · doi:10.1038/s44220-025-00407-5 · Cited by 3
“2), 70% were male and 65.2% were white, with a median age of 24 years (IQR: 21, 28). are challenging to interpret because they are based on within-individual comparisons restricted to those who eventually use LAI therapy, an approach that requires additional assumptions for validity 11–13 .”
InfluentialSelf-citationTackling control risk problems in non-inferiority trials
White, I. R., Quartagno, M., Babiker, A. G., Turner, R., Parmar, M., & Walker, A. S. (2025) · BMJ Medicine · doi:10.1136/bmjmed-2023-000845 · Cited by 1
“7 In this article, we show how to tackle two lesser known difficulties in non-inferiority trials, with a particular focus on binary (yes/no) outcomes.”
Wong, Z. C. T., Mak, I. L., Yu, E. Y. T., Tse, E. T. Y., Chen, J. Y., Chin, W. Y., Chao, D. V. K., Tsui, W. W. S., Ha, T. K. H., Wan, E. Y. F., et al. (2025) · European Journal of Preventive Cardiology · doi:10.1093/eurjpc/zwaf480 · Cited by 1
Jackson, A. K., Tepe, K. A., Sauers‐Ford, H. S., Haines, O., Bosse, D., Mills, K., Price, Z., Huang, B., Lugo, M., Litman, S., et al. (2025) · Journal of Hospital Medicine · doi:10.1002/jhm.70213 · Cited by 1
Cardiovascular Effectiveness of Semaglutide Versus Dulaglutide in Type 2 Diabetes
Bonnesen, K., Heide‐Jørgensen, U., Christensen, D. H., Lash, T. L., Pedersen, L. H., Thomsen, R. W., Matthews, A., & Schmidt, M. (2025) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.70276 · Cited by 1
Beyond observational data: understanding anaesthesia research better with causal diagrams
Wyffels, P., Decruyenaere, A., & Wouters, P. (2026) · European Journal of Anaesthesiology · doi:10.1097/eja.0000000000002355 · Cited by 1
Russo, R. G., Siefkas, A. C., Davis, B. R., Rimm, E. B., Dahabreh, I. J., Hernán, M. Á., & Danaei, G. (2026) · American Journal of Epidemiology · doi:10.1093/aje/kwag049 · Cited by 1
Self-citationFosset, M., Pensier, J., Jung, B., Siddiqi, A., Mamdani, M. M., & Celi, L. A. (2026) · PLOS Digital Health · doi:10.1371/journal.pdig.0001621 · Cited by 2
“However, pragmatic AI trials face methodological challenges including complex statistical analysis requirements for handling time-varying confounders [48], difficulty in maintaining equipoise as algorithms update, and balancing pragmatism with sufficient measurement rigor.”
What place for pragmatic RCTs in intensive care?
Singer, M., & Vincent, J. (2026) · Critical Care · doi:10.1186/s13054-026-06242-z · Cited by 1
Zhu, J., Li, J., Richards, M., Chan, M. Y., & Tai, B. (2025) · BMC Medical Research Methodology · doi:10.1186/s12874-025-02493-6 · Cited by 2
“PP method was known to provide a biased estimator of the treatment effect when there was substantial non-compliance [39].”
Humphreys, A. B. C., Matthews, A., Young, J. C., Berglund, A., Lindahl, B., Wettermark, B., Dahabreh, I. J., Kahan, T., & Hernán, M. Á. (2025) · Annals of Epidemiology · doi:10.1016/j.annepidem.2025.06.003 · Cited by 1
“Future research may investigate the implications of different definitions of treatment assignment on the per protocol effect (effect of full adherence to the treatment strategy) [21].”
Self-citationTarget Trial Emulation: A Framework for Strengthening Causal Inference in Observational Studies
Fukasawa, T., & Shinozaki, T. (2025) · Japanese Journal of Pharmacoepidemiology/Yakuzai ekigaku · doi:10.3820/jjpe.30.e4 · Cited by 4
Hiroki, S., Fukasawa, T., Yokogawa, K., & Kawakami, K. (2025) · Journal of Medical Virology · doi:10.1002/jmv.70606 · Cited by 1
Music therapy for end-of-life care
Calvache, J. A., Collazos-Girón, D., Bolaños, I., Bradt, J., Dileo, C., & Klimek, M. (2025) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd016311 · Cited by 1
Bélan, M., Giguère-Johnson, M., Carranza‐Mamane, B., Pesant, M.-H., Ainmelk, Y., Langlois, M., Lavoie, H. B., Greenblatt, E. M., Laredo, S., Sagle, M. A., et al. (2025) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgaf660 · Cited by 4
Anand, S. T., Hau, C., Davenport, M. J., Ishani, A., Cushman, W. C., Glassman, P. A., Taylor, A. A., Lew, R. A., Ferguson, R. E., & Leatherman, S. M. (2026) · Journal of the American Heart Association · doi:10.1161/jaha.125.046142 · Cited by 1
“6 The pragmatic design allowed us to assess adherence as represented by real-world use, unlike traditional trials.”
Dawwas, G. K., Lewis, J. D., Tedla, Y. G., & Cuker, A. C. (2026) · Annals of Internal Medicine · doi:10.7326/annals-25-01408 · Cited by 1
McDermott, G. C., Solomon, D. H., Sparks, J. A., & Desai, R. J. (2026) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2026.152973 · Cited by 2
Hiu, S. K. W., Wilson, N., Wilson, K., Lin, N., Witham, M. D., Wason, J. M. S., & The M. E. T.-PREVENT Study Group (2026) · Trials · doi:10.1186/s13063-026-09708-1 · Cited by 2
“Valid estimation of PP effects requires controlling for factors that influence adherence (i.e. mediator-outcome confounders) [10, 11].”
Tailored Exercise Strategies and Mortality Among Breast Cancer Survivors
Jayasekera, J. C., Ergas, I. J., Schneider, J. D., Tian, E., Wojcik, K. M., Roh, J. M., Vo, J. B., Kushi, L. H., Wilson, O. W. A., & McGee, E. E. (2026) · JAMA Network Open · doi:10.1001/jamanetworkopen.2026.5177 · Cited by 2
Best (but oft forgotten) practices: Applying the target trial framework in nutrition research
Fridén, M., MacDonald, C. J., Tobias, D. K., Stern, D., Chiu, Y., & Ibsen, D. B. (2026) · American Journal of Clinical Nutrition · doi:10.1016/j.ajcnut.2026.101362 · Cited by 1
“Although the per-protocol approach estimates the effect of adhering to the assigned diet protocol — a joint intervention not to be conflated with the effect of treatment [28] — the intention-to-treat approach estimates the effect of assignment, regardless of adherence [27].”
Eleftheriou, D., Connon, R., Tulloh, R. M. R., Martin, N., Kučera, F., Christov, G., Kahn, R., Mossberg, M., Nordenhäll, C., Bailhache, M., et al. (2026) · EClinicalMedicine · doi:10.1016/j.eclinm.2026.104044 · Cited by 1
“…a more principled version of a standard per-protocol analysis (which introduces bias as it relies on post-randomisation exclusion of participants), 27 for rescue treatment using inverse probability of treatment weights (IPTW), censoring children when they started rescue treatment and using…”
When similar live birth rates do not mean protocol equivalence in frozen embryo transfer
Tuan, D. A. (2026) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-026-03998-9 · Cited by 1
What is the research question?
Suarez, E. A., & Setoguchi, S. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-817663-4.00017-9 · Cited by 1
Kühne, F., Rochau, U., Paracha, N., Yeh, J. M., Sabate, E. J., & Siebert, U. (2021) · Medical Decision Making · doi:10.1177/0272989x211026288 · Cited by 3
Şaylık, F., & Çınar, T. (2022) · Revista da Associação Médica Brasileira · doi:10.1590/1806-9282.20220583 · Cited by 1
Steenkamp, D., Fantasia, K. L., & Wolpert, H. A. (2023) · Endocrinology and Metabolism Clinics of North America · doi:10.1016/j.ecl.2023.07.001 · Cited by 1
Examining engagement effects in an adaptive preventive intervention for college student drinking.
Patrick, M. E., Sur, A., Arterberry, B. J., Peterson, S. J., Morrell, N., & Vock, D. M. (2023) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000845 · Cited by 1
Oba, Y., Goite, Y., Maduke, T., & Fakhouri, E. W. (2024) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015824 · Cited by 2
Yang, X., Galárraga, O., Cao, W., Lin, H., Cao, F., & Chang, C. J. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-080344 · Cited by 1
Krebs, E., Weymann, D., Ho, C., Weppler, A. M., Bosdet, I., Karsan, A., Hanna, T. P., Pollard, S., & Regier, D. A. (2025) · JCO Precision Oncology · doi:10.1200/po-24-00631 · Cited by 2
“33,41,45,47 We aligned our study design choices with the reporting of trials designed to address real-world questions about treatment options in advanced melanoma.”
InfluentialPatient Involvement and Methodological Considerations in the UGIC Endoscopy Screening Cluster Trial
Chen, Z. W., Bian, T.-Z., Zhao, Z.-Y., Chen, Y., & Cao, W.-T. (2025) · Gastroenterology · doi:10.1053/j.gastro.2025.04.029 · Cited by 1
Accommodating Asymmetric Adherence in Clinical Trial Analyses
Kennedy, J. P., Dodd, M., Read, L. L., Jamal, Z., Bal, K. K., Stables, R. H., Henderson, R. A., Evans, R., Clayton, T. C., & Kharbanda, R. K. (2025) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2025.07.018 · Cited by 1
Cancer outcome research – a European challenge Part II: Opportunities and priorities
Kalager, M., Adami, H., Dickman, P. W., Lagergren, P., & Steindorf, K. (2021) · Molecular Oncology · doi:10.1002/1878-0261.13169 · Cited by 1
Metadata
- Authors
- Hernán, M. A., & Robins, J. M.
- Affiliations
- Harvard University (US)
- ORCID
- Robins, James M.
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2017-10-05
- Volume
- 377
- Issue
- 14
- Pages
- 1391-1398
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W2764336450
- Cited by
- 660
- References
- 32
- Citations by year
- 2026: 98 · 2025: 89 · 2024: 95 · 2023: 74 · 2022: 82 · 2021: 79 · 2020: 73 · 2019: 39 · 2018: 26 · 2017: 3
- FWCI
- 26.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- pragmatic trials, per-protocol analysis, intention-to-treat analysis, real-world evidence, treatment effect estimation
- MeSH terms
- Clinical Protocols, Data Interpretation, Statistical, Humans, Patient Compliance, Research Design, Intention to Treat Analysis, Pragmatic Clinical Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.