Per-Protocol Analyses of Pragmatic Trials
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Pragmatic trials are designed to address real-world questions about care options. This article addresses issues that may arise from per-protocol and intention-to-treat analyses of such trials, outlines alternative analytic approaches, and provides guidance on how to choose among them.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We developed a revised risk-of-bias assessment tool to address these issues, incorporate advances in assessment of risk of bias used in other recently developed tools, 9 10 and integrate recent developments in estimation of intervention effects from randomised trials. 11”
From RoB 2: a revised tool for assessing risk of bias in randomised trials (2019) · cites this paper as [11]
In the citing paper
“For trials comparing interventions that are sustained over time, appropriate methods also require measurement of and adjustment for the values of prognostic factors, both before and after randomisation, that predict deviations from intervention. 11”
From RoB 2: a revised tool for assessing risk of bias in randomised trials (2019) · cites this paper as [11]
In the citing paper
“Each effect might be of interest. 11”
From RoB 2: a revised tool for assessing risk of bias in randomised trials (2019) · cites this paper as [11]
In the citing paper
“RoB 2 also incorporates recent developments in estimation of intervention effects from randomised trials: we distinguish bias in the effect of assignment to interventions from bias in the effect of adhering to intervention as specified in the trial protocol.”
From RoB 2: a revised tool for assessing risk of bias in randomised trials (2019) · cites this paper as [11]
Citations
Cites
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
Self-citationRobins, J. (1986) · Mathematical Modelling · doi:10.1016/0270-0255(86)90088-6 · Cited by 2,451
Self-citationRosenbaum, P. R. (2002) · Springer Series in Statistics · doi:10.1007/978-1-4757-3692-2 · Cited by 2,394
Doubly robust estimation in missing data and causal inference models
Bang, H., & Robins, J. M. (2005) · Biometrics · doi:10.1111/j.1541-0420.2005.00377.x · Cited by 1,998
Self-citationIntention-to-treat concept: A review
Gupta, S. (2011) · Perspectives in Clinical Research · doi:10.4103/2229-3485.83221 · Cited by 1,921
The prevention and treatment of missing data in clinical trials
Little, R. J., D'Agostino, R., Cohen, M. L., Dickersin, K., Emerson, S. S., Farrar, J. T., Frangakis, C., Hogan, J. W., Molenberghs, G., Murphy, S. A., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmsr1203730 · Cited by 1,884
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
An introduction to instrumental variables for epidemiologists
Greenland, S. (2000) · International Journal of Epidemiology · doi:10.1093/ije/29.4.722 · Cited by 1,156
Instruments for Causal Inference: An Epidemiologist's Dream?
Hernán, M. A., & Robins, J. M. (2006) · Epidemiology · doi:10.1097/01.ede.0000222409.00878.37 · Cited by 961
Self-citationRobins, J. M., & Finkelstein, D. M. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00779.x · Cited by 877
Self-citation
Cited by
Items 201–300 of 661
Dicken, S. J., Makaronidis, J., van Tulleken, C., Jassil, F. C., Hall, K. D., Brown, A. C., Wheeler‐Kingshott, C. A. M. G., Fisher, A., & Batterham, R. L. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-079027 · Cited by 18
“91 There is no planned interim analysis.”
Data Science Methods for Real-World Evidence Generation in Real-World Data
Liu, F. (2024) · Annual Review of Biomedical Data Science · doi:10.1146/annurev-biodatasci-102423-113220 · Cited by 16
Psoriasis Risk With Immune Checkpoint Inhibitors
To, S.-Y., Lee, C., Chen, Y., Hsu, C.-L., Yang, H.-W., Jiang, Y.-S., Wen, Y.-L., Chen, I.-W., & Kao, L.-T. (2024) · JAMA Dermatology · doi:10.1001/jamadermatol.2024.4129 · Cited by 15
Ewald, H., Speich, B., Ladanie, A., Bucher, H. C., Ioannidis, J. P. A., & Hemkens, L. G. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.11.001 · Cited by 16
Defining standard of practice: pros and cons of the usual care arm
Angriman, F., Masse, M.-H., & Adhikari, N. K. J. (2019) · Current Opinion in Critical Care · doi:10.1097/mcc.0000000000000642 · Cited by 19
Mo, Y., Lim, C., Mukaka, M., & Cooper, B. S. (2019) · Wellcome Open Research · doi:10.12688/wellcomeopenres.15636.1 · Cited by 15
Murray, E. J., Claggett, B. L., Granger, B. B., Solomon, S. D., & Hernán, M. Á. (2020) · Contemporary Clinical Trials · doi:10.1016/j.cct.2020.105937 · Cited by 16
Self-citationHan, E., Park, M., Park, S., Giap, T., & Han, D. (2020) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2020.05.011 · Cited by 16
Impact of Medication Nonadherence in a Clinical Trial of Dual Antiplatelet Therapy
Valgimigli, M., Frigoli, E., Vranckx, P., Ozaki, Y., Morice, M., Chevalier, B., Onuma, Y., Windecker, S., Delorme, L., Kala, P., et al. (2022) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2022.04.065 · Cited by 15
Excess mortality after craniopharyngioma treatment: are we making progress?
Qiao, N. (2018) · Endocrine · doi:10.1007/s12020-018-1830-y · Cited by 15
Bowles, N. I., Davies, J. N., Strohmaier, S., Galante, J., & Van Dam, N. T. (2026) · Journal of Contemplative Studies · doi:10.57010/caxs3076 · Cited by 14
Hatano, M., Sasabuchi, Y., Okada, A., Kimura, Y., Ishikura, H., Tanaka, T., Saito, T., Tanaka, S., & Yasunaga, H. (2025) · Annals of the Rheumatic Diseases · doi:10.1016/j.ard.2025.06.2124 · Cited by 15
Dai, H., Radwan, R. M., Scheiffele, G. D., Tang, H., Sheer, A., Lin, H., Zhang, P., Adirika, D., Luong, K., Bian, J., et al. (2025) · Obesity · doi:10.1002/oby.70024 · Cited by 17
Sonneville, R., Couffignal, C., Sigaud, F., Thy, M., Godard, V., Audibert, J., Contou, D., Celier, A., Djibré, M., Rambaud, T., et al. (2026) · JAMA · doi:10.1001/jama.2026.2897 · Cited by 14
Pepine, C. J., Handberg, E. M., Cooper‐DeHoff, R. M., Cook‐Wiens, G., Diniz, M., Frayne, S. M., Lo, M. C., Smith, S. M., Harris, B., Wei, J., et al. (2026) · Open Heart · doi:10.1136/openhrt-2026-004115 · Cited by 19
Lumbreras-Marquez, M. I., Singh, S., King, C. H., Nelson, C. I., Jespersen, K. N., Fields, K. G., Wang, P., Carusi, D. A., & Farber, M. K. (2022) · Journal of Gynecology Obstetrics and Human Reproduction · doi:10.1016/j.jogoh.2022.102470 · Cited by 14
Fantini, M. C., Fiorino, G., Colli, A., Laharie, D., Armuzzi, A., Caprioli, F., Gisbert, J. P., Kirchgesner, J., Macaluso, F. S., Magro, F., et al. (2024) · Journal of Crohn s and Colitis · doi:10.1093/ecco-jcc/jjae026 · Cited by 15
“48”
Jafarzadeh, S. R., Neogi, T., White, D. K., & Felson, D. T. (2022) · Arthritis & Rheumatology · doi:10.1002/art.42272 · Cited by 16
“We used the causal inference–based method of targeted learning (17,18) to estimate the effect of “following an intervention strategy” (19).”
MethodStatistical Methods for Accommodating Immortal Time: A Selective Review and Comparison
Wang, J., Peduzzi, P. N., Wininger, M., & Ma, S. (2024) · Springer eBooks · doi:10.1007/978-3-031-65937-9_3 · Cited by 22
Kuehne, F., Jahn, B., Conrads‐Frank, A., Bundo, M., Arvandi, M., Endel, F., Popper, N., Endel, G., Urach, C., Gyimesi, M., et al. (2019) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2018-0103 · Cited by 15
Detection bias and the role of negative control outcomes
Núñez, I., & Matthews, A. (2025) · BMJ Medicine · doi:10.1136/bmjmed-2025-001336 · Cited by 14
“17 When selecting an appropriate negative control outcome to assess detection bias, it must share the same unmeasured determinants of ascertainment with the outcome of interest.”
Agbla, S. C., Stavola, B. L. D., & Diaz‐Ordaz, K. (2019) · Statistical Methods in Medical Research · doi:10.1177/0962280219849613 · Cited by 15
“eatment and experiencing the outcome, the ITT provides the causal effect of being offered, rather than of receiving, the treatment. An ITT analysis with poor adherence may dilute a true treatment effect [6]. Recently, there has been an increased interest in estimating other estimands alongside the ITT, as highlighted by…”
BackgroundRochau, U., Stojkov, I., Conrads‐Frank, A., Borba, H. H. L., Koinig, K. A., Arvandi, M., van Marrewijk, C., Garelius, H. G., Germing, U., Symeonidis, A. S., et al. (2020) · British Journal of Haematology · doi:10.1111/bjh.16654 · Cited by 14
“Therefore, it is important to minimise drop-out, to collect information on informative dropout and censoring, and to consider the application of additional methods in order to correctly adjust for selection bias during follow-up, such as causal inference generalised methods (g-methods).(59) We developed the first MDS-…”
MethodA systematic review of endpoint definitions in late phase pulmonary tuberculosis therapeutic trials
Hills, N. K., Lyimo, J., Nahid, P., Savić, R. M., Lienhardt, C., & Phillips, P. P. J. (2021) · Trials · doi:10.1186/s13063-021-05388-1 · Cited by 13
“6 [5, 8]) for DS-TB trials and 10 to 12% (11 [10, 12]) for DR-TB trials.”
BackgroundSzmulewicz, A., Wanis, K. N., Perlis, R. H., Hernández–Díaz, S., Öngür, D., & Hernán, M. Á. (2022) · Biological Psychiatry · doi:10.1016/j.biopsych.2022.09.028 · Cited by 15
Self-citationComparative Effectiveness Research on Spinal versus General Anesthesia for Surgery in Older Adults
Neuman, M. D., Sieber, F. E., & Dillane, D. (2023) · Anesthesiology · doi:10.1097/aln.0000000000004604 · Cited by 18
Beta-Blockers after Myocardial Infarction and Preserved Ejection Fraction
Cleland, J. G. F., McMurray, J. J. V., & Freemantle, N. (2024) · New England Journal of Medicine · doi:10.1056/nejmc2406095 · Cited by 13
Liraglutide vs Semaglutide vs Dulaglutide in Veterans With Type 2 Diabetes
Derington, C. G., Sarwal, A., Wei, G., Hartsell, S. E., Throolin, M. J., Singh, R., Nevers, M. R., Zhang, C., Katkam, N., Takyi, A., et al. (2025) · JAMA Network Open · doi:10.1001/jamanetworkopen.2025.37297 · Cited by 13
SGLT2 Inhibitors vs GLP-1 Receptor Agonists for Kidney Outcomes in Individuals With Type 2 Diabetes
Jensen, S. K., Heide‐Jørgensen, U., Andersen, I. T., Bonnesen, K., Fu, E. L., Thomsen, R. W., & Christiansen, C. F. (2026) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2025.7409 · Cited by 13
Chiu, Y., Huybrechts, K. F., Patorno, E., Yland, J. J., Cesta, C. E., Bateman, B. T., Seely, E. W., Hernán, M. Á., & Hernández–Díaz, S. (2024) · Annals of Internal Medicine · doi:10.7326/m23-2038 · Cited by 16
“Because an intention-to-treat effect may under-estimate potential adverse effects (such as teratoge-nicity) (27, 28), our primary causal contrast of interest is the per protocol effect, that is, the effect if all persons had adhered to their assigned treatment strategy (29).”
BackgroundSelf-citationHeindel, P. V., Fitzgibbon, J. J., Secemsky, E. A., Bhatt, D. L., Al-Omran, M. A., Verma, S., AlMaghlouth, I. A., Madenci, A. L., & Hussain, M. A. (2024) · European Heart Journal Open · doi:10.1093/ehjopen/oeae062 · Cited by 13
“23 These covariates would include age at enrolment, sex, race, medical comorbidities (coronary artery disease, heart failure, cardiac arrythmia, history of MACE, CKD, chronic pulmonary disease, diabetes, hypertension), general health as quantified by the Elixhauser score, 24 gout disease severity…”
MethodClinical trial emulation in nephrology
Zoccali, C., & Tripepi, G. L. (2024) · Journal of Nephrology · doi:10.1007/s40620-024-02158-5 · Cited by 17
Four targets: an enhanced framework for guiding causal inference from observational data
Lu, H., Li, F., Lesko, C. R., Fink, D. S., Rudolph, K. E., Harhay, M. O., Rentsch, C. T., Fiellin, D. A., & Gonsalves, G. (2024) · International Journal of Epidemiology · doi:10.1093/ije/dyaf003 · Cited by 14
Zoccali, C., & Mallamaci, F. (2018) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfx374 · Cited by 14
Curi, A. C. C., Ferreira, A. P. A., Nogueira, L. A. C., Meziat‐Filho, N., & Ferreira, A. D. S. (2022) · International journal of osteopathic medicine · doi:10.1016/j.ijosm.2022.04.004 · Cited by 17
“Sensitivity analysis will be conducted under a per-protocol analysis to test for possible effects of incomplete adherence and loss to follow-up [48]; prerandomization data (age, sex, baseline functional status, time since acute COVID-19 infection, history of ICU admission) will be included as adjustments.”
Martínez‐González, M. Á., Martín‐Calvo, N., Bretos-Azcona, T., Carlos, S., & Delgado‐Rodríguez, M. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph192013653 · Cited by 12
“This approach simulated the per-protocol analysis of a pragmatic trial and we censored participants when they stopped adhering to the intended intervention [58].”
MethodChiu, Y., Rifas‐Shiman, S. L., Kleinman, K., Oken, E., & Young, J. G. (2020) · Paediatric and Perinatal Epidemiology · doi:10.1111/ppe.12646 · Cited by 15
Gragnano, F., Zwahlen, M., Vranckx, P., Heg, D., Schmidlin, K., Hamm, C. W., Steg, P. G., Gargiulo, G., McFadden, E. P., Onuma, Y., et al. (2022) · Journal of the American Heart Association · doi:10.1161/jaha.121.024291 · Cited by 13
Deng, Y., Bai, J., Yang, X., Liu, W. Y., Guo, Z., Zhang, J., Huang, R., Yang, X., Yu, C., Yu, J., et al. (2023) · European Journal of Preventive Cardiology · doi:10.1093/eurjpc/zwad142 · Cited by 12
Generalizing the per-protocol treatment effect: The case of ACTG A5095
Lu, H., Cole, S. R., Hall, H. I., Schisterman, E. F., Breger, T. L., Edwards, J. K., & Westreich, D. J. (2018) · Clinical Trials · doi:10.1177/1740774518806311 · Cited by 18
“the per-protocol comparison).(4,5) Asymptotically consistent estimates of the per-protocol effect (accounting for protocol deviations (e.”
BackgroundChoi, K. H., Kim, J., Kang, D., Doh, J., Kim, J. H., Park, Y. H., Ahn, S. G., Kim, W., Park, J. P., Kim, S.-M., et al. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-086971 · Cited by 11
“17 For the secondary outcomes, such as LVEF, N-terminal pro-brain natriuretic peptide level and quality of life per PROMIS-29, we will use linear mixed-effect models including main effects for visits (indicator terms for each visit) and visit—group interaction terms to assess differences in outcome…”
Defining and Identifying Per-protocol Effects in Randomized Trials
Rudolph, J. E., Naimi, A. I., Westreich, D. J., Kennedy, E. H., & Schisterman, E. F. (2020) · Epidemiology · doi:10.1097/ede.0000000000001234 · Cited by 14
Qiao, N., Shen, M., He, W., He, M., Zhang, Z., Ye, H., Shou, X., Wang, Y., & Zhao, Y. (2021) · Clinical Neurology and Neurosurgery · doi:10.1016/j.clineuro.2021.106781 · Cited by 11
Hedderson, M. M., Badon, S. E., Pimentel, N., Xu, F., Regenstein, A. C., Ferrara, A. M., & Neugebauer, R. S. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.5026 · Cited by 15
Randomized controlled trials in patients with COVID-19: a systematic review and critical appraisal
Kudhail, K., Thompson, J., Mathews, V., Morrison, B., & Hemming, K. (2022) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2022.05.034 · Cited by 12
Smith, L. H., García‐Albéniz, X., Chan, J. M., Zhao, S., Cowan, J. E., Broering, J. M., Cooperberg, M. R., Carroll, P. R., & Hernán, M. Á. (2022) · European Journal of Epidemiology · doi:10.1007/s10654-022-00929-7 · Cited by 16
“The data from the target trial could be used to estimate both the intention-to-treat effect and the per-protocol effect [18].”
MethodSelf-citationBerkowitz, S. A., Kruse, G. R., Ricks, K. A. B., Burch, J., Ouimet, E., Kitzis, B., Forrest, C., Terranova, J., Stewart, P. W., Buse, J. B., et al. (2022) · Contemporary Clinical Trials · doi:10.1016/j.cct.2022.107039 · Cited by 13
Schroeder, E. B., Neugebauer, R. S., Reynolds, K., Schmittdiel, J. A., Loes, L., Dyer, W., Pimentel, N., DESAI, J. R., Vazquez‐Benitez, G., Ho, P. M., et al. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.26605 · Cited by 11
Is a randomized controlled trial of waterbirth possible? An Australian feasibility study
Allen, J., Gao, Y., Dahlen, H. G., Reynolds, M., Beckmann, M. M., Cooper, C., & Kildea, S. V. (2022) · Birth · doi:10.1111/birt.12635 · Cited by 11
Mantzari, E., Ventsel, M., Ferrar, J., Pilling, M. A., Hollands, G. J., & Marteau, T. M. (2022) · Addiction · doi:10.1111/add.16005 · Cited by 11
“Pragmatic trials are often analysed according to the intention-to-treat principle [26].”
BackgroundPer‐Protocol Versus Intention‐to‐Treat in Clinical Trials: The Example of GLOBAL‐LEADERS Trial
Santos‐Gallego, C. G., Requena-Ibáñez, J. A., & Badimón, J. J. (2022) · Journal of the American Heart Association · doi:10.1161/jaha.122.025561 · Cited by 11
Exploring moderators of intervention effects of a mindfulness program for Filipino children
Galvez Tan, L. J. T., & Alampay, L. P. (2022) · International Journal of School & Educational Psychology · doi:10.1080/21683603.2020.1856741 · Cited by 10
Liu, Y., Cui, L., Wang, J., Xiao, Z., Chen, Z. X., Yan, J., Niu, C. M., & Xie, Q. (2024) · Frontiers in Neurology · doi:10.3389/fneur.2024.1453508 · Cited by 10
Instrumental Variables in Randomized Trials
Angrist, J. D., Gao, C., Hull, P., & Yeh, R. W. (2025) · NEJM Evidence · doi:10.1056/evidctw2400204 · Cited by 10
Goman, A. M., Tan, N., Pike, J. R., Bessen, S. Y., Chen, Z. (., Huang, A., Arnold, M. L., Burgard, S. L., Chisolm, T. H., Couper, D. J., et al. (2025) · The Lancet Public Health · doi:10.1016/s2468-2667(25)00088-x · Cited by 10
Frei, A. L., Radtke, T., Lana, K. D., Braun, J., Müller, R. M., & Puhan, M. A. (2019) · BMC Pulmonary Medicine · doi:10.1186/s12890-019-0817-7 · Cited by 10
Evidence-Based Diagnosis: An Introduction to Clinical Epidemiology
Newman, T. B., & Kohn, M. A. (2020) · Cited by 10
Supporting communication of visit information to informal caregivers: A systematic review
Bratches, R. W. R., Scudder, P. N., & Barr, P. J. (2021) · PLoS ONE · doi:10.1371/journal.pone.0254896 · Cited by 10
“Per-protocol analysis better reflects the effect of strict adherence to an intervention, but as a result, provides lower-quality evidence as differences observed could be due to unmeasured confounders that are no longer randomly allocated across the groups [43].”
BackgroundCheng-Lai, A., Prlesi, L., Murthy, S., Bellin, E. Y., Sinnett, M. J., & Goriacko, P. (2022) · Current Problems in Cardiology · doi:10.1016/j.cpcardiol.2022.101507 · Cited by 13
Martinuka, O., von Cube, M., Hazard, D. Y., Marateb, H. R., Mansourian, M., Sami, R., Hajian, M. R., Ebrahimi, S. H., & Wolkewitz, M. (2023) · Life · doi:10.3390/life13030777 · Cited by 11
Ribeiro, D. C., Lamb, S. E., & Abbott, J. H. (2024) · Osteoarthritis and Cartilage Open · doi:10.1016/j.ocarto.2023.100431 · Cited by 11
“By restricting the analyses on a post-randomization event (i.e., surgery), the exchangeability between arms of the trial no longer holds, and there is a risk of selection bias (Figure S1 – supplementary material, Section II) [17,19].”
MethodMethods in causal inference. Part 2: Interaction, mediation, and time-varying treatments
Bulbulia, J. A. (2024) · Evolutionary Human Sciences · doi:10.1017/ehs.2024.32 · Cited by 16
“Note that real-world experiments may fail to meet these assumptions (Bulbulia, 2024c; Hernán & Robins, 2017).”
Causal inference from experiment and observation
Zwahlen, M., & Salanti, G. (2017) · Evidence-Based Mental Health · doi:10.1136/eb-2017-102859 · Cited by 11
Edwards, J. K., Htoo, P. T., & Stürmer, T. (2019) · American Journal of Epidemiology · doi:10.1093/aje/kwz066 · Cited by 10
Virologic outcomes among adults with HIV using integrase inhibitor-based antiretroviral therapy
Lu, H., Cole, S. R., Westreich, D., Hudgens, M. G., Adimora, A. A., Althoff, K. N., Silverberg, M. J., Buchacz, K., Li, J., Edwards, J. K., et al. (2021) · AIDS · doi:10.1097/qad.0000000000003069 · Cited by 10
“Rubin’s rules were applied to pool the results across per-protocol effect of initiating and remaining on an InSTI-based regimen compared with initiating and remaining on the EFV-based regimen on the virologic outcomes [21,22].”
MethodTakeuchi, M., Ogura, M., Inagaki, N., & Kawakami, K. (2022) · BMJ Open Diabetes Research & Care · doi:10.1136/bmjdrc-2021-002636 · Cited by 12
Statistical Considerations for Embedded Pragmatic Clinical Trials in People Living with Dementia
Allore, H. G., Goldfeld, K. S., Gutman, R., Li, F., Monin, J. K., Taljaard, M., & Travison, T. G. (2020) · Journal of the American Geriatrics Society · doi:10.1111/jgs.16616 · Cited by 12
“However, when adherence is low, specialized analysis and data collection are required.(51) Important areas of further methodological research (Table 1) include development of adherence measures for PLWD and the integration of such measures in trials; addressing heterogeneity of adherence and follow-up at the participa…”
BackgroundShin, J., & Grams, M. E. (2023) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2023.07.024 · Cited by 10
Beyond pulmonary rehabilitation: can the PICk UP programme fill the gap? A randomised trial in COPD
Rebelo, P. F. S., Brooks, D., Cravo, J. P. A., Mendes, M. A., Oliveira, A., Rijo, A. S., Moura, M. J., & Marques, A. S. P. D. D. (2024) · Pulmonology · doi:10.1016/j.pulmoe.2024.04.001 · Cited by 11
Truong, B., Hornsby, L. B., Fox, B. I., Chou, C., Zheng, J., & Qian, J. (2024) · Cardiovascular Drugs and Therapy · doi:10.1007/s10557-024-07589-7 · Cited by 10
“ITT effect refers to effect of being assigned to warfarin or DOACs, regardless of whether individuals adhere to initial strategies during follow-up [52, 53].”
Kristensen, F., Christensen, D. H., Callaghan, B. C., Nielsen, J. S., Andersen, H., Sørensen, H. T., & Thomsen, R. W. (2026) · Annals of Internal Medicine · doi:10.7326/annals-25-01262 · Cited by 9
The Tripartite Intervention: Breaking Down Attitudinal Barriers in Education
Freer, J. R. R. (2021) · Journal of Disability Studies in Education · doi:10.1163/25888803-bja10006 · Cited by 9
“Hernán and Robins (2017) further explain, ‘When . . . perfect adherence is unrealistic, one may redefine the per-protocol effect as the effect under ‘satisfactory adherence’ to the protocol (e.g., 80%), rather than the effect under 100% adherence to the protocol’ (p. 1397).”
BackgroundCentral concepts for randomized controlled trials and other emerging trial designs
Heindel, P. V., Dieffenbach, B. V., Freeman, N. L. B., McGinigle, K. L., & Menard, M. T. (2022) · Seminars in Vascular Surgery · doi:10.1053/j.semvascsurg.2022.10.004 · Cited by 10
Khoirunnisa, S. M., Suryanegara, F. D. A., Setiawan, D., & Postma, M. J. (2023) · Frontiers in Pharmacology · doi:10.3389/fphar.2023.1090326 · Cited by 10
“In addition, the tool makes use of a series of signaling questions, prompting a reasonable response and simple answers and providing an algorithm to summarize the outcome of each question (Sterne et al., n.d.; Hernán and Robins, 2017).”
MethodTakeuchi, M., Shinozaki, T., & Kawakami, K. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-070417 · Cited by 11
Kjeldsted, E., Ammitzbøll, G., Jørgensen, L. B., Lodin, A., Bojesen, R. D., Ceballos, S. G., Rosthøj, S., Lænkholm, A., Skou, S. T., Jack, S., et al. (2023) · BMC Cancer · doi:10.1186/s12885-023-11284-5 · Cited by 10
“However, as this analysis might be biased due to post-randomization time-dependent confounding, a causal analysis based on inverse probability of treatment weighting [58] will be attempted.”
MethodMessmer, A. S., Pietsch, U., Siegemund, M., Buehler, P. K., Waskowski, J., Müller, M., Uehlinger, D. E., Hollinger, A., Filipovic, M., Berger, D., et al. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-074847 · Cited by 10
Baptiste, P. J., Wong, A. Y. S., Schultze, A., Clase, C. M., Leyrat, C., Williamson, E., Powell, E. M., Mann, J. F. E., Cunnington, M. C., Teo, K. K., et al. (2024) · PLoS Medicine · doi:10.1371/journal.pmed.1004465 · Cited by 12
Methods in causal inference. Part 3: measurement error and external validity threats
Bulbulia, J. A. (2024) · Evolutionary Human Sciences · doi:10.1017/ehs.2024.33 · Cited by 13
“(cid:129) Per-protocol effect – the effect of adherence to a randomly assigned treatment if adherence was perfect (Hernán & Robins 2017).”
Schnitzer, M. E., Platt, R. W., & Durand, M. (2020) · Statistics in Medicine · doi:10.1002/sim.8715 · Cited by 10
O’Brien, K. S., Arzika, A. M., Maliki, R., Amza, A., Manzo, F., Mankara, A. K., Lebas, E., Cook, C. A., Oldenburg, C. E., Porco, T. C., et al. (2021) · International Journal of Epidemiology · doi:10.1093/ije/dyab198 · Cited by 9
Webster‐Clark, M., Keil, A. P., Sanoff, H. K., Stürmer, T., Westreich, D. J., & Lund, J. L. (2021) · International Journal of Cancer · doi:10.1002/ijc.33565 · Cited by 11
Wan, E. Y. F., Xu, W., Mok, A. H. Y., Chin, W. Y., Yu, E. Y. T., Chui, C. S. L., Chan, E. W., Wong, I. C. K., Lam, C. L. K., & Danaei, G. (2024) · Diabetes Obesity and Metabolism · doi:10.1111/dom.15503 · Cited by 8
“…initiators at baseline, those who discontinued statin were censored unless they stopped the drug because of the occurrence of myopathies or liver dysfunction 17 ; for non-statin initiators at baseline, those who started taking statin were censored unless there was an indication of dyslipidaemia.”
BackgroundRyan, E., Gao, C. X., Grantham, K. L., Thảo, L. T. P., Charles‐Nelson, A., Bowden, R. A., Herschtal, A., Lee, K. J., Forbes, A. B., Heritier, S. R., et al. (2024) · International Journal of Eating Disorders · doi:10.1002/eat.24187 · Cited by 9
Jay, J. S., Pino, E. C., Georges, M. A., Courtepatte, A., Harris, J., Gause, E. L., Abaya, R., Rothman, E. F., & Goldstick, J. E. (2026) · Annals of Internal Medicine · doi:10.7326/annals-25-01678 · Cited by 10
Msellemu, D. F., Ross, A. J., Temu, L., Moshi, I. R., Hofer, L. M., Mwanziva, C. E., Kohi, Y. M., & Moore, S. (2021) · Trials · doi:10.1186/s13063-021-05801-9 · Cited by 9
“Data generated from the comparison of the intention-to-treat and per-protocol analyses [54-56] will give useful information about compliance among the troops.”
MethodThriemer, K., Degaga, T. S., Christian, M., Alam, M. S., Ley, B., Hossain, M. S., Kibria, M. G., Tego, T. T., Tadesse, D., Weston, S., et al. (2022) · Trials · doi:10.1186/s13063-022-06364-z · Cited by 8
“An analysis based on a per-protocol (PP) approach will be conducted following the causal framework presented in Hernan & Robins [9].”
MethodInfluentialReducing Bias in Estimates of Per Protocol Treatment Effects
Cole, S. R., Edwards, J. K., Zivich, P. N., Shook‐Sa, B. E., Hudgens, M. G., & Stringer, J. S. A. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.25907 · Cited by 8
Fung, T. H. M., Yim, T. W., Lois, N., Wright, D. M., Liu, S., & Williamson, T. H. (2024) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd015514.pub2 · Cited by 8
Presneill, J., Gantner, D. C., Nichol, A., McArthur, C. J., Forbes, A. B., Kasza, J., Trapani, T. V., Murray, L., Bernard, S. A., Cameron, P. A., et al. (2018) · Trials · doi:10.1186/s13063-018-2610-y · Cited by 8
“Estimation of the CACE will use an instrumental variables approach in the first instance, with a randomised arm as the instrument [42].”
MethodJackson, J. W. (2019) · American Journal of Epidemiology · doi:10.1093/aje/kwz136 · Cited by 12
Garcia, M. A., Rampon, G. L., Doros, G. D., Jia, S., Jagan, N., Gillmeyer, K. R., Berical, A. C., Hudspeth, J. C., Ieong, M. H., Modzelewski, K. L., et al. (2021) · Annals of the American Thoracic Society · doi:10.1513/annalsats.202009-1124sd · Cited by 9
Compliance-Adjusted Estimates of Aspirin Effects Among Older Persons in the ASPREE Randomized Trial
Smith, C. L., Kasza, J., Woods, R. L., Lockery, J. E., Kirpach, B., Reid, C. M., Storey, E., Nelson, M. R., Shah, R. C., Orchard, S. G., et al. (2023) · American Journal of Epidemiology · doi:10.1093/aje/kwad168 · Cited by 8
Heming, N., Berry, L. R., Lorenzi, E., Berry, S., & Angus, D. C. (2025) · Intensive Care Medicine · doi:10.1007/s00134-025-08046-1 · Cited by 8
Derington, C. G., Berchie, R. O., Scharfstein, D. O., Andrews, R. M., Greene, T. H., Xu, Y., King, J. B., Supiano, M. A., Sonnen, J. A., Williamson, J., et al. (2025) · The Journals of Gerontology, Series A: Biological Sciences and Medical Sciences · doi:10.1093/gerona/glaf028 · Cited by 8
“However, ITT analyses can be biased toward the null because they do not estimate the effect of initiating and adhering to treatment during follow-up (5).”
InfluentialCouples-based interventions and postpartum contraceptive uptake: a systematic review
Sack, D. E., Peetluk, L. S., & Audet, C. M. (2022) · Contraception · doi:10.1016/j.contraception.2022.05.001 · Cited by 7
McGee, E. E., Hernán, M. Á., Giovannucci, E. L., Mucci, L. A., Chiu, Y., Eliassen, A. H., & Dickerman, B. A. (2025) · Epidemiology · doi:10.1097/ede.0000000000001889 · Cited by 10
Self-citationThe Estimand Framework and Causal Inference: Complementary Not Competing Paradigms
Drury, T., Bartlett, J. W., Wright, D., & Keene, O. N. (2025) · Pharmaceutical Statistics · doi:10.1002/pst.70035 · Cited by 9
“[6, 59].”
Safety and Effectiveness of Statins for Primary Prevention in Adults With Type 1 Diabetes
Blais, J. E., Yan, V. K. C., Chan, E. W., Wong, I. C. K., & Wan, E. Y. F. (2025) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2025.07.013 · Cited by 7
Reimer, T., Stachs, A., Veselinovic, K., Kuehn, T., Heil, J., Polata, S., Marme, F., Trapp, E., Hildebrandt, G., Krug, D. A., et al. (2026) · npj Breast Cancer · doi:10.1038/s41523-026-00902-7 · Cited by 7
“Due to the non-inferiority study design, the key secondary end point analysis was performed on the per-protocol set 25,26 .”
Metadata
- Authors
- Hernán, M. A., & Robins, J. M.
- Affiliations
- Harvard University (US)
- ORCID
- Robins, James M.
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2017-10-05
- Volume
- 377
- Issue
- 14
- Pages
- 1391-1398
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W2764336450
- Cited by
- 660
- References
- 32
- Citations by year
- 2026: 98 · 2025: 89 · 2024: 95 · 2023: 74 · 2022: 82 · 2021: 79 · 2020: 73 · 2019: 39 · 2018: 26 · 2017: 3
- FWCI
- 26.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- pragmatic trials, per-protocol analysis, intention-to-treat analysis, real-world evidence, treatment effect estimation
- MeSH terms
- Clinical Protocols, Data Interpretation, Statistical, Humans, Patient Compliance, Research Design, Intention to Treat Analysis, Pragmatic Clinical Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.