Per-Protocol Analyses of Pragmatic Trials
The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Pragmatic trials are designed to address real-world questions about care options. This article addresses issues that may arise from per-protocol and intention-to-treat analyses of such trials, outlines alternative analytic approaches, and provides guidance on how to choose among them.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We developed a revised risk-of-bias assessment tool to address these issues, incorporate advances in assessment of risk of bias used in other recently developed tools, 9 10 and integrate recent developments in estimation of intervention effects from randomised trials. 11”
From RoB 2: a revised tool for assessing risk of bias in randomised trials (2019) · cites this paper as [11]
In the citing paper
“For trials comparing interventions that are sustained over time, appropriate methods also require measurement of and adjustment for the values of prognostic factors, both before and after randomisation, that predict deviations from intervention. 11”
From RoB 2: a revised tool for assessing risk of bias in randomised trials (2019) · cites this paper as [11]
In the citing paper
“Each effect might be of interest. 11”
From RoB 2: a revised tool for assessing risk of bias in randomised trials (2019) · cites this paper as [11]
In the citing paper
“RoB 2 also incorporates recent developments in estimation of intervention effects from randomised trials: we distinguish bias in the effect of assignment to interventions from bias in the effect of adhering to intervention as specified in the trial protocol.”
From RoB 2: a revised tool for assessing risk of bias in randomised trials (2019) · cites this paper as [11]
Citations
Cites
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
Self-citationRobins, J. (1986) · Mathematical Modelling · doi:10.1016/0270-0255(86)90088-6 · Cited by 2,451
Self-citationRosenbaum, P. R. (2002) · Springer Series in Statistics · doi:10.1007/978-1-4757-3692-2 · Cited by 2,394
Doubly robust estimation in missing data and causal inference models
Bang, H., & Robins, J. M. (2005) · Biometrics · doi:10.1111/j.1541-0420.2005.00377.x · Cited by 1,998
Self-citationIntention-to-treat concept: A review
Gupta, S. (2011) · Perspectives in Clinical Research · doi:10.4103/2229-3485.83221 · Cited by 1,921
The prevention and treatment of missing data in clinical trials
Little, R. J., D'Agostino, R., Cohen, M. L., Dickersin, K., Emerson, S. S., Farrar, J. T., Frangakis, C., Hogan, J. W., Molenberghs, G., Murphy, S. A., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmsr1203730 · Cited by 1,884
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
An introduction to instrumental variables for epidemiologists
Greenland, S. (2000) · International Journal of Epidemiology · doi:10.1093/ije/29.4.722 · Cited by 1,156
Instruments for Causal Inference: An Epidemiologist's Dream?
Hernán, M. A., & Robins, J. M. (2006) · Epidemiology · doi:10.1097/01.ede.0000222409.00878.37 · Cited by 961
Self-citationRobins, J. M., & Finkelstein, D. M. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00779.x · Cited by 877
Self-citation
Cited by
Items 601–661 of 661
Dong, Y., Liu, M.-C., Mao, Y., Lu, Y.-H., Wang, A., Zhou, X. X., Ji, Y.-M., Xiao, S.-Y., Lv, Y.-H., Li, T., et al. (2026) · BMC Geriatrics · doi:10.1186/s12877-026-07248-6
“Furthermore, the observed association between the absence of prior radiotherapy and poorer survival likely reflects unmeasured confounding, such as more aggressive disease biology or patient frailty at baseline, rather than a direct causal effect of omitting radiotherapy [45, 46].”
Laserbehandlung bei komplexen Analfisteln
Ilic, L., & Riss, S. (2026) · coloproctology · doi:10.1007/s00053-026-00951-3
“%) und potenzielle Überschätzung des Therapieerfolgs in der Per-Protokoll-Analyse hinweist [3].”
Misra‐Hebert, A. D., Griebeler, M. L., Babiuch, C., Chepp, V., MASIANO, S. P., Tereshchenko, L. G., Hurwitz, H., McMahan, J. L., Scarcipino, M., Anderson, K., et al. (2026) · BMC Family Practice · doi:10.1186/s12875-026-03245-1
“We will use an inverse probability weighting approach to minimize the selection bias [17].”
Simon‐Tillaux, N. (2024) · theses.fr (ABES) · doi:10.70675/1b5d3da3z902az48edz9e84z4e450443544d
Watson Arulsingh, D. R., Ferreira, A. D. S., Kandakurti, P. K., & Patil, S. S. (2026) · Trials · doi:10.1186/s13063-026-09690-8
“Additionally, a sensitivity analysis will be performed using a per-protocol approach to assess the potential impact of incomplete adherence and loss to follow-up [35].”
Jodłowska-Siewert, E., Chen, Y., Zhang, S., Li, J., Dellavalle, R. P., Zhang, R., & Hou, J. (2026) · JMIR Diabetes · doi:10.2196/85083
“Interpretation of intent-to-treat style analysis is dependent on the subsequent treatment patterns and may not generalize to other institutions or future times [63].”
Hatano, M., Okada, A., Sasabuchi, Y., Kimura, Y., Sato, S., Ishikura, H., Tanaka, T., Saito, T., Tanaka, S., & Yasunaga, H. (2026) · Osteoporosis International · doi:10.1007/s00198-026-08026-1
“This attenuation likely reflects both the natural waning of romosozumab’s efficacy after its 12-month maximum duration and increasing exposure misclassification inherent in an intention-to-treat design, in which individuals remain classified as treated even after discontinuation or switching [31].”
Saju, R., Harwood, J. M., Tseng, C.-H., Moin, T., MANGIONE, C., Takada, S., Onufrak, S. J., & Duru, O. K. (2026) · Journal of Managed Care & Specialty Pharmacy · doi:10.18553/jmcp.2026.32.5.540
Gabel, M. J., Goswami, S., Bekena, S., Solomon, E. D., Moulder, K. L., Morris, J. C., & Mozersky, J. (2026) · Alzheimer s & Dementia · doi:10.1002/alz.71356
Liu, T., & Li, D. (2026) · Journal of Pain Research · doi:10.2147/jpr.s621107
Puhr, H. C., Borges, F. C., Monard, L., de la Fouchardière, C., Silva, J. P., Smyth, E. C., Lacombe, D., & van Laarhoven, H. W. M. (2026) · European Journal of Cancer · doi:10.1016/j.ejca.2026.116771
Zhang, G., Shi, X. H., Wang, H., Yin, X., Guo, S., & Jin, G. (2026) · Research Square · doi:10.21203/rs.3.rs-9647757/v1
Zimmerman, C. S., Pei, P., Carayannopoulos, A. G., & Petzschner, F. H. (2026) · medRxiv · doi:10.64898/2026.06.08.26355180
“As Hernán and Robins (2017) argue for the trial setting, the two figures answer different questions (Hernán and Robins 2017).”
Shander, A., & Callum, J. (2026) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000008166
Hernáez, Á., Lassale, C. M., Sandoval, V., Ros, E. S., Ortega, E., Pintó, X., Castañer, O., Martínez‐González, M. Á., Corella, D., Salas‐Salvadó, J., et al. (2026) · Lipids in Health and Disease · doi:10.1186/s12944-026-02999-y
Li, Y., Stern, D., Martínez‐González, M. Á., Yang, S., Chavarro, J. E., Manson, J. E., Rimm, E. B., Platt, R. W., & Chiu, Y. (2026) · American Journal of Clinical Nutrition · doi:10.1016/j.ajcnut.2026.101404
“The causal contrasts of interest would be the intention-to-treat effect and the effect if all individuals had adhered to the dietary strategy throughout the follow-up [17,18].”
García‐Albéniz, X., Vila-Guilera, J., Zamparini, M., Oliveres, H., Alonso-Orduña, V., Feliú, J., Montés, A. F., Martín-Richard, M., Gálvez, E., Ruiz‐Casado, A., et al. (2026) · Cancer Medicine · doi:10.1002/cam4.71950
“This model would be fitted to the data after censoring patients if and when they deviate from their assigned treatment strategy [8].”
Chan, L. S., Xu, W., Chan, E. W., & Wan, E. Y. F. (2026) · PLoS Medicine · doi:10.1371/journal.pmed.1005136 · Cited by 1
Understanding research designs
Dudukina, E., Ehrenstein, V., & Lash, T. L. (2026) · Elsevier eBooks · doi:10.1016/b978-0-443-45863-7.00012-3
Zhou, Z., Dong, X., & Ma, K. (2026) · International Journal of Gynecological Cancer · doi:10.1016/j.ijgc.2026.104837
Seguin‐Fowler, R. A., Hanson, K. L., Eldridge, G. D., Marshall, G. A., Maddock, J. E., Folta, S. C., Villarreal, D. L., & Graham, M. L. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1793324
“Secondarily, per-protocol net effects were estimated by comparing the sub-sample of CCM attendees (who attended at least one Change Club activity) to all controls (53).”
Arakaki, D., Iwata, M., & Terasawa, T. (2026) · Thrombosis Journal · doi:10.1186/s12959-026-00894-1
“Evaluation of the causal effect of sustained interventional strategies, such as IPC therapies, requires statistical adjustment for time-varying prognostic factors, using advanced analytical meth-ods, including G-methods [25].”
Different Clinical Questions Need Different Estimands
Keene, O. N., Lynggaard, H., Fletcher, C., Wright, D., & Terrill, P. (2026) · Therapeutic Innovation & Regulatory Science · doi:10.1007/s43441-026-01012-z
“Hernán and Robins [ 6] argued that randomized trials are not limited to estimating ITT effects and that restricting inference to only the treatment effect of randomisation assignment risks answering a less relevant clinical question.”
Computing assumption-lean bounds for per-protocol effects
Zivich, P. N., Edwards, J. K., Lucas, V. A., Shook‐Sa, B. E., Brookhart, M. A., & Cole, S. R. (2026) · Trials · doi:10.1186/s13063-026-09927-6
“While there are methods to weaken the assumption about the mechanism underlying non-adherence [1, 4, 10], these tend to involve more complicated algorithms for estimation, and selection bias due to unmeasured variables remains a concern.”
Causal estimation of interval-censored failure time data with a binary instrumental variable
Lou, Y., Du, M., Wang, P., & Song, X. (2026) · Test · doi:10.1007/s11749-026-01031-w
Dadakçi, Y. C. (2026) · Pain Research and Management · doi:10.1155/prm/4146674
Psychotherapy vs antidepressants in heart failure: Impact of adherence
IsHak, W. W., Hamilton, M. A., Diniz, M. A., Mirocha, J., Chernoff, R., Hedrick, R., Aronow, H. U., Darwish, T., Messineo, G., Pasini, M., et al. (2026) · Journal of Affective Disorders · doi:10.1016/j.jad.2026.122318
Gaudino, M. F. L., Sandner, S. E., Bagiella, E., Beckman, J. A., Belley‐Côté, E. P., Flather, M. D., Gregg, A. C., Hameed, I., Pocock, S., Redfors, B., et al. (2026) · Circulation · doi:10.1161/cir.0000000000001458
Neuhausser, W., Vaughan, D. A., Sakkas, D., Penzias, A. S., Anchan, R. M., Hornstein, M. D., Reeder, H. T., Barnhart, K. T., Stewart, E. A., Cedars, M. I., et al. (2026) · BMJ Open · doi:10.1136/bmjopen-2025-107903
“38 To examine whether intervention contamination during the study impacts results, we will conduct a per-protocol analysis 39 using inverse probability weighting and a contamination-adjusted intention- to-treat analysis using instrumental variable methods.”
Lithium for the prevention of suicide in US veterans: a target trial emulation
Szmulewicz, A., Gerlovin, H., Rezaee, N. J., Robb, W., Martínez‐Alés, G., Liu, H., Bossarte, R. M., Smith, E. G., Katz, I. R., Ferguson, R. E., et al. (2026) · BMJ Mental Health · doi:10.1136/bmjment-2026-302694
“25 Estimates from the intention- to-treat and per-protocol analyses are discussed in the Results section.”
Self-citationLópez‐Romero, P., Crowe, B. J., He, P., Kan‐Dobrosky, N., Sashegyi, A. I., & Siegel, J. (2026) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2026-114587
Counterfactual Medication Planning before Treatment Is Changed
Williams, N., Collins, G., Brooks, E., & Green, D. (2026) · Archives of Pharmacy Practice · doi:10.51847/qqs5hu4vv0
Core concepts in statistics and research methods. Part 8: randomised trials
Hewson, D. W., & Neuman, M. D. (2026) · BJA Education · doi:10.1016/j.bjae.2026.07.001
Kumar, R., Sharma, N., Deshmukh, A., Kulkarni, S., & Nair, A. (2026) · International Journal Of Pharmaceutical Research And Allied Sciences · doi:10.51847/bab3zplmrw
Accessibility versus efficacy: interpreting the non-inferiority trial of digital hypnotherapy in IBS
Zhang, H., Fang, Z., & Jiang, B. (2026) · Gut · doi:10.1136/gutjnl-2026-340199
The Kidney‐TIME Dose‐Response Rests on a Covariate the Trial Cannot Pin Down
Aggarwal, D., Saeed, M., & Sharma, H. (2026) · Clinical Transplantation · doi:10.1111/ctr.70665
The Pragmatic Clinical Trial—Reconciling Intention, Design, and State of Mind
Huang, A. J., Travison, T. G., & Angus, D. C. (2026) · JAMA · doi:10.1001/jama.2026.12877
Zhang, W., Cotton, C. A., & Wen, L. (2026) · American Journal of Epidemiology · doi:10.1093/aje/kwag214
“In studies where non-adherence to treatment medication is a potential issue, researchers may choose to conduct an intent-to-treat (ITT) analysis and/or a per-protocol (PP) analysis [11, 12].”
Zhang, C., Li, Y., Su, C., Shen, Y., & Lu, S. (2026) · Archives of Orthopaedic and Trauma Surgery · doi:10.1007/s00402-026-06503-0
“For the per-protocol analysis, patients were censored at protocol devia - tion and inverse probability of censoring weights (IPCW) were applied using pooled logistic regression conditional on baseline and monthly time-varying covariates [ 11, 36 ].”
Szmulewicz, A., Liang, Y.-H., Martínez‐Alés, G., O’Dea, R., Thorpe, L. E., Conderino, S. E., Rubio, J. M., Smith, K., Sarpal, D. K., Díaz‐Caneja, C. M., et al. (2026) · The Lancet Psychiatry · doi:10.1016/s2215-0366(26)00239-7
Self-citationDroitcourt, C., Barbarot, S., Visseiche, V., Maruani, A., Dinulescu, M., Darrieux, L., Misery, L., Brenaut, E., Soria, A., Vermersch, A., et al. (2026) · Dermatology and Therapy · doi:10.1007/s13555-026-01914-8
“Pragmatic trials are the best suited design for evaluating add-on therapies in the context of LTC disease management [27].”
Minglu, G., Yongchang, L., Rui, Z., Zhao, G., Liu, F., Qiaoyun, Y., & Zhou, Y. (2026) · Research Square · doi:10.21203/rs.3.rs-10752465/v1
Progesterone receptor modulators for endometriosis
Grammatis, A. L., Gibbons, T., Anucha, E., & Becker, C. M. (2026) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009881.pub3
Fridén, M., MacDonald, C. J., Hagström, H., Åkesson, A., Nielsen, S., & Ibsen, D. B. (2026) · American Journal of Clinical Nutrition · doi:10.1016/j.ajcnut.2026.101526
Interpreting Per-Protocol Efficacy Signals in a Pilot Trial of Inspiratory Muscle Training
Liu, Y. (2026) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2026.08.021
Target Trial Emulation: An Overview
Mayer, F. (2026) · Springer eBooks · doi:10.1007/978-3-032-30873-3_71
Papon, V., Jahn, B., Sroczynski, G., Litt, J., Coll‐Planas, L., Masó-Aguado, M., Arvandi, M., Santamaria, J., Kuchin, I., Puntscher, S., et al. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1891830
“To address the potential bias from drop-out, inverse probability of censoring weights (IPCW) were estimated and applied to the analyses of the intervention effects, relapse probabilities and health state utility values (HSUV) (Cole and Hernan, 2008; Hernán and Robins, 2017).”
Barbati, G., Turoldo, F., & Gregorio, C. (2026) · Springer eBooks · doi:10.1007/978-3-032-30873-3_52
Tuấn, Đ. A. (2026) · Therapeutic Innovation & Regulatory Science · doi:10.1007/s43441-026-01060-5
GLP‐1 receptor agonists and serious adverse events: Evidence, uncertainty and clinical implications
Ueda, P. (2026) · Journal of Internal Medicine · doi:10.1111/joim.70170
Yan, Y., Xu, M., Lu, S., Liang, Z., & Shen, Y. (2026) · Research Square · doi:10.21203/rs.3.rs-11029518/v1
Domingues, L. B., Schneider, V. M., Carpes, L. D. O., Fuchs, S. C. P. C., & Ferrari, R. (2026) · Frontiers in Rehabilitation Sciences · doi:10.3389/fresc.2026.1925760
Li, L., Zhang, D., Xu, M., Li, S., Shen, Y., & Lu, S. (2026) · Frontiers in Nephrology · doi:10.3389/fneph.2026.1930977
D’Souza, P., Macdowall, W. G., Burchett, H., Kwan, I., & Sutcliffe, K. (2026) · Cochrane Evidence Synthesis and Methods · doi:10.1002/cesm.70107
Quantitative Flow Ratio– vs Angiography-Guided Percutaneous Coronary Intervention
Zhang, H., Yanpu, S., Guan, C., Cui, J., Wu, X., Chen, L., Shen, C., Yang, J., Liu, X., 金元哲, et al. (2026) · JAMA Network Open · doi:10.1001/jamanetworkopen.2026.39926
Zhou, X., Liu, H., & Hua, Z. (2026) · British Journal of Anaesthesia · doi:10.1016/j.bja.2026.08.065
Muunda, E., Rao, E. J. O., Hall, D. C., Ritter, C., Ceballos, M. C., & VanLeeuwen, J. A. (2026) · Veterinary and Animal Science · doi:10.1016/j.vas.2026.100914
Luo, F., Jin, L., Zhou, S., Chen, R., Pang, M., Lin, Y., Li, Y., Su, L., Xu, X. P., Nie, S., et al. (2026) · Clinical Kidney Journal · doi:10.1093/ckj/sfag285
Nogueiras‐Álvarez, R., Roncato, R., Benić, M. S., Kapo, S. M., Potočnjak, I., & Belančić, A. (2026) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1080/14737167.2026.2754563
Redfors, B. (2026) · European Journal of Cardio-Thoracic Surgery · doi:10.1093/ejcts/ezag225
Metadata
- Authors
- Hernán, M. A., & Robins, J. M.
- Affiliations
- Harvard University (US)
- ORCID
- Robins, James M.
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2017-10-05
- Volume
- 377
- Issue
- 14
- Pages
- 1391-1398
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W2764336450
- Cited by
- 660
- References
- 32
- Citations by year
- 2026: 98 · 2025: 89 · 2024: 95 · 2023: 74 · 2022: 82 · 2021: 79 · 2020: 73 · 2019: 39 · 2018: 26 · 2017: 3
- FWCI
- 26.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- pragmatic trials, per-protocol analysis, intention-to-treat analysis, real-world evidence, treatment effect estimation
- MeSH terms
- Clinical Protocols, Data Interpretation, Statistical, Humans, Patient Compliance, Research Design, Intention to Treat Analysis, Pragmatic Clinical Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.