A framework for the analysis of heterogeneity of treatment effect in patient-centered outcomes research
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Individuals vary in their response to a treatment. Understanding this heterogeneity of treatment effect is critical for evaluating how well a treatment can be expected to work for an individual or a subgroup of individuals. An overemphasis on hypothesis testing has resulted in a dichotomy of all heterogeneity of treatment effect analyses into confirmatory (hypothesis testing) and exploratory (hypothesis finding) analyses. This limited view of heterogeneity of treatment effect is inadequate for creating evidence that is useful for informing patient-centered decisions. An expanded framework for heterogeneity of treatment effect assessment is proposed. It recognizes four distinct goals of heterogeneity of treatment effect analyses: hypothesis testing, hypothesis finding, reporting subgroup effects for meta-analysis, and individual-level prediction. Accordingly, two new types of heterogeneity of treatment effect analyses are proposed: descriptive and predictive. Descriptive heterogeneity of treatment effect analyses report treatment effects for prespecified subgroups in accordance with prospectively specified analytic strategy. They need not be powered to detect heterogeneity of treatment effect. They emphasize estimation and reporting of subgroup effects rather than hypothesis testing. Sampling properties (e.g., standard error) of descriptive analysis can be characterized, thus facilitating meta-analysis of subgroup effects. Predictive heterogeneity of treatment effect analyses estimate probabilities of beneficial and adverse responses of individuals to treatments and facilitates optimal treatment decisions for different types of individuals. Procedures are also suggested to improve reliability of heterogeneity of treatment effect assessment from observational studies. Heterogeneity of treatment effect analysis should be identified as confirmatory, descriptive, exploratory, or predictive analysis. Evidence should be interpreted in a manner consistent with the analytic goal.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
Breiman, L. (2001) · Statistical Science · doi:10.1214/ss/1009213726 · Cited by 4,340
K-ras Mutations and Benefit from Cetuximab in Advanced Colorectal Cancer
Karapetis, C. S., Khambata-Ford, S., Jonker, D. J., O'Callaghan, C. J., Tu, D., Tebbutt, N. C., Simes, R. J., Chalchal, H., Shapiro, J. D., Robitaille, S., et al. (2008) · New England Journal of Medicine · doi:10.1056/nejmoa0804385 · Cited by 3,622
Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating
Steyerberg, E. W. (2019) · Statistics for Biology and Health · doi:10.1007/978-3-030-16399-0 · Cited by 3,281
A Randomized Trial of the Angiotensin-Receptor Blocker Valsartan in Chronic Heart Failure
Cohn, J. N., & Tognoni, G. (2001) · New England Journal of Medicine · doi:10.1056/nejmoa010713 · Cited by 3,108
Steyerberg, E. W. (2009) · Statistics for Biology and Health · doi:10.1007/978-0-387-77244-8 · Cited by 1,491
Statistics in Medicine — Reporting of Subgroup Analyses in Clinical Trials
Wang, R., Lagakos, S. W., Ware, J. H., Hunter, D. J., & Drazen, J. M. (2007) · New England Journal of Medicine · doi:10.1056/nejmsr077003 · Cited by 1,445 · cited 1×
“Based on recent systematic reviews, including our own, confirmatory heterogeneity of treatment effect is rare [5].”
BackgroundYusuf, S. (1991) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1991.03470010097038 · Cited by 1,014 · cited 1×
“Although much has been written about the perils of SGA, examples abound of inappropriate conduct, reporting, interpretation, and application of subgroup analytic results [2,3].”
BackgroundSubgroup analysis in randomised controlled trials: importance, indications, and interpretation
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17709-5 · Cited by 942
For objective causal inference, design trumps analysis
Rubin, D. B. (2008) · The Annals of Applied Statistics · doi:10.1214/08-aoas187 · Cited by 831
Is a subgroup effect believable? Updating criteria to evaluate the credibility of subgroup analyses
Sun, X., Briel, M., Walter, S. D., & Guyatt, G. H. (2010) · BMJ · doi:10.1136/bmj.c117 · Cited by 808
Cited by
Registries for Evaluating Patient Outcomes: A User’s Guide
(2020) · doi:10.23970/ahrqepcregistries4 · Cited by 960
Personalized evidence based medicine: predictive approaches to heterogeneous treatment effects
Kent, D. M., Steyerberg, E., & van Klaveren, D. (2018) · BMJ · doi:10.1136/bmj.k4245 · Cited by 479
The Predictive Approaches to Treatment effect Heterogeneity (PATH) statement
Kent, D. M., Paulus, J. K., van Klaveren, D., D'Agostino, R., Goodman, S., Hayward, R., Ioannidis, J. P. A., Patrick-Lake, B., Morton, S., Pencina, M., et al. (2020) · Annals of Internal Medicine · doi:10.7326/m18-3667 · Cited by 469
Self-citationTutorial in biostatistics: data‐driven subgroup identification and analysis in clinical trials
Lipkovich, I., Dmitrienko, A., & B., R. (2017) · Statistics in Medicine · doi:10.1002/sim.7064 · Cited by 291
Greenberg, M. T., & Abenavoli, R. (2017) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2016.1246632 · Cited by 255
Metadata
- Authors
- Varadhan, R., Segal, J. B., Boyd, C. M., Wu, A. W., & Weiss, C. O.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2013-08
- Volume
- 66
- Issue
- 8
- Pages
- 818-825
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2028659545
- Cited by
- 146
- References
- 13
- FWCI
- 8.03
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A framework for the analysis of heterogeneity of treatment effect in patient-centered outcomes research. https://app.cochat.ai/papers/10.1016/j.jclinepi.2013.02.009
- The paper
- Varadhan, R., Segal, J. B., Boyd, C. M., Wu, A. W., & Weiss, C. O. (2013). A framework for the analysis of heterogeneity of treatment effect in patient-centered outcomes research. Journal of Clinical Epidemiology. https://doi.org/10.1016/j.jclinepi.2013.02.009
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.