The Challenge of Subgroup Analyses — Reporting without Distorting
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Subgroup analyses are an important part of the analysis of a comparative clinical trial. However, they are commonly overinterpreted14 and can lead to further research that is misguided or, worse, to suboptimal patient care.Consider a randomized, clinical trial designed to determine whether a new treatment is more effective than an established treatment and assessed with a test, based on all randomized patients, of the null hypothesis that the treatments have equal efficacy, as measured in terms of the primary end point. Then, subgroup analyses are conducted to assess whether different types of patients respond differently to the new . . .
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In addition, analyses of HRQoL, IBS symptoms and stool characteristics data were performed in the subgroup of those definitely constipated subjects (n = 19), as defined on the only basis of <3 stools per week; a lower significance level (P < 0.001) was applied for judging results in this subgroup, as recommended.36”
Citations
Cites
Clopidogrel and Aspirin versus Aspirin Alone for the Prevention of Atherothrombotic Events
Bhatt, D. L., Fox, K. A. A., Hacke, W., Berger, P. B., Black, H. R., Boden, W. E., Cacoub, P., Cohen, E. A., Creager, M. A., Easton, J. D., et al. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa060989 · Cited by 2,837
Subgroup analysis and other (mis)uses of baseline data in clinical trials
Assmann, S. F., Pocock, S. J., Enos, L. E., & Kasten, L. E. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02039-0 · Cited by 1,167
Yusuf, S. (1991) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1991.03470010097038 · Cited by 1,014
Enoxaparin versus Unfractionated Heparin with Fibrinolysis for ST-Elevation Myocardial Infarction
Antman, E. M., Morrow, D. A., McCabe, C. H., Murphy, S. A., Ruda, M., Sadowski, Z., Budaj, A., López-Sendón, J. L., Guneri, S., Jiang, F., et al. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa060898 · Cited by 609
Cornell, R. G., Wolf, F. M., Bailar, J. C., & Mosteller, F. (1989) · Journal of the American Statistical Association · doi:10.2307/2289981 · Cited by 295
Yusuf, S. (1991) · JAMA · doi:10.1001/jama.266.1.93 · Cited by 129
Subgroups, treatment effects, and baseline risks: Some lessons from major cardiovascular trials
Parker, A. B., & Naylor, C. D. (2000) · American Heart Journal · doi:10.1067/mhj.2000.106610 · Cited by 61
Bailar, J. C. (1986) · Cited by 28
Cited by
Items 101–200 of 496
Predicting who will benefit from an Expert Patients Programme self-management course
Reeves, D., Kennedy, A. P., Fullwood, C., Bower, P., Gardner, C., Gately, C., Lee, V., Richardson, G. A., & Rogers, A. E. (2008) · British Journal of General Practice · doi:10.3399/bjgp08x277320 · Cited by 78
Calcium supplements and cardiovascular risk: 5 years on
Bolland, M. J., Grey, A. B., & Reid, I. R. (2013) · Therapeutic Advances in Drug Safety · doi:10.1177/2042098613499790 · Cited by 72
“This interpretation is not consistent with recommended approaches to subgroup analyses [Assmann et al. 2000; Lagakos, 2006; Yusuf et al. 1991].”
ResultPathogenesis and treatment of systemic lupus erythematosus nephritis
Davidson, A., & Aranow, C. B. (2006) · Current Opinion in Internal Medicine · doi:10.1097/01.bor.0000240356.45550.13 · Cited by 64
Prevention of Falls in Nursing Homes: Subgroup Analyses of a Randomized Fall Prevention Trial
Rapp, K., Lamb, S. E., Büchele, G., Lall, R., Lindemann, U., & Becker, C. (2008) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2008.01739.x · Cited by 63
Lee, S., Hong, M., Palmerini, T., Kim, H.-S., Valgimigli, M., Feres, F., Colombo, A., Gilard, M., Shin, D., Kim, J., et al. (2018) · JACC: Cardiovascular Interventions · doi:10.1016/j.jcin.2017.10.015 · Cited by 64
“The p value for interaction was corrected using the following formula: 1 (1–resulting p)(6), (21).”
MethodPersonalized Medicine: Four Perspectives of Tailored Medicine
Ruberg, S. J., & Shen, L. (2015) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2015.1059354 · Cited by 64
“Subgroup analysis has received ample negative or cautionary press owing to its misuse and misinterpretation (Cui et al. 2002; Lagakos 2006; Wang et al. 2007).”
BackgroundHoltby, R. M., & Razmjou, H. (2009) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2009.06.011 · Cited by 61
Raghav, K. P. S., Mahajan, S., Yao, J. C., Hobbs, B. P., Berry, D. A., Pentz, R. D., Tam, A., Hong, W. K., Ellis, L. M., Abbruzzese, J., et al. (2015) · Journal of Clinical Oncology · doi:10.1200/jco.2015.62.4148 · Cited by 59
Dupont, B. F., Lortholary, O., Ostrosky-Zeichner, L., Stucker, F., & Yeldandi, V. (2009) · Critical Care · doi:10.1186/cc8117 · Cited by 58
“In this post hoc subgroup analysis of a prospective, randomized clinical trial - conducted in line with various recommendations for post hoc analysis [31-35] - the rate of overall treatment success was higher in non-ICU patients receiving micafungin than those receiving liposomal amphotericin B.”
MethodReser, M. P., Slikboer, R., & Rossell, S. L. (2019) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867419853348 · Cited by 59
“Consideration of the methodological issues associated with systematic reviews and subgroup analysis encouraged caution regarding interpretation of the results and conclusions drawn (Bender et al., 2008; Lagakos, 2006).”
BackgroundCabassa, L. J., Stefancic, A., O’Hara, K., El-Bassel, N., Lewis-Fernández, R., Luchsinger, J. A., Gates, L., Younge, R., Wall, M., Weinstein, L., et al. (2015) · Trials · doi:10.1186/s13063-015-0902-z · Cited by 57
“Because of the exploratory nature of these analyses and the low power for identifying interactions coupled with the multiple tests that will be done, caution will be used when reporting all findings [78].”
BackgroundSmith, L. J., Kalhan, R., Wise, R. A., Sugar, E. A., Lima, J. J., Irvin, C. G., Dozor, A. J., & Holbrook, J. T. (2015) · JAMA · doi:10.1001/jama.2015.5024 · Cited by 63
“Body mass index, median (IQR)a 28 (24-35) 27 (23-34) 29 (24-35)”
InfluentialBiostatistics Primer: What a Clinician Ought to Know: Subgroup Analyses
Barraclough, H., & Govindan, R. (2010) · Journal of Thoracic Oncology · doi:10.1097/jto.0b013e3181d9009e · Cited by 57
Efficacy and Safety of Angiotensin II Receptor Blockade in Elderly Patients With Diabetes
Winkelmayer, W. C., Zhang, Z., Shahinfar, S., Cooper, M. E., Avorn, J., & Brenner, B. M. (2006) · Diabetes Care · doi:10.2337/dc06-0570 · Cited by 59
Martínez, L., Seddon, J. A., Horsburgh, C. R., Lange, C. G., Mandalakas, A. M., Martinez, L., Seddon, J. A., Liu, Q., Acuña-Villaorduña, C., Bonnet, M., et al. (2024) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(24)00083-3 · Cited by 56
Wilson, S. R., Farber, H. J., Knowles, S. B., & Lavori, P. W. (2010) · CHEST Journal · doi:10.1378/chest.10-0772 · Cited by 59
Humphreys, D. K., & Ogilvie, D. (2013) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-10-76 · Cited by 48
“reduce inequalities are less well developed and may even be misleading [33,44].”
BackgroundO'Connell, M. J., Kasprow, W. J., & Rosenheck, R. A. (2012) · Psychiatric Services · doi:10.1176/appi.ps.201000229 · Cited by 54
Facilitating Score and Causal Inference Trees for Large Observational Studies
Su, X., Kang, J., Fan, J., Levine, R. A., Yan, X., & Spirtes, P. (2012) · STARS (University of Central Florida) · Cited by 68
Bozik, M. E., Mitsumoto, H., Brooks, B. R., Rudnicki, S. A., Moore, D. H., Zhang, B., Ludolph, A., Cudkowicz, M. E., van den Berg, L. H., Mather, J., et al. (2014) · Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration · doi:10.3109/21678421.2014.943672 · Cited by 52
Li, D., Bao, Z., Li, X., & Wang, Y. (2016) · Journal of School Health · doi:10.1111/josh.12354 · Cited by 55
Hochman, J. S., & Steg, P. G. (2007) · New England Journal of Medicine · doi:10.1056/nejme078036 · Cited by 53
Individualized Multidirectional Variable Selection
Tang, X., Xue, F., & Qu, A. (2020) · Journal of the American Statistical Association · doi:10.1080/01621459.2019.1705308 · Cited by 67
“serial correlation, the proposed method is able to gain more efficiency than the model assuming independence. In subgroup analysis, to access heterogeneous covariates’ effects, the existing literature [32,11, 44,19,40,13,27] proposes adding more interaction terms under a homogeneous model setting, which relies on pre-s…”
MethodClinical Follow-Up 3 Years After Everolimus- and Paclitaxel-Eluting Stents
Caixeta, A. M., Lansky, A. J., Serruys, P. W. J. C., Hermiller, J. B., Ruygrok, P., Onuma, Y., Gordon, P. C., Yaqub, M., Miquel‐Hébert, K., Veldhof, S., et al. (2010) · JACC: Cardiovascular Interventions · doi:10.1016/j.jcin.2010.07.017 · Cited by 50
Subgroup and per-protocol analyses from the Hypertension in the Very Elderly Trial
Beckett, N., Peters, R., Leonetti, G., Duggan, J., Fagard, R., Thijs, L., Narkiewicz, K., McCormack, T., Banya, W., Fletcher, A., et al. (2014) · Journal of Hypertension · doi:10.1097/hjh.0000000000000195 · Cited by 48
“HYVET is no different in this respect [15,16].”
BackgroundSubgroup Analyses in Reporting of Phase III Clinical Trials in Solid Tumors
Zhang, S., Liang, F., Li, W., & Hu, X. (2015) · Journal of Clinical Oncology · doi:10.1200/jco.2014.59.8862 · Cited by 52
“Post hoc subgroup analyses are of particular concern because it is often unclear how many were undertaken and whether some were motivated by inspection of the data.(15,16) However, the findings from our study show that full prespecification of subgroup analyses was only performed in a minority of the trials.”
ResultFu, H., Zhou, J. J., & Faries, D. E. (2016) · Statistics in Medicine · doi:10.1002/sim.6920 · Cited by 58
Racial diversity in uterine leiomyoma clinical studies
Taran, F., Brown, H. L., & Stewart, E. A. (2009) · Fertility and Sterility · doi:10.1016/j.fertnstert.2009.08.037 · Cited by 47
Antiplatelet therapy in acute coronary syndromes: focus on ticagrelor
Rosenstein, R. S. (2010) · Journal of Blood Medicine · doi:10.2147/jbm.s9650 · Cited by 56
“The presence of heterogeneity when comparing a large number of subgroups needs to be interpreted with caution; 56 however, further studies are warranted.”
Bria, E., Gralla, R. J., Raftopoulos, H., Cuppone, F., Milella, M., Sperduti, I., Carlini, P., Terzoli, E., Cognetti, F., & Giannarelli, D. (2008) · Lung Cancer · doi:10.1016/j.lungcan.2008.05.002 · Cited by 47
Facility Volume and Survival in Nasopharyngeal Carcinoma
Yoshida, E. J., Luu, M., David, J., Kim, S., Mita, A. C., Scher, K. S., Shiao, S. L., Tighiouart, M., Lee, N. Y., Ho, A. S., et al. (2017) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2017.09.038 · Cited by 48
DiNubile, M. J., Lupinacci, R. J., Strohmaier, K. M., Sable, C. A., & Kartsonis, N. A. (2007) · Journal of Critical Care · doi:10.1016/j.jcrc.2006.11.004 · Cited by 47
Hand-carried Echocardiography by Hospitalists: A Randomized Trial
Lucas, B., Candotti, C., Margeta, B., Mba, B., Kumapley, R., Asmar, A., Franco‐Sadud, R., Baru, J. S., Acob, C., Borkowsky, S., et al. (2011) · The American Journal of Medicine · doi:10.1016/j.amjmed.2011.03.029 · Cited by 48
Bertoletti, L., Ollier, É., Duvillard, C., Delavenne, X., Beyens, M., Magalhaes, É. D., Bellet, F., Basset, T., Mismetti, P., & Laporte, S. (2016) · Pharmacological Research · doi:10.1016/j.phrs.2016.06.023 · Cited by 47
Jensen, E. A., Dysart, K., Gantz, M. G., Carper, B. A., Higgins, R. D., Keszler, M., Laughon, M. M., Poindexter, B. B., Stoll, B. J., Walsh, M. C., et al. (2017) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2017.02.003 · Cited by 44
Shu, A. D., Stedman, M. R., Polinski, J. M., Jan, S. A., Patel, M., Truppo, C., Breiner, L., Chen, Y.-Y., Weiss, T. W., & Solomon, D. H. (2009) · PubMed · Cited by 44
Carotid Endarterectomy Benefits Patients with CKD and Symptomatic High-Grade Stenosis
Mathew, A. T., Eliasziw, M., Devereaux, P. J., Merino, J. G., Barnett, H. J. M., & Garg, A. X. (2009) · Journal of the American Society of Nephrology · doi:10.1681/asn.2009030287 · Cited by 46
Altstein, L. L., & Li, G. (2013) · Biometrics · doi:10.1111/j.1541-0420.2012.01818.x · Cited by 50
“Subgroup analyses aim to estimate treatment effects within groups of the patient population distinguished by baseline characteristics and are typically auxiliary to the primary intention-to-treat analysis comparing groups defined by the randomization assignment (Lagakos, 2006; Wang et al., 2007).”
The Problem of Subgroup Analyses: An Example from a Trial on Ruptured Intracranial Aneurysms
Naggara, O. N., Raymond, J., Guilbert, F., & Altman, D. G. (2011) · American Journal of Neuroradiology · doi:10.3174/ajnr.a2442 · Cited by 45
Kubota, K., Yoshioka, H., Oshita, F., Hida, T., Yoh, K., Hayashi, H., Kato, T., Kaneda, H., Yamada, K., Tanaka, H., et al. (2017) · Journal of Clinical Oncology · doi:10.1200/jco.2017.72.7297 · Cited by 42
“Finally, subgroup analyses can generate misleading results; therefore, although trials are adequately powered for their main end points, they may not be sufficiently powered to detect differences in efficacy between subgroups as a result of multiple comparisons.(20) The current findings demonstrate this risk of failur…”
ResultGunter, L., Zhu, J., & Murphy, S. (2011) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2011.608052 · Cited by 41
Dogar, O. F., Jawad, M., Shah, S., Newell, J. N., Kanaan, M. N., Khan, M. A., & Siddiqi, K. (2013) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntt211 · Cited by 44
Outcome based subgroup analysis: a neglected concern
Hirji, K. F., & Fagerland, M. W. (2009) · Trials · doi:10.1186/1745-6215-10-33 · Cited by 41
“With a marked potential to yield unreliable assessments of the existence, direction and extent of treatment differences for a specific category of patients, the clinical message emanating from SGA is generally poorly justified, and may also foster unneeded research [1-13].”
BackgroundBarak, N., Greenway, F. L., Fujioka, K., Aronne, L. J., & Kushner, R. F. (2008) · International Journal of Obesity · doi:10.1038/ijo.2008.135 · Cited by 41
Panagiotou, O. A., Befano, B., González, P., Rodríguez, A. C., Herrero, R., Schiller, J. T., Kreimer, A. R., SCHIFFMAN, M. H., Hildesheim, A., Wilcox, A. J., et al. (2015) · BMJ · doi:10.1136/bmj.h4358 · Cited by 44
Evaluation of toceranib for treatment of apocrine gland anal sac adenocarcinoma in dogs
Heaton, C. M., Fernandes, A., Jark, P. C., & Pan, X. (2020) · Journal of Veterinary Internal Medicine · doi:10.1111/jvim.15706 · Cited by 41
“Multivariate subgroup analysis, however, can be subject to bias and statistical concerns when used in small cohorts and in retrospective analysis.(31) Our multivariate Cox hazard analysis suggests that clinical benefit from toceranib treatment was a positive prognostic factor for clinical outcome, but toceranib dosage…”
MethodAssociation of Body Mass Index With the Safety Profile of Nivolumab With or Without Ipilimumab
McQuade, J. L., Hammers, H. J., Furberg, H. F., Engert, A., André, T., Blumenschein, G. R., Tannir, N. M., Baron, A. D., Larkin, J., El-Khoueiry, A. B., et al. (2022) · JAMA Oncology · doi:10.1001/jamaoncol.2022.5409 · Cited by 41
A New Animal Model of Hemolytic Hyperbilirubinemia-Induced Bilirubin Encephalopathy (Kernicterus)
Rice, A. C., & Shapiro, S. M. (2008) · Pediatric Research · doi:10.1203/pdr.0b013e31817d9be0 · Cited by 40
Minocycline Blocks Acute Bilirubin-Induced Neurological Dysfunction in Jaundiced Gunn Rats
Geiger, A. S., Rice, A. C., & Shapiro, S. M. (2007) · Neonatology · doi:10.1159/000103740 · Cited by 41
Genetic Polymorphisms of Estrogen Receptors α and β and the Risk of Developing Prostate Cancer
Chae, Y. K., Huang, H.-Y., Strickland, P. T., Hoffman, S. C., & Helzlsouer, K. J. (2009) · PLoS ONE · doi:10.1371/journal.pone.0006523 · Cited by 45
Some Medical Inpatients With Unhealthy Alcohol Use May Benefit From Brief Intervention
Saitz, R., Palfai, T. P., Cheng, D. M., Horton, N. J., Dukes, K., Kraemer, K. L., Roberts, M. S., Guerriero, R. T., & Samet, J. H. (2009) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2009.70.426 · Cited by 39
Subgroup analysis in obstetrics clinical trials
Klebanoff, M. A. (2007) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2007.02.030 · Cited by 43
Li, R., Cooper, C., Barber, J., Rapaport, P., Griffin, M., & Livingston, G. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.07.008 · Cited by 38
“plausible range of treatment differences between subgroups (Lagakos, 2006).”
BackgroundHemila, H., & Kaprio, J. (2011) · Clinical Epidemiology · doi:10.2147/clep.s16114 · Cited by 38
“Lagakos noted that “avoiding any presentation of subgroup analysis because of their history of being overinterpreted is a steep price to pay for a problem that can be remedied by more responsible analysis and reporting”.(19) Rothwell responded to popular arguments against subgroup analysis and described situations whe…”
Swaminathan, A., Fell, D. B., Regan, A. K., WALKER, M. C., & Corsi, D. J. (2019) · The Lancet Global Health · doi:10.1016/s2214-109x(19)30458-9 · Cited by 38
Kanafani, Z. A., Kourany, W. M., Fowler, V. G., Levine, D. P., Vigliani, G. A., Campion, M., Katz, D. E., Corey, G. R., & Boucher, H. W. (2009) · European Journal of Clinical Microbiology & Infectious Diseases · doi:10.1007/s10096-009-0808-3 · Cited by 41
“First, it is a subgroup analysis, where the potential for over-interpretation exists [31].”
BackgroundInfluence of Zinc Supplementation in Acute Diarrhea Differs by the Isolated Organism
Patel, A., Dibley, M. J., Mamtani, M., Badhoniya, N., & Kulkarni, H. R. (2010) · International Journal of Pediatrics · doi:10.1155/2010/671587 · Cited by 36
“We first conducted MDR analyses to identify and characterize potential interactions among zinc supplementation and four major isolates: E. coli, Klebsiella, rotavirus, and parasites.”
MethodYip, W., Bonetti, M., Cole, B. F., Barcella, W., Wang, V., Lazar, A., & Gelber, R. D. (2016) · Clinical Trials · doi:10.1177/1740774516643297 · Cited by 36
“Traditionally, patients are divided into subgroups according to median, quartiles, or other convenient cut-points of one or more covariates of interest, and treatment comparisons are then performed within each subgroup.(1,2) Unfortunately such cut points, while convenient, do not necessarily identify clinically import…”
BackgroundSources of Safety Data and Statistical Strategies for Design and Analysis: Clinical Trials
Zink, R. C., Marchenko, O., Sanchez‐Kam, M., Ma, H., & Jiang, Q. (2018) · Therapeutic Innovation & Regulatory Science · doi:10.1177/2168479017738980 · Cited by 40
“Details on subgroup size and the number of subgroups assessed (not just reported), whether subgroups were determined pre or post hoc, multiplicity adjustments were applied, stratified randomization was used, or heterogeneity was assessed through interaction tests should be clearly described.(107,108) For multiplicity,…”
Chan, K. E., Thadhani, R., & Maddux, F. W. (2013) · Kidney International · doi:10.1038/ki.2013.152 · Cited by 35
Randomized trials are frequently fragmented in multiple secondary publications
Ebrahim, S., Montoya, L., el Din, M. K., Sohani, Z. N., Agarwal, A., Bance, S., Saquib, J., Saquib, N., & Ioannidis, J. P. A. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.05.016 · Cited by 37
Jensen, E. A., & Lorch, S. A. (2017) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2017.02.007 · Cited by 35
Losina, E., Wright, J. G., & Katz, J. N. (2012) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.k.00009 · Cited by 36
Geisler, F. H., Moghaddamjou, A., Wilson, J. R. F., & Fehlings, M. G. (2023) · Journal of Neurosurgery Spine · doi:10.3171/2022.12.spine22713 · Cited by 33
Su, X., Meneses, K., McNees, P., & Johnson, W. O. (2011) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.1111/j.1467-9876.2010.00754.x · Cited by 40
“As recommended by Lagakos (2006), it is best not to present p-values for within-subgroup comparisons, but rather to give an estimate of the magnitude of the treatment difference.”
MethodCytokine profiles of preterm neonates with fungal and bacterial sepsis
Sood, B. G., Shankaran, S., Schelonka, R. L., Saha, S., Benjamin, D. K., Sánchez, P. J., Adams-Chapman, I. S., Stoll, B. J., Thorsen, P., Skogstrand, K., et al. (2012) · Pediatric Research · doi:10.1038/pr.2012.56 · Cited by 33
A Primer on the Design, Conduct, and Interpretation of Clinical Trials
Appel, L. J. (2006) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.02850806 · Cited by 39
“Subgroup analyses are prone to false-negative and falsepositive results (13).”
BackgroundAlemayehu, D., Chen, Y., & Markatou, M. (2017) · Statistical Methods in Medical Research · doi:10.1177/0962280217710570 · Cited by 37
Hwee, J., Tait, C. A., Sung, L., Kwong, J. C., Sutradhar, R., & Pole, J. D. (2017) · British Journal of Cancer · doi:10.1038/bjc.2017.360 · Cited by 33
“We corrected for multiple testing using a Bonferroni correction that divides the P-value by the number of tests (Lagakos, 2006).”
MethodSubgroup analysis in the heterogeneous Cox model
Hu, X. J., Huang, J., Liu, L., Sun, D., & Zhao, X. (2020) · Statistics in Medicine · doi:10.1002/sim.8800 · Cited by 37
“Majorized ADMM algorithm Initialize (η(0), β(0),Y(0),u(0);w(0), v(0),Y′(0)), K(0), and (0) for m = 1, 2, · · · do Update (β(m), η(m)) using (9) Update (Y(m),u(m)) using (12) (13), and (14) Update Y′(m) using (6) Update (w(m), v(m)) using (7) Compute ũ ij using (15), and update (K (m),(m)) according to ũ ij Compute r…”
MethodMistry, D., Patel, S., Hee, S. W., Stallard, N., & Underwood, M. R. (2014) · Spine · doi:10.1097/brs.0000000000000231 · Cited by 35
Causal Rule Sets for Identifying Subgroups with Enhanced Treatment Effects
Wang, T., & Rudin, C. D. (2022) · INFORMS journal on computing · doi:10.1287/ijoc.2021.1143 · Cited by 46
Losina, E., Ranstam, J., Collins, J. E., Schnitzer, T. J., & Katz, J. N. (2015) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2015.03.011 · Cited by 32
Trastuzumab duration effects within patient prognostic subgroups in the PHARE trial
Kramar, A., Bachelot, T., Madrange, N., Pierga, J., Kerbrat, P., Espié, M., Fumoleau, P., Pauporté, I., Khayat, D., Romieu, G., et al. (2014) · Annals of Oncology · doi:10.1093/annonc/mdu177 · Cited by 31
Checklist for clinical applicability of subgroup analysis
Gil‐Sierra, M. D., Fenix-Caballero, S., Martín, L. A., Fraga‐Fuentes, M. D., Sánchéz‐Hidalgo, M., de la Lastra‐Romero, C. A., & Rey, E. J. A. D. (2019) · Journal of Clinical Pharmacy and Therapeutics · doi:10.1111/jcpt.13102 · Cited by 31
Carvalho, M. A. B. R., Martins, A. P., & Sepodes, B. M. N. (2018) · Drug Discovery Today · doi:10.1016/j.drudis.2018.12.007 · Cited by 31
Zeng, L., Yan, H., Cheng, Y., & Dibley, M. J. (2011) · International Journal of Epidemiology · doi:10.1093/ije/dyq262 · Cited by 30
Honer, W. G., Thornton, A. E., Sherwood, M., MacEwan, G. W., Ehmann, T. S., Williams, R., Kopala, L. C., Procyshyn, R. M., & Barr, A. M. (2007) · CNS Drugs · doi:10.2165/00023210-200721090-00001 · Cited by 31
Park, E., Kim, J., & Kim, S.-S. (2016) · Journal of Vocational Rehabilitation · doi:10.3233/jvr-150785 · Cited by 30
Evaluating the impact of treating the optimal subgroup
Luedtke, A. R., & van der Laan, M. J. (2017) · Statistical Methods in Medical Research · doi:10.1177/0962280217708664 · Cited by 26
“When the analysis is not prespecified, statistical significance procedures tend not to be reliable.(2,3,8) To exemplify the concerns on this issue, P Sleight shows that the strong marginal effect of aspirin for preventing myocardial infarction changes to a negative effect in two subgroups when these subgroups are”
MethodKovalchik, S. A., Varadhan, R., & Weiss, C. O. (2013) · Statistics in Medicine · doi:10.1002/sim.5881 · Cited by 33
Pelvic ultrasonography and length of stay in the ED: an observational study
Chiem, A. T., Chan, C. H., Ibrahim, D. Y., Anderson, C. L., Wu, D. S., Gilani, C. J., Mancia, Z. J., & Fox, J. C. (2014) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2014.09.006 · Cited by 28
“As we only performed 3 tests for interaction in our subgroup analysis, we did not pursue additional statistical measures to decrease the chance of a type I error [17].”
MethodGorelick, P. B. (2007) · Stroke · doi:10.1161/strokeaha.107.485250 · Cited by 29
Rygård, S. L., Holst, L. B., Wetterslev, J., Johansson, P. I., Perner, A., the TRISS trial group, & the Scandinavian Critical Care Trials Group (2016) · Acta Anaesthesiologica Scandinavica · doi:10.1111/aas.12837 · Cited by 29
“Differences in 90-day mortality in the subgroups were presented as relative risks and tested for subgroup heterogeneity of the intervention effect (test of interaction) using logistic regression.(22) We did supplementary analyses using multiple logistic regression adjusted for the stratification variables being haemat…”
MethodCredit, K., & Lehnert, M. (2023) · Journal of Geographical Systems · doi:10.1007/s10109-023-00413-0 · Cited by 35
“…splitting the sample into relevant subsets (e.g. women vs. men) and finding the difference in ATE between the two, and/or inserting an interaction term into a causal regression between the characteristics of interest and the T variable (Parker and Naylor 2000; Lagakos 2006; Imai and Ratkovic 2013).”
Factors effecting impact of Aspergillus fumigatus sensitization in cystic fibrosis
Kanthan, S. K., Bush, A., Kemp, M., & Buchdahl, R. (2007) · Pediatric Pulmonology · doi:10.1002/ppul.20656 · Cited by 27
Vardakas, K. Z., Matthaiou, D. K., & Falagas, M. E. (2009) · European Journal of Neurology · doi:10.1111/j.1468-1331.2009.02615.x · Cited by 27
“This increases the possibility that the statistically significant findings were because of this chance alone [45,46].”
BackgroundChan, K. E., Pflederer, T. A., Steele, D., Lilly, M. P., Ikizler, T. A., Maddux, F. W., & Hakim, R. M. (2011) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.02860311 · Cited by 27
“002 were recognized as statistically meaningful (26).”
Clinical Experience with Gefitinib in Indian Patients
Parikh, P., Chang, A. Y.-C., Nag, S. M., Digumarti, R., Bhattacharyya, G. S., Doval, D. C., Babu, G., Chacko, R. T., Advani, S. H., Ranade, A. A., et al. (2008) · Journal of Thoracic Oncology · doi:10.1097/jto.0b013e318168f794 · Cited by 28
“Bronchoalveolar 1 (2) 0 (0) 1 (1) Squamous cell 8 (14) 5 (25) 13 (17) Large cell 3 (5) 1 (5) 4 (5) Mixed (squamous cell and”
Effect of Attentional Focus on Sprint Performance: A Meta-Analysis
Li, D., Zhang, L., Yue, X., Memmert, D., & Zhang, Y. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19106254 · Cited by 31
“In addition to reporting whether there is a statistically significant subgroup effect (the results of the Q test) and the extent of heterogeneity within each subgroup (the results of I2), it is helpful to point out whether the subgroup effect is “quantitative” or “qualitative” [38,41,42] (In “quantitative interaction,…”
BackgroundThe making of evidence-based practice: The case of Project ALERT
Gorman, D. M., & Conde, E. (2009) · Children and Youth Services Review · doi:10.1016/j.childyouth.2009.08.018 · Cited by 26
“However, even these findings should be interpreted with caution since the application of multiple statistical tests in subgroup analyses can lead to misleading results by, among other problems, inflating the number of false positive tests (Lagakos, 2006;Wang et al., 2007).”
BackgroundPatel, S., Hee, S. W., Mistry, D., Jordan, J., Brown, S., Dritsaki, M., Ellard, D. R., Friede, T., Lamb, S. E., Lord, J., et al. (2016) · Programme Grants for Applied Research · doi:10.3310/pgfar04100 · Cited by 31
“Analysis To assess the conduct and reporting of subgroup analysis we referred to existing authoritative reviews.(56,57) Papers were assessed for:”
MethodBiccard, B. M., & Rodseth, R. N. (2009) · Anaesthesia · doi:10.1111/j.1365-2044.2009.06010.x · Cited by 25
Disparities in use of computed tomography for patients presenting with headache
Harris, B., Hwang, U., Lee, W. S., & Richardson, L. D. (2009) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2008.03.041 · Cited by 25
“As a subgroup analysis of a larger study, the findings presented here may be limited and should be interpreted in that context [20].”
ResultPatient Variability Seldom Assessed in Cost-effectiveness Studies
Lavelle, T. A., Kent, D. M., Lundquist, C. M., Thorat, T., Cohen, J. T., Wong, J. B., Olchanski, N., & Neumann, P. J. (2018) · Medical Decision Making · doi:10.1177/0272989x17746989 · Cited by 25
“many fundamental issues about the best way to conduct these analyses remain controversial and unsettled.(15,16) Some clinical trials may be underpowered to detect differences in treatment effect within subgroups, particularly for rare diseases or for illnesses with small patient populations, such as children.”
Approaches to Comparative Effectiveness Research in Multimorbid Populations
Maciejewski, M. L., & Bayliss, E. A. (2014) · Medical Care · doi:10.1097/mlr.0000000000000060 · Cited by 24
“This has several limitations(40,43,44) including lack of power and increased risk of false positives if multiple binary comparisons are made.(45,46) The second approach is to stratify based on a multidimensional construct, such as a self-reported or calculated morbidity measure.”
BackgroundTiming of colonoscopy in acute lower GI bleeding: a multicenter retrospective cohort study
Shiratori, Y., Ishii, N., Aoki, T., Kobayashi, K., Yamauchi, A., Yamada, A., Omori, J., Aoyama, T., Tominaga, N., Sato, Y., et al. (2022) · Gastrointestinal Endoscopy · doi:10.1016/j.gie.2022.07.025 · Cited by 27
Recent development on statistical methods for personalized medicine discovery
Zhao, Y., & Zeng, D. (2013) · Frontiers of Medicine · doi:10.1007/s11684-013-0245-7 · Cited by 29
“On the other hand, searching for subgroups afterwards is likely to lead to unreliable results, since most trials lack statistical power to detect subgroup effects due to insufficient sample size [15,18], and the probability of a false positive finding can be substantial [19].”
BackgroundHsieh, H.-I., Chen, P., Wong, R., Wang, J., Yang, P., & Cheng, T. (2007) · Toxicology · doi:10.1016/j.tox.2007.06.089 · Cited by 24
“Lagakos suggests a stricter criterion should be applied to avoid false positive results when multiple subgroup analyses are conducted ( Lagakos, 2006 ).”
BackgroundJanse, B., Huijsman, R., & Fabbricotti, I. N. (2014) · BMC Health Services Research · doi:10.1186/1472-6963-14-140 · Cited by 29
“However, whether this difference affected our results remains unclear, as the relatively small sample of this study did not allow for subgroup analyses [52].”
Result
Metadata
- Authors
- Lagakos, S. W.
- Affiliations
- Harvard University (US)
- Corresponding author
- Lagakos, Stephen W.
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2006-04-20
- Volume
- 354
- Issue
- 16
- Pages
- 1667-1669
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- OpenAlex
- W2085477178
- Semantic Scholar
- d03b954bb3525ed19f989e831c39645293c3c984
- Cited by
- 504
- References
- 7
- Citations by year
- 2026: 8 · 2025: 11 · 2024: 23 · 2023: 13 · 2022: 14 · 2021: 13 · 2020: 21 · 2019: 34 · 2018: 21 · 2017: 21 · 2016: 23 · 2015: 29 · 2014: 21 · 2013: 26 · 2012: 29
- FWCI
- 40.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- subgroup analysis, subgroup heterogeneity, overinterpretation, reporting bias, treatment effect heterogeneity, randomized controlled trials, primary endpoint
- MeSH terms
- Data Interpretation, Statistical, False Positive Reactions, Probability, Statistics as Topic, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.