The DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
A bootstrap resampling procedure for model building: Application to the cox regression model
Abstract
A common problem in the statistical analysis of clinical studies is the selection of those variables in the framework of a regression model which might influence the outcome variable. Stepwise methods have been available for a long time, but as with many other possible strategies, there is a lot of criticism of their use. Investigations of the stability of a selected model are often called for, but usually are not carried out in a systematic way. Since analytical approaches are extremely difficult, data‐dependent methods might be an useful alternative. Based on a bootstrap resampling procedure, Chen and George investigated the stability of a stepwise selection procedure in the framework of the Cox proportional hazard regression model. We extend their proposal and develop a bootstrap‐model selection procedure, combining the bootstrap method with existing selection techniques such as stepwise methods. We illustrate the proposed strategy in the process of model building by using data from two cancer clinical trials featuring two different situations commonly arising in clinical research. In a brain tumour study the adjustment for covariates in an overall treatment comparison is of primary interest calling for the selection of even ‘mild’ effects. In a prostate cancer study we concentrate on the analysis of treatment‐covariate interactions demanding that only ‘strong’ effects should be selected. Both variants of the strategy will be demonstrated analysing the clinical trials with a Cox model, but they can be applied in other types of regression with obvious and straightforward modifications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression Models and Life-Tables
Cox, D. R. (1972) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1972.tb00899.x · Cited by 39,793
Regression Models and Life-Tables
Cox, D. R. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-4380-9_37 · Cited by 26,297
Bootstrap methods: another look at the jackknife
Efron, B. (1979) · The Annals of Statistics · doi:10.1214/aos/1176344552 · Cited by 17,602
Linear Statistical Inference and its Applications: Second Editon
Rao, C. R. (1973) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316436 · Cited by 10,489
The Statistical Analysis of Failure Time Data.
Aitkin, M., Kalbfleisch, J. D., & Prentice, R. L. (1981) · Biometrics · doi:10.2307/2530581 · Cited by 9,877
Efron, B., & Tibshirani, R. (1986) · Statistical Science · doi:10.1214/ss/1177013815 · Cited by 6,033
Cox’s regression model for counting processes: A large sample study
Andersen, P. K., & Gill, R. D. (1982) · The Annals of Statistics · doi:10.1214/aos/1176345976 · Cited by 4,419
Regression modelling strategies for improved prognostic prediction
Harrell, F. E., Lee, K. L., Califf, R. M., Pryor, D. B., & Rosati, R. A. (1984) · Statistics in Medicine · doi:10.1002/sim.4780030207 · Cited by 1,798
Clarke, G. M., Draper, N. R., & Smith, H. (1982) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2982106 · Cited by 1,788
A Biometrics Invited Paper. The Analysis and Selection of Variables in Linear Regression
Hocking, R. R. (1976) · Biometrics · doi:10.2307/2529336 · Cited by 1,765
Cited by
Iakovou, I. (2005) · JAMA · doi:10.1001/jama.293.17.2126 · Cited by 3,132
Calculating the sample size required for developing a clinical prediction model
Riley, R. D., Ensor, J., Snell, K. I. E., Harrell, F. E., Martin, G. P., Reitsma, J. B., Moons, K. G. M., Collins, G., & van Smeden, M. (2020) · BMJ · doi:10.1136/bmj.m441 · Cited by 2,917
Meinshausen, N., & Bühlmann, P. (2010) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2010.00740.x · Cited by 2,215
Risk Factors for Deep Vein Thrombosis and Pulmonary Embolism: A Population-Based Case-Control Study
Heit, J. A., Silverstein, M. D., Mohr, D. N., Petterson, T. M., O'Fallon, W. M., & Melton, L. J. (2000) · Archives of Internal Medicine · doi:10.1001/archinte.160.6.809 · Cited by 2,171
Survival and Prognostic Stratification of 670 Patients With Advanced Renal Cell Carcinoma
Motzer, R. J., Mazumdar, M., Bacik, J., Berg, W., Amsterdam, A., & Ferrara, J. (1999) · Journal of Clinical Oncology · doi:10.1200/jco.1999.17.8.2530 · Cited by 1,801
Model Selection: An Integral Part of Inference
Buckland, S. T., Burnham, K. P., & Augustin, N. H. (1997) · Biometrics · doi:10.2307/2533961 · Cited by 1,717
Variable selection – A review and recommendations for the practicing statistician
Heinze, G., Wallisch, C., & Dunkler, D. (2018) · Biometrical Journal · doi:10.1002/bimj.201700067 · Cited by 1,639
Motzer, R. J., Bacik, J., Murphy, B. A., Russo, P., & Mazumdar, M. (2002) · Journal of Clinical Oncology · doi:10.1200/jco.20.1.289 · Cited by 1,576
Heit, J. A., Mohr, D. N., Silverstein, M. D., Petterson, T. M., O'Fallon, W. M., & Melton, L. J. (2000) · Archives of Internal Medicine · doi:10.1001/archinte.160.6.761 · Cited by 1,352
FRANK, I., BLUTE, M. L., CHEVILLE, J. C., LOHSE, C. M., WEAVER, A. L., & ZINCKE, H. (2002) · Journal of Urology · doi:10.1016/s0022-5347(05)64153-5 · Cited by 1,175
Sauerbrei, W., Royston, P., & Binder, H. (2007) · Statistics in Medicine · doi:10.1002/sim.3148 · Cited by 1,171
Self-citationEvidence-based detection of pulmonary arterial hypertension in systemic sclerosis: the DETECT study
Coghlan, J. G., Denton, C. P., Grünig, E., Bonderman, D., Distler, O., Khanna, D., Müller-Ladner, U., Pope, J. E., Vonk, M. C., Doelberg, M., et al. (2014) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2013-203301 · Cited by 832
Concato, J., Peduzzi, P., Holford, T. R., & Feinstein, A. R. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(95)00510-2 · Cited by 797
Prognostic Factors for Survival in Previously Treated Patients With Metastatic Renal Cell Carcinoma
Motzer, R. J., Bacik, J., Schwartz, L. H., Reuter, V., Russo, P., Marion, S., & Mazumdar, M. (2004) · Journal of Clinical Oncology · doi:10.1200/jco.2004.06.132 · Cited by 793
Sample size for binary logistic prediction models: Beyond events per variable criteria
van Smeden, M., Moons, K. G., de Groot, J. A., Collins, G. S., Altman, D. G., Eijkemans, M. J., & Reitsma, J. B. (2019) · Statistical Methods in Medical Research · doi:10.1177/0962280218784726 · Cited by 791
Steyerberg, E. W., Eijkemans, M. J. C., Harrell, F. E., & Habbema, J. D. F. (2000) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(20000430)19:8<1059::aid-sim412>3.0.co;2-0 · Cited by 785
Dohner, H., Fischer, K., Bentz, M., Hansen, K., Benner, A., Cabot, G., Diehl, D., Schlenk, R., Coy, J., Stilgenbauer, S., et al. (1995) · Blood · doi:10.1182/blood.v85.6.1580.bloodjournal8561580 · Cited by 732
Shaw, E., Arusell, R., Scheithauer, B., O’Fallon, J., O’Neill, B., Dinapoli, R., Nelson, D., Earle, J., Jones, C., Cascino, T., et al. (2002) · Journal of Clinical Oncology · doi:10.1200/jco.2002.09.126 · Cited by 730
Turesson, C., O'Fallon, W. M., Crowson, C. S., Gabriel, S. E., & Matteson, E. L. (2003) · Annals of the Rheumatic Diseases · doi:10.1136/ard.62.8.722 · Cited by 672
Lymphoid Neogenesis in Rheumatoid Synovitis
Takemura, S., Braun, A., Crowson, C., Kurtin, P. J., Cofield, R. H., O’Fallon, W. M., Goronzy, J. J., & Weyand, C. M. (2001) · The Journal of Immunology · doi:10.4049/jimmunol.167.2.1072 · Cited by 660
Quinten, C., Coens, C., Mauer, M., Comte, S., Sprangers, M. A., Cleeland, C., Osoba, D., Bjordal, K., & Bottomley, A. (2009) · The Lancet Oncology · doi:10.1016/s1470-2045(09)70200-1 · Cited by 659
Adaptive Lasso for Cox's proportional hazards model
Zhang, H. H., & Lu, W. (2007) · Biometrika · doi:10.1093/biomet/asm037 · Cited by 644
Smith, J. S., Tachibana, I., Passe, S. M., Huntley, B. K., Borell, T. J., Iturria, N., O'Fallon, J. R., Schaefer, P. L., Scheithauer, B. W., James, C. D., et al. (2001) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/93.16.1246 · Cited by 630
Bootstrap Methods for Developing Predictive Models
Austin, P. C., & Tu, J. V. (2004) · The American Statistician · doi:10.1198/0003130043277 · Cited by 622
Heit, J. A., Silverstein, M. D., Mohr, D. N., Petterson, T. M., O'Fallon, W. M., & Melton, L. J. (1999) · Archives of Internal Medicine · doi:10.1001/archinte.159.5.445 · Cited by 594
The Epidemiology of Venous Thromboembolism in the Community
Mohr, D., Petterson, T., Lohse, C., O’Fallon, W. M., Melton, L. J., Heit, J., & Silverstein, M. (2001) · Thrombosis and Haemostasis · doi:10.1055/s-0037-1616243 · Cited by 571
Gorlia, T., van den Bent, M. J., Hegi, M. E., Mirimanoff, R. O., Weller, M., Cairncross, J. G., Eisenhauer, E., Belanger, K., Brandes, A. A., Allgeier, A., et al. (2008) · The Lancet Oncology · doi:10.1016/s1470-2045(07)70384-4 · Cited by 557
Steyerberg, E. W., Eijkemans, M. J. C., Harrell, F. E., & Habbema, J. D. F. (2001) · Medical Decision Making · doi:10.1177/0272989x0102100106 · Cited by 550
Five myths about variable selection
Heinze, G., & Dunkler, D. (2017) · Transplant International · doi:10.1111/tri.12895 · Cited by 528
Stepwise Selection in Small Data Sets A Simulation Study of Bias in Logistic Regression Analysis
Steyerberg, E. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00103-1 · Cited by 495
Long-Term Durability of Bioprosthetic Aortic Valves: Implications From 12,569 Implants
Johnston, D. R., Soltesz, E. G., Vakil, N., Rajeswaran, J., Roselli, E. E., Sabik, J. F., Smedira, N. G., Svensson, L. G., Lytle, B. W., & Blackstone, E. H. (2015) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2014.10.070 · Cited by 488
Subgroup-Specific Prognostic Implications of TP53 Mutation in Medulloblastoma
Zhukova, N., Ramaswamy, V., Remke, M., Pfaff, E., Shih, D. J. H., Martin, D. C., Castelo-Branco, P., Baskin, B., Ray, P. N., Bouffet, E., et al. (2013) · Journal of Clinical Oncology · doi:10.1200/jco.2012.48.5052 · Cited by 485
Gastrointestinal Stromal Tumor Meta-Analysis Group (MetaGIST) (2010) · Journal of Clinical Oncology · doi:10.1200/jco.2009.24.2099 · Cited by 479
Sauerbrei, W., & Royston, P. (1999) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/1467-985x.00122 · Cited by 475
Self-citationPark, D.-W., Park, S.-W., Park, K.-H., Lee, B.-K., Kim, Y.-H., Lee, C. W., Hong, M.-K., Kim, J.-J., & Park, S.-J. (2006) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2006.02.039 · Cited by 475
Almond, C. S., Morales, D. L., Blackstone, E. H., Turrentine, M. W., Imamura, M., Massicotte, M. P., Jordan, L. C., Devaney, E. J., Ravishankar, C., Kanter, K. R., et al. (2013) · Circulation · doi:10.1161/circulationaha.112.000685 · Cited by 467
Airoldi, F., Colombo, A., Morici, N., Latib, A., Cosgrave, J., Buellesfeld, L., Bonizzoni, E., Carlino, M., Gerckens, U., Godino, C., et al. (2007) · Circulation · doi:10.1161/circulationaha.106.686048 · Cited by 455
A new measure of prognostic separation in survival data
Royston, P., & Sauerbrei, W. (2004) · Statistics in Medicine · doi:10.1002/sim.1621 · Cited by 450
Self-citationInternational prognostic scoring system for Waldenström macroglobulinemia
Morel, P., Duhamel, A., Gobbi, P., Dimopoulos, M. A., Dhodapkar, M. V., McCoy, J., Crowley, J., Ocio, E. M., Garcia-Sanz, R., Treon, S. P., et al. (2009) · Blood · doi:10.1182/blood-2008-08-174961 · Cited by 416
Stability and Performance of a Population Pharmacokinetic Model
Ette, E. I. (1997) · The Journal of Clinical Pharmacology · doi:10.1002/j.1552-4604.1997.tb04326.x · Cited by 353
Craig, J. C., Williams, G. J., Jones, M., Codarini, M., Macaskill, P., Hayen, A., Irwig, L., Fitzgerald, D. A., Isaacs, D., & McCaskill, M. (2010) · BMJ · doi:10.1136/bmj.c1594 · Cited by 350
The Use of Resampling Methods to Simplify Regression Models in Medical Statistics
Sauerbrei, W. (1999) · Journal of the Royal Statistical Society Series C: Applied Statistics · doi:10.1111/1467-9876.00155 · Cited by 310
Self-citationBlackstone, E. H., Suri, R. M., Rajeswaran, J., Babaliaros, V., Douglas, P. S., Fearon, W. F., Miller, D. C., Hahn, R. T., Kapadia, S., Kirtane, A. J., et al. (2015) · Circulation · doi:10.1161/circulationaha.114.012525 · Cited by 290
Prognostic models of thirty-day mortality and morbidity after major pulmonary resection
Harpole, D. H., DeCamp, M. M., Daley, J., Hur, K., Oprian, C. A., Henderson, W. G., & Khuri, S. F. (1999) · The Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/s0022-5223(99)70378-8 · Cited by 289
Royston, P., & Sauerbrei, W. (2004) · Statistics in Medicine · doi:10.1002/sim.1815 · Cited by 280
Self-citationPetersen, V. C., Baxter, K. J., Love, S. B., & Shepherd, N. A. (2002) · Gut · doi:10.1136/gut.51.1.65 · Cited by 273
Methodological challenges in the evaluation of prognostic factors in breast cancer.
Altman, D. G., & Lyman, G. H. (1998) · Breast Cancer Research and Treatment · doi:10.1023/a:1006193704132 · Cited by 271
Primary (AL) Hepatic Amyloidosis: Clinical Features and Natural History in 98 Patients
Park, M. A., Mueller, P. S., Kyle, R. A., Larson, D. R., Plevak, M. F., & Gertz, M. A. (2003) · Medicine · doi:10.1097/01.md.0000091183.93122.c7 · Cited by 263
Alberti, C., Brun-Buisson, C., Goodman, S. V., Guidici, D., Granton, J., Moreno, R., Smithies, M., Thomas, O., Artigas, A., & Le Gall, J. R. (2003) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200208-785oc · Cited by 262
initiative, F. T. O. T. S., Sauerbrei, W., Perperoglou, A., Schmid, M., Abrahamowicz, M., Becher, H., Binder, H., Dunkler, D., Harrell, F. E., Royston, P., et al. (2020) · Diagnostic and Prognostic Research · doi:10.1186/s41512-020-00074-3 · Cited by 256
Self-citationDanilenko-Dixon, D. R., Heit, J. A., Silverstein, M. D., Yawn, B. P., Petterson, T. M., Lohse, C. M., & Melton, L. J. (2001) · American Journal of Obstetrics and Gynecology · doi:10.1067/mob.2001.107919 · Cited by 232
Multivariable Modeling Strategies
Harrell, F. E. (2015) · Springer Series in Statistics · doi:10.1007/978-3-319-19425-7_4 · Cited by 221
New ischemic lesions coexisting with acute intracerebral hemorrhage
Kang, D.-W., Han, M.-K., Kim, H.-J., Yun, S.-C., Jeon, S.-B., Bae, H.-J., Kwon, S. U., & Kim, J. S. (2012) · Neurology · doi:10.1212/wnl.0b013e3182648a79 · Cited by 109
Erdem, H., Cag, Y., Ozturk-Engin, D., Defres, S., Kaya, S., Larsen, L., Poljak, M., Barsic, B., Argemi, X., Sørensen, S. M., et al. (2015) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.05016-14 · Cited by 74
Predictors of Medication Continuity in Children With ADHD
Brinkman, W. B., Sucharew, H., Majcher, J. H., & Epstein, J. N. (2018) · Pediatrics · doi:10.1542/peds.2017-2580 · Cited by 47
Predictability of persistent frequent attendance: a historic 3-year cohort study
Smits, F. T., Brouwer, H. J., van Weert, H. C., Schene, A. H., & ter Riet, G. (2009) · British Journal of General Practice · doi:10.3399/bjgp09x395120 · Cited by 44
Han, D., Kolli, K. K., Gransar, H., Lee, J. H., Choi, S.-Y., Chun, E. J., Han, H.-W., Park, S. H., Sung, J., Jung, H. O., et al. (2020) · Journal of Cardiovascular Computed Tomography · doi:10.1016/j.jcct.2019.09.005 · Cited by 41
McNally, J. S., Sakata, A., Alexander, M. D., Dewitt, L. D., Sonnen, J. A., Menacho, S. T., Stoddard, G. J., Kim, S.-E., & de Havenon, A. H. (2021) · American Journal of Neuroradiology · doi:10.3174/ajnr.a7047 · Cited by 18
Stability selection for lasso, ridge and elastic net implemented with AFT models
Khan, M. H. R., Bhadra, A., & Howlader, T. (2019) · Statistical Applications in Genetics and Molecular Biology · doi:10.1515/sagmb-2017-0001 · Cited by 11
Harrell, F., Jr. (1996) · doi:10.1002/(sici)1097-0258(19960229)15:4<361::aid-sim168>3.0.co;2-4
Metadata
- Authors
- Sauerbrei, W., & Schumacher, M.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 1992-01
- Volume
- 11
- Issue
- 16
- Pages
- 2093-2109
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W1996093516
- Cited by
- 600
- References
- 46
- FWCI
- 3.21
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.