The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
The Use of Resampling Methods to Simplify Regression Models in Medical Statistics
Open accessAbstract
SUMMARY: The number of variables in a regression model is often too large and a more parsimonious model may be preferred. Selection strategies (e.g. all-subset selection with various penalties for model complexity, or stepwise procedures) are widely used, but there are few analytical results about their properties. The problems of replication stability, model complexity, selection bias and an over-optimistic estimate of the predictive value of a model are discussed together with several proposals based on resampling methods. The methods are applied to data from a case–control study on atopic dermatitis and a clinical trial to compare two chemotherapy regimes by using a logistic regression and a Cox model. A recent proposal to use shrinkage factors to reduce the bias of parameter estimates caused by model building is extended to parameterwise shrinkage factors and is discussed as a further possibility to illustrate problems of models which are too complex. The results from the resampling approaches favour greater simplicity of the final regression model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Regression modelling strategies for improved prognostic prediction
Harrell, F. E., Lee, K. L., Califf, R. M., Pryor, D. B., & Rosati, R. A. (1984) · Statistics in Medicine · doi:10.1002/sim.4780030207 · Cited by 1,798
Model Selection: An Integral Part of Inference
Buckland, S. T., Burnham, K. P., & Augustin, N. H. (1997) · Biometrics · doi:10.2307/2533961 · Cited by 1,717 · cited 1×
“More formal approaches to formulating a concept called `model selection uncertainty' in statistical inference were discussed by Hjorth (1994), Chat®eld (1995) and Buckland et al. (1997).”
MethodImprovements on Cross-Validation: The 632+ Bootstrap Method
Efron, B., & Tibshirani, R. (1997) · Journal of the American Statistical Association · doi:10.1080/01621459.1997.10474007 · Cited by 1,636
Model uncertainty, data mining and statistical inference
Chatfield, C. (1995) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983440 · Cited by 1,103
GAIL, M. H., WIEAND, S., & PIANTADOSI, S. (1984) · Biometrika · doi:10.1093/biomet/71.3.431 · Cited by 698
Predictive value of statistical models.
Van Houwelingen, J. C., & Le Cessie, S. (1990) · Statistics in Medicine · doi:10.1002/sim.4780091109 · Cited by 621
Regression, Prediction and Shrinkage
Copas, J. B. (1983) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1983.tb01258.x · Cited by 612
A bootstrap resampling procedure for model building: Application to the cox regression model
Sauerbrei, W., & Schumacher, M. (1992) · Statistics in Medicine · doi:10.1002/sim.4780111607 · Cited by 600
Self-citationExploring the Limits of Bootstrap
Katti, S. K., & Ries, L. (1993) · Technometrics · doi:10.1080/00401706.1993.10485052 · Cited by 428
Cited by
Variable selection – A review and recommendations for the practicing statistician
Heinze, G., Wallisch, C., & Dunkler, D. (2018) · Biometrical Journal · doi:10.1002/bimj.201700067 · Cited by 1,639
Prognosis Research Strategy (PROGRESS) 3: Prognostic Model Research
Steyerberg, E. W., Moons, K. G. M., van der Windt, D. A., Hayden, J. A., Perel, P., Schroter, S., Riley, R. D., Hemingway, H., Altman, D. G., & for the PROGRESS Group (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001381 · Cited by 1,508
Prognosis and prognostic research: validating a prognostic model
Altman, D. G., Vergouwe, Y., Royston, P., & Moons, K. G. M. (2009) · BMJ · doi:10.1136/bmj.b605 · Cited by 1,436
Prognosis and prognostic research: Developing a prognostic model
Royston, P., Moons, K. G. M., Altman, D. G., & Vergouwe, Y. (2009) · BMJ · doi:10.1136/bmj.b604 · Cited by 1,172
Sauerbrei, W., Royston, P., & Binder, H. (2007) · Statistics in Medicine · doi:10.1002/sim.3148 · Cited by 1,171
Self-citationThe use of fractional polynomials to model continuous risk variables in epidemiology
Royston, P., Ambler, G., & Sauerbrei, W. (1999) · International Journal of Epidemiology · doi:10.1093/ije/28.5.964 · Cited by 1,066
Self-citationReporting Recommendations for Tumor Marker Prognostic Studies (REMARK): Explanation and Elaboration
Altman, D. G., McShane, L. M., Sauerbrei, W., & Taube, S. E. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001216 · Cited by 1,013
Self-citationExternal validation is necessary in prediction research:
Bleeker, S. E., Moll, H. A., Steyerberg, E. W., Donders, A. R. T., Derksen-Lubsen, G., Grobbee, D. E., & Moons, K. G. M. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00207-5 · Cited by 710
Medeiros, F. A., Zangwill, L. M., Bowd, C., Vessani, R. M., Susanna, R., & Weinreb, R. N. (2005) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2004.08.069 · Cited by 649
Reporting and Methods in Clinical Prediction Research: A Systematic Review
Bouwmeester, W., Zuithoff, N. P. A., Mallett, S., Geerlings, M. I., Vergouwe, Y., Steyerberg, E. W., Altman, D. G., & Moons, K. G. M. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001221 · Cited by 600
Emotion-regulation skills as a treatment target in psychotherapy
Berking, M., Wupperman, P., Reichardt, A., Pejic, T., Dippel, A., & Znoj, H. (2008) · Behaviour Research and Therapy · doi:10.1016/j.brat.2008.08.005 · Cited by 532
Sauerbrei, W., Taube, S. E., McShane, L. M., Cavenagh, M. M., & Altman, D. G. (2018) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/djy088 · Cited by 486
Self-citationHow should variable selection be performed with multiply imputed data?
Wood, A. M., White, I. R., & Royston, P. (2008) · Statistics in Medicine · doi:10.1002/sim.3177 · Cited by 485
Development and validation of the Nancy histological index for UC
Marchal-Bressenot, A., Salleron, J., Boulagnon-Rombi, C., Bastien, C., Cahn, V., Cadiot, G., Diebold, M.-D., Danese, S., Reinisch, W., Schreiber, S., et al. (2017) · Gut · doi:10.1136/gutjnl-2015-310187 · Cited by 479
Sauerbrei, W., & Royston, P. (1999) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/1467-985x.00122 · Cited by 475
Self-citationA new measure of prognostic separation in survival data
Royston, P., & Sauerbrei, W. (2004) · Statistics in Medicine · doi:10.1002/sim.1621 · Cited by 450
Self-citationInternational prognostic scoring system for Waldenström macroglobulinemia
Morel, P., Duhamel, A., Gobbi, P., Dimopoulos, M. A., Dhodapkar, M. V., McCoy, J., Crowley, J., Ocio, E. M., Garcia-Sanz, R., Treon, S. P., et al. (2009) · Blood · doi:10.1182/blood-2008-08-174961 · Cited by 416
Reporting recommendations for tumor marker prognostic studies (REMARK): explanation and elaboration
Altman, D. G., McShane, L. M., Sauerbrei, W., & Taube, S. E. (2012) · BMC Medicine · doi:10.1186/1741-7015-10-51 · Cited by 372
Self-citationInternational estimated fetal weight standards of the INTERGROWTH‐21st Project
Stirnemann, J., Villar, J., Salomon, L. J., Ohuma, E., Ruyan, P., Altman, D. G., Nosten, F., Craik, R., Munim, S., Cheikh Ismail, L., et al. (2017) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.17347 · Cited by 360
Bannister, C. A., Holden, S. E., Jenkins‐Jones, S., Morgan, C. L., Halcox, J. P., Schernthaner, G., Mukherjee, J., & Currie, C. J. (2014) · Diabetes, Obesity and Metabolism · doi:10.1111/dom.12354 · Cited by 356
“for goodness-of-fit using the Akaike information criterion (AIC) [25].”
MethodInfluentialSauerbrei, W., Meier-Hirmer, C., Benner, A., & Royston, P. (2006) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2005.07.015 · Cited by 351
Self-citationCraig, J. C., Williams, G. J., Jones, M., Codarini, M., Macaskill, P., Hayen, A., Irwig, L., Fitzgerald, D. A., Isaacs, D., & McCaskill, M. (2010) · BMJ · doi:10.1136/bmj.c1594 · Cited by 350
Computer Aided Diagnostic Support System for Skin Cancer: A Review of Techniques and Algorithms
Masood, A., & Ali Al-Jumaily, A. (2013) · International Journal of Biomedical Imaging · doi:10.1155/2013/323268 · Cited by 347
Development and validation of a prediction model with missing predictor data: a practical approach
Vergouwe, Y., Royston, P., Moons, K. G. M., & Altman, D. G. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.03.017 · Cited by 287
A new variable selection approach using Random Forests
Hapfelmeier, A., & Ulm, K. (2013) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2012.09.020 · Cited by 259
initiative, F. T. O. T. S., Sauerbrei, W., Perperoglou, A., Schmid, M., Abrahamowicz, M., Becher, H., Binder, H., Dunkler, D., Harrell, F. E., Royston, P., et al. (2020) · Diagnostic and Prognostic Research · doi:10.1186/s41512-020-00074-3 · Cited by 256
Self-citationVistisen, D., Andersen, G. S., Hansen, C. S., Hulman, A., Henriksen, J. E., Bech-Nielsen, H., & Jørgensen, M. E. (2016) · Circulation · doi:10.1161/circulationaha.115.018844 · Cited by 229
“This means that a predictor with an overestimated regression coefficient is more likely to be included than a predictor with an underestimated regression coefficient.(34) Hence, for the selected predictors, we would expect the estimated regression coefficients on average to be smaller in a different data set.”
BackgroundVandael, E., Vandenberk, B., Vandenberghe, J., Van den Bosch, B., Willems, R., & Foulon, V. (2018) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.13740 · Cited by 48
Calibration of clinical prediction rules does not just assess bias
Vach, W. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.06.003 · Cited by 26
Metadata
- Authors
- Sauerbrei, W.
- Venue
- Journal of the Royal Statistical Society Series C: Applied Statistics
- Publisher
- Oxford University Press (OUP)
- Published
- 1999-09-01
- Volume
- 48
- Issue
- 3
- Pages
- 313-329
- ISSN
- 0035-9254 (ISSN-L)
- 1467-9876
- OpenAlex
- W2073790637
- Cited by
- 310
- References
- 19
- FWCI
- 5.71
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.