The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Assessing the goodness of fit of logistic regression models in large samples: a modification of the Hosmer-Lemeshow test
Abstract
Evaluating the goodness of fit of logistic regression models is crucial to ensure the accuracy of the estimated probabilities. Unfortunately, such evaluation is problematic in large samples. Because the power of traditional goodness of fit tests increases with the sample size, practically irrelevant discrepancies between estimated and true probabilities are increasingly likely to cause the rejection of the hypothesis of perfect fit in larger and larger samples. This phenomenon has been widely documented for popular goodness of fit tests, such as the Hosmer-Lemeshow test. To address this limitation, we propose a modification of the Hosmer-Lemeshow approach. By standardizing the noncentrality parameter that characterizes the alternative distribution of the Hosmer-Lemeshow statistic, we introduce a parameter that measures the goodness of fit of a model but does not depend on the sample size. We provide the methodology to estimate this parameter and construct confidence intervals for it. Finally, we propose a formal statistical test to rigorously assess whether the fit of a model, albeit not perfect, is acceptable for practical purposes. The proposed method is compared in a simulation study with a competing modification of the Hosmer-Lemeshow test, based on repeated subsampling. We provide a step-by-step illustration of our method using a model for postneonatal mortality developed in a large cohort of more than 300 000 observations.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Similar to statistical tests such as the Hosmer-Lemeshow test, the proposed summary measures cannot inform on the direction of miscalibration.”
From Evaluation of performance measures in predictive artificial intelligence models to support medical decisions: overview and guidance (2025) · cites this paper as [61]
Citations
Cites
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
Self-citationAlternative Ways of Assessing Model Fit
Browne, M. W., & Cudeck, R. (1992) · Sociological Methods & Research · doi:10.1177/0049124192021002005 · Cited by 27,200
Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013) · Wiley Series in Probability and Statistics · doi:10.1002/9781118548387 · Cited by 13,861
Self-citationStructural model evaluation and modification: An interval estimation approach
Steiger, J. H. (1990) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2502_4 · Cited by 7,408
Casella, G., & Berger, R. L. (1993) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,835
Journal of the American Statistical Association
Koehler, A. B. (1995) · International Journal of Forecasting · doi:10.1016/0169-2070(95)90067-5 · Cited by 5,359
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Goodness of fit tests for the multiple logistic regression model
Hosmer, D., & Lemesbow, S. (1980) · Communication in Statistics- Theory and Methods · doi:10.1080/03610928008827941 · Cited by 1,780
Kramer, A. A., & Zimmerman, J. E. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000275267.64078.b0 · Cited by 886
Anderson, N. H. (2001) · Psychology Press eBooks · doi:10.4324/9781410600004-7 · Cited by 727
Journal of Statistical Planning and Inference, the
Rodriguesa, J., Castrob, M. D., Canchob, V. G., & Balakrishnanc, N. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1316 · Cited by 720
Computational statistics & data analysis
ScienceDirect (1983) · Cited by 637
What If There Were No Significance Tests?
(2016) · Routledge eBooks · doi:10.4324/9781315629049 · Cited by 543
Standardizing the power of the Hosmer–Lemeshow goodness of fit test in large data sets
Paul, P., Pennell, M. L., & Lemeshow, S. A. (2012) · Statistics in Medicine · doi:10.1002/sim.5525 · Cited by 434
Self-citationAustin, P. C., & Steyerberg, E. W. (2014) · Statistics in Medicine · doi:10.1002/sim.5941 · Cited by 362
Stukel, T. A. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478613 · Cited by 261
Archer, K. J., Lemeshow, S. A., & Hosmer, D. W. (2006) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2006.07.006 · Cited by 236
Self-citationUnified Large-Sample Theory of General Chi-Squared Statistics for Tests of Fit
Moore, D. S., & Spruill, M. C. (1975) · The Annals of Statistics · doi:10.1214/aos/1176343125 · Cited by 204
A new test and graphical tool to assess the goodness of fit of logistic regression models
Nattino, G., Finazzi, S., & Bertolini, G. (2015) · Statistics in Medicine · doi:10.1002/sim.6744 · Cited by 101
Self-citationEstimation of the Non-Centrality Parameter of a Chi Squared Distribution
Saxena, K. M. L., & Alam, K. (1982) · The Annals of Statistics · doi:10.1214/aos/1176345892 · Cited by 80
A modified Hosmer–Lemeshow test for large data sets
Yu, W., Xu, W., & Zhu, L. (2017) · Communication in Statistics- Theory and Methods · doi:10.1080/03610926.2017.1285922 · Cited by 55
How Many Classes in the Pearson Chi—Square Test?
Dahiya, R. C., & Gurland, J. (1973) · Journal of the American Statistical Association · doi:10.1080/01621459.1973.10481409 · Cited by 48
How Many Classes in the Pearson Chi-Square Test?
Dahiya, R. C., & Gurland, J. (1973) · Journal of the American Statistical Association · doi:10.2307/2284803 · Cited by 28
A simple test procedure in standardizing the power of Hosmer–Lemeshow test in large data sets
Lai, X., & Liu, L. (2018) · Journal of Statistical Computation and Simulation · doi:10.1080/00949655.2018.1467912 · Cited by 25
Confidence intervals for the noncentral chi-squared distribution
Kent, J. T., & Hainsworth, T. J. (1995) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(94)00104-4 · Cited by 13
Accuracy of Hospital Standardized Mortality Rates
Kipnis, P., Liu, V., & Escobar, G. J. (2014) · Medical Care · doi:10.1097/mlr.0000000000000111 · Cited by 10
Nattino, G., Finazzi, S., & Bertolini, G. (2014) · Statistics in Medicine · doi:10.1002/sim.6126 · Cited by 7
Self-citation
Cited by
Sorted by citations
Van Calster, B., Collins, G. S., Vickers, A. J., Wynants, L., Kerr, K. F., Barreñada, L., Varoquaux, G., Singh, K., Moons, K. G., Hernandez-Boussard, T., et al. (2025) · The Lancet Digital Health · doi:10.1016/j.landig.2025.100916 · Cited by 112
Pfob, A., Lu, S.-C., & Sidey-Gibbons, C. J. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01758-8 · Cited by 122
Kowalewski, M., Zieliński, K., Brodie, D., MacLaren, G., Whitman, G. J. R., Raffa, G. M., Boeken, U., Shekar, K., Chen, Y., Bermudez, C. A., et al. (2021) · Critical Care Medicine · doi:10.1097/ccm.0000000000004922 · Cited by 93
Statistical Development and Validation of Clinical Prediction Models
Staffa, S., & Zurakowski, D. (2021) · Anesthesiology · doi:10.1097/aln.0000000000003871 · Cited by 75
Guidelines on clinical research evaluation of artificial intelligence in ophthalmology (2023)
Yang, W., & Xu, Y. (2023) · International Journal of Ophthalmology · doi:10.18240/ijo.2023.09.02 · Cited by 92
Metadata
- Authors
- Nattino, G., Pennell, M. L., & Lemeshow, S.
- Affiliations
- The Ohio State University (US)
- Corresponding author
- Nattino, Giovanni
- Venue
- Biometrics
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-04-06
- Volume
- 76
- Issue
- 2
- Pages
- 549-560
- ISSN
- 0006-341X (ISSN-L)
- 1541-0420
- OpenAlex
- W3009925463
- Cited by
- 229
- References
- 27
- Citations by year
- 2026: 29 · 2025: 48 · 2024: 67 · 2023: 27 · 2022: 35 · 2021: 21 · 2020: 2
- FWCI
- 14.98
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Distribution Estimation and Applications
- Keywords
- goodness of fit, logistic regression, Hosmer-Lemeshow test, large samples, noncentrality parameter, confidence intervals, model fit assessment, postneonatal mortality
- MeSH terms
- Biometry, Computer Simulation, Female, Humans, Infant, Infant Mortality, Male, Monte Carlo Method, Ohio, Probability, Models, Statistical, Confidence Intervals, Chi-Square Distribution, Linear Models, Logistic Models, Sample Size
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review