The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Penalization, bias reduction, and default priors in logistic and related categorical and survival regressions
Abstract
Penalization is a very general method of stabilizing or regularizing estimates, which has both frequentist and Bayesian rationales. We consider some questions that arise when considering alternative penalties for logistic regression and related models. The most widely programmed penalty appears to be the Firth small‐sample bias‐reduction method (albeit with small differences among implementations and the results they provide), which corresponds to using the log density of the Jeffreys invariant prior distribution as a penalty function. The latter representation raises some serious contextual objections to the Firth reduction, which also apply to alternative penalties based on t ‐distributions (including Cauchy priors). Taking simplicity of implementation and interpretation as our chief criteria, we propose that the log‐ F (1,1) prior provides a better default penalty than other proposals. Penalization based on more general log‐ F priors is trivial to implement and facilitates mean‐squared error reduction and sensitivity analyses of penalty strength by varying the number of prior degrees of freedom. We caution however against penalization of intercepts, which are unduly sensitive to covariate coding and design idiosyncrasies. Copyright © 2015 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Hosmer, D. W., Lemeshow, S., & Sturdivant, R. X. (2013) · Wiley Series in Probability and Statistics · doi:10.1002/9781118548387 · Cited by 13,861
Standardized Regression Coefficients: A Further Critique and Review of Some Alternatives
Greenland, S., Maclure, M., Schlesselman, J. J., Poole, C., & Morgenstern, H. (1991) · Epidemiology · doi:10.1097/00001648-199109000-00015 · Cited by 138
Self-citation
Cited by
Sparse data bias: a problem hiding in plain sight
Greenland, S., Mansournia, M. A., & Altman, D. G. (2016) · BMJ · doi:10.1136/bmj.i1981 · Cited by 898
Self-citationSample size for binary logistic prediction models: Beyond events per variable criteria
van Smeden, M., Moons, K. G., de Groot, J. A., Collins, G. S., Altman, D. G., Eijkemans, M. J., & Reitsma, J. B. (2019) · Statistical Methods in Medical Research · doi:10.1177/0962280218784726 · Cited by 791
Firth's logistic regression with rare events: accurate effect estimates and predictions?
Puhr, R., Heinze, G., Nold, M., Lusa, L., & Geroldinger, A. (2017) · Statistics in Medicine · doi:10.1002/sim.7273 · Cited by 483
Peiper, N. C., Clarke, S. D., Vincent, L. B., Ciccarone, D., Kral, A. H., & Zibbell, J. E. (2019) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2018.08.007 · Cited by 317
Separation in Logistic Regression: Causes, Consequences, and Control
Mansournia, M. A., Geroldinger, A., Greenland, S., & Heinze, G. (2018) · American Journal of Epidemiology · doi:10.1093/aje/kwx299 · Cited by 296
Self-citation
Metadata
- Authors
- Greenland, S., & Mansournia, M. A.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2015-05-26
- Volume
- 34
- Issue
- 23
- Pages
- 3133-3143
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2136133675
- Cited by
- 237
- References
- 3
- FWCI
- 32.12
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.