The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
A weakly informative default prior distribution for logistic and other regression models
Open accessAbstract
We propose a new prior distribution for classical (nonhierarchical) logistic regression models, constructed by first scaling all nonbinary variables to have mean 0 and standard deviation 0.5, and then placing independent Student-t prior distributions on the coefficients. As a default choice, we recommend the Cauchy distribution with center 0 and scale 2.5, which in the simplest setting is a longer-tailed version of the distribution attained by assuming one-half additional success and one-half additional failure in a logistic regression. Cross-validation on a corpus of datasets shows the Cauchy class of prior distributions to outperform existing implementations of Gaussian and Laplace priors. We recommend this prior distribution as a default choice for routine applied use. It has the advantage of always giving answers, even when there is complete separation in logistic regression (a common problem, even when the sample size is large and the number of predictors is small), and also automatically applying more shrinkage to higher-order interactions. This can be useful in routine data analysis as well as in automated procedures such as chained equations for missing-data imputation. We implement a procedure to fit generalized linear models in R with the Student-t prior distribution by incorporating an approximate EM algorithm into the usual iteratively weighted least squares. We illustrate with several applications, including a series of logistic regressions predicting voting preferences, a small bioassay experiment, and an imputation model for a public health data set.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Self-citationMcCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Multiple imputation after 18+ years
Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476908 · Cited by 4,072
A solution to the problem of separation in logistic regression
Heinze, G., & Schemper, M. (2002) · Statistics in Medicine · doi:10.1002/sim.1047 · Cited by 2,711
Scoring Rules and the Evaluation of Probability Assessors
Winkler, R. L. (1969) · Journal of the American Statistical Association · doi:10.1080/01621459.1969.10501037 · Cited by 271
Verification of forecasts expressed in terms of probability
BRIER, G. W. (1950) · Monthly Weather Review · doi:10.1175/1520-0493(1950)078%3c0001:vofeit%3e2.0.co;2 · cited 1×
“Maximizing the Brier score [Brier (1950)] is equivalent to minimizing mean square error, and maximizing the logarithmic score is equivalent to maximizing the likelihood of the out-of-sample data.”
Method
Cited by
Finak, G., McDavid, A., Yajima, M., Deng, J., Gersuk, V., Shalek, A. K., Slichter, C. K., Miller, H. W., McElrath, M. J., Prlic, M., et al. (2015) · Genome Biology · doi:10.1186/s13059-015-0844-5 · Cited by 3,159
Fake news on Twitter during the 2016 U.S. presidential election
Grinberg, N., Joseph, K., Friedland, L., Swire-Thompson, B., & Lazer, D. (2019) · Science · doi:10.1126/science.aau2706 · Cited by 1,803
MetaHIT Consortium, Nielsen, H. B., Almeida, M., Juncker, A. S., Rasmussen, S., Li, J., Sunagawa, S., Plichta, D. R., Gautier, L., Pedersen, A. G., et al. (2014) · Nature Biotechnology · doi:10.1038/nbt.2939 · Cited by 1,184
Visualization in Bayesian Workflow
Gabry, J., Simpson, D., Vehtari, A., Betancourt, M., & Gelman, A. (2019) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/rssa.12378 · Cited by 1,122
Self-citationPhilosophy and the practice of Bayesian statistics
Gelman, A., & Shalizi, C. R. (2013) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.2011.02037.x · Cited by 825
Self-citationStatistical Analysis of List Experiments
Blair, G., & Imai, K. (2012) · Political Analysis · doi:10.1093/pan/mpr048 · Cited by 639
Firth's logistic regression with rare events: accurate effect estimates and predictions?
Puhr, R., Heinze, G., Nold, M., Lusa, L., & Geroldinger, A. (2017) · Statistics in Medicine · doi:10.1002/sim.7273 · Cited by 483
Improving transparency and replication in Bayesian statistics: The WAMBS-Checklist.
Depaoli, S., & van de Schoot, R. (2017) · Psychological Methods · doi:10.1037/met0000065 · Cited by 448
Tutorial in biostatistics: data‐driven subgroup identification and analysis in clinical trials
Lipkovich, I., Dmitrienko, A., & B., R. (2017) · Statistics in Medicine · doi:10.1002/sim.7064 · Cited by 291
Improving propensity score estimators’ robustness to model misspecification using super learner.
Pirracchio, R., Petersen, M. L., & van der Laan, M. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwu253 · Cited by 186
Mortality Risk Score Prediction in an Elderly Population Using Machine Learning
Rose, S. (2013) · American Journal of Epidemiology · doi:10.1093/aje/kws241 · Cited by 193
Csárdi, G., Franks, A., Choi, D. S., Airoldi, E. M., & Drummond, D. A. (2015) · PLOS Genetics · doi:10.1371/journal.pgen.1005206 · Cited by 181
Bayesian Meta-Analysis with Weakly Informative Prior Distributions
Williams, D. R., Rast, P., & Bürkner, P. C. (2018) · doi:10.31234/osf.io/7tbrm · Cited by 124
Jobes, D. A., Comtois, K. A., Gutierrez, P. M., Brenner, L. A., Huh, D., Chalker, S. A., Ruhe, G., Kerbrat, A. H., Atkins, D. C., Jennings, K., et al. (2017) · Psychiatry · doi:10.1080/00332747.2017.1354607 · Cited by 113
Kay, M., Nelson, G. L., & Hekler, E. B. (2016) · Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems · doi:10.1145/2858036.2858465 · Cited by 113
A flexible, interpretable framework for assessing sensitivity to unmeasured confounding
Dorie, V., Harada, M., Carnegie, N. B., & Hill, J. (2016) · Statistics in Medicine · doi:10.1002/sim.6973 · Cited by 104
Tumour gene expression signature in primary melanoma predicts long-term outcomes
Garg, M., Couturier, D.-L., Nsengimana, J., Fonseca, N. A., Wongchenko, M., Yan, Y., Lauss, M., Jönsson, G. B., Newton-Bishop, J., Parkinson, C., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-21207-2 · Cited by 70
Giudice, N. A., Guenther, B. A., Jensen, N. A., & Haase, K. N. (2020) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2020.00087 · Cited by 60
“Prior distributions for the intercept and the fixed effect were assigned as Cauchy distributions using parameters recommended for weakly informative priors in logistic/probit regression (Gelman et al., 2008, 2013).”
MethodBoom-bust cycles in gray whales associated with dynamic and changing Arctic conditions
Stewart, J. D., Joyce, T. W., Durban, J. W., Calambokidis, J., Fauquier, D., Fearnbach, H., Grebmeier, J. M., Lynn, M., Manizza, M., Perryman, W. L., et al. (2023) · Science · doi:10.1126/science.adi1847 · Cited by 58
Morris, W. K., Vesk, P. A., McCarthy, M. A., Bunyavejchewin, S., & Baker, P. J. (2015) · Ecology and Evolution · doi:10.1002/ece3.1346 · Cited by 51
Imaging, Behavior and Endocrine Analysis of “Jealousy” in a Monogamous Primate
Maninger, N., Mendoza, S. P., Williams, D. R., Mason, W. A., Cherry, S. R., Rowland, D. J., Schaefer, T., & Bales, K. L. (2017) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2017.00119 · Cited by 51
Wilkinson, L., Yi, N., Mehta, T., Judd, S., & Garvey, W. T. (2020) · PLOS Medicine · doi:10.1371/journal.pmed.1003232 · Cited by 47
Gudmestad, A., House, L., & Geeslin, K. L. (2013) · Language Learning · doi:10.1111/lang.12006 · Cited by 47
Gauthier, P. T., Norwood, W. P., Prepas, E. E., & Pyle, G. G. (2015) · Environmental Science & Technology · doi:10.1021/acs.est.5b03233 · Cited by 43
Wroe, E. B., Nhlema, B., Dunbar, E. L., Kulinkina, A. V., Kachimanga, C., Aron, M., Dullie, L., Makungwa, H., Chabwera, B., Phiri, B., et al. (2021) · BMJ Global Health · doi:10.1136/bmjgh-2021-006535 · Cited by 36
Hubbard, A., Munoz, I. D., Decker, A., Holcomb, J. B., Schreiber, M. A., Bulger, E. M., Brasel, K. J., Fox, E. E., del Junco, D. J., Wade, C. E., et al. (2013) · Journal of Trauma and Acute Care Surgery · doi:10.1097/ta.0b013e3182914553 · Cited by 32
Hunger to Violence: Explaining the Violent Escalation of Nonviolent Demonstrations
Gustafson, D. (2020) · Journal of Conflict Resolution · doi:10.1177/0022002719890669 · Cited by 31
Cultural entrenchment of folktales is encoded in language
Karsdorp, F., & Fonteyn, L. (2019) · Palgrave Communications · doi:10.1057/s41599-019-0234-9 · Cited by 20
Csárdi, G., Franks, A., Choi, D. S., Airoldi, E. M., & Drummond, D. A. (2014) · doi:10.1101/009472 · Cited by 8
Metadata
- Authors
- Gelman, A., Jakulin, A., Pittau, M. G., & Su, Y.-S.
- Venue
- The Annals of Applied Statistics
- Publisher
- Institute of Mathematical Statistics
- Published
- 2008-12-01
- Volume
- 2
- Issue
- 4
- Pages
- 1360-1383
- ISSN
- 1932-6157 (ISSN-L)
- OpenAlex
- W2008640468
- Cited by
- 1,790
- References
- 7
- FWCI
- 14.90
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
