The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Large-Scale Bayesian Logistic Regression for Text Categorization
Abstract
Logistic regression analysis of high-dimensional data, such as natural language text, poses computational and statistical challenges. Maximum likelihood estimation often fails in these applications. We present a simple Bayesian logistic regression approach that uses a Laplace prior to avoid overfitting and produces sparse predictive models for text data. We apply this approach to a range of document classification problems and show that it produces compact predictive models at least as effective as those produced by support vector machine classifiers or ridge logistic regression combined with feature selection. We describe our model fitting algorithm, our open source implementations (BBR and BMR), and experimental results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Neural networks for pattern recognition
(1994) · Choice Reviews Online · doi:10.5860/choice.31-5500 · Cited by 18,538
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
Term-weighting approaches in automatic text retrieval
Salton, G., & Buckley, C. (1988) · Information Processing & Management · doi:10.1016/0306-4573(88)90021-0 · Cited by 9,740
Ridge regression: Biased estimation for nonorthogonal problems
Hoerl, A. E., & Kennard, R. W. (1970) · Technometrics · doi:10.1080/00401706.1970.10488634 · Cited by 9,648
Efron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
An algorithm for suffix stripping
Porter, M. F. (1980) · Program · doi:10.1108/eb046814 · Cited by 8,096
Text categorization with Support Vector Machines: Learning with many relevant features
Joachims, T. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0026683 · Cited by 7,999
Cited by
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
“Some of the new classification algorithms in WEKA 3.6 include • Bayesian logistic regression [13]: the BLR method for text categorization, with both Gaussian and Laplace priors.”
InfluentialNearly unbiased variable selection under minimax concave penalty
Zhang, C.-H. (2010) · The Annals of Statistics · doi:10.1214/09-aos729 · Cited by 3,835
Regression Shrinkage and Selection via The Lasso: A Retrospective
Tibshirani, R. (2011) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2011.00771.x · Cited by 3,589
A weakly informative default prior distribution for logistic and other regression models
Gelman, A., Jakulin, A., Pittau, M. G., & Su, Y.-S. (2008) · The Annals of Applied Statistics · doi:10.1214/08-aoas191 · Cited by 1,790
The Development and Psychometric Properties of LIWC2015
Pennebaker, J. W., Boyd, R. L., Jordan, K., & Blackburn, K. (2015) · University of Texas at Austin · doi:10.15781/t25p41 · Cited by 1,674
The Group Lasso for Logistic Regression
Meier, L., Van De Geer, S., & Bühlmann, P. (2008) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00627.x · Cited by 1,674
Text Classification Algorithms: A Survey
Kowsari, K., Jafari Meimandi, K., Heidarysafa, M., Mendu, S., Barnes, L., & Brown, D. (2019) · Information · doi:10.3390/info10040150 · Cited by 1,312
Marketing Analytics for Data-Rich Environments
Wedel, M., & Kannan, P. K. (2016) · Journal of Marketing · doi:10.1509/jm.15.0413 · Cited by 1,261
“Alternatively, lasso-type methods can be used, which place a Laplace prior on coef fi cients (Genkin, Lewis, and Madigan 2007).”
Optimization for Machine Learning
(2011) · The MIT Press eBooks · doi:10.7551/mitpress/8996.001.0001 · Cited by 875
L 1-Regularization Path Algorithm for Generalized Linear Models
Park, M. Y., & Hastie, T. (2007) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2007.00607.x · Cited by 838
L1Penalized Estimation in the Cox Proportional Hazards Model
Goeman, J. J. (2010) · Biometrical Journal · doi:10.1002/bimj.200900028 · Cited by 816
Optimization with Sparsity-Inducing Penalties
Bach, F., Jenatton, R., Mairal, J., & Obozinski, G. (2025) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000015 · Cited by 730
A Model of Text for Experimentation in the Social Sciences
Roberts, M. E., Stewart, B. M., & Airoldi, E. M. (2016) · Journal of the American Statistical Association · doi:10.1080/01621459.2016.1141684 · Cited by 728
Partial Correlation Estimation by Joint Sparse Regression Models
Peng, J., Wang, P., Zhou, N., & Zhu, J. (2009) · Journal of the American Statistical Association · doi:10.1198/jasa.2009.0126 · Cited by 688
Educational data mining: A survey and a data mining-based analysis of recent works
Peña-Ayala, A. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.08.042 · Cited by 660
Machine Learning Meta-analysis of Large Metagenomic Datasets: Tools and Biological Insights
Pasolli, E., Truong, D. T., Malik, F., Waldron, L., & Segata, N. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004977 · Cited by 659
Optimization with Sparsity-Inducing Penalties
Bach, F. (2011) · now publishers, Inc. eBooks · doi:10.1561/9781601985118 · Cited by 608
Shah, K., Patel, H., Sanghvi, D., & Shah, M. (2020) · Augmented Human Research · doi:10.1007/s41133-020-00032-0 · Cited by 576
Penalized regression, standard errors, and Bayesian lassos
Casella, G., Ghosh, M., Gill, J., & Kyung, M. (2010) · Bayesian Analysis · doi:10.1214/10-ba607 · Cited by 567
An empirical evaluation of supervised learning in high dimensions
Caruana, R., Karampatziakis, N., & Yessenalina, A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390169 · Cited by 524
Computational methods in authorship attribution
Koppel, M., Schler, J., & Argamon, S. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20961 · Cited by 528
A user browsing model to predict search engine click data from past observations.
Dupret, G. E., & Piwowarski, B. (2008) · Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/1390334.1390392 · Cited by 442
Stang, P. E., Ryan, P. B., Racoosin, J. A., Overhage, J. M., Hartzema, A. G., Reich, C., Welebob, E., Scarnecchia, T., & Woodcock, J. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-153-9-201011020-00010 · Cited by 441
“Other methods Bayesian logistic regression (32, 33) Columbia University This is a high-dimensional statistical method that is scalable to a substantial number of covariates, accommodating all drugs and conditions in a single model to predict occurrence of ADEs.”
MethodA review of machine learning in processing remote sensing data for mineral exploration
Shirmard, H., Farahbakhsh, E., Müller, R. D., & Chandra, R. (2022) · Remote Sensing of Environment · doi:10.1016/j.rse.2021.112750 · Cited by 420
Novel Data-Mining Methodologies for Adverse Drug Event Discovery and Analysis
Harpaz, R., DuMouchel, W., Shah, N. H., Madigan, D., Ryan, P., & Friedman, C. (2012) · Clinical Pharmacology & Therapeutics · doi:10.1038/clpt.2012.50 · Cited by 393
Self-citationAutomatically profiling the author of an anonymous text
Argamon, S., Koppel, M., Pennebaker, J. W., & Schler, J. (2009) · Communications of the ACM · doi:10.1145/1461928.1461959 · Cited by 376
Onan, A., Korukoğlu, S., & Bulut, H. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.06.005 · Cited by 367
Investigating Capsule Networks with Dynamic Routing for Text Classification
Yang, M., Zhao, W., Ye, J., Lei, Z., Zhao, Z., & Zhang, S. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1350 · Cited by 366
Emotion recognition using a hierarchical binary decision tree approach
Lee, C.-C., Mower, E., Busso, C., Lee, S., & Narayanan, S. (2011) · Speech Communication · doi:10.1016/j.specom.2011.06.004 · Cited by 355
Simultaneous Analysis of All SNPs in Genome-Wide and Re-Sequencing Association Studies
Hoggart, C. J., Whittaker, J. C., De Iorio, M., & Balding, D. J. (2008) · PLoS Genetics · doi:10.1371/journal.pgen.1000130 · Cited by 321
Shrinkage observed-to-expected ratios for robust and transparent large-scale pattern discovery
Norén, G. N., Hopstadius, J., & Bate, A. (2013) · Statistical Methods in Medical Research · doi:10.1177/0962280211403604 · Cited by 336
Wager, T. D., Atlas, L. Y., Leotti, L. A., & Rilling, J. K. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.3420-10.2011 · Cited by 328
“Modern regression techniques used in machine learning can provide solutions to both of these problems (Michalski et al., 1986; Bishop, 2006; Genkin et al., 2007).”
MethodData Mining in Healthcare – A Review
Jothi, N., Rashid, N. A., & Husain, W. (2015) · Procedia Computer Science · doi:10.1016/j.procs.2015.12.145 · Cited by 300
Stochastic methods for l 1 regularized loss minimization
Shalev-Shwartz, S., & Tewari, A. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553493 · Cited by 298
Recent Advances of Large-Scale Linear Classification
Yuan, G.-X., Ho, C.-H., & Lin, C.-J. (2012) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2188013 · Cited by 266
A Survey on Text Classification Algorithms: From Text to Predictions
Gasparetto, A., Marcuzzo, M., Zangari, A., & Albarelli, A. (2022) · Information · doi:10.3390/info13020083 · Cited by 253
Toward Optimal Feature Selection in Naive Bayes for Text Categorization
Tang, B., Kay, S., & He, H. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2563436 · Cited by 253
Quantitative forecasting of PTSD from early trauma responses: A Machine Learning application
Galatzer-Levy, I. R., Karstoft, K.-I., Statnikov, A., & Shalev, A. Y. (2014) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2014.08.017 · Cited by 195
Naseem, U., Razzak, I., Khan, S. K., & Prasad, M. (2021) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3434237 · Cited by 194
Decision support methods for the detection of adverse events in post-marketing data
Hauben, M., & Bate, A. (2009) · Drug Discovery Today · doi:10.1016/j.drudis.2008.12.012 · Cited by 163
A stopping criterion for active learning
Vlachos, A. (2008) · Computer Speech & Language · doi:10.1016/j.csl.2007.12.001 · Cited by 153
Detecting, Tracing, and Monitoring Architectural Tactics in Code
Mirakhorli, M., & Cleland-Huang, J. (2016) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2015.2479217 · Cited by 85
A generalized Dantzig selector with shrinkage tuning
James, G. M., & Radchenko, P. (2009) · Biometrika · doi:10.1093/biomet/asp013 · Cited by 67
Replication-based regularization approaches to diagnose Reinke’s edema by using voice recordings
Naranjo, L., Pérez, C. J., Campos-Roca, Y., & Madruga, M. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102162 · Cited by 11
Metadata
- Authors
- Genkin, A., Lewis, D. D., & Madigan, D.
- Venue
- Technometrics
- Publisher
- Informa UK Limited
- Published
- 2007-08
- Volume
- 49
- Issue
- 3
- Pages
- 291-304
- ISSN
- 0040-1706 (ISSN-L)
- 1537-2723
- OpenAlex
- W2166183437
- Cited by
- 808
- References
- 56
- FWCI
- 58.70
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.