Predictive automatic relevance determination by expectation propagation
Abstract
In many real-world classification problems the input contains a large number of potentially ir-relevant features. This paper proposes a new Bayesian framework for determining the rele-vance of input features. This approach extends one of the most successful Bayesian methods for feature selection and sparse learning, known as Automatic Relevance Determination (ARD). ARD finds the relevance of features by optimiz-ing the model marginal likelihood, also known as the evidence. We show that this can lead to over-fitting. To address this problem, we propose Pre-dictive ARD based on estimating the predictive performance of the classifier. While the actual leave-one-out predictive performance is generally very costly to compute, the expectation propaga-tion (EP) algorithm proposed by Minka provides an estimate of this predictive performance as a side-effect of its iterations. We exploit this in our algorithm to do feature selection, and to select data points in a sparse Bayesian kernel classifier. Moreover, we provide two other improvements to previous algorithms, by replacing Laplace’s approximation with the generally more accurate EP, and by incorporating the fast optimization algorithm proposed by Faul and Tipping. Our experiments show that our method based on the EP estimate of predictive performance is more accurate on test data than relevance determina-tion by optimizing the evidence.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Mackay, D. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.415 · Cited by 4,440 · see citing works
Bayesian Learning for Neural Networks
Neal, R. M. (1996) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-0745-0 · Cited by 4,276 · see citing works
Expectation Propagation for approximate Bayesian inferencePreprint
Minka, T. P. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.2294 · Cited by 1,391 · see citing works
Self-citationRätsch, G., Onoda, T., & Müller, K. R. (2001) · Machine Learning · doi:10.1023/a:1007618119488 · Cited by 1,302 · see citing works
Tipping, M. E. (1999) · Cited by 869 · see citing works
Analysis of Sparse Bayesian Learning
Faul, A., & Tipping, M. E. (2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.003.0054 · Cited by 289 · see citing works
Gaussian Processes for Classification: Mean-Field Algorithms
Opper, M., & Winther, O. (2000) · Neural Computation · doi:10.1162/089976600300014881 · Cited by 209 · see citing works
Bayesian automatic relevance determination algorithms for classifying gene expression data
Li, Y., Campbell, C., & Tipping, M. E. (2002) · Bioinformatics · doi:10.1093/bioinformatics/18.10.1332 · Cited by 175 · see citing works
Flagged first, then by citations
1 of the 9 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
(2010) · doi:10.5555/1756006.1859921 · Cited by 1,924 · see citing works
Zhang, Y., Tang, Q., Zhang, Y., Wang, J., Stimming, U., & Lee, A. A. (2020) · Nature Communications · doi:10.1038/s41467-020-15235-7 · Cited by 889 · see citing works
Sparse multinomial logistic regression: fast algorithms and generalization bounds
Krishnapuram, B., Carin, L., Figueiredo, M. A. T., & Hartemink, A. J. (2005) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2005.127 · Cited by 872 · see citing works
Bayesian Inference and Optimal Design for the Sparse Linear Model
Seeger, M. (2008) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.5555/1390681.1390707 · Cited by 283 · see citing works
Cawley, G. C., & Talbot, N. L. C. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl386 · Cited by 241 · see citing works
Preventing Over-Fitting during Model Selection via Bayesian Regularisation of the Hyper-Parameters
Cawley, G. C., & Talbot, N. L. C. (2007) · UEA Digital Repository (University of East Anglia) · doi:10.5555/1248659.1248690 · Cited by 227 · see citing works
Variational Bayesian Multinomial Probit Regression with Gaussian Process Priors
Girolami, M., & Rogers, S. (2006) · Neural Computation · doi:10.1162/neco.2006.18.8.1790 · Cited by 195 · see citing works
Automatic relevance determination for multi‐way models
Mørup, M., & Hansen, L. K. (2009) · Journal of Chemometrics · doi:10.1002/cem.1223 · Cited by 161 · see citing works
Biomarker discovery in microarray gene expression data with Gaussian processes
Chu, W., Zoubin Ghahramani, A., Francesco Falciani, B., & Wild, D. L. (2005) · Computer applications in the biosciences · doi:10.1093/bioinformatics/bti526 · Cited by 117 · see citing works
Predictive Ensemble Pruning by Expectation Propagation
Chen, H., Peter Tiňo, B., & Yao, X. (2009) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.62 · Cited by 111 · see citing works
Li, K.-Y., de Lima, R. S., Burnside, N. G., Vahtmäe, E., Kutser, T., Sepp, K., Pinheiro, V. H. C., Yang, M., Vain, A., & Sepp, K. (2022) · Remote Sensing · doi:10.3390/rs14051114 · Cited by 86 · see citing works
Probabilistic Multi-Task Feature Selection
Zhang, Y., Yeung, D., & Xu, Q. (2010) · Cited by 83 · see citing works
Bayesian inference for generalized linear models for spiking neurons
Gerwinn, S. (2010) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2010.00012 · Cited by 66 · see citing works
Encoding Tree Sparsity in Multi-Task Learning: A Probabilistic Framework
Han, L., Zhang, Y., Song, G., & Xie, K. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.9009 · Cited by 56 · see citing works
Algorithms for Sparse Linear Classifiers in the Massive Data Setting
Balakrishnan, S., Madigan, D., & Bartlett, P. (2008) · doi:10.7916/d8z0368x · Cited by 54 · see citing works
On Bayesian classification with Laplace priors
Kabán, A. (2007) · Pattern Recognition Letters · doi:10.1016/j.patrec.2007.02.010 · Cited by 46 · see citing works
Sabuncu, M. R., & Leemput, K. V. (2012) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2012.2216543 · Cited by 44 · see citing works
Yu, P., Initiative, A. D. N., Dean, R. A., Hall, S. D., Qi, Y., Sethuraman, G., Willis, B. A., Siemers, E., Martényi, F., Tauscher, J. T., et al. (2012) · Journal of Alzheimer s Disease · doi:10.3233/jad-2012-120832 · Cited by 39 · see citing works
Self-citationRiihimäki, J., Jylänki, P., & Vehtari, A. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1207.3649 · Cited by 36 · see citing works
Bayesian Inference for Sparse Generalized Linear Models
Seeger, M., Gerwinn, S., & Bethge, M. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74958-5_29 · Cited by 34 · see citing works
Automated analysis of musical structure
Vercoe, B. L., & Chai, W. (2005) · Cited by 33 · see citing works
Hierarchical Manifold Learning for Regional Image Analysis
Bhatia, K. K., Rao, A. W., Price, A. N., Wolz, R., Hajnal, J. V., & Rueckert, D. (2013) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2013.2287121 · Cited by 32 · see citing works
Sparse Bayesian Learning for Identifying Imaging Biomarkers in AD Prediction
Shen, L., Qi, Y., Kim, S., Nho, K. T., Wan, J., Risacher, S. L., Saykin, A. J., & ADNI, A. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15711-0_76 · Cited by 30 · see citing works
Self-citationTensor Rank Estimation and Completion via CP-based Nuclear Norm
Shi, Q., Lu, H., & Cheung, Y. (2017) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3132847.3132945 · Cited by 30 · see citing works
Incremental GRLVQ: Learning relevant features for 3D object recognition
Kietzmann, T. C., Lange, S., & Riedmiller, M. (2007) · Neurocomputing · doi:10.1016/j.neucom.2007.08.018 · Cited by 30 · see citing works
Zilker, S., Weinzierl, S., Kraus, M., Zschech, P., & Matzner, M. (2024) · Health Care Management Science · doi:10.1007/s10729-024-09673-8 · Cited by 29 · see citing works
Bias-Correction of Regression Models: A Case Study on hERG Inhibition
Hansen, K., Rathke, F., Schroeter, T. S., Rast, G. F., Fox, T., Kriegl, J. M., & Mika, S. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci9000794 · Cited by 27 · see citing works
Tuning pruning in sparse non-negative matrix factorization
Mørup, M., & Hansen, L. K. (2009) · Technical University of Denmark, DTU Orbit (Technical University of Denmark, DTU) · Cited by 26 · see citing works
Xu, Z., Li, H., Yazdi, M., Ouyang, K., & Peng, W. (2022) · Electronics · doi:10.3390/electronics11233863 · Cited by 25 · see citing works
Sparse Gaussian Process Regression via L1 Penalization
Yan, F., & Qi, Y. (2010) · International Conference on Machine Learning · Cited by 24 · see citing works
Self-citationAutomatic identification of novel bacteria using Raman spectroscopy and Gaussian processes
Kemmler, M., Rodner, E., Rösch, P., Popp, J., & Denzler, J. (2013) · Analytica Chimica Acta · doi:10.1016/j.aca.2013.07.051 · Cited by 24 · see citing works
Automated heart abnormality detection using sparse linear classifiers
Qazi, M., Fung, G., Krishnan, S., Bi, J., Rao, R., & Katz, A. S. (2007) · IEEE Engineering in Medicine and Biology Magazine · doi:10.1109/memb.2007.335591 · Cited by 23 · see citing works
Cheng, H., Zheng, Y., Wu, S., Lin, Y., Gao, F., Lin, D., Wei, J., Wang, S., Shu, D., Wei, S., et al. (2023) · Ore Geology Reviews · doi:10.1016/j.oregeorev.2023.105627 · Cited by 21 · see citing works
Two of a kind or the ratings game? Adaptive pairwise preferences and latent factor models
Balakrishnan, S., & Chopra, S. (2012) · Frontiers of Computer Science · doi:10.1007/s11704-012-2871-7 · Cited by 21 · see citing works
Cross-Validation Optimization for Large Scale Structured Classification Kernel Methods
Seeger, M. (2008) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.5555/1390681.1390720 · Cited by 21 · see citing works
Analyzing travel behavior in Hanoi using Support Vector Machine
Truong, T. M. T., Ly, H., Lee, D., Pham, B. T., & Derrible, S. (2021) · Transportation Planning and Technology · doi:10.1080/03081060.2021.1992178 · Cited by 20 · see citing works
Machine Learning in Medical Imaging
Michel, V., Eger, E., Keribin, C., & Thirion, B. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15948-0 · Cited by 20 · see citing works
Nguyen, D., Tan, A., Lee, R., Lim, W. F., Hui, T. F., & Suhaimi, F. (2024) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2024.108892 · Cited by 19 · see citing works
Identifying main effects and interactions among exposures using Gaussian processes
Ferrari, F., & Dunson, D. B. (2020) · The Annals of Applied Statistics · doi:10.1214/20-aoas1363 · Cited by 19 · see citing works
Expectation Propagation for Neural Networks with Sparsity-promoting PriorsPreprint
JylänkiPasi, NummenmaaAapo, & VehtariAki (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1303.6938 · Cited by 20 · see citing works
Emotion recognition from speech using prosodic features
Väyrynen, E. (2014) · Cited by 15 · see citing works
Fractional Norm Regularization: Learning With Very Few Relevant Features
Kabán, A. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2247417 · Cited by 16 · see citing works
Discovering spatio-temporal dependencies based on time-lag in intelligent transportation data
Zhou, X., Hong, H., Xing, X., Bian, K., Xie, K., & Xu, M. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.06.084 · Cited by 15 · see citing works
Machine learning in the life sciences
Cios, K. J., Kurgan, L., & Reformat, M. (2007) · IEEE Engineering in Medicine and Biology Magazine · doi:10.1109/memb.2007.335579 · Cited by 15 · see citing works
Two of a Kind or the Ratings Game? Adaptive Pairwise Preferences and Latent Factor Models
Balakrishnan, S., & Chopra, S. (2010) · Proceedings · doi:10.1109/icdm.2010.149 · Cited by 14 · see citing works
Probabilistic classifiers with a generalized Gaussian scale mixture prior
Liu, G., Wu, J., & Zhou, S. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2012.07.016 · Cited by 14 · see citing works
A probabilistic framework for learning task relationships in multi-task learning
Zhang, Y. (2011) · doi:10.14711/thesis-b1155168 · Cited by 14 · see citing works
Nested expectation propagation for Gaussian process classification
Riihimäki, J., Jylänki, P., & Vehtari, A. (2013) · Journal of Machine Learning Research · Cited by 13 · see citing works
Multiclass Sparse Bayesian Regression for fMRI-Based Prediction
Michel, V., Eger, E., Keribin, C., & Thirion, B. (2011) · International Journal of Biomedical Imaging · doi:10.1155/2011/350838 · Cited by 12 · see citing works
Selecting useful features for personal credit risk analysis
Li, S., Chaudhari, N. S., & Dash, M. (2010) · International Journal of Business Information Systems · doi:10.1504/ijbis.2010.035745 · Cited by 12 · see citing works
Distributed neural signatures of natural audiovisual speech and music in the human auditory cortex
Salmi, J., Koistinen, O.-P., Glerean, E., Jylänki, P., Vehtari, A., Jääskeläinen, I. P., Mäkelä, S., Nummenmaa, L., Nummi-Kuisma, K., Nummi, I., et al. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.12.005 · Cited by 12 · see citing works
Cross-Validation Optimization for Large Scale Hierarchical Classification Kernel Methods
Seeger, M. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7503.003.0159 · Cited by 12 · see citing works
Hernández-Lobato, J. M. (2010) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 11 · see citing works
Extending expectation propagation for graphical models
Qi, Y., & Picard, R. W. (2005) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 11 · see citing works
Self-citationQi, Y., Missiuro, P. V., Kapoor, A., Hunter, C. P., Jaakkola, T., Gifford, D. K., & Ge, H. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl256 · Cited by 9 · see citing works
Self-citationLearning discriminative models with incomplete data
Picard, R. W., & Kapoor, A. (2006) · Cited by 9 · see citing works
Self-citationEmulation of random output simulators
Boukouvalas, A. (2010) · Aston Publications Explorer (Aston University) · doi:10.48780/publications.aston.ac.uk.00039333 · Cited by 9 · see citing works
Probabilistic dynamic causal model for temporal data
Zhou, X., Huang, W., Zhang, N., Hu, W., Du, S., Song, G., & Xie, K. (2015) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2015.7280468 · Cited by 8 · see citing works
He, L., Pitkäniemi, J. M., Sarin, A., Salomaa, V. V., Sillanpää, M. J., & Ripatti, S. (2014) · Genetic Epidemiology · doi:10.1002/gepi.21871 · Cited by 8 · see citing works
Partial logistic relevance vector machines in survival analysis
Lama, N., Boracchi, P., & Biganzoli, E. M. (2011) · Journal of Applied Statistics · doi:10.1080/02664763.2011.559204 · Cited by 8 · see citing works
Data-driven blended equations of state for condensed-phase explosives
Lee, K., Hernández, A., Stewart, D. S., & Lee, S. (2021) · Combustion Theory and Modelling · doi:10.1080/13647830.2021.1887524 · Cited by 7 · see citing works
Breast Tumor Susceptibility to Chemotherapy Via Support Vector Machines
Fung, G., & Mangasarian, O. L. (2006) · Computational Management Science · doi:10.1007/s10287-005-0002-8 · Cited by 7 · see citing works
Using Ensembles of Neural Networks to Improve Automatic Relevance Determination
Fu, Y., & Browne, A. (2007) · IEEE International Conference on Neural Networks/IEEE ... International Conference on Neural Networks · doi:10.1109/ijcnn.2007.4371195 · Cited by 7 · see citing works
On primal and dual sparsity of Markov networks
Zhu, J., & Xing, E. P. (2009) · International Conference on Machine Learning · doi:10.1145/1553374.1553536 · Cited by 7 · see citing works
Vellido, A. (2005) · Cited by 7 · see citing works
A Tutorial on Gaussian Processes (or why I don't use SVMs)
Zoubin Ghahramani, A. (2011) · Cited by 6 · see citing works
Single-frame image recovery using a Pearson type VII MRF
Kabán, A., & Pitchay, S. A. (2011) · Neurocomputing · doi:10.1016/j.neucom.2011.07.025 · Cited by 6 · see citing works
Multiple kernel Gaussian process classification for generic 3D object recognition
Rodner, E., Hegazy, D., & Denzler, J. (2010) · International Conference on Image and Vision Computing New Zealand (IVCNZ) · doi:10.1109/ivcnz.2010.6148815 · Cited by 6 · see citing works
Application of Bayesian networks to predict SMART power semiconductor lifetime
Plankensteiner, K., Bluder, O., & Pilz, J. (2013) · Conference on Ph.D. Research in Microelectronics and Electronics · doi:10.1109/prime.2013.6603175 · Cited by 6 · see citing works
Pointwise profile monitoring considering covariates based on Gaussian process
Ding, N., He, Z., & He, S. (2024) · Computers & Industrial Engineering · doi:10.1016/j.cie.2024.110348 · Cited by 5 · see citing works
Raval, C. U., Makwana, A., Patel, S. G., Hemani, R. J., & Pandey, S. N. (2025) · International Journal of Clinical Pharmacy · doi:10.1007/s11096-025-01899-y · Cited by 5 · see citing works
Mining Dependencies Considering Time Lag in Spatio-Temporal Traffic Data
Zhou, X., Hong, H., Xing, X., Huang, W., Bian, K., & Xie, K. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-21042-1_23 · Cited by 5 · see citing works
Baek, S., Kang, E., Sohn, B., Kim, S., & Shi, H. (2023) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2023.3293137 · Cited by 5 · see citing works
Carbide Coated Insert Health Monitoring Using Machine Learning Approach through Vibration Analysis
Bohara, N., Jegadeeshwaran, R., & Sakthivel, G. (2020) · International Journal of Prognostics and Health Management · doi:10.36001/ijphm.2017.v8i2.2635 · Cited by 5 · see citing works
Statistical Causality for Multivariate Nonlinear Time Series via Gaussian Process Models
Zaremba, A., & Peters, G. W. (2022) · Methodology And Computing In Applied Probability · doi:10.1007/s11009-022-09928-3 · Cited by 5 · see citing works
Sparse classifiers for Automated HeartWall Motion Abnormality Detection
Fung, G., Qazi, M., Krishnan, S., Bi, J., Rao, B., & Katz, A. (2006) · International Conference on Machine Learning and Applications · doi:10.1109/icmla.2005.59 · Cited by 5 · see citing works
Non-parametric generalized linear modelPreprint
Dowling, M., Zhao, Y., & Park, I. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.01362 · Cited by 5 · see citing works
Bayesian Network Model with Application to Smart Power Semiconductor Lifetime Data
Plankensteiner, K., Bluder, O., & Pilz, J. (2015) · Risk Analysis · doi:10.1111/risa.12342 · Cited by 4 · see citing works
Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., & Rubin, D. B. (2013) · Chapman & Hall/CRC eBooks · doi:10.1201/b16018-28 · Cited by 4 · see citing works
Fast Algorithms and Generalization Bounds
Krishnapuram, B., Carin, L., Figueiredo, M. A. T., & Hartemink, A. J. (2005) · Cited by 3 · see citing works
Sparse Coding and Automatic Relevance Determination for Multi-way models
Mørup, M., & Hansen, L. K. (2009) · Technical University of Denmark, DTU Orbit (Technical University of Denmark, DTU) · Cited by 3 · see citing works
Multi-Class Sparse Bayesian Regression for Neuroimaging Data Analysis
Michel, V., Eger, E., Keribin, C., & Thirion, B. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15948-0_7 · Cited by 3 · see citing works
Cross-Validation Optimization for Structured Hessian Kernel Methods
Seeger, M., & Chapelle, O. (2006) · MPG.PuRe (Max Planck Society) · Cited by 3 · see citing works
EigenNet: A Bayesian hybrid of generative and conditional models for sparse learning
Feng, Y., & Qi, Y. (2011) · neural information processing systems · Cited by 2 · see citing works
Self-citationFinding Discriminative Features for Raman Spectroscopy
Kemmler, M., & Denzler, J. (2015) · Cited by 2 · see citing works
A Hierarchical Bayesian Hidden Markov Model for Multi-Dimensional Discrete Data
Motoi, S., Nakada, Y., Misu, T., Yazaki, T., Matsumoto, T., & Yagi, N. (2008) · InTech eBooks · doi:10.5772/6319 · Cited by 2 · see citing works
Vetrov, D., Kropotov, D., & Ptashko, N. (2009) · Computational Mathematics and Mathematical Physics · doi:10.1134/s096554250911013x · Cited by 1 · see citing works
Kurnianingsih, K., Suharjono, A., Suryono, S., Widyowati, R., & Kubota, N. (2021) · IEEE Region 10 Symposium (TENSYMP) · doi:10.1109/tensymp52854.2021.9550816 · Cited by 1 · see citing works
Bayesian Prediction of SMART Power Semiconductor Lifetime with Bayesian Networks
Plankensteiner, K., Bluder, O., & Pilz, J. (2013) · Springer proceedings in mathematics & statistics · doi:10.1007/978-3-319-02084-6_22 · Cited by 1 · see citing works
Variational Relevance Vector Machine for Tabular Data
Kropotov, D., Vetrov, D., Wolf, L., & Hassner, T. (2010) · Cited by 1 · see citing works
EigenGP: Sparse Gaussian process models with data-dependent eigenfunctionsPreprint
Qi, Y., Dai, B., & Zhu, Y. T. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1204.3972 · Cited by 1 · see citing works
Self-citationA novel hierarchical Bayesian HMM for multi-dimensional discrete data
Motoi, S., Nakada, Y., Misu, T., Matsumoto, T., & Yagi, N. (2008) · International conference on Artificial intelligence and applications · Cited by 1 · see citing works
Predictive Approaches For Gaussian Process Classifier Model SelectionPreprint
Sellamanickam, S., & Selvaraj, S. K. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6038 · Cited by 1 · see citing works
Algorithmic decision making in financial markets
Ghoshal, S. (2018) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-eravmjvx7 · Cited by 1 · see citing works
Advances in single frame image recovery
Pitchay, S. A. (2013) · University of Birmingham Institutional Research Archive (University of Birmingham)
Extended Linear Models with Gaussian Prior on the Parameters and Adaptive Expansion Vectors
Barrio, I., Romero, E. E., & Belanche, L. (2007) · Lecture notes in computer science · doi:10.1007/978-3-540-74690-4_44
Relevant regressors selection by continuous AIC
Kropotov, D., Ptashko, N., & Vetrov, D. (2009) · Pattern Recognition and Image Analysis · doi:10.1134/s1054661809030109
Kropotov, D. (2011) · Computational Mathematics and Mathematical Physics · doi:10.1134/s0965542511080124
Qazi, M. A., Fung, G., Krishnan, S., Bi, J., Rao, R. B., & Katz, A. S. (2007)
Music Classification with Partial Selection Based on Confidence Measures
Chai, W., & Vercoe, B. L. (2005)
- Authors
- Qi, Y. (., Minka, T. P., Picard, R. W., & Ghahramani, Z.
- Affiliations
- MIT Media Lab (US)
- Microsoft Research (United Kingdom) (GB)
- Venue
- Twenty-first international conference on Machine learning - ICML '04
- Publisher
- ACM Press
- Published
- 2004
- Pages
- 85
- OpenAlex
- W2156140776
- Cited by
- 110
- References
- 9
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 3 · 2023: 2 · 2022: 3 · 2021: 3 · 2020: 4 · 2018: 1 · 2017: 2 · 2016: 1 · 2015: 6 · 2014: 3 · 2013: 9 · 2012: 9
- FWCI
- 5.83
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Machine Learning (publishedVersion)
- Cambridge University Engineering Department Publications Database (submittedVersion)
- Funders
- MIT Media Lab
- Gatsby Charitable Foundation
- Defense Advanced Research Projects Agency
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Bayesian Modeling and Causal Inference
- Keywords
- automatic relevance determination, expectation propagation, feature selection, sparse Bayesian learning, overfitting, evidence, Laplace approximation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review