The DOI matches its Crossref record.
10.1162/15324430152748236
Abstract
This paper introduces a general Bayesian framework for obtaining sparse solutions to regression and classification tasks utilising models linear in the parameters. Although this framework is fully general, we illustrate our approach with a particular specialisation that we denote the 'relevance vector machine' (RVM), a model of identical functional form to the popular and state-of-the-art 'support vector machine' (SVM). We demonstrate that by exploiting a probabilistic Bayesian learning framework, we can derive accurate prediction models which typically utilise dramatically fewer basis functions than a comparable SVM while offering a number of additional advantages. These include the benefits of probabilistic predictions, automatic estimation of 'nuisance' parameters, and the facility to utilise arbitrary basis functions (e.g. non-'Mercer' kernels). We detail the Bayesian framework and associated learning algorithm for the RVM, and give some illustrative examples of its application along with some comparative benchmarks. We offer some explanation for the exceptional degree of sparsity obtained, and discuss and demonstrate some of the advantageous features, and potential extensions, of Bayesian relevance learning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
“relevance vectors Empirically it is often observed that the number of relevance vectors is smaller than the number of support vectors on the same problem [Tipping, 2001].”
InfluentialDEAP: A Database for Emotion Analysis ;Using Physiological Signals
Koelstra, S., Muhl, C., Soleymani, M., Lee, J.-S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., & Patras, I. (2012) · IEEE Transactions on Affective Computing · doi:10.1109/t-affc.2011.15 · Cited by 5,093
Ji, S., Xue, Y., & Carin, L. (2008) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2007.914345 · Cited by 2,406
Variational free energy and the Laplace approximation
Friston, K., Mattout, J., Trujillo-Barreto, N., Ashburner, J., & Penny, W. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2006.08.035 · Cited by 880
Hoefler, T., Alistarh, D., Ben-Nun, T., Dryden, N., & Peste, A. (2021) · ETH Zurich · doi:10.3929/ethz-b-000519202 · Cited by 423
Fault diagnosis of low speed bearing based on relevance vector machine and support vector machine
Widodo, A., Kim, E. Y., Son, J.-D., Yang, B.-S., Tan, A. C. C., Gu, D.-S., Choi, B.-K., & Mathew, J. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.09.033 · Cited by 324
Advanced BrainAGE in older adults with type 2 diabetes mellitus
Franke, K., Gaser, C., Manor, B., & Novak, V. (2013) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2013.00090 · Cited by 221
Driver Behavior and Situation Aware Brake Assistance for Intelligent Vehicles
McCall, J. C., & Trivedi, M. M. (2007) · Proceedings of the IEEE · doi:10.1109/jproc.2006.888388 · Cited by 229
Computational Health Informatics in the Big Data Age: A Survey
Fang, R., Pouyanfar, S., Yang, Y., Chen, S.-C., & Iyengar, S. S. (2017) · ACM Computing Surveys · doi:10.1145/2932707 · Cited by 210
Bayesian Methods for Neural Networks and Related Models
Titterington, D. M. (2004) · Statistical Science · doi:10.1214/088342304000000099 · Cited by 162
A Comprehensive Study of Activity Recognition Using Accelerometers
Twomey, N., Diethe, T., Fafoutis, X., Elsts, A., McConville, R., Flach, P., & Craddock, I. (2018) · Informatics · doi:10.3390/informatics5020027 · Cited by 143
Prabhudesai, S., Yang, L., Asthana, S., Huan, X., Liao, Q. V., & Banovic, N. (2023) · Proceedings of the 28th International Conference on Intelligent User Interfaces · doi:10.1145/3581641.3584033 · Cited by 82
CellOracle: Dissecting cell identity via network inference and in silico gene perturbation
Kamimoto, K., Hoffmann, C. M., & Morris, S. A. (2020) · doi:10.1101/2020.02.17.947416 · Cited by 81
Variational Bayesian Sparse Kernel-Based Blind Image Deconvolution With Student's-t Priors
Tzikas, D. G., Likas, A. C., & Galatsanos, N. P. (2009) · IEEE Transactions on Image Processing · doi:10.1109/tip.2008.2011757 · Cited by 80
Multitask Sparse Bayesian Learning with Applications in Structural Health Monitoring
Huang, Y., Beck, J. L., & Li, H. (2019) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12408 · Cited by 79
Model Fusion for Multimodal Depression Classification and Level Detection
Senoussaoui, M., Sarria-Paja, M., Santos, J. F., & Falk, T. H. (2014) · Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge · doi:10.1145/2661806.2661819 · Cited by 80
Widodo, A., Yang, B.-S., Kim, E. Y., Tan, A. C. C., & Mathew, J. (2009) · Nondestructive Testing and Evaluation · doi:10.1080/10589750802378974 · Cited by 58
Tognin, S., Pettersson-Yeo, W., Valli, I., Hutton, C., Woolley, J., Allen, P., McGuire, P., & Mechelli, A. (2014) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2013.00187 · Cited by 56
Huang, Y., & Beck, J. L. (2018) · Computer-Aided Civil and Infrastructure Engineering · doi:10.1111/mice.12358 · Cited by 53
Prognostics of Lithium-Ion Batteries Based on Wavelet Denoising and DE-RVM
Zhang, C., He, Y., Yuan, L., Xiang, S., & Wang, J. (2015) · Computational Intelligence and Neuroscience · doi:10.1155/2015/918305 · Cited by 50
Sparse Bayesian learning for structural damage detection using expectation–maximization technique
Hou, R., Xia, Y., Zhou, X., & Huang, Y. (2019) · Structural Control and Health Monitoring · doi:10.1002/stc.2343 · Cited by 49
Variational Bayesian inference for linear and logistic regression
Drugowitsch, J. (2013) · arXiv · doi:10.48550/arxiv.1310.5438 · Cited by 49
(2011) · Cited by 42
Supersparse Linear Integer Models for Interpretable Classification
Ustun, B., Tracà, S., & Rudin, C. (2013) · arXiv · doi:10.48550/arxiv.1306.6677 · Cited by 26
(2016) · doi:10.1145/2988257.2988265 · Cited by 26
BrainAGE and regional volumetric analysis of a Buddhist monk: a longitudinal MRI case study
Adluru, N., Korponay, C. H., Norton, D. L., Goldman, R. I., & Davidson, R. J. (2020) · Neurocase · doi:10.1080/13554794.2020.1731553 · Cited by 20
Miladinović, A., Ajčević, M., Battaglini, P. P., Silveri, G., Ciacchi, G., Morra, G., Jarmolowska, J., & Accardo, A. (2020) · IFMBE Proceedings · doi:10.1007/978-3-030-31635-8_225 · Cited by 18
Metadata
- Venue
- CrossRef Listing of Deleted DOIs
- Publisher
- Unmaintained records
- Published
- 2000
- Volume
- 1
- ISSN
- 0003-6951 (ISSN-L)
- OpenAlex
- W1648445109
- Cited by
- 1,819
- References
- 0
- FWCI
- 12.49
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
