The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
The Evidence Framework Applied to Classification Networks
Abstract
Three Bayesian ideas are presented for supervised adaptive classifiers. First, it is argued that the output of a classifier should be obtained by marginalizing over the posterior distribution of the parameters; a simple approximation to this integral is proposed and demonstrated. This involves a "moderation" of the most probable classifier's outputs, and yields improved performance. Second, it is demonstrated that the Bayesian framework for model comparison described for regression models in MacKay (1992a,b) can also be applied to classification problems. This framework successfully chooses the magnitude of weight decay terms, and ranks solutions found using different numbers of hidden units. Third, an information-based data selection criterion is derived and demonstrated within this framework.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.415 · Cited by 4,388
Self-citationA practical Bayesian framework for backpropagation networks
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.448 · Cited by 2,917
Self-citationBridle, J. S. (1990) · Neurocomputing · doi:10.1007/978-3-642-76153-9_28 · Cited by 1,237
Information-based objective functions for active data selection
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.4.590 · Cited by 1,221
Self-citationLearning and relearning in Boltzmann machines
Hinton, G. E., & Sejnowski, T. J. (2001) · Graphical Models · doi:10.7551/mitpress/3349.003.0005 · Cited by 1,037
Statistical mechanics of learning from examples
Seung, H. S., Sompolinsky, H., & Tishby, N. (1992) · Physical Review A · doi:10.1103/physreva.45.6056 · Cited by 532
Sequential updating of conditional probabilities on directed graphical structures
Spiegelhalter, D. J., & Lauritzen, S. L. (1990) · Networks · doi:10.1002/net.3230200507 · Cited by 521
Accelerated learning in layered neural networks
Solla, S. A., Levin, E., & Fleisher, M. (1988) · Complex Systems · Cited by 213
Learning algorithms and probability distributions in feed-forward and feed-back networks
Hopfield, J. J. (1987) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.84.23.8429 · Cited by 189
Neural net algorithms that learn in polynomial time from examples and queries
Baum, E. B. (1991) · IEEE Transactions on Neural Networks · doi:10.1109/72.80287 · Cited by 168
Cited by
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705
Statistical pattern recognition: a review
Jain, A. K., Duin, P. W., & Mao, J. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824819 · Cited by 6,767
A practical Bayesian framework for backpropagation networks
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.448 · Cited by 2,917
Self-citation(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/15324430152748236 · Cited by 1,819
A sequential algorithm for training text classifiers
Lewis, D., & Gale, W. A. (1994) · arXiv (Cornell University) · doi:10.5555/188490.188495 · Cited by 1,731
Information-based objective functions for active data selection
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.4.590 · Cited by 1,221
Self-citationLessmann, S., Baesens, B., Mues, C., & Pietsch, S. (2008) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2008.35 · Cited by 1,226
A Sequential Algorithm for Training Text Classifiers
Lewis, D. D., & Gale, W. A. (1994) · SIGIR ’94 · doi:10.1007/978-1-4471-2099-5_1 · Cited by 1,208
Heterogeneous Uncertainty Sampling for Supervised Learning
Lewis, D. D., & Catlett, J. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50026-x · Cited by 1,150
Neural networks and their applications
Bishop, C. M. (1994) · Review of Scientific Instruments · doi:10.1063/1.1144830 · Cited by 926
Benchmarking state-of-the-art classification algorithms for credit scoring
Baesens, B., Van Gestel, T., Viaene, S., Stepanova, M., Suykens, J., & Vanthienen, J. (2003) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2601545 · Cited by 904
Neural Networks and Deep Learning
Theodoridis, S. (2015) · Machine Learning · doi:10.1016/b978-0-12-801522-3.00018-5 · Cited by 900
Combining Machine Learning and Computational Chemistry for Predictive Insights Into Chemical Systems
Keith, J. A., Vassilev-Galindo, V., Cheng, B., Chmiela, S., Gastegger, M., Müller, K.-R., & Tkatchenko, A. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.1c00107 · Cited by 849
Lower Upper Bound Estimation Method for Construction of Neural Network-Based Prediction Intervals
Khosravi, A., Nahavandi, S., Creighton, D., & Atiya, A. F. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2010.2096824 · Cited by 758
Probabilistic Forecasting of Wind Power Generation Using Extreme Learning Machine
Wan, C., Xu, Z., Pinson, P., Dong, Z. Y., & Wong, K. P. (2014) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2013.2287871 · Cited by 753
Mining data with random forests: A survey and results of new tests
Verikas, A., Gelzinis, A., & Bacauskiene, M. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2010.08.011 · Cited by 719
Comprehensive Review of Neural Network-Based Prediction Intervals and New Advances
Khosravi, A., Nahavandi, S., Creighton, D., & Atiya, A. F. (2011) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2011.2162110 · Cited by 694
Bayesian methods for adaptive models
Mackay, D. (1992) · doi:10.7907/h3a1-wm07 · Cited by 610
Self-citationFinancial Fraud: A Review of Anomaly Detection Techniques and Recent Advances
Hilal, W., Gadsden, S. A., & Yawney, J. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.116429 · Cited by 610
Modeling chemical processes using prior knowledge and neural networks'
Thompson, M. L., & Kramer, M. A. (1994) · AIChE Journal · doi:10.1002/aic.690400806 · Cited by 596
Committee-Based Sampling For Training Probabilistic Classifiers
Dagan, I., & Engelson, S. P. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50027-x · Cited by 499
A Bayesian/Information Theoretic Model of Learning to Learn via Multiple Task Sampling
Baxter, J. (1997) · Machine Learning · doi:10.1023/a:1007327622663 · Cited by 462
Buckinx, W., & Van den Poel, D. (2005) · European Journal of Operational Research · doi:10.1016/j.ejor.2003.12.010 · Cited by 424
Variational Relevance Vector Machines
Bishop, C., & Tipping, M. E. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.3838 · Cited by 352
Active learning for logistic regression: an evaluation
Schein, A. I., & Ungar, L. H. (2007) · Machine Learning · doi:10.1007/s10994-007-5019-5 · Cited by 346
Optimal Prediction Intervals of Wind Power Generation
Wan, C., Xu, Z., Pinson, P., Dong, Z. Y., & Wong, K. P. (2014) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2013.2288100 · Cited by 328
(2013) · Cited by 326
Fault diagnosis of low speed bearing based on relevance vector machine and support vector machine
Widodo, A., Kim, E. Y., Son, J.-D., Yang, B.-S., Tan, A. C. C., Gu, D.-S., Choi, B.-K., & Mathew, J. (2009) · Expert Systems with Applications · doi:10.1016/j.eswa.2008.09.033 · Cited by 324
“The approximation procedure proposed by MacKay (1992), which is based on Laplace’s method is used as the following:”
MethodMackay, D. J. C. (1995) · Network Computation in Neural Systems · doi:10.1088/0954-898x/6/3/011 · Cited by 915
Bayesian approaches to Gaussian mixture modeling
Roberts, S. J., Husmeier, D., Rezek, I., & Penny, W. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.730550 · Cited by 317
Detection of Skin Cancer by Classification of Raman Spectra
Sigurdsson, S., Philipsen, P. A., Hansen, L. K., Larsen, J., Gniadecka, M., & Wulf, H. C. (2004) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2004.831538 · Cited by 295
Gestel, T. V., Suykens, J. A. K., Lanckriet, G., Lambrechts, A., Moor, B. D., & Vandewalle, J. (2002) · Neural Computation · doi:10.1162/089976602753633411 · Cited by 291
Natural computing for mechanical systems research: A tutorial overview
Worden, K., Staszewski, W. J., & Hensman, J. J. (2011) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2010.07.013 · Cited by 288
Construction of Optimal Prediction Intervals for Load Forecasting Problems
Khosravi, A., Nahavandi, S., & Creighton, D. (2010) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2010.2042309 · Cited by 267
Bayesian Inference: An Introduction to Principles and Practice in Machine Learning
Tipping, M. E. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-28650-9_3 · Cited by 265
Improving Quantitative Studies of International Conflict: A Conjecture
Beck, N. L., King, G., & Zeng, L. (2000) · American Political Science Review · doi:10.1017/s0003055400220078 · Cited by 257
Personalized Multitask Learning for Predicting Tomorrow's Mood, Stress, and Health
Taylor, S., Jaques, N., Nosakhare, E., Sano, A., & Picard, R. (2020) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2017.2784832 · Cited by 251
Bayesian Methods for Neural Networks and Related Models
Titterington, D. M. (2004) · Statistical Science · doi:10.1214/088342304000000099 · Cited by 162
Clinical prediction from structural brain MRI scans: A large-scale empirical study
Initiative, F. T. A. D. N., Sabuncu, M. R., & Konukoglu, E. (2015) · Neuroinformatics · doi:10.1007/s12021-014-9238-1 · Cited by 161
“RVM builds on MacKay’s Automatic Relevance Determination (ARD) framework (MacKay 1992) and employs a Gaussian prior on the weight parameters, which are (approximately) integrated (or marginalized) out during learning and prediction.”
MethodExact Calculation of the Hessian Matrix for the Multilayer Perceptron
Bishop, C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.4.494 · Cited by 146
Mena, J., Pujol, O., & Vitrià, J. (2022) · ACM Computing Surveys · doi:10.1145/3477140 · Cited by 114
“Initially, efforts focused on approximating the integral analytically [56], either by sampling model parameters [66] or substituting it with tractable posteriors [39].”
BackgroundMethodInfluentialWidodo, A., Yang, B.-S., Kim, E. Y., Tan, A. C. C., & Mathew, J. (2009) · Nondestructive Testing and Evaluation · doi:10.1080/10589750802378974 · Cited by 58
Mohsenzadeh, Y., Sheikhzadeh, H., & Nazari, S. (2016) · Pattern Recognition · doi:10.1016/j.patcog.2016.06.028 · Cited by 22
Quantifying uncertainty in deep learning approaches to radio galaxy classification
Mohan, D., Scaife, A. M. M., Porter, F., Walmsley, M., & Bowles, M. (2022) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stac223 · Cited by 16
I Find Your Lack of Uncertainty in Computer Vision Disturbing
Valdenegro-Toro, M. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw53098.2021.00139 · Cited by 15
Metadata
- Authors
- MacKay, D. J. C.
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 1992-09
- Volume
- 4
- Issue
- 5
- Pages
- 720-736
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2088538739
- Cited by
- 722
- References
- 13
- FWCI
- 8.94
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.