The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Bayesian Interpolation
Abstract
Although Bayesian analysis has been in use since Laplace, the Bayesian method of model-comparison has only recently been developed in depth. In this paper, the Bayesian approach to regularization and model-comparison is demonstrated by studying the inference problem of interpolating noisy data. The concepts and methods described are quite general and can be applied to many other data modeling problems. Regularizing constants are set by examining their posterior probability distribution. Alternative regularizers (priors) and alternative basis sets are objectively compared by evaluating the evidence for them. “Occam's razor” is automatically embodied by this process. The way in which Bayes infers the values of regularizing constants and noise levels has an elegant interpretation in terms of the effective number of parameters determined by the data set. This framework is due to Gull and Skilling.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033
Modeling by shortest data description
Rissanen, J. (1978) · Automatica · doi:10.1016/0005-1098(78)90005-5 · Cited by 6,011
A practical Bayesian framework for backpropagation networks
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.448 · Cited by 2,917
Self-citationProbability, Frequency and Reasonable Expectation
Cox, R. T. (1946) · American Journal of Physics · doi:10.1119/1.1990764 · Cited by 1,308
Statistical predictor identification
Akaike, H. (1970) · Annals of the Institute of Statistical Mathematics · doi:10.1007/bf02506337 · Cited by 1,250
An Information Measure for Classification
Wallace, C. S., & Boulton, D. M. (1968) · The Computer Journal · doi:10.1093/comjnl/11.2.185 · Cited by 933
Estimation and Inference by Compact Coding
Wallace, C. S., & Freeman, P. R. (1987) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1987.tb01695.x · Cited by 523
On the Asymptotic Behaviour of Posterior Distributions
Walker, A. M. (1969) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1969.tb00767.x · Cited by 332
Common Structure of Smoothing Techniques in Statistics
Titterington, D. M. (1985) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1402932 · Cited by 219
Optimisation in the regularisation ill-posed problems
Davies, A. R., & Anderssen, R. (1986) · ANZIAM Journal · doi:10.1017/s0334270000005221 · Cited by 30
Cited by
Items 101–161 of 161
Modeling of daily pan evaporation in sub tropical climates using ANN, LS-SVR, Fuzzy Logic, and ANFIS
Goyal, M. K., Bharti, B., Quilty, J., Adamowski, J., & Pandey, A. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.02.047 · Cited by 292
Cappellari, M. (2023) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stad2597 · Cited by 290
Perez-Ramirez, C. A., Amezquita-Sanchez, J. P., Valtierra-Rodriguez, M., Adeli, H., Dominguez-Gonzalez, A., & Romero-Troncoso, R. J. (2019) · Engineering Structures · doi:10.1016/j.engstruct.2018.10.065 · Cited by 288
Corn cash price forecasting with neural networks
Xu, X., & Zhang, Y. (2021) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2021.106120 · Cited by 288
Analysis of Sparse Bayesian Learning
Faul, A. C., & Tipping, M. E. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0054 · Cited by 287
Gianola, D., Okut, H., Weigel, K. A., & Rosa, G. J. (2011) · BMC Genetics · doi:10.1186/1471-2156-12-87 · Cited by 287
Forecasting diurnal cooling energy load for institutional buildings using Artificial Neural Networks
Deb, C., Eang, L. S., Yang, J., & Santamouris, M. (2016) · Energy and Buildings · doi:10.1016/j.enbuild.2015.12.050 · Cited by 283
A Bayesian approach to reconstructing genetic regulatory networks with hidden factors
Beal, M. J., Falciani, F., Ghahramani, Z., Rangel, C., & Wild, D. L. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti014 · Cited by 283
Expanded uncertainty quantification in inverse problems: Hierarchical Bayes and empirical Bayes
Malinverno, A., & Briggs, V. A. (2004) · Geophysics · doi:10.1190/1.1778243 · Cited by 282
Ahmad, Z., Xie, T., Maheshwari, C., Grossman, J. C., & Viswanathan, V. (2018) · ACS Central Science · doi:10.1021/acscentsci.8b00229 · Cited by 279
Predicting short-term stock prices using ensemble methods and online data sources
Weng, B., Lu, L., Wang, X., Megahed, F. M., & Martinez, W. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.06.016 · Cited by 278
Automatic hourly solar forecasting using machine learning models
Yagli, G. M., Yang, D., & Srinivasan, D. (2019) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2019.02.006 · Cited by 278
Bayesian Inference and Optimal Design for the Sparse Linear Model
Seeger, M. (2008) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.5555/1390681.1390707 · Cited by 277
Sensitivity and Generalization in Neural Networks: an Empirical Study
Novak, R., Bahri, Y., Abolafia, D. A., Pennington, J., & Sohl‐Dickstein, J. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.08760 · Cited by 275
Teräsvirta, T., van Dijk, D., & Medeiros, M. C. (2005) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2005.04.010 · Cited by 274
Pachori, R. B., & Patidar, S. (2014) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2013.11.014 · Cited by 272
Muto, M., & Beck, J. L. (2008) · Journal of Vibration and Control · doi:10.1177/1077546307079400 · Cited by 272
Prediction of blast-induced ground vibration using artificial neural networks
Monjezi, M., Ghafurikalajahi, M., & Bahrami, A. (2011) · Tunnelling and Underground Space Technology · doi:10.1016/j.tust.2010.05.002 · Cited by 267
Zhang, Y., Zhou, G., Jin, J., Wang, X., & Cichocki, A. (2015) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2015.08.004 · Cited by 266
Bayesian Inference: An Introduction to Principles and Practice in Machine Learning
Tipping, M. E. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-28650-9_3 · Cited by 265
Mars, R. B., Debener, S., Gladwin, T. E., Harrison, L. M., Haggard, P., Rothwell, J. C., & Bestmann, S. (2008) · The Journal of Neuroscience · doi:10.1523/jneurosci.2925-08.2008 · Cited by 264
Sparse Bayesian Classification of EEG for Brain–Computer Interface
Zhang, Y., Zhou, G., Jin, J., Zhao, Q., Wang, X., & Cichocki, A. (2016) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2015.2476656 · Cited by 264
Design of inferential sensors in the process industry: A review of Bayesian methods
Khatibisepehr, S., Huang, B., & Khare, S. (2013) · Journal of Process Control · doi:10.1016/j.jprocont.2013.05.007 · Cited by 262
Bayesian model averaging in EEG/MEG imaging
Trujillo-Barreto, N. J., Aubert-Vázquez, E., & Valdés-Sosa, P. A. (2004) · NeuroImage · doi:10.1016/j.neuroimage.2003.11.008 · Cited by 262
Forecasting aggregate retail sales:
Alon, I., Qi, M., & Sadowski, R. J. (2001) · Journal of Retailing and Consumer Services · doi:10.1016/s0969-6989(00)00011-4 · Cited by 258
Probabilistic Independence Networks for Hidden Markov Probability Models
Smyth, P., Heckerman, D., & Jordan, M. I. (1997) · Neural Computation · doi:10.1162/neco.1997.9.2.227 · Cited by 257
Improving Quantitative Studies of International Conflict: A Conjecture
Beck, N. L., King, G., & Zeng, L. (2000) · American Political Science Review · doi:10.1017/s0003055400220078 · Cited by 257
Bayesian fMRI time series analysis with spatial priors
Penny, W. D., Trujillo-Barreto, N. J., & Friston, K. J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.08.034 · Cited by 256
An investigation of model selection criteria for neural network time series forecasting
Qi, M., & Zhang, G. P. (2001) · European Journal of Operational Research · doi:10.1016/s0377-2217(00)00171-5 · Cited by 256
On the evaluation of the viscosity of nanofluid systems: Modeling and data assessment
Hemmati-Sarapardeh, A., Varamesh, A., Husein, M. M., & Karan, K. (2018) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2017.07.049 · Cited by 255
Robust Bayesian mixture modelling
Svensén, M., & Bishop, C. M. (2005) · Neurocomputing · doi:10.1016/j.neucom.2004.11.018 · Cited by 254
Predicting outcome and recovery after stroke with lesions extracted from MRI images
Hope, T. M. H., Seghier, M. L., Leff, A. P., & Price, C. J. (2013) · NeuroImage: Clinical · doi:10.1016/j.nicl.2013.03.005 · Cited by 243
Nasief, H., Zheng, C., Schott, D., Hall, W., Tsai, S., Erickson, B., & Allen Li, X. (2019) · npj Precision Oncology · doi:10.1038/s41698-019-0096-z · Cited by 181
Radiocarbon constraints on the glacial ocean circulation and its impact on atmospheric CO2
Skinner, L. C., Primeau, F., Freeman, E., de la Fuente, M., Goodwin, P. A., Gottschalk, J., Huang, E., McCave, I. N., Noble, T. L., & Scrivner, A. E. (2017) · Nature Communications · doi:10.1038/ncomms16010 · Cited by 178
Generative embedding for model-based classification of fMRI data
Brodersen, K. H., Schofield, T. M., Leff, A. P., Ong, C. S., Lomakina, E. I., Buhmann, J. M., & Stephan, K. E. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002079 · Cited by 165
Bayesian Methods for Neural Networks and Related Models
Titterington, D. M. (2004) · Statistical Science · doi:10.1214/088342304000000099 · Cited by 162
Weight Agnostic Neural Networks
Gaier, A., & Ha, D. (2019) · Unpublished · doi:10.13140/rg.2.2.16025.88169 · Cited by 161
Model averaging, optimal inference, and habit formation
FitzGerald, T. H. B., Dolan, R. J., & Friston, K. J. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00457 · Cited by 121
Van Gelder, L., Das, P., Janssen, H., & Roels, S. (2014) · Simulation Modelling Practice and Theory · doi:10.1016/j.simpat.2014.10.004 · Cited by 123
Mena, J., Pujol, O., & Vitrià, J. (2022) · ACM Computing Surveys · doi:10.1145/3477140 · Cited by 114
“Compared to [55], which also looked at variations in the output once the model is trained, in [39] the variance during the training is also taken into account.”
BackgroundPredictive automatic relevance determination by expectation propagation
Qi, Y. (., Minka, T. P., Picard, R. W., & Ghahramani, Z. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015418 · Cited by 110
Cecotti, H., Eckstein, M. P., & Giesbrecht, B. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2302898 · Cited by 109
Supervised uncertainty quantification for segmentation with multiple annotations
Hu, S., Worrall, D., Knegt, S., Veeling, B., Huisman, H., & Welling, M. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32245-8_16 · Cited by 105
HIERARCHICAL SPARSE BAYESIAN LEARNING FOR STRUCUTRAL HEALTH MONITORING WITH INCOMPLETE MODAL DATA
Huang, Y., & Beck, J. L. (2015) · International Journal for Uncertainty Quantification · doi:10.1615/int.j.uncertaintyquantification.2015011808 · Cited by 87
Rosa, S. M., Soria, M. A., Vélez, C. G., & Galvagno, M. A. (2010) · Bioresource Technology · doi:10.1016/j.biortech.2009.11.056 · Cited by 78
Simões, M., Borra, D., Santamaría-Vázquez, E., GBT-UPM, Bittencourt-Villalpando, M., Krzemiński, D., Miladinović, A., Neural_Engineering_Group, Schmid, T., Zhao, H., et al. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.568104 · Cited by 72
“The modeling applied in this approach is similar to the one proposed by Bishop (2006) with a variation of Automatic Relevance Determination (ARD) that instead of using type-II maximum likelihood (MacKay, 1992), applies full Bayesian treatment (Drugowitsch, 2013).”
MethodMarathe, A. R., Lawhern, V. J., Wu, D., Slayback, D., & Lance, B. J. (2016) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2015.2502323 · Cited by 64
Faisal, A., Dondelinger, F., Husmeier, D., & Beale, C. M. (2010) · Ecological Informatics · doi:10.1016/j.ecoinf.2010.06.005 · Cited by 61
ANN modelling of fractal dimension in machining
Sahoo, P., & Barman, T. K. (2012) · Mechatronics and Manufacturing Engineering · doi:10.1533/9780857095893.159 · Cited by 60
Cecotti, H., & Ries, A. J. (2017) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2016.07.500 · Cited by 50
Variational Bayesian inference for linear and logistic regression
Drugowitsch, J. (2013) · arXiv · doi:10.48550/arxiv.1310.5438 · Cited by 49
Epistemic Communities under Active Inference
Albarracin, M., Demekas, D., Ramstead, M. J. D., & Heins, C. (2022) · Entropy · doi:10.3390/e24040476 · Cited by 60
“The remaining (negative) surprise can be 371 itself used as a score for model averaging and model selection [118,119].”
Döppel, F. A., & Votsmeier, M. (2022) · Chemical Engineering Science · doi:10.1016/j.ces.2022.117964 · Cited by 38
Model-based feature construction for multivariate decoding
Brodersen, K. H., Haiss, F., Ong, C. S., Jung, F., Tittgemeyer, M., Buhmann, J. M., Weber, B., & Stephan, K. E. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.04.036 · Cited by 36
“In this framework, the best model is the one with the highest (log) model evidence, that is, the highest probability of the data given the model (MacKay, 1992).”
MethodA robust time-dependent model of alkali-silica reaction at different temperatures
Allahyari, H., Heidarpour, A., Shayan, A., & Nguyen, V. P. (2020) · Cement and Concrete Composites · doi:10.1016/j.cemconcomp.2019.103460 · Cited by 24
Rinderknecht, M. D., & Klopfenstein, Y. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00482-9 · Cited by 23
Bong, H. K., Selvarajoo, A., & Arumugasamy, S. K. (2022) · Environmental Monitoring and Assessment · doi:10.1007/s10661-021-09691-x · Cited by 21
Robust Sensor Fusion and Biomimetic Control of a Lower-Limb Exoskeleton With Multimodal Sensors
Arceo, J. C., Yu, L., & Bai, S. (2025) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2024.3421318 · Cited by 19
Miladinović, A., Ajčević, M., Battaglini, P. P., Silveri, G., Ciacchi, G., Morra, G., Jarmolowska, J., & Accardo, A. (2020) · IFMBE Proceedings · doi:10.1007/978-3-030-31635-8_225 · Cited by 18
(2019) · arXiv (Cornell University) · Cited by 17
Intention Inference for Human-Robot Collaboration in Assistive Robotics
Ravichandar, H. C., & Dani, A. (2017) · Human Modelling for Bio-Inspired Robotics · doi:10.1016/b978-0-12-803137-7.00007-0 · Cited by 5
Metadata
- Authors
- MacKay, D. J. C.
- Venue
- Neural Computation
- Publisher
- MIT Press
- Published
- 1992-05
- Volume
- 4
- Issue
- 3
- Pages
- 415-447
- ISSN
- 0899-7667 (ISSN-L)
- 1530-888X
- OpenAlex
- W2911546748
- Cited by
- 4,388
- References
- 10
- FWCI
- 28.62
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.