The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Learning Bayesian networks: The combination of knowledge and statistical data
Open accessAbstract
We describe a Bayesian approach for learning Bayesian networks from a combination of prior knowledge and statistical data. First and foremost, we develop a methodology for assessing informative priors needed for learning. Our approach is derived from a set of assumptions made previously as well as the assumption oflikelihood equivalence, which says that data should not help to discriminate network structures that represent the same assertions of conditional independence. We show that likelihood equivalence when combined with previously made assumptions implies that the user's priors for network parameters can be encoded in a single Bayesian network for the next case to be seen—aprior network—and a single measure of confidence for that network. Second, using these priors, we show how to compute the relative posterior probabilities of network structures given data. Third, we describe search methods for identifying network structures with high posterior probabilities. We describe polynomial algorithms for finding the highest-scoring network structures in the special case where every node has at mostk=1 parent. For the general case (k>1), which is NP-hard, we review heuristic search algorithms including local search, iterative local search, and simulated annealing. Finally, we describe a methodology for evaluating Bayesian-network learning algorithms, and apply this approach to a comparison of various approaches.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Equation of State Calculations by Fast Computing Machines
Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953) · The Journal of Chemical Physics · doi:10.1063/1.1699114 · Cited by 37,192
On Information and Sufficiency
Kullback, S., & Leibler, R. A. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729694 · Cited by 20,193
(1988) · Cited by 16,582
Causation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (1993) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2748-9 · Cited by 4,617
Maximum Likelihood from Incomplete Data via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1976) · Cited by 4,517
A Bayesian method for the induction of probabilistic networks from data
Cooper, G. F., & Herskovits, E. (1992) · Machine Learning · doi:10.1007/bf00994110 · Cited by 4,204
Lectures on Functional Equations and their Applications.
Hahn, F., Aczel, J., & Oser, H. (1968) · The American Mathematical Monthly · doi:10.2307/2314998 · Cited by 2,594
Approximating discrete probability distributions with dependence trees
Chow, C., & Liu, C. (1968) · IEEE Transactions on Information Theory · doi:10.1109/tit.1968.1054142 · Cited by 1,720
Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window
Madigan, D., & Raftery, A. E. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476894 · Cited by 1,205
Research works printed but not linked: 7
- Chickering, D. (March, 1995b). Search operators for learning equivalence classes of Bayesian- network structures. Technical Report R231, Cognitive Systems Laboratory, University of California, Los Angeles.
- Edmonds, J. (1967). Optimum brachching.J. Res. NBS 71B:233?240.
- Gabow, H. (1977). Siam journal of computing.Networks 6:139?150.
- Good, I. (1965).The Estimation of Probabilities. MIT Press, Cambridge, MA.
- Howard, R. & Matheson, J. (1981). Influence diagrams. In Howard, R. and Matheson, J., editors,Readings on the Principles and Applications of Decision Analysis, volume II, pages 721?762. Strategic Decisions Group, Menlo Park, CA.
- Matzkevich, I. & Abramson, B. (1993). Deriving a minimal I-map of a belief network relative to a target ordering of its nodes. InProceedings of Ninth Conference on Uncertainty in Artificial Intelligence, Washington, DC, pages 159?165. Morgan Kaufmann.
- York, J. (1992).Bayesian methods for the analysis of misclassified or incomplete multivariate discrete data. PhD thesis. Department of Statistics, University of Washington, Seattle.
Cited by
Friedman, N., Geiger, D., & Goldszmidt, M. (1997) · Machine Learning · doi:10.1023/a:1007465528199 · Cited by 4,742
Self-citationHoeting, J. A., Madigan, D., Raftery, A. E., & Volinsky, C. T. (1999) · Statistical Science · doi:10.1214/ss/1009212519 · Cited by 4,118
Using Bayesian Networks to Analyze Expression Data
Friedman, N., Linial, M., Nachman, I., & Pe'er, D. (2000) · Journal of Computational Biology · doi:10.1089/106652700750050961 · Cited by 3,266
Richardson, M., & Domingos, P. (2006) · Machine Learning · doi:10.1007/s10994-006-5833-1 · Cited by 2,676
Machine learning: a review of classification and combining techniques
Kotsiantis, S. B., Zaharakis, I. D., & Pintelas, P. E. (2006) · Artificial Intelligence Review · doi:10.1007/s10462-007-9052-3 · Cited by 1,582
Active Learning with Statistical Models
Cohn, D. A., Ghahramani, Z., & Jordan, M. I. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.295 · Cited by 1,317
Advantages and challenges of Bayesian networks in environmental modelling
Uusitalo, L. (2007) · Ecological Modelling · doi:10.1016/j.ecolmodel.2006.11.033 · Cited by 1,118
Bayesian Graphical Models for Discrete Data
Madigan, D., York, J., & Allard, D. (1995) · International Statistical Review / Revue Internationale de Statistique · doi:10.2307/1403615 · Cited by 1,090
On Bias, Variance, 0/1—Loss, and the Curse-of-Dimensionality
Friedman, J. H. (1997) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009778005914 · Cited by 1,040
Obtaining well calibrated probabilities using Bayesian binning
Pakdaman Naeini, M., Cooper, G., & Hauskrecht, M. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9602 · Cited by 991
Learning Bayesian networks from data: An information-theory based approach
Cheng, J., Greiner, R., Kelly, J., Bell, D., & Liu, W. (2002) · Artificial Intelligence · doi:10.1016/s0004-3702(02)00191-1 · Cited by 803
Marcot, B. G., Steventon, J. D., Sutherland, G. D., & McCann, R. K. (2006) · Canadian Journal of Forest Research · doi:10.1139/x06-135 · Cited by 667
Bayesian networks in environmental modelling
Aguilera, P. A., Fernández, A., Fernández, R., Rumí, R., & Salmerón, A. (2011) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2011.06.004 · Cited by 666
Good practice in Bayesian network modelling
Chen, S. H., & Pollino, C. A. (2012) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2012.03.012 · Cited by 657
Predicting Gene Expression from Sequence
Beer, M. A., & Tavazoie, S. (2004) · Cell · doi:10.1016/s0092-8674(04)00304-6 · Cited by 599
Bayesian networks in reliability
Langseth, H., & Portinale, L. (2007) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2005.11.037 · Cited by 571
Operations for Learning with Graphical Models
Buntine, W. L. (1994) · Journal of Artificial Intelligence Research · doi:10.1613/jair.62 · Cited by 530
A tutorial on calibration measurements and calibration models for clinical prediction models
Huang, Y., Li, W., Macheret, F., Gabriel, R. A., & Ohno-Machado, L. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz228 · Cited by 486
An introduction and survey of estimation of distribution algorithms
Hauschild, M., & Pelikan, M. (2011) · Swarm and Evolutionary Computation · doi:10.1016/j.swevo.2011.08.003 · Cited by 478
A guide to the literature on learning probabilistic networks from data
Buntine, W. (1996) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.494161 · Cited by 468
The Role of Occam's Razor in Knowledge Discovery
Domingos, P. (1999) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009868929893 · Cited by 459
A characterization of Markov equivalence classes for acyclic digraphs
Andersson, S. A., Madigan, D., & Perlman, M. D. (1997) · The Annals of Statistics · doi:10.1214/aos/1031833662 · Cited by 425
Evaluating implicit measures to improve web search
Fox, S., Karnawat, K., Mydland, M., Dumais, S., & White, T. (2005) · ACM Transactions on Information Systems · doi:10.1145/1059981.1059982 · Cited by 412
Learning Bayesian Networks with Local Structure
Friedman, N., & Goldszmidt, M. (1998) · Learning in Graphical Models · doi:10.1007/978-94-011-5014-9_15 · Cited by 397
Bayesian indoor positioning systems
Madigan, D., Einahrawy, E., Martin, R. P., Ju, W.-H., Krishnan, P., & Krishnakumar, A. S. (2005) · Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies. · doi:10.1109/infcom.2005.1498348 · Cited by 388
Bayesian belief networks: applications in ecology and natural resource management
McCann, R. K., Marcot, B. G., & Ellis, R. (2006) · Canadian Journal of Forest Research · doi:10.1139/x06-238 · Cited by 381
Adaptive Probabilistic Networks with Hidden Variables
Binder, J., Koller, D., Russell, S., & Kanazawa, K. (1997) · Machine Learning · doi:10.1023/a:1007421730016 · Cited by 377
Online Model Selection Based on the Variational Bayes
Sato, M.-A. (2001) · Neural Computation · doi:10.1162/089976601750265045 · Cited by 375
A Survey of Learning Causality with Data: Problems and Methods
Guo, R., Cheng, L., Li, J., Hahn, P. R., & Liu, H. (2021) · ACM Computing Surveys · doi:10.1145/3397269 · Cited by 362
Causal independence for probability assessment and inference using Bayesian networks
Heckerman, D., & Breese, J. S. (1996) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.541341 · Cited by 358
Self-citationGevaert, O., Smet, F. D., Timmerman, D., Moreau, Y., & Moor, B. D. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl230 · Cited by 351
Goldszmidt, M. (2011) · Wiley Encyclopedia of Operations Research and Management Science · doi:10.1002/9780470400531.eorms0099 · Cited by 351
Knowledge Graph Completion: A Review
Chen, Z., Wang, Y., Zhao, B., Cheng, J., Zhao, X., & Duan, Z. (2020) · IEEE Access · doi:10.1109/access.2020.3030076 · Cited by 346
Learning With Bayesian Networks
Heckerman, D. (1995) · Machine Learning Proceedings 1995 · doi:10.1016/b978-1-55860-377-6.50079-7 · Cited by 335
Self-citationMarkov Logic: An Interface Layer for Artificial Intelligence
Domingos, P., & Lowd, D. (2009) · Synthesis lectures on artificial intelligence and machine learning · doi:10.2200/s00206ed1v01y200907aim007 · Cited by 314
Learning Bayesian Networks: The Combination of Knowledge and Statistical Data
Heckerman, D., Geiger, D., & Chickering, D. M. (1994) · Uncertainty Proceedings 1994 · doi:10.1016/b978-1-55860-332-5.50042-0 · Cited by 261
Self-citationProbabilistic Independence Networks for Hidden Markov Probability Models
Smyth, P., Heckerman, D., & Jordan, M. I. (1997) · Neural Computation · doi:10.1162/neco.1997.9.2.227 · Cited by 257
Self-citationTurn-taking cues in task-oriented dialogue
Gravano, A., & Hirschberg, J. (2011) · Computer Speech & Language · doi:10.1016/j.csl.2010.10.003 · Cited by 254
D’ya Like DAGs? A Survey on Structure Learning and Causal Discovery
Vowels, M. J., Camgoz, N. C., & Bowden, R. (2023) · ACM Computing Surveys · doi:10.1145/3527154 · Cited by 237
Strong Completeness and Faithfulness in Bayesian Networks
Meek, C. (2013) · arXiv · doi:10.48550/arxiv.1302.4973 · Cited by 194
Methods for causal inference from gene perturbation experiments and validation
Meinshausen, N., Hauser, A., Mooij, J. M., Peters, J., Versteeg, P., & Bühlmann, P. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1510493113 · Cited by 140
Probabilistic Embedding of Knowledge Graphs with Box Lattice Measures
Vilnis, L., Li, X., Murty, S., & McCallum, A. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1025 · Cited by 111
Chaibub Neto, E., Keller, M. P., Attie, A. D., & Yandell, B. S. (2010) · The Annals of Applied Statistics · doi:10.1214/09-aoas288 · Cited by 110
Morales-Navarrete, H., Segovia-Miranda, F., Klukowski, P., Meyer, K., Nonaka, H., Marsico, G., Chernykh, M., Kalaidzidis, A., Zerial, M., & Kalaidzidis, Y. (2015) · eLife · doi:10.7554/elife.11214 · Cited by 98
Duering, M., Gonik, M., Malik, R., Zieren, N., Reyes, S., Jouvent, E., Hervé, D., Gschwendtner, A., Opherk, C., Chabriat, H., et al. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.10.084 · Cited by 89
Faisal, A., Dondelinger, F., Husmeier, D., & Beale, C. M. (2010) · Ecological Informatics · doi:10.1016/j.ecoinf.2010.06.005 · Cited by 61
Marini, S., Trifoglio, E., Barbarini, N., Sambo, F., Di Camillo, B., Malovini, A., Manfrini, M., Cobelli, C., & Bellazzi, R. (2015) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2015.08.021 · Cited by 61
Modeling asynchronous event sequences with RNNs
Wu, S., Liu, S., Sohn, S., Moon, S., Wi, C.-I., Juhn, Y., & Liu, H. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.05.016 · Cited by 45
Binary Classifier Calibration Using an Ensemble of Near Isotonic Regression Models
Naeini, M. P., & Cooper, G. F. (2016) · 2016 IEEE 16th International Conference on Data Mining (ICDM) · doi:10.1109/icdm.2016.0047 · Cited by 46
“BBQ addresses the main drawbacks of the histogram binning model by considering multiple different equal frequency histogram binning models and their combination using a Bayesian scoring function [11].”
MethodLayout-based Causal Inference for Object Navigation
Zhang, S., Song, X., Li, W., Bai, Y., Yu, X., & Jiang, S. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.01039 · Cited by 41
Realization of a service for the long-term risk assessment of diabetes-related complications
Lagani, V., Chiarugi, F., Manousos, D., Verma, V., Fursse, J., Marias, K., & Tsamardinos, I. (2015) · Journal of Diabetes and its Complications · doi:10.1016/j.jdiacomp.2015.03.011 · Cited by 34
A Bayesian Belief Network to assess rate of changes in coral reef ecosystems
Franco, C., Hepburn, L. A., Smith, D. J., Nimrod, S., & Tucker, A. (2016) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2016.02.029 · Cited by 25
Binary Classifier Calibration Using a Bayesian Non-Parametric Approach
Naeini, M. P., Cooper, G. F., & Hauskrecht, M. (2015) · Proceedings of the 2015 SIAM International Conference on Data Mining · doi:10.1137/1.9781611974010.24 · Cited by 19
Causal analysis of network logs with layered protocols and topology knowledge
Kobayashi, S., Otomo, K., & Fukuda, K. (2019) · 2019 15th International Conference on Network and Service Management (CNSM) · doi:10.23919/cnsm46954.2019.9012718 · Cited by 13
Discovering study-specific gene regulatory networks
Bo, V., Curtis, T., Lysenko, A., Saqi, M., Swift, S., & Tucker, A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0106524 · Cited by 10
Metadata
- Authors
- Heckerman, D., Geiger, D., & Chickering, D. M.
- Venue
- Machine Learning
- Published
- 1995-09
- Volume
- 20
- Issue
- 3
- Pages
- 197-243
- ISSN
- 0885-6125 (ISSN-L)
- 1573-0565
- OpenAlex
- W1517993545
- Cited by
- 2,017
- References
- 51
- FWCI
- 27.77
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.springer.com/tdm (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.