The DOI matches its Crossref record; 89 of the 89 references it cites were found in a registry or an index.
Operations for Learning with Graphical Models
Open accessAbstract
This paper is a multidisciplinary review of empirical, statistical learning from a graphical model perspective. Well-known examples of graphical models include Bayesian networks, directed graphs representing a Markov chain, and undirected networks representing a Markov field. These graphical models are extended to model data analysis and empirical learning using the notation of plates. Graphical operations for simplifying and manipulating a problem are provided including decomposition, differentiation, andthe manipulation of probability models from the exponential family. Two standard algorithm schemas for learning are reviewed in a graphical framework: Gibbs sampling and the expectation maximizationalgorithm. Using these operations and schemas, some popular algorithms can be synthesized from their graphical specification. This includes versions of linear regression, techniques for feed-forward networks, and learning Gaussian and discrete Bayesian networks from data. The paper concludes by sketching some implications for data analysis and summarizing how some popular algorithms fall within the framework presented. The main original contributions here are the decompositiontechniques and the demonstration that graphical models provide a framework for understanding and developing complex learning algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
(1992) · Cited by 23,431
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
(1988) · Cited by 16,582
(1973) · CERN Document Server (European Organization for Nuclear Research) · Cited by 12,895
Statistical Decision Theory and Bayesian Analysis
Berger, J. O. (1985) · Springer Series in Statistics · doi:10.1007/978-1-4757-4286-2 · Cited by 7,722
Introduction to the theory of neural computation
(1994) · Neural Networks · doi:10.1016/0893-6080(94)90014-0 · Cited by 6,401
Likelihood Ratio Tests for Model Selection and Non-Nested Hypotheses
Vuong, Q. H. (1989) · Econometrica · doi:10.2307/1912557 · Cited by 5,929
Casella, G., & Berger, R. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,711
Statistical Analysis With Missing Data
Ghosh, S. (1988) · Technometrics · doi:10.1080/00401706.1988.10488446 · Cited by 4,576
Maximum Likelihood from Incomplete Data via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1976) · Cited by 4,517
Bayesian image restoration, with two applications in spatial statistics
Besag, J., York, J., & Molli�, A. (1991) · Annals of the Institute of Statistical Mathematics · doi:10.1007/bf00116466 · Cited by 4,205
A Bayesian method for the induction of probabilistic networks from data
Cooper, G. F., & Herskovits, E. (1992) · Machine Learning · doi:10.1007/bf00994110 · Cited by 4,204
Bayesian Inference in Statistical Analysis.
Kadane, J. B., Box, G. E. P., & Tiao, G. C. (1975) · Journal of the American Statistical Association · doi:10.2307/2285412 · Cited by 3,824
Optimal Statistical Decisions.
Siegmund, D., & DeGroot, M. H. (1972) · Journal of the American Statistical Association · doi:10.2307/2284675 · Cited by 3,386
Probabilistic Reasoning in Intelligent Systems
(1988) · Elsevier eBooks · doi:10.1016/c2009-0-27609-4 · Cited by 3,321
Simulated annealing: theory and applications.
(1988) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(88)90023-7 · Cited by 2,966
A practical Bayesian framework for backpropagation networks
MacKay, D. J. C. (1992) · Neural Computation · doi:10.1162/neco.1992.4.3.448 · Cited by 2,917
Statistical Analysis of Finite Mixture Distributions.
Lindsay, B. G., Titterington, D. M., Smith, A. F. M., & Makov, U. E. (1987) · Journal of the American Statistical Association · doi:10.2307/2289504 · Cited by 2,905
Stastical Decision Theory and Bayesian Analysis.
Ghosh, M., & Berger, J. (1988) · Journal of the American Statistical Association · doi:10.2307/2288950 · Cited by 2,905
Ripley, B. D. (1981) · Cited by 2,819
Simulated Annealing: Theory and Applications
van Laarhoven, P. J. M., & Aarts, E. H. L. (1987) · Springer eBooks · doi:10.1007/978-94-015-7744-1 · Cited by 2,385
Introduction to Stochastic Processes
(2014) · Stochastic Numerical Methods · doi:10.1002/9783527683147.ch6 · Cited by 2,383
Ripley, B. D. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316726 · Cited by 2,241
Accurate Approximations for Posterior Moments and Marginal Densities
Tierney, L., & Kadane, J. B. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478240 · Cited by 2,129
Mixture models : inference and applications to clustering
McLachlan, G. J., & Basford, K. E. (1988) · M. Dekker eBooks · Cited by 2,094
Learning Bayesian networks: The combination of knowledge and statistical data
Heckerman, D., Geiger, D., & Chickering, D. M. (1995) · Machine Learning · doi:10.1007/bf00994016 · Cited by 2,017
Graphical Models in Applied Multivariate Statistics
Goodall, C. R. (1991) · Technometrics · doi:10.1080/00401706.1991.10484880 · Cited by 1,849
Bayesian Inference in Statistical Analysis
Hill, B. M. (1974) · Technometrics · doi:10.1080/00401706.1974.10489222 · Cited by 1,833
Optimal Statistical Decisions.
Lindley, D. V., & de Groot, M. (1971) · Applied Statistics · doi:10.2307/2346640 · Cited by 1,802
Introduction to the Theory of Neural Computation
Hertz, J., Krogh, A., & Palmer, R. G. (2018) · CRC Press eBooks · doi:10.1201/9780429499661 · Cited by 1,772
Chambers, J., Hastie, T., & Pregibon, D. (1990) · Compstat · doi:10.1007/978-3-642-50096-1_48 · Cited by 1,742
Gill, P. E., Murray, W., & Wright, M. H. (2019) · doi:10.1137/1.9781611975604 · Cited by 1,737 · cited 1×
“Gradient ascent inreal valued problems corresponds to simple methods from function optimization (Gill et al.,1981) and in discrete problems corresponds to local repair or local search (Johnson et al.,1985; Minton, Johnson, Philips, & Laird, 1990; Selman, Levesque, & Mitchell, 1992).”
MethodConditional Independence in Statistical Theory
Dawid, A. P. (1979) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1979.tb01052.x · Cited by 1,501
Shachter, R. D. (1986) · Operations Research · doi:10.1287/opre.34.6.871 · Cited by 1,250
An analysis of Bayesian classifiers
Langley, P., Iba, W., & Thompson, K. (1992) · Cited by 1,214
Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window
Madigan, D., & Raftery, A. E. (1994) · Journal of the American Statistical Association · doi:10.1080/01621459.1994.10476894 · Cited by 1,205
A new method for solving hard satisfiability problems
Selman, B., Levesque, H. J., & Mitchell, D. G. M. (1992) · Cited by 1,156
Mixture Models: Inference and Applications to Clustering.
Lindsay, B., McLachlan, G. L., Basford, K. E., & Dekker, M. (1989) · Journal of the American Statistical Association · doi:10.2307/2289892 · Cited by 1,062
Probabilistic Inference Using Markov Chain Monte Carlo Methods
Neal, R. M. (2011) · Cited by 1,040
Rivest, R. L. (1987) · Machine Learning · doi:10.1007/bf00058680 · Cited by 886
Becker, R. A., Chambers, J. M., & Wilks, A. R. (1989) · Biometrics · doi:10.2307/2531523 · Cited by 820
Introduction to Stochastic Processes
Gillings, D. (1974) · Technometrics · doi:10.1080/00401706.1974.10489162 · Cited by 784
Bayesian Analysis in Expert Systems
Spiegelhalter, D. J., Dawid, A. P., Lauritzen, S. L., & Cowell, R. G. (1993) · Statistical Science · doi:10.1214/ss/1177010888 · Cited by 684
A Language and Program for Complex Bayesian Modelling
Gilks, W. R., Thomas, A., & Spiegelhalter, D. J. (1994) · The Statistician · doi:10.2307/2348941 · Cited by 653
Theory Refinement on Bayesian Networks
Buntine, W. (1991) · Uncertainty Proceedings 1991 · doi:10.1016/b978-1-55860-203-8.50010-3 · Cited by 647
Self-citationSimplifying Neural Networks by Soft Weight-Sharing
Nowlan, S. J., & Hinton, G. E. (1992) · Neural Computation · doi:10.1162/neco.1992.4.4.473 · Cited by 595
Sequential updating of conditional probabilities on directed graphical structures
Spiegelhalter, D. J., & Lauritzen, S. L. (1990) · Networks · doi:10.1002/net.3230200507 · Cited by 521
Independence properties of directed markov fields
Lauritzen, S. L., Dawid, A. P., Larsen, B. N., & Leimer, H. ‐. (1990) · Networks · doi:10.1002/net.3230200503 · Cited by 515
Hyper Markov Laws in the Statistical Analysis of Decomposable Graphical Models
Dawid, A. P., & Lauritzen, S. L. (1993) · The Annals of Statistics · doi:10.1214/aos/1176349260 · Cited by 479
Dean, T., & Wellman, M. P. (1991) · Cited by 451
Tools for Statistical Inference
Tanner, M. A. (1993) · Springer Series in Statistics · doi:10.1007/978-1-4684-0192-9 · Cited by 451
Geiger, D., & Heckerman, D. (1994) · Uncertainty Proceedings 1994 · doi:10.1016/b978-1-55860-332-5.50035-3 · Cited by 426
HUGIN: a shell for building Bayesian belief universes for expert systems
Andersen, S. K., Olesen, K. G., Jensen, F. V., & Jensen, F. (1989) · VBN Forskningsportal (Aalborg Universitet) · Cited by 402
A Fast Improvement to the Em Algorithm on its Own Terms
Meilijson, I. (1989) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1989.tb01754.x · Cited by 371
Buntine, W., & Weigend, A. S. (1991) · Complex Systems · Cited by 361
Self-citationHwang, C.-R. (1988) · Acta Applicandae Mathematicae · doi:10.1007/bf00047572 · Cited by 335
Bayesian networks without tears
CharniakEugene (1991) · AI Magazine · doi:10.5555/122623.122716 · Cited by 335
Bayes Factors and Choice Criteria for Linear Models
Smith, A. F. M., & Spiegelhalter, D. J. (1980) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1980.tb01122.x · Cited by 333
Normal/Independent Distributions and Their Applications in Robust Regression
Lange, K., & Sinsheimer, J. S. (1993) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1993.10474606 · Cited by 322
Shachter, R. D., & Kenley, C. R. (1989) · Management Science · doi:10.1287/mnsc.35.5.527 · Cited by 315
Probabilistic Similarity Networks
Shortliffe, E. H., & Heckerman, D. E. (1991) · Cited by 308
UNKNOWN ATTRIBUTE VALUES IN INDUCTION
Quinlan, J. R. (1989) · Elsevier eBooks · doi:10.1016/b978-1-55860-036-2.50048-5 · Cited by 302
Introduction to Stochastic Processes
Pavliotis, G. A. (2014) · Texts in Applied Mathematics · doi:10.1007/978-1-4939-1323-7_1 · Cited by 285
Solving large-scale constraint satisfaction and scheduling problems using a heuristic repair method
Minton, S., Johnston, M., Philips, A. B., & Laird, P. D. (1990) · National Conference on Artificial Intelligence · Cited by 278
On Substantive Research Hypotheses, Conditional Independence Graphs and Graphical Chain Models
Wermuth, N., & Lauritzen, S. L. (1990) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1990.tb01771.x · Cited by 223
Random fields and inverse problems in imaging
Geman, D. (1990) · Lecture Notes in Mathematics · doi:10.1007/bfb0103042 · Cited by 214
Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window
Madigan, D., & Raftery, A. E. (1994) · Journal of the American Statistical Association · doi:10.2307/2291017 · Cited by 212
Modelling Complexity: Applications of Gibbs Sampling in Medicine
Gilks, W. R., Clayton, D. G., Spiegelhalter, D. J., Best, N. G., McNeil, A. J., Sharples, L. D., & Kirby, A. J. (1993) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1993.tb01468.x · Cited by 199
Properties of Diagnostic Data Distributions
Dawid, A. P. (1976) · Biometrics · doi:10.2307/2529753 · Cited by 180
A computational scheme for reasoning in dynamic probabilistic networks
Kjærulff, U. (1992) · Uncertainty in Artificial Intelligence · doi:10.1016/b978-1-4832-8287-9.50021-9 · Cited by 177
Graphical models in applied multivariate statistics
Whittaker, J. (1991) · Cited by 174
Lindley, D. V. (1990) · Palgrave Macmillan UK eBooks · doi:10.1007/978-1-349-20865-4_39 · Cited by 147
(2011) · SpringerReference · doi:10.1007/springerreference_63660 · Cited by 141
Normal/Independent Distributions and Their Applications in Robust Regression
Lange, K. L., & Sinsheimer, J. S. (1993) · Journal of Computational and Graphical Statistics · doi:10.2307/1390698 · Cited by 109
Promise of Bayesian Inference for Astrophysics
Loredo, T. J. (1992) · Springer eBooks · doi:10.1007/978-1-4613-9290-3_31 · Cited by 107
Computing second derivatives in feed-forward networks: a review
Buntine, W., & Weigend, A. S. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.286919 · Cited by 105
Self-citationGlobal Conditioning for Probabilistic Inference in Belief Networks
Shachter, R. D., Andersen, S. K., & Szolovits, P. (1994) · Elsevier eBooks · doi:10.1016/b978-1-55860-332-5.50070-5 · Cited by 89
BUGS: a Program to Perform Bayesian Inference using Gibbs Sampling
Thomas, A., Spiegelhalter, D. J., & Gilks, W. R. (1992) · doi:10.1093/oso/9780198522669.003.0061 · Cited by 84
Azevedo-Filho, A., & Shachter, R. D. (1994) · Elsevier eBooks · doi:10.1016/b978-1-55860-332-5.50009-2 · Cited by 82
Uncertain reasoning and forecasting
Dagum, P., Galper, A. R., Horvitz, E., & Seiver, A. J. (1995) · International Journal of Forecasting · doi:10.1016/0169-2070(94)02009-e · Cited by 68
Gibbs sampling in Bayesian networks
Hrycej, T. (1990) · Artificial Intelligence · doi:10.1016/0004-3702(90)90020-z · Cited by 65
Compiling Prior Knowledge Into an Explicit Bias
Cohen, W. W. (1992) · Elsevier eBooks · doi:10.1016/b978-1-55860-247-2.50018-8 · Cited by 49
Johnson, D. S., Papadimitriou, C. H., & Yannakakis, M. (1985) · Annual Symposium on Foundations of Computer Science · doi:10.1109/sfcs.1985.31 · Cited by 47
Stewart, L. (1987) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348514 · Cited by 32
Cited by
Data mining: concepts and techniques
(2012) · Choice Reviews Online · doi:10.5860/choice.49-3305 · Cited by 28,531
(2006) · The MIT Press eBooks · doi:10.7551/mitpress/9780262033589.001.0001 · Cited by 4,280
Estimating Continuous Distributions in Bayesian Classifiers
John, G. H., & Langley, P. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.4964 · Cited by 2,885
Link prediction in complex networks: A survey
Lü, L., & Zhou, T. (2011) · Physica A: Statistical Mechanics and its Applications · doi:10.1016/j.physa.2010.11.027 · Cited by 2,819
Richardson, M., & Domingos, P. (2006) · Machine Learning · doi:10.1007/s10994-006-5833-1 · Cited by 2,676
Metadata
- Authors
- Buntine, W. L.
- Venue
- Journal of Artificial Intelligence Research
- Publisher
- AI Access Foundation
- Published
- 1994-12-01
- Volume
- 2
- Pages
- 159-225
- ISSN
- 1076-9757 (ISSN-L)
- OpenAlex
- W1669437150
- Cited by
- 530
- References
- 89
- FWCI
- 21.39
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.