The DOI matches its Crossref record; 136 of the 136 references it cites were found in a registry or an index.
An Introduction to Conditional Random Fields
Open accessAbstract
Many tasks involve predicting a large number of variables that depend on each other as well as on other observed variables. Structured prediction methods are essentially a combination of classification and graphical modeling. They combine the ability of graphical models to compactly model multivariate data with the ability of classification methods to perform prediction using large sets of input features. This survey describes conditional random fields, a popular probabilistic method for structured prediction. CRFs have seen wide application in many areas, including natural language processing, computer vision, and bioinformatics. We describe methods for inference and parameter estimation for CRFs, including practical issues for implementing large-scale CRFs. We do not assume previous knowledge of graphical modeling, so this survey is intended to be useful to practitioners in a wide variety of fields.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
(1988) · Cited by 16,582
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Self-citationBertsekas, D. P. (1997) · Journal of the Operational Research Society · doi:10.1038/sj.jors.2600425 · Cited by 11,726
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Research works printed but not linked: 40
- Blunsom, 2006, Discriminative word alignment with conditional random fields, 65
- Bradley, 2010, Learning tree conditional random fields
- Clark, 2004, Parsing the WSJ using CCG and log-linear models, 103
- Cohn, 2006, European Conference on Machine Learning (ECML), 606
- Cowans, 2005, A graphical model for simultaneous partitioning and labeling
- Crammer, 2003, Ultraconservative online algorithms for multiclass problems, Journal of Machine Learning Research, 3, 951
- Culotta, 2004, First Conference on Email and Anti-Spam (CEAS)
- Culotta, 2004, Confidence estimation for information extraction, 10.3115/1613984.1614012 · doi:10.3115/1613984.1614012
- Daumé III, 2005, International Conference on Machine Learning (ICML)
- Dillon, 2010, Stochastic composite likelihood, Journal of Machine Learning Research, 11, 2597
- Globerson, 2007, Exponentiated gradient algorithms for log-linear structured prediction, 10.1145/1273496.1273535 · doi:10.1145/1273496.1273535
- Goodman, 2004, Exponential priors for maximum entropy models
- Graca, 2009, Posterior vs parameter sparsity in latent variable models, 664
- Kim, 2004, International joint workshop on natural language processing in biomedicine and its applications, 70
- Kulesza, 2008, Structured learning with approximate inference
- Le Cun, 1998, Neural Networks, Tricks of the Trade, Lecture Notes in Computer Scienc
- LeCun, 2007, Predicting Structured Data
- McCallum, 2000, International Conference on Machine Learning (ICML), 591
- McCallum, 2005, Advances in Neural Information Processing Systems 17, 905
- Miller, 2- 7 2004, HLT-NAACL 200f: Main Proceedings, 337
- Murray, 2006, Uncertainty in Artificial Intelligence (UAI), 359
- Ng, 2004, Feature selection, 11 vs. 12 regularization, and rotational invariance
- Ng, 2002, Advances in Neural Information Processing Systems 14, 841
- Qi, 2005, Bayesian conditional random fields
- Qi, 2005, Diagram structure recognition by Bayesian conditional random fields
- Rosenberg, 2007, Mixture-of-parents maximum entropy Markov models
- Sang, 2003, Proceedings of CoNLL-2003, 142
- Sarawagi, 2005, Advances in Neural Information Processing Systems 17, 1185
- Sato, 2005, RNA secondary structural alignment with conditional random fields, Bioinformatics, 21, Ü237, 10.1093/bioinformatics/bti1139 · doi:10.1093/bioinformatics/bti1139
- Singla, 2005, Proceedings of the National Conference on Artificial Intelligence, 868
- Stern, 2005, Advances in Neural Information Processing Systems 17, 1353
- Sutton, 2007, Introduction to Statistical Relational Learning
- Sutton, 2007, Dynamic conditional random fields: Factorized probabilistic models for labeling and segmenting sequence data, Journal of Machine Learning Research, 8, 693
- Taskar, 2004, Advances in Neural Information Processing Systems 16
- Wainwright, 2006, Advances in Neural Information Processing Systems 18
- Welling, 2006, Bayesian random fields: The Bethe-Laplace approximation
- Wick, 2009, SampleRank: Learning preferences from atomic gradients
- Wick, 2008, A discriminative approach to ontology alignment
- Yu, 2010, A quasiNewton approach to nonsmooth convex optimization problems in machine learning, Journal of Machine Learning Research, 11, 1145
- Zhang, 2011, Quasi-Newton Markov chain Monte Carlo
Cited by
Structural-RNN: Deep Learning on Spatio-Temporal Graphs
Jain, A., Zamir, A. R., Savarese, S., & Saxena, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.573 · Cited by 1,133
Marshall, I. J., & Wallace, B. C. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1074-9 · Cited by 638
“The conditional random field (CRF) is amongst the most prominent of these [18].”
BackgroundDeep Learning for Aspect-Based Sentiment Analysis: A Comparative Review
Do, H. H., Prasad, P., Maag, A., & Alsadoon, A. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.10.003 · Cited by 614
A review of natural language processing techniques for opinion mining systems
Sun, S., Luo, C., & Chen, J. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.10.004 · Cited by 542
Exploiting Context for Rumour Detection in Social Media
Zubiaga, A., Liakata, M., & Procter, R. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67217-5_8 · Cited by 350
Metadata
- Authors
- Sutton, C., & McCallum, A.
- Venue
- Foundations and Trends® in Machine Learning
- Publisher
- Emerald
- Published
- 2012-08-23
- Volume
- 4
- Issue
- 4
- Pages
- 267-373
- ISSN
- 1935-8237 (ISSN-L)
- 1935-8245
- OpenAlex
- W2129999749
- Cited by
- 564
- References
- 136
- FWCI
- 43.06
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An Introduction to Conditional Random Fields. https://app.cochat.ai/papers/10.1561/2200000013
- The paper
- Sutton, C., & McCallum, A. (2012). An Introduction to Conditional Random Fields. Foundations and Trends® in Machine Learning. https://doi.org/10.1561/2200000013
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.