The DOI matches its Crossref record; 136 of the 136 references it cites were found in a registry or an index.
An Introduction to Conditional Random Fields
Open accessAbstract
Many tasks involve predicting a large number of variables that depend on each other as well as on other observed variables. Structured prediction methods are essentially a combination of classification and graphical modeling. They combine the ability of graphical models to compactly model multivariate data with the ability of classification methods to perform prediction using large sets of input features. This survey describes conditional random fields, a popular probabilistic method for structured prediction. CRFs have seen wide application in many areas, including natural language processing, computer vision, and bioinformatics. We describe methods for inference and parameter estimation for CRFs, including practical issues for implementing large-scale CRFs. We do not assume previous knowledge of graphical modeling, so this survey is intended to be useful to practitioners in a wide variety of fields.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
(1988) · Cited by 16,582
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Self-citationBertsekas, D. P. (1997) · Journal of the Operational Research Society · doi:10.1038/sj.jors.2600425 · Cited by 11,726
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
Research works printed but not linked: 40
- Blunsom, 2006, Discriminative word alignment with conditional random fields, 65
- Bradley, 2010, Learning tree conditional random fields
- Clark, 2004, Parsing the WSJ using CCG and log-linear models, 103
- Cohn, 2006, European Conference on Machine Learning (ECML), 606
- Cowans, 2005, A graphical model for simultaneous partitioning and labeling
- Crammer, 2003, Ultraconservative online algorithms for multiclass problems, Journal of Machine Learning Research, 3, 951
- Culotta, 2004, First Conference on Email and Anti-Spam (CEAS)
- Culotta, 2004, Confidence estimation for information extraction, 10.3115/1613984.1614012 · doi:10.3115/1613984.1614012
- Daumé III, 2005, International Conference on Machine Learning (ICML)
- Dillon, 2010, Stochastic composite likelihood, Journal of Machine Learning Research, 11, 2597
- Globerson, 2007, Exponentiated gradient algorithms for log-linear structured prediction, 10.1145/1273496.1273535 · doi:10.1145/1273496.1273535
- Goodman, 2004, Exponential priors for maximum entropy models
- Graca, 2009, Posterior vs parameter sparsity in latent variable models, 664
- Kim, 2004, International joint workshop on natural language processing in biomedicine and its applications, 70
- Kulesza, 2008, Structured learning with approximate inference
- Le Cun, 1998, Neural Networks, Tricks of the Trade, Lecture Notes in Computer Scienc
- LeCun, 2007, Predicting Structured Data
- McCallum, 2000, International Conference on Machine Learning (ICML), 591
- McCallum, 2005, Advances in Neural Information Processing Systems 17, 905
- Miller, 2- 7 2004, HLT-NAACL 200f: Main Proceedings, 337
- Murray, 2006, Uncertainty in Artificial Intelligence (UAI), 359
- Ng, 2004, Feature selection, 11 vs. 12 regularization, and rotational invariance
- Ng, 2002, Advances in Neural Information Processing Systems 14, 841
- Qi, 2005, Bayesian conditional random fields
- Qi, 2005, Diagram structure recognition by Bayesian conditional random fields
- Rosenberg, 2007, Mixture-of-parents maximum entropy Markov models
- Sang, 2003, Proceedings of CoNLL-2003, 142
- Sarawagi, 2005, Advances in Neural Information Processing Systems 17, 1185
- Sato, 2005, RNA secondary structural alignment with conditional random fields, Bioinformatics, 21, Ü237, 10.1093/bioinformatics/bti1139 · doi:10.1093/bioinformatics/bti1139
- Singla, 2005, Proceedings of the National Conference on Artificial Intelligence, 868
- Stern, 2005, Advances in Neural Information Processing Systems 17, 1353
- Sutton, 2007, Introduction to Statistical Relational Learning
- Sutton, 2007, Dynamic conditional random fields: Factorized probabilistic models for labeling and segmenting sequence data, Journal of Machine Learning Research, 8, 693
- Taskar, 2004, Advances in Neural Information Processing Systems 16
- Wainwright, 2006, Advances in Neural Information Processing Systems 18
- Welling, 2006, Bayesian random fields: The Bethe-Laplace approximation
- Wick, 2009, SampleRank: Learning preferences from atomic gradients
- Wick, 2008, A discriminative approach to ontology alignment
- Yu, 2010, A quasiNewton approach to nonsmooth convex optimization problems in machine learning, Journal of Machine Learning Research, 11, 1145
- Zhang, 2011, Quasi-Newton Markov chain Monte Carlo
Cited by
Structural-RNN: Deep Learning on Spatio-Temporal Graphs
Jain, A., Zamir, A. R., Savarese, S., & Saxena, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.573 · Cited by 1,133
Marshall, I. J., & Wallace, B. C. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1074-9 · Cited by 638
“The conditional random field (CRF) is amongst the most prominent of these [18].”
BackgroundDeep Learning for Aspect-Based Sentiment Analysis: A Comparative Review
Do, H. H., Prasad, P., Maag, A., & Alsadoon, A. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.10.003 · Cited by 614
A review of natural language processing techniques for opinion mining systems
Sun, S., Luo, C., & Chen, J. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.10.004 · Cited by 542
Exploiting Context for Rumour Detection in Social Media
Zubiaga, A., Liakata, M., & Procter, R. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67217-5_8 · Cited by 350
Ghamisi, P., Maggiori, E., Li, S., Souza, R., Tarablaka, Y., Moser, G., De Giorgi, A., Fang, L., Chen, Y., Chi, M., et al. (2018) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2018.2854840 · Cited by 325
Ge, W., Lin, X., & Yu, Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00315 · Cited by 317
Joint Semantic Segmentation and 3D Reconstruction from Monocular Video
Kundu, A., Li, Y., Dellaert, F., Li, F., & Rehg, J. M. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10599-4_45 · Cited by 220
Information extraction from multi-institutional radiology reports
Hassanpour, S., & Langlotz, C. P. (2016) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2015.09.007 · Cited by 182
A Comprehensive Study of Activity Recognition Using Accelerometers
Twomey, N., Diethe, T., Fafoutis, X., Elsts, A., McConville, R., Flach, P., & Craddock, I. (2018) · Informatics · doi:10.3390/informatics5020027 · Cited by 143
Multi-user activity recognition: Challenges and opportunities
Li, Q., Gravina, R., Li, Y., Alsamhi, S. H., Sun, F., & Fortino, G. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.06.004 · Cited by 140
Machine learning with a reject option: A survey
Hendrickx, K., Perini, L., Van der Plas, D., Meert, W., & Davis, J. (2024) · Machine Learning · doi:10.1007/s10994-024-06534-x · Cited by 134
Advancing entity recognition in biomedicine via instruction tuning of large language models
Keloth, V. K., Hu, Y., Xie, Q., Peng, X., Wang, Y., Zheng, A., Selek, M., Raja, K., Wei, C. H., Jin, Q., et al. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae163 · Cited by 104
Recovering from failure by asking for help
Knepper, R. A., Tellex, S., Li, A., Roy, N., & Rus, D. (2015) · Autonomous Robots · doi:10.1007/s10514-015-9460-1 · Cited by 76
A general path-based representation for predicting program properties
Alon, U., Zilberstein, M., Levy, O., & Yahav, E. (2018) · Proceedings of the 39th ACM SIGPLAN Conference on Programming Language Design and Implementation · doi:10.1145/3192366.3192412 · Cited by 79
Moly, A., Costecalde, T., Martel, F., Martin, M., Larzabal, C., Karakas, S., Verney, A., Charvet, G., Chabardes, S., Benabid, A. L., et al. (2022) · Journal of Neural Engineering · doi:10.1088/1741-2552/ac59a0 · Cited by 65
A Comprehensive Study of Activity Recognition Using Accelerometers
Twomey, N., Diethe, T., Fafoutis, X., Elsts, A., McConville, R., Flach, P., & Craddock, I. (2018) · doi:10.20944/preprints201803.0147.v1 · Cited by 143
PICO entity extraction for preclinical animal literature.
Wang, Q., Liao, J., Lapata, M., & Macleod, M. (2022) · Systematic Reviews · doi:10.1186/s13643-022-02074-4 · Cited by 29
Combination of conditional random field with a rule based method in the extraction of PICO elements.
Chabou, S., & Iglewski, M. (2018) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-018-0699-2 · Cited by 19
An Intelligent Virtual Standard Patient for Medical Students Training Based on Oral Knowledge Graph
Song, W., Hou, X., Li, S., Chen, C., Gao, D., Wang, X., Sun, Y., Hou, J., & Hao, A. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3205456 · Cited by 18
Kuehne, A., Mayr, U., Sévin, D. C., Claassen, M., & Zamboni, N. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005577 · Cited by 9
PICO Extraction by combining the robustness of machine-learning methods with the rule-based methods.
Chabou, S., & Iglewski, M. (2015) · 2015 World Congress on Information Technology and Computer Applications (WCITCA) · doi:10.1109/wcitca.2015.7367038 · Cited by 7
Collaborative Large Language Models for Automated Data Extraction in Living Systematic Reviews
Khan, M. A., Ayub, U., Naqvi, S. A. A., Khakwani, K. Z. R., Sipra, Z. B. R., Raina, A., Zou, S., He, H., Hossein, S. A., Hasan, B., et al. (2024) · doi:10.1101/2024.09.20.24314108 · Cited by 54
Metadata
- Authors
- Sutton, C., & McCallum, A.
- Venue
- Foundations and Trends® in Machine Learning
- Publisher
- Emerald
- Published
- 2012-08-23
- Volume
- 4
- Issue
- 4
- Pages
- 267-373
- ISSN
- 1935-8237 (ISSN-L)
- 1935-8245
- OpenAlex
- W2129999749
- Cited by
- 564
- References
- 136
- FWCI
- 43.06
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.