The DOI matches its Crossref record; 136 of the 136 references it cites were found in a registry or an index.
An Introduction to Conditional Random Fields
Open accessAbstract
Many tasks involve predicting a large number of variables that depend on each other as well as on other observed variables. Structured prediction methods are essentially a combination of classification and graphical modeling. They combine the ability of graphical models to compactly model multivariate data with the ability of classification methods to perform prediction using large sets of input features. This survey describes conditional random fields, a popular probabilistic method for structured prediction. CRFs have seen wide application in many areas, including natural language processing, computer vision, and bioinformatics. We describe methods for inference and parameter estimation for CRFs, including practical issues for implementing large-scale CRFs. We do not assume previous knowledge of graphical modeling, so this survey is intended to be useful to practitioners in a wide variety of fields.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
A tutorial on hidden Markov models and selected applications in speech recognition
Rabiner, L. R. (1989) · Proceedings of the IEEE · doi:10.1109/5.18626 · Cited by 22,743
Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.
Geman, S., & Geman, D. (1984) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1984.4767596 · Cited by 17,949
(1988) · Cited by 16,582
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472
(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Self-citationBertsekas, D. P. (1997) · Journal of the Operational Research Society · doi:10.1038/sj.jors.2600425 · Cited by 11,726
Object Detection with Discriminatively Trained Part-Based Models
Felzenszwalb, P. F., Girshick, R. B., McAllester, D., & Ramanan, D. (2010) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2009.167 · Cited by 9,853
A Stochastic Approximation Method
Robbins, H., & Monro, S. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729586 · Cited by 9,643
Building a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
Sampling-based approaches to calculating marginal densities
Gelfand, A. E., & Smith, A. F. M. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10476213 · Cited by 6,606
Factor graphs and the sum-product algorithm
Kschischang, F. R., Frey, B. J., & Loeliger, H.-A. (2001) · IEEE Transactions on Information Theory · doi:10.1109/18.910572 · Cited by 6,486
Information theory, inference, and learning algorithms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-5949 · Cited by 6,362
(2009) · Cited by 6,153
Spatial Interaction and the Statistical Analysis of Lattice Systems
Besag, J. (1974) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1974.tb00999.x · Cited by 6,067
GrabCut: Interactive foreground extraction using iterated graph cuts
Rother, C., Kolmogorov, V., & Blake, A. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015720 · Cited by 5,703
Monte Carlo Statistical Methods
Kim, H. (2000) · Technometrics · doi:10.1080/00401706.2000.10485722 · Cited by 5,508
WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility
Lunn, D. J., Thomas, A., Best, N., & Spiegelhalter, D. (2000) · Statistics and Computing · doi:10.1023/a:1008929526011 · Cited by 5,368
Training Products of Experts by Minimizing Contrastive Divergence
Hinton, G. E. (2002) · Neural Computation · doi:10.1162/089976602760128018 · Cited by 4,879 · cited 1×
“One possibility to overcome these difficulties is contrastive divergence (CD) [44], in which the true marginals p(yc|x) in (4.”
BackgroundInteractive graph cuts for optimal boundary & region segmentation of objects in N-D images
Boykov, Y. Y., & Jolly, M.-P. (2002) · Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 · doi:10.1109/iccv.2001.937505 · Cited by 3,674
Incorporating non-local information into information extraction systems by Gibbs sampling
Finkel, J. R., Grenager, T., & Manning, C. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219885 · Cited by 3,008
Graphical Models, Exponential Families, and Variational Inference
Wainwright, M. J., & Jordan, M. I. (2007) · now publishers, Inc. eBooks · doi:10.1561/9781601981851 · Cited by 2,959
Feature-rich part-of-speech tagging with a cyclic dependency network
Toutanova, K., Klein, D., Manning, C. D., & Singer, Y. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073478 · Cited by 2,844
Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition
Tjong Kim Sang, E. F., & De Meulder, F. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119195 · Cited by 2,788
Richardson, M., & Domingos, P. (2006) · Machine Learning · doi:10.1007/s10994-006-5833-1 · Cited by 2,676
Stochastic Estimation of the Maximum of a Regression Function
Kiefer, J., & Wolfowitz, J. (1952) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729392 · Cited by 2,133
(2001) · Cited by 1,932
Collins, M. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118694 · Cited by 1,862
Online Passive-Aggressive Algorithms
Crammer, K., Dekel, O., Keshet, J., Shalev‐Shwartz, S., & Singer, Y. (2003) · Cited by 1,682
Constructing Free-Energy Approximations and Generalized Belief Propagation Algorithms
Yedidia, J. S., Freeman, W. T., & Weiss, Y. (2005) · IEEE Transactions on Information Theory · doi:10.1109/tit.2005.850085 · Cited by 1,617
Semi-supervised Learning by Entropy Minimization
Grandvalet, Y., & Bengio, Y. (2004) · Cited by 1,582
Feature selection, L 1 vs. L 2 regularization, and rotational invariance
Ng, A. Y. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015435 · Cited by 1,572
Statistical Analysis of Non-Lattice Data
Besag, J. (1975) · The Statistician · doi:10.2307/2987782 · Cited by 1,559
Markov Random Field Modeling in Image Analysis
Li, S. Z. (2001) · Computer Science Workbench · doi:10.1007/978-4-431-67044-5 · Cited by 1,533
Pegasos: primal estimated sub-gradient solver for SVM
Shalev-Shwartz, S., Singer, Y., Srebro, N., & Cotter, A. (2011) · Mathematical Programming · doi:10.1007/s10107-010-0420-4 · Cited by 1,477
LeCun, Y., Bottou, L., Orr, G., & Müller, K. (1998) · neural information processing systems · Cited by 1,333
Maximum Entropy Markov Models for Information Extraction and Segmentation
McCallum, A., Freitag, D., & Pereira, F. C. N. (2000) · Cited by 1,315
Self-citationShallow parsing with conditional random fields
Sha, F., & Pereira, F. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073473 · Cited by 1,246
Support vector machine learning for interdependent and structured output spaces
Tsochantaridis, I., Hofmann, T., Joachims, T., & Altun, Y. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015341 · Cited by 1,243
Map-Reduce for Machine Learning on Multicore
Chu, C.-T., Kim, S. K., Lin, Y.-A., Yu, Y., Bradski, G., Ng, A. Y., & Olukotun, K. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0040 · Cited by 1,229
Taskar, B., Guestrin, C., & Koller, D. (2003) · Cited by 1,206
McCallum, A., & Li, W. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119206 · Cited by 1,160
Self-citationShotton, J., Winn, J., Rother, C., & Criminisi, A. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744023_1 · Cited by 1,132
Caruana, R. (1998) · Cited by 1,110
Monte Carlo Statistical Methods (Springer Texts in Statistics)
Robert, C. P., & Casella, G. (2005) · Springer eBooks · Cited by 1,002
Pegasos: Primal Estimated sub-GrAdient SOlver for SVM
Shalev-Shwartz, S., Singer, Y., & Srebro, N. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273598 · Cited by 973
Turbo decoding as an instance of Pearl's "belief propagation" algorithm
McEliece, R. J., MacKay, D. J. C., & Cheng, J.-F. (1998) · IEEE Journal on Selected Areas in Communications · doi:10.1109/49.661103 · Cited by 904
Robust Higher Order Potentials for Enforcing Label Consistency
Kohli, P., Ladický, L., & Torr, P. H. S. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-008-0202-0 · Cited by 853
A Tutorial on Energy-Based Learning
LeCun, Y., Chopra, S., Hadsell, R. T., Ranzato, A., & Huang, F. J. (2006) · Cited by 842
An Introduction to Conditional Random Fields for Relational Learning
Sutton, C., & McCallum, A. (2007) · Introduction to Statistical Relational Learning · doi:10.7551/mitpress/7432.003.0006 · Cited by 841
Self-citationMultiscale conditional random fields for image labeling
He, X., Zemel, R. S., & Carreira-Perpinan, M. A. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315232 · Cited by 828
Maximum mutual information estimation of hidden Markov model parameters for speech recognition
Bahl, L., Brown, P., de Souza, P., & Mercer, R. (2005) · ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1986.1169179 · Cited by 817
Representations of quasi-Newton matrices and their use in limited memory methods
Byrd, R. H., Nocedal, J., & Schnabel, R. B. (1994) · Mathematical Programming · doi:10.1007/bf01582063 · Cited by 744
The generalized distributive law
Aji, S. M., & McEliece, R. J. (2000) · IEEE Transactions on Information Theory · doi:10.1109/18.825794 · Cited by 735
Applying Conditional Random Fields to Japanese Morphological Analysis
Kudo, T., Yamamoto, K., & Matsumoto, Y. (2004) · Cited by 715
Introduction to the CoNLL-2000 shared task: chunking
Tjong Kim Sang, E. F., & Buchholz, S. (2000) · Proceedings of the 2nd workshop on Learning language in logic and the 4th conference on Computational natural language learning - · doi:10.3115/1117601.1117631 · Cited by 705
A comparison of algorithms for maximum entropy parameter estimation
Malouf, R. (2002) · proceeding of the 6th conference on Natural language learning - COLING-02 · doi:10.3115/1118853.1118871 · Cited by 655
Discriminative probabilistic models for relational data
Taskar, B., Abbeel, P., & Koller, D. (2002) · Cited by 625
Learning structural SVMs with latent variables
Yu, C.-N. J., & Joachims, T. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553523 · Cited by 610
(2004) · Cited by 610
Ratliff, N. D., Bagnell, J. A., & Zinkevich, M. A. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143936 · Cited by 606
Markov fields on finite graphs and lattices
Hammersley, J. M., & Clifford, P. (1971) · Cited by 579
Introduction to the bio-entity recognition task at JNLPBA
Kim, J.-D., Ohta, T., Tsuruoka, Y., Tateisi, Y., & Collier, N. (2004) · Proceedings of the International Joint Workshop on Natural Language Processing in Biomedicine and its Applications - JNLPBA '04 · doi:10.3115/1567594.1567610 · Cited by 573
Overview of BioCreAtIvE: critical assessment of information extraction for biology
Hirschman, L., Yeh, A., Blaschke, C., & Valencia, A. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-s1-s1 · Cited by 530
(2007) · The MIT Press eBooks · doi:10.7551/mitpress/7443.001.0001 · Cited by 525
Scalable training of L1-regularized log-linear models
Andrew, G., & Gao, J. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273501 · Cited by 506
Hidden Conditional Random Fields
Quattoni, A., Wang, S., Morency, L.-P., Collins, M., & Darrell, T. (2007) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2007.1124 · Cited by 488
Divergence measures and message passing
Minka, T. P. (2005) · Cited by 477
ABNER: an open source tool for automatically tagging genes, proteins and other entity names in text
Settles, B. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti475 · Cited by 468
Search-based structured prediction
Daumé, H., Langford, J., & Marcu, D. (2009) · Machine Learning · doi:10.1007/s10994-009-5106-x · Cited by 465
Chinese segmentation and new word detection using conditional random fields
Peng, F., Feng, F., & McCallum, A. (2004) · Proceedings of the 20th international conference on Computational Linguistics - COLING '04 · doi:10.3115/1220355.1220436 · Cited by 460
Self-citationHidden Markov support vector machines
Altün, Y., Tsochantaridis, I., & Hofmann, T. (2003) · Cited by 458
Posterior Regularization for Structured Latent Variable Models
Ganchev, K., Graça, J., Gillenwater, J., & Taskar, B. (2010) · Cited by 440
Joe, H., Reid, N. M., Xuekun, P., & Firth, D. (2012) · Cited by 434
Collective multi-label classification
Ghamrawi, N., & McCallum, A. (2005) · Proceedings of the 14th ACM international conference on Information and knowledge management · doi:10.1145/1099554.1099591 · Cited by 410
Self-citationKumar, S., & Hebert, M. (2006) · International Journal of Computer Vision · doi:10.1007/s11263-006-7007-9 · Cited by 392
Identifying sources of opinions with conditional random fields and extraction patterns
Choi, Y., Cardie, C., Riloff, E., & Patwardhan, S. (2005) · Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · doi:10.3115/1220575.1220620 · Cited by 366
Efficiently Inducing Features of Conditional Random Fields
McCallum, A. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1212.2504 · Cited by 363
Self-citationTable extraction using conditional random fields
Pinto, D., McCallum, A., Wei, X., & Croft, W. B. (2003) · Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval · doi:10.1145/860435.860479 · Cited by 355
Self-citationConditional random fields for object recognition
Quattoni, A., Collins, M., & Darrell, T. (2004) · Cited by 342
(2000) · CrossRef Listing of Deleted DOIs · doi:10.1162/jmlr.2003.3.4-5.951 · Cited by 307
Hidden conditional random fields for phone classification
Gunawardana, A., Mahajan, M., Acero, A., & Platt, J. C. (2005) · Interspeech 2005 · doi:10.21437/interspeech.2005-126 · Cited by 299
Practical very large scale CRFs
Lavergne, T., Paristech, T., Yvon, F., & Paris-sud, U. (2013) · Cited by 297
Markov Random Fields for Vision and Image Processing
(2011) · The MIT Press eBooks · doi:10.7551/mitpress/8579.001.0001 · Cited by 290
Trust region Newton methods for large-scale logistic regression
Lin, C.-J., Weng, R. C., & Keerthi, S. S. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273567 · Cited by 284
Sutton, C., Rohanimanesh, K., & McCallum, A. (2004) · Twenty-first international conference on Machine learning - ICML '04 · doi:10.1145/1015330.1015422 · Cited by 284
Self-citationMCMC for doubly-intractable distributions
Murray, I., Ghahramani, Z., & Mackay, D. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6848 · Cited by 281
Riezler, S., King, T. H., Kaplan, R. M., Crouch, R., Maxwell, J. T., & Johnson, M. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073129 · Cited by 279
Accelerated training of conditional random fields with stochastic gradient methods
Vishwanathan, S. V. N., Schraudolph, N. N., Schmidt, M. W., & Murphy, K. P. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143966 · Cited by 278
Accurate Information Extraction from Research Papers using Conditional Random Fields
Peng, F., & McCallum, A. (2004) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 271
Self-citationName Tagging with Word Clusters and Discriminative Training
Miller, S. L., Guinness, J., & Zamanian, A. (2004) · Cited by 259
Discriminative training of Markov logic networks
Singla, P., & Domingos, P. (2005) · Cited by 245
Structured Learning and Prediction in Computer Vision
Nowozin, S. (2010) · now publishers, Inc. eBooks · doi:10.1561/9781601984579 · Cited by 239
Tree-based reparameterization framework for analysis of sum-product and related algorithms
Wainwright, M. J., Jaakkola, T. S., & Willsky, A. S. (2003) · IEEE Transactions on Information Theory · doi:10.1109/tit.2003.810642 · Cited by 232
Named entity recognition with a maximum entropy approach
Chieu, H. L., & Ng, H. T. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119199 · Cited by 230
Conditional Models of Identity Uncertainty with Application to Noun Coreference
McCallum, A., & Wellner, B. (2004) · Cited by 226
Self-citationResidual Belief Propagation: Informed Scheduling for Asynchronous Message Passing
Elidan, G., McGraw, I., & Koller, D. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6837 · Cited by 225
Painless Unsupervised Learning with Features
Berg-Kirkpatrick, T., Bouchard‐Côté, A., DeNero, J., & Klein, D. (2010) · Cited by 210
FACTORIE: Probabilistic Programming via Imperatively Defined Factor Graphs
McCallum, A., Schultz, K., & Singh, S. (2009) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 196
Self-citationDiscriminative Fields for Modeling Spatial Dependencies in Natural Images
Kumar, S., & Hebert, M. (2018) · Figshare · doi:10.1184/r1/6554576 · Cited by 196
Taskar, B., Klein, D., Collins, M., Koller, D., & Manning, C. D. (2004) · Cited by 193
Soong, F. K., & Huang, E.-F. (1991) · [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1991.150437 · Cited by 189
Comparisons of sequence labeling algorithms and extensions
Nguyen, N., & Guo, Y. (2007) · Proceedings of the 24th international conference on Machine learning · doi:10.1145/1273496.1273582 · Cited by 183
Localizing Objects While Learning Their Appearance
Deselaers, T., Alexe, B., & Ferrari, V. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15561-1_33 · Cited by 182
Integer linear programming inference for conditional random fields
Roth, D., & Yih, W.-T. (2005) · Proceedings of the 22nd international conference on Machine learning - ICML '05 · doi:10.1145/1102351.1102444 · Cited by 179
Langford, J. C., Smola, A. J., & Zinkevich, M. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0911.0491 · Cited by 178
Efficient, Feature-based, Conditional Random Field Parsing
Finkel, J. R., Kleeman, A., & Manning, C. D. (2008) · Cited by 176
Learning as search optimization
Daumé, H., & Marcu, D. (2005) · International Conference on Machine Learning · doi:10.1145/1102351.1102373 · Cited by 171
A discriminative matching approach to word alignment
Taskar, B., Lacoste-Julien, S., & Klein, D. (2005) · Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · doi:10.3115/1220575.1220585 · Cited by 167
Piecewise Training for Undirected ModelsPreprint
Sutton, C. A., & McCallum, A. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1207.1409 · Cited by 145
Self-citationCollective Segmentation and Labeling of Distant Entities in Information Extraction
Sutton, C. A., & McCallum, A. (2004) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 141
Self-citationCollective information extraction with relational Markov networks
Bunescu, R., & Mooney, R. J. (2004) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1218955.1219011 · Cited by 136
Efficient Training of Conditional Random Fields
Wallach, H. (2002) · Cited by 127
Semi-supervised conditional random fields for improved sequence segmentation and labeling
Jiao, F., Wang, S., Lee, C., Greiner, R., & Schuurmans, D. (2006) · International Conference on Computational Linguistics · doi:10.3115/1220175.1220202 · Cited by 127
A Conditional Random Field for Discriminatively-Trained Finite-State String Edit Distance
McCallum, A., Bellare, K., & Pereira, F. M. B. (2005) · Defense Technical Information Center (DTIC) · doi:10.21236/ada440386 · Cited by 126
Self-citationGeneralized Expectation Criteria for Semi-Supervised Learning of Conditional Random Fields
Mann, G., & McCallum, A. (2008) · Scholarworks (University of Massachusetts Amherst) · Cited by 120
Self-citationAn asymptotic analysis of generative, discriminative, and pseudolikelihood estimators
Liang, P., & Jordan, M. I. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390230 · Cited by 119
Learning from measurements in exponential families
Liang, P., Jordan, M. I., & Klein, D. (2009) · International Conference on Machine Learning · doi:10.1145/1553374.1553457 · Cited by 111
Predicting Structured Data (Neural Information Processing)
Bakir, G. H., Hofmann, T., Schölkopf, B., Smola, A. J., Taskar, B., & Vishwanathan, S. V. N. (2007) · The MIT Press eBooks · Cited by 93
Global Discriminative Learning for Higher-Accuracy Computational Gene Prediction
Bernal, A., Crammer, K., Hatzigeorgiou, A. G., & Pereira, F. (2007) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0030054 · Cited by 90
On the Convergence Properties of Contrastive Divergence
Sutskever, I., & Tieleman, T. (2010) · Cited by 85
Viola, P. A., & Narasimhan, M. (2005) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1076034.1076091 · Cited by 75
Advances in Markov chain Monte Carlo methods
Murray, I. (2007) · Cited by 75
An Empirical Comparison of Supervised Learning Algorithms Using Different Performance Metrics
Caruana, R., & Niculescu-Mizil, A. (2005) · Cited by 74
Liang, P., Daumé, H., & Klein, D. (2008) · International Conference on Machine Learning · doi:10.1145/1390156.1390231 · Cited by 69
Discriminative models, not discriminative training
Minka, T. (2005) · Cited by 59
Piecewise training for structured prediction
Sutton, C. A., & McCallum, A. (2009) · Machine Learning · doi:10.1007/s10994-009-5112-z · Cited by 55
Self-citationPal, C., Sutton, C. A., & McCallum, A. (2006) · doi:10.1109/icassp.2006.1661342 · Cited by 55
Self-citationUsing conditional random fields to predict pitch accents in conversational speech
Gregory, M., & Altün, Y. (2004) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1218955.1219041 · Cited by 52
Reducing weight undertraining in structured discriminative learning
Sutton, C. A., Sindelar, M., & McCallum, A. (2006) · doi:10.3115/1220835.1220847 · Cited by 48
Self-citationImproved Dynamic Schedules for Belief PropagationPreprint
Sutton, C. A., & McCallum, A. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.5291 · Cited by 44
Self-citationProtein Fold Recognition Using Segmentation Conditional Random Fields (SCRFs)
Liu, Y., Carbonell, J. G., Weigele, P., & Gopalakrishnan, V. (2006) · Journal of Computational Biology · doi:10.1089/cmb.2006.13.394 · Cited by 35
Efficient training methods for conditional random fields
McCallum, A. K., & Sutton, C. A. (2008) · Cited by 10
Self-citationEstimating the wrong Markov random field: Benefits in the computation-limited setting
Wainwright, M. J. (2005) · Cited by 5
Research works printed but not linked: 40
- Blunsom, 2006, Discriminative word alignment with conditional random fields, 65
- Bradley, 2010, Learning tree conditional random fields
- Clark, 2004, Parsing the WSJ using CCG and log-linear models, 103
- Cohn, 2006, European Conference on Machine Learning (ECML), 606
- Cowans, 2005, A graphical model for simultaneous partitioning and labeling
- Crammer, 2003, Ultraconservative online algorithms for multiclass problems, Journal of Machine Learning Research, 3, 951
- Culotta, 2004, First Conference on Email and Anti-Spam (CEAS)
- Culotta, 2004, Confidence estimation for information extraction, 10.3115/1613984.1614012 · doi:10.3115/1613984.1614012
- Daumé III, 2005, International Conference on Machine Learning (ICML)
- Dillon, 2010, Stochastic composite likelihood, Journal of Machine Learning Research, 11, 2597
- Globerson, 2007, Exponentiated gradient algorithms for log-linear structured prediction, 10.1145/1273496.1273535 · doi:10.1145/1273496.1273535
- Goodman, 2004, Exponential priors for maximum entropy models
- Graca, 2009, Posterior vs parameter sparsity in latent variable models, 664
- Kim, 2004, International joint workshop on natural language processing in biomedicine and its applications, 70
- Kulesza, 2008, Structured learning with approximate inference
- Le Cun, 1998, Neural Networks, Tricks of the Trade, Lecture Notes in Computer Scienc
- LeCun, 2007, Predicting Structured Data
- McCallum, 2000, International Conference on Machine Learning (ICML), 591
- McCallum, 2005, Advances in Neural Information Processing Systems 17, 905
- Miller, 2- 7 2004, HLT-NAACL 200f: Main Proceedings, 337
- Murray, 2006, Uncertainty in Artificial Intelligence (UAI), 359
- Ng, 2004, Feature selection, 11 vs. 12 regularization, and rotational invariance
- Ng, 2002, Advances in Neural Information Processing Systems 14, 841
- Qi, 2005, Bayesian conditional random fields
- Qi, 2005, Diagram structure recognition by Bayesian conditional random fields
- Rosenberg, 2007, Mixture-of-parents maximum entropy Markov models
- Sang, 2003, Proceedings of CoNLL-2003, 142
- Sarawagi, 2005, Advances in Neural Information Processing Systems 17, 1185
- Sato, 2005, RNA secondary structural alignment with conditional random fields, Bioinformatics, 21, Ü237, 10.1093/bioinformatics/bti1139 · doi:10.1093/bioinformatics/bti1139
- Singla, 2005, Proceedings of the National Conference on Artificial Intelligence, 868
- Stern, 2005, Advances in Neural Information Processing Systems 17, 1353
- Sutton, 2007, Introduction to Statistical Relational Learning
- Sutton, 2007, Dynamic conditional random fields: Factorized probabilistic models for labeling and segmenting sequence data, Journal of Machine Learning Research, 8, 693
- Taskar, 2004, Advances in Neural Information Processing Systems 16
- Wainwright, 2006, Advances in Neural Information Processing Systems 18
- Welling, 2006, Bayesian random fields: The Bethe-Laplace approximation
- Wick, 2009, SampleRank: Learning preferences from atomic gradients
- Wick, 2008, A discriminative approach to ontology alignment
- Yu, 2010, A quasiNewton approach to nonsmooth convex optimization problems in machine learning, Journal of Machine Learning Research, 11, 1145
- Zhang, 2011, Quasi-Newton Markov chain Monte Carlo
Cited by
Structural-RNN: Deep Learning on Spatio-Temporal Graphs
Jain, A., Zamir, A. R., Savarese, S., & Saxena, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.573 · Cited by 1,133
Marshall, I. J., & Wallace, B. C. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1074-9 · Cited by 638
“The conditional random field (CRF) is amongst the most prominent of these [18].”
BackgroundDeep Learning for Aspect-Based Sentiment Analysis: A Comparative Review
Do, H. H., Prasad, P., Maag, A., & Alsadoon, A. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.10.003 · Cited by 614
A review of natural language processing techniques for opinion mining systems
Sun, S., Luo, C., & Chen, J. (2017) · Information Fusion · doi:10.1016/j.inffus.2016.10.004 · Cited by 542
Exploiting Context for Rumour Detection in Social Media
Zubiaga, A., Liakata, M., & Procter, R. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67217-5_8 · Cited by 350
Metadata
- Authors
- Sutton, C., & McCallum, A.
- Venue
- Foundations and Trends® in Machine Learning
- Publisher
- Emerald
- Published
- 2012-08-23
- Volume
- 4
- Issue
- 4
- Pages
- 267-373
- ISSN
- 1935-8237 (ISSN-L)
- 1935-8245
- OpenAlex
- W2129999749
- Cited by
- 564
- References
- 136
- FWCI
- 43.06
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.