Learning Soft Linear Constraints with Application to Citation Field Extraction
Open accessAbstract
Accurately segmenting a citation string into fields for authors, titles, etc. is a challenging task because the output typically obeys various global constraints. Previous work has shown that modeling soft constraints, where the model is encouraged, but not require to obey the constraints, can substantially improve segmentation performance. On the other hand, for imposing hard constraints, dual decomposition is a popular technique for efficient prediction given existing algorithms for unconstrained inference. We extend the technique to perform prediction subject to soft constraints. Moreover, with a technique for performing inference given soft constraints, it is easy to automatically generate large families of constraints and learn their costs with a simple convex optimization problem during training. This allows us to obtain substantial gains in accuracy on a new, challenging citation extraction dataset.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Purely rule-based extraction is often brittle and difficult to scale across bibliography styles, and learning-based approaches such as soft-constrained citation field extractors trained on the UMass Citations corpus still leave residual character-level errors that propagate into downstream verification.
“As a result, purely rule-based extraction is often brittle and difficult to scale across bibliography styles, and learning-based approaches such as soft-constrained citation field extractors trained on the UMass Citations corpus [4, 3] still leave residual character-level errors that propagate into downstream verification.”
From Source or It Didn't Happen: A Multi-Agent Framework for Citation Hallucination Detection (2026) · cites this paper as [4]
Split into 2 atoms — 0 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 1 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421 · see citing works
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601 · see citing works
(2009) · Cited by 6,153 · see citing works
Incorporating non-local information into information extraction systems by Gibbs sampling
Finkel, J. R., Grenager, T., & Manning, C. D. (2005) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1219840.1219885 · Cited by 3,028 · see citing works
Discriminative training methods for hidden Markov models
Collins, M. (2002) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1118693.1118694 · Cited by 1,863 · see citing works
Support vector machine learning for interdependent and structured output spaces
Tsochantaridis, I., Hofmann, T., Joachims, T., & Altun, Y. (2004) · International Conference on Machine Learning · doi:10.1145/1015330.1015341 · Cited by 1,493 · see citing works
A Linear Programming Formulation for Global Inference in Natural Language Tasks
Roth, D., & Yih, W.-T. (2004) · Cited by 441 · see citing works
Learning Hidden Markov Model Structure for Information Extraction
Seymore, K., & Rosenfeld, R. (2018) · doi:10.1184/r1/6606872 · Cited by 381 · see citing works
Accurate Information Extraction from Research Papers using Conditional Random Fields
Peng, F., & McCallum, A. (2004) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 271 · see citing works
Self-citationMRF Optimization via Dual Decomposition: Message-Passing Revisited
Nikos Komodakis, A., Nikos Paragios, A., & Tziritas, G. (2007) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2007.4408890 · Cited by 258 · see citing works
On Dual Decomposition and Linear Programming Relaxations for Natural Language Processing
Rush, A. M., Sontag, D. A., Collins, M., & Jaakkola, T. (2010) · Cited by 163 · see citing works
Dual Decomposition for Parsing with NonProjective Head Automata
Koo, T., Rush, A. M., Collins, M., Jaakkola, T., & Sontag, D. A. (2010) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 161 · see citing works
Introduction to dual composition for inference
Sontag, D. A., Globerson, A., & Jaakkola, T. (2011) · Cited by 150 · see citing works
Collective Segmentation and Labeling of Distant Entities in Information Extraction
Sutton, C. A., & McCallum, A. (2004) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 141 · see citing works
Self-citationCollective information extraction with relational Markov networks
Bunescu, R., & Mooney, R. J. (2004) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1218955.1219011 · Cited by 137 · see citing works
Structured learning with constrained conditional models
Chang, M.-W., Ratinov, L., & Roth, D. (2012) · Machine Learning · doi:10.1007/s10994-012-5296-5 · Cited by 117 · see citing works
Rush, A. M., & Collins, M. J. (2012) · Journal of Artificial Intelligence Research · doi:10.1613/jair.3680 · Cited by 107 · see citing works
Introduction to Dual Decomposition for Inference
Sontag, D. A., Globerson, A., & Jaakkola, T. (2011) · The MIT Press eBooks · doi:10.7551/mitpress/8996.003.0010 · Cited by 71 · see citing works
Approximate inference in graphical models using lp relaxations
Jaakkola, T., & Sontag, D. A. (2010) · Cited by 61 · see citing works
A simple method for citation metadata extraction using hidden markov models
Hetzner, E. (2008) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/1378889.1378937 · Cited by 56 · see citing works
A New Dataset for Fine-Grained Citation Field Extraction
Anzaroot, S., & McCallum, A. (2013) · Cited by 20 · see citing works
Self-citationImplicitly Intersecting Weighted Automata using Dual Decomposition
Paul, M. J., & Eisner, J. M. (2012) · Cited by 9 · see citing works
Chieu, H. L., & Teow, L.-N. (2012) · Cited by 6 · see citing works
Flagged first, then by citations
1 of the 24 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- In Information Fusion (FUSION), 2012 15th Inter- national Conference on, pages 231-238. IEEE.
- Michael J Paul and Jason Eisner. 2012. Implicitly in- tersecting weighted automata using dual decompo- sition. In Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Tech- nologies, pages 232-242. Association for Computa- tional Linguistics.
- Alexander M Rush, Roi Reichart, Michael Collins, and Amir Globerson. 2012. Improved parsing and pos tagging using inter-sentence consistency constraints. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Process- ing and Computational Natural Language Learning, pages 1434-1444.
Cited by
Sorted by citations
Information extraction from scientific articles: a survey
Nasar, Z., Jaffry, S. W., & Malik, M. K. (2018) · Scientometrics · doi:10.1007/s11192-018-2921-5 · Cited by 122 · see citing works
LPF: A Language-Prior Feedback Objective Function for De-biased Visual Question Answering
Liang, Z., Hu, H., & Zhu, J. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462981 · Cited by 50 · see citing works
Meuschke, N., Jagdale, A., Spinde, T., Mitrović, J., & Gipp, B. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-28032-0_31 · Cited by 27 · see citing works
Fashion-GPT: Integrating LLMs with Fashion Retrieval System
Chen, Q., Zhang, T., Nie, M., Wang, Z., Xu, S., Shi, W., & Cao, Z. (2023) · doi:10.1145/3607827.3616844 · Cited by 16 · see citing works
Zhang, B., Şimşek, M., Kulhandjian, M., & Kantarcı, B. (2024) · Electronics · doi:10.3390/electronics13091765 · Cited by 14 · see citing works
Gong, J., Sun, J., Chu, M., Wang, X., Luo, M., Lu, Y., Zhang, L., Wu, Y., Wang, Q., & Liu, C. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579623 · Cited by 11 · see citing works
Atlas: Automating Cross-Language Fuzzing on Android Closed-Source Libraries
Xiong, H., Dai, Q., Chang, R., Qiu, M., Wang, R., Shen, W., & Zhou, Y. (2024) · ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA) · doi:10.1145/3650212.3652133 · Cited by 9 · see citing works
Learning Constraints for Structured Prediction Using Rectifier Networks
Pan, X., Mehta, M., & Srikumar, V. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.438 · Cited by 7 · see citing works
Testing the Fault-Tolerance of Multi-sensor Fusion Perception in Autonomous Driving Systems
Tian, H., Ding, W., Han, X., Wu, G., Guo, A., Zhang, J., Chen, W., Wei, J., & Zhang, T. (2025) · Proceedings of the ACM on software engineering. · doi:10.1145/3728910 · Cited by 6 · see citing works
Guo, Y., Reichart, R., & Korhonen, A. (2015) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00128 · Cited by 6 · see citing works
Embedded-State Latent Conditional Random Fields for Sequence Labeling
Thai, D., Ramesh, S. H., Murty, S., Vilnis, L., & McCallum, A. (2018) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k18-1001 · Cited by 5 · see citing works
Self-citationAutomated Discrimination of Cough in Audio Recordings: A Scoping Review
Sharan, P. (2022) · Frontiers in Signal Processing · doi:10.3389/frsip.2022.759684 · Cited by 4 · see citing works
Zheng, V. W., & Chang, K. C. (2016) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2983323.2983860 · Cited by 3 · see citing works
Message passing for soft constraint dual decomposition
Belanger, D., Passos, A., Riedel, S., & McCallum, A. (2014) · Cited by 2 · see citing works
Self-citationInformation Retrieval Optimization for Non-Exemplar Class Incremental Learning
Guo, S., Gu, Y., Ma, Y., Zhang, Y., Weng, W., Liu, J., Dai, W., & Chen, Y. (2024) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3627673.3679631 · Cited by 1 · see citing works
Determining of Parameters of a Distribution Approximating Unimodal Distribution
Buranova, M., Kartashevskiy, V., Ushakov, V., & Aziz, A. (2024) · International Conference on Future Networks and Distributed Systems (ICFNDS) · doi:10.1145/3726122.3726161 · Cited by 1 · see citing works
P 2 VS: Progressive Partition-Based Volumetric Video Streaming under Network Dynamics
Wu, J., Liu, H., Zhang, J., Wang, D., & Jiang, J. B. (2025) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3746027.3755403 · Cited by 1 · see citing works
Bayesian Causal Inference for Real World Interactive Systems
Chopin, N., Gartrell, M., Liang, D., Lumbreras, A., Rohde, D., & Wang, Z. (2021) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3447548.3469447 · Cited by 1 · see citing works
Source or It Didn't Happen: A Multi-Agent Framework for Citation Hallucination Detection
Li, M., Lin, Z., & Ma, S. (2026) · arXiv · doi:10.48550/arxiv.2605.08583
Toward Solving Penn Treebank Parsing
Choe, D. K. (2017) · doi:10.7301/z0z899vv
F-AVSS: A Fuzzy Layer-Importance Metric for Efficient Large Language Model Compression
Song, Z., Kang, X., & Kang, Z. (2026) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2026.3708997
- Authors
- Anzaroot, S., Passos, A., Belanger, D., & McCallum, A.
- Affiliations
- University of Massachusetts Amherst (US)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2014
- Pages
- 593-602
- ISSN
- 0736-587X (ISSN-L)
- arXiv
- 1403.1349
- OpenAlex
- W2964269754
- Cited by
- 20
- References
- 24
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 4 · 2023: 3 · 2022: 1 · 2021: 2 · 2020: 1 · 2018: 2 · 2017: 1 · 2016: 1 · 2015: 1 · 2014: 1
- FWCI
- 0.79
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Proceedings of the conference - Association for Computational Linguistics. Meeting (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (0958392)
- Defense Advanced Research Projects Agency (FA8750-13-2-0020, FA8750)
- Intelligence Advanced Research Projects Activity
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- dual decomposition, constrained inference, constraint learning, convex optimization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
