The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Introduction to the CoNLL-2005 shared task: semantic role labeling
Open accessAbstract
In this paper we describe the CoNLL-2005 shared task on Semantic Role Labeling.We introduce the specification and goals of the task, describe the data sets and evaluation methods, and present a general overview of the 19 systems that have contributed to the task, providing a comparative description and results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Building a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
Introduction to the CoNLL-2003 Shared Task: Language-Independent Named Entity Recognition
Tjong Kim Sang, E. F., & De Meulder, F. (2003) · Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003 - · doi:10.3115/1119176.1119195 · Cited by 2,788
The Proposition Bank: An Annotated Corpus of Semantic Roles
Palmer, M., Gildea, D., & Kingsbury, P. (2005) · Computational Linguistics · doi:10.1162/0891201053630264 · Cited by 2,273
Head-Driven Statistical Models for Natural Language Parsing
Collins, M. (2003) · Computational Linguistics · doi:10.1162/089120103322753356 · Cited by 1,826
Automatic Labeling of Semantic Roles
Gildea, D., & Jurafsky, D. (2002) · Computational Linguistics · doi:10.1162/089120102760275983 · Cited by 1,626
Introduction to the CoNLL-2002 Shared Task: Language-Independent Named Entity Recognition
Sang, E. T. K. (2002) · arXiv (Cornell University) · doi:10.48550/arxiv.cs/0209010 · Cited by 1,560
(1999) · Cited by 1,521
Introduction to the CoNLL-2004 Shared Task: Semantic Role Labeling
Carreras, X., & Màrquez, L. (2004) · Cited by 395
Self-citationUsing predicate-argument structures for information extraction
Surdeanu, M., Harabagiu, S., Williams, J., & Aarseth, P. (2003) · Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - ACL '03 · doi:10.3115/1075096.1075098 · Cited by 364
Calibrating Features for Semantic Role Labeling
Xue, N., & Palmer, M. S. (2004) · Cited by 316
Cited by
The Proposition Bank: An Annotated Corpus of Semantic Roles
Palmer, M., Gildea, D., & Kingsbury, P. (2005) · Computational Linguistics · doi:10.1162/0891201053630264 · Cited by 2,273
Predicting crime using Twitter and kernel density estimation
Gerber, M. S. (2014) · Decision Support Systems · doi:10.1016/j.dss.2014.02.003 · Cited by 581
The CoNLL-2008 shared task on joint parsing of syntactic and semantic dependencies
Surdeanu, M., Johansson, R., Meyers, A., Màrquez, L., & Nivre, J. (2008) · Proceedings of the Twelfth Conference on Computational Natural Language Learning - CoNLL '08 · doi:10.3115/1596324.1596352 · Cited by 491
Self-citationEfficient Convolution Kernels for Dependency and Constituent Syntactic Trees
Moschitti, A. (2006) · Lecture Notes in Computer Science · doi:10.1007/11871842_32 · Cited by 452
SemEval-2010 Task 8: Multi-Way Classification of Semantic Relations Between Pairs of Nominals
Hendrickx, I., Kim, S. N., Kozareva, Z., Nakov, P., Séaghdha, D. Ó., Padó, S., Marco Pennacchiotti, B., Romano, L., & Śzpakowicz, S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.10422 · Cited by 444
Open information extraction: the second generation
Etzioni, O., Fader, A., Christensen, J., Soderland, S. G., & Mausam, M. (2011) · doi:10.5591/978-1-57735-516-8/ijcai11-012 · Cited by 430
Deep Semantic Role Labeling: What Works and What’s Next
He, L., Lee, K., Lewis, M., & Zettlemoyer, L. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1044 · Cited by 420
DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs
Dua, D., Wang, Y., Dasigi, P., Stanovsky, G., Singh, S., & Gardner, M. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1246 · Cited by 393
The Importance of Syntactic Parsing and Inference in Semantic Role Labeling
Punyakanok, V., Roth, D., & Yih, W.-T. (2008) · Computational Linguistics · doi:10.1162/coli.2008.34.2.257 · Cited by 391
Biases in Large Language Models: Origins, Inventory, and Discussion
Navigli, R., Conia, S., & Ross, B. (2023) · Journal of Data and Information Quality · doi:10.1145/3597307 · Cited by 364
(2013) · Iris (University of Trento) · Cited by 360
End-to-end learning of semantic role labeling using recurrent neural networks
Zhou, J., & Xu, W. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1109 · Cited by 333
SemEval-2007 task 17: English lexical sample, SRL and all words
Pradhan, S. S., Loper, E., Dligach, D., & Palmer, M. (2007) · Proceedings of the 4th International Workshop on Semantic Evaluations - SemEval '07 · doi:10.3115/1621474.1621490 · Cited by 297
Das, D., Chen, D., Martins, A. F. T., Schneider, N., & Smith, N. A. (2014) · Computational Linguistics · doi:10.1162/coli_a_00163 · Cited by 292
Gupta, S., & Malik, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.04474 · Cited by 289
P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks
Liu, X., Ji, K., Fu, Y., Tam, W. L., Du, Z., Yang, Z., & Tang, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07602 · Cited by 254
DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs
Dua, D., Wang, Y., Dasigi, P., Stanovsky, G., Singh, S., & Gardner, M. (2019) · arXiv · doi:10.48550/arxiv.1903.00161 · Cited by 238
Reasoning Over Semantic-Level Graph for Fact Checking
Zhong, W., Xu, J., Tang, D., Xu, Z., Duan, N., Zhou, M., Wang, J., & Yin, J. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.549 · Cited by 151
Potential and Limitations of LLMs in Capturing Structured Semantics: A Case Study on SRL
Cheng, N., Yan, Z., Wang, Z., Li, Z., Yu, J., Zheng, Z., Tu, K., Xu, J., & Han, W. (2024) · Lecture Notes in Computer Science · doi:10.1007/978-981-97-5663-6_5 · Cited by 13
(2012) · Research Explorer (The University of Manchester)
Metadata
- Authors
- Carreras, X., & Màrquez, L.
- Venue
- Proceedings of the Ninth Conference on Computational Natural Language Learning - CONLL '05
- Published
- 2005
- Pages
- 152
- OpenAlex
- W2126851059
- Cited by
- 642
- References
- 20
- FWCI
- 40.78
- Type
- conference paper
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.