The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Parsing Argumentation Structures in Persuasive Essays
Open accessAbstract
In this article, we present a novel approach for parsing argumentation structures. We identify argument components using sequence labeling at the token level and apply a new joint model for detecting argumentation structures. The proposed model globally optimizes argument component types and argumentative relations using Integer Linear Programming. We show that our model significantly outperforms challenging heuristic baselines on two different types of discourse. Moreover, we introduce a novel corpus of persuasive essays annotated with argumentation structures. We show that our annotation scheme and annotation guidelines successfully guide human annotators to substantial agreement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533
(1992) · Cited by 23,431
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
A systematic analysis of performance measures for classification tasks
Sokolova, M., & Lapalme, G. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.03.002 · Cited by 7,515
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank
Socher, R., Perelygin, A., Wu, J., Chuang, J., Manning, C. D., Ng, A., & Potts, C. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1170 · Cited by 6,878
Thumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
Peter, P., & Turney (2002) · Cited by 3,650
Word association norms, mutual information, and lexicography
Church, K., & Hanks, P. (1990) · doi:10.5555/89086.89095 · Cited by 3,590
Accurate unlexicalized parsing
Klein, D., & Manning, C. D. (2003) · Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - ACL '03 · doi:10.3115/1075096.1075150 · Cited by 3,008
Estimating Continuous Distributions in Bayesian Classifiers
John, G. H., & Langley, P. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.4964 · Cited by 2,885
Feature-rich part-of-speech tagging with a cyclic dependency network
Toutanova, K., Klein, D., Manning, C. D., & Singer, Y. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073478 · Cited by 2,844
Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews
Turney, P. D. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073153 · Cited by 2,352
Collins, M. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118694 · Cited by 1,862
Head-Driven Statistical Models for Natural Language Parsing
Collins, M. (2003) · Computational Linguistics · doi:10.1162/089120103322753356 · Cited by 1,826
Ridge Estimators in Logistic Regression
Cessie, S. L., & Houwelingen, J. C. V. (1992) · Applied Statistics · doi:10.2307/2347628 · Cited by 1,680
Inter-Coder Agreement for Computational Linguistics
Artstein, R., & Poesio, M. (2008) · Computational Linguistics · doi:10.1162/coli.07-034-r2 · Cited by 1,665
Text Chunking Using Transformation-Based Learning
Ramshaw, L. A., & Marcus, M. P. (1999) · Text, Speech and Language Technology · doi:10.1007/978-94-017-2390-9_10 · Cited by 1,460
Asher, N. M., & Lascarides, A. (2003) · HAL · Cited by 1,115
The Penn Discourse TreeBank 2.0.
Prasad, R., Dinesh, N., Lee, A., Miltsakaki, E., Robaldo, L., Joshi, A., & Webber, B. (2008) · Proceedings of the Language Resources and Evaluation Conference · doi:10.63317/55sr8v9kexr7 · Cited by 1,115
RHETORICAL STRUCTURE THEORY: A THEORY OF TEXT ORGANIZATION
Mann, W. C. (1987) · Cited by 892
Fundamentals of Argumentation Theory
van Eemeren, F. H., Grootendorst, R., Johnson, R. H., Plantin, C., & Willard, C. A. (2013) · Routledge eBooks · doi:10.4324/9780203811306 · Cited by 807
Govier, T. (1985) · Cited by 704
Building a discourse-tagged corpus in the framework of Rhetorical Structure Theory
Carlson, L., Marcu, D., & Okurowski, M. E. (2001) · Proceedings of the Second SIGdial Workshop on Discourse and Dialogue - · doi:10.3115/1118078.1118083 · Cited by 584
Copi, I. M., Cohen, C., & McMahon, K. (2016) · doi:10.4324/9781315510897 · Cited by 497
Measuring the Reliability of Qualitative Text Analysis Data
krippendorff, K. (2004) · Quality & Quantity · doi:10.1007/s11135-004-8107-7 · Cited by 411
Sentence level discourse parsing using syntactic and lexical information
Soricut, R., & Marcu, D. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073475 · Cited by 402
ARAUCARIA: SOFTWARE FOR ARGUMENT ANALYSIS, DIAGRAMMING AND REPRESENTATION
REED, C., & ROWE, G. (2004) · International Journal on Artificial Intelligence Tools · doi:10.1142/s0218213004001922 · Cited by 393
An unsupervised approach to recognizing discourse relations
Marcu, D., & Echihabi, A. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073145 · Cited by 382
Apples-to-apples in cross-validation studies: pitfalls in classifier performance measurement
Forman, G., & Scholz, M. (2010) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1882471.1882479 · Cited by 368
Identifying Argumentative Discourse Structures in Persuasive Essays
Stab, C., & Gurevych, I. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1006 · Cited by 363
Self-citation(2009) · Cited by 352
Argumentation mining: the detection, classification and structure of arguments in text
Palau, R. M., & Moens, M.-F. (2009) · Proceedings of the 12th International Conference on Artificial Intelligence and Law · doi:10.1145/1568234.1568246 · Cited by 316
Recognizing stances in online debates
Somasundaran, S., & Wiebe, J. (2009) · Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - ACL-IJCNLP '09 · doi:10.3115/1687878.1687912 · Cited by 303
A PDTB-styled end-to-end discourse parser
LIN, Z., NG, H. T., & KAN, M.-Y. (2014) · Natural Language Engineering · doi:10.1017/s1351324912000307 · Cited by 286
From Argument Diagrams to Argumentation Mining in Texts: A Survey
Peldszus, A., & Stede, M. (2013) · International Journal of Cognitive Informatics and Natural Intelligence · doi:10.4018/jcini.2013010101 · Cited by 276
Automatic sense prediction for implicit discourse relations in text
Pitler, E., Louis, A., & Nenkova, A. (2009) · Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - ACL-IJCNLP '09 · doi:10.3115/1690219.1690241 · Cited by 276
Recognizing implicit discourse relations in the Penn Discourse Treebank
Lin, Z., Kan, M.-Y., & Ng, H. T. (2009) · Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing Volume 1 - EMNLP '09 · doi:10.3115/1699510.1699555 · Cited by 274
Argumentation Mining in User-Generated Web Discourse
Habernal, I., & Gurevych, I. (2016) · Computational Linguistics · doi:10.1162/coli_a_00276 · Cited by 273
Self-citationAutomatic detection of arguments in legal texts
Moens, M.-F., Boiy, E., Palau, R. M., & Reed, C. (2007) · Proceedings of the 11th international conference on Artificial intelligence and law · doi:10.1145/1276318.1276362 · Cited by 262
Annotating Argument Components and Relations in Persuasive Essays
Stab, C., & Gurevych, I. (2014) · TUbilio (Technical University of Darmstadt) · Cited by 253
Self-citationMochales, R., & Moens, M.-F. (2011) · Artificial Intelligence and Law · doi:10.1007/s10506-010-9104-x · Cited by 252
O'Keefe, D. J. (1977) · Argumentation and Advocacy · doi:10.1080/00028533.1977.11951098 · Cited by 250
HILDA: A Discourse Parser Using Support Vector Machine Classification
Hernault, H., Prendinger, H., Verle, D. A. D., & Ishizuka, M. (2010) · Dialogue & Discourse · doi:10.5087/dad.2010.003 · Cited by 246
A Corpus for Research on Deliberation and Debate
Walker, M. A., Tree, J. E. F., Anand, P., Abbott, R., & King, J. (2012) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2ommjodrhqvf · Cited by 223
Show Me Your Evidence - an Automatic Method for Context Dependent Evidence Detection
Rinott, R., Dankin, L., Alzate Perez, C., Khapra, M. M., Aharoni, E., & Slonim, N. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1050 · Cited by 199
Context Dependent Claim Detection
Levy, R., Bilu, Y., Hershcovich, D., Aharoni, E., & Slonim, N. (2014) · Cited by 183
Classifying arguments by scheme
Feng, V. W., & Hirst, G. (2011) · Cited by 178
Argumentation Schema and the Myside Bias in Written Argumentation
Wolfe, C. R., Britt, M. A., & Butler, J. A. (2009) · Written Communication · doi:10.1177/0741088309333019 · Cited by 173
A Linear-Time Bottom-Up Discourse Parser with Constraints and Post-Editing
Feng, V. W., & Hirst, G. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-1048 · Cited by 168
Identifying Appropriate Support for Propositions in Online User Comments
Park, J., & Cardie, C. (2014) · Workshop on Argument Mining (ArgMining) · doi:10.3115/v1/w14-2105 · Cited by 165
Modeling Argument Strength in Student Essays
Persing, I., & Ng, V. (2015) · doi:10.3115/v1/p15-1053 · Cited by 161
Back up your Stance: Recognizing Arguments in Online Discussions
Boltužić, F., & Šnajder, J. (2014) · Proceedings of the First Workshop on Argumentation Mining · doi:10.3115/v1/w14-2107 · Cited by 159
Joint prediction in MST-style discourse parsing for argumentation mining
Peldszus, A., & Stede, M. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1110 · Cited by 137
Aharoni, E., Polnarov, A., Lavee, T., Hershcovich, D., Levy, R., Rinott, R., Gutfreund, D., & Slonim, N. (2014) · Workshop on Argument Mining (ArgMining) · doi:10.3115/v1/w14-2109 · Cited by 136
A broad-coverage collection of portable NLP components for building shareable analysis pipelines
de Castilho, R. E., & Gurevych, I. (2014) · doi:10.3115/v1/w14-5201 · Cited by 130
Self-citationA taxonomy of argumentation models used for knowledge representation
Bentahar, J., Moulin, B., & Bélanger, M. (2010) · Artificial Intelligence Review · doi:10.1007/s10462-010-9154-1 · Cited by 102
Analyzing Argumentative Discourse Units in Online Interactions
Ghosh, D., Muresan, S., Wacholder, N., Aakhus, M. A., & Mitsui, M. R. (2014) · Workshop on Argument Mining (ArgMining) · doi:10.3115/v1/w14-2106 · Cited by 99
Argument Extraction from News, Blogs, and Social Media
Goudas, T., Louizos, C., Petasis, G., & Karkaletsis, V. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07064-3_23 · Cited by 95
Joint Morphological and Syntactic Analysis for Richly Inflected Languages
Bohnet, B., Nivre, J., Boguslavsky, I., Farkas, R., Ginter, F., & Hajič, J. (2013) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00238 · Cited by 93
Applying Argumentation Schemes for Essay Scoring
Yi, S., Heilman, M., Klebanov, B. B., & Deane, P. (2014) · Workshop on Argument Mining (ArgMining) · doi:10.3115/v1/w14-2110 · Cited by 87
Linking the Thoughts: Analysis of Argumentation Structures in Scientific Publications
Kirschner, C., Eckle‐Kohler, J., & Gurevych, I. (2015) · Workshop on Argument Mining (ArgMining) · doi:10.3115/v1/w15-0501 · Cited by 85
Self-citationSardianos, C., Katakis, I. M., Petasis, G., & Karkaletsis, V. (2015) · Workshop on Argument Mining (ArgMining) · doi:10.3115/v1/w15-0508 · Cited by 84
Discourse parsing for multi-party chat dialogues
Afantenos, S., Kow, E., Asher, N. M., & Perret, J. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1109 · Cited by 77
Language Resources for Studying Argument
Reed, C., Palau, R. M., Rowe, G., & Moens, M. (2008) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/2f4rjqrpyfr6 · Cited by 74
Extracting Argument and Domain Words for Identifying Argument Components in Texts
Nguyen, H. V., & Litman, D. J. (2015) · Workshop on Argument Mining (ArgMining) · doi:10.3115/v1/w15-0503 · Cited by 74
State-of-the-Art: The Structure of Argumentation
Henkemans, A. F. S. (2000) · Argumentation · doi:10.1023/a:1007800305762 · Cited by 73
IDENTIFYING JUSTIFICATIONS IN WRITTEN DIALOGS BY CLASSIFYING TEXT AS ARGUMENTATIVE
Biran, O., & Rambow, O. (2011) · International Journal of Semantic Computing · doi:10.1142/s1793351x11001328 · Cited by 62
Towards segment-based recognition of argumentation structure in short texts
Peldszus, A. (2014) · Workshop on Argument Mining (ArgMining) · doi:10.3115/v1/w14-2112 · Cited by 57
Argument extraction for supporting public policy formulation
Florou, E., Konstantopoulos, S., Koukourikos, A., & Karampiperis, P. (2013) · Cited by 56
And That's A Fact: Distinguishing Factual and Emotional Argumentation in Online Dialogue
Oraby, S., Reed, L., Compton, R., Riloff, E., Walker, M., & Whittaker, S. (2015) · Workshop on Argument Mining (ArgMining) · doi:10.3115/v1/w15-0515 · Cited by 54
Natural Language Arguments: A Combined Approach
Cabrio, E., & Villata, S. (2012) · Frontiers in artificial intelligence and applications · doi:10.3233/978-1-61499-098-7-205 · Cited by 53
Identifying and classifying subjective claims
Kwon, N., Zhou, L., Hovy, E. H., & Shulman, S. W. (2007) · doi:10.5555/1248460.1248473 · Cited by 46
DKPro Agreement: An Open-Source Java Library for Measuring Inter-Rater Agreement
Meyer, C. M., Mieskes, M., Stab, C., & Gurevych, I. (2014) · TUbilio (Technical University of Darmstadt) · Cited by 40
Self-citationFrom Discourse Analysis to Argumentation Schemes and Back: Relations and Differences
Cabrio, E., Tonelli, S., & Villata, S. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40624-9_1 · Cited by 36
Creating an argumentation corpus: do theories apply to real arguments?
Palau, R. M., & Ieven, A. (2009) · International Conference on Artificial Intelligence and Law · doi:10.1145/1568234.1568238 · Cited by 34
Stab, C., Kirschner, C., Eckle‐Kohler, J., & Gurevych, I. (2014) · TUbilio (Technical University of Darmstadt) · Cited by 33
Self-citationArgumentation Mining: Where are we now, where do we want to be and how do we get there?
Moens, M. (2013) · doi:10.1145/2701336.2701635 · Cited by 30
Managing Uncertainty in Semantic Tagging
Cinková, S., Holub, M., & ⁄, V. K. (2012) · Cited by 16
Gema, A. P., Winton, S., David, T., Suhartono, D., Shodiq, M., & Gazali, W. (2017) · Procedia Computer Science · doi:10.1016/j.procs.2017.10.036 · Cited by 10
(2012) · Research Explorer (The University of Manchester)
Research works printed but not linked: 15
- Afantenos, Stergos and Nicholas Asher. 2014. Counter-argumentation and discourse: A case study. In Proceedings of the Workshop on Frontiers and Connections between Argumentation Theory and Natural Language Processing, pages 11–16, Bertinoro.
- Beigman Klebanov, Beata and Derrick Higgins. 2012. Measuring the use of factual information in test-taker essays. In Proceedings of the Seventh Workshop on Building Educational Applications Using NLP, pages 63–72, Montreal.
- Botley, Simon Philip. 2014. Argument structure in learner writing: a corpus-based analysis using argument mapping. Kajian Malaysia, 32(1):45–77.
- Braud, Chloé and Pascal Denis. 2014. Combining natural and artificial examples to improve implicit discourse relation identification. In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, pages 1694–1705, Dublin.
- Cabrio, Elena and Serena Villata. 2014. NoDE: A benchmark of natural language arguments. In Proceedings of COMMA, pages 449–450, Pitlochry. · doi:10.3233/978-1-61499-436-7-449
- 10.3115/v1/W15-0504 · doi:10.3115/v1/w15-0504
- Cohen, Robin. 1987. Analyzing the structure of argumentative discourse. Computational Linguistics, 13(1-2):11–24.
- 10.22329/il.v13i3.2564 · doi:10.22329/il.v13i3.2564
- 10.3115/v1/P14-5011 · doi:10.3115/v1/p14-5011
- 10.3115/v1/D14-1083 · doi:10.3115/v1/d14-1083
- Lippi, Marco and Paolo Torroni. 2015. Context-independent claim detection for argument mining. In Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence (IJCAI 2015), pages 185–191, Buenos Aires.
- Louis, Annie, Aravind Joshi, Rashmi Prasad, and Ani Nenkova. 2010. Using entity features to classify implicit discourse relations. In Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue, SIGDIAL '10, pages 59–62, Stroudsburg, PA.
- Rooney, Niall, Hui Wang, and Fiona Browne. 2012. Applying kernel methods to argumentation mining. In Proceedings of the Twenty-Fifth International Florida Artificial Intelligence Research Society Conference, FLAIRS '12, pages 272–275, Marco Island, FL.
- Søgaard, Anders. 2013. Estimating effect size across datasets. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 607–611, Atlanta.
- 10.22329/il.v13i3.2563 · doi:10.22329/il.v13i3.2563
Cited by
Lawrence, J., & Reed, C. (2020) · Computational Linguistics · doi:10.1162/coli_a_00364 · Cited by 396
Fake News Stance Detection Using Deep Learning Architecture (CNN-LSTM)
Umer, M., Imtiaz, Z., Ullah, S., Mehmood, A., Choi, G. S., & On, B.-W. (2020) · IEEE Access · doi:10.1109/access.2020.3019735 · Cited by 327
ArgueTutor: An Adaptive Dialog-Based Learning System for Argumentation Skills
Wambsganss, T., Kueng, T., Soellner, M., & Leimeister, J. M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445781 · Cited by 138
Seeing Things from a Different Angle:Discovering Diverse Perspectives about Claims
Chen, S., Khashabi, D., Yin, W., Callison-Burch, C., & Roth, D. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1053 · Cited by 104
Argument Mining for Understanding Peer Reviews
Hua, X., Nikolov, M., Badugu, N., & Wang, L. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1219 · Cited by 86
Metadata
- Authors
- Stab, C., & Gurevych, I.
- Venue
- Computational Linguistics
- Publisher
- MIT Press
- Published
- 2017-09
- Volume
- 43
- Issue
- 3
- Pages
- 619-659
- ISSN
- 0891-2017 (ISSN-L)
- 1530-9312
- OpenAlex
- W2343649478
- Cited by
- 388
- References
- 83
- FWCI
- 24.27
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.