The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Optimizing Statistical Machine Translation for Text Simplification
Open accessAbstract
Most recent sentence simplification systems use basic machine translation models to learn lexical and syntactic paraphrases from a manually simplified parallel corpus. These methods are limited by the quality and quantity of manually simplified corpora, which are expensive to build. In this paper, we conduct an in-depth adaptation of statistical machine translation to perform text simplification, taking advantage of large-scale paraphrases learned from bilingual texts and a small amount of manual simplifications with multiple references. Our work is the first to design automatic metrics that are effective for tuning and evaluating simplification systems, which will facilitate iterative development for this task.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kincaid, J. P., Fishburne, Jr., Robert P., R., Richard L., C., & Brad, S. (1975) · doi:10.21236/ada006655 · Cited by 3,497
Minimum error rate training in statistical machine translation
Och, F. J. (2003) · Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - ACL '03 · doi:10.3115/1075096.1075117 · Cited by 2,725
A Neural Attention Model for Abstractive Sentence Summarization
Rush, A. M., Chopra, S., & Weston, J. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1044 · Cited by 2,656
Hierarchical Phrase-Based Translation
Chiang, D. (2007) · Computational Linguistics · doi:10.1162/coli.2007.33.2.201 · Cited by 1,144
Collecting Highly Parallel Data for Paraphrase Evaluation
Chen, D. J., & Dolan, W. B. (2011) · Cited by 904
Paraphrasing with bilingual parallel corpora
Bannard, C., & Callison-Burch, C. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219914 · Cited by 533
Self-citationSummarization beyond sentence extraction: A probabilistic approach to sentence compression
Knight, K., & Marcu, D. (2002) · Artificial Intelligence · doi:10.1016/s0004-3702(02)00222-9 · Cited by 482
Problems in Current Text Simplification Research: New Data Can Help
Xu, W., Callison-Burch, C., & Napoles, C. (2015) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00139 · Cited by 369
Self-citationA Monolingual Tree-based Translation Model for Sentence Simplification
Zhu, Z., Darmstadt, T. U., Bernhard, D., & Gurevych, I. (2010) · TUbilio (Technical University of Darmstadt) · Cited by 334
Syntax augmented machine translation via chart parsing
Zollmann, A., & Venugopal, A. (2006) · Proceedings of the Workshop on Statistical Machine Translation - StatMT '06 · doi:10.3115/1654650.1654671 · Cited by 305
Better Evaluation for Grammatical Error Correction
Dahlmeier, D., & Ng, H. T. (2012) · Cited by 303
Syntactic Simplification and Text Cohesion
Siddharthan, A. (2006) · Research on Language and Computation · doi:10.1007/s11168-006-9011-1 · Cited by 271
Sentence Compression by Deletion with LSTMs
Filippova, K., Alfonseca, E., Colmenares, C. A., Kaiser, L., & Vinyals, O. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1042 · Cited by 241
Sentence Simplification by Monolingual Machine Translation
Wubben, S., van den Bosch, A. P. J., & Krahmer, E. (2012) · Research portal (Tilburg University) · Cited by 237
Hopkins, M., & May, J. (2011) · Cited by 237
Learning to Simplify Sentences with Quasi-Synchronous Grammar and Integer Programming
Woodsend, K., & Lapata, M. (2011) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 210
A survey of research on text simplification
Siddharthan, A. (2014) · ITL - International Journal of Applied Linguistics · doi:10.1075/itl.165.2.06sid · Cited by 200
Simple English Wikipedia: A New Text Simplification Task
Cöster, W., & Kauchak, D. (2011) · Cited by 181
Text simplification for language learners: a corpus analysis
Petersen, S. E., & Ostendorf, M. (2007) · Speech and Language Technology in Education (SLaTE 2007) · doi:10.21437/slate.2007-20 · Cited by 174
Simplifying Text for Language-Impaired Readers.
Carroll, J., Minnen, G., Pearce, D., Canning, Y., Devlin, S. L., & Tait, J. I. (1999) · Cited by 154
Ground Truth for Grammaticality Correction Metrics
Napoles, C., Sakaguchi, K., Post, M., & Tetreault, J. (2015) · doi:10.3115/v1/p15-2097 · Cited by 151
Self-citationPutting it Simply: a Context-Aware Approach to Lexical Simplification
Biran, O., Brody, S., & Elhadad, N. (2011) · doi:10.7916/d8cv4s20 · Cited by 142
Improving Text Simplification Language Modeling Using Unsimplified Text Data
Kauchak, D. (2013) · Cited by 128
Learning to Simplify Sentences Using Wikipedia
Coster, W., & Kauchak, D. (2011) · Cited by 128
For the sake of simplicity: Unsupervised extraction of lexical simplifications from WikipediaPreprint
Yatskar, M., Pang, B., Danescu-Niculescu-Mizil, C., & Lee, L. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1008.1986 · Cited by 127
Text simplification for reading assistance
Inui, K., Fujita, A., Takahashi, T., Iida, R., & Iwakura, T. (2003) · doi:10.3115/1118984.1118986 · Cited by 126
Text simplification for children
Belder, J. D., & Moens, M. (2010) · Lirias · Cited by 126
Dependency tree based sentence compression
Filippova, K., & Strube, M. (2008) · doi:10.3115/1708322.1708329 · Cited by 125
Facilita: reading assistance for low-literacy readers
Watanabe, W. M., Cândido, A., Uzêda, V. R., Fortes, R. P. D. M., Pardo, T. A. S., & Aluísio, S. M. (2009) · ACM International Conference on Design of Communication (SIGDOC) · doi:10.1145/1621995.1622002 · Cited by 105
Models for sentence compression
Clarke, J., & Lapata, M. (2006) · International Conference on Computational Linguistics · doi:10.3115/1220175.1220223 · Cited by 103
Aligning Sentences from Standard Wikipedia to Simple Wikipedia
Hwang, W., Hajishirzi, H., Mari Ostendorf, E., & Wu, W. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1022 · Cited by 102
deltaBLEU: A Discriminative Metric for Generation Tasks with Intrinsically Diverse Targets
Galley, M., Brockett, C., Sordoni, A., Ji, Y., Auli, M., Quirk, C., Mitchell, M., Gao, J., & Dolan, B. (2015) · doi:10.3115/v1/p15-2073 · Cited by 101
Simple PPDB: A Paraphrase Database for Simplification
Pavlick, E., & Callison-Burch, C. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-2024 · Cited by 89
Self-citationSyntactic simplification for improving content selection in multi-document summarization
Siddharthan, A., Nenkova, A., & McKeown, K. R. (2004) · International Conference on Computational Linguistics · doi:10.3115/1220355.1220484 · Cited by 88
Xu, W. H., Ritter, A., Dolan, B., Grishman, R., & Cherry, C. (2012) · NPARC · Cited by 88
Self-citationJoint Learning of a Dual SMT System for Paraphrase Generation
Sun, H. M., & Zhou, M. (2012) · Cited by 69
Towards a standard evaluation method for grammatical error detection and correction
Felice, M., & Briscoe, T. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1060 · Cited by 66
A Deeper Exploration of the Standard PB-SMT Approach to Text Simplification and its Evaluation
Štajner, S., Béchara, H., & Saggion, H. (2015) · doi:10.3115/v1/p15-2135 · Cited by 38
TESLA: Translation Evaluation of Sentences with Linear-Programming-Based Analysis
Liu, C., Dahlmeier, D., & Ng, H. T. (2010) · Cited by 34
Joshua 4.0: Packing, PRO, and Paraphrases
Ganitkevitch, J., Cao, Y., Weese, J., Post, M., & Callison-Burch, C. (2013) · Cited by 30
Self-citationJoshua 3.0: Syntax-based Machine Translation with the Thrax Grammar Extractor
Weese, J., Ganitkevitch, J., Callison-Burch, C., Post, M., & Lopez, A. (2011) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 26
Self-citationPORT: a Precision-Order-Recall MT Evaluation Metric for Tuning
Chen, B., Kühn, R., & Larkin, S. (2012) · NPARC · Cited by 24
Reformulating Discourse Connectives for Non-Expert Readers
Siddharthan, A., & Katsos, N. (2010) · Open Research Online (The Open University) · Cited by 21
Joshua 5.0: Sparser, Better, Faster, Server
Post, M., Ganitkevitch, J., Orland, L., Weese, J., Cao, Y., & Callison-Burch, C. (2013) · Workshop on Statistical Machine Translation · Cited by 21
Self-citationA Simplification-Translation-Restoration Framework for Cross-Domain SMT Applications
Chen, H., Huang, H., Chen, H., & Tan, C. (2012) · Cited by 18
The Impact of Lexical Simplification by Verbal Paraphrases for People with and without Dyslexia
Rello, L., Baeza-Yates, R. A., & Saggion, H. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-37256-8_41 · Cited by 17
Cost Optimization in Crowdsourcing Translation: Low cost translations made even cheaper
Gao, M., Xu, W. H., & Callison-Burch, C. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1072 · Cited by 13
Self-citation(2013)
Cited by
Leveraging Pre-trained Checkpoints for Sequence Generation Tasks
Rothe, S., Narayan, S., & Severyn, A. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00313 · Cited by 391
Sentence Simplification with Deep Reinforcement Learning
Zhang, X., & Lapata, M. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1062 · Cited by 331
Rao, S., & Tetreault, J. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1012 · Cited by 321
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
Gehrmann, S., Adewumi, T., Aggarwal, K., Ammanamanchi, P. S., Aremu, A., Bosselut, A., Chandu, K. R., Clinciu, M.-A., Das, D., Dhole, K., et al. (2021) · Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021) · doi:10.18653/v1/2021.gem-1.10 · Cited by 159
Self-citationHandling Divergent Reference Texts when Evaluating Table-to-Text Generation
Dhingra, B., Faruqui, M., Parikh, A., Chang, M.-W., Das, D., & Cohen, W. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1483 · Cited by 150
Metadata
- Authors
- Xu, W., Napoles, C., Pavlick, E., Chen, Q., & Callison-Burch, C.
- Venue
- Transactions of the Association for Computational Linguistics
- Publisher
- MIT Press - Journals
- Published
- 2016-12
- Volume
- 4
- Pages
- 401-415
- ISSN
- 2307-387X (ISSN-L)
- OpenAlex
- W2534253848
- Cited by
- 521
- References
- 48
- FWCI
- 28.49
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.