The DOI matches its Crossref record; 89 of the 89 references it cites were found in a registry or an index.
Generating Phrasal and Sentential Paraphrases: A Survey of Data-Driven Methods
Open accessAbstract
The task of paraphrasing is inherently familiar to speakers of all languages. Moreover, the task of automatically generating or extracting semantic equivalences for the various units of language—words, phrases, and sentences—is an important part of natural language processing (NLP) and is being increasingly employed to improve the performance of several NLP applications. In this article, we attempt to conduct a comprehensive and application-independent survey of data-driven phrasal and sentential paraphrase generation methods, while also conveying an appreciation for the importance and potential use of paraphrases in the field of NLP research. Recent work done in manual and automatic construction of paraphrase corpora is also examined. We also discuss the strategies used for evaluating paraphrase generation techniques and briefly explore some future trends in paraphrase generation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
The mathematics of statistical machine translation: parameter estimation
Brown, P. F., Pietra, V. J. D., Pietra, S. A. D., & Mercer, R. L. (1993) · Cited by 3,973
Biological sequence analysis probabilistic models of proteins and nucleic acids
Durbin, R. M., Eddy, S. R., Krogh, A., & Mitchison, G. (1998) · Cited by 3,565
Statistical phrase-based translation
Koehn, P., Och, F. J., & Marcu, D. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073462 · Cited by 3,197
Similarity estimation techniques from rounding algorithms
Charikar, M. S. (2002) · Proceedings of the thiry-fourth annual ACM symposium on Theory of computing · doi:10.1145/509907.509965 · Cited by 2,220
On the resemblance and containment of documents
Broder, A. Z. (2002) · Proceedings. Compression and Complexity of SEQUENCES 1997 (Cat. No.97TB100171) · doi:10.1109/sequen.1997.666900 · Cited by 1,698
A statistical approach to machine translation
Brown, P. F., Cocke, J., Pietra, S. A. D., Pietra, V. J. D., Jelinek, F., Lafferty, J., Mercer, R. L., & Roossin, P. S. (1990) · doi:10.5555/92858.92860 · Cited by 1,655
The PASCAL Recognising Textual Entailment Challenge
Dagan, I., Glickman, O., & Magnini, B. (2006) · Lecture Notes in Computer Science · doi:10.1007/11736790_9 · Cited by 1,628
Automatic retrieval and clustering of similar words
Lin, D. (1998) · Proceedings of the 36th annual meeting on Association for Computational Linguistics - · doi:10.3115/980691.980696 · Cited by 1,545
Text Chunking Using Transformation-Based Learning
Ramshaw, L. A., & Marcus, M. P. (1999) · Text, Speech and Language Technology · doi:10.1007/978-94-017-2390-9_10 · Cited by 1,460
Computational linguistics in 1990
Karlgren, H. (1990) · Proceedings of the 13th conference on Computational linguistics - · doi:10.3115/992507.992531 · Cited by 1,243
Hierarchical Phrase-Based Translation
Chiang, D. (2007) · Computational Linguistics · doi:10.1162/coli.2007.33.2.201 · Cited by 1,144
Automatically Constructing a Corpus of Sentential Paraphrases.
Dolan, W. B., & Brockett, C. (2005) · Cited by 1,095
Distributional clustering of English words
Pereira, F., Tishby, N., & Lee, L. (1993) · Proceedings of the 31st annual meeting on Association for Computational Linguistics - · doi:10.3115/981574.981598 · Cited by 974
CoNLL-X shared task on multilingual dependency parsing
Buchholz, S., & Marsi, E. (2006) · Proceedings of the Tenth Conference on Computational Natural Language Learning - CoNLL-X '06 · doi:10.3115/1596276.1596305 · Cited by 963
A program for aligning sentences in bilingual corpora
Gale, W. A., & Church, K. (1993) · doi:10.5555/972450.972455 · Cited by 945
Learning surface text patterns for a Question Answering system
Ravichandran, D., & Hovy, E. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073092 · Cited by 809
Agglomerative clustering of a search engine query log
Beeferman, D., & Berger, A. (2000) · Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/347090.347176 · Cited by 768
Explorations in Automatic Thesaurus Discovery
Grefenstette, G. (1994) · Springer eBooks · doi:10.1007/978-1-4615-2710-7 · Cited by 749
A web-based kernel function for measuring the similarity of short text snippets
Sahami, M., & Heilman, T. D. (2006) · Proceedings of the 15th international conference on World Wide Web · doi:10.1145/1135777.1135834 · Cited by 735
Unsupervised construction of large paraphrase corpora: exploiting massively parallel news sources
Dolan, B., Quirk, C., & Brockett, C. (2004) · Proceedings of the 20th international conference on Computational Linguistics - COLING '04 · doi:10.3115/1220355.1220406 · Cited by 728
The CoNLL 2007 Shared Task on Dependency Parsing
Nivre, J., Hall, J., Kübler, S., McDonald, R., Nilsson, J., Riedel, S., & Yüret, D. (2007) · Publication Server of Goethe University Frankfurt am Main (Goethe University Frankfurt) · Cited by 663
Penn, T. (1999) · Medical Entomology and Zoology · Cited by 652
Generating query substitutions
Jones, R., Rey, B., Madani, O., & Greiner, W. (2006) · Proceedings of the 15th international conference on World Wide Web · doi:10.1145/1135777.1135835 · Cited by 618
DIRT @SBT@discovery of inference rules from text
Lin, D., & Pantel, P. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502559 · Cited by 541
Paraphrasing with bilingual parallel corpora
Bannard, C., & Callison-Burch, C. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219914 · Cited by 533
Extracting paraphrases from a parallel corpus
Barzilay, R., & McKeown, K. R. (2001) · Proceedings of the 39th Annual Meeting on Association for Computational Linguistics - ACL '01 · doi:10.3115/1073012.1073020 · Cited by 470
Sentence Fusion for Multidocument News Summarization
Barzilay, R., & McKeown, K. R. (2005) · Computational Linguistics · doi:10.1162/089120105774321091 · Cited by 429
Learning to paraphrase: an unsupervised approach using multiple-sequence alignment
Barzilay, R., & Lee, L. (2003) · Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - NAACL '03 · doi:10.3115/1073445.1073448 · Cited by 426
Statistical machine translation
Lopez, A. (2008) · ACM Computing Surveys · doi:10.1145/1380584.1380586 · Cited by 410
Measuring the semantic similarity of texts
Corley, C., & Mihalcea, R. (2005) · Proceedings of the ACL Workshop on Empirical Modeling of Semantic Equivalence and Entailment - EMSEE '05 · doi:10.3115/1631862.1631865 · Cited by 352
Generating natural language under pragmatic constraints
Hovy, E. (1987) · Journal of Pragmatics · doi:10.1016/0378-2166(87)90109-3 · Cited by 337
Monolingual Machine Translation for Paraphrase Generation
Quirk, C., Brockett, C., & Dolan, W. B. (2004) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 305
Similarity Measures for Short Segments of Text
Metzler, D., Dumais, S., & Meek, C. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-71496-5_5 · Cited by 305
Improved statistical machine translation using paraphrases
Callison-Burch, C., Koehn, P., & Osborne, M. (2006) · Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics - · doi:10.3115/1220835.1220838 · Cited by 288
Near-Synonymy and Lexical Choice
Edmonds, P., & Hirst, G. (2002) · Computational Linguistics · doi:10.1162/089120102760173625 · Cited by 260
Paraphrasing for automatic evaluation
Kauchak, D., & Barzilay, R. (2006) · Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics - · doi:10.3115/1220835.1220893 · Cited by 218
Statistical Machine Translation for Query Expansion in Answer Retrieval
Riezler, S., Vasserman, A., Tsochantaridis, I., Mittal, V. O., & Liu, Y. (2007) · Cited by 213
Measuring Word Alignment Quality for Statistical Machine Translation
Fraser, A., & Marcu, D. (2007) · Computational Linguistics · doi:10.1162/coli.2007.33.3.293 · Cited by 209
Randomized algorithms and NLP: using locality sensitive hash function for high speed noun clustering
Ravichandran, D., Pantel, P., & Hovy, E. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219917 · Cited by 208
Paraphrase identification as probabilistic quasi-synchronous recognition
Das, D., & Smith, N. A. (2009) · Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - ACL-IJCNLP '09 · doi:10.3115/1687878.1687944 · Cited by 207
Syntax-based alignment of multiple translations
Pang, B., Knight, K. K., & Marcu, D. (2003) · doi:10.3115/1073445.1073469 · Cited by 202
Soong, F. K., & Huang, E.-F. (1991) · [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1991.150437 · Cited by 189
Automatic paraphrase acquisition from news articles
Shinyama, Y., Sekine, S., & Sudo, K. (2002) · Proceedings of the second international conference on Human Language Technology Research - · doi:10.3115/1289189.1289218 · Cited by 187
Syntactic constraints on paraphrases extracted from parallel corpora
Callison-Burch, C. (2008) · Proceedings of the Conference on Empirical Methods in Natural Language Processing - EMNLP '08 · doi:10.3115/1613715.1613743 · Cited by 181
Experiments in automatic statistical thesaurus construction
Crouch, C. J., & Yang, B. (1992) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/133160.133180 · Cited by 154
Empirical Methods for Exploiting Parallel Texts
Melamed, I. D. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/2708.001.0001 · Cited by 148
On-demand information extraction
Sekine, S. (2006) · International Conference on Computational Linguistics and Annual Meeting of the Association for Computational Linguistics (COLING/ACL) · doi:10.3115/1273073.1273167 · Cited by 140
Application-driven statistical paraphrase generation
Zhao, S., Xiang, L., Liu, T., & Li, S. (2009) · doi:10.3115/1690219.1690263 · Cited by 127
Zhou, L., Lin, C.-Y., Munteanu, D. S., & Hovy, E. H. (2006) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/1220835.1220892 · Cited by 110
Extracting structural paraphrases from aligned monolingual corpora
Ibrahim, A., Katz, B., & Lin, J. (2003) · doi:10.3115/1118984.1118992 · Cited by 107
Mining a lexicon of technical terms and lay equivalents
Elhadad, N., & Sutaria, K. (2007) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.3115/1572392.1572402 · Cited by 102
Re-evaluating machine translation results with paraphrase support
Zhou, L., Lin, C.-Y., & Hovy, E. H. (2006) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1610075.1610087 · Cited by 101
ISP: Learning Inferential Selectional Preferences
Pantel, P., Bhagat, R., Coppola, B., et al. (2007) · Cited by 93
Statistical machine translation with word- and sentence-aligned parallel corpora
Callison-Burch, C., Talbot, D., & Osborne, M. (2004) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1218955.1218978 · Cited by 92
Investigating a Generic Paraphrase-Based Approach for Relation Extraction
Romano, L., Kouylekov, M., Szpektor, I., Dagan, I., & Lavelli, A. (2006) · Cited by 91
Constructing Corpora for the Development and Evaluation of Paraphrase Systems
Cohn, T., Callison-Burch, C., & Lapata, M. (2008) · Computational Linguistics · doi:10.1162/coli.08-003-r1-07-044 · Cited by 87
Explorations in Sentence Fusion
Marsi, E., & Krahmer, E. (2005) · Research portal (Tilburg University) · Cited by 85
Using paraphrases for parameter tuning in statistical machine translation
Madnani, N., Ayan, N. F., Resnik, P., & Dorr, B. J. (2007) · Workshop on Statistical Machine Translation · doi:10.3115/1626355.1626371 · Cited by 82
Self-citationLarge Scale Acquisition of Paraphrases for Learning Surface Patterns
Bhagat, R., & Ravichandran, D. (2008) · Cited by 80
Bootstrapping lexical choice via multiple-sequence alignment
Barzilay, R., & Lee, L. (2002) · doi:10.3115/1118693.1118715 · Cited by 79
Paraphrasing using given and new information in a question-answer system
McKeown, K. R. (1979) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/982163.982182 · Cited by 77
Proceedings of the ACL-PASCAL Workshop on Textual Entailment and Paraphrasing
Sekine, S., Inui, K., Dagan, I., Dolan, B., Giampiccolo, D., & Magnini, B. (2007) · Cited by 73
Support Vector Machines for Paraphrase Identification and Corpus Construction
Brockett, C., & Dolan, W. B. (2005) · Cited by 72
Paraphrase Identification with Lexico-Syntactic Graph Subsumption.
Rus, V., McCarthy, P. M., Lintean, M. C., McNamara, D. S., & Graesser, A. C. (2008) · The Florida AI Research Society · Cited by 72
Aligning Needles in a Haystack: Paraphrase Acquisition Across the Web
PAŞCA, M. A., & Dienes, P. (2005) · Lecture notes in computer science · doi:10.1007/11562214_11 · Cited by 67
Instance-based Evaluation of Entailment Rule Acquisition
Szpektor, I., Shnarch, E., & Dagan, I. (2007) · Cited by 67
Hitting the Right Paraphrases in Good Time
Kok, S., & Brockett, C. (2010) · Cited by 64
Paraphrase recognition using machine learning to combine similarity measures
Malakasiotis, P. (2009) · doi:10.3115/1667884.1667889 · Cited by 64
Callison-Burch, C. (2007) · ERA · Cited by 60
Near-synonymy and the structure of lexical knowledge
Hirst, G. (1995) · Cited by 59
Corpus-based lexical choice in natural language generation
Bangalore, S., & Rambow, O. (2000) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1075218.1075277 · Cited by 51
Contextual bitext-derived paraphrases in automatic MT evaluation
Owczarzak, K., Groves, D., van Genabith, J., & Way, A. (2006) · Conference on Machine Translation (WMT) · doi:10.3115/1654650.1654663 · Cited by 42
ParaMetric: an automatic evaluation metric for paraphrasing
Callison-Burch, C., Cohn, T., & Lapata, M. (2008) · International Conference on Computational Linguistics · doi:10.3115/1599081.1599094 · Cited by 41
Madnani, N., Resnik, P., Dorr, B. J., & Schwartz, R. M. (2008) · Conference of the Association for Machine Translation in the Americas · Cited by 35
Self-citationA Metric for Paraphrase Detection
Cordeiro, J., Dias, G. H., & Brazdil, P. (2007) · International Multi-Conference on Computing in the Global Information Technology (ICCGI) · doi:10.1109/iccgi.2007.4 · Cited by 33
New Functions for Unsupervised Asymmetrical Paraphrase Detection
Cordeiro, J., Dias, G. H., & Brazdil, P. (2007) · Journal of Software · doi:10.4304/jsw.2.4.12-23 · Cited by 32
That's Nice … What Can You Do With It?
Belz, A. (2009) · Computational Linguistics · doi:10.1162/coli.2009.35.1.111 · Cited by 29
Shi, X., & Yang, C. C. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20632 · Cited by 29
Paraphrase generation and information retrieval from stored text.
Culicover, P. W. (1968) · Cited by 21
Garoufi, K. (2007) · Cited by 20
Capturing expression using linguistic information
Uzuner, Ö., & Katz, B. (2005) · National Conference on Artificial Intelligence · Cited by 16
Fujita, A., & Sato, S. (2008) · International Conference on Computational Linguistics · doi:10.3115/1599081.1599110 · Cited by 12
A Class-oriented Approach to Building a Paraphrase Corpus
Fujita, A., & Inui, K. (2005) · Cited by 11
A paraphrase-based exploration of cohesiveness criteria
Inui, K., & Masaru, N. (2001) · doi:10.3115/1117840.1117854 · Cited by 7
Computing Paraphrasability of Syntactic Variants Using Web Snippets
Fujita, A., & Sato, S. (2008) · Future University Hakodate Academic Archive (Future University Hakodate) · Cited by 5
(1997)
Cited by
Adversarial Examples for Evaluating Reading Comprehension Systems
Jia, R., & Liang, P. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1215 · Cited by 1,410
Data augmentation approaches in natural language processing: A survey
Li, B., Hou, Y., & Che, W. (2022) · AI Open · doi:10.1016/j.aiopen.2022.03.001 · Cited by 350
Style transfer through back-translation
Prabhumoye, S., Tsvetkov, Y., Salakhutdinov, R., & Black, A. W. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1080 · Cited by 348
Artificial Intelligence Security: Threats and Countermeasures
Hu, Y., Kuang, W., Qin, Z., Li, K., Zhang, J., Gao, Y., Li, W., & Li, K. (2023) · ACM Computing Surveys · doi:10.1145/3487890 · Cited by 196
Metadata
- Authors
- Madnani, N., & Dorr, B. J.
- Venue
- Computational Linguistics
- Publisher
- MIT Press - Journals
- Published
- 2010-09
- Volume
- 36
- Issue
- 3
- Pages
- 341-387
- ISSN
- 0891-2017 (ISSN-L)
- 1530-9312
- OpenAlex
- W2051593977
- Cited by
- 298
- References
- 89
- FWCI
- 26.87
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.