The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Dear Sir or Madam, May I Introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfer
Open accessAbstract
Style transfer is the task of automatically transforming a piece of text in one particular style into another.A major barrier to progress in this field has been a lack of training and evaluation datasets, as well as benchmarks and automatic metrics.In this work, we create the largest corpus for a particular stylistic transfer (formality) and show that techniques from the machine translation community can serve as strong baselines for future work.We also discuss challenges of using automatic metrics.Informal: I'd say it is punk though.Formal: However, I do believe it to be punk.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
BLEU: a method for automatic evaluation of machine translation
Papineni, K., Roukos, S., Ward, T., & Zhu, W.-J. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073135 · Cited by 21,344
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
On the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Cho, K., van Merrienboer, B., Bahdanau, D., & Bengio, Y. (2014) · Proceedings of SSST-8, Eighth Workshop on Syntax, Semantics and Structure in Statistical Translation · doi:10.3115/v1/w14-4012 · Cited by 7,099
Moses: open source toolkit for statistical machine translation
Koehn, P., Zens, R., Dyer, C., Bojar, O., Constantin, A., Herbst, E., Hoang, H., Birch, A., Callison-Burch, C., Federico, M., et al. (2007) · Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions - ACL '07 · doi:10.3115/1557769.1557821 · Cited by 4,735 · cited 1×
“Identifying Formality: There has been previous work on detecting formality of a given text at the lexical level (Brooke et al., 2010; Lahiri et al., 2011; Brooke and Hirst, 2014; Pavlick and Nenkova, 2015), at the sentence level (Pavlick and Tetreault, 2016) and at the document level (Sheikha and…”
BackgroundMoses : open source toolkit for statistical machine translation
Koehn, P., Hoang, H., Birch, A., Callison-Burch, C., Federico, M., Bertoldi, N., Cowan, B., Shen, W., Moran, C., Zens, R., et al. (2007) · Edinburgh Research Explorer (University of Edinburgh) · Cited by 1,547
Collecting Highly Parallel Data for Paraphrase Evaluation
Chen, D. J., & Dolan, W. B. (2011) · Cited by 904
Intelligent Selection of Language Model Training Data
Moore, R. C., & Lewis, W. D. (2010) · Cited by 702
Optimizing Statistical Machine Translation for Text Simplification
Xu, W., Napoles, C., Pavlick, E., Chen, Q., & Callison-Burch, C. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00107 · Cited by 521
SemEval-2016 Task 1: Semantic Textual Similarity, Monolingual and Cross-Lingual Evaluation
Agirre, E., Banea, C., Cer, D., Diab, M., Gonzalez-Agirre, A., Mihalcea, R., Rigau, G., & Wiebe, J. (2016) · Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016) · doi:10.18653/v1/s16-1081 · Cited by 519
Scalable Modified Kneser-Ney Language Model Estimation
Heafield, K., Pouzyrevsky, I., Clark, J. H., & Koehn, P. (2013) · Cited by 442
Multi-Perspective Sentence Similarity Modeling with Convolutional Neural Networks
He, H., Gimpel, K., & Lin, J. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1181 · Cited by 378
Generating natural language under pragmatic constraints
Hovy, E. (1987) · Journal of Pragmatics · doi:10.1016/0378-2166(87)90109-3 · Cited by 337
A Monolingual Tree-based Translation Model for Sentence Simplification
Zhu, Z., Darmstadt, T. U., Bernhard, D., & Gurevych, I. (2010) · TUbilio (Technical University of Darmstadt) · Cited by 334
Controlling Politeness in Neural Machine Translation via Side Constraints
Sennrich, R., Haddow, B., & Birch, A. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1005 · Cited by 273
Controlling Linguistic Style Aspects in Neural Language Generation
Ficler, J., & Goldberg, Y. (2017) · Proceedings of the Workshop on Stylistic Variation · doi:10.18653/v1/w17-4912 · Cited by 265
Sentence Simplification by Monolingual Machine Translation
Wubben, S., van den Bosch, A. P. J., & Krahmer, E. (2012) · Research portal (Tilburg University) · Cited by 237
Edinburgh Neural Machine Translation Systems for WMT 16
Sennrich, R., Haddow, B., & Birch, A. (2016) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w16-2323 · Cited by 199
Fluency, adequacy, or HTER?: exploring different human judgments with a tunable MT metric
Snover, M., Madnani, N., Dorr, B. J., & Schwartz, R. (2009) · Proceedings of the Fourth Workshop on Statistical Machine Translation - StatMT '09 · doi:10.3115/1626431.1626480 · Cited by 195
Syntactic constraints on paraphrases extracted from parallel corpora
Callison-Burch, C. (2008) · Proceedings of the Conference on Empirical Methods in Natural Language Processing - EMNLP '08 · doi:10.3115/1613715.1613743 · Cited by 181
Formality of Language: definition, measurement and behavioral determinants
Heylighen, F., & Dewaele, J. (1999) · Cited by 161
Shakespearizing Modern Language Using Copy-Enriched Sequence to Sequence Models
Jhamtani, H., Gangal, V., Hovy, E., & Nyberg, E. (2017) · Proceedings of the Workshop on Stylistic Variation · doi:10.18653/v1/w17-4902 · Cited by 156
An Empirical Analysis of Formality in Online Communication
Pavlick, E., & Tetreault, J. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00083 · Cited by 140
Self-citationGenerating natural language under pragmatic constraints
Hovy, E. H. (1987) · Journal of Pragmatics · doi:10.1016/0378-2166(87)90099-3 · Cited by 117
Email Formality in the Workplace: A Case Study on the Enron Corpus
Peterson, K., Hohensee, M., & Xia, F. (2011) · Cited by 89
Xu, W. H., Ritter, A., Dolan, B., Grishman, R., & Cherry, C. (2012) · NPARC · Cited by 88
Predicting Grammaticality on an Ordinal Scale
Heilman, M., Cahill, A., Madnani, N., Lopez, M., Mulholland, M., & Tetreault, J. (2014) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/v1/p14-2029 · Cited by 76
Self-citationA Study of Style in Machine Translation: Controlling the Formality of Machine Translation Output
Niu, X., Martindale, M. J., & Carpuat, M. J. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1299 · Cited by 56
Automatic Acquisition of Lexical Formality
Brooke, J., Wang, T., & Hirst, G. (2010) · International Conference on Computational Linguistics · Cited by 55
There's No Comparison: Reference-less Evaluation Metrics in Grammatical Error Correction
Napoles, C., Sakaguchi, K., & Tetreault, J. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1228 · Cited by 53
Self-citationText Simplification Using Neural Machine Translation
Wang, T., Chen, P., Rochford, J., & Qiang, J. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.9933 · Cited by 49
Kajiwara, T., & Komachi, M. (2016) · International Conference on Computational Linguistics · Cited by 49
Inducing Lexical Style Properties for Paraphrase and Genre Differentiation
Pavlick, E., & Nenkova, A. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1023 · Cited by 43
Generation of Formal and Informal Sentences
Sheikha, F. A., & Inkpen, D. Z. (2011) · Natural Language Generation · Cited by 27
Mosquera, A., & Moreda, P. (2021) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v6i3.14347 · Cited by 11
Cited by
Disentangled Representation Learning for Non-Parallel Text Style Transfer
John, V., Mou, L., Bahuleyan, H., & Vechtomova, O. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1041 · Cited by 253
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
Gehrmann, S., Adewumi, T., Aggarwal, K., Ammanamanchi, P. S., Aremu, A., Bosselut, A., Chandu, K. R., Clinciu, M.-A., Das, D., Dhole, K., et al. (2021) · Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021) · doi:10.18653/v1/2021.gem-1.10 · Cited by 159
“Transforming” Delete, Retrieve, Generate Approach for Controlled Text Style Transfer
Sudhakar, A., Upadhyay, B., & Maheswaran, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1322 · Cited by 142
Choi, M., Pei, J., Kumar, S., Shu, C., & Jurgens, D. (2023) · arXiv · doi:10.48550/arxiv.2305.14938 · Cited by 73
The Perils of Using Mechanical Turk to Evaluate Open-Ended Text Generation
Karpinska, M., Akoury, N., & Iyyer, M. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.97 · Cited by 56
Metadata
- Authors
- Rao, S., & Tetreault, J.
- Venue
- Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers)
- Published
- 2018
- Pages
- 129-140
- OpenAlex
- W2964321064
- Cited by
- 321
- References
- 37
- FWCI
- 17.27
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.