The DOI matches its Crossref record; 27 of the 29 references it cites were found in a registry or an index.
Generating Sentences by Editing Prototypes
Open accessAbstract
We propose a new generative language model for sentences that first samples a prototype sentence from the training corpus and then edits it into a new sentence. Compared to traditional language models that generate from scratch either left-to-right or by first sampling a latent sentence vector, our prototype-then-edit model improves perplexity on language modeling and generates higher quality outputs according to human evaluation. Furthermore, the model gives rise to a latent edit vector that captures interpretable semantics such as sentence similarity and sentence-level analogies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Non-parametric neural language models (NLMs) learn predictive distributions of text utilizing an external datastore, which allows them to learn through explicitly memorizing the training datapoints.”
From Efficient Nearest Neighbor Language Models (2021) · cites this paper as Guu et al., 2018
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Prompt augmentation is closely related to retrieval-based methods that provide more textual context to the model to improve performance [37], a method that has also been shown to be effective in prompt-based learning [99].”
From Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (2023) · cites this paper as [37]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · cited 3×
“Interestingly, the top-10 performance of our model in Table 5 is nearly as good as the performance of GloVe vectors on the simpler lexical analogy task, despite the fact that the sentence prediction task is harder.”
MethodInfluentialEfficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568 · cited 2×
“Our use of lexical similarity neighborhoods is comparable to context windows used in word vector training (Mikolov et al., 2013a).”
BackgroundMethodAuto-Encoding Variational Bayes
Kingma, D. P., & Welling, M. (2013) · arXiv · doi:10.48550/arxiv.1312.6114 · Cited by 20,067 · cited 6×
“aining p(xjx0) as a conditional variational autoencoder (C-VAE) (it is conditioned on x0). We maximize the objective via SGD, approximating the gradient using the usual Monte Carlo estimate for VAEs (Kingma and Welling, 2014). Neural editor p edit(xjx0;z): We implement our neural editor as a left-to-right sequence-to-…”
MethodInfluentialSequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766 · cited 2×
“Neural language models (Bengio et al., 2003) based upon recurrent neural networks and sequence-to-sequence architectures (Sutskever et al., 2014) have been widely used due to their flexibility and performance across a wide-range of NLP tasks (Ju-rafsky and Martin, 2000; Kalchbrenner and Blun-som,…”
BackgroundMethodA Global Geometric Framework for Nonlinear Dimensionality Reduction
Tenenbaum, J. B., Silva, V. D., & Langford, J. C. (2000) · Science · doi:10.1126/science.290.5500.2319 · Cited by 13,585 · cited 1×
“More generally, results in manifold learning demonstrate that a weak metric such as lexical similarity can be used to extract semantic similarity through distributional statistics (Tenenbaum et al., 2000; Hashimoto et al., 2016).”
BackgroundOn Estimation of a Probability Density Function and Mode
Parzen, E. (1962) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704472 · Cited by 10,585 · cited 1×
“From a generative modeling perspective, editing randomly sampled training sentences closely resembles nonparametric kernel density estimation (Parzen, 1962) where one samples points from a training set, and adds noise to smooth the density.”
BackgroundGoogle's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Wu, Y., Schuster, M., Chen, Z., Le, Q. V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., et al. (2016) · arXiv · doi:10.48550/arxiv.1609.08144 · Cited by 5,319 · cited 2×
“Our work is motivated by an emerging consensus that attention-based mechanisms (Bahdanau et al., 2015) can substantially improve performance on various sequence to sequence tasks by capturing more information from the input sequence (Wu et al., 2016; Vaswani et al., 2017).”
BackgroundMethodAn Introduction to Variational Methods for Graphical Models
Jordan, M. I., Ghahramani, Z., Jaakkola, T. S., & Saul, L. K. (1999) · Machine Learning · doi:10.1023/a:1007665907178 · Cited by 3,791
Linguistic Regularities in Continuous Space Word Representations
Mikolov, T., Yih, W.-T., & Zweig, G. (2013) · North American Chapter of the Association for Computational Linguistics · Cited by 2,912
Generating Sentences from a Continuous Space
Bowman, S. R., Vilnis, L., Vinyals, O., Dai, A., Jozefowicz, R., & Bengio, S. (2016) · Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning · doi:10.18653/v1/k16-1002 · Cited by 2,061 · cited 10×
“Second, our parameterization avoids collapsing the latent code, which is a serious problem with variational autoencoders in practice (Bowman et al., 2016).”
BackgroundMethodInfluential
Research works printed but not linked: 1
- Bengio Y., 2003, Journal of machine learning research, 3, 1137
Cited by
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023) · ACM Computing Surveys · doi:10.1145/3560815 · Cited by 4,361
“Prompt augmentation is closely related to retrieval-based methods that provide more textual context to the model to improve performance [37], a method that has also been shown to be effective in prompt-based learning [99].”
MethodRetrieval-Augmented Generation for Knowledge-Intensive NLP Tasks
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-T., Rocktäschel, T., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.11401 · Cited by 3,101
“Such tasks include open-domain question answering [5, 25], fact checking [50], fact completion [42], long-form question answering [12], Wikipedia article generation [32], dialogue [36, 59, 9, 13], translation [16], and language modeling [17, 23].”
BackgroundAdversarial Example Generation with Syntactically Controlled Paraphrase Networks
Iyyer, M., Wieting, J., Gimpel, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1170 · Cited by 615
“Shen et al. (2017) perform style transfer on non-parallel texts, while Guu et al. (2017) generate novel sentences from prototypes; again, these methods are not necessarily seeking to generate meaning-preserving paraphrases, merely transformed sentences that have an altered style.”
BackgroundWhat Makes Good In-Context Examples for GPT-3?
Liu, J., Shen, D., Zhang, Y., Dolan, B., Carin, L., & Chen, W. (2022) · Proceedings of Deep Learning Inside Out (DeeLIO 2022): The 3rd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures · doi:10.18653/v1/2022.deelio-1.10 · Cited by 563
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2021) · arXiv · doi:10.48550/arxiv.2107.13586 · Cited by 4,352
“Prompt augmentation is closely related to retrieval-based methods that provide more textual context to the model to improve performance [37], a method that has also been shown to be effective in prompt-based learning [99].”
MethodDelete, Retrieve, Generate: a Simple Approach to Sentiment and Style Transfer
Li, J., Jia, R., He, H., & Liang, P. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1169 · Cited by 468
“For D ELETE A ND R ETRIEVE , similar to Guu et al. (2018), we retrieve the top-10 sentences and generate results using markers from each sentence.”
BackgroundMethodSelf-citationA Survey on Data Augmentation for Text Classification
Bayer, M., Kaufhold, M.-A., & Reuter, C. (2023) · ACM Computing Surveys · doi:10.1145/3544558 · Cited by 425
Exploring Pre-trained Language Models for Event Extraction and Generation
Yang, S., Feng, D., Qiao, L., Kan, Z., & Li, D. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1522 · Cited by 348
“Inspired by the work of Guu et al. (2018), we take the existing samples as prototypes for event generation, which contains two key steps: argument replacement and adjunct token rewriting.”
MethodFActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation
Min, S., Krishna, K., Lyu, X., Lewis, M., Yih, W.-T., Koh, P., Iyyer, M., Zettlemoyer, L., & Hajishirzi, H. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.741 · Cited by 407
Knowledge-Driven Encode, Retrieve, Paraphrase for Medical Image Report Generation
Li, C. Y., Liang, X., Hu, Z., & Xing, E. P. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016666 · Cited by 299
“Combining traditional retrieval-based and modern generation-based meth-ods for (long) text generation (Li et al. 2018; Guu et al. 2018; Ziqiang Cao and Wei 2018; Hu et al. 2017) has gained increasing research interests.”
BackgroundPAWS: Paraphrase Adversaries from Word Scrambling
Zhang, Y., Baldridge, J., & He, L. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1131 · Cited by 596
“Most text generation models rely on large amount of training data (Iyyer et al., 2018; Guu et al., 2018; Gupta et al., 2018; Li et al., 2018), which is unfortunately not available in our case.”
BackgroundNeural Text Generation with Unlikelihood Training
Welleck, S., Kulikov, I., Roller, S., Dinan, E., Cho, K., & Weston, J. (2019) · arXiv · doi:10.48550/arxiv.1908.04319 · Cited by 254
“Some other lines of work of note are the use of generative control (Kikuchi et al., 2016; Fan et al., 2017; Peng et al., 2018; See et al., 2019) and the retrieve-and-refine setting (Weston et al., 2018; Guu et al., 2018).”
BackgroundToTTo: A Controlled Table-To-Text Generation Dataset
Parikh, A., Wang, X., Gehrmann, S., Faruqui, M., Dhingra, B., Yang, D., & Das, D. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.89 · Cited by 252
ToTTo: A Controlled Table-To-Text Generation Dataset
Parikh, A. P., Wang, X., Gehrmann, S., Faruqui, M., Dhingra, B., Yang, D., & Das, D. (2020) · arXiv · doi:10.48550/arxiv.2004.14373 · Cited by 252
“The technique of editing exemplar sentences has been used in semiparametric generation models (Guu et al., 2018; Pandey et al., 2018; Peng et al., 2019) and crowd-sourcing small, iterative changes to text has been shown to lead to higher-quality data and a more robust annotation process (Little et…”
MethodAdversarially Regularized AutoencodersPreprint
Zhao, J., Kim, Y., Zhang, K., Rush, A. M., & LeCun, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.04223 · Cited by 302
The survey: Text generation models in deep learning
Iqbal, T., & Qureshi, S. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2020.04.001 · Cited by 232
Retrieve, Rerank and Rewrite: Soft Template Based Neural Summarization
Cao, Z., Li, W., Li, S., & Wei, F. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1015 · Cited by 202
“Guu et al. (2017) also proposed to encode human-written sentences to improvement the performance of neural text generation.”
BackgroundMethodGu, J., Wang, C., & Zhao, J. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.11006 · Cited by 176
“Guu et al. (2018) propose a neural editor which learned language modeling by first retrieving a prototype and then editing over that.”
BackgroundHyperspherical Variational Auto-Encoders
Davidson, T. R., Falorsi, L., Cao, N. D., Kipf, T., & Tomczak, J. M. (2018) · UvA-DARE (University of Amsterdam) · doi:10.48550/arxiv.1804.00891 · Cited by 443
“The closest approach to ours is a VAE with a vMF distribution in the latent space used for a sentence generation task by (Guu et al., 2018).”
BackgroundSpherical Latent Spaces for Stable Variational Autoencoders
Xu, J., & Durrett, G. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1480 · Cited by 170
“Using vMF distributions in VAEs also leaves us the flexibility to modify the prior in other ways, such as using a product distribution with a uniform (Guu et al., 2018) or piecewise constant term (Serban et al.”
BackgroundMethodInfluentialAn Empirical Survey of Data Augmentation for Limited Data Learning in NLP
Chen, J., Tam, D., Raffel, C., Bansal, M., & Yang, D. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00542 · Cited by 173
“Generative models used in this setting have been based on conditional VAE (Bowman et al., 2016; Hu et al., 2017; Guu et al., 2017; Malandrakis et al., 2019), GAN (Iyyer et al., 2018; Xu et al., 2018) or pre-trained language models like GPT-2 (Anaby-Tavor et al., 2020; Kumar et al., 2020).”
MethodDeep Learning for Text Style Transfer: A Survey
Jin, D., Jin, Z., Hu, Z., Vechtomova, O., & Mihalcea, R. (2022) · Computational Linguistics · doi:10.1162/coli_a_00426 · Cited by 168
“We discuss in the following two ethics considerations: (1) social impact of TST applications, and (2) data privacy problem of TST. Fields that involve human subjects or direct application to humans work under a set of core principles and guidelines (Beauchamp, Childress et al. 2001).”
MethodInfluentialRetrieve and Refine: Improved Sequence Generation Models For Dialogue
Weston, J., Dinan, E., & Miller, A. (2018) · Proceedings of the 2018 EMNLP Workshop SCAI: The 2nd International Workshop on Search-Oriented Conversational AI · doi:10.18653/v1/w18-5713 · Cited by 165
“…(Junczys-Dowmunt and Grundkiewicz, 2017; Niehues et al., 2016; Novak et al., 2016; Xia et al., 2017; Grangier and Auli, 2017) or combining with retrieval (Gu et al., 2017; Cao et al., 2018), as well as for sentence correction or refinement without context (Guu et al., 2017; Schmaltz et al., 2017).”
BackgroundSemi-Amortized Variational AutoencodersPreprint
Kim, Y., Wiseman, S., Miller, A. C., Sontag, D. A., & Rush, A. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.02550 · Cited by 193
“, 2018), it can be combined with existing work on employing richer posterior/prior distributions within the VAE framework (Rezende & Mohamed, 2015; Kingma et al., 2016; Johnson et al., 2016; Tran et al., 2016; Goyal et al., 2017b; Guu et al., 2017; Tomczak & Welling, 2018).”
BackgroundAutomatically Neutralizing Subjective Bias in Text
Pryzant, R., Martinez, R. D., Dass, N., Kurohashi, S., Jurafsky, D., & Yang, D. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i01.5385 · Cited by 249
Xu, J., Ren, X., Lin, J., & Sun, X. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1428 · Cited by 227
“Moreover, there are also other methods to improve the diversity of the generated text by using mutual-information, prototype editing, and self attention (Li et al., 2016; Guu et al., 2017; Shao et al., 2017).”
MethodCGMH: Constrained Sentence Generation by Metropolis-Hastings Sampling
Miao, N., Zhou, H., Mou, L., Yan, R., & Li, L. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016834 · Cited by 154
Avoiding Latent Variable Collapse With Generative Skip ModelsPreprint
Dieng, A. B., Kim, Y., Rush, A. M., & Blei, D. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.04863 · Cited by 160
“Guu et al. [2017] and Xu and Durrett [2018] use the Von Mises-Fisher distribution for both the prior and the variational posterior and fixing the dispersion parameter of the Von Mises-Fisher distribution to make the KL term in the elbo constant .”
MethodPAWS: Paraphrase Adversaries from Word ScramblingPreprint
Zhang, Y., Baldridge, J., & He, L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.01130 · Cited by 234
“Most text generation models rely on large amount of training data (Iyyer et al., 2018; Guu et al., 2018; Gupta et al., 2018; Li et al., 2018), which is unfortunately not available in our case.”
BackgroundSequential Latent Knowledge Selection for Knowledge-Grounded DialoguePreprint
Kim, B., Ahn, J., & Kim, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.07510 · Cited by 157
“We evaluate several aspects of utterance generation using the similar setting in Guu et al. (2018).”
MethodUnsupervised Question Decomposition for Question Answering
Perez, E., Lewis, P., Yih, W.-T., Cho, K., & Kiela, D. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.713 · Cited by 123
Pre-training via ParaphrasingPreprint
Lewis, M., Ghazvininejad, M., Ghosh, G., Aghajanyan, A., Wang, S. I., & Zettlemoyer, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15020 · Cited by 192
Variational Knowledge Graph Reasoning
Chen, W., Xiong, W., Yan, X., & Wang, W. Y. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1165 · Cited by 149
“Besides, we also try to directly maximize the marginal likelihood p ( r | e s , e d ) = L p ( L | e s , e d ) p ( r | L ) using only the prior and likelihood model following MML (Guu et al., 2017b), which enables us to understand the superiority of introducing an approximate posterior.”
BackgroundMethodInfluentialResponse Generation by Context-Aware Prototype Editing
Wu, Y., Wei, F., Huang, S., Wang, Y., Li, Z., & Zhou, M. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017281 · Cited by 117
Ding, J., & Regev, A. (2021) · Nature Communications · doi:10.1038/s41467-021-22851-4 · Cited by 134
Controllable Paraphrase Generation with a Syntactic Exemplar
Chen, M., Tang, Q., Wiseman, S., & Gimpel, K. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1599 · Cited by 114
“Another related line of work builds generation upon sentential exemplars (Guu et al., 2018; Weston et al., 2018; Pandey et al., 2018; Cao et al., 2018; Peng et al., 2019) in order to improve the quality of the generation itself, rather than to allow for control over syntactic structures.”
BackgroundDeep Generative Models for Synthetic Data: A Survey
Eigenschink, P., Reutterer, T., Vamosi, S., Vamosi, R., Sun, C., & Kalcher, K. (2023) · IEEE Access · doi:10.1109/access.2023.3275134 · Cited by 157
“Metrics employed in [30] and [76] to evaluate diversity stood out, especially when compared to the qualitative diversity evaluation used in [40].”
BackgroundMethodInfluentialBaby steps towards few-shot learning with multiple semantics
Schwartz, E., Karlinsky, L., Feris, R., Giryes, R., & Bronstein, A. M. (2022) · Pattern Recognition Letters · doi:10.1016/j.patrec.2022.06.012 · Cited by 108
Foundation Models and Fair Use
Henderson, P., Li, X., Jurafsky, D., Hashimoto, T., Lemley, M. A., & Liang, P. (2023) · doi:10.2139/ssrn.4404340 · Cited by 57
Self-citationA Closer Look At Feature Space Data Augmentation For Few-Shot Intent Classification
Kumar, V., Glaude, H., de Lichy, C., & Campbell, W. M. (2019) · Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo) · doi:10.18653/v1/d19-6101 · Cited by 96
“For text classification, several text generation based data augmentation techniques have also been explored (Hou et al., 2018; Zhao et al., 2019; Guu et al., 2018; Yoo et al., 2018; Cho et al., 2019a).”
BackgroundCoditT5: Pretraining for Source Code and Natural Language Editing
Zhang, J., Panthaplackel, S., Nie, P., Li, J. J., & Gligoric, M. (2022) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1145/3551349.3556955 · Cited by 144
“For automated code review, we report performance on xMatch and BLEU-4, which have been used previously to benchmark models for this task [51].”
MethodAdversarially Regularising Neural
Minervini, P., & Riedel, S. (2018) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k18-1007 · Cited by 85
“For generating low-perplexity adversarial examples, we take inspiration from Guu et al. (2017) and generate the sentences by editing prototypes extracted from a corpus.”
MethodEfficient 8-Bit Quantization of Transformer Neural Machine Language Translation ModelPreprint
Bhandare, A., Sripathi, V., Karkada, D., Menon, V., Choi, S., Datta, K., & Saletore, V. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.00532 · Cited by 136
Non-Parametric Adaptation for Neural Machine Translation
Bapna, A., & Fırat, O. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1191 · Cited by 89
“Beyond NMT, there have been a few other attempts to incorporate non-parametric approaches into neural generative models (Guu et al., 2018; Hayati et al., 2018; Weston et al., 2018).”
BackgroundLearning to Represent EditsPreprint
Yin, P., Neubig, G., Allamanis, M., Brockschmidt, M., & Gaunt, A. L. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.13337 · Cited by 91
“This edit encoding method is reminiscent of the model used in Guu et al. (2017) for solving a different task of language modeling by marginalizing over latent edits, which we will elaborate in Sect.”
BackgroundMethodTAFSSL: Task-Adaptive Feature Sub-Space Learning for Few-Shot Classification
Lichtenstein, M., Sattigeri, P., Feris, R., Giryes, R., & Karlinsky, L. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-58571-6_31 · Cited by 75
Unsupervised Paraphrasing by Simulated Annealing
Liu, X., Mou, L., Meng, F., Zhou, H., Zhou, J., & Song, S. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.28 · Cited by 75
A Batch Normalized Inference Network Keeps the KL Vanishing Away
Zhu, Q., Bi, W., Liu, X., Ma, X., Li, X., & Wu, D. O. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.235 · Cited by 96
Extending Neural Generative Conversational Model using External Knowledge Sources
Parthasarathi, P., & Pineau, J. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1073 · Cited by 79
“Though (Guu et al., 2017) did not directly make use of an external knowledge source, they used an”
BackgroundA Multi-Task Approach for Disentangling Syntax and Semantics in Sentence Representations
Chen, M., Tang, Q., Wiseman, S., & Gimpel, K. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1254 · Cited by 75
“…as a concentration parameter analogous to the variance in a Gaussian distribution. vMF has been used for modeling similarity between two sentences (Guu et al., 2018), which is particularly suited to our purpose here, since we will evaluate our semantic representations in the context of modeling…”
MethodSpherical Confidence Learning for Face Recognition
Shen, L., Xu, J., Xu, X., Shen, P., Li, S., & Hooi, B. (2021) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr46437.2021.01537 · Cited by 76
“Towards going beyond face recognition, e.g. text modeling [5] and link prediction [2], we believe that the presented research sheds light on a promising direction towards confidence learning with general data whose manifold is not trivially Euclidean.”
BackgroundCAT-Gen: Improving Robustness in NLP Models via Controlled Adversarial Text Generation
Wang, T., Wang, X., Qin, Y., Packer, B., Li, K., Chen, J., Beutel, A., & Ed, H. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.417 · Cited by 105
Learning to Update Natural Language Comments Based on Code Changes
Panthaplackel, S., Nie, P., Gligoric, M., Li, J. J., & Mooney, R. J. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.168 · Cited by 67
Enhancing Aspect Term Extraction with Soft Prototypes
Chen, Z., & Qian, T. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.164 · Cited by 64
“Many of them use the task-dependent metrics (Guu et al., 2018; Hashimoto et al., 2018), common metrics such as Jaccard similarity (Gu et al., 2018; Cao et al., 2018; Wu et al., 2019), or existing tools like Lucene (Cao et al., 2018) to retrieve prototypes, and then input the pro-totypes into a…”
MethodPreventing Posterior Collapse with delta-VAEsPreprint
Razavi, A. S., van den Oord, A., Poole, B., & Vinyals, O. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.03416 · Cited by 127
EditSum: A Retrieve-and-Edit Framework for Source Code Summarization
Li, J., Li, Y., Li, G., Hu, X., Xia, X., & Jin, Z. G. (2021) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase51524.2021.9678724 · Cited by 93
“The motivation behind filtering out summaries with Jaccard similarity 0.3 is the edit module performs well only if a prototype is lexically similar to its target summary [26].”
BackgroundInfluentialNeural machine translation with monolingual translation memory
Cai, D., Wang, Y., Li, H., Lam, W., & Liu, L. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.567 · Cited by 45
“Recently, retrieval-guided generation has gained increasing interest in a wide range of text generation tasks such as language modeling (Guu et al., 2018; Khandelwal et al., 2019; Guu et al., 2020), dialogue response generation (Weston et al.”
BackgroundBiSET: Bi-directional Selective Encoding with Template for Abstractive Summarization
Wang, K., Quan, X., & Wang, R. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1207 · Cited by 68
“Guu et al. (2018) also attempted to encode humanwritten sentences to improve neural text generation.”
BackgroundSticking to the Facts: Confident Decoding for Faithful Data-to-Text Generation
Tian, R., Narayan, S., Sellam, T., & Parikh, A. P. (2019) · arXiv · doi:10.48550/arxiv.1910.08684 · Cited by 60
“Other approaches have proposed generating more accurate text using semiparametric approaches (Guu et al., 2018; Pandey et al., 2018; Peng et al., 2019), reinforcement learning-based rewards (Paulus et al., 2018; Pasunuru & Bansal, 2018), semi-Markov models to learn neural templates (Wiseman et al.,…”
MethodEfficient Nearest Neighbor Language Models
He, J., Neubig, G., & Berg-Kirkpatrick, T. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.461 · Cited by 97
“In contrast, recent non-parametric LMs (Guu et al., 2018; Khandelwal et al., 2020; He et al., 1 Code is available at https://github.com/jxhe/efficient-knnlm.”
MethodTemplate Guided Text Generation for Task-Oriented Dialogue
Kale, M., & Rastogi, A. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.527 · Cited by 64
“Our template based approach bears similarities to sentence fusion (Barzilay and McKeown, 2005), and prototype based text editing (Hossain et al., 2020; Cao et al., 2018; Guu et al., 2018; Wu et al., 2019).”
MethodTowards Personalized Image Captioning via Multimodal Memory Networks
Park, C. C., Kim, B., & Kim, G. (2018) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2824816 · Cited by 65
Adaptive Semiparametric Language Models
Yogatama, D., d’Autume, C. D. M., & Kong, L. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00371 · Cited by 126
He, H., Peng, N., & Liang, P. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1172 · Cited by 56
“We then develop an unsupervised approach to generate puns based on a retrieve-and-edit framework (Guu et al., 2018; Hashimoto et al., 2018) given an unhumorous corpus (Figure 2).”
MethodSelf-citationRetrieval-guided Dialogue Response Generation via a Matching-to-Generation Framework
Cai, D., Wang, Y., Bi, W., Tu, Z., Liu, X., & Shi, S. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1195 · Cited by 61
“For examples, Guu et al. (2018) proposed a prototype-then-edit model for unconditional text generation.”
BackgroundLabel-Agnostic Sequence Labeling by Copying Nearest Neighbors
Wiseman, S., & Stratos, K. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1533 · Cited by 76
“Retrieve-and-edit style structured prediction, where a model retrieves a set of labeled nearest neighbors from the training data and conditions on them to generate the target structure, is a promising approach that has recently received renewed interest (Hashimoto et al., 2018; Guu et al., 2018; Gu et al., 2018; Westo…”
BackgroundInfluentialXu, J., Ren, X., Lin, J., & Sun, X. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.01345 · Cited by 53
Commonsense Knowledge Reasoning and Generation with Pre-trained Language Models: A Survey
Bhargava, P., & Ng, V. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i11.21496 · Cited by 102
Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models
Shen, D., Çelikyılmaz, A., Zhang, Y., Chen, L., Wang, X. E., Gao, J., & Carin, L. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1200 · Cited by 53
“VAEs trained under the neural variational inference (NVI) framework, has been widely used for generating text sequences: (Bowman et al., 2016; Yang et al., 2017; Semeniuta et al., 2017; Miao et al., 2016; Serban et al., 2017; Miao et al., 2017; Zhao et al., 2017; Shen et al., 2017; Guu et al., 2018; Kim et al., 2018;…”
MethodLearning to Flip the Bias of News Headlines
Chen, W.-F., Wachsmuth, H., Al‐Khatib, K., & Stein, B. (2018) · International Conference on Natural Language Generation · doi:10.18653/v1/w18-6509 · Cited by 57
“A related research line that addresses rewriting texts is controlled generation (Guu et al., 2017; Mueller et al., 2017; Zhou and Neubig, 2017).”
BackgroundMethodParaphrase Generation by Learning How to Edit from Samples
Kazemnejad, A., Salehi, M., & Baghshah, M. S. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.535 · Cited by 47
“Guu et al. (2018) proposed the neural editor model for unconditional text generation, which produces a new sentence by editing a retrieved prototype using an edit vector.”
BackgroundMethodInfluentialWikiAtomicEdits: A Multilingual Corpus of Wikipedia Edits for Modeling Language and Discourse
Faruqui, M., Pavlick, E., Tenney, I., & Das, D. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1028 · Cited by 49
“Recent work has attempted to model sentence generation by re-writing existing sentences, either using crowdsourced edit examples (Narayan et al., 2017) or unsupervised heuristics (Guu et al., 2018); in contrast, we provide a large corpus of natural, human-produced edits.”
BackgroundLearning to Abstract for Memory-augmented Conversational Response Generation
Tian, Z., Bi, W., Li, X., & Zhang, N. L. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1371 · Cited by 48
Text Generation with Exemplar-based Adaptive Decoding
Peng, H., Parikh, A. P., Faruqui, M., Dhingra, B., & Das, D. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1263 · Cited by 46
“Without committing to an explicit slot-filling process, a typical method is to include ex-emplars as additional inputs to the sequence-to-sequence models (Gu et al., 2018; Pandey et al., 2018; Guu et al., 2018, inter alia ).”
InfluentialAdversarially Regularising Neural NLI Models to Integrate Logical Background KnowledgePreprint
Minervini, P., & Riedel, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.08609 · Cited by 58
“For generating low-perplexity adversarial examples, we take inspiration from Guu et al. (2017) and generate the sentences by editing prototypes extracted from a corpus.”
MethodDelete, Retrieve, Generate: A Simple Approach to Sentiment and Style TransferPreprint
Li, J., Jia, R., He, H., & Liang, P. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.06437 · Cited by 41
“For D ELETE A ND R ETRIEVE , similar to Guu et al. (2018), we retrieve the top-10 sentences and generate results using markers from each sentence.”
BackgroundMethodSelf-citationAlphaD3M: Machine Learning Pipeline SynthesisPreprint
Drori, I., Krishnamurthy, Y., Rampin, R., Lourenço, R., Ono, J., Cho, K., Silva, C. T., & Freire, J. (2021) · arXiv.org · doi:10.48550/arxiv.2111.02508 · Cited by 99
Simple and Effective Retrieve-Edit-Rerank Text Generation
Hossain, N., Ghazvininejad, M., & Zettlemoyer, L. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.228 · Cited by 44
Meaningful Answer Generation of E-Commerce Question-Answering
Gao, S., Chen, X., Ren, Z., Zhao, D., & Yan, R. (2021) · ACM Transactions on Information Systems · doi:10.1145/3432689 · Cited by 53
“e safe answer problem has been widely explored in recent years [30, 38, 49]. Among these methods that aim at solving this challenge, prototype editing has proven one of the most effective. Guu et al. [29] were the first to propose the prototype editing model, where a prototype sentence is sampled from the training dat…”
BackgroundExtract and Edit: An Alternative to Back-Translation for Unsupervised Neural Machine Translation
Wu, J., Wang, X. E., & Wang, W. Y. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1120 · Cited by 46
“Unlike other studies using the editing to generate more structural sentences (Guu et al., 2018; Hashimoto et al., 2018), here the revised sentences are designed to serve as better pivotal points in the target language space to guide the translation procedure.”
Guess who? Multilingual Approach For The Automated Generation Of Author-Stylized Poetry
Tikhonov, A., & Yamshchikov, I. P. (2018) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt.2018.8639573 · Cited by 35
“However, the problem of style transfer differs from the stylized text generation significantly since as it was shown in [28] an existent human-written source used to control the saliency of the output can significantly improve the quality of the resulting texts.”
BackgroundArtificial Intelligence for Conversational Robo-Advisor
Day, M.-Y., Lin, J.-T., & Chen, Y.-C. (2018) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1109/asonam.2018.8508269 · Cited by 38
“In September 2017, Stanford proposed a new generative model [7], which has also attracted significant attention on Reddit.”
BackgroundStyle Transfer for Texts: Retrain, Report Errors, Compare with Rewrites
Tikhonov, A., Shibaev, V., Nagaev, A., Nugmanova, A., & Yamshchikov, I. P. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1406 · Cited by 47
“d with narrowly defined style-transfer problems is that finding a good solution for one aspect of a style does not guarantee that you can use the same solution for a different aspect of it. For example,Guu et al. (2018) build a generative model for sentiment transfer with a retrieve-edit approach. In (Li et al.,2018) a…”
Simulated annealing for optimization of graphs and sequences
Liu, X., Li, P., Meng, F., Zhou, H., Zhong, H., Zhou, J., Mou, L., & Song, S. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.09.003 · Cited by 34
“Guu et al. (Guu et al., 2018) use a heuristic delete-retrieve-generate approach as a component of a supervised sequence-to-sequence (Seq2Seq) model, but our SAGS is a mathematically inspired, unsupervised search algorithm.”
Controllable Data Generation by Deep Learning: A Review
Wang, S.-Y., Du, Y., Guo, X., Pan, B., Qin, Z. S., & Zhao, L. (2024) · ACM Computing Surveys · doi:10.1145/3648609 · Cited by 58
QuaSE: Sequence Editing under Quantifiable Guidance
Liao, Y., Bing, L., Li, P., Shi, S., Lam, W. P., & Zhang, T. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1420 · Cited by 32
“Another line of works conduct editing on an existing sentence and expect that the output will serve particular purposes better (Guu et al., 2018).”
BackgroundMethodInfluentialIncorporating Discriminator in Sentence Generation: a Gibbs Sampling Method
Su, J., Xu, J., Qiu, X., & Huang, X. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11990 · Cited by 30
Paraphrase Diversification Using Counterfactual Debiasing
Park, S., Hwang, S.-W., Chen, F., Choo, J., Ha, J.-W., Kim, S., & Yim, J. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016883 · Cited by 41
“Another line of related work involves the hypothesis that paraphrase generation is a sequence of edit operations applied to the original sentence (Huang et al. 2018; Guu et al. 2018; Li et al. 2018; Quirk, Brockett, and Dolan 2004).”
BackgroundRetrieve-and-Edit Domain Adaptation for End2End Aspect Based Sentiment Analysis
Chen, Z., & Qian, T. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3146052 · Cited by 33
Gao, S., Chen, X., Li, P., Chan, Z., Zhao, D., & Yan, R. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1388 · Cited by 30
“(Guu et al., 2018) proposed the first prototype editing model, which samples a prototype sentence from training data and then edits it into a new sentence.”
BackgroundGenerating Diverse Translation by Manipulating Multi-Head Attention
Sun, Z., Huang, S., Wei, H., Dai, X., & Chen, J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i05.6429 · Cited by 31
Improving Neural Machine Translation with Soft Template Prediction
Yang, J., Ma, S., Zhang, D., Li, Z., & Zhou, M. Q. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.531 · Cited by 33
“…Lapata, 2018), summarization (Cao et al., 2018; Wang et al., 2019a), question answering (Duan et al., Pandey et al., 2018), and other text generation tasks (Wiseman et al., 2018; Guu et al., 2018), we assume the candidate templates of the target sentences can guide the sentence translation process.”
BackgroundControllable Semantic Parsing via Retrieval Augmentation
Pasupat, P., Zhang, Y., & Guu, K. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.607 · Cited by 53
“Some methods, like CASPER, encode the retrievals alongside the query and let the model decides how to use them (Guu et al., 2018; Hashimoto et al., 2018; He et al., 2020; Weston et al., 2018; Pandey et al., 2018; Lewis et al., 2020).”
BackgroundMethodResultSelf-citationLearning Dynamics Model in Reinforcement Learning by Incorporating the Long Term FuturePreprint
Ke, N. R., Singh, A., Touati, A., Goyal, A., Bengio, Y., Parikh, D., & Batra, D. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.01599 · Cited by 49
“However, in practice it is difficult for latent variables to capture higher level representation in the presence of a strong autoregressive model as shown in Gulrajani et al. (2016); Goyal et al. (2017); Guu et al. (2018).”
BackgroundMethodFew-Shot Table-to-Text Generation with Prototype Memory
Su, Y., Meng, Z., Baker, S., & Collier, N. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.77 · Cited by 44
Eval all, trust a few, do wrong to none: Comparing sentence generation modelsPreprint
Cífka, O., Severyn, A., Alfonseca, E., & Filippova, K. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.07972 · Cited by 49
“Unlike conventional VAEs where the encoder packs the whole sentence into a latent vector, Guu et al. (2017) choose the latent vector to represent an edit that transforms an input prototype into a new sentence.”
A Tutorial on Deep Latent Variable Models of Natural LanguagePreprint
Kim, Y., Wiseman, S., & Rush, A. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.06834 · Cited by 50
“Whereas none of these document-embedding based approaches are presented explicitly within the generative modeling framework above, they can all be viewed as identifying parameterized distributions over real vectors (e.g., Gaussians with particular means and covariances) with each cluster index, which in turn generate…”
BackgroundMethodInfluentialStylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfer
Lyu, Y., Liang, P. P., Pham, H., Hovy, E. H., Póczos, B., Salakhutdinov, R., & Morency, L. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.171 · Cited by 33
Self-citationVARL: a variational autoencoder-based reinforcement learning Framework for vehicle routing problems
Wang, Q. (2021) · Applied Intelligence · doi:10.1007/s10489-021-02920-3 · Cited by 30
“On the one hand, many classical algorithms often have some difficult conditions or too strong constraints during inference and training, so these algorithms cannot meet the needs of complex scenes [44].”
BackgroundExemplars-Guided Empathetic Response Generation Controlled by the Elements of Human Communication
Majumder, N., Ghosal, D., Hazarika, D., Gelbukh, A. F., Mihalcea, R. F., & Poria, S. (2022) · IEEE Access · doi:10.1109/access.2022.3193159 · Cited by 37
Metadata
- Authors
- Guu, K., Hashimoto, T. B., Oren, Y., & Liang, P.
- Affiliations
- Stanford University (US)
- Corresponding author
- Guu, Kelvin
- Hashimoto, Tatsunori B.
- Oren, Yonatan
- Liang, Percy
- Venue
- Transactions of the Association for Computational Linguistics
- Publisher
- MIT Press - Journals
- Published
- 2018-12
- Volume
- 6
- Pages
- 437-450
- ISSN
- 2307-387X (ISSN-L)
- OpenAlex
- W2963018920
- Cited by
- 300
- References
- 29
- Citations by year
- 2026: 4 · 2025: 7 · 2024: 7 · 2023: 30 · 2022: 30 · 2021: 48 · 2020: 56 · 2019: 72 · 2018: 44
- FWCI
- 30.55
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- Locations
- Transactions of the Association for Computational Linguistics (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- arXiv (Cornell University)
- Funders
- Defense Advanced Research Projects Agency
- Army Research Office (W911NF-15-1-, W911NF, W911NF-15)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Keywords
- sentence generation, generative language models, sentence similarity, perplexity, interpretability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.