The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Transformers: State-of-the-Art Natural Language Processing
Open accessAbstract
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, Alexander Rush. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. 2020.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Almost all CLaMs have been made publicly accessible via online model repositories like HuggingFace57.”
From The shaky foundations of large language models and foundation models for electronic health records (2023) · cites this paper as [57]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Employing BERT, GPT-2, RoBERTa, and DistilBERT, we achieved robust results; BERT for deep contextual insights, GPT-2 for coherent text generation, RoBERTa for performance with large data, and DistilBERT for fast, cost-effective efficiency [39].”
From Generative AI-Powered Educational Alignment: A Framework for Matching Syllabus Course Topics with Web Description (2024) · cites this paper as [39]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Open-source ecosystems such as Hugging Face and BLOOM reduce technical barriers but can reproduce extractive defaults without Indigenous authority over datasets, objectives, and deployment pathways (BigScience Workshop, 2022;Wolf et al., 2020).”
From Towards a decolonial AI sovereignty model for indigenous educational settings (2026) · cites this paper as Wolf et al., 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Before the emergence of ChatGPT, BERT is a commonly used pre-trained machine learning model for NLP tasks (Wolf et al., 2020), and a ubiquitous baseline in text classification experiments of research in recent years (Rogers et al., 2021).”
From Towards reliable generative AI-driven scaffolding: Reducing hallucinations and enhancing quality in self-regulated learning support (2026) · cites this paper as Wolf et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“Tamarin is implemented in roughly 9K lines of Python on top of HuggingFace Transformers (Wolf et al., 2020); it uses no custom CUDA and does not modify model weights.”
From Tamarin (HSQ): Reversible Hierarchical KV-Cache Compression for LLM Inference (2026) · cites this paper as Wolf et al., 2020
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“3 speedup on GPT-2 (seq. length 1K)”
From FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness (2022) · cites this paper as [87]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Table 2 shows up to 3 endto-end speedup compared to Huggingface and 1.7 speedup compared to Megatron-LM.”
From FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness (2022) · cites this paper as [87]
Experimental — accuracy not yet measuredIn the citing paper
“While these early explorations are promising, they do not explore how much or what kind of interactivity is beneficial.”
From Interactive Model Cards: A Human-Centered Approach to Model Documentation (2022) · cites this paper as [73]
In the citing paper
“along with high-quality open-source libraries [113] have lowered the barrier to entry and make it possible to build conversational models that exhibit high generalization and coherence [90].”
From Future directions for chatbot research: An interdisciplinary research agenda (2021) · cites this paper as [113]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 2×
“The Transformer (Vaswani et al., 2017) has rapidly become the dominant architecture for natural language processing, surpassing alternative neural models such as convolutional and recurrent neural networks in performance for tasks in both natural language understanding and natural language…”
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173 · cited 4×
“, 2018) and the original source code for BERT (Devlin et al., 2018), both from Google Research.”
InfluentialRoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · cited 3×
“…text corpora, leading to major gains in accuracy on downstream tasks including text classification (Yang et al., 2019), language understanding (Liu et al., 2019b; Wang et al., 2018, 2019), machine translation (Lample and Conneau, 2019a), coreference resolution (Joshi et al., 2019),…”
InfluentialDeep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983 · cited 1×
“Model pretraining (McCann et al., 2017; Howard and Ruder, 2018; Peters et al., 2018; Devlin et al., 2018) allows models to be trained on generic corpora and subsequently be easily adapted to specific tasks with strong performance.”
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · cited 2×
“, 2019) T5 (Raffel et al., 2019) MarianMT (J.”
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
The Stanford CoreNLP Natural Language Processing Toolkit
Manning, C. D., Surdeanu, M., Bauer, J., Finkel, J. R., Bethard, S. J., & McClosky, D. (2014) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.3115/v1/p14-5010 · Cited by 7,252 · cited 1×
“Two core libraries are NLTK (Loper and Bird, 2002) and Stanford CoreNLP (Manning et al., 2014), which collect a variety of different approaches to NLP in a single package.”
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687 · cited 3×
“The Transformer architecture is particularly conducive to pretraining on large text corpora, leading to major gains in accuracy on downstream tasks including text classification (Yang et al., 2019), language understanding (Liu et al.”
InfluentialDistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019) · arXiv · doi:10.48550/arxiv.1910.01108 · Cited by 4,653 · cited 2×
“While core models like BERT and GPT-2 continue to be popular, other specialized models including DistilBERT (Sanh et al., 2019), which was developed for the library, are now widely downloaded by the community.”
Self-citation
Research works printed but not linked: 2
- Alan Akbik, Tanja Bergmann, Duncan Blythe, Kashif Rasul, Stefan Schweter, and Roland Vollgraf. 2019. Flair: An easy-to-use framework for state-of-the-art nlp. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Com- putational Linguistics (Demonstrations), pages 54- 59. aclweb.org.
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog, 1(8):9.
Cited by
Sorted by citations
Items 201–300 of 1,115
How Large Language Models Will Disrupt Data Management
Fernandez, R. C., Elmore, A. J., Franklin, M. J. M., Krishnan, S., & Tan, C. (2023) · Proceedings of the VLDB Endowment · doi:10.14778/3611479.3611527 · Cited by 134
A DNA language model based on multispecies alignment predicts the effects of genome-wide variants
Benegas, G., Albors, C., Aw, A. J., Ye, C., & Song, Y. S. (2025) · Nature Biotechnology · doi:10.1038/s41587-024-02511-w · Cited by 145
Datasets for large language models: a comprehensive survey
Liu, Y., Cao, J., Liu, C., Ding, K., & Jin, L. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11403-7 · Cited by 268
Entity-level Factual Consistency of Abstractive Text Summarization
Nan, F., Nallapati, R. M., Wang, Z., dos Santos, C. N., Zhu, H., Zhang, D., McKeown, K. R., & Xiang, B. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.235 · Cited by 127
Prompting Is Programming: A Query Language for Large Language Models
Beurer-Kellner, L., Fischer, M., & Vechev, M. (2023) · Proceedings of the ACM on Programming Languages · doi:10.1145/3591300 · Cited by 117
An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models
Meade, N., Poole-Dayan, E., & Reddy, S. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.132 · Cited by 135
CancerGPT for few shot drug pair synergy prediction using large pretrained language models
Li, T., Shetty, S., Kamath, A., Jaiswal, A. K., Jiang, X., Ding, Y., & Kim, Y. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01024-9 · Cited by 135
Jonge, N. D., Mildau, K., Meijer, D., Louwen, J. J. R., Bueschl, C., Huber, F., & van der Hooft, J. J. J. (2022) · Metabolomics · doi:10.1007/s11306-022-01963-y · Cited by 131
Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training
Li, S., Liu, H., Bian, Z., Fang, J., Huang, H., Liu, Y., Wang, B., & You, Y. (2023) · Proceedings of the International Conference on Parallel Processing · doi:10.1145/3605573.3605613 · Cited by 174
A systematic survey of air quality prediction based on deep learning
Zhang, Z., Zhang, S., Chen, C., & Yuan, J. (2024) · Alexandria Engineering Journal · doi:10.1016/j.aej.2024.03.031 · Cited by 138
FeTaQA: Free-form Table Question Answering
Nan, L., Hsieh, C., Mao, Z., Lin, X., Verma, N., Zhang, R., Kryściński, W., Schoelkopf, H., Kong, R., Tang, X., et al. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00446 · Cited by 150
Prompt Engineering or Fine-Tuning? A Case Study on Phishing Detection with Large Language Models
Trad, F. S., & Chehab, A. (2024) · Machine Learning and Knowledge Extraction · doi:10.3390/make6010018 · Cited by 140
Investigating Gender Bias in BERT
Bhardwaj, R., Majumder, N., & Poria, S. (2021) · Cognitive Computation · doi:10.1007/s12559-021-09881-2 · Cited by 112
A Recipe for Arbitrary Text Style Transfer with Large Language Models
Reif, E., Ippolito, D., Yuan, A., Coenen, A., Callison-Burch, C., & Wei, J. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-short.94 · Cited by 123
Dave, S., Baghdadi, R., Nowatzki, T., Avancha, S., Shrivastava, A., & Li, B. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3098483 · Cited by 120
Discrete Opinion Tree Induction for Aspect-based Sentiment Analysis
Chen, C., Teng, Z., Wang, Z., & Zhang, Y. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.145 · Cited by 114
LexGLUE: A Benchmark Dataset for Legal Language Understanding in English
Chalkidis, I., Jana, A., Hartung, D., Bommarito, M. J., Androutsopoulos, I., Katz, D. M., & Aletras, N. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3936759 · Cited by 111
Esteva, A., Kale, A., Paulus, R., Hashimoto, K., Yin, W., Radev, D., & Socher, R. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00437-0 · Cited by 169
Medical image captioning via generative pretrained transformers
Selivanov, A., Rogov, O. Y., Chesakov, D., Shelmanov, A., Fedulova, I., & Dylov, D. V. (2023) · Scientific Reports · doi:10.1038/s41598-023-31223-5 · Cited by 124
Peng, L., Jian, S., Kan, Z., Qiao, L., & Li, D. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103564 · Cited by 119
Deep Learning for Novel Antimicrobial Peptide Design
Wang, C. E., Garlick, S., & Zloh, M. (2021) · Biomolecules · doi:10.3390/biom11030471 · Cited by 117
DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Data
Fu, S., Tamir, N., Sundaram, S., Chai, L., Zhang, R., Dekel, T., & Isola, P. (2023) · Advances in Neural Information Processing Systems 36 · doi:10.52202/075280-2208 · Cited by 108
Automated News Summarization Using Transformers
Gupta, A., Chugh, D., Anjum, A., & Katarya, R. (2022) · Lecture notes in electrical engineering · doi:10.1007/978-981-16-9012-9_21 · Cited by 121
Dynamics of online hate and misinformation
Cinelli, M., Pelicon, A., Mozetič, I., Quattrociocchi, W., Novak, P. K., & Zollo, F. (2021) · Scientific Reports · doi:10.1038/s41598-021-01487-w · Cited by 107
Just, J. (2023) · Technovation · doi:10.1016/j.technovation.2023.102883 · Cited by 125
Buschek, D., Zürn, M., & Eiband, M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445372 · Cited by 108
Sentiment trading with large language models
Kirtac, K., & Germano, G. (2024) · Finance Research Letters · doi:10.1016/j.frl.2024.105227 · Cited by 115
GREEK-BERT: The Greeks visiting Sesame Street
Koutsikakis, J., Chalkidis, I., Malakasiotis, P., & Androutsopoulos, I. (2020) · Hellenic Conference on Artificial Intelligence · doi:10.1145/3411408.3411440 · Cited by 126
CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP
Ye, Q., Lin, B. Y., & Ren, X. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.572 · Cited by 154
Label Verbalization and Entailment for Effective Zero and Few-Shot Relation Extraction
Sainz, O., de Lacalle, O. L., Labaka, G., Barrena, A., & Agirre, E. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.92 · Cited by 119
Advances of machine learning in materials science: Ideas and techniques
Chong, S. S., Ng, Y. S., Wang, H., & Zheng, J. (2023) · Frontiers of Physics · doi:10.1007/s11467-023-1325-z · Cited by 114
Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversation
Song, X., Huang, L., Xue, H., & Hu, S. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.347 · Cited by 105
Few-Shot Text Generation with Natural Language Instructions
Schick, T., & Schütze, H. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.32 · Cited by 107
Green learning: Introduction, examples and outlook
Kuo, C. ‐. J., & Madni, A. M. (2022) · Journal of Visual Communication and Image Representation · doi:10.1016/j.jvcir.2022.103685 · Cited by 119
Moutik, O., Sekkat, H., Tigani, S., Chehri, A., Saadane, R., Tchakoucht, T. A., & Paul, A. (2023) · Sensors · doi:10.3390/s23020734 · Cited by 114
Beat the ai: Investigating adversarial human annotation for reading comprehension
Bartolo, M., Roberts, A., Welbl, J., Riedel, S., & Stenetorp, P. (2020) · UCL Discovery (University College London) · Cited by 102
Wang, X., & Ma, W. (2024) · Energy · doi:10.1016/j.energy.2024.131071 · Cited by 110
Interactive Model Cards: A Human-Centered Approach to Model Documentation
Crisan, A., Drouhard, M., Vig, J., & Rajani, N. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533108 · Cited by 101
Backdoor Attacks on Pre-trained Models by Layerwise Weight Poisoning
Li, L., Song, D., Li, X., Zeng, J., Ma, R., & Qiu, X. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.241 · Cited by 145
Decomposed Meta-Learning for Few-Shot Named Entity Recognition
Ma, T., Jiang, H., Wu, Q., Zhao, T., & Lin, C.-Y. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.124 · Cited by 116
Dornheim, J., Morand, L., Nallani, H. J., & Helm, D. (2023) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-023-10009-y · Cited by 116
Clinical Text Summarization: Adapting Large Language Models Can Outperform Human Experts
Veen, D. V., Uden, C. V., Blankemeier, L., Delbrouck, J.-B., Aali, A., Bluethgen, C., Pareek, A., Polacin, M., Reis, E. P., Seehofnerova, A., et al. (2023) · doi:10.21203/rs.3.rs-3483777/v1 · Cited by 892
Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections
Zhong, R., Lee, K., Zhang, Z., & Klein, D. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.244 · Cited by 152
Hate speech detection on Twitter using transfer learning
Ali, R., Farooq, U., Arshad, M. U., Shahzad, W., & Beg, M. O. (2022) · Computer Speech & Language · doi:10.1016/j.csl.2022.101365 · Cited by 117
Performance Study on Extractive Text Summarization Using BERT Models
Abdel-Salam, S., & Rafea, A. (2022) · Information · doi:10.3390/info13020067 · Cited by 106
Hargreaves, C. J., Gaultois, M. W., Daniels, L. M., Watts, E. J., Kurlin, V. A., Moran, M. J., Dang, Y., Morris, R. E., Morscher, A., Thompson, K., et al. (2023) · npj Computational Materials · doi:10.1038/s41524-022-00951-z · Cited by 104
ScaleFL: Resource-Adaptive Federated Learning with Heterogeneous Clients
Ilhan, F., Su, G., & Liu, L. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02350 · Cited by 113
Fine-Tuning Wav2Vec2 for Speaker Recognition
Vaessen, N., & van Leeuwen, D. A. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746952 · Cited by 111
Widmann, T., & Wich, M. (2022) · Political Analysis · doi:10.1017/pan.2022.15 · Cited by 106
Zhang, Y., Liu, P., & Biljecki, F. (2023) · ISPRS Journal of Photogrammetry and Remote Sensing · doi:10.1016/j.isprsjprs.2023.03.008 · Cited by 107
DREEAM: Guiding Attention with Evidence for Improving Document-Level Relation Extraction
Ma, Y., Wang, A., & Okazaki, N. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.145 · Cited by 122
Evaluation of large language models for discovery of gene set function
Hu, M., Alkhairy, S., Lee, I., Pillich, R. T., Fong, D., Smith, K., Bachelder, R., Ideker, T., & Pratt, D. (2025) · Nature Methods · doi:10.1038/s41592-024-02525-x · Cited by 104
Zoom Out and Observe: News Environment Perception for Fake News Detection
Sheng, Q., Cao, J., Zhang, X., Li, R., Wang, D., & Zhu, Y. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.311 · Cited by 115
Brintrup, A. M., Kosasih, E. E., Schaffer, P., Ge, Z., Demirel, G., & MacCarthy, B. L. (2023) · International Journal of Production Research · doi:10.1080/00207543.2023.2270719 · Cited by 107
Deep language algorithms predict semantic comprehension from brain activity
Caucheteux, C., Gramfort, A., & King, J.-R. (2022) · Scientific Reports · doi:10.1038/s41598-022-20460-9 · Cited by 91
BERxiT: Early Exiting for BERT with Better Fine-Tuning and Extension to Regression
Xin, J., Tang, R., Yu, Y., & Lin, J. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.8 · Cited by 112
SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and Arabic
Farha, I. A., Oprea, S. V., Wilson, S. L., & Magdy, W. (2022) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2022.semeval-1.111 · Cited by 98
A Review of Deep-Learning Methods for Change Detection in Multispectral Remote Sensing Images
Jonášová, E. P. (2023) · Remote Sensing · doi:10.3390/rs15082092 · Cited by 111
Calibration of Transformer-Based Models for Identifying Stress and Depression in Social Media
Ilias, L., Mouzakitis, S., & Askounis, D. (2023) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2023.3283009 · Cited by 125
Graphix-T5: Mixing Pre-trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing
Li, J., Hui, B., Cheng, R. C. K., Qin, B., Ma, C., Huo, N., Huang, F., Du, W., Si, L., & Li, Y. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26536 · Cited by 137
Self-citationTowards Adaptive Prefix Tuning for Parameter-Efficient Language Model Fine-tuning
Zhang, Z.-R., Tan, C., Xu, H., Wang, C., Huang, J. G., & Huang, S. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.107 · Cited by 126
A Hybrid LSTM-Transformer Model for Power Load Forecasting
Pentsos, V., Tragoudas, S., Wibbenmeyer, J., & Khdeer, N. (2025) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2025.3535407 · Cited by 107
AlQuraishi, M., & Sorger, P. K. (2021) · Nature Methods · doi:10.1038/s41592-021-01283-4 · Cited by 96
Ontology-driven weak supervision for clinical entity classification in electronic health records
Fries, J., Steinberg, E., Khattar, S., Fleming, S. L., Posada, J., Callahan, A., & Shah, N. H. (2021) · Nature Communications · doi:10.1038/s41467-021-22328-4 · Cited by 102
S oloist : BuildingTask Bots at Scale with Transfer Learning and Machine Teaching
Peng, B., Li, C., Li, J., Shayandeh, S., Lidén, L., & Gao, J. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00399 · Cited by 295
FitzGerald, J., Hench, C., Peris, C., Mackie, S., Rottmann, K., Sanchez, A., Nash, A., Urbach, L., Kakarala, V., Singh, R., et al. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.235 · Cited by 210
LAMBERT: Layout-Aware Language Modeling for Information Extraction
Garncarek, Ł., Powalski, R., Stanisławek, T., Topolski, B., Halama, P., Turski, M., & Graliński, F. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-86549-8_34 · Cited by 120
Adaptive Multimodal Emotion Detection Architecture for Social Robots
Heredia, J., Lopes-Silva, E., Cardinale, Y., Díaz-Amado, J., Dongo, I., Graterol, W., & Aguilera, A. (2022) · IEEE Access · doi:10.1109/access.2022.3149214 · Cited by 99
Yang, K., Zhang, T., & Ananiadou, S. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.102961 · Cited by 95
An Expert Annotated Dataset for the Detection of Online Misogyny
Guest, E., Vidgen, B., Mittos, A., Sastry, N., Gareth Tyson, A., & Margetts, H. Z. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.114 · Cited by 104
Balancing Methods for Multi-label Text Classification with Long-Tailed Class Distribution
Huang, Y., Giledereli, B., Köksal, A., Özgür, A., & Özkırımlı, E. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.643 · Cited by 117
Roudsari, A. H., Afshar, J., Lee, W., & Lee, S. (2021) · Scientometrics · doi:10.1007/s11192-021-04179-4 · Cited by 98
HONEST: Measuring Hurtful Sentence Completion in Language Models
Nozza, D., Bianchi, F., & Hovy, D. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.191 · Cited by 95
Read, Listen, and See: Leveraging Multimodal Information Helps Chinese Spell Checking
Xu, H.-D., Li, Z., Zhou, Q. S., Li, C., Wang, Z., Cao, Y., Huang, H., & Mao, X.-L. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.64 · Cited by 97
Jointly Optimizing Query Encoder and Product Quantization to Improve Retrieval Performance
Zhan, J., Mao, J., Liu, Y., Guo, J., Zhang, M., & Ma, S. (2021) · Proceedings of the 30th ACM International Conference on Information & Knowledge Management · doi:10.1145/3459637.3482358 · Cited by 91
Hybrid recommendation by incorporating the sentiment of product reviews
Elahi, M., Kholgh, D. K., Kiarostami, M. S., Oussalah, M., & Saghari, S. (2023) · Information Sciences · doi:10.1016/j.ins.2023.01.051 · Cited by 91
Large language models for preventing medication direction errors in online pharmacies
Pais, C., Liu, J., Voigt, R., Gupta, V., Wade, E., & Bayati, M. (2024) · Nature Medicine · doi:10.1038/s41591-024-02933-8 · Cited by 101
Large language models and their applications in bioinformatics
Sarumi, O. A., & Heider, D. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.09.031 · Cited by 107
The Large Language Models on Biomedical Data Analysis: A Survey
Lan, W., Tang, Z., Liu, M., Chen, Q., Peng, W., Chen, Y. P., & Pan, Y. F. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3530794 · Cited by 100
Edge Intelligence: A Review of Deep Neural Network Inference in Resource-Limited Environments
Ngo, D., Park, H.-C., & Kang, B. (2025) · Electronics · doi:10.3390/electronics14122495 · Cited by 118
Generative language models exhibit social identity biases
Hu, T., Kyrychenko, Y., Rathje, S., Collier, N., van der Linden, S., & Roozenbeek, J. (2024) · Nature Computational Science · doi:10.1038/s43588-024-00741-1 · Cited by 100
Kennedy, B., Atari, M., Davani, A. M., Yeh, L., Omrani, A., Kim, Y., Coombs, K., Havaldar, S., Portillo-Wightman, G., Gonzalez, E., et al. (2022) · Language Resources and Evaluation · doi:10.1007/s10579-021-09569-x · Cited by 98
Pre-trained language models with domain knowledge for biomedical extractive summarization
Xie, Q., Bishop, J. A., Tiwari, P., & Ananiadou, S. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109460 · Cited by 97
Reframing Human-AI Collaboration for Generating Free-Text Explanations
Wiegreffe, S., Hessel, J., Swayamdipta, S., Riedl, M. O., & Choi, Y. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.47 · Cited by 121
Sheu, Y.-H., Magdamo, C., Miller, M. R., Das, S., Blacker, D., & Smoller, J. W. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00817-8 · Cited by 90
Lim, S., & Schmälzle, R. (2023) · Frontiers in Communication · doi:10.3389/fcomm.2023.1129082 · Cited by 105
Towards end-to-end automation of AI research
Lu, C., Lu, C., Lange, R. T., Yamada, Y., Hu, S., Foerster, J., Ha, D., & Clune, J. (2026) · Nature · doi:10.1038/s41586-026-10265-5 · Cited by 116
Text2NeRF: Text-Driven 3D Scene Generation With Neural Radiance Fields
Zhang, J., Li, X., Wan, Z., Wang, C., & Liao, J. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3361502 · Cited by 94
Müller, B., Anastasopoulos, A., Sagot, B., & Seddah, D. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.38 · Cited by 121
Liao, Q. V., Subramonyam, H., Wang, J., & Vaughan, J. W. (2023) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580652 · Cited by 120
Text-Only Training for Image Captioning using Noise-Injected CLIP
Nukrai, D., Mokady, R., & Globerson, A. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.299 · Cited by 90
Bad Characters: Imperceptible NLP Attacks
Boucher, N., Shumailov, I., Anderson, R., & Papernot, N. (2022) · 2022 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp46214.2022.9833641 · Cited by 102
Sentiment is Not Stance: Target-Aware Opinion Classification for Political Text Analysis
Bestvater, S. E., & Monroe, B. L. (2022) · Political Analysis · doi:10.1017/pan.2022.10 · Cited by 93
Huang, J., Bibri, S. E., & Keel, P. E. (2025) · Environmental Science and Ecotechnology · doi:10.1016/j.ese.2025.100526 · Cited by 108
Data Contamination: From Memorization to Exploitation
Magar, I., & Schwartz, R. (2022) · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/2022.acl-short.18 · Cited by 88
Toward Automatic Audio Description Generation for Accessible Videos
Wang, Y., Liang, W., Huang, H., Zhang, Y., Li, D., & Yu, L.-F. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445347 · Cited by 87
It’s All in the Embedding! Fake News Detection Using Document Embeddings
Truică, C., & Apostol, E. (2023) · Mathematics · doi:10.3390/math11030508 · Cited by 100
Application of deep learning to fault diagnosis of rotating machineries
Su, H., Xiang, L., & Hu, A. (2024) · Measurement Science and Technology · doi:10.1088/1361-6501/ad1e20 · Cited by 90
Characterizing Power Management Opportunities for LLMs in the Cloud
Patel, P., Choukse, E., Zhang, C., Goiri, Í., Warrier, B., Mahalingam, N., & Bianchini, R. (2024) · Proceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 3 · doi:10.1145/3620666.3651329 · Cited by 100
Metadata
- Authors
- Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., Davison, J., Shleifer, S., von Platen, P., Ma, C., Jernite, Y., Plu, J., Xu, C., Le Scao, T., Gugger, S., Drame, M., Lhoest, Q., & Rush, A.
- Affiliations
- Hugging Face (US)
- ORCID
- Venue
- Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
- Published
- 2020
- Pages
- 38-45
- OpenAlex
- W2979826702
- Cited by
- 8,741
- References
- 39
- Citations by year
- 2026: 851 · 2025: 1481 · 2024: 1405 · 2023: 2347 · 2022: 1686 · 2021: 872 · 2020: 94
- FWCI
- 477.50
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- transformer models, natural language processing, Hugging Face
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
