The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Transformers: State-of-the-Art Natural Language Processing
Open accessAbstract
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, Alexander Rush. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. 2020.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Almost all CLaMs have been made publicly accessible via online model repositories like HuggingFace57.”
From The shaky foundations of large language models and foundation models for electronic health records (2023) · cites this paper as [57]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Employing BERT, GPT-2, RoBERTa, and DistilBERT, we achieved robust results; BERT for deep contextual insights, GPT-2 for coherent text generation, RoBERTa for performance with large data, and DistilBERT for fast, cost-effective efficiency [39].”
From Generative AI-Powered Educational Alignment: A Framework for Matching Syllabus Course Topics with Web Description (2024) · cites this paper as [39]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Open-source ecosystems such as Hugging Face and BLOOM reduce technical barriers but can reproduce extractive defaults without Indigenous authority over datasets, objectives, and deployment pathways (BigScience Workshop, 2022;Wolf et al., 2020).”
From Towards a decolonial AI sovereignty model for indigenous educational settings (2026) · cites this paper as Wolf et al., 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Before the emergence of ChatGPT, BERT is a commonly used pre-trained machine learning model for NLP tasks (Wolf et al., 2020), and a ubiquitous baseline in text classification experiments of research in recent years (Rogers et al., 2021).”
From Towards reliable generative AI-driven scaffolding: Reducing hallucinations and enhancing quality in self-regulated learning support (2026) · cites this paper as Wolf et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“Tamarin is implemented in roughly 9K lines of Python on top of HuggingFace Transformers (Wolf et al., 2020); it uses no custom CUDA and does not modify model weights.”
From Tamarin (HSQ): Reversible Hierarchical KV-Cache Compression for LLM Inference (2026) · cites this paper as Wolf et al., 2020
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“3 speedup on GPT-2 (seq. length 1K)”
From FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness (2022) · cites this paper as [87]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Table 2 shows up to 3 endto-end speedup compared to Huggingface and 1.7 speedup compared to Megatron-LM.”
From FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness (2022) · cites this paper as [87]
Experimental — accuracy not yet measuredIn the citing paper
“While these early explorations are promising, they do not explore how much or what kind of interactivity is beneficial.”
From Interactive Model Cards: A Human-Centered Approach to Model Documentation (2022) · cites this paper as [73]
In the citing paper
“along with high-quality open-source libraries [113] have lowered the barrier to entry and make it possible to build conversational models that exhibit high generalization and coherence [90].”
From Future directions for chatbot research: An interdisciplinary research agenda (2021) · cites this paper as [113]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 2×
“The Transformer (Vaswani et al., 2017) has rapidly become the dominant architecture for natural language processing, surpassing alternative neural models such as convolutional and recurrent neural networks in performance for tasks in both natural language understanding and natural language…”
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173 · cited 4×
“, 2018) and the original source code for BERT (Devlin et al., 2018), both from Google Research.”
InfluentialRoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · cited 3×
“…text corpora, leading to major gains in accuracy on downstream tasks including text classification (Yang et al., 2019), language understanding (Liu et al., 2019b; Wang et al., 2018, 2019), machine translation (Lample and Conneau, 2019a), coreference resolution (Joshi et al., 2019),…”
InfluentialDeep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983 · cited 1×
“Model pretraining (McCann et al., 2017; Howard and Ruder, 2018; Peters et al., 2018; Devlin et al., 2018) allows models to be trained on generic corpora and subsequently be easily adapted to specific tasks with strong performance.”
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · cited 2×
“, 2019) T5 (Raffel et al., 2019) MarianMT (J.”
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
The Stanford CoreNLP Natural Language Processing Toolkit
Manning, C. D., Surdeanu, M., Bauer, J., Finkel, J. R., Bethard, S. J., & McClosky, D. (2014) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.3115/v1/p14-5010 · Cited by 7,252 · cited 1×
“Two core libraries are NLTK (Loper and Bird, 2002) and Stanford CoreNLP (Manning et al., 2014), which collect a variety of different approaches to NLP in a single package.”
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687 · cited 3×
“The Transformer architecture is particularly conducive to pretraining on large text corpora, leading to major gains in accuracy on downstream tasks including text classification (Yang et al., 2019), language understanding (Liu et al.”
InfluentialDistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019) · arXiv · doi:10.48550/arxiv.1910.01108 · Cited by 4,653 · cited 2×
“While core models like BERT and GPT-2 continue to be popular, other specialized models including DistilBERT (Sanh et al., 2019), which was developed for the library, are now widely downloaded by the community.”
Self-citation
Research works printed but not linked: 2
- Alan Akbik, Tanja Bergmann, Duncan Blythe, Kashif Rasul, Stefan Schweter, and Roland Vollgraf. 2019. Flair: An easy-to-use framework for state-of-the-art nlp. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Com- putational Linguistics (Demonstrations), pages 54- 59. aclweb.org.
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog, 1(8):9.
Cited by
Sorted by citations
Items 301–400 of 1,115
Shared functional specialization in transformer-based language models and the human brain
Kumar, S., Sumers, T. R., Yamakoshi, T., Goldstein, A., Hasson, U., Norman, K. A., Griffiths, T. L., Hawkins, R. D., & Nastase, S. A. (2024) · Nature Communications · doi:10.1038/s41467-024-49173-5 · Cited by 108
Bonikowski, B., Luo, Y., & Stuhler, O. (2022) · Sociological Methods & Research · doi:10.1177/00491241221122317 · Cited by 99
SRL-ACO: A text augmentation framework based on semantic role labeling and ant colony optimization
Onan, A. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.101611 · Cited by 92
Systematic Review of Hybrid Vision Transformer Architectures for Radiological Image Analysis
Kim, J. W., Khan, A. U., & Banerjee, I. (2025) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-024-01322-4 · Cited by 99
GeDi: Generative Discriminator Guided Sequence Generation
Krause, B., Gotmare, A. D., McCann, B., Keskar, N. S., Joty, S., Socher, R., & Rajani, N. F. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.424 · Cited by 220
Annotating Columns with Pre-trained Language Models
Suhara, Y., Li, J., Li, Y., Zhang, D., Demiralp, Ç., Chen, C., & Tan, W.-C. (2022) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3514221.3517906 · Cited by 128
Understanding and Overcoming the Challenges of Efficient Transformer Quantization
Bondarenko, Y., Nagel, M., & Blankevoort, T. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.627 · Cited by 172
Energy-optimal routing for electric vehicles using deep reinforcement learning with transformer
Tang, M., Zhuang, W., Li, B., Liu, H., Song, Z., & Yin, G. (2023) · Applied Energy · doi:10.1016/j.apenergy.2023.121711 · Cited by 85
Summarization of scholarly articles using BERT and BiGRU: Deep learning-based extractive approach
Bano, S., Khalid, S., Tairan, N. M., Shah, H., & Khattak, H. A. (2023) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2023.101739 · Cited by 101
Emotion Detection for Social Robots Based on NLP Transformers and an Emotion Ontology
Graterol, W., Díaz-Amado, J., Cardinale, Y., Dongo, I., Lopes-Silva, E., & Libarino, C. S. (2021) · Sensors · doi:10.3390/s21041322 · Cited by 91
TILDE: Term Independent Likelihood moDEl for Passage Re-ranking
Zhuang, S., & Zuccon, G. (2021) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3404835.3462922 · Cited by 92
Spatial transformer network on skeleton‐based gait recognition
Zhang, C., Chen, X., Han, G., & Liu, X. (2022) · Expert Syst. J. Knowl. Eng. · doi:10.1111/exsy.13244 · Cited by 100
Fan, G., Wang, J., Li, Y., Zhang, D., & Miller, R. J. (2023) · Proceedings of the VLDB Endowment · doi:10.14778/3587136.3587146 · Cited by 125
Measuring and Improving the Energy Efficiency of Large Language Models Inference
Argerich, M. F., & Patiño-Martı́nez, M. (2024) · IEEE Access · doi:10.1109/access.2024.3409745 · Cited by 110
GPT-GNN: Generative Pre-Training of Graph Neural NetworksPreprint
Hu, Z., Dong, Y., Wang, K., Chang, K.-W., & Sun, Y. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.15437 · Cited by 84
Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Wu, J., et al. (2023) · doi:10.36227/techrxiv.23589741 · Cited by 111
Visual Grounding in Remote Sensing Images
Sun, Y., Feng, S., Li, X., Ye, Y., Kang, J., & Huang, X. (2022) · Proceedings of the 30th ACM International Conference on Multimedia · doi:10.1145/3503161.3548316 · Cited by 81
CasEE: A Joint Learning Framework with Cascade Decoding for Overlapping Event Extraction
Sheng, J., Guo, S., Yu, B., Li, Q., Hei, Y., Wang, L., Liu, T., & Xu, H. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.14 · Cited by 84
Emotionally Informed Hate Speech Detection: A Multi-target Perspective
Chiril, P., Pamungkas, E. W., Benamara, F., Moriceau, V., & Patti, V. (2021) · Cognitive Computation · doi:10.1007/s12559-021-09862-5 · Cited by 102
Explainable deep learning in healthcare: A methodological survey from an attribution view
Jin, D., Sergeeva, E., Weng, W., Chauhan, G., & Szolovits, P. (2022) · WIREs Mechanisms of Disease · doi:10.1002/wsbm.1548 · Cited by 98
MSˆ2: Multi-Document Summarization of Medical Studies
DeYoung, J., Beltagy, I., van Zuylen, M., Kuehl, B., & Wang, L. L. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.594 · Cited by 120
Mining legal arguments in court decisions
Habernal, I., Faber, D. R., Recchia, N., Bretthauer, S., Gurevych, I., Döhmann, I. S. G., & Burchard, C. (2023) · Artificial Intelligence and Law · doi:10.1007/s10506-023-09361-y · Cited by 108
Graph Mamba: Towards Learning on Graphs with State Space Models
Behrouz, A., & Hashemi, F. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3672044 · Cited by 141
Bird, J. J., Ekárt, A., & Faria, D. R. (2021) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-021-03439-8 · Cited by 98
IndicBART: A Pre-trained Model for Indic Natural Language Generation
Dabre, R., Shrotriya, H., Kunchukuttan, A., Puduppully, R., Khapra, M. M., & Kumar, P. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.145 · Cited by 123
Fake news detection: Taxonomy and comparative study
Farhangian, F., Cruz, R. M. O., & Cavalcanti, G. D. C. (2023) · Information Fusion · doi:10.1016/j.inffus.2023.102140 · Cited by 91
Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Grounding
Dziri, N., Madotto, A., Zaïane, O., & Bose, A. J. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.168 · Cited by 81
Subpopulation Data Poisoning Attacks
Jagielski, M., Severi, G., Pousette Harger, N., & Oprea, A. (2021) · Proceedings of the 2021 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3460120.3485368 · Cited by 86
Evaluating Very Long-Term Conversational Memory of LLM Agents
Maharana, A., Lee, D.-H., Tulyakov, S., Bansal, M., Barbieri, F., & Fang, Y. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.747 · Cited by 96
Evaluating the carbon footprint of NLP methods: a survey and analysis of existing tools
Bannour, N., Ghannay, S., Névéol, A., & Ligozat, A.-L. (2021) · Proceedings of the Second Workshop on Simple and Efficient Natural Language Processing · doi:10.18653/v1/2021.sustainlp-1.2 · Cited by 98
Recommending metamodel concepts during modeling activities with pre-trained language models
Weyssow, M., Sahraoui, H. A., & Syriani, E. (2022) · Software & Systems Modeling · doi:10.1007/s10270-022-00975-5 · Cited by 86
Haynes, K., Shirazi, H. M., & Ray, I. (2021) · Procedia Computer Science · doi:10.1016/j.procs.2021.07.040 · Cited by 90
Deep learning for detecting building façade elements from images considering prior knowledge
Zhang, G., Pan, Y., & Zhang, L. (2021) · Automation in Construction · doi:10.1016/j.autcon.2021.104016 · Cited by 82
Lanz, L., Briker, R., & Gerpott, F. H. (2023) · Journal of Business Ethics · doi:10.1007/s10551-023-05393-1 · Cited by 70
Prompt Learning for News Recommendation
Zhang, Z., & Wang, B. (2023) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/3539618.3591752 · Cited by 100
Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluation
Mosbach, M., Pimentel, T., Ravfogel, S., Klakow, D., & Elazar, Y. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.779 · Cited by 171
RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL
Qi, J., Tang, J., He, Z., Wan, X., Cheng, Y., Zhou, C., Wang, X., Zhang, Q., & Lin, Z. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.211 · Cited by 139
Investigating ChatGPT and cybersecurity: A perspective on topic modeling and sentiment analysis
Okey, O. D., Udo, E. U., Rosa, R. L., Rodríguez, D. Z., & Kleinschmidt, J. H. (2023) · Computers & Security · doi:10.1016/j.cose.2023.103476 · Cited by 102
Zheng, Z., Yang, X., Zhao, P., Long, G., Zhu, K., Zhu, F., Zhao, W., Liu, X., Yang, J., Zhai, J., et al. (2022) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3503222.3507723 · Cited by 88
Divide-and-Conquer: Post-User Interaction Network for Fake News Detection on Social Media
Min, E., Rong, Y., Bian, Y., Xu, T., Zhao, P., Huang, J., & Ananiadou, S. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512163 · Cited by 80
Fake news detection via knowledgeable prompt learning
Jiang, G., Liu, S., Zhao, Y., Sun, Y., & Zhang, M. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103029 · Cited by 84
Antypas, D., Preece, A. D., & Camacho-Collados, J. (2023) · Online Social Networks and Media · doi:10.1016/j.osnem.2023.100242 · Cited by 93
Clavié, B., Ciceu, A., Naylor, F., Soulié, G., & Brightwell, T. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35320-8_1 · Cited by 102
PyThaiNLP: Thai Natural Language Processing in Python
Phatthiyaphaibun, W., Chaovavanich, K., Polpanumas, C., Suriyawongkul, A., Lowphansirikul, L., Chormai, P., Limkonchotiwat, P., Suntorntip, T., & Udomcharoenchaikit, C. (2023) · Workshop for NLP Open Source Software (NLP-OSS) · doi:10.18653/v1/2023.nlposs-1.4 · Cited by 102
SOLID: A Large-Scale Semi-Supervised Dataset for Offensive Language Identification
Rosenthal, S., Atanasova, P., Karadzhov, G., Zampieri, M., & Nakov, P. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.80 · Cited by 128
Not All Negatives are Equal: Label-Aware Contrastive Loss for Fine-grained Text Classification
Suresh, V., & Ong, D. C. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.359 · Cited by 82
Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER
Lee, D., Kadakia, A., Tan, K., Agarwal, M., Feng, X., Shibuya, T., Mitani, R., Sekiya, T., Pujara, J., & Ren, X. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.192 · Cited by 84
Distilling Reasoning Capabilities into Smaller Language Models
Shridhar, K., Stolfo, A., & Sachan, M. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.441 · Cited by 79
Zhang, G., Jin, Q., Zhou, Y., Wang, S., Idnay, B., Luo, Y., Park, E., Nestor, J. G., Spotnitz, M. E., Soroush, A., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01239-w · Cited by 105
An Empirical Study of Pre-Trained Model Reuse in the Hugging Face Deep Learning Model Registry
Jiang, W., Synovic, N., Hyatt, M., Schorlemmer, T. R., Sethi, R., Lu, Y.-H., Thiruvathukal, G. K., & Davis, J. C. (2023) · 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) · doi:10.1109/icse48619.2023.00206 · Cited by 76
Can BERT Dig It? Named Entity Recognition for Information Retrieval in the Archaeology Domain
Brandsen, A., Verberne, S., Lambers, K., & Wansleeben, M. (2022) · Journal on Computing and Cultural Heritage · doi:10.1145/3497842 · Cited by 89
Arabic Offensive and Hate Speech Detection Using a Cross-Corpora Multi-Task Learning Model
Aldjanabi, W., Dahou, A., Al‐qaness, M. A. A., Elaziz, M. A., Helmi, A. M., & Damaševičius, R. (2021) · Informatics · doi:10.3390/informatics8040069 · Cited by 82
Adapting GPT, GPT-2 and BERT Language Models for Speech Recognition
Zheng, X., Zhang, C., & Woodland, P. C. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9688232 · Cited by 89
“Low-Resource” Text Classification: A Parameter-Free Classification Method with Compressors
Jiang, Z., Yang, M., Tsirlin, M., Tang, R., Dai, Y., & Lin, J. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.426 · Cited by 100
Shao, M., Li, D., Hong, S., Qi, J., & Sun, H. (2024) · IEEE Transactions on Cognitive Communications and Networking · doi:10.1109/tccn.2024.3485118 · Cited by 78
A fine-grained comparison of pragmatic language understanding in humans and language models
Hu, J., Floyd, S., Jouravlev, O., Fedorenko, E., & Gibson, E. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.230 · Cited by 78
AraCOVID19-MFH: Arabic COVID-19 Multi-label Fake News & Hate Speech Detection Dataset
Ameur, M. S. H., & Aliane, H. (2021) · Procedia Computer Science · doi:10.1016/j.procs.2021.05.086 · Cited by 94
Exploring Task Difficulty for Few-Shot Relation Extraction
Han, J., Cheng, B. H., & Lu, W. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.204 · Cited by 84
Intermediate-Task Transfer Learning with BERT for Sarcasm Detection
Savini, E., & Caragea, C. (2022) · Mathematics · doi:10.3390/math10050844 · Cited by 88
Unsupervised Contrastive Hashing for Cross-Modal Retrieval in Remote Sensing
Mikriukov, G., Ravanbakhsh, M., & Demir, B. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9746251 · Cited by 78
Götz, F. M., Maertens, R., Loomba, S., & van der Linden, S. (2023) · Psychological Methods · doi:10.1037/met0000540 · Cited by 104
Xu, D., Xu, X., Forde, M. C., & Caballero, A. (2023) · Construction and Building Materials · doi:10.1016/j.conbuildmat.2023.132596 · Cited by 88
Mechanism for feature learning in neural networks and backpropagation-free machine learning models
Radhakrishnan, A., Beaglehole, D., Pandit, P., & Belkin, M. (2024) · Science · doi:10.1126/science.adi5639 · Cited by 100
Preference Ranking Optimization for Human Alignment
Song, F., Yu, B., Li, M., Yu, H., Huang, F., Li, Y., & Wang, H. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i17.29865 · Cited by 77
Preference Ranking Optimization for Human Alignment
Song, F., Yu, B., Li, M., Yu, H., Huang, F., Li, Y., & Wang, H. (2023) · arXiv · doi:10.48550/arxiv.2306.17492 · Cited by 77
ASQA: Factoid Questions Meet Long-Form Answers
Stelmakh, I., Luan, Y., Dhingra, B., & Chang, M.-W. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.566 · Cited by 176
“I’m sorry to hear that”: Finding new biases in language models with a holistic descriptor dataset
Smith, E. M., Hall, M., Kambadur, M., Presani, E., & Williams, A. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.625 · Cited by 97
Increasing Text Filtering Accuracy with Improved LSTM
Dang, W., Cai, L., Liu, M., Li, X., Yin, Z., Liu, X., Yin, L., & Zheng, W. (2023) · Computing and Informatics · doi:10.31577/cai_2023_6_1491 · Cited by 77
Apostol, E., Truică, C., & Paschke, A. (2024) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2024.3417232 · Cited by 83
Language Model Crossover: Variation through Few-Shot Prompting
Meyerson, E., Nelson, M. J., Bradley, H., Gaier, A., Moradi, A., Hoover, A. K., & Lehman, J. (2024) · ACM Transactions on Evolutionary Learning and Optimization · doi:10.1145/3694791 · Cited by 75
Transformers enable accurate prediction of acute and chronic chemical toxicity in aquatic organisms
Gustavsson, M., Käll, S., Svedberg, P., Inda-Diaz, J. S., Molander, S., Coria, J., Backhaus, T., & Kristiansson, E. (2024) · Science Advances · doi:10.1126/sciadv.adk6669 · Cited by 82
Using deep learning to value free-form text data for predictive maintenance
Cadavid, J. P. U., Lamouri, S., Grabot, B., & Fortin, A. (2021) · International Journal of Production Research · doi:10.1080/00207543.2021.1951868 · Cited by 78
Evaluating the Robustness of Neural Language Models to Input Perturbations
Moradi, M., & Samwald, M. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.117 · Cited by 118
Han, R., Ketkaew, R., & Luber, S. (2022) · The Journal of Physical Chemistry A · doi:10.1021/acs.jpca.1c10417 · Cited by 78
Transformer-Based Molecular Generative Model for Antiviral Drug Design
Mao, J., Wang, J., Zeb, A., Cho, K., Jin, H., Kim, J., Lee, O., Wang, Y., & No, K. T. (2023) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.3c00536 · Cited by 81
Chung, S., Moon, S., Kim, J.-H., Kim, J., Lim, S. P., & Chi, S. (2023) · Automation in Construction · doi:10.1016/j.autcon.2023.105020 · Cited by 87
Iteratively Prompt Pre-trained Language Models for Chain of Thought
Wang, B., Deng, X. B., & Sun, H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.174 · Cited by 123
Contrastive Grouping with Transformer for Referring Image Segmentation
Tang, J., Ge, Z., Cheng, S., & Yang, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02257 · Cited by 84
Abstractive vs. Extractive Summarization: An Experimental Review
Giarelis, N., Mastrokostas, C., & Karacapilidis, N. I. (2023) · Applied Sciences · doi:10.3390/app13137620 · Cited by 96
Increasing Faithfulness in Knowledge-Grounded Dialogue with Controllable Features
Rashkin, H., Reitter, D., Tomar, G. S., & Das, D. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.58 · Cited by 74
A Transformer Architecture for Stress Detection from ECG
Behinaein, B., Bhatti, A., Rodenburg, D., Hungler, P., & Etemad, A. (2021) · International Symposium on Wearable Computers · doi:10.1145/3460421.3480427 · Cited by 79
DB-BERT: A Database Tuning Tool that "Reads the Manual"
Trummer, I. (2022) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3514221.3517843 · Cited by 90
Liu, Y., Wang, S., Chen, J., Chen, B., Wang, X., Hao, D., & Sun, L. (2022) · Remote Sensing · doi:10.3390/rs14195045 · Cited by 80
Evaluating the Effectiveness of Time Series Transformers for Demand Forecasting in Retail
Oliveira, J. M., & Ramos, P. (2024) · Mathematics · doi:10.3390/math12172728 · Cited by 99
MLAAD: The Multi-Language Audio Anti-Spoofing Dataset
Müller, N. M., Kawa, P., Choong, W. H., Casanova, E., Gölge, E., Müller, T., Syga, P., Sperl, P., & Böttinger, K. (2024) · 2024 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn60899.2024.10650962 · Cited by 73
Contrastive Out-of-Distribution Detection for Pretrained Transformers
Zhou, W., Liu, F., & Chen, M. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.84 · Cited by 99
BioM-Transformers: Building Large Biomedical Language Models with BERT, ALBERT and ELECTRA
Alrowili, S., & Shanker, V. K. (2021) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2021.bionlp-1.24 · Cited by 80
A comparative evaluation and analysis of three generations of Distributional Semantic Models
Lenci, A., Sahlgren, M., Jeuniaux, P. P. J. M. H., Gyllensten, A. C., & Miliani, M. (2022) · Language Resources and Evaluation · doi:10.1007/s10579-021-09575-z · Cited by 97
SEntFiN 1.0: Entity‐aware sentiment analysis for financial news
Sinha, A., Kedas, S., Kumar, R., & Malo, P. (2022) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24634 · Cited by 86
MvP: Multi-view Prompting Improves Aspect Sentiment Tuple Prediction
Gou, Z., Guo, Q., & Yang, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.240 · Cited by 83
ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts
Asai, A., Salehi, M., Peters, M. E., & Hajishirzi, H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.446 · Cited by 103
Zhong, Y., Xu, M., Liang, K., Chen, K., & Wu, M. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43901-8_69 · Cited by 73
Anderson, A. J., Kiela, D., Binder, J. R., Fernandino, L., Humphries, C. J., Conant, L. L., Raizada, R. D. S., Grimm, S., & Lalor, E. C. (2021) · The Journal of Neuroscience · doi:10.1523/jneurosci.1152-20.2021 · Cited by 70
Chung, J., Kamar, E., & Amershi, S. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.34 · Cited by 72
Relevance-guided Supervision for OpenQA with ColBERT
Khattab, O., Potts, C., & Zaharia, M. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00405 · Cited by 81
Probing Toxic Content in Large Pre-Trained Language Models
Ousidhoum, N. D., Zhao, X., Fang, T., Song, Y., & Yeung, D. (2021) · doi:10.18653/v1/2021.acl-long.329 · Cited by 89
Michaelov, J. A., Seana Coulson, A., & Bergen, B. K. (2022) · IEEE Transactions on Cognitive and Developmental Systems · doi:10.1109/tcds.2022.3176783 · Cited by 77
Hunting Conspiracy Theories During the COVID-19 Pandemic
Moffitt, J. D., King, C., & Carley, K. M. (2021) · Social Media + Society · doi:10.1177/20563051211043212 · Cited by 77
GPT2SP: A Transformer-Based Agile Story Point Estimation Approach
Fu, M. C., & Tantithamthavorn, C. K. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3158252 · Cited by 77
An effective multimodal representation and fusion method for multimodal intent recognition
Huang, X., Ma, T., Jia, L., Zhang, Y., Rong, H., & Al-Nabhan, N. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126373 · Cited by 72
Metadata
- Authors
- Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., Davison, J., Shleifer, S., von Platen, P., Ma, C., Jernite, Y., Plu, J., Xu, C., Le Scao, T., Gugger, S., Drame, M., Lhoest, Q., & Rush, A.
- Affiliations
- Hugging Face (US)
- ORCID
- Venue
- Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
- Published
- 2020
- Pages
- 38-45
- OpenAlex
- W2979826702
- Cited by
- 8,741
- References
- 39
- Citations by year
- 2026: 851 · 2025: 1481 · 2024: 1405 · 2023: 2347 · 2022: 1686 · 2021: 872 · 2020: 94
- FWCI
- 477.50
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- transformer models, natural language processing, Hugging Face
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
