The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Transformers: State-of-the-Art Natural Language Processing
Open accessAbstract
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, Alexander Rush. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. 2020.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Almost all CLaMs have been made publicly accessible via online model repositories like HuggingFace57.”
From The shaky foundations of large language models and foundation models for electronic health records (2023) · cites this paper as [57]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Employing BERT, GPT-2, RoBERTa, and DistilBERT, we achieved robust results; BERT for deep contextual insights, GPT-2 for coherent text generation, RoBERTa for performance with large data, and DistilBERT for fast, cost-effective efficiency [39].”
From Generative AI-Powered Educational Alignment: A Framework for Matching Syllabus Course Topics with Web Description (2024) · cites this paper as [39]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Open-source ecosystems such as Hugging Face and BLOOM reduce technical barriers but can reproduce extractive defaults without Indigenous authority over datasets, objectives, and deployment pathways (BigScience Workshop, 2022;Wolf et al., 2020).”
From Towards a decolonial AI sovereignty model for indigenous educational settings (2026) · cites this paper as Wolf et al., 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Before the emergence of ChatGPT, BERT is a commonly used pre-trained machine learning model for NLP tasks (Wolf et al., 2020), and a ubiquitous baseline in text classification experiments of research in recent years (Rogers et al., 2021).”
From Towards reliable generative AI-driven scaffolding: Reducing hallucinations and enhancing quality in self-regulated learning support (2026) · cites this paper as Wolf et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“Tamarin is implemented in roughly 9K lines of Python on top of HuggingFace Transformers (Wolf et al., 2020); it uses no custom CUDA and does not modify model weights.”
From Tamarin (HSQ): Reversible Hierarchical KV-Cache Compression for LLM Inference (2026) · cites this paper as Wolf et al., 2020
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“3 speedup on GPT-2 (seq. length 1K)”
From FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness (2022) · cites this paper as [87]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Table 2 shows up to 3 endto-end speedup compared to Huggingface and 1.7 speedup compared to Megatron-LM.”
From FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness (2022) · cites this paper as [87]
Experimental — accuracy not yet measuredIn the citing paper
“While these early explorations are promising, they do not explore how much or what kind of interactivity is beneficial.”
From Interactive Model Cards: A Human-Centered Approach to Model Documentation (2022) · cites this paper as [73]
In the citing paper
“along with high-quality open-source libraries [113] have lowered the barrier to entry and make it possible to build conversational models that exhibit high generalization and coherence [90].”
From Future directions for chatbot research: An interdisciplinary research agenda (2021) · cites this paper as [113]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 2×
“The Transformer (Vaswani et al., 2017) has rapidly become the dominant architecture for natural language processing, surpassing alternative neural models such as convolutional and recurrent neural networks in performance for tasks in both natural language understanding and natural language…”
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173 · cited 4×
“, 2018) and the original source code for BERT (Devlin et al., 2018), both from Google Research.”
InfluentialRoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · cited 3×
“…text corpora, leading to major gains in accuracy on downstream tasks including text classification (Yang et al., 2019), language understanding (Liu et al., 2019b; Wang et al., 2018, 2019), machine translation (Lample and Conneau, 2019a), coreference resolution (Joshi et al., 2019),…”
InfluentialDeep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983 · cited 1×
“Model pretraining (McCann et al., 2017; Howard and Ruder, 2018; Peters et al., 2018; Devlin et al., 2018) allows models to be trained on generic corpora and subsequently be easily adapted to specific tasks with strong performance.”
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · cited 2×
“, 2019) T5 (Raffel et al., 2019) MarianMT (J.”
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
The Stanford CoreNLP Natural Language Processing Toolkit
Manning, C. D., Surdeanu, M., Bauer, J., Finkel, J. R., Bethard, S. J., & McClosky, D. (2014) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.3115/v1/p14-5010 · Cited by 7,252 · cited 1×
“Two core libraries are NLTK (Loper and Bird, 2002) and Stanford CoreNLP (Manning et al., 2014), which collect a variety of different approaches to NLP in a single package.”
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687 · cited 3×
“The Transformer architecture is particularly conducive to pretraining on large text corpora, leading to major gains in accuracy on downstream tasks including text classification (Yang et al., 2019), language understanding (Liu et al.”
InfluentialDistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019) · arXiv · doi:10.48550/arxiv.1910.01108 · Cited by 4,653 · cited 2×
“While core models like BERT and GPT-2 continue to be popular, other specialized models including DistilBERT (Sanh et al., 2019), which was developed for the library, are now widely downloaded by the community.”
Self-citation
Research works printed but not linked: 2
- Alan Akbik, Tanja Bergmann, Duncan Blythe, Kashif Rasul, Stefan Schweter, and Roland Vollgraf. 2019. Flair: An easy-to-use framework for state-of-the-art nlp. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Com- putational Linguistics (Demonstrations), pages 54- 59. aclweb.org.
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog, 1(8):9.
Cited by
Sorted by citations
Items 701–800 of 1,115
Multitask Learning for Crash Analysis: A Fine-Tuned LLM Framework Using Twitter Data
Jaradat, S., Nayak, R., Paz, A., Ashqar, H. I., & Elhenawy, M. M. Z. (2024) · Smart Cities · doi:10.3390/smartcities7050095 · Cited by 51
Ahmed, N., Saha, A. K., Noman, M. A. A., Jim, J. R., Mridha, M. F., & Kabir, M. M. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100112 · Cited by 65
Large Language Models as Evaluators in Education: Verification of Feedback Consistency and Accuracy
Seo, H., Hwang, T., Jung, J., Kang, H., Namgoong, H., Lee, Y. H., & Jung, S. (2025) · Applied Sciences · doi:10.3390/app15020671 · Cited by 61
Mapping ESG Trends by Distant Supervision of Neural Language Models
Raman, N., Bang, G., & Nourbakhsh, A. (2020) · Machine Learning and Knowledge Extraction · doi:10.3390/make2040025 · Cited by 50
Jacobs, G., Hee, C. V., & Hoste, V. (2020) · Natural Language Engineering · doi:10.1017/s135132492000056x · Cited by 47
Automatic Pronunciation Assessment using Self-Supervised Speech Representation Learning
Kim, E., Jeon, J.-J., Seo, H., & Kim, H. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-10245 · Cited by 48
Hadi, M. U., Al-Tashi, Q., Qureshi, R., Shah, A., Muneer, A., Irfan, M., Zafar, A., Shaikh, M. B., Akhtar, N., Hassan, S. Z., et al. (2023) · doi:10.36227/techrxiv.23589741.v2 · Cited by 54
Geffen, Y., Ofran, Y., & Unger, R. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btac474 · Cited by 40
Guo, Y., Li, C., Roan, C., Pakhomov, S., & Cohen, T. (2021) · Frontiers in Computer Science · doi:10.3389/fcomp.2021.642517 · Cited by 44
fBERT: A Neural Transformer for Identifying Offensive Content
Sarkar, D., Zampieri, M., Ranasinghe, T., & Ororbia, A. G. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.154 · Cited by 46
TA-SBERT: Token Attention Sentence-BERT for Improving Sentence Representation
Seo, J., Lee, S., Liu, L., & Choi, W. (2022) · IEEE Access · doi:10.1109/access.2022.3164769 · Cited by 52
FNR: a similarity and transformer-based approach to detect multi-modal fake news in social media
Ghorbanpour, F., Ramezani, M., Fazli, M. A., & Rabiee, H. R. (2023) · Social Network Analysis and Mining · doi:10.1007/s13278-023-01065-0 · Cited by 50
Automated Question and Answer Generation from Texts using Text-to-Text Transformers
Goyal, R., Kumar, P., & Singh, V. P. (2023) · Arabian Journal for Science and Engineering · doi:10.1007/s13369-023-07840-7 · Cited by 46
DECOR: Degree-Corrected Social Graph Refinement for Fake News Detection
Wu, J., & Hooi, B. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599298 · Cited by 48
Wang, X., Chen, Y., Ding, N., Peng, H. M., Wang, Z., Lin, Y., Han, X., Hou, L., Li, J., Liu, Z., et al. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.60 · Cited by 43
Transformer-Based Under-Sampled Single-Pixel Imaging
Tian, Y., Fu, Y., & Zhang, J. (2023) · Chinese Journal of Electronics · doi:10.23919/cje.2022.00.284 · Cited by 43
Zhang, X., Rajabi, N., Duh, K., & Koehn, P. (2023) · Conference on Machine Translation (WMT) · doi:10.18653/v1/2023.wmt-1.43 · Cited by 56
Smadi, B. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.107921 · Cited by 50
Le, D.-V.-T., Bigo, L., Herremans, D., & Mikaela Keller, A. (2025) · ACM Computing Surveys · doi:10.1145/3714457 · Cited by 65
Multimodal Emotion Recognition Using Feature Fusion: An LLM-Based Approach
Chandraumakantham, O., Gowtham, N., Zakariah, M., & Almazyad, A. S. (2024) · IEEE Access · doi:10.1109/access.2024.3425953 · Cited by 43
Transformer-based improved U-net for high-performance underwater polarization imaging
Lin, B., Chen, W., Fan, X., Peng, P., & Guo, Z. (2024) · Optics & Laser Technology · doi:10.1016/j.optlastec.2024.111664 · Cited by 46
Comparing SMILES and SELFIES tokenization for enhanced chemical language modeling
Leon, M., Perezhohin, Y., Peres, F., Popovič, A., & Castelli, M. (2024) · Scientific Reports · doi:10.1038/s41598-024-76440-8 · Cited by 47
CPLLM: Clinical prediction with large language models
Shoham, O. B., & Rappoport, N. (2024) · PLOS Digital Health · doi:10.1371/journal.pdig.0000680 · Cited by 76
Lakatos, R., Pollner, P., Hajdú, A., & Joó, T. (2025) · Machine Learning and Knowledge Extraction · doi:10.3390/make7010015 · Cited by 69
Beat the AI: Investigating Adversarial Human Annotation for Reading Comprehension
Bartolo, M., Roberts, A., Welbl, J., Riedel, S., & Stenetorp, P. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00338 · Cited by 130
Cruz-Benito, J., Vishwakarma, S., Martín-Fernández, F., & Faro, I. (2021) · AI · doi:10.3390/ai2010001 · Cited by 50
Embed2Detect : temporally clustered embedded words for event detection in social media
Hettiarachchi, H., Adedoyin-Olowe, M., Bhogal, J., & Gaber, M. M. (2022) · Lancaster EPrints (Lancaster University) · Cited by 43
Nascimento, F. R. S., Cavalcanti, G. D. C., & Costa‐Abreu, M. D. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.117032 · Cited by 49
Multimodal Parameter-Efficient Few-Shot Class Incremental Learning
D’Alessandro, M., Alonso, A., Calabrés, E., & Galar, M. (2023) · 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW) · doi:10.1109/iccvw60793.2023.00364 · Cited by 40
Efficient long-text understanding with short-text models
Ivgi, M., Shaham, U., & Berant, J. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00547 · Cited by 42
Natural language understanding for argumentative dialogue systems in the opinion building domain
Abro, W. A., Aicher, A. B., Rach, N., Ultes, S., Minker, W., & Qi, G. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.108318 · Cited by 50
Factual Consistency Evaluation for Text Summarization via Counterfactual Estimation
Xie, Y., Sun, F., Deng, Y., Li, Y., & Ding, B. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.10 · Cited by 49
Generative Steganography Based on Long Readable Text Generation
Cao, Y., Zhou, Z., Chakraborty, C., Wang, M., Wu, Q. M. J., Sun, X., & Yu, K. (2022) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2022.3174013 · Cited by 42
Steed, R., Panda, S., Kobren, A., & Wick, M. J. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.247 · Cited by 55
On Decoding Strategies for Neural Text Generators
Wiher, G., Meister, C., & Cotterell, R. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00502 · Cited by 67
Effective entity matching with transformers
Li, Y., Li, J., Suhara, Y., Doan, A., & Tan, W.-C. (2023) · The VLDB Journal · doi:10.1007/s00778-023-00779-z · Cited by 53
Self-attention in vision transformers performs perceptual grouping, not attention
Mehrani, P., & Tsotsos, J. K. (2023) · Frontiers in Computer Science · doi:10.3389/fcomp.2023.1178450 · Cited by 52
Detecting bots in social-networks using node and structural embeddings
Dehghan, A., Siuta, K., Skorupka, A., Dubey, A., Betlen, A., Miller, D., Xu, W., Kamiński, B., & Prałat, P. (2023) · Journal Of Big Data · doi:10.1186/s40537-023-00796-3 · Cited by 53
A Semantic Perception and CNN-Transformer Hybrid Network for Occluded Person Re-Identification
Gao, Z., Chen, P., Zhuo, T., Liu, M., Zhu, L., Wang, M., & Chen, S. (2023) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2023.3296680 · Cited by 44
Graph Reasoning for Question Answering with Triplet Retrieval
Li, S., Gao, Y., Jiang, H., Yin, Q., Li, Z., Yan, X., Zhang, C., & Yin, B. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.208 · Cited by 42
Jahan, I., Laskar, M. T. R., Peng, C., & Huang, J. X. (2023) · Workshop on Biomedical Language Processing (BioNLP) · doi:10.18653/v1/2023.bionlp-1.30 · Cited by 58
Alamsyah, A., & Girawan, N. D. (2023) · Big Data and Cognitive Computing · doi:10.3390/bdcc7040168 · Cited by 50
Liu, S., Mu, C., Jiang, H., Wang, Y., Zhang, J., Lin, F., Zhou, K., Liu, Q., & Chen, C. (2023) · IEEE Transactions on Very Large Scale Integration (VLSI) Systems · doi:10.1109/tvlsi.2023.3337777 · Cited by 46
DCT-net: Dual-domain cross-fusion transformer network for MRI reconstruction
Wang, B., Lian, Y., Xiong, X., Zhou, H., Liu, Z., & Zhou, X. (2024) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2024.01.007 · Cited by 42
Allo: A Programming Model for Composable Accelerator Design
Chen, H., Zhang, N., Xiang, S., Zeng, Z., Dai, M., & Zhang, Z. (2024) · Proceedings of the ACM on Programming Languages · doi:10.1145/3656401 · Cited by 58
Polak, M. P., Modi, S., Latosinska, A., Zhang, J., Wang, C.-W., Wang, S., Hazra, A. D., & Morgan, D. D. (2024) · Digital Discovery · doi:10.1039/d4dd00016a · Cited by 60
Heilmeyer, F., Böhringer, D., Reinhard, T., Arens, S., Lyssenko, L., & Haverkamp, C. (2024) · JMIR Medical Informatics · doi:10.2196/59617 · Cited by 42
Detecting severity of Diabetic Retinopathy from fundus images: A transformer network-based review
Karkera, T. M., Adak, C., Chattopadhyay, S., & Saqib, M. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.127991 · Cited by 55
Knowledge distillation for BERT unsupervised domain adaptation
Ryu, M., Lee, G., & Lee, K. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01736-y · Cited by 51
Robust Transfer Learning with Pretrained Language Models through Adapters
Han, W., Pang, B., & Wu, Y. N. (2021) · doi:10.18653/v1/2021.acl-short.108 · Cited by 47
Transformers-sklearn: a toolkit for medical language understanding with transformer-based models
Yang, F., Wang, X., Ma, H., & Li, J. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01459-0 · Cited by 42
Adaptive Testing and Debugging of NLP Models
Ribeiro, M. T., & Lundberg, S. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.230 · Cited by 59
TRILLsson: Distilled Universal Paralinguistic Speech Representations
Shor, J., & Venugopalan, S. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-118 · Cited by 42
Sector-level sentiment analysis with deep learning
Almalis, I., Kouloumpris, E., & Vlahavas, I. P. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109954 · Cited by 44
Learning from Noisy Labels for Entity-Centric Information Extraction
Zhou, W., & Chen, M. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.437 · Cited by 51
Multi-Task Learning and Adapted Knowledge Models for Emotion-Cause Extraction
Turcan, E., Wang, S., Anubhai, R., Bhattacharjee, K., Al-Onaizan, Y., & Muresan, S. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.348 · Cited by 42
Tailor: Generating and Perturbing Text with Semantic Controls
Ross, A., Wu, T., Peng, H. M., Peters, M., & Gardner, M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.228 · Cited by 66
Domain-matched Pre-training Tasks for Dense Retrieval
Oğuz, B., Lakhotia, K., Gupta, A., Lewis, P., Karpukhin, V., Piktus, A., Chen, X., Riedel, S., Yih, S., Gupta, S., et al. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.114 · Cited by 50
Characterization of groundwater contamination: A transformer-based deep learning model
Bai, T., & Tahmasebi, P. (2022) · Advances in Water Resources · doi:10.1016/j.advwatres.2022.104217 · Cited by 44
SsciBERT: a pre-trained language model for social science texts
Shen, S., Liu, J., Lin, L., Huang, Y., Zhang, L., Liu, C., Feng, Y., & Wang, D. (2022) · Scientometrics · doi:10.1007/s11192-022-04602-4 · Cited by 51
Asset Price and Direction Prediction via Deep 2D Transformer and Convolutional Neural Networks
Tuncer, T., Kaya, U., Sefer, E., Alacam, O., & Hoser, T. (2022) · ACM International Conference on AI in Finance (ICAIF) · doi:10.1145/3533271.3561738 · Cited by 46
Evaluating a Large Language Model on Searching for GUI Layouts
Brie, P., Burny, N., Sluÿters, A., & Vanderdonckt, J. M. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3593230 · Cited by 41
Leveraging pre-trained language models for mining microbiome-disease relationships
Karkera, N., Acharya, S., & Palaniappan, S. K. (2023) · BMC Bioinformatics · doi:10.1186/s12859-023-05411-z · Cited by 42
Ground-Truth Labels Matter: A Deeper Look into Input-Label Demonstrations
Yoo, K. M., Kim, J., Kim, H. J., Cho, H., Jo, H., Lee, S., Lee, S., & Kim, T. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.155 · Cited by 91
Advancing Neural Encoding of Portuguese with Transformer Albertina PT-*
Rodrigues, J., Gomes, L., Silva, J., Branco, A., Santos, R., Cardoso, H. L., & Osório, T. F. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-49008-8_35 · Cited by 68
Prot2Text: Multimodal Protein’s Function Generation with GNNs and Transformers
Abdine, H., Chatzianastasis, M., Bouyioukos, C., & Vazirgiannis, M. (2024) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v38i10.28948 · Cited by 58
Revisiting Sentiment Analysis for Software Engineering in the Era of Large Language Models
Zhang, T., Irsan, I. C., Thung, F., & Lo, D. (2024) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3697009 · Cited by 63
Rabbah, J., Ridouani, M., & Hassouni, L. (2025) · Biomedical Signal Processing and Control · doi:10.1016/j.bspc.2024.107239 · Cited by 46
Zero-Shot Learning for Cross-Lingual News Sentiment Classification
Pelicon, A., Pranjić, M., Miljković, D., Škrlj, B., & Pollak, S. (2020) · Applied Sciences · doi:10.3390/app10175993 · Cited by 44
Thank you BART! Rewarding Pre-Trained Models Improves Formality Style Transfer
Lai, H., Toral, A., & Nissim, M. (2021) · doi:10.18653/v1/2021.acl-short.62 · Cited by 44
A GPT-2 Language Model for Biomedical Texts in Portuguese
Schneider, E. T. R., de Souza, J. V. P., Gumiel, Y., Moro, C., & Paraiso, E. (2021) · 2021 IEEE 34th International Symposium on Computer-Based Medical Systems (CBMS) · doi:10.1109/cbms52027.2021.00056 · Cited by 36
Let’s Play Mono - Poly : BERT Can Reveal Words’ Polysemy Level and Partitionability into Senses
Soler, A. G., & Apidianaki, M. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00400 · Cited by 63
Differentiable Subset Pruning of Transformer Heads
Li, J., Cotterell, R., & Sachan, M. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00436 · Cited by 50
Hu, W., & Wang, S. Y. (2022) · Translational Vision Science & Technology · doi:10.1167/tvst.11.3.37 · Cited by 45
Rethinking Open-World Object Detection in Autonomous Driving Scenarios
Ma, Z., Yang, Y., Wang, G., Xu, X., Shen, H. T., & Zhang, M. (2022) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3503161.3548165 · Cited by 43
Xing, B., & Tsang, I. W.-H. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.12 · Cited by 41
TP-DDI: Transformer-based pipeline for the extraction of Drug-Drug Interactions
Zaikis, D., & Vlahavas, I. P. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102153 · Cited by 39
Dealing with Typos for BERT-based Passage Retrieval and Ranking
Zhuang, S., & Zuccon, G. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.225 · Cited by 49
Jacobs, G., & Hoste, V. (2021) · Language Resources and Evaluation · doi:10.1007/s10579-021-09562-4 · Cited by 45
Zhang, Y., Hu, D., Yan, Z., Zhao, Q., Quan, G., Luo, S., Zhang, Y., & Chen, Y. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102650 · Cited by 40
Trummer, I. (2022) · Proceedings of the VLDB Endowment · doi:10.14778/3554821.3554896 · Cited by 54
Quantifying chatbots’ ability to learn business processes
Kecht, C., Egger, A., Kratsch, W., & Röglinger, M. (2023) · Information Systems · doi:10.1016/j.is.2023.102176 · Cited by 48
BERT-based GitHub issue report classification
Siddiq, M. L., & Santos, J. C. S. (2022) · IEEE/ACM International Workshop on Natural Language-Based Software Engineering (NLBSE) · doi:10.1145/3528588.3528660 · Cited by 45
Antikainen, E., Linnosmaa, J., Umer, A., Oksala, N., Eskola, M. J., van Gils, M., Hernesniemi, J. A., & Gabbouj, M. (2023) · Scientific Reports · doi:10.1038/s41598-023-30657-1 · Cited by 49
A Unified Framework for Learned Sparse Retrieval
Nguyen, T. D.-M., MacAvaney, S., & Yates, A. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-28241-6_7 · Cited by 51
Accurate, interpretable predictions of materials properties within transformer language models
Korolev, V., & Protsenko, P. V. (2023) · Patterns · doi:10.1016/j.patter.2023.100803 · Cited by 44
mGPT: Few-Shot Learners Go Multilingual
Shliazhko, O., Fenogenova, A., Tikhonova, M., Kozlova, A., Mikhailov, V., & Shavrina, T. (2024) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00633 · Cited by 183
Diverging neural dynamics for syntactic structure building in naturalistic speaking and listening
Giglio, L., Ostarek, M., Sharoh, D., & Peter Hagoort, A. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2310766121 · Cited by 40
Liu, J., Wu, L., Xie, A., Liu, W. L., Zhao, H., Wan, Y., & Mao, W. (2025) · Journal of Nanobiotechnology · doi:10.1186/s12951-025-03169-5 · Cited by 42
Chen, Y.-P., Lo, Y., Lai, F., & Huang, C. (2021) · Journal of Medical Internet Research · doi:10.2196/25113 · Cited by 40
Conversations Gone Alright: Quantifying and Predicting Prosocial Outcomes in Online Conversations
Bao, J., Wu, J., Zhang, Y., Chandrasekharan, E., & Jurgens, D. (2021) · International World Wide Web Conference (WWW) · doi:10.1145/3442381.3450122 · Cited by 44
Olthof, A. W., van Ooijen, P. M. A., & Cornelissen, L. J. (2021) · Journal of Medical Systems · doi:10.1007/s10916-021-01761-4 · Cited by 40
Dynamic Knowledge Distillation for Pre-trained Language Models
Li, L., Lin, Y., Ren, S., Li, P., Zhou, J., & Sun, X. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.31 · Cited by 42
Temporal Effects on Pre-trained Models for Language Processing Tasks
Agarwal, O., & Nenkova, A. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00497 · Cited by 46
Zuluaga-Gómez, J., Prasad, A., Nigmatulina, I., Sarfjoo, S. S., Motlíček, P., Kleinert, M., Helmke, H., Ohneiser, O., & Zhan, Q. (2023) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt54892.2023.10022724 · Cited by 45
Hasan, M., Islam, L., Jahan, I., Meem, S. M., & Rahman, R. M. (2023) · Vietnam Journal of Computer Science · doi:10.1142/s2196888823500021 · Cited by 47
Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable Survey
Kumar, S., Balachandran, V., Njoo, L., Anastasopoulos, A., & Tsvetkov, Y. (2023) · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.241 · Cited by 38
Zhan, J., Mao, J., Liu, Y., Guo, J., Zhang, M., & Ma, S. (2022) · Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining · doi:10.1145/3488560.3498443 · Cited by 72
Wang, Z., Zeng, J., Meng, W., Lohman, D. J., & Pierce, N. E. (2021) · Insect Conservation and Diversity · doi:10.1111/icad.12499 · Cited by 40
Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation
Li, Y., Peng, B., Shen, Y., Mao, Y., Lidén, L., Yu, Z., & Gao, J. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.15 · Cited by 46
Metadata
- Authors
- Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., Davison, J., Shleifer, S., von Platen, P., Ma, C., Jernite, Y., Plu, J., Xu, C., Le Scao, T., Gugger, S., Drame, M., Lhoest, Q., & Rush, A.
- Affiliations
- Hugging Face (US)
- ORCID
- Venue
- Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
- Published
- 2020
- Pages
- 38-45
- OpenAlex
- W2979826702
- Cited by
- 8,741
- References
- 39
- Citations by year
- 2026: 851 · 2025: 1481 · 2024: 1405 · 2023: 2347 · 2022: 1686 · 2021: 872 · 2020: 94
- FWCI
- 477.50
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- transformer models, natural language processing, Hugging Face
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
