The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Transformers: State-of-the-Art Natural Language Processing
Open accessAbstract
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, Alexander Rush. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. 2020.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Almost all CLaMs have been made publicly accessible via online model repositories like HuggingFace57.”
From The shaky foundations of large language models and foundation models for electronic health records (2023) · cites this paper as [57]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Employing BERT, GPT-2, RoBERTa, and DistilBERT, we achieved robust results; BERT for deep contextual insights, GPT-2 for coherent text generation, RoBERTa for performance with large data, and DistilBERT for fast, cost-effective efficiency [39].”
From Generative AI-Powered Educational Alignment: A Framework for Matching Syllabus Course Topics with Web Description (2024) · cites this paper as [39]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Open-source ecosystems such as Hugging Face and BLOOM reduce technical barriers but can reproduce extractive defaults without Indigenous authority over datasets, objectives, and deployment pathways (BigScience Workshop, 2022;Wolf et al., 2020).”
From Towards a decolonial AI sovereignty model for indigenous educational settings (2026) · cites this paper as Wolf et al., 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Before the emergence of ChatGPT, BERT is a commonly used pre-trained machine learning model for NLP tasks (Wolf et al., 2020), and a ubiquitous baseline in text classification experiments of research in recent years (Rogers et al., 2021).”
From Towards reliable generative AI-driven scaffolding: Reducing hallucinations and enhancing quality in self-regulated learning support (2026) · cites this paper as Wolf et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“Tamarin is implemented in roughly 9K lines of Python on top of HuggingFace Transformers (Wolf et al., 2020); it uses no custom CUDA and does not modify model weights.”
From Tamarin (HSQ): Reversible Hierarchical KV-Cache Compression for LLM Inference (2026) · cites this paper as Wolf et al., 2020
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“3 speedup on GPT-2 (seq. length 1K)”
From FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness (2022) · cites this paper as [87]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Table 2 shows up to 3 endto-end speedup compared to Huggingface and 1.7 speedup compared to Megatron-LM.”
From FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness (2022) · cites this paper as [87]
Experimental — accuracy not yet measuredIn the citing paper
“While these early explorations are promising, they do not explore how much or what kind of interactivity is beneficial.”
From Interactive Model Cards: A Human-Centered Approach to Model Documentation (2022) · cites this paper as [73]
In the citing paper
“along with high-quality open-source libraries [113] have lowered the barrier to entry and make it possible to build conversational models that exhibit high generalization and coherence [90].”
From Future directions for chatbot research: An interdisciplinary research agenda (2021) · cites this paper as [113]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 2×
“The Transformer (Vaswani et al., 2017) has rapidly become the dominant architecture for natural language processing, surpassing alternative neural models such as convolutional and recurrent neural networks in performance for tasks in both natural language understanding and natural language…”
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173 · cited 4×
“, 2018) and the original source code for BERT (Devlin et al., 2018), both from Google Research.”
InfluentialRoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · cited 3×
“…text corpora, leading to major gains in accuracy on downstream tasks including text classification (Yang et al., 2019), language understanding (Liu et al., 2019b; Wang et al., 2018, 2019), machine translation (Lample and Conneau, 2019a), coreference resolution (Joshi et al., 2019),…”
InfluentialDeep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983 · cited 1×
“Model pretraining (McCann et al., 2017; Howard and Ruder, 2018; Peters et al., 2018; Devlin et al., 2018) allows models to be trained on generic corpora and subsequently be easily adapted to specific tasks with strong performance.”
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · cited 2×
“, 2019) T5 (Raffel et al., 2019) MarianMT (J.”
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
The Stanford CoreNLP Natural Language Processing Toolkit
Manning, C. D., Surdeanu, M., Bauer, J., Finkel, J. R., Bethard, S. J., & McClosky, D. (2014) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.3115/v1/p14-5010 · Cited by 7,252 · cited 1×
“Two core libraries are NLTK (Loper and Bird, 2002) and Stanford CoreNLP (Manning et al., 2014), which collect a variety of different approaches to NLP in a single package.”
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687 · cited 3×
“The Transformer architecture is particularly conducive to pretraining on large text corpora, leading to major gains in accuracy on downstream tasks including text classification (Yang et al., 2019), language understanding (Liu et al.”
InfluentialDistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019) · arXiv · doi:10.48550/arxiv.1910.01108 · Cited by 4,653 · cited 2×
“While core models like BERT and GPT-2 continue to be popular, other specialized models including DistilBERT (Sanh et al., 2019), which was developed for the library, are now widely downloaded by the community.”
Self-citation
Research works printed but not linked: 2
- Alan Akbik, Tanja Bergmann, Duncan Blythe, Kashif Rasul, Stefan Schweter, and Roland Vollgraf. 2019. Flair: An easy-to-use framework for state-of-the-art nlp. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Com- putational Linguistics (Demonstrations), pages 54- 59. aclweb.org.
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog, 1(8):9.
Cited by
Sorted by citations
Items 601–700 of 1,115
Diniz, E. J. D. S., Fontenele, J. E., de Oliveira, A. C., Bastos, V. H., Teixeira, S. S., Rabêlo, R. A. L., Calçada, D. B., Santos, R. M., de Oliveira, A. K. S., & Teles, A. S. (2022) · Healthcare · doi:10.3390/healthcare10040698 · Cited by 52
Li, C., Xing, W., & Leite, W. L. (2022) · British Journal of Educational Technology · doi:10.1111/bjet.13227 · Cited by 59
Sinclair, A., Jumelet, J., Zuidema, W. H., & Fernández, R. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00504 · Cited by 59
A Review of the Optimal Design of Neural Networks Based on FPGA
Wang, C., & Luo, Z. (2022) · Applied Sciences · doi:10.3390/app122110771 · Cited by 58
BART-IT: An Efficient Sequence-to-Sequence Model for Italian Text Summarization
Quatra, M. L., & Cagliero, L. (2022) · Future Internet · doi:10.3390/fi15010015 · Cited by 66
PharmBERT: a domain-specific BERT model for drug labels
ValizadehAslani, T., Shi, Y., Ren, P., Wang, J., Zhang, Y., Hu, M., Zhao, L., & Liang, H. (2023) · Briefings in Bioinformatics · doi:10.1093/bib/bbad226 · Cited by 56
ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoning
Hou, W., Xu, K., Cheng, Y., Li, W., & Liu, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.451 · Cited by 63
MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition
Adelani, D. I., Neubig, G., Ruder, S., Rijhwani, S., Beukman, M., Palen-Michel, C., Lignos, C., Alabi, J. O., Muhammad, S. H., Nabende, P., et al. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.298 · Cited by 78
Clinical Prompt Learning With Frozen Language Models
Taylor, N., Zhang, Y., Joyce, D. W., Gao, Z., Kormilitzin, A., & Nevado‐Holgado, A. J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3294633 · Cited by 55
Temporal Knowledge Graph Forecasting Without Knowledge Using In-Context Learning
Lee, D., Ahrabian, K., Jin, W., Morstatter, F., & Pujara, J. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.36 · Cited by 80
Wang, F., Lv, Y., Zhu, M., Ding, H., & Han, J. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3643543 · Cited by 60
HPC-Coder: Modeling Parallel Programs using Large Language Models
Nichols, D., Marathe, A., Menon, H., Gamblin, T., & Bhatele, A. S. (2024) · ISC High Performance (ISC) · doi:10.23919/isc.2024.10528929 · Cited by 72
Towards Continual Knowledge Learning of Language Models
Jang, J., Ye, S., Yang, S., Shin, J., Han, J., Kim, G., Choi, S. J., & Seo, M. (2021) · arXiv · doi:10.48550/arxiv.2110.03215 · Cited by 49
Jin, Z., Lalwani, A., Vaidhya, T., Shen, X., Ding, Y., Lyu, Z., Sachan, M., Mihalcea, R., & Schölkopf, B. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022 · doi:10.18653/v1/2022.findings-emnlp.532 · Cited by 52
First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT
Müller, B., Elazar, Y., Sagot, B., & Seddah, D. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.189 · Cited by 62
On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmark
Sun, H., Xu, G., Deng, J., Cheng, J., Zheng, C., Zhou, H., Peng, N., Zhu, X., & Huang, M. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.308 · Cited by 71
Barkan, O., Hauon, E., Caciularu, A., Katz, O., Malkiel, I., Armstrong, O., & Koenigstein, N. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482126 · Cited by 60
User Preference-Based Hierarchical Offloading for Collaborative Cloud-Edge Computing
Tian, S., Chi, C., Long, S., Oh, S., Li, Z., & Long, J. (2021) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2021.3128603 · Cited by 49
Li, J., Wei, Q., Ghiasvand, O., Chen, M., Lobanov, V., Weng, C.-H., & Xu, H. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-01967-7 · Cited by 48
An Emotion-Aware Multitask Approach to Fake News and Rumor Detection Using Transfer Learning
Choudhry, A., Khatri, I., Jain, M., & Vishwakarma, D. K. (2022) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2022.3228312 · Cited by 55
Philippi, D., Rothaus, K., & Castelli, M. (2023) · Scientific Reports · doi:10.1038/s41598-023-27616-1 · Cited by 55
medigan: a Python library of pretrained generative models for medical image synthesis
Osuala, R. O., Skorupko, G., Lazrak, N., Garrucho, L., García, E., Joshi, S., Jouide, S., Rutherford, M., Prior, F., Kushibar, K., et al. (2023) · Journal of medical imaging · doi:10.1117/1.jmi.10.6.061403 · Cited by 58
MuLan-Methyl—multiple transformer-based language models for accurate DNA methylation prediction
Zeng, W., Gautam, A., & Huson, D. H. (2022) · GigaScience · doi:10.1093/gigascience/giad054 · Cited by 49
Analyzing Transformers in Embedding Space
Dar, G., Geva, M., Gupta, A., & Berant, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.893 · Cited by 170
Fake review detection using transformer-based enhanced LSTM and RoBERTa
Mohawesh, R., Salameh, H. B., Jararweh, Y., Alkhalaileh, M. S., & Maqsood, S. (2024) · International Journal of Cognitive Computing in Engineering · doi:10.1016/j.ijcce.2024.06.001 · Cited by 65
Wang, Y., Xiao, B., Bouferguène, A., & Al‐Hussein, M. (2024) · Automation in Construction · doi:10.1016/j.autcon.2024.105602 · Cited by 56
Rethinking of BERT sentence embedding for text classification
Galal, O., Abdel-Gawad, A. H., & Farouk, M. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-10212-3 · Cited by 62
Effect of tokenization on transformers for biological sequences
Dotan, E., Jaschek, G., Pupko, T., & Belinkov, Y. (2024) · Bioinformatics · doi:10.1093/bioinformatics/btae196 · Cited by 49
Hadi, M. A., & Fard, F. H. (2023) · Empirical Software Engineering · doi:10.1007/s10664-023-10314-x · Cited by 61
Unmasking the Mask – Evaluating Social Biases in Masked Language Models
Kaneko, M., & Bollegala, D. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i11.21453 · Cited by 60
Biden vs Trump: Modeling US General Elections Using BERT Language Model
Chandra, R., & Saini, R. (2021) · IEEE Access · doi:10.1109/access.2021.3111035 · Cited by 52
An objective metric for Explainable AI: How and why to estimate the degree of explainability
Sovrano, F., & Vitali, F. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2023.110866 · Cited by 60
Towards Trustworthy AutoGrading of Short, Multi-lingual, Multi-type Answers
Schneider, J., Richner, R., & Riser, M. (2023) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-022-00289-z · Cited by 48
Adelani, D. I., Alabi, J. O., Fan, A., Kreutzer, J., Shen, X., Reid, M., Ruiter, D., Klakow, D., Nabende, P., Chang, E., et al. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.223 · Cited by 63
Nguyen, A., Pellerin, R., Lamouri, S., & Lekens, B. (2022) · International Journal of Production Research · doi:10.1080/00207543.2022.2070044 · Cited by 50
Global Entity Disambiguation with BERT
Yamada, I., Washio, K., Shindo, H., & Matsumoto, Y. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.238 · Cited by 53
Improving text classification with transformers and layer normalization
Rodrawangpai, B., & Daungjaiboon, W. (2022) · Machine Learning with Applications · doi:10.1016/j.mlwa.2022.100403 · Cited by 55
Troiano, E., Oberländer, L., & Klinger, R. (2022) · Computational Linguistics · doi:10.1162/coli_a_00461 · Cited by 71
Automated scoring of the autobiographical interview with natural language processing
van Genugten, R. D. I., & Schacter, D. L. (2024) · Behavior Research Methods · doi:10.3758/s13428-023-02145-x · Cited by 59
Towards Visual-Prompt Temporal Answer Grounding in Instructional Video
Shutao Li, A., Li, B., Sun, B., & Weng, Y. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3411045 · Cited by 55
Toward a Standard Approach for Echo Chamber Detection: Reddit Case Study
Morini, V., Pollacci, L., & Rossetti, G. (2021) · Applied Sciences · doi:10.3390/app11125390 · Cited by 58
Peng, H., Huang, S., Chen, S., Li, B., Geng, T., Li, A., Jiang, W., Wen, W., Bi, J., Liu, H., et al. (2022) · Proceedings of the 59th ACM/IEEE Design Automation Conference · doi:10.1145/3489517.3530585 · Cited by 48
RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectors
Dugan, L., Hwang, A., Trhlík, F., Zhu, A., Ludan, J. M., Xu, H., Ippolito, D., & Callison-Burch, C. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2024.acl-long.674 · Cited by 48
Mitchell, J. R., Szepietowski, P., Howard, R., Reisman, P., Jones, J. D., Lewis, P., Fridley, B. L., & Rollison, D. E. (2022) · Journal of Medical Internet Research · doi:10.2196/27210 · Cited by 45
Agbavor, F., & Liang, H. (2022) · Brain Sciences · doi:10.3390/brainsci13010028 · Cited by 47
Controlling hallucinations at word level in data-to-text generation
Rebuffel, C., Roberti, M., Soulier, L., Scoutheeten, G., Cancelliere, R., & Gallinari, P. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-021-00801-4 · Cited by 50
LEWIS: Levenshtein Editing for Unsupervised Text Style Transfer
Reid, M., & Zhong, V. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.344 · Cited by 49
Evaluating the Robustness of Retrieval Pipelines with Query Variation Generators
Penha, G., Câmara, A., & Hauff, C. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-99736-6_27 · Cited by 58
Prompt-free and Efficient Few-shot Learning with Language Models
Mahabadi, R. K., Zettlemoyer, L., Henderson, J., Mathias, L., Saeidi, M., Stoyanov, V., & Yazdani, M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.254 · Cited by 71
Measuring Harmful Sentence Completion in Language Models for LGBTQIA+ Individuals
Nozza, D., Bianchi, F., Lauscher, A., & Hovy, D. (2022) · Workshop on Language Technology for Equality, Diversity, Inclusion (LT-EDI) · doi:10.18653/v1/2022.ltedi-1.4 · Cited by 52
Semantics Driven Embedding Learning for Effective Entity Alignment
Zhong, Z., Zhang, M., Fan, J., & Dou, C. (2022) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde53745.2022.00205 · Cited by 49
Evaluating Attribution in Dialogue Systems: The BEGIN Benchmark
Dziri, N., Rashkin, H., Linzen, T., & Reitter, D. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00506 · Cited by 79
Knowing Knowledge: Epistemological Study of Knowledge in Transformers
Ranaldi, L., & Pucci, G. (2023) · Applied Sciences · doi:10.3390/app13020677 · Cited by 48
Hate Speech Classifiers Learn Normative Social Stereotypes
Davani, A. M., Atari, M., Kennedy, B., & Dehghani, M. (2023) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00550 · Cited by 73
ChemNLP: A Natural Language-Processing-Based Library for Materials Chemistry Text Data
Choudhary, K. K., & Kelley, M. L. (2023) · The Journal of Physical Chemistry C · doi:10.1021/acs.jpcc.3c03106 · Cited by 53
Fake news detection using dual BERT deep neural networks
Farokhian, M., Rafe, V., & Veisi, H. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-023-17115-w · Cited by 58
Alzheimer's disease recognition from spontaneous speech using large language models
Bang, J., Han, S., & Kang, B. (2024) · ETRI Journal · doi:10.4218/etrij.2023-0356 · Cited by 49
Koutcheme, C., Dainese, N., Sarsa, S., Hellas, A., Leinonen, J., & Denny, P. C. (2024) · ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE) · doi:10.1145/3649217.3653612 · Cited by 82
Neuro-GPT: Towards A Foundation Model For EEG
Cui, W., Jeong, W., Thölke, P., Medani, T., Jerbi, K., Joshi, A. A., & Leahy, R. M. (2024) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi56570.2024.10635453 · Cited by 89
Wang, R., Gao, Z., Zhang, L., Yue, S., & Gao, Z. (2025) · Computer Science Review · doi:10.1016/j.cosrev.2025.100755 · Cited by 61
Röttger, P., & Pierrehumbert, J. B. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.206 · Cited by 65
A Package for Learning on Tabular and Text Data with Transformers
Gu, K., & Budhkar, A. (2021) · doi:10.18653/v1/2021.maiworkshop-1.10 · Cited by 54
Context-aware legal citation recommendation using deep learning
Huang, Z., Low, C., Teng, M., Zhang, H., Ho, D. E., Krass, M., & Grabmair, M. (2021) · International Conference on Artificial Intelligence and Law · doi:10.1145/3462757.3466066 · Cited by 51
A pre-training and self-training approach for biomedical named entity recognition
Gao, S., Kotevska, O., Sorokine, A., & Christian, J. B. (2021) · PLOS ONE · doi:10.1371/journal.pone.0246310 · Cited by 46
LEDGAR : a large-scale multi-label corpus for text classification of legal provisions in contracts
Tuggener, D., von Däniken, P., Peetz, T., & Cieliebak, M. (2020) · Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences) · doi:10.21256/zhaw-20087 · Cited by 46
Ecco: An Open Source Library for the Explainability of Transformer Language Models
Alammar, J. (2021) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.18653/v1/2021.acl-demo.30 · Cited by 53
A Brand-New Look at You: Predicting Brand Personality in Social Media Networks with Machine Learning
Pamuksuz, U., Yun, J. T., & Humphreys, A. (2021) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2021.05.001 · Cited by 54
ExtEnD: Extractive Entity Disambiguation
Barba, E., Procopio, L., & Roberto Navigli, A. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.177 · Cited by 50
BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning
Oh, C., Hwang, H., Lee, H., Lim, Y., Jung, G., Jung, J., Choi, H., & Song, K. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.02320 · Cited by 50
EViT: Privacy-Preserving Image Retrieval via Encrypted Vision Transformer in Cloud Computing
Feng, Q., Li, P., Lu, Z., Li, C., Wang, Z., Liu, Z., Duan, C., Huang, F., Weng, J., & Yu, P. S. (2024) · IEEE Transactions on Circuits and Systems for Video Technology · doi:10.1109/tcsvt.2024.3370668 · Cited by 52
LTP: A New Active Learning Strategy for CRF-Based Named Entity Recognition
Liu, M., Tu, Z., Zhang, T., Su, T., Xu, X., & Wang, Z. (2022) · Neural Processing Letters · doi:10.1007/s11063-021-10737-x · Cited by 84
Accelerating attention through gradient-based learned runtime pruning
Li, Z., Ghodrati, S., Yazdanbakhsh, A., Esmaeilzadeh, H., & Kang, M. (2022) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1145/3470496.3527423 · Cited by 47
XL-WSD: An Extra-Large and Cross-Lingual Evaluation Framework for Word Sense Disambiguation
Pasini, T., Raganato, A., & Roberto Navigli, A. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i15.17609 · Cited by 50
Large Language Models for Text Classification: From Zero-Shot Learning to Instruction-TuningPreprint
Chae, Y., & Davidson, T. (2023) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/sthwk · Cited by 54
Continual Learning for Text Classification with Information Disentanglement Based Regularization
Huang, Y., Zhang, Y., Chen, J., Wang, X., & Yang, D. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.218 · Cited by 74
HeBERT and HebEMO: A Hebrew BERT Model and a Tool for Polarity Analysis and Emotion Recognition
Chriqui, A., & Yahav, I. (2022) · INFORMS Journal on Data Science · doi:10.1287/ijds.2022.0016 · Cited by 64
Kabir, M. K., Islam, M., Kabir, A. N. B., Haque, A., & Rhaman, M. K. (2022) · JMIR Formative Research · doi:10.2196/36118 · Cited by 50
Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Models
Röttger, P., Seelawi, H., Nozza, D., Talat, Z., & Vidgen, B. (2022) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2022.woah-1.15 · Cited by 61
PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices
Hu, Y., Imes, C., Zhao, X., Kundu, S., Beerel, P. A., Crago, S. P., & Walters, J. P. (2022) · Euromicro Conference on Digital System Design (DSD) · doi:10.1109/dsd57027.2022.00048 · Cited by 48
Face It: Quantifying the Impact of Nonverbal Communication in FOMC Press Conferences
Curti, F., & Kazinnik, S. (2021) · Journal of Monetary Economics · doi:10.1016/j.jmoneco.2023.06.007 · Cited by 53
From the Automated Assessment of Student Essay Content to Highly Informative Feedback: a Case Study
Gombert, S., Fink, A., Giorgashvili, T., Jivet, I., Mitri, D. D., Yau, J. Y.-K., Frey, A., & Drachsler, H. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-023-00387-6 · Cited by 71
Soylu, N. N., & Sefer, E. (2024) · Current Bioinformatics · doi:10.2174/0115748936283134240109054157 · Cited by 46
Yoon, D.-H., & Yoon, J. W. (2024) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2024.110069 · Cited by 45
Outside the Comfort Zone: Analysing LLM Capabilities in Software Vulnerability Detection
Guo, Y., Patsakis, C., Hu, Q., Tang, Q., & Casino, F. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70879-4_14 · Cited by 53
A fused large language model for predicting startup success
Maarouf, A., Feuerriegel, S., & Pröllochs, N. (2024) · European Journal of Operational Research · doi:10.1016/j.ejor.2024.09.011 · Cited by 61
Federated and edge learning for large language models
Piccialli, F., Chiaro, D., Qi, P., Bellandi, V., & Damiani, E. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102840 · Cited by 56
Multimodal cell maps as a foundation for structural and functional genomics
Schaffer, L. V., Hu, M., Qian, G., Moon, K., Pal, A., Soni, N., Latham, A. P., Vaites, L. P., Tsai, D., Mattson, N. M., et al. (2025) · Nature · doi:10.1038/s41586-025-08878-3 · Cited by 48
NVILA: Efficient Frontier Visual Language Models
Liu, Z., Zhu, L., Shi, B., Zhang, Z., Lou, Y., Yang, S. W., Xi, H., Cao, S., Gu, Y., Li, D., et al. (2025) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52734.2025.00390 · Cited by 190
Ten quick tips for deep learning in biology
Lee, B. D., Gitter, A., Greene, C. S., Raschka, S., Maguire, F., Titus, A., Kessler, M. D., Lee, A. J., Chevrette, M. G., Stewart, P. A., et al. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009803 · Cited by 45
ScienceWorld: Is your Agent Smarter than a 5th Grader?
Wang, R., Jansen, P., Côté, M.-A., & Ammanabrolu, P. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.775 · Cited by 45
A Closer Look at How Fine-tuning Changes BERT
Zhou, Y., & Srikumar, V. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.75 · Cited by 69
Understanding and predicting user dissatisfaction in a neural generative chatbot
See, A., & Manning, C. D. (2021) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/2021.sigdial-1.1 · Cited by 44
Li, Y., Zhou, Q. S., Li, Y., Li, Z., Liu, R., Sun, R., Wang, Z., Li, C., Cao, Y., & Zheng, H.-T. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.252 · Cited by 49
BI-RADS BERT and Using Section Segmentation to Understand Radiology Reports
Kuling, G., Curpen, D. B., & Martel, A. L. (2021) · Journal of Imaging · doi:10.3390/jimaging8050131 · Cited by 38
Predicting CVSS Metric via Description Interpretation
Costa, J. C., Roxo, T., Sequeiros, J. B. F., Proença, H. P. M. C., & Inácio, P. R. M. (2022) · IEEE Access · doi:10.1109/access.2022.3179692 · Cited by 54
Can Transformer be Too Compositional? Analysing Idiom Processing in Neural Machine Translation
Dankers, V., Lucas, C., & Titov, I. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.252 · Cited by 73
Coding energy knowledge in constructed responses with explainable NLP models
Gombert, S., Mitri, D. D., Karademir, O., Kubsch, M., Kolbe, H., Tautz, S., Grimm, A., Bohm, I., Neumann, K., & Drachsler, H. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12767 · Cited by 57
Gloss-Free End-to-End Sign Language Translation
Lin, K., Wang, X., Zhu, L., Sun, K., Zhang, B., & Yang, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.722 · Cited by 52
Tu, C.-H., Mai, Z., & Chao, W. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00746 · Cited by 54
Brain-Inspired Remote Sensing Foundation Models and Open Problems: A Comprehensive Survey
Jiao, L., Huang, Z., Lu, X., Liu, X., Yang, Y., Zhao, J., Zhang, J., Hou, B., Yang, S., Liu, F., et al. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3316302 · Cited by 49
Metadata
- Authors
- Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., Davison, J., Shleifer, S., von Platen, P., Ma, C., Jernite, Y., Plu, J., Xu, C., Le Scao, T., Gugger, S., Drame, M., Lhoest, Q., & Rush, A.
- Affiliations
- Hugging Face (US)
- ORCID
- Venue
- Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
- Published
- 2020
- Pages
- 38-45
- OpenAlex
- W2979826702
- Cited by
- 8,741
- References
- 39
- Citations by year
- 2026: 851 · 2025: 1481 · 2024: 1405 · 2023: 2347 · 2022: 1686 · 2021: 872 · 2020: 94
- FWCI
- 477.50
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- transformer models, natural language processing, Hugging Face
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
