The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Transformers: State-of-the-Art Natural Language Processing
Open accessAbstract
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, Alexander Rush. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. 2020.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Almost all CLaMs have been made publicly accessible via online model repositories like HuggingFace57.”
From The shaky foundations of large language models and foundation models for electronic health records (2023) · cites this paper as [57]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Employing BERT, GPT-2, RoBERTa, and DistilBERT, we achieved robust results; BERT for deep contextual insights, GPT-2 for coherent text generation, RoBERTa for performance with large data, and DistilBERT for fast, cost-effective efficiency [39].”
From Generative AI-Powered Educational Alignment: A Framework for Matching Syllabus Course Topics with Web Description (2024) · cites this paper as [39]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Open-source ecosystems such as Hugging Face and BLOOM reduce technical barriers but can reproduce extractive defaults without Indigenous authority over datasets, objectives, and deployment pathways (BigScience Workshop, 2022;Wolf et al., 2020).”
From Towards a decolonial AI sovereignty model for indigenous educational settings (2026) · cites this paper as Wolf et al., 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Before the emergence of ChatGPT, BERT is a commonly used pre-trained machine learning model for NLP tasks (Wolf et al., 2020), and a ubiquitous baseline in text classification experiments of research in recent years (Rogers et al., 2021).”
From Towards reliable generative AI-driven scaffolding: Reducing hallucinations and enhancing quality in self-regulated learning support (2026) · cites this paper as Wolf et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“Tamarin is implemented in roughly 9K lines of Python on top of HuggingFace Transformers (Wolf et al., 2020); it uses no custom CUDA and does not modify model weights.”
From Tamarin (HSQ): Reversible Hierarchical KV-Cache Compression for LLM Inference (2026) · cites this paper as Wolf et al., 2020
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“3 speedup on GPT-2 (seq. length 1K)”
From FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness (2022) · cites this paper as [87]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Table 2 shows up to 3 endto-end speedup compared to Huggingface and 1.7 speedup compared to Megatron-LM.”
From FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness (2022) · cites this paper as [87]
Experimental — accuracy not yet measuredIn the citing paper
“While these early explorations are promising, they do not explore how much or what kind of interactivity is beneficial.”
From Interactive Model Cards: A Human-Centered Approach to Model Documentation (2022) · cites this paper as [73]
In the citing paper
“along with high-quality open-source libraries [113] have lowered the barrier to entry and make it possible to build conversational models that exhibit high generalization and coherence [90].”
From Future directions for chatbot research: An interdisciplinary research agenda (2021) · cites this paper as [113]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 2×
“The Transformer (Vaswani et al., 2017) has rapidly become the dominant architecture for natural language processing, surpassing alternative neural models such as convolutional and recurrent neural networks in performance for tasks in both natural language understanding and natural language…”
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173 · cited 4×
“, 2018) and the original source code for BERT (Devlin et al., 2018), both from Google Research.”
InfluentialRoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · cited 3×
“…text corpora, leading to major gains in accuracy on downstream tasks including text classification (Yang et al., 2019), language understanding (Liu et al., 2019b; Wang et al., 2018, 2019), machine translation (Lample and Conneau, 2019a), coreference resolution (Joshi et al., 2019),…”
InfluentialDeep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983 · cited 1×
“Model pretraining (McCann et al., 2017; Howard and Ruder, 2018; Peters et al., 2018; Devlin et al., 2018) allows models to be trained on generic corpora and subsequently be easily adapted to specific tasks with strong performance.”
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · cited 2×
“, 2019) T5 (Raffel et al., 2019) MarianMT (J.”
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
The Stanford CoreNLP Natural Language Processing Toolkit
Manning, C. D., Surdeanu, M., Bauer, J., Finkel, J. R., Bethard, S. J., & McClosky, D. (2014) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.3115/v1/p14-5010 · Cited by 7,252 · cited 1×
“Two core libraries are NLTK (Loper and Bird, 2002) and Stanford CoreNLP (Manning et al., 2014), which collect a variety of different approaches to NLP in a single package.”
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687 · cited 3×
“The Transformer architecture is particularly conducive to pretraining on large text corpora, leading to major gains in accuracy on downstream tasks including text classification (Yang et al., 2019), language understanding (Liu et al.”
InfluentialDistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019) · arXiv · doi:10.48550/arxiv.1910.01108 · Cited by 4,653 · cited 2×
“While core models like BERT and GPT-2 continue to be popular, other specialized models including DistilBERT (Sanh et al., 2019), which was developed for the library, are now widely downloaded by the community.”
Self-citation
Research works printed but not linked: 2
- Alan Akbik, Tanja Bergmann, Duncan Blythe, Kashif Rasul, Stefan Schweter, and Roland Vollgraf. 2019. Flair: An easy-to-use framework for state-of-the-art nlp. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Com- putational Linguistics (Demonstrations), pages 54- 59. aclweb.org.
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog, 1(8):9.
Cited by
Sorted by citations
Items 801–900 of 1,115
Generate, Annotate, and Learn: NLP with Synthetic Text
He, X., Nassar, I., Kiros, J., Haffari, G., & Norouzi, M. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00492 · Cited by 55
Sarcasm detection framework using context, emotion and sentiment features
Vitman, O., Kostiuk, Y., Sidorov, G., & Gelbukh, A. F. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.121068 · Cited by 43
Bayesian Surprise Predicts Human Event Segmentation in Story Listening
Kumar, M., Goldstein, A., Michelmann, S., Zacks, J. M., Hasson, U., & Norman, K. A. (2023) · Cognitive Science · doi:10.1111/cogs.13343 · Cited by 51
Mačina, J., Daheim, N., Chowdhury, S. P., Sinha, T., Kapur, M., Gurevych, I., & Sachan, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.372 · Cited by 62
Zero-Shot Cross-Lingual Summarization via Large Language Models
Wang, J., Liang, Y., Meng, F., Zou, B., Li, Z., Qu, J., & Zhou, J. (2023) · Workshop on New Frontiers in Summarization (NewSum) · doi:10.18653/v1/2023.newsum-1.2 · Cited by 81
Word Frequency and Predictability Dissociate in Naturalistic Reading
Shain, C. (2024) · Open Mind · doi:10.1162/opmi_a_00119 · Cited by 43
TurkishBERTweet: Fast and reliable large language model for social media analysis
Najafi, A., & Varol, O. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124737 · Cited by 54
Versatile Audio-Visual Learning for Emotion Recognition
Goncalves, L., Leem, S.-G., Lin, W.-C., Şişman, B., & Busso, C. (2024) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2024.3433386 · Cited by 51
KronA: Parameter-Efficient Tuning with Kronecker Adapter
Edalati, A., Tahaei, M. S., Kobyzev, I., Nia, V. P., Clark, J. J., & Rezagholizadeh, M. (2025) · Machine translation · doi:10.1007/978-3-031-85747-8_4 · Cited by 168
Smith, G., Haworth, R., & Žitnik, S. (2020) · Journal of Educational Computing Research · doi:10.1177/0735633120927486 · Cited by 42
WRIME: A New Dataset for Emotional Intensity Estimation with Subjective and Objective Annotations
Kajiwara, T., Chu, C., Takemura, N., Nakashima, Y., & Nagahara, H. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.169 · Cited by 42
Towards Facet-Driven Generation of Clarifying Questions for Conversational Search
Sekulić, I., Aliannejadi, M., & Crestani, F. (2021) · ACM SIGIR International Conference on Theory of Information Retrieval (ICTIR) · doi:10.1145/3471158.3472257 · Cited by 48
Zero-Shot Information Extraction as a Unified Text-to-Triple Translation
Wang, C., Liu, X., Chen, Z., Hong, H., Tang, J., & Song, D. X. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.94 · Cited by 47
Kaczmarek, I., Iwaniak, A., Świetlicka, A., Piwowarczyk, M., & Nadolny, A. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.103479 · Cited by 41
Discretized Integrated Gradients for Explaining Language Models
Sanyal, S., & Ren, X. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.805 · Cited by 61
Mahbub, M., Srinivasan, S., Danciu, I., Peluso, A., Begoli, E., Tamang, S. R., & Peterson, G. D. (2022) · PLoS ONE · doi:10.1371/journal.pone.0262182 · Cited by 43
Non-Autoregressive ASR Modeling Using Pre-Trained Language Models for Chinese Speech Recognition
Yu, F.-H., Chen, K.-Y., & Lu, K.-H. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3166400 · Cited by 42
Kauf, C., Tuckute, G., Lévy, R., Andreas, J., & Fedorenko, E. G. (2023) · Neurobiology of Language · doi:10.1162/nol_a_00116 · Cited by 48
Pan, S., Xu, G. J. W., Guo, K., Park, S. H., & Ding, H. (2024) · IEEE Transactions on Games · doi:10.1109/tg.2024.3366239 · Cited by 38
SwiftTron: An Efficient Hardware Accelerator for Quantized Transformers
Marchisio, A., Dura, D., Capra, M., Martina, M., Masera, G., & Shafique, M. (2023) · 2023 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn54540.2023.10191521 · Cited by 39
HIBRIDS: Attention with Hierarchical Biases for Structure-aware Long Document Summarization
Cao, S., & Wang, L. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.58 · Cited by 49
Label Semantic Aware Pre-training for Few-shot Text Classification
Mueller, A., Krone, J., Romeo, S. O., Mansour, S., Mansimov, E., Zhang, Y., & Roth, D. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.570 · Cited by 40
Multimodal Continual Graph Learning with Neural Architecture Search
Cai, J., Wang, X., Guan, C., Tang, Y., Xu, J. H., Zhong, B., & Zhu, W. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512176 · Cited by 38
Drug-Drug Interaction Extraction from Biomedical Text Using Relation BioBERT with BLSTM
KafiKang, M., & Hendawi, A. (2023) · Machine Learning and Knowledge Extraction · doi:10.3390/make5020036 · Cited by 43
Jiang, J., Ren, X., & Ferrara, E. (2023) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v17i1.22160 · Cited by 44
SynGEC: Syntax-Enhanced Grammatical Error Correction with a Tailored GEC-Oriented Parser
Zhang, Y., Zhang, B., Li, Z., Bao, Z., Li, C., & Zhang, M. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.162 · Cited by 46
Trillion Dollar Words: A New Financial Dataset, Task & Market Analysis
Shah, A., Paturi, S., & Chava, S. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.368 · Cited by 73
Generative Language Models for Paragraph-Level Question Generation
Ushio, A., Alva-Manchego, F. E., & Camacho-Collados, J. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.42 · Cited by 41
Oobleck: Resilient Distributed Training of Large Models Using Pipeline Templates
Jang, I., Yang, Z., Zhang, Z., Jin, X., & Chowdhury, M. (2023) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/3600006.3613152 · Cited by 64
Recent progress in the JARVIS infrastructure for next-generation data-driven materials design
Wines, D., Gurunathan, R. L., Garrity, K. F., DeCost, B., Biacchi, A. J., Tavazza, F., & Choudhary, K. K. (2023) · Applied Physics Reviews · doi:10.1063/5.0159299 · Cited by 42
Natural language instructions induce compositional generalization in networks of neurons
Riveland, R., & Pouget, A. (2024) · Nature Neuroscience · doi:10.1038/s41593-024-01607-5 · Cited by 53
Improving Text Classification with Large Language Model-Based Data Augmentation
Zhao, H., Chen, H., Ruggles, T. A., Feng, Y., Singh, D., & Yoon, H. (2024) · Electronics · doi:10.3390/electronics13132535 · Cited by 38
Analyzing the Evolution and Maintenance of ML Models on Hugging Face
Castaño, J., Martínez‐Fernández, S., Franch, X., & Bogner, J. (2024) · International Conference on Mining Software Repositories (MSR) · doi:10.1145/3643991.3644898 · Cited by 42
Learning and actioning general principles of cancer cell drug sensitivity
Carli, F., Chiaro, P. D., Morelli, M., Arora, C., Bisceglia, L., Rosa, N. D. O., Cortesi, A., Franceschi, S., Lessi, F., Stefano, A. L. D., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-56827-5 · Cited by 40
Photovoltaic power forecasting: Using wavelet threshold denoising combined with VMD
Liu, L., Zhang, J., & Xue, S. (2025) · Renewable Energy · doi:10.1016/j.renene.2025.123152 · Cited by 42
Agarwal, O., Yang, Y., Wallace, B., & Nenkova, A. (2021) · Computational Linguistics · doi:10.1162/coli_a_00397 · Cited by 39
The linked legal data landscape: linking legal data across different countries
Filtz, E., Kirrane, S., & Axel Polleres, A. (2021) · Artificial Intelligence and Law · doi:10.1007/s10506-021-09282-8 · Cited by 38
A generic LSTM neural network architecture to infer heterogeneous model transformations
Burgueño, L., Cabot, J., Li, S., & Gérard, S. (2021) · Software & Systems Modeling · doi:10.1007/s10270-021-00893-y · Cited by 41
LeeBERT: Learned Early Exit for BERT with cross-level optimization
Zhu, W. (2021) · doi:10.18653/v1/2021.acl-long.231 · Cited by 41
Kumar, K. N. P., & Gavrilova, M. L. (2021) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2021.3108810 · Cited by 38
BERT-Based Transfer-Learning Approach for Nested Named-Entity Recognition Using Joint Labeling
Agrawal, A., Tripathi, S., Vardhan, M., Sihag, V. K., Choudhary, G., & Dragoni, N. (2022) · Applied Sciences · doi:10.3390/app12030976 · Cited by 44
Metaphors in Pre-Trained Language Models: Probing and Generalization Across Datasets and Languages
Aghazadeh, E., Fayyaz, M., & Yaghoobzadeh, Y. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.144 · Cited by 54
Abualhaija, S., Arora, C., Sleimi, A., & Briand, L. (2022) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re54965.2022.00011 · Cited by 46
A Search Engine for Discovery of Scientific Challenges and Directions
Lahav, D., Saad-Falcon, J., Kuehl, B., Johnson, S., Parasa, S., Shomron, N., Chau, D. H., Yang, D., Horvitz, E., Weld, D. S., et al. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i11.21456 · Cited by 46
Hidayatullah, A. F., Qazi, A., Lai, D. T. C., & Apong, R. A. A. H. M. (2022) · IEEE Access · doi:10.1109/access.2022.3223703 · Cited by 39
Generating Music with Data: Application of Deep Learning Models for Symbolic Music Composition
Ferreira, P., Limongi, R., & Fávero, L. P. L. (2023) · Applied Sciences · doi:10.3390/app13074543 · Cited by 37
Zangari, A., Marcuzzo, M., Schiavinato, M., Gasparetto, A., & Albarelli, A. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.119984 · Cited by 54
FACET: Fairness in Computer Vision Evaluation Benchmark
Gustafson, L., Rolland, C., Ravi, N., Duval, Q., Adcock, A., Fu, C.-Y., Hall, M. A., & Ross, C. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01863 · Cited by 47
Hierarchical Text Classification and Its Foundations: A Review of Current Research
Zangari, A., Marcuzzo, M., Rizzo, M., Giudice, L., Albarelli, A., & Gasparetto, A. (2024) · Electronics · doi:10.3390/electronics13071199 · Cited by 48
Evaluating text classification: A benchmark study
Reusens, M., Stevens, A., Tonglet, J., Smedt, J. D., Verbeke, W., Broucke, S. V., & Baesens, B. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124302 · Cited by 48
Generalization in neural networks: A broad survey
Rohlfs, C. (2024) · Neurocomputing · doi:10.1016/j.neucom.2024.128701 · Cited by 51
When Geoscience Meets Foundation Models: Toward a general geoscience artificial intelligence system
Zhang, H., Xu, J., Cui, H., Li, L., Yang, Y., Tang, C., & Boers, N. (2024) · IEEE Geoscience and Remote Sensing Magazine · doi:10.1109/mgrs.2024.3496478 · Cited by 59
Assessing political bias in large language models
Rettenberger, L., Reischl, M., & Schutera, M. (2025) · Journal of Computational Social Science · doi:10.1007/s42001-025-00376-w · Cited by 96
Federated continual learning: Concepts, challenges, and solutions
Hamedi, P., Razavi‐Far, R., & Hallaji, E. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.130844 · Cited by 55
AI-guided discovery and optimization of antimicrobial peptides through species-aware language model
Bae, D., Kim, M., Seo, J., & Nam, H. (2025) · Briefings in Bioinformatics · doi:10.1093/bib/bbaf343 · Cited by 46
Park, S. H., Suh, C. H., Lee, J. H., Tejani, A. S., You, S. C., Kahn, C. E., & Moy, L. P. (2025) · Korean Journal of Radiology · doi:10.3348/kjr.2025.1522 · Cited by 44
Analysis of Text Feature Extractors using Deep Learning on Fake News
Ahmed, B., Ali, G., Hussain, A., Baseer, A., & Ahmed, J. (2021) · Engineering Technology & Applied Science Research · doi:10.48084/etasr.4069 · Cited by 39
Lauscher, A., Ko, B., Kuehl, B., Johnson, S., Cohan, A., Jurgens, D., & Lo, K. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.137 · Cited by 38
AdvPicker: Effectively Leveraging Unlabeled Data via Adversarial Discriminator for Cross-Lingual NER
Chen, W., Jiang, H., Wu, Q., Karlsson, B. F., & Guan, Y. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.61 · Cited by 38
Deep learning for fake news detection on Twitter regarding the 2019 Hong Kong protests
Zervopoulos, A., Alvanou, A. G., Bezas, K., Papamichail, A., Μaragoudakis, M., & Kermanidis, K. L. (2021) · Neural Computing and Applications · doi:10.1007/s00521-021-06230-0 · Cited by 39
Idiomatic Expression Identification using Semantic Compatibility
Zeng, Z., & Bhat, S. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00442 · Cited by 44
Artificial Intelligence for Dermatopathology: Current Trends and the Road Ahead
Chen, S. B., & Novoa, R. A. (2022) · Seminars in Diagnostic Pathology · doi:10.1053/j.semdp.2022.01.003 · Cited by 37
Automating Genetic Algorithm Mutations for Molecules Using a Masked Language Model
Blanchard, A. E., Chandrashekar, M., Gao, S. B., Gounley, J. P., Lyngaas, I., Gläser, J., & Bhowmik, D. (2022) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2022.3144045 · Cited by 38
Optimism and pessimism analysis using deep learning on COVID-19 related twitter conversations
Blanco, G., & Lourenço, A. M. G. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.102918 · Cited by 38
KALA: Knowledge-Augmented Language Model Adaptation
Kang, M., Baek, J., & Hwang, S. J. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.379 · Cited by 44
LOREN: Logic-Regularized Reasoning for Interpretable Fact Verification
Chen, J., Bao, Q., Sun, C., Zhang, X., Chen, J., Zhou, H., Xiao, Y., & Li, L. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21291 · Cited by 42
Towards Climate Awareness in NLP Research
Hershcovich, D., Webersinke, N., Kraus, M., Bingler, J., & Leippold, M. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.159 · Cited by 51
Using big sequencing data to identify chronic SARS-Coronavirus-2 infections
Harari, S., Miller, D., Fleishon, S., Burstein, D., & Stern, A. (2024) · Nature Communications · doi:10.1038/s41467-024-44803-4 · Cited by 37
It’s not Rocket Science: Interpreting Figurative Language in Narratives
Chakrabarty, T., Choi, Y., & Shwartz, V. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00478 · Cited by 42
Heard the news? Environmental policy and clean investments
Noailly, J., Nowzohour, L., van den Heuvel, M., & Pla, I. (2024) · Journal of Public Economics · doi:10.1016/j.jpubeco.2024.105190 · Cited by 39
Yu, Y., Yuan, J., Mittal, G., Li, F., & Chen, M. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-19818-2_35 · Cited by 37
Mao, S., Zhan, J., Wang, Y., & Jiang, Y. (2023) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2023.3259013 · Cited by 38
Automatic depression severity assessment with deep learning using parameter-efficient tuning
Lau, C., Zhu, X., & Chan, W.-Y. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1160291 · Cited by 39
Expresso: A Benchmark and Analysis of Discrete Expressive Speech Resynthesis
Nguyen, T. A., Hsu, W.-N., D’Avirro, A., Shi, B., Gat, I., Fazel-Zarani, M., Remez, T., Copet, J., Synnaeve, G., Hassid, M., et al. (2023) · Interspeech (USB) · doi:10.21437/interspeech.2023-1905 · Cited by 48
Licari, D., & Comandé, G. (2023) · Computer law & security review · doi:10.1016/j.clsr.2023.105908 · Cited by 44
Open-source Large Language Models are Strong Zero-shot Query Likelihood Models for Document Ranking
Zhuang, S., Liu, B., Koopman, B., & Zuccon, G. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.590 · Cited by 65
A transformer-based approach for Arabic offline handwritten text recognition
Momeni, S., & BabaAli, B. (2024) · Signal Image and Video Processing · doi:10.1007/s11760-023-02970-9 · Cited by 36
Prevalence of bias against neurodivergence‐related terms in artificial intelligence language models
Brandsen, S., Chandrasekhar, T., Franz, L., Grapel, J., Dawson, G., & Carlson, D. (2024) · Autism Research · doi:10.1002/aur.3094 · Cited by 46
TRACED: Execution-aware Pre-training for Source Code
Ding, Y., Steenhoek, B. J., Pei, K., Kaiser, G. E., Le, W., & Ray, B. (2024) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3597503.3608140 · Cited by 41
Lamsal, R., Rodriguez, M. A., & Karunasekera, S. A. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111916 · Cited by 47
ALISA: Accelerating Large Language Model Inference via Sparsity-Aware KV Caching
Zhao, Y., Wu, D., & Wang, J. (2024) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca59077.2024.00077 · Cited by 58
A large language model framework to uncover underreporting in traffic crashes
Arteaga, C., & Park, J. (2024) · Journal of Safety Research · doi:10.1016/j.jsr.2024.11.009 · Cited by 45
Grigorakis, K., Ferousi, C., & Topakas, E. (2025) · Catalysts · doi:10.3390/catal15020147 · Cited by 39
Ferri, P., Sáez, C., Castro, A. F.-D., Juan–Albarracín, J., Blanes-Selva, V., Sánchez-Cuesta, P., & Garcia-Gomez, J. M. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102088 · Cited by 39
Characterizing English Variation across Social Media Communities with BERT
Lucy, L., & Bamman, D. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00383 · Cited by 42
Prediction as a basis for skilled reading: insights from modern language models
Cevoli, B., Watkins, C., & Rastle, K. (2022) · Royal Society Open Science · doi:10.1098/rsos.211837 · Cited by 42
Few-Shot Learning with Siamese Networks and Label Tuning
Müller, T., Pérez-Torró, G., & Franco-Salvador, M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.584 · Cited by 45
An analysis of emotions and the prominence of positivity in #BlackLivesMatter tweets
Field, A., Park, C. Y., Theóphilo, A., Watson-Daniels, J., & Tsvetkov, Y. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2205767119 · Cited by 46
Handbook of Computational Social Science for Policy
Bertoni, E., Fontana, M., Gabrielli, L., Signorelli, S., & Vespe, M. (2023) · Springer eBooks · doi:10.1007/978-3-031-16624-2 · Cited by 47
DCT-Former: Efficient Self-Attention with Discrete Cosine Transform
Scribano, C., Franchini, G., Prato, M., & Bertogna, M. (2023) · Journal of Scientific Computing · doi:10.1007/s10915-023-02125-5 · Cited by 41
Transformer-based deep reverse attention network for multi-sensory human activity recognition
Pramanik, R., Sikdar, R., & Sarkar, R. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.106150 · Cited by 37
Exploiting Global and Local Hierarchies for Hierarchical Text Classification
Jiang, T., Wang, D., Sun, L., Chen, Z., Zhuang, F., & Yang, Q. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.268 · Cited by 47
Hessel, J., Marasović, A., Hwang, J. D., Lee, L., Da, J., Zellers, R., Mankoff, R., & Choi, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.41 · Cited by 79
Automatic Generation of Socratic Subquestions for Teaching Math Word Problems
Shridhar, K., Mačina, J., El‐Assady, M., Sinha, T., Kapur, M., & Sachan, M. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.277 · Cited by 62
Hande, A., Hegde, S. U., Priyadharshini, R., Ponnusamy, R., Kumaresan, P. K., Thavareesan, S., & Chakravarthi, B. R. (2022) · Research Square · doi:10.21203/rs.3.rs-546149/v1 · Cited by 36
RefSum: Refactoring Neural Summarization
Liu, Y., Dou, Z.-Y., & Liu, P. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.113 · Cited by 36
Deka, C., Shrivastava, A., Abraham, A. K., Nautiyal, S., & Chauhan, P. (2025) · Speech, Language and Hearing · doi:10.1080/2050571x.2024.2359274 · Cited by 44
Genomic Surveillance of COVID-19 Variants With Language Models and Machine Learning
Nagpal, S., Pal, R., Ashima, A., Tyagi, A., Tripathi, S., Nagori, A., Ahmad, S., Mishra, H. P., Malhotra, R., Kutum, R., et al. (2022) · Frontiers in Genetics · doi:10.3389/fgene.2022.858252 · Cited by 35
Your fairness may vary: Pretrained language model fairness in toxic text classification
Baldini, I., Wei, D., Ramamurthy, K. N., Singh, M., & Yurochkin, M. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.176 · Cited by 51
Knowledge Monopolies and the Innovation Divide
Safadi, H., & Watson, R. T. (2021) · Information and Organization · doi:10.1016/j.infoandorg.2023.100466 · Cited by 41
Metadata
- Authors
- Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., Davison, J., Shleifer, S., von Platen, P., Ma, C., Jernite, Y., Plu, J., Xu, C., Le Scao, T., Gugger, S., Drame, M., Lhoest, Q., & Rush, A.
- Affiliations
- Hugging Face (US)
- ORCID
- Venue
- Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
- Published
- 2020
- Pages
- 38-45
- OpenAlex
- W2979826702
- Cited by
- 8,741
- References
- 39
- Citations by year
- 2026: 851 · 2025: 1481 · 2024: 1405 · 2023: 2347 · 2022: 1686 · 2021: 872 · 2020: 94
- FWCI
- 477.50
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- transformer models, natural language processing, Hugging Face
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
