The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Transformers: State-of-the-Art Natural Language Processing
Open accessAbstract
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, Alexander Rush. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. 2020.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Almost all CLaMs have been made publicly accessible via online model repositories like HuggingFace57.”
From The shaky foundations of large language models and foundation models for electronic health records (2023) · cites this paper as [57]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Employing BERT, GPT-2, RoBERTa, and DistilBERT, we achieved robust results; BERT for deep contextual insights, GPT-2 for coherent text generation, RoBERTa for performance with large data, and DistilBERT for fast, cost-effective efficiency [39].”
From Generative AI-Powered Educational Alignment: A Framework for Matching Syllabus Course Topics with Web Description (2024) · cites this paper as [39]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Open-source ecosystems such as Hugging Face and BLOOM reduce technical barriers but can reproduce extractive defaults without Indigenous authority over datasets, objectives, and deployment pathways (BigScience Workshop, 2022;Wolf et al., 2020).”
From Towards a decolonial AI sovereignty model for indigenous educational settings (2026) · cites this paper as Wolf et al., 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Before the emergence of ChatGPT, BERT is a commonly used pre-trained machine learning model for NLP tasks (Wolf et al., 2020), and a ubiquitous baseline in text classification experiments of research in recent years (Rogers et al., 2021).”
From Towards reliable generative AI-driven scaffolding: Reducing hallucinations and enhancing quality in self-regulated learning support (2026) · cites this paper as Wolf et al., 2020
The cited source says what the claim attributes to it.
In the citing paper
“Tamarin is implemented in roughly 9K lines of Python on top of HuggingFace Transformers (Wolf et al., 2020); it uses no custom CUDA and does not modify model weights.”
From Tamarin (HSQ): Reversible Hierarchical KV-Cache Compression for LLM Inference (2026) · cites this paper as Wolf et al., 2020
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“3 speedup on GPT-2 (seq. length 1K)”
From FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness (2022) · cites this paper as [87]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Table 2 shows up to 3 endto-end speedup compared to Huggingface and 1.7 speedup compared to Megatron-LM.”
From FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness (2022) · cites this paper as [87]
Experimental — accuracy not yet measuredIn the citing paper
“While these early explorations are promising, they do not explore how much or what kind of interactivity is beneficial.”
From Interactive Model Cards: A Human-Centered Approach to Model Documentation (2022) · cites this paper as [73]
In the citing paper
“along with high-quality open-source libraries [113] have lowered the barrier to entry and make it possible to build conversational models that exhibit high generalization and coherence [90].”
From Future directions for chatbot research: An interdisciplinary research agenda (2021) · cites this paper as [113]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · cited 2×
“The Transformer (Vaswani et al., 2017) has rapidly become the dominant architecture for natural language processing, surpassing alternative neural models such as convolutional and recurrent neural networks in performance for tasks in both natural language understanding and natural language…”
Jakubův, J., Chvalovský, K., Goertzel, Z., et al. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,648
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173 · cited 4×
“, 2018) and the original source code for BERT (Devlin et al., 2018), both from Google Research.”
InfluentialRoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · cited 3×
“…text corpora, leading to major gains in accuracy on downstream tasks including text classification (Yang et al., 2019), language understanding (Liu et al., 2019b; Wang et al., 2018, 2019), machine translation (Lample and Conneau, 2019a), coreference resolution (Joshi et al., 2019),…”
InfluentialDeep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983 · cited 1×
“Model pretraining (McCann et al., 2017; Howard and Ruder, 2018; Peters et al., 2018; Devlin et al., 2018) allows models to be trained on generic corpora and subsequently be easily adapted to specific tasks with strong performance.”
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929 · cited 2×
“, 2019) T5 (Raffel et al., 2019) MarianMT (J.”
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
The Stanford CoreNLP Natural Language Processing Toolkit
Manning, C. D., Surdeanu, M., Bauer, J., Finkel, J. R., Bethard, S. J., & McClosky, D. (2014) · Annual Meeting of the Association for Computational Linguistics: System Demonstrations (ACL Demo) · doi:10.3115/v1/p14-5010 · Cited by 7,252 · cited 1×
“Two core libraries are NLTK (Loper and Bird, 2002) and Stanford CoreNLP (Manning et al., 2014), which collect a variety of different approaches to NLP in a single package.”
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687 · cited 3×
“The Transformer architecture is particularly conducive to pretraining on large text corpora, leading to major gains in accuracy on downstream tasks including text classification (Yang et al., 2019), language understanding (Liu et al.”
InfluentialDistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019) · arXiv · doi:10.48550/arxiv.1910.01108 · Cited by 4,653 · cited 2×
“While core models like BERT and GPT-2 continue to be popular, other specialized models including DistilBERT (Sanh et al., 2019), which was developed for the library, are now widely downloaded by the community.”
Self-citation
Research works printed but not linked: 2
- Alan Akbik, Tanja Bergmann, Duncan Blythe, Kashif Rasul, Stefan Schweter, and Roland Vollgraf. 2019. Flair: An easy-to-use framework for state-of-the-art nlp. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Com- putational Linguistics (Demonstrations), pages 54- 59. aclweb.org.
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. OpenAI Blog, 1(8):9.
Cited by
Sorted by citations
Items 901–1,000 of 1,115
Evolutionary neural architecture search on transformers for RUL prediction
Mo, H., & Iacca, G. (2023) · Materials and Manufacturing Processes · doi:10.1080/10426914.2023.2199499 · Cited by 39
BITE: Textual Backdoor Attacks with Iterative Trigger Injection
Yan, J. H., Gupta, V., & Ren, X. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.725 · Cited by 56
Bartelds, M., San, N., McDonnell, B., Jurafsky, D., & Wieling, M. B. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.42 · Cited by 64
Reasoning Like Program Executors
Pi, X., Liu, Q., Chen, B., Ziyadi, M., Lin, Z., Fu, Q., Gao, Y., Lou, J., & Chen, W. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.48 · Cited by 53
LGViT: Dynamic Early Exiting for Accelerating Vision Transformer
Xu, G., Hao, J., Shen, L., Hu, H., Luo, Y., Lin, H., & Shen, J. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3611762 · Cited by 42
Mamta, M., & Ekbal, A. (2023) · Journal of Intelligent Information Systems · doi:10.1007/s10844-023-00808-x · Cited by 38
Sonkar, S., Liu, N., Mallick, D., & Baraniuk, R. (2023) · Findings of the Association for Computational Linguistics: EMNLP 2023 · doi:10.18653/v1/2023.findings-emnlp.130 · Cited by 35
Anomaly detection in smart manufacturing: An Adaptive Adversarial Transformer-based model
Orabi, M., Tran, K. P., Egger, P., & Thomassey, S. (2024) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2024.09.021 · Cited by 35
Navigating the Ethical Terrain of AI-Generated Text Tools: A Review
Mohamed, Y. A., Mohamed, A. H. H. M., Khanan, A., Bashir, M., Adiel, M. A. E., & Elsadig, M. A. (2024) · IEEE Access · doi:10.1109/access.2024.3521945 · Cited by 44
Embed2Detect: temporally clustered embedded words for event detection in social media
Hettiarachchi, H., Adedoyin-Olowe, M., Bhogal, J., & Gaber, M. M. (2021) · Machine Learning · doi:10.1007/s10994-021-05988-7 · Cited by 49
What Context Features Can Transformer Language Models Use?
O’Connor, J., & Andreas, J. (2021) · doi:10.18653/v1/2021.acl-long.70 · Cited by 59
Pre-training for Ad-hoc Retrieval
Ma, Z., Dou, Z., Xu, W. X., Zhang, X., Jiang, H., Cao, Z., & Wen, J.-R. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3482286 · Cited by 38
VILA: Improving Structured Content Extraction from Scientific PDFs Using Visual Layout Groups
Shen, Z., Lo, K., Wang, L. L., Kuehl, B., Weld, D. S., & Downey, D. (2022) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00466 · Cited by 44
AlephBERT: Language Model Pre-training and Evaluation from Sub-Word to Sentence Level
Seker, A., Bandel, E., Bareket, D., Brusilovsky, I., Greenfeld, R. S., & Tsarfaty, R. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.4 · Cited by 40
Revisiting Automatic Evaluation of Extractive Summarization Task: Can We Do Better than ROUGE?
Akter, M., Bansal, N., & Karmaker, S. K. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.122 · Cited by 44
ConfliBERT: A Pre-trained Language Model for Political Conflict and Violence
Hu, Y., Hosseini, M., Parolin, E. S., Osorio, J., Khan, L. R., Brandt, P. T., & D'Orazio, V. J. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.400 · Cited by 44
Arabic Aspect-Based Sentiment Classification Using Seq2Seq Dialect Normalization and Transformers
Chennafi, M. E., Bedlaoui, H., Dahou, A., & Al‐qaness, M. A. A. (2022) · Knowledge · doi:10.3390/knowledge2030022 · Cited by 35
Zero-shot cross-lingual transfer language selection using linguistic similarity
Eronen, J., Ptaszynski, M. E., & Masui, F. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2022.103250 · Cited by 40
Knowledge graph extension with a pre-trained language model via unified learning method
Choi, B., & Ko, Y. (2023) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.110245 · Cited by 38
Moreno‐García, C. F., Jayne, C., Elyan, E., & Aceves‐Martins, M. (2023) · Decision Analytics Journal · doi:10.1016/j.dajour.2023.100162 · Cited by 37
Inseq: An Interpretability Toolkit for Sequence Generation Models
Sarti, G., Feldhus, N., Sickert, L., & van der Wal, O. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-demo.40 · Cited by 56
Sudowoodo: Contrastive Self-supervised Learning for Multi-purpose Data Integration and Preparation
Wang, R., Li, Y., & Wang, J. (2023) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde55515.2023.00391 · Cited by 51
Kinkead, L., Allam, A., & Krauthammer, M. O. (2020) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-020-01131-z · Cited by 2
REFINER: Reasoning Feedback on Intermediate RepresentationsPreprint
Paul, D., Ismayilzada, M., Peyrard, M., Borges, B., Bosselut, A., West, R., & Faltings, B. V. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.01904 · Cited by 35
Generating dermatopathology reports from gigapixel whole slide images with HistoGPT
Tran, M., Schmidle, P., Guo, R. R., Wagner, S. J., Koch, V., Lupperger, V., Novotny, B., Murphree, D. H., Hardway, H. D., D’Amato, M., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-60014-x · Cited by 36
Wang, F., Zheng, K., Lü, L., Xiao, J. Z., Wu, M. H., Kuo, C., & Miao, S. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3209648 · Cited by 37
Using BERT to identify drug-target interactions from whole PubMed
Aldahdooh, J., Vähä-Koskela, M. J. V., Tang, J. P., & Tanoli, Z. (2022) · BMC Bioinformatics · doi:10.1186/s12859-022-04768-x · Cited by 36
Tensor Decomposition for Model Reduction in Neural Networks: A Review [Feature]
Liu, X., & Parhi, K. K. (2023) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2023.3267921 · Cited by 41
DISCO: Distilling Counterfactuals with Large Language Models
Chen, Z., Gao, Q., Bosselut, A., Sabharwal, A., & Richardson, K. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.302 · Cited by 72
Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysis
Xiao, Y., Liang, P. P., Bhatt, U., Neiswanger, W., Salakhutdinov, R., & Morency, L. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.538 · Cited by 83
Ning, X., Guan, J., Li, X., Wei, Y., & Chen, F. (2023) · Viruses · doi:10.3390/v15081749 · Cited by 34
Lankford, S., Afli, H., & Way, A. (2023) · Information · doi:10.3390/info14120638 · Cited by 43
Feng, T., & Narayanan, S. (2023) · 2023 11th International Conference on Affective Computing and Intelligent Interaction (ACII) · doi:10.1109/acii59096.2023.10388152 · Cited by 34
Artificial Intelligence: An Overview
Jaboob, A. S., Durrah, O., & Chakir, A. (2024) · Synthesis lectures on engineering, science, and technology · doi:10.1007/978-3-031-50300-9_1 · Cited by 34
Could Small Language Models Serve as Recommenders? Towards Data-centric Cold-start Recommendation
Wu, X., Zhou, H., Shi, Y., Yao, W., Huang, X. X., & Liu, N. (2024) · International World Wide Web Conference (WWW) · doi:10.1145/3589334.3645494 · Cited by 54
MECLA: Memory-Compute-Efficient LLM Accelerator with Scaling Sub-matrix Partition
Qin, Y., Wang, Y., Zhao, Z., Yang, X., Zhou, Y., Wei, S., Hu, Y., & Yin, S. (2024) · Proceedings - International Symposium on Computer Architecture/Proceedings · doi:10.1109/isca59077.2024.00079 · Cited by 36
Pirzado, F. A., Ahmed, A., Mendoza-Urdiales, R. A., & Terashima‐Marín, H. (2024) · IEEE Access · doi:10.1109/access.2024.3443621 · Cited by 41
Advanced image generation for cancer using diffusion models
Kidder, B. L. (2024) · Biology Methods and Protocols · doi:10.1093/biomethods/bpae062 · Cited by 40
A Comprehensive Survey on Generative AI for Metaverse: Enabling Immersive Experience
Chamola, V., Sai, S., Bhargava, A., Sahu, A., Jiang, W., Xiong, Z., Niyato, D. T., & Hussain, A. (2024) · Cognitive Computation · doi:10.1007/s12559-024-10342-9 · Cited by 42
CACTUS: Chemistry Agent Connecting Tool Usage to Science
McNaughton, A. D., Ramalaxmi, G. K. S., Kruel, A., Knutson, C. R., Varikoti, R. A., & Kumar, N. (2024) · ACS Omega · doi:10.1021/acsomega.4c08408 · Cited by 53
SOFA: A Compute-Memory Optimized Sparsity Accelerator via Cross-Stage Coordinated Tiling
Wang, H., Fang, J., Tang, X., Yue, Z., Li, J., Qin, Y., Guan, S., Yang, Q., Wang, Y., Li, C., et al. (2024) · IEEE/ACM International Symposium on Microarchitecture (MICRO) · doi:10.1109/micro61859.2024.00093 · Cited by 38
Wu, R., Wang, R., Hao, J., Wu, Q., Wang, P., & Niyato, D. T. (2024) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2024.3515997 · Cited by 34
Consistent Accelerated Inference via Confident Adaptive Transformers
Schuster, T., Fisch, A., Jaakkola, T., & Barzilay, R. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.406 · Cited by 46
Syed, M. H., & Chung, S.-T. (2021) · Applied Sciences · doi:10.3390/app11136007 · Cited by 40
Broaden the Vision: Geo-Diverse Visual Commonsense Reasoning
Yin, D., Li, L. H., Hu, Z., Peng, N., & Chang, K.-W. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.162 · Cited by 49
Comparative Study of Long Document Classification
Wagh, V., Khandve, S., Joshi, I., Wani, A., Kale, G., & Joshi, R. B. (2021) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon54134.2021.9707465 · Cited by 36
Levy, J., Vattikonda, N., Haudenschild, C., Christensen, B. C., & Vaickus, L. J. (2022) · Journal of Pathology Informatics · doi:10.4103/jpi.jpi_52_21 · Cited by 35
Efficient Fine-Tuning of BERT Models on the Edge
Vucetic, D., Tayaranian, M., Ziaeefard, M., Clark, J. J., Meyer, B. H., & Gross, W. J. (2022) · IEEE International Symposium on Circuits and Systems proceedings · doi:10.1109/iscas48785.2022.9937567 · Cited by 42
Detecting abusive comments at a fine-grained level in a low-resource language
Chakravarthi, B. R., Priyadharshini, R., Banerjee, S., Jagadeeshan, M. B., Kumaresan, P. K., Ponnusamy, R., Benhur, S., & McCrae, J. P. (2023) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100006 · Cited by 36
Generating Literal and Implied Subquestions to Fact-check Complex Claims
Chen, J., Sriram, A., Choi, E., & Durrett, G. (2022) · Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2022.emnlp-main.229 · Cited by 34
EUR-Lex-Sum: A Multi- and Cross-lingual Dataset for Long-form Summarization in the Legal Domain
Aumiller, D., Chouhan, A. P. S., & Gertz, M. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.519 · Cited by 61
Emotional Intelligence for the Decision-Making Process of Trajectories in Collaborative Robotics
Antonelli, M. G., Zobel, P. B., Manes, C., Mattei, E., & Stampone, N. (2024) · Machines · doi:10.3390/machines12020113 · Cited by 35
The Impact of Domain-Specific Pre-Training on Named Entity Recognition Tasks in Materials SciencePreprint
Walker, N., Trewartha, A., Huo, H., Lee, S.-H., Cruse, K., Dagdelen, J. M., Dunn, A., Persson, K. A., Ceder, G., & Jain, A. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3950755 · Cited by 36
Tokenization in the Theory of Knowledge
Friedman, R. (2023) · Encyclopedia · doi:10.3390/encyclopedia3010024 · Cited by 41
PUTraceAD: Trace Anomaly Detection with Partial Labels based on GNN and PU Learning
Zhang, K., Zhang, C., Peng, X., & Sha, C. (2022) · 2022 IEEE 33rd International Symposium on Software Reliability Engineering (ISSRE) · doi:10.1109/issre55969.2022.00032 · Cited by 33
Chaichulee, S., Promchai, C., Kaewkomon, T., Kongkamol, C., Ingviya, T., & Sangsupawanich, P. (2022) · PLoS ONE · doi:10.1371/journal.pone.0270595 · Cited by 39
SHAS: Approaching optimal Segmentation for End-to-End Speech Translation
Tsiamas, I., Gállego, G. I., Fonollosa, J. A. R., & Costa‐jussà, M. R. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-59 · Cited by 47
DeepUM: Tensor Migration and Prefetching in Unified Memory
Jung, J., Kim, J.-P., & Lee, J. (2023) · International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · doi:10.1145/3575693.3575736 · Cited by 33
Celeghin, A., Borriero, A., Orsenigo, D., Diano, M., Guerrero, C. A. M., Perotti, A., Petri, G., & Tamietto, M. (2023) · Frontiers in Computational Neuroscience · doi:10.3389/fncom.2023.1153572 · Cited by 50
Machine Learning and Health Science Research: Tutorial
Cho, H., She, J., de Marchi, D., El-Zaatari, H., Barnes, E. L., Kahkoska, A. R., Kosorok, M. R., & Virkud, A. (2023) · Journal of Medical Internet Research · doi:10.2196/50890 · Cited by 39
Transfer learning empowers accurate pharmacokinetics prediction of small samples
Guo, W., Dong, Y., & Hao, G. (2024) · Drug Discovery Today · doi:10.1016/j.drudis.2024.103946 · Cited by 34
Liang, P., Chen, J., Chang, Q. H., & Yao, L. (2024) · Knowledge-Based Systems · doi:10.1016/j.knosys.2024.111664 · Cited by 33
ArcheType: A Novel Framework for Open-Source Column Type Annotation Using Large Language Models
Feuer, B., Liu, Y., Hegde, C., & Freire, J. (2024) · Proceedings of the VLDB Endowment · doi:10.14778/3665844.3665857 · Cited by 50
Gong, A., Qiao, Z., Li, X., Lyu, J., & Li, X. (2024) · Progress in Nuclear Energy · doi:10.1016/j.pnucene.2024.105474 · Cited by 33
Transfer Learning in Pre-Trained Large Language Models for Malware Detection Based on System Calls
Sánchez, P. M. S., Celdrán, A. H., Bovet, G., & Pérez, G. M. (2024) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom61039.2024.10773857 · Cited by 33
How Certain is Your Transformer?
Shelmanov, A., Tsymbalov, E., Puzyrev, D., Fedyanin, K., Panchenko, A., & Panov, M. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.157 · Cited by 34
An Investigation of the (In)effectiveness of Counterfactually Augmented Data
Joshi, N., & He, H. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.256 · Cited by 43
Li, L., Lin, Y., Chen, D., Ren, S., Li, P., Zhou, J., & Sun, X. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.43 · Cited by 44
Zhang, X., Han, L., Sobeih, T., Lappin, L., Lee, M. A., Howard, A., & Kisdi, Á. (2022) · Remote Sensing · doi:10.3390/rs14061400 · Cited by 37
Improving CTC-Based Speech Recognition Via Knowledge Transferring from Pre-Trained Language Models
Deng, K., Cao, S., Zhang, Y., Ma, L., Cheng, G., Ji, X., & Zhang, P. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747887 · Cited by 34
Transfer Learning Approaches for Building Cross-Language Dense Retrieval Models
Nair, S., Yang, E., Lawrie, D., Duh, K., McNamee, P., Murray, K., Mayfield, J., & Oard, D. W. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-99736-6_26 · Cited by 36
Entity Cloze By Date: What LMs Know About Unseen Entities
Onoe, Y., Zhang, M., Choi, E., & Durrett, G. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.52 · Cited by 53
Filighera, A., Parihar, S., Steuer, T., Meuser, T., & Ochs, S. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.587 · Cited by 33
Kumar, P., Pathania, K., & Raman, B. (2022) · Applied Intelligence · doi:10.1007/s10489-022-04046-6 · Cited by 33
Fake News Spreaders Detection: Sometimes Attention Is Not All You Need
Siino, M., Nuovo, E. D., Tinnirello, I., & Cascia, M. L. (2022) · Information · doi:10.3390/info13090426 · Cited by 36
Preventing profiling for ethical fake news detection
Allein, L., Moens, M., & Perrotta, D. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103206 · Cited by 33
Dahou, A., Mabrouk, A., Ewees, A. A., Gaheen, M. A., & Elaziz, M. A. (2023) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2023.122546 · Cited by 34
A Virtual Simulation-Pilot Agent for Training of Air Traffic Controllers
Zuluaga-Gómez, J., Prasad, A., Nigmatulina, I., Motlíček, P., & Kleinert, M. (2023) · Aerospace · doi:10.3390/aerospace10050490 · Cited by 38
Semantics-Aware Dynamic Localization and Refinement for Referring Image Segmentation
Yang, Z., Wang, J., Tang, Y., Chen, K., Zhao, H., & Torr, P. H. S. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i3.25428 · Cited by 35
GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models
Yin, D., Bansal, H., Monajatipoor, M., Li, L. H., & Chang, K.-W. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.132 · Cited by 58
Lalor, J. P., Abbasi, A., Oketch, K., Yang, Y., & Forsgren, N. (2024) · ACM Transactions on Information Systems · doi:10.1145/3641276 · Cited by 40
Yoo, K., Kim, J., Jang, J., & Kwak, N. (2022) · Findings of the Association for Computational Linguistics: ACL 2022 · doi:10.18653/v1/2022.findings-acl.289 · Cited by 33
Qian, K., Liu, S., Li, T., Raković, M., Li, X., Guan, R., Molenaar, I., Nawaz, S., Swiecki, Z., Yan, L., et al. (2026) · Computers & Education · doi:10.1016/j.compedu.2025.105448 · Cited by 39
BERT-based Ensemble Approaches for Hate Speech Detection
Mnassri, K., Rajapaksha, P., Farahbakhsh, R., & Crespi, N. (2022) · Globecom · doi:10.1109/globecom48099.2022.10001325 · Cited by 39
Fyffe, S., Lee, P., & Kaplan, S. A. (2023) · Organizational Research Methods · doi:10.1177/10944281231155771 · Cited by 40
An Effective Deployment of Contrastive Learning in Multi-label Text Classification
Lin, N., Qin, G., Wang, G., Zhou, D., & Yang, A. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.556 · Cited by 32
PuMer: Pruning and Merging Tokens for Efficient Vision Language Models
Cao, Q., Paranjape, B., & Hajishirzi, H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.721 · Cited by 72
Type-Aware Decomposed Framework for Few-Shot Named Entity Recognition
Li, Y., Yu, Y., & Qian, T. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.598 · Cited by 39
Alkhodari, M., Hadjileontiadis, L. J., & Khandoker, A. H. (2024) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2024.3357506 · Cited by 33
Yang, C., & Zhang, Y. (2024) · Urban forestry & urban greening · doi:10.1016/j.ufug.2024.128285 · Cited by 40
Predicting life satisfaction using machine learning and explainable AI
Khan, A. E., Hasan, M. J., Anjum, H., Mohammed, N., & Momen, S. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e31158 · Cited by 35
Multimodal pretraining for unsupervised protein representation learning
Nguyen, V. T. D., & Hy, T. S. (2024) · Biology Methods and Protocols · doi:10.1093/biomethods/bpae043 · Cited by 33
Lv, S., Lu, S., Wang, R., Yin, L., Yin, Z., AlQahtani, S. A., Tian, J., & Zheng, W. (2024) · Systems · doi:10.3390/systems12120516 · Cited by 36
Deng, Z., Sun, R., Xue, M., Ma, W., Wen, S., Nepal, ., & Xiang, Y. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3581103 · Cited by 36
Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image Analysis
Xin, Y., Ates, G. C., Gong, K., & Shao, W. (2025) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2025.3604595 · Cited by 73
CareBot: A Mental Health ChatBot
Crasto, R., Dias, L., Miranda, D., & Kayande, D. (2021) · International Conference for Emerging Technology (INCET) · doi:10.1109/incet51464.2021.9456326 · Cited by 32
Explainable Sentiment Analysis: A Hierarchical Transformer-Based Extractive Summarization Approach
Bacco, L., Cimino, A., Dell’Orletta⋄, F., & Merone, M. (2021) · Electronics · doi:10.3390/electronics10182195 · Cited by 34
Buchlak, Q. D., Esmaili, N., Bennett, C. C., & Farrokhi, F. R. (2021) · Acta neurochirurgica. Supplementum · doi:10.1007/978-3-030-85292-4_32 · Cited by 34
Winds of Change: Impact of COVID-19 on Vaccine-Related Opinions of Twitter Users
Poddar, S., Mondal, M., Misra, J., Ganguly, N., & Ghosh, S. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19334 · Cited by 33
Exploring Language Markers of Mental Health in Psychiatric Stories
Spruit, M. R., Verkleij, S., de Schepper, K., & Scheepers, F. E. (2022) · Applied Sciences · doi:10.3390/app12042179 · Cited by 32
Metadata
- Authors
- Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., Davison, J., Shleifer, S., von Platen, P., Ma, C., Jernite, Y., Plu, J., Xu, C., Le Scao, T., Gugger, S., Drame, M., Lhoest, Q., & Rush, A.
- Affiliations
- Hugging Face (US)
- ORCID
- Venue
- Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
- Published
- 2020
- Pages
- 38-45
- OpenAlex
- W2979826702
- Cited by
- 8,741
- References
- 39
- Citations by year
- 2026: 851 · 2025: 1481 · 2024: 1405 · 2023: 2347 · 2022: 1686 · 2021: 872 · 2020: 94
- FWCI
- 477.50
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- transformer models, natural language processing, Hugging Face
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
