ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

Attention Is All You Need

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404

Adam: A Method for Stochastic Optimization

Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325

Glove: Global Vectors for Word Representation

Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071

Efficient Estimation of Word Representations in Vector Space

Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568

GAN（Generative Adversarial Nets）

淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 20,507

RoBERTa: A Robustly Optimized BERT Pretraining Approach

Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515

Unsupervised representation learning with deep convolutional generative adversarial networks

Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235

Deep Contextualized Word Representations

Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983

Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning

Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 8,608

Language inference-based learning for Low-Resource Chinese clinical named entity recognition using language model

Cui, Z., Yu, K., Yuan, Z., Dong, X., & Luo, W. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104559 · Cited by 13

Transformer-Based End-to-End Speech Translation With Rotary Position Embedding

Li, X., Li, S., Zhang, X.-L., & Rahardja, S. (2024) · IEEE Signal Processing Letters · doi:10.1109/lsp.2024.3353039 · Cited by 15

Multi-class multi-label classification of social media texts for typhoon damage assessment: a two-stage model fully integrating the outputs of the hidden layers of BERT

Zou, L., He, Z., Zhou, C., & Zhu, W. (2024) · International Journal of Digital Earth · doi:10.1080/17538947.2024.2348668 · Cited by 18

On knowing a gene: A distributional hypothesis of gene function

Kwon, J. J., Pan, J., Gonzalez, G., Hahn, W. C., & Žitnik, M. (2024) · Cell Systems · doi:10.1016/j.cels.2024.04.008 · Cited by 14

Real-time phishing URL detection framework using knowledge distilled ELECTRA

Jishnu, K. S., & Arthi, B. (2024) · Automatika · doi:10.1080/00051144.2024.2415797 · Cited by 13

Token and part-of-speech fusion for pretraining of transformers with application in automatic cyberbullying detection

Azmi, N. S. A. B. N., Ptaszynski, M. E., Masui, F., Eronen, J., & Nowakowski, K. (2025) · Natural Language Processing Journal · doi:10.1016/j.nlp.2025.100132 · Cited by 14

A comparative analysis on using GPT and BERT for automated vulnerability scoring

Mirtaheri, S. L., Pugliese, A., Movahedkor, N., & Shahbazian, R. (2025) · Intelligent Systems with Applications · doi:10.1016/j.iswa.2025.200515 · Cited by 20

Enhancing automatic multilabel diagnosis of electrocardiogram signals: A masked transformer approach

Zhou, Y., Diao, X., Huo, Y., Liu, Y., Sun, Z., Fan, X., & Zhao, W. (2025) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2025.110674 · Cited by 31

MusiCoder: A Universal Music-Acoustic Encoder Based on Transformer

Zhao, Y., & Guo, J. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-67832-6_34 · Cited by 13

A Spectral Method for Unsupervised Multi-Document Summarization

Wang, K., Chang, B., & Sui, Z. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.32 · Cited by 14

Flexibly Focusing on Supporting Facts, Using Bridge Links, and Jointly Training Specialized Modules for Multi-Hop Question Answering

Alkhaldi, T., Chu, C., & Kurohashi, S. (2021) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2021.3120643 · Cited by 13

MS-Mentions: Consistently Annotating Entity Mentions in Materials Science Procedural Text

O’Gorman, T., Jensen, Z., Mysore, S., Huang, K., Mahbub, R., Olivetti, E., & McCallum, A. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.101 · Cited by 14

Pretrained models and evaluation data for the Khmer language

Jiang, S., Fu, S., Lin, N., & Fu, Y. (2021) · Tsinghua Science & Technology · doi:10.26599/tst.2021.9010060 · Cited by 14

Dense Image Captioning in Hindi

Gill, K., Saha, S., & Mishra, S. K. (2021) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/smc52423.2021.9658586 · Cited by 13

Emotion Analysis of Arabic Tweets: Language Models and Available Resources

Alqahtani, G., & Alothaim, A. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.843038 · Cited by 16

Multimodal Classification of Safety-Report Observations

Paraskevopoulos, G., Pistofidis, P., Banoutsos, G., Georgiou, E., & Katsouros, V. (2022) · Applied Sciences · doi:10.3390/app12125781 · Cited by 13

Generating knowledge aware explanation for natural language inference

Yang, Z., Xu, Y., Hu, J., & Dong, S. (2022) · Information Processing & Management · doi:10.1016/j.ipm.2022.103245 · Cited by 15

MultiGED-2023 shared task at NLP4CALL: Multilingual Grammatical Error Detection

Volodina, E., Bryant, C., Caines, A., Clercq, O. D., Frey, J.-C., Ershova, E., Rosen, A., & Vinogradova, O. (2023) · Linköping electronic conference proceedings · doi:10.3384/ecp197001 · Cited by 13

Mask the Correct Tokens: An Embarrassingly Simple Approach for Error Correction

Shen, K., Leng, Y., Tan, X., Tang, S., Zhang, Y., Liu, W., & Lin, E. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.708 · Cited by 15

Pre-training Language Models with Deterministic Factual Knowledge

Li, S., Li, X., Shang, L., Sun, C., Liu, B., Ji, Z., Jiang, X., & Liu, Q. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.764 · Cited by 16

RRF102: Meeting the TREC-COVID Challenge with a 100+ Runs EnsemblePreprint

Bendersky, M., Zhuang, H., Ma, J., Han, S., Hall, K., & McDonald, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.00200 · Cited by 21

Searching for Efficient Multi-Stage Vision TransformersPreprint

Liao, Y., Karaman, S., & Sze, V. (2021) · arXiv.org · doi:10.48550/arxiv.2109.00642 · Cited by 19

Ranking and Tuning Pre-trained Models: A New Paradigm for Exploiting Model HubsPreprint

You, K., Liu, Y., Zhang, Z., Wang, J., Jordan, M. I., & Long, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.10545 · Cited by 22

Do Response Selection Models Really Know What’s Next? Utterance Manipulation Strategies for Multi-turn Response Selection

Whang, T., Lee, D., Oh, D., Lee, C., Han, K., Lee, D., & Lee, S. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i16.17653 · Cited by 14

Mind captioning: Evolving descriptive text of mental content from human brain activity

Horikawa, T. (2025) · Science Advances · doi:10.1126/sciadv.adw1464 · Cited by 13

Beyond Reptile: Meta-Learned Dot-Product Maximization between Gradients for Improved Single-Task Regularization

Kedia, A., Chinthakindi, S. C., & Ryu, W. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.37 · Cited by 14

A survey on text classification: Practical perspectives on the Italian language

Gasparetto, A., Zangari, A., Marcuzzo, M., & Albarelli, A. (2022) · PLoS ONE · doi:10.1371/journal.pone.0270904 · Cited by 13

SemEval-2022 Task 7: Identifying Plausible Clarifications of Implicit and Underspecified Phrases in Instructional Texts

Roth, M., Anthonio, T., & Sauer, A. (2022) · International Workshop on Semantic Evaluation (SemEval) · doi:10.18653/v1/2022.semeval-1.146 · Cited by 12

COREQQA: a COmpliance REQuirements understanding using question answering tool

Abualhaija, S., Arora, C., & Briand, L. (2022) · ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) · doi:10.1145/3540250.3558926 · Cited by 14

Regret and Hope on Transformers: An Analysis of Transformers on Regret and Hope Speech Detection Datasets

Sidorov, G., Balouchzahi, F., Butt, S., & Gelbukh, A. F. (2023) · Applied Sciences · doi:10.3390/app13063983 · Cited by 13

InforMask: Unsupervised Informative Masking for Language Model Pretraining

Sadeq, N., Xu, C., & McAuley, J. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.395 · Cited by 16

ReAugKD: Retrieval-Augmented Knowledge Distillation For Pre-trained Language Models

Zhang, J., Muhamed, A., Anantharaman, A., Wang, G., Chen, C., Zhong, K., Cui, Q., Xu, Y., Zeng, B., Chilimbi, T. M., et al. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.97 · Cited by 17

Hybrid Models for Sentence Readability Assessment

Liu, F., & Lee, J. S. Y. (2023) · Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.18653/v1/2023.bea-1.37 · Cited by 15

Prompting ELECTRA: Few-Shot Learning with Discriminative Pre-Trained Models

Xia, M., Artetxe, M., Du, J., Chen, D., & Stoyanov, V. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.780 · Cited by 15

Improving few-shot relation extraction through semantics-guided learning

Wu, H., He, Y., Chen, Y., Bai, Y., & Shi, X. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.10.053 · Cited by 12

Overview of ImageArg-2023: The First Shared Task in Multimodal Argument Mining

Liu, Z., Elaraby, M., Zhong, Y., & Litman, D. J. (2023) · Workshop on Argument Mining (ArgMining) · doi:10.18653/v1/2023.argmining-1.12 · Cited by 12

SimCSE++: Improving Contrastive Learning for Sentence Embeddings from Two Perspectives

Xu, J., Shao, W., Chen, L., & Liu, L. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.737 · Cited by 18

Using Bidirectional Encoder Representations from Transformers (BERT) to predict criminal charges and sentences from Taiwanese court judgments

peng, Y. T., & Lei, C. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.1841 · Cited by 18

Deciphering language disturbances in schizophrenia: A study using fine-tuned language models

Li, R., Cao, M., Fu, D., Wei, W., Wang, D., Yuan, Z., Hu, R., & Deng, W. (2024) · Schizophrenia Research · doi:10.1016/j.schres.2024.07.016 · Cited by 12

Adaptive gate residual connection and multi-scale RCNN for fake news detection

Zhou, Q., & Cai, T. (2024) · Machine Learning with Applications · doi:10.1016/j.mlwa.2024.100612 · Cited by 12

Dynamic link prediction: Using language models and graph structures for temporal knowledge graph completion with emerging entities and relations

Ong, R., Sun, J., Guo, Y., & Şerban, O. (2025) · Expert Systems with Applications · doi:10.1016/j.eswa.2025.126648 · Cited by 13

Advancing sentiment analysis for low-resourced african languages using pre-trained language models

Mabokela, K. R., Primus, M., & Çelik, T. (2025) · PLoS ONE · doi:10.1371/journal.pone.0325102 · Cited by 12

Combining Self-Training and Self-Supervised Learning for Unsupervised Disfluency Detection

Wang, S., Wang, Z., Che, W., & Liu, T. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.142 · Cited by 13

Reference Knowledgeable Network for Machine Reading Comprehension

Zhao, Y., Zhang, Z., & Zhao, H. (2022) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2022.3164219 · Cited by 13

Emotion Dynamics Modeling via BERT

Yang, H., & Shen, J. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9533860 · Cited by 12

Reducing BERT Computation by Padding Removal and Curriculum Learning

Zhang, W., Wei, W., Wang, W., Jin, L., & Cao, Z. (2021) · IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) · doi:10.1109/ispass51385.2021.00025 · Cited by 13

Attend, Memorize and Generate: Towards Faithful Table-to-Text Generation in Few Shots

Zhao, W., Ye, L., Wan, Y., & Yu, P. S. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.347 · Cited by 12

An Interdisciplinary Approach for the Automated Detection and Visualization of Media Bias in News Articles

Spinde, T. (2021) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw53433.2021.00144 · Cited by 16

SentiMedQAer: A Transfer Learning-Based Sentiment-Aware Model for Biomedical Question Answering

Zhu, X., Chen, Y., Gu, Y., & Xiao, Z. (2022) · Frontiers in Neurorobotics · doi:10.3389/fnbot.2022.773329 · Cited by 14

Adversarial Self-Attention for Language Understanding

Wu, H., Ding, R., Zhao, H. Y., Xie, P., Huang, F., & Zhang, M. (2023) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v37i11.26608 · Cited by 15

R2D2: Robust Data-to-Text with Replacement Detection

Nan, L., Flores, L. J., Zhao, Y., Liu, Y., Benson, L., Zou, W., & Radev, D. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.464 · Cited by 14

BioSimCSE: BioMedical Sentence Embeddings using Contrastive learning

Kanakarajan, K. R., Kundumani, B., Abraham, A. N., & Sankarasubbu, M. (2022) · International Workshop on Health Text Mining and Information Analysis (LOUHI) · doi:10.18653/v1/2022.louhi-1.10 · Cited by 14

Exploring the Performance and Efficiency of Transformer Models for NLP on Mobile Devices

Panopoulos, I., Nikolaidis, S., Venieris, S. I., & Venieris, I. S. (2023) · IEEE Symposium on Computers and Communications (ISCC) · doi:10.1109/iscc58397.2023.10217850 · Cited by 16

Beyond Information: Is ChatGPT Empathetic Enough?

Université du Québec à Montréal, C., Belkhir, A., Sadat, F., & Université du Québec à Montréal, C. (2023) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-092-2_018 · Cited by 13

Sentiment Analysis of Drug Reviews using Transfer Learning

Punith, N. S., & Raketla, K. (2021) · International Conference on Inventive Research in Computing Applications (ICIRCA) · doi:10.1109/icirca51532.2021.9544574 · Cited by 12

Efficient Zero-shot Event Extraction with Context-Definition Alignment

Zhang, H., Yao, W., & Yu, D. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.531 · Cited by 13

Logic Against Bias: Textual Entailment Mitigates Stereotypical Sentence Reasoning

Luo, H., & Glass, J. R. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.89 · Cited by 15

COBE: Contextualized Object Embeddings from Narrated Instructional VideoPreprint

Bertasius, G., & Torresani, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.07306 · Cited by 13

VidLanKD: Improving Language Understanding via Video-Distilled Knowledge TransferPreprint

Tang, Z., Cho, J., Tan, H. X., & Bansal, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.02681 · Cited by 13

Graph-free Multi-hop Reading Comprehension: A Select-to-Guide StrategyPreprint

Wu, B., Zhang, Z., & Zhao, H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.11823 · Cited by 24

Benchmarking Multimodal AutoML for Tabular Data with Text FieldsPreprint

Shi, X., Mueller, J. W., Erickson, N., Li, M., & Smola, A. J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2111.02705 · Cited by 29

Proceedings of the Eighth Workshop on Computational Linguistics and Clinical Psychology

(2022) · doi:10.18653/v1/2022.clpsych-1 · Cited by 12

(Media Attention to) Misinformation can Undermine Trust in Information ScientistsPreprint

Hoes, E., von Hohenberg, B. C., Gessler, T., Qian, S., & Wojcieszak, M. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/4m92p · Cited by 14

A Primer on Large Language Models and their LimitationsPreprint

Johnson, S., & Hyland-Wood, D. (2025) · Qeios · doi:10.32388/nhjyvs · Cited by 20

Classifying OSHA construction accident reports: leveraging ensemble learning and lightweight large language models (l-LLMs)

Wang, J., Wu, S., Qu, Z., Shen, J., Memon, S. A., Skitmore, M., & Ma, L. (2025) · Engineering Construction & Architectural Management · doi:10.1108/ecam-08-2025-1273 · Cited by 14

Learning to Predict User-Defined Types

Jesse, K., Dévanbu, P., & Sawant, A. A. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2022.3178945 · Cited by 15

Answer Uncertainty and Unanswerability in Multiple-Choice Machine Reading Comprehension

Raina, V., & Gales, M. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.82 · Cited by 11

Transformer-based Sentiment Analysis for Anomaly Detection on Drone Forensic Timeline

Silalahi, S., Ahmad, T., & Studiawan, H. (2023) · International Symposium on Digital Forensics and Security (ISDFS) · doi:10.1109/isdfs58141.2023.10131749 · Cited by 12

A Brief Survey of Text Classification Methods

Jiao, Q. (2023) · IEEE International Conference on Information Technology, Big Data and Artificial Intelligence (ICIBA) · doi:10.1109/iciba56860.2023.10165621 · Cited by 14

XLNet Transfer Learning Model for Sentimental Analysis

Dhivyaa, C. R., Nithya, K., Sendooran, G., Sudhakar, R., Kumar, K. S., & Kumar, S. (2023) · International Conference on Sustainable Computing and Smart Systems (ICSCSS) · doi:10.1109/icscss57650.2023.10169445 · Cited by 12

Hybrid Uncertainty Quantification for Selective Text Classification in Ambiguous Tasks

Vazhentsev, A., Kuzmin, G., Tsvigun, A., Panchenko, A., Panov, M., Burtsev, M., & Shelmanov, A. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.652 · Cited by 17

DSP: Discriminative Soft Prompts for Zero-Shot Entity and Relation Extraction

Lv, B., Liu, X., Dai, S., Liu, N., Yang, F., Luo, P., & Yu, Y. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.339 · Cited by 11

Case-Based Reasoning with Language Models for Classification of Logical Fallacies

Sourati, Z., Ilievski, F., Sandlin, H.-Â., & Mermoud, A. (2023) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2023/576 · Cited by 25

TacoPrompt: A Collaborative Multi-Task Prompt Learning Method for Self-Supervised Taxonomy Completion

Xu, H., Liu, C., Niu, Y., Chen, Y., Cai, X., Wen, Y., & Yuan, X. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.979 · Cited by 13

A bilingual benchmark for evaluating large language models

Alkaoud, M. (2024) · PeerJ Computer Science · doi:10.7717/peerj-cs.1893 · Cited by 12

Chebifier: automating semantic classification in ChEBI to accelerate data-driven discovery

Glauer, M., Neuhaus, F., Flügel, S., Wosny, M., Mossakowski, T., Memariani, A., Schwerdt, J., & Hastings, J. (2024) · Digital Discovery · doi:10.1039/d3dd00238a · Cited by 11

Training Experimental Language Models with Low Resources, for the Hungarian Language

Yang, Z. G., & Váradi, T. (2023) · Acta Polytechnica Hungarica · doi:10.12700/aph.20.5.2023.5.11 · Cited by 14

Automated Text Scoring in the Age of Generative AI for the GPU-poor

Ormerod, C. M., & Kwako, A. (2024) · Chinese/English Journal of Educational Measurement and Evaluation · doi:10.59863/okuu1904 · Cited by 20

Multi-pattern retrieval-augmented framework for Text-to-SQL with Poincaré-Skeleton retrieval and meta-instruction reasoning

Guo, C., Tian, Z., Tang, J., Li, S., & Wang, T. (2024) · Information Processing & Management · doi:10.1016/j.ipm.2024.103978 · Cited by 15

On Robustness of Neural Semantic Parsers

Huang, S., Li, Z., Qu, L., & Pan, L. (2021) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2021.eacl-main.292 · Cited by 14

Towards Performance of NLP Transformers on URL-Based Phishing Detection for Mobile Devices

(2022) · Journal of Ubiquitous Systems and Pervasive Networks · doi:10.5383/juspn.17.01.005 · Cited by 13

End-to-end Speech-to-Punctuated-Text Recognition

Nozaki, J., Kawahara, T., Ishizuka, K., & Hashimoto, T. (2022) · Interspeech (USB) · doi:10.21437/interspeech.2022-5 · Cited by 17

Don’t Forget About Pronouns: Removing Gender Bias in Language Models Without Losing Factual Gender Information

Limisiewicz, T., & Mareček, D. (2022) · Proceedings of the 4th Workshop on Gender Bias in Natural Language Processing (GeBNLP) · doi:10.18653/v1/2022.gebnlp-1.3 · Cited by 11

The use of annotations to explain labels: Comparing results from a human‐rater approach to a deep learning approach

Lottridge, S. M., Woolf, S., Young, M., Jafari, A., & Ormerod, C. (2023) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12784 · Cited by 11

Compression Methods for Transformers in Multidomain Sentiment Analysis

Korczyński, W., & Kocoń, J. (2022) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw58026.2022.00062 · Cited by 11

A Recursive tree-structured neural network with goal forgetting and information aggregation for solving math word problems

Xiao, J., Huang, L., Song, Y. C., & Tang, N. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103324 · Cited by 11

Farewell to Aimless Large-scale Pretraining: Influential Subset Selection for Language Model

Wang, X., Zhou, W., Zhang, Q., Zhou, J., Gao, S., Wang, J., Zhang, M., Gao, X., Chen, Y. W., & Gui, T. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.35 · Cited by 14

PTCSpell: Pre-trained Corrector Based on Character Shape and Pinyin for Chinese Spelling Correction

Wei, X., Huang, J., Yu, H., & Liu, Q. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.394 · Cited by 12

Toward Expanding the Scope of Radiology Report Summarization to Multiple Anatomies and Modalities

Chen, Z., Varma, M., Wan, X., Langlotz, C. P., & Delbrouck, J.-B. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-short.41 · Cited by 17

Factual Accuracy is not Enough: Planning Consistent Description Order for Radiology Report Generation

Nishino, T., Miura, Y., Taniguchi, T., Ohkuma, T., Suzuki, Y., Kido, S., & Tomiyama, N. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.480 · Cited by 14

Randomized Quantization: A Generic Augmentation for Data Agnostic Self-supervised Learning

Wu, H., Lei, C., Sun, X., Wang, P., Chen, Q., Cheng, K.-T. T., Lin, S. C.-F., & Wu, Z. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01494 · Cited by 12

Paraphrase Identification with Lexical, Syntactic and Sentential Encodings

Xu, S., Shen, X., Fukumoto, F., Li, J., Suzuki, Y., & Nishizaki, H. (2020) · Applied Sciences · doi:10.3390/app10124144 · Cited by 11

Token Drop mechanism for Neural Machine Translation

Zhang, H., Qiu, S., Duan, X., & Zhang, M. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.379 · Cited by 13

Investigating Monolingual and Multilingual BERT Models for Vietnamese Aspect Category Detection

Thin, D. V., Hao, D. N., Hoang, V. X., & Nguyen, N. L.-T. (2022) · RIVF International Conference on Computing and Communication Technologies (RIVF) · doi:10.1109/rivf55975.2022.10013792 · Cited by 12

Attention uncovers task-relevant semantics in emotional narrative understanding

Nguyen, T.-S., Wu, Z., & Ong, D. C. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107162 · Cited by 11

Text Is No More Enough! A Benchmark for Profile-Based Spoken Language Understanding

Xiao, X., Qin, L., Chen, K., Wu, G., Li, L., & Che, W. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21411 · Cited by 12

NYCU_TWD@LT-EDI-ACL2022: Ensemble Models with VADER and Contrastive Learning for Detecting Signs of Depression from Social Media

Wang, W., Tang, Y.-C., Du, W., & Peng, W.-C. (2022) · Workshop on Language Technology for Equality, Diversity, Inclusion (LT-EDI) · doi:10.18653/v1/2022.ltedi-1.15 · Cited by 11

Towards Computationally Feasible Deep Active Learning

Tsvigun, A., Shelmanov, A., Kuzmin, G., Sanochkin, L., Larionov, D., Gusev, G., Avetisian, M., & Евгеньевич, Ж. Л. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.90 · Cited by 11

Toward Zero-Shot and Zero-Resource Multilingual Question Answering

Kuo, C.-C., & Chen, K.-Y. (2022) · IEEE Access · doi:10.1109/access.2022.3207569 · Cited by 12

Task Compass: Scaling Multi-task Pre-training with Task Prefix

Zhang, Z., Wang, S., Yi‐chong, X., Fang, Y., Yu, W., Liu, Y., Zhao, H. Y., Zhu, C., & Zeng, M. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.416 · Cited by 17

Faster Is Not Always Greener : The Costs of LLM-Based Code Optimization (Poster)

Coignion, T., Rouvoy, R., & Quinton, C. (2025) · HAL

Exploring the Performance of ML Model Size for Classification in Relation to Energy Consumption

Bexell, A., Heander, L. G., Söderberg, E., Eldh, S., & Runeson, P. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-12089-2_38

When Faster Isn’t Greener: The Hidden Costs of LLM-Based Code Optimization

Coignion, T., Quinton, C., & Rouvoy, R. (2025) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase63991.2025.00139 · Cited by 1

Large Language Models for Energy-Efficient Code: Emerging Results and Future DirectionsPreprint

Peng, H., Gupte, A., Eliopoulos, N., Ho, C. C., Mantri, R., Deng, L., Jiang, W., Lu, Y.-H., Läufer, K., Thiruvathukal, G. K., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.09241 · Cited by 1

EnergyBench: Holistic Benchmark for Correct and Energy-Efficient LLM-Generated Code

Ionescu, D., Jensen, S. K., & Thomsen, B. (2025) · International Conference on Federated Learning Technologies and Applications (FLTA) · doi:10.1109/flta67013.2025.11336593