ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

Attention Is All You Need

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404

Adam: A Method for Stochastic Optimization

Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325

Glove: Global Vectors for Word Representation

Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071

Efficient Estimation of Word Representations in Vector Space

Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568

GAN（Generative Adversarial Nets）

淳司, 柴. (2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 20,507

RoBERTa: A Robustly Optimized BERT Pretraining Approach

Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515

Unsupervised representation learning with deep convolutional generative adversarial networks

Radford, A., Metz, L., & Chintala, S. (2015) · arXiv · doi:10.48550/arxiv.1511.06434 · Cited by 12,235

Deep Contextualized Word Representations

Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983

Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning

Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 8,608

Aspect-based Document Similarity for Research Papers

Ostendorff, M., Ruas, T., Blume, T., Gipp, B., & Rehm, G. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.545 · Cited by 33

Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrieval

Litschko, R., Vulić, I., Ponzetto, S. P., & Glavaš, G. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-72113-8_23 · Cited by 24

Structure-inducing pre-training

McDermott, M. B. A., Yap, B., Szolovits, P., & Žitnik, M. (2023) · Nature Machine Intelligence · doi:10.1038/s42256-023-00647-z · Cited by 29

Sequence Model with Self-Adaptive Sliding Window for Efficient Spoken Document Segmentation

Zhang, Q., Chen, Q., Li, Y., Liu, J., & Wang, W. (2021) · IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU) · doi:10.1109/asru51503.2021.9688078 · Cited by 27

Modeling Multi-hop Question Answering as Single Sequence Prediction

Yavuz, S., Hashimoto, K., Zhou, Y., Keskar, N. S., & Xiong, C. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.69 · Cited by 28

Modeling Hierarchical Syntax Structure with Triplet Position for Source Code Summarization

Guo, J., Liu, J., Wan, Y., Li, L., & Zhou, P. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.37 · Cited by 23

Pre-training language model incorporating domain-specific heterogeneous knowledge into a unified representation

Zhu, H., Peng, H. M., Lyu, Z., Hou, L., Li, J., & Xiao, J. (2022) · Expert Systems with Applications · doi:10.1016/j.eswa.2022.119369 · Cited by 27

Exploring Natural Language Processing in Model-To-Model Transformations

Danėnas, P., & Skersys, T. (2022) · IEEE Access · doi:10.1109/access.2022.3219455 · Cited by 30

A comprehensive review of State-of-The-Art methods for Java code generation from Natural Language Text

Espejel, J. L., Alassan, M. S. Y., Chouham, E. M., Dahhane, W., & Ettifouri, E. H. (2023) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100013 · Cited by 26

PASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-training

Gu, Z., Fan, J., Tang, N., Nakov, P., Zhao, X., & Du, X. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.331 · Cited by 30

Wine tourism experiences of Chinese tourists: a tourist-centric perspective

Wu, D. C., Cao, C., Wu, J., & Hu, M. (2024) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-07-2023-1003 · Cited by 25

DNCP: An attention-based deep learning approach enhanced with attractiveness and timeliness of News for online news click prediction

Xiong, J., Yu, L., Zhang, D., & Leng, Y. (2021) · Information & Management · doi:10.1016/j.im.2021.103428 · Cited by 23

Disambiguating Clinical Abbreviations using Pre-trained Word Embeddings

Jaber, A., & Martı́nez, P. (2021) · International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC) · doi:10.5220/0010256105010508 · Cited by 23

GhostBERT: Generate More Features with Cheap Operations for BERT

Huang, Z., Hou, L., Shang, L., Jiang, X., Chen, X. D., & Liu, Q. (2021) · doi:10.18653/v1/2021.acl-long.509 · Cited by 23

Fine-Tuned Transformers Show Clusters of Similar Representations Across Layers

Phang, J., Liu, H., & Bowman, S. R. (2021) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2021.blackboxnlp-1.42 · Cited by 24

AVocaDo: Strategy for Adapting Vocabulary to Downstream Domain

Hong, J., Kim, T., Lim, H., & Choo, J. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.385 · Cited by 26

NewsPod: Automatic and Interactive News Podcasts

Laban, P., Ye, E., Korlakunta, S., Canny, J., & Hearst, M. A. (2022) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3490099.3511147 · Cited by 26

Deep learning-based approach for Arabic open domain question answering

Alsubhi, K., Jamal, A. T., & Alhothali, A. (2022) · PeerJ Computer Science · doi:10.7717/peerj-cs.952 · Cited by 24

Uncertainty Estimation of Transformer Predictions for Misclassification Detection

Vazhentsev, A., Kuzmin, G., Shelmanov, A., Tsvigun, A., Tsymbalov, E., Fedyanin, K., Panov, M., Panchenko, A., Gusev, G., Burtsev, M., et al. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.566 · Cited by 22

Comparison of pre-trained language models in terms of carbon emissions, time and accuracy in multi-label text classification using AutoML

Savcı, P., & Daş, B. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e15670 · Cited by 24

MasakhaNEWS: News Topic Classification for African languages

Adelani, D. I., Masiak, M., Azime, I. A., Alabi, J. O., Tonja, A. L., Mwase, C., Ogundepo, O., Dossou, B. F. P., Oladipo, A., Nixdorf, D., et al. (2023) · International Joint Conference on Natural Language Processing and Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (IJCNLP-AACL) · doi:10.18653/v1/2023.ijcnlp-main.10 · Cited by 46

Effective Unsupervised Domain Adaptation with Adversarially Trained Language Models

Vu, T.-T., Phung, D., & Haffari, G. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.497 · Cited by 25

Character-level Representations Improve DRS-based Semantic Parsing Even in the Age of BERT

van Noord, R., Toral, A., & Bos, J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.371 · Cited by 23

Self-Supervised Test-Time Learning for Reading Comprehension

Banerjee, P., Gokhale, T., & Baral, C. R. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.95 · Cited by 30

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing: Student Research Workshop

(2021) · doi:10.18653/v1/2021.acl-srw · Cited by 22

Proceedings of Deep Learning Inside Out (DeeLIO 2022): The 3rd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures

(2022) · doi:10.18653/v1/2022.deelio-1 · Cited by 22

Transfer learning for language model adaptation

Saiful, B. M. (2023) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/169892 · Cited by 22

DirectQE: Direct Pretraining for Machine Translation Quality Estimation

Cui, Q., Huang, S., Li, J., Geng, X., Zheng, Z., Huang, G., & Chen, J. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i14.17506 · Cited by 21

Too Much in Common: Shifting of Embeddings in Transformer Language Models and its Implications

Biś, D., Podkorytov, M., & Liu, X. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.403 · Cited by 33

RoR: Read-over-Read for Long Document Machine Reading Comprehension

Zhao, J., Bao, J., Wang, Y., Zhou, Y., Wu, Y., He, X., & Zhou, B. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.160 · Cited by 22

Testing the Generalization of Neural Language Models for COVID-19 Misinformation Detection

Wahle, J. P., Kumar, N. A., Ruas, T., Meuschke, N., Ghosal, T., & Gipp, B. (2022) · Lecture notes in computer science · doi:10.1007/978-3-030-96957-8_33 · Cited by 21

Exploring the Effects of AI-assisted Emotional Support Processes in Online Mental Health Community

Shin, D., Park, S., Kim, E. H., Kim, S., Seo, J., & Hong, H. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3519854 · Cited by 21

SETTI: A S elf-supervised Adv E rsarial Malware De T ection Archi T ecture in an I oT Environment

Golmaryami, M., Taheri, R., Pooranian, Z., Shojafar, M., & Xiao, P. (2022) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3536425 · Cited by 24

LAD: Layer-Wise Adaptive Distillation for BERT Model Compression

Lin, Y.-J., Chen, K., & Kao, H. (2023) · Sensors · doi:10.3390/s23031483 · Cited by 23

CBCT-guided adaptive radiotherapy using self-supervised sequential domain adaptation with uncertainty estimation

Ebadi, N., Li, R., Das, A., Roy, A., Papanikolaou, N., & Najafirad, P. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.102800 · Cited by 22

Edge-enabled federated sequential recommendation with knowledge-aware Transformer

Wei, S., Meng, S., Li, Q., Zhou, X., Qi, L., & Xu, X. (2023) · Future Generation Computer Systems · doi:10.1016/j.future.2023.06.028 · Cited by 21

Adapting Pretrained Text-to-Text Models for Long Text Sequences

Xiong, W., Gupta, A., Toshniwal, S., Mehdad, Y., & Yih, S. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.370 · Cited by 29

Opportunities and challenges in the application of large artificial intelligence models in radiology

Pan, L., Zhao, Z., Lu, Y., Tang, K., Fu, L., Liang, Q., & Peng, S. (2024) · Meta-Radiology · doi:10.1016/j.metrad.2024.100080 · Cited by 22

Corpus-Level Evaluation for Event QA: The IndiaPoliceEvents Corpus Covering the 2002 Gujarat Violence

Halterman, A., Keith, K. A., Sarwar, S. M., & O’Connor, B. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.371 · Cited by 20

Neural Quality Estimation with Multiple Hypotheses for Grammatical Error Correction

Liu, Z., Yi, X., Sun, M., Yang, L., & Chua, T. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.429 · Cited by 25

Frustratingly Simple Pretraining Alternatives to Masked Language Modeling

Yamaguchi, A., Chrysostomou, G., Margatina, K., & Αλέτρας, Ν. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.249 · Cited by 21

A Multimodal Deep Framework for Derogatory Social Media Post Identification of a Recognized Person

Bhowmick, R. S., Ganguli, I., Paul, J., & Sil, J. (2021) · ACM Transactions on Asian and Low-Resource Language Information Processing · doi:10.1145/3447651 · Cited by 21

Type-Aware Medical Visual Question Answering

Zhang, A., Tao, W., Li, Z., Wang, H., & Zhang, W. (2022) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp43922.2022.9747087 · Cited by 18

Systematic literature review of arabic aspect-based sentiment analysis

Alyami, S., Alhothali, A., & Jamal, A. T. (2022) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2022.07.001 · Cited by 22

An Ensemble of Arabic Transformer-based Models for Arabic Sentiment Analysis

Karfi, I. E., & Fkihi, S. E. (2022) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2022.0130865 · Cited by 20

DynamicRetriever: A Pre-trained Model-based IR System Without an Explicit Index

Zhou, Y., Yao, J., Dou, Z., Wu, L., & Wen, J.-R. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1373-9 · Cited by 39

Medical text classification based on the discriminative pre-training model and prompt-tuning

Wang, Y., Wang, Y., Peng, Z., Zhang, F., Zhou, L., & Yang, F. (2023) · Digital Health · doi:10.1177/20552076231193213 · Cited by 22

GraphCA: Learning from Graph Counterfactual Augmentation for Knowledge Tracing

Wang, X., Zhao, S., Guo, L., Zhu, L., Cui, C., & Xu, L. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123678 · Cited by 21

Automatic quantitative stroke severity assessment based on Chinese clinical named entity recognition with domain-adaptive pre-trained large language model

Gu, Z., He, X., Yu, P., Jia, W., Yang, X., Peng, G., Hu, P., Chen, S., Chen, H., & Lin, Y. (2024) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2024.102822 · Cited by 27

Task-specific Objectives of Pre-trained Language Models for Dialogue AdaptationPreprint

Li, J., Zhang, Z., Zhao, H., Zhou, X., & Zhou, X. (2020) · arXiv (Cornell University) · Cited by 19

Prompting disentangled embeddings for knowledge graph completion with pre-trained language model

Geng, Y., Chen, J., Zeng, Y., Chen, Z., Zhang, W., Pan, J. Z., Wang, Y., & Xu, X. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.126175 · Cited by 20

Probing Task-Oriented Dialogue Representation from Language Models

Wu, C.-S., & Xiong, C. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.409 · Cited by 20

How Can the [MASK] Know? The Sources and Limitations of Knowledge in BERT

Podkorytov, M., Biś, D., & Liu, X. (2021) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn52387.2021.9534299 · Cited by 21

Performance Comparison of Transformer-Based Models on Twitter Health Mention Classification

Khan, P. I., Razzak, I., Dengel, A. R., & Ahmed, S. (2022) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2022.3143768 · Cited by 19

Improving Pretrained Language Model Fine-Tuning With Noise Stability Regularization

Hua, H., Li, X., Dou, D., Xu, C., & Luo, J. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3330926 · Cited by 24

Attention-aware contrastive learning for predicting T cell receptor–antigen binding specificity

Fang, Y., Liu, X., & Liu, H. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac378 · Cited by 20

Topic Classification for Political Texts with Pretrained Language Models

Wang, Y. (2023) · Political Analysis · doi:10.1017/pan.2023.3 · Cited by 18

A benchmark for evaluating Arabic contextualized word embedding models

Elnagar, A., Yagi, S., Mansour, Y., Lulu, L., & Fareh, S. I. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103452 · Cited by 19

On the Evaluation of Neural Code Translation: Taxonomy and Benchmark

Jiao, M., Yu, T., Li, X., Qiu, G., Gu, X., & Shen, B. (2023) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase56229.2023.00114 · Cited by 40

A Cheaper and Better Diffusion Language Model with Soft-Masked Noise

Chen, J., Zhang, A., Li, M., Smola, A. J., & Yang, D. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.289 · Cited by 28

CAR: Conceptualization-Augmented Reasoner for Zero-Shot Commonsense Question Answering

Wang, W., Fang, T., Ding, W., Xu, B., Liu, X., Song, Y., & Bosselut, A. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.902 · Cited by 25

On the effectiveness of small, discriminatively pre-trained language representation models for biomedical text mining

Özyurt, İ. B. (2020) · Workshop on Scholarly Document Processing (SDP) · doi:10.18653/v1/2020.sdp-1.12 · Cited by 18

Show Me How To Revise: Improving Lexically Constrained Sentence Generation with XLNet

He, X., & Li, V. O. K. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i14.17536 · Cited by 19

From Easy to Hard: Two-Stage Selector and Reader for Multi-Hop Question Answering

Li, X., Lei, W.-J., & Yang, Y.-B. (2023) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp49357.2023.10096119 · Cited by 26

Character-based Neural Semantic Parsing

van Noord, R. (2021) · University of Groningen research database (University of Groningen / Centre for Information Technology) · doi:10.33612/diss.169308968 · Cited by 18

An Intelligent Virtual Standard Patient for Medical Students Training Based on Oral Knowledge Graph

Song, W., Hou, X., Li, S., Chen, C., Gao, D., Wang, X., Sun, Y., Hou, J., & Hao, A. (2023) · IEEE Transactions on Multimedia · doi:10.1109/tmm.2022.3205456 · Cited by 18

Repulsive Attention: Rethinking Multi-head Attention as Bayesian Inference

An, B., Lyu, J., Wang, Z., Li, C., Hu, C., Tan, F., Zhang, R., Hu, Y., & Chen, C. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.17 · Cited by 26

Data Efficient Masked Language Modeling for Vision and Language

Bitton, Y., Elhadad, M., Stanovsky, G., & Schwartz, R. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.259 · Cited by 20

Are Factuality Checkers Reliable? Adversarial Meta-evaluation of Factuality in Summarization

Chen, Y., Liu, P., & Qiu, X. (2021) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2021.findings-emnlp.179 · Cited by 21

Transformer-Based Approaches for Legal Text Processing

Nguyen, H.-T., Nguyen, P., Vuong, T.-H.-Y., Bui, M.-Q., Nguyen, M.-C., Dang, T.-B., Tran, V., Nguyen, L.-M., & Satoh, K. (2022) · The Review of Socionetwork Strategies · doi:10.1007/s12626-022-00102-2 · Cited by 21

CTA: Hardware-Software Co-design for Compressed Token Attention Mechanism

Wang, H., Xu, H., Wang, Y., & Han, Y. (2023) · IEEE International Symposium on High-Performance Computer Architecture (HPCA) · doi:10.1109/hpca56546.2023.10070997 · Cited by 18

Efficacy of ELECTRA-based Language Model in Sentiment Analysis

Mala, J. B., J, A. A. S., M, A. R. S., & Rajan, R. (2023) · International Conference on Intelligent Systems for Communication, IoT and Security (ICISCoIS) · doi:10.1109/iciscois56541.2023.10100342 · Cited by 19

On the Use of Transformer-Based Models for Intent Detection Using Clustering Algorithms

Moura, A. D. S., Lima, P., Mendonça, F., Mostafa, S. S., & Morgado‐Dias, F. (2023) · Applied Sciences · doi:10.3390/app13085178 · Cited by 18

Counterfactual can be strong in medical question and answering

Yang, Z., Liu, Y., Ouyang, C., Ren, L., & Wen, W. (2023) · Information Processing & Management · doi:10.1016/j.ipm.2023.103408 · Cited by 19

Patton: Language Model Pretraining on Text-Rich Networks

Jin, B., Zhang, W., Zhang, Y., Yu, M., Zhang, X., Zhu, Q., & Han, J. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.387 · Cited by 52

SERENGETI: Massively Multilingual Language Models for Africa

Adebara, I., Elmadany, A., Abdul-Mageed, M., & Inciarte, A. A. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.97 · Cited by 41

PIEClass: Weakly-Supervised Text Classification with Prompting and Noise-Robust Iterative Ensemble Training

Zhang, Y., Jiang, M., Meng, Y., Zhang, Y., & Han, J. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.780 · Cited by 21

Lexicon-based prompt for financial dimensional sentiment analysis

Wei, L., & Liao, L.-C. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.122936 · Cited by 21

Detect Arabic fake news through deep learning models and Transformers

Alnabrisi, I. K., & Saad, M. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.123997 · Cited by 21

To what extent do human explanations of model behavior align with actual model behavior?

Prasad, G., Nie, Y., Bansal, M., Jia, R., Kiela, D., & Williams, A. (2021) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/2021.blackboxnlp-1.1 · Cited by 22

GNN-LM: Language Modeling based on Global Contexts via GNNPreprint

Meng, Y., Zong, S., Li, X., Sun, X., Zhang, T., Wu, F. Q., & Li, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.08743 · Cited by 30

TextGraphs 2020 Shared Task on Multi-Hop Inference for Explanation Regeneration

Jansen, P. A., & Ustalov, D. (2020) · doi:10.18653/v1/2020.textgraphs-1.10 · Cited by 19

Bidirectional Language Modeling: A Systematic Literature Review

Jahan, M. S., Khan, H. U., Akbar, S., Farooq, M. U., Gul, S., & Amjad, A. (2021) · Scientific Programming · doi:10.1155/2021/6641832 · Cited by 18

Assessing Dialogue Systems with Distribution Distances

Xiang, J., Liu, Y., Cai, D., Li, H., Lian, D., & Liu, L. (2021) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2021.findings-acl.193 · Cited by 23

Pre-training a BERT with Curriculum Learning by Increasing Block-Size of Input Text

Nagatsuka, K., Broni-Bediako, C., & Atsumi, M. (2021) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-072-4_112 · Cited by 19

Contextual Representation Learning beyond Masked Language Modeling

Fu, Z., Zhou, W., Xu, J., Zhou, H., & Li, L. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.193 · Cited by 17

Token Dropping for Efficient BERT Pretraining

Hou, L., Pang, R. Y., Zhou, T., Wu, Y., Song, X., Song, X., & Zhou, D. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.262 · Cited by 27

A Survey of Text Representation Methods and Their Genealogy

Siebers, P., Janiesch, C., & Zschech, P. (2022) · IEEE Access · doi:10.1109/access.2022.3205719 · Cited by 21

Improving BERT with local context comprehension for multi-turn response selection in retrieval-based dialogue systems

Chen, Z., Liu, L., Wan, Y., Chen, Y., Chen, D., Li, W., & Lin, Y. (2023) · Computer Speech & Language · doi:10.1016/j.csl.2023.101525 · Cited by 18

Inductive Biased Swin-Transformer With Cyclic Regressor for Remote Sensing Scene Classification

Hao, S., Li, N., & Ye, Y. (2023) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2023.3290676 · Cited by 18

Gender-tuning: Empowering Fine-tuning for Debiasing Pre-trained Language Models

Ghanbarzadeh, S., Huang, Y., Palangi, H., Cruz Moreno, R., & Khanpour, H. (2023) · Findings of the Association for Computational Linguistics: ACL 2023 · doi:10.18653/v1/2023.findings-acl.336 · Cited by 17

Leveraging Social Media as a Source of Mobility Intelligence: An NLP-Based Approach

Fontes, T., Murços, F., Carneiro, E., Ribeiro, J., & Rossetti, R. J. F. (2023) · IEEE Open Journal of Intelligent Transportation Systems · doi:10.1109/ojits.2023.3308210 · Cited by 21

Transformers with Learnable Activation Functions

Fang, H., Lee, J.-U., Moosavi, N. S., & Gurevych, I. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.181 · Cited by 24

ViDeBERTa: A powerful pre-trained language model for Vietnamese

Tran, C. D., Pham, N. H., Nguyen, A. T., Hy, T. S., & Vu, T. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.79 · Cited by 20

Chinese Cyber Threat Intelligence Named Entity Recognition via RoBERTa-wwm-RDCNN-CRF

Zhen, Z., & Gao, J. J. (2023) · Computers, materials & continua/Computers, materials & continua (Print) · doi:10.32604/cmc.2023.042090 · Cited by 18

Challenges and opportunities for Arabic question-answering systems: current techniques and future directions

Alrayzah, A., Alsolami, F., & Saleh, M. (2023) · PeerJ Computer Science · doi:10.7717/peerj-cs.1633 · Cited by 22

Hadamard Adapter: An Extreme Parameter-Efficient Adapter Tuning Method for Pre-trained Language Models

Chen, Y., Fu, Q., Fan, G., Du, L., Lou, J., Han, S., Zhang, D., Li, Z., & Xiao, Y. (2023) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3583780.3614904 · Cited by 21

How to Boost Face Recognition with StyleGAN?

Sevastopolsky, A., Malkov, Y. A., Durasov, N., Verdoliva, L., & Nießner, M. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01913 · Cited by 18

Training-free retrieval-based log anomaly detection with pre-trained language model considering token-level information

No, G., Lee, Y., Kang, H., & Kang, P. (2024) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2024.108613 · Cited by 21

The role of artificial intelligence algorithms in information systems research: a conceptual overview and avenues for research

Bendig, D., & Bräunche, A. (2024) · Management Review Quarterly · doi:10.1007/s11301-024-00451-y · Cited by 22

Faster Is Not Always Greener : The Costs of LLM-Based Code Optimization (Poster)

Coignion, T., Rouvoy, R., & Quinton, C. (2025) · HAL

Exploring the Performance of ML Model Size for Classification in Relation to Energy Consumption

Bexell, A., Heander, L. G., Söderberg, E., Eldh, S., & Runeson, P. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-12089-2_38

When Faster Isn’t Greener: The Hidden Costs of LLM-Based Code Optimization

Coignion, T., Quinton, C., & Rouvoy, R. (2025) · IEEE/ACM International Conference on Automated Software Engineering (ASE) · doi:10.1109/ase63991.2025.00139 · Cited by 1

Large Language Models for Energy-Efficient Code: Emerging Results and Future DirectionsPreprint

Peng, H., Gupte, A., Eliopoulos, N., Ho, C. C., Mantri, R., Deng, L., Jiang, W., Lu, Y.-H., Läufer, K., Thiruvathukal, G. K., et al. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2410.09241 · Cited by 1

EnergyBench: Holistic Benchmark for Correct and Energy-Efficient LLM-Generated Code

Ionescu, D., Jensen, S. K., & Thomsen, B. (2025) · International Conference on Federated Learning Technologies and Applications (FLTA) · doi:10.1109/flta67013.2025.11336593