Framework for Deep Learning-Based Language Models Using Multi-Task Learning in Natural Language Understanding: A Systematic Literature Review and Future Directions
Open accessAbstract
Learning human languages is a difficult task for a computer. However, Deep Learning (DL) techniques have enhanced performance significantly for almost all-natural language processing (NLP) tasks. Unfortunately, these models cannot be generalized for all the NLP tasks with similar performance. NLU (Natural Language Understanding) is a subset of NLP including tasks, like machine translation, dialogue-based systems, natural language inference, text entailment, sentiment analysis, etc. The advancement in the field of NLU is the collective performance enhancement in all these tasks. Even though MTL (Multi-task Learning) was introduced before Deep Learning, it has gained significant attention in the past years. This paper aims to identify, investigate, and analyze various language models used in NLU and NLP to find directions for future research. The Systematic Literature Review (SLR) is prepared using the literature search guidelines proposed by Kitchenham and Charters on various language models between 2011 and 2021. This SLR points out that the unsupervised learning method-based language models show potential performance improvement. However, they face the challenge of designing the general-purpose framework for the language model, which will improve the performance of multi-task NLU and the generalized representation of knowledge. Combining these approaches may result in a more efficient and robust multi-task NLU. This SLR proposes building steps for a conceptual framework to achieve goals of enhancing the performance of language models in the field of NLU.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The disparity in performance between deep learning and traditional models is considerable across these tasks.
“The disparity in performance between deep learning and traditional models is considerable across these tasks.”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Samant et al. 2022
Both natural language processing and graph learning employ analogous learning methodologies.
“Furthermore, both natural language processing (NLP) and graph learning (GL) employ analogous learning methodologies (Samant et al. 2022).”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Samant et al. 2022
Deep learning algorithms in computer vision display superior efficacy compared to traditional learning algorithms across a broad spectrum of tasks.
“Studies indicate that deep learning algorithms within the field of computer vision (CV), display superior efficacy in contrast to traditional learning algorithms across a broad spectrum of tasks.”
From Large language models (LLMs): survey, technical frameworks, and future challenges (2024) · cites this paper as Samant et al. 2022
The “Models Based on CNN” and “Capsule Neural Network-Based Models” sections discuss CNNs for text and image classification, but do not compare deep learning with traditional algorithms across computer-vision tasks. Searches for computer vision and for comparisons with traditional methods found no passage addressing the claimed superiority. The retrieved passages have no page numbers. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · see citing works
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404 · see citing works
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071 · see citing works
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568 · see citing works
Semi-supervised classification with graph convolutional networks
Kipf, T. N., & Welling, M. (2016) · arXiv · doi:10.48550/arxiv.1609.02907 · Cited by 24,853 · see citing works
Distributed Representations of Words and Phrases and their Compositionality
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1310.4546 · Cited by 24,533 · see citing works
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · see citing works
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · see citing works
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213 · see citing works
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831 · see citing works
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,695 · see citing works
Indexing by latent semantic analysis
Deerwester, S. C., Dumais, S., Furnas, G. W., Landauer, T. K., & Harshman, R. A. (1990) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199009)41:6 · Cited by 12,758 · see citing works
Veličković, P., Cucurull, G., Casanova, A., Romero, A., Liò, P., & Bengio, Y. (2017) · arXiv · doi:10.48550/arxiv.1710.10903 · Cited by 12,107
Graph Attention NetworksPreprint
Veličković, P., Casanova, A., Liò, P., Cucurull, G., Romero, A., & Bengio, Y. (2017) · arXiv (Cornell University) · doi:10.17863/cam.48429 · Cited by 12,099 · see citing works
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983 · see citing works
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000 · see citing works
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687 · see citing works
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · see citing works
Hierarchical Attention Networks for Document Classification
Yang, Z., Yang, D., Dyer, C., He, X., Smola, A. J., & Hovy, E. H. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1174 · Cited by 4,874 · see citing works
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Sanh, V., Debut, L., Chaumond, J., & Wolf, T. (2019) · arXiv · doi:10.48550/arxiv.1910.01108 · Cited by 4,653 · see citing works
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019) · arXiv · doi:10.48550/arxiv.1909.11942 · Cited by 4,308 · see citing works
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222 · see citing works
Dynamic Routing Between Capsules
Sabour, S., Frosst, N., & Hinton, G. E. (2017) · arXiv · doi:10.48550/arxiv.1710.09829 · Cited by 4,167 · see citing works
Universal Language Model Fine-tuning for Text Classification
Howard, J., & Ruder, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1031 · Cited by 4,100 · see citing works
TextRank: Bringing Order into Text
Mihalcea, R. F., & Tarau, P. (2004) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 3,631 · see citing works
A Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1062 · Cited by 3,601 · see citing works
A Neural Probabilistic Language Model
Bengio, Y., Ducharme, R., Vincent, P., Jauvin, C., Jaz, K., Hofmann, T., Poggio, T., & Shawe-Taylor, J. S. (2000) · Cited by 3,451 · see citing works
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
Tai, K. S., Socher, R., & Manning, C. D. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1150 · Cited by 3,081 · see citing works
Graph Convolutional Networks for Text Classification
Yao, L., Mao, C., & Luo, Y. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017370 · Cited by 2,171 · see citing works
SpanBERT: Improving Pre-training by Representing and Predicting Spans
Joshi, M., Chen, D., Liu, Y., Weld, D. S., Zettlemoyer, L., & Levy, O. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00300 · Cited by 1,827 · see citing works
Pre-trained models for natural language processing: A survey
Qiu, X., Sun, T., Xu, Y., Shao, Y., Dai, N., & Huang, X. (2020) · Science China Technological Sciences · doi:10.1007/s11431-020-1647-3 · Cited by 1,591 · see citing works
Document Modeling with Gated Recurrent Neural Network for Sentiment Classification
Tang, D., Qin, B., & Liu, T. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1167 · Cited by 1,538 · see citing works
Training Very Deep NetworksPreprint
Srivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1507.06228 · Cited by 1,453 · see citing works
Hinton, G. E., Krizhevsky, A., & Wang, S. D. (2011) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-21735-7_6 · Cited by 1,360 · see citing works
Unified Language Model Pre-training for Natural Language Understanding and Generation
Dong, L., Yang, N., Wang, W., Wei, F., Liu, X., Wang, Y., Gao, J., Zhou, M., & Hon, H.-W. (2019) · arXiv · doi:10.48550/arxiv.1905.03197 · Cited by 1,225 · see citing works
Recurrent Neural Network for Text Classification with Multi-Task LearningPreprint
Liu, P., Qiu, X., & Huang, X. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.05101 · Cited by 1,209 · see citing works
An overview of multi-task learning
Zhang, Y., & Yang, Q. (2017) · National Science Review · doi:10.1093/nsr/nwx105 · Cited by 1,120 · see citing works
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems
Wang, A., Pruksachatkun, Y., Nangia, N., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. R. (2019) · arXiv · doi:10.48550/arxiv.1905.00537 · Cited by 1,051 · see citing works
Very Deep Convolutional Networks for Text Classification
Conneau, A., Schwenk, H., Barrault, L., & Lecun, Y. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers · doi:10.18653/v1/e17-1104 · Cited by 1,046 · see citing works
ERNIE: Enhanced Representation through Knowledge IntegrationPreprint
Sun, Y., Wang, S., Li, Y., Feng, S., Chen, X., Zhang, H., Tian, X., Zhu, D., Tian, H., & Wu, H. R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.09223 · Cited by 983 · see citing works
Baselines and Bigrams: Simple, Good Sentiment and Topic Classification
Wang, S., & Manning, C. D. (2012) · Cited by 957 · see citing works
FastText.zip: Compressing text classification models
Joulin, A., Grave, E., Bojanowski, P., Douze, M., Jégou, H., & Mikolov, T. (2016) · arXiv · doi:10.48550/arxiv.1612.03651 · Cited by 887 · see citing works
DiSAN: Directional Self-Attention Network for RNN/CNN-Free Language Understanding
Shen, T., Zhou, T., Long, G., Jiang, J., Pan, S., & Zhang, C. (2018) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v32i1.11941 · Cited by 779 · see citing works
Deep Learning for Extreme Multi-label Text Classification
Liu, J., Chang, W.-C., Wu, Y., & Yang, Y. (2017) · Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3077136.3080834 · Cited by 676 · see citing works
A C-LSTM Neural Network for Text ClassificationPreprint
Zhou, C., Sun, C., Liu, Z., & Lau, F. C. M. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1511.08630 · Cited by 666 · see citing works
Li, Z., & Hoiem, D. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_37 · Cited by 659 · see citing works
Adversarial NLI: A New Benchmark for Natural Language Understanding
Nie, Y., Williams, A., Dinan, E., Bansal, M., Weston, J., & Kiela, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.441 · Cited by 656 · see citing works
Caruana, R. (1998) · Learning to Learn · doi:10.1007/978-1-4615-5529-2_5 · Cited by 577 · see citing works
The Natural Language Decathlon: Multitask Learning as Question Answering
McCann, B., Keskar, N. S., Xiong, C., & Socher, R. (2018) · arXiv · doi:10.48550/arxiv.1806.08730 · Cited by 448 · see citing works
GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding
Lepikhin, D., Lee, H., Xu, Y., Chen, D., Firat, O., Huang, Y., Krikun, M., Shazeer, N., & Chen, Z. (2020) · arXiv · doi:10.48550/arxiv.2006.16668 · Cited by 412 · see citing works
Marelli, M., Bentivogli, L., Baroni, M., Raffaella Bernardi, B., Menini, S., & Zamparelli, R. (2014) · International Workshop on Semantic Evaluation (SemEval) · doi:10.3115/v1/s14-2001 · Cited by 378 · see citing works
Gated-Attention Readers for Text Comprehension
Dhingra, B., Liu, H., Yang, Z., Cohen, W., & Salakhutdinov, R. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1168 · Cited by 366 · see citing works
Attention-based LSTM Network for Cross-Lingual Sentiment Classification
Zhou, X., Wan, X., & Xiao, J. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1024 · Cited by 302 · see citing works
The Next Decade in AI: Four Steps Towards Robust Artificial Intelligence
Marcus, G. (2020) · arXiv · doi:10.48550/arxiv.2002.06177 · Cited by 297 · see citing works
Long Short-Term Memory Over Recursive Structures
Zhu, X., Sobihani, P., & Guo, H. (2015) · Cited by 292 · see citing works
Learning Natural Language Inference using Bidirectional LSTM model and Inner-AttentionPreprint
Liu, Y., Sun, C., Lin, L., & Wang, X.-L. (2016) · arXiv.org · doi:10.48550/arxiv.1605.09090 · Cited by 287 · see citing works
Chen, G.-B., Ye, D., Xing, Z., Chen, J., & Cambria, E. (2017) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2017.7966144 · Cited by 261 · see citing works
Improving text classification with weighted word embeddings via a multi-channel TextCNN model
Guo, B., Zhang, C., Liu, J., & Ma, X. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.07.052 · Cited by 250 · see citing works
Stochastic Answer Networks for Machine Reading Comprehension
Liu, X., Shen, Y., Duh, K., & Gao, J. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1157 · Cited by 200 · see citing works
Evaluating Natural Language Understanding Services for Conversational Question Answering Systems
Braun, D., Hernandez-Mendez, A., Matthes, F., & Langen, M. (2017) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/w17-5522 · Cited by 199 · see citing works
Convolutional Recurrent Neural Networks for Text Classification
Wang, R., Li, Z., Cao, J., Chen, T., & Wang, L. (2019) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2019.8852406 · Cited by 198 · see citing works
Text classification using capsules
Kim, J., Jang, S., Park, E., & Choi, S. (2019) · Neurocomputing · doi:10.1016/j.neucom.2019.10.033 · Cited by 191 · see citing works
Multi-Timescale Long Short-Term Memory Neural Network for Modelling Sentences and Documents
Liu, P., Qiu, X., Chen, X., Wu, S., & Huang, X. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1280 · Cited by 182 · see citing works
Efficient Character-level Document Classification by Combining Convolution and Recurrent LayersPreprint
Xiao, Y., & Cho, K. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.00367 · Cited by 166 · see citing works
The NLP Cookbook: Modern Recipes for Transformer Based Deep Learning Architectures
Singh, S. K., & Mahmood, A. (2021) · IEEE Access · doi:10.1109/access.2021.3077350 · Cited by 164 · see citing works
Zhang, Y., & Wallace, B. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1510.03820 · Cited by 153 · see citing works
Out-of-Domain Detection for Natural Language Understanding in Dialog Systems
Zheng, Y., Chen, G., & Huang, M. (2019) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.2983593 · Cited by 141 · see citing works
Dependency Sensitive Convolutional Neural Networks for Modeling Sentences and Documents
Zhang, R., Lee, H., & Radev, D. (2016) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n16-1177 · Cited by 131 · see citing works
Dynamic Entity Representations in Neural Language Models
Ji, Y., Tan, C., Martschat, S., Choi, Y., & Smith, N. A. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1195 · Cited by 95 · see citing works
An Intelligent Chatbot System Based on Entity Extraction Using RASA NLU and Neural Network
Jiao, A. (2020) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1487/1/012014 · Cited by 86 · see citing works
Compositional coding capsule network with k-means routing for text classification
Ren, H., & Lu, H. (2022) · Pattern Recognition Letters · doi:10.1016/j.patrec.2022.05.028 · Cited by 69 · see citing works
Natural Language Understanding (NLU, not NLP) in Cognitive Systems
McShane, M. J. (2017) · AI Magazine · doi:10.1609/aimag.v38i4.2745 · Cited by 68 · see citing works
Dynamic Integration of Background Knowledge in Neural NLU SystemsPreprint
Weissenborn, D., Kočiský, T., & Dyer, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.02596 · Cited by 65 · see citing works
Semantic vector learning for natural language understanding
Jung, S. (2019) · Computer Speech & Language · doi:10.1016/j.csl.2018.12.008 · Cited by 54 · see citing works
Hierarchical Regularization Cascade for Joint Learning
Zweig, A., & Weinshall, D. (2013) · Cited by 48 · see citing works
Efficient Contextualized Representation: Language Model Pruning for Sequence Labeling
Liu, L., Ren, X., Shang, J., Gu, X., Peng, J., & Han, J. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1153 · Cited by 45 · see citing works
Dual Learning for Semi-Supervised Natural Language Understanding
Zhu, S., Cao, R., & Yu, K. (2020) · IEEE/ACM Transactions on Audio Speech and Language Processing · doi:10.1109/taslp.2020.3001684 · Cited by 38 · see citing works
Squeezed Very Deep Convolutional Neural Networks for Text Classification
Duque, A. B., Santos, L. L. J., Macêdo, D., & Zanchettin, C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-30487-4_16 · Cited by 34 · see citing works
Designing a Better Data Representation for Deep Neural Networks and Text Classification
Prusa, J. D., & Khoshgoftaar, T. M. (2016) · IEEE International Conference on Information Reuse and Integration (IRI) · doi:10.1109/iri.2016.61 · Cited by 29 · see citing works
A Dialogue-Act Taxonomy for a Virtual Coach Designed to Improve the Life of Elderly
Montenegro, C., Zorrilla, A. L., Olaso, J. M., Santana, R., Justo, R., Lozano, J. A., & Torres, M. I. (2019) · Multimodal Technologies and Interaction · doi:10.3390/mti3030052 · Cited by 27 · see citing works
Human Annotated Dialogues Dataset for Natural Conversational Agents
Merdivan, E., Singh, D., Hanke, S., Kropf, J., Holzinger, A., & Geist, M. (2020) · Applied Sciences · doi:10.3390/app10030762 · Cited by 24 · see citing works
Auxiliary Task Reweighting for Minimum-data LearningPreprint
Shi, B., Hoffman, J., Saenko, K., Darrell, T., & Xu, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.08244 · Cited by 21 · see citing works
A dynamic goal adapted task oriented dialogue agent
Tiwari, A., Saha, T., Saha, S., Sengupta, S., Maitra, A., Ramnani, R., & Bhattacharyya, P. (2021) · PLoS ONE · doi:10.1371/journal.pone.0249030 · Cited by 16 · see citing works
A Conversational User Interface for Stock Analysis
Lauren, P., & Watta, P. B. (2019) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata47090.2019.9005635 · Cited by 14 · see citing works
Reading and Acting while Blindfolded: The Need for Semantics in Text Game Agents
Yao, S., Narasimhan, K., & Hausknecht, M. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.247 · Cited by 14 · see citing works
Peng, S., & Zeldes, A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.00522 · Cited by 14 · see citing works
Dimovski, M., Musat, C., Ilievski, V., Hossman, A., & Baeriswyl, M. (2018) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/559 · Cited by 11 · see citing works
Zubani, M., Sigalini, L., Serina, I., & Gerevini, A. (2020) · Procedia Computer Science · doi:10.1016/j.procs.2020.09.095 · Cited by 11 · see citing works
dos Reis, E. S., da Costa, C. A., da Silveira, D. E., Bavaresco, R. S., Righi, R. D. R., Barbosa, J. L. V., Antunes, R. S., Gomes, M. M., & Federizzi, G. (2021) · Communications of the ACM · doi:10.1145/3430937 · Cited by 11 · see citing works
Faceted Text Segmentation via Multitask Learning
Wu, B., Wei, B., Liu, J., Wu, K., & Wang, M. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3015996 · Cited by 8 · see citing works
Natural Language Understanding: Methodological Conceptualization
Shymko, V. (2019) · PSYCHOLINGUISTICS · doi:10.31470/2309-1797-2019-25-1-431-443 · Cited by 6 · see citing works
Son, S., Hwang, S., Bae, S., Park, S. J., & Choi, J. (2021) · Applied Sciences · doi:10.3390/app11073095 · Cited by 5 · see citing works
Jenset, G. B., & McGillivray, B. C. (2019) · Machine Learning and Knowledge Extraction · doi:10.3390/make1020037 · Cited by 4 · see citing works
Automatic Labeled Dialogue Generation for Nursing Record Systems
Mairittha, T., Mairittha, N., & Inoue, S. (2020) · Journal of Personalized Medicine · doi:10.3390/jpm10030062 · Cited by 4 · see citing works
Predicting Garden Path Sentences Based on Natural Language Understanding System
Du, J., & Yu, P. (2012) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2012.031101 · Cited by 3 · see citing works
Reading and Acting while Blindfolded: The Need for Semantics in Text Game AgentsPreprint
Yao, S., Narasimhan, K., & Hausknecht, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.13552 · Cited by 3 · see citing works
Enriching Language Models with Semantics
Mayer, T. (2020) · Frontiers in artificial intelligence and applications · doi:10.3233/faia200452 · Cited by 3 · see citing works
VirAAL: Virtual Adversarial Active Learning for NLU
Senay, G., Idrissi, B. Y., & Haziza, M. (2021) · IEEE Spoken Language Technology Workshop (SLT) · doi:10.1109/slt48900.2021.9383576 · Cited by 1 · see citing works
An AI Using Construction Grammar to Understand Text
Kiselev, D. (2020) · International Journal of Cognitive Informatics and Natural Intelligence · doi:10.4018/ijcini.20210401.oa4 · Cited by 1 · see citing works
Chen, T., Wang, Z., Li, L., Li, D., Li, Z., Chang, X., Bian, P., Liang, G., Wang, Q., & Xie, T. (2025) · Schloss Dagstuhl – Leibniz-Zentrum für Informatik · doi:10.4230/lipics.ecoop.2025.6
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805
Gradient Surgery for Multi-Task Learning
Yu, T., Kumar, S., Gupta, A., Levine, S., Hausman, K., & Finn, C. (2020) · arXiv · doi:10.48550/arxiv.2001.06782
Flagged first, then by citations
Research works printed but not linked: 11
- E. S. Dos Reis, C. A. Da Costa, D. E. Da Silveira, and R. S. Bavaresco, ''Transformer aftermath review,'' Commun. ACM, vol. 64, no. 4, pp. 154-163, Apr. 2021.
- A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, and A. N. Gomez, ''Attention is all you need,'' in Proc. Adv. Neural Inf. Process. Syst., Dec. 2017, pp. 5999-6009.
- B. Kitchenham and S. Charters, ''Guidelines for performing systematic literature reviews in SE,'' Guidel. Perform. Syst. Lit. Rev., vol. 3, pp. 1-44, Oct. 2007.
- Q. Le and T. Mikolov, ''Distributed representations of sentences and documents,'' in Proc. Int. Conf. Mach. Learn., 2014, pp. 1188-1196.
- S. Sabour, N. Frosst, and G. Hinton, ''Matrix capsules with em routing,'' in Proc. 6th Int. Conf. Learn. Represent., 2018, pp. 1-15.
- A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, and I. Sutskever, ''Language models are unsupervised multi-task learners,'' OpenAI Blog, vol. 1, no. 8, p. 9, 2019.
- Z. Yang, Z. Dai, Y. Yang, J. Carbonell, R. R. Salakhutdinov, and Q. V. Le, ''XLNet: Generalized autoregressive pre-training for language under- standing,'' in Proc. Adv. Neural Inf. Process. Syst., 2019, pp. 5754-5764.
- A. Wang, A. Singh, J. Michael, F. Hill, O. Levy, and S. R. Bowman, ''GLUE: A multi-task benchmark and analysis platform for natural language understanding,'' 2018, arXiv:1804.07461. · arXiv
- D. Chen, ''A through examination of the CNN/daily mail reading comprehension task,'' in Proc. 54th Annu. Meeting ACL, Berlin, Germany, 2018, pp. 2358-2367.
- W. Che, Y. Liu, Y. Wang, B. Zheng, and T. Liu, ''Towards better UD parsing,'' in Proc. CoNLL, 2018, pp. 55-64.
- E. Tomal and K. D. Forbus, ''EA NLU: Practical language understanding for cognitive modelling,'' in Proc. 22nd Int. Florida Artif. Intell. Res. Soc. Conf., vol. 22, 2009, pp. 117-122.
Cited by
Sorted by citations
Agentic AI: Autonomous intelligence for complex goals–a comprehensive survey
Acharya, D. B., Kuppan, K., & Divya, B. (2025) · IEEE Access · doi:10.1109/access.2025.3532853 · Cited by 717 · see citing works
Large language models (LLMs): survey, technical frameworks, and future challenges
Kumar, P. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10888-y · Cited by 395 · see citing works
Generative artificial intelligence in the metaverse era
Lv, Z. (2023) · Cognitive Robotics · doi:10.1016/j.cogr.2023.06.001 · Cited by 330 · see citing works
McIntosh, T. R., Susnjak, T., Liu, T., Watters, P., Xu, D., Liu, D., & Halgamuge, M. N. (2025) · Technologies · doi:10.3390/technologies13020051 · Cited by 102 · see citing works
“…(NLU) : NLU is central to enhancing the comprehension and contextualization of human language in AI systems, and involves key capabilities such as semantic analysis, named entity recognition, sentiment analysis, textual entailment, and machine reading comprehension [190], [191], [192], [193].”
BackgroundDas, N., Sadhukhan, B., Chatterjee, R., & Chakrabarti, S. (2024) · Decision Analytics Journal · doi:10.1016/j.dajour.2024.100417 · Cited by 73 · see citing works
Jose, S., Nguyen, K. T. P., Medjaher, K., Zemouri, R. M., Lévesque, M., & Tahan, A. S. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2024.124603 · Cited by 67 · see citing works
Hate Speech Detection Using Large Language Models: A Comprehensive Review
Albladi, A., Islam, M., Das, A., Bigonah, M., Zhang, Z., Jamshidi, F., Rahgouy, M., Raychawdhary, N., Marghitu, D., & Seals, C. (2025) · IEEE Access · doi:10.1109/access.2025.3532397 · Cited by 72 · see citing works
Utility of artificial intelligence‐based large language models in ophthalmic care
Biswas, S., Davies, L. N., Sheppard, A. L., Logan, N. S., & Wolffsohn, J. S. (2024) · Ophthalmic and Physiological Optics · doi:10.1111/opo.13284 · Cited by 61 · see citing works
Robust Automatic Modulation Classification in Low Signal to Noise Ratio
An, T. T., & Lee, B. M. (2023) · IEEE Access · doi:10.1109/access.2023.3238995 · Cited by 56 · see citing works
CTRAN: CNN-Transformer-based network for natural language understanding
Rafiepour, M., & Sartakhti, J. S. (2023) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2023.107013 · Cited by 52 · see citing works
Large language models: an overview of foundational architectures, recent trends, and a new taxonomy
Mienye, I. D., Jere, N., Obaido, G., Ogunruku, O. O., Esenogho, E., & Modisane, C. (2025) · Discover Applied Sciences · doi:10.1007/s42452-025-07668-w · Cited by 46 · see citing works
Optimization of Natural Language Understanding with Contextual Embeddings
Sangeetha, R., Srivastava, D., Logeshwaran, J., Vishwakarma, P. K., & Vats, S. (2023) · International Conference on Research Methodologies in Knowledge Management, Artificial Intelligence and Telecommunication Engineering (RMKMATE) · doi:10.1109/rmkmate59243.2023.10369022 · Cited by 50 · see citing works
Upadhyay, R., Phlypo, R., Saini, R., & Liwicki, M. (2024) · IEEE Access · doi:10.1109/access.2024.3478805 · Cited by 45 · see citing works
Zhao, F.-F., He, H.-J., Liang, J.-J., Cen, J., Wang, Y., Lin, H., Chen, F., Li, T., Yang, J., Chen, L., et al. (2024) · Eye · doi:10.1038/s41433-024-03545-9 · Cited by 34 · see citing works
The applications and prospects of big data in perioperative anesthetic management
Zhu, Y., Liu, X., Li, Y., & Yi, B. (2024) · Anesthesiology and Perioperative Science · doi:10.1007/s44254-024-00068-0 · Cited by 33 · see citing works
A review on application of machine learning-based methods for power system inertia monitoring
Heidari, M., Ding, L., Kheshti, M., Bao, W., Zhao, X., Popov, M., & Terzija, V. V. (2024) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2024.110279 · Cited by 30 · see citing works
Leveraging Large Language Models for Enhancing Safety in Maritime Operations
Miller, T. I., Durlik, I., Kostecka, E., Łobodzińska, A., Łazuga, K., & Kozlovska, P. (2025) · Applied Sciences · doi:10.3390/app15031666 · Cited by 31 · see citing works
On tacit knowledge management in product design: status, challenges, and trends
Sun, X., Huang, R., Jiang, Z., Lu, J., & Yang, S. (2024) · Journal of Engineering Design · doi:10.1080/09544828.2023.2301232 · Cited by 31 · see citing works
A Multi-Lingual Speech Recognition-Based Framework to Human-Drone Interaction
Choutri, K., Lagha, M., Meshoul, S., Batouche, M., Kacel, Y., & Mebarkia, N. (2022) · Electronics · doi:10.3390/electronics11121829 · Cited by 25 · see citing works
Torbarina, L., Ferkovic, T., Roguski, Ł., Mihelčić, V., Šarlija, B., & Kraljević, Ž. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2024.100076 · Cited by 29 · see citing works
Evaluation of Transfer Learning and Adaptability in Large Language Models with the GLUE BenchmarkPreprint
Sulaiman, N., & Hamzah, F. (2024) · doi:10.36227/techrxiv.171077989.99407624/v1 · Cited by 20 · see citing works
Wang, H., Yao, Z., Li, T., Zhan, Y., Wu, X., Hao, S., Liu, M., Wang, Z., & Gu, T. (2023) · Ecological Indicators · doi:10.1016/j.ecolind.2023.110788 · Cited by 18 · see citing works
Machine learning-based inertia estimation in power systems: a review of methods and challenges
Diggikar, S., Patil, A., Satyapal, K. S., & Samad, K. (2025) · Energy Informatics · doi:10.1186/s42162-025-00496-7 · Cited by 16 · see citing works
Nabavi, S. F., Garmestani, H., & Fekri, F. (2025) · Journal of Manufacturing Processes · doi:10.1016/j.jmapro.2025.11.035 · Cited by 19 · see citing works
The Era of Metaverse and Generative Artificial Intelligence
Ali, S. I., Shaikh, M. S., Shahane, S., Sharma, K., & Macwan, K. (2024) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3693-9173-0.ch002 · Cited by 15 · see citing works
Streamlined Transmission: A Semantic-Aware XR Deployment Framework Enhanced by Generative AI
Yang, W., Xiong, Z., Quek, T. Q. S., & Shen, X. (2024) · IEEE Network · doi:10.1109/mnet.2024.3414398 · Cited by 13 · see citing works
Comparison of Leading AI Models an Analytical Study of ChatGPT Google Bard and Microsoft Bing
Adomako, P., Khan, T. A., Ali, R. H., & Koutaly, R. (2025) · ADCAIJ ADVANCES IN DISTRIBUTED COMPUTING AND ARTIFICIAL INTELLIGENCE JOURNAL · doi:10.14201/adcaij.31857 · Cited by 13 · see citing works
Citation recommendation based on argumentative zoning of user queries
Ma, S.-T., Zhang, C.-Z., Zhang, H., & Gao, Z. (2025) · J. Informetrics · doi:10.1016/j.joi.2024.101607 · Cited by 15 · see citing works
Deng, Y., Wang, B., Zhu, Q., Liu, J., Kuang, J., & Li, X. (2024) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2024.101958 · Cited by 12 · see citing works
A Comparison Study on AI Language Detector
Singh, A. (2023) · IEEE Annual Computing and Communication Workshop and Conference (CCWC) · doi:10.1109/ccwc57344.2023.10099219 · Cited by 12 · see citing works
Electricity theft recognition and time period detection considering based on multi-task learning
Zheng, S., Gao, Y., Gu, D., Shi, J., Chen, K., & Li, Y. (2023) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2023.109570 · Cited by 10 · see citing works
Zhang, Y., Huan, K., Liu, X., Fan, Y., Cao, X., & Han, X. (2025) · Foods · doi:10.3390/foods14213769 · Cited by 9 · see citing works
Yılmaz, B. E., Özbey, F., Yılmaz, B., & Akpınar, H. (2025) · Journal of Stomatology Oral and Maxillofacial Surgery · doi:10.1016/j.jormas.2025.102644 · Cited by 9 · see citing works
Using large language models to analyze political texts through natural language understanding
Benoit, K. R., de Marchi, S., Laver, C., Laver, M., & Ma, J. (2026) · American Journal of Political Science · doi:10.1111/ajps.70050 · Cited by 9 · see citing works
Bolt Looseness Identification using Faster R-CNN and Grid Mask Augmentation
Panmatharit, N., Jiraraksopakun, Y., Siripanichgorn, A., & Siricharoen, P. (2022) · Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) · doi:10.23919/apsipaasc55919.2022.9980142 · Cited by 8 · see citing works
Perspective Chapter: Recent Trends in Deep Learning for Conversational AI
Wassan, J. T., & Ghuriani, V. (2023) · Artificial intelligence · doi:10.5772/intechopen.113250 · Cited by 8 · see citing works
Meng, Z., & Xu, X. (2024) · Data Technologies and Applications · doi:10.1108/dta-03-2023-0088 · Cited by 7 · see citing works
Impact of an Artificial Intelligence in Language Learning - A survey
Raj, D. D. A. A. R. A., Rukmani, K. V., Rukmani, K. C., Rukmani, P. M., & Rukmani, A. (2024) · International Journal of Scientific Research in Computer Science Engineering and Information Technology · doi:10.32628/cseit2410218 · Cited by 7 · see citing works
A non-deteriorating approach to improve Natural Language Understanding in Conversational Agents
Arevalillo‐Herráez, M., Luise, R. S. A.-D., & Wu, Y. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.129652 · Cited by 7 · see citing works
A Large Language Model and Qualitative Comparative Analysis-Based Study of Trust in E-Commerce
Davoodi, L., & Mezei, J. (2024) · Applied Sciences · doi:10.3390/app142110069 · Cited by 6 · see citing works
Review on Social and Ethical Concerns of Generative AI and IoT
Hazra, S. K. (2024) · Studies in computational intelligence · doi:10.1007/978-981-97-8460-8_13 · Cited by 7 · see citing works
Trisna, K. W., Huang, J., Chen, Y., & Putra, I. G. J. E. (2025) · IEEE Access · doi:10.1109/access.2025.3538621 · Cited by 7 · see citing works
Garlapati, A., Koutharapu, H., & Doddi, N. (2025) · IEEE International Conference on Emerging Technologies and Applications (MPSec ICETA) · doi:10.1109/mpseciceta64837.2025.11118538 · Cited by 5 · see citing works
del Río, J. S., Talavera, A., Fernández‐Pozo, N., Veredas, F. J., & Claros, M. G. (2025) · Journal of Experimental Botany · doi:10.1093/jxb/eraf498 · Cited by 6 · see citing works
Multi-Task Deep Learning Games: Investigating Nash Equilibria and Convergence Properties
Lee, M. (2023) · Axioms · doi:10.3390/axioms12060569 · Cited by 5 · see citing works
Torrisi‐Steele, G. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-2397-8.ch006 · Cited by 4 · see citing works
Neuro-oscillatory models of cortical speech processing
Dogonasheva, O., Giraud, A., Геннадьевич, З. Д., & Gutkin, B. S. (2025) · Neural Networks · doi:10.1016/j.neunet.2025.108194 · Cited by 7 · see citing works
Trustworthy Medical Sentiment Detection for Maternal and Neonatal Healthcare
Marvin, G., Hellen, N., Nabende, J. N., & Alam, M. G. R. (2023) · International Conference on Trends in Electronics and Informatics (ICOEI) · doi:10.1109/icoei56765.2023.10126020 · Cited by 4 · see citing works
Li, F., & Zhang, C. (2024) · Journal of Circuits Systems and Computers · doi:10.1142/s0218126625500215 · Cited by 4 · see citing works
A lightweight model design approach for few-shot malicious traffic classification
Wang, R., Huang, M., Zhao, J., Zhang, H., Zhong, W., Zhang, Z., & He, L. (2024) · Scientific Reports · doi:10.1038/s41598-024-73342-7 · Cited by 4 · see citing works
Yang, J. (2023) · Neural Computing and Applications · doi:10.1007/s00521-023-08624-8 · Cited by 3 · see citing works
Ma, S., Chen, M., Ma, Y., Li, W., Chen, Y., & Li, S. (2026) · Developments in the Built Environment · doi:10.1016/j.dibe.2026.100850 · Cited by 3 · see citing works
Artificial Intelligence Models for Eye Disease Diagnosis: A Systematic Review
Zong, C., Gao, W., Chen, S., & Xiao, F. (2026) · International Journal of Imaging Systems and Technology · doi:10.1002/ima.70301 · Cited by 3 · see citing works
Zheng, J., Almonte, P., Haft, J., Ribas, D., Ortega, A., Lleida, E., Carro, P. L., Losada, M. Á., López, A., Gascón, J. M., et al. (2024) · IEEE SoutheastCon · doi:10.1109/southeastcon52093.2024.10500175 · Cited by 3 · see citing works
Multitask Twin Pinball Kernel Matrix Classifier for Pattern Classification
Chen, C., Pan, H., Tong, J., Wang, Y., Cheng, J., & Zheng, J. (2025) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2025.3552866 · Cited by 3 · see citing works
Wang, R., Fei, J., Zhao, M., Zhang, R., Guo, M., Li, X., & Qi, Z. (2022) · Electronics · doi:10.3390/electronics11213577 · Cited by 3 · see citing works
Standard Latent Space Dimension for Network Intrusion Detection Systems Datasets
Moyano, R. F., Duque, A., Riofrío, D., Pérez, N., Benítez, D. S., Baldeon-Calisto, M., & Fernández, D. (2023) · IEEE Access · doi:10.1109/access.2023.3283567 · Cited by 3 · see citing works
A Feature Selection Approach Towards the Standardization of Network Security Datasets
Moyano, R. F., Duque, A., Riofrío, D., Benítez, D. S., Pérez, N., Baldeon-Calisto, M., & Fernández, D. (2023) · IEEE International Conference on Network Softwarization (NetSoft) · doi:10.1109/netsoft57336.2023.10175497 · Cited by 3 · see citing works
AutoBloom: AI-Based Classification of Cognitive Levels in Educational Content
Shaik, T., Tao, X., Li, L., Sun, Y., Li, Y. H. M., Zhang, J., & Dann, C. E. (2023) · IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT) · doi:10.1109/wi-iat59888.2023.00081 · Cited by 3 · see citing works
GAI in healthcare system: Transforming research in medicine and care for patients
Mahesh, A., Angelin, R. M., Vinodh, K. M., Deepika, P., Sakthidevi, I., & Sathish, C. (2024) · CRC Press eBooks · doi:10.1201/9781003471059-9 · Cited by 3 · see citing works
Kaduskar, V. P., & Kassa, S. R. (2025) · Discover Sustainability · doi:10.1007/s43621-025-01977-1 · Cited by 2 · see citing works
Ansari, S. A., Wajid, M. A., Arif, M., & Wajid, M. S. (2025) · Neurocomputing · doi:10.1016/j.neucom.2025.131450 · Cited by 2 · see citing works
Noisy image enhancements using deep learning techniques
Daurenbekov, K., Aitimova, U., Dauitbayeva, A. O., Sankibayev, A., Tulegenova, E. N., Yerzhan, A., Yerzhanova, A., & Mukhamedrakhimova, G. (2023) · International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering · doi:10.11591/ijece.v14i1.pp811-818 · Cited by 2 · see citing works
Leveraging intent–entity relationships to enhance semantic accuracy in NLU models
Luise, R. S. A.-D., Arevalillo‐Herráez, M., & Wu, Y. (2024) · Neural Computing and Applications · doi:10.1007/s00521-024-09927-0 · Cited by 2 · see citing works
The Future of Medicine: Large Language Models Redefining Healthcare DynamicsPreprint
Haque, A., Chowdhury, M. N.-U.-R., & Neha, F. F. (2023) · doi:10.36227/techrxiv.24354451.v1 · Cited by 2 · see citing works
The Future of Medicine: Large Language Models Redefining Healthcare DynamicsPreprint
Haque, A., Chowdhury, M. N.-U.-R., & Neha, F. F. (2023) · doi:10.36227/techrxiv.24354451.v2 · Cited by 2 · see citing works
Gao, S. (2023) · International Conference on Energy Engineering and Power Systems (EEPS) · doi:10.1109/eeps58791.2023.10256917 · Cited by 1 · see citing works
DAT-MT Accelerated Graph Fusion Dependency Parsing Model for Small Samples in Professional Fields
Li, R., Shili, S., Wang, S., Liu, Y., Li, Y., & Peng, M. (2023) · Entropy · doi:10.3390/e25101444 · Cited by 1 · see citing works
BiLSTM Derin Öğrenme Yöntemi ile Uzun Metinlerden Yeni Özet Metinlerin Türetilmesi
Şahin, O., & Yayla, R. (2024) · Karadeniz Fen Bilimleri Dergisi · doi:10.31466/kfbd.1423022 · Cited by 1 · see citing works
Evaluating Large Language Models: Challenges, Limitations, and Future Directions
Li, L.-H., & Nugroho, A. C. (2025) · Joint International Conference on Digital Arts, Media and Technology with ECTI Northern Section Conference on Electrical, Electronics, Computer and Telecommunications Engineering (ECTI DAMT & NCON) · doi:10.1109/ectidamtncon64748.2025.10961969 · Cited by 1 · see citing works
Gender, Age, and Depression detection with BERT-based multitask model
Oulahbib, I., Benhaddi, M., & Hadaj, S. E. (2025) · International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET) · doi:10.1109/iraset64571.2025.11008193 · Cited by 1 · see citing works
Xiong, Y., Zeng, Y.-M., Liu, H.-N., Sun, Y., Tang, W., & Liu, C. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1582377 · Cited by 1 · see citing works
Zheng, D., & Li, P. (2025) · International Journal of Systems Assurance Engineering and Management · doi:10.1007/s13198-025-02935-w · Cited by 1 · see citing works
An Innovative Speech Translation System for Accurate Idiomatic and Contextual Interpretation
Koreddi, V., Yasmin, N., Divya, N. S., & Somanath, N. (2025) · Algorithms for intelligent systems · doi:10.1007/978-981-96-5265-5_48 · Cited by 1 · see citing works
Pan, H., Chen, C., Hu, W., Zheng, J., Cheng, J., & Wang, J. (2026) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2026.113777 · Cited by 1 · see citing works
A Multitask Cross-Lingual Summary Method Based on ABO Mechanism
Li, Q., Wan, W., & Zhao, Y. (2023) · Applied Sciences · doi:10.3390/app13116723 · Cited by 1 · see citing works
Machine Translation Techniques using AI : A Review
Singh, C., Bansal, R. K., & Bansal, S. (2023) · IEEE International Conference on Computer Vision and Machine Intelligence (CVMI) · doi:10.1109/cvmi59935.2023.10464455 · Cited by 1 · see citing works
Maulana, F. I., Adi, P. D. P., Lestari, D. E., Purnomo, A., & Wangean, D. A. (2024) · Lecture notes in electrical engineering · doi:10.1007/978-981-97-1463-6_26 · Cited by 1 · see citing works
Design and Evaluation of a Medical Chatbot Built on BERT Language Model for Remote Health Assistance
Rao, D. R., Thottempudi, K., Surla, B. K., & Satapathy, A. (2024) · International Conference for Innovation in Technology (INOCON) · doi:10.1109/inocon60754.2024.10511493 · Cited by 1 · see citing works
Deep Learning Based Monocular Depth Estimation for Object Distance Inference in 2D Images
Daniel, G. V., Shritej, K. G., Sai, K. H., & Namith, S. (2024) · International Journal of Innovative Science and Research Technology (IJISRT) · doi:10.38124/ijisrt/ijisrt24apr1431 · Cited by 1 · see citing works
Unveiling the Potential of Machine Learning in Activity Recognition for Industry 4.0
Chiaro, D., Qi, P., Rosa, M. D., Cuomo, S., & Piccialli, F. (2024) · Internet of things · doi:10.1007/978-3-031-60027-2_7 · Cited by 1 · see citing works
Few-Shot Source Separation for IoT Anti-Jamming via Multitask Learning and Meta-Learning
Guo, P., Yu, M., Cheng, L., An, K., Sun, Y., Chatzinotas, S., & Niyato, D. T. (2025) · IEEE Internet of Things Journal · doi:10.1109/jiot.2025.3534578 · Cited by 2 · see citing works
Impact of Artificial Intelligence on Lingual Connection and Its Perspectives
Yahya, H. T. A., Al-Muoaeweed, O., & Bilal, D. A. (2025) · Lecture notes on data engineering and communications technologies · doi:10.1007/978-3-031-81308-5_32 · Cited by 1 · see citing works
Anatomizing Text Without Training Dataset
Raizada, M. (2022) · International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COM-IT-CON) · doi:10.1109/com-it-con54601.2022.9850487
POnSS, una nueva herramienta de segmentación discursiva
Ortiz, A. D. (2022) · Recursos para el Aula de Español investigación y enseñanza · doi:10.37536/rr.1.2.2022.2054
A Deep Detection Model based on Multi-task Learning for Appearance Defect of Solid Propellants
Yan, J., Li, J., Luo, M., Li, B., & Zhang, C. (2022) · Highlights in Science Engineering and Technology · doi:10.54097/hset.v24i.3909
Samson, D., Herman, I. A., Bwalya, I. O., & Penchinkilas, K. (2023) · Asian Journal of Applied Science and Technology · doi:10.38177/ajast.2023.7112
The Future of Medicine: Large Language Models Redefining Healthcare DynamicsPreprint
Haque, A., & Chowdhury, M. N.-U.-R. (2023) · doi:10.36227/techrxiv.24354451
Jagirdar, W. A., & Jamal, M. R. (2023) · International Journal of Computer Applications · doi:10.5120/ijca2023923212
Improving Semantic Analysis in Visualization with Meta Network Representation and Parsing Algorithm
Ji, C., Liu, N., Wang, Z., & Zhen, Y. (2024) · Scalable Computing Practice and Experience · doi:10.12694/scpe.v25i1.2266
Exploring advancements in deep learning for natural language processing tasks
Pandey, A., Ramesh, V., Mittal, P., Suruthi, Muniyandy, E., & Deepa, G. G. (2023) · THE SCIENTIFIC TEMPER · doi:10.58414/scientifictemper.2023.14.4.38
Natural Language Processing to Improve Content Retrieval Performance
Jadhav, V. D., Doda, D. K., Swarup, L., Kumar, R., Pandian, R., & Rufina, P. (2023) · International Conference on Smart Generation Computing, Communication and Networking (SMART GENCON) · doi:10.1109/smartgencon60755.2023.10442867
RetractedEnhancing Sentiment Analysis Using MCNN-BRNN Model with BERT
Almlawi, S., Fang, J., & Li, J. (2023) · International Conference on Electronic Information Engineering and Computer Communication (EIECC) · doi:10.1109/eiecc60864.2023.10456641
Chen, J., & Qi, J. (2023) · International Conference on Network and Information Systems for Computers (ICNISC) · doi:10.1109/icnisc60562.2023.00101
Li, Y. (2024) · Journal of Electrical Systems · doi:10.52783/jes.1704
Taxonomy for Deep Learning in Natural Language ProcessingPreprint
Bhattacharya, K., & Prasad, S. S. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4488754
Palaniappan, J. R. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4487028
Design and Evaluation of English Vocabulary Learning Aids Based on Word Vector Modelling
Long, Y. (2024) · Journal of Electrical Systems · doi:10.52783/jes.3094
- Authors
- Samant, R. M., Bachute, M. R., Gite, S., & Kotecha, K.
- Affiliations
- Symbiosis International University (IN)
- Venue
- IEEE Access
- Published
- 2022
- Volume
- 10
- Pages
- 17078-17097
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4210894209
- Cited by
- 123
- References
- 103
- Citations by year
- 2026: 14 · 2025: 33 · 2024: 40 · 2023: 28 · 2022: 8
- FWCI
- 1.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- public-domain
- creativecommons.org/licenses/by-nc-nd/4.0/ (vor)
- Locations
- IEEE Access (publishedVersion, public-domain)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Keywords
- multi-task learning, natural language understanding, language models, deep learning, conceptual framework, machine translation, dialogue systems, natural language inference, sentiment analysis, knowledge representation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review