The DOI matches its Crossref record; 152 of the 152 references it cites were found in a registry or an index.
A Survey on Text Classification: From Traditional to Deep Learning
Abstract
Text classification is the most fundamental and essential task in natural language processing. The last decade has seen a surge of research in this area due to the unprecedented success of deep learning. Numerous methods, datasets, and evaluation metrics have been proposed in the literature, raising the need for a comprehensive and updated survey. This paper fills the gap by reviewing the state-of-the-art approaches from 1961 to 2021, focusing on models from traditional models to deep learning. We create a taxonomy for text classification according to the text involved and the models used for feature extraction and classification. We then discuss each of these categories in detail, dealing with both the technical developments and benchmark datasets that support tests of predictions. A comprehensive comparison between different techniques, as well as identifying the pros and cons of various evaluation metrics are also provided in this survey. Finally, we conclude by summarizing key implications, future research directions, and the challenges facing the research area.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
Efficient Estimation of Word Representations in Vector Space
Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013) · arXiv · doi:10.48550/arxiv.1301.3781 · Cited by 26,568
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439
Nearest neighbor pattern classification
Cover, T., & Hart, P. (1967) · IEEE Transactions on Information Theory · doi:10.1109/tit.1967.1053964 · Cited by 16,936
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515
Convolutional Neural Networks for Sentence Classification
Kim, Y. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1181 · Cited by 14,831
Introduction to information retrieval
(2009) · Choice Reviews Online · doi:10.5860/choice.46-2715 · Cited by 12,278
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
Identity mappings in deep residual networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_38 · Cited by 10,741
Identity Mappings in Deep Residual Networks
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · arXiv · doi:10.48550/arxiv.1603.05027 · Cited by 10,665
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.703 · Cited by 8,821
Lewis, M., Liu, Y., Goyal, N., Ghazvininejad, M., Mohamed, A., Levy, O., Stoyanov, V., & Zettlemoyer, L. (2019) · arXiv · doi:10.48550/arxiv.1910.13461 · Cited by 8,816
Text categorization with Support Vector Machines: Learning with many relevant features
Joachims, T. (1998) · Lecture Notes in Computer Science · doi:10.1007/bfb0026683 · Cited by 7,999
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., & Soricut, R. (2019) · arXiv · doi:10.48550/arxiv.1909.11942 · Cited by 4,308
Universal Language Model Fine-tuning for Text Classification
Howard, J., & Ruder, S. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1031 · Cited by 4,100
Understanding of a convolutional neural network
Albawi, S., Mohammed, T. A., & Al-Zawi, S. (2017) · 2017 International Conference on Engineering and Technology (ICET) · doi:10.1109/icengtechnol.2017.8308186 · Cited by 3,986
A Convolutional Neural Network for Modelling Sentences
Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014) · Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.3115/v1/p14-1062 · Cited by 3,601
A large annotated corpus for learning natural language inference
Bowman, S. R., Angeli, G., Potts, C., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1075 · Cited by 3,377
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference
Williams, A., Nangia, N., & Bowman, S. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1101 · Cited by 3,342
A sentimental education: sentiment analysis using subjectivity summarization based on minimum cuts
Pang, B., & Lee, L. (2004) · Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics - ACL '04 · doi:10.3115/1218955.1218990 · Cited by 3,301
Transformer-XL: Attentive language models beyond a fixed-length context
Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q., & Salakhutdinov, R. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1285 · Cited by 3,169
DBpedia – A large-scale, multilingual knowledge base extracted from Wikipedia
Lehmann, J., Isele, R., Jakob, M., Jentzsch, A., Kontokostas, D., Mendes, P. N., Hellmann, S., Morsey, M., van Kleef, P., Auer, S., et al. (2015) · Semantic Web · doi:10.3233/sw-140134 · Cited by 3,168
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
Tai, K. S., Socher, R., & Manning, C. D. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1150 · Cited by 3,081
Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning
Miyato, T., Maeda, S.-I., Koyama, M., & Ishii, S. (2019) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2018.2858821 · Cited by 2,843
RCV1: A New Benchmark Collection for Text Categorization Research
Lewis, D., Yang, Y., Rose, T. G., & Li, F. (2004) · Goldsmiths (University of London) · doi:10.5555/1005332.1005345 · Cited by 2,503
Attention-based LSTM for Aspect-level Sentiment Classification
Wang, Y., Huang, M., zhu, X., & Zhao, L. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1058 · Cited by 2,450
Recurrent Convolutional Neural Networks for Text Classification
Lai, S., Xu, L., Liu, K., & Zhao, J. (2015) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v29i1.9513 · Cited by 2,280
A desicion-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1995) · Lecture Notes in Computer Science · doi:10.1007/3-540-59119-2_166 · Cited by 2,252
Know What You Don't Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · arXiv · doi:10.48550/arxiv.1806.03822 · Cited by 2,242
Know What You Don’t Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2124 · Cited by 2,240
Signature Verification Using A "Siamese" Time Delay Neural Network
BROMLEY, J., BENTZ, J. W., BOTTOU, L., GUYON, I., LECUN, Y., MOORE, C., SÄCKINGER, E., & SHAH, R. (1993) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001493000339 · Cited by 2,077
Graph Convolutional Networks for Text Classification
Yao, L., Mao, C., & Luo, Y. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33017370 · Cited by 1,983
Improved Boosting Algorithms Using Confidence-rated Predictions
Schapire, R. E., & Singer, Y. (1999) · Machine Learning · doi:10.1023/a:1007614523901 · Cited by 1,971
SpanBERT: Improving Pre-training by Representing and Predicting Spans
Joshi, M., Chen, D., Liu, Y., Weld, D. S., Zettlemoyer, L., & Levy, O. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00300 · Cited by 1,827
SpanBERT: Improving Pre-training by Representing and Predicting Spans
Joshi, M., Chen, D., Liu, Y., Weld, D. S., Zettlemoyer, L., & Levy, O. (2019) · arXiv · doi:10.48550/arxiv.1907.10529 · Cited by 1,827
Annotating Expressions of Opinions and Emotions in Language
Wiebe, J., Wilson, T., & Cardie, C. (2005) · Language Resources and Evaluation · doi:10.1007/s10579-005-7880-9 · Cited by 1,755
The PASCAL Recognising Textual Entailment Challenge
Dagan, I., Glickman, O., & Magnini, B. (2006) · Lecture Notes in Computer Science · doi:10.1007/11736790_9 · Cited by 1,628
Pre-trained models for natural language processing: A survey
Qiu, X., Sun, T., Xu, Y., Shao, Y., Dai, N., & Huang, X. (2020) · Science China Technological Sciences · doi:10.1007/s11431-020-1647-3 · Cited by 1,591
SemEval-2017 Task 1: Semantic Textual Similarity Multilingual and Crosslingual Focused Evaluation
Cer, D., Diab, M., Agirre, E., Lopez-Gazpio, I., & Specia, L. (2017) · Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017) · doi:10.18653/v1/s17-2001 · Cited by 1,562
How to Fine-Tune BERT for Text Classification?
Sun, C., Qiu, X., Xu, Y., & Huang, X. (2019) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-32381-3_16 · Cited by 1,534
Document Modeling with Gated Recurrent Neural Network for Sentiment Classification
Tang, D., Qin, B., & Liu, T. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1167 · Cited by 1,519
A Survey on Deep Learning: Algorithms, Techniques, and Applications
Pouyanfar, S., Sadiq, S., Yan, Y., Tian, H., Tao, Y., Reyes, M. P., Shyu, M.-L., Chen, S.-C., & Iyengar, S. S. (2019) · ACM Computing Surveys · doi:10.1145/3234150 · Cited by 1,403
Understanding bag-of-words model: a statistical framework
Zhang, Y., Jin, R., & Zhou, Z.-H. (2010) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-010-0001-0 · Cited by 1,384
Text Classification Algorithms: A Survey
Kowsari, K., Jafari Meimandi, K., Heidarysafa, M., Mendu, S., Barnes, L., & Brown, D. (2019) · Information · doi:10.3390/info10040150 · Cited by 1,312
(2019) · doi:10.18653/v1/p19-1356 · Cited by 1,291
Modeling Relations and Their Mentions without Labeled Text
Riedel, S., Yao, L., & McCallum, A. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-15939-8_10 · Cited by 1,270
Long Short-Term Memory-Networks for Machine Reading
Cheng, J., Dong, L., & Lapata, M. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1053 · Cited by 1,172
Multi-Task Deep Neural Networks for Natural Language Understanding
Liu, X., He, P., Chen, W., & Gao, J. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1441 · Cited by 1,154
Sentiment strength detection for the social web
Thelwall, M., Buckley, K., & Paltoglou, G. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21662 · Cited by 1,062
THE SPECTRUM KERNEL: A STRING KERNEL FOR SVM PROTEIN CLASSIFICATION
LESLIE, C., ESKIN, E., & NOBLE, W. S. (2001) · Biocomputing 2002 · doi:10.1142/9789812799623_0053 · Cited by 927
Encoding Sentences with Graph Convolutional Networks for Semantic Role Labeling
Marcheggiani, D., & Titov, I. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1159 · Cited by 907
WikiQA: A Challenge Dataset for Open-Domain Question Answering
Yang, Y., Yih, W.-T., & Meek, C. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1237 · Cited by 829
Deep Pyramid Convolutional Neural Networks for Text Categorization
Johnson, R., & Zhang, T. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1052 · Cited by 823
Position-aware Attention and Supervised Data Improve Slot Filling
Zhang, Y., Zhong, V., Chen, D., Angeli, G., & Manning, C. D. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1004 · Cited by 798
Bilateral Multi-Perspective Matching for Natural Language Sentences
Wang, Z., Hamza, W., & Florian, R. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/579 · Cited by 739
Unsupervised construction of large paraphrase corpora: exploiting massively parallel news sources
Dolan, B., Quirk, C., & Brockett, C. (2004) · Proceedings of the 20th international conference on Computational Linguistics - COLING '04 · doi:10.3115/1220355.1220406 · Cited by 728
Learning to Rank Short Text Pairs with Convolutional Deep Neural Networks
Severyn, A., & Moschitti, A. (2015) · Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/2766462.2767738 · Cited by 722
ERNIE: Enhanced Representation through Knowledge Integration
Sun, Y., Wang, S., Li, Y., Feng, S., Chen, X., Zhang, H., Tian, X., Zhu, D., Tian, H., & Wu, H. R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.09223 · Cited by 721
Deep Unordered Composition Rivals Syntactic Methods for Text Classification
Iyyer, M., Manjunatha, V., Boyd-Graber, J., & Daumé III, H. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1162 · Cited by 714
Deep Learning for Extreme Multi-label Text Classification
Liu, J., Chang, W.-C., Wu, Y., & Yang, Y. (2017) · Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval · doi:10.1145/3077136.3080834 · Cited by 676
Fake news detection using naive Bayes classifier
Granik, M., & Mesyura, V. (2017) · 2017 IEEE First Ukraine Conference on Electrical and Computer Engineering (UKRCON) · doi:10.1109/ukrcon.2017.8100379 · Cited by 583
PubMed and beyond: a survey of web tools for searching biomedical literature
Lu, Z. (2011) · Database · doi:10.1093/database/baq036 · Cited by 571
Automatic Indexing: An Experimental Inquiry
Maron, M. E. (1961) · Journal of the ACM · doi:10.1145/321075.321084 · Cited by 570 · cited 3×
“For traditional models, NB [8] is the first model used for the text classification task.”
MethodA dirichlet multinomial mixture model-based approach for short text clustering
Yin, J., & Wang, J. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623715 · Cited by 561
Multi-grained Attention Network for Aspect-Level Sentiment Classification
Fan, F., Feng, Y., & Zhao, D. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1380 · Cited by 520
BAE: BERT-based Adversarial Examples for Text Classification
Garg, S., & Ramakrishnan, G. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.498 · Cited by 478
HDLTex: Hierarchical Deep Learning for Text Classification
Kowsari, K., Brown, D. E., Heidarysafa, M., Jafari Meimandi, K., Gerber, M. S., & Barnes, L. E. (2017) · 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA) · doi:10.1109/icmla.2017.0-134 · Cited by 454
Jointly modeling aspects, ratings and sentiments for movie recommendation (JMARS)
Diao, Q., Qiu, M., Wu, C.-Y., Smola, A. J., Jiang, J., & Wang, C. (2014) · Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2623330.2623758 · Cited by 447
Zafrir, O., Boudoukh, G., Izsak, P., & Wasserblat, M. (2019) · 2019 Fifth Workshop on Energy Efficient Machine Learning and Cognitive Computing - NeurIPS Edition (EMC2-NIPS) · doi:10.1109/emc2-nips53020.2019.00016 · Cited by 442
Sequential Short-Text Classification with Recurrent and Convolutional Neural Networks
Lee, J. Y., & Dernoncourt, F. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1062 · Cited by 434
Large-Scale Hierarchical Text Classification with Recursively Regularized Deep Graph-CNN
Peng, H., Li, J., He, Y., Liu, Y., Bao, M., Wang, L., Song, Y., & Yang, Q. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186005 · Cited by 415
Self-citationMulti-label learning by exploiting label dependency
Zhang, M.-L., & Zhang, K. (2010) · Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1835804.1835930 · Cited by 411
Joint Embedding of Words and Labels for Text Classification
Wang, G., Li, C., Wang, W., Zhang, Y., Shen, D., Zhang, X., Henao, R., & Carin, L. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1216 · Cited by 405
Deep Learning Based Text Classification: A Comprehensive Review
Minaee, S., Kalchbrenner, N., Cambria, E., Nikzad, N., Asgari-Chenaghlu, M., & Gao, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.03705 · Cited by 381
Hybrid Attention-Based Prototypical Networks for Noisy Few-Shot Relation Classification
Gao, T., Han, X., Liu, Z., & Sun, M. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016407 · Cited by 379
Marelli, M., Bentivogli, L., Baroni, M., Bernardi, R., Menini, S., & Zamparelli, R. (2014) · Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) · doi:10.3115/v1/s14-2001 · Cited by 378
Investigating Capsule Networks with Dynamic Routing for Text Classification
Yang, M., Zhao, W., Ye, J., Lei, Z., Zhao, Z., & Zhang, S. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1350 · Cited by 366
Hao, Y., Zhang, Y., Liu, K., He, S., Liu, Z., Wu, H., & Zhao, J. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1021 · Cited by 359
Neighbor-weighted K-nearest neighbor for unbalanced text corpus
TAN, S. (2005) · Expert Systems with Applications · doi:10.1016/j.eswa.2004.12.023 · Cited by 345
Heterogeneous Graph Attention Networks for Semi-supervised Short Text Classification
Linmei, H., Yang, T., Shi, C., Ji, H., & Li, X. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1488 · Cited by 326
An improved K-nearest-neighbor algorithm for text categorization
Jiang, S., Pang, G., Wu, M., & Kuang, L. (2012) · Expert Systems with Applications · doi:10.1016/j.eswa.2011.08.040 · Cited by 322
Bayesian Naïve Bayes classifiers to text classification
Xu, S. (2018) · Journal of Information Science · doi:10.1177/0165551516677946 · Cited by 314
Text Level Graph Neural Network for Text Classification
Huang, L., Ma, D., Li, S., Zhang, X., & Wang, H. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1345 · Cited by 314
Combining Knowledge with Deep Convolutional Neural Networks for Short Text Classification
Wang, J., Wang, Z., Zhang, D., & Yan, J. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/406 · Cited by 303
dos Santos, C. N., Tan, M., Xiang, B., & Zhou, B. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.03609 · Cited by 300
Attention-based LSTM Network for Cross-Lingual Sentiment Classification
Zhou, X., Wan, X., & Xiao, J. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1024 · Cited by 297
Improved Representation Learning for Question Answer Matching
Tan, M., dos Santos, C., Xiang, B., & Zhou, B. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1044 · Cited by 250
Deep Multi-Task Learning for Aspect Term Extraction with Memory Interaction
Li, X., & Lam, W. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1310 · Cited by 246
Be More with Less: Hypergraph Attention Networks for Inductive Text Classification
Ding, K., Wang, J., Li, J., Li, D., & Liu, H. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.399 · Cited by 243
Self-citationA simple KNN algorithm for text categorization
Soucy, P., & Mineau, G. W. (2002) · Proceedings 2001 IEEE International Conference on Data Mining · doi:10.1109/icdm.2001.989592 · Cited by 227
A statistical learning learning model of text classification for support vector machines
Joachims, T. (2001) · Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/383952.383974 · Cited by 224
Transfer Capsule Network for Aspect Level Sentiment Classification
Chen, Z., & Qian, T. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1052 · Cited by 218
Taming Pretrained Transformers for Extreme Multi-label Text Classification
Chang, W.-C., Yu, H.-F., Zhong, K., Yang, Y., & Dhillon, I. S. (2020) · Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3394486.3403368 · Cited by 217
PUBLIC: A Decision Tree Classifier that Integrates Building and Pruning
Rastogi, R., & Shim, K. (2000) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009887311454 · Cited by 216
Sentiment Analysis by Capsules
Wang, Y., Sun, A., Han, J., Liu, Y., & Zhu, X. (2018) · Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW '18 · doi:10.1145/3178876.3186015 · Cited by 210
Constructing Narrative Event Evolutionary Graph for Script Event Prediction
Li, Z., Ding, X., & Liu, T. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/584 · Cited by 205
Croce, D., Castellucci, G., & Basili, R. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.191 · Cited by 202
Induction Networks for Few-Shot Text Classification
Geng, R., Li, B., Li, Y., Zhu, X., Jian, P., & Sun, J. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1403 · Cited by 199
Du, J., Vong, C.-M., & Chen, C. L. P. (2021) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2020.2969705 · Cited by 194
Large-Scale Multi-Label Text Classification on EU Legislation
Chalkidis, I., Fergadiotis, E., Malakasiotis, P., & Androutsopoulos, I. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1636 · Cited by 191
Text classification using capsules
Kim, J., Jang, S., Park, E., & Choi, S. (2020) · Neurocomputing · doi:10.1016/j.neucom.2019.10.033 · Cited by 189
Automatic Dialog Act Segmentation and Classification in Multiparty Meetings
Ang, J., Liu, Y., & Shriberg, E. (2006) · Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005. · doi:10.1109/icassp.2005.1415300 · Cited by 178
Peng, H., Li, J., Wang, S., Wang, L., Gong, Q., Yang, R., Li, B., Yu, P. S., & He, L. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2019.2959991 · Cited by 176
Self-citationMulti-Timescale Long Short-Term Memory Neural Network for Modelling Sentences and Documents
Liu, P., Qiu, X., Chen, X., Wu, S., & Huang, X. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1280 · Cited by 174
Reinforced Neighborhood Selection Guided Multi-Relational Graph Neural Networks
Peng, H., Zhang, R., Dou, Y., Yang, R., Zhang, J., & Yu, P. S. (2022) · ACM Transactions on Information Systems · doi:10.1145/3490181 · Cited by 158
Self-citationTopic Memory Networks for Short Text Classification
Zeng, J., Li, J., Song, Y., Gao, C., Lyu, M. R.-T., & King, I. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1351 · Cited by 151
Self-citationDeep Short Text Classification with Knowledge Powered Attention
Chen, J., Hu, Y., Liu, J., Xiao, Y., & Jiang, H. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016252 · Cited by 151
Integrating Semantic Knowledge to Tackle Zero-shot Text Classification
Zhang, J., Lertvittayakumjorn, P., & Guo, Y. (2019) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n19-1108 · Cited by 138
Jiang, T., Wang, D., Sun, L., Yang, H., Zhao, Z., & Zhuang, F. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i9.16974 · Cited by 132
Self-citationThe Fourth Dialog State Tracking Challenge
Kim, S., D’Haro, L. F., Banchs, R. E., Williams, J. D., & Henderson, M. (2016) · Lecture notes in electrical engineering · doi:10.1007/978-981-10-2585-3_36 · Cited by 131
Learning to Discriminate Perturbations for Blocking Adversarial Attacks in Text Classification
Zhou, Y., Jiang, J., Chang, K.-W., & Wang, W. W. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1496 · Cited by 128
MAGNET: Multi-Label Text Classification using Attention-based Graph Neural Network
Pal, A., Selvakumar, M., & Sankarasubbu, M. (2020) · International Conference on Agents and Artificial Intelligence (ICAART) · doi:10.5220/0008940304940505 · Cited by 126
Alsmadi, M. K., Omar, K., Noah, S. A. M., et al. (2009) · IEEE International Advance Computing Conference · doi:10.1109/iadcc.2009.4809024 · Cited by 122
HFT-CNN: Learning Hierarchical Category Structure for Multi-label Short Text Categorization
Shimura, K., Li, J., & Fukumoto, F. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1093 · Cited by 120
Self-citationA decision-tree-based symbolic rule induction system for text categorization
Johnson, D. E., Oles, F. J., Zhang, T., & Goetz, T. (2002) · IBM Systems Journal · doi:10.1147/sj.413.0428 · Cited by 115
Higher-Order Attribute-Enhancing Heterogeneous Graph Neural Networks
Li, J., Peng, H. M., Cao, Y., Dou, Y., Zhang, H., Yu, P. S., & He, L. (2021) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2021.3074654 · Cited by 106
Self-citationConcept-based Short Text Classification and Ranking
Wang, F., Wang, Z., Li, Z., & Wen, J.-R. (2014) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2661829.2662067 · Cited by 102
Hierarchical Multi-label Classification of Text with Capsule Networks
Aly, R., Remus, S., & Biemann, C. (2019) · Annual Meeting of the Association for Computational Linguistics: Student Research Workshop (ACL SRW) · doi:10.18653/v1/p19-2045 · Cited by 101
HTCInfoMax: A Global Model for Hierarchical Text Classification via Information Maximization
Deng, Z., Peng, H. M., He, D., Li, J., & Yu, P. S. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.260 · Cited by 90
Self-citationA Semantics Aware Random Forest for Text Classification
Islam, M. Z., Liu, J., Li, J., Liu, L., & Kang, W. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3357891 · Cited by 81
Self-citationTrain Once, Test Anywhere: Zero-Shot Learning for Text Classification
Pushp, P. K., & Srivastava, M. M. (2017) · arXiv · doi:10.48550/arxiv.1712.05972 · Cited by 74
Event Representation Learning Enhanced with External Commonsense Knowledge
Ding, X., Liao, K., Liu, T., Li, Z., & Duan, J. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1495 · Cited by 72
A quantum-inspired sentiment representation model for twitter sentiment analysis
Zhang, Y., Song, D., Zhang, P., Li, X., & Wang, P. (2019) · Applied Intelligence · doi:10.1007/s10489-019-01441-4 · Cited by 71
Text Graph Transformer for Document Classification
Zhang, H., & Zhang, J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.668 · Cited by 71
Li, Y., Jin, R., & Luo, Y. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy157 · Cited by 65
A nonparametric model for online topic discovery with word embeddings
Chen, J., Gong, Z., & Liu, W. (2019) · Information Sciences · doi:10.1016/j.ins.2019.07.048 · Cited by 64
Wang, T., Liu, L., Liu, N., Zhang, H., Zhang, L., & Feng, S. (2020) · Applied Intelligence · doi:10.1007/s10489-020-01680-w · Cited by 64
T-Miner: A Generative Approach to Defend Against Trojan Attacks on DNN-based Text ClassificationPreprint
Azizi, A., Tahmid, I. A., Waheed, A., Mangaokar, N., Pu, J., Javed, M., Reddy, C. K. A., & Viswanath, B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.04264 · Cited by 60
A Dirichlet process biterm-based mixture model for short text stream clustering
Chen, J., Gong, Z., & Liu, W. (2020) · Applied Intelligence · doi:10.1007/s10489-019-01606-1 · Cited by 56
Generalized Zero-Shot Text Classification for ICD Coding
Song, C., Zhang, S., Sadoughi, N., Xie, P., & Xing, E. P. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/556 · Cited by 53
Cognitive structure learning model for hierarchical multi-label text classification
Wang, B., Hu, X., Li, P., & Yu, P. S. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.106876 · Cited by 51
Self-citationA Deep Neural Architecture for Sentence-Level Sentiment Classification in Twitter Social Networking
Nguyen, H., & Nguyen, L.-M. (2018) · Communications in computer and information science · doi:10.1007/978-981-10-8438-6_2 · Cited by 48
Short Text Classification Using Semantic Random Forest
Bouaziz, A., Dartigues-Pallez, C., Pereira, C. D. C., Precioso, F., & Lloret, P. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10160-6_26 · Cited by 41
Liang, X., Cheng, D., Yang, F., Luo, Y., Qian, W., & Zhou, A. (2020) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2020/619 · Cited by 40
Recurrent Neural Network for Text Classification with Hierarchical Multiscale Dense Connections
Zhao, Y., Shen, Y., & Yao, J. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/757 · Cited by 34
K-Nearest Neighbor Algorithm Optimization in Text Categorization
Chen, S. (2018) · IOP Conference Series Earth and Environmental Science · doi:10.1088/1755-1315/108/5/052074 · Cited by 31
Efficient Strategies for Hierarchical Text Classification: External Knowledge and Auxiliary Tasks
Rojas, K. R., Bustamante, G., Oncevay, A., & Cabezudo, M. A. S. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.205 · Cited by 31
Adams, B., & McKenzie, G. (2018) · Transactions in GIS · doi:10.1111/tgis.12317 · Cited by 28
Sentiment Classification towards Question-Answering with Hierarchical Matching Network
Shen, C., Sun, C., Wang, J., Kang, Y., Li, S., Liu, X., Si, L., Zhang, M., & Zhou, G. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1401 · Cited by 25
Less is More: Attention Supervision with Counterfactuals for Text Classification
Choi, S. L., Park, H., Yeo, J., & Hwang, S.-W. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.543 · Cited by 16
Jiang, T., Wang, D., Sun, L., et al. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2101.03305 · Cited by 14
Self-citationPointing to Select: A Fast Pointer-LSTM for Long Text Classification
Du, J., Huang, Y., & Moilanen, K. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.544 · Cited by 9
TAM: Targeted Analysis Model With Reinforcement Learning on Short Texts
Chen, J., Gong, Z., Wang, W. W., Liu, W., Yang, M. H., & Wang, C. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3009247 · Cited by 8
A Simple yet Brisk and Efficient Active Learning Platform for Text ClassificationPreprint
Kanchinadam, T., You, Q., Westpfahl, K., Kim, J., Gunda, S., Seith, S., & Fung, G. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.00426 · Cited by 2
Cited by
A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4
Kalyan, K. S. (2024) · Natural Language Processing Journal · doi:10.1016/j.nlp.2023.100048 · Cited by 335
Artificial intelligence in multimodal learning analytics: a systematic literature review
Mohammadi, M., Tajik, E., Martinez-Maldonado, R., Sadiq, S., Tomaszewski, W., & Khosravi, H. (2025) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2025.100426 · Cited by 85
Predicting retracted research: a dataset and machine learning approaches
Fletcher, A. H. A., & Stevenson, M. (2025) · Research Integrity and Peer Review · doi:10.1186/s41073-025-00168-w · Cited by 9
Yilmaz, M., Gauthier, A., & Cukurova, M. (2026) · Educational technology research and development · doi:10.1007/s11423-026-10595-1 · Cited by 9
“Recall, on the other hand, calculates how effectively all true positive instances in the feedback are identified (Li et al., 2022).”
Metadata
- Authors
- Li, Q., Peng, H., Li, J., Xia, C., Yang, R., Sun, L., Yu, P. S., & He, L.
- Venue
- ACM Transactions on Intelligent Systems and Technology
- Published
- 2022-04-08
- Volume
- 13
- Issue
- 2
- Pages
- 1-41
- ISSN
- 2157-6904 (ISSN-L)
- 2157-6912
- OpenAlex
- W4226418765
- Cited by
- 494
- References
- 152
- FWCI
- 35.38
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.