The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
A performance comparison of supervised machine learning models for Covid-19 tweets sentiment analysis
Open accessAbstract
The spread of Covid-19 has resulted in worldwide health concerns. Social media is increasingly used to share news and opinions about it. A realistic assessment of the situation is necessary to utilize resources optimally and appropriately. In this research, we perform Covid-19 tweets sentiment analysis using a supervised machine learning approach. Identification of Covid-19 sentiments from tweets would allow informed decisions for better handling the current pandemic situation. The used dataset is extracted from Twitter using IDs as provided by the IEEE data port. Tweets are extracted by an in-house built crawler that uses the Tweepy library. The dataset is cleaned using the preprocessing techniques and sentiments are extracted using the TextBlob library. The contribution of this work is the performance evaluation of various machine learning classifiers using our proposed feature set. This set is formed by concatenating the bag-of-words and the term frequency-inverse document frequency. Tweets are classified as positive, neutral, or negative. Performance of classifiers is evaluated on the accuracy, precision, recall, and F1 score. For completeness, further investigation is made on the dataset using the Long Short-Term Memory (LSTM) architecture of the deep learning model. The results show that Extra Trees Classifiers outperform all other models by achieving a 0.93 accuracy score using our proposed concatenated features set. The LSTM achieves low accuracy as compared to machine learning classifiers. To demonstrate the effectiveness of our proposed feature set, the results are compared with the Vader sentiment analysis technique based on the GloVe feature extraction approach.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
Glove: Global Vectors for Word Representation
Pennington, J., Socher, R., & Manning, C. (2014) · Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/v1/d14-1162 · Cited by 34,071
VADER: a parsimonious rule-based model for sentiment analysis of social media text
Hutto, C., & Gilbert, E. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14550 · Cited by 6,087
Guo (2020) · doi:10.1186/s40779-020-00240-0 · Cited by 4,735
A survey of decision tree classifier methodology
Safavian, S. R., & Landgrebe, D. (1991) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/21.97458 · Cited by 3,808
The COVID-19 social media infodemic
Cinelli, M., Quattrociocchi, W., Galeazzi, A., Valensise, C. M., Brugnoli, E., Schmidt, A. L., Zola, P., Zollo, F., & Scala, A. (2020) · Scientific Reports · doi:10.1038/s41598-020-73510-5 · Cited by 2,313
Deep learning for sentiment analysis: A survey
Zhang, L., Wang, S., & Liu, B. (2018) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1253 · Cited by 1,928
Economic Effects of Coronavirus Outbreak (COVID-19) on the World Economy
Fernandes, N. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3557504 · Cited by 1,881
Li, S., Wang, Y., Xue, J., Zhao, N., & Zhu, T. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17062032 · Cited by 1,835
Top concerns of tweeters during the COVID-19 pandemic: Infoveillance study
Abd-Alrazaq, A., Alhuwail, D., Househ, M., Hamdi, M., & Shah, Z. (2020) · Journal of Medical Internet Research · doi:10.2196/19016 · Cited by 774
A comparative study of TF*IDF, LSI and multi-words for text classification
Zhang, W., Yoshida, T., & Tang, X. (2011) · Expert Systems with Applications · doi:10.1016/j.eswa.2010.08.066 · Cited by 676
Sentiment Analysis of Comment Texts Based on BiLSTM
Xu, G., Meng, Y., Qiu, X., Yu, Z., & Wu, X. (2019) · IEEE Access · doi:10.1109/access.2019.2909919 · Cited by 649
COVID-19 Future Forecasting Using Supervised Machine Learning Models
Rustam, F., Reshi, A. A., Mehmood, A., Ullah, S., On, B.-W., Aslam, W., & Choi, G. S. (2020) · IEEE Access · doi:10.1109/access.2020.2997311 · Cited by 529
Self-citationUsing deep neural network with small dataset to predict material defects
Feng, S., Zhou, H., & Dong, H. (2019) · Materials & Design · doi:10.1016/j.matdes.2018.11.060 · Cited by 512
Phase-adjusted estimation of the number of Coronavirus Disease 2019 cases in Wuhan, China
Wang, H., Wang, Z., Dong, Y., Chang, R., Xu, C., Yu, X., Zhang, S., Tsamlag, L., Shang, M., Huang, J., et al. (2020) · Cell Discovery · doi:10.1038/s41421-020-0148-0 · Cited by 496
Deep Convolution Neural Networks for Twitter Sentiment Analysis
Jianqiang, Z., Xiaolin, G., & Xuejun, Z. (2018) · IEEE Access · doi:10.1109/access.2017.2776930 · Cited by 482
COVID-19 Public Sentiment Insights and Machine Learning for Tweets Classification
Samuel, J., Ali, G. G. M. N., Rahman, M. M., Esawi, E., & Samuel, Y. (2020) · Information · doi:10.3390/info11060314 · Cited by 407
The Porter stemming algorithm: then and now
Willett, P. (2006) · Program · doi:10.1108/00330330610681295 · Cited by 406
Jelodar, H., Wang, Y., Orji, R., & Huang, S. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3001216 · Cited by 400
Chakraborty, K., Bhatia, S., Bhattacharyya, S., Platos, J., Bag, R., & Hassanien, A. E. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106754 · Cited by 375
Twitter discussions and emotions about the COVID-19 pandemic: Machine learning approach
Xue, J., Chen, J., Hu, R., Chen, C., Zheng, C., Su, Y., & Zhu, T. (2020) · Journal of Medical Internet Research · doi:10.2196/20550 · Cited by 369
A Comparative Study of Stemming Algorithms
Jivani, A. G. (2011) · Cited by 361
Sentiment analysis of nationwide lockdown due to COVID 19 outbreak: Evidence from India
Barkur, G., Vibha, & Kamath, G. B. (2020) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2020.102089 · Cited by 350
Iacus, S. M., Natale, F., Santamaria, C., Spyratos, S., & Vespe, M. (2020) · Safety Science · doi:10.1016/j.ssci.2020.104791 · Cited by 348
A Comprehensive Study on Lexicon Based Approaches for Sentiment Analysis
Bonta, V., Kumaresh, N., & Janardhan, N. (2019) · Asian Journal of Computer Science and Technology · doi:10.51983/ajcst-2019.8.s2.2037 · Cited by 344
Imran, A. S., Daudpota, S. M., Kastrati, Z., & Batra, R. (2020) · IEEE Access · doi:10.1109/access.2020.3027350 · Cited by 343
Semantic Pooling for Complex Event Analysis in Untrimmed Videos
Chang, X., Yu, Y.-L., Yang, Y., & Xing, E. P. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2608901 · Cited by 324
Zhang, L.-K., Sun, Y., Zeng, H., Wang, Q., Jiang, X., Shang, W.-J., Wu, Y., Li, S., Zhang, Y.-L., Hao, Z.-N., et al. (2020) · Cell Discovery · doi:10.1038/s41421-020-00235-0 · Cited by 298
Sentiments and emotions evoked by news headlines of coronavirus disease (COVID-19) outbreak
Aslam, F., Awan, T. M., Syed, J. H., Kashif, A., & Parveen, M. (2020) · Humanities and Social Sciences Communications · doi:10.1057/s41599-020-0523-3 · Cited by 272
COVID-19 Sensing: Negative Sentiment Analysis on Social Media in China via BERT Model
Wang, T., Lu, K., Chow, K. P., & Zhu, Q. (2020) · IEEE Access · doi:10.1109/access.2020.3012595 · Cited by 251
Subjectivity and Sentiment Analysis of Modern Standard Arabic
Abdul-Mageed, M., Diab, M., & Korayem, M. (2011) · Cited by 246
Measuring Emotions in the COVID-19 Real World Worry Dataset
Kleinberg, B., van der Vegt, I., & Mozes, M. (2020) · Research portal (Tilburg University) · doi:10.48550/arxiv.2004.04225 · Cited by 192
Sentiment analysis using Support Vector Machine
Zainuddin, N., & Selamat, A. (2014) · 2014 International Conference on Computer, Communications, and Control Technology (I4CT) · doi:10.1109/i4ct.2014.6914200 · Cited by 187
A Survey on Decision Tree Algorithm for Classification
nbspPatel Brijain, R., & Rana, N. K. (2014) · International Journal of Engineering Development and Research · Cited by 186
Tweets Classification on the Base of Sentiments for US Airline Companies
Rustam, F., Ashraf, I., Mehmood, A., Ullah, S., & Choi, G. (2019) · Entropy · doi:10.3390/e21111078 · Cited by 185
Self-citationDeep CNN-LSTM with combined kernels from multiple branches for IMDb review sentiment analysis
Yenter, A., & Verma, A. (2017) · 2017 IEEE 8th Annual Ubiquitous Computing, Electronics and Mobile Communication Conference (UEMCON) · doi:10.1109/uemcon.2017.8249013 · Cited by 170
(2010) · Swinburne figshare (Swinburne University of Technology) · Cited by 151
Machine Learning in Rock Facies Classification: An Application of XGBoost
Zhang, L., & Zhan, C. (2017) · doi:10.1190/igc2017-351 · Cited by 148
Jin, Y., Zhan, Q., Peng, Z., Ren, X., Yin, X., Cai, L., Yuan, Y., Yue, J., Zhang, X., Yang, Q., et al. (2020) · Military Medical Research · doi:10.1186/s40779-020-00270-8 · Cited by 123
Financial Sentiment Lexicon Analysis
Sohangir, S., Petty, N., & Wang, D. (2018) · IEEE International Conference on Semantic Computing (ICSC) · doi:10.1109/icsc.2018.00052 · Cited by 101
Information Re-Sharing on Social Network Sites in the Age of Fake News
Koohikamali, M., & Sidorova, A. (2017) · Informing Science The International Journal of an Emerging Transdiscipline · doi:10.28945/3871 · Cited by 90
Word frequency and sentiment analysis of twitter messages during Coronavirus pandemicPreprint
Rajput, N. K., Grover, B. A., Rathi, V. K., & Bansal, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.03925 · Cited by 88
Sanders, A. C., White, R., Severson, L. S., Ma, R., McQueen, R., Paulo, H. C. A., Zhang, Y., Erickson, J. S., & Bennett, K. P. (2020) · medRxiv · doi:10.1101/2020.08.28.20183863 · Cited by 84
Text Classification with Heterogeneous Information Network Kernels
Wang, C., Song, Y., Li, H., Zhang, M., & Han, J. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10297 · Cited by 82
Survey of Sentiment Analysis Using Deep Learning Techniques
Prabha, M., & Srikanth, G. U. (2019) · International Conference on Innovations in Information and Communication Technology (ICIICT) · doi:10.1109/iciict1.2019.8741438 · Cited by 81
Classification of Shopify App User Reviews Using Novel Multi Text Features
Rustam, F., Mehmood, A., Ahmad, M. I., Ullah, S., Khan, D. M., & Choi, G. S. (2020) · IEEE Access · doi:10.1109/access.2020.2972632 · Cited by 81
Self-citationLi, I., Li, Y., Li, T., Álvarez-Napagao, S., García-Gasulla, D., & Suzumura, T. (2020) · Lecture notes in computer science · doi:10.1007/978-3-030-63799-6_27 · Cited by 63
Sentiment Classification of Chinese Traveler Reviews by Support Vector Machine Algorithm
Zheng, W., & Ye, Q. (2009) · 2009 Third International Symposium on Intelligent Information Technology Application · doi:10.1109/iita.2009.457 · Cited by 58
Vector representation of words for sentiment analysis using GloVe
Sharma, Y., Agrawal, G., Jain, P., & Kumar, T. (2017) · International Conference on Intelligent Communication and Computational Techniques (ICCT) · doi:10.1109/intelcct.2017.8324059 · Cited by 56
Sentiment analysis of Twitter corpus related to artificial intelligence assistants
Park, C. W., & Seo, D. R. (2018) · IEEE International Conference on Industrial Engineering and Applications (ICIEA) · doi:10.1109/iea.2018.8387151 · Cited by 55
Feng, Y., & Zhou, W. (2021) · Information Processing & Management · doi:10.1016/j.ipm.2021.102820 · Cited by 49
Predicting pulsar stars using a random tree boosting voting classifier (RTB-VC)
Rustam, F., Mehmood, A., Ullah, S., Ahmad, M., Khan, D. M., Choi, G. S., & On, B.-W. (2020) · Astronomy and Computing · doi:10.1016/j.ascom.2020.100404 · Cited by 46
Self-citationMining Twitter Data on COVID-19 for Sentiment analysis and frequent patterns DiscoveryPreprint
Drias, H., & Drias, Y. (2020) · medRxiv · doi:10.1101/2020.05.08.20090464 · Cited by 31
Sentiment Classification for Chinese Text Based on Interactive Multitask Learning
Zhang, H., Sun, S., Hu, Y., Liu, J., & Guo, Y. (2020) · IEEE Access · doi:10.1109/access.2020.3007889 · Cited by 28
Xue, J., Chen, J., Hu, R., Chen, C., Zheng, C., & Zhu, T. (2020) · Europe PMC (PubMed Central) · Cited by 10
Cited by
COVID-19 Tweets Classification Based on a Hybrid Word Embedding Method
Didi, Y., Walha, A., & Wali, A. (2022) · Big Data and Cognitive Computing · doi:10.3390/bdcc6020058 · Cited by 38
Metadata
- Authors
- Rustam, F., Khalid, M., Aslam, W., Rupapara, V., Mehmood, A., & Choi, G. S.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2021-02-25
- Volume
- 16
- Issue
- 2
- Pages
- e0245909
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W3131504710
- Cited by
- 313
- References
- 55
- FWCI
- 23.55
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.