The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
The evolution of sentiment analysis—A review of research topics, venues, and top cited papers
Open accessAbstract
Sentiment analysis is one of the fastest growing research areas in computer science, making it challenging to keep track of all the activities in the area. We present a computer-assisted literature review, where we utilize both text mining and qualitative coding, and analyze 6,996 papers from Scopus. We find that the roots of sentiment analysis are in the studies on public opinion analysis at the beginning of 20th century and in the text subjectivity analysis performed by the computational linguistics community in 1990's. However, the outbreak of computer-based sentiment analysis only occurred with the availability of subjective texts on the Web. Consequently, 99% of the papers have been published after 2004. Sentiment analysis papers are scattered to multiple publication venues, and the combined number of papers in the top-15 venues only represent ca. 30% of the papers in total. We present the top-20 cited papers from Google Scholar and Scopus and a taxonomy of research topics. In recent years, sentiment analysis has shifted from analyzing online product reviews to social media texts from Twitter and Facebook. Many topics beyond product reviews like stock markets, elections, disasters, medicine, software engineering and cyberbullying extend the utilization of sentiment analysis
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mining and summarizing customer reviews
Hu, M., & Liu, B. (2004) · Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1014052.1014073 · Cited by 7,793
Thumbs up?: sentiment classification using machine learning techniques
Pang, B., Lee, L., & Vaithyanathan, S. (2002) · Proceedings of the ACL-02 conference on Empirical methods in natural language processing - EMNLP '02 · doi:10.3115/1118693.1118704 · Cited by 7,024
Opinion mining and sentiment analysis
Pang, B., & Lee, L. (2008) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000011 · Cited by 6,372
Graph drawing by force‐directed placement
Fruchterman, T. M. J., & Reingold, E. M. (1991) · Software: Practice and Experience · doi:10.1002/spe.4380211102 · Cited by 6,352
McCabe, T. J. (1976) · IEEE Transactions on Software Engineering · doi:10.1109/tse.1976.233837 · Cited by 6,059
Griffiths, T. L., & Steyvers, M. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307752101 · Cited by 6,049
A metrics suite for object oriented design
Chidamber, S. R., & Kemerer, C. F. (1994) · IEEE Transactions on Software Engineering · doi:10.1109/32.295895 · Cited by 5,669
The journal coverage of Web of Science and Scopus: A comparative analysis
Mongeon, P., & Paul-Hus, A. (2016) · Scientometrics · doi:10.1007/s11192-015-1765-5 · Cited by 5,274
Holzmann, G. J. (1997) · IEEE Transactions on Software Engineering · doi:10.1109/32.588521 · Cited by 3,803
Recognizing contextual polarity in phrase-level sentiment analysis
Wilson, T., Wiebe, J., & Hoffmann, P. (2005) · Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing - HLT '05 · doi:10.3115/1220575.1220619 · Cited by 3,345
Lexicon-based methods for sentiment analysis
Taboada, M., Brooke, J., Tofiloski, M., Voll, K., & Stede, M. (2011) · Computational Linguistics · doi:10.1162/coli_a_00049 · Cited by 3,301
Sentiment Analysis and Opinion Mining
Liu, B. (2012) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02145-9 · Cited by 3,281
QoS-aware middleware for Web services composition
Zeng, L., Benatallah, B., Ngu, A. H. H., Dumas, M., Kalagnanam, J., & Chang, H. (2004) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2004.11 · Cited by 2,757
Predicting Elections with Twitter: What 140 Characters Reveal about Political Sentiment
Tumasjan, A., Sprenger, T., Sandner, P., & Welpe, I. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14009 · Cited by 2,649
Thumbs up or thumbs down?: semantic orientation applied to unsupervised classification of reviews
Turney, P. D. (2001) · Proceedings of the 40th Annual Meeting on Association for Computational Linguistics - ACL '02 · doi:10.3115/1073083.1073153 · Cited by 2,352
From Tweets to Polls: Linking Text Sentiment to Public Opinion Time Series
O'Connor, B., Balasubramanyan, R., Routledge, B., & Smith, N. (2010) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v4i1.14031 · Cited by 1,923
Mining the peanut gallery: opinion extraction and semantic classification of product reviews
Dave, K., Lawrence, S., & Pennock, D. M. (2003) · Proceedings of the twelfth international conference on World Wide Web - WWW '03 · doi:10.1145/775152.775226 · Cited by 1,916
Google Scholar, Scopus and the Web of Science: A Longitudinal and Cross-Disciplinary Comparison
Harzing, A.-W., & Alakangas, S. (2016) · Scientometrics · doi:10.1007/s11192-015-1798-9 · Cited by 1,784 · cited 4×
“As reported by Harzing and Alakangas [Harzing and Alakangas 2016], Google Scholar offers the most comprehensive coverage of the literature, but Scopus follows closely and offers quality inclusion criteria and data exporting features that Scholar does not offer (furthermore, data scraping is…”
BackgroundMethodInfluentialMeasuring praise and criticism: Inference of semantic orientation from association
Turney, P. D., & Littman, M. L. (2003) · ACM Transactions on Information Systems · doi:10.1145/944012.944013 · Cited by 1,502
Techniques and applications for sentiment analysis
Feldman, R. (2013) · Communications of the ACM · doi:10.1145/2436256.2436274 · Cited by 1,489
Ghose, A., & Ipeirotis, P. G. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.188 · Cited by 1,400
New Avenues in Opinion Mining and Sentiment Analysis
Cambria, E., Schuller, B., Xia, Y., & Havasi, C. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.30 · Cited by 1,285
Sentiment strength detection for the social web
Thelwall, M., Buckley, K., & Paltoglou, G. (2012) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21662 · Cited by 1,062
Predicting the semantic orientation of adjectives
Hatzivassiloglou, V., & McKeown, K. R. (1997) · Proceedings of the eighth conference on European chapter of the Association for Computational Linguistics - · doi:10.3115/979617.979640 · Cited by 815
Text mining for market prediction: A systematic review
Khadjeh Nassirtoussi, A., Aghabozorgi, S., Ying Wah, T., & Ngo, D. C. L. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.06.009 · Cited by 615
Van Noorden, R., Maher, B., & Nuzzo, R. (2014) · Nature · doi:10.1038/514550a · Cited by 508
Development and use of a gold-standard data set for subjectivity classifications
Wiebe, J. M., Bruce, R. F., & O'Hara, T. P. (1999) · Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics - · doi:10.3115/1034678.1034721 · Cited by 503
Are they different? Affect, feeling, emotion, sentiment, and opinion detection in text
Munezero, M., Montero, C. S., Sutinen, E., & Pajunen, J. (2014) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2014.2317187 · Cited by 374 · cited 2×
“1 See [14] for the differences between feelings, opinions, sentiment, and emotions in the context of natural language processing.”
BackgroundWeb of Science, Scopus and Google Scholar: A content comprehensiveness comparison
S. Adriaanse, L., & Rensleigh, C. (2013) · The Electronic Library · doi:10.1108/el-12-2011-0174 · Cited by 284
Ferreira, M. P., Santos, J. C., de Almeida, M. I. R., & Reis, N. R. (2014) · Journal of Business Research · doi:10.1016/j.jbusres.2014.03.015 · Cited by 251
Tweeting the terror: modelling the social media reaction to the Woolwich terrorist attack
Burnap, P., Williams, M. L., Sloan, L., Rana, O., Housley, W., Edwards, A., Knight, V., Procter, R., & Voss, A. (2014) · Social Network Analysis and Mining · doi:10.1007/s13278-014-0206-4 · Cited by 240
Analytical mapping of opinion mining and sentiment analysis research during 2000–2015
Piryani, R., Madhavi, D., & Singh, V. K. (2017) · Information Processing & Management · doi:10.1016/j.ipm.2016.07.001 · Cited by 204
On the difficulty of automatically detecting irony: beyond a simple case of negation
Reyes, A., & Rosso, P. (2013) · Knowledge and Information Systems · doi:10.1007/s10115-013-0652-8 · Cited by 172
Citations, research topics and active countries in software engineering: A bibliometrics study
Garousi, V., & Mäntylä, M. (2016) · Computer Science Review · doi:10.1016/j.cosrev.2015.12.002 · Cited by 130
Self-citationAn ELM-based model for affective analogical reasoning
Cambria, E., Gastaldo, P., Bisio, F., & Zunino, R. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.01.064 · Cited by 121
Kozak, M., Bornmann, L., & Loet Leydesdorff, A. (2014) · Scientometrics · doi:10.1007/s11192-014-1439-8 · Cited by 112
Multi-lingual support for lexicon-based sentiment analysis guided by semantics
Hogenboom, A., Heerschop, B., Frăsincar, F., Kaymak, U., & de Jong, F. M. G. (2014) · Decision Support Systems · doi:10.1016/j.dss.2014.03.004 · Cited by 101
Expanding and shifting trends in carbon market research: a quantitative bibliometric study
Du, H., Li, B., Brown, M. A., Mao, G., Rameezdeen, R., & Chen, H. (2014) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2014.05.094 · Cited by 94
Wildgaard, L. (2015) · Scientometrics · doi:10.1007/s11192-015-1608-4 · Cited by 90
The focus on bibliometrics makes papers less useful
Werner, R. F. (2015) · Nature · doi:10.1038/517245a · Cited by 87
Highly-cited papers in software engineering: The top-100
Garousi, V., & Fernandes, J. M. (2015) · Information and Software Technology · doi:10.1016/j.infsof.2015.11.003 · Cited by 87
The Cross-Out Technique as a Method in Public Opinion Analysis
Stagner, R. (1940) · The Journal of Social Psychology · doi:10.1080/00224545.1940.9918734 · Cited by 28
Cited by
A comprehensive survey on sentiment analysis: Approaches, challenges and trends
Birjali, M., Kasri, M., & Beni-Hssane, A. (2021) · Knowledge-Based Systems · doi:10.1016/j.knosys.2021.107134 · Cited by 921
Sentiment Analysis in Social Media and Its Application: Systematic Literature Review
Drus, Z., & Khalid, H. (2019) · Procedia Computer Science · doi:10.1016/j.procs.2019.11.174 · Cited by 408
Machine learning algorithms for social media analysis: A survey
T.K., B., Annavarapu, C. S. R., & Bablani, A. (2021) · Computer Science Review · doi:10.1016/j.cosrev.2021.100395 · Cited by 276
Using VADER sentiment and SVM for predicting customer response sentiment
Borg, A., & Boldt, M. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113746 · Cited by 251
Sentiment analysis: A survey on design framework, applications and future scopes
Bordoloi, M., & Biswas, S. K. (2023) · Artificial Intelligence Review · doi:10.1007/s10462-023-10442-2 · Cited by 183
Metadata
- Authors
- Mäntylä, M. V., Graziotin, D., & Kuutila, M.
- Venue
- Computer Science Review
- Publisher
- Elsevier BV
- Published
- 2018-02
- Volume
- 27
- Pages
- 16-32
- ISSN
- 1574-0137 (ISSN-L)
- OpenAlex
- W2571253853
- Cited by
- 558
- References
- 42
- FWCI
- 21.16
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.