Seeing the wood for the trees: How machine learning can help firms in identifying relevant electronic word-of-mouth in social media
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
The increasing volume of firm-related conversations on social media has made it considerably more difficult for marketers to track and analyse electronic word-of-mouth (eWOM) about brands, products or services. Firms often use sentiment analysis to identify relevant eWOM that requires a response to consequently engage in webcare. In this paper, we show that sentiment analysis of any kind might not be ideal for this purpose, because it relies on the questionable assumption that only negative eWOM is response-worthy and it is not able to infer meaning from text. We propose and test an approach based on supervised machine learning that first decides whether eWOM is relevant for the brand to respond, and then—based on a categorization of seven different types of eWOM (e.g., question, complaint)—classifies three customer satisfaction dimensions. Using a dataset of approximately 60,000 Facebook comments and 11,000 tweets about 16 different brands in eight different industries, we test and compare the efficacy of various sentiment analysis, dictionary-based and machine learning techniques to detect relevant eWOM. In doing so, this study identifies response-worthy eWOM based on the content instead of its expressed sentiment. The results indicate that these machine learning techniques achieve considerably higher accuracy in detecting relevant eWOM on social media compared to any kind of sentiment analysis. Moreover, it is shown that industry-specific classifiers can further improve this process and that algorithms are applicable across different social networks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Opinion mining and sentiment analysis
Pang, B., & Lee, L. (2008) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000011 · Cited by 6,372
Using Online Conversations to Study Word-of-Mouth Communication
Godes, D., & Mayzlin, D. (2004) · Marketing Science · doi:10.1287/mksc.1040.0071 · Cited by 2,601
Babić Rosario, A., Sotgiu, F., De Valck, K., & Bijmolt, T. H. A. (2016) · Journal of Marketing Research · doi:10.1509/jmr.14.0380 · Cited by 1,073
Automated Text Analysis for Consumer Research
Humphreys, A., & Wang, R. J.-H. (2018) · Journal of Consumer Research · doi:10.1093/jcr/ucx104 · Cited by 636
Comparing automated text classification methods
Hartmann, J., Huppertz, J., Schamp, C., & Heitmann, M. (2019) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2018.09.009 · Cited by 399
Measuring and Managing Consumer Sentiment in an Online Community Environment
Homburg, C., Ehm, L., & Artz, M. (2015) · Journal of Marketing Research · doi:10.1509/jmr.11.0448 · Cited by 196
Handling consumer messages on social networking sites: Customer service or privacy infringement?
Demmers, J., van Dolen, W. M., & Weltevreden, J. W. J. (2018) · International Journal of Electronic Commerce · doi:10.1080/10864415.2018.1396110 · Cited by 33
Cited by
Dwivedi, Y. K., Ismagilova, E., Hughes, D. L., Carlson, J., Filieri, R., Jacobson, J., Jain, V., Karjaluoto, H., Kefi, H., Krishen, A. S., et al. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2020.102168 · Cited by 4,608
“…employed by companies such as transformational - where the experience and identity of the focal brand exhibits desirable psychological characteristics; in-formational - presents factual product; service information in clear terms and interactional - where social media advertising cultivates…”
BackgroundMachine learning and AI in marketing–Connecting computing power to human insights
Ma, L., & Sun, B. (2020) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2020.04.005 · Cited by 602
Algorithmic bias in machine learning-based marketing models
Akter, S., Dwivedi, Y. K., Sajib, S., Biswas, K., Bandara, R. J., & Michael, K. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2022.01.083 · Cited by 242
Online reviews and product sales: the role of review visibility
Alzate, M., Arce-Urriza, M., & Cebollada, J. (2021) · Journal of Theoretical and Applied Electronic Commerce Research · doi:10.3390/jtaer16040038 · Cited by 45
Basu, R., Aktar, M. N., & Kumar, S. (2025) · Journal of Marketing Analytics · doi:10.1057/s41270-024-00355-6 · Cited by 35
Metadata
- Authors
- Vermeer, S. A. M., Araujo, T., Bernritter, S. F., & van Noort, G.
- Venue
- International Journal of Research in Marketing
- Publisher
- Elsevier BV
- Published
- 2019-09
- Volume
- 36
- Issue
- 3
- Pages
- 492-508
- ISSN
- 0167-8116 (ISSN-L)
- OpenAlex
- W2912773127
- Cited by
- 146
- References
- 8
- FWCI
- 8.63
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Seeing the wood for the trees: How machine learning can help firms in identifying relevant electronic word-of-mouth in social media. https://app.cochat.ai/papers/10.1016/j.ijresmar.2019.01.010
- The paper
- Vermeer, S. A. M., Araujo, T., Bernritter, S. F., & van Noort, G. (2019). Seeing the wood for the trees: How machine learning can help firms in identifying relevant electronic word-of-mouth in social media. International Journal of Research in Marketing. https://doi.org/10.1016/j.ijresmar.2019.01.010
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.