Sentiment Analysis in the Age of Generative AI
Open accessThe DOI matches its Crossref record; 65 of the 66 references it cites were found in a registry or an index; 9 of the 35 sources its claims cite were checked for support.
Abstract
In the rapidly advancing age of Generative AI, Large Language Models (LLMs) such as ChatGPT stand at the forefront of disrupting marketing practice and research. This paper presents a comprehensive exploration of LLMs’ proficiency in sentiment analysis, a core task in marketing research for understanding consumer emotions, opinions, and perceptions. We benchmark the performance of three state-of-the-art LLMs, i.e., GPT-3.5, GPT-4, and Llama 2, against established, high-performing transfer learning models. Despite their zero-shot nature, our research reveals that LLMs can not only compete with but in some cases also surpass traditional transfer learning methods in terms of sentiment classification accuracy. We investigate the influence of textual data characteristics and analytical procedures on classification accuracy, shedding light on how data origin, text complexity, and prompting techniques impact LLM performance. We find that linguistic features such as the presence of lengthy, content-laden words improve classification performance, while other features such as single-sentence reviews and less structured social media text documents reduce performance. Further, we explore the explainability of sentiment classifications generated by LLMs. The findings indicate that LLMs, especially Llama 2, offer remarkable classification explanations, highlighting their advanced human-like reasoning capabilities. Collectively, this paper enriches the current understanding of sentiment analysis, providing valuable insights and guidance for the selection of suitable methods by marketing researchers and practitioners in the age of Generative AI.
Overview
CoChat Summary
TL;DR
This paper benchmarks GPT-3.5, GPT-4, and Llama 2 against fine-tuned transfer learning models for sentiment analysis, finding that LLMs are competitive in zero-shot binary and three-class tasks but not uniformly superior. It also shows that data origin, text characteristics, prompting method, and explainability shape LLM performance.
Key findings
- In binary zero-shot sentiment classification, SiEBERT had the highest average accuracy at 95.8%, followed by GPT-4 at 93.1%, Llama 2 at 90.9%, and GPT-3.5 at 87.7%. In three-class classification, GPT-4 averaged 82.6%, while GPT-3.5 and RoBERTa each averaged 77.7%, and Llama 2 averaged 75.7%.
- Logistic regression across 7,096 documents found that Twitter origin lowered odds of correct prediction by about 65%, three-class tasks lowered odds by approximately 54% to 63%, and “Big Words” positively predicted accuracy across all LLMs. Single-sentence documents reduced accuracy, especially for GPT-4 and Llama 2.
- Prompting effects varied: GPT-3.5 benefited from contextual prompts (odds ratio 1.382, p < 0.001), while GPT-4 and Llama 2 did not significantly benefit. Few-shot prompting improved GPT-4 in seven of eight datasets and GPT-3.5 in five of eight, but reduced Llama 2 accuracy across all datasets, by as much as 8.6 percentage points.
- In explainability, 15 marketing academics rated 96 LLM-generated explanations (1,440 votes). Llama 2 received the highest mean ratings, closely followed by GPT-4, while GPT-3.5 scored lowest; trustworthiness was the lowest-rated dimension for all LLMs.
Methods
- Experiment 1 compared GPT-3.5, GPT-4, and Llama 2 in zero-shot binary and three-class sentiment classification against transfer learning models including SiEBERT and RoBERTa. Binary used 3,120 unique documents from 16 datasets; three-class used 792 documents from four datasets, with 20 datasets total and over 3,900 unique documents overall.
- Experiment 2 tested contextual versus instructive prompts and few-shot versus zero-shot prompting on eight datasets and 1,592 documents. It extracted LIWC and TextAnalyzer linguistic features and ran logistic regressions on 7,096 documents across experiments, with prediction correctness as the dependent variable.
- Experiment 3 surveyed 15 marketing academics who rated 96 classification explanations on understandability, level of detail, and trustworthiness using five-point Likert scales. An OLS regression examined determinants of explainability, including word count and citations.
Limitations
- The paper states that it evaluates only off-the-shelf zero-shot and few-shot LLM use, without fine-tuning or task-specific training, so results likely represent a lower bound of LLM potential. It also notes that aspect-based sentiment analysis and non-text modalities were not tested.
- The paper states reproducibility concerns: temperature zero yields only near-deterministic outputs, closed-source models can change over time, and prompt adjustments can substantially affect performance. It also notes practical constraints around fine-tuning access, proprietary data, and computational cost.
- Evident from the text: the explainability experiment relies on a small survey sample of 15 academics rating 96 explanations, and the benchmark covers a limited set of datasets and model versions, which may constrain generalizability.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
8 Valid · 0 Not valid · 17 Not checked · 139 Own results and interpretations
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Demonstrating a significant advancement, Hartmann et al. (2023) find a superior performance of transfer learning models in sentiment analysis tasks compared to lexicon-based and traditional machine learning approaches, by 20 and 10 percentage points in accuracy, respectively [24].”
§ Sentiment Analysis in the Age of Generative AI > 1 Introduction
What the sources say
- Not checked yetcites Hartmann et al. (2023)
- Supportedcites [24] Hartmann J, Heitmann M, Siebert C et al (2023) More than a Feeling: Accuracy and Application of Sentiment Analysis. Int J Res Mark 40(1):75-87. https:// doi. org/ 10. 1016/j. ijres mar. 2022. 05. 005 source
The Data Description & Model-Free Results section reports that transfer learning outperformed lexicons by 20.22 percentage points and traditional machine learning by 10.77 percentage points in average classification accuracy (p < .01 for both). The citing sentence rounds those figures to 20 and 10 percentage points, respectively. (LLM, conf=0.95)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“RoBERTa, specifically fine-tuned on a corpus of over 5,000 social media posts [23], exhibits the highest accuracy in one of the Twitter dataset (see Table 2, Twitter Various II).”
§ Sentiment Analysis in the Age of Generative AI > 3.3 Results Three-Class Sentiment Analysis
What the sources say
- Partly supportedcites [23] Hartmann J, Heitmann M, Schamp C et al (2021) The Power of Brand Selfies. J Mark Res 58(6):1159-1177. https:// doi. org/ 10. 1177/ 00222 43721 10372 58 sourceExperimental — accuracy not yet measured
Our copy supports the identification half of the claim: Automated Text Classification (p. 9) states they 'classify the sentiment of the caption as positive, neutral, or negative by fine-tuning the RoBERTa language model on 5,304 manually annotated posts (86.1% accuracy for the three classes on 1,327 holdout observations)', i.e. RoBERTa fine-tuned on a corpus of over 5,000 social media posts. However, nothing in our copy supports the comparative assertion that RoBERTa 'exhibits the highest accuracy in one of the Twitter dataset': the paper reports no cross-model or cross-dataset accuracy ranking (searched: classifier accuracy comparison, benchmark/other models). The only comparison it draws is that LIWC-based sentiment 'often produces relatively low levels of accuracy' (p. 9, footnote 5), which credits superior accuracy to their own model rather than establishing a highest-accuracy result on a named Twitter dataset — that ranking appears to come from the citing paper's own Table 2. (LLM, conf=0.72)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Recent studies have indicated that the efficiency of LLMs varies with the nature of the prompts employed [8,57,71].”
§ Sentiment Analysis in the Age of Generative AI > Hartmann et al. (2019 & 2023
What the sources say
- Not checked yetcites [8] Brown T, Mann B, Ryder N et al (2020) Language Models are Few-Shot Learners. In: Larochelle H, Ranzato M, Hadsell R et al (eds) Advances in Neural Information Processing Systems, vol 33. Curran Associates Inc, pp 1877-1901
- Not checked yetcites [57] Reynolds L, McDonell K (2021) Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm. In: Kitamura Y, Quigley A, Isbister K et al (eds) Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, pp 1-7
- Supportedcites [71] Zhou Y, Muresanu AI, Han Z et al. (2022) Large Language Mod- els Are Human-Level Prompt Engineers. arXiv. https:// doi. org/ 10. 48550/ arXiv. 2211. 01910 source
The Abstract (p. 1) states that 'task performance depends significantly on the quality of the prompt used to steer the model,' and the Introduction (pp. 1-2) adds that 'plain language prompts do not always produce the desired results, even when those results are possible to produce with alternative instructions' and that instruction quality 'can only be measured when executing these instructions on a downstream task.' This matches the attributed point that LLM outcomes vary with the prompt used; only the word 'efficiency' is looser than the paper's 'performance/accuracy'. (LLM, conf=0.85)
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Conversely, transfer learning models such as SiEBERT only provide explainability when used in conjunction with other models, such as LIME [21].”
§ Sentiment Analysis in the Age of Generative AI > 6.1 Summary
What the sources say
- Partly supportedcites [21] Hartmann J, Bergner A, Hildebrand C (2023) MindMiner: Uncovering linguistic markers of mind perception as a new lens to understand consumer-smart object relationships. J Consum Psychol 33(4):645-667. https:// doi. org/ 10. 1002/ jcpy. 1381 sourceExperimental — accuracy not yet measured
Our copy supports the general proposition: 'Detecting mind perception using language models' states that language models are 'often considered a "black box," sacrificing interpretability for prediction accuracy' and that 'the current research combines the predictive power of language models with the interpretability of other text-mining methods (i.e., ... semi-supervised LDA, LIME, and LASSO),' and 'Methodological contributions' adds that 'even though language models are often thought of as black boxes ... it is possible to obtain post hoc explanations of such models through interpretable machine learning techniques,' with 'Model-free evidence' showing LIME approximating RoBERTa's nonlinear boundary locally. However, the paper's transfer-learning model is MindMiner, a fine-tuned RoBERTa (BERT-derived) language model; it never mentions SiEBERT/sentence-BERT, and its benchmarked alternatives are word2vec and fastText, so attributing the explainability-with-LIME point specifically to SiEBERT goes beyond what our copy says. (LLM, conf=0.75)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Similar to the findings of other researchers [56,58], this variability in results, which depends on the prompts chosen, poses a reproducibility challenge that is particularly important for researchers in the field of Generative AI.”
§ Sentiment Analysis in the Age of Generative AI > 4.5 Discussion
What the sources say
- Supportedcites [56] Reiss MV (2023) Testing the Reliability of ChatGPT for Text Annotation and Classification: A Cautionary Remark. arXiv. https:// doi. org/ 10. 48550/ arXiv. 2304. 11085 source
The Conclusion says the exact prompt is decisive and that even tiny wording changes can produce inconsistent outputs. The Discussion calls this a problem for research using ChatGPT for text annotation and classification, supporting the cited reproducibility concern. (LLM, conf=0.87)
- Partly supportedcites [58] Rytting CM, Sorensen T, Argyle L et al. (2023) Towards Coding Social Science Datasets with Language Models. arXiv. https:// doi. org/ 10. 48550/ arXiv. 2306. 02177 sourceExperimental — accuracy not yet measured
The Additional information section says small prompt-format changes can significantly alter token probabilities, and Accuracy with Additional Exemplars reports that one choice of response wording significantly worsened performance. But the paper also says prompt engineering generally made little difference to coding performance and that results across many format variations were relatively stable. It does not characterize prompt-dependent results as a particular reproducibility challenge for generative-AI researchers. (LLM, conf=0.84)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
98 more claims
Create a free account to see all 164 claims and to verify the 26 references still open.
- Probably not a substantial claim. 25
- It may state two separate claims as one. 42
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A growing body of research suggests that the recent generation of large language model (LLMs) excel, and in many cases outpace humans, at writing persuasively and empathetically, at inferring user traits from text, and at mimicking human-like conversation believably and effectively—without possessing any true empathy or social understanding.”
From The benefits and dangers of anthropomorphic conversational agents (2025) · cites this paper as [54]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In addition to persuasive writing, LLMs are now capable of reliably inferring emotion and sentiment from human-written text. In one study, a fine-tuned LLM was able to detect emotions in social media posts with 84% accuracy (55). Another study found precision levels of over 95% for LLMs assessing sentiment across multiple languages, with the ability to identify nuanced feelings such as nostalgia”
From The benefits and dangers of anthropomorphic conversational agents (2025) · cites this paper as [54]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Sentiment Analysis in the Age of Generative AI > 3.2 Results Binary Sentiment Analysis
“It surpasses all other traditional transfer learning models by a margin of at least four percentage points in 15 out of the 16 datasets.”
§ Sentiment Analysis in the Age of Generative AI > 7 Conclusion
“| Amazon (Various) | 94.0 | 94.0 | 95.6 | 95.9 | 96.5 | 90.5 | 94.5 | 95.0 | | Amazon Titles (Various) | 84.8 | 87.6 | 86.7 | 87.8 | 86.5 | 82.0 | 88.5 | 87.0 | | Yelp (Various) | 96.8 | 95.6 | 97.2 | 97.0 | 98.5 | 96.5 | 97.5 | 98.5 |”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Sentiment Analysis in the Age of Generative AI > 6.1 Summary
“Interestingly, among the three LLMs, only GPT-3.5 benefited from few-shot and contextual prompting.”
§ Sentiment Analysis in the Age of Generative AI > 4.3 Results for Few-Shot Prompting
“For GPT-4, the introduction of few-shot prompting leads to an increase in prediction accuracy in seven out of eight datasets.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Sentiment Analysis in the Age of Generative AI > 4.4 Results of Logistic Regression Analysis: Impact of Prompting Method and Data Characteristics
“Third, sentiment prediction accuracy correlates positively and statistically significantly with word length, as evidenced by the presence of 'Big Words', across all LLMs (p < 0.001).”
§ Sentiment Analysis in the Age of Generative AI > 7 Conclusion
“| log(Big Words) | 1.082** (.03) | 1.137* (.05) | 1.117* (.046) |”
Citations
Cites
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 3×
“5 [8], and an estimated 1.8 trillion for GPT-4 [59], full parameter updates are often impractical and highly cost-inefficient.”
InfluentialAdvances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
LoRA: Low-Rank Adaptation of Large Language Models
Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., & Chen, W. (2021) · arXiv · doi:10.48550/arxiv.2106.09685 · Cited by 13,453 · cited 1×
“Thus, parameter-efficient fine-tuning methods, such as Low-Rank Adoption (LoRA) of LLMs, are increasingly utilized, optimizing only a subset of the model’s parameters [32].”
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 17×
“This tendency is more noticeable with datasets comprising Tweets, reflecting the colloquial and sometimes offensive language used on Twitter.”
InfluentialDwivedi, Y. K., Kshetri, N., Hughes, L., Slade, E. L., Jeyaraj, A., Kar, A. K., Baabdullah, A. M., Koohang, A., Raghavan, V., Ahuja, M., et al. (2023) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2023.102642 · Cited by 4,584
Kincaid, J. P., Fishburne, Jr., Robert P., R., Richard L., C., & Brad, S. (1975) · doi:10.21236/ada006655 · Cited by 3,497 · cited 1×
“We extract features including word count, the frequency of lengthy words (more than seven letters), the proportion of capitalized words (e.g., “GREAT”), netspeak (a measure of informal language usage), and the grade level score (an indicator of text complexity) [37].”
What Makes Online Content Viral?
Berger, J., & Milkman, K. L. (2012) · Journal of Marketing Research · doi:10.1509/jmr.10.0353 · Cited by 3,178 · cited 1×
“Applications of sentiment analysis include generating market insights from user-generated online content [45], predicting virality from linguistic features of newspaper articles [3], or identifying top performing individuals by analyzing the language style used in emails [67].”
Llama 2: Open Foundation and Fine-Tuned Chat Models
Touvron, H., Martin, L., Stone, K., Albert, P., Almahairi, A., Babaei, Y., Bashlykov, N., Batra, S., Bhargava, P., Bhosale, S., et al. (2023) · arXiv · doi:10.48550/arxiv.2307.09288 · Cited by 2,604 · cited 4×
“Meta has specifically focused on selecting and weighting its training data based on the truthfulness, toxicity, and bias inherent in the language when training Llama 2 [63].”
InfluentialExperimental evidence on the productivity effects of generative artificial intelligence
Noy, S., & Zhang, W. (2023) · Science · doi:10.1126/science.adh2586 · Cited by 2,150 · cited 2×
“First, Generative AI is used in content creation, including creative writing tasks [47, 55], conversational customer support [9], or market research based on emulated consumers [7, 40].”
Advances in natural language processing
Hirschberg, J., & Manning, C. D. (2015) · Science · doi:10.1126/science.aaa8685 · Cited by 1,712 · cited 1×
“Sentiment analysis based on natural language processing stands out as a prevalent use case in marketing, drawing significant attention across application contexts [2, 28, 65].”
Research works printed but not linked: 4
- Azam W (2022) Headphone Dataset Review Analysis. https:// www. kaggle. com/ datas ets/ mdwaq uaraz am/ headp hone-datas et- review-analy sis. Accessed 24 Aug 2023
- Boyd RL, Ashokkumar A, Seraj S et al (2022) The development and psychometric properties of LIWC-22. University of Texas at Austin, Austin, TX, pp 1-47. https:// www. liwc. app/ static/ docum ents/ LIWC-22% 20Man ual% 20-% 20Dev elopm ent% 20and% 20Psy chome trics. pdf
- Konrad M, Hartmann J (2023) One model fits all? Exploring the zero-shot capabilities of multimodal large language models for automated marketing image analytics. In: Proceeding of the 2023 Marketing Dynamics Conference
- Konrad M, Hartmann J (2023) One model fits all? Exploring the zero-shot capabilities of multimodal large language models for automated marketing image analytics. In: Proceeding of the 2023 Marketing Dynamics Conference 39. Larochelle H, Dumitro E, Yoshua B (2008) Zero-Data Learning of New Tasks. AAAI 1(2):646-651
Cited by
Items 101–195 of 195
Estrategias Discursivas y Comunicacionales de Startups en Redes Sociales
Torres, M. J. F., Rando-Cueto, D., & Rodríguez-Vera, A. D. P. (2025) · VISUAL REVIEW International Visual Culture Review / Revista Internacional de Cultura Visual · doi:10.62161/revvisual.v17.5763 · Cited by 2
Mabokela, K. R., Schlippe, T., & Wölfel, M. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2511.17301 · Cited by 3
Why should statisticians who primarily work with structured data learn to use large language models?
Rodrigues, K. A. S. (2025) · Teaching Statistics · doi:10.1111/test.70005 · Cited by 1
Using generative AI to uncover what drives player enjoyment
Abdelqader, H. (2026) · Multimedia Tools and Applications · doi:10.1007/s11042-026-21207-8 · Cited by 3
Generative AI adoption and barriers in the insurance industry
Owen, A., Sheehan, B., & Mullins, M. (2026) · Risk Management and Insurance Review · doi:10.1111/rmir.70041 · Cited by 2
Leveraging LLMs for Unstructured Direct Elicitation of Decision Rules
Dong, S. (2024) · Customer Needs and Solutions · doi:10.1007/s40547-024-00151-4 · Cited by 8
Farmers’ Protests in Germany: Media Coverage and Types of Bias
Schlichte, F., & Läpple, D. (2025) · Agribusiness · doi:10.1002/agr.70037 · Cited by 2
Sentiment Analysis on Movie Reviews: A Deep Dive into Modern Techniques and Open ChallengesPreprint
Gosai, A., De, S., Thankachan, K., ZeinEldin, R. A., Mohamed, A., & Mousavirad, S. J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2601.07235 · Cited by 1
“Krugmann and Hartmann [73] benchmarked GPT-3.”
Koppel, T., Tammet, T., & Solvak, M. (2026) · Journal of Decision System · doi:10.1080/12460125.2026.2655313 · Cited by 2
Schuck, A. D. F., Garcia, G. L., Manesco, J. R. R., Paiola, P. H., & Papa, J. P. (2025) · Journal of the Brazilian Computer Society · doi:10.5753/jbcs.2025.5793 · Cited by 6
Can a simple customer review outperform a feature set for predicting churn?
Beckhauser, W. J., & Fileto, R. (2024) · Simpósio Brasileiro de Bancos de Dados (SBBD) · doi:10.5753/sbbd.2024.240217 · Cited by 4
Beyond Hype: Empirical Evidence and Guidelines on Generative AI in Qualitative Analysis
Marcolin, C. B., Behr, A., da Silveira, C. C., & Giovannetti, V. E. G. (2025) · Revista de Administração Contemporânea · doi:10.1590/1982-7849rac2025250045.en · Cited by 4
Zhao, Y., Qiu, X., Xiao, Z., & Kaufman, M. R. (2025) · BMC Psychology · doi:10.1186/s40359-025-03854-y · Cited by 2
Consumer-Perceived Differences between Best- and Second-Best-Rated Product Reviews
Kim, M.-Y., Moon, S., & Jenkins, M. R. (2026) · Customer Needs and Solutions · doi:10.1007/s40547-026-00162-3 · Cited by 4
Arboleda, V. R., Pajarillo, B. S., Adarle, L. J., Arsenal, D. A., & Paula, E. D. (2024) · Philippine Journal of Science Engineering and Technology · doi:10.63179/pjset.v1i1.46 · Cited by 2
Sentiment Analysis for Low-Resource Languages Using a Hybrid XLM-Roberta and Bi-LSTM Model
Bharathi Mohan, G., Veda Sampreetha, M., & Meghana, K. (2025) · International Conference on Networks & Advances in Computational Technologies (NetACT) · doi:10.1109/netact65906.2025.11188922 · Cited by 4
Coping With the Digital Trilemma? Trade‐Offs and Risks in EU Digital Policy
Küsters, A., & Sottilotta, C. E. (2025) · European Policy Analysis · doi:10.1002/epa2.70023 · Cited by 1
Enhancing Personalized Service Development with Virtual Agents and Upcycling Techniques
Nakata, T., Chen, S., Saiki, S., & Nakamura, M. (2024) · The International journal of networked and distributed computing · doi:10.1007/s44227-024-00043-y · Cited by 5
Cosentino, C., Gündüz-Cüre, M., Marozzo, F., & Birim, Ş. Ö. (2026) · Machine Learning · doi:10.1007/s10994-026-07037-7 · Cited by 3
“…dimension in isolation—whether sentiment, topic, emotion, or domain-specific factors (e.g., political stance, mental-health status) (Guidotti, 2024 ; Krugmann & Hartmann, 2024; Qu et al., 2025; Wang et al., 2025)—our approach integrates multiple analytical layers within an explainable…”
InfluentialWass, L. M., Wu, Z., Vizoso, J., Wu, J. T. K., & Lin, L. K. (2026) · Journal of Medical Internet Research · doi:10.2196/80346 · Cited by 4
Boosting ChatGPT Sentiment Classification with Stacking and Majority Voting on Skewed Data
Patil, D. R. (2025) · Vietnam Journal of Computer Science · doi:10.1142/s2196888825500083 · Cited by 3
Niimi, J. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.07199 · Cited by 1
“Through next-token prediction on massive corpora, LLMs acquire broad linguistic and reasoning capabilities that transfer to a wide range of downstream tasks [4, 14, 15, 16].”
Sentiment Simulation using Generative AI AgentsPreprint
Tia, M., Lanuzo, J. S., Baltazar, L. R., Lopez-Relente, M. J., Quiñones, D. M. A., & Albia, J. R. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.22125 · Cited by 1
Dang, T.-D., & Nguyen, M.-T. (2025) · Consumer Behavior in Tourism and Hospitality · doi:10.1108/cbth-08-2024-0276 · Cited by 4
Fine-Tuning LLMs for E-Commerce Sentiment Analysis: Proprietary Versus Open-Source Approaches
Ghatora, P. S., Dang, B. T., Hoc, H. T., & Pervez, S. (2025) · IEEE Access · doi:10.1109/access.2025.3631616
Rajiv, A., Kothur, K., & Reddy, G. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.22745
Kościałkowski, J., & Marcinkowski, P. (2025) · arXiv (Cornell University) · doi:10.48550/arxiv.2505.06320
Han, X., Wang, E., Rui, Z., Wang, L., & Liu, Q. (2026) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2026.103667
Leveraging LLMs for Smart Cities Qualitative Data Analysis
Covato, E., Soomro, K., Khan, Z., Bilal, M., Cormack, R., & Green, S. (2026) · Concurrency and Computation Practice and Experience · doi:10.1002/cpe.70547
Comparison of the accuracy of selected sentiment analysis tools with psychologists’ evaluations
Magdin, M., Munk, M., Koprda, Š., Šášik, M., Přibáň, T., & Boháčová, A. (2026) · Humanities and Social Sciences Communications · doi:10.1057/s41599-026-07345-2
Yadav, I., Schindler, S., Peters, D., & Klinger, R. (2026) · Semantic Web · doi:10.1177/22104968261453132 · Cited by 5
“These models have demonstrated impressive capabilities in various NLP tasks, including sentiment analysis (Krugmann & Hartmann, 2024), text classifi-cation (Fields et al., 2024), machine translation (Gao et al., 2024; Vaswani et al., 2017), named entity recognition (NER) (Luo et al., 2023), and…”
Liew, X. Y., Hameed, N., Clos, J., & Fischer, J. E. (2026) · PeerJ Computer Science · doi:10.7717/peerj-cs.3632 · Cited by 1
Li, Y. X. (2026) · Journal of big data and computing. · doi:10.62517/jbdc.202601122
Polarity Detection of Sustainable Development Goals in News Text
Cadeddu, A., Chessa, A., Leo, V. D., et al. (2025) · doi:10.48550/arxiv.2509.19833
De, S., Gosai, A., Thankachan, K., ZeinEldin, R. A., Almaktoom, A. T., Bayram, M., & Mohamed, A. W. (2026) · Computer Modeling in Engineering & Sciences · doi:10.32604/cmes.2026.080601 · Cited by 3
Generative AI in Marketing Innovation:Applications and Research Outlook
Shen, Q., Hu, D., & Xie, H. (2025) · 中国科学基金 · doi:10.3724/bnsfc-2025-0013 · Cited by 3
Deep Learning-Based Sentiment Analysis Using Hybrid CNN and BiGRU with Attention Mechanism
Soni, T., Kumar, G. R., Bhatt, S., Joshi, A., Singh, H., & Kumar, V. (2026) · 2026 International Conference on Data Science for Cyber-Physical Systems Resilience using Advanced Applications (ICDCA) · doi:10.1109/icdca69396.2026.11620220
Multimodal text-audio sentiment in clinical aphasia speech using NLP
Manir, S. B., Kothari, A. N., Gross, W. L., & Deshpande, P. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1740270
Satria, C., Sumadewa, I. N. Y., Anggrawan, A., Destiana, B. E. V. D., Azwar, M., & Maulana, M. M. (2025) · International Conference on Cybernetics and Intelligent System (ICORIS) · doi:10.1109/icoris67789.2025.11296065
Stable LLM Ensemble: Interaction between Example Representativeness and Diversity
Niimi, J. (2025) · arXiv.org · doi:10.48550/arxiv.2510.13143
Comparative Study of LLMs and BERT for Informal Indonesian TikTok Sentiment Analysis
Fadila, C., & Rakhmawati, N. A. (2026) · ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS) · doi:10.1109/icetsis68266.2026.11549346
Research on Evidence-Relation Constraint Methods for Hallucinations in Sentiment Analysis
Si, F. (2026) · International Conference on Big Data & Artificial Intelligence & Software Engineering (ICBASE) · doi:10.1109/icbase70763.2026.11619506
Ju, X., Li, D., Zhu, Y. C., Li, Y., Wang, Q., Yang, Y., Xia, R., Ye, P., & Wang, S. (2026) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi15050201
From image to action: How social proof turns brand image into repurchase intention
Yin, C., Do, K.-A., & Liu, Y. (2026) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2026.105142
Study on Sentiment Analysis Methods for Uyghur Videos
Wang, J., Zhang, J., Guan, H., & He, W. (2026) · Frontiers in Computing and Intelligent Systems · doi:10.54097/v396ne87
The Evolution of SEO in the Era of Generative AI: A Business Intelligence Perspective
Roumeliotis, K. I., Margaris, D., Spiliotopoulos, D., & Vassilakis, C. (2026) · Electronics · doi:10.3390/electronics15163541 · Cited by 1
Dwi, F. A., & Purwadi (2026) · Jurnal Siber Multi Disiplin · doi:10.38035/jsmd.v4i2.866
The Rephrased Reality: Analysing Sentiment Shifts in LLM-Rephrased Text
Richardson, F. L., Villavicencio, A., & de Menezes, R. P. (2025) · ACM Symposium on Applied Computing · doi:10.1145/3672608.3707717
Kaushik, P. K., Bisht, R. K., Manchanda, M., & Sahoo, A. K. (2026) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-026-05036-z · Cited by 1
Fashion Review Intelligence with Instruction-Tuned LLMs: A Multi-Task Benchmark
Pritul, T. I., & Ratul, Q. E. A. (2026) · Intermountain Engineering, Technology and Computing (IETC) · doi:10.1109/ietc69527.2026.11568641
From joy to fear in scientific titles: automated emotion recognition and the citation payoff
Gerardy, N., Kervyn, N. O., & Verardi, V. (2026) · Scientometrics · doi:10.1007/s11192-026-05720-z
Revolutionizing sentiment analysis with generative AI: techniques, trends, and challenges
Mamun, R., Sadman, S., Nabil, H. R., Mridha, M. F., & Kabir, M. (2026) · Multimedia Tools and Applications · doi:10.1007/s11042-026-21390-8 · Cited by 1
Benchmarking large language models for target-based financial sentiment and stock return
Muhammad, I., Rospocher, M., Knez, T., & Žitnik, S. (2026) · International Journal of Data Science and Analytics · doi:10.1007/s41060-026-01201-x · Cited by 1
Kushwah, S., Agrawal, K. K., Parwekar, P., Singh, S., Rajpoot, D. S., Ali, J., & Vidyarthi, A. (2026) · Wireless Networks · doi:10.1007/s11276-026-04227-y
Plisiecki, H., Koc, P., Flakus, M., & Pokropek, A. (2025) · Quality & Quantity · doi:10.1007/s11135-025-02116-8 · Cited by 4
Hybrid Deep Learning Model for the Financial Market Public Sentiment Monitoring and Analysis
Zhang, Y. (2025) · International Conference on Intelligent Algorithms for Computational Intelligence Systems (IACIS) · doi:10.1109/iacis65746.2025.11211278
Niimi, J. (2025) · arXiv · doi:10.48550/arxiv.2510.25378 · Cited by 7
“Large language models (LLMs) have achieved remarkable fluency across a wide range of domains [1].”
Limitations in cultural context: systematic biases of LLMs in Chinese sentiment analysis
Geng, R., Zhang, J., Yang, R., Quan, M., Zheng, X., & Xu, Y. (2026) · Information Research · doi:10.47989/ir31iconf64278
Bias in the Machine: Cross-Model Evaluation of ChatGPT-4 and Qwen in Hotel Booking Review Annotation
Voutsa, M. C., Tsapatsoulis, N., Djouvas, C., & Andreou, C. (2025) · International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP) · doi:10.1109/smap66932.2025.00023 · Cited by 1
Birzniece, I., Andersone, I., Bicans, J., & Bāliņa, S. (2025) · International Conference on Computing and Artificial Intelligence (ICCAI) · doi:10.1109/iccai66501.2025.00058
An LLM-based multi-agent system for multilingual product review analysis
Hasan, H. R., Salah, K., Musamih, A., Islayem, R., Mayyas, A. T., Al-Hammadi, Y., & Omar, M. (2026) · Expert Systems with Applications · doi:10.1016/j.eswa.2026.134388
Intelligent product recommendation using market basket patterns and LLM-powered retrieval systems
BENGHARSALLAH, R., Tarhouni, M., & Aicha, F. B. (2026) · International Journal of Data Science and Analytics · doi:10.1007/s41060-026-01099-5 · Cited by 1
Bhartiya, K. G. A. R. (2026) · International Journal of Advanced Research in Science Communication and Technology · doi:10.48175/ijarsct-37647
Trillo, J. R., González-Quesada, J. C., Cabrerizo, F. J., & Pérez, I. J. (2026) · Evolving Systems · doi:10.1007/s12530-026-09813-1
Георгиевич, А. Е., Levchenko, V. V., & Seletkova, G. I. (2024) · Digital sociology · doi:10.26425/2658-347x-2024-7-3-4-14 · Cited by 4
Li, X., Li, Q., & Kim, J. (2026) · Expert Systems · doi:10.1111/exsy.70208 · Cited by 1
LLM sentiment analysis-integrated sales forecasting for E-commerce—a case study on Amazon
Ren, X., Li, M., Li, W., & Qu, T. (2026) · Digital engineering. · doi:10.1016/j.dte.2026.100134 · Cited by 2
Овсянко, О. Л., Prokopenko, A. V., & Zinchenko, A. (2025) · East European Journal of Psycholinguistics · doi:10.29038/ovs
A comprehensive survey on multimodal sentiment analysis: Approaches, challenges and open issues
Hemmatian, F., Sabbaghi, A., & Sohrabi, M. K. (2026) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2026.103138
Bots, Y., & Ключніков, А. Є. (2024) · Таврійський науковий вісник Серія Економіка · doi:10.32782/2708-0366/2024.21.14
Mullick, M. A. O., Ahmed, R., Islam, M. M., Islam, M. N., Azim, A., Alkhamees, B. F., & Hassan, M. M. (2026) · IEEE Access · doi:10.1109/access.2026.3660365
Cao, X., Zhou, S., Zhu, J., & Wang, X. (2026) · Journalism & Mass Communication Quarterly · doi:10.1177/10776990261480553 · Cited by 1
Cross-Linguistic and Text-Length Effects on Emotion Word Recognition in Large Language Models
Yan, C., Luo, J., & He, Y. (2026) · International Conference on Advanced Electronic Materials, Computers and Software Engineering (AEMCSE) · doi:10.1109/aetcse69203.2026.11504347
Khairova, N., Redozub, I., Dignum, V., & Rizun, N. (2026) · Social Sciences · doi:10.3390/socsci15060341
Sentiment aware interactive Chatbot AI using multi agent processing model
Shukla, V. K., Alagarsamy, S., Nagarajan, V., & Shanmugam, G. (2026) · IAES International Journal of Robotics and Automation (IJRA) · doi:10.11591/ijra.v15i1.pp200-209
Winter, C. G. H., Zacharias, N. A., & Hartwig, M. (2026) · Marketing Letters · doi:10.1007/s11002-026-09824-7 · Cited by 2
Metadata
- Authors
- Krugmann, J. O., & Hartmann, J.
- Affiliations
- Technical University of Munich (DE)
- Corresponding author
- Krugmann, Jan Ole
- Venue
- Customer Needs and Solutions
- Published
- 2024-03-05
- Volume
- 11
- Issue
- 1
- ISSN
- 2196-291X (ISSN-L)
- 2196-2928
- OpenAlex
- W4392462461
- Cited by
- 189
- References
- 55
- Citations by year
- 2026: 59 · 2025: 102 · 2024: 26
- FWCI
- 27.54
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Customer Needs and Solutions (publishedVersion, cc-by)
- Econstor (Econstor) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- Technische Universität München
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Keywords
- sentiment analysis, large language models, generative AI, sentiment classification, GPT-4, Llama 2, ChatGPT, consumer emotions, social media text, text complexity, prompting techniques, explainability, market analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-06, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-06 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.