PreprintCited by 12Sentiment Analysis and Opinion MiningEthics and Social Impacts of AIComputational and Text Analysis Methods

Public Attitudes Toward ChatGPT on Twitter: Sentiments, Topics, and Occupations

Open access
Koonchanok, Ratanond, Pan, Yanling, Jang, Hyeju·2023·arXiv

Abstract

ChatGPT sets a new record with the fastest-growing user base, as a chatbot powered by a large language model (LLM). While it demonstrates state-of-the-art capabilities in a variety of language-generation tasks, it also raises widespread public concerns regarding its societal impact. In this paper, we investigated public attitudes towards ChatGPT by applying natural language processing techniques such as sentiment analysis and topic modeling to Twitter data from December 5, 2022 to June 10, 2023. Our sentiment analysis result indicates that the overall sentiment was largely neutral to positive, and negative sentiments were decreasing over time. Our topic model reveals that the most popular topics discussed were Education, Bard, Search Engines, OpenAI, Marketing, and Cybersecurity, but the ranking varies by month. We also analyzed the occupations of Twitter users and found that those with occupations in arts and entertainment tweeted aboutChatGPT most frequently. Additionally, people tended to tweet about topics relevant to their occupation. For instance, Cybersecurity is the most discussed topic among those with occupations related to computer and math, and Education is the most discussed topic among those in academic and research. Overall, our exploratory study provides insights into the public perception of ChatGPT, which could be valuable to both the general public and developers of this technology.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2306.12951

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The study's result on LLM attitude is consistent with Koonchanok et al. [52], who found that overall public sentiment towards ChatGPT from December 2022 to March 2023 was largely neutral to positive.

    “This result consistent with that of Koonchanok et al. [52] who investigated public attitudes towards ChatGPT by analyzing Twitter data from December 2022 to March 2023 and found that the overall sentiment is largely neutral to positive.”

    From "I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust (2024) · cites this paper as [52]

    The Discussion reports that the overall tweet sentiment was mildly positive, with neutral tweets the largest group. But the Dataset section says the Twitter data ran from December 5, 2022 through June 10, 2023—not only through March 2023. (LLM, conf=0.91)

    Experimental — accuracy not yet measured
  • A comprehensive data-driven inquiry into how specifically academia perceives and utilizes ChatGPT is still lacking.

    “Additionally, although some research has leveraged Twitter data to capture a wider view of ChatGPT's early adoption through topic and sentiment analysis (e.g., Koonchanok et al., 2023;Leiter et al., 2023;Taecharungroj, 2023), a comprehensive data-driven inquiry into how specifically academia perceives and utilizes ChatGPT is still lacking.”

    From Widen the debate: What is the academic community’s perception on ChatGPT? (2024) · cites this paper as Koonchanok et al., 2023

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 2

  1. abq1158 · DOI · Paper page
  2. Dwivedi, Y.K., Kshetri, N., Hughes, L., Slade, E.L., Jeyaraj, A., Kar, A.K., Baabdul- lah, A.M., Koohang, A., Raghavan, V., Ahuja, M., et al.: "so what if chatgpt wrote it?" multidisciplinary perspectives on opportunities, challenges and implications of generative conversational ai for research, practice and policy. International Journal of Information Management 71, 102642 (2023)

Cited by

Sorted by citations

Authors
Koonchanok, R., Pan, Y., & Jang, H.
Affiliations
  • Indiana University Indianapolis (US)
  • Indiana University – Purdue University Indianapolis (US)
Corresponding author
Jang, Hyeju
Venue
arXiv
Publisher
arXiv
Published
2023
ISSN
2331-8422 (ISSN-L)
OpenAlex
W4381795714
Cited by
5
References
48
Citations by year
2024: 3 · 2023: 2
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Social Sciences › General Social Sciences › Computational and Text Analysis Methods
Keywords
ChatGPT, public attitudes, large language models, chatbots, Twitter, sentiment analysis, topic modeling, social impact, cybersecurity, Google Bard, OpenAI

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review