The DOI matches its Crossref record; 130 of the 130 references it cites were found in a registry or an index; 12 of the 28 sources its claims cite were checked for support.
Co-Writing with Opinionated Language Models Affects Users’ Views
Open accessAbstract
If large language models like GPT-3 preferably produce a particular point of view, they may influence people’s opinions on an unknown scale. This study investigates whether a language-model-powered writing assistant that generates some opinions more often than others impacts what users write – and what they think. In an online experiment, we asked participants (N=1,506) to write a post discussing whether social media is good for society. Treatment group participants used a language-model-powered writing assistant configured to argue that social media is good or bad for society. Participants then completed a social media attitude survey, and independent judges (N=500) evaluated the opinions expressed in their writing. Using the opinionated language model affected the opinions expressed in participants’ writing and shifted their opinions in the subsequent attitude survey. We discuss the wider implications of our results and argue that the opinions built into AI language technologies need to be monitored and engineered more carefully.
Overview
CoChat Summary
TL;DR
In an online experiment, participants co-writing with a GPT-3 assistant prompted to argue that social media is good or bad were more likely to express that view in their posts and shifted in a later attitude survey. The authors call this “latent persuasion by language models” and argue that model opinions need to be monitored and engineered more carefully.
Key findings
- Participants using a model supportive of social media were 2.04 times more likely than controls to argue social media is good for society (p<0.0001, 95% CI [1.83, 2.30]); those using a critical model were 2.0 times more likely to argue it is bad (p<0.0001, 95% CI [1.79, 2.24]).
- In the post-task attitude survey, 45% of participants with the supportive model said social media is good for society, compared with 35% of controls (d=0.22, p<0.001); the critical model shifted views toward “bad” (d=0.19, p<0.005).
- Most participants did not blindly accept suggestions: on average 63% of sentences were written by participants themselves, 25% were mixed, and 11.5% were fully accepted from the model; about one in four accepted no suggestion, and one in ten had more than 75% of their post written by the model.
- Awareness was limited: only 10% of participants whose views aligned with the model noticed imbalanced suggestions, while 30% of those contradicted by the model noticed skew; about 20% of non-aligned participants believed the model influenced them.
Methods
- Online experiment with N=1,506 post-exclusion participants (507 control, 508 techno-optimist, 491 techno-pessimist), recruited via Prolific as US-based adults at least 18 years old; participants wrote at least five sentences replying to a Reddit-style post on whether social media is good for society.
- Treatment groups used a GPT-3 (“text-davinci-002”) writing assistant configured via prefix and infix prompts to generate suggestions arguing social media is good or bad; controls wrote without assistance.
- Outcomes included sentence-level opinion labels from N=500 judges (84.1% agreement, Cohen’s κ=0.76), keystroke-level interaction logs, a post-task attitude survey, and a user-experience survey; analysis used logistic regression and treated the ordinal opinion scale as interval (-1 bad, 1 good, 0 both/neither).
Limitations
- The paper states that the study tested only one topic, one specific GPT-3 writing-assistant implementation, and a strongly opinionated model; generalization to entrenched topics, other applications, and weaker models is unknown, and persistence over time was not tested.
- The paper states that pre-task opinion was measured retrospectively and is biased by the treatment effect, amounting to 14% of its standard deviation; the sample was US-based Prolific participants doing a short paid task (average 5.9 minutes).
- The paper states that demand effects cannot be fully ruled out, though most participants did not identify the study’s purpose as testing the assistant’s influence; the mechanisms behind the observed opinion shift remain unidentified.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
8 Valid · 1 Not valid · 8 Not checked · 81 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“We also experimented with fine-tuning [53] to guide the models' opinion, but the fine-tuned models did not consistently produce the intended opinion.”
What the sources say
- Supportedcites [53] [53] Jeremy Howard and Sebastian Ruder. 2018. Universal language model fine-tuning for text classification. arXiv preprint arXiv:1801.06146 (2018). - source
The citation is attached to “fine-tuning,” identifying the method the citing authors tried. The source’s Introduction describes its proposed Universal Language Model Fine-tuning method. The statement that the citing authors’ models did not consistently produce the intended opinion reports their own experiment, not a finding attributed to this source. (LLM, conf=0.93)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“when participants strongly argued for another opinion in their writing, the model's continuations would follow their opinion”
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“shifted their opinions in the subsequent attitude survey”
- Also stated in: § 1 INTRODUCTION · p. 2 · plain
“We find that both participants' writing and their attitude towards social media in the survey were considerably affected by the model's preferred opinion.”
plainstates a causen = 1,506- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 INTRODUCTION · p. 2 · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This additional prompt guided the model's continuation towards the target opinion even if participants had articulated a different opinion earlier in their writing.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Using the opinionated language model affected the opinions expressed in participants' writing”
- Also stated in: § 1 INTRODUCTION · p. 2 · plain
“We find that both participants' writing and their attitude towards social media in the survey were considerably affected by the model's preferred opinion.”
plainstates a causen = 1,506- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1 INTRODUCTION · p. 2 · plain
43 more claims
Create a free account to see all 98 claims and to verify the 1 reference still open.
- Probably not a substantial claim. 36
- It may state two separate claims as one. 19
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“More recently, [29] found that writing with AI assistance on opinionated content affects not only a user's writing output but also their own opinions toward the written topic.”
From 'It was 80% me, 20% AI': Seeking Authenticity in Co-Writing with Large Language Models (2025) · cites this paper as [29]
The cited source says what the claim attributes to it.
In the citing paper
“Furthermore, using a large language model has been shown to affect the user's own opinions [102].”
From The Robots Are Here: Navigating the Generative AI Revolution in Computing Education (2023) · cites this paper as [102]
The cited source says what the claim attributes to it.
In the citing paper
“In fact, they found that suggestion systems influence what people write, even when suggestions do not reflect their own opinions (see also [58]).”
From The AI Ghostwriter Effect: When Users do not Perceive Ownership of AI-Generated Text but Self-Declare as Authors (2024) · cites this paper as [58]
The cited source says what the claim attributes to it.
In the citing paper
“On the other hand, LLMs can influence and persuade humans26, with research demonstrating that LLM-based writing assistants are capable of swaying people’s views27.”
From Generative language models exhibit social identity biases (2024) · cites this paper as [27]
The cited source says what the claim attributes to it.
In the citing paper
“Writers who compose with an opinionated language model shift their expressed views toward the model's (Jakesch et al., 2023), and writers who accept substantial AI contributions report reduced ownership of the resulting text (Draxler et al., 2024).”
From Think Before You Accept: Can Written Justification Reduce Uncritical Uptake of AI Writing Suggestions? (2026) · cites this paper as Jakesch et al., 2023
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Kaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
On the Dangers of Stochastic Parrots: Can Language Models Be Too Big? 🦜
Bender, E. M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445922 · Cited by 6,988
Bem, D. J. (1972) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60024-6 · Cited by 5,241 · cited 1×
“According to self-perception theory [13], such changes in behavior may lead to changes in opinion.”
The Spread of Obesity in a Large Social Network over 32 Years
Christakis, N. A., & Fowler, J. H. (2007) · New England Journal of Medicine · doi:10.1056/nejmsa066082 · Cited by 5,007
Behavioral Study of obedience.
Milgram, S. (1963) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0040525 · Cited by 4,918 · cited 1×
“On a personal level, people may conform to majority views against their better judgement [6] and obey an authority figure even if it means harming others [80].”
BackgroundI tweet honestly, I tweet passionately: Twitter users, context collapse, and the imagined audience
Marwick, A. E., & boyd, D. (2011) · New Media & Society · doi:10.1177/1461444810365313 · Cited by 4,612 · cited 1×
“Research has shown that a variety of sources infuences users’ attitudes and behaviors, including friends, family, experts, and internet celebrities [48, 78]; the latter group was labeled infuencers due to their infuence on a large group of ’followers’ [10].”
BackgroundHumans and automation: Use, misuse, disuse, abuse
Parasuraman, R., & Riley, V. (1997) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872097778543886 · Cited by 4,554
Research works printed but not linked: 5
- 10.1093/jcmc · doi:10.1093/jcmc
- Daniel Kahneman. 2011. Thinking, fast and slow. Macmillan.
- D.G. Myers. 2008. Social Psychology. McGraw-Hill.
- Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, 2019. Language models are unsupervised multitask learners. OpenAI blog 1, 8 (2019), 9.
- Daijin Yang, Yanpeng Zhou, Zhiyuan Zhang, Toby Jia-Jun Li, and LC Ray. 2022. AI as an Active Writer: Interaction Strategies with Generated Text in Human-AI Collaborative Fiction Writing 56-65. In IUI Workshops.
Cited by
Generative artificial intelligence
Banh, L., & Strobel, G. (2023) · Electronic Markets · doi:10.1007/s12525-023-00680-1 · Cited by 579
“The promotion of explainable and responsible AI becomes paramount once more (Meske et al., 2022), especially in a technological state where distinguishing between generated and real content by GAI models is becoming increasingly more challenging (Jakesch et al., 2023b; Lehmann & Buschek, 2020).”
When combinations of humans and AI are useful: A systematic review and meta-analysis
Vaccaro, M., Almaatouq, A., & Malone, T. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02024-1 · Cited by 570
The Robots Are Here: Navigating the Generative AI Revolution in Computing Education
Prather, J., Denny, P., Leinonen, J., Becker, B. A., Albluwi, I., Craig, M., Keuning, H., Kiesler, N., Kohn, T., Luxton-Reilly, A., et al. (2023) · Proceedings of the 2023 Working Group Reports on Innovation and Technology in Computer Science Education · doi:10.1145/3623762.3633499 · Cited by 396
More human than human: measuring ChatGPT political bias
Motoki, F., Pinho Neto, V., & Rodrigues, V. (2024) · Public Choice · doi:10.1007/s11127-023-01097-2 · Cited by 329
“Additionally, there is evidence that biased LLMs influence the views of users (Jakesch et al., 2023).”
InfluentialKar, A. K., Varsha, P. S., & Rajan, S. (2023) · Global Journal of Flexible Systems Management · doi:10.1007/s40171-023-00356-x · Cited by 192
“It also improves the content in advertising for brand or product promotion (Jakesch et al., 2023).”
Background
Metadata
- Authors
- Jakesch, M., Bhat, A., Buschek, D., Zalmanson, L., & Naaman, M.
- Affiliations
- Cornell University (US)
- Indian Institute of Technology Bombay (IN)
- University of Bayreuth (DE)
- Tel Aviv University (IL)
- Cornell Tech (US)
- Venue
- Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2023-04-19
- Pages
- 1-15
- OpenAlex
- W4319167005
- Semantic Scholar
- 92999f7a304e866a2be7176e59c745481ed01042
- Cited by
- 265
- References
- 117
- Citations by year
- 2026: 77 · 2025: 85 · 2024: 85 · 2023: 18
- FWCI
- 66.30
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (CHS 1901151/1901329)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Physical Sciences › Physics and Astronomy › Statistical and Nonlinear Physics › Opinion Dynamics and Social Influence
- Keywords
- large language models, AI writing tools, opinion formation, attitudes toward social media, user attitudes, GPT-3
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Co-Writing with Opinionated Language Models Affects Users’ Views. https://app.cochat.ai/papers/10.1145/3544548.3581196
- The paper
- Jakesch, M., Bhat, A., Buschek, D., Zalmanson, L., & Naaman, M. (2023). Co-Writing with Opinionated Language Models Affects Users’ Views. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3544548.3581196
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.