CoChat
Sign Up
PreprintCited by 1Topic ModelingSpeech and dialogue systemsMulti-Agent Systems and Negotiation

Attractor States Emerge in Multi-Turn LLM Conversations

Open access
Ko, Ting-Wen, Geiping, Jonas·2026·arXiv
DOI 10.48550/arxiv.2606.30571arXiv 2606.30571
Open this paper in CoChat — free accountOpen PDF

Abstract

Large language models (LLMs) are increasingly used in open-ended multi-agent settings, but the long-run dynamics of model--model interaction remain poorly understood. We study whether open-ended LLM discussions exhibit attractor-like behavior, i.e. topic-independent stable sets of behaviors which conversations settle into. Across 7 LLMs and 20 controversial topics, we compare self-play and mixed-play dyadic debates, tracking trajectories in representation space, discourse traits, and stances. We find self-play trajectories to be model-specific attractors that draw their conversation partners asymmetrically in mixed-play debates, influencing the other models' stylistic choices and behavior. For example, Claude Haiku is a strong attractor of other models in latent space, corresponding to other models taking on its traits like metacommentary, and models like GPT-4.1 nano are especially malleable. Our results suggest that open-ended LLM interactions are partially predictable from model-specific attractors, but shaped by structured and asymmetric partner influence. Overall, our analysis sheds some light on the complex behavior of open-ended multi-agent interaction, which we hope is helpful in designing, predicting, and monitoring autonomous agentic systems in the real world.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2606.30571

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Multi-turn LLM self-play conversations drift into topic-independent attractor states.

    “multi-turn LLM self-play conversations drift into topic-independent attractor states [124]”

    From Recursive Self-Improvement in AI: From Bounded Self-Refinement to Autonomous Research Loops (2026) · cites this paper as [124]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

  • LLMs Get Lost In Multi-Turn Conversation

    Laban, P., Hayashi, H., Zhou, Y., & Neville, J. (2025) · arXiv · Cited by 10 · cited 1× · see citing works

    “…self-play attractors. raises several questions: limited diversity of generated content (Jiang et al., 2025a), shifts in language use (Abdulhai et al., 2026), amplified opinions (Nehring et al., 2024), and drift away from initial objectives (Laban et al., 2025; Rat-nakar & Raghavendra, 2025).”

Flagged first, then by citations

Research works printed but not linked: 43

  1. Abdulhai, M., White, I., Wan, Y., Qureshi, I., Leibo, J., Kleiman-Weiner, M., and Jaques, N. How LLMs Distort Our Written Language, March 2026. URL http:// arxiv.org/abs/2603.18161. arXiv:2603.18161 [cs.CL. · arXiv
  2. Bai, Y., Kadavath, S., Kundu, S., Askell, A., Kernion, J., Jones, A., Chen, A., Goldie, A., Mirhoseini, A., McKinnon, C., Chen, C., Olsson, C., Olah, C., Hernan- dez, D., Drain, D., Ganguli, D., Li, D., Tran-Johnson, E., Perez, E., Kerr, J., Mueller, J., Ladish, J., Lan- dau, J., Ndousse, K., Lukosuite, K., Lovitt, L., Sell- itto, M., Elhage, N., Schiefer, N., Mercado, N., Das- Sarma, N., Lasenby, R., Larson, R., Ringer, S., John- ston, S., Kravec, S., El Showk, S., Fort, S., Lanham, T., Telleen-Lawton, T., Conerly, T., Henighan, T., Hume, T., Bowman, S. R., Hatfield-Dodds, Z., Mann, B., Amodei, D., Joseph, N., McCandlish, S., Brown, T., and Ka- plan, J. Constitutional AI: Harmlessness from AI feed- back. arXiv preprint arXiv:2212.08073, 2022. URL https://arxiv.org/abs/2212.08073. · arXiv
  3. Baltaji, R., Hemmatian, B., and Varshney, L. Conformity, confabulation, and impersonation: Persona inconstancy in multi-agent LLM collaboration. In Prabhakaran, V., Dev, S., Benotti, L., Hershcovich, D., Cabello, L., Cao, Y., Adebara, I., and Zhou, L. (eds.), Proceedings of the 2nd Workshop on Cross-Cultural Considerations in NLP, pp. 17-31, Bangkok, Thailand, August 2024. Association for Computational Linguistics. doi: 10.18653/v1/2024 .c3nlp-1.2. URL https://aclanthology.org/2 024.c3nlp-1.2/. · DOI
  4. Cau, E., Pansanella, V., Pedreschi, D., and Rossetti, G. Language-driven opinion dynamics in agent-based sim- ulations with LLMs. arXiv preprint arXiv:2502.19098, 2025a. URL https://arxiv.org/abs/2502.1 9098. · arXiv
  5. Cau, E., Pansanella, V., Pedreschi, D., and Rossetti, G. Se- lective agreement, not sycophancy: investigating opinion dynamics in LLM interactions. EPJ Data Science, 14(1): 59, 2025b. URL https://link.springer.com/ article/10.1140/epjds/s13688-025-005 79-1. · DOI · Paper page
  6. Cheng, M., Yu, S., Lee, C., Khadpe, P., Ibrahim, L., and Jurafsky, D. Social sycophancy: A broader understanding of LLM sycophancy. In The Fourteenth International Conference on Learning Representations, 2026. URL https://openreview.net/forum?id=igbR HKEiAs. Also arXiv:2505.13995. · arXiv
  7. Choi, Y., Li, C., Yang, Y., and Jin, Z. Agent-to-agent theory of mind: Testing interlocutor awareness among large lan- guage models. In Christodoulopoulos, C., Chakraborty, T., Rose, C., and Peng, V. (eds.), Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pp. 28895-28928, Suzhou, China, November 2025. Association for Computational Linguistics. ISBN 979-8-89176-332-6. doi: 10.18653/v1/2025.emnlp-main. 1471. URL https://aclanthology.org/2025. · DOI
  8. Chuang, Y.-S., Goyal, A., Harlalka, N., Suresh, S., Hawkins, R., Yang, S., Shah, D., Hu, J., and Rogers, T. Simu- lating opinion dynamics with networks of LLM-based agents. In Findings of the Association for Computational Linguistics: NAACL 2024, pp. 3326-3346, Mexico City, Mexico, 2024. Association for Computational Linguis- tics. doi: 10.18653/v1/2024.findings-naacl.211. URL https://aclanthology.org/2024.findin gs-naacl.211/. · DOI · Paper page
  9. Costello, T. H., Pennycook, G., and Rand, D. G. Durably reducing conspiracy beliefs through dialogues with ai. Science, 385(6714):eadq1814, 2024. doi: 10.1126/scienc e.adq1814. URL https://www.science.org/do i/abs/10.1126/science.adq1814. · DOI · Paper page
  10. Du, Y., Li, S., Torralba, A., Tenenbaum, J. B., and Mordatch, I. Improving factuality and reasoning in language models through multiagent debate. In Proceedings of the 41st International Conference on Machine Learning, 2024. URL https://composable-models.github .io/llm_debate/.
  11. Estornell, A. and Liu, Y. Multi-LLM debate: Framework, principals, and interventions. In Proceedings of the 38th International Conference on Neural Information Pro- cessing Systems (NeurIPS 2024).
  12. Curran Associates Inc., 2024. URL https://proceedings.neurips. cc/paper_files/paper/2024/hash/32e07 a110c6c6acf1afbf2bf82b614ad-Abstrac t-Conference.html.
  13. Frisch, I. and Giulianelli, M. LLM agents in interaction: Measuring personality consistency and linguistic align- ment in interacting populations of large language models. In Proceedings of the 1st Workshop on Personalization of Generative AI Systems (PERSONALIZE 2024), pp. 102-111, St. Julians, Malta, 2024. Association for Com- putational Linguistics. URL https://aclantholo gy.org/2024.personalize-1.9/.
  14. Gottweis, J., Weng, W.-H., Daryin, A., Tu, T., Sirkovic, P., Myaskovsky, A., Glowaty, G., Weissenberger, F., Orlandi, A., Popovici, D., et al. Accelerating scientific discovery with co-scientist. Nature, pp. 1-3, 2026.
  15. Hughes, K. D., Konnikov, A., Denier, N., and Hu, Y. Problematizing the role of artificial intelligence in hir- ing and organizational inequalities: A multidisciplinary review. Human Relations, 79(2):246-278, 2026. doi: 10.1177/00187267251403902. URL https://doi. org/10.1177/00187267251403902. · DOI
  16. Jiang, L., Chai, Y., Li, M., Liu, M., Fok, R., Dziri, N., Tsvetkov, Y., Sap, M., Albalak, A., and Choi, Y. Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond), October 2025a. URL http:// arxiv.org/abs/2510.22954. arXiv:2510.22954 · arXiv
  17. Jiang, Y., Guo, L., Wu, Y., Caliskan, A., Mitra, T., and Shen, H. Beyond one-way influence: Bidirectional opinion dynamics in multi-turn human-LLM interactions. arXiv preprint arXiv:2510.20039, 2025b. URL https://ar xiv.org/abs/2510.20039. · arXiv
  18. Kaur, A. Echoes of Agreement: Argument Driven Syco- phancy in Large Language models. In Christodoulopou- los, C., Chakraborty, T., Rose, C., and Peng, V. (eds.), Findings of the Association for Computational Linguis- tics: EMNLP 2025, pp. 22803-22812, Suzhou, China, November 2025. Association for Computational Linguis- tics. ISBN 979-8-89176-335-7. doi: 10.18653/v1/2025 .findings-emnlp.1241. URL https://aclantholo gy.org/2025.findings-emnlp.1241/. · DOI
  19. Khan, A., Hughes, J., Valentine, D., Ruis, L., Sachan, K., Radhakrishnan, A., Grefenstette, E., Bowman, S. R., Rocktäschel, T., and Perez, E. Debating with more per- suasive LLMs leads to more truthful answers. In Proceed- ings of the 41st International Conference on Machine Learning, volume 235 of Proceedings of Machine Learn- ing Research, pp. 23662-23733. PMLR, 2024. URL https://proceedings.mlr.press/v235/k han24a.html.
  20. Lehr, S. A., Saichandran, K. S., Harmon-Jones, E., Vitali, N., and Banaji, M. R. Kernels of selfhood: GPT-4o shows humanlike patterns of cognitive dissonance moderated by free choice. Proceedings of the National Academy of Sciences, 122(20):e2501823122, 2025. doi: 10.1073/pn as.2501823122. URL https://www.pnas.org/d oi/10.1073/pnas.2501823122. · DOI
  21. Li, G., Hammoud, H. A. A. K., Itani, H., Khizbullin, D., and Ghanem, B. CAMEL: Communicative agents for "mind" exploration of large language model society. In Thirty- seventh Conference on Neural Information Processing Systems, 2023. URL https://arxiv.org/abs/ 2303.17760.
  22. Li, K., Liu, T., Bashkansky, N., Bau, D., Viégas, F., Pfis- ter, H., and Wattenberg, M. Measuring and controlling instruction (in)stability in language model dialogs. In Conference on Language Modeling (COLM 2024), 2024. URL https://arxiv.org/abs/2402.10962. arXiv:2402.10962. · arXiv
  23. Li, Y., Shen, X., Miao, Y., Yao, X., Ding, X., Krishnan, R., and Padman, R. Beyond single-turn: A survey on multi-turn interactions with large language models. arXiv preprint arXiv:2504.04717, 2025. · arXiv
  24. Liang, T., He, Z., Jiao, W., Wang, X., Wang, Y., Wang, R., Yang, Y., Shi, S., and Tu, Z. Encouraging divergent thinking in large language models through multi-agent debate. In Proceedings of the 2024 Conference on Em- pirical Methods in Natural Language Processing, pp. 17889-17904, Miami, Florida, USA, 2024. Association for Computational Linguistics. doi: 10.18653/v1/2024.e mnlp-main.992. URL https://aclanthology.o rg/2024.emnlp-main.992/. · DOI · Paper page
  25. Liu, J., Jain, A., Takuri, S., Vege, S., Akalin, A., Zhu, K., O'Brien, S., and Sharma, V. TRUTH DECAY: Quantifying multi-turn sycophancy in language mod- els. arXiv preprint arXiv:2503.11656, 2025. URL https://arxiv.org/abs/2503.11656. · arXiv
  26. Lu, C., Gallagher, J., Michala, J., Fish, K., and Lind- sey, J. The assistant axis: Situating and stabilizing the default persona of language models. arXiv preprint arXiv:2601.10387, 2026. · arXiv
  27. Michels, J. "spiritual bliss" in Claude 4: Case study of an "attractor state" and journalistic responses. 2025. URL https://philarchive.org/rec/MICSBI. Phi- lArchive preprint.
  28. Nehring, J., Gabryszak, A., Jürgens, P., Burchardt, A., Schaffer, S., Spielkamp, M., and Stark, B. Large Lan- guage Models Are Echo Chambers. In Calzolari, N., Kan, M.-Y., Hoste, V., Lenci, A., Sakti, S., and Xue, N. (eds.), Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pp. 10117-10123, Torino, Italia, May 2024. ELRA and ICCL. URL https://aclanthology.org/2024.lr ec-main.884/.
  29. Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C. L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., and Lowe, R. Training language models to follow instructions with human feedback. In Advances in Neural Information Processing Systems, volume 35, 2022.
  30. Park, J. S., O'Brien, J. C., Cai, C. J., Morris, M. R., Liang, P., and Bernstein, M. S. Generative agents: Interactive simulacra of human behavior. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST '23), New York, NY, USA, 2023. Association for Computing Machinery. doi: 10.1145/35 86183.3606763. URL https://dl.acm.org/doi /10.1145/3586183.3606763. · DOI · Paper page
  31. Qiu, T. A., He, Z., Chugh, T., and Kleiman-Weiner, M. The Lock-in Hypothesis: Stagnation by Algorithm, June 2025. URL http://arxiv.org/abs/2506.06166. arXiv:2506.06166 [cs. · arXiv
  32. Ratnakar, S. and Raghavendra, S. The Chameleon Na- ture of LLMs: Quantifying Multi-Turn Stance Instabil- ity in Search-Enabled Language Models, October 2025. URL http://arxiv.org/abs/2510.16712. arXiv:2510.16712 [cs. · arXiv
  33. Reimers, N. and Gurevych, I. Sentence-bert: Sentence em- beddings using siamese bert-networks. In Proceedings of the 2019 Conference on Empirical Methods in Natu- ral Language Processing. Association for Computational Linguistics, 11 2019. URL https://arxiv.org/ abs/1908.10084. · arXiv
  34. Salvi, F., Horta Ribeiro, M., Gallotti, R., and West, R. On the conversational persuasiveness of GPT-4. Nature Human Behaviour, 2025. doi: 10.1038/s41562-025-02194-6. URL https://www.nature.com/articles/ s41562-025-02194-6. Preprint: arXiv:2403.14380, 2024. · DOI
  35. Sharma, M., Tong, M., Korbak, T., Duvenaud, D., Askell, A., Bowman, S. R., Durmus, E., Hatfield-Dodds, Z., John- ston, S. R., Kravec, S., Maxwell, T., McCandlish, S., Ndousse, K., Rausch, O., Schiefer, N., Yan, D., Zhang, M., and Perez, E. Towards understanding sycophancy in language models. In The Twelfth International Confer- ence on Learning Representations, 2024. URL https: //openreview.net/forum?id=tvhaxkMKAn.
  36. Shimao, H., Khern-am nuai, W., and Kim, S. J. Chaotic dynamics in multi-llm deliberation. arXiv preprint arXiv:2603.09127, 2026. · arXiv
  37. Simhi, A., Barez, F., Tutek, M., Belinkov, Y., and Co- hen, S. B. Old Habits Die Hard: How Conversa- tional History Geometrically Traps LLMs, February 2026. URL http://arxiv.org/abs/2603.03308. arXiv:2603.03308 [cs.. · arXiv
  38. Strogatz, S. H. Nonlinear dynamics and chaos: with appli- cations to physics, biology, chemistry, and engineering. CRC press, 2nd edition, 2018.
  39. Tacheny, N. Geometric Dynamics of Agentic Loops in Large Language Models, January 2026. URL http:// arxiv.org/abs/2512.10350. arXiv:2512.10350 [cs]. · arXiv
  40. USA, November 2024. Association for Computational Linguistics. doi: 10.18653/v1/2024.emnlp-main.16. URL https://aclanthology.org/2024.em nlp-main.16/. · DOI · Paper page
  41. Thakkar, N., Yuksekgonul, M., Silberg, J., Garg, A., Peng, N., Sha, F., Yu, R., Vondrick, C., and Zou, J. A large- scale randomized study of large language model feedback in peer review. Nature Machine Intelligence, pp. 1-11, 2026.
  42. Wang, Z., Li, Y., Yan, J., Cheng, Y., and Zhang, Y. Un- veiling Attractor Cycles in Large Language Models: A Dynamical Systems View of Successive Paraphrasing, February 2025. URL https://arxiv.org/abs/ 2502.15208v2.
  43. Zhang, H., Cui, Z., Zhang, Q., and Hu, S. Multi-LLM- agents debate -performance, efficiency, and scaling chal- lenges. In The Fourth Blogpost Track at ICLR 2025, 2025. URL https://openreview.net/forum ?id=Wv0J0bEly5.

Cited by

Sorted by citations

Authors
Ko, T.-W., & Geiping, J.
ORCID
Geiping, Jonas
Venue
arXiv
Publisher
arXiv
Published
2026
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2606.30571
arXiv
2606.30571
OpenAlex
W7166660585
Cited by
0
References
1
Type
posted content
Language
en
Open access
Licence
arxiv.org/licenses/nonexclusive-distrib/1.0/
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
Hector Stiftung
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
Keywords
large language models, multi-agent systems, attractor states, self-play, stance, metacommentary, controversial issues

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review