CoChat
Sign Up
PreprintCited by 38Multi-Agent Systems and NegotiationEthics and Social Impacts of AIPsychiatry, Mental Health, Neuroscience

MetaAgents: Large Language Model Based Agents for Decision-Making on Teaming

Open access
Li, Yuan, Sun, Lichao, Zhang, Yixuan·2023·arXiv
DOI 10.48550/arxiv.2310.06500arXiv 2310.06500

Preprint — published as 10.1145/3711032

Open this paper in CoChat — free accountOpen PDF

Abstract

Significant advancements have occurred in the application of Large Language Models (LLMs) for social simulations. Despite this, their abilities to perform teaming in task-oriented social events are underexplored. Such capabilities are crucial if LLMs are to effectively mimic human-like social behaviors and form efficient teams to solve tasks. To bridge this gap, we introduce MetaAgents, a social simulation framework populated with LLM-based agents. MetaAgents facilitates agent engagement in conversations and a series of decision making within social contexts, serving as an appropriate platform for investigating interactions and interpersonal decision-making of agents. In particular, we construct a job fair environment as a case study to scrutinize the team assembly and skill-matching behaviors of LLM-based agents. We take advantage of both quantitative metrics evaluation and qualitative text analysis to assess their teaming abilities at the job fair. Our evaluation demonstrates that LLM-based agents perform competently in making rational decisions to develop efficient teams. However, we also identify limitations that hinder their effectiveness in more complex team assembly tasks. Our work provides valuable insights into the role and evolution of LLMs in task-oriented social simulations.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2310.06500

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • LLM-based agents can save previous experiences for future problems, and maintain context in conversational development interfaces.

    “They can save previous experiences for future problems, and also maintain context in conversational development interfaces [142, 144, 1, 109].”

    From A Survey on the Memory Mechanism of Large Language Model-based Agents (2025) · cites this paper as [109]

    The Memory section (page unavailable) says MetaAgents stores conversations and previous decisions for later retrieval to support decision-making. Section 3.1 says its multi-turn conversations build on previous dialogue and remain context-aware. The paper describes a simulated job fair, however, not conversational development interfaces, so that setting is unsupported. (LLM, conf=0.85)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 64

  1. Alberto Acerbi and Joseph M. Stubbersfield. 2023. Large language models show human-like content biases in transmis- sion chain experiments. Proceedings of the National Academy of Sciences of the United States of America 120, 44 (Oct 2023). doi:10.1073/pnas.2313790120 · DOI · Paper page
  2. Gati V Aher, Rosa I Arriaga, and Adam Tauman Kalai. 2023. Using large language models to simulate multiple humans and replicate human subject studies. In International Conference on Machine Learning. PMLR, 337-371.
  3. Lisa P. Argyle, Ethan C. Busby, Nancy Fulda, Joshua R. Gubler, Christopher Rytting, and David Wingate. 2023. Out of One, Many: Using Language Models to Simulate Human Samples. Political Analysis 31, 3 (Jul 2023), 337-351. doi:10.1017/pan.2023.2 · DOI · Paper page
  4. Amanda Askell, Yuntao Bai, Anna Chen, Dawn Drain, Deep Ganguli, Tom Henighan, Andy Jones, Nicholas Joseph, Ben Mann, Nova DasSarma, et al. 2021. A general language assistant as a laboratory for alignment. arXiv preprint arXiv:2112.00861 (2021). · arXiv
  5. Nikola Banovic, Tofi Buzali, Fanny Chevalier, Jennifer Mankoff, and Anind K. Dey. 2016. Modeling and Understanding Human Routine Behavior. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 248-260. doi:10.1145/2858036. 2858557 · DOI
  6. Youssef Bassil. 2012. A simulation model for the waterfall software development life cycle. arXiv preprint arXiv:1205.6904 (2012). · arXiv
  7. Federico Bianchi, Patrick John Chia, Mert Yuksekgonul, Jacopo Tagliabue, Dan Jurafsky, and James Zou. 2024. How Well Can LLMs Negotiate? NegotiationArena Platform and Analysis. In Forty-first International Conference on Machine Learning. https://openreview.net/forum?id=CmOmaxkt8p
  8. Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al. 2021. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258 (2021). · arXiv
  9. Philip Brookins and Jason Matthew DeBacker. 2023. Playing Games With GPT: What Can We Learn About a Large Language Model From Canonical Strategic Games? Social Science Research Network (Jan 2023). doi:10.2139/ssrn.4493398 · DOI
  10. Derek S. Chapman and Jane Webster. 2003. The Use of Technologies in the Recruiting, Screening, and Selection Processes for Job Candidates. International Journal of Selection and Assessment 11, 2-3 (Jun 2003), 113-120. doi:10.1111/1468- 2389.00234 · DOI
  11. John Chen, Xi Lu, Yuzhou Du, Michael Rejtig, Ruth Bagley, Mike Horn, and Uri Wilensky. 2024. Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chat. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '24). Association for Computing Machinery, New York, NY, USA, Article 141, 18 pages. doi:10.1145/3613904.3642377 · DOI
  12. Weize Chen, Yusheng Su, Jingwei Zuo, Cheng Yang, Chenfei Yuan, Chi-Min Chan, Heyang Yu, Yaxi Lu, Yi-Hsin Hung, Chen Qian, Yujia Qin, Xin Cong, Ruobing Xie, Zhiyuan Liu, Maosong Sun, and Jie Zhou. 2024. AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors. (2024). https://openreview.net/forum?id=EHg5GDnyq1
  13. Harm De Vries, Dzmitry Bahdanau, and Christopher Manning. 2020. Towards ecologically valid research on language user interfaces. arXiv preprint arXiv:2007.14435 (2020). · arXiv
  14. Ameet Deshpande, Vishvak Murahari, Tanmay Rajpurohit, Ashwin Kalyan, and Karthik Narasimhan. 2023. Toxicity in chatgpt: Analyzing persona-assigned language models. In Findings of the Association for Computational Linguistics: EMNLP 2023, Houda Bouamor, Juan Pino, and Kalika Bali (Eds.). Association for Computational Linguistics, Singapore, 1236-1270. doi:10.18653/v1/2023.findings-emnlp.88 · DOI · Paper page
  15. Paul Dourish and Victoria Bellotti. 1992. Awareness and coordination in shared workspaces. In Proceedings of the 1992 ACM Conference on Computer-Supported Cooperative Work (Toronto, Ontario, Canada) (CSCW '92). Association for Computing Machinery, New York, NY, USA, 107-114. doi:10.1145/143457.143468 · DOI · Paper page
  16. Apostolos Filippas, John J. Horton, and Benjamin S. Manning. 2024. Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?. In Proceedings of the 25th ACM Conference on Economics and Computation (New Haven, CT, USA) (EC '24). Association for Computing Machinery, New York, NY, USA, 614-615. doi:10.1145/3670865.3673513 · DOI
  17. Susan R. Fussell, Robert E. Kraut, F. Javier Lerch, William L. Scherlis, Matthew M. McNally, and Jonathan J. Cadiz. 1998. Coordination, overload and team performance: effects of team communication strategies. In Proceedings of the 1998 ACM Conference on Computer Supported Cooperative Work (Seattle, Washington, USA) (CSCW '98). Association for Computing Machinery, New York, NY, USA, 275-284. doi:10.1145/289444.289502 · DOI
  18. Diego Gómez-Zará, Leslie A. DeChurch, and Noshir S. Contractor. 2020. A Taxonomy of Team-Assembly Systems: Understanding How People Use Technologies to Form Teams. Proc. ACM Hum.-Comput. Interact. 4, CSCW2, Article 181 (Oct. 2020), 36 pages. doi:10.1145/3415252 · DOI
  19. Francis Green. 2013. Skills and skilled work : an economic and social analysis. Oxford University Press, Oxford.
  20. R. Guimera. 2005. Team Assembly Mechanisms Determine Collaboration Network Structure and Team Performance. Science 308, 5722 (Apr 2005), 697-702. doi:10.1126/science.1106340 · DOI · Paper page
  21. Michael J. Handel. 2003. Skills Mismatch in the Labor Market. Annual Review of Sociology 29, 1 (Aug 2003), 135-165. doi:10.1146/annurev.soc.29.010202.100030 · DOI
  22. Alexa M. Harris, Diego Gómez-Zará, Leslie A. DeChurch, and Noshir S. Contractor. 2019. Joining Together Online: The Trajectory of CSCW Scholarship on Group Formation. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 148 (Nov. 2019), 27 pages. doi:10.1145/3359250 · DOI
  23. Sirui Hong, Mingchen Zhuge, Jonathan Chen, Xiawu Zheng, Yuheng Cheng, Jinlin Wang, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, Lingfeng Xiao, Chenglin Wu, and Jürgen Schmidhuber. 2024. MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework. In The Twelfth International Conference on Learning Representations. https://openreview.net/forum?id=VtmBAGCN7o
  24. Yuki Hou, Haruki Tamoto, and Homei Miyashita. 2024. "My agent understands me better": Integrating Dynamic Human-like Memory Recall and Consolidation in LLM-Based Agents. In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA '24). Association for Computing Machinery, New York, NY, USA, Article 7, 7 pages. doi:10.1145/3613905.3650839 · DOI · Paper page
  25. Wenyue Hua, Lizhou Fan, Lingyao Li, Kai Mei, Jianchao Ji, Yingqiang Ge, Libby Hemphill, and Yongfeng Zhang. 2023. War and peace (waragent): Large language model-based multi-agent simulation of world wars. arXiv preprint arXiv:2311.17227 (2023). · arXiv
  26. Yue Huang, Lichao Sun, Haoran Wang, Siyuan Wu, Qihui Zhang, Yuan Li, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, et al. 2024. Position: TrustLLM: Trustworthiness in large language models. In International Conference on Machine Learning. PMLR, 20166-20270.
  27. Ziheng Huang, Sebastian Gutierrez, Hemanth Kamana, and Stephen Macneil. 2023. Memory Sandbox: Transparent and Interactive Memory Management for Conversational Agents. In Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (San Francisco, CA, USA) (UIST '23 Adjunct). Association for Computing Machinery, New York, NY, USA, Article 97, 3 pages. doi:10.1145/3586182.3615796 · DOI · Paper page
  28. Farnaz Jahanbakhsh, Wai-Tat Fu, Karrie Karahalios, Darko Marinov, and Brian Bailey. 2017. You Want Me to Work with Who? Stakeholder Perceptions of Automated Team Formation in Project-based Courses. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 3201-3212. doi:10.1145/3025453.3026011 · DOI
  29. Guy Laban, Tomer Laban, and Hatice Gunes. 2024. LEXI: Large Language Models Experimentation Interface. arXiv preprint arXiv:2407.01488 (2024). · arXiv
  30. Richard P. Larrick. 2016. The Social Context of Decisions. Annual Review of Organizational Psychology and Organiza- tional Behavior 3, 1 (Mar 2016), 441-467. doi:10.1146/annurev-orgpsych-041015-062445 · DOI
  31. Nian Li, Chen Gao, Mingyu Li, Yong Li, and Qingmin Liao. 2024. EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activities. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Lun-Wei Ku, Andre Martins, and Vivek Srikumar (Eds.). Association for Computational Linguistics, Bangkok, Thailand, 15523-15536. doi:10.18653/v1/2024.acl-long.829 · DOI · Paper page
  32. Jiaju Lin, Haoran Zhao, Aochi Zhang, Yiting Wu, Huqiuyue Ping, and Qin Chen. 2023. AgentSims: An Open-Source Sandbox for Large Language Model Evaluation. arXiv preprint arXiv:2308.04026 (2023). · arXiv
  33. Joseph E. McGrath, Holly Arrow, and Jennifer L. Berdahl. 2000. The Study of Groups: Past, Present, and Future. Personality and Social Psychology Review 4, 1 (2000), 95-105. doi:10.1207/S15327957PSPR0401_8 arXiv:https://doi.org/10.1207/S15327957PSPR0401_8 · DOI
  34. Seamus McGuinness, Konstantinos Pouliakas, and Paul Redmond. 2018. SKILLS MISMATCH: CONCEPTS, MEASURE- MENT AND POLICY APPROACHES. Journal of Economic Surveys 32, 4 (Jan 2018), 985-1015. doi:10.1111/joes.12254 · DOI
  35. Michael Muller, Ingrid Lange, Dakuo Wang, David Piorkowski, Jason Tsay, Q. Vera Liao, Casey Dugan, and Thomas Erickson. 2019. How Data Science Workers Work with Data: Discovery, Capture, Curation, Design, Creation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1-15. doi:10.1145/3290605.3300356 · DOI
  36. OpenAI. 2023. GPT-4 Technical Report. ArXiv abs/2303.08774 (2023). · arXiv
  37. Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems 35 (2022), 27730-27744.
  38. Joon Sung Park, Joseph O'Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2023. Generative Agents: Interactive Simulacra of Human Behavior. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (San Francisco, CA, USA) (UIST '23). Association for Computing Machinery, New York, NY, USA, Article 2, 22 pages. doi:10.1145/3586183.3606763 · DOI · Paper page
  39. Joon Sung Park, Lindsay Popowski, Carrie Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2022. Social Simulacra: Creating Populated Prototypes for Social Computing Systems. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (Bend, OR, USA) (UIST '22). Association for Computing Machinery, New York, NY, USA, Article 74, 18 pages. doi:10.1145/3526113.3545616 · DOI · Paper page
  40. Chen Qian, Wei Liu, Hongzhang Liu, Nuo Chen, Yufan Dang, Jiahao Li, Cheng Yang, Weize Chen, Yusheng Su, Xin Cong, Juyuan Xu, Dahai Li, Zhiyuan Liu, and Maosong Sun. 2024. ChatDev: Communicative Agents for Software Development. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Lun-Wei Ku, Andre Martins, and Vivek Srikumar (Eds.). Association for Computational Linguistics, Bangkok, Thailand, 15174-15186. doi:10.18653/v1/2024.acl-long.810 · DOI · Paper page
  41. Eduardo Salas, C. Shawn Burke, and Janis A. Cannon-Bowers. 2000. Teamwork: Emerging Principles. International Journal of Management Reviews 2, 4 (Dec 2000), 339-356.
  42. Niloufar Salehi and Michael S. Bernstein. 2018. Hive: Collective Design Through Network Rotation. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 151 (Nov. 2018), 26 pages. doi:10.1145/3274420 · DOI
  43. Maarten Sap, Ronan Le Bras, Daniel Fried, and Yejin Choi. 2022. Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMs. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, Yoav Goldberg, Zornitsa Kozareva, and Yue Zhang (Eds.). Association for Computational Linguistics, Abu Dhabi, United Arab Emirates, 3762-3780. doi:10.18653/v1/2022.emnlp-main.248 · DOI · Paper page
  44. Allan Schweyer. 2004. Talent management systems : best practices in technology solutions for recruitment, retention, and workforce planning. Wiley, Toronto, Ont.
  45. Omar Shaikh, Valentino Emil Chai, Michele Gelfand, Diyi Yang, and Michael S. Bernstein. 2024. Rehearsal: Simulating Conflict to Teach Conflict Resolution. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '24). Association for Computing Machinery, New York, NY, USA, Article 920, 20 pages. doi:10.1145/3613904.3642159 · DOI
  46. Jaisie Sin, Heloisa Candello, Leigh Clark, Benjamin R. Cowan, Minha Lee, Cosmin Munteanu, Martin Porcheron, Sarah Theres Völkel, Stacy Branham, Robin N. Brewer, Ana Paula Chaves, Razan Jaber, and Amanda Lazar. 2023. CUI@CHI: Inclusive Design of CUIs Across Modalities and Mobilities. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA '23). Association for Computing Machinery, New York, NY, USA, Article 341, 5 pages. doi:10.1145/3544549.3573820 · DOI
  47. Eliot R. Smith and Frederica R. Conrey. 2007. Agent-Based Modeling: A New Approach for Theory Building in Social Psychology. Personality and Social Psychology Review 11, 1 (Feb 2007), 87-104. doi:10.1177/1088868306294789 · DOI
  48. Annelies E.M. van Vianen and Carsten K.W. De Dreu. 2001. Personality in teams: Its relationship to social cohesion, task cohesion, and team performance. European Journal of Work and Organizational Psychology 10, 2 (Jun 2001), 97-120. doi:10.1080/13594320143000573 · DOI
  49. Dakuo Wang, Justin D. Weisz, Michael Muller, Parikshit Ram, Werner Geyer, Casey Dugan, Yla Tausczik, Horst Samulowitz, and Alexander Gray. 2019. Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AI. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 211 (Nov. 2019), 24 pages. doi:10.1145/3359313 · DOI · Paper page
  50. Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, et al. 2023. A Survey on Large Language Model based Autonomous Agents. arXiv preprint arXiv:2308.11432 (2023). · arXiv
  51. Lei Wang, Jingsen Zhang, Xu Chen, Yankai Lin, Ruihua Song, Wayne Xin Zhao, and Ji-Rong Wen. 2023. RecAgent: A Novel Simulation Paradigm for Recommender Systems. arXiv preprint arXiv:2306.02552 (2023). · arXiv
  52. Shenzhi Wang, Chang Liu, Zilong Zheng, Siyuan Qi, Shuo Chen, Qisen Yang, Andrew Zhao, Chaofei Wang, Shiji Song, and Gao Huang. 2023. Avalon's Game of Thoughts: Battle Against Deception through Recursive Contemplation. arXiv preprint arXiv:2310.01320 (2023). · arXiv
  53. Xuewei Wang, Weiyan Shi, Richard Kim, Yoojung Oh, Sijia Yang, Jingwen Zhang, and Zhou Yu. 2019. Persuasion for good: Towards a personalized persuasive dialogue system for social good. arXiv preprint arXiv:1906.06725 (2019). · arXiv
  54. Warren E. Watson, Larry K. Michaelsen, and Walt Sharp. 1991. Member competence, group interaction, and group decision making: A longitudinal study. Journal of Applied Psychology 76, 6 (1991), 803-809. doi:10.1037/0021- 9010.76.6.803 · DOI
  55. Anita Williams Woolley, Ishani Aggarwal, and Thomas W Malone. 2015. Collective intelligence and group performance. Current Directions in Psychological Science 24, 6 (2015), 420-424.
  56. Zhiheng Xi, Wenxiang Chen, Xin Guo, Wei He, Yiwen Ding, Boyang Hong, Ming Zhang, Junzhe Wang, Senjie Jin, Enyu Zhou, et al. 2023. The rise and potential of large language model based agents: A survey. arXiv preprint arXiv:2309.07864 (2023). · arXiv
  57. Yuzhuang Xu, Shuo Wang, Peng Li, Fuwen Luo, Xiaolong Wang, Weidong Liu, and Yang Liu. 2023. Exploring large language models for communication games: An empirical study on werewolf. arXiv preprint arXiv:2309.04658 (2023). · arXiv
  58. Zelai Xu, Chao Yu, Fei Fang, Yu Wang, and Yi Wu. 2023. Language agents with reinforcement learning for strategic play in the werewolf game. arXiv preprint arXiv:2310.18940 (2023). · arXiv
  59. Amy X. Zhang, Michael Muller, and Dakuo Wang. 2020. How do Data Science Workers Collaborate? Roles, Workflows, and Tools. Proc. ACM Hum.-Comput. Interact. 4, CSCW1, Article 22 (May 2020), 23 pages. doi:10.1145/3392826 · DOI
  60. Qinlin Zhao, Jindong Wang, Yixuan Zhang, Yiqiao Jin, Kaijie Zhu, Hao Chen, and Xing Xie. [n. d.]. CompeteAI: Under- standing the Competition Dynamics of Large Language Model-based Agents. In Forty-first International Conference on Machine Learning.
  61. Pei Zhou, Aman Madaan, Srividya Pranavi Potharaju, Aditya Gupta, Kevin R McKee, Ari Holtzman, Jay Pujara, Xiang Ren, Swaroop Mishra, Aida Nematzadeh, et al. 2023. How FaR Are Large Language Models From Agents with Theory-of-Mind? arXiv preprint arXiv:2310.03051 (2023). · arXiv
  62. Xuhui Zhou, Hao Zhu, Leena Mathur, Ruohong Zhang, Haofei Yu, Zhengyang Qi, Louis-Philippe Morency, Yonatan Bisk, Daniel Fried, Graham Neubig, and Maarten Sap. 2024. SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents. In The Twelfth International Conference on Learning Representations. https://openreview.net/forum? id=mM7VurbA4r
  63. Caleb Ziems, Omar Ahmed Shaikh, Z Zhang, William A Held, Jiaao Chen, and Diyi Yang. 2023. Can Large Language Models Transform Computational Social Science? Computational Linguistics (Dec 2023), 1-53. doi:10.1162/coli_a_00502 · DOI · Paper page
  64. Wazeer Deen Zulfikar, Samantha Chan, and Pattie Maes. 2024. Memoro: Using Large Language Models to Realize a Concise Interface for Real-Time Memory Augmentation. In Proceedings of the CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '24). Association for Computing Machinery, New York, NY, USA, Article 450, 18 pages. doi:10.1145/3613904.3642450 · DOI

Cited by

Sorted by citations

Authors
Li, Y., Sun, L., & Zhang, Y.
Affiliations
  • University of Cambridge (GB)
  • Lehigh University (US)
  • William & Mary (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
Volume
9
Issue
2
Pages
1-27
ISSN
2573-0142 (ISSN-L)
DOI
10.48550/arxiv.2310.06500
arXiv
2310.06500
OpenAlex
W4410049680
Cited by
38
References
0
Citations by year
2026: 17 · 2025: 13 · 2024: 6 · 2023: 2
FWCI
12.13
Type
journal article
Language
en
Open access
Licence
Locations
  • Proceedings of the ACM on Human-Computer Interaction (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Funders
National Science Foundation (2418582, 2346158, 2427915, 2246067)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Multi-Agent Systems and Negotiation
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Psychiatry, Mental Health, Neuroscience
Keywords
large language models, LLM agents, teaming, team formation, interpersonal decision making, social simulation, job fairs, skill matching

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review