CoChat
Sign Up
PreprintCited by 1Child and Animal Learning DevelopmentEmbodied and Extended CognitionSocial Robot Interaction and HRI

EgoNormia: Benchmarking Physical Social Norm Understanding

Open access
Rezaei, MohammadHossein, Fu, Yicheng, Cuvin, Phil, Ziems, Caleb, Zhang, Yanzhe, Zhu, Hao, Yang, Diyi·2025·arXiv
DOI 10.48550/arxiv.2502.20490arXiv 2502.20490
Open this paper in CoChat — free account

Abstract

Human activity is moderated by norms; however, supervision for normative reasoning is sparse, particularly where norms are physically- or socially-grounded. We thus present EGONORMIA $\|ε\|$, comprising 1,853 (200 for EGONORMIA-verified) multiple choice questions (MCQs) grounded within egocentric videos of human interactions, enabling the evaluation and improvement of normative reasoning in vision-language models (VLMs). EGONORMIA spans seven norm categories: safety, privacy, proxemics, politeness, cooperation, coordination/proactivity, and communication/legibility. To compile this dataset at scale, we propose a novel pipeline to generate grounded MCQs from raw egocentric video. Our work demonstrates that current state-of-the-art VLMs lack robust grounded norm understanding, scoring a maximum of 54% on EGONORMIA and 65% on EGONORMIA-verified, with performance across norm categories indicating significant risks of safety and privacy when VLMs are used in real-world agents. We additionally explore methods for improving normative understanding, demonstrating that a naive retrieval-based generation (RAG) method using EGONORMIA can enhance normative reasoning in VLMs.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2502.20490

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • LLM-driven embodied systems fail to align with human ethical requirements and are easily jailbroken to perform harmful actions, such as recording private information.

    “Moreover, these systems fail to align with human ethical requirements and are easily jailbroken to perform harmful actions, such as recording private information (Rezaei et al., 2025; Zhang et al., 2024c).”

    From Large Language Model Reasoning Failures (2026) · cites this paper as Rezaei et al., 2025

    The paper’s research-question summary reports that vision-language models fall far behind human performance on physical-social-norm decisions, primarily because of gaps in normative reasoning. Its Physical Social Norms section includes respect for private information among those norms. Our copy does not report that embodied systems are easily jailbroken or induced to record private information. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 62

  1. Keshigeyan Chandrasegaran, Agrim Gupta, Lea M. Hadzic, Taran Kota, Jimming He, Cristobal Eyza- guirre, Zane Durante, Manling Li, Jiajun Wu, and Fei-Fei Li. 2024. Hourvideo: 1-hour video-language understanding. In Advances in Neural Information Processing Systems, volume 37.
  2. Boyuan Chen, Zhuo Xu, Sean Kirmani, Brian Ichter, Dorsa Sadigh, Leonidas Guibas, and Fei Xia. 2024a. Spatialvlm: Endowing vision-language models with spatial reasoning capabilities. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 14455–14465. IEEE.
  3. Zhe Chen, Weiyun Wang, Yue Cao, Yangzhou Liu, Zhangwei Gao, Erfei Cui, Jinguo Zhu, Shenglong Ye, Hao Tian, Zhaoyang Liu, Lixin Gu, Xuehui Wang, Qingyun Li, Yimin Ren, Zixuan Chen, Jiapeng Luo, Jiahao Wang, Tan Jiang, Bo Wang, Conghui He, Bo- tian Shi, Xingcheng Zhang, Han Lv, Yi Wang, Wenqi Shao, Pei Chu, Zhongying Tu, Tong He, Zhiyong Wu, Huipeng Deng, Jiaye Ge, Kai Chen, Kaipeng Zhang, Limin Wang, Min Dou, Lewei Lu, Xizhou Zhu, Tong Lu, Dahua Lin, Yu Qiao, Jifeng Dai, and Wenhai Wang. 2024b. Expanding performance boundaries of open-source multimodal models with model, data, and test-time scaling. Preprint, arXiv:2412.05271. · arXiv
  4. Ted Chiang. 2010. The lifecycle of software objects. Subterranean Press Burton.
  5. Aditya Chinchure, Sahithya Ravi, Raymond Ng, Vered Shwartz, Boyang Li, and Leonid Sigal. 2024. Black swan: Abductive and defeasible video reasoning in unpredictable events. Preprint, arXiv:2412.05725. · arXiv
  6. Francois Chollet, Mike Knoop, Gregory Kamradt, and Bryan Landers. 2024. Arc prize 2024: Technical report. arXiv preprint arXiv:2412.04604. · arXiv
  7. Wei Chow, Jiageng Mao, Boyi Li, Daniel Seita, Vitor Guizilini, and Yue Wang. 2025. Physbench: Bench- marking and enhancing vision-language models for physical world understanding. In Proceedings of the International Conference on Learning Representa- tions (ICLR).
  8. Maciej Chudek and Joseph Henrich. 2011. Culture– gene coevolution, norm-psychology and the emer- gence of human prosociality. Trends in cognitive sciences, 15(5):218–226.
  9. Adrienne Chung Adrienne Chung and Rajiv N Rimal Rajiv N Rimal. 2016. Social norms: A review. Re- view of Communication Research, 4:01–28.
  10. Ernst Fehr and Urs Fischbacher. 2004. Social norms and human cooperation. Trends in cognitive sciences, 8(4):185–190.
  11. Anthony Francis, Claudia Pérez-d'Arpino, Chengshu Li, Fei Xia, Alexandre Alahi, Aniket Bera, Abhi- jat Biswas, Joydeep Biswas, Rohan Chandra, Hao- Tien Lewis Chiang, Michael Everett, Sehoon Ha, Justin Hart, Jonathan P How, Haresh Karnan, Tsang- Wei Edward Lee, Luis J Manso, Reuth Mirksy, Sören Pirk, Peter Stone, Ada V Taylor, Peter Trautman, Nathan Tsoi, Marynel Vázquez, Xuesu Xiao, Peng Xu, Naoki Yokoyama, Alexander Toshev, Roberto Martín-Martín, Rachid Alami, and Phani-Teja Singa- maneni. 2024. Principles and Guidelines for Eval- uating Social Robot Navigation Algorithms. ACM Transactions on Human-Robot Interaction.
  12. Anthony Francis, Claudia Pérez-D'Arpino, Chengshu Li, Fei Xia, Alexandre Alahi, Rachid Alami, Aniket Bera, Abhijat Biswas, Joydeep Biswas, Rohan Chan- dra, Hao-Tien Lewis Chiang, Michael Everett, Se- hoon Ha, Justin Hart, Jonathan P. How, Haresh Kar- nan, Tsang-Wei Edward Lee, Luis J. Manso, Reuth Mirksy, Sören Pirk, Phani Teja Singamaneni, Pe- ter Stone, Ada V. Taylor, Peter Trautman, Nathan Tsoi, Marynel Vázquez, Xuesu Xiao, Peng Xu, Naoki Yokoyama, Alexander Toshev, and Roberto Martín- Martín. 2023. Principles and guidelines for evalu- ating social robot navigation algorithms. Preprint, arXiv:2306.16740. · arXiv
  13. Jack P Gibbs. 1965. Norms: The problem of definition and classification. American Journal of Sociology, 70(5):586–594.
  14. Yash Goyal, Tejas Khot, Douglas Summers-Stay, Dhruv Batra, and Devi Parikh. 2017. Making the v in vqa matter: Elevating the role of image understanding in visual question answering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
  15. Kristen Grauman, Andrew Westbury, Eugene Byrne, Zachary Chavis, Antonino Furnari, Rohit Girdhar, Jackson Hamburger, Hao Jiang, Miao Liu, Xingyu Liu, Miguel Martin, Tushar Nagarajan, Ilija Ra- dosavovic, Santhosh Kumar Ramakrishnan, Fiona Ryan, Jayant Sharma, Michael Wray, Mengmeng Xu, Eric Zhongcong Xu, Chen Zhao, Siddhant Bansal, Dhruv Batra, Vincent Cartillier, Sean Crane, Tien Do, Morrie Doulaty, Akshay Erapalli, Christoph Fe- ichtenhofer, Adriano Fragomeni, Qichen Fu, Abrham Gebreselasie, Cristina Gonzalez, James Hillis, Xuhua Huang, Yifei Huang, Wenqi Jia, Weslie Khoo, Jachym Kolar, Satwik Kottur, Anurag Kumar, Fed- erico Landini, Chao Li, Yanghao Li, Zhenqiang Li, Karttikeya Mangalam, Raghava Modhugu, Jonathan Munro, Tullie Murrell, Takumi Nishiyasu, Will Price, Paola Ruiz Puentes, Merey Ramazanova, Leda Sari, Kiran Somasundaram, Audrey Southerland, Yusuke Sugano, Ruijie Tao, Minh Vo, Yuchen Wang, Xindi Wu, Takuma Yagi, Ziwei Zhao, Yunyi Zhu, Pablo Arbelaez, David Crandall, Dima Damen, Gio- vanni Maria Farinella, Christian Fuegen, Bernard Ghanem, Vamsi Krishna Ithapu, C. V. Jawahar, Han- byul Joo, Kris Kitani, Haizhou Li, Richard New- combe, Aude Oliva, Hyun Soo Park, James M. Rehg, Yoichi Sato, Jianbo Shi, Mike Zheng Shou, An- tonio Torralba, Lorenzo Torresani, Mingfei Yan, and Jitendra Malik. 2022. Ego4d: Around the world in 3,000 hours of egocentric video. Preprint, arXiv:2110.07058. · arXiv
  16. Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Ruoyu Zhang, Runxin Xu, Qihao Zhu, Shirong Ma, Peiyi Wang, Xiao Bi, et al. 2025. Deepseek-r1: In- centivizing reasoning capability in llms via reinforce- ment learning. arXiv preprint arXiv:2501.12948. · arXiv
  17. Feng He, Tianqing Zhu, Dayong Ye, Bo Liu, Wanlei Zhou, and Philip S Yu. 2024. The emerged security https://openaccess.thecvf.com/content/CVPR2024/papers/Chen_SpatialVLM_Endowing_Vision-Language_Models_with_Spatial_Reasoning_Capabilities_CVPR_2024_paper.pdf https://openaccess.thecvf.com/content/CVPR2024/papers/Chen_SpatialVLM_Endowing_Vision-Language_Models_with_Spatial_Reasoning_Capabilities_CVPR_2024_paper.pdf https://arxiv.org/abs/2412.05271 https://arxiv.org/abs/2412.05271 https://arxiv.org/abs/2412.05271 https://arxiv.org/abs/2412.05725 https://arxiv.org/abs/2412.05725 https://arxiv.org/abs/2412.05725 https://arxiv.org/abs/2501.16411 https://arxiv.org/abs/2501.16411 https://arxiv.org/abs/2501.16411 https://doi.org/10.1145/3700599 https://doi.org/10.1145/3700599 https://arxiv.org/abs/2306.16740 https://arxiv.org/abs/2306.16740 https://arxiv.org/abs/2110.07058 https://arxiv.org/abs/2110.07058 and privacy of llm agent: A survey with case studies. arXiv preprint arXiv:2407.19354. · DOI · Paper page
  18. Christopher D Hollander and Annie S Wu. 2011. The current state of normative agent-based systems. Jour- nal of Artificial Societies and Social Simulation, 14(2):6.
  19. Ann Huang, Pascal Knierim, Francesco Chiossi, Lewis L Chuang, and Robin Welsch. 2022. Prox- emics for human-agent interaction in augmented re- ality. In Proceedings of the 2022 CHI conference on human factors in computing systems, pages 1–13.
  20. Aaron Hurst, Adam Lerer, Adam P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Os- trow, Akila Welihinda, Alan Hayes, Alec Radford, et al. 2024. Gpt-4o system card. arXiv preprint arXiv:2410.21276. · arXiv
  21. Aaron Jaech, Adam Kalai, Adam Lerer, Adam Richard- son, Ahmed El-Kishky, Aiden Low, Alec Helyar, Aleksander Madry, Alex Beutel, Alex Carney, et al. 2024. Openai o1 system card. arXiv preprint arXiv:2412.16720. · arXiv
  22. Moritz Köster and Robert Hepach. 2024. Preverbal infants' understanding of social norms. Scientific Reports, 14(1):2983.
  23. Minae Kwon, Hengyuan Hu, Vivek Myers, Siddharth Karamcheti, Anca Dragan, and Dorsa Sadigh. 2024. Toward grounded commonsense reasoning. Preprint, arXiv:2306.08651. · arXiv
  24. Przemyslaw A Lasota, Terrence Fong, Julie A Shah, et al. 2017. A survey of methods for safe human- robot interaction. Foundations and Trends® in Robotics, 5(4):261–349.
  25. Matthew Le, Y-Lan Boureau, and Maximilian Nickel. 2019. Revisiting the evaluation of theory of mind through question answering. In Proceedings of the 2019 Conference on Empirical Methods in Natu- ral Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 5872–5877, Hong Kong, China. Association for Computational Linguistics.
  26. Jie Lei, Licheng Yu, Mohit Bansal, and Tamara Berg. 2018. TVQA: Localized, compositional video ques- tion answering. In Proceedings of the 2018 Con- ference on Empirical Methods in Natural Language Processing, pages 1369–1379, Brussels, Belgium. Association for Computational Linguistics.
  27. Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Tim Rocktäschel, Sebastian Ruder, Luca Weihs, and Douwe Kiela. 2020. Retrieval-augmented generation for knowledge-intensive nlp tasks. arXiv preprint arXiv:2005.11401. · arXiv
  28. Manling Li, Shiyu Zhao, Qineng Wang, Kangrui Wang, Yu Zhou, Sanjana Srivastava, Cem Gokmen, Tony Lee, Li Erran Li, Ruohan Zhang, et al. 2024b. Em- bodied agent interface: Benchmarking llms for em- bodied decision making. In The Thirty-eight Con- ference on Neural Information Processing Systems Datasets and Benchmarks Track.
  29. Karttikeya Mangalam, Raiymbek Akshulakov, and Ji- tendra Malik. 2023. Egoschema: A diagnostic bench- mark for very long-form video language understand- ing. In Advances in Neural Information Processing Systems, volume 36, pages 46212–46244. Curran As- sociates, Inc.
  30. Christoforos Mavrogiannis, Francesca Baldini, Allan Wang, Dapeng Zhao, Pete Trautman, Aaron Steinfeld, and Jean Oh. 2023. Core challenges of social robot navigation: A survey. ACM Transactions on Human- Robot Interaction, 12(3):1–39.
  31. Sara Mills and Dániel Z Kádár. 2011. Politeness and culture. Politeness in East Asia, pages 21–44.
  32. Bryce Morsky and Erol Akçay. 2019. Evolution of social norms and correlated equilibria. Proceedings of the National Academy of Sciences, 116(18):8834– 8839.
  33. Partha Mukherjee, Sandip Sen, and Stephane Airiau. 2007. Emergence of norms with biased inter- actions in heterogeneous agent societies. In 2007 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology- Workshops, pages 512–515. IEEE.
  34. Margot ME Neggers, Raymond H Cuijpers, Peter AM Ruijten, and Wijnand A IJsselsteijn. 2022. Deter- mining shape and size of personal space of a human when passed by a robot. International Journal of Social Robotics, 14(2):561–572.
  35. Elinor Ostrom. 2000. Collective action and the evolu- tion of social norms. Journal of economic perspec- tives, 14(3):137–158.
  36. Aishwarya Padmakumar, Jesse Thomason, Ayush Shri- vastava, Patrick Lange, Anjali Narayan-Chen, Span- dana Gella, Robinson Piramuthu, Gokhan Tur, and Dilek Hakkani-Tur. 2021. Teach: Task-driven em- bodied agents that chat. Preprint, arXiv:2110.00534. https://arxiv.org/abs/2306.08651 https://doi.org/10.18653/v1/D19-1598 https://doi.org/10.18653/v1/D19-1598 https://doi.org/10.18653/v1/D18-1167 https://doi.org/10.18653/v1/D18-1167 https://arxiv.org/abs/2005.11401 https://arxiv.org/abs/2005.11401 https://doi.org/10.30658/hmc.1.6 https://doi.org/10.30658/hmc.1.6 https://doi.org/10.30658/hmc.1.6 https://proceedings.neurips.cc/paper_files/paper/2023/file/90ce332aff156b910b002ce4e6880dec-Paper-Datasets_and_Benchmarks.pdf https://proceedings.neurips.cc/paper_files/paper/2023/file/90ce332aff156b910b002ce4e6880dec-Paper-Datasets_and_Benchmarks.pdf https://proceedings.neurips.cc/paper_files/paper/2023/file/90ce332aff156b910b002ce4e6880dec-Paper-Datasets_and_Benchmarks.pdf https://openai.com/index/o3-mini-system-card/ https://arxiv.org/abs/2110.00534 https://arxiv.org/abs/2110.00534 · DOI
  37. Cédric Paternotte and Jonathan Grose. 2013. Social norms and game theory: Harmony or discord? The British journal for the philosophy of science.
  38. Abhinav Rao, Akhila Yerukola, Vishwa Shah, Katha- rina Reinecke, and Maarten Sap. 2024. Normad: A framework for measuring the cultural adaptability of large language models. Preprint, arXiv:2404.12464. · arXiv
  39. James A Russell and Lawrence M Ward. 1982. Envi- ronmental psychology. Annual review of psychology.
  40. Maarten Sap, Ronan Le Bras, Emily Allaway, Chan- dra Bhagavatula, Nicholas Lourie, Hannah Rashkin, Brendan Roof, Noah A Smith, and Yejin Choi. 2019. Atomic: An atlas of machine commonsense for if- then reasoning. In Proceedings of the AAAI con- ference on artificial intelligence, volume 33, pages 3027–3035.
  41. Marco FH Schmidt, Lucas P Butler, Julia Heinz, and Michael Tomasello. 2016. Young children see a single action and infer a social norm: Promiscuous normativity in 3-year-olds. Psychological Science, 27(10):1360–1370.
  42. Yijia Shao, Tianshi Li, Weiyan Shi, Yanchen Liu, and Diyi Yang. 2024. Privacylens: Evaluating pri- vacy norm awareness of language models in action. Preprint, arXiv:2409.00138. · arXiv
  43. Natalie Shapira, Guy Zwirn, and Yoav Goldberg. 2023. How well do large language models perform on faux pas tests? In Findings of the Association for Compu- tational Linguistics: ACL 2023, pages 10438–10451, Toronto, Canada. Association for Computational Lin- guistics.
  44. Weiyan Shi, Ryan Li, Yutong Zhang, Caleb Ziems, Raya Horesh, Rogério Abreu de Paula, Diyi Yang, et al. 2024. Culturebank: An online community-driven knowledge base towards culturally aware language technologies. arXiv preprint arXiv:2404.15238. · arXiv
  45. Charlie Snell, Jaehoon Lee, Kelvin Xu, and Aviral Ku- mar. 2024. Scaling llm test-time compute optimally can be more effective than scaling model parameters. Preprint, arXiv:2408.03314. · arXiv
  46. Robyn Speer, Joshua Chin, and Catherine Havasi. 2017. Conceptnet 5.5: An open multilingual graph of gen- eral knowledge. In Proceedings of the AAAI confer- ence on artificial intelligence, volume 31.
  47. Gemini Team, Petko Georgiev, Ving Ian Lei, Ryan Burnell, Libin Bai, Anmol Gulati, Garrett Tanzer, Damien Vincent, Zhufeng Pan, Shibo Wang, et al. 2024. Gemini 1.5: Unlocking multimodal under- standing across millions of tokens of context. arXiv preprint arXiv:2403.05530. · arXiv
  48. Paul AM Van Lange, Jeff Joireman, Craig D Parks, and Eric Van Dijk. 2013. The psychology of social dilemmas: A review. Organizational Behavior and Human Decision Processes, 120(2):125–141.
  49. Ruiyi Wang, Haofei Yu, Wenxin Zhang, Zhengyang Qi, Maarten Sap, Yonatan Bisk, Graham Neubig, and Hao Zhu. 2024. SOTOPIA-π: Interactive learning of socially intelligent language agents. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 12912–12940, Bangkok, Thailand. Association for Computational Linguistics.
  50. Xuewei Wang, Weiyan Shi, Richard Kim, Yoojung Oh, Sijia Yang, Jingwen Zhang, and Zhou Yu. 2019. Per- suasion for good: Towards a personalized persuasive dialogue system for social good. In Proceedings of the 57th Annual Meeting of the Association for Com- putational Linguistics, pages 5635–5649, Florence, Italy. Association for Computational Linguistics.
  51. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022. Chain-of-thought prompting elicits rea- soning in large language models. Advances in neural information processing systems, 35:24824–24837.
  52. Yangzhen Wu, Zhiqing Sun, Shanda Li, Sean Welleck, and Yiming Yang. 2024. Inference scaling laws: An empirical analysis of compute-optimal inference for problem-solving with language models. Preprint, arXiv:2408.00724. · arXiv
  53. Junbin Xiao, Xindi Shang, Angela Yao, and Tat-Seng Chua. 2021. Next-qa: Next phase of question- answering to explaining temporal actions. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 9777– 9786.
  54. Zhou Yu, Dejing Xu, Jun Yu, Ting Yu, Zhou Zhao, Yuet- ing Zhuang, and Dacheng Tao. 2019. Activitynet-qa: A dataset for understanding complex web videos via question answering. In AAAI, pages 9127–9134.
  55. Rowan Zellers, Yonatan Bisk, Ali Farhadi, and Yejin Choi. 2019. From recognition to cognition: Vi- sual commonsense reasoning. In Proceedings of the IEEE/CVF conference on computer vision and pat- tern recognition, pages 6720–6731.
  56. Zhicheng Zheng, Xin Yan, Zhenfang Chen, Jingzhou Wang, Qin Zhi Eddie Lim, Joshua B Tenenbaum, and Chuang Gan. 2024. Contphy: Continuum physical concept learning and reasoning from videos. In Inter- national Conference on Machine Learning. PMLR.
  57. Kaiwen Zhou, Chengzhi Liu, Xuandong Zhao, An- derson Compalas, Dawn Song, and Xin Eric Wang. 2024a. Multimodal situational safety. arXiv preprint arXiv:2410.06172. · arXiv
  58. Xuhui Zhou, Hao Zhu, Leena Mathur, Ruohong Zhang, Haofei Yu, Zhengyang Qi, Louis-Philippe Morency, Yonatan Bisk, Daniel Fried, Graham Neubig, and https://arxiv.org/abs/2404.12464 https://arxiv.org/abs/2404.12464 https://arxiv.org/abs/2404.12464 https://arxiv.org/abs/2409.00138 https://arxiv.org/abs/2409.00138 https://doi.org/10.18653/v1/2023.findings-acl.663 https://doi.org/10.18653/v1/2023.findings-acl.663 https://arxiv.org/abs/2408.03314 https://arxiv.org/abs/2408.03314 https://qwenlm.github.io/blog/qwen2.5-vl/ https://doi.org/10.18653/v1/2024.acl-long.698 https://doi.org/10.18653/v1/2024.acl-long.698 https://doi.org/10.18653/v1/P19-1566 https://doi.org/10.18653/v1/P19-1566 https://doi.org/10.18653/v1/P19-1566 https://arxiv.org/abs/2408.00724 https://arxiv.org/abs/2408.00724 https://arxiv.org/abs/2408.00724 · DOI
  59. Maarten Sap. 2024b. Sotopia: Interactive evaluation for social intelligence in language agents. Preprint, arXiv:2310.11667. · arXiv
  60. Hao Zhu, Vidhi Jain, Su Li, and Yonatan Bisk. 2024. Siat: Stretch control with immersive ar teleopera- tion. In Conference on Robot Learning (CoRL) Demo Track. Munich, Germany.
  61. Hao Zhu, Raghav Kapoor, So Yeon Min, Winson Han, Jiatai Li, Kaiwen Geng, Graham Neubig, Yonatan Bisk, Aniruddha Kembhavi, and Luca Weihs. 2023. Excalibur: Encouraging and evaluating embodied exploration. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 14931–14942.
  62. Caleb Ziems, Jane Dwivedi-Yu, Yi-Chia Wang, Alon Halevy, and Diyi Yang. 2023. NormBank: A knowl- edge bank of situational social norms. In Proceed- ings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7756–7776, Toronto, Canada. Association for Computational Linguistics. https://arxiv.org/abs/2310.11667 https://arxiv.org/abs/2310.11667 https://doi.org/10.18653/v1/2023.acl-long.429 https://doi.org/10.18653/v1/2023.acl-long.429 · DOI

Cited by

Sorted by citations

Authors
Rezaei, M., Fu, Y., Cuvin, P., Ziems, C., Zhang, Y., Zhu, H., & Yang, D.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2025
Pages
19256-19283
DOI
10.48550/arxiv.2502.20490
arXiv
2502.20490
OpenAlex
W4412888103
Cited by
0
References
1
FWCI
0.00
Type
conference paper
Language
en
Open access
Licence
Locations
  • Findings of the Association for Computational Linguistics: ACL (Findings of ACL) (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Topics
  • Social Sciences › Psychology › Developmental and Educational Psychology › Child and Animal Learning Development
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Embodied and Extended Cognition
  • Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
Keywords
social norms, benchmarking, norm violation detection

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review