Deception at Scale: Deceptive Designs in 1K LLM-Generated E-Commerce Components
Open accessAbstract
Recent work has shown that front-end code generated by Large Language Models (LLMs) can embed deceptive designs. To assess the magnitude of this problem, identify the factors that influence deceptive design production, and test strategies for reducing deceptive designs, we carried out two studies which generated and analyzed 1,296 LLM-generated web components, along with a design rationale for each. The first study tested four LLMs for 15 common ecommerce components. Overall 55.8% of components contained at least one deceptive design, and 30.6% contained two or more. Occurence varied significantly across models, with DeepSeek-V3 producing the fewest. Interface interference emerged as the dominant strategy, using color psychology to influence actions and hiding essential information. The first study found that prompts emphasizing business interests (e.g., increasing sales) significantly increased deceptive designs, so a second study tested a variety of prompting strategies to reduce their frequency, finding a values-centered approach the most effective. Our findings highlight risks in using LLMs for coding and offer recommendations for LLM developers and providers.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Even LLM-generated software has tendencies to embed dark patterns, particularly when prompted to optimize for business goals and product success.
“Furthermore, even LLM-generated software has tendencies to embed dark patterns, particularly when prompted to optimize for business goals and product success (Chen et al., 2026;Krauß et al., 2025).”
From Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents (2025) · cites this paper as Chen et al., 2026
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
AI deception: A survey of examples, risks, and potential solutions
Park, P. S., Goldstein, S., O’Gara, A., Chen, M., & Hendrycks, D. (2024) · Patterns · doi:10.1016/j.patter.2024.100988 · Cited by 243 · see citing works
Do Users Write More Insecure Code with AI Assistants?
Perry, N., Srivastava, M., Kumar, D., & Boneh, D. (2022) · arXiv · cited 1×
“The membership sign-up component collects customer names and email without explaining how it will be used or protected ( interface interference in Gray’s taxonomy [29]).”
Flagged first, then by citations
Research works printed but not linked: 61
- [2][2] Marwa Abdulhai, Gregory Serapio-Garcia, Clément Crepy, Daria Valter, John Canny, and Natasha Jaques. 2023. Moral Foundations of Large Language Models. arXiv:2310.15337 [cs.AI] https://arxiv.org/abs/2310.15337 - · arXiv
- [3][3] Francis M Adams and Charles E Osgood. 1973. A cross-cultural study of the affective meanings of color. Journal of cross-cultural psychology 4, 2 (1973). doi:10.1177/002202217300400201 - · DOI
- [4][4] Haris Ahmed, Tahseen Ahmed Jilani, Waleej Haider, Mohammad Asad Abbasi, Shardha Nand, and Saher Kamran. 2017. Establishing Standard Rules for Choosing Best KPIs for an E-Commerce Business based on Google Analytics and Machine Learning Technique. International Journal of Advanced Computer Science and Applications 8, 5 (2017). doi:10.14569/IJACSA.2017.080570 - · DOI
- [6][6] Sadia Asif, Israel Antonio Rosales Laguan, Haris Khan, Shumaila Asif, and Muneeb Asif. 2025. DarkPatterns-LLM: A Multi-Layer Benchmark for Detecting Manipulative and Harmful AI Behavior. arXiv:2512.22470 [cs.AI] https: //arxiv.org/abs/2512.22470 - · arXiv
- [7][7] Bowen Baker, Joost Huizinga, Leo Gao, Zehao Dou, Melody Y. Guan, Aleksander Madry, Wojciech Zaremba, Jakub Pachocki, and David Farhi. 2025. Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscation. arXiv:2503.11926 [cs.AI] https://arxiv.org/abs/2503.11926 - · arXiv
- [8][8] Yutong Bian, Xianhao Lin, Yupeng Xie, Tianyang Liu, Mingchen Zhuge, Siyuan Lu, Haoming Tang, Jinlin Wang, Jiayi Zhang, Jiaqi Chen, Xiangru Tang, Yongxin Ni, Sirui Hong, and Chenglin Wu. 2025. You Don't Know Until You Click:Automated GUI Testing for Production-Ready Software Evaluation. arXiv:2508.14104 [cs.SE] https://arxiv.org/abs/2508.14104 - · arXiv
- [9][9] Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, Erik Brynjolfsson, Shyamal Buch, Dallas Card, Rodrigo Castellon, Niladri Chatterji, Annie Chen, Kathleen Creel, Jared Quincy Davis, Dora Demszky, Chris Donahue, Moussa Doumbouya, Esin Durmus, Stefano Ermon, John Etchemendy, Kawin Ethayarajh, Li Fei-Fei, Chelsea Finn, Trevor Gale, Lauren Gillespie, Karan Goel, Noah Goodman, Shelby Grossman, Neel Guha, Tatsunori Hashimoto, Peter Henderson, John Hewitt, Daniel E. Ho, Jenny Hong, Kyle Hsu, Jing Huang, Thomas Icard, Saahil Jain, Dan Jurafsky, Pratyusha Kalluri, Siddharth Karamcheti, Geoff Keeling, Fereshte Khani, Omar Khattab, Pang Wei Koh, Mark Krass, Ranjay Krishna, Rohith Kuditipudi, Ananya Kumar, Faisal Ladhak, Mina Lee, Tony Lee, Jure Leskovec, Isabelle Levent, Xiang Lisa Li, Xuechen Li, Tengyu Ma, Ali Malik, Christopher D. Manning, Suvir Mirchandani, Eric Mitchell, Zanele Munyikwa, Suraj Nair, Avanika Narayan, Deepak Narayanan, Ben Newman, Allen Nie, Juan Carlos Niebles, Hamed Nilforoshan, Julian Nyarko, Giray Ogut, Laurel Orr, Isabel Papadimitriou, Joon Sung Park, Chris Piech, Eva Portelance, Christopher Potts, Aditi Raghunathan, Rob Reich, Hongyu Ren, Frieda Rong, Yusuf Roohani, Camilo Ruiz, Jack Ryan, Christopher Ré, Dorsa Sadigh, Shiori Sagawa, Keshav Santhanam, Andy Shih, Krishnan Srinivasan, Alex Tamkin, Rohan Taori, Armin W. Thomas, Florian Tramèr, Rose E. Wang, William Wang, Bohan Wu, Jiajun Wu, Yuhuai Wu, Sang Michael Xie, Michihiro Yasunaga, Jiaxuan You, Matei Zaharia, Michael Zhang, Tianyi Zhang, Xikun Zhang, Yuhui Zhang, Lucia Zheng, Kaitlyn Zhou, and Percy Liang. 2022. On the Opportunities and Risks of Foundation Models. arXiv:2108.07258 [cs.LG] https://arxiv.org/abs/2108.07258 - · arXiv
- [10][10] Kerstin Bongard-Blanchy, Arianna Rossi, Salvador Rivas, Sophie Doublet, Vincent Koenig, and Gabriele Lenzini. 2021. 'I am Definitely Manipulated, Even When I am Aware of it. It's Ridiculous!' - Dark Patterns from the End-User Perspective. In Proc. of the Designing Interactive Systems Conference (DIS) . Association for Computing Machinery. doi:10.1145/3461778.3462086 - · DOI
- [11][11] David M. Boush. 2009. Marketplace Deception Protection Skills. In Deception in the Marketplace: The Psychology of Deceptive Persuasion and Consumer SelfProtection , David M. Boush, Marian Friestad, and Peter Wright (Eds.). Taylor & Francis Group, New York. doi:10.4324/9780203875959 - · DOI
- [14][14] Christoph Bösch, Benjamin Erb, Frank Kargl, Henning Kopp, and Stefan Pfattheicher. 2016. Tales from the Dark Side: Privacy Dark Strategies and Privacy Dark Patterns. Proc. on Privacy Enhancing Technologies 2016, 4 (2016). doi:10.1515/ popets-2016-0038 -
- [16][16] Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anastasios N. Angelopoulos, Tianle Li, Dacheng Li, Banghua Zhu, Hao Zhang, Michael I. Jordan, Joseph E. Gonzalez, and Ion Stoica. 2024. Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference (ICML) . JMLR.org. -
- [17][17] Gregory Conti and Edward Sobiesk. 2010. Malicious Interface Design: Exploiting the User. In Proc. of the International Conference on World Wide Web (WWW) . Association for Computing Machinery. doi:10.1145/1772690.1772719 - · DOI
- [18][18] Phil Cuvin, Hao Zhu, and Diyi Yang. 2025. DECEPTICON: How Dark Patterns Manipulate Web Agents. arXiv:2512.22894 [cs.CR] https://arxiv.org/abs/2512. 22894 - · arXiv
- [21][21] Linda Di Geronimo, Larissa Braz, Enrico Fregnan, Fabio Palomba, and Alberto Bacchelli. 2020. UI Dark Patterns and Where to Find Them: A Study on Mobile Applications and User Perception. In Proc. of the Conference on Human Factors in Computing Systems (CHI) . Association for Computing Machinery. doi:10.1145/ 3313831.3376600 -
- [22][22] European Parliament and Council of the European Union. [n. d.]. Regulation (EU) 2022/2065 on a Single Market for Digital Services (Digital Services Act). Official Journal of the European Union, L 277, 27 October 2022, pp. 1-102. https://eurlex.europa.eu/legal-content/EN/TXT/?uri=CELEX:32022R2065 Entered into force 16 November 2022; application from 17 February 2024. -
- [23][23] Federal Trade Commission - Bureau of Consumer Protection. 2022. Bringing Dark Patterns to Light: FTC Staff Report. FTC Workshop Staff Report. https://www.ftc.gov/system/files/ftc\_gov/pdf/P214800%20Dark% 20Patterns%20Report%209.14.2022%20-%20FINAL.pdf -
- [24][24] Zijian Feng, Hanzhang Zhou, Zixiao Zhu, Junlang Qian, and Kezhi Mao. 2024. Unveiling and Manipulating Prompt Influence in Large Language Models. arXiv:2405.11891 [cs.CL] https://arxiv.org/abs/2405.11891 - · arXiv
- [25][25] Batya Friedman and Peter H. Jr Kahn. 2007. Human Values, Ethics, and Design. In Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications (2nd ed.), Andrew Sears and Julie A. Jacko (Eds.). CRC Press. -
- [28][28] Colin M. Gray, Yubo Kou, Bryan Battles, Joseph Hoggatt, and Austin L. Toombs. 2018. The Dark (Patterns) Side of UX Design. In Proc. of the Conference on Human Factors in Computing Systems (CHI) . Association for Computing Machinery. doi:10. 1145/3173574.3174108 -
- [29][29] Colin M. Gray, Cristiana Teixeira Santos, Nataliia Bielova, and Thomas Mildner. 2024. An Ontology of Dark Patterns Knowledge: Foundations, Definitions, and a Pathway for Shared Knowledge-Building. In Proc. of the Conference on Human Factors in Computing Systems (CHI) . Association for Computing Machinery. doi:10. 1145/3613904.3642436 -
- [30][30] Johanna Gunawan, Woodrow Hartzog, Neil Richards, David Choffnes, and Christo Wilson. 2025. Dark Patterns as Disloyal Design. Indiana Law Journal 100, 4 (2025). https://www.repository.law.indiana.edu/ilj/vol100/iss4/3 -
- [31][31] Hans Haans, Niels Raassens, and Roeland van Hout. 2013. Search engine advertisements: The impact of advertising statements on click-through and conversion rates. Marketing Letters 24, 2 (2013). doi:10.1007/s11002-013-9226-5 - · DOI
- [32][32] Hilda Hadan, Lydia Choong, Leah Zhang-Kennedy, and Lennart E. Nacke. 2024. Deceived by Immersion: A Systematic Analysis of Deceptive Design in Extended Reality. ACM Comput. Surv. 56 (2024). doi:10.1145/3659945 - · DOI
- [33][33] Thilo Hagendorff. 2024. Deception abilities emerged in large language models. Proc. of the National Academy of Sciences 121, 24 (2024). doi:10.1073/pnas. 2317967121 - · DOI
- [34][34] Jon D. Hanson and Douglas A. Kysar. 1999. Taking Behavioralism Seriously: The Problem of Market Manipulation. New York University Law Review 74 (1999). https://ssrn.com/abstract=1288182 -
- [35][35] Yilei Jiang, Yaozhi Zheng, Yuxuan Wan, Jiaming Han, Qunzhong Wang, Michael R. Lyu, and Xiangyu Yue. 2025. ScreenCoder: Advancing Visual-toCode Generation for Front-End Automation via Modular Multimodal Agents. arXiv:2507.22827 [cs.CV] https://arxiv.org/abs/2507.22827 - · arXiv
- [36][36] Claudia Kawai, Yang Zhang, Gáspár Lukács, Wenyi Chu, Chaoyi Zheng, Cijun Gao, Davood Gozli, Yonghui Wang, and Ulrich Ansorge. 2023. The Good, the Bad, and the Red: Implicit Color-Valence Associations Across Cultures. Psychological Research 87, 3 (2023). doi:10.1007/s00426-022-01697-5 - · DOI
- [37][37] Agnieszka Kitkowska. 2023. The Hows and Whys of Dark Patterns: Categorizations and Privacy. In Human Factors in Privacy Research . Springer International Publishing, 173-198. -
- [38][38] Esben Kran, Hieu Minh "Jord" Nguyen, Akash Kundu, Sami Jawhar, Jinsuk Park, and Mateusz Maria Jurewicz. 2025. DarkBench: Benchmarking Dark Patterns in Large Language Models. arXiv:2503.10728 [cs.CL] https://arxiv.org/abs/2503. 10728 - · arXiv
- [39][39] Veronika Krauß, Mark McGill, Thomas Kosch, Yolanda Maira Thiel, Dominik Schön, and Jan Gugenheimer. 2025. 'Create a Fear of Missing Out' - ChatGPT Implements Unsolicited Deceptive Designs in Generated Websites Without Warning. In Proc. of the Conference on Human Factors in Computing Systems (CHI) . Association for Computing Machinery. doi:10.1145/3706598.3713083 - · DOI
- [40][40] Veronika Krauß, Pejman Saeghe, Alexander Boden, Mohamed Khamis, Mark McGill, Jan Gugenheimer, and Michael Nebeling. 2024. What Makes XR Dark? Examining Emerging Dark Patterns in Augmented and Virtual Reality through Expert Co-Design. ACM Trans. Comput.-Hum. Interact. 31 (2024). doi:10.1145/ 3660340 -
- [41][41] MohammadAminKuhail, Sujith Samuel Mathew, Ashraf Khalil, Jose Berengueres, and Syed Jawad Hussain Shah. 2024. 'Will I be replaced?' Assessing ChatGPT's Effect on Software Development and Programmer Perceptions of AI Tools. Science of Computer Programming 235 (2024). doi:10.1016/j.scico.2024.103111 - · DOI · Paper page
- [42][42] Jenny T. Liang, Chenyang Yang, and Brad A. Myers. 2024. A Large-Scale Survey on the Usability of AI Programming Assistants: Successes and Challenges. In Proc. of the International Conference on Software Engineering (ICSE) . Association for Computing Machinery. doi:10.1145/3597503.3608128 - · DOI · Paper page
- [43][43] Stephen MacNeil, Andrew Tran, Arto Hellas, Joanne Kim, Sami Sarsa, Paul Denny, Seth Bernstein, and Juho Leinonen. 2023. Experiences from Using Code Explanations Generated by Large Language Models in a Web Software Development E-Book. In Proc. of the Technical Symposium on Computer Science Education (SIGCSE) . Association for Computing Machinery. doi:10.1145/3545945.3569785 - · DOI · Paper page
- [44][44] James Martin, Magda Nenycz-Thiel, John Dawes, Arry Tanusondjaja, Justin Cohen, Bruce McColl, and Giang Trinh. 2020. Fundamental basket size patterns and their relation to retailer performance. Journal of Retailing and Consumer Services 54 (2020). -
- [45][45] Arunesh Mathur, Gunes Acar, Michael J. Friedman, Eli Lucherini, Jonathan Mayer, Marshini Chetty, and Arvind Narayanan. 2019. Dark Patterns at Scale: Findings from a Crawl of 11K Shopping Websites. Proc. ACM Hum.-Comput. Interact. 3 (2019). doi:10.1145/3359183 - · DOI · Paper page
- [46][46] Arunesh Mathur, Mihir Kshirsagar, and Jonathan Mayer. 2021. What Makes a Dark Pattern... Dark? Design Attributes, Normative Considerations, and Measurement Methods. In Proc. of the Conference on Human Factors in Computing Systems (CHI) . Association for Computing Machinery. doi:10.1145/3411764.3445610 - · DOI
- [47][47] William C McDowell, Rachel C Wilson, and Charles Owen Kile Jr. 2016. An examination of retail website design and conversion rate. Journal of Business Research 69, 11 (2016). -
- [48][48] Thomas Mildner, Merle Freye, Gian-Luca Savino, Philip R. Doyle, Benjamin R. Cowan, and Rainer Malaka. 2023. Defending Against the Dark Arts: Recognising Dark Patterns in Social Media. In Proc. of the Designing Interactive Systems Conference (DIS) . Association for Computing Machinery. doi:10.1145/3563657.3595964 - · DOI
- [49][49] Thomas Mildner, Gian-Luca Savino, Philip R. Doyle, Benjamin R. Cowan, and Rainer Malaka. 2023. About Engaging and Governing Strategies: A Thematic Analysis of Dark Patterns in Social Networking Services. In Proc. of the Conference on Human Factors in Computing Systems (CHI) . Association for Computing Machinery. doi:10.1145/3544548.3580695 - · DOI
- [50][50] Stuart Mills and Richard Whittle. 2023. Detecting Dark Patterns Using Generative AI: Some Preliminary Results. Available at SSRN 4614907 (2023). -
- [51][51] Alberto Monge Roffarello, Kai Lukoff, and Luigi De Russis. 2023. Defining and Identifying Attention Capture Deceptive Designs in Digital Interfaces. In Proc. of the Conference on Human Factors in Computing Systems (CHI) . Association for Computing Machinery. doi:10.1145/3544548.3580729 - · DOI
- [52][52] Carol Moser, Sarita Y. Schoenebeck, and Paul Resnick. 2019. Impulse Buying: Design Practices and Consumer Needs. In Proc. of the Conference on Human Factors in Computing Systems (CHI) . Association for Computing Machinery. doi:10.1145/ 3290605.3300472 -
- [53][53] Daye Nam, Andrew Macvean, Vincent Hellendoorn, Bogdan Vasilescu, and Brad Myers. 2024. Using an LLM to Help With Code Understanding. In Proc. of the International Conference on Software Engineering (ICSE) . Association for Computing Machinery. doi:10.1145/3597503.3639187 - · DOI · Paper page
- [54][54] Jakob Nielsen. 1989. Coordinating user interfaces for consistency. SIGCHI Bull. 20, 3 (1989). doi:10.1145/67900.67910 - · DOI
- [59][59] Hammond Pearce, Baleegh Ahmad, Benjamin Tan, Brendan Dolan-Gavitt, and Ramesh Karri. 2021. Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributions. arXiv:2108.09293 [cs.CR] https://arxiv.org/abs/ 2108.09293 - · arXiv
- [61][61] Sonja Rattay, Ville Vakkuri, Marco C. Rozendaal, and Irina Shklovski. 2025. "Why do we do this?": Moral Stress and the Affective Experience of Ethics in Practice. In Proc. of the Conference on Human Factors in Computing Systems (CHI) . Association for Computing Machinery. doi:10.1145/3706598.3713264 - · DOI
- [62][62] Katharina Reinecke and Krzysztof Z. Gajos. 2014. Quantifying Visual Preferences Around the World. In Proc. of the Conference on Human Factors in Computing Systems (CHI) . Association for Computing Machinery. doi:10.1145/2556288.2557052 - · DOI
- [63][63] René Schäfer, Paul Miles Preuschoff, Rene Niewianda, Sophie Hahn, Kevin Fiedler, and Jan Borchers. 2025. Don't Detect, Just Correct: Can LLMs Defuse Deceptive Patterns Directly?. In Proc. of the Extended Abstracts of the Conference on Human Factors in Computing Systems (CHI EA) . Association for Computing Machinery, Article 199. doi:10.1145/3706599.3719683 - · DOI
- [64][64] Brennan Schaffner, Neha A. Lingareddy, and Marshini Chetty. 2022. Understanding Account Deletion and Relevant Dark Patterns on Social Media. Proc. ACM Hum.-Comput. Interact. 6 (2022). doi:10.1145/3555142 - · DOI
- [65][65] Helen Sharp, Yvonne Rogers, and Jenny Preece. 2007. Interaction Design: Beyond Human Computer Interaction . John Wiley. -
- [66][66] Yike Shi, Qing Xiao, Qing Hu, Hong Shen, and Hua Shen. 2025. The Siren Song of LLMs: How Users Perceive and Respond to Dark Patterns in Large Language Models. arXiv:2509.10830 [cs.HC] https://arxiv.org/abs/2509.10830 - · arXiv
- [67][67] Chenglei Si, Yanzhe Zhang, Ryan Li, Zhengyuan Yang, Ruibo Liu, and Diyi Yang. 2025. Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineering. arXiv:2403.03163 [cs.CL] https://arxiv.org/abs/2403. 03163 - · arXiv
- [68][68] Ray Sin, Ted Harris, Simon Nilsson, and Talia Beck. 2025. Dark Patterns in Online Shopping: Do They Work and Can Nudges Help Mitigate Impulse Buying? Behavioural Public Policy 9 (2025). doi:10.1017/bpp.2022.11 - · DOI
- [69][69] Haojin Wang, Zining Zhu, and Freda Shi. 2025. Distribution Prompting: Understanding the Expressivity of Language Models Through the Next-Token Distributions They Can Produce. arXiv:2505.12244 [cs.CL] https://arxiv.org/abs/2505. 12244 - · arXiv
- [70][70] Christopher Rhys Watkins, Colin M. Gray, Austin L. Toombs, and Paul Parsons. 2020. Tensions in Enacting a Design Philosophy in UX Practice. In Proc. of the Designing Interactive Systems Conference (DIS) . Association for Computing Machinery. doi:10.1145/3357236.3395505 - · DOI
- [71][71] Lois B. Wexner. 1954. The degree to which colors (hues) are associated with mood-tones. Journal of Applied Psychology 38, 6 (1954). https://www.proquest.com/scholarly-journals/degree-which-colors-huesare-associated-with-mood/docview/614248816/se-2 -
- [72][72] Lauren E. Willis. 2020. Deception by Design. Harvard Journal of Law & Technology 34 (2020). https://ssrn.com/abstract=3694575 -
- [75][75] Sukmin Yun, Haokun Lin, Rusiru Thushara, Mohammad Qazim Bhat, Yongxin Wang, Zutao Jiang, Mingkai Deng, Jinhong Wang, Tianhua Tao, Junbo Li, Haonan Li, Preslav Nakov, Timothy Baldwin, Zhengzhong Liu, Eric P. Xing, Xiaodan Liang, and Zhiqiang Shen. 2024. Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs. In Advances in Neural Information Processing Systems , A. Globerson, L. Mackey, D. Belgrave, A. Fan, U. Paquet, J. Tomczak, and C. Zhang (Eds.), Vol. 37. Curran Associates, Inc. doi:10.52202/079017-3560 - · DOI
- [76][76] José Pablo Zagal, Staffan Björk, and Chris Lewis. 2013. Dark Patterns in the Design of Games. In International Conference on Foundations of Digital Games . https://api.semanticscholar.org/CorpusID:17683705 -
- [77][77] Chenchen Zhang, Yuhang Li, Can Xu, Jiaheng Liu, Ao Liu, Changzhi Zhou, Ken Deng, Dengpeng Wu, Guanhua Huang, Kejiao Li, Qi Yi, Ruibin Xiong, Shihui Hu, Yue Zhang, Yuhao Jiang, Zenan Xu, Yuanxing Zhang, Wiggin Zhou, Chayse Zhou, and Fengzong Lian. 2025. ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluation. arXiv:2507.04952 [cs.CL] https://arxiv. org/abs/2507.04952 · arXiv
Cited by
Sorted by citations
Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents
de Witt, C. S., Krawiecka, K., Krawczuk, I., Hagag, B., Anderson, W. L., Belcak, P., Bucknall, B., Cai, X., Chopra, A., Cohen, D., et al. (2025) · arXiv · doi:10.48550/arxiv.2505.02077 · Cited by 2 · see citing works
Hostile interaction design: AI, governance, and the quest for human oversight
Foth, M. (2026) · AI & SOCIETY · doi:10.1007/s00146-026-03065-y · Cited by 1 · see citing works
- Authors
- Chen, Z., Shen, J., Luna, Zhang, H., & Vaccaro, K.
- Affiliations
- University of California San Diego (US)
- Venue
- Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2026-04-13
- Pages
- 1-18
- OpenAlex
- W4407764297
- Cited by
- 7
- References
- 2
- Citations by year
- 2026: 5 · 2025: 2
- FWCI
- 23.53
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by)
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Information Systems › Software Engineering Research
- Keywords
- dark patterns, large language models, LLM-generated code, color psychology, prompting strategies, DeepSeek-V3, front-end web development, user interface design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review