CoChat
Sign Up
PreprintCited by 13Ethics and Social Impacts of AIArtificial Intelligence ApplicationsArtificial Intelligence in Healthcare and Education

Next Steps for Human-Centered Generative AI: A Technical Perspective

Open access
Chen, Xiang 'Anthony', Burke, Jeff, Du, Ruofei, Hong, Matthew K., Jacobs, Jennifer, Laban, Philippe, Li, Dingzeyu, Peng, Nanyun +3 more·2023·arXiv
DOI 10.48550/arxiv.2306.15774arXiv 2306.15774
Open this paper in CoChat — free accountOpen PDF

Abstract

Through iterative, cross-disciplinary discussions, we define and propose next-steps for Human-centered Generative AI (HGAI). We contribute a comprehensive research agenda that lays out future directions of Generative AI spanning three levels: aligning with human values; assimilating human intents; and augmenting human abilities. By identifying these next-steps, we intend to draw interdisciplinary research teams to pursue a coherent set of emergent ideas in HGAI, focusing on their interested topics while maintaining a coherent big picture of the future work landscape.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2306.15774

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • These same properties pose a challenge for designing GenAI systems to be human-centered.

    “However, these same properties also pose a challenge for designing GenAI systems to be human-centered [34].”

    From The Metacognitive Demands and Opportunities of Generative AI (2024) · cites this paper as [34]

  • Designing truly human-centered GenAI systems means grappling with these metacognitive demands.

    “Designing truly human-centered GenAI systems [34,104] means grappling with these metacognitive demands.”

    From The Metacognitive Demands and Opportunities of Generative AI (2024) · cites this paper as [34]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

No citation lists for this paper

No citation lists for this paper yet — checked again daily.

Cited by 13

Research works printed but not linked: 132

  1. Mark S. Ackerman. 2000. The Intellectual Challenge of CSCW: The Gap Between Social Requirements and Technical Feasibility. Human-Computer Interaction 15, 2-3 (Sept. 2000), 179-203. https://doi.org/10.1207/S15327051HCI1523_5 Pub- lisher: Taylor & Francis _eprint: https://doi.org/10.1207/S15327051HCI1523_5. · DOI
  2. Rahul Arora, Rubaiat Habib Kazi, Tovi Grossman, George Fitzmaurice, and Karan Singh. 2018. SymbiosisSketch: Combining 2D & 3D Sketching for Designing Detailed 3D Objects in Situ. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, 1-15. https://doi.org/10.1145/3173574.3173759 · DOI
  3. Yuntao Bai, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion, Andy Jones, Anna Chen, Anna Goldie, Azalia Mirhoseini, Cameron McKinnon, et al. 2022. Constitutional AI: Harmlessness from AI Feedback. arXiv preprint arXiv:2212.08073 (2022). · arXiv
  4. Arpit Bansal, Ping-Yeh Chiang, Michael J Curry, Rajiv Jain, Curtis Wigington, Varun Manjunatha, John P Dickerson, and Tom Goldstein. 2022. Certified Neural Network Watermarks with Randomized Smoothing. In Proceedings of the 39th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 162), Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesvari, Gang Niu, and Sivan Sabato (Eds.). PMLR, 1450-1465. https: //proceedings.mlr.press/v162/bansal22a.html
  5. Olivier Bau and Wendy E. Mackay. 2008. OctoPocus: a dynamic guide for learning gesture-based command sets. In Proceedings of the 21st annual ACM symposium on User interface software and technology (UIST '08). Association for Computing Machinery, New York, NY, USA, 37-46. https://doi.org/10.1145/ 1449715.1449724 · DOI · Paper page
  6. Cynthia L. Bennett and Daniela K. Rosner. 2019. The Promise of Empathy: Design, Disability, and Knowing the "Other". In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, 1-13. https://doi.org/10.1145/ 3290605.3300528 · DOI · Paper page
  7. Michael S. Bernstein, Greg Little, Robert C. Miller, Björn Hartmann, Mark S. Ackerman, David R. Karger, David Crowell, and Katrina Panovich. 2010. Soylent: a word processor with a crowd inside. In Proceedings of the 23nd annual ACM symposium on User interface software and technology (UIST '10). Association for Computing Machinery, New York, NY, USA, 313-322. https://doi.org/10.1145/ 1866029.1866078 · DOI
  8. Steven Bills, Nick Cammarata, Dan Mossing, Henk Tillman, Leo Gao, Gabriel Goh, Ilya Sutskever, Jan Leike, Jeff Wu, and William Saunders. 2023. Language models can explain neurons in language models. https://openaipublic.blob. core.windows.net/neuron-explainer/paper/index.html
  9. Marsden S. Blois. 1980. Clinical Judgment and Computers. New Eng- land Journal of Medicine 303, 4 (1980), 192-197. https://doi.org/10.1056/ NEJM198007243030405 arXiv:https://doi.org/10.1056/NEJM198007243030405 PMID: 7383090. · DOI
  10. Marsden S. Blois. 1984. Information and medicine: the nature of medical descrip- tions. University of California Press, Berkeley.
  11. Virginia Braun and Victoria Clarke. 2012. Thematic analysis. In APA handbook of research methods in psychology, Vol 2: Research designs: Quantitative, quali- tative, neuropsychological, and biological. American Psychological Association, Washington, DC, US, 57-71. https://doi.org/10.1037/13620-004 · DOI · Paper page
  12. Luke Breitfeller, Emily Ahn, David Jurgens, and Yulia Tsvetkov. 2019. Finding Microaggressions in the Wild: A Case for Locating Elusive Phenomena in Social Media Posts. In Proceedings of the 2019 Conference on Empirical Methods in Nat- ural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguis- tics, Hong Kong, China, 1664-1674. https://doi.org/10.18653/v1/D19-1176 · DOI
  13. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020. Language Models Are Few-Shot Learners. Advances in Neural Information Processing Systems 33 (2020), 1877-1901. https://doi.org/10.5555/ 3495724.3495883 · DOI
  14. Beatriz Cabrero-Daniel and Andrea Sanagustín Cabrero. 2023. Perceived Trust- worthiness of Natural Language Generators. https://doi.org/10.1145/3597512. 3599715 arXiv:2305.18176 [cs]. · DOI
  15. Carrie J. Cai, Emily Reif, Narayan Hegde, Jason Hipp, Been Kim, Daniel Smilkov, Martin Wattenberg, Fernanda Viegas, Greg S. Corrado, Martin C. Stumpe, and Michael Terry. 2019. Human-Centered Tools for Coping with Imperfect Al- gorithms During Medical Decision-Making. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, 1-14. https://doi.org/10.1145/ 3290605.3300234 · DOI · Paper page
  16. Tara Capel and Margot Brereton. 2023. What is Human-Centered about Human- Centered AI? A Map of the Research Landscape. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). Association for Computing Machinery, New York, NY, USA, 1-23. https://doi.org/10.1145/ 3544548.3580959 · DOI · Paper page
  17. Davide Castelvecchi. 2020. Is Facial Recognition Too Biased to be Let Loose? Nature 587, 7834 (Nov. 2020), 347-349. https://doi.org/10.1038/d41586-020- 03186-4 · DOI
  18. Pierre Chambon, Christian Bluethgen, Jean-Benoit Delbrouck, Rogier Van der Sluijs, Małgorzata Połacin, Juan Manuel Zambrano Chaves, Tanishq Mathew Abraham, Shivanshu Purohit, Curtis P. Langlotz, and Akshay Chaudhari. 2022. RoentGen: Vision-Language Foundation Model for Chest X-ray Generation. https://doi.org/10.48550/arXiv.2211.12737 arXiv:2211.12737 [cs]. · DOI
  19. Stevie Chancellor. 2023. Toward Practices for Human-Centered Machine Learn- ing. Commun. ACM 66, 3 (Feb. 2023), 78-85. https://doi.org/10.1145/3530987 · DOI
  20. Chaofan Chen, Oscar Li, Daniel Tao, Alina Barnett, Cynthia Rudin, and Jonathan K Su. 2019. This Looks Like That: Deep Learning for Interpretable Image Recognition. In Advances in Neural Information Processing Systems, Vol. 32. Curran Associates, Inc. https://proceedings.neurips.cc/paper/2019/ hash/adf7ee2dcf142b0e11888e72b43fcb75-Abstract.html
  21. Liming Chen, Jesse Hoey, Chris D. Nugent, Diane J. Cook, and Zhiwen Yu. 2012. Sensor-Based Activity Recognition. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 42, 6 (Nov. 2012), 790-808. https: //doi.org/10.1109/TSMCC.2012.2198883 Conference Name: IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews). · DOI
  22. Mia Xu Chen, Benjamin N. Lee, Gagan Bansal, Yuan Cao, Shuyuan Zhang, Justin Lu, Jackie Tsay, Yinan Wang, Andrew M. Dai, Zhifeng Chen, Timothy Sohn, and Yonghui Wu. 2019. Gmail Smart Compose: Real-Time Assisted Writing. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD '19). 2287-2295. https://doi.org/10.1145/3292500. 3330723 · DOI · Paper page
  23. Xiang 'Anthony' Chen, Ye Tao, Guanyun Wang, Runchang Kang, Tovi Grossman, Stelian Coros, and Scott E. Hudson. 2018. Forte: User-Driven Generative Design. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). 1-12. https://doi.org/10.1145/3173574.3174070 · DOI
  24. Xiang 'Anthony' Chen, Chien-Sheng Wu, Tong Niu, Wenhao Liu, and Caiming Xiong. 2022. Marvista: A Human-AI Collaborative Reading Tool. arXiv preprint arXiv:2207.08401 (2022). · arXiv
  25. John Joon Young Chung, Wooseok Kim, Kang Min Yoo, Hwaran Lee, Eytan Adar, and Minsuk Chang. 2022. TaleBrush: Sketching Stories with Generative Pretrained Language Models. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22). Association for Computing Machinery, New York, NY, USA, 1-19. https://doi.org/10.1145/3491102.3501819 · DOI · Paper page
  26. Douglass R. Cutting, David R. Karger, Jan O. Pedersen, and John W. Tukey. 2017. Scatter/Gather: A Cluster-based Approach to Browsing Large Document Collections. ACM SIGIR Forum 51, 2 (Aug. 2017), 148-159. https://doi.org/10. 1145/3130348.3130362 · DOI
  27. Xinyue Dai, Mark T. Keane, Laurence Shalloo, Elodie Ruelle, and Ruth M.J. Byrne. 2022. Counterfactual Explanations for Prediction and Diagnosis in XAI. In Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society (AIES '22). Association for Computing Machinery, New York, NY, USA, 215-226. https://doi.org/10.1145/3514094.3534144 · DOI
  28. Hai Dang, Sven Goller, Florian Lehmann, and Daniel Buschek. 2023. Choice Over Control: How Users Write with Large Language Models using Diegetic and Non-Diegetic Prompting. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). Association for Computing Machinery, New York, NY, USA, 1-17. https://doi.org/10.1145/3544548.3580969 · DOI · Paper page
  29. Hai Dang, Lukas Mecke, and Daniel Buschek. 2022. GANSlider: How Users Control Generative Models for Images using Multiple Sliders with and without Feedforward Information. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22). Association for Computing Machinery, New York, NY, USA, 1-15. https://doi.org/10.1145/3491102.3502141 · DOI · Paper page
  30. Sumanth Dathathri, Andrea Madotto, Janice Lan, Jane Hung, Eric Frank, Piero Molino, Jason Yosinski, and Rosanne Liu. 2020. Plug and Play Language Models: A Simple Approach to Controlled Text Generation. https://doi.org/10.48550/ arXiv.1912.02164 arXiv:1912.02164 [cs]. · DOI
  31. Stefano De Paoli. 2023. Can Large Language Models emulate an inductive The- matic Analysis of semi-structured interviews? An exploration and provocation on the limits of the approach and the model. https://doi.org/10.48550/arXiv. 2305.13014 arXiv:2305.13014 [cs]. · DOI
  32. Kexin Ding, Mu Zhou, He Wang, Olivier Gevaert, Dimitris Metaxas, and Shaoting Zhang. 2023. A Large-scale Synthetic Pathological Dataset for Deep Learning- enabled Segmentation of Breast Cancer. Scientific Data 10, 1 (April 2023), 231. https://doi.org/10.1038/s41597-023-02125-y Number: 1 Publisher: Nature Publishing Group. · DOI
  33. Ruofei Du, Na Li, Jing Jin, Michelle Carney, Scott Miles, Maria Kleiner, Xi- uxiu Yuan, Yinda Zhang, Anuva Kulkarni, Xingyu Liu, Ahmed Sabie, Sergio Orts-Escolano, Abhishek Kar, Ping Yu, Ram Iyengar, Adarsh Kowdle, and Alex Olwal. 2023. Rapsai: Accelerating Machine Learning Prototyping of Multi- media Applications Through Visual Programming. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI). ACM, 23 pages. https://doi.org/10.1145/3544548.3581338 · DOI
  34. Kevin Ellis, Catherine Wong, Maxwell Nye, Mathias Sablé-Meyer, Lucas Morales, Luke Hewitt, Luc Cary, Armando Solar-Lezama, and Joshua B. Tenenbaum. 2021. DreamCoder: bootstrapping inductive program synthesis with wake- sleep library learning. In Proceedings of the 42nd ACM SIGPLAN International Conference on Programming Language Design and Implementation (PLDI 2021). Association for Computing Machinery, New York, NY, USA, 835-850. https: //doi.org/10.1145/3453483.3454080 · DOI · Paper page
  35. Noyan Evirgen and Xiang 'Anthony' Chen. 2022. GANzilla: User-Driven Direction Discovery in Generative Adversarial Networks. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST '22). Association for Computing Machinery, New York, NY, USA, 1-10. https://doi.org/10.1145/3526113.3545638 · DOI
  36. Noyan Evirgen and Xiang 'Anthony Chen. 2023. GANravel: User-Driven Di- rection Disentanglement in Generative Adversarial Networks. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI '23). Association for Computing Machinery, New York, NY, USA, Article 19, 15 pages. https://doi.org/10.1145/3544548.3581226 · DOI
  37. Jerry Alan Fails and Dan R. Olsen. 2003. Interactive machine learning. In Proceedings of the 8th international conference on Intelligent user interfaces (IUI '03). Association for Computing Machinery, New York, NY, USA, 39-45. https: //doi.org/10.1145/604045.604056 · DOI · Paper page
  38. Pierre Fernandez, Guillaume Couairon, Hervé Jégou, Matthijs Douze, and Teddy Furon. 2023. The Stable Signature: Rooting Watermarks in Latent Diffusion Models. arXiv:2303.15435 [cs.CV] · arXiv
  39. James Finnie-Ansley, Paul Denny, Brett A. Becker, Andrew Luxton-Reilly, and James Prather. 2022. The Robots Are Coming: Exploring the Implications of OpenAI Codex on Introductory Programming. In Proceedings of the 24th Aus- tralasian Computing Education Conference (ACE '22). Association for Computing Machinery, New York, NY, USA, 10-19. https://doi.org/10.1145/3511861.3511863 · DOI · Paper page
  40. Batya Friedman. 1996. Value-sensitive design. interactions 3, 6 (1996), 16-23.
  41. Theodoros Galanos, Antonios Liapis, and Georgios N. Yannakakis. 2023. Ar- chitext: Language-Driven Generative Architecture Design. https://doi.org/10. 48550/arXiv.2303.07519 arXiv:2303.07519 [cs]. · DOI
  42. Susan Gasson. 2003. Human-centered vs. user-centered approaches to informa- tion system design. Journal of Information Technology Theory and Application (JITTA) 5, 2 (2003), 5.
  43. Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumé III, and Kate Crawford. 2021. Datasheets for Datasets. https://doi.org/10.48550/arXiv.1803.09010 arXiv:1803.09010 [cs]. · DOI
  44. Ian J. Goodfellow, Jonathon Shlens, and Christian Szegedy. 2015. Explaining and Harnessing Adversarial Examples. https://doi.org/10.48550/arXiv.1412.6572 arXiv:1412.6572 [cs, stat]. · DOI
  45. Hongyan Gu, Yuan Liang, Yifan Xu, Christopher Kazu Williams, Shino Ma- gaki, Negar Khanlou, Harry Vinters, Zesheng Chen, Shuo Ni, Chunxu Yang, Wenzhong Yan, Xinhai Robert Zhang, Yang Li, Mohammad Haeri, and Xiang 'An- thony' Chen. 2022. Improving Workflow Integration with XPath: Design and Evaluation of a Human-AI Diagnosis System in Pathology. ACM Trans. Comput.- Hum. Interact. (Dec. 2022). https://doi.org/10.1145/3577011 Place: New York, NY, USA Publisher: Association for Computing Machinery. · DOI
  46. Hongyan Gu, Chunxu Yang, Mohammad Haeri, Jing Wang, Shirley Tang, Wenzhong Yan, Shujin He, Christopher Kazu Williams, Shino Magaki, and Xiang 'Anthony' Chen. 2023. Augmenting Pathologists with NaviPath: De- sign and Evaluation of a Human-AI Collaborative Navigation System. In Pro- ceedings of the 2023 CHI Conference on Human Factors in Computing Sys- tems (CHI '23). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3544548.3580694 event-place: Hamburg, Germany. · DOI
  47. Arnav Gudibande, Eric Wallace, Charlie Snell, Xinyang Geng, Hao Liu, Pieter Abbeel, Sergey Levine, and Dawn Song. 2023. The False Promise of Imitating Proprietary LLMs. https://doi.org/10.48550/arXiv.2305.15717 arXiv:2305.15717 [cs]. · DOI
  48. David Gunning and David Aha. 2019. DARPA's Explainable Artificial In- telligence (XAI) Program. AI Magazine 40, 2 (June 2019), 44-58. https: //doi.org/10.1609/aimag.v40i2.2850 Number: 2. · DOI
  49. Bo Hedberg and Enid Mumford. 1975. The design of computer systems: Man's vision of man as an integral part of the system design process. Human choice and computers 31 (1975), 59.
  50. Joseph Henrich, Steven J. Heine, and Ara Norenzayan. 2010. Most people are not WEIRD. Nature 466, 7302 (July 2010), 29-29. https://doi.org/10.1038/466029a Number: 7302 Publisher: Nature Publishing Group. · DOI
  51. Christian Holz and Andrew Wilson. 2011. Data miming: inferring spatial object descriptions from human gesture. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). Association for Computing Machinery, New York, NY, USA, 811-820. https://doi.org/10.1145/1978942. 1979060 · DOI
  52. Eric Horvitz. 1999. Principles of mixed-initiative user interfaces. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. 159-166.
  53. Yongquan Hu, Mingyue Yuan, Kaiqi Xian, Don Samitha Elvitigala, and Aaron Quigley. 2023. Exploring the Design Space of Employing AI-Generated Content for Augmented Reality Display. https://doi.org/10.48550/arXiv.2303.16593 arXiv:2303.16593 [cs]. · DOI
  54. Scott E. Hudson and Jennifer Mankoff. 2014. Concepts, Values, and Methods for Technical Human-Computer Interaction Research. In Ways of Knowing in HCI, Judith S. Olson and Wendy A. Kellogg (Eds.). Springer, New York, NY, 69-93. https://doi.org/10.1007/978-1-4939-0378-8_4 · DOI
  55. Nils Hulzebosch, Sarah Ibrahimi, and Marcel Worring. 2020. Detecting CNN- Generated Facial Images in Real-World Scenarios. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops.
  56. Hilary Hutchinson, Wendy Mackay, Bo Westerlund, Benjamin B. Bederson, Allison Druin, Catherine Plaisant, Michel Beaudouin-Lafon, Stéphane Con- versy, Helen Evans, Heiko Hansen, Nicolas Roussel, and Björn Eiderbäck. 2003. Technology probes: inspiring design for and with families. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). Association for Computing Machinery, Ft. Lauderdale, Florida, USA, 17-24. https://doi.org/10.1145/642611.642616 · DOI · Paper page
  57. Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Ye Jin Bang, Andrea Madotto, and Pascale Fung. 2023. Survey of Hallucination in Natural Language Generation. Comput. Surveys 55, 12 (March 2023), 248:1- 248:38. https://doi.org/10.1145/3571730 · DOI · Paper page
  58. Heewoo Jun and Alex Nichol. 2023. Shap-E: Generating Conditional 3D Implicit Functions. https://doi.org/10.48550/arXiv.2305.02463 arXiv:2305.02463 [cs]. · DOI
  59. Pranav Khadpe, Ranjay Krishna, Li Fei-Fei, Jeffrey T. Hancock, and Michael S. Bernstein. 2020. Conceptual Metaphors Impact Perceptions of Human-AI Col- laboration. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (Oct. 2020), 163:1-163:26. https://doi.org/10.1145/3415234 · DOI · Paper page
  60. Been Kim, Martin Wattenberg, Justin Gilmer, Carrie Cai, James Wexler, Fernanda Viegas, and Rory Sayres. 2018. Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV). In Proceedings of the 35th International Conference on Machine Learning. PMLR, 2668-2677. https://proceedings.mlr.press/v80/kim18d.html ISSN: 2640-3498.
  61. Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C. Berg, Wan-Yen Lo, Piotr Dollár, and Ross Girshick. 2023. Segment Anything. https://doi.org/10.48550/ arXiv.2304.02643 arXiv:2304.02643 [cs]. · DOI
  62. Rob Kling. 1977. The Organizational Context of User-Centered Software Designs. MIS Quarterly 1, 4 (1977), 41-52. https://doi.org/10.2307/249021 Publisher: Management Information Systems Research Center, University of Minnesota. · DOI
  63. Rob Kling and Susan Leigh Star. 1998. Human centered systems in the perspec- tive of organizational and social informatics. Acm Sigcas Computers and Society 28, 1 (1998), 22-29. Publisher: ACM New York, NY, USA.
  64. Janin Koch, Nicolas Taffin, Michel Beaudouin-Lafon, Markku Laine, Andrés Lucero, and Wendy E. Mackay. 2020. ImageSense: An Intelligent Collaborative Ideation Tool to Support Diverse Human-Computer Partnerships. Proceedings of the ACM on Human-Computer Interaction 4, CSCW1 (May 2020), 45:1-45:27. https://doi.org/10.1145/3392850 · DOI
  65. Pang Wei Koh, Thao Nguyen, Yew Siang Tang, Stephen Mussmann, Emma Pierson, Been Kim, and Percy Liang. 2020. Concept Bottleneck Models. In Proceedings of the 37th International Conference on Machine Learning. PMLR, 5338-5348. https://proceedings.mlr.press/v119/koh20a.html ISSN: 2640-3498.
  66. Gierad Laput, Xiang 'Anthony' Chen, and Chris Harrison. 2015. 3D Printed Hair: Fused Deposition Modeling of Soft Strands, Fibers, and Bristles. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). Association for Computing Machinery, New York, NY, USA, 593-597. https://doi.org/10.1145/2807442.2807484 · DOI
  67. Ziyi Li, Qinye Zhou, Xiaoyun Zhang, Ya Zhang, Yanfeng Wang, and Weidi Xie. 2023. Guiding Text-to-Image Diffusion Model Towards Grounded Generation. https://doi.org/10.48550/arXiv.2301.05221 arXiv:2301.05221 [cs]. · DOI
  68. Joseph CR Licklider. 1960. Man-computer symbiosis. IRE transactions on human factors in electronics 1 (1960), 4-11.
  69. David Chuan-En Lin, Fabian Caba Heilbron, Joon-Young Lee, Oliver Wang, and Nikolas Martelaro. 2022. VideoMap: Video Editing in Latent Space. https: //doi.org/10.48550/arXiv.2211.12492 arXiv:2211.12492 [cs]. · DOI
  70. Zhiyu Lin, Upol Ehsan, Rohan Agarwal, Samihan Dani, Vidushi Vashishth, and Mark Riedl. 2023. Beyond Prompts: Exploring the Design Space of Mixed- Initiative Co-Creativity Systems. https://doi.org/10.48550/arXiv.2305.07465 arXiv:2305.07465 [cs]. · DOI
  71. Sebastian Linxen, Christian Sturm, Florian Brühlmann, Vincent Cassau, Klaus Opwis, and Katharina Reinecke. 2021. How WEIRD is CHI?. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA, 1-14. https://doi. org/10.1145/3411764.3445488 · DOI · Paper page
  72. Vivian Liu, Jo Vermeulen, George Fitzmaurice, and Justin Matejka. 2022. 3DALL- E: Integrating Text-to-Image AI in 3D Design Workflows. https://doi.org/10. 48550/arXiv.2210.11603 arXiv:2210.11603 [cs]. · DOI
  73. Xingyu "Bruce" Liu, Vladimir Kirilyuk, Xiuxiu Yuan, Alex Olwal, Peggy Chi, Xiang 'Anthony' Chen, and Ruofei Du. 2023. Visual Captions: Augmenting Verbal Communication with On-the-Fly Visuals. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3544548. 3581566 event-place: Hamburg, Germany. · DOI
  74. Sidi Lu, Tao Meng, and Nanyun Peng. 2022. InsNet: An Efficient, Flexible, and Performant Insertion-based Text Generation Model. https://doi.org/10.48550/ arXiv.2102.11008 arXiv:2102.11008 [cs]. · DOI
  75. David McNeill. 2008. Gesture and Thought. In Gesture and Thought. University of Chicago Press. https://doi.org/10.7208/9780226514642 · DOI
  76. Tao Meng, Sidi Lu, Nanyun Peng, and Kai-Wei Chang. 2022. Controllable Text Generation with Neurally-Decomposed Oracle. https://doi.org/10.48550/arXiv. 2205.14219 arXiv:2205.14219 [cs]. · DOI
  77. Danaë Metaxa, Joon Sung Park, Ronald E. Robertson, Karrie Karahalios, Christo Wilson, Jeff Hancock, and Christian Sandvig. 2021. Auditing Algorithms: Understanding Algorithmic Systems from the Outside In. Foundations and Trends® in Human-Computer Interaction 14, 4 (Nov. 2021), 272-344. https: //doi.org/10.1561/1100000083 Publisher: Now Publishers, Inc.. · DOI
  78. Rada Mihalcea and Chee Wee Leong. 2008. Toward Communicating Simple Sentences Using Pictorial Representations. Machine Translation 22, 3 (2008), 153-173.
  79. Sewon Min, Xinxi Lyu, Ari Holtzman, Mikel Artetxe, Mike Lewis, Hannaneh Hajishirzi, and Luke Zettlemoyer. 2022. Rethinking the Role of Demonstrations: What Makes In-Context Learning Work? https://doi.org/10.48550/arXiv.2202. 12837 arXiv:2202.12837 [cs]. · DOI
  80. Aditi Mishra, Utkarsh Soni, Anjana Arunkumar, Jinbin Huang, Bum Chul Kwon, and Chris Bryan. 2023. PromptAid: Prompt Exploration, Perturbation, Testing and Iteration using Visual Analytics for Large Language Models. https://doi. org/10.48550/arXiv.2304.01964 arXiv:2304.01964 [cs]. · DOI
  81. Eric Mitchell, Yoonho Lee, Alexander Khazatsky, Christopher D. Manning, and Chelsea Finn. 2023. DetectGPT: Zero-Shot Machine-Generated Text Detec- tion using Probability Curvature. https://doi.org/10.48550/arXiv.2301.11305 arXiv:2301.11305 [cs]. · DOI
  82. Yasuhide Miura, Yuhao Zhang, Emily Bao Tsai, Curtis P. Langlotz, and Dan Jurafsky. 2021. Improving Factual Completeness and Consistency of Image-to- Text Radiology Report Generation. https://doi.org/10.48550/arXiv.2010.10042 arXiv:2010.10042 [cs]. · DOI
  83. Florian Floyd Mueller, Pedro Lopes, Paul Strohmeier, Wendy Ju, Caitlyn Seim, Martin Weigel, Suranga Nanayakkara, Marianna Obrist, Zhuying Li, Joseph Delfa, Jun Nishida, Elizabeth M. Gerber, Dag Svanaes, Jonathan Grudin, Stefan Greuter, Kai Kunze, Thomas Erickson, Steven Greenspan, Masahiko Inami, Joe Marshall, Harald Reiterer, Katrin Wolf, Jochen Meyer, Thecla Schiphorst, Dakuo Wang, and Pattie Maes. 2020. Next Steps for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1-15. https://doi.org/10.1145/3313831.3376242 · DOI · Paper page
  84. Nelson Nauata, Sepidehsadat Hosseini, Kai-Hung Chang, Hang Chu, Chin-Yi Cheng, and Yasutaka Furukawa. 2021. House-GAN++: Generative Adversar- ial Layout Refinement Networks. https://doi.org/10.48550/arXiv.2103.02574 arXiv:2103.02574 [cs]. · DOI
  85. OpenAI. 2023. GPT-4 Technical Report. ArXiv abs/2303.08774 (2023). · arXiv
  86. Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems 35 (2022), 27730-27744.
  87. Xingang Pan, Ayush Tewari, Thomas Leimkühler, Lingjie Liu, Abhimitra Meka, and Christian Theobalt. 2023. Drag Your GAN: Interactive Point-based Manipu- lation on the Generative Image Manifold. https://doi.org/10.48550/arXiv.2305. 10973 arXiv:2305.10973 [cs]. · DOI
  88. Joon Sung Park, Joseph C. O'Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2023. Generative Agents: Interactive Simulacra of Human Behavior. https://doi.org/10.48550/arXiv.2304.03442 arXiv:2304.03442 [cs]. · DOI
  89. Ethan Perez, Sam Ringer, Kamilė Lukošiūtė, Karina Nguyen, Edwin Chen, Scott Heiner, Craig Pettit, Catherine Olsson, Sandipan Kundu, Saurav Kadavath, Andy Jones, Anna Chen, Ben Mann, Brian Israel, Bryan Seethor, Cameron McKinnon, Christopher Olah, Da Yan, Daniela Amodei, Dario Amodei, Dawn Drain, Dustin Li, Eli Tran-Johnson, Guro Khundadze, Jackson Kernion, James Landis, Jamie Kerr, Jared Mueller, Jeeyoon Hyun, Joshua Landau, Kamal Ndousse, Landon Goldberg, Liane Lovitt, Martin Lucas, Michael Sellitto, Miranda Zhang, Neerav Kingsland, Nelson Elhage, Nicholas Joseph, Noemí Mercado, Nova DasSarma, Oliver Rausch, Robin Larson, Sam McCandlish, Scott Johnston, Shauna Kravec, Sheer El Showk, Tamera Lanham, Timothy Telleen-Lawton, Tom Brown, Tom Henighan, Tristan Hume, Yuntao Bai, Zac Hatfield-Dodds, Jack Clark, Samuel R. Bowman, Amanda Askell, Roger Grosse, Danny Hernandez, Deep Ganguli, Evan Hubinger, Nicholas Schiefer, and Jared Kaplan. 2022. Discovering Language Model Behaviors with Model-Written Evaluations. https://doi.org/10.48550/ arXiv.2212.09251 arXiv:2212.09251 [cs]. · DOI
  90. Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021. Learning Transferable Visual Models From Natural Language Supervision. https://doi.org/10.48550/arXiv.2103.00020 arXiv:2103.00020 [cs]. · DOI
  91. Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. 2022. Hierarchical Text-Conditional Image Generation with CLIP Latents. ArXiv abs/2204.06125 (2022), 10. · arXiv
  92. Horst W Rittel and Melvin M Webber. 1974. Wicked problems. Man-made Futures 26, 1 (1974), 272-280.
  93. Andrew Slavin Ross, Michael C. Hughes, and Finale Doshi-Velez. 2017. Right for the Right Reasons: Training Differentiable Models by Constraining their Explanations. (2017), 2662-2670. https://www.ijcai.org/Proceedings/2017/371
  94. Shibani Santurkar, Esin Durmus, Faisal Ladhak, Cinoo Lee, Percy Liang, and Tatsunori Hashimoto. 2023. Whose Opinions Do Language Models Reflect? https://doi.org/10.48550/arXiv.2303.17548 arXiv:2303.17548 [cs]. · DOI · Paper page
  95. Greg Saul, Manfred Lau, Jun Mitani, and Takeo Igarashi. 2010. SketchChair: an all-in-one chair design system for end users. In Proceedings of the fifth inter- national conference on Tangible, embedded, and embodied interaction (TEI '11). Association for Computing Machinery, New York, NY, USA, 73-80. https: //doi.org/10.1145/1935701.1935717 · DOI
  96. B. Schilit, N. Adams, and R. Want. 1994. Context-Aware Computing Applications. In 1994 First Workshop on Mobile Computing Systems and Applications. 85-90. https://doi.org/10.1109/WMCSA.1994.16 · DOI
  97. Albrecht Schmidt. 2020. Interactive human centered artificial intelligence: a definition and research challenges. In Proceedings of the International Conference on Advanced Visual Interfaces. 1-4.
  98. Shawn Shan, Jenna Cryan, Emily Wenger, Haitao Zheng, Rana Hanocka, and Ben Y. Zhao. 2023. GLAZE: Protecting Artists from Style Mimicry by Text-to- Image Models. https://doi.org/10.48550/arXiv.2302.04222 arXiv:2302.04222 [cs]. · DOI
  99. Hong Shen, Leijie Wang, Wesley H. Deng, Ciell Brusse, Ronald Velgersdijk, and Haiyi Zhu. 2022. The Model Card Authoring Toolkit: Toward Community- centered, Deliberation-driven AI Design. In 2022 ACM Conference on Fairness, Accountability, and Transparency (FAccT '22). 440-451. https://doi.org/10.1145/ 3531146.3533110 · DOI
  100. Yujun Shen and Bolei Zhou. 2021. Closed-Form Factorization of Latent Se- mantics in GANs. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). https://doi.org/10.1109/CVPR46437.2021.00158 · DOI
  101. Emily Sheng, Kai-Wei Chang, Prem Natarajan, and Nanyun Peng. 2020. Towards Controllable Biases in Language Generation. In Findings of the Association for Computational Linguistics: EMNLP 2020. 3239-3254. https://doi.org/10.18653/ v1/2020.findings-emnlp.291 · DOI
  102. Emily Sheng, Kai-Wei Chang, Prem Natarajan, and Nanyun Peng. 2021. "Nice Try, Kiddo": Investigating Ad Hominems in Dialogue Responses. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 750-767. https: //doi.org/10.18653/v1/2021.naacl-main.60 · DOI
  103. Joon Gi Shin, Janin Koch, Andrés Lucero, Peter Dalsgaard, and Wendy E. Mackay. 2023. Integrating AI in Human-Human Collaborative Ideation. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA '23). Association for Computing Machinery, New York, NY, USA, 1-5. https://doi.org/10.1145/3544549.3573802 · DOI
  104. Patrice Y. Simard, Saleema Amershi, David M. Chickering, Alicia Edelman Pelton, Soroush Ghorashi, Christopher Meek, Gonzalo Ramos, Jina Suh, Johan Verwey, Mo Wang, and John Wernsing. 2017. Machine Teaching: A New Paradigm for Building Machine Learning Systems. https://doi.org/10.48550/arXiv.1707.06742 arXiv:1707.06742 [cs, stat]. · DOI
  105. Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. 2013. Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps. (Dec. 2013). http://arxiv.org/abs/1312.6034 _eprint: 1312.6034. · arXiv
  106. Timo Speith. 2022. A Review of Taxonomies of Explainable Artificial Intelligence (XAI) Methods. In Proceedings of the 2022 ACM Conference on Fairness, Account- ability, and Transparency (FAccT '22). Association for Computing Machinery, New York, NY, USA, 2239-2250. https://doi.org/10.1145/3531146.3534639 · DOI
  107. Christopher Steiner. 2012. Automate This: How Algorithms Came to Rule Our World. Portfolio/Penguin, New York. OCLC: ocn757470260.
  108. Jiao Sun, Yu Hou, Jiin Kim, and Nanyun Peng. 2023. Helpfulness and Fairness of Task-Oriented Dialogue Systems. https://doi.org/10.48550/arXiv.2205.12554 arXiv:2205.12554 [cs] version: 2. · DOI
  109. Jiao Sun, Q. Vera Liao, Michael Muller, Mayank Agarwal, Stephanie Houde, Kartik Talamadupula, and Justin D. Weisz. 2022. Investigating Explainability of Generative AI for Code through Scenario-based Design. In 27th International Conference on Intelligent User Interfaces (IUI '22). Association for Computing Machinery, New York, NY, USA, 212-228. https://doi.org/10.1145/3490099. 3511119 · DOI · Paper page
  110. Raphael Tang, Linqing Liu, Akshat Pandey, Zhiying Jiang, Gefei Yang, Karun Kumar, Pontus Stenetorp, Jimmy Lin, and Ferhan Ture. 2022. What the DAAM: Interpreting Stable Diffusion Using Cross Attention. https://doi.org/10.48550/ arXiv.2210.04885 arXiv:2210.04885 [cs]. · DOI
  111. Steven Umbrello and Ibo van de Poel. 2021. Mapping value sensitive design onto AI for social good principles. AI and Ethics 1, 3 (Aug. 2021), 283-296. https://doi.org/10.1007/s43681-021-00038-3 · DOI · Paper page
  112. David A van Dyk and Xiao-Li Meng. 2001. The Art of Data Augmentation. Journal of Computational and Graphical Statistics 10, 1 (March 2001), 1-50. https://doi.org/10.1198/10618600152418584 Publisher: Taylor & Francis _eprint: https://doi.org/10.1198/10618600152418584. · DOI
  113. Richard Van Noorden. 2023. Medicine is plagued by untrustworthy clinical trials. How many studies are faked or flawed? Nature 619, 7970 (2023), 454-458.
  114. Veniamin Veselovsky, Manoel Horta Ribeiro, and Robert West. 2023. Artificial Artificial Artificial Intelligence: Crowd Workers Widely Use Large Language Models for Text Production Tasks. arXiv preprint arXiv:2306.07899 (2023). · arXiv
  115. Yael Vinker, Ehsan Pajouheshgar, Jessica Y. Bo, Roman Christian Bachmann, Amit Haim Bermano, Daniel Cohen-Or, Amir Zamir, and Ariel Shamir. 2022. CLIPasso: semantically-aware object sketching. ACM Transactions on Graphics 41, 4 (July 2022), 86:1-86:11. https://doi.org/10.1145/3528223.3530068 · DOI · Paper page
  116. Yau-Shian Wang and Yingshan Chang. 2022. Toxicity Detection with Gen- erative Prompt-based Inference. https://doi.org/10.48550/arXiv.2205.12390 arXiv:2205.12390 [cs]. · DOI
  117. Daniel Wigdor and Dennis Wixon. 2011. Brave NUI world: designing natural user interfaces for touch and gesture. Elsevier.
  118. Jacob O Wobbrock and Julie A Kientz. 2016. Research contributions in human- computer interaction. interactions 23, 3 (2016), 38-44. Publisher: ACM New York, NY, USA.
  119. Catherine Wong, William P. McCarthy, Gabriel Grand, Yoni Friedman, Joshua B. Tenenbaum, Jacob Andreas, Robert D. Hawkins, and Judith E. Fan. 2022. Identifying concept libraries from language about object structure. https: //doi.org/10.48550/arXiv.2205.05666 arXiv:2205.05666 [cs]. · DOI
  120. Jiajun Wu, Chengkai Zhang, Tianfan Xue, Bill Freeman, and Josh Tenenbaum. 2016. Learning a Probabilistic Latent Space of Object Shapes via 3D Generative- Adversarial Modeling. In Advances in Neural Information Processing Systems, Vol. 29. Curran Associates, Inc. https://proceedings.neurips.cc/paper/2016/ hash/44f683a84163b3523afe57c2e008bc8c-Abstract.html
  121. Tongshuang Wu, Ellen Jiang, Aaron Donsbach, Jeff Gray, Alejandra Molina, Michael Terry, and Carrie J Cai. 2022. Promptchainer: Chaining large language model prompts through visual programming. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1-10.
  122. Jingfeng Yang, Hongye Jin, Ruixiang Tang, Xiaotian Han, Qizhang Feng, Haom- ing Jiang, Bing Yin, and Xia Hu. 2023. Harnessing the power of llms in practice: A survey on chatgpt and beyond. arXiv preprint arXiv:2304.13712 (2023). · arXiv
  123. Fan Yin, Jesse Vig, Philippe Laban, Shafiq Joty, Caiming Xiong, and Chien- Sheng Jason Wu. 2023. Did You Read the Instructions? Rethinking the Effec- tiveness of Task Definitions in Instruction Learning. https://doi.org/10.48550/ arXiv.2306.01150 arXiv:2306.01150 [cs]. · DOI
  124. Jiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen, Xin Lu, and Thomas S. Huang. 2018. Generative Image Inpainting With Contextual Attention. 5505- 5514. https://openaccess.thecvf.com/content_cvpr_2018/html/Yu_Generative_ Image_Inpainting_CVPR_2018_paper.html
  125. J.D. Zamfirescu-Pereira, Richmond Y. Wong, Bjoern Hartmann, and Qian Yang. 2023. Why Johnny Can't Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). Association for Computing Machinery, New York, NY, USA, 1-21. https://doi.org/10.1145/3544548.3581388 · DOI · Paper page
  126. Andy Zeng, Maria Attarian, Brian Ichter, Krzysztof Choromanski, Adrian Wong, Stefan Welker, Federico Tombari, Aveek Purohit, Michael Ryoo, Vikas Sindhwani, Johnny Lee, Vincent Vanhoucke, and Pete Florence. 2022. Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language. https://doi.org/ 10.48550/arXiv.2204.00598 arXiv:2204.00598 [cs]. · DOI
  127. Honghua Zhang, Meihua Dang, Nanyun Peng, and Guy Van den Broeck. 2023. Tractable Control for Autoregressive Language Generation. https://doi.org/10. 48550/arXiv.2304.07438 arXiv:2304.07438 [cs]. · DOI
  128. Lvmin Zhang and Maneesh Agrawala. 2023. Adding Conditional Control to Text-to-Image Diffusion Models. arXiv:2302.05543 [cs.CV] · arXiv
  129. Zexuan Zhong, Tao Lei, and Danqi Chen. 2022. Training Language Mod- els with Memory Augmentation. https://doi.org/10.48550/arXiv.2205.12674 arXiv:2205.12674 [cs]. · DOI
  130. Zhongyi Zhou and Koji Yatani. 2022. Gesture-aware Interactive Machine Teaching with In-situ Object Annotations. In Proceedings of the 35th An- nual ACM Symposium on User Interface Software and Technology (UIST '22). Association for Computing Machinery, New York, NY, USA, 1-14. https: //doi.org/10.1145/3526113.3545648 · DOI
  131. Xiaojin Zhu, Andrew B Goldberg, Mohamed Eldawy, Charles R Dyer, and Bradley Strock. 2007. A Text-to-Picture Synthesis System for Augmenting Communication. In AAAI, Vol. 7. Association for Computing Machinery, New York, NY, USA, 1590-1595. https://doi.org/10.5555/1619797.1619900 · DOI
  132. Changqing Zou, Haoran Mo, Chengying Gao, Ruofei Du, and Hongbo Fu. 2019. Language-based Colorization of Scene Sketches. ACM Transactions on Graphics 38, 6 (Dec. 2019), 233:1-233:16. https://doi.org/10.1145/3355089.3356561 · DOI · Paper page

Authors
Chen, X. '., Burke, J., Du, R., Hong, M. K., Jacobs, J., Laban, P., Li, D., Peng, N., Willis, K. D. D., Wu, C.-S., & Zhou, B.
Affiliations
  • University of California, Los Angeles (US)
  • Google (United States) (US)
  • Toyota Research Institute (US)
  • University of California, Santa Barbara (US)
  • Salesforce (United States) (US)
  • Adobe Systems (United States) (US)
  • Autodesk (United States) (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2023
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2306.15774
arXiv
2306.15774
OpenAlex
W4382603181
Cited by
13
References
0
Citations by year
2025: 6 · 2024: 5 · 2023: 2
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Social Sciences › Safety Research › Ethics and Social Impacts of AI
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
research agenda, value alignment, human intent, AI alignment, interdisciplinary collaboration

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review