The DOI matches its Crossref record; 121 of the 121 references it cites were found in a registry or an index.
Visibility into AI Agents
Open accessAbstract
Increased delegation of commercial, scientific, governmental, and personal activities to AI agents—systems capable of pursuing complex goals with limited supervision—may exacerbate existing societal risks and introduce new risks. Understanding and mitigating these risks involves critically evaluating existing governance structures, revising and adapting these structures where needed, and ensuring accountability of key stakeholders. Information about where, why, how, and by whom certain AI agents are used, which we refer to as visibility, is critical to these objectives. In this paper, we assess three categories of measures to increase visibility into AI agents: agent identifiers, real-time monitoring, and activity logging. For each, we outline potential implementations that vary in intrusiveness and informativeness. We analyze how the measures apply across a spectrum of centralized through decentralized deployment contexts, accounting for various actors in the supply chain including hardware and software service providers. Finally, we discuss the implications of our measures for privacy and concentration of power. Further work into understanding the measures and mitigating their negative impacts can help to build a foundation for the governance of AI agents.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“When coupled with validation protocols (e.g., response verification or schema checks in Waitgpt [219]) and observation mechanisms (e.g., feedback loops or audit logs [220, 221]), these boundaries are reinforced, ensuring that each agent not only performs its assigned task but does so transparently and accountably.”
From AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges (2026) · cites this paper as [220]
Citations
Cites
Theory of the firm: Managerial behavior, agency costs and ownership structure
Jensen, M. C., & Meckling, W. H. (1976) · Journal of Financial Economics · doi:10.1016/0304-405x(76)90026-x · Cited by 71,491
Scaling Laws for Neural Language Models
Kaplan, J., McCandlish, S., Henighan, T., Brown, T. B., Chess, B., Child, R., Gray, S., Radford, A., Wu, J., & Amodei, D. (2020) · arXiv · doi:10.48550/arxiv.2001.08361 · Cited by 9,550 · cited 1×
“…struggle to perform even simple tasks [98, 106, 108, 130, 163, 164], but given increasing investments in AI research [61], scaling laws [15, 83, 94], pressures to develop autonomous capabilities for military use [86, 102, 142], economic applications [35], and scientific prestige [35, 67], we…”
BackgroundReinforcement Learning: An Introduction
Johnson, J. D., Li, J., & Chen, Z. (2000) · Neurocomputing · doi:10.1016/s0925-2312(00)00324-6 · Cited by 8,414
Moral Hazard and Observability
Holmstrom, B. (1979) · The Bell Journal of Economics · doi:10.2307/3003320 · Cited by 8,311
Multitask principal – agent analyses: Incentive contracts, asset ownership, and job design
Holmstrom, B., & Milgrom, P. (1991) · The Journal of Law, Economics, and Organization · doi:10.1093/jleo/7.special_issue.24 · Cited by 6,046
Explanation in artificial intelligence: Insights from the social sciences
Miller, T. (2019) · Artificial Intelligence · doi:10.1016/j.artint.2018.07.007 · Cited by 5,302
Agency Problems and Residual Claims
Fama, E. F., & Jensen, M. C. (1983) · The Journal of Law and Economics · doi:10.1086/467038 · Cited by 4,827
Chain-Of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q. V., & Zhou, D. (2022) · Advances in Neural Information Processing Systems 35 · doi:10.52202/068431-1800 · Cited by 4,505
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Xia, F., Chi, E., Le, Q., & Zhou, D. (2022) · arXiv · doi:10.48550/arxiv.2201.11903 · Cited by 4,263
Model Cards for Model Reporting
Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I. D., & Gebru, T. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287596 · Cited by 2,681 · cited 2×
“We refer to the set of such additional information as an agent card , drawing inspiration from previous work on documenting AI systems [24, 68, 69, 112].”
BackgroundMethod
Research works printed but not linked: 30
- Daron Acemoglu and Pascual Restrepo. 2018. Artificial Intelligence, Automation, and Work. In The Economics of Artificial Intelligence: An Agenda. University of Chicago Press, 197–236. https://www.nber.org/books-and-chapters/economics-artificial-intelligence-agenda/artificial-intelligence-automation-and-work
- 10.31219/osf.io · doi:10.31219/osf.io
- Luke Bailey, Euan Ong, Stuart Russell, and Scott Emmons. 2023. Image Hijacks: Adversarial Images can Control Generative Models at Runtime. https://arxiv.org/abs/2309.00236v2 · arXiv
- Patrick Birkinshaw. 2006. Freedom of Information and Openness: Fundamental Human Rights?Administrative Law Review 58, 1 (2006), 177–218. https://www.jstor.org/stable/40712007 Publisher: American Bar Association.
- 10.18653/v1 · doi:10.18653/v1
- Ryan Carey and Tom Everitt. 2023. Human Control: Definitions and Algorithms. In Proceedings of the Thirty-Ninth Conference on Uncertainty in Artificial Intelligence. PMLR, 271–281. https://proceedings.mlr.press/v216/carey23a.html ISSN: 2640-3498.
- Securities and Exchange Commission. 2022. 17 CFR § 240.17a-3 - Records to be made by certain exchange members, brokers and dealers.Federal Register (April 2022).
- Securities and Exchange Commission. 2022. 17 CFR § 240.17a-4 - Records to be preserved by certain exchange members, brokers and dealers.Federal Register (April 2022).
- Ernesto Dal Bó. 2006. Regulatory capture: A review. Oxford review of economic policy 22, 2 (2006), 203–225. Publisher: Oxford University Press.
- 10.1093/idpl · doi:10.1093/idpl
- Jeffrey C. Ely and Balazs Szentes. 2023. Natural selection of artificial intelligence. (2023).
- 10.1093/idpl · doi:10.1093/idpl
- Chloe Goodwin. 2018. Cooperation or resistance?: The role of tech companies in government surveillance. 131 (2018), 1722–1722.
- Ryan Greenblatt Buck Shlegeris Kshitij Sachan and Fabien Roger. 2024. AI Control: Improving Safety Despite Intentional Subversion. http://arxiv.org/abs/2312.06942arXiv:2312.06942 [cs].
- Valentina Guarnieri, Maria Moriondo, Mattia Giovannini, Lorenzo Lodi, Silvia Ricci, Laura Pisano, Paola Barbacci, Costanza Bini, Giuseppe Indolfi, Alberto Zanobini, and Chiara Azzari. 2021. Surveillance on Healthcare Workers During the First Wave of SARS-CoV-2 Pandemic in Italy: The Experience of a Tertiary Care Pediatric Hospital. Frontiers in Public Health 9 (2021). https://www.frontiersin.org/articles/10.3389/fpubh.2021.644702 · DOI
- Megan Kinniment, Lucas Jun Koba Sato, Haoxing Du, Brian Goodrich, Max Hasin, Lawrence Chan, Luke Harold Miles, Tao R. Lin, Hjalmar Wijk, Joel Burget, Aaron Ho, Elizabeth Barnes, and Paul Christiano. 2023. Evaluating Language-Model Agents on Realistic Autonomous Tasks. https://evals.alignment.org/Evaluating_LMAs_Realistic_Tasks.pdf
- 10.2307/j.ctv7h0rwr · doi:10.2307/j.ctv7h0rwr
- Grégoire Mialon Clémentine Fourrier Craig Swift Thomas Wolf Yann LeCun and Thomas Scialom. 2023. GAIA: a benchmark for General AI Assistants. https://arxiv.org/abs/2311.12983v1 · arXiv
- Richard Ngo Lawrence Chan and Sören Mindermann. 2022. The alignment problem from a deep learning perspective. https://arxiv.org/abs/2209.00626v5 · arXiv
- Scott Reed, Konrad Zolna, Emilio Parisotto, Sergio Gómez Colmenarejo, Alexander Novikov, Gabriel Barth-maron, Mai Giménez, Yury Sulsky, Jackie Kay, Jost Tobias Springenberg, Tom Eccles, Jake Bruce, Ali Razavi, Ashley Edwards, Nicolas Heess, Yutian Chen, Raia Hadsell, Oriol Vinyals, Mahyar Bordbar, and Nando de Freitas. 2022. A Generalist Agent. Transactions on Machine Learning Research (2022). https://openreview.net/forum?id=1ikK0kHjvj
- Felix Richter. 2023. Infographic: Amazon Maintains Lead in the Cloud Market. https://www.statista.com/chart/18819/worldwide-market-share-of-leading-cloud-infrastructure-service-providers
- Stuart J. Russell and Peter Norvig. 2021. Artificial Intelligence: A Modern Approach (4 ed.).
- Jonas B. Sandbrink. 2023. Artificial intelligence and biological misuse: Differentiating risks of language models and biological design tools. http://arxiv.org/abs/2306.13952arXiv:2306.13952 [cs].
- Lee Sharkey, Clíodhna Ní Ghuidhir, Dan Braun, Jérémy Scheurer, Mikita Balesni, Lucius Bushnaq, Charlotte Stix, and Marius Hobbhahn. 2023. A Causal Framework for AI Regulation and Auditing. https://static1.squarespace.com/static/6461e2a5c6399341bcfc84a5/t/654bc268049d687cecac24d8/1699463818729/auditing_framework_web.pdf
- Alexander F Siegenfeld and Yaneer Bar-Yam. 2020. An introduction to complex systems science and its applications. Complexity 2020 (2020), 1–16. Publisher: Hindawi Limited.
- Nate Soares, Benja Fallenstein, Stuart Armstrong, and Eliezer Yudkowsky. 2015. Corrigibility. In Workshops at the Twenty-Ninth AAAI Conference on Artificial Intelligence.
- Zihan Wang Olivia Byrnes Hu Wang Ruoxi Sun Congbo Ma Huaming Chen Qi Wu and Minhui Xue. 2021. Data Hiding with Deep Learning: A Survey Unifying Digital Watermarking and Steganography. https://arxiv.org/abs/2107.09287v3 · arXiv
- Zelai Xu Chao Yu Fei Fang Yu Wang and Yi Wu. 2023. Language Agents with Reinforcement Learning for Strategic Play in the Werewolf Game. https://arxiv.org/abs/2310.18940v2 · arXiv
- Andy Zou Zifan Wang Nicholas Carlini Milad Nasr J. Zico Kolter and Matt Fredrikson. 2023. Universal and Transferable Adversarial Attacks on Aligned Language Models. https://arxiv.org/abs/2307.15043v2 · arXiv
- Remco Zwetsloot and Allan Dafoe. 2019. Thinking about risks from AI: Accidents, misuse and structure. Lawfare. February 11 (2019), 2019.
Cited by
AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2026) · Information Fusion · doi:10.1016/j.inffus.2025.103599 · Cited by 671
“Systems like ReAct [136] exemplify this architecture, combining reasoning and action in an iterative framework where agents simulate internal dialogue before selecting external actions.”
Foundational Challenges in Assuring Alignment and Safety of Large Language ModelsPreprint
Anwar, U., Saparov, A., Ramírez, J. R., Paleka, D., Turpin, M., Hase, P., Lubana, E. S., Jenner, E., Casper, S., Sourbut, O., et al. (2024) · arXiv (Cornell University) · doi:10.3929/ethz-b-000706962 · Cited by 321
Self-citationOpen Problems in Mechanistic Interpretability
Sharkey, L., Chughtai, B., Batson, J., Lindsey, J., Wu, J., Bushnaq, L., Goldowsky-Dill, N., Heimersheim, S., Ortega, A., Bloom, J., et al. (2025) · arXiv · doi:10.48550/arxiv.2501.16496 · Cited by 291
The role of agentic AI in shaping a smart future: A systematic review
Hosseini, S., & Seilani, H. (2025) · Array · doi:10.1016/j.array.2025.100399 · Cited by 280
AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges
Sapkota, R., Roumeliotis, K. I., & Karkee, M. (2025) · SuperIntelligence - Robotics - Safety & Alignment · doi:10.70777/si.v2i3.15161 · Cited by 186
Metadata
- Authors
- Chan, A., Ezell, C., Kaufmann, M., Wei, K., Hammond, L., Bradley, H., Bluemke, E., Rajkumar, N., Krueger, D., Kolt, N., Heim, L., & Anderljung, M.
- Affiliations
- Mila - Quebec Artificial Intelligence Institute (CA)
- Harvard University (US)
- Independent, United Kingdom
- University of Oxford (GB)
- University of Cambridge (GB)
- Centre for the Governance of AI (GB)
- University of Toronto (CA)
- ORCID
- Venue
- The 2024 ACM Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2024-06-03
- Pages
- 958-973
- OpenAlex
- W4399364360
- Cited by
- 84
- References
- 103
- Citations by year
- 2026: 42 · 2025: 38 · 2024: 4
- FWCI
- 38.24
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion, public-domain)
- arXiv (Cornell University) (public-domain)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Law › Digitalization, Law, and Regulation
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Keywords
- AI agents, visibility, real-time monitoring, activity logging, AI governance, accountability, privacy, concentration of power, supply chain, societal risk
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Visibility into AI Agents. https://app.cochat.ai/papers/10.1145/3630106.3658948
- The paper
- Chan, A., Ezell, C., Kaufmann, M., Wei, K., Hammond, L., Bradley, H., Bluemke, E., Rajkumar, N., Krueger, D., Kolt, N., Heim, L., & Anderljung, M. (2024). Visibility into AI Agents. The 2024 ACM Conference on Fairness, Accountability, and Transparency. https://doi.org/10.1145/3630106.3658948
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.