The DOI matches its DataCite record; 34 of the 34 references it cites were found in a registry or an index; none of the 28 sources its claims cite is checked for support yet.
Privacy Practices of Browser Agents
Open accessAbstract
This paper presents a systematic evaluation of the privacy behaviors and attributes of eight recent, popular browser agents. Browser agents are software that automate Web browsing using large language models and ancillary tooling. However, the automated capabilities that make browser agents powerful also make them high-risk points of failure. Both the kinds of tasks browser agents are designed to execute, along with the kinds of information browser agents are entrusted with to fulfill those tasks, mean that vulnerabilities in these tools can result in enormous privacy harm. This work presents a framework of five broad factors (totaling 15 distinct measurements) to measure the privacy risks in browser agents. Our framework assesses i. vulnerabilities in the browser agent's components, ii. how the browser agent protects against website behaviors, iii. whether the browser agent prevents cross-site tracking, iv. how the agent responds to privacy-affecting prompts, and v. whether the tool leaks personal information to sites. We apply our framework to eight browser agents and identify 30 vulnerabilities, ranging from disabled browser privacy features to "autocompleting" sensitive personal information in form fields. We have responsibly disclosed our findings, and plan to release our dataset and other artifacts.
Overview
CoChat Summary
TL;DR
This paper systematically evaluates privacy behaviors of eight popular browser agents using a 15-measurement framework across five risk dimensions, finding 30 privacy concerns in every tested agent. It identifies issues including disabled browser privacy features, missing malicious-site/TLS warnings, cross-site tracking exposure, poor handling of privacy dialogs, and leakage of personal information.
Key findings
- Across eight browser agents and 15 measurements, the authors identify 30 privacy concerns, with at least one vulnerability in every agent: 8 component risks, 8 protections against insecure/malicious websites, 3 cross-site tracking risks, 5 privacy-dialog risks, and 6 personal-information leakage risks.
- Director used Chromium version 124, which was 16 major versions out of date and had 340 reported CVEs at measurement; six tools did not show warnings for malicious websites, and Director and Browser Use did not show warnings for revoked TLS certificates.
- Nova Act and Browser Use only partitioned the subset of storage state that Chromium partitions by default; Director saved profile state without informing users and did not allow users to delete it; four tools accepted all cookies in at least one setting, and Browser Use automatically granted notification permissions.
- Claude Computer Use, ChatGPT Agent, and Director shared personal information with websites that requested but did not require it; Claude Computer Use, Claude for Chrome, and Director shared information with sites that withheld content until information was provided; Director additionally shared the user’s credit card number, and ChatGPT Agent used IP-based geolocation to determine zip code.
Methods
- The paper defines a framework of five broad factors totaling 15 distinct measurements: component vulnerabilities, protections against website behaviors, cross-site tracking prevention, responses to privacy-affecting prompts, and personal-information leakage.
- It applies the framework to eight popular commercial browser agents: Claude Computer Use, Claude for Chrome, ChatGPT Agent, Perplexity Comet, Amazon Nova Act, Google Project Mariner, Browserbase Director, and Browser Use. It excludes AI browser assistants that do not perform automation and open-source research prototypes.
- Testing uses three approaches: authoritative provider information (documentation and source code), browser privacy/security test suites, and constructed websites with control and experimental pages under an indirect agent decision-making methodology. Risk is counted as additional privacy risk over the browser bundled with each agent, comparing Chromium-based agents against stock Chrome. The authors responsibly disclosed 13 issues to all eight agents.
Limitations
- Stated: the study is restricted to eight popular commercial browser agents and excludes non-automation AI browser assistants and open-source research prototypes; some findings are temporal, such as Director later updating its browser, and one passkey finding is suspected but not conclusively stated.
- Stated: tests did not use malicious websites that could exploit the tools, and personal-information leakage tests used a fictitious persona and controlled websites.
- Evident: the black-box methodology and point-in-time measurements may not capture all implementation details or future versions, and findings may not generalize beyond the tested agents and versions.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
0 Valid · 8 Not valid · 24 Not checked · 98 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We apply our framework to eight browser agents and identify 30 vulnerabilities, ranging from disabled browser privacy features to “autocompleting” sensitive personal information in form fields.”
- Also stated in: § 1. Introduction · plain
“identifying 30 privacy vulnerabilities in browser agents, including at least one vulnerability in each browser agent”
- Also stated in: § 5. Results · plain
“We find 30 privacy concerns across the eight browser agents we study, which we summarize in Table 2.”
§ Privacy Practices of Browser Agents > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § 1. Introduction · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“identifying 30 privacy vulnerabilities in browser agents, including at least one vulnerability in each browser agent”
§ Privacy Practices of Browser Agents > 1. Introduction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Anthropic Claude Computer Use 14 , is unique among the studied tools because it is the only one that controls the entire desktop rather than a browser.”
§ Privacy Practices of Browser Agents > 3. Browser Agents
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We find eight vulnerabilities in total.”
- Also stated in: § §5.1 Takeaway · plain
“We identify eight vulnerabilities related to each system's components.”
§ Privacy Practices of Browser Agents > 5.1. Privacy Risks of Components
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § §5.1 Takeaway · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We find seven vulnerabilities, as seven browser agents only support off-device models.”
§ Privacy Practices of Browser Agents > 5.1.1. Off-Device Models.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
58 more claims
Create a free account to see all 130 claims and every source verdict.
- Probably not a substantial claim. 41
- It may state two separate claims as one. 32
Citations
Cites
Evasion Attacks against Machine Learning at Test Time
Biggio, B., Corona, I., Maiorca, D., Nelson, B., Šrndić, N., Laskov, P., Giacinto, G., & Roli, F. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40994-3_25 · Cited by 890
Extracting Training Data from Large Language Models
Carlini, N., Tramer, F., Wallace, E., Jagielski, M., Herbert-Voss, A., Lee, K., Roberts, A., Brown, T., Song, D., Erlingsson, U., et al. (2020) · arXiv · doi:10.48550/arxiv.2012.07805 · Cited by 727
WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models
He, H., Yao, W., Ma, K., Yu, W., Dai, Y., Zhang, H., Lan, Z., & Yu, D. (2024) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2024.acl-long.371 · Cited by 568
Felten, E. W., & Schneider, M. A. (2000) · Proceedings of the 7th ACM conference on Computer and Communications Security · doi:10.1145/352600.352606 · Cited by 305
The Spy in the Sandbox: Practical Cache Attacks in JavaScript and their Implications
Oren, Y., Kemerlis, V. P., Sethumadhavan, S., & Keromytis, A. D. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813708 · Cited by 263
FPDetective: dusting the web for fingerprinters
Acar, G., Juarez, M., Nikiforakis, N., Diaz, C., Gürses, S., Piessens, F., & Preneel, B. (2013) · Proceedings of the 2013 ACM SIGSAC conference on Computer & communications security - CCS '13 · doi:10.1145/2508859.2516674 · Cited by 260
Improving SSL Warnings: Comprehension and Adherence
Felt, A. P., Ainslie, A., Reeder, R. W., Consolvo, S., Thyagaraja, S., Bettes, A., Harris, H., & Grimes, J. (2015) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702442 · Cited by 160
Attacking Vision-Language Computer Agents via Pop-upsPreprint
Zhang, Y., Yu, T., & Yang, D.-Y. (2024) · Annual Meeting of the Association for Computational Linguistics · doi:10.48550/arxiv.2411.02391 · Cited by 142
(2023) · doi:10.52202/075280-1220 · Cited by 134
Membership Inference Attacks against Language Models via Neighbourhood ComparisonPreprint
Mattern, J., Mireshghallah, F., Jin, Z., Schölkopf, B., Sachan, M., & Berg-Kirkpatrick, T. (2023) · arXiv (Cornell University) · doi:10.3929/ethz-b-000653508 · Cited by 108
Research works printed but not linked: 6
- Devdatta Akhawe and Adrienne Porter Felt. Alice in Warningland: A Large-Scale Field Study of Browser Security Warning Effectiveness. In USENIX Security Symposium (USENIX), 2013.
- Muhammad Ahmad Bashir, Sajjad Arshad, William Robertson, and Christo Wilson. Tracing information flows between ad exchanges using retargeted ads. In USENIX Security Symposium (USENIX), 2016.
- Priyanshu Kumar, Elaine Lau, Saranya Vijayakumar, Tu Trinh, Elaine T Chang, Vaughn Robinson, Shuyan Zhou, Matt Fredrikson, Sean M Hendryx, Summer Yue, et al. Aligned llms are not aligned browser agents. In International Conference on Learning Represen- tations (ICLR), 2025.
- Zeyi Liao, Lingbo Mo, Chejian Xu, Mintong Kang, Jiawei Zhang, Chaowei Xiao, Yuan Tian, Bo Li, and Huan Sun. Eia: Environmental injection attack on generalist web agents for privacy leakage. In International Conference on Learning Representations (ICLR), 2025.
- Peter Snyder, Soroush Karami, Arthur Edelstein, Benjamin Livshits, and Hamed Haddadi. {Pool-Party}: Exploiting browser resource pools for web tracking. In USENIX Security Symposium (USENIX), 2023.
- Paul Syverson and Matthew Traudt. Hsts supports targeted surveil- lance. In Workshop on Free and Open Communications on the Internet (FOCI), 2018.
Cited by
Beyond the Protocol: Unveiling Attack Vectors in the Model Context Protocol (MCP) Ecosystem
Song, H., Shen, Y., Luo, W., Guo, L., Chen, T., Wang, J., Li, B., Zhang, X., & Chen, J. (2026) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2026.3694876 · Cited by 63
A New Era in LLM Security: Exploring Security Concerns in Real-World LLM-based Systems
Wu, F., Zhang, N., Jha, S., McDaniel, P., & Xiao, C. (2024) · arXiv · doi:10.48550/arxiv.2402.18649 · Cited by 23
FP-Agent: Fingerprinting AI Browsing AgentsPreprint
Wang, E., Shafiq, Z., & Vekaria, Y. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2605.01247 · Cited by 7
Security, privacy, and ethical risks in OpenClaw
Jin, Y., Zhang, Z., Lyu, Z., & Ni, J. (2026) · Journal of Information and Intelligence · doi:10.1016/j.jiixd.2026.05.006 · Cited by 2
AgentTell: Behavioural Side-Channel Leakage in Browser-Use AgentsPreprint
Shahriar, A., Rahman, M. N., Ahmed, S., Sadeque, F., & Parvez, M. R. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2609.32915 · Cited by 1
Metadata
- Authors
- Ukani, A., Haddadi, H., Shamsabadi, A. S., & Snyder, P.
- Affiliations
- University of California San Diego (US)
- Imperial College London (GB)
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2025
- ISSN
- 2331-8422 (ISSN-L)
- arXiv
- 2512.07725
- OpenAlex
- W7110836078
- Cited by
- 9
- References
- 13
- Citations by year
- 2026: 8
- Type
- posted content
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University) (cc-by-nc-sa)
- Topics
- Social Sciences › Sociology and Political Science › Privacy, Security, and Data Protection
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Physical Sciences › Computer Science › Information Systems › Web Data Mining and Analysis
- Keywords
- privacy risks, large language models, personal information leakage, privacy vulnerabilities, responsible disclosure
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-13, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-13 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Privacy Practices of Browser Agents. https://app.cochat.ai/papers/10.48550/arxiv.2512.07725
- The paper
- Ukani, A., Haddadi, H., Shamsabadi, A. S., & Snyder, P. (2025). Privacy Practices of Browser Agents. arXiv. https://doi.org/10.48550/arxiv.2512.07725
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.