Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its DataCite record; 34 of the 34 references it cites were found in a registry or an index; none of the 28 sources its claims cite is checked for support yet.

Privacy Practices of Browser Agents

Open access
Ukani, Alisha, Haddadi, Hamed, Shamsabadi, Ali Shahin, Snyder, Peter·2025·arXiv

Abstract

This paper presents a systematic evaluation of the privacy behaviors and attributes of eight recent, popular browser agents. Browser agents are software that automate Web browsing using large language models and ancillary tooling. However, the automated capabilities that make browser agents powerful also make them high-risk points of failure. Both the kinds of tasks browser agents are designed to execute, along with the kinds of information browser agents are entrusted with to fulfill those tasks, mean that vulnerabilities in these tools can result in enormous privacy harm. This work presents a framework of five broad factors (totaling 15 distinct measurements) to measure the privacy risks in browser agents. Our framework assesses i. vulnerabilities in the browser agent's components, ii. how the browser agent protects against website behaviors, iii. whether the browser agent prevents cross-site tracking, iv. how the agent responds to privacy-affecting prompts, and v. whether the tool leaks personal information to sites. We apply our framework to eight browser agents and identify 30 vulnerabilities, ranging from disabled browser privacy features to "autocompleting" sensitive personal information in form fields. We have responsibly disclosed our findings, and plan to release our dataset and other artifacts.

Overview

CoChat Summary

TL;DR

This paper systematically evaluates privacy behaviors of eight popular browser agents using a 15-measurement framework across five risk dimensions, finding 30 privacy concerns in every tested agent. It identifies issues including disabled browser privacy features, missing malicious-site/TLS warnings, cross-site tracking exposure, poor handling of privacy dialogs, and leakage of personal information.

Key findings

  • Across eight browser agents and 15 measurements, the authors identify 30 privacy concerns, with at least one vulnerability in every agent: 8 component risks, 8 protections against insecure/malicious websites, 3 cross-site tracking risks, 5 privacy-dialog risks, and 6 personal-information leakage risks.
  • Director used Chromium version 124, which was 16 major versions out of date and had 340 reported CVEs at measurement; six tools did not show warnings for malicious websites, and Director and Browser Use did not show warnings for revoked TLS certificates.
  • Nova Act and Browser Use only partitioned the subset of storage state that Chromium partitions by default; Director saved profile state without informing users and did not allow users to delete it; four tools accepted all cookies in at least one setting, and Browser Use automatically granted notification permissions.
  • Claude Computer Use, ChatGPT Agent, and Director shared personal information with websites that requested but did not require it; Claude Computer Use, Claude for Chrome, and Director shared information with sites that withheld content until information was provided; Director additionally shared the user’s credit card number, and ChatGPT Agent used IP-based geolocation to determine zip code.

Methods

  • The paper defines a framework of five broad factors totaling 15 distinct measurements: component vulnerabilities, protections against website behaviors, cross-site tracking prevention, responses to privacy-affecting prompts, and personal-information leakage.
  • It applies the framework to eight popular commercial browser agents: Claude Computer Use, Claude for Chrome, ChatGPT Agent, Perplexity Comet, Amazon Nova Act, Google Project Mariner, Browserbase Director, and Browser Use. It excludes AI browser assistants that do not perform automation and open-source research prototypes.
  • Testing uses three approaches: authoritative provider information (documentation and source code), browser privacy/security test suites, and constructed websites with control and experimental pages under an indirect agent decision-making methodology. Risk is counted as additional privacy risk over the browser bundled with each agent, comparing Chromium-based agents against stock Chrome. The authors responsibly disclosed 13 issues to all eight agents.

Limitations

  • Stated: the study is restricted to eight popular commercial browser agents and excludes non-automation AI browser assistants and open-source research prototypes; some findings are temporal, such as Director later updating its browser, and one passkey finding is suspected but not conclusively stated.
  • Stated: tests did not use malicious websites that could exploit the tools, and personal-information leakage tests used a fictitious persona and controlled websites.
  • Evident: the black-box methodology and point-in-time measurements may not capture all implementation details or future versions, and findings may not generalize beyond the tested agents and versions.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2512.07725

Cites

34 of 34 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

0 Valid · 8 Not valid · 24 Not checked · 98 Own results and interpretations

58 more claims

Create a free account to see all 130 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 41
  • It may state two separate claims as one. 32

Create a free account to see these claims.

Citations

Cites

Show all 13 references

Research works printed but not linked: 6

  1. Devdatta Akhawe and Adrienne Porter Felt. Alice in Warningland: A Large-Scale Field Study of Browser Security Warning Effectiveness. In USENIX Security Symposium (USENIX), 2013.
  2. Muhammad Ahmad Bashir, Sajjad Arshad, William Robertson, and Christo Wilson. Tracing information flows between ad exchanges using retargeted ads. In USENIX Security Symposium (USENIX), 2016.
  3. Priyanshu Kumar, Elaine Lau, Saranya Vijayakumar, Tu Trinh, Elaine T Chang, Vaughn Robinson, Shuyan Zhou, Matt Fredrikson, Sean M Hendryx, Summer Yue, et al. Aligned llms are not aligned browser agents. In International Conference on Learning Represen- tations (ICLR), 2025.
  4. Zeyi Liao, Lingbo Mo, Chejian Xu, Mintong Kang, Jiawei Zhang, Chaowei Xiao, Yuan Tian, Bo Li, and Huan Sun. Eia: Environmental injection attack on generalist web agents for privacy leakage. In International Conference on Learning Representations (ICLR), 2025.
  5. Peter Snyder, Soroush Karami, Arthur Edelstein, Benjamin Livshits, and Hamed Haddadi. {Pool-Party}: Exploiting browser resource pools for web tracking. In USENIX Security Symposium (USENIX), 2023.
  6. Paul Syverson and Matthew Traudt. Hsts supports targeted surveil- lance. In Workshop on Free and Open Communications on the Internet (FOCI), 2018.

Cited by

See all 9

Metadata

Authors
Ukani, A., Haddadi, H., Shamsabadi, A. S., & Snyder, P.
Affiliations
  • University of California San Diego (US)
  • Imperial College London (GB)
Venue
arXiv
Publisher
arXiv
Published
2025
ISSN
2331-8422 (ISSN-L)
OpenAlex
W7110836078
Cited by
9
References
13
Citations by year
2026: 8
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University) (cc-by-nc-sa)
Topics
  • Social Sciences › Sociology and Political Science › Privacy, Security, and Data Protection
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
  • Physical Sciences › Computer Science › Information Systems › Web Data Mining and Analysis
Keywords
privacy risks, large language models, personal information leakage, privacy vulnerabilities, responsible disclosure

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-13, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-13 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Privacy Practices of Browser Agents. https://app.cochat.ai/papers/10.48550/arxiv.2512.07725
The paper
Ukani, A., Haddadi, H., Shamsabadi, A. S., & Snyder, P. (2025). Privacy Practices of Browser Agents. arXiv. https://doi.org/10.48550/arxiv.2512.07725

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.