Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its DataCite record; 29 of the 29 references it cites were found in a registry or an index; none of the 18 sources its claims cite is checked for support yet.

Whose Agent Are You? Multi-Layer Fingerprinting and Attribution of Autonomous Web Agents

Open access

Abstract

As AI web agents proliferate, combining large language models with autonomous, browser-level control, indiscriminate content scraping by web agents has emerged as a privacy and security challenge. Existing defenses, such as robots.txt and active bot-blocking, are insufficient, as they are widely violated and easily circumvented. In this work, we demonstrate that AI web agents can be effectively distinguished from humans and traditional crawlers using a multi-layer fingerprint based on both network layer characteristics (e.g., TLS, HTTP) and browser interaction behavior. We implement this mechanism as a programmatic logging framework that can be deployed on a live, instrumented domain. By analyzing six prominent agent frameworks (AutoGen, Browser Use, Claude, Gemini, ChatGPT, and Skyvern), we uncover latent structural differences in how these systems assemble HTTP requests, establish TLS/HTTP connections, and execute autonomous browser actions. Feeding these multi-layer features into a decision tree classifier, our framework achieves high-fidelity identification (100% accuracy), successfully isolating distinct agent architectures and differentiating agent traffic from both human browsing baselines and legacy crawlers. Our findings demonstrate that cross-layer agent tracking provides a robust approach to content protection and web security policy enforcement.

Overview

CoChat Summary

TL;DR

The paper presents MARK, a server-side multi-layer fingerprinting framework that distinguishes AI web agents from humans and legacy crawlers using request timing, TLS/HTTP, and browser interaction behavior. Across six agent frameworks, an Extra Trees classifier on combined features reaches 97% accuracy (0.971 F1), with protocol-level features enabling >60% macro F1 after three requests.

Key findings

  • Combined four feature layers identify agents, humans, and crawlers with 97% accuracy (0.971 F1); no single layer is sufficient: full-trace temporal 1.000, HTTP 0.820, TLS 0.747, behavioral 0.876.
  • Distinct signatures emerge: Skyvern is uniquely identifiable at TLS/H2 (17 TLS extensions, distinct JA4 c hash, stream-5 priority weight 110); Browser Use violates Sec-Fetch rules in 100% of requests; Operator shows 39% Firefox JA4 HTTP/2 sessions; AutoGen has 100% UA vs. Sec-Ch-Ua incoherence and high temporal variability; Claude and Gemini are nearly identical at the network layer but separable behaviorally (Gemini most typing, Claude most consistent low-variance).
  • In early real-time identification, after three requests the combined features exceed 60% macro F1; HTTP and TLS perform better early, while behavioral features supplement later. Temporal features are poor early despite 100% full-trace accuracy.
  • Legacy crawlers are identified with 100% F1 across request, HTTP, and TLS layers; human browsing reaches 0.952 F1 with HTTP features and 0.984 with behavioral features.

Methods

  • Deployed a live instrumented testbed on AWS EC2 with five controlled UX scenarios, logging TLS, HTTP, request timing, and browser events at 1 ms resolution; the logger issues no mid-session HTTP requests and flushes via sendBeacon.
  • Ran six agents (AutoGen, Browser Use, Claude, Gemini, Operator, Skyvern) 30 times each on the same prompt visiting seven URLs; open-source agents used GPT-5-mini, proprietary agents used native computer-use models. Baselines: 30 human participants and 30 crawl sessions each for Scrapy, Heritrix, and Nutch.
  • Extracted four feature vectors (9 temporal, 29 TLS, 35 HTTP header, 108 behavioral) and trained an Extra Trees classifier with 200 estimators and 30-fold cross-validation, separately per feature set and combined.

Limitations

  • Stated: feature-based identification cannot distinguish agents with fully identical back-end systems and decision-making processes (e.g., Claude/Gemini at network layers), nor an agent that perfectly mimics human browsing and network traces. The controlled testbed uses ambiguous tasks that may affect behavioral accuracy; temporal features may shift with task, website, or prompt; classifier performance may degrade as agents and underlying models evolve.
  • Evident from the text: only six agent frameworks and three crawlers are measured; proprietary agents are bundled with native models, so attribution may reflect model-plus-agent rather than agent alone; crawlers execute no JavaScript and never negotiate HTTP/2, so behavioral and H2 features are unavailable for them; the human baseline is 30 participants; the live domain receives background scanner traffic, handled by sequential single-IP crawl attribution.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

DataCite · 10.48550/arxiv.2606.20910

Cites

29 of 29 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Overview of MARK. Our M ulti-layer A gent fingerprinting framewo RK (MARK) consists of four stages: (1) configuring agents with a common web-interaction instruction, (2) collecting raw network and client-side traces as each agent visits URLs and performs controlled UX tasks, (3) extracting TLS, HTTP, and behavioral features from the segmented traces, and (4) using the resulting feature vectors to attribute traces to humans, crawlers, or web agents.
Figure 1 Overview of MARK. Our M ulti-layer A gent fingerprinting framewo RK (MARK) consists of four stages: (1) configuring agents with a common web-interaction instruction, (2) collecting raw network and client-side traces as each agent visits URLs and performs controlled UX tasks, (3) extracting TLS, HTTP, and behavioral features from the segmented traces, and (4) using the resulting feature vectors to attribute traces to humans, crawlers, or web agents.CC-BY · From the PDF
Figure 2 Comparison of request timing (Inter-RequestIntervals and Inter-Event-Intervals). A similar tendency between IRI and IEI indicates the pacing strategies of agents.
Figure 2 Comparison of request timing (Inter-RequestIntervals and Inter-Event-Intervals). A similar tendency between IRI and IEI indicates the pacing strategies of agents.CC-BY · From the PDF
Figure 3 Comparison results of the request rate sent by the agent and its Coefficient of Variation. This feature shows the stability and pacing of each agent.
Figure 3 Comparison results of the request rate sent by the agent and its Coefficient of Variation. This feature shows the stability and pacing of each agent.CC-BY · From the PDF
Figure 4 Mean and standard deviation values of mouse trajectory length. It implies agent type and strategy for human-mimicking behavior.
Figure 4 Mean and standard deviation values of mouse trajectory length. It implies agent type and strategy for human-mimicking behavior.CC-BY · From the PDF
Figure 5 Web component interaction proportion for each web agent on different pages. The event profile proportion suggests a web content exploration strategy of agents, and it is different for agents even though the network packet structures are identical. (S5 webpage is skipped because Claude, Gemini, and Skyvern have no record for it.)
Figure 5 Web component interaction proportion for each web agent on different pages. The event profile proportion suggests a web content exploration strategy of agents, and it is different for agents even though the network packet structures are identical. (S5 webpage is skipped because Claude, Gemini, and Skyvern have no record for it.)CC-BY · From the PDF
Figure 6 The key downs and mouse movements per session clustered regions across agents. Agents generally use keyboard controls rather than mouse movements, except for Skyvern, which presents human-like behavior.
Figure 6 The key downs and mouse movements per session clustered regions across agents. Agents generally use keyboard controls rather than mouse movements, except for Skyvern, which presents human-like behavior.CC-BY · From the PDF
Figure 7 Agent identification performance comparison as the number of requests seen at the website end. Protocol-level fingerprints preserve more than 60% agent discrimination after 3 requests are received, and behavioral replenishes the performance after signals are accumulated.
Figure 7 Agent identification performance comparison as the number of requests seen at the website end. Protocol-level fingerprints preserve more than 60% agent discrimination after 3 requests are received, and behavioral replenishes the performance after signals are accumulated.CC-BY · From the PDF
Image 8
CC-BY · From the PDF
Image 9
CC-BY · From the PDF
Image 10
CC-BY · From the PDF
Image 11
CC-BY · From the PDF
Figure 13 Scenario 3.
Figure 13 Scenario 3.CC-BY · From the PDF
Figure 14 Scenario 4.
Figure 14 Scenario 4.CC-BY · From the PDF
Figure 15 Scenario 5.
Figure 15 Scenario 5.CC-BY · From the PDF

Verification

Claims the paper makes

0 Valid · 2 Not valid · 14 Not checked · 141 Own results and interpretations

77 more claims

Create a free account to see all 157 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 20
  • It may state two separate claims as one. 59
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

5 of 5

Citations

Cites

Show all 29 references

Research works printed but not linked: 5

  1. Q. Sun, D. R. Simon, Y.-M. Wang, W. Russell, V. N. Padmanabhan, and L. Qiu, "Statistical identification of encrypted web browsing traf- fic," in Proceedings 2002 IEEE Symposium on Security and Privacy. IEEE, 2002, pp. 19-30.
  2. J. Bazinska, M. Mathys, F. Casucci, M. Rojas-Carulla, X. Davies, A. Souly, and N. Pfister, "Breaking agent backbones: Evaluating the security of backbone LLMs in AI agents," in The Fourteenth International Conference on Learning Representations, 2026.
  3. S. Yao, J. Zhao, D. Yu, N. Du, I. Shafran, K. Narasimhan, and Y. Cao, "ReAct: Synergizing reasoning and acting in language models," in ICLR, 2023.
  4. G. Wang, Y. Xie, Y. Jiang, A. Mandlekar, C. Xiao, Y. Zhu, L. Fan, and A. Anandkumar, "Voyager: An open-ended embodied agent with Large Language Models," Transactions on Machine Learning Research, 2024. [Online]. Available: https://openreview.net/forum?i d=ehfRiF0R3a
  5. E. Wang, Z. Shafiq, and Y. Vekaria, "Fp-agent: Fingerprinting ai browsing agents," 2026. [Online]. Available: https://arxiv.org/abs/26 05.01247

Cited by

See all 3

Metadata

Authors
Kang, D., Jeong, H., Sheffey, J., Datta, P., & Houmansadr, A.
Affiliations
University of Massachusetts Amherst (US)
Venue
arXiv
Publisher
arXiv
Published
2026
ISSN
2331-8422 (ISSN-L)
OpenAlex
W7165620675
Cited by
3
References
29
Citations by year
2026: 3
Type
posted content
Language
en
Open access
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
  • Physical Sciences › Computer Science › Information Systems › Web Data Mining and Analysis
  • Physical Sciences › Computer Science › Artificial Intelligence › Internet Traffic Analysis and Secure E-voting
Keywords
web scraping, bot detection, large language models, content protection, AutoGen, Claude, ChatGPT

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-17, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-17 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Whose Agent Are You? Multi-Layer Fingerprinting and Attribution of Autonomous Web Agents. https://app.cochat.ai/papers/10.48550/arxiv.2606.20910
The paper
Kang, D., Jeong, H., Sheffey, J., Datta, P., & Houmansadr, A. (2026). Whose Agent Are You? Multi-Layer Fingerprinting and Attribution of Autonomous Web Agents. arXiv. https://doi.org/10.48550/arxiv.2606.20910

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.