Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index; 5 of the 17 sources its claims cite were checked for support.

ET-BERT: A Contextualized Datagram Representation with Pre-training Transformers for Encrypted Traffic Classification

Open access
Lin, Xinjie, Xiong, Gang, Gou, Gaopeng, Li, Zhen, Shi, Junzheng, Yu, Jing · 2022 · Proceedings of the ACM Web Conference 2022

Abstract

Encrypted traffic classification requires discriminative and robust traffic representation captured from content-invisible and imbalanced traffic data for accurate classification, which is challenging but indispensable to achieve network security and network management. The major limitation of existing solutions is that they highly rely on the deep features, which are overly dependent on data size and hard to generalize on unseen data. How to leverage the open-domain unlabeled traffic data to learn representation with strong generalization ability remains a key challenge. In this paper, we propose a new traffic representation model called Encrypted Traffic Bidirectional Encoder Representations from Transformer (ET-BERT), which pre-trains deep contextualized datagram-level representation from large-scale unlabeled data. The pre-trained model can be fine-tuned on a small number of task-specific labeled data and achieves state-of-the-art performance across five encrypted traffic classification tasks, remarkably pushing the F1 of ISCX-VPN-Service to 98.9% (5.2%↑), Cross-Platform (Android) to 92.5% (5.4%↑), CSTNET-TLS 1.3 to 97.4% (10.0%↑). Notably, we provide explanation of the empirically powerful pre-training model by analyzing the randomness of ciphers. It gives us insights in understanding the boundary of classification ability over encrypted traffic. The code is available at: https://github.com/linwhitehat/ET-BERT.

Overview

CoChat Summary

TL;DR

ET-BERT pre-trains a Transformer on large-scale unlabeled encrypted traffic using BURST-based datagram tokens and two self-supervised tasks, then fine-tunes for classification. It reports state-of-the-art F1 across five encrypted traffic tasks, including 98.9% on ISCX-VPN-Service and 97.4% on CSTNET-TLS 1.3.

Key findings

  • ET-BERT achieves state-of-the-art performance across five encrypted traffic classification tasks; the abstract reports F1 of 98.9% on ISCX-VPN-Service (5.2%↑), 92.5% on Cross-Platform (Android) (5.4%↑), and 97.4% on CSTNET-TLS 1.3 (10.0%↑).
  • In the comparison tables, ET-BERT(packet) reaches F1 of 0.9754 on Cross-Platform(iOS), 0.9206 on Cross-Platform(Android), 0.9890 on ISCX-VPN-Service, 0.9937 on ISCX-VPN-App, 0.9921 on ISCX-Tor, 0.9916 on USTC-TFC, and 0.9741 on CSTNET-TLS 1.3.
  • Ablation on ISCX-VPN-App shows removing SBP lowers F1 by 3.97%, removing MBM lowers it by 9.33%, replacing BURST input with packets lowers it by 1.37%, and removing pre-training lowers it by 37.57%.
  • Few-shot results on ISCX-VPN-Service show ET-BERT(packet) F1 of 95.78%, 98.33%, and 91.55% at 40%, 20%, and 10% data; Deeppacket’s performance decreases by 40.22% from full size to 10%. Randomness analysis finds ciphers fail perfect randomness, and ET-BERT reaches near-100% F1 on datasets with weaker randomness, averaging 99.14% in ETCV, 99.21% in EACT, and 99.30% in EMC.

Methods

  • Two-stage design: self-supervised pre-training on unlabeled traffic with a Transformer (12 blocks, 12 attention heads, token dimension 768, 512 input tokens), followed by fine-tuning on task-specific labeled data. Datagram2Token converts flows into BURSTs, then bi-gram/BPE tokens (vocabulary size 65,536), with token, position, and segment embeddings.
  • Pre-training tasks: Masked BURST Model masks 15% of tokens (80% replaced with [MASK], 10% random token, 10% unchanged); Same-origin BURST Prediction uses a binary classifier to predict whether two sub-BURSTs are from the same BURST origin, with 50% actual next sub-BURST and 50% random sub-BURST. Pre-training uses about 30GB unlabeled traffic (about 15GB public datasets and 15GB passively collected CSTNET traffic).
  • Downstream evaluation covers five tasks on six public datasets plus a new CSTNET-TLS 1.3 dataset; fine-tuning randomly selects at most 500 flows and 5,000 packets per class, with an 8:1:1 train/validation/test split. Metrics are Accuracy, Precision, Recall, and F1 with macro average; ET-BERT is compared with 11 methods and uses packet-level and flow-level fine-tuning strategies.

Limitations

  • Stated: generalizability is challenged by variability of encrypted traffic over time; TLS 1.3 labeling via SNI will not be possible with ECH, and the authors mitigate this by active visiting and labeling with unique process identifiers.
  • Stated: pre-training security depends on clean pre-training data; an attacker can add low-frequency subwords as “toxic” embeddings to create a poisoned pre-trained model with a backdoor, and how to construct such toxic tokens for encrypted traffic has not been studied.
  • Evident from the text: the TLS 1.3 dataset labels rely on SNI, so evaluation may not transfer under ECH; datasets are fixed snapshots and no temporal drift evaluation is reported; pre-training mixes public and CSTNET traffic, so domain bias is possible.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/3485447.3512217

Cites

48 of 48 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Four main kinds of Encrypted Traffic Classification Methods: (a) Plaintext feature based fingerprint matching. (b) Statistical feature based machine learning. (c) Raw traffic feature based ML. (d) Raw traffic based pre-training.
Figure 1 Four main kinds of Encrypted Traffic Classification Methods: (a) Plaintext feature based fingerprint matching. (b) Statistical feature based machine learning. (c) Raw traffic feature based ML. (d) Raw traffic based pre-training.From the PDF
Figure 2 Overview of ET-BERT Framework.
Figure 2 Overview of ET-BERT Framework.From the PDF
Figure 3 The Distribution of the Ciphers across all Datasets.
Figure 3 The Distribution of the Ciphers across all Datasets.From the PDF
Figure 4 Comparison Results on Few-shot ISCX-VPN-App.
Figure 4 Comparison Results on Few-shot ISCX-VPN-App.From the PDF
Figure 5 t-SNE Visualization of Classification Boundaries with 6 Methods on ISCX-VPN-App Testset.
Figure 5 t-SNE Visualization of Classification Boundaries with 6 Methods on ISCX-VPN-App Testset.From the PDF

Verification

Claims the paper makes

3 Valid · 1 Not valid · 11 Not checked · 57 Own results and interpretations

44 more claims

Create a free account to see all 72 claims and to verify the 2 references still open.

See all claims — free account
  • It may state two separate claims as one. 18
  • The quote only partly states this claim. 2
  • Probably not a substantial claim. 6

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 46 references

Cited by

See all 599

Metadata

Authors
Lin, X., Xiong, G., Gou, G., Li, Z., Shi, J., & Yu, J.
Affiliations
Chinese Academy of Sciences (CN)
Venue
Proceedings of the ACM Web Conference 2022
Publisher
ACM
Published
2022-04-25
Pages
633-642
OpenAlex
W4224315052
Cited by
599
References
46
Citations by year
2026: 217 · 2025: 199 · 2024: 123 · 2023: 52 · 2022: 8
FWCI
52.77
Type
conference paper
Language
en
Open access
Locations
  • International World Wide Web Conference (WWW) (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
  • the Strategic Priority Research Program of Chinese Academy of Sciences (No. XDC02040400)
  • The National Key Research and Development Program of China (No. 2021YFB3101400)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Internet Traffic Analysis and Secure E-voting
  • Physical Sciences › Computer Science › Computer Networks and Communications › Network Security and Intrusion Detection
  • Physical Sciences › Computer Science › Computer Networks and Communications › Software-Defined Networks and 5G
Keywords
encrypted traffic classification, BERT, context representation, network security, network management, fine-tuning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: ET-BERT: A Contextualized Datagram Representation with Pre-training Transformers for Encrypted Traffic Classification. https://app.cochat.ai/papers/10.1145/3485447.3512217
The paper
Lin, X., Xiong, G., Gou, G., Li, Z., Shi, J., & Yu, J. (2022). ET-BERT: A Contextualized Datagram Representation with Pre-training Transformers for Encrypted Traffic Classification. Proceedings of the ACM Web Conference 2022. https://doi.org/10.1145/3485447.3512217

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.