CoChat

HTTP security headers analysis of top one million websites

Lavrenovs, Arturs, Melon, F. Jesus Rubio · 2018 · 2018 10th International Conference on Cyber Conflict (CyCon)

The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.

Abstract

We present research on the security of the most popular websites, ranked according to Alexa's top one million list, based on an HTTP response headers analysis. For each of the domains included in the list, we made four different requests: an HTTP/1.1 request to the domain itself and to its "www" subdomain and two more equivalent HTTPS requests. Redirections were always followed. A detailed discussion of the request process and main outcomes is presented, including X.509 certificate issues and comparison of results with equivalent HTTP/2 requests. The body of the responses was discarded, and the HTTP response header fields were stored in a database. We analysed the prevalence of the most important response headers related to web security aspects. In particular, we took into account Strict- Transport-Security, Content-Security-Policy, X-XSS-Protection, X-Frame-Options, Set-Cookie (for session cookies) and X-Content-Type. We also reviewed the contents of response HTTP headers that potentially could reveal unwanted information, like Server (and related headers), Date and Referrer-Policy. This research offers an up-to-date survey of current prevalence of web security policies implemented through HTTP response headers and concludes that most popular sites tend to implement it noticeably more often than less popular ones. Equally, HTTPS sites seem to be far more eager to implement those policies than HTTP only websites. A comparison with previous works show that web security policies based on HTTP response headers are continuously growing, but still far from satisfactory widespread adoption.

Overview

Integrity signals

Registry

Crossref · 10.23919/cycon.2018.8405025

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

1 more claim about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Citations

Cites

Research works printed but not linked: 31

  1. 2016, Subresource Integrity, W3C Recommendation
  2. 0, Content Security Policy 1.0, (CSPl) W3C Working Group Note 19 February 2015 discontinued
  3. 0, Usage of HTTP/2 for websites W3Techs
  4. 2017, Referrer Policy, W3C Candidate Recommendation
  5. 2014, Good Practices for Capability URLs, W3C First Public Working Draft
  6. 2016, Content Security Policy Level 3, (CSP3) W3C Working Draft
  7. 2016, Content Security Policy Level 2, (CSP2) W3C Recommendation
  8. 2011, HTTP State Management Mechanism, IETF Standard RFC 6265
  9. 2015, Public Key Pinning Extension for HTTP, IETF Standard RFC 7469
  10. 2016, Same-Site Cookies, IETF Internet-Draft Standard
  11. king, 2017, Analysis of the Alexa Top 1M sites (June 2017)
  12. 0, Let's encrypt - free ssl/tls certificates
  13. 0, Mozilla HTTP Observatory Website
  14. 0, Mozilla Included CA Certificate List
  15. helme, 2017, I am giving up on HPKP, Blog Post
  16. ristic, 2016, Is HTTP Public Key Pinning dead?, Blog Post
  17. 0, Cisco Umbrella 1 Million
  18. helme, 0, Daily scans of the top one million sites
  19. 0, [IO] Security Headers Website
  20. helme, 2017, Alexa Top 1 Million Analysis - August 2017, Blog Post
  21. 0, Http/2
  22. 0, Httprint web server fingerprinting tool
  23. 2013, HTTP Header Field X-Frame-Options, IETF Informational RFC 7034
  24. 0, Alexa's Top One Million Websites
  25. 0, Mozilla Intermediate Certificates
  26. 0, NMap
  27. 0, Netcraft Site Report
  28. palmer, 2017, Intent to deprecate and remove HPKP, forum post
  29. 0, OWASP Clickjacking Defence Cheat Sheet
  30. 0, Requests HTTP for humans v2 18 4 Python library
  31. prodromou, 2016, Using logs to investigate a web application attack, Blog Post

Cited by

See all 67

Metadata

Authors
Lavrenovs, A., & Melon, F. J. R.
Venue
2018 10th International Conference on Cyber Conflict (CyCon)
Publisher
IEEE
Published
2018-05
Pages
345-370
OpenAlex
W2850153722
Cited by
41
References
7
Citations by year
2026: 6 · 2025: 6 · 2024: 4 · 2023: 7 · 2022: 4 · 2021: 5 · 2020: 6 · 2019: 3
FWCI
2.75
Type
conference paper
Language
en
Open access
closed
Topics
  • Physical Sciences › Computer Science › Information Systems › Web Application Security Vulnerabilities
  • Physical Sciences › Computer Science › Information Systems › Information and Cyber Security
  • Social Sciences › Sociology and Political Science › Privacy, Security, and Data Protection
Keywords
web security, HTTP/2, HTTPS, content security policy, X.509 certificates, popular websites

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.