Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 48 of the 51 references it cites were found in a registry or an index; 5 of the 26 sources its claims cite were checked for support.

Measuring Price Discrimination and Steering on E-commerce Web Sites

Hannak, Aniko, Soeller, Gary, Lazer, David, Mislove, Alan, Wilson, Christo · 2014 · Proceedings of the 2014 Conference on Internet Measurement Conference

Abstract

Today, many e-commerce websites personalize their content, including Netflix (movie recommendations), Amazon (product suggestions), and Yelp (business reviews). In many cases, personalization provides advantages for users: for example, when a user searches for an ambiguous query such as ``router,'' Amazon may be able to suggest the woodworking tool instead of the networking device. However, personalization on e-commerce sites may also be used to the user's disadvantage by manipulating the products shown (price steering) or by customizing the prices of products (price discrimination). Unfortunately, today, we lack the tools and techniques necessary to be able to detect such behavior.

Overview

CoChat Summary

TL;DR

Hannak et al. develop a control-based measurement methodology and use 300 real-world users plus synthetic accounts to detect price steering and discrimination on 16 e-commerce sites. They find personalization on nine sites, including members-only hotel discounts, A/B-test steering, mobile-browser steering/discrimination, and history-based reordering.

Key findings

  • Across 16 sites, the authors find evidence of personalization on nine sites (four general retailers and five travel sites); real-world AMT data showed price inconsistencies, e.g., a hotel priced at $565 for the control/comparison but $633 for an AMT user.
  • Cheaptickets and Orbitz showed price discrimination: logged-in users received different prices on ≈5% of hotels, $12 cheaper on average, via “Members Only” reductions. Expedia and Hotels.com used A/B buckets: the clear-cookie treatment was assigned 62% to bucket 1, 21% to bucket 2, 9% to bucket 3, and 7% unknown; bucket 3 users saw >60% different results, while buckets 1 and 2 had higher nDCG values, indicating more expensive hotels near the top.
  • Home Depot and Travelocity personalized for mobile devices: Home Depot served 24 results to desktop/Android but 48 to iOS, steered mobile users toward more expensive products, and discriminated against Android on ≈6% of prices with an average differential of ≈$0.41. Travelocity lowered prices by ≈$15 on ≈5% of hotels for iOS users.
  • Priceline altered hotel search results based on click and purchase history, but the reordering was not correlated with prices and no price discrimination was observed.

Methods

  • Real-world data: 300 Amazon Mechanical Turk users (100 each for retail, hotel, and car experiments) ran searches through a PAC proxy and iframe, forwarding their cookies; the study covered 16 sites (10 general retailers, 6 travel retailers) with 20 searches per site, plus PhantomJS comparison/control searches from the same IP and static DNS.
  • Synthetic experiments: PhantomJS instances with an n+1 control design tested account/cookies, OS/browser User-Agent, and click/purchase history; each ran 20 queries per site per day, spaced one minute apart, with travel purchase history built via no-payment reservations that were later canceled.
  • Analysis used Jaccard index, Kendall’s τ, nDCG, percent of products with inconsistent prices, and average price difference, comparing treatments against controls to separate noise from personalization.

Limitations

  • The paper states the study is limited to US e-commerce sites, US IP addresses, English searches, and US users; it can identify only positive instances of personalization, not absence, and leaves other features such as geolocation, HTTP Referer, browsing history, and purchase history to future work. It also notes unexplained personalization on Newegg and Sears and that experiments were conducted in spring 2014, so results may not hold in the future.
  • The paper states that Expedia and Hotels.com could not be analyzed from the AMT experiment because A/B testing made comparison and control results rarely match; rental car steering was not examined because travel sites present cars in a deterministic grid; and the authors could not infer which specific AMT user characteristics triggered personalization.
  • The text makes evident that Home Depot’s differences may be artifacts of different server-side implementations for desktop and mobile rather than an explicit personalization algorithm, though they still qualify under the paper’s definition; synthetic purchase-history treatments may not embody realistic user behavior but were designed as unambiguous signals.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1145/2663716.2663744

Cites

48 of 48 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

5 Valid · 2 Not valid · 12 Not checked · 107 Own results and interpretations

66 more claims

Create a free account to see all 126 claims and to verify the 5 references still open.

See all claims — free account
  • Probably not a substantial claim. 26
  • It may state two separate claims as one. 35
  • The quote only partly states this claim. 2

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Show all 51 references

Research works printed but not linked: 1

  1. T. Wadhwa . How Advertisers Can Use Your Personal Information to Make You Pay Higher Prices. Huffington Post , 2014 . http://www.huffingtonpost.com/tarun-wadhwa/how-advertisers-can-use-y_b_4703013.html. T. Wadhwa. How Advertisers Can Use Your Personal Information to Make You Pay Higher Prices. Huffington Post, 2014. http://www.huffingtonpost.com/tarun-wadhwa/how-advertisers-can-use-y_b_4703013.html.

Cited by

See all 405

Metadata

Authors
Hannak, A., Soeller, G., Lazer, D., Mislove, A., & Wilson, C.
Affiliations
  • Northeastern University, Boston, MA, USA
  • Northeastern University (US)
Venue
Proceedings of the 2014 Conference on Internet Measurement Conference
Publisher
ACM
Published
2014-11-05
Pages
305-318
OpenAlex
W2161392727
Cited by
405
References
51
Citations by year
2026: 30 · 2025: 57 · 2024: 25 · 2023: 46 · 2022: 36 · 2021: 41 · 2020: 28 · 2019: 34 · 2018: 40 · 2017: 28 · 2016: 25 · 2015: 14 · 2014: 1
FWCI
63.84
Type
conference paper
Language
en
Open access
closed
Locations
ACM Internet Measurement Conference (IMC) (publishedVersion)
Funders
  • National Science Foundation (CHS- 1408345)
  • Division of Computer and Network Systems (CNS-1054233)
  • Amazon Web Services in Education
  • Army Research Office (W911NF-12-1-0556)
Topics
  • Social Sciences › Business, Management and Accounting › Marketing › Consumer Market Behavior and Pricing
  • Physical Sciences › Computer Science › Information Systems › Web Data Mining and Analysis
  • Social Sciences › Sociology and Political Science › Privacy, Security, and Data Protection
Keywords
price discrimination, e-commerce personalization, recommender systems, personalized pricing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-07, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-07 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Measuring Price Discrimination and Steering on E-commerce Web Sites. https://app.cochat.ai/papers/10.1145/2663716.2663744
The paper
Hannak, A., Soeller, G., Lazer, D., Mislove, A., & Wilson, C. (2014). Measuring Price Discrimination and Steering on E-commerce Web Sites. Proceedings of the 2014 Conference on Internet Measurement Conference. https://doi.org/10.1145/2663716.2663744

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.