The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
The Power of Rankings: Quantifying the Effect of Rankings on Online Consumer Search and Purchase Decisions
Open accessAbstract
Online search intermediaries, such as Amazon or Expedia, use rankings (ordered lists) to present third-party sellers’ products to consumers. These rankings decrease consumer search costs and increase the probability of a match with a seller, ultimately increasing consumer welfare. Constructing relevant rankings requires understanding their causal effect on consumer choices. However, this is challenging because rankings are endogenous: consumers pay more attention to highly ranked products, and intermediaries rank the most relevant products at the top. In this paper, I use the first data set with experimental variation in the ranking from a field experiment at Expedia to make three contributions. First, I identify the causal effect of rankings and show that they affect what consumers search, but conditional on search, do not affect purchases. Second, I quantify the effect of rankings using a sequential search model and find an average position effect of $1.92, which is lower than literature estimates obtained without experimental variation. I also use model predictions, data patterns, and a feature of the data set (opaque offers) to show rankings lower search costs, instead of affecting consumer expectations or utility. Finally, I show a utility-based ranking built on this model’s estimates benefits consumers and the search intermediary. Data and the online appendix are available at https://doi.org/10.1287/mksc.2017.1072 .
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, previous research has found that online search engines lower the cost of locating information without affecting expectations or utility for consumers [25,26].”
From Consumer Responses to Generative AI Chatbots Versus Search Engines for Product Evaluation (2025) · cites this paper as [26]
In the citing paper
“The position coefficient on inspection is negative and significant for all LLMs, ranging from -0.0002 to -0.0005 (all ps<0.001;Table 2, left panel), whereas the human benchmark is -0.0019 (p<0.001).”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“AI agents search more deeply than humans and never decline to buy.”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“For Flash and Pro, it is indistinguishable from zero (-0.000014, p=0.338 and -0.000008, p=0.606, respectively).”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“Search depth is marginally lower ( M Alternative = 2.92 vs. M Original = 3.12 ) but remains far above the human benchmark ( M Human = 1.12 ).”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“whereas the human benchmark is -0.0019 (p<0.001).”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“The designs differ in list length: our page shows 100 listings, while impressions in the human benchmark average roughly seven, so the per-rank slope is estimated over a much longer span in our data.”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“Research shows that with hotel search, humans make on average 1.12 clicks and 93% of sessions contain only one click (Ursu 2018).”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“The canonical explanation is that ranking determines which alternatives enter the consideration set while leaving the consumer's valuation of an inspected alternative untouched (Ursu 2018).”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“For human consumers, an effect on the consideration set is an effect on demand, because the consideration set mostly holds one alternative.”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“human consumers who click at least once book 66% of the time and take the outside option 34% of the time”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
Citations
Cites
Discrete Choice Methods with Simulation
Train, K. E. (2001) · doi:10.1017/cbo9780511805271 · Cited by 7,784
Automobile Prices in Market Equilibrium
Berry, S., Levinsohn, J., & Pakes, A. (1995) · Econometrica · doi:10.2307/2171802 · Cited by 4,840
Structural analysis of discrete data with econometric applications
Grether, D. M. (1982) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(82)90042-6 · Cited by 1,928
McFadden, D. L. (1989) · Econometrica · doi:10.2307/1913621 · Cited by 1,627
Optimal Search for the Best Alternative
Weitzman, M. L. (1979) · Econometrica · doi:10.2307/1910412 · Cited by 1,117
Internet Recommendation Systems
Ansari, A., Essegaier, S., & Kohli, R. (2000) · Journal of Marketing Research · doi:10.1509/jmkr.37.3.363.18779 · Cited by 711
An Empirical Analysis of Search Engine Advertising: Sponsored Search in Electronic Markets
Ghose, A., & Yang, S. (2009) · Management Science · doi:10.1287/mnsc.1090.1054 · Cited by 684
Ghose, A., Ipeirotis, P. G., & Li, B. (2012) · Marketing Science · doi:10.1287/mksc.1110.0700 · Cited by 649
Ansari, A., & Mela, C. F. (2003) · Journal of Marketing Research · doi:10.1509/jmkr.40.2.131.19224 · Cited by 639
Hortaçsu, A., & Syverson, C. (2004) · The Quarterly Journal of Economics · doi:10.1162/0033553041382184 · Cited by 593
Research works printed but not linked: 3
- Athey S, Imbens G (2015) Machine learning methods for estimating heterogeneous causal effects. Working paper, Stanford University, Palo Alto, CA, http://arxiv.org/pdf/1504.01132v1.pdf. · arXiv
- Chen Y, 2016, Management Sci., 34, 606
- Hausman J, 1996, The Economics of New Goods, Studies in Income and Wealth, 207
Cited by
Sorted by citations
Items 301–330 of 330
Leszkiewicz, A., Sunder, S., Kumar, V., & Dev, C. S. (2026) · Production and Operations Management · doi:10.1177/10591478261437885
Essais on e-commerce platforms
Cazaubiel, A. (2020) · doi:10.70675/aec9563bz5642z4afezae0az3b17978e894c
Regulation of Digital Platforms : Essays in Industrial Organization
Thébaudin, G. (2023) · theses.fr (ABES) · doi:10.70675/908eb6b6z4ccez4167z950dzf04380881911
Price-Directed Search, Consumer Stickiness, and the Sustainability of CollusionPreprint
Vo, M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6583558
Variety Seeking in High-Frequency Consumption: Implications for Targeted MarketingPreprint
Zhang, F., Lu, C. H., & Lin, Z. (2026) · Research Square · doi:10.21203/rs.3.rs-9407887/v1
Dynamic Effects of Visibility Shocks: Evidence on Demand and Pricing in Digital MarketplacesPreprint
Huang, K.-C., Huang, M.-H., & Tian, T. (2026) · Research Square · doi:10.21203/rs.3.rs-9349904/v1
How rank position and list length shape people’s evaluations
Barnea, U., Moon, A., & Silverman, J. (2022) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2026.104492
Hub-and-Spoke Collusion with Platform Ranking AlgorithmsPreprint
Wang, Z. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6634738
Campbell, F. S., & Moskovitch, Y. (2026) · Proceedings of the ACM on Management of Data · doi:10.1145/3802081
When Location Shapes Choice: Placement Optimization of Substitutable Products
Housni, O. E., & Udwani, R. (2026) · Management Science · doi:10.1287/mnsc.2023.03826
The Singular Effect of Expert Short Recommendation Lists
Mejía, V. D., & Guesmi, S. (2026) · Psychology and Marketing · doi:10.1002/mar.70173
Zheng, Y., Alba, J. W., Hutchinson, J. B., & Hutchinson, J. W. (2026) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-026-01174-0
Tourism Intelligence: Basic Concepts
Neira, C. B., López-Molina, D., & Fernández, J. I. P. (2026) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-83742-171-820261002
Isaac, M. S., Mormann, M. M., & Jain, S. P. (2026) · Journal of Consumer Research · doi:10.1093/jcr/ucag023
The (Agent-Orchestrated) Customer Journey: How AI Agent Optimization is Revolutionizing Branding
Василева, С. (2026) · Proceedings of the ... International Conference on Business Excellence · doi:10.2478/picbe-2026-0035
Promotion Thresholds, Revenue Sharing, and Delivery Risk in Reward-Based Crowdfunding
Laik, J., Gal‐Or, E., & Mirchandani, P. (2026) · Games · doi:10.3390/g17040038
Consumer bias, provider visibility, and ranking algorithms on online platforms
Chen, Y., & Jiang, W. (2026) · International Review of Economics & Finance · doi:10.1016/j.iref.2026.105642
Zheng, C., Zheng, S., Lu, F., Wang, Y., & Dao, C. (2026) · Information Technology and Management · doi:10.1007/s10799-026-00506-4
Rahayu, S., Wedadjati, R. S., Setyadi, B., & Helmi, S. (2026) · Journal of Current Studies in SDGs · doi:10.63230/jocsis.2.2.163
The Welfare Impact of Delegating Choice to Large Language ModelsPreprint
Delaprez, Y., & Hortaçsu, A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6631180
How Online Rankings Shape Purchase Intentions: ERP Evidence from Mobile Shopping
Li, Y., Zhu, W., & Cheng, Q. (2026) · Journal of theoretical and applied electronic commerce research · doi:10.3390/jtaer21080252
Platform Power in News AggregationPreprint
Simonov, A. O., Mikhailov, D., Сергеевич, Е. Р., & Durante, R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7166280
Speed of Intervention in Algorithmic Markets: Controlling Collusion and StabilityPreprint
Haugh, M. B., Caldentey, R. A., & Xie, T. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7265419
The impact of traceability information on consumer purchase behavior in e-commerce platforms
Li, M., Du, R., Burton‐Jones, A., & Xie, J. (2026) · Internet Research · doi:10.1108/intr-08-2025-1158
Adi, Y. S. (2026) · Jurnal Manajemen dan Pemasaran Digital · doi:10.38035/jmpd.v4i3.818
Hero products and the value of position in live streaming commerce evidence from Douyin
Hu, J. (2026) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2026.105072
The Search Orientation Framework: How Consumers Start, Switch, and Stop in AI-Mediated Search
Kyung, E. J., Longoni, C., Ding, Y., & Zhang, E. (2026) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2026.102472
Li, Z., & Zhang, J. (2026) · Social Science Computer Review · doi:10.1177/08944393261497163
Yang, X., Lin, Z., & Cai, Y. (2026) · MIS Quarterly · doi:10.25300/misq/2026/19632
Zhao, B., & Kang, T. (2026) · Asia Pacific Journal of Marketing and Logistics · doi:10.1108/apjml-07-2026-1801
Metadata
- Authors
- Ursu, R. M.
- Affiliations
- New York University (US)
- Corresponding author
- Ursu, Raluca M.
- ORCID
- Ursu, Raluca M.
- Venue
- Marketing Science
- Published
- 2018-08
- Volume
- 37
- Issue
- 4
- Pages
- 530-552
- ISSN
- 0732-2399 (ISSN-L)
- 1526-548X
- OpenAlex
- W3124312273
- Cited by
- 328
- References
- 39
- Citations by year
- 2026: 47 · 2025: 53 · 2024: 57 · 2023: 35 · 2022: 44 · 2021: 35 · 2020: 26 · 2019: 11 · 2018: 12
- FWCI
- 37.64
- Type
- journal article
- Language
- en
- Open access
- Licence
- cc-by-nc-nd
- Locations
- Marketing Science (publishedVersion)
- Knowledge@UChicago (University of Chicago) (submittedVersion, cc-by-nc-nd)
- University of Chicago
- Topics
- Social Sciences › Business, Management and Accounting › Marketing › Consumer Market Behavior and Pricing
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Social Sciences › Business, Management and Accounting › Marketing › Digital Marketing and Social Media
- Keywords
- search engine ranking, consumer search behavior, purchase decision, position effect, search costs, consumer welfare, Expedia, third-party sellers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review