The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
The Power of Rankings: Quantifying the Effect of Rankings on Online Consumer Search and Purchase Decisions
Open accessAbstract
Online search intermediaries, such as Amazon or Expedia, use rankings (ordered lists) to present third-party sellers’ products to consumers. These rankings decrease consumer search costs and increase the probability of a match with a seller, ultimately increasing consumer welfare. Constructing relevant rankings requires understanding their causal effect on consumer choices. However, this is challenging because rankings are endogenous: consumers pay more attention to highly ranked products, and intermediaries rank the most relevant products at the top. In this paper, I use the first data set with experimental variation in the ranking from a field experiment at Expedia to make three contributions. First, I identify the causal effect of rankings and show that they affect what consumers search, but conditional on search, do not affect purchases. Second, I quantify the effect of rankings using a sequential search model and find an average position effect of $1.92, which is lower than literature estimates obtained without experimental variation. I also use model predictions, data patterns, and a feature of the data set (opaque offers) to show rankings lower search costs, instead of affecting consumer expectations or utility. Finally, I show a utility-based ranking built on this model’s estimates benefits consumers and the search intermediary. Data and the online appendix are available at https://doi.org/10.1287/mksc.2017.1072 .
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For example, previous research has found that online search engines lower the cost of locating information without affecting expectations or utility for consumers [25,26].”
From Consumer Responses to Generative AI Chatbots Versus Search Engines for Product Evaluation (2025) · cites this paper as [26]
In the citing paper
“The position coefficient on inspection is negative and significant for all LLMs, ranging from -0.0002 to -0.0005 (all ps<0.001;Table 2, left panel), whereas the human benchmark is -0.0019 (p<0.001).”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“AI agents search more deeply than humans and never decline to buy.”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“For Flash and Pro, it is indistinguishable from zero (-0.000014, p=0.338 and -0.000008, p=0.606, respectively).”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“Search depth is marginally lower ( M Alternative = 2.92 vs. M Original = 3.12 ) but remains far above the human benchmark ( M Human = 1.12 ).”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“whereas the human benchmark is -0.0019 (p<0.001).”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“The designs differ in list length: our page shows 100 listings, while impressions in the human benchmark average roughly seven, so the per-rank slope is estimated over a much longer span in our data.”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“Research shows that with hotel search, humans make on average 1.12 clicks and 93% of sessions contain only one click (Ursu 2018).”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“The canonical explanation is that ranking determines which alternatives enter the consideration set while leaving the consumer's valuation of an inspected alternative untouched (Ursu 2018).”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“For human consumers, an effect on the consideration set is an effect on demand, because the consideration set mostly holds one alternative.”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
In the citing paper
“human consumers who click at least once book 66% of the time and take the outside option 34% of the time”
From Does Rank Still Matter? Position Bias When AI Agents Shop on Our Behalf (2026) · cites this paper as Ursu 2018
Citations
Cites
Discrete Choice Methods with Simulation
Train, K. E. (2001) · doi:10.1017/cbo9780511805271 · Cited by 7,784
Automobile Prices in Market Equilibrium
Berry, S., Levinsohn, J., & Pakes, A. (1995) · Econometrica · doi:10.2307/2171802 · Cited by 4,840
Structural analysis of discrete data with econometric applications
Grether, D. M. (1982) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(82)90042-6 · Cited by 1,928
McFadden, D. L. (1989) · Econometrica · doi:10.2307/1913621 · Cited by 1,627
Optimal Search for the Best Alternative
Weitzman, M. L. (1979) · Econometrica · doi:10.2307/1910412 · Cited by 1,117
Internet Recommendation Systems
Ansari, A., Essegaier, S., & Kohli, R. (2000) · Journal of Marketing Research · doi:10.1509/jmkr.37.3.363.18779 · Cited by 711
An Empirical Analysis of Search Engine Advertising: Sponsored Search in Electronic Markets
Ghose, A., & Yang, S. (2009) · Management Science · doi:10.1287/mnsc.1090.1054 · Cited by 684
Ghose, A., Ipeirotis, P. G., & Li, B. (2012) · Marketing Science · doi:10.1287/mksc.1110.0700 · Cited by 649
Ansari, A., & Mela, C. F. (2003) · Journal of Marketing Research · doi:10.1509/jmkr.40.2.131.19224 · Cited by 639
Hortaçsu, A., & Syverson, C. (2004) · The Quarterly Journal of Economics · doi:10.1162/0033553041382184 · Cited by 593
How Is the Mobile Internet Different? Search Costs and Local Activities
Ghose, A., Avi Goldfarb, B., & Han, S. P. (2012) · Information Systems Research · doi:10.1287/isre.1120.0453 · Cited by 530
Yang, S., & Ghose, A. (2010) · Marketing science (Providence, R.I.) · doi:10.1287/mksc.1090.0552 · Cited by 403
Consumer Heterogeneity and Paid Search Effectiveness: A Large-Scale Field Experiment
Blake, T., Nosko, C., & Tadelis, S. (2015) · Econometrica · doi:10.3982/ecta12423 · Cited by 371
Location, Location, Location: An Analysis of Profitability of Position in Online Advertising Markets
Agarwal, A., Hosanagar, K., & Smith, M. D. (2011) · Journal of Marketing Research · doi:10.1509/jmr.08.0468 · Cited by 364
Position Auctions with Consumer Search
Athey, S. C., & Ellison, G. (2011) · The Quarterly Journal of Economics · doi:10.1093/qje/qjr028 · Cited by 352
Response Modeling with Nonrandom Marketing-Mix Variables
Manchanda, P., Rossi, P. E., & Chintagunta, P. K. (2004) · Journal of Marketing Research · doi:10.1509/jmkr.41.4.467.47005 · Cited by 324
Quantifying search and switching costs in the US auto insurance industry
Honka, E. (2014) · The RAND Journal of Economics · doi:10.1111/1756-2171.12073 · Cited by 303
Why do intermediaries divert search?
Hagiu, A., & Jullien, B. (2011) · The RAND Journal of Economics · doi:10.1111/j.1756-2171.2011.00136.x · Cited by 300
Examining the Impact of Ranking on Consumer Behavior and Search Engine Revenue
Ghose, A., Ipeirotis, P. G., & Li, B. (2014) · Management Science · doi:10.1287/mnsc.2013.1828 · Cited by 299
Online Demand Under Limited Consumer Search
Kim, J. B., Albuquerque, P., & Bronnenberg, B. J. (2010) · Marketing Science · doi:10.1287/mksc.1100.0574 · Cited by 293
A Dynamic Model of Sponsored Search Advertising
Yao, S., & Mela, C. F. (2011) · Marketing Science · doi:10.1287/mksc.1100.0626 · Cited by 246
The Role of Search Engine Optimization in Search Marketing
Berman, R., & Katona, Z. (2013) · Marketing Science · doi:10.1287/mksc.2013.0783 · Cited by 243
Revenue Management's Renaissance
Cross, R. G., Higbie, J. A., & Cross, D. Q. (2008) · Cornell Hospitality Quarterly · doi:10.1177/1938965508328716 · Cited by 215
Simultaneous or Sequential? Search Strategies in the U.S. Auto Insurance Industry
Honka, E., & Chintagunta, P. K. (2013) · Marketing Science · doi:10.1287/mksc.2016.0995 · Cited by 166
A Latent Instrumental Variables Approach to Modeling Keyword Conversion in Paid Search Advertising
Rutz, O. J., Bucklin, R. E., & Sonnier, G. P. (2012) · Journal of Marketing Research · doi:10.1509/jmr.10.0354 · Cited by 165
Search for differentiated products: identification and estimation
Koulayev, S. (2014) · The RAND Journal of Economics · doi:10.1111/1756-2171.12062 · Cited by 164
Position Effects in Search Advertising and their Moderators: A Regression Discontinuity Approach
Narayanan, S., & Kalyanam, K. (2015) · Marketing Science · doi:10.1287/mksc.2014.0893 · Cited by 157
A “Position Paradox” in Sponsored Search Auctions
Jerath, K., Ma, L., Park, Y., & Srinivasan, K. (2011) · Marketing Science · doi:10.1287/mksc.1110.0645 · Cited by 145
What Makes Them Click: Empirical Analysis of Consumer Demand for Search Advertising
Jeziorski, P., & Segal, I. (2015) · American Economic Journal Microeconomics · doi:10.1257/mic.20100119 · Cited by 141
Assessing Sale Strategies in Online Markets Using Matched Listings
Liran Einav, B., Kuchler, T., Levin, J., & Sundaresan, N. (2015) · American Economic Journal Microeconomics · doi:10.1257/mic.20130046 · Cited by 126
Optimizing Click-Through in Online Rankings with Endogenous Search Refinement
Santos, B. D. L., & Koulayev, S. (2017) · Marketing Science · doi:10.1287/mksc.2017.1036 · Cited by 120
The Probit Choice Model Under Sequential Search with an Application to Online Retailing
Kim, J. B., Albuquerque, P., & Bronnenberg, B. J. (2016) · Management Science · doi:10.1287/mnsc.2016.2545 · Cited by 81
Consumer Search Activities and the Value of Ad Positions in Sponsored Search Advertising
Chan, T. Y., & Park, Y. (2015) · Marketing Science · doi:10.1287/mksc.2015.0903 · Cited by 67
Big Data and Marketing Analytics in Gaming: Combining Empirical Models and Field Experimentation
Nair, H. S., Misra, S., Hornbuckle, W. J., Mishra, R., & Acharya, A. (2017) · Marketing Science · doi:10.1287/mksc.2017.1039 · Cited by 59
Advertiser Prominence Effects in Search Advertising
Jeziorski, P., & Moorthy, S. (2017) · Management Science · doi:10.1287/mnsc.2016.2677 · Cited by 59
Hotel revenue management: Principles and practices
Crossan, M. (2014) · Journal of Revenue and Pricing Management · doi:10.1057/rpm.2014.5 · Cited by 55
What’s in a name? Measuring prominence and its impact on organic traffic from search engines
Baye, M. R., Santos, B. D. L., & Wildenbeest, M. R. (2016) · Information Economics and Policy · doi:10.1016/j.infoecopol.2016.01.002 · Cited by 29
Online Marketplace AdvertisingPreprint
Choi, H., & Mela, C. F. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2839802 · Cited by 4
Quality Provision in the Presence of a Biased IntermediaryPreprint
de Cornière, A., & Taylor, G. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2506341 · Cited by 4
Research works printed but not linked: 3
- Athey S, Imbens G (2015) Machine learning methods for estimating heterogeneous causal effects. Working paper, Stanford University, Palo Alto, CA, http://arxiv.org/pdf/1504.01132v1.pdf. · arXiv
- Chen Y, 2016, Management Sci., 34, 606
- Hausman J, 1996, The Economics of New Goods, Studies in Income and Wealth, 207
Cited by
Sorted by citations
Chen, Y., & Yao, S. (2012) · Management Science · doi:10.1287/mnsc.2016.2557 · Cited by 179
Search Personalization Using Machine Learning
Yoganarasimhan, H. (2019) · Management Science · doi:10.1287/mnsc.2018.3255 · Cited by 171
Zhang, J., Adomavičius, G., Gupta, A., & Ketter, W. (2020) · Information Systems Research · doi:10.1287/isre.2019.0876 · Cited by 132
Armstrong, M. (2017) · Journal of the European Economic Association · doi:10.1093/jeea/jvx017 · Cited by 117
Online Reviews: Star Ratings, Position Effects and Purchase Likelihood
Vana, P., & Lambrecht, A. (2018) · Marketing Science · doi:10.1287/mksc.2020.1278 · Cited by 115
Metadata
- Authors
- Ursu, R. M.
- Affiliations
- New York University (US)
- Corresponding author
- Ursu, Raluca M.
- ORCID
- Ursu, Raluca M.
- Venue
- Marketing Science
- Published
- 2018-08
- Volume
- 37
- Issue
- 4
- Pages
- 530-552
- ISSN
- 0732-2399 (ISSN-L)
- 1526-548X
- OpenAlex
- W3124312273
- Cited by
- 328
- References
- 39
- Citations by year
- 2026: 47 · 2025: 53 · 2024: 57 · 2023: 35 · 2022: 44 · 2021: 35 · 2020: 26 · 2019: 11 · 2018: 12
- FWCI
- 37.64
- Type
- journal article
- Language
- en
- Open access
- Licence
- cc-by-nc-nd
- Locations
- Marketing Science (publishedVersion)
- Knowledge@UChicago (University of Chicago) (submittedVersion, cc-by-nc-nd)
- University of Chicago
- Topics
- Social Sciences › Business, Management and Accounting › Marketing › Consumer Market Behavior and Pricing
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Social Sciences › Business, Management and Accounting › Marketing › Digital Marketing and Social Media
- Keywords
- search engine ranking, consumer search behavior, purchase decision, position effect, search costs, consumer welfare, Expedia, third-party sellers
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review