The DOI matches its Crossref record; 87 of the 87 references it cites were found in a registry or an index.
Accurately measuring willingness to pay for consumer goods: a meta-analysis of the hypothetical bias
Open accessAbstract
Consumers’ willingness to pay (WTP) is highly relevant to managers and academics, and the various direct and indirect methods used to measure it vary in their accuracy, defined as how closely the hypothetically measured WTP (HWTP) matches consumers’ real WTP (RWTP). The difference between HWTP and RWTP is the “hypothetical bias.” A prevalent assumption in marketing science is that indirect methods measure WTP more accurately than do direct methods. With a meta-analysis of 77 studies reported in 47 papers and resulting in 115 effect sizes, we test that assumption by assessing the hypothetical bias. The total sample consists of 24,347 included observations for HWTP and 20,656 for RWTP. Moving beyond extant meta-analyses in marketing, we introduce an effect size metric (i.e., response ratio) and a novel analysis method (i.e., multivariate mixed linear model) to analyze the stochastically dependent effect sizes. Our findings are relevant for academic researchers and managers. First, on average, the hypothetical bias is 21%, and this study provides a reference point for the expected magnitude of the hypothetical bias. Second, the deviation primarily depends on the use of a direct or indirect method for measuring HWTP. In contrast with conventional wisdom, indirect methods actually overestimate RWTP significantly stronger than direct methods. Third, the hypothetical bias is greater for higher valued products, specialty goods (cf. other product types), and within-subject designs (cf. between-subject designs), thus a stronger downward adjustment of HWTP values is necessary to reflect consumers’ RWTP.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1994) · Journal of the American Dietetic Association · doi:10.1016/0002-8223(94)92216-0 · Cited by 45,910
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen, P., Cohen, P., West, S. G., & Aiken, L. S. (2014) · Psychology Press eBooks · doi:10.4324/9781410606266 · Cited by 20,737
Conducting Meta-Analyses in R with the metafor Package
Viechtbauer, W. (2010) · Journal of Statistical Software · doi:10.18637/jss.v036.i03 · Cited by 20,464
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009) · doi:10.1002/9780470743386 · Cited by 14,225
Multimodel Inference: Understanding AIC and BIC in Model Selection
Burnham, K. P., & Anderson, D. R. (2004) · Sociological Methods & Research · doi:10.1177/0049124104268644 · Cited by 11,648
Cicchetti, D. V. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.4.284 · Cited by 9,349
COUNTERSPECULATION, AUCTIONS, AND COMPETITIVE SEALED TENDERS
Vickrey, W. (1961) · The Journal of Finance · doi:10.1111/j.1540-6261.1961.tb02789.x · Cited by 7,722
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences.
Henry, N. W., Cohen, J., & Cohen, P. (1977) · Contemporary Sociology · doi:10.2307/2064799 · Cited by 7,089
The meta-analysis of response ratios in experimental ecology
Hedges, L. V., Gurevitch, J., & Curtis, P. S. (1999) · Ecology · doi:10.1890/0012-9658(1999)080[1150:tmaorr]2.0.co;2 · Cited by 4,704 · cited 13×
“Y es D is ci pl in e E co no m ic s D um m y va ri ab le (m ar ke tin g = 1) C or re sp on di ng re se ar ch di sc ip lin e M ar ke tin g C ita tio ns M et ri c va ri ab le N um be r of ci ta tio ns in G oo gl e S ch ol ar Ye ar M et ri c va ri ab le Y ea r th e st ud y w as pu bl is he d M od er at or s in ita lic s…”
BackgroundMethodInfluentialComputing Inter-Rater Reliability for Observational Data: An Overview and Tutorial
Hallgren, K. A. (2012) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.08.1.p023 · Cited by 3,884
Measuring utility by a single-response sequential method
Becker, G. M., Degroot, M. H., & Marschak, J. (1964) · Behavioral Science · doi:10.1002/bs.3830090304 · Cited by 2,640
Morris, S. B., & DeShon, R. P. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.105 · Cited by 2,502
Generalized Collinearity Diagnostics
Fox, J., & Monette, G. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10475190 · Cited by 1,881
Advanced methods in meta‐analysis: multivariate approach and meta‐regression
van Houwelingen, H. C., Arends, L. R., & Stijnen, T. (2002) · Statistics in Medicine · doi:10.1002/sim.1040 · Cited by 1,580
(2010) · The RAND Journal of Economics · doi:10.1111/(issn)1756-2171 · Cited by 1,574
Measuring Utility by a Single-Response Sequential Method (1964)
Becker, G. M., & DeGroot, M. H. (1974) · Economic Information, Decision, and Prediction · doi:10.1007/978-94-010-9276-0_16 · Cited by 1,540
Experimental methods: Between-subject and within-subject design
Charness, G., Gneezy, U., & Kuhn, M. A. (2012) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2011.08.009 · Cited by 1,469 · cited 2×
“In particular, the subject design of an experiment determines the results, in the sense that between-subject designs tend to be more conservative (Charness et al. 2012), whereas within-subject designs tend to result in stronger effects (Ariely et al. 2006).”
Result"Coherent Arbitrariness": Stable Demand Curves Without Stable Preferences
Ariely, D., Loewenstein, G., & Prelec, D. (2003) · The Quarterly Journal of Economics · doi:10.1162/00335530360535153 · Cited by 1,452
Three-level meta-analysis of dependent effect sizes
Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2013) · Behavior Research Methods · doi:10.3758/s13428-012-0261-6 · Cited by 1,130 · cited 3×
“…instead of the multivariate mixed linear model, we used a random-effects, three-level model, such that the ES measures nested within studies with a V-known model at the lowest level (Bijmolt and Pieters 2001; van den Noortgate et al. 2013), which can account for dependence between observations.”
MethodA Meta-analysis of Hypothetical Bias in Stated Preference Valuation
Murphy, J. J., Allen, P. G., Stevens, T. H., & Weatherhead, D. (2005) · Environmental & Resource Economics · doi:10.1007/s10640-004-3332-z · Cited by 1,092
Babić Rosario, A., Sotgiu, F., De Valck, K., & Bijmolt, T. H. A. (2016) · Journal of Marketing Research · doi:10.1509/jmr.14.0380 · Cited by 1,073
Self-citationCan There Ever Be Too Many Options? A Meta-Analytic Review of Choice Overload
Scheibehenne, B., Greifeneder, R., & Todd, P. M. (2010) · Journal of Consumer Research · doi:10.1086/651235 · Cited by 1,070 · cited 1×
“When the differences stem from a comparison of a treatment and a control group, standardized mean differences (SMD) are appropriate measures (e.g. Abraham and Hamilton 2018; Scheibehenne et al. 2010).”
MethodAmbiguity Aversion and Comparative Ignorance
Fox, C. R., & Tversky, A. (1995) · The Quarterly Journal of Economics · doi:10.2307/2946693 · Cited by 1,022
What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?
List, J. A., & Gallet, C. A. (2001) · Environmental and Resource Economics · doi:10.1023/a:1012791822804 · Cited by 1,001
Are Choice Experiments Incentive Compatible? A Test with Quality Differentiated Beef Steaks
Lusk, J. L., & Schroeder, T. C. (2004) · American Journal of Agricultural Economics · doi:10.1111/j.0092-5853.2004.00592.x · Cited by 809
A REVIEW OF METHODS FOR MEASURING WILLINGNESS-TO-PAY
Breidert, C., Hahsler, M., & Reutterer, T. (2006) · WU Research · Cited by 754
Measuring Consumers' Willingness to Pay at the Point of Purchase
Wertenbroch, K., & Skiera, B. (2002) · Journal of Marketing Research · doi:10.1509/jmkr.39.2.228.19086 · Cited by 742
On Product Uncertainty in Online Markets: Theory and Evidence1
Dimoka, A., Hong, Y., & Pavlou, P. A. (2012) · MIS Quarterly · doi:10.2307/41703461 · Cited by 682
Ambiguity Aversion and Comparative Ignorance
Fox, C. R., & Tversky, A. (2000) · Choices, Values, and Frames · doi:10.1017/cbo9780511803475.031 · Cited by 670
Arts, J. W. C., Frambach, R. T., & Bijmolt, T. H. A. (2011) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2010.11.002 · Cited by 567
Self-citationMeasuring Preferences for Really New Products
Hoeffler, S. (2003) · Journal of Marketing Research · doi:10.1509/jmkr.40.4.406.19394 · Cited by 551
Carson, R. T., Flores, N. E., Martin, K., Wright, J. L., Carson, R. T., Flores, N. E., Martin, K. M., & Wright, J. L. (1995) · RePEc: Research Papers in Economics · doi:10.22004/ag.econ.148793 · Cited by 534
Hypothetical bias, choice experiments and willingness to pay
Hensher, D. A. (2010) · Transportation Research Part B: Methodological · doi:10.1016/j.trb.2009.12.012 · Cited by 527
Journal of the Academy of Marketing Science, 2000 to 2003
Varadarajan, P. R. (2003) · Journal of the Academy of Marketing Science · doi:10.1177/00920703030314001 · Cited by 507
Relation of Consumers' Buying Habits to Marketing Methods
Copeland, M. T. (1923) · Harvard business review · Cited by 500
Stochastically dependent effect sizes.
Gleser, L. J., & Olkin, I. (1994) · Cited by 485
Carson, R. T., Flores, N. E., Martin, K. M., & Wright, J. L. (1996) · Land Economics · doi:10.2307/3147159 · Cited by 469
Uses and misuses of meta‐analysis in plant ecology
Koricheva, J., & Gurevitch, J. (2014) · Journal of Ecology · doi:10.1111/1365-2745.12224 · Cited by 460
Kagel, J. H., Harstad, R. M., & Levin, D. (2009) · Common Value Auctions and the Winner's Curse · doi:10.1515/9781400830138.177 · Cited by 458
Miller, K. M., Hofstetter, R., Krohmer, H., & Zhang, Z. J. (2011) · Journal of Marketing Research · doi:10.1509/jmkr.48.1.172 · Cited by 441
New Empirical Generalizations on the Determinants of Price Elasticity
Bijmolt, T. H. A., Van Heerde, H. J., & Pieters, R. G. M. (2005) · Journal of Marketing Research · doi:10.1509/jmkr.42.2.141.62296 · Cited by 440
Self-citationCustomer Value Assessment in Business Markets: A State-of-Practice Study
Anderson, J. C., Jain, D. C., & Chintagunta, P. K. (1992) · Journal of Business-to-Business Marketing · doi:10.1300/j033v01n01_02 · Cited by 440
On the meta-analysis of response ratios for studies with correlated and multi-group designs
Lajeunesse, M. J. (2011) · Ecology · doi:10.1890/11-0423.1 · Cited by 432
Kagel, J. H., Harstad, R. M., & Levin, D. (1987) · Econometrica · doi:10.2307/1913557 · Cited by 399
Lilien, G. L. (2016) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2016.01.003 · Cited by 379
Which Response Format Reveals the Truth about Donations to a Public Good?
Brown, T. C., Champ, P. A., Bishop, R. C., & McCollum, D. W. (1996) · Land Economics · doi:10.2307/3146963 · Cited by 368
Hypothetical Surveys and Real Economic Commitments
Neill, H. R., Cummings, R. G., Ganderton, P. T., Harrison, G. W., & McGuckin, T. (1994) · Land Economics · doi:10.2307/3146318 · Cited by 349
Incentive-Aligned Conjoint Analysis
Ding, M., Grewal, R., & Liechty, J. (2005) · Journal of Marketing Research · doi:10.1509/jmkr.42.1.67.56890 · Cited by 329
Ockenfels, A., & Roth, A. E. (2006) · Games and Economic Behavior · doi:10.1016/j.geb.2005.02.010 · Cited by 325
The Showrooming Phenomenon: It's More than Just about Price
Gensler, S., Neslin, S. A., & Verhoef, P. C. (2017) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2017.01.003 · Cited by 321
The Role of the Beneficiary in Willingness to Pay for Socially Responsible Products: A Meta-analysis
Tully, S. M., & Winer, R. S. (2014) · Journal of Retailing · doi:10.1016/j.jretai.2014.03.004 · Cited by 294
Meta-Analysis in Marketing when Studies Contain Multiple Measurements
Bijmolt, T. H. A., & Pieters, R. G. M. (2001) · Marketing Letters · doi:10.1023/a:1011117103381 · Cited by 293
Self-citationShogren, J. F., Margolis, M., Koo, C., & List, J. A. (2001) · Journal of Economic Behavior & Organization · doi:10.1016/s0167-2681(01)00165-2 · Cited by 286
Miller, K. M., Hofstetter, R., Krohmer, H., & Zhang, Z. J. (2011) · SSRN Electronic Journal · Cited by 253
The Strategy and Tactics of Pricing: A Guide to Growing More Profitably
Nagle, T. T., & Müller, G. (2017) · Routledge eBooks · doi:10.4324/9781315185309 · Cited by 235
Revealing consumers' willingness-to-pay: A comparison of the BDM mechanism and the Vickrey auction
Noussair, C., Robin, S., & Ruffieux, B. (2004) · Journal of Economic Psychology · doi:10.1016/j.joep.2003.06.004 · Cited by 234
A multivariate mixed linear model for meta-analysis.
Kalaian, H. A., & Raudenbush, S. W. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.3.227 · Cited by 229
Tom Sawyer and the construction of value
Ariely, D., Loewenstein, G., & Prelec, D. (2006) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2004.10.003 · Cited by 228
Meta-analysis: integrating accumulated knowledge
Grewal, D., Puccinelli, N., & Monroe, K. B. (2018) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-017-0570-5 · Cited by 227
An Experimental Analysis of Ending Rules in Internet Auctions
Ariely, D., Ockenfels, A., & Roth, A. E. (2003) · SSRN Electronic Journal · doi:10.2139/ssrn.429963 · Cited by 226
An Incentive-Aligned Mechanism for Conjoint Analysis
Ding, M. (2007) · Journal of Marketing Research · doi:10.1509/jmkr.44.2.214 · Cited by 223
Experimental Evidence on the Existence of Hypothetical Bias in Value Elicitation Methods
Harrison, G. W., & Rutström, E. E. (2008) · Handbook of experimental economics results · Cited by 209
Power pricing: how managing price transforms the bottom line
(1997) · Choice Reviews Online · doi:10.5860/choice.35-0371 · Cited by 197
Home-grown values and incentive compatible auction design
Rutström, E. E. (1998) · International Journal of Game Theory · doi:10.1007/s001820050082 · Cited by 196
Augmenting Conjoint Analysis to Estimate Consumer Reservation Price
Jedidi, K., & Zhang, Z. J. (2002) · Management Science · doi:10.1287/mnsc.48.10.1350.272 · Cited by 195
Further tests of entreaties to avoid hypothetical bias in referendum contingent valuation
Brown, T. C., Ajzen, I., & Hrubes, D. (2003) · Journal of Environmental Economics and Management · doi:10.1016/s0095-0696(02)00041-4 · Cited by 167
Marketing's Impact on Firm Value: Generalizations from a Meta-Analysis
Edeling, A., & Fischer, M. (2016) · Journal of Marketing Research · doi:10.1509/jmr.14.0046 · Cited by 166
Scope (in)sensitivity in elicited valuations
Frederick, S., & Fischhoff, B. (1998) · Risk Decision and Policy · doi:10.1080/135753098348239 · Cited by 163
Pavlovian Processes in Consumer Choice: The Physical Presence of a Good Increases Willingness-to-Pay
Bushong, B., King, L. M., Camerer, C. F., & Rangel, A. (2010) · American Economic Review · doi:10.1257/aer.100.4.1556 · Cited by 157
Reservation Price as a Range: An Incentive-Compatible Measurement Approach
Wang, T., Venkatesh, R., & Chatterjee, R. (2007) · Journal of Marketing Research · doi:10.1509/jmkr.44.2.200 · Cited by 148
Edeling, A., & Himme, A. (2018) · Journal of Marketing · doi:10.1509/jm.16.0250 · Cited by 137
Reliability and Validity of Conjoint Analysis and Self-Explicated Weights: A Comparison
Leigh, T. W., MacKay, D. B., & Summers, J. O. (1984) · Journal of Marketing Research · doi:10.1177/002224378402100410 · Cited by 129
Ingenbleek, P. T. M., Frambach, R. T., & Verhallen, T. M. M. (2013) · Journal of Product Innovation Management · doi:10.1111/jpim.12008 · Cited by 106
Measuring Consumer Willingness to Pay at the Point of PurchasePreprint
Wertenbroch, K., & Skiera, B. (2001) · SSRN Electronic Journal · Cited by 104
Willingness to Pay: Measurement and Managerial Implications
Jedidi, K., & Jagpal, S. (2009) · Edward Elgar Publishing eBooks · doi:10.4337/9781848447448.00010 · Cited by 79
Indifference Curves that Travel with the Choice Set
Drolet, A. L., Simonson, I., & Tversky, A. (2000) · Marketing Letters · doi:10.1023/a:1008198925117 · Cited by 71
Methoden zur Messung individueller Zahlungsbereitschaften: Ein Überblick zum State of the Art
Völckner, F. (2006) · Journal für Betriebswirtschaft · doi:10.1007/s11301-006-0002-y · Cited by 63
When Does Partitioned Pricing Lead to More Favorable Consumer Preferences?: Meta-Analytic Evidence
Abraham, A. T., & Hamilton, R. W. (2018) · Journal of Marketing Research · doi:10.1177/0022243718800724 · Cited by 53
Pebsworth, P. A., MacIntosh, A. J. J., Morgan, H. R., & Huffman, M. A. (2012) · International Journal of Primatology · doi:10.1007/s10764-012-9620-5 · Cited by 49
Do customized service packages impede value capture in industrial markets?
Steiner, M., Eggert, A., Ulaga, W., & Backhaus, K. (2014) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-014-0410-9 · Cited by 47
Hofstetter, R., Miller, K. M., Krohmer, H., & Zhang, Z. J. (2013) · Journal of Product Innovation Management · doi:10.1111/jpim.12040 · Cited by 42
Bolton, G. E., & Ockenfels, A. (2013) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2013.11.003 · Cited by 41
Sichtmann, C., Wilken, R., & Diamantopoulos, A. (2010) · British Journal of Management · doi:10.1111/j.1467-8551.2010.00696.x · Cited by 39
Vickrey vs. eBay: Why Second-Price Sealed-Bid Auctions Lead to More Realistic Price-Demand Functions
Barrot, C., Albers, S., Skiera, B., & Schäfers, B. (2010) · International Journal of Electronic Commerce · doi:10.2753/jec1086-4415140401 · Cited by 30
When Does Partitioned Pricing Lead to More Favorable Consumer Preferences? Meta-Analytic Evidence
Abraham, A. T., & Hamilton, R. W. (2018) · Journal of Marketing Research · doi:10.1509/jmr.14.0567 · Cited by 13
Borah, A., Wang, X., & Ryoo, J. H. (2018) · Customer Needs and Solutions · doi:10.1007/s40547-018-0089-z · Cited by 6
Explaining heterogeneity in meta-analysis: a comparison of methods
Thompson, S. G., & Sharp, S. J. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19991030)18:20
Cited by
Wong, L. P., Alias, H., Wong, P.-F., Lee, H. Y., & AbuBakar, S. (2020) · Human Vaccines & Immunotherapeutics · doi:10.1080/21645515.2020.1790279 · Cited by 814
Understanding COVID-19 vaccine demand and hesitancy: A nationwide online survey in China
Lin, Y., Hu, Z., Zhao, Q., Alias, H., Danaee, M., & Wong, L. P. (2020) · PLOS Neglected Tropical Diseases · doi:10.1371/journal.pntd.0008961 · Cited by 688
Kumar, A., Prakash, G., & Kumar, G. (2021) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2020.102270 · Cited by 414
Social interactions in the metaverse: Framework, initial evidence, and research roadmap
Hennig-Thurau, T., Aliman, D. N., Herting, A. M., Cziehso, G. P., Linder, M., & Kübler, R. V. (2023) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-022-00908-0 · Cited by 411
The Potential of Generative AI for Personalized Persuasion at Scale
Matz, S., Teeny, J., Vaid, S. S., Peters, H., Harari, G. M., & Cerf, M. (2023) · doi:10.31234/osf.io/rn97c · Cited by 312
Metadata
- Authors
- Schmidt, J., & Bijmolt, T. H. A.
- Venue
- Journal of the Academy of Marketing Science
- Published
- 2019-06-07
- Volume
- 48
- Issue
- 3
- Pages
- 499-518
- ISSN
- 0092-0703 (ISSN-L)
- 1552-7824
- OpenAlex
- W2947920467
- Cited by
- 285
- References
- 87
- FWCI
- 9.22
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.