The DOI matches its Crossref record; 91 of the 91 references it cites were found in a registry or an index.
Understanding Hypothetical Bias: An Enhanced Meta‐Analysis
Abstract
The presence of hypothetical bias (HB) associated with stated preference methods has garnered frequent attention in the broad literature trying to describe and understand human behavior, often seen in environmental valuation, marketing studies, transportation choices, medical research, and others. This study presents an updated meta‐analysis to explore the source of HB and methods to mitigate it. While previous meta‐analysis on this topic often involves a few dozen articles, this analysis includes 131 studies after reviewing over 500 published and unpublished articles. This enables the inclusion of several important factors that have not been investigated before. These include relatively recent willingness to pay elicitation methods such as choice experiments and the Turnbull lower bound estimator. Newly emerged HB reduction techniques such as consequentiality and certainty follow‐up treatments are also included. For explanatory variables that have been examined in previous studies, this analysis does not always report consistent findings. In particular, holding everything constant and contrary to commonly‐held beliefs, the method of auction does not offer much reduction to HB compared to more conventional methods such as a referendum vote. However, choice experiment, cheap talk, consequentiality and certainty follow‐up all significantly contributed to explaining and mitigating the magnitude of HB. These results help practitioners to understand HB's presence and choose appropriate methods for amelioration. The framework established through this study also enables future analyses targeted at understanding variations built upon one or multiple HB mitigation techniques.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using surveys to value public goods: the contingent valuation method
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0417 · Cited by 4,215
Report of NOAA Panel on Contingent Valuation
Arrow, K. J. (1993) · Compact disc federal register/Federal law on disc. Federal register/Federal register · Cited by 1,929
Using Surveys to Value Public Goods: The Contingent Valuation Method
Randall, A., Mitchell, R. C., & Carson, R. T. (1990) · Land Economics · doi:10.2307/3146688 · Cited by 1,549
Combining Revealed and Stated Preference Methods for Valuing Environmental Amenities
Adamowicz, W., Louviere, J., & Williams, M. (1994) · Journal of Environmental Economics and Management · doi:10.1006/jeem.1994.1017 · Cited by 1,474
Incentive and informational properties of preference questions
Carson, R. T., & Groves, T. (2007) · Environmental and Resource Economics · doi:10.1007/s10640-007-9124-5 · Cited by 1,362
Cummings, R. G., & Taylor, L. O. (1999) · American Economic Review · doi:10.1257/aer.89.3.649 · Cited by 1,292
Valuing environmental and natural resources - the econometrics of non-market valuation.
Haab, T. C., & McConnell, K. E. (2002) · Cited by 1,224
A Meta-analysis of Hypothetical Bias in Stated Preference Valuation
Murphy, J. J., Allen, P. G., Stevens, T. H., & Weatherhead, D. (2005) · Environmental & Resource Economics · doi:10.1007/s10640-004-3332-z · Cited by 1,092
Valuing Environmental and Natural Resources: The Econometrics of Non-market Valuation
Haab, T. C., & McConnell, K. E. (2002) · Edward Elgar Publishing eBooks · doi:10.4337/9781843765431 · Cited by 1,018
What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?
List, J. A., & Gallet, C. A. (2001) · Environmental and Resource Economics · doi:10.1023/a:1012791822804 · Cited by 1,001
Horowitz, J. K., & McConnell, K. E. (2002) · Journal of Environmental Economics and Management · doi:10.1006/jeem.2001.1215 · Cited by 868
Meta-Regression Analysis in Economics and Business
Stanley, T. D., & Doucouliagos, H. (2012) · Routledge eBooks · doi:10.4324/9780203111710 · Cited by 797
Handbook of Experimental Economic Results
Plott, C. R., & Smith, V. L. (2008) · RePEc: Research Papers in Economics · Cited by 708
Ajzen, I., Brown, T. C., & Carvajal, F. (2004) · Personality and Social Psychology Bulletin · doi:10.1177/0146167204264079 · Cited by 605
Stanley, T. D. (2008) · Oxford Bulletin of Economics and Statistics · doi:10.1111/j.1468-0084.2007.00487.x · Cited by 605
Using Donation Mechanisms to Value Nonuse Benefits from Public Goods
Champ, P. A., Bishop, R. C., Brown, T. C., & McCollum, D. W. (1997) · Journal of Environmental Economics and Management · doi:10.1006/jeem.1997.0988 · Cited by 582
Carson, R. T., Flores, N. E., Martin, K., Wright, J. L., Carson, R. T., Flores, N. E., Martin, K. M., & Wright, J. L. (1995) · RePEc: Research Papers in Economics · doi:10.22004/ag.econ.148793 · Cited by 534
The Use (and Abuse) of Meta-Analysis in Environmental and Natural Resource Economics: An Assessment
Nelson, J. P., & Kennedy, P. E. (2009) · Environmental and Resource Economics · doi:10.1007/s10640-008-9253-5 · Cited by 530
The Disparity Between Willingness to Accept and Willingness to Pay Measures of Value
Coursey, D. L., Hovis, J. L., & Schulze, W. D. (1987) · The Quarterly Journal of Economics · doi:10.2307/1884223 · Cited by 518
A satisfactory benefit cost indicator from contingent valuation
Hoehn, J. P., & Randall, A. (1987) · Journal of Environmental Economics and Management · doi:10.1016/0095-0696(87)90018-0 · Cited by 487
Carson, R. T., Flores, N. E., Martin, K. M., & Wright, J. L. (1996) · Land Economics · doi:10.2307/3147159 · Cited by 469
META‐ANALYSIS OF ECONOMICS RESEARCH REPORTING GUIDELINES
Stanley, T. D., Doucouliagos, H., Giles, M., Heckemeyer, J. H., Johnston, R. J., Laroche, P., Nelson, J. P., Paldam, M., Poot, J., Pugh, G., et al. (2013) · Journal of Economic Surveys · doi:10.1111/joes.12008 · Cited by 463
Alfnes, F., Guttormsen, A. G., Steine, G., & Kolstad, K. (2006) · American Journal of Agricultural Economics · doi:10.1111/j.1467-8276.2006.00915.x · Cited by 409
Welsh, M. P., & Poe, G. L. (1998) · Journal of Environmental Economics and Management · doi:10.1006/jeem.1998.1043 · Cited by 394
Truth in Consequentiality: Theory and Field Evidence on Discrete Choice Experiments
Vossler, C. A., Doyon, M., & Rondeau, D. (2012) · American Economic Journal: Microeconomics · doi:10.1257/mic.4.4.145 · Cited by 374
Which Response Format Reveals the Truth about Donations to a Public Good?
Brown, T. C., Champ, P. A., Bishop, R. C., & McCollum, D. W. (1996) · Land Economics · doi:10.2307/3146963 · Cited by 368
Hypothetical Surveys and Real Economic Commitments
Neill, H. R., Cummings, R. G., Ganderton, P. T., Harrison, G. W., & McGuckin, T. (1994) · Land Economics · doi:10.2307/3146318 · Cited by 349
Using cheap talk as a test of validity in choice experiments
Carlsson, F., Frykblom, P., & Johan Lagerkvist, C. (2005) · Economics Letters · doi:10.1016/j.econlet.2005.03.010 · Cited by 311
Measuring the Value of a Public Good: An Empirical Comparison of Elicitation Procedures
Brookshire, D. S., & COURSEY, D. L. (1987) · American Economic Review · Cited by 309
Yea-Saying in Contingent Valuation Surveys
Blamey, R. K., Bennett, J., & Morrison, M. (1999) · Land Economics · doi:10.2307/3146997 · Cited by 266
Alternative Non-market Value-Elicitation Methods: Are the Underlying Preferences the Same?
Cameron, T. A., Poe, G. L., Ethier, R. G., & Schulze, W. D. (2002) · Journal of Environmental Economics and Management · doi:10.1006/jeem.2001.1210 · Cited by 261
Chapter 81 Experimental Evidence on the Existence of Hypothetical Bias in Value Elicitation Methods
Harrison, G. W., & Rutström, E. E. (2008) · Handbook of Experimental Economics Results · doi:10.1016/s1574-0722(07)00081-9 · Cited by 235
Provision Point Mechanisms and Field Validity Tests of Contingent Valuation
Poe, G. L., Clark, J. E., Rondeau, D., & Schulze, W. D. (2002) · Environmental and Resource Economics · doi:10.1023/a:1020242907259 · Cited by 234
CVM‐X: Calibrating Contingent Values with Experimental Auction Markets
Fox, J. A., Shogren, J. F., Hayes, D. J., & Kliebenstein, J. B. (1998) · American Journal of Agricultural Economics · doi:10.2307/1244548 · Cited by 232
Consequentiality: A Theoretical and Experimental Exploration of a Single Binary Choice
Carson, R. T., Groves, T., & List, J. A. (2014) · Journal of the Association of Environmental and Resource Economists · doi:10.1086/676450 · Cited by 230
A new meta-analysis on the WTP/WTA disparity
Tunçel, T., & Hammitt, J. K. (2014) · Journal of Environmental Economics and Management · doi:10.1016/j.jeem.2014.06.001 · Cited by 228
Substitutes or Complements? Consumer Preference for Local and Organic Food Attributes
Meas, T., Hu, W., Batte, M. T., Woods, T. A., & Ernst, S. (2015) · American Journal of Agricultural Economics · doi:10.1093/ajae/aau108 · Cited by 224
Self-citationBulte, E., Gerking, S., List, J. A., & de Zeeuw, A. (2005) · Journal of Environmental Economics and Management · doi:10.1016/j.jeem.2004.06.001 · Cited by 221
Valuing Environmental Commodities: Some Recent Experiments
Schulze, W. D., d'Arge, R. C., & Brookshire, D. S. (1981) · Land Economics · doi:10.2307/3145783 · Cited by 219
Do Reminders of Substitutes and Budget Constraints Influence Contingent Valuation Estimates?
Loomis, J., Gonzalez-Caban, A., & Gregory, R. (1994) · Land Economics · doi:10.2307/3146643 · Cited by 206
Experimental Results on Expressed Certainty and Hypothetical Bias in Contingent Valuation
Blumenschein, K., Johannesson, M., Blomquist, G. C., Liljas, B., & O'Conor, R. M. (1998) · Southern Economic Journal · doi:10.1002/j.2325-8012.1998.tb00136.x · Cited by 204
Insurance for Low-Probability Hazards: A Bimodal Response to Unlikely Events
McClelland, G. H., Schulze, W. D., & COURSEY, D. L. (1993) · Springer eBooks · doi:10.1007/978-94-011-2192-7_7 · Cited by 198
Insurance for low-probability hazards: A bimodal response to unlikely events
McClelland, G. H., Schulze, W. D., & COURSEY, D. L. (1993) · Journal of Risk and Uncertainty · doi:10.1007/bf01065317 · Cited by 193
Preference elicitation under oath
Jacquemet, N., Joule, R.-V., Luchini, S., & Shogren, J. F. (2013) · Journal of Environmental Economics and Management · doi:10.1016/j.jeem.2012.05.004 · Cited by 191
Loomis, J., Brown, T., Lucero, B., & Peterson, G. (1996) · Land Economics · doi:10.2307/3146908 · Cited by 182
An Experimental Examination of Intrinsic Values as a
Boyce, R. R., Brown, T. C., McClelland, G. H., Peterson, G. L., & Schulze, W. D. (1992) · Cited by 182
Hypothetical and Real Choice Differentially Activate Common Valuation Areas
Kang, M. J., Rangel, A., Camus, M., & Camerer, C. F. (2011) · The Journal of Neuroscience · doi:10.1523/jneurosci.1583-10.2011 · Cited by 171
Ethier, R. G., Poe, G. L., Schulze, W. D., & Clark, J. (2000) · Land Economics · doi:10.2307/3147257 · Cited by 166
Morrison, M., & Brown, T. C. (2009) · Environmental and Resource Economics · doi:10.1007/s10640-009-9287-3 · Cited by 164
Testing a meta-analysis model for benefit transfer in international outdoor recreation
Shrestha, R. K., & Loomis, J. B. (2001) · Ecological Economics · doi:10.1016/s0921-8009(01)00193-8 · Cited by 163
An Experimental Examination of Intrinsic Values as a Source of the WTA-WTP Disparity
Boyce, R. R., Brown, T. C., McClelland, G. H., Peterson, G. L., & Schulze, W. D. (2010) · Cited by 162
2013WAEA Keynote Address: Strategies for Overcoming Hypothetical Bias in Stated Preference Surveys
Loomis, J. B., & Loomis, J. B. (2014) · RePEc: Research Papers in Economics · doi:10.22004/ag.econ.168258 · Cited by 160
On the Use of Honesty Priming Tasks to Mitigate Hypothetical Bias in Choice Experiments
de‐Magistris, T., Gracía, A., & Nayga, R. M. (2013) · American Journal of Agricultural Economics · doi:10.1093/ajae/aat052 · Cited by 142
Michaud, C., Llerena, D., & Joly, I. (2012) · European Review of Agricultural Economics · doi:10.1093/erae/jbs025 · Cited by 134
A Comparison of Approaches to Mitigate Hypothetical Bias
Champ, P. A., Moore, R., & Bishop, R. C. (2009) · Agricultural and Resource Economics Review · doi:10.1017/s106828050000318x · Cited by 130
Landry, C. E., & List, J. A. (2007) · American Journal of Agricultural Economics · doi:10.1111/j.1467-8276.2007.01017.x · Cited by 126
Comparing Open‐Ended Choice Experiments and Experimental Auctions: An Application to Golden Rice
Corrigan, J. R., Depositario, D. P. T., Nayga, R. M., Wu, X., & Laude, T. P. (2009) · American Journal of Agricultural Economics · doi:10.1111/j.1467-8276.2009.01267.x · Cited by 125
Blomquist, G. C., Blumenschein, K., & Johannesson, M. (2008) · Environmental and Resource Economics · doi:10.1007/s10640-008-9242-8 · Cited by 112
Economic Valuation Of Natural Resources: Issues, Theory, And Applications
Johnson, R. (2019) · Medical Entomology and Zoology · Cited by 105
Demand for health risk reductions
Cameron, T. A., & DeShazo, J. R. (2012) · Journal of Environmental Economics and Management · doi:10.1016/j.jeem.2012.05.008 · Cited by 103
Revisiting Cheap Talk with New Evidence from a Field Experiment
Silva, A., Nayga, R. M., Campbell, B. L., & Park, J. L. (2011) · RePEc: Research Papers in Economics · doi:10.22004/ag.econ.117168 · Cited by 101
Is Willingness to Pay for a Public Good Sensitive to the Elicitation Format?
Champ, P. A., & Bishop, R. C. (2006) · Land Economics · doi:10.3368/le.82.2.162 · Cited by 97
Shrestha, R. K., & Loomis, J. B. (2003) · Environmental and Resource Economics · doi:10.1023/a:1023658501572 · Cited by 94
Foster, V., Bateman, I. J., & Harley, D. (1997) · Journal of Agricultural Economics · doi:10.1111/j.1477-9552.1997.tb01140.x · Cited by 92
Brown, K. M., & Taylor, L. O. (2000) · Journal of Economic Behavior & Organization · doi:10.1016/s0167-2681(00)00113-x · Cited by 91
Auction Bids and Shopping Choices
Lusk, J. L., & Schroeder, T. C. (2006) · Advances in Economic Analysis & Policy · doi:10.2202/1538-0637.1539 · Cited by 90
Calibration of Willingness-to-Accept
List, J. A., & Shogren, J. F. (2002) · Journal of Environmental Economics and Management · doi:10.1006/jeem.2000.1182 · Cited by 86
Vlaev, I. (2012) · Journal of Economic Psychology · doi:10.1016/j.joep.2012.05.005 · Cited by 78
The truth, the whole truth, and nothing but the truth—A multiple country test of an oath script
Carlsson, F., Kataria, M., Krupnick, A., Lampi, E., Löfgren, Å., Qin, P., & Sterner, T. (2013) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2013.02.003 · Cited by 78
Alpízar, F., Carlsson, F., & Johansson‐Stenman, O. (2008) · Experimental Economics · doi:10.1007/s10683-007-9194-9 · Cited by 76
Gracía, A., Loureiro, M. L., & Nayga, R. M. (2011) · American Journal of Agricultural Economics · doi:10.1093/ajae/aar054 · Cited by 72
Creating Truth-Telling Incentives with the Bayesian Truth Serum
Weaver, R., & Prelec, D. (2012) · Journal of Marketing Research · doi:10.1509/jmr.09.0039 · Cited by 69
Loomis, J. B., & Santiago, L. E. (2013) · Coastal Management · doi:10.1080/08920753.2012.749754 · Cited by 67
Cognitive dissonance as a means of reducing hypothetical bias
Alfnes, F., Yue, C., & Jensen, H. H. (2010) · European Review of Agricultural Economics · doi:10.1093/erae/jbq012 · Cited by 66
Using Random nth Price Auctions to Value Non-Market Goods and Services
List, J. A. (2003) · Journal of Regulatory Economics · doi:10.1023/a:1022259014448 · Cited by 54
Bedate, A. M., Prieto, L. C. H., & Lara, J. Á. S. (2009) · Journal of Cultural Economics · doi:10.1007/s10824-009-9098-y · Cited by 53
Mahieu, P., Riera, P., & Giergiczny, M. (2012) · Journal of Environmental Planning and Management · doi:10.1080/09640568.2011.626524 · Cited by 50
Interis, M. G., & Petrolia, D. R. (2016) · Land Economics · doi:10.3368/le.92.2.292 · Cited by 49
Veisten, K., & Navrud, S. (2006) · Applied Economics · doi:10.1080/00036840500400152 · Cited by 47
A penny for your thoughts: Inducing truth-telling in stated preference elicitation
Barrage, L., & Lee, M. S. (2009) · Economics Letters · doi:10.1016/j.econlet.2009.11.006 · Cited by 44
Mitani, Y., & Flores, N. E. (2013) · Environmental and Resource Economics · doi:10.1007/s10640-013-9741-0 · Cited by 43
Resolving questions about bias in real and hypothetical referenda
Burton, A. C., Carson, K. S., Chilton, S., & Hutchinson, G. (2007) · Environmental and Resource Economics · doi:10.1007/s10640-007-9095-6 · Cited by 41
Onwujekwe, O. E., Hanson, K., & Fox-Rushby, J. A. (2004) · Social Science & Medicine · doi:10.1016/j.socscimed.2004.05.023 · Cited by 39
Development of a bias ratio to examine factors influencing hypothetical bias
Mjelde, J. W., Jin, Y., Lee, C., Kim, T.-K., & Han, S. (2011) · Journal of Environmental Management · doi:10.1016/j.jenvman.2011.10.001 · Cited by 31
An experimental approach to valuing new differentiated products
Maynard, L. J., Hartell, J. G., Meyer, A. L., & Hao, J. (2004) · Agricultural Economics · doi:10.1016/j.agecon.2004.09.016 · Cited by 29
A Field Experiment Involving Cash and Hypothetical Charitable Donations
MacMillan, D. C., Smart, T. S., & Thorburn, A. P. (1999) · Environmental and Resource Economics · doi:10.1023/a:1008304405734 · Cited by 27
Hypothetical–actual bid calibration of a multigood auction
List, J. A., Margolis, M., & Shogren, J. F. (1998) · Economics Letters · doi:10.1016/s0165-1765(98)00117-7 · Cited by 27
Testing the Effect of a Short Cheap Talk Script in Choice ExperimentsPreprint
Ladenburg, J., Dahlgaard, J. O., & Bonnichsen, O. (2010) · RePEc: Research Papers in Economics · Cited by 23
An experimental approach to valuing new differentiated products
Maynard, L. J., Hartell, J. G., Meyer, A. L., & Hao, J. (2004) · Agricultural Economics · doi:10.1111/j.1574-0862.2004.tb00268.x · Cited by 19
Does gender matter for demand revelation in threshold public goods experiments
Mitani, Y., & Flores, N. (2007) · RePEc: Research Papers in Economics · Cited by 14
Does gender matter when using cheap talk in contingent valuation studies
Mahieu, P. (2010) · RePEc: Research Papers in Economics · Cited by 14
Cited by
Hypothetical bias mitigation in representative and convenience samples
Penn, J. M., Petrolia, D. R., & Fannin, J. M. (2023) · Applied Economic Perspectives and Policy · doi:10.1002/aepp.13374 · Cited by 42
Self-citationDrought exposure decreases altruism with salient group identities as key moderator
Döring, S., & Hall, J. (2023) · Nature Climate Change · doi:10.1038/s41558-023-01732-2 · Cited by 24
Metadata
- Authors
- Penn, J. M., & Hu, W.
- Venue
- American Journal of Agricultural Economics
- Publisher
- Wiley
- Published
- 2018-06-04
- Volume
- 100
- Issue
- 4
- Pages
- 1186-1206
- ISSN
- 0002-9092 (ISSN-L)
- 1467-8276
- OpenAlex
- W2806860413
- Cited by
- 275
- References
- 91
- FWCI
- 30.09
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.