A systematic review of the reliability and validity of discrete choice experiments in valuing non-market environmental goods
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
While discrete choice experiments (DCEs) are increasingly used in the field of environmental valuation, they remain controversial because of their hypothetical nature and the contested reliability and validity of their results. We systematically reviewed evidence on the validity and reliability of environmental DCEs from the past thirteen years (Jan 2003-February 2016). 107 articles met our inclusion criteria. These studies provide limited and mixed evidence of the reliability and validity of DCE. Valuation results were susceptible to small changes in survey design in 45% of outcomes reporting reliability measures. DCE results were generally consistent with those of other stated preference techniques (convergent validity), but hypothetical bias was common. Evidence supporting theoretical validity (consistency with assumptions of rational choice theory) was limited. In content validity tests, 2-90% of respondents protested against a feature of the survey, and a considerable proportion found DCEs to be incomprehensible or inconsequential (17-40% and 10-62% respectively). DCE remains useful for non-market valuation, but its results should be used with caution. Given the sparse and inconclusive evidence base, we recommend that tests of reliability and validity are more routinely integrated into DCE studies and suggest how this might be achieved.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A New Approach to Consumer Theory
Lancaster, K. J. (1966) · Journal of Political Economy · doi:10.1086/259131 · Cited by 8,471
Guidelines for systematic review in Conservation and environmental management
PULLIN, A. S., & STEWART, G. B. (2006) · Conservation Biology · doi:10.1111/j.1523-1739.2006.00485.x · Cited by 1,137
Discrete Choice Experiments Are Not Conjoint Analysis
Louviere, J. J., Flynn, T. N., & Carson, R. T. (2010) · Journal of Choice Modelling · doi:10.1016/s1755-5345(13)70014-9 · Cited by 738
Not bored yet – Revisiting respondent fatigue in stated choice experiments
Hess, S., Hensher, D. A., & Daly, A. (2012) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2011.11.008 · Cited by 154 · cited 1×
“…stage included not valuing non-market environmental goods or non-market environmental attributes of market goods (e.g. Lusk and Schroeder, 2004; Hess et al., 2012), absence of a test of 6 We distinguish such tests from those described in Section 2.2.2, which concern assumptions on which the…”
MethodInfluential
Cited by
Szinay, D., Cameron, R., Naughton, F., Whitty, J. A., Brown, J., & Jones, A. (2021) · Journal of Medical Internet Research · doi:10.2196/32365 · Cited by 106
“Following administration of the survey, methods are available for the measurement and assessment of the content validity of the instrument, although their use is not widely reported [30].”
Method
Metadata
- Authors
- Rakotonarivo, O. S., Schaafsma, M., & Hockley, N.
- Venue
- Journal of Environmental Management
- Publisher
- Elsevier BV
- Published
- 2016-12
- Volume
- 183
- Pages
- 98-109
- ISSN
- 0301-4797 (ISSN-L)
- OpenAlex
- W2508608959
- Cited by
- 199
- References
- 4
- FWCI
- 8.72
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.