A multi‐method approach to measuring health‐state valuations
Abstract
Existing techniques for eliciting health-state valuations incorporate both strength of preferences for health states and other values such as risk aversion or time preference. This paper presents a new methodological approach that allows estimation of a set of core underlying health-state values based on responses elicited through multiple measurement techniques. A study was undertaken in which respondents completed the visual analogue (VAS) scale, time trade-off (TTO), standard gamble (SG) and person trade-off (PTO) for a range of states. By specifying flexible parametric functions to explain responses on each measurement technique, we estimated both the underlying strength of preference values for the health states in the study and the values for a set of auxiliary parameters characterising risk attitudes, discount rates, distributional concerns and scale distortion effects in the group of respondents. This study demonstrates that it is possible to understand responses on these four different measurement techniques based on a consistent set of core values. The approach presented here can provide insights into different sources of observed variation in VAS, TTO, SG and PTO responses and facilitate appropriate adjustment of valuations elicited through different methods for use in summary health measures and economic analyses.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Visual analogue scales carry low participant burden, show moderate-to-strong test-retest reliability, and are often used to assess health status in longitudinal studies.
“Visual analogue scales carry low-participant burden, show moderate-to-strong test–retest reliability (Salomon & Murray, 2004; Siegel et al., 1997), and are often used to assess health status in longitudinal studies.”
From Perception of Physical Demand, Mental Demand, and Performance: A Comparison of Two Voice Interventions for Parkinson's Disease (2022) · cites this paper as Salomon & Murray, 2004
Cited by
Sorted by citations
Measuring the Burden of Neglected Tropical Diseases: The Global Burden of Disease Framework
Mathers, C. D., Ezzati, M., & López, A. D. (2007) · PLoS neglected tropical diseases · doi:10.1371/journal.pntd.0000114 · Cited by 512 · see citing works
Assessing gambling-related harm in Victoria: a public health perspective
Browne, M., Langham, E., Rawat, V., Greer, N., Li, E., Rose, J., Rockloff, M., Donaldson, P., Thorne, H., Goodwin, B., et al. (2016) · doi:10.11575/prism/9419 · Cited by 246 · see citing works
Nord, E., Daniels, N., & Kamlet, M. S. (2009) · Value in Health · doi:10.1111/j.1524-4733.2009.00516.x · Cited by 187 · see citing works
QALYs and the capability approach.
Cookson, R. (2005) · Health Economics · doi:10.1002/hec.975 · Cited by 140
“One way partly to address such problems is a ‘multi-method’ approach [32].”
MethodDiscrete Choice Modeling for the Quantification of Health States: The Case of the EQ-5D
Stolk, E. A., Oppe, M., Scalone, L., & Krabbe, P. F. M. (2010) · Value in Health · doi:10.1111/j.1524-4733.2010.00783.x · Cited by 121 · see citing works
Health status and quality of life among older adults in rural Tanzania
Mwanyangala, M. A., Mayombana, C., Urassa, H., Charles, J., Mahutanga, C., Abdullah, S., & Nathan, R. (2010) · Global Health Action · doi:10.3402/gha.v3i0.2142 · Cited by 94 · see citing works
Robberstad, B. (2005) · Norsk Epidemiologi · doi:10.5324/nje.v15i2.217 · Cited by 106 · see citing works
“Currently, there is no agreement on which method that should be preferred for eliciting disease or quality of life weights (19,20).”
BackgroundResultDisability-Adjusted Life Years
Salomon, J. (2014) · Elsevier eBooks · doi:10.1016/b978-0-12-375678-7.00511-3 · Cited by 101 · see citing works
Self-citationGlobal patterns of healthy life expectancy in the year 2002
Mathers, C., Iburg, K., Salomon, J., Tandon, A., Chatterji, S., Ustün, B., & Murray, C. (2004) · BMC Public Health · doi:10.1186/1471-2458-4-66 · Cited by 100 · see citing works
Self-citationNeedle Phobia and Stress-Reducing Medical Devices in Pediatric and Adult Chemotherapy Patients
Kettwich, S. C., Sibbitt, W., Brandt, J., Johnson, C. R., Wong, C., & Bankhurst, A. (2007) · Journal of Pediatric Oncology Nursing · doi:10.1177/1043454206296023 · Cited by 86 · see citing works
Lugnér, A. K., & Krabbe, P. F. M. (2020) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1080/14737167.2020.1779062 · Cited by 99 · see citing works
Quality of life of dengue patients.
Lum, L., Suaya, J., Tan, L., Sah, B., & Shepard, D. (2008) · American Journal of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.2008.78.862 · Cited by 75
“Additional refinements include adjustment from visual analog scales, such as that in the EQ-5D, to time-tradeoff utilities.(29,30) The prolonged duration of sub-optimal QoL in the young and productive adult population may contribute to the economic impact of dengue.”
BackgroundRetaining, and Enhancing, the QALY
Lipscomb, J., Drummond, M., Fryback, D. G., Gold, M. R., & Revicki, D. A. (2009) · Value in Health · doi:10.1111/j.1524-4733.2009.00518.x · Cited by 75 · see citing works
“Recently, Salamon and Murray [ 49 ] developed and applied a multimethod approach to analyze jointly and compare the major preference elicitation approaches (SG, TTO, VAS, and the person trade-off (PTO)) in terms of their ability to yield health state weights while accounting for such influences as risk attitude, time…”
BackgroundMeasuring the Burden of Gambling Harm in New Zealand
Browne, M., Bellringer, M., Greer, N. L., Kolandai‐Matchett, K., Rawat, V., Langham, E., Rockloff, M., du Preez, K. P., & Abbott, M. (2017) · Tuwhera (Auckland University of Technology) · doi:10.11575/prism/9668 · Cited by 67 · see citing works
Ratcliffe, J., Brazier, J., Tsuchiya, A., Symonds, T., & Brown, M. L. (2009) · Health Economics · doi:10.1002/hec.1426 · Cited by 71 · see citing works
Decision-analytical modelling in health-care economic evaluations
Sun, X., & Faunce, T. (2008) · European Journal of Health Economics · doi:10.1007/s10198-007-0078-x · Cited by 71
“In an overview of the health-state measures, Brazier [18] argued that, although outcomes for health states were not diffentiated by using different techniques, SG and TTO should be used for their theoretical validity.”
MethodAlonso, J., Vilagut, G., Chatterji, S., Heeringa, S., Schoenbaum, M., Bedirhan Üstün, T., Rojas-Farreras, S., Angermeyer, M., Bromet, E., Bruffaerts, R., et al. (2011) · Psychological Medicine · doi:10.1017/s0033291710001212 · Cited by 61 · see citing works
Norrie disease and peripheral venous insufficiency
Michaelides, M. (2004) · British Journal of Ophthalmology · doi:10.1136/bjo.2004.042556 · Cited by 39 · see citing works
Has the burden of depression been overestimated?
Kruijshaar, M., Hoeymans, N., Spijker, J., Stouthard, M., & Essink-bot, M. (2005) · Bulletin of the World Health Organization · doi:10.1590/s0042-96862005000600012 · Cited by 42
Preference values associated with stage III colon cancer and adjuvant chemotherapy
Best, J., Garrison, L., Hollingworth, W., Ramsey, S., & Veenstra, D. (2010) · Quality of Life Research · doi:10.1007/s11136-010-9589-5 · Cited by 39
“Subjects completed a ranking and VAS rating exercise to familiarize them with valuing health states [16, 21].”
BackgroundTesting the interval-level measurement property of multi-item visual analogue scales
Krabbe, P., Stalmeier, P., Lamers, L., & Busschbach, J. (2006) · Quality of Life Research · doi:10.1007/s11136-006-0027-7 · Cited by 39 · see citing works
“distortion of the linearity of this relation for the VAS [39].”
Bijlenga, D., Birnie, E., & Bonsel, G. (2009) · Value in Health · doi:10.1111/j.1524-4733.2009.00503.x · Cited by 36
Norman, J., Annerstedt, M., Boman, M., & Mattsson, L. (2010) · Scandinavian Journal of Forest Research · doi:10.1080/02827581.2010.485999 · Cited by 39 · see citing works
“There are also other health valuation techniques, which present trade-off scenarios to the respondents, for example Time Trade-Off (TTO) and Standard Gamble (SG) (Salomon & Murray, 2004).”
BackgroundQuantification of Health States with Rank-Based Nonmetric Multidimensional Scaling
Krabbe, P., Salomon, J., & Murray, C. (2007) · Medical decision making · doi:10.1177/0272989x07302131 · Cited by 31 · see citing works
“Miami 604 (6) 1188 (21) 1726 29) 968 (18) 2339 (39)”
Self-citationAugestad, L., Rand-Hendriksen, K., Stavem, K., & Kristiansen, I. (2013) · Quality of Life Research · doi:10.1007/s11136-012-0192-9 · Cited by 28
Economic evaluation in critical care medicine.
Cox, H. L., Laupland, K., & Manns, B. (2006) · Journal of critical care · doi:10.1016/j.jcrc.2006.02.003 · Cited by 28
“There are different methods of eliciting utility values, ranging from direct methods such as the time trade-off or standard gamble [20,21] to indirect approaches such as the EuroQoL Group’s EQ-5D [22].”
MethodUnpacking privacy: Valuation of personal data protection
Skatova, A., McDonald, R. L., Ma, S., & Maple, C. R. (2023) · PLoS ONE · doi:10.1371/journal.pone.0284581 · Cited by 32 · see citing works
“Discrepancies between values of a health outcome have been found depending on the method used to elicit them [e.g. 24, 28–30].”
Robinson, S., & Bryan, S. (2013) · Value in Health · doi:10.1016/j.jval.2013.03.1633 · Cited by 21 · see citing works
“Other studies have found similar issues around “nontraders” and the PTO technique [38,41,43].”
ResultEstimating the Burden of Disease for Autism Spectrum Disorders in Spain in 2003
Sánchez-Valle, E., de la Paz, M. P., Villaverde‐Hueso, A., Aguilera, E. T., Ferrari-Arroyo, M. J., Boada, L., Martín-Arribas, M. C., Canal‐Bedia, R., & Fuentes-Biggi, J. (2007) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-007-0393-1 · Cited by 22 · see citing works
“To estimate disability weights a group of experts ranged the severity of several disabling conditions from 0 (equal to perfect health) to 1 (equal to death) using a person trade-off methodology ( Salomon & Murray, 2004 ).”
MethodTrading people versus trading time: What is the difference?
Damschroder, L., Roberts, T. R., Goldstein, C. C., Miklosovic, M. E., & Ubel, P. (2005) · Population Health Metrics · doi:10.1186/1478-7954-3-10 · Cited by 23
“Indeed, Salomon and Murray demonstrated how these "distributional concerns" could be derived as weights separate from the "core strength of preference" that is common across many elicitation methods [25].”
BackgroundResultWhy People Refuse to Make Tradeoffs in Person Tradeoff Elicitations: A Matter of Perspective?
Damschroder, L., Roberts, T. R., Zikmund-Fisher, B., & Ubel, P. (2007) · Medical decision making · doi:10.1177/0272989x07300601 · Cited by 22
THE DURATION EFFECT: A LINK BETWEEN TTO AND VAS VALUES
Craig, B. M. (2009) · Health Economics · doi:10.1002/hec.1356 · Cited by 21
Essink-bot, M., Stuifbergen, M. C., Meerding, W., Looman, C., & Bonsel, G. (2007) · BMC Health Services Research · doi:10.1186/1472-6963-7-62 · Cited by 21
“However, the trading that is inherent in these methods is complex, because preferences elicited by these techniques incorporate both the preferences for health states and preferences for the commodity that is hypothetically being traded in exchange for better health [14].”
BackgroundPatients' preferences and trade-offs for the treatment of early stage hepatocellular carcinoma
Molinari, M., Coutere, S. D., Krahn, M. D., Helton, S. W., & Urbach, D. R. (2014) · Journal of Surgical Research · doi:10.1016/j.jss.2014.02.015 · Cited by 18 · see citing works
Valuation Structures of Health States Revealed with Singular Value Decomposition
Krabbe, P. (2006) · Medical decision making · doi:10.1177/0272989x05284106 · Cited by 15
“So far, there is little agreement about which technique is the most appropriate.(4) Apart from theoretical and methodological differences between the valuation techniques, the general underlying assumption is that individuals possess implicit preferences for health states that range from good to bad and that, in princ…”
BackgroundRobinson, S. (2011) · Health Economics · doi:10.1002/hec.1677 · Cited by 14 · see citing works
When are person tradeoffs valid?
Doctor, J., Miyamoto, J., & Bleichrodt, H. (2009) · Journal of Health Economics · doi:10.1016/j.jhealeco.2009.06.010 · Cited by 13 · see citing works
“Because PTO responses require interpersonal comparisons, several researchers have conjectured that these responses capture distributional concerns (e.g., Nord (1999), p. 90, first paragraph; Damschroder et al. 2005, p. 2 fifth paragraph; Salomon & Murray (2004), p. 284, second paragraph).”
BackgroundOck, M., Park, J., Son, W.-S., Lee, H.-J., Kim, S.-H., & Jo, M. (2016) · Health and Quality of Life Outcomes · doi:10.1186/s12955-016-0566-8 · Cited by 12
“Furthermore, there is no single preferred method of evaluation that is appropriate under all circumstances [24].”
How Many Alternatives Can Be Ranked? A Comparison of the Paired Comparison and Ranking Methods.
Ock, M., Yi, N., Ahn, J., & Jo, M. (2016) · Value in Health · doi:10.1016/j.jval.2016.03.1836 · Cited by 12
Strong, K., & Mathers, C. D. (2011) · Elsevier eBooks · doi:10.1016/b978-1-4160-5478-8.10019-3 · Cited by 12 · see citing works
Levels in Decision Making and Techniques for Clinicians
Molinari, M., Güler, S., Hurton, S., & winn, M. C. (2015) · International Journal of Digestive Diseases · doi:10.4172/2472-1891.100002 · Cited by 11 · see citing works
Utility Scores for Comorbid Conditions: Methodological Issues and Advances
Mcintosh, C. (2010) · doi:10.1007/978-0-387-78665-0_20 · Cited by 10
Disease Burden of Dengue Fever and Dengue Hemorrhagic Fever
Suaya, J., Shepard, D., Beatty, M., & Farrar, J. (2010) · Springer eBooks · doi:10.1007/978-0-387-78665-0_72 · Cited by 9 · see citing works
Richardson, K., Huber, J. E., Kiefer, B., & Snyder, S. (2022) · American Journal of Speech-Language Pathology · doi:10.1044/2022_ajslp-22-00026 · Cited by 9 · see citing works
King, N., Harper, S., Young, M., Berry, S., & Voigt, K. (2018) · PLoS ONE · doi:10.1371/journal.pone.0195338 · Cited by 8
Multi-method approach to valuing health states: problems with meaning.
Nord, E., Menzel, P., & Richardson, J. (2006) · Health Economics · doi:10.1002/hec.1063 · Cited by 8
“In an earlier article in Health Economics, Salomon and Murray argue that by applying maximum likelihood techniques to predetermined functional forms and to a data set where a number of health states are valued by means of four standard valuation techniques, underlying ‘pure’ valuations of health may be teased out, tog…”
BackgroundInfluentialDisease severity-based evaluation of utility weights for lung cancer-related health states in Korea
Kim, E.-J., Ock, M., Kim, K.-P., Jung, N. H., Lee, H.-J., Kim, S.-H., & Jo, M. (2018) · BMC Cancer · doi:10.1186/s12885-018-4960-y · Cited by 5
Imperfect Perception and Stochastic Choice in Experiments
Brañas‐Garza, P., & Smith, J. A. (2023) · Cambridge University Press eBooks · doi:10.1017/9781009049207 · Cited by 4 · see citing works
Using Discounting Biases, Risk Characteristics, and Perceived Control Improves Preventive Programs
Ortendahl, M. (2007) · International Journal of Biomedical Science · doi:10.59566/ijbs.2007.3081 · Cited by 3
“The role of risk does not seem to have been studied to the same extent, although it is known that risk generally has a large impact on judgments and decisions being made, either by the individual or by health educators (18).”
BackgroundPerson tradeoffs and the problem of risk
Doctor, J., & Miyamoto, J. (2005) · Expert review of pharmacoeconomics & outcomes research · doi:10.1586/14737167.5.6.677 · Cited by 2 · see citing works
Cost effectiveness analyses of influenza A (H1N1) vaccination programs: How accurate were they?
Beeler, M. F., Aleman, D., & Carter, M. W. (2014) · doi:10.5897/jidi2013.0127 · Cited by 1
“QALY weights generated by different methods are often only weakly correlated (Arnesen and Trommald, 2004), and some methods have been found to give significantly more weight to morbidity than others (Salomon and Murray, 2004).”
MethodKymes, S., & Frick, K. (2005) · British Journal of Ophthalmology · doi:10.1136/bjo.2004.063784/10.1136/bjo.2004.063792 · Cited by 1
Krabbe, P. F. M. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-801504-9.00012-x
- Authors
- Salomon, J. A., & Murray, C. J. L.
- Affiliations
- Harvard University (US)
- World Health Organization (CH)
- Corresponding author
- Salomon, Joshua A.
- Venue
- Health Economics
- Publisher
- Wiley
- Published
- 2003-06-20
- Volume
- 13
- Issue
- 3
- Pages
- 281-290
- ISSN
- 1057-9230 (ISSN-L)
- 1099-1050
- OpenAlex
- W2151514342
- Cited by
- 81
- References
- 0
- Citations by year
- 2023: 2 · 2022: 1 · 2021: 2 · 2020: 1 · 2019: 1 · 2018: 2 · 2016: 3 · 2015: 2 · 2014: 4 · 2013: 1 · 2012: 3
- FWCI
- 22.62
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Health Economics (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- National Institute on Aging (P01 AG17625, P01AG017625)
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Economic and Environmental Valuation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- health state valuation, preference elicitation, visual analogue scale, time trade-off, standard gamble, person trade-off, risk aversion, time preference, discount rate, distributional concerns, scale distortion
- MeSH terms
- Health Status Indicators, Humans, Public Health, Quality of Life, Models, Statistical, Developed Countries
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
