A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled Trials
Open accessThe DOI matches its Crossref record; 46 of the 49 references it cites were found in a registry or an index; none of the 28 sources its claims cite is checked for support yet.
Abstract
Missing data are a frequent problem in cost-effectiveness analysis (CEA) within a randomised controlled trial. Inappropriate methods to handle missing data can lead to misleading results and ultimately can affect the decision of whether an intervention is good value for money. This article provides practical guidance on how to handle missing data in within-trial CEAs following a principled approach: (i) the analysis should be based on a plausible assumption for the missing data mechanism, i.e. whether the probability that data are missing is independent of or dependent on the observed and/or unobserved values; (ii) the method chosen for the base-case should fit with the assumed mechanism; and (iii) sensitivity analysis should be conducted to explore to what extent the results change with the assumption made. This approach is implemented in three stages, which are described in detail: (1) descriptive analysis to inform the assumption on the missing data mechanism; (2) how to choose between alternative methods given their underlying assumptions; and (3) methods for sensitivity analysis. The case study illustrates how to apply this approach in practice, including software code. The article concludes with recommendations for practice and suggestions for future research.
Overview
CoChat Summary
## TL;DR
This paper gives a practical, three-stage guide for handling missing data in within-trial cost-effectiveness analysis: diagnose the likely missingness mechanism, choose a method consistent with that assumption, and then test sensitivity to departures from MAR. It argues that ad hoc approaches such as complete-case analysis, mean imputation, and last-value-carried-forward are usually inadequate for costs and QALYs.
## Key findings
- The recommended workflow is: (1) descriptive analysis to inform the missing-data mechanism, (2) choose a base-case method that matches that mechanism, and (3) run sensitivity analyses for alternative assumptions.
- In the REFLUX case study, complete-data proportions fell over follow-up but were similar between arms: 75% to 65% in the surgery group and 82% to 63% in the medical-management group from year 1 to year 5.
- In that case study, the main analyses gave different point estimates depending on method: incremental costs were £1,668 (CCA), £1,305 (MI), and £1,338 (mixed model); incremental QALYs were 0.301, 0.244, and 0.227, respectively.
- The sensitivity analysis in the REFLUX study found the surgery cost-effectiveness result was robust to most plausible MNAR departures; the probability of cost-effectiveness changed materially only when QALYs for missing-data individuals in the surgery arm were reduced, and surgery still remained the most likely cost-effective option even if year 1 imputed QALYs were reduced by 50%.
## Methods
- Methodological guidance paper with a worked illustration using individual patient data from the REFLUX randomized controlled trial, which followed patients for 5 years.
- The paper combines descriptive missing-data analysis, discussion of alternative handling methods (including MI, IPW, likelihood-based methods, CCA, and available-case analysis), and sensitivity analysis under MNAR assumptions.
- In the case study, the base case used multiple imputation by chained equations (MI-MICE) under MAR, with a mixed model as an alternative and a pattern-mixture-style sensitivity analysis.
## Limitations
- The paper states that the true missing-data mechanism is usually unknown, so MNAR cannot be ruled out from the observed data alone.
- It states that selection models and pattern-mixture approaches can be difficult for non-specialists to implement, and that more research is needed on practical sensitivity-analysis methods and software.
- Evident from the text: the REFLUX illustration is a single case study, so the numerical results shown there are specific to that trial and are not evidence of general performance across all within-trial CEAs.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
0 Valid · 2 Not valid · 22 Not checked · 81 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, all were significant predictors of costs and QALYs at each year (data not shown).”
§ A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled Trials > Illustration with the REFLUX Study > Stage 1: Descriptive Analysis of Missing Data
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Nonetheless, surgery remains the intervention most likely to be cost effective even if imputed QALYs in year 1 are reduced by 50 %.”
§ A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled Trials > Illustration with the REFLUX Study > Stage 3: Sensitivity Analysis to the MAR Assumption
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The probability changes considerably only when the QALYs of individuals with missing data allocated to surgery are decreased, so that the data are assumed MAR in the medical management arm (scenario 4).”
§ A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled Trials > Illustration with the REFLUX Study > Stage 3: Sensitivity Analysis to the MAR Assumption
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“However, the three methods agree that surgery is the cost-effective alternative.”
§ A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled Trials > Illustration with the REFLUX Study > Stage 2: Choosing and Implementing a Method to Handle Missing Data
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The mean differences in costs and QALYs and the incremental cost-effectiveness ratio changed according to the method.”
§ A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled Trials > Illustration with the REFLUX Study > Stage 2: Choosing and Implementing a Method to Handle Missing Data
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
51 more claims
Create a free account to see all 105 claims and to verify the 28 references still open.
- It may state two separate claims as one. 29
- Probably not a substantial claim. 24
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Missing data were imputed by treatment arm using chained equations to create 100 complete datasets [21].”
From Cost-effectiveness of acceptance and commitment therapy for people living with motor neuron disease, and their health-related quality of life (2024) · cites this paper as [21]
Experimental — accuracy not yet measured
Citations
Cites
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
mice: Multivariate Imputation by Chained Equations in R
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870 · cited 1×
“One option is to assess whether the distributions of observed and imputed values are similar [32, 33].”
BackgroundMultiple imputation using chained equations: Issues and guidance for practice
White, I. R., Royston, P., & Wood, A. M. (2011) · Statistics in Medicine · doi:10.1002/sim.4067 · Cited by 9,792 · cited 3×
“The imputation model should include all variables that are associated with both the missing data and CEA outcomes (costs and health outcomes), and all covariates that are in the analysis model [20].”
BackgroundMethodInfluentialSelf-citationAnalysis of Incomplete Multivariate Data
Schafer, J. L. (1997) · doi:10.1201/9781439821862 · Cited by 6,012
Analysis of Incomplete Multivariate Data
Booth, D. E. (2000) · Technometrics · doi:10.1080/00401706.2000.10486013 · Cited by 5,627 · cited 1×
“This can be an issue for within-trial CEAs since costs and QALYs are usually non-normally distributed, although variables can be transformed to normality [21, 22].”
BackgroundStatistical Analysis With Missing Data
Ghosh, S. (1988) · Technometrics · doi:10.1080/00401706.1988.10488446 · Cited by 4,576 · cited 2×
“The MI procedure follows three steps [12].”
MethodMultiple imputation of discrete and continuous data by fully conditional specification
van Buuren, S. (2007) · Statistical Methods in Medical Research · doi:10.1177/0962280206074463 · Cited by 2,827
Smearing Estimate: A Nonparametric Retransformation Method
Duan, N. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10478017 · Cited by 2,232 · cited 1×
“This back transformation does not require correcting for non-normal errors (also referred to as smearing [28]) because the imputed value is drawn from the posterior predictive distribution.”
BackgroundDoubly robust estimation in missing data and causal inference models
Bang, H., & Robins, J. M. (2005) · Biometrics · doi:10.1111/j.1541-0420.2005.00377.x · Cited by 1,998 · cited 1×
“More sophisticated methods have been developed in order to improve precision and reduce the reliance of IPW on the correct specification of the model [17, 18].”
Method
Cited by
Fretland, Å. A., Dagenborg, V. J., Bjørnelv, G. M. W., Kazaryan, A. M., Kristiansen, R., Fagerland, M. W., Hausken, J., Tønnessen, T. I., Abildgaard, A., Barkhatov, L., et al. (2018) · Annals of Surgery · doi:10.1097/sla.0000000000002353 · Cited by 703
“280 Sum treatment up to 1 month, mean (SD), $ 15,307 (20,354) 15,793 (27,475) 486 0.”
Methods for Analysing and Reporting EQ-5D Data
Devlin, N., Parkin, D., & Janssen, B. (2020) · Springer eBooks · doi:10.1007/978-3-030-47622-9 · Cited by 371
Beard, D. J., Davies, L. J., Cook, J. A., MacLennan, G., Price, A., Kent, S., Hudson, J., Carr, A., Leal, J., Campbell, H., et al. (2019) · The Lancet · doi:10.1016/s0140-6736(19)31281-4 · Cited by 306
Cost and effects of integrated care: a systematic literature review and meta-analysis
Rocks, S., Berntson, D., Gil-Salmerón, A., Kadu, M., Ehrenberg, N., Stein, V., & Tsiachristas, A. (2020) · The European Journal of Health Economics · doi:10.1007/s10198-020-01217-5 · Cited by 243
Human and economic impacts of natural disasters: can we trust the global data?
Jones, R. L., Guha‐Sapir, D., & Tubeuf, S. (2022) · Scientific Data · doi:10.1038/s41597-022-01667-x · Cited by 184
Metadata
- Authors
- Faria, R., Gomes, M., Epstein, D., & White, I. R.
- Affiliations
- University of York (GB)
- London School of Hygiene & Tropical Medicine (GB)
- Universidad de Granada (ES)
- MRC Biostatistics Unit (GB)
- Corresponding author
- Faria, Rita
- Venue
- PharmacoEconomics
- Published
- 2014-07-29
- Volume
- 32
- Issue
- 12
- Pages
- 1157-1170
- ISSN
- 1170-7690 (ISSN-L)
- 1179-2027
- PMC
- PMC4244574
- OpenAlex
- W2151182129
- Cited by
- 673
- References
- 49
- Citations by year
- 2026: 46 · 2025: 92 · 2024: 87 · 2023: 60 · 2022: 82 · 2021: 84 · 2020: 77 · 2019: 44 · 2018: 50 · 2017: 32 · 2016: 12 · 2015: 4 · 2014: 1
- FWCI
- 40.41
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- PharmacoEconomics (publishedVersion, cc-by-nc)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Institutional Repository of the University of Granada (University of Granada) (publishedVersion, cc-by-nc)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, cc-by-nc)
- UCL Discovery (University College London) (submittedVersion)
- Funders
- University of Aberdeen
- Medical Research Council (MR/K02177X/1, U1052 60558)
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- missing data, cost-effectiveness analysis, randomized controlled trials, missing data mechanisms, sensitivity analysis, value for money, economic evaluation
- MeSH terms
- Cost-Benefit Analysis, Humans, Statistics as Topic, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled Trials. https://app.cochat.ai/papers/10.1007/s40273-014-0193-3
- The paper
- Faria, R., Gomes, M., Epstein, D., & White, I. R. (2014). A Guide to Handling Missing Data in Cost-Effectiveness Analysis Conducted Within Randomised Controlled Trials. PharmacoEconomics. https://doi.org/10.1007/s40273-014-0193-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.