Developing Appropriate Methods for Cost-Effectiveness Analysis of Cluster Randomized Trials
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Aim. Cost-effectiveness analyses (CEAs) may use data from cluster randomized trials (CRTs), where the unit of randomization is the cluster, not the individual. However, most studies use analytical methods that ignore clustering. This article compares alternative statistical methods for accommodating clustering in CEAs of CRTs. Methods. Our simulation study compared the performance of statistical methods for CEAs of CRTs with 2 treatment arms. The study considered a method that ignored clustering—seemingly unrelated regression (SUR) without a robust standard error (SE)—and 4 methods that recognized clustering—SUR and generalized estimating equations (GEEs), both with robust SE, a “2-stage” nonparametric bootstrap (TSB) with shrinkage correction, and a multilevel model (MLM). The base case assumed CRTs with moderate numbers of balanced clusters (20 per arm) and normally distributed costs. Other scenarios included CRTs with few clusters, imbalanced cluster sizes, and skewed costs. Performance was reported as bias, root mean squared error (rMSE), and confidence interval (CI) coverage for estimating incremental net benefits (INBs). We also compared the methods in a case study. Results. Each method reported low levels of bias. Without the robust SE, SUR gave poor CI coverage (base case: 0.89 v. nominal level: 0.95). The MLM and TSB performed well in each scenario (CI coverage, 0.92–0.95). With few clusters, the GEE and SUR (with robust SE) had coverage below 0.90. In the case study, the mean INBs were similar across all methods, but ignoring clustering underestimated statistical uncertainty and the value of further research. Conclusions. MLMs and the TSB are appropriate analytical methods for CEAs of CRTs with the characteristics described. SUR and GEE are not recommended for studies with few clusters.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bootstrap Methods and their Application
Davison, A. C., & Hinkley, D. V. (1997) · doi:10.1017/cbo9780511802843 · Cited by 7,350
Cost-Effectiveness in Health and Medicine
(1996) · doi:10.1093/oso/9780195108248.001.0001 · Cited by 7,193
A Note on Robust Variance Estimation for Cluster‐Correlated Data
Williams, R. L. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00645.x · Cited by 2,501
Generalized Estimating Equations
Hardin, J. W., & Hilbe, J. M. (2002) · doi:10.1201/9781420035285 · Cited by 1,766
Eldridge, S. M., Ashby, D., & Kerry, S. (2006) · International Journal of Epidemiology · doi:10.1093/ije/dyl129 · Cited by 529 · cited 2×
“SA: cluster-size imbalance informed by range of values reported across case studies and previous study.(42) Final case: median from the case studies.”
MethodWillan, A. R., Briggs, A. H., & Hoch, J. S. (2004) · Health Economics · doi:10.1002/hec.843 · Cited by 364 · cited 5×
“in a different context, this corroborates previous findings that suggest methods assuming normality may be quite robust to skewed cost data.(21,40,41,43) However, it would be worth investigating whether MLMs that better accommodate skewed costs would lead to gains in precision.”
BackgroundMethodResultInfluentialCampbell, M. K., Fayers, P. M., & Grimshaw, J. M. (2005) · Clinical Trials · doi:10.1191/1740774505cn071oa · Cited by 275
Statistical Analysis of Cost‐effectiveness Data
Willan, A. R., & Briggs, A. H. (2006) · doi:10.1002/0470856289 · Cited by 155
Murphy, A. W., Cupples, M. E., Smith, S. M., Byrne, M., Byrne, M. C., Newell, J., & for the SPHERE study team (2009) · BMJ · doi:10.1136/bmj.b4220 · Cited by 99
Morgan, K., Thompson, J., Dixon, S., Tomeny, M., & Mathers, N. (2003) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(02)00569-x · Cited by 62
Use of the bootstrap in analysing cost data from cluster randomised trials: some simulation results
Flynn, T. N., & Peters, T. J. (2004) · BMC Health Services Research · doi:10.1186/1472-6963-4-33 · Cited by 32 · cited 7×
“Davison and Hinkley(23) propose a 2-stage routine for CRTs, which resamples clusters as well as individuals, and this approach has been considered for CEAs.(24,26,34) The TSB can recognize the individual-level correlation between costs and outcomes by bivariate resampling, and the resampling can also stratify by treat…”
BackgroundMethodInfluential
Cited by
Ramsey, S. D., Willke, R. J., Glick, H., Reed, S. D., Augustovski, F., Jonsson, B., Briggs, A., & Sullivan, S. D. (2015) · Value in Health · doi:10.1016/j.jval.2015.02.001 · Cited by 811
Review of recent methodological developments in group-randomized trials: part 2—analysis
Turner, E. L., Prague, M., Gallis, J. A., Li, F., & Murray, D. M. (2017) · American Journal of Public Health · doi:10.2105/ajph.2017.303707 · Cited by 195
Henderson, C., Knapp, M., Fernández, J.-L., Beecham, J., Hirani, S. P., Beynon, M., Cartwright, M., Rixon, L., Doll, H., Bower, P., et al. (2014) · Age and Ageing · doi:10.1093/ageing/afu067 · Cited by 64
Ramsay, C. R., Clarkson, J. E., Duncan, A., Lamont, T. J., Heasman, P. A., Boyers, D., Goulão, B., Bonetti, D., Bruce, R., Gouick, J., et al. (2018) · Health Technology Assessment · doi:10.3310/hta22380 · Cited by 57
Metadata
- Authors
- Gomes, M., Ng, E. S.-W., Grieve, R., Nixon, R., Carpenter, J., & Thompson, S. G.
- Venue
- Medical Decision Making
- Publisher
- SAGE Publications
- Published
- 2011-10-19
- Volume
- 32
- Issue
- 2
- Pages
- 350-361
- ISSN
- 0272-989X (ISSN-L)
- 1552-681X
- OpenAlex
- W2101104998
- Cited by
- 151
- References
- 11
- FWCI
- 6.12
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.