Using balance statistics to determine the optimal number of controls in matching studies
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
When a randomized controlled trial is not feasible, investigators typically turn to matching techniques as an alternative approach to evaluate the effectiveness of health care interventions. Matching studies are designed to minimize imbalances on measured pre‐intervention characteristics, thereby reducing bias in estimates of treatment effects. Generally, a matching ratio up to 4:1 (control to treatment) elicits the lowest bias. However, when matching techniques are used in prospective studies, investigators try to maximize the number of controls matched to each treated individual to increase the likelihood that a sufficient sample size will remain after attrition. In this paper, we describe a systematic approach to managing the trade‐off between minimizing bias and maximizing matched sample size. Our approach includes the following three steps: (1) run the desired matching algorithm, starting with 1:1 (one control to one treated individual) matching and iterating until the maximum desired number of potential controls per treated subject is reached; (2) for each iteration, test for covariate balance; and (3) generate numeric summaries and graphical plots of the balance statistics across all iterations in order to determine the optimal solution. We demonstrate the implementation of this approach with data from a medical home pilot programme and with a simulation study of populations of 100 000 in which 1000 individuals receive the intervention. We advocate undertaking this methodical approach in matching studies to ensure that the optimal matching solution is identified. Doing so will raise the overall quality of the literature and increase the likelihood of identifying effective interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Austin, P. C. (2009) · Statistics in Medicine · doi:10.1002/sim.3697 · Cited by 6,758
SOME PRACTICAL GUIDANCE FOR THE IMPLEMENTATION OF PROPENSITY SCORE MATCHING
Caliendo, M., & Kopeinig, S. (2008) · Journal of Economic Surveys · doi:10.1111/j.1467-6419.2007.00527.x · Cited by 6,238
Matching Methods for Causal Inference: A Review and a Look Forward
Stuart, E. A. (2010) · Statistical Science · doi:10.1214/09-sts313 · Cited by 5,478 · cited 3×
“While we utilize a propensity score approach, a strength of this methodology is that it can be implemented in conjunction with any matching procedure that offers a k:1 solution (we refer readers to Stuart [7] for a comprehensive treatment of available matching approaches and procedures, and Caliendo & Kopeinig [8] for…”
BackgroundMethodUsing Propensity Scores to Help Design Observational Studies: Application to the Tobacco Litigation
Rubin, D. B. (2001) · Health Services and Outcomes Research Methodology · doi:10.1023/a:1020363010465 · Cited by 2,228 · cited 4×
“Matching is often favoured over other adjustment techniques, such as regression analysis, because it decouples the design from the analysis of treatment effects [14].”
BackgroundInfluentialAustin, P. C. (2009) · Biometrical Journal · doi:10.1002/bimj.200810488 · Cited by 769 · cited 2×
“Following the data generating process described by Austin [26], we created five continuous and five dichotomous covariates.”
BackgroundMethodMatching to remove bias in observational studies
Rubin, D. B. (1973) · Biometrics · doi:10.2307/2529684 · Cited by 737
Cited by
Ali, M. S., Prieto-Alhambra, D., Lopes, L. C., Ramos, D., Bispo, N., Ichihara, M. Y., Pescarini, J. M., Williamson, E., Fiaccone, R. L., Barreto, M. L., et al. (2019) · Frontiers in Pharmacology · doi:10.3389/fphar.2019.00973 · Cited by 200
Kobori, T., Onishi, Y., Yoshida, Y., Tahara, T., Kikuchi, T., Kubota, T., Iwamoto, M., Sawada, T., Kobayashi, R., Fujiwara, H., et al. (2023) · Journal of Diabetes Investigation · doi:10.1111/jdi.14005 · Cited by 144
A matching framework to improve causal inference in interrupted time‐series analysis
Linden, A. (2018) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12874 · Cited by 62
Self-citationShahshahani, M. A., Liu, X., Norman, M., Tilden, E. L., & Ahlberg, M. (2024) · Midwifery · doi:10.1016/j.midw.2024.104079 · Cited by 7
Metadata
- Authors
- Linden, A., & Samuels, S. J.
- Venue
- Journal of Evaluation in Clinical Practice
- Publisher
- Wiley
- Published
- 2013-08-03
- Volume
- 19
- Issue
- 5
- Pages
- 968-975
- ISSN
- 1356-1294 (ISSN-L)
- 1365-2753
- OpenAlex
- W2159657555
- Cited by
- 178
- References
- 6
- FWCI
- 3.44
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.