The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Too Much Ado about Propensity Score Models? Comparing Methods of Propensity Score Matching
Open accessAbstract
OBJECTIVE A large number of possible techniques are available when conducting matching procedures, yet coherent guidelines for selecting the most appropriate application do not yet exist. In this article we evaluate several matching techniques and provide a suggested guideline for selecting the best technique. METHODS The main purpose of a matching procedure is to reduce selection bias by increasing the balance between the treatment and control groups. The following approach, consisting of five quantifiable steps, is proposed to check for balance: 1) Using two sample t-statistics to compare the means of the treatment and control groups for each explanatory variable; 2) Comparing the mean difference as a percentage of the average standard deviations; 3) Comparing percent reduction of bias in the means of the explanatory variables before and after matching; 4) Comparing treatment and control density estimates for the explanatory variables; and 5) Comparing the density estimates of the propensity scores of the control units with those of the treated units. We investigated seven different matching techniques and how they performed with regard to proposed five steps. Moreover, we estimate the average treatment effect with multivariate analysis and compared the results with the estimates of propensity score matching techniques. The Medstat MarketScan Data Base provided data for use in empirical examples of the utility of several matching methods. We conducted nearest neighborhood matching (NNM) analyses in seven ways: replacement, 2 to 1 matching, Mahalanobis matching (MM), MM with caliper, kernel matching, radius matching, and the stratification method. RESULTS Comparing techniques according to the above criteria revealed that the choice of matching has significant effects on outcomes. Patients with asthma are compared with patients without asthma and cost of illness ranged from 2040 dollars to 4463 dollars depending on the type of matching. After matching, we looked at the insignificant differences or larger P-values in the mean values (criterion 1); low mean differences as a percentage of the average standard deviation (criterion 2); 100% reduction bias in the means of explanatory variables (criterion 3); and insignificant differences when comparing the density estimates of the treatment and control groups (criterion 4 and criterion 5). Mahalanobis matching with caliber yielded the better results according all five criteria (Mean = 4463 dollars, SD = 3252 dollars). We also applied multivariate analysis over the matched sample. This decreased the deviation in cost of illness estimates more than threefold (Mean = 4456 dollars, SD = 996 dollars). CONCLUSION Sensitivity analysis of the matching techniques is especially important because none of the proposed methods in the literature is a priori superior to the others. The suggested joint consideration of propensity score matching and multivariate analysis offers an approach to assessing the robustness of the estimates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Hosmer, D. W., & Lemeshow, S. (2000) · doi:10.1002/0471722146 · Cited by 20,302
Practical Nonparametric Statistics
Groggel, D. J. (2000) · Technometrics · doi:10.1080/00401706.2000.10486067 · Cited by 11,041
Matching as an econometric evaluation estimator: Evidence from evaluating a job training programme
Heckman, J. J., Ichimura, H., & Todd, P. E. (1997) · The Review of Economic Studies · doi:10.2307/2971733 · Cited by 5,486
Propensity Score-Matching Methods for Nonexperimental Causal Studies
Dehejia, R. H., & Wahba, S. (2002) · Review of Economics and Statistics · doi:10.1162/003465302317331982 · Cited by 4,846
Does matching overcome lalonde’s critique of nonexperimental estimators?
A. Smith, J., & E. Todd, P. (2005) · Journal of Econometrics · doi:10.1016/j.jeconom.2004.04.011 · Cited by 3,176
The Economics and Econometrics of Active Labor Market Programs
Heckman, J. J., Lalonde, R. J., & Smith, J. A. (1999) · Handbook of Labor Economics · doi:10.1016/s1573-4463(99)03012-6 · Cited by 3,059
Evaluation: A Systematic Approach
Rossi, P. H., Lipsey, M. W., & Freeman, H. E. (1979) · Cited by 2,943
Estimating Causal Effects from Large Data Sets Using Propensity Scores
Rubin, D. B. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-8_part_2-199710151-00064 · Cited by 2,877
Cited by
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Kim, M. H., Johnston, S. S., Chu, B.-C., Dalal, M. R., & Schulman, K. L. (2011) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.110.958165 · Cited by 793
Internet use and depression among older adults
Cotten, S. R., Ford, G., Ford, S., & Hale, T. M. (2012) · Computers in Human Behavior · doi:10.1016/j.chb.2011.10.021 · Cited by 330
Johnson, M. L., Crown, W., Martin, B. C., Dormuth, C. R., & Siebert, U. (2009) · Value in Health · doi:10.1111/j.1524-4733.2009.00602.x · Cited by 285
Landreneau, R. J., Normolle, D. P., Christie, N. A., Awais, O., Wizorek, J. J., Abbas, G., Pennathur, A., Shende, M., Weksler, B., Luketich, J. D., et al. (2014) · Journal of Clinical Oncology · doi:10.1200/jco.2013.50.8762 · Cited by 272
Metadata
- Authors
- Baser, O.
- Venue
- Value in Health
- Publisher
- Elsevier BV
- Published
- 2006-11
- Volume
- 9
- Issue
- 6
- Pages
- 377-385
- ISSN
- 1098-3015 (ISSN-L)
- OpenAlex
- W2060420558
- Cited by
- 372
- References
- 39
- FWCI
- 9.46
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Too Much Ado about Propensity Score Models? Comparing Methods of Propensity Score Matching. https://app.cochat.ai/papers/10.1111/j.1524-4733.2006.00130.x
- The paper
- Baser, O. (2006). Too Much Ado about Propensity Score Models? Comparing Methods of Propensity Score Matching. Value in Health. https://doi.org/10.1111/j.1524-4733.2006.00130.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.