CoChat

Selecting an Appropriate Caliper Can Be Essential for Achieving Good Balance With Propensity Score Matching

Open access
Lunt, Mark · 2014 · American Journal of Epidemiology

The DOI matches its Crossref record; 23 of the 25 references it cites were found in a registry or an index.

Abstract

Matching on the propensity score is widely used to estimate the effect of an exposure in observational studies. However, the quality of the matches can be affected by decisions made during the matching process, particularly the order in which subjects are selected for matching and the maximum permitted difference between matched subjects (the "caliper"). This study used simulations to explore the effects of these decisions on both the imbalance of covariates and the closeness of matching, while allowing the numbers of potential matches and strengths of association between the confounding variable and the exposure to vary. It was found that, without a caliper, substantial bias was possible, particularly with a relatively small reservoir of potential matches and strong confounder-exposure association. Use of the recommended caliper reduced the bias considerably, but bias remained if subjects were selected by increasing or decreasing propensity score. A tighter caliper led to greatly reduced bias and closer matches, although some subjects could not be matched. This study suggests that a narrow caliper can improve the performance of propensity score matching. In situations where it is impossible to find appropriate matches for all exposed subjects, it is better to select subjects in order of the best available matches, rather than increasing or decreasing the propensity score.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/aje/kwt212

Cites

23 of 23 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1. Distribution of X in exposed and unexposed subjects when the log of the odds ratio for the effect of X on exposure takes the values A) 1.5, B) 2, C) 5, and D) 10. The solid line represents treated subjects, and the dashed line represents untreated subjects.
Figure 1. Distribution of X in exposed and unexposed subjects when the log of the odds ratio for the effect of X on exposure takes the values A) 1.5, B) 2, C) 5, and D) 10. The solid line represents treated subjects, and the dashed line represents untreated subjects.CC BY-NC · PubMed Central
Figure 2. Scatter plot of X in matched control against X in exposed subject when no caliper is used. A and C show the results when there are 2 controls per case; B and D show 10 controls per case. In A and B, the odds ratio for the effect of X on exposure is 1.5, and in C and D it is 10. Matching methods used are symbolized as follows: blue x, descending; red o, ascending; yellow x, random; green o, best-first; and brown +, 5-to-1-digit. The diagonal line represents perfect matches.
Figure 2. Scatter plot of X in matched control against X in exposed subject when no caliper is used. A and C show the results when there are 2 controls per case; B and D show 10 controls per case. In A and B, the odds ratio for the effect of X on exposure is 1.5, and in C and D it is 10. Matching methods used are symbolized as follows: blue x, descending; red o, ascending; yellow x, random; green o, best-first; and brown +, 5-to-1-digit. The diagonal line represents perfect matches.CC BY-NC · PubMed Central
Figure 3. Scatter plot of X in matched control against X in exposed subject by using 0.25-standard deviation caliper. A and C show the results when there are 2 controls per case, and B and D show 10 controls per case. In A and B, the odds ratio for the effect of X on exposure is 1.5, and in C and D it is 10. Matching methods used are symbolized as follows: blue x, descending; red o, ascending; yellow x, random; green o, best-first; and brown +, 5-to-1-digit.
Figure 3. Scatter plot of X in matched control against X in exposed subject by using 0.25-standard deviation caliper. A and C show the results when there are 2 controls per case, and B and D show 10 controls per case. In A and B, the odds ratio for the effect of X on exposure is 1.5, and in C and D it is 10. Matching methods used are symbolized as follows: blue x, descending; red o, ascending; yellow x, random; green o, best-first; and brown +, 5-to-1-digit.CC BY-NC · PubMed Central
Figure 4. Cumulative frequency plot for the magnitude of the difference between the logit of the propensity score for a given exposed subject and the logit of the propensity score for the matched unexposed subject.
Figure 4. Cumulative frequency plot for the magnitude of the difference between the logit of the propensity score for a given exposed subject and the logit of the propensity score for the matched unexposed subject.CC BY-NC · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 23 references

Cited by

See all 371

Metadata

Authors
Lunt, M.
Affiliations
University of Manchester (GB)
Corresponding author
Lunt, Mark
Venue
American Journal of Epidemiology
Published
2013-10-10
Volume
179
Issue
2
Pages
226-235
ISSN
  • 0002-9262 (ISSN-L)
  • 1476-6256
OpenAlex
W2154872949
Cited by
358
References
25
Citations by year
2026: 30 · 2025: 50 · 2024: 21 · 2023: 35 · 2022: 31 · 2021: 39 · 2020: 36 · 2019: 39 · 2018: 24 · 2017: 16 · 2016: 15 · 2015: 16 · 2014: 6
FWCI
10.88
Type
journal article
Language
en
Open access
Licence
cc-by-nc
Locations
  • American Journal of Epidemiology (publishedVersion, cc-by-nc)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
  • PubMed Central (publishedVersion, cc-by-nc)
  • PubMed (publishedVersion)
  • Research Explorer (The University of Manchester) (publishedVersion)
Funders
Versus Arthritis (/17552)
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords
propensity score matching, covariate imbalance, matching bias, confounding, observational studies
MeSH terms
Epidemiologic Methods, Humans, Bias, Propensity Score

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Selecting an Appropriate Caliper Can Be Essential for Achieving Good Balance With Propensity Score Matching. https://app.cochat.ai/papers/10.1093/aje/kwt212
The paper
Lunt, M. (2014). Selecting an Appropriate Caliper Can Be Essential for Achieving Good Balance With Propensity Score Matching. American Journal of Epidemiology. https://doi.org/10.1093/aje/kwt212

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.