Propensity score matching and complex surveys
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Researchers are increasingly using complex population-based sample surveys to estimate the effects of treatments, exposures and interventions. In such analyses, statistical methods are essential to minimize the effect of confounding due to measured covariates, as treated subjects frequently differ from control subjects. Methods based on the propensity score are increasingly popular. Minimal research has been conducted on how to implement propensity score matching when using data from complex sample surveys. We used Monte Carlo simulations to examine two critical issues when implementing propensity score matching with such data. First, we examined how the propensity score model should be formulated. We considered three different formulations depending on whether or not a weighted regression model was used to estimate the propensity score and whether or not the survey weights were included in the propensity score model as an additional covariate. Second, we examined whether matched control subjects should retain their natural survey weight or whether they should inherit the survey weight of the treated subject to which they were matched. Our results were inconclusive with respect to which method of estimating the propensity score model was preferable. In general, greater balance in measured baseline covariates and decreased bias was observed when natural retained weights were used compared to when inherited weights were used. We also demonstrated that bootstrap-based methods performed well for estimating the variance of treatment effects when outcomes are binary. We illustrated the application of our methods by using the Canadian Community Health Survey to estimate the effect of educational attainment on lifetime prevalence of mood or anxiety disorders.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Austin, P. C. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.568786 · Cited by 12,242 · cited 1×
“An important class of statistical methods comprises those that are based on the propensity score.(1,2) The propensity score is the probability of treatment selection conditional on observed baseline covariates.”
Self-citationEstimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436 · cited 1×
“Prior to presenting alternate estimators, we briefly introduce the potential outcomes framework.(12) Let Y(1) and Y(0) denote the potential outcomes observed under the active treatment (Z1⁄4 1) and the control treatment (Z1⁄4 0), respectively.”
MethodAustin, P. C. (2009) · Statistics in Medicine · doi:10.1002/sim.3697 · Cited by 6,758 · cited 2×
“In each of the six matched samples, balance in the measured baseline covariates was assessed using standardized differences estimated in the weighted sample.(23) The effect of exposure on the outcome was determined by estimating the prevalence of the outcome in exposed and control subjects separately in the matched sa…”
MethodSelf-citationAustin, P. C. (2011) · Pharmaceutical Statistics · doi:10.1002/pst.433 · Cited by 3,949 · cited 2×
“2 of the standard deviation of the logit of the propensity score.(15,17) This method was selected because it was shown to have superior performance compared to NNM and optimal matching.”
BackgroundMethodSelf-citationA comparison of 12 algorithms for matching on the propensity score
Austin, P. C. (2014) · Statistics in Medicine · doi:10.1002/sim.6004 · Cited by 1,085
Self-citationAustin, P. C. (2009) · Biometrical Journal · doi:10.1002/bimj.200810488 · Cited by 769 · cited 2×
“This method was selected because it was shown to have superior performance compared to NNM and optimal matching.(14,20) Subjects were matched on only the propensity score and not on stratum or cluster, as these identifiers are often not available to the analyst (e.”
BackgroundMethodSelf-citationGeneralizing Observational Study Results: Applying Propensity Score Methods to Complex Surveys
DuGoff, E. H., Schuler, M., & Stuart, E. A. (2014) · Health Services Research · doi:10.1111/1475-6773.12090 · Cited by 605
Gayat, E., Resche‐Rigon, M., Mary, J., & Porcher, R. (2012) · Pharmaceutical Statistics · doi:10.1002/pst.537 · Cited by 136
Cited by
Forke, C. M., Catallozzi, M., Localio, A. R., Grisso, J. A., Wiebe, D. J., & Fein, J. A. (2019) · Preventive Medicine Reports · doi:10.1016/j.pmedr.2019.100942 · Cited by 63
Active gingival inflammation is linked to hypertension
Pietropaoli, D., Monaco, A., D’Aiuto, F., Muñoz Aguilera, E., Ortu, E., Giannoni, M., Czesnikiewicz-Guzik, M., Guzik, T. J., Ferri, C., & Del Pinto, R. (2020) · Journal of Hypertension · doi:10.1097/hjh.0000000000002514 · Cited by 56
“In order to test our hypothesis in a controlled setting, we adopted a surveybased propensity score matching (PSM) [29,30] a technique used in observational studies to aid in the evaluation of cause–effect hypotheses [29,31] and to reduce bias in the effect estimates by ensuring balance on the observed variables betwee…”
Method
Metadata
- Authors
- Austin, P. C., Jembere, N., & Chiu, M.
- Venue
- Statistical Methods in Medical Research
- Publisher
- SAGE Publications
- Published
- 2016-07-26
- Volume
- 27
- Issue
- 4
- Pages
- 1240-1257
- ISSN
- 0962-2802 (ISSN-L)
- 1477-0334
- OpenAlex
- W2484604119
- Cited by
- 181
- References
- 8
- FWCI
- 8.12
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Propensity score matching and complex surveys. https://app.cochat.ai/papers/10.1177/0962280216658920
- The paper
- Austin, P. C., Jembere, N., & Chiu, M. (2018). Propensity score matching and complex surveys. Statistical Methods in Medical Research. https://doi.org/10.1177/0962280216658920
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.