Marginal mean weighting through stratification: A generalized method for evaluating multivalued and multiple treatments with nonexperimental data
The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
Propensity score matching and stratification enable researchers to make statistical adjustment for a large number of observed covariates in nonexperimental data. These methods have recently become popular in psychological research. Yet their applications to evaluations of multi-valued and multiple treatments are limited. The inverse-probability-of-treatment weighting method, though suitable for evaluating multi-valued and multiple treatments, often generates results that are not robust when only a portion of the population provides support for causal inference or when the functional form of the propensity score model is misspecified. The marginal mean weighting through stratification (MMW-S) method promises a viable nonparametric solution to these problems. By computing weights on the basis of stratified propensity scores, MMW-S adjustment equates the pretreatment composition of multiple treatment groups under the assumption that unmeasured covariates do not confound the treatment effects given the observed covariates. Analyzing data from a weighted sample, researchers can estimate a causal effect by computing the difference between the estimated average potential outcomes associated with alternative treatments within the analysis of variance framework. After providing an intuitive illustration of the theoretical rationale underlying the weighting method for causal inferences, the article demonstrates how to apply the MMW-S method to evaluations of treatments measured on a binary, ordinal, or nominal scale approximating a completely randomized experiment; to studies of multiple concurrent treatments approximating factorial randomized designs; and to moderated treatment effects approximating randomized block designs. The analytic procedure is illustrated with an evaluation of educational services for English language learners attending kindergarten in the United States.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In particular, we use the marginal mean weighting through stratification (MMWS) approach (Hong, 2012).”
From The effects of uppercase vs. lowercase letters on consumers’ perceptions and brand attitudes (2021) · cites this paper as Hong, 2012
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
An Introduction to Categorical Data Analysis
Agresti, A. (2007) · Wiley Series in Probability and Statistics · doi:10.1002/0470114754 · Cited by 6,689
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
A generalization of sampling without replacement from a finite universe
Horvitz, D. G., & Thompson, D. J. (1952) · Journal of the American Statistical Association · doi:10.1080/01621459.1952.10483446 · Cited by 4,293
Austin, P. C. (2011) · Pharmaceutical Statistics · doi:10.1002/pst.433 · Cited by 3,949
Reducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082
A Generalization of Sampling Without Replacement From a Finite Universe
Horvitz, D. G., & Thompson, D. J. (1952) · Journal of the American Statistical Association · doi:10.2307/2280784 · Cited by 3,011
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
Estimating Causal Effects from Large Data Sets Using Propensity Scores
Rubin, D. B. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-8_part_2-199710151-00064 · Cited by 2,877
Cited by
Items 101–106 of 106
Oregon’s Transitional Leave Program and Recidivism
Leymon, M. H., Campbell, C. M., & Henning, K. (2023) · Criminal Justice and Behavior · doi:10.1177/00938548231208192
“We employed a PSM approach known as marginal means weighting through stratification (MMW-S; Hong, 2010, 2012) to assess the association between the “dosage” or length of STTL received and recidivism.”
MethodHo, E., SELTZER, M. H., & Jeon, M. (2024) · PLoS ONE · doi:10.1371/journal.pone.0300587 · Cited by 1
How Brands can Capitalize on Retailers' Temporary Reward ProgramsPreprint
Bombaij, N. J. F., Gelper, S., & Dekimpe, M. G. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5408926
Reward-Program Promotions: How Brands Can Capitalize on Retailers’ Temporary Reward Programs
Bombaij, N. J. F., Gelper, S., & Dekimpe, M. G. (2026) · Journal of Marketing · doi:10.1177/00222429261417962
Mishima, R., & Koide, D. (2026) · Drugs - Real World Outcomes · doi:10.1007/s40801-026-00567-5
Campbell, V. A., Britton, T., & Chelliah, B. (2026) · The Journal of Higher Education · doi:10.1080/00221546.2026.2706434
Metadata
- Authors
- Hong, G.
- Affiliations
- University of Chicago (US)
- Corresponding author
- Hong, Guanglei
- ORCID
- Hong, Guanglei
- Venue
- Psychological Methods
- Published
- 2012-03
- Volume
- 17
- Issue
- 1
- Pages
- 44-60
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W1993260957
- Cited by
- 105
- References
- 46
- Citations by year
- 2026: 5 · 2025: 3 · 2024: 7 · 2023: 12 · 2022: 4 · 2021: 6 · 2020: 9 · 2019: 5 · 2018: 13 · 2017: 5 · 2016: 9 · 2015: 19 · 2014: 4 · 2013: 2 · 2012: 1
- FWCI
- 2.25
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Spencer Foundation
- Social Sciences and Humanities Research Council of Canada
- National Academy of Education
- William T. Grant Foundation
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- multiple treatments, nonparametric causal inference, inverse probability of treatment weighting, factorial design, kindergarten, non-experimental data
- MeSH terms
- Analysis of Variance, Child, Data Interpretation, Statistical, Humans, Learning, Longitudinal Studies, Models, Theoretical, Research Design, Vocabulary, Models, Statistical, Program Evaluation, Selection Bias, Causality, Randomized Controlled Trials as Topic, Statistics, Nonparametric, Propensity Score
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.