The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Marginal mean weighting through stratification: A generalized method for evaluating multivalued and multiple treatments with nonexperimental data
Abstract
Propensity score matching and stratification enable researchers to make statistical adjustment for a large number of observed covariates in nonexperimental data. These methods have recently become popular in psychological research. Yet their applications to evaluations of multi-valued and multiple treatments are limited. The inverse-probability-of-treatment weighting method, though suitable for evaluating multi-valued and multiple treatments, often generates results that are not robust when only a portion of the population provides support for causal inference or when the functional form of the propensity score model is misspecified. The marginal mean weighting through stratification (MMW-S) method promises a viable nonparametric solution to these problems. By computing weights on the basis of stratified propensity scores, MMW-S adjustment equates the pretreatment composition of multiple treatment groups under the assumption that unmeasured covariates do not confound the treatment effects given the observed covariates. Analyzing data from a weighted sample, researchers can estimate a causal effect by computing the difference between the estimated average potential outcomes associated with alternative treatments within the analysis of variance framework. After providing an intuitive illustration of the theoretical rationale underlying the weighting method for causal inferences, the article demonstrates how to apply the MMW-S method to evaluations of treatments measured on a binary, ordinal, or nominal scale approximating a completely randomized experiment; to studies of multiple concurrent treatments approximating factorial randomized designs; and to moderated treatment effects approximating randomized block designs. The analytic procedure is illustrated with an evaluation of educational services for English language learners attending kindergarten in the United States.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In particular, we use the marginal mean weighting through stratification (MMWS) approach (Hong, 2012).”
From The effects of uppercase vs. lowercase letters on consumers’ perceptions and brand attitudes (2021) · cites this paper as Hong, 2012
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
An Introduction to Categorical Data Analysis
Agresti, A. (2007) · Wiley Series in Probability and Statistics · doi:10.1002/0470114754 · Cited by 6,689
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
A generalization of sampling without replacement from a finite universe
Horvitz, D. G., & Thompson, D. J. (1952) · Journal of the American Statistical Association · doi:10.1080/01621459.1952.10483446 · Cited by 4,293
Austin, P. C. (2011) · Pharmaceutical Statistics · doi:10.1002/pst.433 · Cited by 3,949
Reducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082
A Generalization of Sampling Without Replacement From a Finite Universe
Horvitz, D. G., & Thompson, D. J. (1952) · Journal of the American Statistical Association · doi:10.2307/2280784 · Cited by 3,011
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
Estimating Causal Effects from Large Data Sets Using Propensity Scores
Rubin, D. B. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-8_part_2-199710151-00064 · Cited by 2,877
Cited by
Statistical mediation analysis with a multicategorical independent variable
Hayes, A. F., & Preacher, K. J. (2014) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12028 · Cited by 3,403
“…certain alternative explanations, and more complex statistical approaches than we discuss here can be used in non-experimental studieswhen causal inference is less justified due to limitations of the design (such as non-random assignment; see, for example, Hong, 2012; Muth en, 2011; Pearl, 2012).”
MethodJiang, F., & McComas, W. F. (2015) · International Journal of Science Education · doi:10.1080/09500693.2014.1000426 · Cited by 167
“causal inference, the propensity score analysis was performed within the marginal mean weighting through stratification (MMW-S) approach (Hong, 2012).”
BackgroundMethodInfluentialEstimating causal effects for multivalued treatments: a comparison of approaches
Linden, A., Uysal, S. D., Ryan, A. M., & Adams, J. (2015) · Statistics in Medicine · doi:10.1002/sim.6768 · Cited by 165
WeightIt: Weighting for Covariate Balance in Observational Studies
Greifer, N. (2017) · doi:10.32614/cran.package.weightit · Cited by 97
Sheth, D. S., Cafri, G., Paxton, E. W., & Namba, R. S. (2016) · The Journal of Arthroplasty · doi:10.1016/j.arth.2016.03.018 · Cited by 87
“All models we fit address device/ person-level confounding using average treatment effect propensity score weights [25,26].”
BackgroundMethod
Metadata
- Authors
- Hong, G.
- Affiliations
- University of Chicago (US)
- Corresponding author
- Hong, Guanglei
- ORCID
- Hong, Guanglei
- Venue
- Psychological Methods
- Published
- 2012-03
- Volume
- 17
- Issue
- 1
- Pages
- 44-60
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W1993260957
- Cited by
- 105
- References
- 46
- Citations by year
- 2026: 5 · 2025: 3 · 2024: 7 · 2023: 12 · 2022: 4 · 2021: 6 · 2020: 9 · 2019: 5 · 2018: 13 · 2017: 5 · 2016: 9 · 2015: 19 · 2014: 4 · 2013: 2 · 2012: 1
- FWCI
- 2.25
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Spencer Foundation
- Social Sciences and Humanities Research Council of Canada
- National Academy of Education
- William T. Grant Foundation
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- multiple treatments, nonparametric causal inference, inverse probability of treatment weighting, factorial design, kindergarten, non-experimental data
- MeSH terms
- Analysis of Variance, Child, Data Interpretation, Statistical, Humans, Learning, Longitudinal Studies, Models, Theoretical, Research Design, Vocabulary, Models, Statistical, Program Evaluation, Selection Bias, Causality, Randomized Controlled Trials as Topic, Statistics, Nonparametric, Propensity Score
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Marginal mean weighting through stratification: A generalized method for evaluating multivalued and multiple treatments with nonexperimental data. https://app.cochat.ai/papers/10.1037/a0024918
- The paper
- Hong, G. (2012). Marginal mean weighting through stratification: A generalized method for evaluating multivalued and multiple treatments with nonexperimental data. Psychological Methods. https://doi.org/10.1037/a0024918
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.