CoChat

Marginal mean weighting through stratification: A generalized method for evaluating multivalued and multiple treatments with nonexperimental data

Hong, Guanglei · 2012 · Psychological Methods

The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.

Abstract

Propensity score matching and stratification enable researchers to make statistical adjustment for a large number of observed covariates in nonexperimental data. These methods have recently become popular in psychological research. Yet their applications to evaluations of multi-valued and multiple treatments are limited. The inverse-probability-of-treatment weighting method, though suitable for evaluating multi-valued and multiple treatments, often generates results that are not robust when only a portion of the population provides support for causal inference or when the functional form of the propensity score model is misspecified. The marginal mean weighting through stratification (MMW-S) method promises a viable nonparametric solution to these problems. By computing weights on the basis of stratified propensity scores, MMW-S adjustment equates the pretreatment composition of multiple treatment groups under the assumption that unmeasured covariates do not confound the treatment effects given the observed covariates. Analyzing data from a weighted sample, researchers can estimate a causal effect by computing the difference between the estimated average potential outcomes associated with alternative treatments within the analysis of variance framework. After providing an intuitive illustration of the theoretical rationale underlying the weighting method for causal inferences, the article demonstrates how to apply the MMW-S method to evaluations of treatments measured on a binary, ordinal, or nominal scale approximating a completely randomized experiment; to studies of multiple concurrent treatments approximating factorial randomized designs; and to moderated treatment effects approximating randomized block designs. The analytic procedure is illustrated with an evaluation of educational services for English language learners attending kindergarten in the United States.

Overview

Integrity signals

Registry

Crossref · 10.1037/a0024918

Cites

47 of 47 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Cited by

See all 106

Metadata

Authors
Hong, G.
Affiliations
University of Chicago (US)
Corresponding author
Hong, Guanglei
Venue
Psychological Methods
Published
2012-03
Volume
17
Issue
1
Pages
44-60
ISSN
  • 1082-989X (ISSN-L)
  • 1939-1463
OpenAlex
W1993260957
Cited by
105
References
46
Citations by year
2026: 5 · 2025: 3 · 2024: 7 · 2023: 12 · 2022: 4 · 2021: 6 · 2020: 9 · 2019: 5 · 2018: 13 · 2017: 5 · 2016: 9 · 2015: 19 · 2014: 4 · 2013: 2 · 2012: 1
FWCI
2.25
Type
journal article
Language
en
Open access
closed
Locations
  • Psychological Methods (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • Spencer Foundation
  • Social Sciences and Humanities Research Council of Canada
  • National Academy of Education
  • William T. Grant Foundation
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
  • Social Sciences › Public Administration › Evaluation and Performance Assessment
Keywords
multiple treatments, nonparametric causal inference, inverse probability of treatment weighting, factorial design, kindergarten, non-experimental data
MeSH terms
Analysis of Variance, Child, Data Interpretation, Statistical, Humans, Learning, Longitudinal Studies, Models, Theoretical, Research Design, Vocabulary, Models, Statistical, Program Evaluation, Selection Bias, Causality, Randomized Controlled Trials as Topic, Statistics, Nonparametric, Propensity Score

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.