Marginal mean weighting through stratification: A generalized method for evaluating multivalued and multiple treatments with nonexperimental data
The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Abstract
Propensity score matching and stratification enable researchers to make statistical adjustment for a large number of observed covariates in nonexperimental data. These methods have recently become popular in psychological research. Yet their applications to evaluations of multi-valued and multiple treatments are limited. The inverse-probability-of-treatment weighting method, though suitable for evaluating multi-valued and multiple treatments, often generates results that are not robust when only a portion of the population provides support for causal inference or when the functional form of the propensity score model is misspecified. The marginal mean weighting through stratification (MMW-S) method promises a viable nonparametric solution to these problems. By computing weights on the basis of stratified propensity scores, MMW-S adjustment equates the pretreatment composition of multiple treatment groups under the assumption that unmeasured covariates do not confound the treatment effects given the observed covariates. Analyzing data from a weighted sample, researchers can estimate a causal effect by computing the difference between the estimated average potential outcomes associated with alternative treatments within the analysis of variance framework. After providing an intuitive illustration of the theoretical rationale underlying the weighting method for causal inferences, the article demonstrates how to apply the MMW-S method to evaluations of treatments measured on a binary, ordinal, or nominal scale approximating a completely randomized experiment; to studies of multiple concurrent treatments approximating factorial randomized designs; and to moderated treatment effects approximating randomized block designs. The analytic procedure is illustrated with an evaluation of educational services for English language learners attending kindergarten in the United States.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In particular, we use the marginal mean weighting through stratification (MMWS) approach (Hong, 2012).”
From The effects of uppercase vs. lowercase letters on consumers’ perceptions and brand attitudes (2021) · cites this paper as Hong, 2012
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,265
An Introduction to Categorical Data Analysis
Agresti, A. (2007) · Wiley Series in Probability and Statistics · doi:10.1002/0470114754 · Cited by 6,689
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
A generalization of sampling without replacement from a finite universe
Horvitz, D. G., & Thompson, D. J. (1952) · Journal of the American Statistical Association · doi:10.1080/01621459.1952.10483446 · Cited by 4,293
Austin, P. C. (2011) · Pharmaceutical Statistics · doi:10.1002/pst.433 · Cited by 3,949
Reducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082
A Generalization of Sampling Without Replacement From a Finite Universe
Horvitz, D. G., & Thompson, D. J. (1952) · Journal of the American Statistical Association · doi:10.2307/2280784 · Cited by 3,011
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
Estimating Causal Effects from Large Data Sets Using Propensity Scores
Rubin, D. B. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-8_part_2-199710151-00064 · Cited by 2,877
Cited by
Statistical mediation analysis with a multicategorical independent variable
Hayes, A. F., & Preacher, K. J. (2014) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12028 · Cited by 3,403
“…certain alternative explanations, and more complex statistical approaches than we discuss here can be used in non-experimental studieswhen causal inference is less justified due to limitations of the design (such as non-random assignment; see, for example, Hong, 2012; Muth en, 2011; Pearl, 2012).”
MethodJiang, F., & McComas, W. F. (2015) · International Journal of Science Education · doi:10.1080/09500693.2014.1000426 · Cited by 167
“causal inference, the propensity score analysis was performed within the marginal mean weighting through stratification (MMW-S) approach (Hong, 2012).”
BackgroundMethodInfluentialEstimating causal effects for multivalued treatments: a comparison of approaches
Linden, A., Uysal, S. D., Ryan, A. M., & Adams, J. (2015) · Statistics in Medicine · doi:10.1002/sim.6768 · Cited by 165
WeightIt: Weighting for Covariate Balance in Observational Studies
Greifer, N. (2017) · doi:10.32614/cran.package.weightit · Cited by 102
Sheth, D. S., Cafri, G., Paxton, E. W., & Namba, R. S. (2016) · The Journal of Arthroplasty · doi:10.1016/j.arth.2016.03.018 · Cited by 87
“All models we fit address device/ person-level confounding using average treatment effect propensity score weights [25,26].”
BackgroundMethodStatistics in Brief: An Introduction to the Use of Propensity Scores
Inacio, M. C. S., Chen, Y., Paxton, E. W., Namba, R. S., Kurtz, S. M., & Cafri, G. (2015) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-015-4239-4 · Cited by 86
“However, one method, marginal mean weighting through stratification, does include such restrictions [9, 10].”
MethodChinese development assistance and household welfare in Sub-Saharan Africa
Martorano, B., Metzger, L., & Sanfilippo, M. (2020) · World Development · doi:10.1016/j.worlddev.2020.104909 · Cited by 96
“Moreover, we apply an extension to our analysis by using the propensity score-based marginal mean weighting through stratification (MMWS) method (Hong, 2010; Hong, 2012; Huang et al 2005).”
MethodLinden, A. (2014) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12254 · Cited by 83
Inacio, M. C. S., Cafri, G., Paxton, E. W., Kurtz, S. M., & Namba, R. S. (2013) · Acta Orthopaedica · doi:10.3109/17453674.2013.784660 · Cited by 67
“Given the non-randomized nature of the bearing surface group assignment, counfounding was addressed using a weighted propensity score approach (Hong 2010, 2012).”
MethodLeite, W. L., Jimenez, F., Kaya, Y., Stapleton, L. M., MacInnes, J. W., & Sandbach, R. (2015) · Multivariate Behavioral Research · doi:10.1080/00273171.2014.991018 · Cited by 76
“PS stratification weights for estimating the ATE and for multiple treatments are presented in Hong (2010, 2012).”
BackgroundMethodHong, G., Corter, C. M., Hong, Y., & Pelletier, J. (2011) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373711424206 · Cited by 81
“This causal inference strategy originated from the rationale provided by Rosenbaum (1987) and Imbens (2000) and has been lately formalized (Hong, 2010, 2011) and applied in epidemiological and educational research (Hong & Hong, 2009; Huang, Frangakis, Dominici, Diette, & Wu, 2005).”
MethodSelf-citationWarne, R. T., Larsen, R., Anderson, B., & Odasso, A. J. (2015) · The Journal of Educational Research · doi:10.1080/00220671.2014.917253 · Cited by 74
“Marginal mean weights are analogous to sampling weights in survey research where certain sample members are weighted to compensate for sampling or response bias (Hong, 2012).”
BackgroundMethodInfluentialTraining and performance in SMEs: Empirical evidence from large-scale data from the UK
Idris, B., Saridakis, G., & Johnstone, S. (2020) · Journal of Small Business Management · doi:10.1080/00472778.2020.1816431 · Cited by 87
“For estimating propensity scores for nominal treatments, a multinomial logistic regression is used, utilising the Marginal Mean Weighting through Stratification (MMWS) method (Huang et al. 2005; Hong, 2010; 2012; Linden, 2014).”
MethodWeighting-Based Sensitivity Analysis in Causal Mediation Studies
Hong, G., Qin, X., & Yang, F. (2018) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998617749561 · Cited by 51
“Researchers (Hong, 2010b, 2012, 2015; Huang, Frangakis, Dominici, Diette, & Wu, 2005) have also developed a marginal mean weighting through stratification method as an alternative to IPTW for removing bias in treatment evaluation.”
MethodSelf-citationThe effect of perceived brand leadership on luxury service WOM
Chang, Y., Ko, Y. J., & Leite, W. L. (2016) · Journal of Services Marketing · doi:10.1108/jsm-01-2015-0005 · Cited by 74
Hong, G., Deutsch, J., & Hill, H. D. (2015) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998615583902 · Cited by 53
“In contrast, nonparametric weighting methods, such as marginal mean weighting through stratification (MMWS), produce robust results despite such misspecifications (Hong, 2010b, 2012).”
Self-citationVariation in the incarceration length-recidivism dose–response relationship
Rydberg, J., & Clark, K. (2016) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2016.04.002 · Cited by 53
Paxton, E. W., Inacio, M. C. S., Kurtz, S. M., Love, R. M., Cafri, G., & Namba, R. S. (2015) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-014-4046-3 · Cited by 51
“Because tibial insert material was not randomly assigned, we addressed possible confounding using a weighted propensity score approach [7, 8].”
MethodTeng, L., Xie, C., Liu, T., Wang, F., & Foti, L. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2021.07.037 · Cited by 42
“In particular, we use the marginal mean weighting through stratification (MMWS) approach (Hong, 2012).”
MethodLinden, A. (2017) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12714 · Cited by 49
Propensity Score Matching for Education Data: Worked Examples
Powell, M. G., Hull, D. M., & Beaujean, A. A. (2020) · The Journal of Experimental Education · doi:10.1080/00220973.2018.1541850 · Cited by 40
“More-complex models include probability weights to correct for selection bias (e.g., Hong, 2012).”
BackgroundTreatment of Intertrochanteric Femur Fractures with Long versus Short Cephalomedullary Nails
Sadeghi, C., Prentice, H. A., Okike, K. M., & Paxton, E. W. (2020) · The Permanente Journal · doi:10.7812/tpp/19.229 · Cited by 40
Melli, G., Chiorri, C., Carraresi, C., Stopani, E., & Bulli, F. (2015) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2015.07.001 · Cited by 43
Melli, G., Chiorri, C., Bulli, F., Carraresi, C., Stopani, E., & Abramowitz, J. S. (2014) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-014-9450-1 · Cited by 44
“We used a propensity score approach for polytomous categorical grouping variables, the marginal mean weighting through stratification (MMW-S; Hong 2012), that allowed us to adjust the effects of group membership for the differences in socio-demographical variables and to control the effects of these potentially confou…”
MethodVäätäinen, S. T., Keinanen-Kiukaanniemi, S. M., Saramies, J., Uusitalo, H. M. T., Tuomilehto, J. O., & Martikainen, J. A. (2014) · Quality of Life Research · doi:10.1007/s11136-014-0638-3 · Cited by 41
Consumers’ perceived post purchase risk in luxury services
Chang, Y., & Ko, Y. J. (2016) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2016.09.005 · Cited by 42
Dewi, A. U. (2021) · Jurnal Cakrawala Pendidikan · doi:10.21831/cp.v40i1.33821 · Cited by 78
“The next step was to conduct a propensity score analysis with weighting process that is often called by inverse probability of treatment weighting (Fan & Nowell, 2011; Hong, 2012; Rosenbaum & Rubin, 1984).”
MethodLinden, A., & Yarnold, P. R. (2016) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12610 · Cited by 38
Cafri, G., Paxton, E. W., Love, R. M., Bini, S. A., & Kurtz, S. M. (2016) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-016-4966-1 · Cited by 30
Sources of information and portfolio allocation
Shin, S. H., Kim, K. T., & Seay, M. C. (2019) · Journal of Economic Psychology · doi:10.1016/j.joep.2019.102212 · Cited by 37
Weighting Methods for Assessing Policy Effects Mediated by Peer Change
Hong, G., & Nomi, T. (2012) · Journal of Research on Educational Effectiveness · doi:10.1080/15348431.2012.688421 · Cited by 32
Self-citationCampbell, C. M., Labrecque, R. M., Weinerman, M., & Sanchagrin, K. (2020) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2020.101719 · Cited by 33
Mueller, C. E., Keil, S. I., & Bauer, C. (2018) · Energy Policy · doi:10.1016/j.enpol.2018.10.053 · Cited by 26
Leite, W. L., Stapleton, L. M., & Bettini, E. A. (2018) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2018.1522591 · Cited by 33
“Recently, Hong (2010, 2012)) proposed the method of marginal mean weighting through stratification, which entails creating weights based on the discrepancy between strata membership for a randomized study and strata membership in the non-experimental study of interest.”
MethodHong, G., Yang, F., & Qin, X. (2020) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/rssa.12621 · Cited by 34
“The analyst may stratify the sample on the estimated propensity score and then re-estimate the propensity score according to the observed frequency distribution of treatment assignment within each stratum (Hong, 2010, 2012, 2015; Huang et al, 2005).”
MethodSelf-citationMueller, C. E. (2023) · Journal of Business Venturing Insights · doi:10.1016/j.jbvi.2023.e00408 · Cited by 31
Characteristics of Veteran and Civilian Suicide Decedents: A Sex-Stratified Analysis
Horwitz, A. G., Smith, D. L., Held, P., & Zalta, A. K. (2019) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2018.11.017 · Cited by 23
Linden, A., & Yarnold, P. R. (2017) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12859 · Cited by 17
Impacts of Grouping and Time on the Math Learning of Language Minority Kindergartners
Garrett, R., & Hong, G. (2015) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373715611484 · Cited by 27
“We employ the propensity score-based marginal mean weighting through stratification (MMWS) method (Hong, 2010, 2012, 2015) to equate the observed pretreatment composition among the eight treatment groups within each subpopulation.”
BackgroundMethodSelf-citationHuang, P. S., Cross, M., Gupta, A., Intwala, D., Ruppenkamp, J., & Hoeffel, D. P. (2024) · The Journal of Knee Surgery · doi:10.1055/a-2343-2444 · Cited by 18
“26,27 A total of 200 strata were created, and no individual patient information was discardedusing thismethod.”
BackgroundTriventi, M., Barone, C., & Facchini, M. (2021) · Research in Social Stratification and Mobility · doi:10.1016/j.rssm.2021.100626 · Cited by 26
Limvorapitak, W., Barnett, M. J., Hogge, D. E., Forrest, D. L., Nevill, T. J., Narayanan, S., Power, M. M., Nantel, S. H., Broady, R. C., Song, K., et al. (2018) · Clinical Lymphoma Myeloma & Leukemia · doi:10.1016/j.clml.2018.07.290 · Cited by 15
REVISITING JUVENILE WAIVER: INTEGRATING THE INCAPACITATION EXPERIENCE*
Augustyn, M. B., & McGloin, J. M. (2017) · Criminology · doi:10.1111/1745-9125.12165 · Cited by 15
“The use of propensity scores, though, tends to be limited to the examination of the effect of a single treatment (Hong, 2012).”
Leite, W. L., Aydın, B., & Gürel, S. (2018) · The Journal of Experimental Education · doi:10.1080/00220973.2017.1409179 · Cited by 15
“To address the issue, Hong (2010, 2008, 2012), proposed marginal mean weighting through stratification (MMWTS) which combines propensity score stratification and weighting.”
BackgroundMethodInfluentialRural–urban migration and urban identity differentiation in China
Xie, S., Chen, J., & Zeng-yang, X. (2023) · Eurasian Geography and Economics · doi:10.1080/15387216.2023.2167096 · Cited by 12
“To resolve this issue, we use the propensity score-based marginal mean weighting through stratification (MMW-S) approach proposed by Hong (2010, 2012).”
How Does Undergraduate Debt Affect Graduate School Application and Enrollment?
Chen, R., & Bahr, P. R. (2020) · Research in Higher Education · doi:10.1007/s11162-020-09610-y · Cited by 19
“The MMW-S method is a nonparametric strategy that combines key elements of stratification and IPTW but remedies their main limitations (Hong 2012; Raffaele et al.”
BackgroundMethodInfluentialIm, Y., & VanderWeele, T. J. (2018) · Infant Mental Health Journal · doi:10.1002/imhj.21716 · Cited by 14
Paracetamol use and lowered risk of acute kidney injury in patients with rhabdomyolysis
Desgrouas, M., & Boulain, T. (2021) · Journal of Nephrology · doi:10.1007/s40620-020-00950-7 · Cited by 10
Campbell, C. M., & Labrecque, R. M. (2022) · Journal of Experimental Criminology · doi:10.1007/s11292-022-09532-y · Cited by 11
“We followed the average treatment effect for the treated formula suggested by Hong (2010, 2012), and chose the fewest number of strata necessary for maintaining similar distributions of the propensity score within each stratum.”
Anderson, K. A. (2019) · Journal of Teacher Education · doi:10.1177/0022487119849564 · Cited by 11
“Accordingly, the MMW-S weighting procedure equates the composition of pretreatment variables across all treatment groups, simulating a randomized experiment (Hong, 2012).”
BackgroundMethodInfluentialGorman‐Smith, D., Garthe, R. C., Schoeny, M. E., Cosey-Gay, F. N., Harris, C., Brown, C. H., & Villamar, J. A. (2024) · Prevention Science · doi:10.1007/s11121-024-01707-5 · Cited by 10
“We employed marginal mean weighting through stratification (MMWS) method for propensity score matching of tracts (Hong, 2012, 2015).”
Jung, H., & Seo, E. H. (2018) · Asia Pacific Education Review · doi:10.1007/s12564-018-9570-5 · Cited by 14
Chang, Y., & Katz, M. (2023) · Sport Management Review · doi:10.1080/14413523.2023.2229097 · Cited by 8
“…formally, the afore-mentioned scenario could be summarized as follows: [Y Internal , Y External ]_LOC|Z NBA By following the existing guidelines (Hong, 2012), the manipulation variable (i.e., sport spectatorship LOC; internal vs. external) was dummy coded: 0 = Spectators who were categorized…”
BackgroundMethodInfluentialHamilton, W. G., Sershon, R. A., Gupta, A., Goldstein, L., Kabiri, M., Holy, C. E., & Díaz, R. (2023) · Expert Review of Medical Devices · doi:10.1080/17434440.2023.2238609 · Cited by 8
“shown to be particularly effective where large differences in sample size exist between groups [27,28].”
BackgroundNagengast, B., Marsh, H. W., Chiorri, C., & Hau, K. (2014) · Journal of Educational Psychology · doi:10.1037/a0035615 · Cited by 13
Personalized Healthcare Outcome Analysis of Cardiovascular Surgical Procedures
Wang, G., Li, J., & Hopp, W. J. (2023) · Manufacturing & Service Operations Management · doi:10.1287/msom.2023.1227 · Cited by 12
Kishi, N., Matsuo, Y., Menju, T., Hamaji, M., Nakakura, A., Hanazawa, H., Takehana, K., Date, H., & Mizowaki, T. (2022) · Journal of Radiation Research · doi:10.1093/jrr/rrac041 · Cited by 7
“According to PSSBRT, PSLob and PSSLR, each individual’s weight was calculated using marginal mean weighting with the stratification method [22].”
MethodOnline Credit Recovery as an Intervention for High School Students Who Fail Courses
Viano, S. L., & Henry, G. T. (2023) · Educational Policy · doi:10.1177/08959048231153597 · Cited by 11
“MMWS combines propensity score and stratification methods of matching (Hong, 2010, 2012; Linden, 2017).”
MethodBrakenhoff, T. B., Moons, K. G. M., Kluin, J., & Groenwold, R. H. H. (2018) · Health Services Insights · doi:10.1177/1178632918785133 · Cited by 6
Quinlan, T. A. G., Roberts, A. W., Frank, J. W., & Whittington, M. D. (2021) · Health Services Research · doi:10.1111/1475-6773.13875 · Cited by 4
Covariate Balance for Observational Effectiveness Studies: A Comparison of Matching and Weighting
Kush, J. M., Pas, E. T., Musci, R. J., & Bradshaw, C. P. (2022) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2022.2110545 · Cited by 5
“Similarly, nonparametric weighting methods such as marginal mean weighting through stratification (Hong, 2010, 2012), a combination of nonparametric estimators with entropy balancing (Vegetabile et al., 2021), and covariate balancing generalized propensity score methods (Fong et al., 2018) may…”
MethodNalbantis, G., & Pawlowski, T. (2023) · European Sport Management Quarterly · doi:10.1080/16184742.2023.2275609 · Cited by 4
“Then, marginal mean weights are computed for each DMA based on its actual treatment assignment and stratum (see Hong, 2012).”
Wasenius, N., Isomaa, B., Östman, B., Söderström, J., Forsén, B., Lahti, K., Hakaste, L., Eriksson, J. G., Groop, L., Hansson, O., et al. (2020) · BMJ Open Diabetes Research & Care · doi:10.1136/bmjdrc-2020-001377 · Cited by 5
Gao, S. (2014) · Digital Scholarship - UNLV (University of Nevada Reno) · doi:10.34917/6456410 · Cited by 4
The valorization of employment: How communities and founders shape new venture outcomes
Eberhart, R. N., Rottner, R. M., & Lounsbury, M. D. (2026) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2026.106585 · Cited by 4
Beyond the Surface: Intimate Partner Violence Typology and Recent Depression
Hernández, W., & Ortega, J. (2024) · Violence Against Women · doi:10.1177/10778012241248452 · Cited by 5
“We opted for MMWS instead of using the IPTW directly because the former presents less bias and greater ef fi ciency even in the presence of speci fi cation errors in the generalized propensity score model (Hong, 2012; Huang et al., 2005).”
Labrecque, R. M., Viglione, J., & Campbell, C. M. (2025) · Justice Quarterly · doi:10.1080/07418825.2025.2568469 · Cited by 3
To Math or Not to Math: The Algebra-Calculus Pipeline and Postsecondary Mathematics Remediation
Showalter, D. (2017) · The Journal of Experimental Education · doi:10.1080/00220973.2017.1299080 · Cited by 5
“Since then, Hong (2012) has devised marginal mean weighting through stratification—a variant of propensity score analysis—that allows researchers to leverage the full range of an ordinal-level treatment variable such as coursetaking in the algebra-calculus pipeline.”
BackgroundInfluentialPropensity Score Matching with Cross-Classified Data Structures: A Comparison of Methods
Lee, Y., Leite, W., & Leroux, A. J. (2023) · Journal of Experimental Education · doi:10.1080/00220973.2023.2164843 · Cited by 2
“Case weights for OFM are calculated with the same equations as PS stratification (Hong, 2012; Leite, 2017).”
MethodAustralian Parental Leave Policy, Employers' Cognitive Bias, and Mothers' Wages: Penalty or Premium?
Lee, D., & Craig, L. (2024) · Gender Work and Organization · doi:10.1111/gwao.13216 · Cited by 5
Mueller, C. E., & Keil, S. I. (2019) · Zeitschrift für Energiewirtschaft · doi:10.1007/s12398-019-00251-y · Cited by 3
Hong, Y., & Hong, G. (2021) · AERA Open · doi:10.1177/2332858420979167 · Cited by 3
“…Longitudinal Study Kindergarten (ECLS-K) and use a propensity score-based approach, the marginal mean weighting through stratification (MMW-S; Hong, 2010, 2012, 2015) to compare schools with and without test-based promotion in the amount of time teachers spent on the core subjects in Grade 3…”
BackgroundMethodSelf-citationEffects of Federal Loans on First-Year College Student Retention, Transfer, and Dropout
Chen, R., & Smith, K. N. (2024) · Journal of College Student Retention Research Theory & Practice · doi:10.1177/15210251241252927 · Cited by 3
“Consistent with Hong (2012), to identify the common support that contains counterfactual information needed for causal inference, we used the minimum of the maximum values of a logit propensity score among all loan groups as the upper bound and used the maximum of the minimum values of the same…”
InfluentialChang, C. (2015) · Society for Research on Educational Effectiveness · Cited by 2
Schnellinger, E. M., Valeri, L., & Jackson, J. W. (2020) · American Journal of Epidemiology · doi:10.1093/aje/kwaa143 · Cited by 2
The impacts of length of prison stay on recidivism of non-violent offenders in Oregon
Leymon, M. H., Campbell, C. M., Henning, K., & Renauer, B. (2022) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2022.102002 · Cited by 5
Prahalad, P., Lorman, V., Wu, Q., Razzaghi, H., Chen, Y., Pajor, N. M., Case, A., Bose‐Brill, S., Block, J. P., Patel, P. B., et al. (2023) · Pediatric Diabetes · doi:10.1155/2023/8798997 · Cited by 3
“…fi cation matching which grouped patients into six subclasses by propensity score and assigned weights to each subclass to balance age group, sex, race/ethnicity, HbA1c group ( 7 % , 7 % – 9 % , ≥ 9 % ), insurance class, center, testing location, and cohort entry month in the two cohorts [36].”
Patterson, J. A., Stuart, E. A., & Ford, J. B. (2016) · BMC Research Notes · doi:10.1186/s13104-016-2169-1 · Cited by 2
“Weighting methods, while easily applied in the binary propensity score case, do not exploit the extra information available in the case of ordinal or continuous data, [34] and are more difficult in cases with a truly continuous outcome [35].”
MethodOutlier classification performance of risk adjustment methods when profiling multiple providers
Brakenhoff, T. B., Roes, K. C. B., Moons, K. G. M., & Groenwold, R. H. H. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0510-1 · Cited by 2
“Next the marginal mean weight (MMW) was calculated for each patient according to the formula described by Hong [44]:”
BackgroundMethodInfluentialZhang, H., & Leite, W. (2024) · Journal of Experimental Education · doi:10.1080/00220973.2024.2352766 · Cited by 1
“For example, MMWS is robust to the misspecification of propensity scores because smaller degrees of misspecification may not change strata membership (Hong, 2012).”
Wang, B., Liu, K. S. N., Mak, I. L., Choi, E. P. H., Lam, C. L. K., & Wan, E. Y. F. (2025) · Diabetes Obesity and Metabolism · doi:10.1111/dom.70061 · Cited by 3
Chen, R., & Boatman, A. (2026) · Research in Higher Education · doi:10.1007/s11162-026-09904-7 · Cited by 1
“The only exception involved the high-level loan group in the 2012 cohort, where two absolute standardized differences are reduced from 1.225 to 0.827 prior to weighting, and 0.337 and 0.310 after weighting, which is acceptable based on prior stud - ies (e.g., Hong, 2012).”
InfluentialBishop, C. D., Snyder, P., Algina, J. J., & Leite, W. L. (2016) · Springer eBooks · doi:10.1007/978-3-319-28492-7_27 · Cited by 2
Bodily, R., Larsen, R., & Warne, R. T. (2018) · Archives of Scientific Psychology · doi:10.1037/arc0000035 · Cited by 1
“…PPSA with another method of conducting propensity score analysis with ordered categories, marginal mean weighting through stratification (MMW-S; Hong, 2010, 2012) in a 3 5 4 study across three model misspecification conditions, five matching methods, and four sample sizes (1,000, 5,000,…”
BackgroundMethodGürel, S., & Leite, W. L. (2023) · Uluslararası Türk Eğitim Bilimleri Dergisi · doi:10.46778/goputeb.1312865 · Cited by 1
Remedial Enrollment During the 1st Year of College, Institutional Transfer, and Degree Attainment
Saw, G. K. (2018) · The Journal of Higher Education · doi:10.1080/00221546.2018.1493668 · Cited by 2
“The MMW-S method was recently developed for evaluating the effects of multivalued and multiple concurrent treatments with nonexperimental data (Hong, 2010, 2012).”
MethodMarginal mean weighting through stratification for investigating moderated treatment effects
Hong, G. (2015) · Wiley eBooks · doi:10.1002/9781119030638.ch7 · Cited by 1
Self-citationAdjustment for selection bias through weighting
(2015) · doi:10.1002/9781119030638.ch4 · Cited by 1
Koyama, E. (2015) · TSpace (University of Toronto)
Evaluations of multivalued treatments
Hong, G. (2015) · doi:10.1002/9781119030638.ch5
Self-citationExisting analytic methods for investigating causal mediation mechanisms
Hong, G. (2015) · Wiley eBooks · doi:10.1002/9781119030638.ch10
Self-citation(2015) · Wiley eBooks · doi:10.1002/9781119030638.ch15
Ferrera, J. M. C., & Díaz, V. C. B. (2017) · XXIV Encuentro de Economía Pública, 2017
Essilfie, F. L. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3217421
Essilfie, F. L. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3201096
Cumulative effects of time‐varying treatments
Hong, G. (2015) · Wiley eBooks · doi:10.1002/9781119030638.ch8
Self-citationHong, G. (2015) · Wiley eBooks · doi:10.1002/9781119030638.ch1
Self-citation- Self-citation
Shah, W. F. (2023) · International Journal for Research in Applied Science and Engineering Technology · doi:10.22214/ijraset.2023.55102
Metadata
- Authors
- Hong, G.
- Affiliations
- University of Chicago (US)
- Corresponding author
- Hong, Guanglei
- ORCID
- Hong, Guanglei
- Venue
- Psychological Methods
- Published
- 2012-03
- Volume
- 17
- Issue
- 1
- Pages
- 44-60
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W1993260957
- Cited by
- 105
- References
- 46
- Citations by year
- 2026: 5 · 2025: 3 · 2024: 7 · 2023: 12 · 2022: 4 · 2021: 6 · 2020: 9 · 2019: 5 · 2018: 13 · 2017: 5 · 2016: 9 · 2015: 19 · 2014: 4 · 2013: 2 · 2012: 1
- FWCI
- 2.25
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Spencer Foundation
- Social Sciences and Humanities Research Council of Canada
- National Academy of Education
- William T. Grant Foundation
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- multiple treatments, nonparametric causal inference, inverse probability of treatment weighting, factorial design, kindergarten, non-experimental data
- MeSH terms
- Analysis of Variance, Child, Data Interpretation, Statistical, Humans, Learning, Longitudinal Studies, Models, Theoretical, Research Design, Vocabulary, Models, Statistical, Program Evaluation, Selection Bias, Causality, Randomized Controlled Trials as Topic, Statistics, Nonparametric, Propensity Score
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.