The DOI matches its Crossref record.
Comparison of Multivariate Matching Methods: Structures, Distances, and Algorithms
Abstract
A comparison and evaluation is made of recent proposals for multivariate matched sampling in observational studies, where the following three questions are answered: (1) Algorithms: In current statistical practice, matched samples are formed using “nearest available” matching, a greedy algorithm. Greedy matching does not minimize the total distance within matched pairs, though good algorithms exist for optimal matching that do minimize the total distance. How much better is optimal matching than greedy matching? We find that optimal matching is sometimes noticeably better than greedy matching in the sense of producing closely matched pairs, sometimes only marginally better, but it is no better than greedy matching in the sense of producing balanced matched samples. (2) Structures: In common practice, treated units are matched to one control, called pair matching or 1–1 matching, or treated units are matched to two controls, called 1–2 matching, and so on. It is known, however, that the optimal structure is a full matching in which a treated unit may have one or more controls or a control may have one or more treated units. Optimal 1 — k matching is compared to optimal full matching, finding that optimal full matching is often much better. (3) Distances: Matching involves defining a distance between covariate vectors, and several such distances exist. Three recent proposals are compared. Practical advice is summarized in a final section.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
No references could be resolved yet.
Research works printed but not linked: 19
- Anderson , T. 1984 . An Introduction to Multivariate Statistical Analysis, , second ed. , New York : John Wiley .
- Bertsekas , D. 1991 . Linear Network Optimization: Algorithms and Codes , Cambridge , MA : MIT Press .
- 10.1093/biomet/64.2.299 · DOI
- Cochran , W. G. 1965 . “The Planning of Observational Studies of Human Populations” . Journal of the Royal Statistical Society , 128 : 134 – 155 . (with discussion), Ser. A
- Cochran , W. G. and Rubin , D. B. 1973 . “Controlling Bias in Observational Studies: A Review” . Sankya , 35 : 417 – 446 . Ser. A
- 10.1016/0002-9149(81)90391-X · DOI
- Gu , X. 1992 . “A Comparison and Evaluation of Recent Developments for Multivariate Matching in Observational Studies” , University of Pennsylvania, Department of Statistics . unpublished Ph.D. thesis
- 10.2307/1165073 · DOI
- 10.1093/biomet/75.3.577 · DOI
- 10.1080/01621459.1989.10478868 · DOI
- 10.1111/j.2517-6161.1991.tb01848.x · DOI
- 10.1093/biomet/70.1.41 · DOI · Paper page
- 10.1080/00031305.1985.10479383 · DOI
- 10.2307/2529685 · DOI
- Rubin , D. B. 1976 . “Multivariate Matching Methods That are Equal Percent Bias Reducing, I: Some Examples” . Biometrics , 32 : 185 – 203 .
- 10.1080/01621459.1979.10482513 · DOI
- 10.2307/2529981 · DOI
- 10.2307/2529548 · DOI · Paper page
- 10.1137/0208036 · DOI
Cited by
Sorted by citations
Items 101–200 of 595
Hannan, E., Samadashvili, Z., Cozzens, K., Walford, G., Jacobs, A., Holmes, D., Stamato, N., Gold, J., Sharma, S. K., Venditti, F. J., et al. (2012) · Circulation · doi:10.1161/circulationaha.111.071811 · Cited by 87
“Edad, media (DE), años 65,1 (11,0) 67,9 (10,9) 64,9 (10,9) 0,001”
Ripollone, J. E., Huybrechts, K. F., Rothman, K. J., Ferguson, R. E., & Franklin, J. M. (2019) · American Journal of Epidemiology · doi:10.1093/aje/kwz268 · Cited by 105
Implications of the Propensity Score Matching Paradox in Pharmacoepidemiology
Ripollone, J. E., Huybrechts, K. F., Rothman, K. J., Ferguson, R. E., & Franklin, J. M. (2018) · American Journal of Epidemiology · doi:10.1093/aje/kwy078 · Cited by 98
The Power of Optimization Over Randomization in Designing Experiments Involving Small Samples
Bertsimas, D., Johnson, M., & Kallus, N. (2015) · Operational Research · doi:10.1287/opre.2015.1361 · Cited by 86
Abdia, Y., Kulasekera, K. B., Datta, S., Boakye, M., & Kong, M. (2017) · Biometrical Journal · doi:10.1002/bimj.201600094 · Cited by 89
“Gu and Rosenbaum (1993) concluded that optimal matching and greedy matching perform equally in terms of creating groups with good balance, but the optimal matching does reduce the distance within pairs.”
BackgroundAsymptotic separability in sensitivity analysis
Gastwirth, J., Krieger, A., & Rosenbaum, P. R. (2000) · doi:10.1111/1467-9868.00249 · Cited by 82
Self-citationHow do integrated health care systems address racial and ethnic disparities in colon cancer?
Rhoads, K., Patel, M. I., Ma, Y.-F., & Schmidt, L. A. (2015) · Journal of Clinical Oncology · doi:10.1200/jco.2014.56.8642 · Cited by 77
“To compare survival within versus outside the IHS, we used propensity score matching (PSM) with a five-to-one Greedy matching approach.(34) Patients were matched on characteristics known to affect colon cancer survival, including: age, sex, race,(35) composite SES score,(30,36) Deyo-modified Charlson comorbidity score…”
Austin, P., & Cafri, G. (2020) · Statistics in Medicine · doi:10.1002/sim.8502 · Cited by 76
The Cost to Medicare of Bladder Cancer Care.
Sloan, F., Yashkin, A., Akushevich, I., & Inman, B. (2020) · European Urology Oncology · doi:10.1016/j.euo.2019.01.015 · Cited by 75
Sills, E., de Sassi, C., Jagger, P., Lawlor, K., Miteva, D., Pattanayak, S., & Sunderlin, W. (2017) · Global Environmental Change · doi:10.1016/j.gloenvcha.2017.02.002 · Cited by 75
“With the rapid rural appraisal data on villages, we implemented covariate matching with a Mahalanobis metric (Gu and Rosenbaum, 1993) to identify a matched sample in each country including four intervention and four control villages per site (except in one site with fewer than four villages in the…”
MethodRahkovsky, I. M., Lin, B., Lin, C., & Lee, J. (2013) · Food Policy · doi:10.1016/j.foodpol.2013.08.013 · Cited by 75
Weller, N., & Barnes, J. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9781139644501 · Cited by 106
Merits and caveats of propensity scores to adjust for confounding.
Fu, E., Groenwold, R., Zoccali, C., Jager, K., van Diepen, M., & Dekker, F. (2018) · Nephrology, Dialysis and Transplantation · doi:10.1093/ndt/gfy283 · Cited by 73
Mozer, R., Miratrix, L. W., Kaufman, A. R., & Anastasopoulos, L. J. (2020) · Political Analysis · doi:10.1017/pan.2020.1 · Cited by 77
“For instance, there are distance metrics for scalar covariates (Rubin, 1973b), for multivariate covariates summarized through a univariate propensity score (Rosenbaum and Rubin, 1983, 1985), and multivariate metrics such as the Mahalanobis distance metric (Rubin, 1978; Gu and Rosenbaum, 1993).”
BackgroundChen, C., Haduong, P., Brennan, K. A., Sonnert, G., & Sadler, P. M. (2018) · Computer Science Education · doi:10.1080/08993408.2018.1547564 · Cited by 87
“We fi rst used the sample after optimal matching as our prototypical sample, because optimal matching was principally based on nearest matching, but performed better than nearest matching at minimizing the total distance between matched pairs (Gu & Rosenbaum, 1993; Stuart, 2010).”
MethodMatching and thick description in an observational study of mortality after surgery
Rosenbaum, P. (2001) · Biostatistics · doi:10.1093/biostatistics/2.2.217 · Cited by 68
“…they are less attainable than balanced groups, modern matching methods insist on covariate balance for groups as a whole, and then attempt to maximize proximity within matched sets by minimizing a distance that emphasizes the propensity score (Rosenbaum and Rubin, 1985; Gu and Rosenbaum, 1993).”
BackgroundMethodResultInfluentialSelf-citationPark, K.-W., Lee, J., Kang, S.-H., Ahn, H., Kang, H.-J., Koo, B., Rhew, J., Hwang, S., Lee, S. Y., Kang, T., et al. (2014) · JACC: Cardiovascular Interventions · doi:10.1016/j.jcin.2013.12.201 · Cited by 70
Fischer, J., Wes, A., Nelson, J. A., Basta, M., Rohrbach, J., Wu, L.-Z. C., Serletti, J., & Kovach, S. (2014) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2014.02.028 · Cited by 68
“Propensity scores were incorporated into this analysis to reduce the risk of selection bias due to the nonrandomized assignment of modality and retrospective nature of this study.(13-15) A propensity score for modality selection (autologous reconstruction) was calculated by assessing perioperative factors associated w…”
MethodZávada, J., Uher, M., Sisol, K., Forejtová, Š., Jarošová, K., Mann, H. F., Vencovský, J., & Pavelká, K. (2014) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2014-205202 · Cited by 68
Kluve, J., Lehmann, H., & Schmidt, C. M. (2001) · Social Science Research Network · doi:10.2139/ssrn.283449 · Cited by 64
“…the two measures under scrutiny – Training and Intervention Works – we start the construction of matched samples from an initial sample consisting of treated individuals and untreated potential comparison individuals, where every observation is required to have at least one spell of unemployment.”
BackgroundPropensity score methods for observational studies with clustered data: A review
Chang, T., & Stuart, E. A. (2022) · Statistics in Medicine · doi:10.1002/sim.9437 · Cited by 65
Hannan, E., Zhong, Y., Walford, G., Holmes, D., Venditti, F. J., Berger, P., Jacobs, A., Stamato, N., Curtis, J., Sharma, S. K., et al. (2014) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2014.09.074 · Cited by 63
Schranz, N., Tomkinson, G., Olds, T., & Daniell, N. (2010) · Jurnal sport science · doi:10.1080/02640411003663284 · Cited by 63
“To avoid age-related differences in anthropometric dimensions, rowers and members of the general population were matched one-for-one for decimal age using a greedy matching procedure (Gu & Rosenbaum, 1993 ).”
MethodMultiple Versus Single Arterial Coronary Bypass Graft Surgery for Multivessel Disease.
Samadashvili, Z., Sundt, T., Wechsler, A., Chikwe, J., Adams, D., Smith, C. R., Jordan, D., Girardi, L., Lahey, S., Gold, J., et al. (2019) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2019.06.067 · Cited by 62
Hypertensive Patients Show Delayed Wound Healing following Total Hip Arthroplasty
Ahmed, A. A., Mooar, P., Kleiner, M., Torg, J., & Miyamoto, C. (2011) · PLoS ONE · doi:10.1371/journal.pone.0023224 · Cited by 62
“Previous research has shown that while matching approaches generally involve the selection of the same sets of controls for the overall matched samples, optimal matching is superior in terms of minimizing the distance within each pair [18].”
BackgroundBottigliengo, D., Baldi, I., Lanera, C., Lorenzoni, G., Bejko, J., Bottio, T., Tarzia, V., Carrozzini, M., Gerosa, G., Berchialla, P., et al. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01454-z · Cited by 73
Bertolo, R. G., Simone, G., Garisto, J., Nakhoul, G., Armanyous, S. R., Agudelo, J., Costantini, M., Tuderti, G., Gallucci, M., & Kaouk, J. H. (2018) · European Journal of Surgical Oncology · doi:10.1016/j.ejso.2018.12.005 · Cited by 59
Hannan, E., Zhong, Y., Reddy, P., Jacobs, A., Ling, F. S. K., King, S. B., Berger, P., Venditti, F. J., Walford, G., & Tamis-Holland, J. (2022) · Circulation. Cardiovascular Interventions · doi:10.1161/circinterventions.121.011687 · Cited by 59
Evaluation of subset matching methods and forms of covariate balance
Resa, M. D. L. A., & Zubizarreta, J. R. (2016) · Statistics in Medicine · doi:10.1002/sim.7036 · Cited by 55
“**We decided to fix the number of treated and control subjects, as in [14], instead of randomly assigning to treatment each unit by means of another Bernoulli random variable, as in [16], to have a fixed number of maximum possible pairs and be able to better compare the number of units matched across simulations.”
MethodPropensity Score Matching in Randomized Clinical Trials
Xu, Z.-Z., & Kalbfleisch, J. (2010) · Biometrics · doi:10.1111/j.1541-0420.2009.01364.x · Cited by 58
“The method of propensity score matching has been widely used in observational studies to control for bias (Rosenbaum and Rubin, 1984; Gu and Rosenbaum, 1993; Ming and Rosenbaum, 2000; Rosenbaum, 2002; Hansen, 2004).”
MethodAdverse health outcomes associated with surgical management of the small renal mass.
Shuch, B., Hanley, J. M., Lai, J. C., Vourganti, S., Setodji, C., Dick, A., Chow, W., & Saigal, C. (2014) · Journal of Urology · doi:10.1016/j.juro.2013.08.074 · Cited by 56
Stone, C. A. (2020) · doi:10.7275/qkqa-9k50 · Cited by 51
“Gu and Rosenbaum (1993) found that “…optimal matching is often better than nearest neighbor matching when the goal is to minimize the average distance within pairs…” (p.413).”
Usui, A., Miyata, H., Ueda, Y., Motomura, N., & Takamoto, S. (2012) · General Thoracic and Cardiovascular Surgery · doi:10.1007/s11748-011-0857-2 · Cited by 56
Critical Issues and Common Pitfalls in Designing and Conducting Impact Studies in Education
Song, M., & Herman, R. (2010) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373710373389 · Cited by 56
Assessing the Performance of Matching Algorithms When Selection into Treatment is Strong
Augurzky, B., & Kluve, J. (2007) · Social Science Research Network · doi:10.1002/jae.919 · Cited by 56
“Disregarding born in south, balancing success is more or less equal.16 This finding is in line with Gu and Rosenbaum (1993) who observe that in terms of balance, optimal matching seems to have no advantage over greedy matching.”
BackgroundMethodResultInfluentialUnsupervised Discovery of Implicit Gender Bias
Field, A., & Tsvetkov, Y. (2020) · Conference on Empirical Methods in Natural Language Processing · doi:10.48550/arxiv.2004.08361 · Cited by 55
“Then, we use greedy matching to match each O TEXTi where the true value of W GENDERi is F with O TEXTj where the true value of W GENDERj is M and |ei(O TEXTi)− ej(O TEXTj)| is minimal (Gu and Rosenbaum, 1993).”
BackgroundMethodSalimi, B., Parikh, H., Kayali, M., Getoor, L. C., Roy, S., & Suciu, D. M. (2020) · ACM SIGMOD International Conference on Management of Data (SIGMOD) · doi:10.1145/3318464.3389759 · Cited by 45
Oliveira, G. D. D., Errea, M., Bialek, J. M., Kendall, M., & McCarthy, R. (2018) · BMC Health Services Research · doi:10.1186/s12913-018-3755-9 · Cited by 55
“6 standard deviations (SD) to match the pairs [22].”
BackgroundLeite, W. L., Jimenez, F., Kaya, Y., Stapleton, L. M., MacInnes, J. W., & Sandbach, R. (2015) · Multivariate Behavioral Research · doi:10.1080/00273171.2014.991018 · Cited by 62
“One-to-many matching is known to outperform one-to-one matching for estimating the ATT in general conditions (Cepeda, Boston, Farrar, & Strom, 2003; Gu & Rosenbaum, 1993).”
BackgroundBabalola, S., & Vonrasek, C. (2005) · Journal of family planning and reproductive health care · doi:10.1783/1471189054484022 · Cited by 55
Saha, K., Reddy, M. D., Mattingly, S. M., Moskal, E., Sirigiri, A., & de Choudhury, M. (2019) · Proc. ACM Hum. Comput. Interact. · doi:10.1145/3359239 · Cited by 54
“Therefore, with these characteristics as covariates (see Table 2), we draw on matching techniques from causal inference [71, 124] to match individuals using Mahalanobis Distance Matching [59].”
Fischer, J., Tuggle, C. T., Wes, A., & Kovach, S. (2014) · Journal of Plastic, Reconstructive & Aesthetic Surgery · doi:10.1016/j.bjps.2014.01.021 · Cited by 54
Oliveira, G. D. D., Akikwala, T., Kendall, M., Fitzgerald, P., Sullivan, J. T., Zell, C., & McCarthy, R. (2012) · Anesthesiology · doi:10.1097/aln.0b013e31825fb04b · Cited by 54
“6 SD will remove approximately 90% of the bias in observed confounders.(11) Applicants who did not have an acceptable range of match were excluded.”
Michalek, J. (2012) · doi:10.2791/8228 · Cited by 54
“Moreover, matching on all the covariates using a distance measure, which effectively regards all interactions among the X covariates as equally important, does not work very well (Gu and Rosenbaum, 1993; Rubin and Thomas, 1996).”
BackgroundOptimizing matching and analysis combinations for estimating causal effects
Colson, K. E., Rudolph, K. E., Zimmerman, S. C., Goin, D. E., Stuart, E. A., van der Laan, M. J., & Ahern, J. (2016) · Scientific Reports · doi:10.1038/srep23222 · Cited by 54
“The variable results of previous comparisons of matching methods attest that there is no single approach that best fits all scenarios (see for example 38,29,32 ).”
BackgroundResultOliveira, G. D. D., Chang, R., Khan, S., Hansen, N., Khan, J. H., McCarthy, R. J., & Apkarian, A. (2014) · The Breast Journal · doi:10.1111/tbj.12207 · Cited by 53
Effect of bisphosphonates on knee replacement surgery
Neogi, T., Li, S., Peloquin, C. E., Misra, D., & Zhang, Y. (2017) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2017-211811 · Cited by 64
E-Cigarette Use and Intention to Initiate or Quit Smoking Among US Youths.
Park, J.-Y., Seo, D., & Lin, H.-C. (2016) · American Journal of Public Health · doi:10.2105/ajph.2015.302994 · Cited by 51
Schermerhorn, M., Giles, K., Sachs, T., Bensley, R. P., O'Malley, A., Cotterill, P., & Landon, B. (2011) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2010.12.003 · Cited by 49
“This requirement ensures the removal of approximately 90% of the bias in estimates of effects due to differences in covariate distributions between the endovascular repair group and the open repair group [6,7].”
BackgroundBaşer, O. (2007) · Journal of Medical Economics · doi:10.3111/13696990701646577 · Cited by 44
IDENTIFYING THE LOCAL ECONOMIC DEVELOPMENT EFFECTS OF MILLION DOLLAR FACILITIES
Patrick, C. E. (2016) · Economic Inquiry · doi:10.1111/ecin.12339 · Cited by 54
“Matching on propensity score is more biasreducing/robust than covariate matching on more than five covariates (Gu and Rosenbaum 1993; Rubin and Thomas 2000).”
Fischer, J., Wes, A., & Kovach, S. (2014) · Journal of Plastic Surgery and Hand Surgery · doi:10.3109/2000656x.2014.882345 · Cited by 48
“Similar to previously published work, we used a matchedpropensity analysis, since this may be a superior technique and also provides an opportunity to incorporate significantly different covariates after matching into final risk-adjusted models [25,26].”
MethodSchneeweiss, S., Doherty, M., Zhu, S., Funch, D., Schlienger, R., Fernández-Vidaurre, C., & Seeger, J. (2009) · Dermatology · doi:10.1159/000209289 · Cited by 48
Matching estimators and optimal bandwidth choice
Frölich, M. (2005) · Statistics and computing · doi:10.1007/s11222-005-1309-6 · Cited by 48
“For other pair-matching techniqes see e.g. Gu and Rosenbaum (1993) .”
BackgroundCausal inference with observational data: A tutorial on propensity score analysis
Narita, K., Tena, J. D. D., & Detotto, C. (2023) · The Leadership Quarterly · doi:10.1016/j.leaqua.2023.101678 · Cited by 54
Hannan, E., Samadashvili, Z., Walford, G., Jacobs, A., Stamato, N., Venditti, F. J., Holmes, D., Sharma, S. K., & King, S. (2013) · Circulation. Cardiovascular Interventions · doi:10.1161/circinterventions.112.974485 · Cited by 47
Suh, D., Sung, J., Gause, D., Raut, M., Huang, J., & Choi, I. (2007) · Journal of Managed Care Pharmacy · doi:10.18553/jmcp.2007.13.9.778 · Cited by 47
“The propensity score was used to match cases with comparisons using a greedy matching method, which pairs each case patient with a unique comparison patient based on the closest propensity scores without replacement.(23) The mean of c-statistics was 0.”
MethodPlanquette, B., Berre, A. L., Khider, L., Yannoutsos, A., Gendron, N., de Torcy, M., Mohamedi, N., Jouveshomme, S., Smadja, D. M., Lazareth, I., et al. (2020) · Thrombosis Research · doi:10.1016/j.thromres.2020.11.001 · Cited by 58
“For each patient of the PE group, a greedy-matching algorithm was used to select the control patients who most closely matched that patient in terms of the three matching factors [23].”
MethodTokuda, Y., Miyata, H., Motomura, N., Oshima, H., Usui, A., & Takamoto, S. (2014) · Circulation Journal · doi:10.1253/circj.cj-14-0565 · Cited by 46
Impact of Incomplete Revascularization on Long-Term Mortality Following Coronary Stenting
Wu, C., Dyer, A., King, S., Walford, G., Holmes, D., Stamato, N., Venditti, F. J., Sharma, S. K., Fergus, I., Jacobs, A., et al. (2011) · Circulation. Cardiovascular Interventions · doi:10.1161/circinterventions.111.963058 · Cited by 46
Vitamin D supplementation is associated with slower epigenetic aging
Vetter, V. M., Sommerer, Y., Kalies, C. H., Spira, D., Bertram, L., & Demuth, I. (2022) · GeroScience · doi:10.1007/s11357-022-00581-9 · Cited by 55
“It is very similar to the often used “nearest neighbor” method but reduces the distance within each pair better [64].”
MethodPatterns and predictors of early electric vehicle adoption in Massachusetts
Gehrke, S., & Reardon, T. G. (2021) · International Journal of Sustainable Transportation · doi:10.1080/15568318.2021.1912223 · Cited by 45
“To do so, a logit model with an optimal matching method without replacement, where a one-to-one ratio of control units were matched to a treatment observation based on the smallest average absolute distance across matches, was estimated (Gu & Rosenbaum, 1993).”
MethodAssessing the differential impacts of online, mixed, and offline gambling
Papineau, E., Lacroix, G., Sévigny, S., Biron, J.-F., Corneau-Tremblay, N., & Lemétayer, F. (2018) · International Gambling Studies · doi:10.1080/14459795.2017.1378362 · Cited by 45
“Thus every individual from the comparison group whose probability (score) is close to that of a given treated individuals may be used as a counterfactual to the latter (Gu & Rosenbaum, 1993).”
MethodRubin, D. B. (2007) · Handbook of statistics · doi:10.1016/s0169-7161(07)27002-6 · Cited by 39
Returns to rural electrification: Evidence from Bhutan
Litzow, E. L., Pattanayak, S., & Thinley, T. (2019) · World Development · doi:10.1016/j.worlddev.2019.04.002 · Cited by 44
Branson, Z., Dasgupta, T., & Rubin, D. (2016) · doi:10.1214/16-aoas959 · Cited by 44
“The Mahalanobis distance is well known within the matching and observational study literature where it is used to find subsets of the treatment and control that are similar [Rubin (1976), Rosenbaum and Rubin (1985), Gu and Rosenbaum (1993), Rubin and Thomas (2000)].”
MethodOutcomes and revision rates in normal, overweight, and obese patients 5 years after lumbar fusion.
Owens, R. K., Djurasovic, M., Onyekwelu, I., Bratcher, K. R., McGraw, K., & Carreon, L. (2016) · The spine journal · doi:10.1016/j.spinee.2016.06.005 · Cited by 44
A causal inference approach to measure price elasticity in Automobile Insurance
Guelman, L., & Guillén, M. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.07.059 · Cited by 43
“In this paper, we propose using propensity scores (Rosenbaum and Rubin, 1983) and matching algorithms (Gu and Rosenbaum, 1993) as a method for removing all biases associated with differences in the pre-treatment variables.”
MethodBeta-amyloid and Cortical Thickness Reveal Racial Disparities in Preclinical Alzheimer's Disease
McDonough, I. M. (2017) · NeuroImage Clinical · doi:10.1016/j.nicl.2017.09.014 · Cited by 48
“Then, pairs of observations that had similar propensity scores, but differed in race, were matched using the nearest neighbor method, which matched the closest control for each treated unit one at a time (Gu and Rosenbaum, 1993).”
Jonsson, N., Nilsen, T., Gille-Johnson, P., Bell, M., Martling, C., Larsson, A., & Mårtensson, J. (2017) · Critical Care and Resuscitation · doi:10.1016/s1441-2772(23)00918-3 · Cited by 43
D'Agostino, R., Lang, W., Walkup, M., Morgan, T., & Karter, A. (2001) · Health Services & Outcomes Research Methodology · doi:10.1023/a:1020375413191 · Cited by 43
“…(Barker 2nd, Chang and Gutin et al., 1998; Conners Jr., Speroff and Dawson et al., 1996; Rosenbaum and Rubin, 1984) on estimated propensity scores is used, often in combination with model-based adjustments (Lieberman, Cohen and Lang et al., 1996; Rich, 1998; Gu and Rosenbaum, 1993).”
MethodOliveira, G. D. D., Holl, J., McCarthy, R., Butt, Z., Nouriel, J. E., McCaffery, K., & Wolf, M. (2014) · International Journal of Surgery · doi:10.1016/j.ijsu.2014.11.016 · Cited by 42
Leon, A. C., Solomon, D. A., Li, C., Fiedorowicz, J. G., Coryell, W. H., Endicott, J., & Keller, M. B. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.11060948 · Cited by 54
Rana, P., & Miller, D. C. (2019) · Environmental Research Letters · doi:10.1088/1748-9326/aafa8f · Cited by 41
Beloncle, F., Studer, A., Seegers, V., Richard, J.-C., Desprez, C., Fage, N., Merdji, H., Pavlovsky, B., Helms, J., Cunat, S., et al. (2021) · Critical Care · doi:10.1186/s13054-021-03665-8 · Cited by 58
Ribas, L. G. D. S., Pressey, R. L., & Bini, L. M. (2021) · Biological reviews/Biological reviews of the Cambridge Philosophical Society · doi:10.1111/brv.12697 · Cited by 49
“…control j units, as follows: Dij= Xi−Xj ´ X−1 Xi−Xj ð2Þ A weakness of this measure is that the ability to represent differences between two units decreases as the number of covariates increases, due to the possible interactions in the calculation of the distance (Gu & Rosenbaum, 1993; Zhao, 2004).”
BackgroundMaloney, M. H., Schilz, S. R., Herrin, J., Sangaralingham, L., Shah, N., & Barkmeier, A. (2019) · Ophthalmology (Rochester, Minn.) · doi:10.1016/j.ophtha.2018.09.040 · Cited by 41
Kum, H., & Masterson, T. (2010) · Journal of Economic and Social Measurement · doi:10.3233/jem-2010-0332 · Cited by 41
“Gu and Rosenbaum [9] show that propensity score matching produces matched samples that are more balanced than the use of the Mahalanobis distance function or propensity score with a Mahalanobis caliper if there are many covariates and large imbalances in the covariates between data sets.”
Feature Selection as Causal Inference: Experiments with Text Classification
Paul, M. J. (2017) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k17-1018 · Cited by 40
“In this work, we perform one-to-one matching without replacement using a greedy matching algorithm; Gu and Rosenbaum (1993) found no quality difference using greedy versus optimal matching.”
MethodHannan, E., Samadashvili, Z., Jordan, D., Sundt, T., Stamato, N., Lahey, S., Gold, J., Wechsler, A., Ashraf, M. H., Ruiz, C., et al. (2015) · Circulation. Cardiovascular Interventions · doi:10.1161/circinterventions.115.002744 · Cited by 40
Treatment patterns and associated costs with Parkinson's disease levodopa induced dyskinesia.
Suh, D., Pahwa, R., & Mallya, U. (2012) · Journal of Neurological Sciences · doi:10.1016/j.jns.2012.05.029 · Cited by 40
“, greedy matching method) to adjust for differences in characteristics between the two patients groups [31].”
MethodKim, J., & Seltzer, M. H. (2007) · doi:10.1037/e644002011-001 · Cited by 40
Learning Causal Effects From Observational Data in Healthcare: A Review and Summary
Shi, J.-P., & Norgeot, B. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2022.864882 · Cited by 38
“These algorithms differ from each other in whether patients are chosen with or without replacement (24), whether matching is optimal, greedy (24), one-to-one, or one-to-many (25), and what metric is used to measure similarity between two patients (11, 23, 26, 27).”
BackgroundStatin use and survival following a diagnosis of ovarian cancer: A prospective observational study
Majidi, A., Na, R.-H., Jordan, S., Defazio, A., & Webb, P. (2020) · International Journal of Cancer · doi:10.1002/ijc.33333 · Cited by 38
Fischer, J., Wes, A., Tuggle, C. T., Nelson, J. A., Tchou, J., Serletti, J., Kovach, S., & Wu, L.-Z. C. (2014) · Journal of Plastic, Reconstructive & Aesthetic Surgery · doi:10.1016/j.bjps.2014.07.021 · Cited by 38
An Alternative Approach to Addressing Selection Into and Out of Social Settings
Sharkey, P. (2012) · Sociological Methods & Research · doi:10.1177/0049124112452391 · Cited by 38
A comparison of propensity score matching methods for reducing selection bias
Bai, H.-Y. (2011) · International Journal of Research & Method in Education · doi:10.1080/1743727x.2011.552338 · Cited by 38
“PSM intends to balance the treatment and comparison groups on multiple covariates simultaneously, which is potentially similar to the balance achieved in randomization trials (Gu and Rosenbaum 1993 ); therefore, PSM is regarded as an effective strategy from alternative designs (Glynn, Schneeweiss, and Sturmer 2006 ) a…”
MethodMatching and Weighting With Functions of Error-Prone Covariates for Causal Inference
Lockwood, J. R., & McCaffrey, D. F. (2015) · Journal of the American Statistical Association · doi:10.1080/01621459.2015.1122601 · Cited by 35
“Methods for choosing matched samples has been an active area of research for decades (Rosenbaum and Rubin 1985; Rosenbaum 1989; Gu and Rosenbaum 1993; Hansen and Klopfer 2006), and Stuart (2010) provided a review of that literature.”
BackgroundKwon, J., Park, E.-J., Jung, S., Sohn, H., Ryu, H., & Suh, H. S. (2015) · Journal of dentistry research · doi:10.1177/0022034515587862 · Cited by 37
Is Dexamethasone Associated with Recurrence of Ovarian Cancer?
Oliveira, G. D. D., McCarthy, R., Turan, A., Schink, J., Fitzgerald, P., & Sessler, D. (2014) · Anesthesia and Analgesia · doi:10.1213/ane.0b013e3182a5d656 · Cited by 37
Investigating Transit-Induced Displacement Using Eviction Data
Delmelle, E. C., Nilsson, I. M., & Bryant, A. (2020) · Housing Policy Debate · doi:10.1080/10511482.2020.1815071 · Cited by 47
“Although the two approaches generally produce the same set of matched samples, optimal matching is sometimes marginally better in producing closely matched pairs (Gu & Rosenbaum, 1993; Ho, Imai, King, & Stuart, 2011).”
ResultRandom Recursive Partitioning: a matching method for the estimation of the average treatment effect
Porro, G., & Iacus, S. M. (2008) · Journal of Applied Econometrics · doi:10.1002/jae.1026 · Cited by 34
“We concisely report the results in what follows: first we replicated the Monte Carlo experiment of Gu and Rosenbaum (1993).”
Miller, J. A., Toesca, D. A. S., Baclay, J. R. M., Vitzthum, L. K., Dubrowski, P., Pollom, E. L., & Chang, D. T. (2021) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2021.07.1698 · Cited by 44
Pimperl, A. F., Schulte, T., Mühlbacher, A. C., Rosenmöller, M., Busse, R., Groene, O., Rodríguez, H. P., & Hildebrandt, H. (2016) · Population Health Management · doi:10.1089/pop.2016.0036 · Cited by 49
“30 However, because optimal matching does not produce better balanced matched samples than greedy matching, 33 and greedy matching can be realized in an easier and faster way, the team decided to use greedy matching.”
Informative Subspace Learning for Counterfactual Inference
Chang, Y., & Dy, J. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10800 · Cited by 22
“Mahalanobis distance matching (MDM) computes the Mahalanobis distance between the feature vectors of different samples and works well for low-dimensional data (Rubin 1979; Rosenbaum 2002), but it can fail when the dimensionality of features becomes large or when the distribution of features are not Gaussian (Gu and Ro…”
BackgroundMethodInfluentialGupta, P., Richardson, T., Hall, M., Bertoch, D., Hebbar, K. B., Fortenberry, J., & Wetzel, R. (2016) · Critical Care Medicine · doi:10.1097/ccm.0000000000001837 · Cited by 35
“In addition, matching by propensity scores achieves a better balance of covariates between groups than other matching strategies (22, 23).”
BackgroundEffectiveness of a “Grass Roots” Statewide Enrichment Program for Gifted Elementary School Children
Golle, J., Zettler, I., Rose, N., Trautwein, U., Hasselhorn, M., & Nagengast, B. (2017) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2017.1402396 · Cited by 49
“In contrast to nearest neighbor matching, optimal matching was used to minimize the average absolute distance across all matched pairs (Gu & Rosenbaum, 1993; Ho et al., 2011).”
MethodPan, W., & Bai, H. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0049-3 · Cited by 40
“Both matching algorithms usually produce similar matched data when the size of the comparison group is large; whereas optimal matching gives rise to smaller overall distances within matched units [11, 12].”
BackgroundSmith, V. A., Arterburn, D. E., Berkowitz, T. S. Z., Olsen, M. K., Livingston, E. H., Yancy, W. S., Weidenbacher, H. J., & Maciejewski, M. L. (2019) · JAMA Surgery · doi:10.1001/jamasurg.2019.3732 · Cited by 38
Park, K., Sceats, L., Dehghan, M., Trickey, A. W., Wren, A. A., Wong, J. J., Bensen, R., Limketkai, B., Keyashian, K., & Kin, C. (2018) · Alimentary Pharmacology and Therapeutics · doi:10.1111/apt.14842 · Cited by 33
Metadata
- Authors
- Gu, X. S., & Rosenbaum, P. R.
- Affiliations
- C.S. First Boston Hong Kong, Ltd.
- University of Pennsylvania (US)
- ORCID
- Rosenbaum, Paul R.
- Venue
- Journal of Computational and Graphical Statistics
- Publisher
- Informa UK Limited
- Published
- 1993-12
- Volume
- 2
- Issue
- 4
- Pages
- 405-420
- ISSN
- 1061-8600 (ISSN-L)
- 1537-2715
- OpenAlex
- W2030614017
- Cited by
- 702
- References
- 0
- Citations by year
- 2026: 20 · 2025: 29 · 2024: 27 · 2023: 32 · 2022: 35 · 2021: 41 · 2020: 46 · 2019: 37 · 2018: 51 · 2017: 36 · 2016: 36 · 2015: 40 · 2014: 36 · 2013: 35 · 2012: 27
- FWCI
- 1.01
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Computational and Graphical Statistics (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Decision Sciences › Management Science and Operations Research › Optimal Experimental Design Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- optimal matching, greedy matching, pair matching, covariate balance, distance measures, observational studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review