The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
Using the Propensity Score Method to Estimate Causal Effects: A Review and Practical Guide
Abstract
Evidence-based management requires management scholars to draw causal inferences. Researchers generally rely on observational data sets and regression models where the independent variables have not been exogenously manipulated to estimate causal effects; however, using such models on observational data sets can produce a biased effect size of treatment intervention. This article introduces the propensity score method (PSM)—which has previously been widely employed in social science disciplines such as public health and economics—to the management field. This research reviews the PSM literature, develops a procedure for applying the PSM to estimate the causal effects of intervention, elaborates on the procedure using an empirical example, and discusses the potential application of the PSM in different management fields. The implementation of the PSM in the management field will increase researchers’ ability to draw causal inferences using observational data sets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731 · cited 4×
“Friedman (2001) has shown that boosted regression outperforms other methods in reducing prediction error. McCaffrey et al. (2004) summarized three important advantages of the boosting technique. First, regression trees are easy and fast to fit. Second, regression trees can handle different types of covariates includin…”
MethodInfluentialSample Selection Bias as a Specification Error
Heckman, J. J. (1979) · Econometrica · doi:10.2307/1912352 · Cited by 28,779
(2001) · RePEc: Research Papers in Economics · Cited by 27,577
Designing Social Inquiry: Scientific Inference in Qualitative Research
King, G., Keohane, R. O., & Verba, S. (1994) · Princeton University Press · doi:10.1515/9781400821211 · Cited by 7,225
Regression Models for Categorical and Limited Dependent Variables.
MTW, & Long, J. S. (1997) · Journal of the American Statistical Association · doi:10.2307/2965458 · Cited by 6,898
Matching as an econometric evaluation estimator: Evidence from evaluating a job training programme
Heckman, J. J., Ichimura, H., & Todd, P. E. (1997) · The Review of Economic Studies · doi:10.2307/2971733 · Cited by 5,486 · cited 3×
“Readers who are interested in estimating the ATT using longitudinal data can also refer to the nonparametric conditional difference-in-difference model (Heckman et al., 1997) and the semiparametric conditional difference-in-difference model (Heckman et al.”
BackgroundMethodRegression Models for Categorical and Limited Dependent Variables
Calvin, J. A. (1998) · Technometrics · doi:10.1080/00401706.1998.10485496 · Cited by 5,201
Recent Developments in the Econometrics of Program Evaluation
Imbens, G. W., & Wooldridge, J. M. (2009) · Journal of Economic Literature · doi:10.1257/jel.47.1.5 · Cited by 4,926
Propensity Score-Matching Methods for Nonexperimental Causal Studies
Dehejia, R. H., & Wahba, S. (2002) · Review of Economics and Statistics · doi:10.1162/003465302317331982 · Cited by 4,846
Rosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 4,774
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Fixed Effects Regression Models
Allison, P. (2009) · doi:10.4135/9781412993869 · Cited by 3,999
Journal of Statistical Software
Leeuw, J. D. (2009) · WIREs Computational Statistics · doi:10.1002/wics.10 · Cited by 3,599
Does matching overcome lalonde’s critique of nonexperimental estimators?
A. Smith, J., & E. Todd, P. (2005) · Journal of Econometrics · doi:10.1016/j.jeconom.2004.04.011 · Cited by 3,176
Reducing Bias in Observational Studies Using Subclassification on the Propensity Score
Rosenbaum, P. R., & Rubin, D. B. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10478078 · Cited by 3,082
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
Estimating Causal Effects from Large Data Sets Using Propensity Scores
Rubin, D. B. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-8_part_2-199710151-00064 · Cited by 2,877
Estimation of Average Treatment Effects Based on Propensity Scores
Becker, S. O., & Ichino, A. (2002) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0200200403 · Cited by 2,754
On making causal claims: A review and recommendations
Antonakis, J., Bendahan, S., Jacquart, P., & Lalive, R. (2010) · The Leadership Quarterly · doi:10.1016/j.leaqua.2010.10.010 · Cited by 2,441
Causal effects in nonexperimental studies: Reevaluating the evaluation of training programs
Dehejia, R. H., & Wahba, S. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10473858 · Cited by 2,395
Rosenbaum, P. R. (2002) · Springer Series in Statistics · doi:10.1007/978-1-4757-3692-2 · Cited by 2,394
Characterizing Selection Bias Using Experimental Data
Heckman, J., Ichimura, H., Smith, J., & Todd, P. (1998) · Econometrica · doi:10.2307/2999630 · Cited by 2,286
The real effects of financial constraints: Evidence from a financial crisis
Campello, M., Graham, J. R., & Harvey, C. R. (2010) · Journal of Financial Economics · doi:10.1016/j.jfineco.2010.02.009 · Cited by 2,280
(2009) · American Economic Review · doi:10.1257/aer.99.4.i · Cited by 2,230
Using Propensity Scores to Help Design Observational Studies: Application to the Tobacco Litigation
Rubin, D. B. (2001) · Health Services and Outcomes Research Methodology · doi:10.1023/a:1020363010465 · Cited by 2,228 · cited 1×
“Rubin (2001) provided additional discussion on covariate adjustment.”
BackgroundLeuven, E., & Sianesi, B. (2003) · RePEc: Research Papers in Economics · Cited by 2,168
An Introduction to the Bootstrap
Grimshaw, S. D., Efron, B., & Tibshirani, R. J. (1995) · Technometrics · doi:10.2307/1269918 · Cited by 2,095
The role of the propensity score in estimating dose-response functions
Imbens, G. (2000) · Biometrika · doi:10.1093/biomet/87.3.706 · Cited by 1,776
Sekhon, J. S. (2011) · Journal of Statistical Software · doi:10.18637/jss.v042.i07 · Cited by 1,543
The use of logit and probit models in strategic management research: Critical issues
Hoetker, G. (2007) · Strategic Management Journal · doi:10.1002/smj.582 · Cited by 1,519
(2007) · Cited by 1,428
McCaffrey, D. F., Ridgeway, G., & Morral, A. R. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.403 · Cited by 1,317
Correcting for Endogeneity in Strategic Management Research
Hamilton, B. H., & Nickerson, J. A. (2003) · Strategic Organization · doi:10.1177/1476127003001001218 · Cited by 1,309
Causal Analysis: Assumptions, Models, and Data
Schriesheim, C. A., James, L. R., Muliak, S. A., & Brett, J. M. (1984) · The Academy of Management Review · doi:10.2307/258244 · Cited by 1,240
An Introduction to Sample Selection Bias in Sociological Data
Berk, R. A. (1983) · American Sociological Review · doi:10.2307/2095230 · Cited by 1,213 · cited 2×
“For more information on two-stage selection models, readers can consult Berk (1983).”
BackgroundIntroduction to Structural Equation Models.
Cherlin, A., & Duncan, O. D. (1976) · Contemporary Sociology · doi:10.2307/2064059 · Cited by 1,190
Counterfactuals and Causal Inference: Methods and Principles for Social Research
Morgan, S. L., & Winship, C. (2007) · doi:10.1017/cbo9780511804564 · Cited by 1,146
Invited Commentary: Propensity Scores
Joffe, M. M., & Rosenbaum, P. R. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a010011 · Cited by 1,048
The Oxford Handbook of Human Resource Management
(2008) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199547029.001.0001 · Cited by 1,023
Is there Such a thing as “Evidence-Based Management”?
Rousseau, D. M. (2006) · Academy of Management Review · doi:10.5465/amr.2006.20208679 · Cited by 965
The Effectiveness of Adjustment by Subclassification in Removing Bias in Observational Studies
Cochran, W. G. (1968) · Biometrics · doi:10.2307/2528036 · Cited by 961
Heckman, J. (1989) · National Bureau of Economic Research · doi:10.3386/w2861 · Cited by 882
Harder, V. S., Stuart, E. A., & Anthony, J. C. (2010) · Psychological Methods · doi:10.1037/a0019623 · Cited by 802
DiPrete, T. A., & Gangl, M. (2004) · Sociological Methodology · doi:10.1111/j.0081-1750.2004.00154.x · Cited by 732
Comparison of Multivariate Matching Methods: Structures, Distances, and Algorithms
Gu, X. S., & Rosenbaum, P. R. (1993) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1993.10474623 · Cited by 702 · cited 2×
“Heckman et al. (1998) demonstrated that the PSM cannot eliminate bias due to unobservable differences across groups.”
BackgroundEarnings Losses of Displaced Workers Revisited
Couch, K. A., & Placzek, D. W. (2010) · American Economic Review · doi:10.1257/aer.100.1.572 · Cited by 676
Malmendier, U., & Tate, G. (2009) · Quarterly Journal of Economics · doi:10.1162/qjec.2009.124.4.1593 · Cited by 676
Sensitivity analysis for average treatment effects
Becker, S. O., & Caliendo, M. (2007) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0700700104 · Cited by 620
Founder-CEO Succession and the Paradox of Entrepreneurial Success
Wasserman, N. (2003) · Organization Science · doi:10.1287/orsc.14.2.149.14995 · Cited by 555
On the Benefits of Concurrent Lending and Underwriting
DRUCKER, S., & PURI, M. (2005) · The Journal of Finance · doi:10.1111/j.1540-6261.2005.00816.x · Cited by 538
Heckman, J. J., & Hotz, V. J. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478848 · Cited by 515
Analysis of Covariance: Its Nature and Uses
Cochran, W. G. (1957) · Biometrics · doi:10.2307/2527916 · Cited by 504
Lechner, M. (2002) · Review of Economics and Statistics · doi:10.1162/003465302317411488 · Cited by 499
The importance of covariate selection in controlling for selection bias in observational studies.
Steiner, P. M., Cook, T. D., Shadish, W. R., & Clark, M. H. (2010) · Psychological Methods · doi:10.1037/a0018719 · Cited by 490
Angrist, J. D. (1998) · Econometrica · doi:10.2307/2998558 · Cited by 490
Rynes, S. L., Giluk, T. L., & Brown, K. G. (2007) · Academy of Management Journal · doi:10.5465/amj.2007.27151939 · Cited by 485
Scar Effects of Unemployment: An Assessment of Institutional Complementarities
Gangl, M. (2006) · American Sociological Review · doi:10.1177/000312240607100606 · Cited by 452
Introduction to Structural Equation Models
(1975) · Elsevier eBooks · doi:10.1016/c2009-0-03148-1 · Cited by 446
Matching Estimators of Causal Effects: Prospects and Pitfalls in Theory and Practice
Morgan, S. L., & Harding, D. J. (2006) · Sociological Methods & Research · doi:10.1177/0049124106289164 · Cited by 392
(2010) · Routledge eBooks · doi:10.4324/9780203867266 · Cited by 387
Wolfe, F., & Michaud, K. (2004) · The American Journal of Medicine · doi:10.1016/j.amjmed.2003.09.039 · Cited by 372
Heckman, J. J., & Vytlacil, E. J. (2007) · Handbook of Econometrics · doi:10.1016/s1573-4412(07)06071-0 · Cited by 369
Angrist, J. (1995) · National Bureau of Economic Research · doi:10.3386/w5192 · Cited by 341
Toolkit for Weighting and Analysis of Nonequivalent Groups: A tutorial for the twang package
Ridgeway, G. K., McCarey, D., Morral, A. R., Burgette, L. F., & Grin, B. A. (2014) · Cited by 285
Causality: Some Statistical Aspects
Cox, D. R. (1992) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982962 · Cited by 277 · cited 1×
“Cox (1992) defined a cause as an intervention that brings about a change in the variable of interest, compared with the baseline control model.”
Latino Immigrants and the U.S. Racial Order: How and Where Do They Fit In?
Frank, R., Akresh, I. R., & Lu, B. (2010) · American Sociological Review · doi:10.1177/0003122410372216 · Cited by 273
Mediation Testing in Management Research: A Review and Proposals
Wood, R. E., Goodman, J. S., Beckmann, N., & Cook, A. (2008) · Organizational Research Methods · doi:10.1177/1094428106297811 · Cited by 235
GERHART, B., WRIGHT, P. M., & MCMAHAN, G. C. (2000) · Personnel Psychology · doi:10.1111/j.1744-6570.2000.tb02420.x · Cited by 218
The Role of a Second Control Group in an Observational Study
Rosenbaum, P. R. (1987) · Statistical Science · doi:10.1214/ss/1177013232 · Cited by 195
Boosted Regression (Boosting): An Introductory Tutorial and a Stata Plugin
Schonlau, M. (2005) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0500500304 · Cited by 192
Li, Y. P., Propert, K. J., & Rosenbaum, P. R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753208573 · Cited by 191
Empire-Building or Bridge-Building? Evidence from New CEOs’ Internal Capital Allocation Decisions
Xuan, Y. (2009) · Review of Financial Studies · doi:10.1093/rfs/hhp030 · Cited by 172
Beck, N., Brüderl, J., & Woywode, M. (2008) · Academy of Management Journal · doi:10.5465/amj.2008.32625943 · Cited by 150
Comparing Experimental and Matching Methods Using a Large-Scale Voter Mobilization Experiment
Arceneaux, K., Gerber, A. S., & GREEN, D. P. (2005) · Political Analysis · doi:10.1093/pan/mpj001 · Cited by 148
The unmeasured variables problem in path analysis.
James, L. R. (1980) · Journal of Applied Psychology · doi:10.1037/0021-9010.65.4.415 · Cited by 130
Teaching Statistical Inference for Causal Effects in Experiments and Observational Studies
Rubin, D. B. (2004) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986029003343 · Cited by 126
Compensatory Sponsorship in Higher Education
Grodsky, E. (2007) · American Journal of Sociology · doi:10.1086/512707 · Cited by 117
Anti–tumor necrosis factor therapies
Taylor, P. C. (2001) · Current Opinion in Rheumatology · doi:10.1097/00002281-200105000-00003 · Cited by 93
The truth(s) on testing for mediation in the social and organizational sciences
LeBreton, J. M., Wu, J., & Bing, M. N. (2008) · Cited by 73
Analysis of Robust Quasi-Deviances for Generalized Linear Models
Cantoni, E. (2004) · Journal of Statistical Software · doi:10.18637/jss.v010.i04 · Cited by 60
PSAgraphics: AnRPackage to Support Propensity Score Analysis
Helmreich, J. E., & Pruzek, R. M. (2009) · Journal of Statistical Software · doi:10.18637/jss.v029.i06 · Cited by 21
Matching in Observational Studies
Rosenbaum, P. R. (2004) · Wiley series in probability and statistics · doi:10.1002/0470090456.ch2 · Cited by 13
Mellor, S., & Mark, M. M. (1998) · Organizational Research Methods · doi:10.1177/109442819813003 · Cited by 8
Cited by
Hill, A. D., Johnson, S. G., Greco, L. M., O’Boyle, E. H., & Walter, S. L. (2021) · Journal of Management · doi:10.1177/0149206320960533 · Cited by 762
On doing better science: From thrill of discovery to policy implications
Antonakis, J. (2017) · The Leadership Quarterly · doi:10.1016/j.leaqua.2017.01.006 · Cited by 475
Does environmental regulation indirectly induce upstream innovation? New evidence from India
Chakraborty, P., & Chatterjee, C. (2017) · Research Policy · doi:10.1016/j.respol.2017.03.004 · Cited by 313
Podsakoff, P. M., & Podsakoff, N. P. (2019) · The Leadership Quarterly · doi:10.1016/j.leaqua.2018.11.002 · Cited by 312
Does contract farming improve welfare? A review
Bellemare, M. F., & Bloem, J. R. (2018) · World Development · doi:10.1016/j.worlddev.2018.08.018 · Cited by 280
Metadata
- Authors
- Li, M.
- Venue
- Organizational Research Methods
- Publisher
- SAGE Publications
- Published
- 2012-06-13
- Volume
- 16
- Issue
- 2
- Pages
- 188-226
- ISSN
- 1094-4281 (ISSN-L)
- 1552-7425
- OpenAlex
- W2126600133
- Cited by
- 366
- References
- 86
- FWCI
- 5.39
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.