The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Omitted Variable Bias: Examining Management Research With the Impact Threshold of a Confounding Variable (ITCV)
Open accessAbstract
Management research increasingly recognizes omitted variables as a primary source of endogeneity that can induce bias in empirical estimation. Methodological scholarship on the topic overwhelmingly advocates for empirical researchers to employ two-stage instrumental variable modeling, a recommendation we approach with trepidation given the challenges associated with this analytic procedure. Over the course of two studies, we leverage a statistical technique called the impact threshold of a confounding variable (ITCV) to better conceptualize what types of omitted variables might actually bias causal inference and whether they have appeared to do so in published management research. In Study 1, we apply the ITCV to published studies and find that a majority of the causal inference is unlikely biased from omitted variables. In Study 2, we respecify an influential simulation on endogeneity and determine that only the most pervasive omitted variables appear to substantively impact causal inference. Our simulation also reveals that only the strongest instruments (perhaps unrealistically strong) attenuate bias in meaningful ways. Taken together, we offer guidelines for how scholars can conceptualize omitted variables in their research, provide a practical approach that balances the tradeoffs associated with instrumental variable models, and comprehensively describe how to implement the ITCV technique.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Introductory Econometrics: A Modern Approach
Wooldridge, J. M. (1999) · Cited by 14,451
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Kemp, F. (2003) · Journal of the Royal Statistical Society: Series D (The Statistician) · doi:10.1046/j.1467-9884.2003.t01-2-00383_4.x · Cited by 9,293
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Hsiao, C. (2014) · doi:10.1017/cbo9781139839327 · Cited by 7,869
Hsiao, C. (2022) · doi:10.1017/9781009057745 · Cited by 7,869
A Survey of Weak Instruments and Weak Identification in Generalized Method of Moments
Stock, J. H., Wright, J. H., & Yogo, M. (2002) · Journal of Business & Economic Statistics · doi:10.1198/073500102288618658 · Cited by 4,274
HELPING AND VOICE EXTRA-ROLE BEHAVIORS: EVIDENCE OF CONSTRUCT AND PREDICTIVE VALIDITY.
Van Dyne, L., & LePine, J. A. (1998) · Academy of Management Journal · doi:10.2307/256902 · Cited by 3,178
On the use of instrumental variables in accounting research
Larcker, D. F., & Rusticus, T. O. (2010) · Journal of Accounting and Economics · doi:10.1016/j.jacceco.2009.11.004 · Cited by 2,408
Podsakoff, N. P., Whiting, S. W., Podsakoff, P. M., & Blume, B. D. (2009) · Journal of Applied Psychology · doi:10.1037/a0013079 · Cited by 2,356
Dispositional effects on job and life satisfaction: The role of core evaluations.
Judge, T. A., Locke, E. A., Durham, C. C., & Kluger, A. N. (1998) · Journal of Applied Psychology · doi:10.1037//0021-9010.83.1.17 · Cited by 2,007
Kish-Gephart, J. J., Harrison, D. A., & Treviño, L. K. (2010) · Journal of Applied Psychology · doi:10.1037/a0017103 · Cited by 1,690
Dulebohn, J. H., Bommer, W. H., Liden, R. C., Brouer, R. L., & Ferris, G. R. (2012) · Journal of Management · doi:10.1177/0149206311415280 · Cited by 1,625
Correcting for Endogeneity in Strategic Management Research
Hamilton, B. H., & Nickerson, J. A. (2003) · Strategic Organization · doi:10.1177/1476127003001001218 · Cited by 1,309
Controlling for endogeneity with instrumental variables in strategic management research
Bascle, G. (2008) · Strategic Organization · doi:10.1177/1476127008094339 · Cited by 1,133
Impact of a Confounding Variable on a Regression Coefficient
FRANK, K. A. (2000) · Sociological Methods & Research · doi:10.1177/0049124100029002001 · Cited by 1,032
Shaver, J. M. (1998) · Management Science · doi:10.1287/mnsc.44.4.571 · Cited by 1,014
Sample selection bias and Heckman models in strategic management research
Certo, S. T., Busenbark, J. R., Woo, H., & Semadeni, M. (2016) · Strategic Management Journal · doi:10.1002/smj.2475 · Cited by 946
Self-citationEby, L. T. D. T., Hurst, C. S., & Butts, M. M. (2008) · Cited by 926
Hill, A. D., Johnson, S. G., Greco, L. M., O’Boyle, E. H., & Walter, S. L. (2021) · Journal of Management · doi:10.1177/0149206320960533 · Cited by 762
Gabriel, A. S., Podsakoff, N. P., Beal, D. J., Scott, B. A., Sonnentag, S., Trougakos, J. P., & Butts, M. M. (2019) · Organizational Research Methods · doi:10.1177/1094428118802626 · Cited by 755 · cited 2×
“In micro-oriented management scholarship, researchers are often constrained in terms of the number of variables they can collect, so it is quite costly to secure more data after the initial process (Atinc, Simmering, & Kroll, 2012; Gabriel et al., 2019).”
BackgroundSemadeni, M., Withers, M. C., & Trevis Certo, S. (2014) · Strategic Management Journal · doi:10.1002/smj.2136 · Cited by 739
Self-citationMETA-ANALYSES OF FINANCIAL PERFORMANCE AND EQUITY: FUSION OR CONFUSION?
Dalton, D. R., Daily, C. M., Certo, S. T., & Roengpitya, R. (2003) · Academy of Management Journal · doi:10.2307/30040673 · Cited by 643
Chamberlin, M., Newton, D. W., & Lepine, J. A. (2017) · Personnel Psychology · doi:10.1111/peps.12185 · Cited by 532
Multicollinearity: How common factors cause Type 1 errors in multivariate regression
Kalnins, A. (2018) · Strategic Management Journal · doi:10.1002/smj.2783 · Cited by 526 · cited 1×
“We specify our simulations using a procedure informed by protocols implemented in the growing stream of management research that uses simulations to investigate methodological questions (Certo, Busenbark, Kalm, & LePine, 2020; Certo et al., 2016; Kalnins, 2018; Semadeni et al., 2014; Zelner, 2009).”
MethodUsing simulation to interpret results from logit, probit, and other nonlinear models
Zelner, B. A. (2009) · Strategic Management Journal · doi:10.1002/smj.783 · Cited by 459
Jeong, S.-H., & Harrison, D. A. (2017) · Academy of Management Journal · doi:10.5465/amj.2014.0716 · Cited by 429
Frank, K. A., Maroulis, S. J., Duong, M. Q., & Kelcey, B. M. (2013) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373713493129 · Cited by 406 · cited 8×
“…to highlight that the ITCV is useful to examine the causal inference and statistical significance of relationships between independent and dependent variables, but it does not address inaccuracies of the parameter estimate itself (Frank, 2000; Frank et al., 2013; Larcker & Rusticus, 2010).”
BackgroundMethodInfluentialMatta, F. K., Scott, B. A., Koopman, J., & Conlon, D. E. (2015) · Academy of Management Journal · doi:10.5465/amj.2014.0106 · Cited by 386
OLS and IV estimation of regression models including endogenous interaction terms
Bun, M. J. G., & Harrison, T. D. (2019) · Econometric Reviews · doi:10.1080/07474938.2018.1427486 · Cited by 346
A tale of two effects: Using longitudinal data to compare within‐ and between‐firm effects
Certo, S. T., Withers, M. C., & Semadeni, M. (2017) · Strategic Management Journal · doi:10.1002/smj.2586 · Cited by 296
Self-citationHigher Highs and Lower Lows: The Role of Corporate Social Responsibility in CEO Dismissal
Hubbard, T. D., Christensen, D. M., & Graffin, S. D. (2017) · Strategic Management Journal · doi:10.1002/smj.2646 · Cited by 274
Gamache, D. L., & McNamara, G. (2019) · Academy of Management Journal · doi:10.5465/amj.2017.0526 · Cited by 272
Self-citationControl Variable Use and Reporting in Macro and Micro Management Research
Atinc, G., Simmering, M. J., & Kroll, M. J. (2012) · Organizational Research Methods · doi:10.1177/1094428110397773 · Cited by 267
Advice on using heteroskedasticity-based identification
Baum, C. F., & Lewbel, A. (2019) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x19893614 · Cited by 225
konfound: Command to quantify robustness of causal inferences
Xu, R., Frank, K. A., Maroulis, S. J., & Rosenberg, J. M. (2019) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x19874223 · Cited by 223 · cited 4×
“The RIR value is calculated using identical inputs to the ITCV, but it deals with hypothetical changes to the underlying data rather than correlations (Frank et al., forthcoming; Xu et al., 2019).”
BackgroundMethodInfluentialQuantitative empirical analysis in strategic management
Bettis, R., Gambardella, A., Helfat, C., & Mitchell, W. (2014) · Strategic Management Journal · doi:10.1002/smj.2278 · Cited by 212
Divided We Fall: How Ratios Undermine Research in Strategic Management
Certo, S. T., Busenbark, J. R., Kalm, M., & LePine, J. A. (2020) · Organizational Research Methods · doi:10.1177/1094428118773455 · Cited by 178
Self-citationCarnes, C. M., Xu, K., Sirmon, D. G., & Karadag, R. (2018) · Journal of Management Studies · doi:10.1111/joms.12391 · Cited by 165
Foreshadowing as Impression Management: Illuminating the Path for Security Analysts
Busenbark, J. R., Lange, D. A., & Certo, S. T. (2017) · Strategic Management Journal · doi:10.1002/smj.2659 · Cited by 162
Self-citationHarrison, J. S., Boivie, S., Sharp, N. Y., & Gentry, R. J. (2017) · Academy of Management Journal · doi:10.5465/amj.2016.0471 · Cited by 151
SCIENTIFIC APOPHENIA IN STRATEGIC MANAGEMENT RESEARCH: SIGNIFICANCE TESTS & MISTAKEN INFERENCE
Goldfarb, B. D., & King, A. A. (2016) · Strategic Management Journal · doi:10.1002/smj.2459 · Cited by 116
BS in the boardroom: Benevolent sexism and board chair orientations
Oliver, A. G., Krause, R. A., Busenbark, J. R., & Kalm, M. (2017) · Strategic Management Journal · doi:10.1002/smj.2698 · Cited by 116
Self-citationBowen, H. P. (2010) · Journal of Management · doi:10.1177/0149206309356324 · Cited by 114
60th Anniversary Essay: How Journals Could Improve Research Practices in Social Science
Starbuck, W. H. (2016) · Administrative Science Quarterly · doi:10.1177/0001839216629644 · Cited by 110
Does NBPTS Certification Affect the Number of Colleagues a Teacher Helps With Instructional Matters?
Frank, K. A., Sykes, G., Anagnostopoulos, D., Cannata, M. A., Chard, L., Krause, A. E., & McCrory, R. (2008) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373707313781 · Cited by 89
Impression Offsetting as an Early Warning Signal of Low CEO Confidence in Acquisitions
Gamache, D. L., McNamara, G. M., Graffin, S. D., Kiley, J. T., Haleblian, J. M., & Devers, C. E. (2018) · Academy of Management Journal · doi:10.5465/amj.2017.0158 · Cited by 87
Self-citationData analytic trends and training in strategic management
Shook, C. L., Ketchen, D. J., Cycyota, C. S., & Crockett, D. R. (2003) · Strategic Management Journal · doi:10.1002/smj.352 · Cited by 81
A Call for Openness in Research Reporting: How to Turn Covert Practices Into Helpful Tools
Schwab, A., & Starbuck, W. H. (2016) · Academy of Management Learning and Education · doi:10.5465/amle.2016.0039 · Cited by 80
Hill, A., Recendes, T., & Ridge, J. W. (2018) · Strategic Management Journal · doi:10.1002/smj.2986 · Cited by 78
A Probability Index of the Robustness of a Causal Inference
Pan, W., & Frank, K. A. (2003) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986028004315 · Cited by 28
Cited by
Chandler, J. A., Johnson, N. E., Jordan, S. L., B, D. K., & Short, J. C. (2023) · The Leadership Quarterly · doi:10.1016/j.leaqua.2022.101660 · Cited by 105
Metadata
- Authors
- Busenbark, J. R., Yoon, H. (., Gamache, D. L., & Withers, M. C.
- Venue
- Journal of Management
- Publisher
- SAGE Publications
- Published
- 2021-04-23
- Volume
- 48
- Issue
- 1
- Pages
- 17-48
- ISSN
- 0149-2063 (ISSN-L)
- 1557-1211
- OpenAlex
- W3158674489
- Cited by
- 457
- References
- 50
- FWCI
- 38.96
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.