Assessing Cumulative Evidence within ‘Macro’ Research: Why Meta-Analysis Should be Preferred Over Vote Counting
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Understanding the conclusions a body of evidence offers involves accumulating findings. Two recent articles used vote counting to assess the evidence related to important macro theories: transaction cost theory and resource-based theory. Each concluded that its focal theory is not well supported. In contrast, recent meta-analyses of the same theories concluded that both are strongly supported. We explain why macro researchers should trust the findings of meta-analyses but not those of vote counts. A direct implication is that researchers interested in advancing transaction cost and resource-based theories need to build upon the meta-analytic evidence. A broader implication is that, as the preferred method for accumulating evidence, meta-analysis can be a catalyst for the re-evaluation of established theories and the development of new theory.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524
Firm Resources and Sustained Competitive Advantage
Barney, J. (1991) · Journal of Management · doi:10.1177/014920639101700108 · Cited by 48,334
HUSELID, M. A. (1995) · Academy of Management Journal · doi:10.2307/256741 · Cited by 9,342
The Structure of Scientific Revolutions
Kuhn, T. S. (1996) · doi:10.7208/chicago/9780226458106.001.0001 · Cited by 7,281
Managing Firm Resources in Dynamic Environments to Create Value: Looking Inside the Black Box
Sirmon, D. G., Hitt, M. A., & Ireland, R. D. (2007) · Academy of Management Review · doi:10.5465/amr.2007.23466005 · Cited by 3,701
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023
Five-factor model of personality and job satisfaction: A meta-analysis.
Judge, T. A., Heller, D., & Mount, M. K. (2002) · Journal of Applied Psychology · doi:10.1037/0021-9010.87.3.530 · Cited by 2,164
Risk of Cardiovascular Events Associated with Selective COX-2 Inhibitors
Mukherjee, D. (2001) · JAMA · doi:10.1001/jama.286.8.954 · Cited by 1,741
On the Use of Beta Coefficients in Meta-Analysis.
Peterson, R. A., & Brown, S. P. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.1.175 · Cited by 1,643
Statistical Power Analysis for the Behavioral Sciences
Wassertheil, S., & Cohen, J. (1970) · Biometrics · doi:10.2307/2529115 · Cited by 1,383
Cited by
How to conduct a bibliometric analysis: An overview and guidelines
Donthu, N., Kumar, S., Mukherjee, D., Pandey, N., & Lim, W. M. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2021.04.070 · Cited by 14,329
Pickering, C., & Byrne, J. (2014) · Higher Education Research & Development · doi:10.1080/07294360.2013.841651 · Cited by 1,334
Stam, W., Arzlanian, S., & Elfring, T. (2014) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2013.01.002 · Cited by 1,018
Cao, Z., & Lumineau, F. (2015) · Journal of Operations Management · doi:10.1016/j.jom.2014.09.009 · Cited by 937
Doing More with Less: Innovation Input and Output in Family Firms
Duran, P., Kammerlander, N., van Essen, M., & Zellweger, T. (2016) · Academy of Management Journal · doi:10.5465/amj.2014.0424 · Cited by 928
Metadata
- Authors
- Combs, J. G., Ketchen Jr, D. J., Crook, T. R., & Roth, P. L.
- Venue
- Journal of Management Studies
- Publisher
- Wiley
- Published
- 2009-11-04
- Volume
- 48
- Issue
- 1
- Pages
- 178-197
- ISSN
- 0022-2380 (ISSN-L)
- OpenAlex
- W1500399834
- Cited by
- 153
- References
- 14
- FWCI
- 4.78
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessing Cumulative Evidence within ‘Macro’ Research: Why Meta-Analysis Should be Preferred Over Vote Counting. https://app.cochat.ai/papers/10.1111/j.1467-6486.2009.00899.x
- The paper
- Combs, J. G., Ketchen Jr, D. J., Crook, T. R., & Roth, P. L. (2011). Assessing Cumulative Evidence within ‘Macro’ Research: Why Meta-Analysis Should be Preferred Over Vote Counting. Journal of Management Studies. https://doi.org/10.1111/j.1467-6486.2009.00899.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.