META‐REGRESSION ANALYSIS: A QUANTITATIVE METHOD OF LITERATURE SURVEYS
Open accessAbstract
Abstract. Pedagogically, literature reviews are instrumental. They summarize the large literature written on a particular topic, give coherence to the complex, often disparate, views expressed about an issue, and serve as a springboard for new ideas. However, literature surveys rarely establish anything approximating unanimous consensus. Ironically, this is just as true for the empirical economic literature. To harmonize this dissonance, we offer a quantitative methodology for reviewing the empirical economic literature. Meta-regression analysis (MRA) is the regression analysis of regression analyses. MRA tends to objectify the review process. It studies the processes that produce empirical economic results as though they were any other social scientific phenomenon. MRA provides a framework for replication and offers a sensitivity analysis for model specification. In this brief essay, we propose a new method of reviewing economic literature, MRA, and discuss its potential.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695 · see citing works
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890 · see citing works
Meta-analysis of comparative therapy outcome studies: a replication and refinement.
Shapiro, D. A., & Shapiro, D. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.92.3.581 · Cited by 590 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Delmas, M. A., Fischlein, M., & Asensio, O. I. (2013) · Energy Policy · doi:10.1016/j.enpol.2013.05.109 · Cited by 672 · see citing works
A solution to minimum sample size for regressions
Jenkins, D. G., & Quintana-Ascencio, P. F. (2020) · PLOS ONE · doi:10.1371/journal.pone.0229345 · Cited by 665 · see citing works
The Power of Bias in Economics Research
Ioannidis, J. P. A., Stanley, T. D., & Doucouliagos, H. (2017) · The Economic Journal · doi:10.1111/ecoj.12461 · Cited by 634 · see citing works
Self-citationA meta-analysis on the price elasticity of energy demand
Labandeira, X., Labeaga, J. M., & López-Otero, X. (2017) · Energy Policy · doi:10.1016/j.enpol.2017.01.002 · Cited by 590 · see citing works
Quaglia, J. T., Braun, S. E., Freeman, S. P., McDaniel, M. A., & Brown, K. W. (2016) · Psychological Assessment · doi:10.1037/pas0000268 · Cited by 341 · see citing works
How to conduct a meta-analysis in eight steps: A practical guide
Hansen, C., Steinmetz, H., & Block, J. (2022) · Management Review Quarterly · doi:10.1007/s11301-021-00247-4 · Cited by 218 · see citing works
INFLATION AND CENTRAL BANK INDEPENDENCE: A META-REGRESSION ANALYSIS
Klomp, J., & De Haan, J. (2010) · Journal of Economic Surveys · doi:10.1111/j.1467-6419.2009.00597.x · Cited by 209 · see citing works
Neither fixed nor random: weighted least squares meta‐regression
Stanley, T. D., & Doucouliagos, H. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1211 · Cited by 205 · see citing works
Self-citationInformation Technology Impacts on Firm Performance: An Extension of Kohli and 1
Sabherwal, R., & Jeyaraj, A. (2015) · MIS Quarterly · doi:10.25300/misq/2015/39.4.4 · Cited by 200 · see citing works
Demand for gasoline is more price-inelastic than commonly thought
Havranek, T., Irsova, Z., & Janda, K. (2012) · Energy Economics · doi:10.1016/j.eneco.2011.09.003 · Cited by 164 · see citing works
The impact of Covid-19 on student achievement: Evidence from a recent meta-analysis
Di Pietro, G. (2023) · Educational Research Review · doi:10.1016/j.edurev.2023.100530 · Cited by 173 · see citing works
Youth cyber dating abuse: A meta-analysis of risk and protective factors
Caridade, S. M. M., & Braga, T. (2020) · Cyberpsychology: Journal of Psychosocial Research on Cyberspace · doi:10.5817/cp2020-3-2 · Cited by 76 · see citing works
Public sector reforms and their impact on the level of corruption: A systematic review
Mugellini, G., Della Bella, S., Colagrossi, M., Isenring, G. L., & Killias, M. (2021) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.1002/cl2.1173 · Cited by 60 · see citing works
Respiratory therapy for the treatment of anxiety: Meta-analytic review and regression
Leyro, T. M., Versella, M. V., Yang, M.-J., Brinkman, H. R., Hoyt, D. L., & Lehrer, P. (2021) · Clinical Psychology Review · doi:10.1016/j.cpr.2021.101980 · Cited by 53 · see citing works
- Authors
- Stanley, T. D., & Jarrell, S. B.
- Affiliations
- Hendrix College (US)
- Western Carolina University (US)
- ORCID
- Stanley, T. D.
- Venue
- Journal of Economic Surveys
- Publisher
- Wiley
- Published
- 2005-06-22
- Volume
- 19
- Issue
- 3
- Pages
- 299-308
- ISSN
- 0950-0804 (ISSN-L)
- OpenAlex
- W2122415632
- Cited by
- 805
- References
- 3
- Citations by year
- 2026: 23 · 2025: 26 · 2024: 48 · 2023: 31 · 2022: 40 · 2021: 44 · 2020: 48 · 2019: 49 · 2018: 57 · 2017: 29 · 2016: 36 · 2015: 44 · 2014: 36 · 2013: 49 · 2012: 34
- FWCI
- 2.43
- Type
- journal article
- Language
- en
- Open access
- green
- papers.ssrn.com
- Locations
- Journal of Economic Surveys (publishedVersion)
- SSRN Electronic Journal (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Keywords
- empirical economics, replication, sensitivity analysis, model specification
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review