The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Beyond Publication Bias
Open accessAbstract
This review considers several meta-regression and graphical methods that can differentiate genuine empirical effect from publication bias. Publication selection exists when editors, reviewers, or researchers have a preference for statistically significant results. Because all areas of empirical research are susceptible to publication selection, any average or tally of significant/insignificant studies is likely to be biased and potentially misleading. Meta-regression analysis can see through the murk of random sampling error and selected misspecification bias to identify the underlying statistical structures that characterize genuine empirical effect. Meta-significance testing and precision-effect testing (PET) are offered as a means to identify empirical effect beyond publication bias and are applied to four areas of empirical economics research – minimum wage effects, union-productivity effects, price elasticities, and tests of the natural rate hypothesis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Quantifying heterogeneity in a meta‐analysis
Higgins, J. P. T., & Thompson, S. G. (2002) · Statistics in Medicine · doi:10.1002/sim.1186 · Cited by 36,763
A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity
White, H. (1980) · Econometrica · doi:10.2307/1912934 · Cited by 25,861
Operating characteristics of a rank correlation test for publication bias
Begg, C. B., & Mazumdar, M. (1994) · Biometrics · doi:10.2307/2533446 · Cited by 16,955
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
The Logic of Scientific Discovery
Popper, K. R., & Weiss, G. (1959) · Physics Today · doi:10.1063/1.3060577 · Cited by 2,717
Publication and related bias in meta-analysis
Sterne, J. A. C., Gavaghan, D., & Egger, M. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00242-0 · Cited by 2,282
Econometric Theory and Methods
Davidson, R., & MacKinnon, J. G. (2003) · Cited by 1,768
Davidson, J. E. H., Hendry, D. F., Srba, F., & Yeo, S. (1978) · The Economic Journal · doi:10.2307/2231972 · Cited by 1,628
Assessing the Effects of School Resources on Student Performance: An Update
Hanushek, E. A. (1997) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737019002141 · Cited by 1,612
Empirical assessment of effect of publication bias on meta-analyses
Sutton, A. J. (2000) · BMJ · doi:10.1136/bmj.320.7249.1574 · Cited by 1,398
A comparison of methods to detect publication bias in meta‐analysis
Macaskill, P., Walter, S. D., & Irwig, L. (2001) · Statistics in Medicine · doi:10.1002/sim.698 · Cited by 1,286
Multinational Companies and Productivity Spillovers: A Meta‐Analysis
Gorg, H., & Strobl, E. (2001) · The Economic Journal · doi:10.1111/1468-0297.00669 · Cited by 1,039
Sterling, T. D. (1959) · Journal of the American Statistical Association · doi:10.1080/01621459.1959.10501497 · Cited by 964
Wheat From Chaff: Meta-Analysis As Quantitative Literature Review
Stanley, T. D. (2001) · Journal of Economic Perspectives · doi:10.1257/jep.15.3.131 · Cited by 948
Self-citationCombining results of independent studies.
Rosenthal, R. (1978) · Psychological Bulletin · doi:10.1037//0033-2909.85.1.185 · Cited by 910
The Time-Varying NAIRU and its Implications for Economic Policy
Gordon, R. J. (1997) · Journal of Economic Perspectives · doi:10.1257/jep.11.1.11 · Cited by 827
Publication bias—a problem in interpreting medical data
Begg, C. B., & Berlin, J. A. (1988) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2982993 · Cited by 814
META‐REGRESSION ANALYSIS: A QUANTITATIVE METHOD OF LITERATURE SURVEYS
Stanley, T. D., & Jarrell, S. B. (2005) · Journal of Economic Surveys · doi:10.1111/j.0950-0804.2005.00249.x · Cited by 805
Self-citationMETA‐REGRESSION ANALYSIS: A QUANTITATIVE METHOD OF LITERATURE SURVEYS
Stanley, T. D., & Jarrell, S. B. (1989) · Journal of Economic Surveys · doi:10.1111/j.1467-6419.1989.tb00064.x · Cited by 805
Self-citationEconomic Considerations and Class Size
Krueger, A. B. (2003) · The Economic Journal · doi:10.1111/1468-0297.00098 · Cited by 723
Micro Data, Heterogeneity, and the Evaluation of Public Policy: Nobel Lecture
Heckman, J. J. (2001) · Journal of Political Economy · doi:10.1086/322086 · Cited by 675
Reflections on the Natural Rate Hypothesis
Stiglitz, J. (1997) · Journal of Economic Perspectives · doi:10.1257/jep.11.1.3 · Cited by 664
A note on graphical presentation of estimated odds ratios from several clinical trials
Galbraith, R. F. (1988) · Statistics in Medicine · doi:10.1002/sim.4780070807 · Cited by 663
Price and Income Elasticities of Residential Water Demand: A Meta-Analysis
Dalhuisen, J. M., Florax, R. J. G. M., de Groot, H. L. F., & Nijkamp, P. (2003) · Land Economics · doi:10.2307/3146872 · Cited by 633
A review of estimates of the schooling/earnings relationship, with tests for publication bias
Ashenfelter, O., Harmon, C., & Oosterbeek, H. (1999) · Labour Economics · doi:10.1016/s0927-5371(99)00041-x · Cited by 413
A Meta-Analytic Assessment of the Effect of Immigration on Wages
Longhi, S., Nijkamp, P., & Poot, J. (2005) · Journal of Economic Surveys · doi:10.1111/j.0950-0804.2005.00255.x · Cited by 388
Selection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 384
Modeling Publication Selection Effects in Meta-Analysis
Hedges, L. V. (1992) · Statistical Science · doi:10.1214/ss/1177011364 · Cited by 359
Publication Bias (The "File-Drawer Problem") in Scientific Inference
Scargle, J. D. (1999) · arXiv · doi:10.48550/arxiv.physics/9909033 · Cited by 313
Are all Economic Hypotheses False?
De Long, J. B., & Lang, K. (1992) · Journal of Political Economy · doi:10.1086/261860 · Cited by 295
A Meta-Analysis of β-Convergence: the Legendary 2%
Abreu, M., de Groot, H. L. F., & Florax, R. J. G. M. (2005) · Journal of Economic Surveys · doi:10.1111/j.0950-0804.2005.00253.x · Cited by 294
Gender Wage Discrimination Bias? A Meta-Regression Analysis
Stanley, T. D., & Jarrell, S. B. (1998) · The Journal of Human Resources · doi:10.2307/146404 · Cited by 281
Self-citationWhat Do Unions Do to Productivity? A Meta‐Analysis
Doucouliagos, C., & Laroche, P. (2003) · Industrial Relations: A Journal of Economy and Society · doi:10.1111/1468-232x.00310 · Cited by 257
Hedges, L. V., & Vevea, J. L. (1996) · Journal of Educational and Behavioral Statistics · doi:10.2307/1165338 · Cited by 221
Doucouliagos, C. (2005) · Journal of Economic Surveys · doi:10.1111/j.0950-0804.2005.00252.x · Cited by 213
Economic Considerations and Class Size
Krueger, A. B. (2002) · National Bureau of Economic Research · doi:10.3386/w8875 · Cited by 206
The Effect of State and Local Taxes on Economic Development: A Meta-Analysis
Phillips, J. M., & Goss, E. (1995) · Southern Economic Journal · doi:10.2307/1060685 · Cited by 169
An Assessment of Publication Bias Using a Sample of Published Clinical Trials
Berlin, J. A., Begg, C. B., & Louis, T. A. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478782 · Cited by 137
New Wine in Old Bottles: A Meta-Analysis of Ricardian Equivalence
Stanley, T. D. (1998) · Southern Economic Journal · doi:10.1002/j.2325-8012.1998.tb00089.x · Cited by 120
Self-citationThe Income Elasticity of Money Demand: A Meta-Analysis of Empirical Results*
Knell, M., & Stix, H. (2005) · Journal of Economic Surveys · doi:10.1111/j.0950-0804.2005.00257.x · Cited by 105
Declining Bias and Gender Wage Discrimination? A Meta-Regression Analysis
Jarrell, S. B., & Stanley, T. D. (2004) · The Journal of Human Resources · doi:10.2307/3558999 · Cited by 93
Self-citationThe Very Idea of Applying Economics: The Modern Minimum-Wage Controversy and Its Antecedents
Leonard, T. C. (2000) · History of Political Economy · doi:10.1215/00182702-32-suppl_1-117 · Cited by 60
Does unemployment hysteresis falsify the natural rate hypothesis? a meta‐regression analysis
Stanley, T. D. (2004) · Journal of Economic Surveys · doi:10.1111/j.0950-0804.2004.00231.x · Cited by 50
Self-citationPublication Bias in the Economic Freedom and Economic Growth LiteraturePreprint
Doucouliagos, H. (2005) · SSRN Electronic Journal · Cited by 27
Krakovsky, M. (2004) · Scientific American · doi:10.1038/scientificamerican1204-18 · Cited by 23
Cited by
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
A meta-analysis of estimates of urban agglomeration economies
Melo, P. C., Graham, D. J., & Noland, R. B. (2009) · Regional Science and Urban Economics · doi:10.1016/j.regsciurbeco.2008.12.002 · Cited by 821
META‐REGRESSION ANALYSIS: A QUANTITATIVE METHOD OF LITERATURE SURVEYS
Stanley, T. D., & Jarrell, S. B. (2005) · Journal of Economic Surveys · doi:10.1111/j.0950-0804.2005.00249.x · Cited by 805
Self-citationMETA‐REGRESSION ANALYSIS: A QUANTITATIVE METHOD OF LITERATURE SURVEYS
Stanley, T. D., & Jarrell, S. B. (1989) · Journal of Economic Surveys · doi:10.1111/j.1467-6419.1989.tb00064.x · Cited by 805
Self-citationReflections on the Natural Rate Hypothesis
Stiglitz, J. (1997) · Journal of Economic Perspectives · doi:10.1257/jep.11.1.3 · Cited by 664
Metadata
- Authors
- Stanley, T. D.
- Venue
- Journal of Economic Surveys
- Publisher
- Wiley
- Published
- 2005-06-22
- Volume
- 19
- Issue
- 3
- Pages
- 309-345
- ISSN
- 0950-0804 (ISSN-L)
- OpenAlex
- W1864180066
- Cited by
- 742
- References
- 47
- FWCI
- 21.01
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.