Meta-Analysis and the Development of Knowledge
The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.
Abstract
With the widespread application of meta-analysis, it is important to examine the role of meta-analysis in the development of knowledge. Researchers have proposed that meta-analysis provides us with an overview of where the research field has been, summarizes and integrates extant research findings, and suggests directions for future research efforts. Some researchers further argue that meta-analysis can contribute to the accumulation of knowledge and the progress of science. In this article, these claims are examined from an epistemological perspective. Using Kuhn’s (1962 , 1970b ) framework, the authors discuss how meta-analysis contributes to the progress of both normal science and extraordinary science and thus plays an important role in knowledge development in a field.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Podsakoff, P. M., MacKenzie, S. B., Paine, J. B., & Bachrach, D. G. (2000) · Journal of Management · doi:10.1177/014920630002600307 · Cited by 5,897
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890 · cited 2×
“Some researchers argue that meta-analysis merely provides a description and summary review of extant studies in a field (e.g., Glass, 1976; Glass et al., 1981; Guzzo et al., 1987; Hoyle, 1993; Sohn, 1996) but is not ideally suited for theory development and scientific discovery (e.g., Chow, 1987;…”
BackgroundMethodFalsification and the Methodology of Scientific Research Programmes
Lakatos, I. (1970) · Criticism and the Growth of Knowledge · doi:10.1017/cbo9781139171434.009 · Cited by 4,649 · cited 1×
“Indeed, well-known philosophers have argued that multiple paradigms can and have coexisted simultaneously even for the mature sciences (Lakatos, 1970; Laudan, 1977; Popper, 1970).”
BackgroundThe Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
The empirical status of cognitive-behavioral therapy: A review of meta-analyses
Butler, A. C., Chapman, J. E., Forman, E. M., & Beck, A. T. (2006) · Clinical Psychology Review · doi:10.1016/j.cpr.2005.07.003 · Cited by 3,215
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023
Meta-Analytic review of leader–member exchange theory: Correlates and construct issues.
Gerstner, C. R., & Day, D. V. (1997) · Journal of Applied Psychology · doi:10.1037/0021-9010.82.6.827 · Cited by 3,005
DePaulo, B. M., Lindsay, J. J., Malone, B. E., Muhlenbruck, L., Charlton, K., & Cooper, H. (2003) · Psychological Bulletin · doi:10.1037/0033-2909.129.1.74 · Cited by 2,479 · cited 2×
“As another example, DePaulo and colleagues’ (DePaulo et al., 2003) meta-analytic study revealed that whether people are lying about transgressions versus nontransgressions (i.”
ResultMeta-analysis: Principles and procedures
Egger, M., Smith, G. D., & Phillips, A. N. (1997) · BMJ · doi:10.1136/bmj.315.7121.1533 · Cited by 2,415
Podsakoff, N. P., Whiting, S. W., Podsakoff, P. M., & Blume, B. D. (2009) · Journal of Applied Psychology · doi:10.1037/a0013079 · Cited by 2,356
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033 · cited 3×
“First, in order for a meta-analysis to be conducted, a corpus of primary studies must exist (Lipsey & Wilson, 1993).”
BackgroundMethodMeta-Analysis: Recent Developments in Quantitative Methods for Literature Reviews
Rosenthal, R., & DiMatteo, M. R. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.59 · Cited by 1,780
Psychology as the behaviorist views it.
Watson, J. B. (1994) · Psychological Review · doi:10.1037//0033-295x.101.2.248 · Cited by 1,735
Johnson, D. W., Maruyama, G., Johnson, R., Nelson, D., & Skon, L. (1981) · Psychological Bulletin · doi:10.1037/0033-2909.89.1.47 · Cited by 1,588
One Hundred Years of Social Psychology Quantitatively Described
Richard, F. D., Bond, C. F., & Stokes-Zoota, J. J. (2003) · Review of General Psychology · doi:10.1037/1089-2680.7.4.331 · Cited by 1,558 · cited 1×
“However, applying metaanalysis to the results of these studies demonstrates that much of the variation across studies is due to sampling error (Richard et al., 2003; Schmidt, 1992) and that the study results are actually quite homogeneous after sampling error is partialed out.”
ResultEffectiveness of training in organizations: A meta-analysis of design and evaluation features.
Arthur, W., Bennett, W., Edens, P. S., & Bell, S. T. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.2.234 · Cited by 1,252
Leader-member exchange and citizenship behaviors: A meta-analysis
Ilies, R., Nahrgang, J. D., & Morgeson, F. P. (2007) · Journal of Applied Psychology · doi:10.1037/0021-9010.92.1.269 · Cited by 1,210
Estimation of a Single Effect Size: Parametric and Nonparametric Methods
Hedges, L. V., & Olkin, I. (1985) · Statistical Methods for Meta-Analysis · doi:10.1016/b978-0-08-057065-5.50010-5 · Cited by 983
DEVELOPMENT OF A LEADER-MEMBER EXCHANGE: A LONGITUDINAL TEST.
BAUER, T. N., & GREEN, S. G. (1996) · Academy of Management Journal · doi:10.2307/257068 · Cited by 944 · cited 1×
“According to LMX theory, leaders form different relationships with their subordinates, such that they have close relationships with some subordinates and distant relationships with others (Bauer & Green, 1996).”
Normal Science and its Dangers
Popper, K. R. (1970) · Criticism and the Growth of Knowledge · doi:10.1017/cbo9781139171434.007 · Cited by 792
The road to forgiveness: A meta-analytic synthesis of its situational and dispositional correlates
Fehr, R., Gelfand, M. J., & Nag, M. (2010) · Psychological Bulletin · doi:10.1037/a0019993 · Cited by 749
What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology.
Schmidt, F. L. (1992) · American Psychologist · doi:10.1037/0003-066x.47.10.1173 · Cited by 564 · cited 19×
“However, applying metaanalysis to the results of these studies demonstrates that much of the variation across studies is due to sampling error (Richard et al., 2003; Schmidt, 1992) and that the study results are actually quite homogeneous after sampling error is partialed out.”
BackgroundMethodResultInfluentialOn Being Rejected: A Meta-Analysis of Experimental Research on Rejection
Gerber, J., & Wheeler, L. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01158.x · Cited by 498 · cited 1×
“…(Baas, De Dreu, & Nijstad, 2008; Becker, 2001; Dalton & Dalton, 2008; Egger, Smith, & Phillips, 1997; Egger, Smith, Schneider, & Minder, 1997; Gerber & Wheeler, 2009; Hunter & Schmidt, 1996, 2004; Kendall & Maruyama, 1985; Richard, Bond, & Stokes-Zoota, 2003; Schmidt, 1992; Steblay, Dysart,…”
Mechanisms of masked priming: A meta-analysis.
Van den Bussche, E., Van den Noortgate, W., & Reynvoet, B. (2009) · Psychological Bulletin · doi:10.1037/a0015329 · Cited by 350
Sharpe, D. (1997) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00056-1 · Cited by 334
Development and test of a new model for validity generalization.
Callender, J. C., & Osburn, H. G. (1980) · Journal of Applied Psychology · doi:10.1037/0021-9010.65.5.543 · Cited by 112 · cited 1×
“Researchers have developed various meta-analytic methods over the years—for fuller descriptions of these methods, see Hedges and Olkin (1985); Rosenthal (1984); Raju, Burke, Normand, and Langlois (1991); Callender and Osburn (1980); Glass et al. (1981); as well as Hunter and Schmidt (2004).”
Method
Cited by
Luque-Suarez, A., Martinez-Calderon, J., & Falla, D. (2019) · British Journal of Sports Medicine · doi:10.1136/bjsports-2017-098673 · Cited by 546
Self-Efficacy and Chronic Pain Outcomes: A Meta-Analytic Review
Jackson, T., Wang, Y., Wang, Y., & Fan, H. (2014) · The Journal of Pain · doi:10.1016/j.jpain.2014.05.002 · Cited by 411
Attentional bias to pain-related information: a meta-analysis.
Crombez, G., Van Ryckeghem, D. M. L., Eccleston, C., & Van Damme, S. (2013) · Pain · doi:10.1016/j.pain.2012.11.013 · Cited by 334
“A meta-analytic synthesis is necessary because in combining data from multiple studies, we can overcome the restrictions or peculiarities of any singular study [22].”
Antecedents and Outcomes of Informal Learning Behaviors: a Meta-Analysis
Cerasoli, C. P., Alliger, G. M., Donsbach, J. S., Mathieu, J. E., Tannenbaum, S. I., & Orvis, K. A. (2018) · Journal of Business and Psychology · doi:10.1007/s10869-017-9492-y · Cited by 319
The effects of psychological distance on abstraction: Two meta-analyses.
Soderberg, C. K., Callahan, S. P., Kochersberger, A. O., Amit, E., & Ledgerwood, A. (2015) · Psychological Bulletin · doi:10.1037/bul0000005 · Cited by 299
Metadata
- Authors
- Chan, M. E., & Arvey, R. D.
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2012-01
- Volume
- 7
- Issue
- 1
- Pages
- 79-92
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W2087244196
- Cited by
- 126
- References
- 28
- FWCI
- 7.43
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.