Cited by 2,461Meta-analysis and systematic reviewsPsychology Research and BibliometricsStatistical Methods in Epidemiology

The DOI matches its Crossref record; 331 of the 332 references it cites were found in a registry or an index.

The Essential Guide to Effect Sizes: Statistical Power, Meta-Analysis, and the Interpretation of Research Results

Ellis, Paul D.·2010·Cambridge University Press eBooks

DOI 10.1017/cbo9780511761676

Open this paper in CoChat — free account

Abstract

This succinct and jargon-free introduction to effect sizes gives students and researchers the tools they need to interpret the practical significance of their results. Using a class-tested approach that includes numerous examples and step-by-step exercises, it introduces and explains three of the most important issues relating to the practical significance of research results: the reporting and interpretation of effect sizes (Part I), the analysis of statistical power (Part II), and the meta-analytic pooling of effect size estimates drawn from different studies (Part III). The book concludes with a handy list of recommendations for those actively engaged in or currently preparing research projects.

Integrity signals

Registry

Crossref · 10.1017/cbo9780511761676

Cites

331 of 331 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
Statistical Methods for Rates and Proportions
Fleiss, J. L., Levin, B., & Paik, M. C. (2003) · Wiley Series in Probability and Statistics · doi:10.1002/0471445428 · Cited by 18,646
Case Study Research
Hartley, J. (2004) · Essential Guide to Qualitative Methods in Organizational Research · doi:10.4135/9781446280119.n26 · Cited by 15,461
Untitled work
(1963) · Medical Entomology and Zoology · Cited by 15,085
Psychometric theory (2nd ed.).
Sitgreaves, R. (1979) · Contemporary Psychology · doi:10.1037/018882 · Cited by 14,384
Estimating Nonresponse Bias in Mail Surveys
Armstrong, J. S., & Overton, T. S. (1977) · Journal of Marketing Research · doi:10.2307/3150783 · Cited by 12,222
Statistical Methods for Research Workers
Fisher, R. A. (1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,883
Estimating nonresponse bias in mail surveys
Armstrong, J. S., & Overton, T. S. (1977) · Journal of Marketing Research · doi:10.1177/002224377701400320 · Cited by 10,390
Book Reviews: Statistical Methods for Meta-Analysis Larry V. Hedges and Ingram Olkin New York: Academic Press, 1985. xxii + 369 pp
Wasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,377
The Effect of a Market Orientation on Business Profitability
Narver, J. C., & Slater, S. F. (1990) · Journal of Marketing · doi:10.2307/1251757 · Cited by 9,917
Untitled work
(2000) · Cited by 9,198
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
A power primer.
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
The Logic of Scientific Discovery.
Hutchison, T. W., & Popper, K. R. (1959) · Economica · doi:10.2307/2550489 · Cited by 7,629
No adjustments are needed for multiple comparisons.
Rothman, K. J. (1990) · Epidemiology · doi:10.1097/00001648-199001000-00010 · Cited by 5,965
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
Schmidt, F. L., & Hunter, J. E. (2015) · doi:10.4135/9781483398105 · Cited by 5,542
The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Market Orientation: Antecedents and Consequences
Jaworski, B. J., & Kohli, A. K. (1993) · Journal of Marketing · doi:10.1177/002224299305700304 · Cited by 4,343
Meta-Analytic Procedures for Social Research.
Metcalfe, A., & Rosenthal, R. (1994) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348600 · Cited by 4,249
The earth is round (p < .05).
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
How many subjects does it take to do a regression analysis
Green, S. B. (1991) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr2603_7 · Cited by 3,916
Meta-analysis in social research
(1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90011-8 · Cited by 3,896
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Essence of Decision: Explaining the Cuban Missile Crisis
Holsti, O. R., & Allison, G. T. (1972) · The Western Political Quarterly · doi:10.2307/446741 · Cited by 3,662
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246
Methods of Meta-Analysis
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023
Thirteen Ways to Look at the Correlation Coefficient
Rodgers, J. L., & Nicewander, W. A. (1988) · The American Statistician · doi:10.1080/00031305.1988.10475524 · Cited by 3,004
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Strong Inference: Certain systematic methods of scientific thinking may produce much more rapid progress than others.
Platt, J. R. (1964) · Science · doi:10.1126/science.146.3642.347 · Cited by 2,907
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
MARKOR: A Measure of Market Orientation
Kohli, A. K., Jaworski, B. J., & Kumar, A. S. (1993) · Journal of Marketing Research · doi:10.1177/002224379303000406 · Cited by 2,353
Market Orientation: A Meta-Analytic Review and Assessment of its Antecedents and Impact on Performance
Kirca, A. H., Jayachandran, S., & Bearden, W. O. (2005) · Journal of Marketing · doi:10.1509/jmkg.69.2.24.60761 · Cited by 2,182
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154
A Fail-Safe N for Effect Size in Meta-Analysis
Orwin, R. G. (1983) · Journal of Educational Statistics · doi:10.2307/1164923 · Cited by 2,064
Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology.
Meehl, P. E. (1978) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.46.4.806 · Cited by 2,061
The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
Hoenig, J. M., & Heisey, D. M. (2001) · The American Statistician · doi:10.1198/000313001300339897 · Cited by 2,046
The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis.
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033
HARKing: Hypothesizing after the results are known
Kerr, N. L. (1998) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0203_4 · Cited by 1,989
A Primer of Multivariate Statistics
Strauss, D., & Harris, R. J. (1975) · Biometrics · doi:10.2307/2529445 · Cited by 1,980
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Things I have learned (so far).
Cohen, J. (1990) · American Psychologist · doi:10.1037/0003-066x.45.12.1304 · Cited by 1,781
Meta-Analysis: Recent Developments in Quantitative Methods for Literature Reviews
Rosenthal, R., & DiMatteo, M. R. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.59 · Cited by 1,780
Practical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778
The Cost of Dichotomization
Cohen, J. (1983) · Applied Psychological Measurement · doi:10.1177/014662168300700301 · Cited by 1,564
Inferences of competence from faces predict election outcomes
Todorov, A., Mandisodza, A. N., Goren, A., & Hall, C. C. (2005) · Science · doi:10.1126/science.1110589 · Cited by 1,508
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
Inference by Eye: Confidence Intervals and How to Read Pictures of Data.
Cumming, G., & Finch, S. (2005) · American Psychologist · doi:10.1037/0003-066x.60.2.170 · Cited by 1,449
Statistics with Confidence: Confidence Intervals and Statistical Guidelines.
JOLLIFFE, F. R., Gardner, M. J., & Altman, D. G. (1990) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.2307/2982808 · Cited by 1,319
A simple, general purpose display of magnitude of experimental effect.
Rosenthal, R., & Rubin, D. B. (1982) · Journal of Educational Psychology · doi:10.1037//0022-0663.74.2.166 · Cited by 1,233
Effect Size and Power in Assessing Moderating Effects of Categorical Variables Using Multiple Regression: A 30-Year Review.
Aguinis, H., Beaty, J. C., Boik, R. J., & Pierce, C. A. (2005) · Journal of Applied Psychology · doi:10.1037/0021-9010.90.1.94 · Cited by 1,216
Some Practical Guidelines for Effective Sample Size Determination
Lenth, R. (2001) · The American Statistician · doi:10.1198/000313001317098149 · Cited by 1,200
The Determinants of Salesperson Performance: A Meta-Analysis
Churchill, G. A., Ford, N. M., Hartley, S. W., & Walker, O. C. (1985) · Journal of Marketing Research · doi:10.2307/3151357 · Cited by 1,188
Discrepancies between Meta-Analyses and Subsequent Large Randomized, Controlled Trials
LeLorier, J., Grégoire, G., Benhaddad, A. A., Lapierre, J., & Derderian, F. (1997) · New England Journal of Medicine · doi:10.1056/nejm199708213370806 · Cited by 1,164
The Insignificance of Statistical Significance Testing
Johnson, D. H. (1999) · Journal of Wildlife Management · doi:10.2307/3802789 · Cited by 1,124
Null hypothesis significance testing: a review of an old and continuing controversy
Nickerson, R. S. (2000) · Psychological Methods · doi:10.1037/1082-989x.5.2.241 · Cited by 1,090
A variance explanation paradox: When a little is a lot.
Abelson, R. P. (1985) · Psychological Bulletin · doi:10.1037/0033-2909.97.1.129 · Cited by 1,045
Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers.
Schmidt, F. L. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.115 · Cited by 1,044
Beyond significance testing: Reforming data analysis methods in behavioral research.
Kline, R. B. (2004) · doi:10.1037/10693-000 · Cited by 1,034
When small effects are impressive
Prentice, D. A., & Miller, D. T. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.112.1.160 · Cited by 1,008
Qualitative Descriptors of Strength of Association and Effect Size
Rosenthal, J. A. (1996) · Journal of Social Service Research · doi:10.1300/j079v21n04_02 · Cited by 992
Publication Decisions and their Possible Effects on Inferences Drawn from Tests of Significance—or Vice Versa
Sterling, T. D. (1959) · Journal of the American Statistical Association · doi:10.1080/01621459.1959.10501497 · Cited by 964
Theory-Testing in Psychology and Physics: A Methodological Paradox
Meehl, P. E. (1967) · Philosophy of Science · doi:10.1086/288135 · Cited by 962
Modern robust statistical methods: An easy way to maximize the accuracy and power of your research.
Erceg-Hurn, D. M., & Mirosevich, V. M. (2008) · American Psychologist · doi:10.1037/0003-066x.63.7.591 · Cited by 959
The test of significance in psychological research.
Bakan, D. (1966) · Psychological Bulletin · doi:10.1037/h0020412 · Cited by 957
How Many Subjects?: Statistical Power Analysis in Research
KRAEMER, H. C., & Blasey, C. M. (2016) · SAGE Publications Ltd eBooks · doi:10.4135/9781483398761 · Cited by 935
A common language effect size statistic
McGraw, K. O., & Wong, S. P. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.111.2.361 · Cited by 934
The case against statistical significance testing
Carver, R. (1978) · Harvard Educational Review · doi:10.17763/haer.48.3.t490261645281841 · Cited by 931
Market orientation and innovation
Atuahene-Gima, K. (1996) · Journal of Business Research · doi:10.1016/0148-2963(95)00051-8 · Cited by 900
Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach
Rosenthal, R., Rosnow, R. L., & Rubin, D. B. (1999) · Cited by 854
Logistic Regression: A Primer
Pampel, F. C. (2021) · Sage eBooks · doi:10.4135/9781071878729 · Cited by 848
Fixed effects vs. random effects meta-analysis models: implications for cumulative research knowledge.
Hunter, J. E., & Schmidt, F. L. (2000) · International Journal of Selection and Assessment · doi:10.1111/1468-2389.00156 · Cited by 833
Regression Methods to Detect Publication and Other Bias in Meta‐Analysis
Sterne, J. A. C., & Egger, M. (2005) · Publication Bias in Meta‐Analysis · doi:10.1002/0470870168.ch6 · Cited by 826
Using confidence intervals for graphically based data interpretation.
Masson, M. E., & Loftus, G. (2003) · Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale · doi:10.1037/h0087426 · Cited by 819
Statistics for Management and Economics.
Lowther, J., Keller, G., & Warwick, B. (1997) · Journal of the Operational Research Society · doi:10.2307/3010500 · Cited by 803
Statistical power analysis: a simple and general model for traditional and modern hypothesis tests
Murphy, K. R., & Myors, B. (1998) · Choice Reviews Online · doi:10.5860/choice.36-1020 · Cited by 797
Design Sensitivity: Statistical Power for Experimental Research.
Lachenbruch, P. A., & Lipsey, M. W. (1990) · Journal of the American Statistical Association · doi:10.2307/2289636 · Cited by 781
Development of a general solution to the problem of validity generalization.
Schmidt, F. L., & Hunter, J. E. (1977) · Journal of Applied Psychology · doi:10.1037/0021-9010.62.5.529 · Cited by 769
The Positive Effect of a Market Orientation on Business Profitability
Slater, S. F., & Narver, J. C. (2000) · Journal of Business Research · doi:10.1016/s0148-2963(98)00077-0 · Cited by 764
Market Orientation and Company Performance: Empirical Evidence From UK Companies
Greenley, G. E. (1995) · British Journal of Management · doi:10.1111/j.1467-8551.1995.tb00082.x · Cited by 758
Do studies of statistical power have an effect on the power of studies?
Sedlmeier, P., & Gigerenzer, G. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.2.309 · Cited by 748
Effect sizes for research: A broad practical approach.
Grissom, R. J., & Kim, J. J. (2005) · Cited by 732
Fixed‐ versus random‐effects models in meta‐analysis: Model properties and an empirical comparison of differences in results
Schmidt, F. L., Oh, I., & Hayes, T. L. (2008) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711007x255327 · Cited by 729
The cult of statistical significance: how the standard error costs us jobs, justice, and lives
(2008) · Choice Reviews Online · doi:10.5860/choice.46-0372 · Cited by 716
The power of statistical tests in meta-analysis
Hedges, L. V., & Pigott, T. D. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.3.203 · Cited by 716
Measures of Effect Size for Comparative Studies: Applications, Interpretations, and Limitations
Olejnik, S. F., & Algina, J. J. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.2000.1040 · Cited by 703
A meta-analysis of the relationship between market orientation and business performance: evidence from five continents
Cano, C. R., Carrillat, F. A., & Jaramillo, F. (2004) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2003.07.001 · Cited by 693
Arbitrary metrics in psychology
Blanton, H., & Jaccard, J. (2006) · American Psychologist · doi:10.1037/0003-066x.61.1.27 · Cited by 681
What If There Were No Significance Tests?
(2013) · Psychology Press eBooks · doi:10.4324/9781315827353 · Cited by 675
The Use of Predicted Confidence Intervals When Planning Experiments and the Misuse of Power When Interpreting Results
Goodman, S. N., & Berlin, J. A. (1994) · Annals of Internal Medicine · doi:10.7326/0003-4819-121-3-199408010-00008 · Cited by 658
The Persistence of Underpowered Studies in Psychological Research: Causes, Consequences, and Remedies.
Maxwell, S. E. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.2.147 · Cited by 655
The impact of chief executive officer personality on top management team dynamics: One mechanism by which leadership affects organizational performance
Peterson, R. S., Smith, D. B., Martorana, P. V., & Owens, P. D. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.795 · Cited by 654
Statistical procedures and the justification of knowledge in psychological science.
Rosnow, R. L., & Rosenthal, R. (1992) · American Psychological Association eBooks · doi:10.1037/10109-027 · Cited by 653
1993 Presidential Address: What if the Academy Actually Mattered?
Hambrick, D. C. (1994) · Academy of Management Review · doi:10.2307/258833 · Cited by 629
Serendipity: Accidental Discoveries in Science
Roberts, R. M. (1989) · Cited by 623
Beyond the F Test: Effect Size Confidence Intervals and Tests of Close Fit in the Analysis of Variance and Contrast Analysis.
Steiger, J. H. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.2.164 · Cited by 592
Measurement error in psychological research: Lessons from 26 research scenarios.
Schmidt, F. L., & Hunter, J. E. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.199 · Cited by 567
What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology.
Schmidt, F. L. (1992) · American Psychologist · doi:10.1037/0003-066x.47.10.1173 · Cited by 564
How to Estimate and Interpret Various Effect Sizes.
Vacha‐Haase, T., & Thompson, B. (2004) · Journal of Counseling Psychology · doi:10.1037/0022-0167.51.4.473 · Cited by 556
The Continuing Unethical Conduct of Underpowered Clinical Trials
Halpern, S. D. (2002) · JAMA · doi:10.1001/jama.288.3.358 · Cited by 548
What Future Quantitative Social Science Research Could Look Like: Confidence Intervals for Effect Sizes
Thompson, B. (2002) · Educational Researcher · doi:10.3102/0013189x031003025 · Cited by 546
Sample Size Planning for Statistical Power and Accuracy in Parameter Estimation
Maxwell, S. E., Kelley, K., & Rausch, J. R. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093735 · Cited by 542
Why Current Publication Practices May Distort Science
Young, N. S., Ioannidis, J. P. A., & Al‐Ubaydli, O. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050201 · Cited by 533
A Primer on the Understanding, Use, and Calculation of Confidence Intervals that are Based on Central and Noncentral Distributions
Cumming, G., & Finch, S. (2001) · Educational and Psychological Measurement · doi:10.1177/0013164401614002 · Cited by 528
Slack resources and firm performance: a meta-analysis
Daniel, F., Lohrke, F. T., Fornaciari, C. J., & Turner, R. A. (2002) · Journal of Business Research · doi:10.1016/s0148-2963(02)00439-3 · Cited by 526
The meanings and measurement of clinical significance.
Kazdin, A. E. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.67.3.332 · Cited by 522
Selecting the language of the publications included in a meta-analysis: Is there a tower of babel bias?
Grégoire, G., Derderian, F., & LeLorier, J. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00098-b · Cited by 521
Market Orientation and Other Potential Influences on Performance in Small and Medium-Sized Manufacturing Firms
Pelham, A. M. (2000) · Journal of Small Business Management · Cited by 514
Vote-counting methods in research synthesis.
Hedges, L., & Olkin, I. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.2.359 · Cited by 511
Misleading meta-analysis
Egger, M., & Smith, G. D. (1995) · BMJ · doi:10.1136/bmj.310.6982.752 · Cited by 508
How are we doing in soft psychology?
Rosenthal, R. (1990) · American Psychologist · doi:10.1037/0003-066x.45.6.775 · Cited by 507
How meta-analysis increases statistical power.
Cohn, L. D., & Becker, B. J. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.3.243 · Cited by 500
Post Hoc Power Analysis: An Idea Whose Time Has Passed?
Levine, M., & Ensom, M. H. H. (2001) · Pharmacotherapy: The Journal of Human Pharmacology and Drug Therapy · doi:10.1592/phco.21.5.405.34503 · Cited by 473
An exercise in mega-silliness.
Eysenck, H. J. (1978) · American Psychologist · doi:10.1037/0003-066x.33.5.517.a · Cited by 466
Statistical rules of thumb
van Belle, G. (2002) · Wiley-Interscience eBooks · Cited by 461
Investigating and Dealing with Publication and Other Biases
Sterne, J. A. C., Egger, M., & Smith, G. D. (2001) · Systematic Reviews in Health Care · doi:10.1002/9780470693926.ch11 · Cited by 449
Accumulating Evidence: Procedures for Resolving Contradictions among Different Research Studies
Light, R., & Smith, P. (1971) · Harvard Educational Review · doi:10.17763/haer.41.4.437714870334w144 · Cited by 444
Market Orientation and Performance: A Meta‐Analysis and Cross‐National Comparisons*
Ellis, P. D. (2006) · Journal of Management Studies · doi:10.1111/j.1467-6486.2006.00630.x · Cited by 443
Self-citation
Confusion of confidence intervals and credibility intervals in meta-analysis.
Whitener, E. M. (1990) · Journal of Applied Psychology · doi:10.1037/0021-9010.75.3.315 · Cited by 432
Effect Size, Practical Importance, and Social Policy for Children
McCartney, K., & Rosenthal, R. (2000) · Child Development · doi:10.1111/1467-8624.00131 · Cited by 429
Evaluating statistical difference, equivalence, and indeterminacy using inferential confidence intervals: an integrated alternative method of conducting null hypothesis statistical tests.
Tryon, W. (2001) · Psychological methods · doi:10.1037/1082-989x.6.4.371 · Cited by 423
EVALUATING CODING DECISIONS
Vevea, J. L., Zelinsky, N. A. M., & Orwin, R. G. (2019) · Russell Sage Foundation eBooks · doi:10.7758/9781610448864.13 · Cited by 417
Effect sizes for experimenting psychologists.
Rosnow, R. L., & Rosenthal, R. (2003) · Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale · doi:10.1037/h0087427 · Cited by 416
Size matters: the standard error of regressions in the American Economic Review
Ziliak, S. T., & McCLOSKEY, D. N. (2004) · The Journal of Socio-Economics · doi:10.1016/j.socec.2004.09.024 · Cited by 408
Retrospective Power Analysis
Thomas, L. (1997) · Conservation Biology · doi:10.1046/j.1523-1739.1997.96102.x · Cited by 404
When effect sizes disagree: The case of r and d.
McGrath, R. E., & Meyer, G. J. (2006) · Psychological Methods · doi:10.1037/1082-989x.11.4.386 · Cited by 402
‘Statistical’, ‘practical’, and ‘clinical’: How many kinds of significance do counselors need to consider
Thompson, B. (2002) · Journal of Counseling & Development · doi:10.1002/j.1556-6678.2002.tb00167.x · Cited by 398
Effect sizes, confidence intervals, and confidence intervals for effect sizes
Thompson, B. (2007) · Psychology in the Schools · doi:10.1002/pits.20234 · Cited by 392
Selection Models and the File Drawer Problem
Iyengar, S., & Greenhouse, J. B. (1988) · Statistical Science · doi:10.1214/ss/1177013012 · Cited by 388
Guidelines for Statistical Reporting in Articles for Medical Journals
Bailar, J. C., & MOSTELLER, F. (1988) · Annals of Internal Medicine · doi:10.7326/0003-4819-108-2-266 · Cited by 387
The Method of Multiple Working Hypotheses
Chamberlin, T. C. (1998) · Springer eBooks · doi:10.1007/978-1-4899-0084-5_20 · Cited by 377
Beautiful but dangerous: Effects of offender attractiveness and nature of the crime on juridic judgment.
Sigall, H., & Ostrove, N. (1975) · Journal of Personality and Social Psychology · doi:10.1037/h0076472 · Cited by 361
Drinking Water Source and Chlorination Byproducts II. Risk of Colon and Rectal Cancers
Hildesheim, M. E., Cantor, K. P., Lynch, C. F., Dosemeci, M., Lubin, J. H., Alavanja, M. C. R., & Craun, G. F. (1998) · Epidemiology · doi:10.1097/00001648-199801000-00008 · Cited by 357
Meta-analysis/Shmeta-analysis
Shapiro, S. (1994) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117324 · Cited by 354
Market Orientation and Performance: Objective and Subjective Empirical Evidence from UK Companies
Harris, L. C. (2001) · Journal of Management Studies · doi:10.1111/1467-6486.00226 · Cited by 347
The effect of physical appearance on the judgment of guilt, interpersonal attraction, and severity of recommended punishment in a simulated jury task
Efran, M. G. (1974) · Journal of Research in Personality · doi:10.1016/0092-6566(74)90044-0 · Cited by 344
The Funnel Plot
Sterne, J. A. C., Becker, B. J., & Egger, M. (2005) · Publication Bias in Meta‐Analysis · doi:10.1002/0470870168.ch5 · Cited by 341
Statistical power of psychological research: What have we gained in 20 years?
Rossi, J. S. (1990) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.58.5.646 · Cited by 340
Large Trials vs Meta-analysis of Smaller Trials: How Do Their Results Compare?
Cappelleri, J. C. (1996) · JAMA · doi:10.1001/jama.1996.03540160054033 · Cited by 336
Meta-analysis: Statistical alchemy for the 21st century
Feinstein, A. R. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00110-c · Cited by 335
Effects of intravenous magnesium in suspected acute myocardial infarction: overview of randomised trials.
Teo, K. K., Yusuf, S., Collins, R., Held, P. H., & Peto, R. (1991) · BMJ · doi:10.1136/bmj.303.6816.1499 · Cited by 333
Is the Meta-Analysis of Correlation Coefficients Accurate When Population Correlations Vary?
Field, A. P. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.4.444 · Cited by 329
Review of developments in meta-analytic method.
Bangert‐Drowns, R. L. (1986) · Psychological Bulletin · doi:10.1037/0033-2909.99.3.388 · Cited by 327
On the origins of the .05 level of statistical significance.
Cowles, M., & Davis, C. (1982) · American Psychologist · doi:10.1037/0003-066x.37.5.553 · Cited by 323
Statistical power of psychological research: What have we gained in 20 years?
Rossi, J. S. (1990) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.58.5.646 · Cited by 323
From the Editors
Eden, D. (2002) · Academy of Management Journal · doi:10.5465/amj.2002.7718946 · Cited by 318
Magnitude of experimental effect and a table for its rapid estimation.
Friedman, H. (1968) · Psychological Bulletin · doi:10.1037/h0026258 · Cited by 317
Studies for Students: The Method of Multiple Working Hypotheses
Chamberlin, T. C. (1897) · The Journal of Geology · doi:10.1086/607980 · Cited by 316
Needed: A Ban on the Significance Test
Hunter, J. E. (1997) · Psychological Science · doi:10.1111/j.1467-9280.1997.tb00534.x · Cited by 314
The Problem of Statistical Power in MIS Research
Baroudi, J. J., & Orlikowski, W. J. (1989) · MIS Quarterly · doi:10.2307/248704 · Cited by 308
An Alternative to Cohen's Standardized Mean Difference Effect Size: A Robust Parameter and Confidence Interval in the Two Independent Groups Case.
Algina, J. J., Keselman, H. J., & Penfield, R. D. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.3.317 · Cited by 290
Significance Tests Die Hard: The Amazing Persistence of a Probabilistic Misconception
Falk, R., & Greenbaum, C. W. (1995) · Theory & Psychology · doi:10.1177/0959354395051004 · Cited by 279
Correct Confidence Intervals for Various Regression Effect Sizes and Parameters: The Importance of Noncentral Distributions in Computing Intervals
Smithson, M. J. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971392 · Cited by 275
Statistical Power and Effect Size in Marketing Research
Sawyer, A. G., & Ball, A. D. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800302 · Cited by 268
Evaluating Results Using Corrected and Uncorrected Effect Size Estimates
Snyder, P., & Lawson, S. (1993) · The Journal of Experimental Education · doi:10.1080/00220973.1993.10806594 · Cited by 265
Theory testing and measurement error
Schmidt, F. L., & Hunter, J. E. (1999) · Intelligence · doi:10.1016/s0160-2896(99)00024-0 · Cited by 254
Confidence intervals are a more useful complement to nonsignificant tests than are power calculations
Colegrave, N. (2003) · Behavioral Ecology · doi:10.1093/beheco/14.3.446 · Cited by 251
How Science Takes Stock: The Story of Meta-Analysis
Hunt, M. M. (1997) · Project Muse (Johns Hopkins University) · Cited by 248
Measures of effect size for categorical data.
Fleiss, J. L. (1994) · Cited by 248
Market orientation and performance: a meta‐analysis
Shoham, A., Rose, G. M., & Kropp, F. (2005) · Marketing Intelligence & Planning · doi:10.1108/02634500510612627 · Cited by 248
Editors Can Lead Researchers to Confidence Intervals, but Can't Make Them Think
Fidler, F. M., Thomason, N. R., Cumming, G., Finch, S. J., & Leeman, J. (2004) · Psychological Science · doi:10.1111/j.0963-7214.2004.01502008.x · Cited by 244
A History of Effect Size Indices
Huberty, C. J. (2002) · Educational and Psychological Measurement · doi:10.1177/0013164402062002002 · Cited by 242
The Problems in Using Fixed-Effects Models of Meta-Analysis on Real-World Data
Field, A. P. (2003) · Understanding Statistics · doi:10.1207/s15328031us0202_02 · Cited by 237
Useful Effect Size Interpretations for Single Case Research
Parker, R. I., & Hagan–Burke, S. (2006) · Behavior Therapy · doi:10.1016/j.beth.2006.05.002 · Cited by 236
Evolved mechanisms underlying wayfinding
SILVERMAN, I. W., Choi, J., MacKewn, A., Fisher, M. L., Moro, J., & Olshansky, E. (2000) · Evolution and Human Behavior · doi:10.1016/s1090-5138(00)00036-2 · Cited by 228
Predictive ability of meta-analyses of randomised controlled trials
Villar, J., Carroli, G., & Belizán, J. M. (1995) · The Lancet · doi:10.1016/s0140-6736(95)90646-0 · Cited by 223
House dust mite control measures in the management of asthma: meta-analysis
Gotzsche, P. C., Hammarquist, C., & Burr, M. (1998) · BMJ · doi:10.1136/bmj.317.7166.1105 · Cited by 222
Statistical Significance and Effect Size in Education Research: Two Sides of a Coin
Fan, X. (2001) · The Journal of Educational Research · doi:10.1080/00220670109598763 · Cited by 221
Confidence Intervals for Effect Sizes
Fan, X., & Thompson, B. (2001) · Educational and Psychological Measurement · doi:10.1177/0013164401614001 · Cited by 219
Probability of the superior outcome of one treatment over another.
Grissom, R. J. (1994) · Journal of Applied Psychology · doi:10.1037/0021-9010.79.2.314 · Cited by 217
Untitled work
(2004) · Cited by 214
Editorial: Some Remarks From the Outgoing Editor.
(1982) · Journal of Applied Psychology · doi:10.1037/h0077946 · Cited by 207
Arbitrary metrics: Implications for identifying evidence-based treatments.
Kazdin, A. E. (2006) · American Psychologist · doi:10.1037/0003-066x.61.1.42 · Cited by 198
What Statistical Significance Testing Is, and What It Is Not
Shaver, J. P. (1993) · The Journal of Experimental Education · doi:10.1080/00220973.1993.10806592 · Cited by 194
Confidence Intervals About Score Reliability Coefficients, Please: An EPM Guidelines Editorial
Fan, X., & Thompson, B. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971365 · Cited by 191
Post Hoc Power: A Concept Whose Time Has Come
Onwuegbuzie, A. J., & Leech, N. L. (2004) · Understanding Statistics · doi:10.1207/s15328031us0304_1 · Cited by 188
Practical Significance:The Use of Effect Sizes in School Counseling Research
Sink, C. A., & Stroh, H. R. (2006) · Professional School Counseling · doi:10.5330/prsc.9.4.283746k664204023 · Cited by 188
Promoting good statistical practices: Some suggestions
Kirk, R. E. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971185 · Cited by 184
Reporting effect size estimates in school psychology research
Volker, M. A. (2006) · Psychology in the Schools · doi:10.1002/pits.20176 · Cited by 183
Failsafe N or File‐Drawer Number
Becker, B. J. (2005) · Wiley eBooks · doi:10.1002/0470870168.ch7 · Cited by 179
The Significance of Statistical Significance Tests in Marketing Research
Sawyer, A. G., & Peter, J. P. (1983) · Journal of Marketing Research · doi:10.1177/002224378302000203 · Cited by 175
Can Meta-analysis Be Salvaged?
Greenland, S. (1994) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117326 · Cited by 168
On the logic and purpose of significance testing.
Cortina, J. M., & Dunlap, W. P. (1997) · Psychological Methods · doi:10.1037/1082-989x.2.2.161 · Cited by 166
Effect of positive findings on submission and acceptance rates: A note on meta-analysis bias.
Coursol, A., & Wagner, E. E. (1986) · Professional Psychology Research and Practice · doi:10.1037/0735-7028.17.2.136 · Cited by 165
Market orientation and business performance: some evidence from Hong Kong
Ngai, J. C. H., & Ellis, P. (1998) · International Marketing Review · doi:10.1108/02651339810212502 · Cited by 162
Self-citation
Statistical Power and Effect Sizes of Clinical Neuropsychology Research
Bezeau, S., & Graves, R. E. (2001) · Journal of Clinical and Experimental Neuropsychology · doi:10.1076/jcen.23.3.399.1181 · Cited by 161
How much power is enough? Against the development of an arbitrary convention for statistical power calculations
Stefano, J. D. (2003) · Functional Ecology · doi:10.1046/j.1365-2435.2003.00782.x · Cited by 160
Marketing research an applied orientation,2nd ed
Malhotra, N. K., Hall, J. E., Shaw, M., & Oppenheim, P. (2002) · Cited by 159
Effect Size Estimation: Factors to Consider and Mistakes to Avoid
Breaugh, J. A. (2003) · Journal of Management · doi:10.1177/014920630302900106 · Cited by 154
Power analysis for experimental research a practical guide for the biological, medical and social sciences
Bausell, R. B. 1., & Li, Y. (2002) · Cited by 153
KAJIAN PERSIAPAN SERTIFIKASI PENERAPAN HAZARD ANALYSIS CRITICAL CONTROL POINT (HACCP) PADA PROSES PRODUKSI PERUSAHAAN CIMOL BOJOT MOZZARELLA
Pramesti Cahyadewi, A. (2025) · Universitas Pasundan institutional repositories & scientific journals (Universitas Pasundan) · Cited by 145
Editor's Afterword
Rynes, S. L. (2007) · Academy of Management Journal · doi:10.5465/amj.2007.27156169 · Cited by 143
Advantages of excluding underpowered studies in meta-analysis: Inclusionist versus exclusionist viewpoints.
Kraemer, H. C., Gardner, C., Brooks, J. O., & Yesavage, J. A. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.1.23 · Cited by 141
On the Surprising Longevity of Flogged Horses: Why There Is a Case for the Significance Test
Abelson, R. P. (1997) · Psychological Science · doi:10.1111/j.1467-9280.1997.tb00536.x · Cited by 141
If Statistical Significance Tests are Broken/Misused, What Practices Should Supplement or Replace Them?
Thompson, B. (1999) · Theory & Psychology · doi:10.1177/095935439992006 · Cited by 138
Reporting Practices and APA Editorial Policies Regarding Statistical Significance and Effect Size
Vacha-haase, T., Nilsson, J. E., Reetz, D. R., Lance, T. S., & Thompson, B. (2000) · Theory & Psychology · doi:10.1177/0959354300103006 · Cited by 138
Design Sensitivity: Statistical Power for Applied Experimental Research
Lipsey, M. W., & Hurley, S. (2009) · Sage eBooks · doi:10.4135/9781483348858.n2 · Cited by 136

Sorted by citations

Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t-tests and ANOVAs
Lakens, D. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00863 · Cited by 10,303
Effect size estimates: Current use, calculations, and interpretation.
Fritz, C. O., Morris, P. E., & Richler, J. J. (2012) · Journal of Experimental Psychology: General · doi:10.1037/a0024338 · Cited by 5,199
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
Effect size guidelines for individual differences researchers
Gignac, G. E., & Szodorai, E. T. (2016) · Personality and Individual Differences · doi:10.1016/j.paid.2016.06.069 · Cited by 2,860
Cross-national epidemiology of DSM-IV major depressive episode
Bromet, E., Andrade, L. H., Hwang, I., Sampson, N. A., Alonso, J., de Girolamo, G., de Graaf, R., Demyttenaere, K., Hu, C., Iwata, N., et al. (2011) · BMC Medicine · doi:10.1186/1741-7015-9-90 · Cited by 2,221

See all 2,461

Authors: Ellis, P. D.
Affiliations: Hong Kong Polytechnic University (HK)
Corresponding author: Ellis, Paul D.
Venue: Cambridge University Press eBooks
Publisher: Cambridge University Press
Published: 2010-07-01
DOI: 10.1017/cbo9780511761676
OpenAlex: W578092267
Cited by: 2,461
References: 332
Citations by year: 2026: 114 · 2025: 161 · 2024: 170 · 2023: 178 · 2022: 187 · 2021: 269 · 2020: 248 · 2019: 204 · 2018: 188 · 2017: 147 · 2016: 143 · 2015: 137 · 2014: 133 · 2013: 83 · 2012: 57
FWCI: 33.44
Type: book
Language: en
Open access: closed
Licence: www.cambridge.org/core/terms (unspecified, 705 d)
Locations: Cambridge University Press eBooks (publishedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Keywords: effect size, practical significance, statistical power, meta-analysis, effect size reporting, interpretation of research results

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

The Essential Guide to Effect Sizes: Statistical Power, Meta-Analysis, and the Interpretation of Research Results

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks