How hard is hard science, how soft is soft science? The empirical cumulativeness of research.

Abstract

ABSTRACT. " Research results in the social and behavioral sciences are often conceded to be less replicable than research results in the physical sciences. However, direct empirical comparisons of the cumulativeness of research in the social and physical sciences have not been made to date. This article notes the parallels between methods used in the quantitative synthesis of research in the social and in the physical sciences. Essentially identical methods are used to test the consistency of research results in physics and in psychology. These methods can be used to compare the consistency of replicated research results in physics and in the social sciences. The methodology is illustrated with 13 exemplary reviews from each domain. The exemplary comparison suggests that the results of physical experiments may not be strikingly more consistent than

Cites (5)

1. Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
   Hedges, Larry V. · 1981 · Journal of Educational Statistics
2. Primary, Secondary, and Meta-Analysis of Research
   GLASS, GENE V · 1976 · Educational Researcher
3. Meta-analysis of psychotherapy outcome studies.
   Smith, Mary L., Glass, Gene V. · 1977 · American Psychologist
4. Social psychology as history.
   Gergen, Kenneth J. · 1973 · Journal of Personality and Social Psychology
5. Magnitude of teacher expectancy effects on pupil IQ as a function of the credibility of expectancy induction: A synthesis of findings from 18 experiments.
   Raudenbush, Stephen W. · 1984 · Journal of Educational Psychology

Show all 5 references

Cited by (32)

1. Corporate Social and Financial Performance: A Meta-Analysis
   Orlitzky, Marc, Schmidt, Frank L., Rynes, Sara L. · 2003 · Organization Studies
2. Trust in leadership: Meta-analytic findings and implications for research and practice.
   Dirks, Kurt T., Ferrin, Donald L. · 2002 · Journal of Applied Psychology
3. Meta-Analytic review of leader–member exchange theory: Correlates and construct issues.
   Gerstner, Charlotte R., Day, David V. · 1997 · Journal of Applied Psychology
4. Gender and leadership style: A meta-analysis.
   Alice H. Eagly, Blair T. Johnson · 1990 · Psychological Bulletin
5. Social loafing: a meta-analytic review and theoretical integration.
   Karau, Steven J., Williams, Kipling D. · 1993 · Journal of Personality and Social Psychology

See all 435