Progress in clinical psychology: Is there any?
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
This article addresses the criticisms that clinical psychology research is characterized by (a) generally disappointing results, (b) unreplicability, and (c) poor cumulation. Results are found to be quite encouraging when we (a) distinguish effect size estimation from significance testing, (b) clarify the interpretation of nonsignificant results, and (c) evaluate the practical importance of obtained effect sizes. Furthermore, our research is found to be considerably more replicable when we clarify the definition of successful replication and employ various metrics of the success of replication. Finally, problems of poor cumulation are addressed by a discussion of the evaluations (negative and positive) of meta-analysis and how clinical researchers, in particular, can employ meta-analytic procedures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen (2013) · doi:10.4324/9780203774441 · Cited by 3,228
Statistical Power Analysis for the Behavioral Sciences
(1977) · doi:10.1016/c2013-0-10517-x · Cited by 2,457
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Things I have learned (so far).
Cohen, J. (1990) · American Psychologist · doi:10.1037/0003-066x.45.12.1304 · Cited by 1,781
Statistical Power Analysis for the Behavioral Sciences
Wassertheil, S., & Cohen, J. (1970) · Biometrics · doi:10.2307/2529115 · Cited by 1,383
Interpersonal expectancy effects: the first 345 studies
Rosenthal, R., & Rubin, D. B. (1978) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00075506 · Cited by 1,158
Self-citationDo studies of statistical power have an effect on the power of studies?
Sedlmeier, P., & Gigerenzer, G. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.2.309 · Cited by 748
Research works printed but not linked: 67
- Altman, 1994, February 21, In major finding, drug limits H.I.V. infection in newborns, New York Times, Al
- Barnes, 1986, Promising results halt trial of anti-AIDS drug, Science, 234, 15, 10.1126/science.3529393 · doi:10.1126/science.3529393
- Canadian Multicentre Transplant Study Group, 1983, A randomized clinical trial of cyclosporine in cadaveric renal transplantation, New England Journal of Medicine, 309, 809, 10.1056/NEJM198310063091401 · DOI · Paper page
- Centers for Disease Control Vietnam Experience Study, 1988, Health status of Vietnam veterans: 1. Psychosocial characteristics, Journal of the American Medical Association, 259, 2701, 10.1001/jama.1988.03720180027028 · DOI · Paper page
- Cohen, 1965, Handbook of clinical psychology, 95
- Cohen, 1988, Statistical power analysis for the behavioral sciences
- Cohen, 1993, A new goal: Preventing disease, not infection, Science, 262, 1820, 10.1126/science.8266069 · DOI
- Collins, 1985, Changing order: Replication and induction in scientific practice
- Cooper, 1981, On the significance of effects and the effects of significance, Journal of Personality and Social Psychology, 41, 1013, 10.1037/0022-3514.41.5.1013 · DOI
- Cooper, 1984, The integrative research review: A social science approach
- Cooper, 1989, Integrating research: A guide to literature reviews
- 1994, Handbook of research synthesis
- Cromie, 1990, October 5, Report: Drugs affect lung cancer survival, Harvard Gazette, 1
- Dabbs, 1990, Testosterone, social class, and antisocial behavior in a sample of 4,462 men, Psychological Science, 1, 209, 10.1111/j.1467-9280.1990.tb00200.x · DOI · Paper page
- Fleiss, 1994, Handbook of research synthesis, 245
- Glass, 1976, Primary, secondary, and meta-analysis of research, Educational Researcher, 5, 3, 10.3102/0013189X005010003 · DOI · Paper page
- Glass, 1978, In defense of generalization, The Behavioral and Brain Sciences, 3, 394, 10.1017/S0140525X00075610 · DOI
- Glass, 1981, Meta-analysis in social research
- Goldfinger, 1991, August, Garlic: Good for what ails you, Harvard Health Letter, 16, 1
- Guilford, 1954, Psychometric methods
- Hedges, 1982, Estimation of effect size from a series of independent experiments, Psychological Bulletin, 92, 490, 10.1037/0033-2909.92.2.490 · DOI · Paper page
- Hedges, 1987, How hard is hard science, how soft is soft science, American Psychologist, 42, 443, 10.1037/0003-066X.42.5.443 · doi:10.1037/0003-066x.42.5.443 · Paper page
- Hedges, 1985, Statistical methods for meta-analysis
- Hunter, 1990, Methods of meta-analysis: Correcting error and bias in research findings
- Jung, 1978, Self-negating functions of self-fulfilling prophecies, The Behavioral and Brain Sciences, 3, 397, 10.1017/S0140525X00075658 · DOI
- Kolata, 1981, Drug found to help heart attack survivors, Science, 214, 774, 10.1126/science.7027443 · DOI
- Light, 1984, Summing up: The science of reviewing research, 10.4159/9780674040243 · DOI · Paper page
- Nelson, 1986, Interpretation of significance levels and effect sizes by psychological researchers, American Psychologist, 41, 1299, 10.1037/0003-066X.41.11.1299 · DOI
- Roberts, 1987, Study bolsters case against cholesterol, Science, 237, 28, 10.1126/science.3603009 · doi:10.1126/science.3603009
- Rosenthal, 1966, Experimenter effects in behavioral research
- Rosenthal, 1969, Artifact in behavioral research, 181
- Rosenthal, 1976, Experimenter effects in behavioral research
- Rosenthal, 1979, The “file drawer problem” and tolerance for null results, Psychological Bulletin, 86, 638, 10.1037/0033-2909.86.3.638 · DOI · Paper page
- Rosenthal, 1983, Assessing the statistical and social importance of the effects of psychotherapy, Journal of Consulting and Clinical Psychology, 51, 4, 10.1037/0022-006X.51.1.4 · DOI
- Rosenthal, 1985, Placebo: Theory, research, and mechanisms, 110
- Rosenthal, 1986, Nonsignificant relationships as scientific evidence, The Behavioral and Brain Sciences, 9, 479, 10.1017/S0140525X00046665 · DOI
- Rosenthal, 1989a, April, Research: How are we doing
- Rosenthal, 1989b, August, Experimenter expectancy, covert communication, and meta-analytic methods
- Rosenthal, 1990a, How are we doing in soft psychology, American Psychologist, 45, 775, 10.1037/0003-066X.45.6.775 · DOI · Paper page
- Rosenthal, 1990b, Replication in behavioral research, Journal of Social Behavior and Personality, 5, 1
- Rosenthal, 1991a, Meta-analytic procedures for social research, 10.4135/9781412984997 · DOI · Paper page
- Rosenthal, 1991b, Quality-weighting of studies in meta-analytic research, Psychotherapy Research, 1, 25, 10.1080/10503309112331334031 · DOI · Paper page
- Rosenthal, 1993, A handbook for data analysis in the behavioral sciences: Methodological issues, 519
- Rosenthal, 1994a, Interpersonal expectancy effects: A thirty-year perspective, Current Directions in Psychological Science, 3, 176, 10.1111/1467-8721.ep10770698 · DOI · Paper page
- Rosenthal, 1994b, Handbook of research synthesis, 231
- Rosenthal, 1963, The interpretation of levels of significance by psychological researchers, Journal of Psychology, 55, 33, 10.1080/00223980.1963.9916596 · DOI · Paper page
- Rosenthal, 1964, Further evidence for the cliff effect in the interpretation of levels of significance, Psychological Reports, 15, 570, 10.2466/pr0.1964.15.2.570 · DOI
- Rosenthal, 1985, Contrast analysis: Focused comparisons in the analysis of variance
- Rosenthal, 1991, Essentials of behavioral research: Methods and data analysis
- Rosenthal, 1978b, Issues in summarizing the first 345 studies of interpersonal expectancy effects, The Behavioral and Brain Sciences, 3, 410, 10.1017/S0140525X00075804 · DOI
- Rosenthal, 1979a, Comparing significance levels of independent studies, Psychological Bulletin, 86, 1165, 10.1037/0033-2909.86.5.1165 · DOI
- Rosenthal, 1979b, A note on percent variance explained as a measure of the importance of effects, Journal of Applied Social Psychology, 9, 395, 10.1111/j.1559-1816.1979.tb02713.x · DOI · Paper page
- Rosenthal, 1982a, Comparing effect sizes of independent studies, Psychological Bulletin, 92, 500, 10.1037/0033-2909.92.2.500 · doi:10.1037/0033-2909.92.2.500 · Paper page
- Rosenthal, 1982b, A simple, general purpose display of magnitude of experimental effect, Journal of Educational Psychology, 74, 166, 10.1037/0022-0663.74.2.166 · doi:10.1037/0022-0663.74.2.166 · Paper page
- Rosenthal, 1985, Statistical analysis: Summarizing evidence versus establishing facts, Psychological Bulletin, 97, 527, 10.1037/0033-2909.97.3.527 · DOI
- Rosenthal, 1986, Meta-analytic procedures for combining studies with multiple effect sizes, Psychological Bulletin, 99, 400, 10.1037/0033-2909.99.3.400 · doi:10.1037/0033-2909.99.3.400 · Paper page
- Rosenthal, 1988, Comment: Assumptions and procedures in the file drawer problem, Statistical Science, 3, 120, 10.1214/ss/1177013014 · DOI
- Rosenthal, 1989, Effect size estimation for one-sample multiple-choice-type data: Design, analysis, and meta-analysis, Psychological Bulletin, 106, 332, 10.1037/0033-2909.106.2.332 · doi:10.1037/0033-2909.106.2.332
- Rosenthal, 1994, The counternull value of an effect size: A new statistic, Psychological Science, 5, 329, 10.1111/j.1467-9280.1994.tb00281.x · DOI · Paper page
- Shoham-Salomon, 1987, Paradoxical interventions: A meta-analysis, Journal of Consulting and Clinical Psychology, 55, 22, 10.1037/0022-006X.55.1.22 · DOI
- Skinner, 1983, August, On the value of research, APA Monitor, 39
- Smith, 1980, The benefits of psychotherapy
- Snedecor, 1980, Statistical methods
- Snedecor, 1989, Statistical methods
- Steering Committee of the Physicians Health Study Research Group, 1988, Preliminary report: Findings from the aspirin component of the ongoing physicians' health study, New England Journal of Medicine, 318, 262, 10.1056/NEJM198801283180431 · DOI · Paper page
- Tukey, 1977, Exploratory data analysis
- Zuckerman, 1993, Contemporary issues in the analysis of data: A survey of 551 psychologists, Psychological Science, 4, 49, 10.1111/j.1467-9280.1993.tb00556.x · DOI · Paper page
Cited by
Meta-Analysis: Recent Developments in Quantitative Methods for Literature Reviews
Rosenthal, R., & DiMatteo, M. R. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.59 · Cited by 1,780
Self-citationDisorganized attachment in early childhood: Meta-analysis of precursors, concomitants, and sequelae
VAN IJZENDOORN, M. H., SCHUENGEL, C., & BAKERMANS–KRANENBURG, M. J. (1999) · Development and Psychopathology · doi:10.1017/s0954579499002035 · Cited by 1,625
Patient Adherence and Medical Treatment Outcomes: A Meta-Analysis
Robin DiMatteo, M., Giordani, P. J., Lepper, H. S., & Croghan, T. W. (2002) · Medical Care · doi:10.1097/00005650-200209000-00009 · Cited by 1,490
Rosnow, R. L., & Rosenthal, R. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.4.331 · Cited by 761
Self-citationStanton, M., & Shadish, W. R. (1997) · Psychological Bulletin · doi:10.1037//0033-2909.122.2.170 · Cited by 586
Metadata
- Authors
- Rosenthal, R.
- Venue
- Clinical Psychology: Science and Practice
- Published
- 1995
- Volume
- 2
- Issue
- 2
- Pages
- 133-150
- ISSN
- 0969-5893 (ISSN-L)
- 1468-2850
- OpenAlex
- W2147129541
- Cited by
- 75
- References
- 10
- FWCI
- 9.79
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm)
- onlinelibrary.wiley.com/termsAndConditions#vor (vor, 4042 d)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Progress in clinical psychology: Is there any? https://app.cochat.ai/papers/10.1111/j.1468-2850.1995.tb00035.x
- The paper
- Rosenthal, R. (1995). Progress in clinical psychology: Is there any? Clinical Psychology: Science and Practice. https://doi.org/10.1111/j.1468-2850.1995.tb00035.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.