When the Evidence Says, “Yes, No, and Maybe So”: Attending to and Interpreting Inconsistent Findings Among Evidence-Based Interventions
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
An international, multidisciplinary effort aims to identify evidence-based treatments (EBTs) or interventions. The goal of this effort is to identify specific techniques or programs that successfully target and change specific behaviors. In clinical psychology, EBTs are identified based on the outcomes of randomized controlled trials examining whether treatments outperform control or alternative treatment conditions. Treatment outcomes are measured in multiple ways. Consistently, different ways of gauging outcomes yield inconsistent conclusions. Historically, EBT research has not accounted for these inconsistencies. In this paper we highlight the implications of inconsistencies, describe a framework for redressing inconsistent findings, and illustrate how the framework can guide future research on how to administer and combine treatments to maximize treatment effects and how to study treatments via quantitative review.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
De Los Reyes, A., & Kazdin, A. E. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.4.483 · Cited by 2,548
Self-citationMeta-Analysis: Recent Developments in Quantitative Methods for Literature Reviews
Rosenthal, R., & DiMatteo, M. R. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.59 · Cited by 1,780
Treating anxiety disorders in children: Results of a randomized clinical trial.
Kendall, P. C. (1994) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.62.1.100 · Cited by 1,376
Webster-Stratton, C., & Hammond, M. (1997) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.65.1.93 · Cited by 1,029 · cited 1×
“Within studies, only some measures show that the treatment and control conditions are statistically different (e.g., De Los Reyes & Kazdin, 2006; Flannery-Schroeder & Kendall, 2000; Webster-Stratton & Hammond, 1997).”
Therapy for youths with anxiety disorders: A second randomized clincal trial.
Kendall, P. C., Flannery-Schroeder, E., Panichelli-Mindel, S. M., Southam-Gerow, M., Henin, A., & Warman, M. (1997) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.65.3.366 · Cited by 984 · cited 2×
“’’ Further, between two or more studies of the same treatment, measures that support and do not support the treatment in one study do not necessarily lead to the same conclusions in other studies (e.g., Barrett, Dadds, & Rapee, 1996; Kendall, 1994; Kendall et al., 1997).”
Family treatment of childhood anxiety: A controlled trial.
Barrett, P. M., Dadds, M. R., & Rapee, R. M. (1996) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.64.2.333 · Cited by 791
Arbitrary metrics in psychology
Blanton, H., & Jaccard, J. (2006) · American Psychologist · doi:10.1037/0003-066x.61.1.27 · Cited by 681
Eating disorder prevention programs: A meta-analytic review.
Stice, E., & Shaw, H. (2004) · Psychological Bulletin · doi:10.1037/0033-2909.130.2.206 · Cited by 510 · cited 1×
“Andres De Los Reyes and Alan E. Kazdin have identified effects of specific treatment techniques by averaging effects multiple times—not only within studies but also between studies of the same or similar techniques (e.g., Matt, 1989; Stice & Shaw, 2004).”
Assessment of Adult Psychopathology: Meta-Analyses and Implications of Cross-Informant Correlations.
Achenbach, T. M., Krukowski, R. A., Dumenci, L., & Ivanova, M. Y. (2005) · Psychological Bulletin · doi:10.1037/0033-2909.131.3.361 · Cited by 406
Flannery-Schroeder, E. C., & Kendall, P. C. (2000) · Cognitive Therapy and Research · doi:10.1023/a:1005500219286 · Cited by 362 · cited 1×
“Within studies, only some measures show that the treatment and control conditions are statistically different (e.g., De Los Reyes & Kazdin, 2006; Flannery-Schroeder & Kendall, 2000; Webster-Stratton & Hammond, 1997).”
Research works printed but not linked: 6
- 10.1037/0033-2909.101.2.213 · DOI · Paper page
- Achenbach T.M. (2006). (See References). A brief review of the implications of informant discrepancies for clinical assessment.
- 10.1111/j.0963-7214.2006.00414.x · DOI · Paper page
- 10.4135/9781412985031 · DOI · Paper page
- 10.1093/med:psych/9780195126181.001.0001 · DOI · Paper page
- 10.1037/0033-2909.105.1.106 · doi:10.1037/0033-2909.105.1.106 · Paper page
Cited by
De Los Reyes, A. (2011) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2011.533405 · Cited by 564
Self-citationPrinciples Underlying the Use of Multiple Informants' Reports
De Los Reyes, A., Thomas, S. A., Goodman, K. L., & Kundey, S. M. A. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185617 · Cited by 559
Self-citationYeager, D. S., Fong, C. J., Lee, H. Y., & Espelage, D. L. (2015) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2014.11.005 · Cited by 472
An internalizing pathway to alcohol use and disorder.
Hussong, A. M., Jones, D. J., Stein, G. L., Baucom, D. H., & Boeding, S. (2011) · Psychology of Addictive Behaviors · doi:10.1037/a0024519 · Cited by 420
Laird, R. D., & De Los Reyes, A. (2013) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-012-9659-y · Cited by 320
Self-citation
Metadata
- Authors
- De Los Reyes, A., & Kazdin, A. E.
- Venue
- Current Directions in Psychological Science
- Publisher
- SAGE Publications
- Published
- 2008-02
- Volume
- 17
- Issue
- 1
- Pages
- 47-51
- ISSN
- 0963-7214 (ISSN-L)
- 1467-8721
- OpenAlex
- W2127580958
- Cited by
- 80
- References
- 11
- FWCI
- 8.62
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: When the Evidence Says, “Yes, No, and Maybe So”: Attending to and Interpreting Inconsistent Findings Among Evidence-Based Interventions. https://app.cochat.ai/papers/10.1111/j.1467-8721.2008.00546.x
- The paper
- De Los Reyes, A., & Kazdin, A. E. (2008). When the Evidence Says, “Yes, No, and Maybe So”: Attending to and Interpreting Inconsistent Findings Among Evidence-Based Interventions. Current Directions in Psychological Science. https://doi.org/10.1111/j.1467-8721.2008.00546.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.