Size of Treatment Effects and Their Importance to Clinical Research and Practice
The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“equivalent to a 23% reduction of antisocial behavior in clients receiving care in a residential facility with a therapeutic group climate”
From Safety First! Residential Group Climate and Antisocial Behavior: A Multilevel Meta-analysis (2025) · cites this paper as Kraemer and Kupfer (2006)
In the citing paper
“showing a significant and medium effect size of r = .30, which amounts to a 34% reduction of antisocial behavior”
From Safety First! Residential Group Climate and Antisocial Behavior: A Multilevel Meta-analysis (2025) · cites this paper as Kraemer and Kupfer (2006)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
Statistical Methods for Meta-Analysis.
Freeman, P. R., Hedges, L. V., & Olkin, I. (1986) · Biometrics · doi:10.2307/2531069 · Cited by 4,784
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,642
On the practice of dichotomization of quantitative variables.
MacCallum, R. C., Zhang, S., Preacher, K. J., & Rucker, D. D. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.19 · Cited by 3,538
A leisurely look at the bootstrap, the jackknife, and cross-validation
Efron, B., & Gong, G. (1983) · The American Statistician · doi:10.1080/00031305.1983.10483087 · Cited by 3,229
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Research works printed but not linked: 2
- Cliff, 1993, Dominance statistics, Psychol Bull, 114, 494, 10.1037/0033-2909.114.3.494 · doi:10.1037/0033-2909.114.3.494 · Paper page
- Sackett, 1996, Down with the odds ratio!, Evidence Based Med, 1, 164
Cited by
Items 101–155 of 155
Cognitive Behavioral Guided Self-Help for the Treatment of Recurrent Binge Eating
Striegel-Moore, R. H., Wilson, G. T., DeBar, L., Perrin, N., Lynch, F., Rosselli, F., & Kraemer, H. C. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0018915 · Cited by 119
Self-citationHengartner, M. P., & Plöderl, M. (2022) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2020-111600 · Cited by 114
Amanvermez, Y., Zhao, R., Cuijpers, P., de Wit, L. M., Ebert, D. D., Kessler, R. C., Bruffaerts, R., & Karyotaki, E. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100503 · Cited by 110
“We also calculated the number needed to treat (NNT) to improve the understandability of the findings (Kraemer and Kupfer, 2006).”
Ebert, D. D., Franke, M., Kählke, F., Küchler, A., Bruffaerts, R., Mortier, P., Karyotaki, E., Alonso, J., Cuijpers, P., Berking, M., et al. (2019) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1754 · Cited by 105
Non-specific versus targeted approaches to youth mentoring: A follow-up meta-analysis
Christensen, K. M., Hagler, M. A., Stams, G.-J., Raposa, E. B., Burton, S., & Rhodes, J. E. (2020) · Journal of Youth and Adolescence · doi:10.1007/s10964-020-01233-x · Cited by 107
Molina‐López, J., Leiva‐García, B., Planells, E., & Planells, P. (2021) · International Journal of Eating Disorders · doi:10.1002/eat.23631 · Cited by 108
McLaren, A. N., LaMantia, M. A., & Callahan, C. M. (2013) · Aging & Mental Health · doi:10.1080/13607863.2013.781121 · Cited by 103
Velligan, D., Mintz, J., Maples, N., Xueying, L., Gajewski, S., Carr, H., & Sierra, C. (2013) · Schizophrenia Bulletin · doi:10.1093/schbul/sbs116 · Cited by 87
Oldham, M., Kellett, S., Miles, E., & Sheeran, P. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0029630 · Cited by 84
“The practical significance of interventions of this magnitude can be illustrated using the binomial effect size display (BESD; Rosenthal & Rubin, 1982) and the number needed to treat (NNT; Kraemer & Kupfer, 2006) analyses.”
MethodStice, E., Desjardins, C. D., Rohde, P., & Shaw, H. (2021) · Journal of Abnormal Psychology · doi:10.1037/abn0000666 · Cited by 81
Ebert, D. D., Buntrock, C., Lehr, D., Smit, F., Riper, H., Baumeister, H., Cuijpers, P., & Berking, M. (2018) · Behavior Therapy · doi:10.1016/j.beth.2017.05.004 · Cited by 75
Developmental origins of child mental health disorders
Swanson, J. D., & Wadhwa, P. M. (2008) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2008.02014.x · Cited by 78
Montgomery, S. A., Mansuy, L., Ruth, A., Bose, A., Li, H., & Li, D. (2013) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.12m08141 · Cited by 78
Regression to the mean in substance use disorder treatment research
Finney, J. W. (2008) · Addiction · doi:10.1111/j.1360-0443.2007.02032.x · Cited by 78
The effects of psychotherapy for depression on anxiety symptoms: a meta-analysis
Weitz, E., Kleiboer, A., van Straten, A., & Cuijpers, P. (2018) · Psychological Medicine · doi:10.1017/s0033291717003622 · Cited by 77
“In addition to standardized effect sizes, we also calculated the numbers-needed-to-treat (NNT) using the Kraemer & Kupfer (2006) formula.”
MethodThe efficacy of supported employment for middle-aged and older people with schizophrenia
Twamley, E. W., Vella, L., Burton, C. Z., Becker, D. R., Bell, M. D., & Jeste, D. V. (2012) · Schizophrenia Research · doi:10.1016/j.schres.2011.11.036 · Cited by 75
“Work attainment was examined using χ2 analyses, area under the curve (AUC), and number needed to treat (NNT; Kraemer and Kupfer, 2006).”
MethodCuijpers, P., Van Straten, A., Hollon, S. D., & Andersson, G. (2010) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2009.01513.x · Cited by 74
Ghielen, I., Rutten, S., Boeschoten, R. E., Houniet-de Gier, M., van Wegen, E. E. H., van den Heuvel, O. A., & Cuijpers, P. (2019) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2019.05.001 · Cited by 74
Patient-reported functioning in major depressive disorder
IsHak, W. W., James, D. M., Mirocha, J., Youssef, H., Tobia, G., Pi, S., Collison, K. L., & Cohen, R. M. (2016) · Therapeutic Advances in Chronic Disease · doi:10.1177/2040622316639769 · Cited by 71
“Clinical significance for numerical outcomes was estimated using effect sizes [Kraemer, 2006] in which Cohen’s d values of 0.2, 0.5 and 0.8 describe small, medium and large effects, respectively [Cohen, 1988].”
MethodInfluentialKramer, J., Conijn, B., Oijevaar, P., & Riper, H. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3261 · Cited by 69
“The number needed to treat was calculated as 1/success rate difference [40].”
The Effect of Cognitive Behavioral Group Therapy for Depression: A Meta‐Analysis 2000–2010
Feng, C., Chu, H., Chen, C., Chang, Y., Chen, T., Chou, Y., Chang, Y., & Chou, K. (2012) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2011.00229.x · Cited by 66
Sander, L. B., Paganini, S., Terhorst, Y., Schlicker, S., Lin, J., Spanhel, K., Buntrock, C., Ebert, D. D., & Baumeister, H. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.1021 · Cited by 63
Deckersbach, T., Peters, A. T., Sylvia, L., Urdahl, A., Magalhães, P. V. S., Otto, M. W., Frank, E., Miklowitz, D. J., Berk, M., Kinrys, G., et al. (2014) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2013.13020225 · Cited by 65
Romijn, G., Batelaan, N., Kok, R., Koning, J., van Balkom, A., Titov, N., & Riper, H. (2019) · Journal of Medical Internet Research · doi:10.2196/11706 · Cited by 52
Cognitive Behavioral Treatment for Recurrent Binge Eating in Adolescent Girls: A Pilot Trial
DeBar, L. L., Wilson, G. T., Yarborough, B. J., Burns, B., Oyler, B., Hildebrandt, T., Clarke, G. N., Dickerson, J., & Striegel, R. H. (2013) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2012.04.001 · Cited by 58
McCracken, J. T., McGough, J. J., Loo, S. K., Levitt, J., Del’Homme, M., Cowen, J., Sturm, A., Whelan, F., Hellemann, G., Sugar, C., et al. (2016) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2016.05.015 · Cited by 57
Varkovitzky, R. L., Sherrill, A. M., & Reger, G. M. (2018) · Behavior Modification · doi:10.1177/0145445517724539 · Cited by 55
Georgescu, R., Fodor, L. A., Dobrean, A., & Cristea, I. A. (2020) · Psychological Medicine · doi:10.1017/s0033291719001855 · Cited by 53
“, 1988), computed with the Kraemer and Kupfer formula (Kraemer and Kupfer, 2006).”
MethodCabassa, L. J., Druss, B., Wang, Y., & Lewis-Fernández, R. (2011) · Implementation Science · doi:10.1186/1748-5908-6-80 · Cited by 50
de Vries, Y. A., de Jonge, P., van den Heuvel, E., Turner, E. H., & Roest, A. M. (2016) · British Journal of Psychiatry · doi:10.1192/bjp.bp.115.173450 · Cited by 50
The Impact of APA and AERA Guidelines on effect size reporting
Peng, C.-Y. J., Chen, L.-T., Chiang, H.-M., & Chiang, Y.-C. (2013) · Educational Psychology Review · doi:10.1007/s10648-013-9218-2 · Cited by 46
Cuijpers, P., Karyotaki, E., Andersson, G., Li, J., Mergl, R., & Hegerl, U. (2015) · European Psychiatry · doi:10.1016/j.eurpsy.2015.06.005 · Cited by 44
“Numbers-needed-to-treated (NNT) were calculated using the formulae provided by Kraemer and Kupfer [36].”
MethodTsai, H.-J., Yang, A. C., Zhu, J.-D., Hsu, Y.-Y., Hsu, T.-F., & Tsai, S.-J. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12030481 · Cited by 45
“Moreover, to detect the treatment effect and to estimate the clinical significance [41], the number needed to treat (NNT) was computed using the Kraemer and Kupfer method [42] for subjective SQ.”
MethodMa, J., Yank, V., Lv, N., Goldhaber-Fiebert, J. D., Lewis, M. A., Kramer, M. K., Snowden, M. B., Rosas, L. G., Xiao, L., & Blonstein, A. C. (2015) · Contemporary Clinical Trials · doi:10.1016/j.cct.2015.06.010 · Cited by 45
Breitborde, N. J., Moreno, F. A., Mai-Dixon, N., Peterson, R., Durst, L., Bernstein, B., Byreddy, S., & McFarlane, W. R. (2011) · BMC Psychiatry · doi:10.1186/1471-244x-11-9 · Cited by 45
“Although there is no established criteria for a clinically meaningful reduction in NNT [36], for the current study we defined a clinically meaningful benefit of the MFG and CR condition as an NNT one-half the size of the NNT for MFG along (i.”
BackgroundMethodInfluentialPeters, A., Sylvia, L. G., da Silva Magalhães, P. V., Miklowitz, D. J., Frank, E., Otto, M. W., Hansen, N. S., Dougherty, D. D., Berk, M., Nierenberg, A. A., et al. (2014) · Psychological Medicine · doi:10.1017/s0033291714000804 · Cited by 41
Psychological treatment of anxiety in primary care: a meta-analysis
Seekles, W., Cuijpers, P., Kok, R., Beekman, A., van Marwijk, H., & van Straten, A. (2013) · Psychological Medicine · doi:10.1017/s0033291712000670 · Cited by 41
Larouche, E., Hudon, C., & Goulet, S. (2019) · Complementary Therapies in Clinical Practice · doi:10.1016/j.ctcp.2018.11.008 · Cited by 41
Montero-Marin, J., Garcia-Campayo, J., López-Montoyo, A., Zabaleta-del-Olmo, E., & Cuijpers, P. (2018) · Psychological Medicine · doi:10.1017/s0033291717003099 · Cited by 37
“To facilitate the clinical interpretation of Hedges’ g, we transformed the ESs into the number needed to treat (NNT), with the conversion of Kraemer & Kupfer (2006).”
MethodBrick, R., Padgett, L., Jones, J., Wood, K. C., Pergolotti, M., Marshall, T. F., Campbell, G., Eilers, R., Keshavarzi, S., Flores, A. M., et al. (2023) · Journal of Cancer Survivorship · doi:10.1007/s11764-022-01181-4 · Cited by 36
“Betweengroup effect sizes were estimated by the differences between the intervention mean changes in functional disability in each intervention and control group divided by the pooled standard deviation (SD) at baseline [21].”
MethodImplications of clinical trial design on sample size requirements
Leon, A. C. (2007) · Schizophrenia Bulletin · doi:10.1093/schbul/sbn035 · Cited by 35
“the number needed to treat (NNT), which is viewed by many to be more clinically interpretable.(3) Given any 3”
BackgroundKanuri, N., Taylor, C. B., Cohen, J. M., & Newman, M. G. (2015) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2015.05.011 · Cited by 32
Guided Self-Help Treatment for Recurrent Binge Eating: Replication and Extension
DeBar, L. L., Striegel-Moore, R. H., Wilson, G. T., Perrin, N., Yarborough, B. J., Dickerson, J., Lynch, F., Rosselli, F., & Kraemer, H. C. (2011) · Psychiatric Services · doi:10.1176/ps.62.4.pss6204_0367 · Cited by 32
Self-citationLisdexamfetamine Dimesylate: A New Therapeutic Option for Attention-Deficit Hyperactivity Disorder
Steer, C., Froelich, J., Soutullo, C. A., Johnson, M., & Shaw, M. (2012) · CNS Drugs · doi:10.2165/11634340-000000000-00000 · Cited by 30
“NNT has been described as the effect size estimate that is most useful in conveying the clinical significance of treatment effects.([51]) For hyperactive/ impulsive symptoms the effect size difference was also significantly greater for amfetamines than for methylphenidate (1.”
Background(2008) · Research at the University of Copenhagen (University of Copenhagen) · Cited by 26
Treatment validity for intervention studies.
Chambless, D. L., & Hollon, S. D. (2012) · APA handbook of research methods in psychology, Vol 2: Research designs: Quantitative, qualitative, neuropsychological, and biological. · doi:10.1037/13620-028 · Cited by 24
Gaudiano, B., Davis, C., Epstein-Lubow, G., Johnson, J., Mueser, K., & Miller, I. (2017) · Healthcare · doi:10.3390/healthcare5020023 · Cited by 22
“, “number needed to treat”) as recommended for treatment development trials [93].”
BackgroundRichards, C., McIntyre, R. S., Weisler, R., Sambunaris, A., Brawman-Mintzer, O., Gao, J., Geibel, B., Dauphin, M., & Madhoo, M. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.07.006 · Cited by 20
Schefft, C., Guhn, A., Brakemeier, E. ‐., Sterzer, P., & Köhler, S. (2019) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12995 · Cited by 17
Richards, C., Iosifescu, D. V., Mago, R., Sarkis, E., Reynolds, J., Geibel, B., & Dauphin, M. (2017) · Journal of Psychopharmacology · doi:10.1177/0269881117722998 · Cited by 14
Zarski, A.-C., Weisel, K. K., Berger, T., Krieger, T., Schaub, M. P., Berking, M., Görlich, D., Jacobi, C., & Ebert, D. D. (2024) · Psychotherapy and Psychosomatics · doi:10.1159/000536149 · Cited by 13
“For each of the analyses, the number needed to treat (NNT) and the 95% con fi dence interval to achieve one additional treatment response were calculated [64].”
MethodSystematic Reviews and Cancer Research: a Suggested Stepwise Approach
Kelley, G. A., & Kelley, K. S. (2018) · BMC Cancer · doi:10.1186/s12885-018-4163-6 · Cited by 13
Effect of Psychotherapy on Intolerance of Uncertainty: A Systematic Review and Meta‐Analysis
Näsling, J., Åström, E., Jacobsson, L., & Ljungberg, J. K. (2024) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.3026 · Cited by 12
Thielecke, J., Buntrock, C., Titzler, I., Braun, L., Freund, J., Berking, M., Baumeister, H., & Ebert, D. D. (2024) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x221106027 · Cited by 8
Safety First! Residential Group Climate and Antisocial Behavior: A Multilevel Meta-analysis
E. M. A, E., J. J, R., G. H. P, V. D. H., E. J. E, H., C. H. Z, K., K. S, N., S, V., J. D, L., G. J. J. M, S., E, K., et al. (2025) · International Journal of Offender Therapy and Comparative Criminology · doi:10.1177/0306624x241252052 · Cited by 4
“For the purpose of clinical importance, we converted the overall effect size into a percentage of change using a formula provided by Kraemer and Kupfer (2006), transforming r into Area Under Curve (AUC), subsequently computing a percentage of change through: (2 * AUC – 1) * 100.”
Metadata
- Authors
- Kraemer, H. C., & Kupfer, D. J.
- Venue
- Biological Psychiatry
- Publisher
- Elsevier BV
- Published
- 2006-06
- Volume
- 59
- Issue
- 11
- Pages
- 990-996
- ISSN
- 0006-3223 (ISSN-L)
- OpenAlex
- W2059171296
- Cited by
- 850
- References
- 47
- FWCI
- 20.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.