The DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Probabilistic index: an intuitive non‐parametric approach to measuring the size of treatment effects
Abstract
Effect sizes (ES) tell the magnitude of the difference between treatments and, ideally, should tell clinicians how likely their patients will benefit from the treatment. Currently used ES are expressed in statistical rather than in clinically useful terms and may not give clinicians the appropriate information. We restrict our discussion to studies with two groups: one with n patients receiving a new treatment and the other with m patients receiving the usual or no treatment. The standardized mean difference (e.g. Cohen's d) is a well‐known index for continuous outcomes. There is some intuitive value to d, but measuring improvement in standard deviations (SD) is a statistical concept that may not help a clinician. How much improvement is a half SD? A more intuitive and simple‐to‐calculate ES is the probability that the response of a patient given the new treatment (X) is better than the one for a randomly chosen patient given the old or no treatment (Y) (i.e. P(X > Y), larger values meaning better outcomes). This probability has an immediate identity with the area under the curve (AUC) measure in procedures for receiver operator characteristic (ROC) curve comparing responses to two treatments. It also can be easily calculated from the Mann–Whitney U, Wilcoxon, or Kendall τ statistics. We describe the characteristics of an ideal ES. We propose P(X > Y) as an alternative index, summarize its correspondence with well‐known non‐parametric statistics, compare it to the standardized mean difference index, and illustrate with clinical data. Copyright © 2005 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
Statistical Methods for Meta-Analysis
Wasserman, S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,326
Statistical Methods for Meta-Analysis.
Freeman, P. R., Hedges, L. V., & Olkin, I. (1986) · Biometrics · doi:10.2307/2531069 · Cited by 4,784
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Miller, R. G. (1981) · Cited by 3,336
Moran, P. A. P., & Kendall, M. G. (1951) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2980903 · Cited by 2,573
The number needed to treat: a clinically useful measure of treatment effect
Cook, R. J., & Sackett, D. L. (1995) · BMJ · doi:10.1136/bmj.310.6977.452 · Cited by 1,885
Practical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778
Olejnik, S., & Algina, J. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.4.434 · Cited by 1,622
A common language effect size statistic
McGraw, K. O., & Wong, S. P. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.111.2.361 · Cited by 934
Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach
Rosenthal, R., Rosnow, R. L., & Rubin, D. B. (1999) · Cited by 854
Measures of Effect Size for Comparative Studies: Applications, Interpretations, and Limitations
Olejnik, S., & Algina, J. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.2000.1040 · Cited by 701
Nonparametric analysis of longitudinal data in factorial experiments
Brunner, E., Domhof, S., & Langer, F. (2002) · Cited by 635
Effect-Size Indices for Dichotomized Outcomes in Meta-Analysis.
Sánchez-Meca, J., Marín-Martínez, F., & Chacón-Moscoso, S. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.4.448 · Cited by 634
Nonparametrics: Statistical Methods Based on Ranks.
Berengut, D., & Lehmann, E. L. (1978) · Journal of the American Statistical Association · doi:10.2307/2286308 · Cited by 595
Textbook of psychopharmacology
Edwards, G. (1975) · Nature · doi:10.1038/258648b0 · Cited by 585
Contrasts and Effect Sizes in Behavioral Research: A Correlational Approach
Rosenthal, R., Rosnow, R. L., & Rubin, D. B. (1999) · Cambridge University Press eBooks · doi:10.1017/cbo9780511804403 · Cited by 535
Consistency and Unbiasedness of Certain Nonparametric Tests
Lehmann, E. L. (1951) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177729639 · Cited by 394
Measures of Clinical Significance
KRAEMER, H. C., MORGAN, G. A., LEECH, N. L., GLINER, J. A., VASKE, J. J., & HARMON, R. J. (2003) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200312000-00022 · Cited by 367
Sample Size Determination for Some Common Nonparametric Tests
Noether, G. E. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478478 · Cited by 307
Effect-Size Estimates: Issues and Problems in Interpretation
Fern, E. F., & Monroe, K. B. (1996) · Journal of Consumer Research · doi:10.1086/209469 · Cited by 301
Fidler, F., Thomason, N., Cumming, G., Finch, S., & Leeman, J. (2004) · Psychological Science · doi:10.1111/j.0963-7214.2004.01502008.x · Cited by 244
A History of Effect Size Indices
Huberty, C. J. (2002) · Educational and Psychological Measurement · doi:10.1177/0013164402062002002 · Cited by 241
Sample Size Determination for Some Common Nonparametric Tests
Noether, G. E. (1987) · Journal of the American Statistical Association · doi:10.2307/2289477 · Cited by 225
Probability of the superior outcome of one treatment over another.
Grissom, R. J. (1994) · Journal of Applied Psychology · doi:10.1037//0021-9010.79.2.314 · Cited by 217
On Constructing Statistics and Reporting Data
Wolfe, D. A., & Hogg, R. V. (1971) · The American Statistician · doi:10.1080/00031305.1971.10477278 · Cited by 95
On the Consistency and the Power of Wilcoxon’s two Sample Test
van Dantzig, D. (1951) · Indagationes Mathematicae (Proceedings) · doi:10.1016/s1385-7258(51)50001-x · Cited by 64
Mee, R. W. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10474942 · Cited by 58
Cognitive therapy for persistent psychosis in schizophrenia: a case-controlled clinical trial
TEMPLE, S. D., & Ho, B. (2004) · Schizophrenia Research · doi:10.1016/j.schres.2004.05.013 · Cited by 24
Self-citationCerejeira, A. (2005) · Nature Medicine · doi:10.1038/nm0105-1 · Cited by 20
Cited by
An improved effect size for single-case research: nonoverlap of all pairs.
Parker, R. I., & Vannest, K. (2009) · Behavior Therapy · doi:10.1016/j.beth.2008.10.006 · Cited by 1,126
Modern robust statistical methods: An easy way to maximize the accuracy and power of your research.
Erceg-Hurn, D. M., & Mirosevich, V. M. (2008) · American Psychologist · doi:10.1037/0003-066x.63.7.591 · Cited by 959
Size of Treatment Effects and Their Importance to Clinical Research and Practice
Kraemer, H. C., & Kupfer, D. J. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.09.014 · Cited by 850
Effect Size in Single-Case Research: A Review of Nine Nonoverlap Techniques
Parker, R. I., Vannest, K. J., & Davis, J. L. (2011) · Behavior Modification · doi:10.1177/0145445511399147 · Cited by 841
. Caution regarding the use of pilot studies to guide power calculations for study proposals.
Kraemer, H. C., Mintz, J., Noda, A., Tinklenberg, J., & Yesavage, J. A. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.5.484 · Cited by 702
Metadata
- Authors
- Acion, L., Peterson, J. J., Temple, S., & Arndt, S.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2005-09-05
- Volume
- 25
- Issue
- 4
- Pages
- 591-602
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2073502055
- Cited by
- 269
- References
- 31
- FWCI
- 7.00
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.