Confidence intervals for an effect size measure based on the Mann–Whitney statistic. Part 2: asymptotic methods and evaluation
Abstract
Several asymptotic confidence interval methods for U / mn , the Mann–Whitney U statistic divided by the product of the two sample sizes, are developed and evaluated alongside published methods. Novel methods derived from Gaussian and beta models perform well, though overall a modification of the Hanley–McNeil approach (method 5 in this evaluation) performed better and is recommended for calculating confidence intervals for U / mn for continuously distributed data. Copyright © 2005 John Wiley & Sons, Ltd.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Newcombe's method can approximate the standard error of the c-statistic from the reported c-statistic, total sample size, and total number of events.
“We here consider a method proposed by Newcombe to estimate the standard error of the c-statistic.29”
From A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes (2019) · cites this paper as [29]
Cites
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856 · see citing works
Probable Inference, the Law of Succession, and Statistical Inference
Wilson, E. B. (1927) · Journal of the American Statistical Association · doi:10.1080/01621459.1927.10502953 · Cited by 4,476 · see citing works
Tables for Computing Bivariate Normal Probabilities
Owen, D. B. (1956) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728074 · Cited by 463 · see citing works
Blyth, C. R., & Still, H. A. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477938 · Cited by 406 · see citing works
Sample Size Determination for Some Common Nonparametric Tests
Noether, G. E. (1987) · Journal of the American Statistical Association · doi:10.1080/01621459.1987.10478478 · Cited by 308 · see citing works
Meta-analysis of multiple outcomes by regression with random effects
Berkey, C. S., Hoaglin, D. C., Antczak‐Bouckoms, A., Mosteller, F. C., & Colditz, G. A. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19981130)17:22 · Cited by 274 · see citing works
Sample Size Determination for Some Common Nonparametric Tests
Noether, G. E. (1987) · Journal of the American Statistical Association · doi:10.2307/2289477 · Cited by 227 · see citing works
Agresti, A., & Min, Y. (2005) · Biometrics · doi:10.1111/j.1541-0420.2005.031228.x · Cited by 121 · see citing works
Mee, R. W. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10474942 · Cited by 54 · see citing works
Distribution-Free Confidence Intervals for Pr(X 1 < X 2 )
Halperin, M., Gilbert, P. R., & Lachin, J. M. (1987) · Biometrics · doi:10.2307/2531950 · Cited by 44 · see citing works
Determining the Appropriate Sample Size for Nonparametric Tests for Location Shift
Hamilton, M. A., & Collings, B. J. (1991) · Technometrics · doi:10.2307/1268784 · Cited by 37 · see citing works
Mee, R. W. (1990) · Journal of the American Statistical Association · doi:10.2307/2290017 · Cited by 24 · see citing works
Confidence Bounds When the Estimated ROC Area is 1.0
Obuchowski, N. A., & Lieber, M. L. (2002) · Academic Radiology · doi:10.1016/s1076-6332(03)80329-x · Cited by 19 · see citing works
Applied Statistics Algorithms.
Paige, W. S., Griffiths, P., & Hill, I. D. (1986) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2347872 · Cited by 18 · see citing works
Bioinformatics: New Science–New Statistics?
Gilks, W. R. (2004) · Significance · doi:10.1111/j.1740-9713.2004.00001.x · Cited by 7 · see citing works
Fearnley, D. E., & Williams, T. (2001) · Medicine Science and the Law · doi:10.1177/002580240104100111 · Cited by 6 · see citing works
Bootstrap Wilcoxon-Mann-Whitney test for use in relation with non-shift alternatives
Reiczigel, J., Rózsa, L., & Zakariás, I. (2003) · Controlled Clinical Trials · Cited by 2 · see citing works
Detecting and describing heterogeneity in meta-analysis
Hardy, R. J., & Thompson, S. G. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19980430)17:8
Flagged first, then by citations
Cited by
Sorted by citations
Beitler, J. R., Sarge, T., Banner-Goodspeed, V. M., Gong, M. N., Cook, D., Novack, V., Loring, S. H., Talmor, D., & for the EPVent-2 Study Group (2019) · JAMA · doi:10.1001/jama.2019.0555 · Cited by 469 · see citing works
Minimum sample size for external validation of a clinical prediction model with a binary outcome
Riley, R. D., Debray, T. P. A., Collins, G. S., Archer, L., Ensor, J., van Smeden, M., & Snell, K. I. E. (2021) · Statistics in Medicine · doi:10.1002/sim.9025 · Cited by 400 · see citing works
A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes
Debray, T. P., Damen, J. A., Riley, R. D., Snell, K., Reitsma, J. B., Hooft, L., Collins, G. S., & Moons, K. G. (2019) · Statistical Methods in Medical Research · doi:10.1177/0962280218785504 · Cited by 278 · see citing works
“We here consider a method proposed by Newcombe to estimate the standard error of the c-statistic.(29)”
MethodMRI visual rating scales in the diagnosis of dementia: evaluation in 184 post-mortem confirmed cases
Harper, L., Fumagalli, G. G., Barkhof, F., Scheltens, P., O’Brien, J. T., Bouwman, F., Burton, E. J., Rohrer, J. D., Fox, N. C., Ridgway, G. R., et al. (2016) · Brain · doi:10.1093/brain/aww005 · Cited by 264 · see citing works
Minimum sample size for external validation of a clinical prediction model with a continuous outcome
Archer, L., Snell, K. I. E., Ensor, J., Hudda, M. T., Collins, G. S., & Riley, R. D. (2021) · Statistics in Medicine · doi:10.1002/sim.8766 · Cited by 198 · see citing works
Hirvikoski, T., Lindholm, T., Nordenström, A., Nordström, A.-L., & Lajic, S. (2009) · Hormones and Behavior · doi:10.1016/j.yhbeh.2008.12.004 · Cited by 123 · see citing works
Pointing and tracing enhance computer-based learning
Ginns, P., & King, V. (2021) · Educational Technology Research and Development · doi:10.1007/s11423-021-09997-0 · Cited by 31 · see citing works
Ginns, P., Hu, F., & Bobis, J. (2020) · Applied Cognitive Psychology · doi:10.1002/acp.3732 · Cited by 27 · see citing works
- Authors
- Newcombe, R. G.
- Affiliations
- Cardiff University (GB)
- Corresponding author
- Newcombe, Robert G.
- ORCID
- Newcombe, Robert G.
- Venue
- Statistics in Medicine
- Publisher
- Wiley
- Published
- 2005-10-11
- Volume
- 25
- Issue
- 4
- Pages
- 559-573
- ISSN
- 0277-6715 (ISSN-L)
- 1097-0258
- OpenAlex
- W2152394445
- Cited by
- 159
- References
- 18
- Citations by year
- 2026: 8 · 2025: 13 · 2024: 9 · 2023: 5 · 2022: 7 · 2021: 14 · 2020: 10 · 2019: 10 · 2018: 11 · 2017: 8 · 2016: 4 · 2015: 5 · 2014: 5 · 2013: 7 · 2012: 13
- FWCI
- 2.70
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Statistics in Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- effect size, confidence intervals, asymptotic methods, Gaussian model, beta model, continuous data, two-sample comparison
- MeSH terms
- Data Interpretation, Statistical, Humans, Confidence Intervals, Sample Size, Statistics, Nonparametric
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review