The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Sample size estimation in diagnostic test studies of biomedical informatics
Open accessAbstract
OBJECTIVES This review provided a conceptual framework of sample size calculations in the studies of diagnostic test accuracy in various conditions and test outcomes. METHODS The formulae of sample size calculations for estimation of adequate sensitivity/specificity, likelihood ratio and AUC as an overall index of accuracy and also for testing in single modality and comparing two diagnostic tasks have been presented for desired confidence interval. RESULTS The required sample sizes were calculated and tabulated with different levels of accuracies and marginal errors with 95% confidence level for estimating and for various effect sizes with 80% power for purpose of testing as well. The results show how sample size is varied with accuracy index and effect size of interest. CONCLUSION This would help the clinicians when designing diagnostic test studies that an adequate sample size is chosen based on statistical principles in order to guarantee the reliability of study.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
The meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
Hanley, J. A., & McNeil, B. J. (1983) · Radiology · doi:10.1148/radiology.148.3.6878708 · Cited by 7,016
Two-sided confidence intervals for the single proportion: comparison of seven methods
Newcombe, R. G. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19980430)17:8<857::aid-sim777>3.0.co;2-e · Cited by 5,107
Approximate is Better than “Exact” for Interval Estimation of Binomial Proportions
Agresti, A., & Coull, B. A. (1998) · The American Statistician · doi:10.1080/00031305.1998.10480550 · Cited by 3,223
Receiver-operating characteristic analysis for evaluating diagnostic tests and predictive models
Zou, K. H., O’Malley, A. J., & Mauri, L. (2007) · Circulation · doi:10.1161/circulationaha.105.594929 · Cited by 1,473
Bamber, D. (1975) · Journal of Mathematical Psychology · doi:10.1016/0022-2496(75)90001-2 · Cited by 1,439
Likelihood ratios with confidence: Sample size estimation for diagnostic test studies
Simel, D. L., Samsa, G. P., & Matchar, D. B. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90128-v · Cited by 932 · cited 3×
“Regarding to AUC, at least three methods (Hanley and McNeil method [15], binormal estimator [22,33,24] and Delong’s method [35,36] have been proposed for SE of AUC.”
BackgroundMethodBuderer, N. M. F. (1996) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.1996.tb03538.x · Cited by 921
Receiver operating characteristic (ROC) curve for medical researchers
Kumar, R., & Indrayan, A. (2011) · Indian Pediatrics · doi:10.1007/s13312-011-0055-4 · Cited by 872
The use of receiver operating characteristic curves in biomedical informatics
Lasko, T. A., Bhagwat, J. G., Zou, K. H., & Ohno-Machado, L. (2005) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.02.008 · Cited by 823
Receiver operating characteristic (ROC) methodology: the state of the art.
Hanley, J. A. (1989) · PubMed · Cited by 807
Metz, C. E., Herman, B. A., & Shen, J.-H. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19980515)17:9<1033::aid-sim784>3.0.co;2-z · Cited by 793
ROC Analysis Applied to the Evaluation of Medical Imaging Techniques
SWETS, J. A. (1979) · Investigative Radiology · doi:10.1097/00004424-197903000-00002 · Cited by 699
An introduction to power and sample size estimation
Jones, S. R., Carley, S., & Harrison, M. (2003) · Emergency Medicine Journal · doi:10.1136/emj.20.5.453 · Cited by 643
Predicting sample size required for classification performance
Figueroa, R. L., Zeng-Treitler, Q., Kandula, S., & Ngo, L. H. (2012) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-12-8 · Cited by 520
Sample size calculation should be performed for design accuracy in diagnostic test studies
Flahault, A., Cadilhac, M., & Thomas, G. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.12.009 · Cited by 468
Metz, C. E., Wang, P.-L., & Kronman, H. B. (1984) · Information Processing in Medical Imaging · doi:10.1007/978-94-009-6045-9_25 · Cited by 356
Sample size calculations in studies of test accuracy
Obuchowski, N. A. (1998) · Statistical Methods in Medical Research · doi:10.1177/096228029800700405 · Cited by 221
Sample Size for Testing Differences in Proportions for the Paired-Sample Design
Connor, R. J. (1987) · Biometrics · doi:10.2307/2531961 · Cited by 187
Sample sizes of studies on diagnostic accuracy: literature survey.
Bachmann, L. M., Puhan, M. A., Riet, G. T., & Bossuyt, P. M. (2006) · BMJ · doi:10.1136/bmj.38793.637789.2f · Cited by 184
Hanley, J. A., & Hajian-Tilaki, K. O. (1997) · Academic Radiology · doi:10.1016/s1076-6332(97)80161-4 · Cited by 180
Self-citationText Categorization Models for High-Quality Article Retrieval in Internal Medicine
Aphinyanaphongs, Y. (2004) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1641 · Cited by 177 · cited 1×
“For example, recently a text classifier model for high quality article retrieval in internal medicine [9] and an automated text classifier to detect radiology report have been evaluated in ROC analysis [10].”
A simple nomogram for sample size for estimating sensitivity and specificity of medical tests
Malhotra, R., & Indrayan, A. (2010) · Indian Journal of Ophthalmology · doi:10.4103/0301-4738.71699 · Cited by 164
Practical Sample Size Calculations for Surveillance and Diagnostic Investigations
Fosgate, G. T. (2009) · Journal of Veterinary Diagnostic Investigation · doi:10.1177/104063870902100102 · Cited by 164
Newcombe, R. G. (2006) · Statistics in Medicine · doi:10.1002/sim.2324 · Cited by 159
Sample Size Tables For Receiver Operating Characteristic Studies
Obuchowski, N. A. (2000) · American Journal of Roentgenology · doi:10.2214/ajr.175.3.1750603 · Cited by 159
Hajian‐Tilaki, K., Hanley, J. A., Joseph, L., & Collet, J. (1997) · Medical Decision Making · doi:10.1177/0272989x9701700111 · Cited by 144
Self-citationOn sample size for sensitivity and specificity in prospective diagnostic accuracy studies
Li, J., & Fine, J. P. (2004) · Statistics in Medicine · doi:10.1002/sim.1836 · Cited by 135
Simple nomograms to calculate sample size in diagnostic studies
Carley, S. D. (2005) · Emergency Medicine Journal · doi:10.1136/emj.2003.011148 · Cited by 131
Comparison of quantitative diagnostic tests: Type I error, power, and sample size
Línnet, K. (1987) · Statistics in Medicine · doi:10.1002/sim.4780060207 · Cited by 97
Steinberg, D. M., Fine, J. P., & Chappell, R. J. (2008) · Biostatistics · doi:10.1093/biostatistics/kxn018 · Cited by 93
Computing Sample Size for Receiver Operating Characteristic Studies
Obuchowski, N. A. (1994) · Investigative Radiology · doi:10.1097/00004424-199402000-00020 · Cited by 75
Preoperative prediction of malignancy of ovarian tumors using least squares support vector machines
Lü, C., Gestel, T. V., Suykens, J. A. K., Huffel, S. V., Vergote, I. B., & Timmerman, D. (2003) · Artificial Intelligence in Medicine · doi:10.1016/s0933-3657(03)00051-4 · Cited by 75
Lachin, J. M. (1992) · Statistics in Medicine · doi:10.1002/sim.4780110909 · Cited by 64
Strategies for improving power in diagnostic radiology research.
Beam, C. A. (1992) · American Journal of Roentgenology · doi:10.2214/ajr.159.3.1503041 · Cited by 62
Chapman, W. W., Cooper, G. F., Hanbury, P., Chapman, B. E., Harrison, L. H., & D, M. M. W. M. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1330 · Cited by 45
Hajian‐Tilaki, K., & Hanley, J. A. (2002) · Academic Radiology · doi:10.1016/s1076-6332(03)80561-5 · Cited by 38
Self-citationRockette, H. E., Campbell, W. L., Britton, C. A., Holbert, J. M., King, J. L., & Gur, D. (1999) · Academic Radiology · doi:10.1016/s1076-6332(99)80468-1 · Cited by 38
Sample size determination in studies with matched pairs
Fleiss, J. L., & Levin, B. L. (1988) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(88)90158-8 · Cited by 30
Sample size in studies on diagnostic accuracy in ophthalmology: a literature survey
Bochmann, F., Johnson, Z. K., & Azuara‐Blanco, A. (2007) · British Journal of Ophthalmology · doi:10.1136/bjo.2006.113290 · Cited by 30
Sample size determination for bibliographic retrieval studies
Yao, X., Wilczynski, N. L., Walter, S. D., & Haynes, R. B. (2008) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-8-43 · Cited by 19
Evaluation of a Cardiac Diagnostic Program in a Typical Clinical Setting
Fraser, H. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1184 · Cited by 15
Cited by
Serdar, C. C., Cihan, M., Yücel, D., & Serdar, M. A. (2021) · Biochemia medica · doi:10.11613/bm.2021.010502 · Cited by 1,570
How sample size influences research outcomes
Faber, J., & Fonseca, L. M. (2014) · Dental Press Journal of Orthodontics · doi:10.1590/2176-9451.19.4.027-029.ebo · Cited by 946
Evaluation of a decided sample size in machine learning applications
Rajput, D., Wang, W.-J., & Chen, C.-C. (2023) · BMC Bioinformatics · doi:10.1186/s12859-023-05156-9 · Cited by 411
Guo, S., Popp, J., & Bocklitz, T. (2021) · Nature Protocols · doi:10.1038/s41596-021-00620-3 · Cited by 361
Qin, Z. Z., Sander, M. S., Rai, B., Titahong, C. N., Sudrungrot, S., Laah, S. N., Adhikari, L. M., Carter, E. J., Puri, L., Codlin, A. J., et al. (2019) · Scientific Reports · doi:10.1038/s41598-019-51503-3 · Cited by 289
Metadata
- Authors
- Hajian-Tilaki, K.
- Venue
- Journal of Biomedical Informatics
- Publisher
- Elsevier BV
- Published
- 2014-04
- Volume
- 48
- Pages
- 193-204
- ISSN
- 1532-0464 (ISSN-L)
- OpenAlex
- W2016293149
- Cited by
- 995
- References
- 43
- FWCI
- 24.06
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.