The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
A Primer on Receiver Operating Characteristic Analysis and Diagnostic Efficiency Statistics for Pediatric Psychology: We Are Ready to ROC
Open accessAbstract
OBJECTIVE: To offer a practical demonstration of receiver operating characteristic (ROC) analyses, diagnostic efficiency statistics, and their application to clinical decision making using a popular parent checklist to assess for potential mood disorder. METHOD: Secondary analyses of data from 589 families seeking outpatient mental health services, completing the Child Behavior Checklist and semi-structured diagnostic interviews. RESULTS: Internalizing Problems raw scores discriminated mood disorders significantly better than did age- and gender-normed T scores, or an Affective Problems score. Internalizing scores <8 had a diagnostic likelihood ratio <0.3, and scores >30 had a diagnostic likelihood ratio of 7.4. CONCLUSIONS: This study illustrates a series of steps in defining a clinical problem, operationalizing it, selecting a valid study design, and using ROC analyses to generate statistics that support clinical decisions. The ROC framework offers important advantages for clinical interpretation. Appendices include sample scripts using SPSS and R to check assumptions and conduct ROC analyses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3338 · Cited by 35,305
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Hosmer, D. W., & Lemeshow, S. (2000) · doi:10.1002/0471722146 · Cited by 20,302
Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
pROC: an open-source package for R and S+ to analyze and compare ROC curves
Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J.-C., & Müller, M. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-77 · Cited by 13,697
KAUFMAN, J., BIRMAHER, B., BRENT, D., RAO, U., FLYNN, C., MORECI, P., WILLIAMSON, D., & RYAN, N. (1997) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199707000-00021 · Cited by 10,148
(2000) · Cited by 9,198
Hanley, J. A., & McNeil, B. J. (1983) · Radiology · doi:10.1148/radiology.148.3.6878708 · Cited by 7,016
Evidence-Based Medicine: How to Practice and Teach EBM
Sackett, D. L. (2000) · Cited by 5,950
Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative.
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-1-200301070-00010 · Cited by 3,219
Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · BMJ · doi:10.1136/bmj.326.7379.41 · Cited by 3,215
Towards Complete and Accurate Reporting of Studies of Diagnostic Accuracy: The STARD Initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · Radiology · doi:10.1148/radiol.2261021292 · Cited by 3,215
Bayes, T. (1763) · Philosophical Transactions of the Royal Society of London · doi:10.1098/rstl.1763.0053 · Cited by 2,995
AN ESSAY TOWARDS SOLVING A PROBLEM IN THE DOCTRINE OF CHANCES
BAYES (1958) · Biometrika · doi:10.1093/biomet/45.3-4.296 · Cited by 2,911
The Statistical Evaluation of Medical Tests for Classification and Prediction
Pepe, M. S. (2003) · doi:10.1093/oso/9780198509844.001.0001 · Cited by 2,198
Clinical versus statistical prediction: A theoretical analysis and a review of the evidence.
Meehl, P. E. (1954) · University of Minnesota Press eBooks · doi:10.1037/11281-000 · Cited by 2,171
How to improve Bayesian reasoning without instruction: Frequency formats.
Gigerenzer, G., & Hoffrage, U. (1995) · Psychological Review · doi:10.1037//0033-295x.102.4.684 · Cited by 2,127
The Statistical Evaluation of Medical Tests for Classification and Prediction
(2005) · Technometrics · doi:10.1198/tech.2005.s278 · Cited by 1,899
Statistical Methods in Diagnostic Medicine
Zhou, X., Obuchowski, N. A., & McClish, D. K. (2011) · Wiley Series in Probability and Statistics · doi:10.1002/9780470906514 · Cited by 1,784
Evidence-Based Medicine: How to Practice and Teach EBM
Wilson, M. C. (2001) · ACP Journal Club · doi:10.7326/acpjc-2001-134-1-a15 · Cited by 1,661
Adolescent Onset of the Gender Difference in Lifetime Rates of Major Depression: A Theoretical Model
Cyranowski, J. M., Frank, E., Young, E., & Shear, M. K. (2000) · Archives of General Psychiatry · doi:10.1001/archpsyc.57.1.21 · Cited by 1,276
Statistical Methods in Diagnostic Medicine
Zhou, X., Obuchowski, N. A., & McClish, D. K. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9780470317082 · Cited by 1,165
Psychological Science Can Improve Diagnostic Decisions
Swets, J. A., Dawes, R. M., & Monahan, J. (2000) · Psychological Science in the Public Interest · doi:10.1111/1529-1006.001 · Cited by 868
Evaluating Medical Tests: Objective and Quantitative Guidelines.
Guthrie, D., & Kraemer, H. C. (1992) · Journal of the American Statistical Association · doi:10.2307/2290671 · Cited by 629
Meta-analysis of screening and diagnostic tests.
Hasselblad, V., & Hedges, L. V. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.117.1.167 · Cited by 579
Doing Bayesian Data Analysis: A Tutorial with R and BUGS
Barry, J. (2011) · Europe’s Journal of Psychology · doi:10.5964/ejop.v7i4.163 · Cited by 563 · cited 4×
“, 2011) or continuous dependent variables (Kruschke, 2011).”
BackgroundMethodInfluentialUse of the Beck Depression Inventory for Primary Care to screen for major depression disorders
Steer, R. A., Cavalieri, T. A., Leonard, D. M., & Beck, A. T. (1999) · General Hospital Psychiatry · doi:10.1016/s0163-8343(98)00070-x · Cited by 313
Warnick, E. M., Bracken, M. B., & Kasl, S. (2008) · Child and Adolescent Mental Health · doi:10.1111/j.1475-3588.2007.00461.x · Cited by 258
QUANTIFYING THE INFORMATION VALUE OF CLINICAL ASSESSMENTS WITH SIGNAL DETECTION THEORY
McFall, R. M., & Treat, T. A. (1999) · Annual Review of Psychology · doi:10.1146/annurev.psych.50.1.215 · Cited by 250
Validity of the CBCL/YSR DSM-IV scales Anxiety Problems and Affective Problems
Ferdinand, R. F. (2008) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2007.01.008 · Cited by 172
Lengua, L. J., Sadowski, C. A., Friedrich, W. N., & Fisher, J. (2001) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.69.4.683 · Cited by 172
Properties of the beck depression inventory as a screening instrument for adolescent depression
Barrera, M., & Garrison-Jones, C. V. (1988) · Journal of Abnormal Child Psychology · doi:10.1007/bf00913799 · Cited by 162
Youngstrom, E. A., Meyers, O. I., Demeter, C., Youngstrom, J. K., Morello, L., PIIPARINEN, R. A., Feeny, N. C., Calabrese, J. R., & Findling, R. L. (2005) · Bipolar Disorders · doi:10.1111/j.1399-5618.2005.00269.x · Cited by 149
Self-citationYoungstrom, E. A. (2012) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2012.736358 · Cited by 119
Self-citationJenkins, M. M., Youngstrom, E. A., Washburn, J. J., & Youngstrom, J. K. (2011) · Professional Psychology Research and Practice · doi:10.1037/a0022506 · Cited by 80
Self-citationDoing Bayesian Data Analysis: A Tutorial with R and BUGS
Barry, J. A. (2011) · PsycEXTRA Dataset · doi:10.1037/e617512012-011 · Cited by 52
Youngstrom, E. A., Meyers, O. I., Youngstrom, J. K., Calabrese, J. R., & Findling, R. L. (2006) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.06.023 · Cited by 50
Self-citationA Brief Screening Tool for a Prepubertal and Early Adolescent Bipolar Disorder Phenotype
Tillman, R., & Geller, B. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.6.1214 · Cited by 30
Pulleyblank, R., Chuma, J., Gilbody, S. M., & Thompson, C. A. (2013) · Psychological Assessment · doi:10.1037/a0032394 · Cited by 11
(2001) · Medical Entomology and Zoology
Cited by
Pediatric Pain Screening Tool: rapid identification of risk in youth with pain complaints
Simons, L. E., Smith, A., Ibagon, C., Coakley, R., Logan, D. E., Schechter, N., Borsook, D., & Hill, J. C. (2015) · Pain · doi:10.1097/j.pain.0000000000000199 · Cited by 89
Exploring how feedback reflects entrustment decisions using artificial intelligence
Gin, B. C., ten Cate, O., O'Sullivan, P. S., Hauer, K. E., & Boscardin, C. (2022) · Medical Education · doi:10.1111/medu.14696 · Cited by 37
Skarphedinsson, G., Jarbin, H., Andersson, M., & Ivarsson, T. (2021) · PLOS ONE · doi:10.1371/journal.pone.0254953 · Cited by 29
Crabtree, V. M., Klages, K. L., Sykes, A., Wise, M. S., Lu, Z., Indelicato, D., Merchant, T. E., Avent, Y., & Mandrell, B. N. (2019) · Journal of Clinical Sleep Medicine · doi:10.5664/jcsm.7982 · Cited by 27
Van Meter, A. R., You, D. S., Halverson, T., Youngstrom, E. A., Birmaher, B., Fristad, M. A., Kowatch, R. A., Storfer-Isser, A., Horwitz, S. M., Frazier, T. W., et al. (2018) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2016.1188698 · Cited by 23
Self-citation
Metadata
- Authors
- Youngstrom, E. A.
- Venue
- Journal of Pediatric Psychology
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-08-21
- Volume
- 39
- Issue
- 2
- Pages
- 204-221
- ISSN
- 0146-8693 (ISSN-L)
- 1465-735X
- OpenAlex
- W2156030748
- Cited by
- 387
- References
- 44
- FWCI
- 13.05
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.