The ADOS Calibrated Severity Score: Relationship to Phenotypic Variables and Stability over Time
Open accessAbstract
Measurement of the severity of autism at a single time point, and over time, is a widespread challenge for researchers. Recently, G otham, P ickles, and L ord published a severity metric (calibrated severity scores; CSS) that takes into account age and language level and is based on raw total scores of the A utism D iagnostic O bservation S chedule (ADOS), a standardized measure commonly used in autism diagnosis. The present study examined psychometric characteristics of the CSS compared to raw scores in an independent sample of 368 children aged 2 to 12 years with autism, pervasive developmental disorder‐not otherwise specified (PDD‐NOS), non‐spectrum delay, or typical development. Reflecting the intended calibration, the CSS were more uniformly distributed within clinical diagnostic category and across ADOS modules than were raw scores. Cross‐sectional analyses examining raw and severity scores and their relationships to participant characteristics revealed that verbal developmental level was a significant predictor of raw score but accounted for significantly less variance in the CSS. Longitudinal analyses indicated overall stability of the CSS over 12 to 24 months in children with autism. Findings from this study support the use of the CSS as a more valid indicator of autism severity than the ADOS raw total score, and extend the literature by examining the stability over 12 to 24 months of the CSS in children with ASD. Autism Res 2012, 5: 267–276. © 2012 International Society for Autism Research, Wiley Periodicals, Inc.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
ADOS-2 standardized scores have little relation to age or IQ.
“These scores have little relation to age or IQ (Kanne et al. 2011, Shumway et al. 2012), and some evidence suggests that they may be useful for identifying different trajectories of ASD severity (Gotham et al. 2012).”
From Recent Advances in Autism Research as Reflected in DSM-5 Criteria for Autism Spectrum Disorder (2015) · cites this paper as Shumway et al. 2012
The Results (page not provided) show that cognitive and demographic variables explained less variance in calibrated severity scores (18%) than in ADOS raw scores (56%); no individual variable, including age or developmental-quotient measures, reached the paper’s significance threshold for predicting calibrated scores. This supports a relatively weak relationship, but the study examined ADOS calibrated severity scores, not scores explicitly identified as ADOS-2 scores. (LLM, conf=0.83)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR)
American Psychiatric Association (2000) · doi:10.1176/appi.books.9780890423349 · Cited by 11,069 · see citing works
A Children's Global Assessment Scale (CGAS)
Shaffer, D. (1983) · Archives of General Psychiatry · doi:10.1001/archpsyc.1983.01790100074010 · Cited by 3,716 · see citing works
Dawson, G., Rogers, S., Munson, J., Smith, M., Winter, J., Greenson, J., Donaldson, A., & Varley, J. (2010) · Pediatrics · doi:10.1542/peds.2009-0958 · Cited by 2,621 · see citing works
Comparing correlated correlation coefficients
Meng, X.-L., Rosenthal, R., & Rubin, D. B. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.111.1.172 · Cited by 2,472 · see citing works
Autism Diagnostic Interview-Revised
Rutter, M., LeCouteur, A., & Lord, C. (2016) · PsycTESTS Dataset · doi:10.1037/t18128-000 · Cited by 1,627 · see citing works
Standardizing ADOS Scores for a Measure of Severity in Autism Spectrum Disorders
Gotham, K., Pickles, A., & Lord, C. (2009) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-008-0674-3 · Cited by 1,605 · see citing works
Autism From 2 to 9 Years of Age
Lord, C., Risi, S., DiLavore, P. S., Shulman, C., Thurm, A., & Pickles, A. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.6.694 · Cited by 973 · see citing works
Self-citationCombining Information From Multiple Sources in the Diagnosis of Autism Spectrum Disorders
RISI, S., LORD, C., GOTHAM, K., CORSELLO, C., CHRYSLER, C., SZATMARI, P., COOK, E. H., LEVENTHAL, B. L., & PICKLES, A. (2006) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/01.chi.0000227880.42780.0e · Cited by 581 · see citing works
A Replication of the Autism Diagnostic Observation Schedule (ADOS) Revised Algorithms
GOTHAM, K., RISI, S., DAWSON, G., TAGER-FLUSBERG, H., JOSEPH, R., CARTER, A., HEPBURN, S., McMAHON, W., RODIER, P., HYMAN, S. L., et al. (2008) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e31816bffb7 · Cited by 374 · see citing works
Oosterling, I., Roos, S., de Bildt, A., Rommelse, N., de Jonge, M., Visser, J., Lappenschaar, M., Swinkels, S., van der Gaag, R. J., & Buitelaar, J. (2010) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-009-0915-0 · Cited by 79 · see citing works
Flagged first, then by citations
Research works printed but not linked: 9
- Bishop S Guthrie W Coffing M Lord C 2011 Covergent validity of the Mullen Scales of Early Learning and the Differential Ability Scales in children with autism spectrum disorders American Journal on Intellectual and Developmental Disabilities 116 331 343 21905802 PMC7398154
- Charman T Taylor E Drew A Cockerill H Brown J Baird G 2005 Outcome at 7 years of children diagnosed with autism at age 2: Predictive validity of assessments conducted at 2 and 3 years of age and pattern of symptom change over time Journal of Child Psychology and Psychiatry 46 500 513 15845130
- de Bildt A Oosterling I van Lang N Sytema S Minderaa R van Engeland H 2011 Standardized ADOS scores: Measuring severity of autism spectrum disorders in a Dutch sample Journal of Autism and Developmental Disorders 41 311 319 20617374 PMC3040310
- Gotham K Risi S Pickles A Lord C 2007 The Autism Diagnostic Observation Schedule: Revised algorithms for improved diagnostic validity Journal of Autism and Developmental Disorders 37 613 627 17180459
- Hurt B Arnold L Aman M Martin A Scahill L Kratochvil C 2010 Clinical instruments and scales in pediatric psychopharmacology Pediatric Psychopharmacology: Principles and Practice 2 New York, NY Oxford University Press
- Krug D Arick J Almond P 1980 Behavior checklist for identifying severely handicapped individuals with high levels of autistic behavior Journal of Child Psychology and Psychiatry 21 221 229 7430288
- Lord C Risi S Lambrecht L Cook E Jr Leventhal B DiLavore P 2000 The Autism Diagnostic Observation Schedule-Generic: A standard measure of social and communication deficits associated with the spectrum of autism Journal of Autism and Developmental Disorders 30 205 223 11055457
- Sparrow S Cicchetti D Balla D 2005 Vineland Adaptive Behavior Scales, Survey Interview Form/Caregiver Rating Form 2 Livonia, MN Pearson Assessments
- Stone W Lee E Ashford L Brissie J Hepburn S Coonrod E 1999 Can autism be diagnosed accurately in children under 3 years? Journal of Child Psychology and Psychiatry 40 219 226 10188704
Cited by
Sorted by citations
Identification, Evaluation, and Management of Children With Autism Spectrum Disorder
Hyman, S. L., Levy, S. E., Myers, S. M., COUNCIL ON CHILDREN WITH DISABILITIES, S. O. D. A. B. P., Kuo, D. Z., Apkon, S., Davidson, L. F., Ellerbeck, K. A., Foster, J. E. A., Noritz, G. H., et al. (2020) · Pediatrics · doi:10.1542/peds.2019-3447 · Cited by 1,548 · see citing works
Beyond Autism: A Baby Siblings Research Consortium Study of High-Risk Children at Three Years of Age
Messinger, D., Young, G. S., Ozonoff, S., Dobkins, K., Carter, A., Zwaigenbaum, L., Landa, R. J., Charman, T., Stone, W. L., Constantino, J. N., et al. (2013) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2012.12.011 · Cited by 290 · see citing works
Recent Advances in Autism Research as Reflected in DSM-5 Criteria for Autism Spectrum Disorder
Lord, C., & Bishop, S. L. (2015) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-032814-112745 · Cited by 224 · see citing works
Limited Fine Motor and Grasping Skills in 6-Month-Old Infants at High Risk for Autism
Libertus, K., Sheperd, K. A., Ross, S. W., & Landa, R. J. (2014) · Child Development · doi:10.1111/cdev.12262 · Cited by 181 · see citing works
Behavioral Phenotype of ASD Preschoolers with Gastrointestinal Symptoms or Food Selectivity
Prosperi, M., Santocchi, E., Balboni, G., Narzisi, A., Bozza, M., Fulceri, F., Apicella, F., Igliozzi, R., Cosenza, A., Tancredi, R., et al. (2017) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-017-3271-5 · Cited by 82 · see citing works
Diagnosing autism in neurobiological research studies
Jones, R. M., & Lord, C. (2013) · Behavioural Brain Research · doi:10.1016/j.bbr.2012.10.037 · Cited by 56 · see citing works
“They have been independently validated [22, 23].”
The longitudinal heterogeneity of autistic traits: A systematic review
Pender, R., Fearon, P., Heron, J., & Mandy, W. (2020) · Research in Autism Spectrum Disorders · doi:10.1016/j.rasd.2020.101671 · Cited by 55 · see citing works
Wiggins, L. D., Barger, B., Moody, E., Soke, G., Pandey, J., & Levy, S. (2019) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-017-3072-x · Cited by 41 · see citing works
Muratori, F., Turi, M., Prosperi, M., Narzisi, A., Valeri, G., Guerrera, S., Santocchi, E., Apicella, F., Lattarulo, C., Calderoni, S., et al. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00107 · Cited by 29 · see citing works
Extracting Latent Subdimensions of Social Communication: A Cross-Measure Factor Analysis
Zheng, S., Kaat, A., Farmer, C., Kanne, S., Georgiades, S., Lord, C., Esler, A., & Bishop, S. L. (2021) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2020.08.444 · Cited by 26 · see citing works
Self-citationValagussa, G., Trentin, L., Balatti, V., & Grossi, E. (2017) · Autism Research · doi:10.1002/aur.1796 · Cited by 9 · see citing works
- Authors
- Shumway, S., Farmer, C., Thurm, A., Joseph, L., Black, D., & Golden, C.
- Affiliations
- National Institutes of Health (US)
- Corresponding author
- Farmer, Cristan
- Venue
- Autism Research
- Publisher
- Wiley
- Published
- 2012-05-24
- Volume
- 5
- Issue
- 4
- Pages
- 267-276
- ISSN
- 1939-3792 (ISSN-L)
- 1939-3806
- PMC
- PMC3422401
- OpenAlex
- W2123735324
- Cited by
- 117
- References
- 10
- Citations by year
- 2026: 8 · 2025: 2 · 2024: 10 · 2023: 3 · 2022: 10 · 2021: 11 · 2020: 14 · 2019: 10 · 2018: 12 · 2017: 9 · 2016: 9 · 2015: 8 · 2014: 5 · 2013: 4 · 2012: 2
- FWCI
- 3.11
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- Autism Research (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health
- National Institute of Mental Health (ZIAMH002868)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Autism Spectrum Disorder Research
- Health Sciences › Medicine › Psychiatry and Mental health › Child Nutrition and Feeding Issues
- Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
- Keywords
- autism severity, Autism Diagnostic Observation Schedule, severity measurement, longitudinal stability, pervasive developmental disorder not otherwise specified, children with autism, psychometric properties
- MeSH terms
- Age Factors, Child, Developmental Disabilities, Child Development Disorders, Pervasive, Child, Preschool, Female, Humans, Intelligence, Language Development Disorders, Longitudinal Studies, Male, Personality Assessment, Phenotype, Psychometrics, Reference Values, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review