Validating two survey methods for identifying cases of autism spectrum disorder among adults in the community
Open accessThe DOI matches its Crossref record; 31 of the 34 references it cites were found in a registry or an index.
Abstract
Background: There are no tested methods for conducting epidemiological studies of autism spectrum disorders (ASDs) in adult general population samples. We tested the validity of the Autism Diagnostic Observation Schedule module-4 (ADOS-4) and the 20-item Autism-Spectrum Quotient (AQ-20). Method: Randomly sampled adults aged ⩾16 years were interviewed throughout England in a general population multi-phase survey. The AQ-20 was self-completed by 7353 adults in phase 1. A random subset completed phase 2, ADOS-4 assessments (n=618); the probability of selection increased with AQ-20 score. In phase 3, informant-based Diagnostic Interview Schedule for Social and Communication Disorders (DISCO) and Autism Diagnostic Interview – Revised (ADI-R) developmental assessments were completed (n=56). Phase 1 and 2 data were presented as vignettes to six experienced clinicians (working in pairs). The probability of respondents having an ASD was compared across the three survey phases. Results: There was moderate agreement between clinical consensus diagnoses and ADOS-4. A range of ADOS-4 caseness thresholds was identified by clinicians: 5+ to 13+ with greatest area under the curve (AUC) at 5+ (0.88). Modelling of the presence of ASD using 56 DISCO assessments suggested an ADOS-4 threshold in the range of 10+ to 13+ with the highest AUC at ADOS 10+ to 11+ (0.93–0.94). At ADOS 10+, the sensitivity was 1 [95% confidence interval (CI) 0.59–1.0] and the specificity 0.86 (95% CI 0.72–0.94). The AQ-20 was only a weak predictor of ADOS-4 cases. Conclusions: Clinically recommended ADOS-4 thresholds are also recommended for community cases: 7+ for subthreshold and 10+ for definite cases. Further work on adult population screening methods is needed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Studies using electronic health records have demonstrated that adults with ASD are more likely to be diagnosed with many physical health conditions such as immune conditions, sleep disorders and obesity, compared with adults in the general population 162”
From Autism spectrum disorder (2020) · cites this paper as [162]
In the citing paper
“In addition to the core features of ASD, co-occurring difficulties or disorders (Fig. 5) are much more widely recognized in research 160,161 , although they are not necessarily adequately addressed in clinical practice 162”
From Autism spectrum disorder (2020) · cites this paper as [162]
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. (2013) · Encyclopedia of Social Work · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,519
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Lord, C., Rutter, M., & Le Couteur, A. (1994) · Journal of Autism and Developmental Disorders · doi:10.1007/bf02172145 · Cited by 9,065 · cited 4×
“Potentially suitable standardized instruments for this purpose are the Autism Diagnostic Interview – Revised (ADI-R; Lord et al. 1994) and the Diagnostic Interview Schedule for Social and Communication Disorders (DISCO; Wing et al.”
BackgroundMethodInfluential(1943) · The Nervous child · Cited by 8,870
Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., & Clubley, E. (2001) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1005653411471 · Cited by 6,450 · cited 4×
“We tested the validity of the Autism Diagnostic Observation Schedule module-4 (ADOS-4) and the 20-item Autism-Spectrum Quotient (AQ-20).”
MethodInfluentialWing, L., & Gould, J. (1979) · Journal of Autism and Developmental Disorders · doi:10.1007/bf01531288 · Cited by 2,587 · cited 1×
“Study 1a used standardized ASD assessments (phase 3) of development and current functioning and diagnostic algorithms based on the DISCO (Wing & Gould, 1979) and ADI-R (Lord et al. 1994).”
MethodSCAN: Schedules fonr Clinical Assessment in Neuropsychiatry
Wing, J. K. (1990) · Archives of General Psychiatry · doi:10.1001/archpsyc.1990.01810180089012 · Cited by 2,517
Baird, G., Simonoff, E., Pickles, A., Chandler, S., Loucas, T., Meldrum, D., & Charman, T. (2006) · The Lancet · doi:10.1016/s0140-6736(06)69041-7 · Cited by 2,104
Adult outcome for children with autism
Howlin, P., Goode, S., Hutton, J., & Rutter, M. (2004) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2004.00215.x · Cited by 1,813
The Structured Clinical Interview for DSM-III-R (SCID): II. Multisite Test-Retest Reliability
Williams, J. B. W. (1992) · Archives of General Psychiatry · doi:10.1001/archpsyc.1992.01820080038006 · Cited by 1,618
Epidemiological Surveys of Autism and Other Pervasive Developmental Disorders: An Update
Fombonne, E. (2003) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1025054610557 · Cited by 1,505
Haro, J. M., Arbabzadeh-Bouchez, S., Brugha, T. S., De Girolamo, G., Guyer, M. E., Jin, R., Lepine, J. P., Mazzi, F., Reneses, B., Vilagut, G., et al. (2006) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.196 · Cited by 1,082
Self-citationPrevalence of autism-spectrum conditions: UK school-based population study
Baron-Cohen, S., Scott, F. J., Allison, C., Williams, J., Bolton, P., Matthews, F. E., & Brayne, C. (2009) · British Journal of Psychiatry · doi:10.1192/bjp.bp.108.059345 · Cited by 918
Epidemiology of Autism Spectrum Disorders in Adults in the Community in England
Brugha, T. S., McManus, S., Bankart, J., Scott, F., Purdon, S., Smith, J., Bebbington, P., Jenkins, R., & Meltzer, H. (2011) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.38 · Cited by 903
Self-citationFrith, U., & Mira, M. (1992) · Focus on Autistic Behavior · doi:10.1177/108835769200700302 · Cited by 870
Adult psychiatric morbidity in England, 2007: Results of a household survey
Mcmanus, S., Meltzer, H., Brugha, T., Bebbington, P., & Jenkins, R. (2009) · Unpublished · doi:10.13140/2.1.1563.5205 · Cited by 814
Self-citation(2005) · PubMed · Cited by 775
‘Autistic psychopathy’ in childhood
Asperger, H. (1991) · Autism and Asperger Syndrome · doi:10.1017/cbo9780511526770.002 · Cited by 765
Wing, L., Leekam, S. R., Libby, S. J., Gould, J., & Larcombe, M. (2002) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00023 · Cited by 694 · cited 8×
“In phase 3, informant-based Diagnostic Interview Schedule for Social and Communication Disorders (DISCO) and Autism Diagnostic Interview – Revised (ADI-R) developmental assessments were completed (n=56).”
BackgroundMethodInfluentialInternational encyclopedia of public health
(2009) · Choice Reviews Online · doi:10.5860/choice.46-3012 · Cited by 651
(1991) · Cambridge University Press eBooks · doi:10.1017/cbo9780511526770 · Cited by 564
Genomewide Association Studies: History, Rationale, and Prospects for Psychiatric Disorders
Psychiatric GWAS Consortium Coordinating Committee (2009) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08091354 · Cited by 450
Wing, L. (1997) · The Lancet · doi:10.1016/s0140-6736(97)09218-0 · Cited by 332
BRUGHA, T. S., BEBBINGTON, P. E., & JENKINS, R. (1999) · Psychological Medicine · doi:10.1017/s0033291799008880 · Cited by 191 · cited 1×
“Such surveys have often incorporated clinical diagnostic assessments by face-to-face or telephone interview (Brugha et al. 1999 ; Haro et al. 2006) after a fully structured lay interview and/or completion of a self-report questionnaire.”
BackgroundSelf-citationHarris, J., Brugha, T. S., McManus, S. B., Meltzer, H., Smith, J., Gullon-Scott, F., Purdon, S., & Bankart, J. (2009) · Research Portal (King's College London) · Cited by 103
Self-citationThe British Mental Health Survey Programme: achievements and latest findings
Jenkins, R., Meltzer, H., Bebbington, P., Brugha, T. S., Farrell, M., McManus, S., & Singleton, N. (2009) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-009-0112-7 · Cited by 87
Self-citationThe Economic Consequences of Autism in the UK
Knapp, M. R. J., Romeo, R., & Beecham, J. K. (2007) · London School of Economics and Political Science Research Online (London School of Economics and Political Science) · Cited by 53
McNamee, R. (2002) · Statistics in Medicine · doi:10.1002/sim.1318 · Cited by 36
Measurement of Psychiatric and Psychological Disorders and Outcomes in Populations
Brugha, T. S., & Meltzer, H. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-803678-5.00272-1 · Cited by 6
Self-citationMeasurement of Psychiatric and Psychological Disorders and Outcomes in Populations
Brugha, T. S., & Meltzer, H. (2008) · Elsevier eBooks · doi:10.1016/b978-012373960-5.00036-8 · Cited by 4
Self-citation篠津, 和. (1998) · Medical Entomology and Zoology · Cited by 1
Research works printed but not linked: 3
- Brugha, 1998, SCAN-SF. A Survey Form of the Present State Examination and SCAN: Supplementary schedule for lay interviewers
- 1993, The ICD-10 Classification of Mental and Behavioural Disorders: Diagnostic Criteria for Research
- Lord, 2002, Autism Diagnostic Observation Schedule. ADOS Manual
Cited by
Lord, C., Brugha, T. S., Charman, T., Cusack, J., Dumas, G., Frazier, T., Jones, E. J. H., Jones, R. M., Pickles, A., State, M. W., et al. (2020) · Nature Reviews Disease Primers · doi:10.1038/s41572-019-0138-4 · Cited by 1,859
Self-citationThe Lancet Commission on the future of care and clinical research in autism
Lord, C., Charman, T., Havdahl, A., Carbone, P., Anagnostou, E., Boyd, B., Carr, T., de Vries, P. J., Dissanayake, C., Divan, G., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(21)01541-5 · Cited by 924
Ruzich, E., Allison, C., Smith, P., Watson, P., Auyeung, B., Ring, H., & Baron-Cohen, S. (2015) · Molecular Autism · doi:10.1186/2040-2392-6-2 · Cited by 610
“While, perhaps due to it being freely available, easy to administer, and widely precedented in the literature, the AQ is used as a screening instrument (such as for patients referred to a diagnostic clinic for a detailed assessment for ASC [93]), it has been argued that the AQ does not have the sensitivity and specifi…”
Hus, V., & Lord, C. (2014) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2080-3 · Cited by 547
“Recent studies have supported the validity of the original Module 4 algorithm (e.g., Brugha et al. 2012).”
Whose Expertise Is It? Evidence for Autistic Adults as Critical Autism Experts
Gillespie-Lynch, K., Kapp, S. K., Brooks, P. J., Pickens, J., & Schwartzman, B. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00438 · Cited by 384
“%) also more frequently indicated that autism is hereditary than non-autistic participants (80%), χ2 = 21.07, p < 0.001; ϕ = 0.18.”
BackgroundInfluential
Metadata
- Authors
- Brugha, T. S., McManus, S., Smith, J., Scott, F. J., Meltzer, H., Purdon, S., Berney, T., Tantam, D., Robinson, J., Radley, J., & Bankart, J.
- Affiliations
- University of Leicester (GB)
- NatCen Social Research (GB)
- Newcastle University (GB)
- University of Sheffield (GB)
- Cambridgeshire and Peterborough NHS Foundation Trust (GB)
- St Andrew's Healthcare (GB)
- Corresponding author
- Brugha, T. S.
- Venue
- Psychological Medicine
- Publisher
- Cambridge University Press (CUP)
- Published
- 2011-07-29
- Volume
- 42
- Issue
- 3
- Pages
- 647-656
- ISSN
- 0033-2917 (ISSN-L)
- 1469-8978
- OpenAlex
- W1982079221
- Cited by
- 78
- References
- 34
- Citations by year
- 2025: 2 · 2024: 7 · 2023: 3 · 2022: 5 · 2021: 9 · 2020: 6 · 2019: 5 · 2018: 7 · 2017: 7 · 2016: 5 · 2015: 8 · 2014: 6 · 2013: 7 · 2012: 1
- FWCI
- 2.27
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- Psychological Medicine (publishedVersion)
- PubMed (publishedVersion)
- Leicester Research Archive (University of Leicester) (submittedVersion)
- Newcastle University ePrints (Newcastle Univesity)
- Funders
- National Institute for Health and Care Research
- University of Leicester
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Autism Spectrum Disorder Research
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- autism spectrum disorder, adults, case finding, diagnostic validity, community prevalence, autism screening, disco, ADI-R, clinician agreement
- MeSH terms
- Adolescent, Adult, Aged, Calibration, Child, Child Development Disorders, Pervasive, Child, Preschool, England, Female, Health Surveys, Humans, Interview, Psychological, Male, Mass Screening, Middle Aged, Surveys and Questionnaires, Sensitivity and Specificity, Reproducibility of Results, Consensus, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.