Outcome measures in intervention trials for adults with autism spectrum disorders; a systematic review of assessments of core autism features and associated emotional and behavioural problems
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
A systematic review was conducted of outcome measures used in treatment trials for older adolescents and adults with autism spectrum disorders (ASDs). Of 818 titles only 30 articles (19 of which involved pharmacological treatments) were identified that met inclusion criteria (sample size > 5; mean age of group > 15 years; mean IQ > 30; ASD diagnosis confirmed; use of objective ASD outcome measures; focus on symptoms core to or typically associated with ASDs). Selected studies included randomized and placebo‐controlled trials, retrospective assessment studies, case series and open label or case‐control trials. Use of outcome measures varied with frequent use of non‐standardized assessments, very little use of measures designed specifically for individuals with ASD or of instruments focusing on core ASD deficits, such as communication or social functioning. Most commonly used were the Clinical Global Impression (CGI) rating scale and the Yale–Brown Obsessive Compulsive Scale (Y‐BOCS). The strengths or deficiencies of the outcome measures used were not systematically evaluated. Although there are now many well controlled treatment trials for children with ASDs, adult intervention research is very limited. The lack of valid and reliable outcome measures for adults with ASDs compromises attempts at treatment evaluation. Copyright © 2015 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., & Clubley, E. (2001) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1005653411471 · Cited by 6,450 · cited 4×
“Assessing the impact of social skills training (Anagnostou et al., 2012), used the “Reading the Mind in the Eyes Test” (Baron-Cohen et al., 2001a); Hillier et al. (2012) used the Index of Peer Relationships (Hudson, 1993) and Golan and Baron-Cohen used the Cambridge Mind-Reading Face Voice Battery (Golan et al., 2006).”
BackgroundMethodInfluentialBaron‐Cohen, S., Wheelwright, S., Hill, J., Raste, Y., & Plumb, I. (2001) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00715 · Cited by 4,555 · cited 6×
“The following search terms were used: ASD, autism (autistic) spectrum (disorder), Asperger(’s) disorder (syndrome), high functioning autism, Autism Spectrum Quotient, or autism screening questionnaire combined with “adult” or “adolescent” combined with “intervention”, “treatment”, “therapy”, “clinical trial” or “scree…”
BackgroundMethodInfluentialBaron-Cohen, S., & Wheelwright, S. (2004) · Journal of Autism and Developmental Disorders · doi:10.1023/b:jadd.0000022607.19833.00 · Cited by 4,093
Robins, L. N. (1988) · Archives of General Psychiatry · doi:10.1001/archpsyc.1988.01800360017003 · Cited by 2,909 · cited 1×
“Secondly, in adult trials in mental disorder, assessment of treatment response often relies on participants’ own descriptions (i.e. self report) of their experiences and emotions (Robins et al., 1988; Wing et al., 1990; Fitzpatrick et al., 1998) rather than observer ratings.”
BackgroundDawson, G., Rogers, S., Munson, J., Smith, M., Winter, J., Greenson, J., Donaldson, A., & Varley, J. (2010) · Pediatrics · doi:10.1542/peds.2009-0958 · Cited by 2,835 · cited 2×
“Moreover, despite the fact that they have been used to assess effectiveness in child-based interventions (e.g. Dawson et al., 2010; Green et al., 2010) they were not constructed to be sensitive to change in response to treatment.”
BackgroundThe Yale-Brown Obsessive Compulsive Scale: II. Validity
Goodman, W. K. (1989) · Archives of General Psychiatry · doi:10.1001/archpsyc.1989.01810110054008 · Cited by 2,799 · cited 1×
“Scale [Y-BOCS (full or modified forms); Goodman et al., 1989].”
MethodSCAN: Schedules fonr Clinical Assessment in Neuropsychiatry
Wing, J. K. (1990) · Archives of General Psychiatry · doi:10.1001/archpsyc.1990.01810180089012 · Cited by 2,517 · cited 2×
“self report) of their experiences and emotions (Robins et al., 1988; Wing et al., 1990; Fitzpatrick et al., 1998) rather than observer ratings.”
BackgroundToward objective classification of childhood autism: Childhood Autism Rating Scale (CARS)
Schopler, E., Reichler, R. J., DeVellis, R. F., & Daly, K. (1980) · Journal of Autism and Developmental Disorders · doi:10.1007/bf02408436 · Cited by 2,432 · cited 6×
“The CARS was the only other specific measure of core ASD used in the studies reviewed.”
BackgroundMethodInfluentialECDEU Assessment Manual: (591322011-001)
Guy, W. (1976) · PsycEXTRA Dataset · doi:10.1037/e591322011-001 · Cited by 1,896
Adult outcome for children with autism
Howlin, P., Goode, S., Hutton, J., & Rutter, M. (2004) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2004.00215.x · Cited by 1,813
Self-citationEvaluating patient-based outcome measures for use in clinical trials.
Fitzpatrick, Davey, Buxton, & Jones (1998) · Health Technology Assessment · doi:10.3310/hta2140 · Cited by 1,715 · cited 2×
“There was little evidence of the use in ASD intervention studies of the low cost self-report methods (Brugha and Meltzer, 2008; Fitzpatrick et al., 1998) that are typically used in intervention trials for psychiatric disorders.”
BackgroundAutism Diagnostic Interview-Revised
Rutter, M., LeCouteur, A., & Lord, C. (2016) · PsycTESTS Dataset · doi:10.1037/t18128-000 · Cited by 1,627
Constantino, J. N., Davis, S. A., Todd, R. D., Schindler, M. K., Gross, M. M., Brophy, S. L., Metzger, L. M., Shoushtari, C. S., Splinter, R., & Reich, W. (2003) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1025014929212 · Cited by 1,611 · cited 7×
“None of the reviewed papers made use of detailed diagnostic interviews (e.g. ADI-R; Le Couteur et al., 2003), DISCO (Diagnostic Interview for Social and Communication Disorders; Wing et Int.”
MethodInfluentialPromoting social behavior with oxytocin in high-functioning autism spectrum disorders.
Andari, E., Duhamel, J.-R., Zalla, T., Herbrecht, E., Leboyer, M., & Sirigu, A. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0910249107 · Cited by 941
Constantino, J. N. (2013) · Encyclopedia of Autism Spectrum Disorders · doi:10.1007/978-1-4419-1698-3_296 · Cited by 908
Epidemiology of Autism Spectrum Disorders in Adults in the Community in England
Brugha, T. S., McManus, S., Bankart, J., Scott, F., Purdon, S., Smith, J., Bebbington, P., Jenkins, R., & Meltzer, H. (2011) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.38 · Cited by 903
Self-citationGreen, J., Charman, T., McConachie, H., Aldred, C., Slonims, V., Howlin, P., Le Couteur, A., Leadbitter, K., Hudry, K., Byford, S., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60587-9 · Cited by 857 · cited 2×
“Moreover, despite the fact that they have been used to assess effectiveness in child-based interventions (e.g. Dawson et al., 2010; Green et al., 2010) they were not constructed to be sensitive to change in response to treatment.”
BackgroundSelf-citationWing, L., Leekam, S. R., Libby, S. J., Gould, J., & Larcombe, M. (2002) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00023 · Cited by 694
Oxytocin Increases Retention of Social Cognition in Autism
Hollander, E., Bartz, J., Chaplin, W., Phillips, A., Sumner, J., Soorya, L., Anagnostou, E., & Wasserman, S. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.05.030 · Cited by 693 · cited 1×
“Thirty articles, describing 29 intervention studies [two articles by Hollander et al. (2003, 2007) involved the same participants] met inclusion criteria.”
BackgroundOxytocin Infusion Reduces Repetitive Behaviors in Adults with Autistic and Asperger's Disorders
Hollander, E., Novotny, S., Hanratty, M., Yaffe, R., DeCaria, C. M., Aronowitz, B. R., & Mosovich, S. (2003) · Neuropsychopharmacology · doi:10.1038/sj.npp.1300021 · Cited by 689 · cited 1×
“Thirty articles, describing 29 intervention studies [two articles by Hollander et al. (2003, 2007) involved the same participants] met inclusion criteria.”
BackgroundGOLAN, O., & BARON-COHEN, S. (2006) · Development and Psychopathology · doi:10.1017/s0954579406060305 · Cited by 645
Adults with Autism Spectrum Disorders
Howlin, P., & Moss, P. (2012) · The Canadian Journal of Psychiatry · doi:10.1177/070674371205700502 · Cited by 559 · cited 2×
“…of ASD treatments need to be developed with some urgency as the lack of standardized adult measures is also reflected /mpr 111 in the paucity of adult intervention research generally (Bishop-Fitzpatrick et al., 2013; Henninger and Taylor, 2013 ; Howlin and Moss, 2012; Shattuck et al., 2012).”
BackgroundSelf-citationSibling Recurrence and the Genetic Epidemiology of Autism
Constantino, J. N., Zhang, Y., Frazier, T., Abbacchi, A. M., & Law, P. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.09101470 · Cited by 481 · cited 2×
“It has been widely used in genetic studies (Constantino et al., 2010) and is increasingly used as a screening measure for ASD in clinical and educational settings (Charman et al., 2007).”
MethodAnagnostou, E., Soorya, L., Chaplin, W., Bartz, J., Halpern, D., Wasserman, S., Wang, A. T., Pepa, L., Tanel, N., Kushki, A., et al. (2012) · Molecular Autism · doi:10.1186/2040-2392-3-16 · Cited by 350
Ritvo, R. A., Ritvo, E. R., Guthrie, D., Ritvo, M. J., Hufnagel, D. H., McMahon, W., Tonge, B., Mataix-Cols, D., Jassi, A., Attwood, T., et al. (2011) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-010-1133-5 · Cited by 344
Golan, O., Baron-Cohen, S., & Hill, J. (2006) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-005-0057-y · Cited by 335
Services for Adults with an Autism Spectrum Disorder
Shattuck, P. T., Roux, A. M., Hudson, L. E., Taylor, J. L., Maenner, M. J., & Trani, J.-F. (2012) · The Canadian Journal of Psychiatry · doi:10.1177/070674371205700503 · Cited by 289
Berk, M., Ng, F., Dodd, S., Callaly, T., Campbell, S., Bernardo, M., & Trauer, T. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2007.00921.x · Cited by 280 · cited 1×
“However, although it has generally good reliability and validity data when used by trained clinicians in adult mental health services, it is a subjective measure and thus open to bias, especially when used by untrained clinicians (Beneke and Rasmus, 1992; Berk et al., 2008).”
BackgroundMindfulness-based therapy in adults with an autism spectrum disorder: a randomized controlled trial
Spek, A. A., van Ham, N. C., & Nyklíček, I. (2013) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2012.08.009 · Cited by 274
Outcomes in adults with autism spectrum disorders: a historical perspective
Henninger, N. A., & Taylor, J. L. (2013) · Autism · doi:10.1177/1362361312441266 · Cited by 267 · cited 1×
“…of ASD treatments need to be developed with some urgency as the lack of standardized adult measures is also reflected /mpr 111 in the paucity of adult intervention research generally (Bishop-Fitzpatrick et al., 2013; Henninger and Taylor, 2013 ; Howlin and Moss, 2012; Shattuck et al., 2012).”
BackgroundEfficacy of three screening instruments in the identification of autistic-spectrum disorders
Charman, T., Baird, G., Simonoff, E., Loucas, T., Chandler, S., Meldrum, D., & Pickles, A. (2007) · British Journal of Psychiatry · doi:10.1192/bjp.bp.107.040196 · Cited by 263
Self-Reported Autism Symptoms in Adults with Autism Spectrum Disorders
Bishop, S. L., & Seltzer, M. M. (2012) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-012-1483-2 · Cited by 123
Faja, S., Webb, S. J., Jones, E., Merkle, K., Kamara, D., Bavaro, J., Aylward, E., & Dawson, G. (2012) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-011-1243-8 · Cited by 89 · cited 1×
“Faja et al. (2008, 2012) used the Benton test of facial recognition (Benton, 1990) and the Wechsler Memory Scales to assess the effectiveness of a face processing training programme.”
MethodBrugha, T. S., McManus, S., Smith, J., Scott, F. J., Meltzer, H., Purdon, S., Berney, T., Tantam, D., Robinson, J., Radley, J., et al. (2012) · Psychological Medicine · doi:10.1017/s0033291711001292 · Cited by 78 · cited 1×
“There are also concerns about its validity (Bishop and Seltzer, 2012; Brugha et al., 2012).”
BackgroundSelf-citationBrief Report: The Use of WAIS-III in Adults with HFA and Asperger Syndrome
Spek, A. A., Scholte, E. M., & van Berckelaer-Onnes, I. A. (2008) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-007-0446-5 · Cited by 71 · cited 1×
“The Positive and Negative Affect Schedule (PANAS) scales (Watson et al., 1998) were used in the Oxytocin trial of Andari et al. (2010) and the Symptom Checklist-90-R (SCL-90-R; Derogatis and Spencer, 1982) in the Spek et al. (2008) trial of modified Mindfulness based therapy.”
MethodShumway, S., Thurm, A., Swedo, S. E., Deprey, L., Barnett, L. A., Amaral, D. G., Rogers, S. J., & Ozonoff, S. (2011) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-011-1203-3 · Cited by 69 · cited 8×
“Me 108 al., 2002), ADOS (Lord et al., 2000), to measure change in ASD, although they were used in some studies to confirm diagnosis.”
MethodInfluential
Cited by
Hollocks, M. J., Lerh, J. W., Magiati, I., Meiser-Stedman, R., & Brugha, T. S. (2019) · Psychological Medicine · doi:10.1017/s0033291718002283 · Cited by 988
Self-citationPredictors of quality of life for autistic adults
Mason, D., McConachie, H., Garland, D., Petrou, A., Rodgers, J., & Parr, J. R. (2018) · Autism Research · doi:10.1002/aur.1965 · Cited by 327
“Autism spectrum disorders (ASD) have been widely researched in children; however, the quantity and quality of adult research, including research with those diagnosed as adults, lags behind research conducted with autistic children [Brugha et al., 2015; Gotham et al., 2015].”
ResultBolognani, F., del Valle Rubido, M., Squassante, L., Wandel, C., Derks, M., Murtagh, L., Sevigny, J., Khwaja, O., Umbricht, D., & Fontoura, P. (2019) · Science Translational Medicine · doi:10.1126/scitranslmed.aat7838 · Cited by 128
“Changes in symptoms are often assessed using scales designed to evaluate ASD severity (8), such as the caregiver-rated Social Responsiveness Scale, 2nd Edition (SRS-2).”
BackgroundMethodSpain, D., & Happé, F. (2020) · Journal of Rational-Emotive & Cognitive-Behavior Therapy · doi:10.1007/s10942-019-00335-1 · Cited by 97
Moore, H. L., Brice, S., Powell, L., Ingham, B., Freeston, M., Parr, J. R., & Rodgers, J. (2022) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-021-05312-1 · Cited by 42
Metadata
- Authors
- Brugha, T. S., Doos, L., Tempier, A., Einfeld, S., & Howlin, P.
- Venue
- International Journal of Methods in Psychiatric Research
- Publisher
- Wiley
- Published
- 2015-06
- Volume
- 24
- Issue
- 2
- Pages
- 99-115
- ISSN
- 1049-8931 (ISSN-L)
- 1557-0657
- OpenAlex
- W2157188736
- Cited by
- 90
- References
- 36
- FWCI
- 0.49
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.