Autism and epistemology III: child development, behavioral stability, and reliability of measurement
Abstract
Early diagnosis and treatment of autism increases the likelihood that symptoms associated with the disorder can be alleviated. However, the behaviors of both typically and atypically developing young infants and toddlers are quite variable and often change as these children age. Studies have shown that this is the case for same‐aged children who are diagnosed with autistic disorder (AD) or other Pervasive Developmental Disabilities (PDDs). Therefore, an early accurate assessment of AD or PDD may be problematic. Moreover, instruments used to make the diagnosis may not be as reliable as desired. Statistics employed to evaluate diagnostic accuracy and behavioral stability of instruments' or clinicians' assessments suggest that their diagnoses have been only moderately successful. In addition, the statistics themselves have limitations that would suggest that the measures of diagnostic accuracy and behavioral stability implemented may not be as effective as they would seem. A resolution to these problems is proposed. © 2012 Wiley Periodicals, Inc.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Fisch showed that the rising prevalence of autism is related to the use of different diagnostic criteria.
“However, Fisch (19, 20) showed clearly that this rising prevalence is related to the use of different diagnostic criteria.”
From Gene × Environment Interactions in Autism Spectrum Disorders: Role of Epigenetic Mechanisms (2014) · cites this paper as [20]
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · see citing works
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398 · see citing works
Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR)
American Psychiatric Association (2000) · doi:10.1176/appi.books.9780890423349 · Cited by 11,069 · see citing works
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736 · see citing works
High agreement but low Kappa: I. the problems of two paradoxes
Feinstein, A. R., & Cicchetti, D. V. (1990) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(90)90158-l · Cited by 3,034 · see citing works
Investigations of Temperament at Three to Seven Years: The Children's Behavior Questionnaire
Rothbart, M. K., Ahadi, S. A., Hershey, K. L., & Fisher, P. A. (2001) · Child Development · doi:10.1111/1467-8624.00355 · Cited by 2,424 · see citing works
Use and Misuse of the Receiver Operating Characteristic Curve in Risk Prediction
Cook, N. R. (2007) · Circulation · doi:10.1161/circulationaha.106.672402 · Cited by 2,123 · see citing works
High agreement but low kappa: II. Resolving the paradoxes
Cicchetti, D. V., & Feinstein, A. R. (1990) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(90)90159-m · Cited by 1,838 · see citing works
Coefficient Kappa: Some Uses, Misuses, and Alternatives
Brennan, R. L., & Prediger, D. J. (1981) · Educational and Psychological Measurement · doi:10.1177/001316448104100307 · Cited by 1,590 · see citing works
Robins, D. L., Fein, D., Barton, M. L., & Green, J. A. (2001) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1010738829569 · Cited by 1,563 · see citing works
Large sample standard errors of kappa and weighted kappa.
Fleiss, J. L., Cohen, J., & Everitt, B. S. (1969) · Psychological Bulletin · doi:10.1037/h0028106 · Cited by 1,542 · see citing works
Manual for the Bayley Scales of Infant Development
Bayley, N. (1969) · Medical Entomology and Zoology · Cited by 1,328 · see citing works
Measurement reliability and agreement in psychiatry
Shrout, P. E. (1998) · Statistical Methods in Medical Research · doi:10.1177/096228029800700306 · Cited by 1,211 · see citing works
Autism From 2 to 9 Years of Age
Lord, C., Risi, S., DiLavore, P. S., Shulman, C., Thurm, A., & Pickles, A. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.6.694 · Cited by 973 · see citing works
Interrater reliability and agreement of subjective judgments.
Tinsley, H. E. A., & Weiss, D. J. (1975) · Journal of Counseling Psychology · doi:10.1037/h0076640 · Cited by 855 · see citing works
Misinterpretation and misuse of the kappa statistic
MACLURE, M., & WILLETT, W. C. (1987) · American Journal of Epidemiology · doi:10.1093/aje/126.2.161 · Cited by 808 · see citing works
A Screening Instrument for Autism at 18 Months of Age: A 6-Year Follow-up Study
BAIRD, G., CHARMAN, T., BARON-COHEN, S., COX, A., SWETTENHAM, J., WHEELWRIGHT, S., & DREW, A. (2000) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200006000-00007 · Cited by 804 · see citing works
The role of early fine and gross motor development on later motor and cognitive ability
Piek, J. P., Dawson, L., Smith, L. M., & Gasson, N. (2008) · Human Movement Science · doi:10.1016/j.humov.2007.11.002 · Cited by 731 · see citing works
Follow‐Up of Two‐Year‐Olds Referred for Possible Autism
Lord, C. (1995) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1995.tb01669.x · Cited by 645 · see citing works
Shattuck, P. T., Seltzer, M. M., Greenberg, J. S., Orsmond, G. I., Bolt, D. M., Kring, S. R., Lounds, J. J., & Lord, C. (2006) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-006-0307-7 · Cited by 558 · see citing works
Charman, T., Taylor, E., Drew, A., Cockerill, H., Brown, J., & Baird, G. (2005) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2004.00377.x · Cited by 469 · see citing works
Linden, A. (2006) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2005.00598.x · Cited by 449 · see citing works
Mitchell, S. K. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.376 · Cited by 445 · see citing works
Autism Spectrum Disorders at 20 and 42 Months of Age: Stability of Clinical and ADI-R Diagnosis
Cox, A., Klein, K., Charman, T., Baird, G., Baron‐Cohen, S., Swettenham, J., Drew, A., & Wheelwright, S. J. (1999) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00488 · Cited by 429 · see citing works
Can Autism Be Diagnosed Accurately in Children Under 3 Years?
Stone, W. L., Lee, E. B., Ashford, L., Brissie, J. S., Hepburn, S., Coonrod, E. E., & Weiss, B. (1999) · Journal of Child Psychology and Psychiatry · doi:10.1111/1469-7610.00435 · Cited by 428 · see citing works
Autism spectrum disorder in the second year: stability and change in syndrome expression
Chawarska, K., Klin, A., Paul, R., & Volkmar, F. (2007) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2006.01685.x · Cited by 384 · see citing works
ARTIFACT, BIAS, AND COMPLEXITY OF ASSESSMENT: THE ABCs OF RELIABILITY
Kazdin, A. E. (1977) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1977.10-141 · Cited by 368 · see citing works
What are infant siblings teaching us about autism in infancy?
Rogers, S. J. (2009) · Autism Research · doi:10.1002/aur.81 · Cited by 351 · see citing works
Using the Childhood Autism Rating Scale to Diagnose Autism Spectrum Disorders
Chlebowski, C., Green, J. A., Barton, M. L., & FEIN, D. A. (2010) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-009-0926-x · Cited by 341 · see citing works
Assessing Inter-Rater Reliability for Rating Scales: Resolving some Basic Issues
Cicchetti, D. V. (1976) · The British Journal of Psychiatry · doi:10.1192/bjp.129.5.452 · Cited by 322 · see citing works
Diagnostic Stability in Very Young Children with Autism Spectrum Disorders
Kleinman, J. M., Ventola, P. E., Pandey, J., Verbalis, A. D., Barton, M., Hodgson, S., Green, J., Dumont-Mathieu, T., Robins, D. L., & Fein, D. (2008) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-007-0427-8 · Cited by 272 · see citing works
How Well Does Early Diagnosis of Autism Stand the Test of Time?
Moore, V., & Goodson, S. (2003) · Autism · doi:10.1177/1362361303007001005 · Cited by 241 · see citing works
Autism Under Age 3 Years: A Clinical Study of 28 Cases Referred for Autistic Symptoms in Infancy
Gillberg, C., Ehlers, S., Schaumann, H., Jakobsson, G., Dahlgren, S. O., Lindblom, R., Bågenholm, A., Tjuus, T., & Blidner, E. (1990) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1990.tb00834.x · Cited by 240 · see citing works
A prospective study of toddlers with ASD: short‐term diagnostic and cognitive outcomes
Chawarska, K., Klin, A., Paul, R., Macari, S. L., & Volkmar, F. R. (2009) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2009.02101.x · Cited by 233 · see citing works
The First Five Years of Life. A Guide to the Study of the Pre-School Child
Koshuk, R. P., & Gesell, A. (1941) · Marriage and Family Living · doi:10.2307/346931 · Cited by 199 · see citing works
One statistical test is sufficient for assessing new predictive markers
Vickers, A. J., Cronin, A. M., & Begg, C. B. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-13 · Cited by 198 · see citing works
The Very Early Identification of Autism: Outcome to Age 41/2–5
Eaves, L. C., & Ho, H. H. (2004) · Journal of Autism and Developmental Disorders · doi:10.1023/b:jadd.0000037414.33270.a8 · Cited by 197 · see citing works
Variability in outcome for children with an ASD diagnosis at age 2
Turner, L. M., & Stone, W. L. (2007) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2007.01744.x · Cited by 191 · see citing works
A Cognitive Approach to the Development of Early Language
Rose, S. A., Feldman, J. F., & Jankowski, J. J. (2009) · Child Development · doi:10.1111/j.1467-8624.2008.01250.x · Cited by 189 · see citing works
Matson, J. L., Boisjoli, J. A., Hess, J. A., & Wilkins, J. W. (2010) · Developmental Neurorehabilitation · doi:10.3109/17518420903213576 · Cited by 159 · see citing works
Matson, J. L., Wilkins, J. W., Sharp, B., Knight, C., Sevin, J. A., & Boisjoli, J. A. (2009) · Research in Autism · doi:10.1016/j.rasd.2009.04.001 · Cited by 159 · see citing works
Ventola, P. E., Kleinman, J. M., Pandey, J., Wilson, L. B., Esser, E. L., Boorstein, H., Dumont-Mathieu, T. M., Marshia, G., Barton, M. L., Hodgson, S., et al. (2006) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-006-0177-z · Cited by 150 · see citing works
Kappa coefficients in epidemiology: An appraisal of a reappraisal
KRAEMER, H. C., & Bloch, D. A. (1988) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(88)90032-7 · Cited by 108 · see citing works
Starr, E. M., Szatmári, P., Bryson, S. E., & Zwaigenbaum, L. (2003) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1022222202970 · Cited by 94 · see citing works
The Validity of the Baby and Infant Screen for Children with aUtIsm Traits: Part 1 (BISCUIT: Part 1)
Matson, J. L., Wilkins, J. W., & Fodstad, J. C. (2010) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-010-0973-3 · Cited by 87 · see citing works
van Daalen, E., Kemner, C., Dietz, C., Willemsen‐Swinkels, S. H. N., Buitelaar, J. K., & van Engeland, H. (2009) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-009-0025-8 · Cited by 83 · see citing works
Stability of Initial Autism Spectrum Disorder Diagnoses in Community Settings
Daniels, A. M., Rosenberg, R. E., Law, J. K., Lord, C., Kaufmann, W. E., & Law, P. A. (2010) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-010-1031-x · Cited by 73 · see citing works
Developmental Diagnosis—Normal and Abnormal Child Development
Bolt, R. A. (1942) · American Journal of Public Health and the Nations Health · doi:10.2105/ajph.32.6.657-b · Cited by 71 · see citing works
A longitudinal study of temperament and its correlates in the first 12 months
Peters-Martin, P., & Wachs, T. D. (1984) · Infant Behavior and Development · doi:10.1016/s0163-6383(84)80044-2 · Cited by 70 · see citing works
Outcome of young children with autism
Darrou, C., Pry, R., Pernon, É., Michelon, C., Aussilloux, C., & Baghdadli, A. (2010) · Autism · doi:10.1177/1362361310374156 · Cited by 68 · see citing works
Commentary: The Modified Checklist for Autism in Toddlers
Charman, T., Baron‐Cohen, S., Baird, G., Cox, A., Wheelwright, S. J., Swettenham, J., & Drew, A. (2001) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1010790813639 · Cited by 61 · see citing works
Intellectual Disabilities and Autism Spectrum Disorder: A Cautionary Note
Dykens, E. M., & Lense, M. (2011) · Oxford University Press eBooks · doi:10.1093/med/9780195371826.003.0018 · Cited by 60 · see citing works
Gaddis, G., & Gaddis, M. L. (1990) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(05)82198-5 · Cited by 58 · see citing works
Gray, K. M., Tonge, B. J., Sweeney, D. J., & Einfeld, S. (2007) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-007-0473-2 · Cited by 57 · see citing works
Moss, J. F., Magiati, I., Charman, T., & Howlin, P. (2007) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-007-0487-9 · Cited by 51 · see citing works
Soke, G. N., Philofsky, A., DiGuiseppi, C. G., Lezotte, D. C., Rogers, S. J., & Hepburn, S. (2011) · Autism · doi:10.1177/1362361309358332 · Cited by 50 · see citing works
Individual stability in dimensions of infant behavior
Hageküll, B., & Bohlin, G. (1981) · Infant Behavior and Development · doi:10.1016/s0163-6383(81)80012-4 · Cited by 49 · see citing works
Yama, B. A., Freeman, T., Graves, E., Yuan, S., & Campbell, M. K. (2011) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-011-1211-3 · Cited by 48 · see citing works
Predictive validity of Bayley scale in language development of children at 6–36 months
Lung, F., Shu, B., Chiang, T., Chen, P., & Lin, L. (2009) · Pediatrics International · doi:10.1111/j.1442-200x.2009.02844.x · Cited by 38 · see citing works
Weighted Chi Square: an Extension of the Kappa Method
Cohen, J. (1972) · Educational and Psychological Measurement · doi:10.1177/001316447203200106 · Cited by 38 · see citing works
Worley, J. A., Matson, J. L., Mahan, S., Kozlowski, A. M., & Neal, D. (2011) · Developmental Neurorehabilitation · doi:10.3109/17518423.2010.530638 · Cited by 35 · see citing works
Matson, J. L., Fodstad, J. C., & Dempsey, T. (2009) · Developmental Neurorehabilitation · doi:10.3109/17518420903029501 · Cited by 30 · see citing works
Michelotti, J., Charman, T., Slonims, V., et al. (2002) · Developmental Medicine & Child Neurology · doi:10.1111/j.1469-8749.2002.tb00771.x · Cited by 27 · see citing works
From Toddlers to Adults: The Changing Landscape of the Brain in Autism
Courchesne, E., Webb, S. J., & Schumann, C. M. (2011) · Oxford University Press eBooks · doi:10.1093/med/9780195371826.003.0040 · Cited by 26 · see citing works
de Moura, D. R., da Costa, J. C., Santos, I. S., Barros, A. J. D., Matijasevich, A., Halpern, R., Dumith, S. C., Karam, S. D. M., & Barros, F. C. (2010) · Journal of Paediatrics and Child Health · doi:10.1111/j.1440-1754.2010.01717.x · Cited by 23 · see citing works
Kolling, T., Goertz, C., Frahsek, S., et al. (2010) · Infant Behavior and Development · doi:10.1016/j.infbeh.2009.12.007 · Cited by 18 · see citing works
Autism as a Developmental Neurobiological Disorder: New Insights from Functional Neuroimaging
Minshew, N. J., Scherf, K. S., Behrmann, M., et al. (2011) · Oxford University Press eBooks · doi:10.1093/med/9780195371826.003.0041 · Cited by 5 · see citing works
Hosmer (1997) · doi:10.1002/(sici)1097-0258(19970515)16:9
Flagged first, then by citations
Cited by
Sorted by citations
Ozonoff, S., Young, G. S., Landa, R. J., Brian, J., Bryson, S., Charman, T., Chawarska, K., Macari, S. L., Messinger, D., Stone, W. L., et al. (2015) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12421 · Cited by 377 · see citing works
Gene × Environment Interactions in Autism Spectrum Disorders: Role of Epigenetic Mechanisms
Tordjman, S., Somogyi, E., Coulon, N., Kermarrec, S., Cohen, D., Bronsard, G., Bonnot, O., Weismann-Arcache, C., Botbol, M., Lauth, B., et al. (2014) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2014.00053 · Cited by 283 · see citing works
Nosology and epidemiology in autism: classification counts
Fisch, G. S. (2012) · American Journal of Medical Genetics Part C: Seminars in Medical Genetics · doi:10.1002/ajmg.c.31325 · Cited by 51 · see citing works
Self-citation
- Authors
- Fisch, G. S.
- Affiliations
- Yeshiva University (US)
- Corresponding author
- Fisch, Gene S.
- ORCID
- Fisch, Gene S.
- Venue
- American Journal of Medical Genetics Part A
- Publisher
- Wiley
- Published
- 2012-04-09
- Volume
- 158A
- Issue
- 5
- Pages
- 969-979
- ISSN
- 1552-4825 (ISSN-L)
- 1552-4833
- OpenAlex
- W1965207064
- Cited by
- 13
- References
- 68
- Citations by year
- 2020: 1 · 2019: 1 · 2018: 1 · 2017: 1 · 2015: 2 · 2014: 2 · 2013: 3 · 2012: 2
- FWCI
- 1.47
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Medical Genetics Part A (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Autism Spectrum Disorder Research
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Health Sciences › Medicine › Psychiatry and Mental health › Child Nutrition and Feeding Issues
- Keywords
- autism spectrum disorder, pervasive developmental disorders, early diagnosis, diagnostic accuracy, behavioral stability, measurement reliability, child development, assessment instruments, infants and toddlers
- MeSH terms
- Autistic Disorder, Child, Child Behavior, Child Development, Child Development Disorders, Pervasive, Humans, Reproducibility of Results, Early Diagnosis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
