Accuracy of autism screening in a large pediatric network
Abstract
BACKGROUND: Universal screening is recommended to reduce the age of diagnosis for autism spectrum disorder (ASD). However, there are insufficient data on children who screen negative and no study of outcomes from truly universal screening. With this study, we filled these gaps by examining the accuracy of universal screening with systematic follow-up through 4 to 8 years. METHODS: Universal, primary care-based screening was conducted using the Modified Checklist for Autism in Toddlers with Follow-Up (M-CHAT/F) and supported by electronic administration and integration into electronic health records. All children with a well-child visit (1) between 16 and 26 months, (2) at a Children’s Hospital of Philadelphia site after universal electronic screening was initiated, and (3) between January 2011 and July 2015 were included (N = 25 999). RESULTS: Nearly universal screening was achieved (91%), and ASD prevalence was 2.2%. Overall, the M-CHAT/F’s sensitivity was 38.8%, and its positive predictive value (PPV) was 14.6%. Sensitivity was higher in older toddlers and with repeated screenings, whereas PPV was lower in girls. Finally, the M-CHAT/F's specificity and PPV were lower in children of color and those from lower-income households. CONCLUSIONS: Universal screening in primary care is possible when supported by electronic administration. In this “real-world” cohort that was systematically followed, the M-CHAT/F was less accurate in detecting ASD than in previous studies. Disparities in screening rates and accuracy were evident in traditionally underrepresented groups. Future research should focus on the development of new methods that detect a greater proportion of children with ASD and reduce disparities in the screening process.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Patients from minority groups in the United States are screened less often for autism.
“Additionally, patients from minority groups in the United States are screened less often (Carbone et al., 2020; Guthrie et al., 2019; Zuckerman et al., 2013)”
From Navigating the Challenges: A Commentary on Barriers to Autism Screening in Childcare Centers (2026) · cites this paper as Guthrie et al., 2019
Cites
Baio, J., Wiggins, L., Christensen, D. L., Maenner, M. J., Daniels, J., Warren, Z., Kurzius-Spencer, M., Zahorodny, W., Robinson, C., Rosenberg, et al. (2018) · MMWR. Surveillance Summaries · doi:10.15585/mmwr.ss6706a1 · Cited by 6,078 · see citing works
Dawson, G., Rogers, S., Munson, J., Smith, M., Winter, J., Greenson, J., Donaldson, A., & Varley, J. (2010) · Pediatrics · doi:10.1542/peds.2009-0958 · Cited by 2,621 · see citing works
Identification and Evaluation of Children With Autism Spectrum Disorders
Johnson, C. P., Myers, S. M., & and the Council on Children With Disabilities (2007) · Pediatrics · doi:10.1542/peds.2007-2361 · Cited by 2,011 · see citing works
Christensen, D. L., Baio, J., Braun, K. V. N., Bilder, D., Charles, J., Constantino, J. N., Daniels, J., Durkin, M. S., Fitzgerald, R. T., Kurzius-Spencer, M., et al. (2016) · MMWR. Surveillance Summaries · doi:10.15585/mmwr.ss6503a1 · Cited by 1,964 · see citing works
Robins, D. L., Fein, D., Barton, M. L., & Green, J. A. (2001) · Journal of Autism and Developmental Disorders · doi:10.1023/a:1010738829569 · Cited by 1,563 · see citing works
Validation of the Modified Checklist for Autism in Toddlers, Revised With Follow-up (M-CHAT-R/F)
Robins, D. L., Casagrande, K., Barton, M., Chen, C.-M. A., Dumont-Mathieu, T., & Fein, D. (2014) · Pediatrics · doi:10.1542/peds.2013-1813 · Cited by 1,081 · see citing works
A Systematic Review of Early Intensive Intervention for Autism Spectrum Disorders
Warren, Z., McPheeters, M. L., Sathe, N., Foss-Feig, J. H., Glasser, A., & Veenstra-VanderWeele, J. (2011) · Pediatrics · doi:10.1542/peds.2011-0426 · Cited by 790 · see citing works
Race differences in the age at diagnosis among medicaid-eligible children with autism
MANDELL, D. S., LISTERUD, J., LEVY, S. E., & PINTO-MARTIN, J. A. (2002) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200212000-00016 · Cited by 684 · see citing works
Self-citationSurveillance of Vaccination Coverage Among Adult Populations — United States, 2014
Williams, W. W., Lu, P.-J., O’Halloran, A. C., Kim, D. K., Grohskopf, L. A., Pilishvili, T., Skoff, T. H., Nelson, N. P., Harpaz, R., Markowitz, L. E., et al. (2016) · MMWR Surveillance Summaries · doi:10.15585/mmwr.ss6501a1 · Cited by 511 · see citing works
Parent-Implemented Social Intervention for Toddlers With Autism: An RCT
Wetherby, A. M., Guthrie, W., Woods, J. J., Schatschneider, C. W., Holland, R. D., Morgan, L., & Lord, C. (2014) · PEDIATRICS · doi:10.1542/peds.2014-0757 · Cited by 403 · see citing works
Self-citationKleinman, J. M., Robins, D. L., Ventola, P. E., Pandey, J., Boorstein, H., Esser, E. L., Wilson, L. B., ROSENTHAL, M. A., Sutera, S., Verbalis, A. D., et al. (2007) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-007-0450-9 · Cited by 395 · see citing works
Self-citationChristensen, D. L., Maenner, M. J., Bilder, D., Constantino, J. N., Daniels, J., Durkin, M. S., Fitzgerald, R. T., Kurzius-Spencer, M., Pettygrove, S. D., Robinson, C., et al. (2019) · MMWR. Surveillance Summaries · doi:10.15585/mmwr.ss6802a1 · Cited by 344 · see citing works
Malaria Surveillance — United States, 2015
Mace, K. E., Arguin, P. M., & Tan, K. R. (2018) · MMWR Surveillance Summaries · doi:10.15585/mmwr.ss6707a1 · Cited by 279 · see citing works
Siu, A. L., and the US Preventive Services Task Force (USPSTF), Bibbins-Domingo, K., Grossman, D. C., Baumann, L. C., Davidson, K. W., Ebell, M., García, F. A. R., Gillman, M., Herzstein, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.0018 · Cited by 261 · see citing works
Large-Scale Use of the Modified Checklist for Autism in Low-Risk Toddlers
Chlebowski, C., Robins, D. L., Barton, M. L., & Fein, D. (2013) · Pediatrics · doi:10.1542/peds.2012-1525 · Cited by 258 · see citing works
Kuban, K., O’Shea, T. M., Allred, E. N., Tager-Flusberg, H. B., Goldstein, D. J., & Leviton, A. (2009) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2008.10.011 · Cited by 184 · see citing works
Pandey, J., Verbalis, A. D., Robins, D. L., Boorstein, H., Klin, A., Babitz, T., Chawarska, K., Volkmar, F. R., Green, J., Barton, M. L., et al. (2008) · Autism · doi:10.1177/1362361308094503 · Cited by 163 · see citing works
Self-citationAge of Diagnosis Among Medicaid-Enrolled Children With Autism, 2001–2004
Mandell, D. S., Morales, K. H., Xie, M., Lawer, L., Stahmer, A. C., & Marcus, S. C. (2010) · Psychiatric Services · doi:10.1176/ps.2010.61.8.822 · Cited by 155 · see citing works
Identifying Children with Autism Spectrum Disorder at 18 Months in a General Population Sample
Stenberg, N., Bresnahan, M., Gunnes, N., Hirtz, D., Hornig, M., Lie, K. K., Lipkin, W. I., Lord, C., Magnus, P., Reichborn‐Kjennerud, T., et al. (2014) · Paediatric and Perinatal Epidemiology · doi:10.1111/ppe.12114 · Cited by 130 · see citing works
Modified Checklist for Autism in Toddlers: Cross-Cultural Adaptation and Validation in Spain
Canal‐Bedia, R., Primo, P. G., Cilleros, M. V. M., Borbujo, J. S., Fernández, Z. G., Herráez-García, L., Herráez-García, M. D. M., Boada-Muñoz, L., Fuentes-Biggi, J., & de la Paz, M. P. (2010) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-010-1163-z · Cited by 125 · see citing works
Does a claims diagnosis of autism mean a true case?
Burke, J. P., Jain, A., Yang, W., Kelly, J. P., Kaiser, M. Y., Becker, L. K., Shea, L., & Newschaffer, C. J. (2013) · Autism · doi:10.1177/1362361312467709 · Cited by 123 · see citing works
Computer vision analysis captures atypical attention in toddlers with autism
Campbell, K. M., Carpenter, K. L. H., Hashemi, J., Espinosa, S., Marsan, S., Borg, J. S., Chang, Z., Qiu, Q., Vermeer, S., Adler, E. M., et al. (2018) · Autism · doi:10.1177/1362361318766247 · Cited by 102 · see citing works
Guy, A., Seaton, S. E., Boyle, E. M., Draper, E. S., Field, D. J., Manktelow, B. N., Marlow, N., Smith, L. K., & Johnson, S. J. (2014) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2014.10.053 · Cited by 99 · see citing works
Coleman, K. J., Lutsky, M., Yau, V. M., Qian, Y., Pomichowski, M. E., Crawford, P. M., Lynch, F. L., Madden, J. M., Owen‐Smith, A. A., Pearson, J. A., et al. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-015-2358-0 · Cited by 85 · see citing works
Kanne, S. M., Carpenter, L. A., & Warren, Z. E. (2018) · Autism Research · doi:10.1002/aur.1959 · Cited by 63 · see citing works
Luyster, R., Kuban, K., O’Shea, T. M., Paneth, N., Allred, E. N., Leviton, A., & for ELGAN Study investigators (2011) · Paediatric and Perinatal Epidemiology · doi:10.1111/j.1365-3016.2010.01187.x · Cited by 53 · see citing works
Toh, T., Tan, V. W.-Y., Lau, P. S.-T., & Kiyu, A. (2017) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-017-3287-x · Cited by 41 · see citing works
Janvier, Y. M., Coffield, C. N., Harris, J. F., Mandell, D. S., & Cidav, Z. (2018) · Autism · doi:10.1177/1362361318770430 · Cited by 27 · see citing works
Hosmer (1997) · doi:10.1002/(sici)1097-0258(19970515)16:9
Flagged first, then by citations
Cited by
Sorted by citations
The Lancet Commission on the future of care and clinical research in autism
Lord, C., Charman, T., Havdahl, A., Carbone, P., Anagnostou, E., Boyd, B., Carr, T., de Vries, P. J., Dissanayake, C., Divan, G., et al. (2022) · The Lancet · doi:10.1016/s0140-6736(21)01541-5 · Cited by 924 · see citing works
de Leeuw, A., Happé, F., & Hoekstra, R. A. (2020) · Autism Research · doi:10.1002/aur.2276 · Cited by 295 · see citing works
Roman-Urrestarazu, A., van Kessel, R., Allison, C., Matthews, F. E., Brayne, C., & Baron-Cohen, S. (2021) · JAMA Pediatrics · doi:10.1001/jamapediatrics.2021.0054 · Cited by 242 · see citing works
Primary care autism screening and later autism diagnosis
Carbone, P. S., Campbell, K., Wilkes, J., Stoddard, G. J., Huynh, K., Young, P. C., & Gabrielsen, T. P. (2020) · Pediatrics · doi:10.1542/peds.2019-2314 · Cited by 144 · see citing works
Pierce, K., Gazestani, V., Bacon, E., Courchesne, E., Cheng, A., Barnes, C. C., Nalabolu, S., Cha, D., Arias, S., Lopez, L., et al. (2021) · The Journal of Pediatrics · doi:10.1016/j.jpeds.2021.04.041 · Cited by 66 · see citing works
DiGuiseppi, C., Rosenberg, S. A., Tomcho, M. A., Colborn, K., Hightshoe, K., Gutiérrez-Raghunath, S., Cordova, J. M., Dooling-Litfin, J. K., & Rosenberg, C. R. (2021) · Autism · doi:10.1177/1362361320974175 · Cited by 31 · see citing works
Cell Therapies for Autism Spectrum Disorder Based on New Pathophysiology: A Review
Nabetani, M., Mukai, T., & Taguchi, A. (2023) · Cell Transplantation · doi:10.1177/09636897231163217 · Cited by 13 · see citing works
Navigating the Challenges: A Commentary on Barriers to Autism Screening in Childcare Centers
Wieckowski, A. T., Perez Liz, G., McGhee Hassrick, E., Koku, E., Frick, E., Austin, A., & Robins, D. L. (2026) · Behavioral Sciences · doi:10.3390/bs16010079
- Authors
- Guthrie, W., Wallis, K., Bennett, A., Brooks, E., Dudley, J., Gerdes, M., Pandey, J., Levy, S. E., Schultz, R. T., & Miller, J. S.
- Affiliations
- cCenter for Pediatric Clinical Effectiveness,
- Children's Hospital of Philadelphia (US)
- aDivision of Developmental and Behavioral Pediatrics,
- bDepartment of Biomedical and Health Informatics,
- dCenter for Autism Research, and
- University of Pennsylvania (US)
- ORCID
- Venue
- Pediatrics
- Publisher
- American Academy of Pediatrics (AAP)
- Published
- 2019-10-01
- Volume
- 144
- Issue
- 4
- ISSN
- 0031-4005 (ISSN-L)
- 1098-4275
- OpenAlex
- W2975755927
- Semantic Scholar
- 007e563fef9e01228a9914065485bfe9744579ba
- Cited by
- 252
- References
- 29
- Citations by year
- 2026: 24 · 2025: 27 · 2024: 41 · 2023: 41 · 2022: 35 · 2021: 52 · 2020: 30 · 2019: 2
- FWCI
- 17.30
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- PEDIATRICS (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Mental Health (R03MH116356)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Autism Spectrum Disorder Research
- Health Sciences › Medicine › Psychiatry and Mental health › Child Nutrition and Feeding Issues
- Social Sciences › Psychology › Clinical Psychology › Family and Disability Support Research
- Keywords
- autism spectrum disorder, universal screening, screening accuracy, primary care, electronic health records, autism prevalence, sensitivity and positive predictive value, screening disparities, children of color, low-income children, toddlers, well-child visits
- MeSH terms
- Autism Spectrum Disorder, Age Factors, Child, Preschool, Female, Follow-Up Studies, Hospitals, Pediatric, Humans, Infant, Male, Mass Screening, Minority Groups, Pediatrics, Predictive Value of Tests, Sensitivity and Specificity, Sex Factors, Socioeconomic Factors, Philadelphia, Prevalence, Checklist, Electronic Health Records
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review