Methodological Issues in Cross-Syndrome Comparisons: Matching Procedures, Sensitivity ( Se ), and Specificity ( Sp )
The DOI matches its Crossref record.
Abstract
We are impressed with the magnitude and potential importance of the studies presented by Sigman and Ruskin in this monograph. The within-syndrome findings for the children with autism concerning relations between early joint attention and a range of cognitive abilities a full 9 years later provide the strongest evidence so far that early nonverbal communication skills play an important role in the later development of language, intelligence, and social relations with peers. The purpose of the monograph was not limited to within-syndrome research questions, however. Sigman and Ruskin state that a major goal of the research reported in the monograph was to identify specific, unique, and universal deficits for autism and Down syndrome. They base their method of identifying such syndrome characteristics on the group-matching procedure. Given that this procedure is fraught with difficulties, we are concerned that many of Sigman and Ruskin's cross-syndrome comparisons may be incorrect. We do not mean to single out Sigman and Ruskin. The group-matching method is frequently used in special populations research, with the null hypothesis of no differences on the control variable being accepted at dangerously low p values. Our concerns with the group-matching problem extend to much of the extant research that attempts to identify characteristics of individuals based on the performance of their syndrome group relative to a control group. The profiling procedure we outlined seems more fruitful and conceptually satisfying than the traditional matching method. When profiling is not possible, however, it is important to consider the impact of CA confounds and statistical decision procedures used to ensure matching on the control variable, when interpreting syndrome differences on variables of interest.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
An investigation of language impairment in autism: Implications for genetic subgroups
Kjelgaard, M. M., & Tager-Flusberg, H. (2001) · Language and Cognitive Processes · doi:10.1080/01690960042000058 · Cited by 1,130
Behavioral phenotype of individuals with Down syndrome
Chapman, R. S., & Hesketh, L. J. (2000) · Mental Retardation and Developmental Disabilities Research Reviews · doi:10.1002/1098-2779(2000)6:2<84::aid-mrdd2>3.0.co;2-p · Cited by 672
Language development in Down syndrome: From the prelinguistic period to the acquisition of literacy
Abbeduto, L., Warren, S. F., & Conners, F. A. (2007) · Mental Retardation and Developmental Disabilities Research Reviews · doi:10.1002/mrdd.20158 · Cited by 440
Challenges in Evaluating Psychosocial Interventions for Autistic Spectrum Disorders
Lord, C., Wagner, A., Rogers, S., Szatmari, P., Aman, M., Charman, T., Dawson, G., Durand, V. M., Grossman, L., Guthrie, D., et al. (2005) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-005-0017-6 · Cited by 382
Hudry, K., Leadbitter, K., Temple, K., Slonims, V., McConachie, H., Aldred, C., Howlin, P., Charman, T., & the PACT Consortium (2010) · International Journal of Language & Communication Disorders · doi:10.3109/13682820903461493 · Cited by 306
Metadata
- Authors
- Mervis, C. B., & Robinson, B. F.
- Venue
- Monographs of the Society for Research in Child Development
- Publisher
- Oxford University Press (OUP)
- Published
- 1999-03
- Volume
- 64
- Issue
- 1
- Pages
- 115-130
- ISSN
- 0037-976X (ISSN-L)
- 1540-5834
- OpenAlex
- W2134886333
- Cited by
- 71
- References
- 0
- FWCI
- 1.07
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Methodological Issues in Cross-Syndrome Comparisons: Matching Procedures, Sensitivity ( Se ), and Specificity ( Sp ). https://app.cochat.ai/papers/10.1111/1540-5834.00011
- The paper
- Mervis, C. B., & Robinson, B. F. (2003). Methodological Issues in Cross-Syndrome Comparisons: Matching Procedures, Sensitivity ( Se ), and Specificity ( Sp ). Monographs of the Society for Research in Child Development. https://doi.org/10.1111/1540-5834.00011
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.