Construct Validity of the WISC-IV with a Referred Sample: Direct versus Indirect Hierarchical Structures
The DOI matches its Crossref record; 76 of the 77 references it cites were found in a registry or an index.
Abstract
The Wechsler Intelligence Scale for Children-Fourth Edition (WISC-IV) is one of the most frequently used intelligence tests in clinical assessments of children with learning difficulties. Construct validity studies of the WISC-IV have generally supported the higher order structure with four correlated first-order factors and one higher-order general intelligence factor, but recent studies have supported an alternate model in which general intelligence is conceptualized as a breadth factor rather than a superordinate factor (M. W. Watkins, 2010, Structure of the Wechsler Intelligence Scale for Children-Fourth Edition among a national sample of referred students, Psychological Assessment, Vol. 22, pp. 782-787; M. W. Watkins, G. L. Canivez, T. James, K. & R. Good, in press, Construct validity of the WISC-IVUK with a large referred Irish sample, International Journal of School and Educational Psychology). WISC-IV core subtest data obtained from evaluations to assess learning difficulties in 345 children (224 boys, 121 girls) were examined. One through four, first order factor models and indirect versus direct hierarchical models were compared using confirmatory factor analyses. The correlated four-factor Wechsler model provided good fit to these data, but the direct hierarchical model showed statistically significant improvement over the indirect hierarchical model and correlated four-factor model. The direct hierarchical model was judged the best explanation of the WISC-IV factor structure, with the general factor accounting for 71.6% of the common variance while the first order factors accounted for 2.4-10.3% of the common variance. Thus, the results with the present sample of referred children were similar to those from other investigations (G. E. Gignac, 2005, Revisiting the factor structure of the WAIS-R: Insights through nested factor modeling, Assessment, Vol. 12, pp. 320-329; G. E. Gignac, 2006, The WAIS-III as a nested factors model: A useful alternative to the more conventional oblique and higher-order models, Journal of Individual Differences, Vol. 27, pp. 73-86; P. Golay, I. Reverte, J. Rossier, N. Favez, & T. Lecerf, 2012, Further insights on the French WISC-IV factor structure through Bayesian structural equation modeling. Psychological Assessment, advance online publication; M. W. Watkins, 2010, Structure of the Wechsler Intelligence Scale for Children-Fourth Edition among a national sample of referred students, Psychological Assessment, Vol. 22, pp. 782-787; M. W. Watkins, G. L. Canivez, T. James, K. & R. Good, in press, Construct validity of the WISC-IV(UK) with a large referred Irish sample, International Journal of School and Educational Psychology) supporting primary interpretation of the Full Scale IQ rather than the factor index scores.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The WISC-IV and its four index scores demonstrate strong psychometric properties, with excellent validity and high reliability.”
From ADHD Children Take More Time to Inhibit Automatic Responses: A Comparison with Anxiety Disorders Using NEPSY-II (2025) · cites this paper as [68]
In the citing paper
“These findings were as expected and are consistent with existing data involving children in general (Devena et al., 2013; Watkins et al., 2013; Canivez, 2014).”
From Structure of the Wechsler Intelligence Scale for Children – Fourth Edition in a Group of Children with ADHD (2016) · cites this paper as Canivez, 2014
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance
Cheung, G. W., & Rensvold, R. B. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_5 · Cited by 16,280
Hu, L.-T., & Bentler, P. M. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.424 · Cited by 12,298
Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
Chen, F. F. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301834 · Cited by 12,217
Marsh, H. W., Hau, K.-T., & Wen, Z. (2004) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1103_2 · Cited by 6,691 · cited 1×
“…1999) recommended a dual criterion of CFA fit statistic values of .95 for the comparative fit index (CFI) and .06 for the root mean square error of approximation (RMSEA) to guard against both Type I and Type II errors, but Marsh, Hau, and Wen (2004) warned about overgeneralizing these criteria.”
Method"General Intelligence," Objectively Determined and Measured
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412107 · Cited by 6,207
Wechsler Abbreviated Scale of Intelligence
Dumont, R., Willis, J. O., Veizel, K., & Zibulsky, J. (2014) · Encyclopedia of Special Education · doi:10.1002/9781118660584.ese2519 · Cited by 5,521
Measures of multivariate skewness and kurtosis with applications
MARDIA, K. V. (1970) · Biometrika · doi:10.1093/biomet/57.3.519 · Cited by 4,792
Structural Equation Modeling With AMOS: Basic Concepts, Applications, and Programming, Third Edition
Byrne, B. M. (2016) · doi:10.4324/9781315757421 · Cited by 4,653
Human Cognitive Abilities: A Survey of Factor-Analytic Studies
Carroll, J. B. (1993) · doi:10.1017/cbo9780511571312 · Cited by 4,121 · cited 2×
“The structure and content of the WISC-IV reflect current conceptualizations of intelligence articulated by Carroll, Cattell, and Horn (Carroll, 1993, 2003; Cattell & Horn, 1978; Horn, 1991; Horn & Cattell, 1966), and some internal structure studies have examined alternate WISC-IV structural models based on the Cattell…”
BackgroundByrne, B. M. (2013) · doi:10.4324/9780203805534 · Cited by 4,016
Human cognitive abilities a survey of factor-analytic studies
Carroll, J. B. (2004) · Cited by 3,400
The Rediscovery of Bifactor Measurement Models
Reise, S. P. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.715555 · Cited by 2,112 · cited 4×
“Reise (2012) noted several advantages of the direct hierarchical (bifactor) model, including: the general factor having direct influences is easy to interpret, both general and specific influences on indicators (subtests) can be examined simultaneously, and examining the psychometric properties is…”
BackgroundMethodInfluentialHeadstrom, B. R. (1928) · Science · doi:10.1126/science.68.1750.38-a · Cited by 1,814
The Measurement and Appraisal of Adult Intelligence (4th ed.).
Wechsler, D. (1958) · doi:10.1037/11167-000 · Cited by 1,683
Refinement and test of the theory of fluid and crystallized general intelligences.
Horn, J. L., & Cattell, R. B. (1966) · Journal of Educational Psychology · doi:10.1037/h0023816 · Cited by 1,565
Contemporary intellectual assessment: theories, tests, and issues
(1997) · Choice Reviews Online · doi:10.5860/choice.34-5370 · Cited by 1,234
The Development of Hierarchical Factor Solutions
Schmid, J., & Leiman, J. M. (1957) · Psychometrika · doi:10.1007/bf02289209 · Cited by 1,098
The Measurement of Adult Intelligence.
(1940) · Archives of Neurology And Psychiatry · doi:10.1001/archneurpsyc.1940.02280030188021 · Cited by 979
Holzinger, K. J., & Swineford, F. (1937) · Psychometrika · doi:10.1007/bf02287965 · Cited by 756
The Measurement of Adult Intelligence
Anastasi, A., & Wechsler, D. (1942) · The American Journal of Psychology · doi:10.2307/1417140 · Cited by 730
Wechsler Intelligence Scale for Children–Fourth Edition
Dumont, R., Willis, J. O., Veizel, K., & Zibulsky, J. (2014) · Encyclopedia of Special Education · doi:10.1002/9781118660584.ese2522 · Cited by 634
A Tutorial on Hierarchically Structured Constructs
Brunner, M., Nagy, G., & Wilhelm, O. (2012) · Journal of Personality · doi:10.1111/j.1467-6494.2011.00749.x · Cited by 459
(2005) · Cited by 361
Benson, N., Hulac, D. M., & Kranzler, J. H. (2010) · Psychological Assessment · doi:10.1037/a0017767 · Cited by 309
Gorsuch, R. L. (1988) · Handbook of Multivariate Experimental Psychology · doi:10.1007/978-1-4613-0893-5_6 · Cited by 295
Contemporary practice of psychological assessment by clinical psychologists.
Watkins, C. E., Jr., Campbell, V. L., Nieberding, R. J., & Hallmark, R. (1995) · Professional Psychology Research and Practice · doi:10.1037//0735-7028.26.1.54 · Cited by 264
Keith, T. Z., Fine, J. G., Taub, G. E., Reynolds, M. R., & Kranzler, J. H. (2006) · STARS (University of Central Florida) · Cited by 254
Long-term stability of the Wechsler Intelligence Scale for Children—Fourth Edition.
Watkins, M. W., & Smith, L. G. (2013) · Psychological Assessment · doi:10.1037/a0031653 · Cited by 252
A CHECK ON THE THEORY OF FLUID AND CRYSTALLIZED INTELLIGENCE WITH DESCRIPTION OF NEW SUBTEST DESIGNS
CATTELL, R. B., & HORN, J. L. (1978) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1978.tb00065.x · Cited by 249
Stanford-Binet Intelligence Scales, Fifth Edition
(2011) · Encyclopedia of Child Behavior and Development · doi:10.1007/978-0-387-79061-9_6176 · Cited by 249
Analysis of the major intelligence batteries according to a proposed comprehensive Gf-Gc framework.
McGrew, K. S. (1997) · Cited by 235
WISC-IV Clinical Use and Interpretation : Scientist-Practitioner Perspectives
Prifetera, A., & Saklofske, D. (2004) · Cited by 213
The Higher-stratum Structure of Cognitive Abilities
Carroll, J. B. (2003) · The Scientific Study of General Intelligence · doi:10.1016/b978-008043793-4/50036-2 · Cited by 207
Higher-order models versus direct hierarchical models: g as superordinate or breadth factor?
Gignac, G. E. (2008) · UWA Profiles and Research Repository (UWA) · Cited by 169
WAIS-IV and Clinical Validation of the Four- and Five-Factor Interpretative Approaches
Weiss, L. G., Keith, T. Z., Zhu, J., & Chen, H. (2013) · Journal of Psychoeducational Assessment · doi:10.1177/0734282913478030 · Cited by 143
Canivez, G. L., & Watkins, M. W. (2010) · Psychological Assessment · doi:10.1037/a0020429 · Cited by 143
Self-citationCurrent Test Usage by Practicing School Psychologists: A National Survey
Stinnett, T. A., Havey, J. M., & Oehler-Stinnett, J. (1994) · Journal of Psychoeducational Assessment · doi:10.1177/073428299401200403 · Cited by 140
The practice of psychological assessment among school psychologists.
Goh, D. S., Teslow, J., & Fuller, G. B. (1981) · Professional Psychology · doi:10.1037/0735-7028.12.6.696 · Cited by 134
Assessment Practices of School Psychologists: Ten Years Later
Hutton, J. B., Dubes, R., & Muir, S. (1992) · School Psychology Review · doi:10.1080/02796015.1992.12085614 · Cited by 132
Canivez, G. L., Konold, T. R., Collins, J. M., & Wilson, G. (2009) · School Psychology Quarterly · doi:10.1037/a0018030 · Cited by 131 · cited 3×
“Other intelligence tests also have larger portions of subtest variance associated with a higher order general factor than their first order factors, including the Stanford–Binet Intelligence Scales, Fifth Edition (SB-5; Roid, 2003; Canivez, 2008), Wechsler Abbreviated Scales of Intelligence (WASI; Wechsler, 1999), Wid…”
Self-citationGolay, P., & Lecerf, T. (2011) · Psychological Assessment · doi:10.1037/a0021230 · Cited by 126
SB5: Stanford-Binet Intelligence Scales, Fifth Edition
Roid, G. H., & Pomplun, M. R. (2012) · edoc (University of Basel) · Cited by 124
On Methodology in the Study of Cognitive Abilities
Carroll, J. B. (1995) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3003_6 · Cited by 112
Elliott, R. (2004) · Archives of Clinical Neuropsychology · doi:10.1016/j.acn.2003.10.001 · Cited by 109
Orthogonal higher order structure of the Wechsler Intelligence Scale for Children--Fourth edition.
Watkins, M. W. (2006) · Psychological Assessment · doi:10.1037/1040-3590.18.1.123 · Cited by 101
Watkins, M. W. (2010) · Psychological Assessment · doi:10.1037/a0020043 · Cited by 99 · cited 18×
“…verbal, perceptual, working memory, and processing speed factors (see Figure 1); (e) an indirect hierarchical model (as per Bodin et al., 2009), with four first-order factors (see Figure 2); and (f) a direct hierarchical model (as per Watkins, 2010), with four first-order factors (see Figure 3).”
BackgroundMethodResultInfluentialGolay, P., Reverte, I., Rossier, J., Favez, N., & Lecerf, T. (2013) · Psychological Assessment · doi:10.1037/a0030676 · Cited by 94
Watkins, M. W., Wilson, S. M., Kotz, K. M., Carbone, M. C., & Babula, T. (2006) · Educational and Psychological Measurement · doi:10.1177/0013164406288168 · Cited by 94
Essentials of WISC-III and WPPSI-R Assessment
Kaufman, A. S., & Lichtenberger, E. O. (2000) · Medical Entomology and Zoology · Cited by 91
Higher order factor structure of the WISC-IV in a clinical neuropsychological sample.
Bodin, D., Pardini, D. A., Burns, T. G., & Stevens, A. B. (2009) · Child Neuropsychology · doi:10.1080/09297040802603661 · Cited by 87 · cited 5×
“This has been observed in the WISC-IV (Bodin et al., 2009; Watkins, 2006; Watkins et al., in press; Watkins et al., 2006), French WISC-IV (Golay et al., Table 3 Sources of Variance in the WISC-IV for the Referred Sample (N 345) According to a Direct”
BackgroundMethodResultInfluential(2006) · Cited by 77
Gignac, G. E. (2006) · Journal of Individual Differences · doi:10.1027/1614-0001.27.2.73 · Cited by 76
Chen, H., Keith, T. Z., Weiss, L. G., Zhu, J., & Li, Y. (2010) · Personality and Individual Differences · doi:10.1016/j.paid.2010.06.004 · Cited by 74
Canivez, G. L. (2008) · School Psychology Quarterly · doi:10.1037/a0012884 · Cited by 74
Self-citationThe practitioner's view of IQ testing and profile analysis.
Pfeiffer, S. I., Reddy, L. A., Kletzel, J. E., Schmelzer, E. R., & Boyer, L. M. (2000) · School Psychology Quarterly · doi:10.1037/h0088795 · Cited by 72
Canivez, G. L., & Kush, J. C. (2013) · Journal of Psychoeducational Assessment · doi:10.1177/0734282913478036 · Cited by 69
Self-citationPsychometric Versus Actuarial Interpretation of Intelligence and Related Aptitude Batteries
Canivez, G. L. (2013) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199796304.013.0004 · Cited by 67
Self-citationDombrowski, S. C., Watkins, M. W., & Brogan, M. J. (2009) · Journal of Psychoeducational Assessment · doi:10.1177/0734282909333179 · Cited by 65
Revisiting the Factor Structure of the WAIS-R: Insights Through Nested Factor Modeling
Gignac, G. E. (2005) · Assessment · doi:10.1177/1073191105278118 · Cited by 65
Canivez, G. L., & Watkins, M. W. (2010) · School Psychology Quarterly · doi:10.1037/a0022046 · Cited by 63
Self-citationDombrowski, S. C., & Watkins, M. W. (2013) · Psychological Assessment · doi:10.1037/a0031335 · Cited by 62
Current status of doctoral‐level training in psychological testing
Belter, R. W., & Piotrowski, C. (2001) · Journal of Clinical Psychology · doi:10.1002/jclp.1044 · Cited by 59
Nelson, J. M., Canivez, G. L., Lindstrom, W. A., & Hatt, C. V. (2007) · Journal of School Psychology · doi:10.1016/j.jsp.2007.03.003 · Cited by 59
Self-citationNelson, J. M., & Canivez, G. L. (2012) · Psychological Assessment · doi:10.1037/a0024878 · Cited by 56
Self-citationNiileksela, C. R., Reynolds, M. R., & Kaufman, A. S. (2013) · Psychological Assessment · doi:10.1037/a0031175 · Cited by 55
The Course on Individual Cognitive Assessment
Alfonso, V. C., LaRocca, R., Oakland, T. D., & Spanakos, A. (2000) · School Psychology Review · doi:10.1080/02796015.2000.12085997 · Cited by 49
A Cross-Cultural Analysis of the WISC-III
Georgas, J. G., van de Vijver, F. J. R., Weiss, L. G., & Saklofske, D. H. (2003) · Elsevier eBooks · doi:10.1016/b978-012280055-9/50021-7 · Cited by 47
Measurement Invariance of WISC-IV across Normative and Clinical Samples
Chen, H., & Zhu, J. (2012) · Personality and Individual Differences · doi:10.1016/j.paid.2011.10.006 · Cited by 46
Construct Validity of the WISC–IVUKWith a Large Referred Irish Sample
Watkins, M. W., Canivez, G. L., James, T., James, K., & Good, R. (2013) · International Journal of School & Educational Psychology · doi:10.1080/21683603.2013.794439 · Cited by 43
Self-citationCanivez, G. L. (2011) · School Psychology Quarterly · doi:10.1037/a0025973 · Cited by 40
Self-citationCanivez, G. L., Watkins, M. W., James, T., Good, R., & James, K. (2014) · British Journal of Educational Psychology · doi:10.1111/bjep.12056 · Cited by 38
Self-citationLecerf, T., Rossier, J., Favez, N., Reverte, I., & Coleaux, L. (2010) · Swiss Journal of Psychology · doi:10.1024/1421-0185/a000026 · Cited by 37
Interpreting the WISC-IV Index Scores
Weiss, L. G., Prifitera, A., & Saklofske, D. H. (2005) · Elsevier eBooks · doi:10.1016/b978-012564931-5/50004-9 · Cited by 26
Cross-Cultural Analysis of the WISC-III
van de Vijver, F. J. R. (2004) · PsycEXTRA Dataset · doi:10.1037/e633152007-001 · Cited by 8
(2005)
Cited by
Karr, J. E., Areshenkoff, C. N., Rast, P., Hofer, S. M., Iverson, G. L., & Garcia-Barrera, M. A. (2018) · Psychological Bulletin · doi:10.1037/bul0000160 · Cited by 637
“loadings were freely estimated for all models, with one exception: models with only two indicators on any specific factor in the bifactor or nested factor models had the loadings for those indicators set to be equal for purposes of model identification, as done by previous researchers (Canivez, 2014; Watkins, 2010).”
Gignac, G. E. (2015) · Intelligence · doi:10.1016/j.intell.2015.07.006 · Cited by 117
Canivez, G. L., Watkins, M. W., & Dombrowski, S. C. (2016) · Psychological Assessment · doi:10.1037/pas0000238 · Cited by 113
Self-citationCanivez, G. L., Watkins, M. W., & Dombrowski, S. C. (2017) · Psychological Assessment · doi:10.1037/pas0000358 · Cited by 106
Self-citationDombrowski, S. C., Canivez, G. L., Watkins, M. W., & Alexander Beaujean, A. (2015) · Intelligence · doi:10.1016/j.intell.2015.10.009 · Cited by 105
Self-citation
Metadata
- Authors
- Canivez, G. L.
- Affiliations
- Eastern Illinois University (US)
- Corresponding author
- Canivez, Gary L.
- ORCID
- Canivez, Gary L.
- Venue
- School Psychology Quarterly
- Published
- 2014-03
- Volume
- 29
- Issue
- 1
- Pages
- 38-51
- ISSN
- 1045-3830 (ISSN-L)
- 1939-1560
- OpenAlex
- W2133587264
- Cited by
- 87
- References
- 77
- Citations by year
- 2026: 3 · 2025: 2 · 2024: 2 · 2023: 1 · 2022: 4 · 2021: 6 · 2020: 9 · 2019: 5 · 2018: 11 · 2017: 17 · 2016: 15 · 2015: 8 · 2014: 3
- FWCI
- 12.17
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- School Psychology Quarterly (publishedVersion)
- PubMed (publishedVersion)
- The Keep (Eastern Illinois University) (submittedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Cognitive Abilities and Testing
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Neuropsychology and Physiological Psychology › Developmental and Educational Neuropsychology
- Keywords
- WISC-IV, construct validity, factor structure, hierarchical models, general intelligence factor, referred children, learning difficulties, intelligence testing, children with learning difficulties, factor loadings
- MeSH terms
- Adolescent, Bayes Theorem, Child, Factor Analysis, Statistical, Female, Humans, Intelligence, Learning Disabilities, Male, Psychometrics, Wechsler Scales, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.