A systematic review of evidence for the psychometric properties of the Strengths and Difficulties Questionnaire
Open accessThe DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Abstract
This article synthesized evidence for the validity and reliability of the Strengths and Difficulties Questionnaire in children aged 3–5 years. A systematic review using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement guidelines was carried out. Study quality was rated using the Consensus-based Standards for the Selection of Health Measurement Instruments. In total, 41 studies were included (56 manuscripts). Two studies examined content and cultural validity, revealing issues with some questions. Six studies discussed language validations with changes to some wording recommended. There was good evidence for discriminative validity (Area Under the Curve ≥ 0.80), convergent validity (weighted average correlation coefficients ≥ 0.50, except for the Prosocial scale), and the 5-factor structural validity. There was limited support for discriminant validity. Sensitivity was below 70% and specificity above 70% in most studies that examined this. Internal consistency of the total difficulty scale was good (weighted average Chronbach’s alpha parents’ and teachers’ version 0.79 and 0.82) but weaker for other subscales (weighted average parents’ and teachers’ range 0.49–0.69 and 0.69–0.83). Inter-rater reliability between parents was moderate (correlation coefficients range 0.42–0.64) and between teachers strong (range 0.59–0.81). Cross-informant consistency was weak to moderate (weighted average correlation coefficients range 0.25–0.45). Test-retest reliability was mostly inadequate. In conclusion, the lack of evidence for cultural validity, criterion validity and test-retest reliability should be addressed given wide-spread implementation of the tool in routine clinical practice. The moderate level of consistency between different informants indicate that an assessment of a pre-schooler should not rely on a single informant.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
The Strengths and Difficulties Questionnaire: A research note
Goodman, R. (1997) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1997.tb01545.x · Cited by 14,908
Guidelines for the process of cross-cultural adaptation of self-report measures
Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000) · Spine · doi:10.1097/00007632-200012150-00014 · Cited by 14,542
Quality criteria were proposed for measurement properties of health status questionnaires
Terwee, C. B., Bot, S. D. M., de Boer, M. R., van der Windt, D. A. W. M., Knol, D. L., Dekker, J., Bouter, L. M., & de Vet, H. C. W. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.03.012 · Cited by 10,764 · cited 1×
“…for each psychometric property were acceptable, we used the following criteria (Dancey & Reidy, 2007; Hu & Bentler, 1999; Streiner & Norman, 2008; Terwee et al., 2007): Cronbach’s alpha ≥ 0.7 (for group use) and ≥ 0.85 (for use with individuals); Intraclass Correlation Coefficient (ICC) ≥ 0.70;…”
MethodInfluentialLiberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349
Psychometric properties of the strengths and difficulties questionnaire
GOODMAN, R. (2001) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200111000-00015 · Cited by 6,813
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.2.213 · Cited by 5,436
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. W. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.02.006 · Cited by 4,465 · cited 4×
“Definitions used of measurement properties (R. Goodman, 1997; Mokkink et al., 2010; Streiner & Norman, 2008, pp. 261–263).”
BackgroundMethodResultInfluentialGoodman, R., Meltzer, H., & Bailey, V. (1998) · European Child & Adolescent Psychiatry · doi:10.1007/s007870050057 · Cited by 2,238
Kim-Cohen, J., Caspi, A., Moffitt, T. E., Harrington, H., Milne, B. J., & Poulton, R. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.7.709 · Cited by 2,025
Terwee, C. B., Mokkink, L. B., Knol, D. L., Ostelo, R. W. J. G., Bouter, L. M., & de Vet, H. C. W. (2012) · Quality of Life Research · doi:10.1007/s11136-011-9960-1 · Cited by 1,978 · cited 2×
“It is possible that we identified a larger number of study limitations of studies than others have (Stone et al., 2010) as the COSMIN tool is relatively new (Mokkink et al., 2010; Terwee et al., 2012).”
MethodResultGoodman, A., Lamping, D. L., & Ploubidis, G. B. (2010) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-010-9434-x · Cited by 1,570
Goodman, R., & Scott, S. (1999) · Journal of Abnormal Child Psychology · doi:10.1023/a:1022658222914 · Cited by 1,420 · cited 1×
“…file A (Becker et al., 2004; Birkás et al., 2008; Downs, Strand, Heinrichs, & Cerna, 2012; Du et al., 2008; Ezpeleta et al., 2012; R. Goodman, 1997; R. Goodman & Scott, 1999; Hawes & Dadds, 2004; Janssens, 2009; Klasen et al., 2000; Mathai, Anderson, & Bourne, 2002; C. Mieloo et al., 2012; C. L.…”
Caspi, A. (1996) · Archives of General Psychiatry · doi:10.1001/archpsyc.1996.01830110071009 · Cited by 1,159
Stone, L. L., Otten, R., Engels, R. C. M. E., Vermulst, A. A., & Janssens, J. M. A. M. (2010) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-010-0071-2 · Cited by 1,031 · cited 4×
“We contend that the coefficient values found in Stone et al. (2010) and our review are actually rather low and indicate that at best 22% of variance can be explained by scores from different informants.”
BackgroundResultInfluentialStrengths and Difficulties Questionnaire as a Dimensional Measure of Child Mental Health
Goodman, A., & Goodman, R. (2009) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e3181985068 · Cited by 977 · cited 1×
“Two studies used odds ratios to estimate the likelihood of receiving a diagnosis at baseline (concurrent validity) and 3 years later (predictive validity) (A. Goodman & Goodman, 2009; A. Goodman, Lamping, et al., 2010).”
Goodman, R., Renfrew, D., & Mullick, M. (2000) · European Child & Adolescent Psychiatry · doi:10.1007/s007870050008 · Cited by 552
The Strengths and Difficulties Questionnaire: U.S. Normative Data and Psychometric Properties
Bourdon, K. H., Goodman, R., Rae, D. S., Simpson, G., & Koretz, D. S. (2005) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/01.chi.0000159157.57075.c8 · Cited by 536
Matsuishi, T., Nagano, M., Araki, Y., Tanaka, Y., Iwasaki, M., Yamashita, Y., Nagamitsu, S., Iizuka, C., Ohya, T., Shibuya, K., et al. (2008) · Brain and Development · doi:10.1016/j.braindev.2007.12.003 · Cited by 346
Cited by
Bergström, M., & Baviskar, S. (2021) · Journal of Evidence-Based Social Work · doi:10.1080/26408066.2020.1788477 · Cited by 80
Murray, A. L., Ushakova, A., Speyer, L., Brown, R., Auyeung, B., & Zhu, X. (2022) · JCPP Advances · doi:10.1002/jcv2.12057 · Cited by 33
Wong, T. K. Y., Colasante, T., & Malti, T. (2023) · Journal of School Psychology · doi:10.1016/j.jsp.2023.101253 · Cited by 31
Speyer, L. G., Auyeung, B., & Murray, A. L. (2023) · Assessment · doi:10.1177/10731911221128948 · Cited by 25
“It measures emotional and behavioral development in five domains: conduct problems, emotional problems, peer problems, hyperactivity/inattention, and prosocial behaviors and has been translated into nearly 80 languages (Kersten et al., 2016).”
BackgroundMethodResultInfluentialAristodemou, M. E., Rommelse, N., & Kievit, R. (2024) · Collabra: Psychology · doi:10.1525/collabra.122517 · Cited by 12
Metadata
- Authors
- Kersten, P., Czuba, K., McPherson, K., Dudley, M., Elder, H., Tauroa, R., & Vandal, A.
- Venue
- International Journal of Behavioral Development
- Publisher
- SAGE Publications
- Published
- 2015-02-18
- Volume
- 40
- Issue
- 1
- Pages
- 64-75
- ISSN
- 0165-0254 (ISSN-L)
- 1464-0651
- OpenAlex
- W2067596444
- Cited by
- 165
- References
- 19
- FWCI
- 0.96
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.