Agreement on web-based diagnoses and severity of mental health problems in Norwegian child and adolescent mental health services
Open accessAbstract
OBJECTIVE: This study examined the agreement between diagnoses and severity ratings assigned by clinicians using a structured web-based interview within a child and adolescent mental health outpatient setting. METHOD: Information on 100 youths was obtained from multiple informants through a web-based Development and Well-Being Assessment (DAWBA). Based on this information, four experienced clinicians independently diagnosed (according to the International Classification of Diseases Revision 10) and rated the severity of mental health problems according to the Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA) and the Children's Global Assessment Scale (C-GAS). RESULTS: Agreement for diagnosis was κ=0.69-0.82. Intra-class correlation for single measures was 0.78 for HoNOSCA and 0.74 for C-GAS, and 0.93 and 0.92, respectively for average measures. CONCLUSIONS: Agreement was good to excellent for all diagnostic categories. Agreement for severity was moderate, but improved to substantial when the average of the ratings given by all clinicians was considered. Therefore, we conclude that experienced clinicians can assign reliable diagnoses and assess severity based on DAWBA data collected online.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
DAWBA diagnoses have good validity when compared to clinical diagnoses.
“When compared to clinical diagnoses, DAWBA diagnoses have good validity (58).”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 23,433 · see citing works
Forming inferences about some intraclass correlation coefficients.
McGraw, K. O., & Wong, S. P. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.30 · Cited by 6,903 · see citing works
(1981) · PubMed · Cited by 2,253 · see citing works
Goodman, R., Ford, T., Richards, H., Gatward, R., & Meltzer, H. (2000) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2000.tb02345.x · Cited by 1,755 · see citing works
The British Child and Adolescent Mental Health Survey 1999: The Prevalence of DSM-IV Disorders
FORD, T., GOODMAN, R., & MELTZER, H. (2003) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200310000-00011 · Cited by 1,227 · cited 1× · see citing works
“Results: Agreement for diagnosis was =0.69-0.82.”
InfluentialMental health of children and adolescents in Great Britain
Meltzer, H., Gatward, R., Goodman, R., & Ford, T. (2003) · International Review of Psychiatry · doi:10.1080/0954026021000046155 · Cited by 1,214 · see citing works
Measurement reliability and agreement in psychiatry
Shrout, P. E. (1998) · Statistical Methods in Medical Research · doi:10.1177/096228029800700306 · Cited by 1,211 · see citing works
Costello, E. J., Egger, H., & Angold, A. (2005) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/01.chi.0000172552.41596.6f · Cited by 1,134 · see citing works
Systematic Reviews of Diagnostic Test Accuracy
Leeflang, M. M. G., Deeks, J. J., Gatsonis, C., & Bossuyt, P. M. M. (2008) · Annals of Internal Medicine · doi:10.7326/0003-4819-149-12-200812160-00008 · Cited by 1,124 · see citing works
Psychiatric Disorders in Norwegian 8- to 10-Year-Olds
HEIERVANG, E., STORMARK, K. M., LUNDERVOLD, A. J., HEIMANN, M., GOODMAN, R., POSSERUD, M.-B., ULLEBØ, A. K., PLESSEN, K. J., BJELLAND, I., LIE, S. A., et al. (2007) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e31803062bf · Cited by 392 · see citing works
Self-citationMethods to Improve Diagnostic Accuracy in a Community Mental Health Setting
Basco, M. R., Bostic, J. Q., Davies, D., Rush, A. J., Witte, B. P., Hendrickse, W. A., & Barnett, V. (2000) · American Journal of Psychiatry · doi:10.1176/appi.ajp.157.10.1599 · Cited by 388 · see citing works
Gowers, S. G., Harrington, R. C., Whitton, A., Lelliott, P., Beevor, A., Wing, J., & Jezzard, R. (1999) · British Journal of Psychiatry · doi:10.1192/bjp.174.5.413 · Cited by 378 · see citing works
Further Measures of the Psychometric Properties of the Children's Global Assessment Scale
Bird, H. (1987) · Archives of General Psychiatry · doi:10.1001/archpsyc.1987.01800210069011 · Cited by 331 · see citing works
Pirkis, J., Burgess, P. M., Kirk, P. K., Dodson, S., Coombs, T., & Williamson, M. K. (2005) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-3-76 · Cited by 330 · see citing works
Is This Patient Clinically Depressed?
Williams, J. W. (2002) · JAMA · doi:10.1001/jama.287.9.1160 · Cited by 319 · see citing works
Goodman, A., Heiervang, E. R., Collishaw, S., & Goodman, R. (2010) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-010-0219-x · Cited by 195 · see citing works
Self-citationGlobal assessment of psychosocial functioning in child and adolescent psychiatry
Schorre, B. E. H., & Vandvik, I. H. (2004) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-004-0390-2 · Cited by 172 · see citing works
The Children's Global Assessment Scale in Clinical Practice: An Empirical Evaluation
GREEN, B., SHIRK, S., HANZE, D., & WANSTRATH, J. (1994) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199410000-00011 · Cited by 166 · see citing works
Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA)
Gowers, S., Harrington, R., Whitton, A., Lelliott, P. T., Beevor, A., Wing, J., & Jezzard, R. (1999) · The British Journal of Psychiatry · doi:10.1192/bjp.174.5.428 · Cited by 153 · see citing works
Child and adolescent mental health service use
Garralda, M. E., Yates, P., & Higginson, I. J. (2000) · The British Journal of Psychiatry · doi:10.1192/bjp.177.1.52 · Cited by 151 · see citing works
Heiervang, E., Goodman, A., & Goodman, R. (2008) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2008.01882.x · Cited by 137 · see citing works
Self-citationEzpeleta, L., de la Osa, N., Domenech, J. M., Navarro, J. B., Losilla, J.-M., & Júdez, J. (1997) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1997.tb01528.x · Cited by 127 · see citing works
Medical decision making: a selective review for child psychiatrists and psychologists
Galanter, C. A., & Patel, V. L. (2005) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2005.01452.x · Cited by 121 · see citing works
Lundh, A., Kowalski, J. H., Sundberg, C. J., Gumpert, C. H., & Landén, M. (2010) · Psychiatry Research · doi:10.1016/j.psychres.2010.02.006 · Cited by 107 · see citing works
Dyrborg, J., Larsen, F. W., Nielsen, S. L., Byman, J., Nielsen, B. B., & Gautrè-Delay, F. (2000) · European Child & Adolescent Psychiatry · doi:10.1007/s007870070043 · Cited by 89 · see citing works
Brann, P., Coleman, G. J., & Luk, E. (2001) · Australian & New Zealand Journal of Psychiatry · doi:10.1046/j.1440-1614.2001.00890.x · Cited by 89 · see citing works
McClellan, J., & WERRY, J. S. (2000) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200001000-00013 · Cited by 87 · see citing works
Routine measurement of outcomes in Australia's public sector mental health services
Pirkis, J., Burgess, P. M., Dickson, R., Clarke, A., Jones-Ellis, D., & Coombes, T. (2005) · Australia and New Zealand Health Policy · doi:10.1071/hp050208 · Cited by 73 · see citing works
Miller, P. R. (2001) · Psychiatry Research · doi:10.1016/s0165-1781(01)00318-3 · Cited by 72 · see citing works
The Italian Preadolescent Mental Health Project (PrISMA): rationale and methods
Frigerio, A., Vanzin, L., Pastore, V., Nobile, M., Giorda, R., Marino, C., Molteni, M., Rucci, P., Ammaniti, M., Lucarelli, L., et al. (2006) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.25 · Cited by 61 · see citing works
Hanssen-Bauer, K., Aalen, O., Ruud, T., & Heyerdahl, S. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0134-y · Cited by 55 · see citing works
Foreman, D. M., Morton, S., & Ford, T. J. (2009) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2008.02017.x · Cited by 50 · see citing works
Hanssen‐Bauer, K., Gowers, S., Aalen, O. O., Bilenberg, N., Brann, P., Garralda, M. E., Merry, S., & Heyerdahl, S. (2007) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-007-0135-x · Cited by 45 · see citing works
How "objective" are psychiatric diagnoses?: (guess again).
Pies, R. W. (2007) · PubMed · Cited by 40 · see citing works
Lauth, B., Levy, S. R. A., Juliusdottir, G. M., Ferrari, P., & Pétursson, H. (2008) · Child and Adolescent Psychiatry and Mental Health · doi:10.1186/1753-2000-2-14 · Cited by 28 · see citing works
Martin‐Khan, M., Wootton, R., Whited, J. D., & Gray, L. (2011) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2011.101113 · Cited by 20 · see citing works
Foreman, D. M., & Ford, T. J. (2008) · Child and Adolescent Psychiatry and Mental Health · doi:10.1186/1753-2000-2-32 · Cited by 19 · see citing works
Computer Assisted Clinical Assessment
Berger, M. (2006) · Child and Adolescent Mental Health · doi:10.1111/j.1475-3588.2006.00394.x · Cited by 16 · see citing works
Use of videoconferencing in Norwegian psychiatry
Hanssen, B., Wangberg, S. C., & Gammon, D. (2007) · Journal of Telemedicine and Telecare · doi:10.1258/135763307780677587 · Cited by 12 · see citing works
How many raters are needed for a reliable diagnosis?
Noda, A. M., KRAEMER, H. C., Yesavage, J. A., & Periyakoil, V. S. (2001) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.107 · Cited by 9 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Barnett, P., Goulding, L., Casetta, C., Jordan, H., Sheridan-Rains, L., Steare, T., Williams, J., Wood, L., Gaughran, F., & Johnson, S. (2021) · Journal of Medical Internet Research · doi:10.2196/26492 · Cited by 136 · see citing works
Videoconferencing in psychiatry, a meta-analysis of assessment and treatment
Drago, A., Winding, T. N., & Antypa, N. (2016) · European Psychiatry · doi:10.1016/j.eurpsy.2016.03.007 · Cited by 106 · see citing works
Homotypic and heterotypic psychopathological continuity: a child cohort study
Shevlin, M. E., McElroy, E., & Murphy, J. (2017) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-017-1396-7 · Cited by 69 · see citing works
Halvorsen, M. B., Aman, M. G., Mathiassen, B., Brøndbo, P. H., Steinsvik, O. O., & Martinussen, M. (2019) · Journal of Mental Health Research in Intellectual Disabilities · doi:10.1080/19315864.2019.1630872 · Cited by 35 · see citing works
Self-citationHenje Blom, E., Tymofiyeva, O., Chesney, M. A., Ho, T. C., Moran, P., Connolly, C. G., Duncan, L. G., Baldini, L., Weng, H. Y., Acree, M., et al. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2016.00208 · Cited by 33 · see citing works
“When compared to clinical diagnoses, DAWBA diagnoses have good validity (58).”
ResultHilty, D. M., Shoemaker, E. Z., Myers, K., Snowdy, C. E., Yellowlees, P., & Yager, J. (2016) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/cap.2015.0129 · Cited by 28 · see citing works
Neurodevelopmental correlates of behavioural and emotional problems in a neuropaediatric sample
Halvorsen, M. B., Mathiassen, B., Myrbakk, E., Brøndbo, P. H., Sætrum, A., Steinsvik, O. O., & Martinussen, M. (2018) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2018.11.005 · Cited by 28 · see citing works
Self-citationTelepsychiatry: what clinicians need to know about digital mental healthcare
Brunt, T. J., & Gale‐Grant, O. (2022) · BJPsych Advances · doi:10.1192/bja.2022.42 · Cited by 25 · see citing works
Halvorsen, M. B., Mathiassen, B., Amundsen, T., Ellingsen, J., Brøndbo, P. H., Sundby, J., Steinsvik, O. O., & Martinussen, M. (2018) · Child Neuropsychology · doi:10.1080/09297049.2018.1508564 · Cited by 21 · see citing works
Self-citationLatent classes of symptoms related to clinically depressed mood in adolescents
Blom, E. H., Forsman, M., Yang, T. T., Serlachius, E., & Larsson, J.-O. (2013) · Scandinavian Journal of Child and Adolescent Psychiatry and Psychology · doi:10.21307/sjcapp-2014-004 · Cited by 18 · see citing works
Hilty, D. M., Yellowlees, P., Myers, K., Parish, M. B., & Rabinowitz, T. (2015) · Springer eBooks · doi:10.1007/978-3-319-20852-7_6 · Cited by 10 · see citing works
Shoemaker, E. Z., & Hilty, D. M. (2015) · Springer eBooks · doi:10.1007/978-3-319-20852-7_3 · Cited by 10 · see citing works
Kjærandsen, K. S., Handegård, B. H., Brøndbo, P. H., & Halvorsen, M. B. (2020) · Journal of Applied Research in Intellectual Disabilities · doi:10.1111/jar.12834 · Cited by 8 · see citing works
Bøsndbo, P. H., Mathiassen, B., Martinussen, M., Handegård, B. H., & Kvernmo, S. E. (2013) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2012.120209 · Cited by 8 · see citing works
Self-citationHalvorsen, M. B., Heiervang, E. R., Mathiassen, B., Aman, M. G., Kaiser, S., & Helverschou, S. B. (2025) · Research in Autism · doi:10.1016/j.reia.2025.202550 · Cited by 7 · see citing works
Self-citationMåleegenskaper ved den norske versjonen av Children’s Global Assessment Scale (CGAS)
Jozefiak, T., Hanssen‐Bauer, K., & Bjelland, I. (2018) · PsykTestBarn · doi:10.21337/0058 · Cited by 7 · see citing works
Social Media and Clinical Practice: What Stays the Same, What Changes, and How to Plan Ahead?
Snowdy, C. E., Shoemaker, E. Z., Chan, S. R., & Hilty, D. M. (2015) · Springer eBooks · doi:10.1007/978-3-319-20852-7_8 · Cited by 3 · see citing works
Måleegenskaper ved den norske versjonen av Development and Well-being Assessment (DAWBA)
Brøndbo, P. H., & Martinussen, M. (2013) · PsykTestBarn · doi:10.21337/0028 · Cited by 1 · see citing works
Self-citationThe Psychopathology in Autism Checklist–Revised (PAC-R): Development and Validation
Kildahl, A. N., Helverschou, S. B., Mathiassen, B., Heiervang, E. R., & Halvorsen, M. B. (2026) · Autism · doi:10.1177/13623613261480174
Self-citation
- Authors
- Brøndbo, H., Mathiassen, B., Martinussen, M., Heiervang, E., Eriksen, M., & Kvernmo, S.
- Affiliations
- University Hospital of North Norway (NO)
- UiT The Arctic University of Norway (NO)
- University of Oslo (NO)
- Finnmarkssykehuset (NO)
- Venue
- Clinical Practice & Epidemiology in Mental Health
- Publisher
- Bentham Science Publishers Ltd.
- Published
- 2012-03-22
- Volume
- 8
- Issue
- 1
- Pages
- 16-21
- ISSN
- 1745-0179 (ISSN-L)
- PMC
- PMC3343321
- OpenAlex
- W2133352398
- Cited by
- 19
- References
- 40
- Citations by year
- 2026: 1 · 2025: 1 · 2022: 1 · 2021: 1 · 2020: 1 · 2019: 1 · 2018: 3 · 2017: 2 · 2016: 2 · 2015: 3 · 2013: 3
- FWCI
- 2.19
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Clinical Practice and Epidemiology in Mental Health (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › Psychology › Clinical Psychology › Child and Adolescent Psychosocial and Emotional Development
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- diagnostic agreement, severity rating, child and adolescent mental health, online assessment, Development and Well-Being Assessment, HoNOSCA, Children's Global Assessment Scale, inter-rater reliability, clinician diagnosis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
