A psychometric evaluation of the German version of the ‘health of the nation outcome scales, HoNOS-D’: On the feasibility and reliability of clinician-performed measurements of severity in patients with mental disorders
Abstract
BACKGROUND: The assessment of the severity of a mental illness is a central component in the treatment of patients with mental disorders in both the in- and outpatient settings. In Great Britain, the 'Health of the Nation Outcome Scales, HoNOS' were developed to assess the health and social functioning of patients with mental disorders. AIMS: To examine the psychometric properties, especially the feasibility and reliability, of a German version of the HoNOS (HoNOS-D) and to thus provide international data for the comparison of different mental health services. SAMPLING AND METHODS: The HoNOS was translated into German (HoNOS-D) in an extensive and multilayered consensus procedure. The HoNOS-D was then reviewed within the framework of a pilot study on quality assurance measures implemented by the German statutory health insurance institutes in 11 hospitals. Assessments were made of the psychometric qualities of feasibility and reliability using a representative sample of patients with mental and behavioral disorders. RESULTS: An analysis of the feasibility of the HoNOS-D showed a range of missing values between 1.3 and 4.5% for 11 of the 12 items. An item analysis showed that three items of the HoNOS-D are particularly positively skewed. In most instances, the individual items of the rating scale exhibited only slight correlations to each other. With regard to retest reliability, satisfactory intraclass correlations between 0.80 and 0.91 were seen for 9 of the 12 items. CONCLUSIONS: The authors of the original version of the HoNOS [Wing et al.:Br J Psychiatry 1998;172:11-18] primarily emphasized the feasibility of the instrument and the independence of the individual items and dimensions. The analysis of the missing values showed satisfactory results for feasibility. The intercorrelation matrix of the individual items also exhibited only few correlations >0.30. The retest reliability also proves to be satisfactory for the majority of the items. The narrow distribution of some of the items must be critically discussed in comparison to analyses of results in other countries (e.g. Great Britain) and other settings (e.g. inpatient psychiatric hospitals or outpatient psychotherapy).
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
HoNOS-D test-retest reliability intraclass coefficients have been found to be between 0.72 and 0.91.
“Regarding test–retest reliability, intraclass coefficients have been found to be between 0.72 and 0.91 [30].”
From Blended care in in-patient acute psychiatric care. The example of a group training for social competences in adults—A pretest–posttest feasibility study (2021) · cites this paper as [30]
Cites
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · see citing works
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,406 · see citing works
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770 · see citing works
Fleiss, J. L., & Cohen, J. (1973) · Educational and Psychological Measurement · doi:10.1177/001316447303300309 · Cited by 3,354 · see citing works
Health of the Nation Outcome Scales (HoNOS): Research and development
Wing, J. K., Beevor, A. S., Curtis, R. H., Park, S. G. B., Hadden, J., & Burns, A. (1998) · British Journal of Psychiatry · doi:10.1192/bjp.172.1.11 · Cited by 1,203 · see citing works
Ware, J., Kosinski, M., Dewey, J., Gandek, B., Kisinski, M., Ware, J. E., & Dewey, J. M. (2001) · Cited by 824 · see citing works
Translation of Health Status Instruments
Sartorius, N., & Kuyken, W. (1994) · Springer eBooks · doi:10.1007/978-3-642-79123-9_1 · Cited by 344 · see citing works
Validity of the Zung Self-rating Depression Scale
Biggs, J. T., Wylie, L. T., & Ziegler, V. E. (1978) · British Journal of Psychiatry · doi:10.1192/bjp.132.4.381 · Cited by 326 · see citing works
Psychiatrists in the UK do not use outcomes measures
Gilbody, S. M., House, A. O., & Sheldon, T. (2002) · The British Journal of Psychiatry · doi:10.1192/bjp.180.2.101 · Cited by 231 · see citing works
Factor Structure of the SCL-90-R: Is There One?
Cyr, J. J., McKenna-Foley, J. M., & Peacock, E. (1985) · Journal of Personality Assessment · doi:10.1207/s15327752jpa4906_2 · Cited by 207 · see citing works
Orrell, M. W., Yard, P., Handysides, J., & Schapira, R. (1999) · The British Journal of Psychiatry · doi:10.1192/bjp.174.5.409 · Cited by 120 · see citing works
Health of the Nation Outcome Scales
Trauer, T., Callaly, T., Hantz, P. M., Little, J., Shields, R. B., & Smith, J. (1999) · The British Journal of Psychiatry · doi:10.1192/bjp.174.5.380 · Cited by 119 · see citing works
Vassend, O. M., & Skrondal, A. (1999) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(98)00182-x · Cited by 105 · see citing works
Bailey, J., & Coppen, A. J. (1976) · The British Journal of Psychiatry · doi:10.1192/bjp.128.5.486 · Cited by 105 · see citing works
Making Sense of Statistics in Psychology: A Second-Level Course
Everitt, B. J. (1996) · Cited by 100 · see citing works
Brooks, R. (2000) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/j.1440-1614.2000.00755.x · Cited by 76 · see citing works
Page, A. C., Hooke, G. R., & Rutherford, E. M. (2001) · Australian & New Zealand Journal of Psychiatry · doi:10.1046/j.1440-1614.2001.00908.x · Cited by 56 · see citing works
Value of HoNOS in assessing patient change in NHS psychotherapy and psychological treatment services
Audin, K., Margison, F. R., Clark, J. M., & Barkham, M. (2001) · The British Journal of Psychiatry · doi:10.1192/bjp.178.6.561 · Cited by 52 · see citing works
Goldney, R. D., Fisher, L. J., & Walmsley, S. H. (1998) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048679809062729 · Cited by 44 · see citing works
Developing a Casemix Classification for Mental Health Services: Summary
Buckingham, B., Burgess, P., Solomon, S., et al. (1998) · PsycEXTRA Dataset · doi:10.1037/e676332010-001 · Cited by 35 · see citing works
HoNOS: is there any point in training clinicians?
Rock, D. J., & Preston, N. J. (2001) · Journal of Psychiatric and Mental Health Nursing · doi:10.1046/j.1365-2850.2001.00410.x · Cited by 23 · see citing works
Classification in Primary Care: Experience with Current Diagnostic Systems
Jenkins, R., Goldberg, D., Kiima, D., et al. (2002) · Psychopathology · doi:10.1159/000065132 · Cited by 13 · see citing works
Health of the Nation Outcome Scales (HoNOS): use in an Irish psychiatric outpatient population
Browne, S., Doran, M., & McGauran, S. (2000) · Irish Journal of Psychological Medicine · doi:10.1017/s0790966700003980 · Cited by 8 · see citing works
Andreas, S., Dirmaier, J., Lang, K., et al. (2004) · PPmP - Psychotherapie · Psychosomatik · Medizinische Psychologie · doi:10.1055/s-2003-814949 · Cited by 3 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Bendig, E., Küchler, A.-M., Baumeister, H., & Becker, T. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18189433 · Cited by 14 · see citing works
Egger, S. T., Vetter, S., Weniger, G., Vandeleur, C., Seifritz, E., & Müller, M. (2016) · Frontiers in Public Health · doi:10.3389/fpubh.2016.00220 · Cited by 6 · see citing works
- Authors
- Andreas, S., Harfst, T., Dirmaier, J., Kawski, S., Koch, U., & Schulz, H.
- Affiliations
- University Medical Center Hamburg-Eppendorf (DE)
- Venue
- Psychopathology
- Publisher
- S. Karger AG
- Published
- 2007
- Volume
- 40
- Issue
- 2
- Pages
- 116-125
- ISSN
- 0254-4962 (ISSN-L)
- 1423-033X
- OpenAlex
- W2045158775
- Cited by
- 48
- References
- 24
- Citations by year
- 2026: 3 · 2024: 5 · 2023: 1 · 2022: 4 · 2021: 6 · 2020: 5 · 2017: 2 · 2016: 3 · 2015: 2 · 2014: 3 · 2013: 2 · 2012: 3
- FWCI
- 2.17
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychopathology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Deutsche Rentenversicherung
- Bundesministerium für Bildung und Forschung
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Keywords
- Health of the Nation Outcome Scales, German translation, psychometric properties, test-retest reliability, feasibility, missing data, mental illness, behavioral disorders, cross-cultural adaptation
- MeSH terms
- Adult, Aged, Mental Disorders, Cross-Cultural Comparison, Feasibility Studies, Female, Germany, Hospitalization, Humans, Language, Male, Middle Aged, Personality Assessment, Psychometrics, Reproducibility of Results, Outcome Assessment, Health Care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review