Quality of Longer Term Mental Health Facilities in Europe: Validation of the Quality Indicator for Rehabilitative Care against Service Users’ Views
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
BACKGROUND: The Quality Indicator for Rehabilitative Care (QuIRC) is a staff rated, international toolkit that assesses care in longer term hospital and community based mental health facilities. The QuIRC was developed from review of the international literature, an international Delphi exercise with over 400 service users, practitioners, carers and advocates from ten European countries at different stages of deinstitutionalisation, and review of the care standards in these countries. It can be completed in under an hour by the facility manager and has robust content validity, acceptability and inter-rater reliability. In this study, we investigated the internal validity of the QuIRC. Our aim was to identify the QuIRC domains of care that independently predicted better service user experiences of care. METHOD: At least 20 units providing longer term care for adults with severe mental illness were recruited in each of ten European countries. Service users completed standardised measures of their experiences of care, quality of life, autonomy and the unit's therapeutic milieu. Unit managers completed the QuIRC. Multilevel modelling allowed analysis of associations between service user ratings as dependent variables with unit QuIRC domain ratings as independent variables. RESULTS: 1750/2495 (70%) users and the managers of 213 units from across ten European countries participated. QuIRC ratings were positively associated with service users' autonomy and experiences of care. Associations between QuIRC ratings and service users' ratings of their quality of life and the unit's therapeutic milieu were explained by service user characteristics (age, diagnosis and functioning). A hypothetical 10% increase in QuIRC rating resulted in a clinically meaningful improvement in autonomy. CONCLUSIONS: Ratings of the quality of longer term mental health facilities made by service managers were positively associated with service users' autonomy and experiences of care. Interventions that improve quality of care in these settings may promote service users' autonomy.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Some emerging evidence indicates that PARC services and similar services promote increased recovery for consumers [16–20].”
From Consumers lived experiences and satisfaction with sub-acute mental health residential services (2024) · cites this paper as [17]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
What are the functional consequences of neurocognitive deficits in schizophrenia?
(1996) · American Journal of Psychiatry · doi:10.1176/ajp.153.3.321 · Cited by 3,516 · cited 1×
“The people who reside in longer term facilities mostly have diagnoses of psychotic illnesses [6] with complications such as treatment resistance [7], cognitive impairment and negative symptoms [8], poor social functioning [9], substance misuse and challenging behaviours [10].”
BackgroundApplication and Results of the Manchester Short Assessment of Quality of Life (Mansa)
Priebe, S., Huxley, P., Knight, S., & Evans, S. (1999) · International Journal of Social Psychiatry · doi:10.1177/002076409904500102 · Cited by 1,071 · cited 4×
“Summary of Results for Each Dependent Variable Quality of life (MANSA).”
MethodInfluentialJones, S. H., Thornicroft, G., Coffey, M., & Dunn, G. (1995) · British Journal of Psychiatry · doi:10.1192/bjp.166.5.654 · Cited by 1,015 · cited 1×
“An assessment of service user function was also made by the researcher using the Global Assessment of Function (GAF) [21] in order to take this into account as a potential mediator.”
MethodElliott, M. (1989) · Elderly Care · doi:10.7748/eldc.9.2.22.s18 · Cited by 960
Treatment-Resistant Schizophrenia - The Role of Clozapine
Meltzer, H. Y. (1997) · Current Medical Research and Opinion · doi:10.1185/03007999709113338 · Cited by 491 · cited 1×
“The people who reside in longer term facilities mostly have diagnoses of psychotic illnesses [6] with complications such as treatment resistance [7], cognitive impairment and negative symptoms [8], poor social functioning [9], substance misuse and challenging behaviours [10].”
BackgroundPriebe, S., Badesconyi, A., Fioritti, A., Hansson, L., Kilian, R., Torres-Gonzales, F., Turner, T., & Wiersma, D. (2005) · BMJ · doi:10.1136/bmj.38296.611215.ae · Cited by 463 · cited 1×
“Although the exact number of longer term mental health facilities is unknown, concerns have been raised about the continuing reliance on large asylums in less economically developed countries [2] and the expansion of the ‘‘virtual asylum’’ of smaller health and social care facilities provided by the independent sector…”
BackgroundSelf-citationHandbook of social functioning in schizophrenia
Mueser, K. T., & Tarrier, N. (1998) · Cited by 305
Taylor, T. L., Killaspy, H., Wright, C., Turton, P., White, S., Kallert, T. W., Schuster, M., Cervilla, J. A., Brangier, P., Raboch, J., et al. (2009) · BMC Psychiatry · doi:10.1186/1471-244x-9-55 · Cited by 134 · cited 1×
“The domains of care included in the toolkit were identified through triangulation of the results of: i) a review of care standards in each country; ii) a systematic literature review of the components of care (and their effectiveness) in longer term mental health units [13]; iii) an international Delphi exercise with…”
MethodSelf-citationTrieman, N., & Leff, J. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.181.5.428 · Cited by 100
Knapp, M., Beecham, J., McDaid, D., Matosevic, T., & Smith, M. (2010) · Health & Social Care in the Community · doi:10.1111/j.1365-2524.2010.00969.x · Cited by 89 · cited 1×
“A review of studies that investigated the costs of care associated with deinstitutionalisation in England, Germany and Italy concluded that well managed community based care was more cost-effective than long-stay hospital care as it was able to provide better quality care that resulted in better clinical outcomes [5].”
Background
Research works printed but not linked: 1
- Rehabilitation, Social Faculty (2009) Enabling recovery for people with complex mental health needs: a template for rehabilitation services in England. Royal College of Psychiatrists, FR/RS/ 04.
Cited by
Killaspy, H. T., Priebe, S., Bremner, S. A., McCrone, P., Dowling, S., Harrison, I., Krotofil, J., McPherson, P., Sandhu, S., Arbuthnott, M., et al. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(16)30327-3 · Cited by 90
Self-citationKillaspy, H. T., Marston, L., Omar, R., Green, N., Harrison, I., Lean, M., Holloway, F. A., Craig, T., Leavey, G., & King, M. (2012) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.112.114421 · Cited by 74
Self-citationBredewold, F., Hermus, M., & Trappenburg, M. J. (2018) · Journal of Social Work · doi:10.1177/1468017318793620 · Cited by 73
“Two studies (Killaspy et al., 2012; Young & Ashman, 2004b) found that the quality of care for disabled people (therapeutic environment, treatments and interventions, social interface, self-management and autonomy, living environment, human rights, recovery-based practice) improved after their…”
BackgroundKillaspy, H. T., Marston, L., Green, N., Harrison, I., Lean, M., Holloway, F. A., Craig, T., Leavey, G., Arbuthnott, M., Koeser, L., et al. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0797-6 · Cited by 70
Self-citationKillaspy, H., Marston, L., Green, N., Harrison, I., Lean, M., Cook, S., Mundy, T., Craig, T., Holloway, F., Leavey, G., et al. (2015) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)00050-9 · Cited by 52
Self-citationSalisbury, T. T., Killaspy, H. T., & King, M. (2016) · European Psychiatry · doi:10.1016/j.eurpsy.2016.11.011 · Cited by 44
“suggests that higher QuIRC domain scores are associated with improved service user outcomes [9].”
Self-citationKillaspy, H. T., White, S. J., Dowling, S., Krotofil, J., McPherson, P., Sandhu, S., Arbuthnott, M., Curtis, S. E., Leavey, G., Priebe, S., et al. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0799-4 · Cited by 45
Self-citationSánchez‐Balcells, S., Roca, M. C., Zunino, N. R., Llobet, M. P., Lluch‐Canut, T., & Roldán-Merino, J. F. (2018) · Journal of Advanced Nursing · doi:10.1111/jan.13813 · Cited by 39
Quality of care in long-term care departments in mental health facilities across the Czech Republic
Kališová, L., Páv, M., Winkler, P., Michalec, J., & Killaspy, H. T. (2018) · European Journal of Public Health · doi:10.1093/eurpub/cky151 · Cited by 35
Self-citationde Girolamo, G., Rocchetti, M., Benzi, I. M. A., Agosta, S., Casiraghi, L., Ferrari, C., Franceschi, N. D., Macis, A., Pogliaghi, S., & Starace, F. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02588-y · Cited by 35
“To evaluate the associations between the quality of RFs rated by service managers and patient experiences of care, in accordance with Killaspy and colleagues [83], we will perform multilevel modelling analyses of associations between service user ratings (level 1 data) as dependent variables with unit QuIRC-SA domain…”
MethodThe Active Recovery Triad Model: A New Approach in Dutch Long-Term Mental Health Care
Zomer, L. J. C., Voskes, Y., van Weeghel, J., Widdershoven, G. A. M., van Mierlo, T. F. M. M., Berkvens, B., Stavenuiter, B., & van der Meer, L. (2020) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2020.592228 · Cited by 35
Vollmann, J. (2013) · Der Nervenarzt · doi:10.1007/s00115-013-3866-9 · Cited by 40
In-patient rehabilitation: clinical outcomes and cost implications
Bunyan, M., Ganeshalingam, Y., Morgan, E., Thompson-Boy, D., Wigton, R. L., Holloway, F. A., & Tracy, D. K. (2016) · BJPsych Bulletin · doi:10.1192/pb.bp.114.049858 · Cited by 26
Coercion and compulsion in mental healthcare—An international perspective
Molodynski, A., Turnpenny, L., Rugkåsa, J., Burns, T., & Moussaoui, D. (2013) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2013.08.002 · Cited by 32
Killaspy, H. T., Cardoso, G., White, S. J., Wright, C., Caldas‐de‐Almeida, J. M., Turton, P., Salisbury, T. T., Schützwohl, M., Schuster, M., Cervilla, J. A., et al. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0737-5 · Cited by 24
Self-citationCardoso, G., Papoila, A. L., Tomé, G., Killaspy, H. T., King, M., & Caldas‐de‐Almeida, J. M. (2016) · BMC Psychiatry · doi:10.1186/s12888-016-0743-7 · Cited by 24
“The QuIRC has excellent inter-rater reliability and good internal validity (Killaspy et al, 2012) [14].”
BackgroundSelf-citationWiles, L., Hooper, T. D., Hibbert, P. D., Molloy, C. J., White, L., Jaffé, A., Cowell, C. T. C. T., Harris, M., Runciman, W. B., Schmiede, A., et al. (2019) · PLoS ONE · doi:10.1371/journal.pone.0209637 · Cited by 21
The reliability of the Personal and Social Performance scale – informing its training and use
White, S. J., Dominise, C., Naik, D., & Killaspy, H. T. (2016) · Psychiatry Research · doi:10.1016/j.psychres.2016.06.047 · Cited by 20
Self-citationKillaspy, H. T., Cook, S., Mundy, T., Craig, T., Holloway, F. A., Leavey, G., Marston, L., McCrone, P., Koeser, L., Arbuthnott, M., et al. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-216 · Cited by 23
Self-citationMartinelli, A., Iozzino, L., Pozzan, T., Cristofalo, D., Bonetto, C., & Ruggeri, M. (2022) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-021-02128-3 · Cited by 22
“The QuIRC-SA is completed by RFs managers via a webpage that immediately produces a report (https:// quirc. eu/ quirc- sa/).”
MethodInfluentialKillaspy, H. T., King, M., Holloway, F. A., Craig, T., Cook, S., Mundy, T., Leavey, G., McCrone, P., Koeser, L., Omar, R., et al. (2017) · Programme Grants for Applied Research · doi:10.3310/pgfar05070 · Cited by 19
Self-citationSocial care: an essential aspect of mental health rehabilitation services
Craig, T. J. (2018) · Epidemiology and Psychiatric Sciences · doi:10.1017/s204579601800029x · Cited by 17
“…is clear leadership from the top, a shared understanding by all members of the rehabilitation team and their managers of the goals and procedures of rehabilitation and regular audit of the quality of environments and standards of care against national benchmarks (e.g. Killaspy et al. 2012).”
Harvey, C., Brophy, L., Tibble, H., Killaspy, H., Spittal, M. J., Hamilton, B., Ennals, P., Newton, R., Cruickshank, P., Hall, T., et al. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00383 · Cited by 16
“Although completed by the service manager, ratings correlate well with consumers’ experiences of the service, including the degree to which it promotes their autonomy (28).”
BackgroundSelf-citationFletcher, J., Brophy, L., Killaspy, H., Ennals, P., Hamilton, B., Collister, L., Hall, T., & Harvey, C. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00735 · Cited by 15
“In the original validation of the QuIRC, service managers’ ratings of quality (as indicated by the domain scores) concurred with consumer ratings of their care and autonomy (17), allowing some confidence that the ratings reflect consumer views and experiences of the care provided.”
BackgroundSelf-citationContemporary mental health rehabilitation.
Killaspy, H. T. (2014) · PubMed · Cited by 13
Self-citationKillaspy, H. T., Priebe, S., King, M., Eldridge, S. M., McCrone, P., Shepherd, G., Arbuthnott, M., Leavey, G., Curtis, S. E., McPherson, P., et al. (2019) · Programme Grants for Applied Research · doi:10.3310/pgfar07070 · Cited by 10
Self-citationService Users’ Perception of the Therapeutic Milieu in a Mental Health Rehabilitation Unit
Grech, P., Scerri, J., Vincenti, S. C., Sammut, A., Galea, M., Bitar, D. C., & Sant, S. D. (2020) · Issues in Mental Health Nursing · doi:10.1080/01612840.2020.1757797 · Cited by 10
Dalton‐Locke, C., Attard, R., Killaspy, H. T., & White, S. J. (2018) · BMC Psychiatry · doi:10.1186/s12888-018-1912-7 · Cited by 10
Self-citationAlmeda, N., GARCÍA-ALONSO, C. R., Killaspy, H. T., Gutiérrez-Colosía, M. R., & Salvador‐Carulla, L. (2022) · PLoS ONE · doi:10.1371/journal.pone.0265319 · Cited by 9
Self-citationPsychiatric Rehabilitation: Quality of Care and Clinical Effectiveness
Awara, M. A., Simon, P., Lewis, N., Edem, D., & Morrison, J. (2017) · Journal of Psychosocial Rehabilitation and Mental Health · doi:10.1007/s40737-017-0082-0 · Cited by 8
Consumers lived experiences and satisfaction with sub-acute mental health residential services
Waks, S., Morrisroe, E., Reece, J., Fossey, E., Brophy, L., & Fletcher, J. (2024) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-024-02631-3 · Cited by 7
Salisbury, T. T., Killaspy, H. T., & King, M. (2017) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.116.186213 · Cited by 8
Self-citationMaki, S., Nagai, K., Ando, S., & Tamakoshi, K. (2021) · PLoS ONE · doi:10.1371/journal.pone.0250771 · Cited by 7
Three-year-cohort-study: clinical and cost effectiveness of an inpatient psychiatric rehabilitation
Awara, M. A., Downing, L. M., Edem, D., Lewis, N., & Green, J. T. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1140265 · Cited by 6
“QuIRC is a standardized, international quality assessment tool for inpatient and community rehabilitation units and although completed by managers of the service, during its development, the ratings were validated against service users’ experiences of care and autonomy and found to correlate well (9).”
BackgroundAkut-Tagesklinik als kosteneffiziente Alternative zu stationärer Therapie
Pausch, K., Nordt, C., Pichler, E. M., Warnke, I., Seifritz, E., & Kawohl, W. (2017) · Neuropsychiatrie · doi:10.1007/s40211-017-0221-6 · Cited by 2
Awara, M. A., & Green, J. T. (2024) · Community Mental Health Journal · doi:10.1007/s10597-024-01325-z · Cited by 1
Quality Indicators for Mental Health Services
Killaspy, H. T. (2017) · Springer eBooks · doi:10.1007/978-3-319-55266-8_12 · Cited by 1
Self-citationZomer, L. J. C., van der Meer, L., van Weeghel, J., Widdershoven, G. A. M., & Voskes, Y. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13123488 · Cited by 2
“In recent decades, the concept of recovery has become an important guiding principle in mental health care [1–5].”
BackgroundSu, S., Rong, J., & Li, J.-B. (2016) · European Scientific Journal ESJ · doi:10.19044/esj.2016.v12n12p113
Sánchez‐Balcells, S. (2019) · Dipòsit Digital de la Universitat de Barcelona (Universitat de Barcelona) · Cited by 1
Pedrosa, B., Cardoso, G., Lopes, S. A., Aluh, D. O., Grigaitė, U., Dias, M., Silva, M., & Caldas‐de‐Almeida, J. M. (2022) · International Journal of Social Psychiatry · doi:10.1177/00207640221127928
“This is aligned with the findings by Killaspy et al. (2012), in which a 10% increase in any QuIRC domain led to a maximum increase of 1.1 units in the users’ experiences of care scores, using the YTC.”
MethodSelf-citationInstitutionalizing individuals with physical disabilities in the republic of Serbia
Budimirovic, M. (2024) · National Repository of Dissertations in Serbia
Sasaki, Y., Yamaguchi, K., Shobugawa, Y., Ohaku, Y., Otaga, M., Machida, M., Miura, H., HAYASHI, R., Arai, H., Tum, V., et al. (2026) · Geriatrics and gerontology international/Geriatrics & gerontology international · doi:10.1111/ggi.70821
Metadata
- Authors
- Killaspy, H., White, S., Wright, C., Taylor, T. L., Turton, P., Kallert, T., Schuster, M., Cervilla, J. A., Brangier, P., Raboch, J., Kalisova, L., Onchev, G., Alexiev, S., Mezzina, R., Ridente, P., Wiersma, D., Visser, E., Kiejna, A., Piotrowski, P., Ploumpidis, D., Gonidakis, F., Caldas-de-Almeida, J. M., Cardoso, G., & King, M.
- Affiliations
- University College London (GB)
- St George's, University of London (GB)
- Helios Park-Klinikum Leipzig (DE)
- Technische Universität Dresden (DE)
- Universidad de Granada (ES)
- Charles University (CZ)
- Bulgarian Academy of Sciences (BG)
- University Medical Center Groningen (NL)
- Wroclaw Medical University (PL)
- University Mental Health Research Institute (GR)
- University of Lisbon (PT)
- Corresponding author
- Killaspy, Helen
- ORCID
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-06-04
- Volume
- 7
- Issue
- 6
- Pages
- e38070
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3366953
- OpenAlex
- W2138480654
- Cited by
- 42
- References
- 24
- Citations by year
- 2026: 1 · 2024: 3 · 2023: 2 · 2022: 3 · 2021: 1 · 2020: 3 · 2019: 4 · 2018: 5 · 2017: 5 · 2016: 9 · 2015: 1 · 2014: 1 · 2013: 3 · 2012: 1
- FWCI
- 2.18
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Portal (King's College London) (publishedVersion, other-oa)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (publishedVersion, cc-by)
- St George's Online Research Archive (St George's University of London) (acceptedVersion)
- LSHTM Research Online (London School of Hygiene and Tropical Medicine) (acceptedVersion)
- UCL Discovery (University College London) (submittedVersion, cc-by)
- Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, cc-by)
- Funders
- European Commission
- University of Nottingham
- Universidad de Granada
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Quality and Management
- Health Sciences › Health Professions › General Health Professions › Mental Health and Patient Involvement
- Keywords
- long-term psychiatric care, severe mental illness, therapeutic environment, quality of life, deinstitutionalization, internal validity, community mental health services
- MeSH terms
- Adolescent, Adult, Aged, Aged, 80 and over, Mental Disorders, Europe, Female, Health Facilities, Humans, Long-Term Care, Male, Mental Health Services, Middle Aged, Reproducibility of Results, Quality Indicators, Health Care, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.