CoChat
Sign Up
Cited by 134Disability Education and EmploymentSchizophrenia research and treatmentEmployment and Welfare Studies

A meta-regression of the impact of policy on the efficacy of individual placement and support

Open access
Brinchmann, B., Widding‐Havneraas, T., Modini, M., Rinaldi, M., Moe, C. F., McDaid, D., Park, A‐L., Killackey, E. +2 more·2020·Acta Psychiatrica Scandinavica
DOI 10.1111/acps.13129
Open this paper in CoChat — free accountOpen PDF

Abstract

Objective: Individual placement and support (IPS) has shown consistently better outcomes on competitive employment for patients with severe mental illness than traditional vocational rehabilitation. The evidence for efficacy originates from few countries, and generalization to different countries has been questioned. This has delayed implementation of IPS and led to requests for country‐specific RCTs. This meta‐analysis examines if evidence for IPS efficacy can be generalized between rather different countries. Methods: A systematic search was conducted according to PRISMA guidelines to identify RCTs. Overall efficacy was established by meta‐analysis. The generalizability of IPS efficacy between countries was analysed by random‐effects meta‐regression, employing country‐ and date‐specific contextual data obtained from the OECD and the World Bank. Results: The systematic review identified 27 RCTs. Employment rates are more than doubled in IPS compared with standard vocational rehabilitation (RR 2.07 95% CI 1.82–2.35). The efficacy of IPS was marginally moderated by strong legal protection against dismissals. It was not moderated by regulation of temporary employment, generosity of disability benefits, type of integration policies, GDP, unemployment rate or employment rate for those with low education. Conclusions: The evidence for efficacy of IPS is very strong. The efficacy of IPS can be generalized between countries.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1111/acps.13129

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Specialist education and employment services have been shown to be effective in supporting recovery in many different health systems and welfare contexts, to be cost-effective for adult populations, and to have growing evidence of efficacy in youth populations.

    “These services have been shown to be effective in supporting recovery in many different health systems and welfare contexts, 474 to be cost-effective for adult populations, 475 and to have growing evidence of efficacy in youth populations. 476”

    From The Lancet Psychiatry Commission on youth mental health (2024) · cites this paper as [474]

    Split into 3 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 1 unverifiable. Expand the claim to see per-atom verdicts.

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 52

  1. Summergrad P. Homeless and impaired: the burden of seri- ous psychiatric illness. Acta Psychiatr Scand 2015; 131:238-239.
  2. Marwaha S, Johnson S, Bebbington P et al. Rates and corre- lates of employment in people with schizophrenia in the UK, France and Germany. Br J Psychiatry 2007;191:30- 37.
  3. Kooyman I, Dean K, Harvey S, Walsh E. Outcomes of pub- lic concern in schizophrenia. Br J Psychiatry. 2007;191:29- 36.
  4. Bond GR, Resnick SG, Drake RE, Xie H, McHugo GJ, Beb- out RR. Does competitive employment improve nonvoca- tional outcomes for people with severe mental illness? J Consult Clin Psychol 2001;69:489-501.
  5. Burns T, Catty J, White S et al. The impact of supported employment and working on clinical and social function- ing: results of an international study of individual place- ment and support. Schizophr Bull 2009;35:949-958.
  6. Rinaldi M, Perkins R. Implementing evidence-based sup- ported employment. BJPsych Bulletin 2007;31:244-249.
  7. Carlier BE, Schuring M, L€ otters FJB, Bakker B, Borgers N, Burdorf A. The influence of re-employment on quality of life and self-rated health, a longitudinal study among unemployed persons in the Netherlands. BMC Public Health 2013;13:503.
  8. Glozier N. Workplace effects of the stigmatization of depression. J Occup Environ Med 1998;40:793-800.
  9. Rinaldi M, Perkins R, Glynn E, Montibeller T, Clenaghan M, Rutherford J. Individual placement and support: from research to practice. Adv Psychiatr Treat 2008;14:50-60.
  10. Modini M, Tan L, Brinchmann B et al. Supported employ- ment for people with severe mental illness: systematic review and meta-analysis of the international evidence. Br J Psychiatry 2016;209:14-22.
  11. Bond GR. Supported employment: evicence for an evi- dence-based practice. Psychiatr Rehabil J 2004;27:345- 359.
  12. Mueser KT, Drake RE, Bond GR. Recent advances in sup- ported employment for people with serious mental illness. Curr Opin Psychiatry 2016;29:196-201.
  13. Waghorn G, Hielscher E. The availability of evidence- based practices in supported employment for Australians with severe and persistent mental illness. Aust Occup Ther J 2015;62:141-144.
  14. Fioritti A, Burns T, Hilarion P et al. Individual placement and support in Europe. Psychiatr Rehabil J 2014;37:123- 128.
  15. Bruns EJ, Kerns SE, Pullmann MD, Hensley SW, Lutter- man T, Hoagwood KE. Research, data, and evidence-based treatment use in state behavioral health systems, 2001- 2012. Psychiatr Serv 2015;67:496-503.
  16. Mueser KT, Cook JA. Why cant't we fund supported employment? Psychiatr Rehabil J 2016;39:85-89.
  17. Barbieri P, Cutuli G. Employment protection lagislation, labour market dualism, and inequality in Europe. Eur Sociol Rev 2016;32:501-516.
  18. Cook JA, Mulkern V, Grey DD et al. Effects of local unem- ployment rate on vocational outcomes in a randomized trial of supported employment for individuals with psychi- atric disabilities. J Vocat Rehabil 2006;25:71-84.
  19. Bond GR, Drake RE, Becker DR. Generalizability of the Individual Placement and Support (IPS) model of sup- ported employment outside the US. World Psychiatry 2012;11:32-39.
  20. Bond GR, Becker DR, Drake RE, Vogler KM. A fidelity scale for the individual placement and support model of supported employment. Rehabil Couns Bull 1997;40:265- 284.
  21. Olivo SA, Macedo LG, Gadotti IC, Fuentes J, Stanton T, Magee DJ. Scales to assess the quality of randomized con- trolled trials: a systematic review. Phys Ther 2008;88:156- 175.
  22. Borenstein M. Introduction to meta-analysis. Chichester: Wiley; 2009.
  23. Hoffmann H, J€ ackel D, Glauser S, Kupper Z. A randomised controlled trial of the efficacy of supported employment. Acta Psychiatr Scand 2012;125:157-167.
  24. Hoffmann H, J€ ackel D, Glauser S, Mueser KT, Kupper Z. Long-term effectiveness of supported employment: 5-year follow-up of a randomized controlled trial. Am J Psychia- try 2014;171:1183-1190.
  25. Howard LM, Heslin M, Leese M et al. Supported employ- ment: randomised controlled trial. Br J Psychiatry 2010;196:404-411.
  26. Bond GR, Kim SJ, Becker DR, Swanson SJ, Drake RE, Krzos IM. A controlled trial of supported employment for people with severe mental illness and justice involvement. Psychiatric Services 2015;66:1027-1034.
  27. Bond GR, Salyers MP, Dincin J et al. A randomized con- trolled trial comparing two vocational models for persons with severe mental illness. J Consult Clin Psychol 2007;75:968-982.
  28. Christensen TN, Wallstrom IG, Stenager E et al. Effects of individual placement and support supplemented with cog- nitive remediation and work-focused social skills training for people with severe mental illness: a randomized clinical trial. JAMA Psychiatry 2019;76:1232.
  29. Davis LL, Leon AC, Toscano R et al. A randomized con- trolled trial of supported employment among veterans with posttraumatic stress disorder. Psychiatric Services 2012;63:464-470.
  30. Davis LL, Kyriakides TC, Suris AM et al. Effect of evi- dence-based supported employment vs transitional work on achieving steady work among veterans with posttrau- matic stress disorder: a randomized clinical trial. JAMA Psychiatry 2018;75:316-324.
  31. Drake RE, McHugo GJ, Bebout RR et al. A randomized clinical trial of supported employment for inner-city patients with severe mental disorders. Archives General Psychiatry 1999;56:627.
  32. Drake RE, Frey W, Bond GR et al. Assisting Social Secu- rity Disability Insurance beneficiaries with schizophrenia, bipolar disorder, or major depression in returning to work. Am J Psychiatry 2013;170:1433.
  33. Drake RE, McHugo GJ, Becker DR, Anthony WA, Clark RE. The New Hampshire study of supported employment for people with severe mental illness. J Consult Clin Psy- chol 1996;64:391-399.
  34. Gold PB, Meisler N, Santos AB, Carnemolla MA, Wil- liams OH, Keleher J. Randomized trial of supported employment integrated with assertive community treat- ment for rural adults with severe mental illness. Schizophr Bull 2006;32:378-395.
  35. Killackey E, Allott K, Jackson HJ et al. Individual place- ment and support for vocational recovery in first-episode psychosis: randomised controlled trial. Br J Psychiatry 2019;214:76-82.
  36. Killackey E, Jackson HJ, McGorry PD. Vocational inter- vention in first-episode psychosis: individual placement and support v. treatment as usual. Brit J Psychiatry 2008;193:114.
  37. Latimer EA, Lecomte T, Becker DR et al. Generalisability of the individual placement and support model of sup- ported employment: Results of a Canadian randomised controlled trial. Br J Psychiatry 2006;189:65-73.
  38. Lehman AF, Goldberg R, Dixon LB et al. Improving employment outcomes for persons with severe mental ill- nesses. Arch Gen Psychiatry 2002;59:165-172.
  39. Michon H, Busschbach JT, Stant AD, Vugt MD, Weeghel J, Kroon H. Effectiveness of individual placement and sup- port for people with severe mental illness in The Nether- lands: a 30-month randomized controlled trial. Psychiatr Rehabil J 2014;37:129-136.
  40. Tsang HW, Chan A, Wong A, Liberman RP. Vocational outcomes of an integrated supported employment pro- gram for individuals with persistent and severe mental ill- ness. J Behav Ther Exp Psychiatry 2009;40:292-305.
  41. Twamley EW, Narvaez JM, Becker DR, Bartels SJ, Jeste DV. Supported employment for middle-aged and older people with Schizophrenia. Am J Psychiatric Rehabil 2008;11:76-89.
  42. Viering S, J€ ager M, B€ artsch B et al. Supported employ- ment for the reintegration of disability pensioners with mental illnesses: a randomized controlled trial. Frontiers Public Health 2015;3:237-237.
  43. Wong KK, Chiu R, Tang B, Mak D, Liu J, Chiu SN. A ran- domized controlled trial of a supported employment pro- gram for persons with long-term mental illness in Hong Kong. Psychiatric Services 2008;59:84-90.
  44. Zhang GF, Tsui CM, Lu AJB, Yu LB, Tsang HWH, Li D. Integrated supported employment for people with schizophrenia in mainland china: a randomized controlled trial. Am J Occup Ther 2017;71:7106165020p7106165021- 7106165020p7106165028.
  45. Hellstrom L, Bech P, Hjorthoj C, Nordentoft M, Lindschou J, Eplov LF. Effect on return to work or education of Indi- vidual Placement and Support modified for people with mood and anxiety disorders: results of a randomised clini- cal trial. Occup Environ Med 2017;74:717-725.
  46. Bejerholm U, Larsson ME, Johanson S. Supported employ- ment adapted for people with affective disorders-A ran- domized controlled trial. J Affect Disord 2017;207:212- 220.
  47. LePage JP, Lewis AA, Crawford AM et al. Incorporating in-dividualized placement and support principles into vocational re-habilitation for formerly incarcerated veter- ans. Psychiatr Serv 2016;67:735-742.
  48. Reme SE et al. Work-focused cognitive-behavioural ther- apy and individual job support to increase work participa- tion in common mental disorders: a randomised controlled multicentre trial. Occup Environ Med 2015;72:745-752.
  49. Lones CE et al. Individual placement and support (IPS) for methadone maintenance therapy patients: a pilot ran- domized controlled trial. Adm Policy Ment Health 2017;44:359-364.
  50. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ 2003;327:557-560.
  51. Bond GR, Drake RE, Pogue JA. Expanding Individual Placement and Support to populations with conditions and disorders other than serious mental illness. Psychiatr Serv 2019;70:488-498.
  52. Drake RE, Becker DR, Bond GR. Introducing individual placement and support (IPS) supported employment in Japan. Psychiatry Clin. Neurosci. 2018;73:47-49.

Cited by

Sorted by citations

Authors
Brinchmann, B., Widding‐Havneraas, T., Modini, M., Rinaldi, M., Moe, C. F., McDaid, D., Park, A., Killackey, E., Harvey, S. B., & Mykletun, A.
Affiliations
  • Nordland Hospital Trust (NO)
  • Haukeland University Hospital (NO)
  • The University of Sydney (AU)
  • South West London and St George's Mental Health NHS Trust (GB)
  • London School of Economics and Political Science (GB)
  • The University of Melbourne (AU)
  • Black Dog Institute (AU)
  • Norwegian Institute of Public Health (NO)
Corresponding author
Brinchmann, B.
ORCID
Venue
Acta Psychiatrica Scandinavica
Publisher
Wiley
Published
2019-12-19
Volume
141
Issue
3
Pages
206-220
ISSN
  • 0001-690X (ISSN-L)
  • 1600-0447
DOI
10.1111/acps.13129
OpenAlex
W2987143591
Cited by
134
References
13
Citations by year
2026: 22 · 2025: 20 · 2024: 23 · 2023: 14 · 2022: 24 · 2021: 24 · 2020: 7
FWCI
3.61
Type
journal article
Language
en
Open access
Licence
Locations
  • Acta Psychiatrica Scandinavica (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • London School of Economics and Political Science Theses Online (London School of Economics and Political Science) (acceptedVersion)
  • London School of Economics and Political Science Research Online (London School of Economics and Political Science) (acceptedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • NORA - Norwegian Open Research Archives (submittedVersion, other-oa)
  • NORA - Norwegian Open Research Archives (submittedVersion, cc-by)
Funders
  • Norges Forskningsråd (273665, 280589, 227097)
  • icare
  • NSW Ministry of Health
Topics
  • Social Sciences › Safety Research › Disability Education and Employment
  • Health Sciences › Medicine › Psychiatry and Mental health › Schizophrenia research and treatment
  • Health Sciences › Health Professions › General Health Professions › Employment and Welfare Studies
Keywords
Individual Placement and Support, severe mental illness, competitive employment, vocational rehabilitation, generalizability of evidence, disability benefits
MeSH terms
Asia, Australia, Mental Disorders, Employment, Europe, Humans, North America, Randomized Controlled Trials as Topic, Employment, Supported, Policy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review