Effective components of feedback from Routine Outcome Monitoring (ROM) in youth mental health care: study protocol of a three-arm parallel-group randomized controlled trial
Open accessAbstract
BACKGROUND: Routine Outcome Monitoring refers to regular measurements of clients' progress in clinical practice, aiming to evaluate and, if necessary, adapt treatment. Clients fill out questionnaires and clinicians receive feedback about the results. Studies concerning feedback in youth mental health care are rare. The effects of feedback, the importance of specific aspects of feedback, and the mechanisms underlying the effects of feedback are unknown. In the present study, several potentially effective components of feedback from Routine Outcome Monitoring in youth mental health care in the Netherlands are investigated. METHODS/DESIGN: We will examine three different forms of feedback through a three-arm parallel-group randomized controlled trial. 432 children and adolescents (aged 4 to 17 years) and their parents, who have been referred to mental health care institution Pro Persona, will be randomly assigned to one of three feedback conditions (144 participants per condition). Randomization will be stratified by age of the child or adolescent and by department. All participants fill out questionnaires at the start of treatment, one and a half months after the start of treatment, every three months during treatment, and at the end of treatment. Participants in the second and third feedback conditions fill out an additional questionnaire. In condition 1, clinicians receive basic feedback regarding clients' symptoms and quality of life. In condition 2, the feedback of condition 1 is extended with feedback regarding possible obstacles to a good outcome and with practical suggestions. In condition 3, the feedback of condition 2 is discussed with a colleague while following a standardized format for case consultation. The primary outcome measure is symptom severity and secondary outcome measures are quality of life, satisfaction with treatment, number of sessions, length of treatment, and rates of dropout. We will also examine the role of being not on track (not responding to treatment). DISCUSSION: This study contributes to the identification of effective components of feedback and a better understanding of how feedback functions in real-world clinical practice. If the different feedback components prove to be effective, this can help to support and improve the care for youth. TRIAL REGISTRATION: Dutch Trial Register NTR4234.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Formal and informal support classifications were derived from similar British and international studies of service use.
“Formal and informal support classifications were derived from similar British23 and international studies of service use.29”
From Support received after bereavement by suicide and other sudden deaths: A cross-sectional UK study of 3432 young bereaved adults (2017) · cites this paper as [23]
Young adults tend to avoid accessing mental health services.
“We focused on young adults given concerns about their vulnerabilities to suicide,22 their tendency to avoid accessing mental health services23 and their priority status within UK suicide prevention strategies.4–6”
From Support received after bereavement by suicide and other sudden deaths: A cross-sectional UK study of 3432 young bereaved adults (2017) · cites this paper as [23]
Gender differences in help-seeking for mental illness exist, particularly in relation to informal support.
“Given gender differences in help-seeking for mental illness,22 particularly in relation to informal support,23”
From Support received after bereavement by suicide and other sudden deaths: A cross-sectional UK study of 3432 young bereaved adults (2017) · cites this paper as [23]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Statistical power analyses using G∗Power 3.1: tests for correlation and regression analyses
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.1149 · Cited by 37,615 · see citing works
A Theory of Cognitive Dissonance
Festinger, L. (1957) · doi:10.1515/9781503620766 · Cited by 24,241 · see citing works
A Theory of Cognitive Dissonance
Morvan, C., & O’Connor, A. (2017) · Macat Library eBooks · doi:10.4324/9781912282432 · Cited by 18,284 · see citing works
The Strengths and Difficulties Questionnaire: A research note
Goodman, R. (1997) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.1997.tb01545.x · Cited by 14,908 · see citing works
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371 · see citing works
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883 · see citing works
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770 · see citing works
Kluger, A. N., & DeNisi, A. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.119.2.254 · Cited by 5,882 · see citing works
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485 · see citing works
Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987) · Psychological Bulletin · doi:10.1037/0033-2909.101.2.213 · Cited by 5,436 · see citing works
A Theory of Goal Setting and Task Performance
Tosi, H. L., Locke, E. A., & Latham, G. P. (1991) · Academy of Management Review · doi:10.2307/258875 · Cited by 4,840 · see citing works
Tosi, H. L. (1991) · Academy of Management Review · doi:10.5465/amr.1991.4278976 · Cited by 4,147 · see citing works
CONSORT 2010 statement: updated guidelines for reporting parallel group randomized trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group* (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-152-11-201006010-00232 · Cited by 3,824 · see citing works
Carver, C. S., & Scheier, M. F. (1982) · Psychological Bulletin · doi:10.1037//0033-2909.92.1.111 · Cited by 2,650 · see citing works
Consequences of individual feedback on behavior in organizations.
Ilgen, D. R., Fisher, C. D., & Taylor, M. S. (1979) · Journal of Applied Psychology · doi:10.1037/0021-9010.64.4.349 · Cited by 1,822 · see citing works
Kazdin, A. E. (2008) · American Psychologist · doi:10.1037/0003-066x.63.3.146 · Cited by 1,112 · see citing works
Stone, L. L., Otten, R., Engels, R. C. M. E., Vermulst, A. A., & Janssens, J. M. A. M. (2010) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-010-0071-2 · Cited by 1,031 · see citing works
Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE–OM
Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.1.51 · Cited by 934 · see citing works
The Strengths and Difficulties Questionnaire (SDQ)
Muris, P., Meesters, C., & van den Berg, F. (2003) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-003-0298-2 · Cited by 920 · see citing works
Audit and feedback: effects on professional practice and health care outcomes
Jamtvedt, G., Young, J. M., Kristoffersen, D. T., O'Brien, M. A., & Oxman, A. D. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub2 · Cited by 912 · see citing works
Ravens-Sieberer, U., Gosch, A., Rajmil, L., Erhart, M., Bruil, J., Power, M., Duer, W., Auquier, P., Cloetta, B., Czemy, L., et al. (2008) · Value in Health · doi:10.1111/j.1524-4733.2007.00291.x · Cited by 807 · see citing works
Valderas, J. M., Kotzeva, A., Espallargues, M., Guyatt, G., Ferrans, C. E., Halyard, M. Y., Revicki, D. A., Symonds, T., Parada, A., & Alonso, J. (2008) · Quality of Life Research · doi:10.1007/s11136-007-9295-0 · Cited by 775 · see citing works
Dutch version of the Strengths and Difficulties Questionnaire (SDQ)
van Widenfelt, B. M., Goedhart, A. W., Treffers, P. D. A., & Goodman, R. (2003) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-003-0341-3 · Cited by 691 · see citing works
Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0019247 · Cited by 657 · see citing works
Is it time for clinicians to routinely track patient outcome? A meta-analysis
Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpg025 · Cited by 608 · see citing works
Impact of patient‐reported outcome measures on routine practice: a structured review
Marshall, S., Haywood, K., & Fitzpatrick, R. (2006) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2006.00650.x · Cited by 602 · see citing works
A lab test and algorithms for identifying clients at risk for treatment failure.
Hannan, C. R., Lambert, M., Harmon, C., Nielsen, S. L., Smart, D., Shimokawa, K., & Sutton, S. (2005) · Journal of Clinical Psychology · doi:10.1002/jclp.20108 · Cited by 550 · see citing works
Lambert, M. (2007) · Psychotherapy Research · doi:10.1080/10503300601032506 · Cited by 461 · cited 1× · see citing works
“Subsequently, clinicians are provided with feedback about their clients’ response to treatment [11].”
BackgroundBickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011) · Psychiatric Services · doi:10.1176/appi.ps.002052011 · Cited by 421 · see citing works
Mortality, ADHD, and Psychosocial Adversity in Adults With Childhood ADHD: A Prospective Study
Barbaresi, W. J., Colligan, R. C., Weaver, A. L., Voigt, R. G., Killian, J. M., & Katusic, S. K. (2013) · Pediatrics · doi:10.1542/peds.2012-2354 · Cited by 401 · see citing works
Whipple, J. L., Lambert, M. J., Vermeersch, D. A., Smart, D. W., Nielsen, S. L., & Hawkins, E. J. (2003) · Journal of Counseling Psychology · doi:10.1037/0022-0167.50.1.59 · Cited by 374 · see citing works
Effects of feedback of information on clinical practice: a review.
Mugford, M., Banfield, P., & O'Hanlon, M. (1991) · BMJ · doi:10.1136/bmj.303.6799.398 · Cited by 333 · see citing works
Prevention of Treatment Failure: The Use of Measuring, Monitoring, and Feedback in Clinical Practice
Lambert, M. (2010) · American Psychological Association eBooks · doi:10.1037/12141-000 · Cited by 328 · see citing works
Lambert, M. J., Harmon, C., Slade, K., Whipple, J. L., & Hawkins, E. J. (2004) · Journal of Clinical Psychology · doi:10.1002/jclp.20113 · Cited by 326 · see citing works
Hatfield, D., McCullough, L., Frantz, S. H. B., & Krieger, K. (2010) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.656 · Cited by 321 · see citing works
Routine outcome monitoring and feedback on physical or mental health status: evidence and theory
Carlier, I. V. E., Meuldijk, D., van Vliet, I. M., van Fenema, E. M., van der Wee, N. J. A., & Zitman, F. G. (2010) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01543.x · Cited by 275 · see citing works
Feedback to clinicians: Theory, research, and practice
Sapyta, J. J., Riemer, M., & Bickman, L. (2004) · Journal of Clinical Psychology · doi:10.1002/jclp.20107 · Cited by 273 · see citing works
A Measurement Feedback System (MFS) Is Necessary to Improve Mental Health Outcomes
Hamilton, J. D., & Bickman, L. (2008) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e3181825af8 · Cited by 270 · see citing works
The partners for change outcome management system
Miller, S. D., Duncan, B. L., Sorrell, R., & Brown, G. S. (2004) · Journal of Clinical Psychology · doi:10.1002/jclp.20111 · Cited by 264 · see citing works
Effect of feedback of treatment outcome in specialist mental healthcare: meta-analysis
Knaup, C., Koesters, M., Schöfer, D., Becker, T. M., & Puschner, B. (2009) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.108.053967 · Cited by 264 · see citing works
de Jong, K., van Sluis, P., Nugter, A., Heiser, W. J., & Spinhoven, P. (2012) · Psychotherapy Research · doi:10.1080/10503307.2012.673023 · Cited by 250 · see citing works
Agreement of informants on emotional and behavioral problems from childhood to adulthood.
van der Ende, J., Verhulst, F. C., & Tiemeier, H. W. (2011) · Psychological Assessment · doi:10.1037/a0025500 · Cited by 246 · see citing works
The therapeutic effects of providing patient progress information to therapists and patients
Hawkins, E. J., Lambert, M. J., Vermeersch, D. A., Slade, K. L., & Tuttle, K. C. (2004) · Psychotherapy Research · doi:10.1093/ptr/kph027 · Cited by 230 · see citing works
Patient participation in the consultation process: A structured review of intervention strategies
Haywood, K. L., Marshall, S., & Fitzpatrick, R. M. (2006) · Patient Education and Counseling · doi:10.1016/j.pec.2005.10.005 · Cited by 227 · see citing works
Do early responders to psychotherapy maintain treatment gains?
Haas, E., Hill, R., Lambert, M., & Morrell, B. (2002) · Journal of Clinical Psychology · doi:10.1002/jclp.10044 · Cited by 220 · see citing works
Psychotherapy for children and adolescents evidence-based treatments and case examples
Weisz, J. R. (2004) · Cited by 212 · see citing works
Psychotherapy for Children and Adolescents: Evidence-Based Treatments and Case Examples
Weisz, J. R. (2004) · doi:10.1017/cbo9780511734960 · Cited by 202 · see citing works
Warren, J. S., Nelson, P. L., Mondragon, S. A., Baldwin, S. A., & Burlingame, G. M. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0018544 · Cited by 188 · see citing works
Social Psychology and Evaluation
Shackman, G. (2012) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v8i17.333 · Cited by 171 · see citing works
Slade, K., Lambert, M. J., Harmon, S. C., Smart, D. W., & Bailey, R. (2008) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.594 · Cited by 148 · see citing works
Jensen, P. S., Hoagwood, K., & Petti, T. A. (1996) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199608000-00018 · Cited by 138 · see citing works
Simon, W., Lambert, M. J., Harris, M. W., Busath, G., & Vazquez, A. (2012) · Psychotherapy Research · doi:10.1080/10503307.2012.698918 · Cited by 137 · see citing works
Harmon, C., Hawkins, E. J., Lambert, M. J., Slade, K., & Whipple, J. L. (2004) · Journal of Clinical Psychology · doi:10.1002/jclp.20109 · Cited by 93 · see citing works
Claiborn, C. D., & Goodyear, R. K. (2004) · Journal of Clinical Psychology · doi:10.1002/jclp.20112 · Cited by 68 · see citing works
Whipple, J. L., & Lambert, M. J. (2011) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-040510-143938 · Cited by 56 · see citing works
Kazdin, A. E. (1996) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.1996.tb00059.x · Cited by 40 · see citing works
When children with autism become adults
Volkmar, F. R., & Wolf, J. M. (2013) · World Psychiatry · doi:10.1002/wps.20020 · Cited by 37 · see citing works
Ivers, N. M., Tu, K., Francis, J., Barnsley, J. M., Shah, B. R., Upshur, R. E. G., Kiss, A., Grimshaw, J., & Zwarenstein, M. (2010) · Implementation Science · doi:10.1186/1748-5908-5-98 · Cited by 27 · see citing works
Warren, J. S., Nelson, P. L., Burlingame, G. M., & Mondragon, S. A. (2011) · Journal of Clinical Psychology · doi:10.1002/jclp.20831 · Cited by 23 · see citing works
Heiser, W., Spinhoven, P., Nugter, A., & de Jong, K. (2006) · Cited by 11 · see citing works
Boer, F., Mt, M., & Vermeiren, R. R. J. M. (2012) · PubMed · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Impact of Ebola experiences and risk perceptions on mental health in Sierra Leone, July 2015
Jalloh, M. F., Li, W., Bunnell, R. E., Ethier, K. A., O’Leary, A., Hageman, K. M., Sengeh, P., Jalloh, M. B., Morgan, O., Hersey, S., et al. (2018) · BMJ Global Health · doi:10.1136/bmjgh-2017-000471 · Cited by 433 · see citing works
Annual Research Review: Building a science of personalized intervention for youth mental health
Ng, M. Y., & Weisz, J. R. (2016) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12470 · Cited by 291 · see citing works
Stone, L. L., Janssens, J., Vermulst, A. A., der Maten, M. L. J.-V., Engels, R. C. M. E., & Otten, R. (2015) · BMC Psychology · doi:10.1186/s40359-015-0061-8 · Cited by 175 · see citing works
Gondek, D., Edbrooke-Childs, J. H., Fink, E., Deighton, J., & Wolpert, M. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-015-0710-5 · Cited by 159 · see citing works
Tam, H. E., & Ronan, K. R. (2017) · Clinical Psychology Review · doi:10.1016/j.cpr.2017.04.005 · Cited by 97 · see citing works
Maffei, C., Lee, C., Planich, M., Ramprasad, M., Ravi, N., Trainor, D., Urban, Z., Kim, M., Jones, R. J., Henin, A., et al. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2021.118706 · Cited by 87 · see citing works
Pitman, A. L., Rantell, K., Moran, P., Sireling, L., Marston, L., King, M., & Osborn, D. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-014487 · Cited by 89 · see citing works
Kamulegeya, L., Bwanika, J., Okello, M., Rusoke, D., Nassiwa, F., Lubega, W., Musinguzi, D., & Börve, A. (2023) · African Health Sciences · doi:10.4314/ahs.v23i2.86 · Cited by 111 · see citing works
Adolescent depression and brain development: evidence from voxel-based morphometry
Straub, J., Brown, R. C., Malejko, K., Bonenberger, M., Grön, G., Plener, P. L., & Abler, B. (2019) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.170233 · Cited by 75 · see citing works
Client feedback in psychological therapy for children and adolescents with mental health problems
Bergman, H., Kornør, H., Nikolakopoulou, A., Hanssen‐Bauer, K., Soares‐Weiser, K., Tollefsen, T. K., & Bjørndal, A. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011729.pub2 · Cited by 70 · see citing works
Trevillion, K., Stuart, R., Ocloo, J. E., Broeckelmann, E., Jeffreys, S., Jeynes, T., Allen, D., Russell, J., Billings, J., Crawford, M., et al. (2022) · BMC Psychiatry · doi:10.1186/s12888-021-03605-4 · Cited by 66 · see citing works
Adolescent perceptions of sleep and influences on sleep behaviour: A qualitative study
Godsell, S., & White, J. L. (2019) · Journal of Adolescence · doi:10.1016/j.adolescence.2019.03.010 · Cited by 64 · see citing works
Potentially inappropriate prescribing in dementia: a state-of-the-art review since 2007
Delgado, J., Bowman, K., & Clare, L. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-029172 · Cited by 61 · see citing works
Teesson, M., Champion, K. E., Newton, N. C., KAY‐LAMBKIN, F. J., Chapman, C., Thornton, L. K., Slade, T. N., Sunderland, M., Mills, K. L., Gardner, L. A., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-035662 · Cited by 58 · see citing works
Somvanshi, P. R., Mellon, S. H., Yehuda, R., Flory, J. D., Makotkine, I., Bierer, L., Marmar, C., Jett, M., & Doyle, F. J. (2020) · American Journal of Physiology-Endocrinology and Metabolism · doi:10.1152/ajpendo.00398.2019 · Cited by 55 · see citing works
Kamulegeya, L. H., Okello, M., Bwanika, J. M., Musinguzi, D., Lubega, W., Rusoke, D., Nassiwa, F., & Börve, A. (2019) · doi:10.1101/826057 · Cited by 111 · see citing works
Interface of Multiple Sclerosis, Depression, Vascular Disease, and Mortality
Palladino, R., Chataway, J., Majeed, A., & Marrie, R. A. (2021) · Neurology · doi:10.1212/wnl.0000000000012610 · Cited by 52 · see citing works
Metz, M. J., Franx, G. C., Veerbeek, M., de Beurs, E., Feltz-Cornelis, C. M. V. D., & Beekman, A. T. F. (2015) · BMC Psychiatry · doi:10.1186/s12888-015-0696-2 · Cited by 36 · see citing works
Horsch, A., Gilbert, L., Lanzi, S., Gross, J., Kayser, B., Vial, Y., Siméoni, U., Hans, D. B., Berney, A., Scholz, U., et al. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-020462 · Cited by 36 · see citing works
Ingram, W. M., Baker, A. M., Bauer, C. R., Brown, J. P., Goes, F. S., Larson, S. L., & Zandi, P. P. (2020) · Neurology Psychiatry and Brain Research · doi:10.1016/j.npbr.2020.02.002 · Cited by 32 · see citing works
Horsch, A., Jacobs, I., Gilbert, L., Favrod, C., Schneider, J., Harari, M. M., & Graz, M. B. (2017) · BMJ Paediatrics Open · doi:10.1136/bmjpo-2017-000059 · Cited by 33 · see citing works
Effects in language development of young children with language delay during early intervention
Vermeij, B. A. M., Wiefferink, C. H., Knoors, H. E. T., & Scholte, R. H. J. (2023) · Journal of Communication Disorders · doi:10.1016/j.jcomdis.2023.106326 · Cited by 58 · see citing works
James, A. C., Wotton, C. J., Duffy, A. C., Hoang, U., & Goldacre, M. J. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.06.018 · Cited by 27 · see citing works
van Sonsbeek, M. A. M. S., Hutschemaekers, G. J. M., Veerman, J. W., Vermulst, A. A., Kleinjan, M., & Tiemens, B. G. (2020) · Child & Youth Care Forum · doi:10.1007/s10566-020-09574-1 · Cited by 24 · see citing works
Self-citationSivarajkumar, S., Tam, T. Y. C., Mohammad, H. A., Viggiano, S., Oniani, D., Visweswaran, S., & Wang, Y. (2024) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocae177 · Cited by 24 · see citing works
Sosu, E., & Schmidt, P. (2016) · Journal of Psychoeducational Assessment · doi:10.1177/0734282916655503 · Cited by 23 · see citing works
Welsh, J., Korda, R., Joshy, G., Butterworth, P., Brown, A. D. H., & Banks, E. (2017) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2017-209535 · Cited by 21 · see citing works
Russell, K. C., Gillis, H. L. “., Law, L. A., & Couillard, J. (2018) · Child & Youth Care Forum · doi:10.1007/s10566-018-9437-2 · Cited by 20 · see citing works
Association of language, behavior, and parental stress in young children with a language disorder
Vermeij, B. A. M., Wiefferink, C. H., Knoors, H. E. T., & Scholte, R. H. J. (2018) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2018.11.012 · Cited by 18 · see citing works
Nigussie, K., Tesfaye, B., Lemma, A., & Kerebih, H. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-043227 · Cited by 17 · see citing works
Kamin, H. S., McCarthy, A., Abel, M. R., Jellinek, M. S., Baer, L., & Murphy, J. M. (2014) · Child Psychiatry & Human Development · doi:10.1007/s10578-014-0525-8 · Cited by 14 · see citing works
Vermeij, B. A. M., Wiefferink, C. H., Scholte, R. H. J., & Knoors, H. E. T. (2021) · International Journal of Language & Communication Disorders · doi:10.1111/1460-6984.12665 · Cited by 12 · see citing works
Azdi, Z. A., Saif, S. I., Kushal, S. A., Islam, M. T., Maaz, L., Reza, S., Yasmeen, S., Chaklader, M. A., & Amin, Y. M. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-091933 · Cited by 11 · see citing works
Reduction of anxiety after treatment with transdermal clonidine
Ye, L., & Lippmann, S. (2018) · American Journal of Health-System Pharmacy · doi:10.2146/ajhp180064 · Cited by 11 · see citing works
Strijbosch, E., Wissink, I. B., van der Helm, P., & Stams, G. J. J. M. (2018) · Children and Youth Services Review · doi:10.1016/j.childyouth.2018.11.051 · Cited by 11 · see citing works
Understanding discrimination towards persons experiencing homelessness: A scoping review protocol
Canham, S. L., Rose, J., Weldrick, R., Siantz, E., Casucci, T., & McFarland, M. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-066522 · Cited by 9 · see citing works
Internet Access for Patients on Psychiatric Units.
Morris, N. P. (2018) · PubMed · doi:10.29158/jaapl.003760-18 · Cited by 9 · see citing works
Lamers, A., van Nieuwenhuizen, C., Siebelink, B. M., Blaauw, T., & Vermeiren, R. R. J. M. (2015) · Child and Adolescent Psychiatry and Mental Health · doi:10.1186/s13034-015-0049-4 · Cited by 8 · see citing works
Lusk, S. L., Koch, L. C., & Paul, T. M. (2016) · Rehabilitation Research Policy and Education · doi:10.1891/2168-6653.30.3.243 · Cited by 8 · see citing works
Pilot study of a ketogenic diet in bipolar disorder: a process evaluation
Rigby, B. P., Needham, N., Grossi, H., Kamenská, I., Campbell, I. H., Meadowcroft, B., Creasy, F., Fisher, C., Bahuguna, P., Norrie, J. D., et al. (2025) · BMC Psychiatry · doi:10.1186/s12888-025-06479-y · Cited by 7 · see citing works
Welsh, J., Banks, E., Joshy, G., Butterworth, P., Strazdins, L., & Korda, R. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-039628 · Cited by 5 · see citing works
Ricardo, Y. L., Zamora, M. C. R., Hernández, J. P., & Martínez, C. R. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-052704 · Cited by 7 · see citing works
Peer support for youth suicide prevention: a scoping review protocol
Hilario, C. T., Kamanzi, J., Kennedy, M., Gilchrist, L., & Richter, S. M. (2021) · BMJ Open · doi:10.1136/bmjopen-2021-048837 · Cited by 6 · see citing works
Zhu, S., Yang, C., Chen, S., Kang, L., Li, T., Li, J., & Li, L. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-064416 · Cited by 6 · see citing works
Su, L., Lu, Z., Shi, S., & Xu, Y. (2018) · General Psychiatry · doi:10.1136/gpsych-2018-000016 · Cited by 6 · see citing works
Metz, M. J., Elfeddali, I., Krol, D. H. G., Veerbeek, M., de Beurs, E., Beekman, A. T. F., & Feltz-Cornelis, C. M. V. D. (2017) · BMC Psychiatry · doi:10.1186/s12888-017-1247-9 · Cited by 6 · see citing works
Cooper, R. E., Saunders, K. R. K., Greenburgh, A., Shah, P., Appleton, R., Machin, K., Jeynes, T., Barnett, P., Allan, S. M., Griffiths, J., et al. (2023) · medRxiv · doi:10.1101/2023.10.23.23297394 · Cited by 6 · see citing works
Hautmann, C., Rausch, J., Geldermann, N., Oswald, F., Gehlen, D., Hellmich, M., Rosenberger, K. D., Samel, C., Woitecki, K., Walter, D., et al. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03502-w · Cited by 5 · see citing works
Patel, K., Moukhtarian, T. R., Russell, S., Daly, G. B. J., Walasek, L., Tang, N. K. Y., Toro, C. T., & Meyer, C. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-060545 · Cited by 5 · see citing works
Uddin, M. N., & Islam, A. F. M. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-034523 · Cited by 5 · see citing works
Vermeij, B. A. M., Wiefferink, C. H., Scholte, R. H. J., & Knoors, H. E. T. (2022) · Frontiers in Communication · doi:10.3389/fcomm.2022.1011175 · Cited by 4 · see citing works
Ledden, S., Rains, L. S., Schlief, M., Barnett, P., Ching, B. C. F., Hallam, B., Günak, M. M., Steare, T., Parker, J., Labovitch, S., et al. (2021) · medRxiv · doi:10.1101/2021.12.07.21267399 · Cited by 4 · see citing works
Areshenkoff, C. N., de Brouwer, A. J., Gale, D. J., Nashed, J. Y., Flanagan, J. R., Smallwood, J., & Gallivan, J. P. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.07.01.547344 · Cited by 4 · see citing works
The anomalous effect of COVID-19 pandemic restrictions on the duration of untreated psychosis
Nicholls-Mindlin, J., Hazan, H., Zhou, B., Li, F., Ferrara, M., Levine, N., Riley, S., Karmani, S., Mathis, W. S., Keshavan, M. S., et al. (2024) · BJPsych Open · doi:10.1192/bjo.2024.813 · Cited by 3 · see citing works
Hajek, A., & König, H. (2022) · BMJ Open · doi:10.1136/bmjopen-2022-061525 · Cited by 3 · see citing works
A cross-sectional MR study of body fat volumes and distribution in chronic schizophrenia
Osimo, E. F., Brugger, S. P., Thomas, E. L., & Howes, O. D. (2022) · Schizophrenia · doi:10.1038/s41537-022-00233-z · Cited by 3 · see citing works
Sintayehu, D., Zerihun, T., & Bacha, T. (2025) · medRxiv · doi:10.1101/2025.03.18.25324208 · Cited by 3 · see citing works
Yu-Lefler, H. F., Marsteller, J. A., & Riley, A. W. (2022) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-022-01196-0 · Cited by 2 · see citing works
van Benthem, P., Spijkerman, R., Blanken, P., Boon, A. E., Vermeiren, R. R. J. M., & Hendriks, V. M. (2023) · European Addiction Research · doi:10.1159/000528355 · Cited by 2 · see citing works
Les troubles maniaco-dépressifs à l’adolescence : aspects cliniques
Balsan, G., & Corcos, M. (2016) · Archives de Pédiatrie · doi:10.1016/j.arcped.2015.12.006 · Cited by 2 · see citing works
Adebusoye, L. A., Oyinlola, O., & Cadmus, E. (2023) · medRxiv · doi:10.1101/2023.06.20.23291667 · Cited by 2 · see citing works
Gebreegziabher, Z. A., Eristu, R., & Molla, A. (2023) · medRxiv · doi:10.1101/2023.01.27.23285096 · Cited by 2 · see citing works
Khan, K., Babbage, C. M., Sprange, K., Hall, C. L., Parker, A., Greenhalgh, C., Jeffery, M., Lucassen, M. F. G., Merry, S., Prasad, V., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-092483 · Cited by 1 · see citing works
Upadhyaya, A., Topan, R., Pandya, S., Williams, S., Fragkos, K., Zarate-Lopez, N., Roukas, C., Mihaylova, B., & Fikree, A. (2025) · Frontline Gastroenterology · doi:10.1136/flgastro-2025-103250 · Cited by 1 · see citing works
Gibbs, A., Chirwa, E. D., Harling, G., Chimbindi, N., Dreyer, J., Herbst, C., Okesola, N., Behuhuma, N. O., Mthiyane, N., Baisley, K. J., et al. (2025) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000003709 · Cited by 1 · see citing works
Martin, K.-L., Jindani, F., Turner, N. E., & DeSouza, J. F. X. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/359257 · Cited by 1 · see citing works
Heart Rate fractality disruption as a footprint of subthreshold depressive symptomsPreprint
Mandarano, P., Ossola, P., Marazzi, P., Carsillo, M., Rozzi, S., & Lazzeroni, D. (2021) · medRxiv · doi:10.1101/2021.12.28.21268480 · Cited by 1 · see citing works
Areshenkoff, C. N., de Brouwer, A. J., Gale, D. J., Nashed, J. Y., & Gallivan, J. P. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.08.16.504134 · Cited by 1 · see citing works
Zungu, N. P., Makusha, T., Makola, L., Mabaso, M., & Shisana, O. (2023) · medRxiv · doi:10.1101/2023.08.11.23293980 · Cited by 1 · see citing works
Psychological Impact of the 2023 Kahramanmaraş Earthquakes on Non-VictimsPreprint
Çınaroğlu, M., Yılmazer, E., Alpuğan, Z., & Sayar, G. H. (2024) · medRxiv · doi:10.1101/2024.07.31.24311268 · Cited by 1 · see citing works
A Multi-Symptom Circuit Architecture of Obsessive–Compulsive DisorderPreprint
Hollunder, B., Meyer, G. M., Li, N., Reinhardt, P., Sahin, I. A., Rajamani, N., Pijar, J., Nombela, C., Mosley, P. E., Acevedo, N., et al. (2025) · medRxiv · doi:10.64898/2025.12.14.25342121 · Cited by 1 · see citing works
Predicting Self-harm Incidents Following Inpatient Visits using Disease Comorbidity NetworkPreprint
Xu, Z., Zhang, Q., & Yip, P. S. F. (2020) · medRxiv · doi:10.1101/2020.02.03.20019331
Evaluating a Tree of Life group for individuals with Multiple Sclerosis
Coppock, C., Adlington, R., Fisher, K., & MacCormack, M. (2019) · Health Psychology Update · doi:10.53841/bpshpu.2019.28.1.4
Bauermeister, S., Reid, G., Yehuda, M. B., Howgego, G., Ritchie, K. A., Watermeyer, T. J., Gregory, S., Terrera, G. M., & Koychev, I. G. (2023) · medRxiv · doi:10.1101/2023.01.31.23285252
Kumpulainen, V., Kataja, E., Pulli, E. P., Copeland, A., Silver, E. A., Häikiö, T., Saukko, E., Korja, R., Karlsson, L., Karlsson, H., et al. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.11.01.565103
Constantino-Pettit, A. M., Tillman, R., Wilson, J., Lashley-Simms, N., Vatan, N. M., Atkinson, A., Leverett, S. D., Lenze, S. N., Smyser, C. D., Bogdan, R., et al. (2024) · medRxiv · doi:10.1101/2024.04.09.24305545
A Scoping Review on Client-Focused Feedback System in Psychotherapy: Routine Outcome Monitoring
ÖZTÜRK, İ., & Yorulmaz, O. (2024) · Psikiyatride Guncel Yaklasimlar - Current Approaches in Psychiatry · doi:10.18863/pgy.1414793
Eager, S., Baldwin, H., McCrone, P., McDaid, D., Stefanidou, T., Shah, P., Jeffreys, S., Rojas‐García, A., Jarvis, R. R., Chipp, B., et al. (2024) · medRxiv · doi:10.1101/2024.12.14.24318998
Türközer, H. B., Karcher, N. R., Clauss, J. A., Nordentoft, M., Lewandowski, K. E., Roffman, J. L., & Öngür, D. (2025) · medRxiv · doi:10.1101/2025.01.31.25321486
Glossop, Z., Čermáková, A. L., Marshall, P., Rayson, P., Robinson, H., Semino, E., & Lobban, F. (2025) · medRxiv · doi:10.1177/20552076261458957
Nath, B., Desai, R., Cook, J. M., Dziura, J. D., Davis‐Plourde, K. L., Youins, R., Guy, K., Pavlo, A. J., Smith, P. E., Smith, P. D., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2025-103775
Kadak, K., Momi, D., Wang, Z., Bastiaens, S. P., Oveisi, M. P., Morshedzadeh, T., Ismail, M., Fousek, J., & Griffiths, J. D. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.06.17.660153
Wong, Z. Z. B., Soh, Q. X., Mau, A. W. K., Xia, W. H., & Soh, Q. R. (2026) · Cognitive Neuropsychiatry · doi:10.1080/13546805.2026.2672448
Catalão, R., Kebede, L., Mulushoa, A., Eshetu, T., Medhin, G., Abdella, A., Alem, A., Keynejad, R. C., Sandall, J., Howard, L. M., et al. (2025) · PLoS ONE · doi:10.1371/journal.pone.0319362
Moss, S. J., Chacon, C. Z., Hekmati, F. B., Siddiqui, S. A., Stelfox, M., Ahmed, S. B., Birnie, K. A., Halperin, B. A., Halperin, S. A., Tutelman, P. R., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2023-083285
Opondo, C. O., Kamadi, J., Amisi, J. A., Camplain, R. L., Pastakia, S. D., Gletsu-Miller, N. A., Ludema, C., & Rosenberg, M. S. (2026) · medRxiv · doi:10.64898/2026.07.23.26358808
Nandwana, V., Bajpai, G., Sun, C.-F., Kablinger, A. S., & Shah, A. K. (2026) · BMJ Neurology Open · doi:10.1136/bmjno-2025-001473
- Authors
- van Sonsbeek, M. A., Hutschemaekers, G. G., Veerman, J. W., & Tiemens, B. B.
- Affiliations
- Radboud University Nijmegen (NL)
- Venue
- BMC Psychiatry
- Published
- 2014-01-06
- Volume
- 14
- Issue
- 1
- Pages
- 3-3
- ISSN
- 1471-244X (ISSN-L)
- PMC
- PMC3898381
- OpenAlex
- W1999393136
- Cited by
- 86
- References
- 61
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 6 · 2023: 10 · 2022: 10 · 2021: 9 · 2020: 7 · 2019: 3 · 2018: 10 · 2017: 5 · 2016: 4 · 2015: 5 · 2014: 1
- FWCI
- 5.90
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- BMC Psychiatry (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Radboud Repository (Radboud University) (submittedVersion)
- Radboud Repository (Radboud University) (submittedVersion, other-oa)
- Funders
- ZonMw (157031002, 80-82470-98-006, 159010001)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Clinical Psychology › Psychiatric care and mental health services
- Social Sciences › Psychology › Social Psychology › Mental Health Treatment and Access
- Keywords
- routine outcome monitoring, clinician feedback, youth mental health care, children and adolescents, symptom severity, quality of life, treatment discontinuation, treatment response, case consultation, treatment satisfaction
- MeSH terms
- Adolescent, Child, Feedback, Female, Humans, Male, Mental Health, Netherlands, Parents, Quality of Life, Surveys and Questionnaires, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review