A model for developing outcome measures from the perspectives of mental health service users
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
It is becoming increasingly recognized that conventionally derived outcome measures in mental health research are problematic. This is both because of the methodology used and because a 'good' outcome is framed from the perspective of clinicians and researchers. This paper describes a methodology for developing outcome measures for use in large studies entirely from the perspective of mental health service users. It is a mixed methods model starting with a participatory and qualitative methodology and proceeding to psychometric testing. At all stages, the researchers are themselves mental health service users. In the first phase of the model, focus groups are convened comprising people who have received the treatment or service being measured. The focus groups meet twice resulting in a draft mixed-methods questionnaire devised from thematic analysis of the focus group data. This is then taken to expert panels, again comprising individuals who have received the treatment or service being evaluated for refinement. Following this, a feasibility study is conducted with N ∼ 50 participants and changes made iteratively to the questionnaire in light of feedback. The final measure is subject to psychometric testing both to ensure it is robust and to explore similarities and differences with conventionally derived measures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
A concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785
Flesch, R. (1948) · Journal of Applied Psychology · doi:10.1037/h0057532 · Cited by 5,391 · cited 1×
“We also assess the reading ease of the instrument to complement the comprehension aspect of the feasibility study (Flesch, 1948).”
MethodThe kappa statistic in reliability studies: use, interpretation, and sample size requirements
Sim, J., & Wright, C. C. (2005) · Physical Therapy · doi:10.1093/ptj/85.3.257 · Cited by 4,093 · cited 1×
“The statistics calculated are Cohen’s kappa (Sim & Wright, 2005) and Lin’s concordance coefficient (Lin, 1989).”
MethodQualitative research in health care: Assessing quality in qualitative research
Mays, N. (2000) · BMJ · doi:10.1136/bmj.320.7226.50 · Cited by 3,742 · cited 1×
“The participants at this meeting check that the analysis captures what they had intended to say – so-called ‘respondent validation’ (Mays & Pope, 2000).”
BackgroundEvaluating patient-based outcome measures for use in clinical trials.
Fitzpatrick, Davey, Buxton, & Jones (1998) · Health Technology Assessment · doi:10.3310/hta2140 · Cited by 1,715 · cited 1×
“However, it is advised that this is important in assessing the acceptability of a measure (Fitzpatrick et al., 1998) and so we add such questions in the feasibility study (above).”
BackgroundCommunity-based participatory research as a tool to advance environmental health sciences
O'Fallon, L. R., & Dearry, A. (2002) · Environmental Health Perspectives · doi:10.1289/ehp.02110s2155 · Cited by 604 · cited 1×
“When participatory research moved into more developed countries the focus was on public health projects designed to empower communities to take control of their own health (O’Fallon & Dearry, 2002).”
BackgroundPatients' perspectives on electroconvulsive therapy: systematic review
Rose, D., Fleischmann, P., Wykes, T., Leese, M., & Bindman, J. (2003) · BMJ · doi:10.1136/bmj.326.7403.1363 · Cited by 497
Self-citationSelecting outcome measures in mental health: the views of service users
Crawford, M. J., Robotham, D., Thana, L., Patterson, S., Weaver, T., Barber, R., Wykes, T., & Rose, D. (2011) · Journal of Mental Health · doi:10.3109/09638237.2011.577114 · Cited by 172
Research works printed but not linked: 20
- Bluthenthal RN, 2006, Ethnicity and Disease, 16, 18
- Boyatzis R, 1998, Transforming Qualitative Information: Thematic Analysis and Code Development
- Cay EL, 1975, Lancet, 305, 29, 10.1016/S0140-6736(75)92384-3 · DOI
- Cornwall A, 1995, Social Science and Medicine, 41, 1667, 10.1016/0277-9536(95)00127-S · DOI · Paper page
- Cronbach L, 1951, Psychometrika, 16, 297, 10.1007/BF02310555 · DOI · Paper page
- Faulkner A, 2002, British Journal of Psychiatry, 180, 1, 10.1192/bjp.180.1.1 · DOI · Paper page
- Fitzpatrick R, 1998, Health Technology Assessments, 2, 14
- Freeman G, 2000, Continuity of Care – A Scoping Exercise
- Gillard S, 2010, Health Expectations, 13, 185, 10.1111/j.1369-7625.2010.00596.x · DOI · Paper page
- Greenfield T, 2004, Psychological Testing: Treatment Planning and Outcome Assessment, 813
- Greenwood K, 2010, Schizophrenia Bulletin, 36, 126, 10.1093/schbul/sbp117 · DOI · Paper page
- Joyce A, 2004, Canadian Journal of Psychiatry, 49, 539, 10.1177/070674370404900805 · DOI
- Mason R, 1996, Canadian Journal of Community Mental Health, 15, 145, 10.7870/cjcmh-1996-0015 · DOI
- Morgan DL, 1993, Successful Focus Groups: Advancing the State of the Art, 10.4135/9781483349008 · DOI · Paper page
- Netemeyer RG, 2003, Scaling Procedures: Issues and Applications, 10.4135/9781412985772 · DOI · Paper page
- Oppenheimer AN, 1966, Questionnaire Design and Attitude Measurement
- Rose D, 2003, Psychiatric Bulletin, 27, 404, 10.1192/pb.27.11.404 · DOI · Paper page
- Rose D, 2008, American Journal of Psychiatric Rehabilitation, 11, 81, 10.1080/15487760801963694 · DOI · Paper page
- Rose D, 2009, Acta Psychiatrica Scandinavica, 119, 320, 10.1111/j.1600-0447.2008.01296.x · DOI · Paper page
- Ware NC, 2003, Mental Health Services Research, 5, 209, 10.1023/A:1026276918081 · DOI
Cited by
Patient involvement in the development of patient‐reported outcome measures: a scoping review
Wiering, B., de Boer, D., & Delnoij, D. (2017) · Health Expectations · doi:10.1111/hex.12442 · Cited by 371
‘Is it worth doing?’ Measuring the impact of patient and public involvement in research
Staley, K. (2015) · Research Involvement and Engagement · doi:10.1186/s40900-015-0008-5 · Cited by 364
Oram, S., Fisher, H. L., Minnis, H., Seedat, S., Walby, S., Hegarty, K., Rouf, K., Angénieux, C., Callard, F., Chandra, P. S., et al. (2022) · The Lancet Psychiatry · doi:10.1016/s2215-0366(22)00008-6 · Cited by 331
Self-citationConnell, J., Carlton, J., Grundy, A., Taylor Buck, E., Keetharuth, A. D., Ricketts, T., Barkham, M., Robotham, D., Rose, D., & Brazier, J. (2018) · Quality of Life Research · doi:10.1007/s11136-018-1847-y · Cited by 311
Self-citationImpact of patient involvement in mental health research: longitudinal study
Ennis, L., & Wykes, T. (2013) · British Journal of Psychiatry · doi:10.1192/bjp.bp.112.119818 · Cited by 283
Self-citation
Metadata
- Authors
- Rose, D., Evans, J., Sweeney, A., & Wykes, T.
- Venue
- International Review of Psychiatry
- Publisher
- Informa UK Limited
- Published
- 2011-02
- Volume
- 23
- Issue
- 1
- Pages
- 41-46
- ISSN
- 0954-0261 (ISSN-L)
- 1369-1627
- OpenAlex
- W2100889218
- Cited by
- 113
- References
- 9
- FWCI
- 14.44
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.