Outcome Rating Scale and Session Rating Scale in psychological practice: Clinical utility of ultra-brief measures
The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
The validity and reliability of the Outcome Rating Scale (ORS) and the Session Rating Scale (SRS) were evaluated against existing longer measures, including the Outcome Questionnaire-45, Working Alliance Inventory, Depression Anxiety Stress Scale-21, Quality of Life Scale, Rosenberg Self-Esteem Scale and General Self-efficacy Scale. The measures were administered to patients referred for psychological services to a rural primary health-care service. Participants were recruited from both current and new patients of psychologists providing the service. Both the ORS and SRS demonstrated good reliability and concurrent validity with their longer alternatives. The ORS also evidenced significant correlations with measures of self-esteem, self-efficacy, and quality of life. The ORS and SRS offer benefits such as cost-effectiveness, brevity, simple administration, and easy interpretation of results in the measurement of clinical outcomes when compared to their longer counterparts. These results provide clear support for the adoption of brief outcome assessment measures in psychological practice.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The ORS correlates highly with lengthier, traditional outcome measures such as OQ-45 and the Quality of Life Scale (QOLS) [29].”
From Artificial intelligence framework for simulating clinical decision-making: A Markov decision process approach (2013) · cites this paper as [29]
In the citing paper
“The SRS was shown to have high test–retest and internal consistency reliability, as well as acceptable validity [100, 101].”
Citations
Cites
Lovibond, P. F., & Lovibond, S. H. (1995) · Behaviour Research and Therapy · doi:10.1016/0005-7967(94)00075-u · Cited by 14,523 · cited 2×
“Scores are generated for each subscale and then doubled so that interpretations can be made based on the 42-item DASS scoring method (Lovibond & Lovibond, 1995).”
MethodAntony, M. M., Bieling, P. J., Cox, B. J., Enns, M. W., & Swinson, R. P. (1998) · Psychological Assessment · doi:10.1037/1040-3590.10.2.176 · Cited by 4,874 · cited 1×
“The factor structure of the DASS is well established (Antony et al., 1998; Norton, 2007).”
Development and validation of the working alliance inventory
Horvath, A. O., & Greenberg, L. S. (1989) · Journal of Counseling Psychology · doi:10.1037//0022-0167.36.2.223 · Cited by 3,520 · cited 1×
“The 12-item WAI is a short form of the original 36-item patient version and is scored on a 7-point Likert scale (1¼ does not correspond, 7¼ corresponds exactly) (Horvath & Greenberg, 1989).”
Factor structure of the working alliance inventory
Tracey, T. J., & Kokotovic, A. M. (1989) · Psychological Assessment: A Journal of Consulting and Clinical Psychology · doi:10.1037/1040-3590.1.3.207 · Cited by 1,501 · cited 1×
“The four highest-loading items on the Task, Bond, and Goal subscales were used to form the WAI-Short, and each subscale demonstrates strong internal consistency estimates (a¼ .90, .92, and .90, respectively) (Tracey & Kokotovic, 1989).”
Health and quality of life outcomes
Jolly, M., Sequeira, W., & Block, J. A. (2014) · Health and Quality of Life Outcomes · doi:10.1186/s12955-014-0173-5 · Cited by 719
Depression Anxiety and Stress Scales (DASS-21): Psychometric analysis across four racial groups
Norton, P. J. (2007) · Anxiety, Stress, & Coping · doi:10.1080/10615800701309279 · Cited by 708 · cited 1×
“The factor structure of the DASS is well established (Antony et al., 1998; Norton, 2007).”
Miller, S. D., Duncan, B. L., & Brown, J. (2003) · Cited by 580
King, R. (2008) · Cited by 458
Optimism, Vulnerability, and self-beliefs as health-related cognitions: A systematic overview
Schwarzer, R. (1994) · Psychology & Health · doi:10.1080/08870449408407475 · Cited by 383 · cited 2×
“93) and validity estimates have been reported for the German version (Schwarzer, 1994).”
Interchangeability of the Working Alliance Inventory and Working Alliance Inventory, Short Form.
Busseri, M. A., & Tyler, J. D. (2003) · Psychological Assessment · doi:10.1037/1040-3590.15.2.193 · Cited by 337 · cited 1×
“Concurrent validity estimates suggest a strong relationship between WAI and WAI-12 subscale and total scores (Busseri & Tyler, 2003).”
Research works printed but not linked: 6
- Campbell A., 2005, Paper presented at the Australian Counselling and Supervision Conference
- Duncan B. L., 2003, Journal of Brief Therapy, 3, 3
- Miller S. D., 2000, The Outcome and Session Rating Scales: Administration and scoring manuals
- Miller S. D., 2003, Journal of Brief Therapy, 2, 91
- Stedman T., 1997, Measuring consumer outcomes in mental health
- 2006, About outcome measurement, 2006
Cited by
Bennett, C. C., & Hauser, K. (2013) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2012.12.003 · Cited by 378
“The ORS correlates highly with lengthier, traditional outcome measures such as OQ-45 and the Quality of Life Scale (QOLS) [29].”
Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0016062 · Cited by 347
Anker, M. G., Owen, J., Duncan, B. L., & Sparks, J. A. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0020051 · Cited by 123
“In an independent investigation, Campbell and Hemsley (2009) found the SRS was correlated with the Working Alliance Inventory, r (cid:1) .63 (Horvath & Greenberg, 1989).”
InfluentialThe Partners for Change Outcome Management System (PCOMS): The Heart and Soul of Change Project.
Duncan, B. L. (2012) · Canadian Psychology / Psychologie canadienne · doi:10.1037/a0027762 · Cited by 117
“The average bivariate correlation between the ORS and OQ across three studies (Bringhurst et al., 2006; Campbell & Hemsley, 2009; Miller et al., 2003) was .62 (range (cid:2) .53–.74), indicating moderately strong concurrent validity (Gillaspy & Murphy, 2011).”
InfluentialDuncan, B. L., & Reese, R. J. (2015) · Psychotherapy · doi:10.1037/pst0000026 · Cited by 114
“…concurrent validity with longer alliance measures; r (cid:2) .48 with the Helping Alliance Questionnaire–II (Duncan et al., 2003), r (cid:2) .63 with the Working Alliance Inventory (Campbell & Hemsley, 2009), and r (cid:2) .65 with the Working Alliance Inventory–Short Revised (Reese et al., 2013).”
Influential
Metadata
- Authors
- Campbell, A., & Hemsley, S.
- Affiliations
- James Cook University (AU)
- Australian Institute of Health and Welfare (AU)
- ORCID
- Campbell, Alistair
- Venue
- Clinical Psychologist
- Publisher
- Informa UK Limited
- Published
- 2009-03-01
- Volume
- 13
- Issue
- 1
- Pages
- 1-9
- ISSN
- 1328-4207 (ISSN-L)
- 1742-9552
- OpenAlex
- W2050131507
- Cited by
- 225
- References
- 25
- Citations by year
- 2026: 9 · 2025: 14 · 2024: 16 · 2023: 20 · 2022: 18 · 2021: 13 · 2020: 21 · 2019: 19 · 2018: 13 · 2017: 15 · 2016: 10 · 2015: 11 · 2014: 10 · 2013: 12 · 2012: 12
- FWCI
- 8.48
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm)
- onlinelibrary.wiley.com/termsAndConditions#vor (vor, 695 d)
- Locations
- Clinical Psychologist (publishedVersion)
- ResearchOnline at James Cook University (James Cook University) (submittedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- Outcome Rating Scale, Session Rating Scale, clinical outcome assessment, concurrent validity, reliability statistics, Outcome Questionnaire-45, Working Alliance Inventory, self-esteem, self-efficacy, quality of life, rural primary care, cost-effectiveness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Outcome Rating Scale and Session Rating Scale in psychological practice: Clinical utility of ultra-brief measures. https://app.cochat.ai/papers/10.1080/13284200802676391
- The paper
- Campbell, A., & Hemsley, S. (2009). Outcome Rating Scale and Session Rating Scale in psychological practice: Clinical utility of ultra-brief measures. Clinical Psychologist. https://doi.org/10.1080/13284200802676391
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.