The DOI matches its Crossref record, with a small difference in title or year; 25 of the 26 references it cites were found in a registry or an index.
Psychometric Properties of the Outcome Rating Scale (ORS) in a Spanish Clinical Sample
Open accessAbstract
The Outcome Rating Scale (ORS) is an ultra-brief measure of well-being designed to track outcome in psychotherapy. This research studied the psychometric properties of the ORS in a Spanish clinical sample. One-hundred and sixty-five adult participants from different primary care centers of the city of Barcelona were recruited. The psychometric properties of the ORS in the sample were explored and described, comparing them to the properties of other instruments already validated in Spain. Our results showed good reliability (α = .91 [.88, .93]; α = .96; test re-test correlations from .61 to .84), good validity (convergent validity correlations with distress and symptoms measures from -.32 to -.76), and good sensitivity to change (pre-post comparison through Wilcoxon signed-rank test, Mdnpre = 31.0, Mdnpost = 19.6, z = -7.38, p < .05, r = .42). These results are consistent with previous findings in other countries. We conclude suggesting that the instrument can be applied to monitor outcome in psychotherapy and to test the effectiveness of treatments imparted with Spanish speaking clients. However, further research with the ORS in Spanish could provide more evidence of its psychometric properties.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The Outcome Rating Scale (ORS) was validated in a Spanish population by Moggia et al. (2018).
“Escala de Evaluación de Resultados ( Outcome Rating Scales en inglés, ORS; Miller et al., 2003, adaptado al español por Harris, 2010, validado en población española por Moggia et al., 2018)”
From El Proceso de Aceptación y Adaptación a la Bisexualidad a través de la Terapia Cognitivo-Conductual con Enfoque Afirmativo: Estudio de caso único (2022) · cites this paper as Moggia et al., 2018
The Discussion says this was the first study of the ORS in Spain and that it “seems to be valid” for assessing well-being and psychotherapy outcomes. But the study assessed only a small, nonrandom clinical sample; the authors caution against generalizing and say further research is needed to adapt and standardize the ORS for the Spanish population. Thus, “validated in a Spanish population” overstates the scope and certainty of the finding. (LLM, conf=0.85)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lovibond, P. F., & Lovibond, S. H. (1995) · Behaviour Research and Therapy · doi:10.1016/0005-7967(94)00075-u · Cited by 14,523
Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE–OM
Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002) · British Journal of Psychiatry · doi:10.1192/bjp.180.1.51 · Cited by 934 · cited 1×
“A total score without the risk scale can also be calculated (Evans et al., 2002).”
BackgroundStatistical Inference for Coefficient Alpha
Feldt, L. S., Woodruff, D. J., & Salih, F. A. (1987) · Applied Psychological Measurement · doi:10.1177/014662168701100107 · Cited by 526
Reliability and validity of the Brief Symptom Inventory.
Boulet, J., & Boss, M. W. (1991) · Psychological Assessment · doi:10.1037/1040-3590.3.3.433 · Cited by 503
Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions
Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015) · Psychotherapy Research · doi:10.1080/10503307.2013.817696 · Cited by 494
Self-citationMiller, S. D., Duncan, B. L., & Brown, J. (2003) · Cited by 445
Self-citationAnker, M. G., Duncan, B. L., & Sparks, J. A. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0016062 · Cited by 375
The Approximate Sampling Distribution of Kuder-Richardson Reliability Coefficient Twenty
Feldt, L. S. (1965) · Psychometrika · doi:10.1007/bf02289499 · Cited by 296
Does a continuous feedback system improve psychotherapy outcome?
Reese, R. J., Norsworthy, L. A., & Rowlands, S. (2009) · Psychotherapy · doi:10.1037/a0017901 · Cited by 241
Sanz, J., Perdigón, A. L., & Vázquez, C. (2003) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 235
Campbell, A., & Hemsley, S. (2009) · Clinical Psychologist · doi:10.1080/13284200802676391 · Cited by 225
Sanz, J., Navarro, M. E., & Vázquez, C. (2003) · Dialnet (Universidad de la Rioja) · Cited by 156
Reese, R. J., Usher, E. L., Bowman, D. C., Norsworthy, L. A., Halstead, J., Rowlands, S., & Chisholm, R. (2009) · Training and Education in Professional Psychology · doi:10.1037/a0015673 · Cited by 148
Anker, M. G., Owen, J. J., Duncan, B. L., & Sparks, J. A. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0020051 · Cited by 143
(2006) · Cited by 131
Self-citationBringhurst, D. L., Watson, C. W., Miller, S. D., & Duncan, B. L. (2004) · Defense Technical Information Center (DTIC) · Cited by 100
Self-citationFeixas, G., Trujillo, A., Bados, A., García‐Grau, E., Salla, M., Medina, J. C., Montesano, A., Soriano, J., Medeiros-Ferreira, L., Cañete, J., et al. (2016) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s103079 · Cited by 62
Self-citationProgress monitoring measures: A brief guide.
Overington, L., & Ionita, G. (2012) · Canadian Psychology/Psychologie canadienne · doi:10.1037/a0028017 · Cited by 59
Measuring Feedback From Clients
Janse, P. D., Boezen-Hilberdink, L., van Dijk, M. K., Verbraak, M. J. P. M., & Hutschemaekers, G. J. M. (2013) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000172 · Cited by 44
Hafkenscheid, A., Duncan, B. L., & Miller, S. D. (2010) · Cited by 40
Self-citationLa versión española del CORE-OM: Clinical Outcomes in Routine Evaluation - Outcome Measure
Feixas, G., García‐Grau, E., Bados, A., González, E., Corbella, S., Botella, L., Saúl, L. Á., Trujillo, A., Evans, C., & López-González, M. A. (2012) · Revista de Psicoterapia · doi:10.33898/rdp.v23i89.641 · Cited by 37
Self-citationSeidel, J. A., Andrews, W. P., Owen, J. J., Miller, S. D., & Buccino, D. L. (2016) · Psychological Assessment · doi:10.1037/pas0000311 · Cited by 19
Self-citationDeSantis, B., Jackson, M. J., Duncan, B. L., & Reese, R. J. (2016) · Primary Health Care Research & Development · doi:10.1017/s1463423616000311 · Cited by 17
Munro, L., & Rodwell, J. (2009) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670902721111 · Cited by 14
Bieščad, M., & Timulák, L. (2014) · European Journal of Psychotherapy & Counselling · doi:10.1080/13642537.2014.895772 · Cited by 7
Flagged first, then by citations
1 of the 26 references couldn’t be matched to a known paper.
Research works printed but not linked: 6
- Lovibond, 1995, Manual for Depression, Anxiety, Stress Scales (2nd ed.)
- Donoso, 2006, Chilean adaptation and validation of the Outcome Rating Scale (ORS)
- Beck, 1996, Beck Depression Inventory–II Manual (2nd Ed.)
- Duncan, 2003, The Session Rating Scale: Preliminary psychometric properties of a “working” alliance measure, Journal of Brief Therapy, 3, 3
- Lambert, 1996, Administration and scoring manual for the Outcome Questionnaire (OQ–45.2)
- 1998, CORE System (information management) handbook.
Cited by
Sorted by citations
The impact of poly-traumatization on treatment outcomes in young people with substance use disorders
Karsberg, S., Hesse, M., Pedersen, M. M., Charak, R., & Pedersen, M. U. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03129-x · Cited by 20
Montesano, A., Medina, J. C., Paz, C., García‐Mieres, H., Niño‐Robles, N., García‐Grau, E., Cañete, J., Garcia-Gutierrez, A., Alabèrnia-Segura, M., & Feixas, G. (2021) · Trials · doi:10.1186/s13063-021-05809-1 · Cited by 11
Self-citationPsychometric properties of the Session Rating Scale 3.0 in a Spanish clinical sample
Danilo Moggia, N., Niño‐Robles, N., Miller, S. D., & Feixas, G. (2020) · British Journal of Guidance and Counselling · doi:10.1080/03069885.2020.1778635 · Cited by 7
Self-citationExploring counselling outcomes in New Zealand schools
Manthei, R. J., Tuck, B. F., Crocket, A., Gardiner, B., & Agee, M. (2020) · Counselling and Psychotherapy Research · doi:10.1002/capr.12353 · Cited by 6
Rodríguez Riesco, L., Vivas, S., Ruiz-Duet, A. M., & Pérez-Calvo, C. (2022) · Revista de Psicoterapia · doi:10.33898/rdp.v33i123.1140 · Cited by 4
Systematic Client Feedback: A naturalistic pilot study
Gimeno-Peón, A., Prado-Abril, J., Inchausti, F., Barrio-Nespereira, A., Álvarez-Casariego, M. T., & Duncan, B. L. (2019) · Ansiedad y Estrés · doi:10.1016/j.anyes.2019.04.005 · Cited by 3
Cazauvieilh, C., Gana, K., Miller, S. D., & Quintard, B. (2020) · Current Psychology · doi:10.1007/s12144-020-00992-x · Cited by 3
Self-citationJefferson, L., & Ohrt, J. H. (2023) · Journal of Poetry Therapy · doi:10.1080/08893675.2023.2269316 · Cited by 2
Letourneau, N. L., McManus, C., Novick, J., & Silverstone, A. (2024) · Canadian Journal of Nursing Research · doi:10.1177/08445621241272723 · Cited by 2
Andrade‐González, N., Rodrigo-Holgado, I., Fernández-Rozas, J., Cáncer, P. F., Lahera, G., Fernández-Liria, A., Rubio, G., & Miller, S. D. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.663791 · Cited by 2
Self-citationConducting practice‐based research with a counsellor in private practice
Manthei, R. J., & Tuck, B. F. (2021) · Counselling and Psychotherapy Research · doi:10.1002/capr.12500 · Cited by 1
Cazauvieilh, C. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/t86y4
Infante, M. F. P. (2026) · Revista Mexicana de Trastornos Alimentarios/Mexican Journal of Eating Disorders · doi:10.22201/fesi.20071523e.2026.1.874
Metadata
- Authors
- Moggia, D., Niño-Robles, N., Miller, S. D., & Feixas, G.
- Affiliations
- Universitat de Barcelona (ES)
- Venue
- The Spanish Journal of Psychology
- Publisher
- Cambridge University Press (CUP)
- Published
- 2018
- Volume
- 21
- Pages
- E30-E30
- ISSN
- 1138-7416 (ISSN-L)
- 1988-2904
- OpenAlex
- W2885813501
- Cited by
- 13
- References
- 26
- Citations by year
- 2026: 1 · 2024: 1 · 2023: 1 · 2022: 1 · 2021: 4 · 2020: 3 · 2019: 1 · 2018: 1
- FWCI
- 2.64
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- The Spanish Journal of Psychology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- Outcome Rating Scale, psychotherapy outcome assessment, psychometric properties, Spanish adaptation, primary care patients, convergent validity, test-retest reliability, sensitivity to change, well-being
- MeSH terms
- Adult, Mental Disorders, Female, Humans, Male, Middle Aged, Psychometrics, Sensitivity and Specificity, Spain, Reproducibility of Results, Outcome Assessment, Health Care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review