Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system.
The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: Outcome research has documented worsening among a minority of the patient population (5% to 10%). In this study, we conducted a meta-analytic and mega-analytic review of a psychotherapy quality assurance system intended to enhance outcomes in patients at risk of treatment failure. METHOD: Original data from six major studies conducted at a large university counseling center and a hospital outpatient setting (N = 6,151, mean age = 23.3 years, female = 63.2%, Caucasian = 85%) were reanalyzed to examine the effects of progress feedback on patient outcome. In this quality assurance system, the Outcome Questionnaire-45 was routinely administered to patients to monitor their therapeutic progress and was utilized as part of an early alert system to identify patients at risk of treatment failure. Patient progress feedback based on this alert system was provided to clinicians so that they could intervene before treatment failure occurred. Meta-analytic and mega-analytic approaches were applied in intent-to-treat and efficacy analyses of the effects of feedback interventions. RESULTS: Three forms of feedback interventions-integral elements of this quality assurance system-were effective in enhancing treatment outcome, especially for signal alarm patients. Two of the three feedback interventions were also effective in preventing treatment failure (clinical support tools and the provision of patient progress feedback to therapists). CONCLUSIONS: The current state of evidence appears to support the efficacy and effectiveness of feedback interventions in enhancing treatment outcome.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“therapist supervision and feedback can improve patient outcomes, 52,53”
From Canadian Network for Mood and Anxiety Treatments (CANMAT) 2016 Clinical Guidelines for the Management of Adults with Major Depressive Disorder (2016) · cites this paper as [52]
In the citing paper
“Using MBC results in more clinically effective,17 cost-effective,18 and efficient treatment.19”
From Using Machine Learning to Match Clients and Therapy Providers: Evaluating Clinical Quality and Cost of Care (2025) · cites this paper as [19]
Citations
Cites
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695 · cited 1×
“Following recommendations by Overton (1998) and Hedges and Vevea (1998), we used a random-effects model, given that the research on providing feedback for the purpose of enhancing treatment outcome is relatively new in psychotherapy outcome literature, that studies included in this meta-analysis contained slight varia…”
MethodBergin and Garfield's Handbook of Psychotherapy and Behavior Change
Lambert, M. J. (2003) · Cited by 3,383
Self-citationFixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Evidence-based practice in psychology.
American Psychological Association (2006) · American Psychologist · doi:10.1037/0003-066x.61.4.271 · Cited by 2,478
A Fail-Safe N for Effect Size in Meta-Analysis
Orwin, R. G. (1983) · Journal of Educational Statistics · doi:10.2307/1164923 · Cited by 2,064
The psychotherapy dose-response effect and its implications for treatment delivery services.
Hansen, N. B., Lambert, M. J., & Forman, E. M. (2002) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.9.3.329 · Cited by 783 · cited 1×
“Similarly, an argument can be made against causal statements based on the data of studies not directly compared in the same randomized trials, such as in the case of comparing the CST Fb group and the pooled TAU group in the studies of Harmon et al. (2007) and Slade et al.”
BackgroundSelf-citationÆgisdóttir, S., White, M. J., Spengler, P. M., Maugherman, A. S., Anderson, L. A., Cook, R. S., Nichols, C. N., Lampropoulos, G. K., Walker, B. S., Cohen, G., et al. (2006) · The Counseling Psychologist · doi:10.1177/0011000005285875 · Cited by 737 · cited 2×
“As has been repeatedly demonstrated in clinical research, any prediction relying on statistical or actuarial methods tends to fare better than clinical judgment alone (Ægisdóttir et al., 2006; Grove, 2005).”
Background
Cited by
Items 501–600 of 660
van Sonsbeek, M. A. M. S., Holtmaat, C. J. M., Tiemens, B. G., Hutschemaekers, G. J. M., & de Jong, K. (2017) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2075 · Cited by 2
Egeter, J., Wintner, L. M., Huber, N., Rumpold, G., Sperner‐Unterweger, B., Bliem, H. R., & Holzner, B. (2018) · psychopraxis neuropraxis · doi:10.1007/s00739-018-0490-2 · Cited by 2
Olkowska, A., Sundet, R., & Karlsson, B. (2018) · Fokus på familien · doi:10.18261/issn.0807-7487-2018-04-05 · Cited by 1
Bergmann, B. (2019) · Forensische Psychiatrie Psychologie Kriminologie · doi:10.1007/s11757-019-00552-5 · Cited by 2
The Incremental Validity of the sPaCE Scale in Predicting Treatment Outcome
Jiménez-Arista, L. E., Holzapfel, J., Shanholtz, C. E., & Tracey, T. J. G. (2019) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2019.1640617 · Cited by 2
Sica, R. B. (2020) · Neurorehabilitation · doi:10.3233/nre-192973 · Cited by 2
Farmer, C. M., & Dong, L. (2020) · RAND Corporation eBooks · doi:10.7249/rra337-1 · Cited by 2
Case-Control and Cohort Designs
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.008 · Cited by 2
Null Hypothesis Significance Testing
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.014 · Cited by 1
Roche, A. I., Savitz, S. T., Kelpin, S. S., Lebow, J. R., Lombardi, N., Bogucki, O. E., Kurtzhals, A. A., Drews, M. S., Trane, S. T., Allen, J.-S. P., et al. (2023) · The Annals of Family Medicine · doi:10.1370/afm.2927 · Cited by 2
Optimizing Adherence and Outcomes in Psychotherapy
Vaughan, B., & Ochoa, E. S. (2016) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.16030269 · Cited by 1
Rankin, P. S. (2019) · The University of Queensland · doi:10.14264/uql.2020.35 · Cited by 4
Innovations in Systemic Family Therapy Effectiveness Research
Miller, R. B., & Jaurequi, M. E. (2020) · Wiley eBooks · doi:10.1002/9781119790181.ch19 · Cited by 1
Cho, E. (2021) · MOspace Institutional Repository (University of Missouri) · doi:10.32469/10355/88045 · Cited by 1
Rognstad, K., Helland, S. S., Neumer, S., Baardstu, S., & Kjøbli, J. (2022) · Research Square · doi:10.21203/rs.3.rs-1315138/v1 · Cited by 1
Integrative Psychotherapy Alliance in Family, Couple, and Individual Therapy
Pinsof, W. M., Goldsmith, J. Z., & Quirk, K. M. (2018) · Springer eBooks · doi:10.1007/978-3-319-15877-8_1152-1 · Cited by 1
(2018) · De Boeck Supérieur eBooks · doi:10.3917/dbu.debba.2018.01.0239 · Cited by 2
la Rosa-Cáceres, A. D., Lozano, O. M., Sánchez‐García, M., Fernández‐Calderón, F., Rossi, G. M. P., & Díaz, C. (2022) · Research Square · doi:10.21203/rs.3.rs-1725233/v1 · Cited by 1
Cost-effectiveness of feedback-informed psychological treatment: Evidence from the IAPT-FIT trial
Delgadillo, J., McMillan, D., Gilbody, S. M., Jong, K. D., Lucock, M. P., Lutz, W., Rubel, J. A., Aguirre, E., & Ali, S. (2021) · PsycEXTRA Dataset · doi:10.1037/e506602022-001 · Cited by 2
Sichel, C. E., & Connors, E. H. (2022) · Research Square · doi:10.21203/rs.3.rs-1573722/v1 · Cited by 1
Psychotherapy; current evidence and trends
Doorn, K. A., & Gutterman, D. (2022) · Elsevier eBooks · doi:10.1016/b978-0-323-91497-0.00077-1 · Cited by 1
Lambert, M. J. (2015) · Wiley eBooks · doi:10.1002/9781118625392.wbecp051
Self-citationUsing Client Feedback in Psychotherapy – The Research
(2012) · Wiley eBooks · doi:10.1002/9781119967590.ch6
Routine Outcome Monitoring in Anxiety Disorders
Lambert, M. J., & Greaves, M. R. (2014) · Wiley eBooks · doi:10.1002/9781118775349.ch34
Self-citationDysthymia and Chronic Major Depression
Arnow, B. A., Corcoran, K., & Thase, M. E. (2013) · Wiley eBooks · doi:10.1002/9781118528563.wbcbt49
O’Halloran, D. M. (2013) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York)
What can we learn from what works across therapies
Beel, N. (2011) · University of Southern Queensland ePrints (University of Southern Queensland)
de la Iglesia, G., Stover, J. B., Liporace, M. F., & Solano, A. C. (2016) · Research in Psychotherapy Psychopathology Process and Outcome · doi:10.4081/ripppo.2016.179 · Cited by 1
“When this hypothesis was tested, Shimokawa, Lambert, and Smart (2010) found that feedback interventions, such as this type of assessment, significantly enhanced treatment outcomes.”
MethodGrossi, A. B. (2016) · UKnowledge (University of Kentucky) · doi:10.13023/etd.2016.091 · Cited by 1
“Using the meta-analysis conducted by Shimokawa et al. (2010), Lambert and Shimokawa (2011) further examined the efficacy of the OQ System by examining only those clients who completed treatment (as opposed to the ITT sample).”
MethodImplementing a Measurement Feedback System in a Psychology Graduate Training Clinic
Wynn, E., Mechammil, M., Levin, M. E., & Cruz, R. A. (2016) · Digital Commons - USU (Utah State University)
Verschillen tussen behandelaars in het omgaan met routinematige uitkomstmetingen
de Jong, K. (2016) · Nederlands Tijdschrift voor Evidence Based Practice · doi:10.1007/s12468-016-0019-8
Bowen, M. M., Lambert, M. J., Berkeljon, A., Orr, T. E., Berrett, M. E., & Simon, W. (2016) · Cogent Psychology · doi:10.1080/23311908.2016.1191119 · Cited by 2
“Among other findings, the Shimokawa, Lambert, and Smart (2010) meta/mega-analysis of the effects of applying the OQ®-Analyst system (an electronic form of providing feedback) found that deterioration rates could be reduced from the baseline of 20% in NOT cases to 13% when therapists were alerted to…”
BackgroundSelf-citationTew, A. H. (2013) · Smith ScholarWorks (Smith College)
Grundstruktur einer Paartherapie
Schär, M. (2016) · Springer eBooks · doi:10.1007/978-3-662-47482-2_6
Toward a Rational Model of Depression Treatment
Forand, N. R., Richards, D. A., Huibers, M. J. H., & Bockting, C. (2016) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199973965.013.41
Vaz, A. (2016) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Mastergradsoppgave Klient- og resultatstyrt praksis i psykisk helsearbeid
Austdal, S. V. (2015)
The Use of Feedback in Group Counseling in a State Vocational Rehabilitation Setting: A Pilot Study
Grizzell, S. T. (2015) · Digital Commons - USU (Utah State University) · doi:10.26076/8bdb-a976
Yates, C. M., Holmes, C. M., Smith, J., & Nielson, T. (2016) · The Professional Counselor · doi:10.15241/cy.6.1.22
“Clinicians who receive weekly feedback on per-session client progress consistently show improved effectiveness and have clients who prematurely terminate counseling less often (Lambert, 2010; Shimokawa et al., 2010).”
BackgroundMethodInfluentialScientific Research into Psychotherapy
Sousa, D. (2017) · Palgrave Macmillan US eBooks · doi:10.1057/978-1-349-95217-5_1
ROM als behandelondersteuning: met vallen en opstaan naar een nieuwe werkroutine
Jonker, F., Tiemens, B. G., & Koole, R. (2017) · GZ - Psychologie · doi:10.1007/s41480-017-0073-5
Herstelgerichte ‘blended’ cognitieve gedragstherapie voor cliënten met verslavingsproblematiek
van Orden, M. L., & den Hollander, N. (2018) · Verslaving · doi:10.1007/s12501-018-0153-2
"Un passo avanti, ma ancora non ci siamo": verso una terapia familiare orientata al feedback
Rober, P., Tricht, K. V., & Sundet, R. (2018) · RIVISTA DI PSICOTERAPIA RELAZIONALE · doi:10.3280/pr2018-047004
Sprung, M. S., Hold, B., Streibl, L. E., Kaiser, E., Riedl, D., Rumpold, G., & Riffer, F. (2018) · psychopraxis neuropraxis · doi:10.1007/s00739-018-0492-0
Feedback-informierte Therapie im psychiatrisch-psychotherapeutischen Alltag
Rogausch, A., Gutscher, G., & Gschwind, A. (2017) · Swiss Archives of Neurology Psychiatry and Psychotherapy · doi:10.4414/sanp.2017.00479 · Cited by 1
The Complexities of Problem Solving in Mental Health Settings
Hanham, J. (2018) · Springer eBooks · doi:10.1007/978-981-13-2808-4_7
Imai, H., Takeshima, N., Hayasaka, Y., Yonemoto, N., Ogawa, Y., Tajika, A., Fujita, H., Kato, T., Furukawa, T. A., & for the FLATT Investigators (2019) · Psychiatry and Clinical Neurosciences · doi:10.1111/pcn.12849
“Previous studies using structured scales have shown that feedback from patients improves health outcomes.(2) The present study used patients’ raw feedback comments to evaluate their relation to depressive mood, satisfaction, homework conducted, and dropouts.”
BackgroundResultValidating a Global Measure of Severity in Children with Chronic Conditions
Tompke, B. K. (2019) · UWSpace (University of Waterloo)
The Concept Map of Effective Counselors’ Factors Perceived by Clients: College Counseling Centers
김은하, 김이윤, YOUNG, K. J., & 김현준 (2018) · Korea Journal of Counseling · doi:10.15703/kjc.19.1.201802.1
Gmeinwieser, S. (2020) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-7805
Wirkfaktoren und Prozessfeedback in der Psychotherapie – Erfahrungen eines Psychoanalytikers
Bachler, E. (2020) · Springer eBooks · doi:10.1007/978-3-658-29906-4_28
Bitan, D. T., Zilcha‐Mano, S., Asper, A., & Bloch, Y. (2020) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0000000000001199 · Cited by 1
“Studies comparing ROM-assisted therapy to treatment as usual (TAU) indicate that NOT patients are 2.3 times more likely to deteriorate in usual care than in the ROMassisted condition (Shimokawa et al., 2010).”
BackgroundMethodInfluentialToward an Evidence-based Standard of Professional Competence
Miller, S. D., Madsen, J. W., & Hubble, M. A. (2020) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198817338.013.79
Cazauvieilh, C. (2018) · Pratiques Psychologiques · doi:10.1016/j.prps.2020.09.005
Personalized treatment strategies for depression
van Bronswijk, S. C. (2020) · Research Publications (Maastricht University) · doi:10.26481/dis.20201211sb
Houben, S. T. L. (2021) · Research Publications (Maastricht University) · doi:10.26481/dis.20210527sh
Association of Trainee Psychotherapist Competency and Client Outcomes
Dziurzynski, K. (2020) · doi:10.12794/metadc1707414
Connors, E. H., Lyon, A. R., Garcia, K. A., Sichel, C. E., Hoover, S., Weist, M. D., & Tebes, J. K. (2021) · Research Square · doi:10.21203/rs.3.rs-1044947/v1
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.001
Construct and Data-Evaluation Validity
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.004
Single-Case Experimental Research Designs
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.009
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.007
Cautions, Negative Effects, and Replication
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.016
Selecting Measures for Research
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.011
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.021
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.013
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.022
Ideas that Begin the Research Process
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.005
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.020
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.025
Presenting and Analyzing the Data
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.015
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.024
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.018
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.002
Assessment: Types of Measures and Their Use
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.012
Experimental Research Using Group Designs
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.006
Ethical Issues and Guidelines for Research
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.017
Communication of Research Findings
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.019
(2015) · Wiley eBooks · doi:10.1002/9781119154082.refs
Providing Choice and Preferences to Service Users Accessing Trauma Treatment: A Multicultural Lens
Mahon, D. (2022) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-80382-429-120221008 · Cited by 1
Progress Research in Couple and Family Therapy
Sparks, J. A., & Duncan, B. L. (2018) · Springer eBooks · doi:10.1007/978-3-319-15877-8_156-1
“Regarding outcome research, a meta-analysis of six RCTs of the OQ System found that 5.5% of at-risk clients whose therapists received feedback deteriorated compared with 20.1% of at-risk clients in the no-feedback group (Shimokawa et al. 2010).”
Influential(2017) · Le Journal des psychologues · doi:10.3917/jdp.345.0049
Integrative Psychotherapy Alliance in Family, Couple, and Individual Therapy
Pinsof, W. M., Goldsmith, J. Z., & Quirk, K. M. (2019) · Springer eBooks · doi:10.1007/978-3-319-49425-8_1152
Innovations in Systemic Family Therapy Effectiveness Research
Miller, R. B., & Jaurequi, M. E. (2020) · Wiley eBooks · doi:10.1002/9781119438519.ch19
Progress Research in Couple and Family Therapy
Sparks, J. A., & Duncan, B. L. (2019) · Springer eBooks · doi:10.1007/978-3-319-49425-8_156
Attitudes of Austrian psychotherapists towards process and outcome monitoringPreprint
Kaiser, T., Schmutzhart, L., & Laireiter, A. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/4gscw
Connors, E. H., Lyon, A. R., Garcia, K. A., Sichel, C. E., Hoover, S., Weist, M. D., & Tebes, J. A. (2022) · Research Square · doi:10.21203/rs.3.rs-1044947/v2
Assessment and Evaluation of Outcomes in Youth Day Treatment Programs
Rech, M., Lovelace, J., Kale, M., & Patriquin, M. A. (2022) · Issues in clinical child psychology · doi:10.1007/978-3-031-14567-4_5
Young people’s experiences of outcome measures in a CAMHS clinic
Keyes, C., & Elder-Vass, J. (2018) · Clinical Psychology Forum · doi:10.53841/bpscpf.2018.1.310.18
DeePsy: Představení online nástroje pro zpětnou vazbu v psychoterapii
Řiháček, T., Nehyba, J., Čevelíček, M., Polok, A., Matějka, P., & Doležal, P. (2023) · Psychoterapie · doi:10.5817/psy2023-1-1
Whittaker, K. J., Johnson, S. U., Solbakken, O. A., Wampold, B. E., & Tilden, T. (2023) · Gezinstherapie Wereldwijd · doi:10.1007/s12440-023-00211-6
“Door tijdens de therapie herhaaldelijk metingen te doen, kunnen patiënten die niet vooruitgaan of met hun behandeling dreigen te stoppen mogelijk op tijd worden geïdentificeerd (Shimokawa et al. 2010).”
Background(2016) · Wiley eBooks · doi:10.1002/9781394258918.refs
L’evidence-based practice en psychologie : une approche tripartite souvent mal comprise
Blause, S. D., Durieux, N., Tirelli, E., & Willems, S. J. (2024) · Pratiques Psychologiques · doi:10.1016/j.prps.2024.03.005 · Cited by 2
Reyes, A. D. L. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197686607.002.0007
Why Theories About Rater Biases Fail to Explain Discrepant Results
Reyes, A. D. L. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197686607.003.0006
Metadata
- Authors
- Shimokawa, K., Lambert, M. J., & Smart, D. W.
- Affiliations
- Brigham Young University (US)
- ORCID
- Lambert, Michael J.
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2010
- Volume
- 78
- Issue
- 3
- Pages
- 298-311
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- OpenAlex
- W2143726303
- Semantic Scholar
- 94c5e3fb3707d960610a79e604c2b070280c0014
- Cited by
- 657
- References
- 38
- Citations by year
- 2026: 18 · 2025: 23 · 2024: 64 · 2023: 24 · 2022: 37 · 2021: 57 · 2020: 47 · 2019: 47 · 2018: 59 · 2017: 54 · 2016: 45 · 2015: 61 · 2014: 44 · 2013: 31 · 2012: 30
- FWCI
- 26.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Brigham Young University
- Topics
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Social Sciences › Psychology › Clinical Psychology › Counseling Practices and Supervision
- Social Sciences › Psychology › Clinical Psychology › Counseling, Therapy, and Family Dynamics
- Keywords
- treatment failure, early alert systems, progress feedback, patient outcomes, Outcome Questionnaire-45, clinical support tools, therapist feedback, counseling centers
- MeSH terms
- Adult, Mental Disorders, Feedback, Female, Humans, Male, Psychology, Clinical, Psychotherapy, Quality Assurance, Health Care, Surveys and Questionnaires, Referral and Consultation, Risk, Outcome Assessment, Health Care, Treatment Failure, Disease Progression, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.