Development of a scoring system for non-specialist ratings of clinical competence in global mental health: a qualitative process evaluation of the Enhancing Assessment of Common Therapeutic Factors (ENACT) scale
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Background.: Task-sharing is the involvement of non-specialist providers to deliver mental health services. A challenge for task-sharing programs is to achieve and maintain clinical competence of non-specialists, including primary care workers, paraprofessionals, and lay providers. We developed a tool for non-specialist peer ratings of common factors clinical competency to evaluate and optimize competence during training and supervision in global mental health task-sharing initiatives. Methods.: The 18-itemENhancingAssessment ofCommonTherapeutic factors (ENACT) tool was pilot-tested with non-specialists participating in mental health Gap Action Programme trainings in Nepal. Qualitative process evaluation was used to document development of the peer rating scoring system. Qualitative data included interviews with trainers and raters as well as transcripts of pre- and post-training observed structured clinical evaluations. Results.: Five challenges for non-specialist peer ratings were identified through the process evaluation: (1) balance of training and supervision objectives with research objectives; (2) burden for peer raters due to number of scale items, number of response options, and use of behavioral counts; (3) capturing hierarchy of clinical skills; (4) objective v.subjective aspects of rating; and (5) social desirability when rating peers. Conclusion.: The process culminated in five recommendations based on the key findings for the development of scales to be used by non-specialists for peer ratings in low-resource settings. Further research is needed to determine the ability of ENACT to capture the relationship of clinical competence with client outcomes and to explore the relevance of these recommendations for non-specialist peer ratings in high-resource settings.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Frank, J. (1993) · doi:10.56021/9780801840678 · Cited by 1,094
Heine, S. J., Lehman, D. R., Peng, K., & Greenholtz, J. (2002) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.82.6.903 · Cited by 1,080
Disparity in Depression Treatment Among Racial and Ethnic Minority Populations in the United States
Alegría, M., Chatterji, P., Wells, K., Cao, Z., Chen, C.-N., Takeuchi, D., Jackson, J., & Meng, X.-L. (2008) · Psychiatric Services · doi:10.1176/ps.2008.59.11.1264 · Cited by 993 · cited 1×
“Gaps in services are especially pronounced among racial and ethnic minority groups (Alegría et al. 2008).”
BackgroundHuman resources for mental health care: current situation and strategies for action
Kakuma, R., Minas, H., van Ginneken, N., Dal Poz, M. R., Desiraju, K., Morris, J. E., Saxena, S., & Scheffler, R. M. (2011) · The Lancet · doi:10.1016/s0140-6736(11)61093-3 · Cited by 979 · cited 1×
“Clinical resources for training and supervision—both in terms of human capacity and materials—are historically lacking in most LMIC settings (Abas et al. 2003; Kakuma et al. 2011).”
BackgroundPotential barriers to the use of health services among ethnic minorities: A review
Scheppers, E. (2006) · Family Practice · doi:10.1093/fampra/cmi113 · Cited by 759 · cited 1×
“These providers may be preferred because of financial barriers, lack of transportation, stigma associated with mental health professionals, and other cultural issues in explanatory models and help-seeking behavior that limit use of specialty mental health services (Scheppers et al. 2006).”
BackgroundLund, C., Tomlinson, M., De Silva, M., Fekadu, A., Shidhaye, R., Jordans, M., Petersen, I., Bhana, A., Kigozi, F., Prince, M., et al. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001359 · Cited by 584
Self-citationvan Ginneken, N., Tharyan, P., Lewin, S., Rao, G. N., Meera, S., Pian, J., Chandrashekar, S., & Patel, V. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009149.pub2 · Cited by 575 · cited 1×
“…training community health workers and persons without a professional health role to diagnose and manage common mental disorders and deliver specialized psychological treatments including interpersonal therapy, behavioral activation, and cognitive processing therapy (van Ginneken et al. 2013).”
The revised cognitive therapy scale (CTS-R): psychometric properties.
Blackburn, I.-M., James, I. A., Milne, D. L., Baker, C., Standart, S., Garland, A., & Reichelt, F. K. (2001) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465801004040 · Cited by 568 · cited 9×
“Examples of response options for therapist rating scales Tool Number of items Response options Coding the Interaction in Psychotherapy, CIP (Schindler, Hohenberger‐Sieber, & Hahlweg, 1989) 19 items Relative frequency response with behavior counts CTS-R (Blackburn et al. 2001) 12 items 0–6 scale, with skill-based descr…”
BackgroundMethodInfluentialStereotypes and standards of judgment.
Biernat, M., Manis, M., & Nelson, T. E. (1991) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.60.4.485 · Cited by 449 · cited 1×
“For instance, Likert scale peer rating instruments capture subjective feelings relative to a non-representative comparison group, thereby limiting their ability to capture absolute or context-free judgment at the population level (Biernat et al. 1991).”
BackgroundTherapist competence, therapy quality, and therapist training
Fairburn, C. G., & Cooper, Z. (2011) · Behaviour Research and Therapy · doi:10.1016/j.brat.2011.03.005 · Cited by 372 · cited 1×
“…evidence-based treatment and implementing it with appropriate skill and is typically measured with structured role plays using standardize patients; therapy quality refers to how well a treatment is delivered in a clinical setting with real patients (Margison et al. 2000; Fairburn & Cooper, 2011).”
Background
Cited by
Kohrt, B. A., Asher, L., Bhardwaj, A., Fazel, M., Jordans, M. J. D., Mutamba, B. B., Nadkarni, A., Pedersen, G. A., Singla, D. R., & Patel, V. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15061279 · Cited by 347
Self-citationKohrt, B. A., Jordans, M. J. D., Turner, E. L., Sikkema, K. J., Luitel, N. P., Rai, S., Singla, D. R., Lamichhane, J., Lund, C., & Patel, V. (2018) · Pilot and Feasibility Studies · doi:10.1186/s40814-018-0234-3 · Cited by 141
Self-citationRahman, A., Akhtar, P., Hamdani, S. U., Atif, N., Nazir, H., Uddin, I., Nisar, A., Huma, Z., Maselko, J., Sikander, S., et al. (2019) · Global Mental Health · doi:10.1017/gmh.2019.7 · Cited by 99
Seward, N., Hanlon, C., Abdulahi, A., Abrams, Z., Alem, A., Araya, R., Bachmann, M., Bogale, B., Brima, N., Chibanda, D., et al. (2021) · doi:10.1101/2021.01.06.20248468 · Cited by 84
Kohrt, B. A., Mutamba, B. B., Luitel, N. P., Gwaikolo, W., Onyango Mangen, P., Nakku, J., Rose, K., Cooper, J., Jordans, M. J. D., & Baingana, F. (2018) · International Review of Psychiatry · doi:10.1080/09540261.2019.1566116 · Cited by 83
“…worker using a rating tool developed for competency assessment of non-specialists: ENhancing Assessment of Common Therapeutic factors (ENACT) : The ENACT tool is used by raters observing standardized role plays of trainees (Kohrt et al., 2015a; Kohrt, Ramaiya, Rai, Bhardwaj, & Jordans, 2015b).”
MethodSelf-citation
Metadata
- Authors
- Kohrt, B. A., Ramaiya, M. K., Rai, S., Bhardwaj, A., & Jordans, M. J. D.
- Venue
- Global Mental Health
- Publisher
- Cambridge University Press (CUP)
- Published
- 2015
- Volume
- 2
- ISSN
- 2054-4251 (ISSN-L)
- OpenAlex
- W2191714483
- Cited by
- 91
- References
- 21
- FWCI
- 3.23
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Development of a scoring system for non-specialist ratings of clinical competence in global mental health: a qualitative process evaluation of the Enhancing Assessment of Common Therapeutic Factors (ENACT) scale. https://app.cochat.ai/papers/10.1017/gmh.2015.21
- The paper
- Kohrt, B. A., Ramaiya, M. K., Rai, S., Bhardwaj, A., & Jordans, M. J. D. (2015). Development of a scoring system for non-specialist ratings of clinical competence in global mental health: a qualitative process evaluation of the Enhancing Assessment of Common Therapeutic Factors (ENACT) scale. Global Mental Health. https://doi.org/10.1017/gmh.2015.21
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.