CoChat

A Digital Tool (Technology-Assisted Problem Management Plus) for Lay Health Workers to Address Common Mental Health Disorders: Co-production and Usability Study in Pakistan

Open access

The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index; 34 of the 51 sources its claims cite were checked for support.

Abstract

Background: Mental health remains among the top 10 leading causes of disease burden globally, and there is a significant treatment gap due to limited resources, stigma, limited accessibility, and low perceived need for treatment. Problem Management Plus, a World Health Organization–endorsed brief psychological intervention for mental health disorders, has been shown to be effective and cost-effective in various countries globally but faces implementation challenges, such as quality control in training, supervision, and delivery. While digital technologies to foster mental health care have the potential to close treatment gaps and address the issues of quality control, their development requires context-specific, interdisciplinary, and participatory approaches to enhance impact and acceptance. Objective: We aimed to co-produce Technology-Assisted Problem Management Plus (TA-PM+) for "lady health workers" (LHWs; this is the terminology used by the Lady Health Worker Programme for lay health workers) to efficiently deliver sessions to women with symptoms of common mental health disorders within the community settings of Pakistan and conducted usability testing in community settings. Methods: A 3-stage framework was used for co-producing and prototyping the intervention. Stage 1 (evidence review and stakeholder consultation) included 3 focus group discussions with 32 LHWs and 7 in-depth interviews with key stakeholders working in the health system or at the health policy level. Thematic analyses using the Capability, Opportunity, and Motivation for Behavioral Change (COM-B) model were conducted. Stage 2 included over eight online workshops, and a multidisciplinary intervention development group co-produced TA-PM+. Stage 3 (prototyping) involved 2 usability testing rounds. In round 1 conducted in laboratory settings, 6 LHWs participated in role plays and completed the 15-item mHealth Usability App Questionnaire (MUAQ) (score range 0-7). In round 2 conducted in community settings, trained LHWs delivered the intervention to 6 participants screened for depression and anxiety. Data were collected using the MUAQ completed by LHWs and the Patient Satisfaction Questionnaire (PSQ) (score range 0-46) completed by participants. Results: Qualitative analysis indicated that a lack of digital skills among LHWs, high workload, resource scarcity for digitization (specifically internet bandwidth in the community), and need for comprehensive training were barriers for TA-PM+ implementation in the community through LHWs. Training, professional support, user guidance, an easy and automated interface, offline functionalities, incentives, and strong credibility among communities were perceived to enhance the capability, opportunity, and motivation of LHWs to implement TA-PM+. TA-PM+ was co-produced with features like an automated interface, a personal dashboard, guidance videos, and a connected supervisory panel. The mean MUAQ score was 5.62 in round 1 of usability testing and improved to 5.96 after incorporating LHW feedback in round 2. The mean PSQ score for TA-PM+ was 40 in round 2. Conclusions: Co-production of TA-PM+ for LHWs balanced context and evidence. The 3-stage iterative development approach resulted in high usability and acceptability of TA-PM+ for LHWs and participants. ©Maham Saleem, Shamsa Zafar, Thomas Klein, Markus Koesters, Adnan Bashir, Daniela C Fuhr, Siham Sikander, Hajo Zeeb.

Overview

CoChat Summary

## TL;DR

This study co-produced Technology-Assisted Problem Management Plus (TA-PM+) for lady health workers (LHWs) in Pakistan to support face-to-face delivery of PM+ for women with common mental health problems. In two usability rounds, the app’s mean MUAQ score improved from 5.62 to 5.96, and participant satisfaction was reported as high.

## Key findings

  • Qualitative analysis identified barriers to implementation: limited digital skills, heavy workload, resource scarcity/internet bandwidth, need for comprehensive training, stigma, and time burden; participants recommended shorter sessions from 90 minutes to 45–60 minutes.
  • TA-PM+ was co-produced with features including an automated interface, personal dashboard, guidance videos, and a connected supervisory panel; it also included offline features for video content, while backend data storage and monitoring required internet.
  • In usability testing with 6 LHWs, the mean MUAQ score was 5.62 in round 1 and increased to 5.96 in round 2 after feedback was incorporated.
  • In the community usability round, 6 women were screened and received the first TA-PM+ session; the mean PSQ score was 40 out of a possible 46.

## Methods

  • The study used a 3-stage co-production and prototyping framework: (1) qualitative investigation, (2) co-production workshops, and (3) prototyping/usability testing.
  • Stage 1 included 3 focus group discussions with 32 LHWs and 7 in-depth interviews with health-system/policy stakeholders; data were analyzed using framework analysis informed by COM-B and the Theoretical Domain Framework.
  • Stage 3 involved 2 rounds of usability testing: round 1 in a laboratory setting with 6 LHWs completing the MUAQ, and round 2 in community settings with 6 LHWs delivering the first session to 6 screened women, followed by the MUAQ and PSQ.

## Limitations

  • The paper states that the co-production sample may have lacked inclusivity and diversity, and that people with lived experience were not involved in development.
  • It states that usability testing was done on a limited sample size and only in the first session of TA-PM+, assuming interface uniformity across sessions.
  • It states that TA-PM+ requires the internet for backend data storage and online monitoring, so it cannot function without internet access; the text also makes evident that this limits applicability in low-connectivity settings.
  • It states that TA-PM+ is administered by LHWs who provide services to women only, so it is not applicable to men; this is a design limitation made explicit in the paper.
  • It states that TA-PM+ is currently in Urdu, requiring further technical and cultural adaptation for other sociocultural settings.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/59414

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Figure 1 Perceived barriers and facilitators for the implementation of Technology-Assisted Problem Management Plus (TA-PM+) and the corresponding digital facilitators of TA-PM+ identified to address the barriers. Thematic analysis conducted using the Capability, Opportunity, and Motivation for Behavioral Change (COM-B) framework. TDF: Theoretical Domain Framework.
Figure 1 Perceived barriers and facilitators for the implementation of Technology-Assisted Problem Management Plus (TA-PM+) and the corresponding digital facilitators of TA-PM+ identified to address the barriers. Thematic analysis conducted using the Capability, Opportunity, and Motivation for Behavioral Change (COM-B) framework. TDF: Theoretical Domain Framework.CC BY · PubMed Central
Figure 2 User interface of the Technology-Assisted Problem Management Plus (TA-PM+) app developed to assist lady health workers in delivering mental health interventions within community settings in Pakistan. The first screen presents a dashboard with color-coded indicators (red, yellow, and green) to track and prioritize patient sessions. Subsequent screens illustrate session navigation, patient data entry, and automated PSYCHLOPS (Psychological Outcome Profiles) assessments in Urdu. Features have been co-designed for cultural relevance and usability among lady health workers in Pakistan.
Figure 2 User interface of the Technology-Assisted Problem Management Plus (TA-PM+) app developed to assist lady health workers in delivering mental health interventions within community settings in Pakistan. The first screen presents a dashboard with color-coded indicators (red, yellow, and green) to track and prioritize patient sessions. Subsequent screens illustrate session navigation, patient data entry, and automated PSYCHLOPS (Psychological Outcome Profiles) assessments in Urdu. Features have been co-designed for cultural relevance and usability among lady health workers in Pakistan.CC BY · PubMed Central
Figure 3 Screenshots from session-aid videos developed for lady health workers to enhance digital literacy and support the delivery of Technology-Assisted Problem Management Plus (TA-PM+). These videos, designed in Urdu, provide step-by-step instructions for navigating the TA-PM+ app and conducting sessions effectively.
Figure 3 Screenshots from session-aid videos developed for lady health workers to enhance digital literacy and support the delivery of Technology-Assisted Problem Management Plus (TA-PM+). These videos, designed in Urdu, provide step-by-step instructions for navigating the TA-PM+ app and conducting sessions effectively.CC BY · PubMed Central
Figure 4 Screenshots from psychoeducational videos for patients, showing the characters Dr Ayesha, lady health worker Shazia, and patient Saima, which have been developed for sessions of Technology-Assisted Problem Management Plus (TA-PM+).
Figure 4 Screenshots from psychoeducational videos for patients, showing the characters Dr Ayesha, lady health worker Shazia, and patient Saima, which have been developed for sessions of Technology-Assisted Problem Management Plus (TA-PM+).CC BY · PubMed Central

Verification

Claims the paper makes

17 Valid · 4 Not valid · 6 Not checked · 85 Own results and interpretations

37 more claims

Create a free account to see all 112 claims and to verify the 5 references still open.

See all claims — free account
  • Probably not a substantial claim. 53
  • It may state two separate claims as one. 31

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 37 references

Research works printed but not linked: 3

  1. 2013, Diagnostic and statistical manual of mental disorders: DSM-5
  2. Hafeez, A, 2011, J Pak Med Assoc, 61, 210
  3. Joyce, G, 2014, Design, User Experience, and Usability. Theories, Methods, and Tools for Designing the User Experience. DUXU 2014. Lecture Notes in Computer Science, vol 8517, 465

Cited by

Metadata

Authors
Saleem, M., Zafar, S., Klein, T., Koesters, M., Bashir, A., Fuhr, D. C., Sikander, S., & Zeeb, H.
Affiliations
  • Leibniz Institute for Prevention Research and Epidemiology - BIPS (DE)
  • Air University (PK)
  • Universität Ulm (DE)
  • Zentrum für Evidenzbasierte Gesundheitsversorgung (DE)
  • University of Liverpool (GB)
Corresponding author
Saleem, Maham
Venue
JMIR Formative Research
Published
2025-01-28
Volume
9
Pages
e59414
ISSN
2561-326X (ISSN-L)
OpenAlex
W4406900904
Cited by
5
References
34
Citations by year
2026: 2 · 2025: 3
FWCI
3.99
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR Formative Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Bundesministerium für Bildung und Forschung (01KA2105A)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
Keywords
Problem Management Plus, lay health workers, Lady Health Workers, digital mental health interventions, mobile health, co-production, usability testing, depression, anxiety, common mental disorders, women's mental health, community mental health services, treatment gap, COM-B model, digital skills, offline functionality, Pakistan, patient satisfaction, role-play training
MeSH terms
Digital Technology, Adult, Mental Disorders, Community Health Workers, Female, Humans, Male, Middle Aged, Pakistan, Focus Groups, Telemedicine, Qualitative Research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.