A Digital Tool (Technology-Assisted Problem Management Plus) for Lay Health Workers to Address Common Mental Health Disorders: Co-production and Usability Study in Pakistan
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index; 34 of the 51 sources its claims cite were checked for support.
Abstract
Background: Mental health remains among the top 10 leading causes of disease burden globally, and there is a significant treatment gap due to limited resources, stigma, limited accessibility, and low perceived need for treatment. Problem Management Plus, a World Health Organization–endorsed brief psychological intervention for mental health disorders, has been shown to be effective and cost-effective in various countries globally but faces implementation challenges, such as quality control in training, supervision, and delivery. While digital technologies to foster mental health care have the potential to close treatment gaps and address the issues of quality control, their development requires context-specific, interdisciplinary, and participatory approaches to enhance impact and acceptance. Objective: We aimed to co-produce Technology-Assisted Problem Management Plus (TA-PM+) for "lady health workers" (LHWs; this is the terminology used by the Lady Health Worker Programme for lay health workers) to efficiently deliver sessions to women with symptoms of common mental health disorders within the community settings of Pakistan and conducted usability testing in community settings. Methods: A 3-stage framework was used for co-producing and prototyping the intervention. Stage 1 (evidence review and stakeholder consultation) included 3 focus group discussions with 32 LHWs and 7 in-depth interviews with key stakeholders working in the health system or at the health policy level. Thematic analyses using the Capability, Opportunity, and Motivation for Behavioral Change (COM-B) model were conducted. Stage 2 included over eight online workshops, and a multidisciplinary intervention development group co-produced TA-PM+. Stage 3 (prototyping) involved 2 usability testing rounds. In round 1 conducted in laboratory settings, 6 LHWs participated in role plays and completed the 15-item mHealth Usability App Questionnaire (MUAQ) (score range 0-7). In round 2 conducted in community settings, trained LHWs delivered the intervention to 6 participants screened for depression and anxiety. Data were collected using the MUAQ completed by LHWs and the Patient Satisfaction Questionnaire (PSQ) (score range 0-46) completed by participants. Results: Qualitative analysis indicated that a lack of digital skills among LHWs, high workload, resource scarcity for digitization (specifically internet bandwidth in the community), and need for comprehensive training were barriers for TA-PM+ implementation in the community through LHWs. Training, professional support, user guidance, an easy and automated interface, offline functionalities, incentives, and strong credibility among communities were perceived to enhance the capability, opportunity, and motivation of LHWs to implement TA-PM+. TA-PM+ was co-produced with features like an automated interface, a personal dashboard, guidance videos, and a connected supervisory panel. The mean MUAQ score was 5.62 in round 1 of usability testing and improved to 5.96 after incorporating LHW feedback in round 2. The mean PSQ score for TA-PM+ was 40 in round 2. Conclusions: Co-production of TA-PM+ for LHWs balanced context and evidence. The 3-stage iterative development approach resulted in high usability and acceptability of TA-PM+ for LHWs and participants. ©Maham Saleem, Shamsa Zafar, Thomas Klein, Markus Koesters, Adnan Bashir, Daniela C Fuhr, Siham Sikander, Hajo Zeeb.
Overview
CoChat Summary
## TL;DR
This study co-produced Technology-Assisted Problem Management Plus (TA-PM+) for lady health workers (LHWs) in Pakistan to support face-to-face delivery of PM+ for women with common mental health problems. In two usability rounds, the app’s mean MUAQ score improved from 5.62 to 5.96, and participant satisfaction was reported as high.
## Key findings
- Qualitative analysis identified barriers to implementation: limited digital skills, heavy workload, resource scarcity/internet bandwidth, need for comprehensive training, stigma, and time burden; participants recommended shorter sessions from 90 minutes to 45–60 minutes.
- TA-PM+ was co-produced with features including an automated interface, personal dashboard, guidance videos, and a connected supervisory panel; it also included offline features for video content, while backend data storage and monitoring required internet.
- In usability testing with 6 LHWs, the mean MUAQ score was 5.62 in round 1 and increased to 5.96 in round 2 after feedback was incorporated.
- In the community usability round, 6 women were screened and received the first TA-PM+ session; the mean PSQ score was 40 out of a possible 46.
## Methods
- The study used a 3-stage co-production and prototyping framework: (1) qualitative investigation, (2) co-production workshops, and (3) prototyping/usability testing.
- Stage 1 included 3 focus group discussions with 32 LHWs and 7 in-depth interviews with health-system/policy stakeholders; data were analyzed using framework analysis informed by COM-B and the Theoretical Domain Framework.
- Stage 3 involved 2 rounds of usability testing: round 1 in a laboratory setting with 6 LHWs completing the MUAQ, and round 2 in community settings with 6 LHWs delivering the first session to 6 screened women, followed by the MUAQ and PSQ.
## Limitations
- The paper states that the co-production sample may have lacked inclusivity and diversity, and that people with lived experience were not involved in development.
- It states that usability testing was done on a limited sample size and only in the first session of TA-PM+, assuming interface uniformity across sessions.
- It states that TA-PM+ requires the internet for backend data storage and online monitoring, so it cannot function without internet access; the text also makes evident that this limits applicability in low-connectivity settings.
- It states that TA-PM+ is administered by LHWs who provide services to women only, so it is not applicable to men; this is a design limitation made explicit in the paper.
- It states that TA-PM+ is currently in Urdu, requiring further technical and cultural adaptation for other sociocultural settings.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
17 Valid · 4 Not valid · 6 Not checked · 85 Own results and interpretations
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“Prior research has indicated that participants commonly had difficulties finishing all 5 sessions of PM+ because of the lengthy sessions, which frequently interfered with finding or maintaining a job, performing domestic duties, or raising children [8-10].”
§ A Digital Tool (Technology-Assisted Problem Management Plus) for Lay Health Workers to Address Common Mental Health Disorders: Co-production and Usability Study in Pakistan > Discussion > Principal Findings
What the sources say
- Partly supportedcites [8] matched to “Group problem management plus (PM+) to decrease psychological distress among Syrian refugees in Turkey: a pilot randomised controlled trial” (2022) sourceExperimental — accuracy not yet measured
The Results section on acceptability and attendance identifies programme length, work requirements and childcare as barriers to attending gPM+ sessions. However, it does not report interference with domestic duties or finding or maintaining a job. The Methods define treatment completion as attending at least three of five sessions, so the reported 75% completion rate does not establish how commonly participants struggled to finish all five. Page numbers were not supplied. (LLM, conf=0.86)
- Disputedcites [9] matched to “Peer-provided Problem Management Plus (PM+) for adult Syrian refugees: a pilot randomised controlled trial on effectiveness and cost-effectiveness” (2020) sourceExperimental — accuracy not yet measured
Split into 2 atoms — 0 confirmed, 0 partially supported, 2 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Checked by a reasoning model — may be wrong.
- Not checked — no full text of the sourcecites [10] matched to “Evaluating feasibility and acceptability of a group WHO trans-diagnostic intervention for women with common mental disorders in rural Pakistan: A cluster randomised controlled feasibility trial” (2019) source
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“but faces implementation challenges, such as quality control in training, supervision, and delivery.”
- Also stated in: § Background Recent research has indicated that mental health remains among the top 10 leading causes of disease burden globally and constitutes 32.4% of years lived with disability [1]. Common mental health disorders are conditions that impact mood, thought processes, and behavior, often leading to challenges in daily functioning and overall well-being. These include disorders, such as depression, anxiety, and bipolar disorder, each characterized by unique symptoms and impacts on the lives of individuals [2]. Depression, affecting over 300 million people globally, is the most prevalent mental health disorder [3]. A major part of this burden (about 70%) is concentrated in low- and middle-income countries (LMICs). Additionally, a shortage of mental health specialists in LMICs contributes to a mental health treatment gap of 90% for almost all mental health conditions, meaning that only 1 out of 10 conditions requiring mental health treatment receive it from a mental health specialist [3]. Various factors contribute to the mental health treatment gap, including lack of human resources for mental health, stigma, accessibility, uneven mental health service distribution, and lack of a perceived need for treatment [4]. To address this gap, the World Health Organization (WHO) developed the Mental Health Gap Action Programme (mhGAP) by providing evidence-based interventions for 8 priority mental health disorders. These guidelines recommend involving lay health workers and community members in the early detection of mental health disorders and low-intensity psychological care of patients with mental health disorders. This can help LMICs address the treatment gap and health resource shortfall, and achieve WHO Mental Health Action Plan targets [3,4]. Building on the WHO’s mhGAP, several initiatives in LMICs have been developed to address the mental health treatment gap [5-7]. These programs empower nonspecialist health workers to deliver mental health care through structured culturally adapted interventions. Examples include Problem Management Plus (PM+), a transdiagnostic intervention for managing stress and depression, and the Thinking Healthy Programme, which addresses perinatal depression through simplified behavioral strategies. Community-based programs like Friendship Bench in Zimbabwe further extend the reach of mhGAP by embedding mental health support within local settings, demonstrating significant improvements in access and patient outcomes. The Disease Control Priorities (DCP3) report endorses such scalable models as effective affordable solutions that bolster mental health care capacity in LMICs [6,7]. A comprehensive review [7] of 208 studies focusing on various mhGAP interventions in LMICs demonstrated their overall efficacy. The mhGAP interventions were shown to significantly improve the symptoms of common mental health disorders, reduce substance use, and positively impact parenting and child outcomes. Furthermore, mhGAP training across these interventions enhanced the clinical skills, knowledge, and competency of health workers, contributing to improved quality of care after training [7]. PM+ is a low-intensity brief psychological and transdiagnostic intervention for common mental health disorders. It is an evidence-based intervention that can address various mental health issues and address the limitations posed by scarce specialized treatments in low-resource settings [8-14]. PM+ has been designed for depression, anxiety, stress, grief, and self-identified practical issues (interpersonal conflict and unemployment) and is delivered by lay health workers [15]. The intervention consists of 5 weekly face-to-face sessions involving stress management and problem-solving approaches [15]. PM+ has been tested for effectiveness and cost-effectiveness in various LMICs [8-14]. It has proven to be particularly effective in reducing the symptoms of anxiety, depression, and general distress in settings affected by significant adversity, including conflict-affected regions or under-resourced settings [16]. PM+ is recommended for stepped-care models, especially in low-resource settings where it serves as an effective first-line intervention. In these contexts, PM+ addresses common mental health needs at a low cost, allowing higher-intensity services to be reserved for more severe cases. This approach optimizes resource use and enhances accessibility in areas with limited mental health infrastructure. Notably, PM+ is available in several languages including Urdu, and it has been contextualized and rigorously evaluated in Pakistan [10,12,13]. However, the implementation of PM+ can be challenging for lay health workers and can be hampered by issues of quality control in training, supervision, and delivery [8-11]. Lengthy sessions and the complex nature of systematic stress and patient problem management strategies further compound these challenges, along with the struggle to recall all core strategies and protocols [8-11]. This specific phenomenon is termed “program drift” in the field of implementation science, which refers to a situation where the quality and fidelity of an intervention diminish because of deviations from the manual protocol, resulting in a reduction in the potential benefits of the intervention [17]. These challenges and barriers can be overcome by using digital tools and training lay health workers for them [18]. A recent systematic review of studies from LMICs revealed that the integration of digital technologies into mental health interventions led by nonspecialists typically results in positive outcomes and has the potential to address the following three gaps highlighted in mental health literature: (1) the treatment gap, (2) the treatment-quality gap by improving the competencies and knowledge of nonspecialists, and (3) the service utilization gap by increasing the use of mental health care services [18]. Few initiatives have pursued digital adaptations of PM+ to enhance accessibility and scalability, particularly in low-resource settings. The step-by-step intervention was initially conceptualized as an online self-help adaptation of PM+. While the step-by-step intervention initially incorporated the principles of PM+, the intervention diverged as the complexity of implementing problem-solving components within a digital app proved challenging. Consequently, the step-by-step intervention evolved into an independent transdiagnostic intervention focused on managing stress and addressing depression and anxiety through behavioral activation principles [19]. In response to the COVID-19 pandemic, additional digital training frameworks were developed to enable remote training of lay health workers, ensuring uninterrupted mental health support amid physical distancing measures [20]. PM+ has been rigorously evaluated in Pakistan, showing effectiveness in reducing depression and anxiety symptoms [10,12,13]. Despite higher initial costs than the standard care, it has demonstrated long-term cost-effectiveness and is recommended for integration into a stepped-care model in resource-limited settings like Pakistan [12]. In a stepped-care model [21], individuals begin with lower-intensity support and progress to more intensive treatments only if necessary, optimizing resources and tailoring care to individual needs. This approach is particularly relevant in Pakistan, where mental health services are limited and mostly concentrated in major urban centers [22]. Pakistan’s health care system, with its community outreach through "lady health workers" (LHWs; this is the terminology used by the Lady Health Worker Programme for lay health workers) [23], who have established supervision and referral mechanisms, provides a strong foundation for implementing stepped-care mental health interventions like PM+. To address the challenges in implementing PM+ by applying technological assistance and to align with the recommended stepped-care model for Pakistan, we aimed to develop a technological platform Technology-Assisted Problem Management Plus (TA-PM+). TA-PM+ consists of an app designed to support nonspecialists in delivering the PM+ intervention within Pakistan’s health system, with an established backend for supervision, monitoring, and referral processes. TA-PM+ seeks to ensure the consistent delivery of therapeutic components at the appropriate dosage and with high fidelity while being delivered face-to-face, fostering a therapeutic alliance, which is essential for maintaining the problem-management focus required for effective intervention delivery. This paper describes the stepwise co-production of TA-PM+ and its key features. · plain
“However, the implementation of PM+ can be challenging for lay health workers and can be hampered by issues of quality control in training, supervision, and delivery [8-11].”
§ A Digital Tool (Technology-Assisted Problem Management Plus) for Lay Health Workers to Address Common Mental Health Disorders: Co-production and Usability Study in Pakistan > Abstract > Background
What the sources say
- Partly supportedcites [8] matched to “Group problem management plus (PM+) to decrease psychological distress among Syrian refugees in Turkey: a pilot randomised controlled trial” (2022) sourceExperimental — accuracy not yet measured
The Results (Attendance, follow-up and fidelity; page unavailable) report that 20% of assessed core components were only partially delivered. The Discussion (page unavailable) says two components need to be strengthened in facilitator training. The Methods describe weekly supervision, but do not identify quality control in supervision as a challenge. (LLM, conf=0.86)
- Partly supportedcites [9] matched to “Peer-provided Problem Management Plus (PM+) for adult Syrian refugees: a pilot randomised controlled trial on effectiveness and cost-effectiveness” (2020) sourceExperimental — accuracy not yet measured
The Results (Objective 1, protocol fidelity assessment; page unavailable) report 76.6% adherence to the PM+ protocol in independently checked recordings, supporting a concern about delivery quality. The Methods (Problem Management Plus; page unavailable) describe training and weekly supervision as procedures, but do not identify quality control in either as an implementation challenge. (LLM, conf=0.82)
- Not checked — no full text of the sourcecites [10] matched to “Evaluating feasibility and acceptability of a group WHO trans-diagnostic intervention for women with common mental disorders in rural Pakistan: A cluster randomised controlled feasibility trial” (2019) source
- Could not verifycites [11] Maercker, A, 2019, Cultural Clinical Psychology and PTSD sourceExperimental — accuracy not yet measured
Our copy of Cultural Clinical Psychology and PTSD contains no mention of PM+ / Problem Management Plus, nor of quality control in training, supervision or delivery; four targeted searches ('PM+ Problem Management Plus implementation challenges quality control training supervision delivery', 'Problem Management Plus PM+', 'quality control supervision trained lay providers fidelity implementation', 'scalable interventions WHO mental health care task sharing non-specialist providers') returned only front-matter material (Abstract, Introduction, chapter overviews, table of contents). The nearest content is the summary of Chapter 13 by Heim, Harper Shehadeh, van't Hof, and Carswell on 'Cultural Adaptation of Scalable Interventions' (About the Editors > Conceptualizations of Culture), which describes scalable interventions for resource-limited settings but makes no claim about PM+ implementation or quality-control challenges, so the attributed point is not addressed in our copy. (LLM, conf=0.62)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Background Recent research has indicated that mental health remains among the top 10 leading causes of disease burden globally and constitutes 32.4% of years lived with disability [1]. Common mental health disorders are conditions that impact mood, thought processes, and behavior, often leading to challenges in daily functioning and overall well-being. These include disorders, such as depression, anxiety, and bipolar disorder, each characterized by unique symptoms and impacts on the lives of individuals [2]. Depression, affecting over 300 million people globally, is the most prevalent mental health disorder [3]. A major part of this burden (about 70%) is concentrated in low- and middle-income countries (LMICs). Additionally, a shortage of mental health specialists in LMICs contributes to a mental health treatment gap of 90% for almost all mental health conditions, meaning that only 1 out of 10 conditions requiring mental health treatment receive it from a mental health specialist [3]. Various factors contribute to the mental health treatment gap, including lack of human resources for mental health, stigma, accessibility, uneven mental health service distribution, and lack of a perceived need for treatment [4]. To address this gap, the World Health Organization (WHO) developed the Mental Health Gap Action Programme (mhGAP) by providing evidence-based interventions for 8 priority mental health disorders. These guidelines recommend involving lay health workers and community members in the early detection of mental health disorders and low-intensity psychological care of patients with mental health disorders. This can help LMICs address the treatment gap and health resource shortfall, and achieve WHO Mental Health Action Plan targets [3,4]. Building on the WHO’s mhGAP, several initiatives in LMICs have been developed to address the mental health treatment gap [5-7]. These programs empower nonspecialist health workers to deliver mental health care through structured culturally adapted interventions. Examples include Problem Management Plus (PM+), a transdiagnostic intervention for managing stress and depression, and the Thinking Healthy Programme, which addresses perinatal depression through simplified behavioral strategies. Community-based programs like Friendship Bench in Zimbabwe further extend the reach of mhGAP by embedding mental health support within local settings, demonstrating significant improvements in access and patient outcomes. The Disease Control Priorities (DCP3) report endorses such scalable models as effective affordable solutions that bolster mental health care capacity in LMICs [6,7]. A comprehensive review [7] of 208 studies focusing on various mhGAP interventions in LMICs demonstrated their overall efficacy. The mhGAP interventions were shown to significantly improve the symptoms of common mental health disorders, reduce substance use, and positively impact parenting and child outcomes. Furthermore, mhGAP training across these interventions enhanced the clinical skills, knowledge, and competency of health workers, contributing to improved quality of care after training [7]. PM+ is a low-intensity brief psychological and transdiagnostic intervention for common mental health disorders. It is an evidence-based intervention that can address various mental health issues and address the limitations posed by scarce specialized treatments in low-resource settings [8-14]. PM+ has been designed for depression, anxiety, stress, grief, and self-identified practical issues (interpersonal conflict and unemployment) and is delivered by lay health workers [15]. The intervention consists of 5 weekly face-to-face sessions involving stress management and problem-solving approaches [15]. PM+ has been tested for effectiveness and cost-effectiveness in various LMICs [8-14]. It has proven to be particularly effective in reducing the symptoms of anxiety, depression, and general distress in settings affected by significant adversity, including conflict-affected regions or under-resourced settings [16]. PM+ is recommended for stepped-care models, especially in low-resource settings where it serves as an effective first-line intervention. In these contexts, PM+ addresses common mental health needs at a low cost, allowing higher-intensity services to be reserved for more severe cases. This approach optimizes resource use and enhances accessibility in areas with limited mental health infrastructure. Notably, PM+ is available in several languages including Urdu, and it has been contextualized and rigorously evaluated in Pakistan [10,12,13]. However, the implementation of PM+ can be challenging for lay health workers and can be hampered by issues of quality control in training, supervision, and delivery [8-11]. Lengthy sessions and the complex nature of systematic stress and patient problem management strategies further compound these challenges, along with the struggle to recall all core strategies and protocols [8-11]. This specific phenomenon is termed “program drift” in the field of implementation science, which refers to a situation where the quality and fidelity of an intervention diminish because of deviations from the manual protocol, resulting in a reduction in the potential benefits of the intervention [17]. These challenges and barriers can be overcome by using digital tools and training lay health workers for them [18]. A recent systematic review of studies from LMICs revealed that the integration of digital technologies into mental health interventions led by nonspecialists typically results in positive outcomes and has the potential to address the following three gaps highlighted in mental health literature: (1) the treatment gap, (2) the treatment-quality gap by improving the competencies and knowledge of nonspecialists, and (3) the service utilization gap by increasing the use of mental health care services [18]. Few initiatives have pursued digital adaptations of PM+ to enhance accessibility and scalability, particularly in low-resource settings. The step-by-step intervention was initially conceptualized as an online self-help adaptation of PM+. While the step-by-step intervention initially incorporated the principles of PM+, the intervention diverged as the complexity of implementing problem-solving components within a digital app proved challenging. Consequently, the step-by-step intervention evolved into an independent transdiagnostic intervention focused on managing stress and addressing depression and anxiety through behavioral activation principles [19]. In response to the COVID-19 pandemic, additional digital training frameworks were developed to enable remote training of lay health workers, ensuring uninterrupted mental health support amid physical distancing measures [20]. PM+ has been rigorously evaluated in Pakistan, showing effectiveness in reducing depression and anxiety symptoms [10,12,13]. Despite higher initial costs than the standard care, it has demonstrated long-term cost-effectiveness and is recommended for integration into a stepped-care model in resource-limited settings like Pakistan [12]. In a stepped-care model [21], individuals begin with lower-intensity support and progress to more intensive treatments only if necessary, optimizing resources and tailoring care to individual needs. This approach is particularly relevant in Pakistan, where mental health services are limited and mostly concentrated in major urban centers [22]. Pakistan’s health care system, with its community outreach through "lady health workers" (LHWs; this is the terminology used by the Lady Health Worker Programme for lay health workers) [23], who have established supervision and referral mechanisms, provides a strong foundation for implementing stepped-care mental health interventions like PM+. To address the challenges in implementing PM+ by applying technological assistance and to align with the recommended stepped-care model for Pakistan, we aimed to develop a technological platform Technology-Assisted Problem Management Plus (TA-PM+). TA-PM+ consists of an app designed to support nonspecialists in delivering the PM+ intervention within Pakistan’s health system, with an established backend for supervision, monitoring, and referral processes. TA-PM+ seeks to ensure the consistent delivery of therapeutic components at the appropriate dosage and with high fidelity while being delivered face-to-face, fostering a therapeutic alliance, which is essential for maintaining the problem-management focus required for effective intervention delivery. This paper describes the stepwise co-production of TA-PM+ and its key features. · plain
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“It has proven to be particularly effective in reducing the symptoms of anxiety, depression, and general distress in settings affected by significant adversity, including conflict-affected regions or under-resourced settings [16].”
§ A Digital Tool (Technology-Assisted Problem Management Plus) for Lay Health Workers to Address Common Mental Health Disorders: Co-production and Usability Study in Pakistan > Introduction > Background Recent research has indicated that mental health remains among the top 10 leading causes of disease burden globally and constitutes 32.4% of years lived with disability [1]. Common mental health disorders are conditions that impact mood, thought processes, and behavior, often leading to challenges in daily functioning and overall well-being. These include disorders, such as depression, anxiety, and bipolar disorder, each characterized by unique symptoms and impacts on the lives of individuals [2]. Depression, affecting over 300 million people globally, is the most prevalent mental health disorder [3]. A major part of this burden (about 70%) is concentrated in low- and middle-income countries (LMICs). Additionally, a shortage of mental health specialists in LMICs contributes to a mental health treatment gap of 90% for almost all mental health conditions, meaning that only 1 out of 10 conditions requiring mental health treatment receive it from a mental health specialist [3]. Various factors contribute to the mental health treatment gap, including lack of human resources for mental health, stigma, accessibility, uneven mental health service distribution, and lack of a perceived need for treatment [4]. To address this gap, the World Health Organization (WHO) developed the Mental Health Gap Action Programme (mhGAP) by providing evidence-based interventions for 8 priority mental health disorders. These guidelines recommend involving lay health workers and community members in the early detection of mental health disorders and low-intensity psychological care of patients with mental health disorders. This can help LMICs address the treatment gap and health resource shortfall, and achieve WHO Mental Health Action Plan targets [3,4]. Building on the WHO’s mhGAP, several initiatives in LMICs have been developed to address the mental health treatment gap [5-7]. These programs empower nonspecialist health workers to deliver mental health care through structured culturally adapted interventions. Examples include Problem Management Plus (PM+), a transdiagnostic intervention for managing stress and depression, and the Thinking Healthy Programme, which addresses perinatal depression through simplified behavioral strategies. Community-based programs like Friendship Bench in Zimbabwe further extend the reach of mhGAP by embedding mental health support within local settings, demonstrating significant improvements in access and patient outcomes. The Disease Control Priorities (DCP3) report endorses such scalable models as effective affordable solutions that bolster mental health care capacity in LMICs [6,7]. A comprehensive review [7] of 208 studies focusing on various mhGAP interventions in LMICs demonstrated their overall efficacy. The mhGAP interventions were shown to significantly improve the symptoms of common mental health disorders, reduce substance use, and positively impact parenting and child outcomes. Furthermore, mhGAP training across these interventions enhanced the clinical skills, knowledge, and competency of health workers, contributing to improved quality of care after training [7]. PM+ is a low-intensity brief psychological and transdiagnostic intervention for common mental health disorders. It is an evidence-based intervention that can address various mental health issues and address the limitations posed by scarce specialized treatments in low-resource settings [8-14]. PM+ has been designed for depression, anxiety, stress, grief, and self-identified practical issues (interpersonal conflict and unemployment) and is delivered by lay health workers [15]. The intervention consists of 5 weekly face-to-face sessions involving stress management and problem-solving approaches [15]. PM+ has been tested for effectiveness and cost-effectiveness in various LMICs [8-14]. It has proven to be particularly effective in reducing the symptoms of anxiety, depression, and general distress in settings affected by significant adversity, including conflict-affected regions or under-resourced settings [16]. PM+ is recommended for stepped-care models, especially in low-resource settings where it serves as an effective first-line intervention. In these contexts, PM+ addresses common mental health needs at a low cost, allowing higher-intensity services to be reserved for more severe cases. This approach optimizes resource use and enhances accessibility in areas with limited mental health infrastructure. Notably, PM+ is available in several languages including Urdu, and it has been contextualized and rigorously evaluated in Pakistan [10,12,13]. However, the implementation of PM+ can be challenging for lay health workers and can be hampered by issues of quality control in training, supervision, and delivery [8-11]. Lengthy sessions and the complex nature of systematic stress and patient problem management strategies further compound these challenges, along with the struggle to recall all core strategies and protocols [8-11]. This specific phenomenon is termed “program drift” in the field of implementation science, which refers to a situation where the quality and fidelity of an intervention diminish because of deviations from the manual protocol, resulting in a reduction in the potential benefits of the intervention [17]. These challenges and barriers can be overcome by using digital tools and training lay health workers for them [18]. A recent systematic review of studies from LMICs revealed that the integration of digital technologies into mental health interventions led by nonspecialists typically results in positive outcomes and has the potential to address the following three gaps highlighted in mental health literature: (1) the treatment gap, (2) the treatment-quality gap by improving the competencies and knowledge of nonspecialists, and (3) the service utilization gap by increasing the use of mental health care services [18]. Few initiatives have pursued digital adaptations of PM+ to enhance accessibility and scalability, particularly in low-resource settings. The step-by-step intervention was initially conceptualized as an online self-help adaptation of PM+. While the step-by-step intervention initially incorporated the principles of PM+, the intervention diverged as the complexity of implementing problem-solving components within a digital app proved challenging. Consequently, the step-by-step intervention evolved into an independent transdiagnostic intervention focused on managing stress and addressing depression and anxiety through behavioral activation principles [19]. In response to the COVID-19 pandemic, additional digital training frameworks were developed to enable remote training of lay health workers, ensuring uninterrupted mental health support amid physical distancing measures [20]. PM+ has been rigorously evaluated in Pakistan, showing effectiveness in reducing depression and anxiety symptoms [10,12,13]. Despite higher initial costs than the standard care, it has demonstrated long-term cost-effectiveness and is recommended for integration into a stepped-care model in resource-limited settings like Pakistan [12]. In a stepped-care model [21], individuals begin with lower-intensity support and progress to more intensive treatments only if necessary, optimizing resources and tailoring care to individual needs. This approach is particularly relevant in Pakistan, where mental health services are limited and mostly concentrated in major urban centers [22]. Pakistan’s health care system, with its community outreach through "lady health workers" (LHWs; this is the terminology used by the Lady Health Worker Programme for lay health workers) [23], who have established supervision and referral mechanisms, provides a strong foundation for implementing stepped-care mental health interventions like PM+. To address the challenges in implementing PM+ by applying technological assistance and to align with the recommended stepped-care model for Pakistan, we aimed to develop a technological platform Technology-Assisted Problem Management Plus (TA-PM+). TA-PM+ consists of an app designed to support nonspecialists in delivering the PM+ intervention within Pakistan’s health system, with an established backend for supervision, monitoring, and referral processes. TA-PM+ seeks to ensure the consistent delivery of therapeutic components at the appropriate dosage and with high fidelity while being delivered face-to-face, fostering a therapeutic alliance, which is essential for maintaining the problem-management focus required for effective intervention delivery. This paper describes the stepwise co-production of TA-PM+ and its key features.
What the sources say
- Partly supportedcites [16] matched to “World Health Organization's low‐intensity psychosocial interventions: a systematic review and meta‐analysis of the effects of Problem Management Plus and Step‐by‐Step” (2023) sourceExperimental — accuracy not yet measured
The Effects at post-intervention section reports reductions in anxiety, depressive symptoms, and general distress for PM+ and Step-by-Step combined; the Discussion places these interventions in populations exposed to adversity. But the paper does not establish that PM+ is particularly effective in conflict-affected or under-resourced settings, and the Abstract rates the certainty of evidence as very low. “Proven particularly effective” overstates those findings. (LLM, conf=0.85)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“A notable challenge in LMICs pertains to the availability of internet access and sufficient bandwidth.”
§ A Digital Tool (Technology-Assisted Problem Management Plus) for Lay Health Workers to Address Common Mental Health Disorders: Co-production and Usability Study in Pakistan > Discussion > Principal Findings
What the sources say
- Partly supportedcites [38] matched to “Perception of healthcare workers on mobile app-based clinical guideline for the detection and treatment of mental health problems in primary care: a qualitative study in Nepal” (2021) sourceExperimental — accuracy not yet measured
The Results section, under “Perceived barriers of using the app based clinical guideline” (page unavailable), identifies lack of internet access and poor connectivity at remote health facilities in Nepal as a major barrier. It does not specifically assess bandwidth, and its findings from Nepal do not establish the extent of the challenge across LMICs. (LLM, conf=0.84)
- Partly supportedcites [39] matched to “Experience of primary healthcare workers in using the mobile app-based WHO mhGAP intervention guide in detection and treatment of people with mental disorders: A qualitative study in Nepal” (2023) sourceExperimental — accuracy not yet measured
The Results section identifies unavailable or poor internet connectivity as a challenge to using the app in Nepal. The paper does not specifically assess bandwidth or establish how widespread this challenge is across LMICs. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Training, professional support, user guidance, an easy and automated interface, offline functionalities, incentives, and strong credibility among communities were perceived to enhance the capability, opportunity, and motivation of LHWs to implement TA-PM+.”
§ A Digital Tool (Technology-Assisted Problem Management Plus) for Lay Health Workers to Address Common Mental Health Disorders: Co-production and Usability Study in Pakistan > Abstract > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
37 more claims
Create a free account to see all 112 claims and to verify the 5 references still open.
- Probably not a substantial claim. 53
- It may state two separate claims as one. 31
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A Digital Tool (Technology-Assisted Problem Management Plus) for Lay Health Workers to Address Common Mental Health Disorders: Co-production and Usability Study in Pakistan > Methods > TA-PM+ Co-production
“The MUAQ comprises 18 items rated on a 7-point scale, with a higher score indicating greater usability.”
§ A Digital Tool (Technology-Assisted Problem Management Plus) for Lay Health Workers to Address Common Mental Health Disorders: Co-production and Usability Study in Pakistan > Abstract > Methods
“Stage 3 (prototyping) involved 2 usability testing rounds. In round 1 conducted in laboratory settings, 6 LHWs participated in role plays and completed the 15-item mHealth Usability App Questionnaire (MUAQ) (score range 0-7).”
Citations
Cites
Atkins, L., Francis, J., Islam, R., O’Connor, D., Patey, A., Ivers, N., Foy, R., Duncan, E. M., Colquhoun, H., Grimshaw, J. M., et al. (2017) · Implementation Science · doi:10.1186/s13012-017-0605-9 · Cited by 3,819 · cited 1×
“The deductive framework was constructed using the Capability Opportunity and Motivation for Behavioral Change framework and the Theoretical Domain Framework (TDF) [26].”
The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change
Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013) · Implementation Science · doi:10.1186/1748-5908-8-117 · Cited by 1,724 · cited 1×
“…specific phenomenon is termed “program drift” in the field of implementation science, which refers to a situation where the quality and fidelity of an intervention diminish because of deviations from the manual protocol, resulting in a reduction in the potential benefits of the intervention [17].”
The mHealth App Usability Questionnaire (MAUQ): Development and Validation Study
Zhou, L., Bao, J., Setiawan, I. M. A., Saptono, A., & Parmanto, B. (2019) · JMIR mHealth and uHealth · doi:10.2196/11500 · Cited by 675 · cited 2×
“After session delivery, the MUAQ [31] was administered to the LHWs, while the Patient Satisfaction Questionnaire (PSQ) involving an mHealth intervention [32] adapted for TA-PM+ was administered to the participants.”
Feedback from research participants: are member checks useful in qualitative research?
Thomas, D. R. (2017) · Qualitative Research in Psychology · doi:10.1080/14780887.2016.1219435 · Cited by 487 · cited 1×
“Additionally, member checking [27] (ie, sharing the findings with all members of the workshop) was carried out to verify the authenticity of the summarized findings.”
Dawson, K. S., Bryant, R. A., Harper, M., Kuowei Tay, A., Rahman, A., Schafer, A., & van Ommeren, M. (2015) · World Psychiatry · doi:10.1002/wps.20255 · Cited by 440 · cited 2×
“PM+ has been designed for depression, anxiety, stress, grief, and self-identified practical issues (interpersonal conflict and unemployment) and is delivered by lay health workers [15].”
Development of a framework for the co-production and prototyping of public health interventions
Hawkins, J., Madden, K., Fletcher, A., Midgley, L., Grant, A., Cox, G., Moore, L., Campbell, R., Murphy, S., Bonell, C., et al. (2017) · BMC Public Health · doi:10.1186/s12889-017-4695-8 · Cited by 310 · cited 1×
“In line with the 3-stage framework of co-production and prototyping of public health interventions [25], TA-PM+ was designed in three stages: (1) qualitative investigation, (2) co-production, and (3) prototyping and usability testing.”
Morrison, L. G., Yardley, L., Powell, J., & Michie, S. (2012) · Telemedicine and e-Health · doi:10.1089/tmj.2011.0062 · Cited by 290 · cited 1×
“Likewise, recent reviews on engagement with digital mental health interventions [40,41] identified that tailored digital technologies with personalized videos and avatars increased user engagement and demonstrated effectiveness.”
World Health Assembly adopts Comprehensive Mental Health Action Plan 2013–2020
Saxena, S., Funk, M., & Chisholm, D. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61139-3 · Cited by 218
Saleem, M., Kühne, L., De Santis, K. K., Christianson, L., Brand, T., & Busse, H. (2021) · JMIR Mental Health · doi:10.2196/30000 · Cited by 199 · cited 1×
“Likewise, recent reviews on engagement with digital mental health interventions [40,41] identified that tailored digital technologies with personalized videos and avatars increased user engagement and demonstrated effectiveness.”
Self-citation
Research works printed but not linked: 3
- 2013, Diagnostic and statistical manual of mental disorders: DSM-5
- Hafeez, A, 2011, J Pak Med Assoc, 61, 210
- Joyce, G, 2014, Design, User Experience, and Usability. Theories, Methods, and Tools for Designing the User Experience. DUXU 2014. Lecture Notes in Computer Science, vol 8517, 465
Cited by
Chau, L. W., Lam, R. W. M., Minas, H., Hayashi, K., Nguyen, V. C., & O’Neil, J. (2025) · JMIR Mental Health · doi:10.2196/68296 · Cited by 39
“%) reported on the importance of orientation and training programs and mobilization of community health volunteers [89,111] and how an understanding of the intervention and its potential benefits will likely support its uptake [90].”
InfluentialFuhr, D. C. (2025) · Public Health Forum · doi:10.1515/pubhef-2025-0055
“A digital support and implementation strategy is currently being trialled that shows promise to further facilitate intervention delivery during face to face sessions [15].”
Self-citationOccupational Noise Exposure and Age as Predictors of Disabling Hearing Loss in Pakistan
Hanif, H., Thakur, I., Georgiou, G. P., & Βinos, P. (2025) · Language, Technology, and Social Media. · doi:10.70211/ltsm.3026-7196.275 · Cited by 1
Posas, J. A., & Libradilla, D. (2026) · Psychology and Education A Multidisciplinary Journal · doi:10.70838/pemj.520902
Saleem, M., Zafar, S., Abbasi, F., Pohlabeln, H., Sikander, S., Fuhr, D. C., & Zeeb, H. (2026) · Scientific Reports · doi:10.1038/s41598-026-49596-8
Self-citation
Metadata
- Authors
- Saleem, M., Zafar, S., Klein, T., Koesters, M., Bashir, A., Fuhr, D. C., Sikander, S., & Zeeb, H.
- Affiliations
- Leibniz Institute for Prevention Research and Epidemiology - BIPS (DE)
- Air University (PK)
- Universität Ulm (DE)
- Zentrum für Evidenzbasierte Gesundheitsversorgung (DE)
- University of Liverpool (GB)
- Corresponding author
- Saleem, Maham
- ORCID
- Venue
- JMIR Formative Research
- Publisher
- JMIR Publications Inc.
- Published
- 2025-01-28
- Volume
- 9
- Pages
- e59414
- ISSN
- 2561-326X (ISSN-L)
- PMC
- PMC11815293
- OpenAlex
- W4406900904
- Semantic Scholar
- 1a6b8ee62b2c89f3409944501c2a3aae626f2a74
- Cited by
- 5
- References
- 34
- Citations by year
- 2026: 2 · 2025: 3
- FWCI
- 3.99
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Formative Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Bundesministerium für Bildung und Forschung (01KA2105A)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- Problem Management Plus, lay health workers, Lady Health Workers, digital mental health interventions, mobile health, co-production, usability testing, depression, anxiety, common mental disorders, women's mental health, community mental health services, treatment gap, COM-B model, digital skills, offline functionality, Pakistan, patient satisfaction, role-play training
- MeSH terms
- Digital Technology, Adult, Mental Disorders, Community Health Workers, Female, Humans, Male, Middle Aged, Pakistan, Focus Groups, Telemedicine, Qualitative Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Digital Tool (Technology-Assisted Problem Management Plus) for Lay Health Workers to Address Common Mental Health Disorders: Co-production and Usability Study in Pakistan. https://app.cochat.ai/papers/10.2196/59414
- The paper
- Saleem, M., Zafar, S., Klein, T., Koesters, M., Bashir, A., Fuhr, D. C., Sikander, S., & Zeeb, H. (2025). A Digital Tool (Technology-Assisted Problem Management Plus) for Lay Health Workers to Address Common Mental Health Disorders: Co-production and Usability Study in Pakistan. JMIR Formative Research. https://doi.org/10.2196/59414
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.