Using Participatory Design Methodologies to Co-Design and Culturally Adapt the Spanish Version of the Mental Health eClinic: Qualitative Study
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Background: The Mental Health eClinic (MHeC) aims to deliver best-practice clinical services to young people experiencing mental health problems by making clinical care accessible, affordable, and available to young people whenever and wherever they need it most. The original MHeC consists of home page with a visible triage system for those requiring urgent help; a online physical and mental health self-report assessment; a results dashboard; a booking and videoconferencing system; and the generation of a personalized well-being plan. Populations who do not speak English and reside in English-speaking countries are less likely to receive mental health care. In Australia, international students have been identified as disadvantaged compared with their peers; have weaker social support networks; and have higher rates of psychological distress. This scenario is acquiring significant relevance as Spanish-speaking migration is rapidly growing in Australia, and the mental health services for culturally and linguistically diverse populations are limited. Having a Spanish version (MHeC-S) of the Mental Health eClinic would greatly benefit these students. Objective: We used participatory design methodologies with users (young people aged 16-30 years, supportive others, and health professionals) to (1) conduct workshops with users to co-design and culturally adapt the MHeC; (2) inform the development of the MHeC-S alpha prototype; (3) test the usability of the MHeC-S alpha prototype; (4) translate, culturally adapt, and face-validate the MHeC-S self-report assessment; and (5) collect information to inform its beta prototype. Methods: A research and development cycle included several participatory design phases: co-design workshops; knowledge translation; language translation and cultural adaptation; and rapid prototyping and user testing of the MHeC-S alpha prototype. Results: We held 2 co-design workshops with 17 users (10 young people, 7 health professionals). A total of 15 participated in the one-on-one user testing sessions (7 young people, 5 health professionals, 3 supportive others). We collected 225 source documents, and thematic analysis resulted in 5 main themes (help-seeking barriers, technology platform, functionality, content, and user interface). A random sample of 106 source documents analyzed by 2 independent raters revealed almost perfect agreement for functionality (kappa=.86; P<.001) and content (kappa=.92; P<.001) and substantial agreement for the user interface (kappa=.785; P<.001). In this random sample, no annotations were coded for help-seeking barriers or the technology platform. Language was identified as the main barrier to getting medical or psychological services, and smartphones were the most-used device to access the internet. Acceptability was adequate for the prototype’s 5 main elements: home page and triage system, self-report assessment, dashboard of results, booking and video visit system, and personalized well-being plan. The data also revealed gaps in the alpha prototype, such as the need for tailored assessment tools and a greater integration with Spanish-speaking services and communities. Spanish-language apps and e-tools, as well as online mental health information, were lacking. Conclusions: Through a research and development process, we co-designed and culturally adapted, developed and user tested, and evaluated the MHeC-S. By translating and culturally adapting the MHeC to Spanish, we aimed to increase accessibility and availability of e-mental health care in the developing world, and assist vulnerable populations that have migrated to English-speaking countries.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
SAUNDERS, J. B., AASLAND, O. G., BABOR, T. F., DE LA FUENTE, J. R., & GRANT, M. (1993) · Addiction · doi:10.1111/j.1360-0443.1993.tb02093.x · Cited by 13,597
The Fagerstrom Test for Nicotine Dependence: a revision of the Fagerstrom Tolerance Questionnaire
HEATHERTON, T. F., KOZLOWSKI, L. T., FRECKER, R. C., & FAGERSTROM, K. (1991) · British Journal of Addiction · doi:10.1111/j.1360-0443.1991.tb01879.x · Cited by 10,738
KESSLER, R. C., ANDREWS, G., COLPE, L. J., HIRIPI, E., MROCZEK, D. K., NORMAND, S.-L. T., WALTERS, E. E., & ZASLAVSKY, A. M. (2002) · Psychological Medicine · doi:10.1017/s0033291702006074 · Cited by 10,327
Qualitative research in health care: Analysing qualitative data
Pope, C. (2000) · BMJ · doi:10.1136/bmj.320.7227.114 · Cited by 8,131
Psychometric properties of the PTSD checklist (PCL)
Blanchard, E. B., Jones-Alexander, J., Buckley, T. C., & Forneris, C. A. (1996) · Behaviour Research and Therapy · doi:10.1016/0005-7967(96)00033-2 · Cited by 3,997
Rush, A. J., Trivedi, M. H., Ibrahim, H. M., Carmody, T. J., Arnow, B., Klein, D. N., Markowitz, J. C., Ninan, P. T., Kornstein, S., Manber, R., et al. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01866-8 · Cited by 3,829
Sousa, V. D., & Rojjanasrirat, W. (2011) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01434.x · Cited by 3,322 · cited 1×
“…culturally adapt, and face-validate the Australian self-report assessment using a modified version of the “user-friendly guideline for the translation, adaptation and validation of instruments or scales for cross-cultural health care research” developed by Sousa and Rojjanasrirat [55].”
Detecting Alcoholism: The CAGE Questionnaire
Ewing, J. A. (1984) · JAMA · doi:10.1001/jama.1984.03350140051025 · Cited by 3,005
Global burden of disease in young people aged 10–24 years: a systematic analysis
Gore, F. M., Bloem, P. J., Patton, G. C., Ferguson, J., Joseph, V., Coffey, C., Sawyer, S. M., & Mathers, C. D. (2011) · The Lancet · doi:10.1016/s0140-6736(11)60512-6 · Cited by 2,301 · cited 1×
“Limited access to services is of particular concern for young people, as it is well established that 75% of the serious mental diseases and substance use problems emerge before 25 years of age [3].”
Group, W. A. W. (2002) · Addiction · doi:10.1046/j.1360-0443.2002.00185.x · Cited by 1,982
Bhugra, D. (2004) · Acta Psychiatrica Scandinavica · doi:10.1046/j.0001-690x.2003.00246.x · Cited by 1,196
McHugh, R. K., & Barlow, D. H. (2010) · American Psychologist · doi:10.1037/a0018121 · Cited by 909 · cited 1×
“The internet and new and emerging technologies hold enormous promise for significantly expanding the reach of adequate-quality mental health care by addressing several barriers [18].”
Supportive interactions, negative interactions, and depressed mood
Schuster, T. L., Kessler, R. C., & Aseltine, R. H. (1990) · American Journal of Community Psychology · doi:10.1007/bf00938116 · Cited by 835
Development and validation of an Overall Anxiety Severity and Impairment Scale (OASIS)
Norman, S. B., Hami Cissell, S., Means-Christensen, A. J., & Stein, M. B. (2006) · Depression and Anxiety · doi:10.1002/da.20182 · Cited by 770 · cited 1×
“Overall Anxiety Severity and Impairment Scale [70] Anxiety 6.”
Garcia-Campayo, J., Zamorano, E., Ruiz, M. A., Pardo, A., Perez-Paramo, M., Lopez-Gomez, V., Freire, O., & Rejas, J. (2010) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-8-8 · Cited by 673 · cited 1×
“We replaced the Suicidal Ideation Attributes Scale with the Suicide Behaviors Questionnaire-Revised [111] and we replaced the Overall Anxiety Severity and Impairment Scale with the 7-item Generalized Anxiety Disorder scale [112], both of which have their translation process and psychometric properties published.”
Methode-Health technologies show promise in developing countries
Blaya, J. A., Fraser, H. S. F., & Holt, B. (2010) · Health Affairs · doi:10.1377/hlthaff.2009.0894 · Cited by 581
van Spijker, B. A. J., Batterham, P. J., Calear, A. L., Farrer, L., Christensen, H., Reynolds, J., & Kerkhof, A. J. F. M. (2014) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12084 · Cited by 492
Hunkeler, E. M. (2000) · Archives of Family Medicine · doi:10.1001/archfami.9.8.700 · Cited by 464
Latulippe, K., Hamel, C., & Giroux, D. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6731 · Cited by 458 · cited 1×
“…Spanish is the second most common language spoken worldwide and HIT is a growing field, Spanish-speaking populations (including migrants and those residing in low-and middle-income countries) are at risk of experiencing not only physical but also technological social health inequalities [115].”
Reducing the treatment gap for mental disorders: a WPA survey
PATEL, V., MAJ, M., FLISHER, A. J., DE SILVA, M. J., KOSCHORKE, M., PRINCE, M., WPA Zonal and Member Society Representatives, Tempier, R., Riba, M., Sanchez, M., et al. (2010) · World Psychiatry · doi:10.1002/j.2051-5545.2010.tb00305.x · Cited by 420 · cited 1×
“When young people do seek and receive help, timely and evidence-based treatments are encountered by only a small proportion; in some low- and middle-income countries, the treatment gap can be as high as 90% [4].”
BackgroundClinician-Assisted Internet-Based Treatment is Effective for Panic: A Randomized Controlled Trial
Wims, E., Titov, N., Andrews, G., & Choi, I. (2010) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048671003614171 · Cited by 290
Clinician-Assisted Internet-Based Treatment is Effective for Depression: Randomized Controlled Trial
Perini, S., Titov, N., & Andrews, G. (2009) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670902873722 · Cited by 231 · cited 1×
“Although positive results are seen from the use of self-directed electronic health interventions, increased effectiveness has been reported if they are used as part of a stepped-care model [28], with the support of a trained health professional [29] or as an adjunct to face-to-face treatment [30].”
Calear, A. L., & Christensen, H. (2010) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2010.tb03686.x · Cited by 220 · cited 1×
“A large number of studies, including randomized controlled trials, have also demonstrated the effectiveness of various internet-delivered interventions, such as psychotherapy and psychoeducation [22], treating problematic health behaviors [23], and delivering prevention and treatment programs [24].”
Stip, E., Caron, J., Renaud, S., Pampoulova, T., & Lecomte, Y. (2003) · Comprehensive Psychiatry · doi:10.1016/s0010-440x(03)00086-5 · Cited by 214 · cited 2×
“The self-report assessment included 16 modules (Table 1 [64-89]) with smart skips built in so that it was tailored to each individual and took a minimum amount of time to complete (approximately 45 minutes).”
MethodTelemedicine across borders: A systematic review of factors that hinder or support implementation
Saliba, V., Legido-Quigley, H., Hallik, R., Aaviksoo, A., Car, J., & McKee, M. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.08.003 · Cited by 173 · cited 2×
“Traditional telemedicine has supported the cooperation between developed and developing countries to deliver care across borders by linking professionals rather than providing direct connection between professionals and patients [32].”
van der Zanden, R., Kramer, J., Gerrits, R., & Cuijpers, P. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2033 · Cited by 152
Aguilera, A., Bruehlman-Senecal, E., Demasi, O., & Avila, P. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6914 · Cited by 122 · cited 1×
“Initial reports have demonstrated their potential utility in the screening of mental health problems [40], as well as in the treatment of depression [31,41,42], anxiety [43], and substance use disorders [44].”
Peters, D., Davis, S., Calvo, R. A., Sawyer, S. M., Smith, L., & Foster, J. M. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6994 · Cited by 92 · cited 1×
“Experience in other languages (mostly English) has demonstrated that participatory design research methodologies that involve stakeholders and end users in the design and development of these systems at all stages could finally increase user engagement and system usability [45-48].”
Moreno, F. A., Chong, J., Dumbauld, J., Humke, M., & Byreddy, S. (2012) · Psychiatric Services · doi:10.1176/appi.ps.201100274 · Cited by 91
Evaluating the promise of health IT to enhance/expand the reach of mental health services
Clarke, G., & Yarborough, B. J. (2013) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2013.03.013 · Cited by 88 · cited 1×
“Access to adequate-quality mental health care is also limited for many populations but is particularly limited for vulnerable groups such as the elderly and youth populations, racial and ethnic minorities, the socioeconomically disadvantaged, and rural populations [2].”
BackgroundRomero-Sanchiz, P., Nogueira-Arjona, R., García-Ruiz, A., Luciano, J. V., García Campayo, J., Gili, M., Botella, C., Baños, R., Castro, A., López-Del-Hoyo, Y., et al. (2017) · PLOS ONE · doi:10.1371/journal.pone.0172741 · Cited by 78 · cited 1×
“Initial reports have demonstrated their potential utility in the screening of mental health problems [40], as well as in the treatment of depression [31,41,42], anxiety [43], and substance use disorders [44].”
Baker-Ericzén, M. J., Connelly, C. D., Hazen, A. L., Dueñas, C., Landsverk, J. A., & Horwitz, S. M. (2012) · Families, Systems, & Health · doi:10.1037/a0028750 · Cited by 78
Hoek, W., Marko, M., Fogel, J., Schuurmans, J., Gladstone, T., Bradford, N., Domanico, R., Fagan, B., Bell, C., Reinecke, M. A., et al. (2011) · Translational research · doi:10.1016/j.trsl.2011.07.006 · Cited by 73 · cited 1×
“English-language, Web-based mental health interventions have proven to be effective for self-screening and referral [6], reducing symptoms and delivering effective treatment for major mental health disorders [21].”
Kim, E.-H., Coumar, A., Lober, W. B., & Kim, Y. (2011) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2011.2107561 · Cited by 65 · cited 2×
“English-language, Web-based mental health interventions have proven to be effective for self-screening and referral [6], reducing symptoms and delivering effective treatment for major mental health disorders [21].”
Hickie, I. B., Luscombe, G. M., Davenport, T. A., Burns, J. M., & Highet, N. J. (2007) · Early Intervention in Psychiatry · doi:10.1111/j.1751-7893.2007.00042.x · Cited by 39
Self-citation
Cited by
An overview of and recommendations for more accessible digital mental health services
Lattie, E. G., Stiles-Shields, C., & Graham, A. K. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-021-00003-1 · Cited by 446
Grindell, C., Coates, E., Croot, L., & O’Cathain, A. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08079-y · Cited by 409
“They perceived that their ‘co’approach helped retain engagement even within those groups who do not traditionally get involved in research [34, 35, 39, 50]: ‘The research and development cycle that we employed in this study is an optimal methodology to engage, retain, and work more efficiently with hardto-reach popula…”
BackgroundInfluentialBack to the Future: Achieving Health Equity Through Health Informatics and Digital Health
Brewer, L. C., Fortuna, K. L., Jones, C., Walker, R., Hayes, S. N., Patten, C. A., & Cooper, L. A. (2020) · JMIR mHealth and uHealth · doi:10.2196/14512 · Cited by 367
Chunara, R., Zhao, Y., Chen, J., Lawrence, K., Testa, P. A., Nov, O., & Mann, D. M. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa217 · Cited by 317
Whitehead, L., Talevski, J., Fatehi, F., & Beauchamp, A. (2023) · Journal of Medical Internet Research · doi:10.2196/42719 · Cited by 261
Metadata
- Authors
- Ospina-Pinillos, L., Davenport, T., Mendoza Diaz, A., Navarro-Mancilla, A., Scott, E. M., & Hickie, I. B.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-08-02
- Volume
- 21
- Issue
- 8
- Pages
- e14127
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2965575732
- Cited by
- 104
- References
- 37
- FWCI
- 12.32
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.