Developing a Mental Health eClinic to Improve Access to and Quality of Mental Health Care for Young People: Using Participatory Design as Research Methodologies
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Each year, many young Australians aged between 16 and 25 years experience a mental health disorder, yet only a small proportion access services and even fewer receive timely and evidence-based treatments. Today, with ever-increasing access to the Internet and use of technology, the potential to provide all young people with access (24 hours a day, 7 days a week) to the support they require to improve their mental health and well-being is promising. OBJECTIVE: The aim of this study was to use participatory design (PD) as research methodologies with end users (young people aged between 16 and 25 years and youth health professionals) and our research team to develop the Mental Health eClinic (a Web-based mental health clinic) to improve timely access to, and better quality, mental health care for young people across Australia. METHODS: A research and development (R&D) cycle for the codesign and build of the Mental Health eClinic included several iterative PD phases: PD workshops; translation of knowledge and ideas generated during workshops to produce mockups of webpages either as hand-drawn sketches or as wireframes (simple layout of a webpage before visual design and content is added); rapid prototyping; and one-on-one consultations with end users to assess the usability of the alpha build of the Mental Health eClinic. RESULTS: Four PD workshops were held with 28 end users (young people n=18, youth health professionals n=10) and our research team (n=8). Each PD workshop was followed by a knowledge translation session. At the conclusion of this cycle, the alpha prototype was built, and one round of one-on-one end user consultation sessions was conducted (n=6; all new participants, young people n=4, youth health professionals n=2). The R&D cycle revealed the importance of five key components for the Mental Health eClinic: a home page with a visible triage system for those requiring urgent help; a comprehensive online physical and mental health assessment; a detailed dashboard of results; a booking and videoconferencing system to enable video visits; and the generation of a personalized well-being plan that includes links to evidence-based, and health professional-recommended, apps and etools. CONCLUSIONS: The Mental Health eClinic provides health promotion, triage protocols, screening, assessment, a video visit system, the development of personalized well-being plans, and self-directed mental health support for young people. It presents a technologically advanced and clinically efficient system that can be adapted to suit a variety of settings in which there is an opportunity to connect with young people. This will enable all young people, and especially those currently not able or willing to connect with face-to-face services, to receive best practice clinical services by breaking down traditional barriers to care and making health care more personalized, accessible, affordable, and available.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
How Many Interviews Are Enough?: An Experiment with Data Saturation and Variability
Guest, G., Bunce, A., & Johnson, L. (2006) · Field Methods · doi:10.1177/1525822x05279903 · Cited by 20,808
The answer is 17 years, what is the question: understanding time lags in translational research
Morris, Z. S., Wooding, S., & Grant, J. (2011) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2011.110180 · Cited by 3,340 · cited 1×
“As consumers have the opportunity to share their preferences before the development of expensive, and potentially helpful, systems, the rationale behind the use of PD in the development of mental health technologies could mean that an active engagement of end users could reduce the 17-year gap in translational researc…”
BackgroundSensitive questions in surveys.
Tourangeau, R., & Yan, T. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.5.859 · Cited by 3,057 · cited 1×
“Individuals often show a preference for computerized screening over face-to-face interviews when the subject matter is sensitive in nature [28-32].”
BackgroundMobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · cited 1×
“Youth health professionals felt confident about the MHeC suggesting apps and etools to young people “only if they are from a reputable source” and had greater confidence in those that had been independently rated using the Mobile App Rating Scale [75].”
Eysenbach, G., Powell, J., Kuss, O., & Sa, E.-R. (2002) · JAMA · doi:10.1001/jama.287.20.2691 · Cited by 1,871
Prevalence and correlates of depression, anxiety, and suicidality among university students
Eisenberg, D., Gollust, S. E., Golberstein, E., & Hefner, J. L. (2007) · American Journal of Orthopsychiatry · doi:10.1037/0002-9432.77.4.534 · Cited by 1,592 · cited 1×
“Several studies emphasize that screening alone is insufficient for connecting end users with the necessary resources for effective treatment [9,76-78].”
BackgroundInternet-Based and Other Computerized Psychological Treatments for Adult Depression: A Meta-Analysis
Andersson, G., & Cuijpers, P. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070903318960 · Cited by 1,368 · cited 1×
“Importantly, there is also a growing body of literature supporting the use of Internet-based treatment approaches for a range of mental health problems in adults and adolescents [6,17-19].”
BackgroundMcHugh, R. K., & Barlow, D. H. (2010) · American Psychologist · doi:10.1037/a0018121 · Cited by 909 · cited 1×
“The Internet and emerging technologies have long been identified as having the potential to significantly expand the reach of quality mental health care by addressing geographical, economical, and human resource barriers [1,2].”
BackgroundMuller, M. J., & Kuhn, S. (1993) · Communications of the ACM · doi:10.1145/153571.255960 · Cited by 909
2007 National Survey of Mental Health and Wellbeing: Methods and Key Findings
Slade, T., Johnston, A., Oakley Browne, M. A., Andrews, G., & Whiteford, H. (2009) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670902970882 · Cited by 832
Psychoeducation for depression, anxiety and psychological distress: a meta-analysis
Donker, T., Griffiths, K. M., Cuijpers, P., & Christensen, H. (2009) · BMC Medicine · doi:10.1186/1741-7015-7-79 · Cited by 542 · cited 1×
“In line with these recommendations, Internet-based clinical assessments have been implemented and trialed in various Web-based clinics as a means of rapid assessment and referral to appropriate online interventions [79,80] and integrated with face-to-face and online support [20].”
BackgroundReview of key telepsychiatry outcomes
Hubley, S., Lynch, S. B., Schneck, C., Thomas, M., & Shore, J. (2016) · World Journal of Psychiatry · doi:10.5498/wjp.v6.i2.269 · Cited by 492 · cited 1×
“Importalty, videoconferencing has been found to be as reliable as face-to-face assessments, and more cost-effective [41].”
BackgroundEvaluation of symptom checkers for self diagnosis and triage: audit study
Semigran, H. L., Linder, J. A., Gidengil, C., & Mehrotra, A. (2015) · BMJ · doi:10.1136/bmj.h3480 · Cited by 489 · cited 1×
“In general, there is, however, the potential that symptom, Web-based assessment tools may increase demand on services as the tools are often risk averse (due to medico-legal concerns), recommending professional care when self-management is an appropriate alternative [36,37].”
BackgroundA systematic review of online youth mental health promotion and prevention interventions
Clarke, A. M., Kuosmanen, T., & Barry, M. M. (2015) · Journal of Youth and Adolescence · doi:10.1007/s10964-014-0165-0 · Cited by 381 · cited 1×
“for young people, however, limited uptake, engagement, adherence, and dropout rates have been identified as significant problems [48,49].”
BackgroundEmerging mHealth and eHealth interventions for serious mental illness: a review of the literature
Naslund, J. A., Marsch, L. A., McHugo, G. J., & Bartels, S. J. (2015) · Journal of Mental Health · doi:10.3109/09638237.2015.1019054 · Cited by 327 · cited 1×
“Importantly, there is also a growing body of literature supporting the use of Internet-based treatment approaches for a range of mental health problems in adults and adolescents [6,17-19].”
BackgroundGriffiths, K. M., Farrer, L., & Christensen, H. (2010) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2010.tb03685.x · Cited by 303 · cited 2×
“Importantly, there is also a growing body of literature supporting the use of Internet-based treatment approaches for a range of mental health problems in adults and adolescents [6,17-19].”
BackgroundChristensen, H., Griffiths, K. M., & Korten, A. (2002) · Journal of Medical Internet Research · doi:10.2196/jmir.4.1.e3 · Cited by 292 · cited 2×
“[63]; beyondblue [64,65]); national online counseling services (eg, eheadspace [66]); structured self-directed online therapy (eg, MoodGYM [67]); and those offering a combination of assessment and structured online therapy, including additional therapist support (eg, MindSpot Clinic [68]).”
BackgroundCost Effectiveness of Internet Interventions: Review and Recommendations
Tate, D. F., Finkelstein, E. A., Khavjou, O., & Gustafson, A. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9131-6 · Cited by 261 · cited 1×
“Importantly, there is also a growing body of literature supporting the use of Internet-based treatment approaches for a range of mental health problems in adults and adolescents [6,17-19].”
BackgroundRickwood, D. J., Telford, N. R., Parker, A. G., Tanti, C. J., & McGorry, P. D. (2014) · Medical Journal of Australia · doi:10.5694/mja13.11235 · Cited by 207 · cited 2×
“Innovations in the use of technology during the assessment process hold potential as they can go some way to addressing documented youth service capacity issues [84,88].”
BackgroundDoherty, G., Coyle, D., & Sharry, J. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208602 · Cited by 198
Titov, N., Dear, B. F., Staples, L. G., Bennett-Levy, J., Klein, B., Rapee, R. M., Shann, C., Richards, D., Andersson, G., Ritterband, L., et al. (2015) · Psychiatric Services · doi:10.1176/appi.ps.201400477 · Cited by 181
Orlowski, S. K., Lawn, S., Venning, A., Winsall, M., Jones, G. M., Wyld, K., Damarell, R. A., Antezana, G., Schrader, G., Smith, D., et al. (2015) · JMIR Human Factors · doi:10.2196/humanfactors.4361 · Cited by 165
Transdiagnostic stepped care in mental health
Cross, S., & Hickie, I. (2017) · Public Health Research and Practice · doi:10.17061/phrp2721712 · Cited by 130 · cited 1×
“Web-based platforms are also being used to deliver real-time stepped care services [10], providing information and low-intensity treatment for those in the early stages of help-seeking, with the capacity to increase scope and intensity of treatments as illnesses progress”
MethodSelf-citationHickie, I. (2004) · Australasian Psychiatry · doi:10.1111/j.1039-8562.2004.02098.x-i1 · Cited by 93
Self-citationPeters, D., Davis, S., Calvo, R. A., Sawyer, S. M., Smith, L., & Foster, J. M. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6994 · Cited by 92 · cited 1×
“Participatory design (PD) methodologies, which were developed in the late 1960s and early 1970s, emphasize the importance of involving all stakeholders (including end users, developers, and researchers) during the development of products to help ensure the end product meets everyone’s needs; improve usability; and inc…”
BackgroundEvaluating the promise of health IT to enhance/expand the reach of mental health services
Clarke, G., & Yarborough, B. J. (2013) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2013.03.013 · Cited by 88 · cited 1×
“Access to quality care is especially difficult for disadvantaged and vulnerable populations, including children; Aboriginal and Torres Strait Islander young peoples; young people from culturally and linguistically diverse backgrounds; and young people living in regional, rural, and remote areas [14,15].”
Rickwood, D., Webb, M., Kennedy, V., & Telford, N. (2016) · JMIR Mental Health · doi:10.2196/mental.5988 · Cited by 66 · cited 1×
“In Australia, Web-based mental health services include health promotion, self-directed, and low intensity mental health support (eg, ReachOut! [63]; beyondblue [64,65]); national online counseling services (eg, eheadspace [66]); structured self-directed online therapy (eg, MoodGYM [67]); and those offering a combinati…”
Kim, E.-H., Coumar, A., Lober, W. B., & Kim, Y. (2011) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2011.2107561 · Cited by 65 · cited 4×
“Importantly, Internet-based screening for common mental health problems has been shown to be reliable and effective [9,33,34].”
BackgroundInfluentialRothgangel, A., Braun, S., Smeets, R., & Beurskens, A. (2017) · JMIR Rehabilitation and Assistive Technologies · doi:10.2196/rehab.6761 · Cited by 42
Wood, F. B., Benson, D., LaCroix, E.-M., Siegel, E. R., & Fariss, S. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.3.e31 · Cited by 36
Cited by
Designing and scaling up integrated youth mental health care
McGorry, P. D., Mei, C., Chanen, A., Hodges, C., Alvarez‐Jimenez, M., & Killackey, E. (2022) · World Psychiatry · doi:10.1002/wps.20938 · Cited by 546
“Co-designed with end-users 120,121 , the platform facilitates a number of key processes, including multidimensional assessment, allocation of clinical stage, feedback of assessment results, shared decision-making, and monitoring of change over time 119 .”
Grindell, C., Coates, E., Croot, L., & O’Cathain, A. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08079-y · Cited by 409
“In contrast other studies [38, 41, 44] that favoured creative activities, felt that their design and participatory methods helped to engage diverse groups of people with varying goals, feelings and abilities.”
BackgroundResultInfluentialBack to the Future: Achieving Health Equity Through Health Informatics and Digital Health
Brewer, L. C., Fortuna, K. L., Jones, C., Walker, R., Hayes, S. N., Patten, C. A., & Cooper, L. A. (2020) · JMIR mHealth and uHealth · doi:10.2196/14512 · Cited by 367
Hickie, I. B., Scott, E. M., Cross, S. P., Iorfino, F., Davenport, T. A., Guastella, A. J., Naismith, S. L., Carpenter, J. S., Rohleder, C., Crouse, J. J., et al. (2019) · Medical Journal of Australia · doi:10.5694/mja2.50383 · Cited by 208
Self-citationIorfino, F., Cross, S. P., Davenport, T., Carpenter, J. S., Scott, E., Shiran, S., & Hickie, I. B. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00595 · Cited by 125
Self-citation
Metadata
- Authors
- Ospina-Pinillos, L., Davenport, T. A., Ricci, C. S., Milton, A. C., Scott, E. M., & Hickie, I. B.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2018-05-28
- Volume
- 20
- Issue
- 5
- Pages
- e188
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2805925061
- Cited by
- 81
- References
- 31
- FWCI
- 10.12
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.