Young People’s Satisfaction With the Online Mental Health Service eheadspace: Development and Implementation of a Service Satisfaction Measure
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Background: Online youth mental health services are an expanding approach to meeting service need and can be used as the first step in a stepped-care approach. However, limited evidence exists regarding satisfaction with online services, and there is no standardized service satisfaction measure. Objective: This study implemented an online youth mental health service satisfaction questionnaire within eheadspace, an online youth mental health service. The aims were to test the questionnaire’s psychometric properties and identify current levels of satisfaction among service users, as well as to identify client and service contact characteristics that affect satisfaction. Methods: Data were collected from 2280 eheadspace clients via an online questionnaire advertised and accessed through the eheadspace service platform between September 2016 and February 2018. Client and service contact characteristics, potential outcomes, and session and service feedback data were collected. Results: The service satisfaction questionnaire demonstrated high internal consistency for the overall satisfaction scale (alpha=.95) and its three subscales: session satisfaction, potential outcomes, and service satisfaction. A three-factor model was the best fit to the data, although including a higher order unidimensional construct of overall satisfaction was also a reasonable fit. Overall, young people were very satisfied with eheadspace (mean 3.60, SD 0.83). Service characteristics, but not client characteristics, were significantly associated with satisfaction. Young people were more satisfied with eheadspace when they had greater engagement as evident through receiving esupport rather than briefer service provision, having a longer session and greater interaction with the clinician, and not previously attending a face-to-face headspace center. Conclusions: The online youth mental health service satisfaction questionnaire developed for and implemented in eheadspace showed good psychometric properties. The measure is brief, has good internal consistency, and has a clear factor structure. The measure could be adapted for use in other online youth mental health services. The young people using eheadspace and completing the feedback survey were highly satisfied. Greater engagement with the online service was shown to be associated with greater satisfaction. No specific client demographic groups were shown to be more or less satisfied.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
Mental health of young people: A global public-health challenge
Patel, V., Flisher, A. J., Hetrick, S., & McGorry, P. (2007) · The Lancet · doi:10.1016/s0140-6736(07)60368-7 · Cited by 3,126 · cited 2×
“Patel et al [1] suggested that both young person and parental feedback is essential in assessing satisfaction with mental health services and this should be explored in the online service domain.”
BackgroundKim-Cohen, J., Caspi, A., Moffitt, T. E., Harrington, H., Milne, B. J., & Poulton, R. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.7.709 · Cited by 2,025
When and how do young people seek professional help for mental health problems?
Rickwood, D. J., Deane, F. P., & Wilson, C. J. (2007) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2007.tb01334.x · Cited by 1,195
Self-citationAdvantages and limitations of Internet-based interventions for common mental disorders
Andersson, G., & Titov, N. (2014) · World Psychiatry · doi:10.1002/wps.20083 · Cited by 1,160 · cited 1×
“Online mental health services have emerged as an innovative way to promote self-referral, increase help-seeking behaviors, and meet the high level of unmet service demand, through accessible youth-friendly technology [11,12].”
BackgroundIs it time for clinicians to routinely track patient outcome? A meta-analysis
Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003) · Clinical Psychology: Science and Practice · doi:10.1093/clipsy.bpg025 · Cited by 608 · cited 1×
“Regular feedback is recommended for all mental health practice, as clinicians are not always able to recognize treatment failure as it is happening [28,29].”
BackgroundBurgess, P. M., Pirkis, J. E., Slade, T. N., Johnston, A. K., Meadows, G. N., & Gunn, J. M. (2009) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670902970858 · Cited by 318 · cited 1×
“Mental health problems peak in young people between the ages of 12 and 25 years [1], and more than one in four young people experience a mental illness each year [2].”
BackgroundGriffiths, K. M., Farrer, L., & Christensen, H. (2010) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2010.tb03685.x · Cited by 303 · cited 1×
“The internet has escalated as a source of information for mental health issues in recent years [15-17].”
Internet-based mental health programs: A powerful tool in the rural medical kit
Griffiths, K. M., & Christensen, H. (2007) · Australian Journal of Rural Health · doi:10.1111/j.1440-1584.2007.00859.x · Cited by 270 · cited 1×
“The internet has escalated as a source of information for mental health issues in recent years [15-17].”
BackgroundThe internet as a setting for mental health service utilisation by young people
Burns, J. M., Davenport, T. A., Durkin, L. A., Luscombe, G. M., & Hickie, I. B. (2010) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2010.tb03688.x · Cited by 257 · cited 2×
“The measure could be adapted for use with other online youth mental health services, which are emerging as a critical setting for mental health service provision as part of stepped-care approaches in mental health [18].”
Transdiagnostic stepped care in mental health
Cross, S., & Hickie, I. (2017) · Public Health Research and Practice · doi:10.17061/phrp2721712 · Cited by 130 · cited 2×
“This measure was included to gain some understanding of the potential impact of client complexity, but it is acknowledged that a brief, online minimum data collection procedure cannot provide a robust measure of clinical stage such as can be ascertained through clinical interview within mental health services that ado…”
BackgroundOnline Health Promotion, Early Identification of Difficulties, and Help Seeking in Young People
SANTOR, D. A., POULIN, C., LeBLANC, J. C., & KUSUMAKAR, V. (2007) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/01.chi.0000242247.45915.ee · Cited by 93 · cited 1×
“Online services have many advantages, including increasing mental health literacy [23], potentially improving help-seeking behaviors for face-to-face therapy [4], and providing support that is easily and widely accessible, while reducing the costs to service providers as part of an integrated system of care [24].”
BackgroundReachOut.com: The role of an online service for promoting help-seeking in young people
Collin, P. J., Metcalf, A. T., Stephens-Reicher, J. C., Blanchard, M. E., Herrman, H. E., Rahilly, K., & Burns, J. M. (2011) · Advances in Mental Health · doi:10.5172/jamh.2011.10.1.39 · Cited by 75 · cited 1×
“Online services have many advantages, including increasing mental health literacy [23], potentially improving help-seeking behaviors for face-to-face therapy [4], and providing support that is easily and widely accessible, while reducing the costs to service providers as part of an integrated system of care [24].”
BackgroundRickwood, D., Webb, M., Kennedy, V., & Telford, N. (2016) · JMIR Mental Health · doi:10.2196/mental.5988 · Cited by 66 · cited 3×
“However, the demographics of eheadspace clients are quite different from those of the headspace centers, as they are much more likely to be female and present with a high level of psychological distress [25].”
Self-citationMental health in Canada: out of the shadows forever
Kirby, M. (2008) · Canadian Medical Association Journal · doi:10.1503/cmaj.071897 · Cited by 38
Dowling, M., & Rickwood, D. (2015) · Counselling and Psychotherapy Research · doi:10.1002/capr.12037 · Cited by 22 · cited 1×
“Further, earlier research revealed that eheadspace clients have high service expectations [44], which are unlikely to be met with the minimal engagement that is typical.”
BackgroundSelf-citation
Cited by
Ojio, Y., Mori, R., Matsumoto, K., Nemoto, T., Sumiyoshi, T., Fujita, H., Morimoto, T., Nishizono‐Maher, A., Fuji, C., & Mizuno, M. (2021) · Early Intervention in Psychiatry · doi:10.1111/eip.12959 · Cited by 59
Ho, T. Q. A., Le, L. K.-D., Engel, L., Le, N., Melvin, G., Le, H. N. D., & Mihalopoulos, C. (2025) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-024-02386-x · Cited by 38
Radomski, A. D., Bagnell, A., Curtis, S., Hartling, L., & Newton, A. S. (2020) · JMIR Mental Health · doi:10.2196/15795 · Cited by 30
“To target our anticipated participants, we used current, key literature [30,52,53,70,112-114] to develop the UEQII.”
Siddhpuria, S., Breau, G., Lackie, M. E., Lavery, B. M., Ryan, D., Shulman, B., Kennedy, A. L., & Brotto, L. A. (2022) · JMIR Formative Research · doi:10.2196/33411 · Cited by 6
“Similar methods as described in this phase have been employed outside of PPD or in the postdevelopment phase for improvement purposes [42,43].”
Method
Metadata
- Authors
- Rickwood, D., Wallace, A., Kennedy, V., O’Sullivan, S., Telford, N., & Leicester, S.
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2019-04-17
- Volume
- 6
- Issue
- 4
- Pages
- e12169
- ISSN
- 2368-7959 (ISSN-L)
- OpenAlex
- W2903622367
- Cited by
- 36
- References
- 16
- FWCI
- 3.37
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.