The first 30 months of the MindSpot Clinic: Evaluation of a national e-mental health service against project objectives
The DOI matches its Crossref record; 39 of the 40 references it cites were found in a registry or an index.
Abstract
Objective: The MindSpot Clinic provides online mental health services to Australian adults with anxiety and depression. This paper describes users of MindSpot between January 2013 and June 2015. Outcomes are considered against three key objectives: improving access to mental health services, improving public awareness of how to access services and providing evidence-based treatments. Method: Website traffic data were examined to determine patterns of use. Demographic characteristics, past service utilisation and reasons for contacting MindSpot were analysed. Outcomes for patients enrolled in a MindSpot treatment course were also analysed. Primary outcomes were scores on the 9-Item Patient Health Questionnaire, Generalised Anxiety Disorder 7-Item, Yale–Brown Obsessive Compulsive Scale and Post-Traumatic Stress Disorder Checklist–Civilian Version, administered at assessment, post-treatment and 3-month follow-up. Results: The website was visited by almost 500,000 Australians, of which 33,990 adults started assessments, and 25,469 people completed assessment and were eligible for analysis. Mean age was 36.4 years (standard deviation = 13.3 years; range = 18–94 years), and 72% were female. The proportion living in rural or remote regions and who identified as Aboriginal and Torres Strait Islander closely matched national statistics. The majority (82%) reported that they were not currently in contact with mental health services. Most patients sought an assessment, information about treatment options, or referral to another service, and only 24% of those completing an assessment commenced a MindSpot treatment course. Of these, large clinical effects ( d: 0.7–2.4; average symptom reductions: 25.5% to 61.6%) were found from assessment to follow-up on all outcome measures. Deterioration ranged from 1.0% to 4.3%. Conclusion: Based on the number of website visits, completed assessments and treatment outcomes, MindSpot achieved its three programme objectives. This model of service provision has considerable value as a complement to existing services, and is proving particularly important for improving access for people not using existing services.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Both groups have published data from their routine clinical practice, indicating that ICBT works when delivered as a regular intervention with ordinary clients.”
From Internet-delivered psychological treatments: from innovation to implementation (2019) · cites this paper as [19]
In the citing paper
“Removing studies [51,52] as well as PTSD and panic disorder studies by Ruwaard et al [50] and PTSD study by Titov et al [53] from the analysis did not influence the result significantly (g=0.90; 95% CI 0.81-0.99; I2=77%, 95% CI 62-86; p<.001), but resulted in less, although still high, heterogeneity.”
In the citing paper
“On the other hand, uncontrolled effectiveness studies show large clinical effects [15-20], thereby suggesting that iCBT for anxiety disorders may be as effective in routine care settings as demonstrated in efficacy trials.”
From Internet-Delivered Cognitive Behavioral Therapy for Anxiety Disorders in Open Community Versus Clinical Service Recruitment: Meta-Analysis (2019) · cites this paper as [16]
In the citing paper
“This striking gender imbalance is consistent with previously reported gender imbalances in both online and face-to-face therapy.”
From Behavioral Activation and Depression Symptomatology: Longitudinal Assessment of Linguistic Indicators in Text-Based Therapy Sessions (2021) · cites this paper as [46]
In the citing paper
“Although DMHTs have begun to be integrated into health care systems in Europe and Australia (16–20), they have not been well integrated into the U.S. health care system.”
From Banbury forum consensus statement on the path forward for digital mental health treatment (2021) · cites this paper as [18]
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 8×
“For the Wellbeing and Wellbeing Plus courses, clinical deterioration was defined as an increase in scores ⩾6 for the PHQ-9, and ⩾5 for the GAD-7.”
BackgroundMethodInfluentialKESSLER, R. C., ANDREWS, G., COLPE, L. J., HIRIPI, E., MROCZEK, D. K., NORMAND, S.-L. T., WALTERS, E. E., & ZASLAVSKY, A. M. (2002) · Psychological Medicine · doi:10.1017/s0033291702006074 · Cited by 10,327 · cited 1×
“The Kessler 10-Item Scale (K-10) was used as a secondary outcome measure to assess general psychological distress (Kessler et al., 2002).”
MethodWhiteford, H. A., Degenhardt, L., Rehm, J., Baxter, A. J., Ferrari, A. J., Erskine, H. E., Charlson, F. J., Norman, R. E., Flaxman, A. D., Johns, N., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61611-6 · Cited by 6,006 · cited 9×
“Similarly, effect size estimates were large (⩾0.7) but were greater for those in the Wellbeing, Wellbeing Plus and PTSD courses (ds = 1.1–2.4) compared to the OCD course (ds = 0.7–1.2.”
BackgroundInfluentialAnxiety disorders in primary care: prevalence, impairment, comorbidity, and detection
Kroenke, K., Spitzer, R. L., Williams, J. B. W., Monahan, P. O., & Löwe, B. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-146-5-200703060-00004 · Cited by 4,741 · cited 2×
“Scores range from 0 to 21, and a total score of 8 or more indicates the likely Australian & New Zealand Journal of Psychiatry, 51(12) presence of an anxiety disorder (Kroenke et al., 2007).”
BackgroundKroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.03.006 · Cited by 4,057 · cited 2×
“The PHQ-9 has good internal consistency and is sensitive to change (Kroenke et al., 2010).”
BackgroundThe global burden of mental disorders: An update from the WHO World Mental Health (WMH) surveys
Kessler, R. C., Aguilar-Gaxiola, S., Alonso, J., Chatterji, S., Lee, S., Ormel, J., Üstün, T. B., & Wang, P. S. (2009) · Epidemiologia e Psichiatria Sociale · doi:10.1017/s1121189x00001421 · Cited by 1,895 · cited 2×
“4% of the global total burden of disease (Kessler et al., 2009; Whiteford et al., 2013).”
BackgroundInfluentialWang, P. S., Aguilar-Gaxiola, S., Alonso, J., Angermeyer, M. C., Borges, G., Bromet, E. J., Bruffaerts, R., de Girolamo, G., de Graaf, R., Gureje, O., et al. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61414-7 · Cited by 1,655 · cited 2×
“In a 12-month period, fewer than half of those affected seek or receive evidence-based treatments (Wang et al., 2007; Whiteford et al., 2014).”
BackgroundAdvantages and limitations of Internet-based interventions for common mental disorders
Andersson, G., & Titov, N. (2014) · World Psychiatry · doi:10.1002/wps.20083 · Cited by 1,160 · cited 1×
“These strategies have been initiated following research demonstrating the efficacy of online treatments for high prevalence mental disorders (Andersson and Titov, 2014), and their potential to eliminate some of the barriers to mental health care.”
BackgroundInfluentialSelf-citationHubbard (2010) · doi:10.1097/ede.0b013e3181caeb90 · Cited by 1,139 · cited 1×
“Generalised estimating equation (GEE) models were used to examine changes in symptom measures over time (Hubbarb et al., 2010).”
Method
Research works printed but not linked: 7
- Australian Bureau of Statistics (ABS), 2010, General Social Survey: Summary Results, Australia
- Australian Bureau of Statistics (ABS), 2012, Year Book Australia
- Australian Bureau of Statistics (ABS), 2015, Labour Force
- Australian National Mental Health Commission, 2014, The National Review of Mental Health Programmes and Services
- Baer L, 1991, Getting Control: Overcoming Your Obsessions and Compulsions
- Mental Health Commission of Canada, 2014, E-Mental Health in Canada: Transforming the Mental Health System Using Technology
- Ministry of Health New Zealand, 2012, Rising to the Challenge: The Mental Health and Addiction Service Development Plan 2012–2017
Cited by
Internet-delivered psychological treatments: from innovation to implementation
Andersson, G., Titov, N., Dear, B. F., Rozental, A., & Carlbring, P. (2019) · World Psychiatry · doi:10.1002/wps.20610 · Cited by 750
Self-citationEbert, D. D., Van Daele, T., Nordgreen, T., Karekla, M., Compare, A., Zarbo, C., Brugnera, A., Øverland, S., Trebbi, G., Jensen, K. L., et al. (2018) · European Psychologist · doi:10.1027/1016-9040/a000318 · Cited by 437
“…in routine clinical practice (Andrews & Williams, 2014; El Alaoui, Hedman, Kaldo, et al., 2015; El Alaoui, Hedman, Ljótsson, & Lindefors, 2015; Hedman et al., 2014; Nordgreen, Gjestad, Andersson, Carlbring, & Havik, 2017; Titov et al., 2015, 2016; Williams, O’Moore, Mason, & Andrews, 2014).”
The Handbook of Behavior Change
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108677318 · Cited by 407
Staples, L. G., Dear, B. F., Gandy, M., Fogliati, V., Fogliati, R., Karin, E., Nielssen, O., & Titov, N. (2019) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2018.11.003 · Cited by 405
“The use of routine monitoring of symptoms and reporting of outcomes has also been applied to the internet-delivery of psychological treatments [4].”
MethodResultSelf-citationEtzelmueller, A., Vis, C., Karyotaki, E., Baumeister, H., Titov, N., Berking, M., Cuijpers, P., Riper, H., & Ebert, D. D. (2020) · Journal of Medical Internet Research · doi:10.2196/18100 · Cited by 356
“Removing studies [51,52] as well as PTSD and panic disorder studies by Ruwaard et al [50] and PTSD study by Titov et al [53] from the analysis did not influence the result significantly (g=0.”
BackgroundInfluentialSelf-citation
Metadata
- Authors
- Titov, N., Dear, B. F., Staples, L. G., Bennett-Levy, J., Klein, B., Rapee, R. M., Andersson, G., Purtell, C., Bezuidenhout, G., & Nielssen, O. B.
- Affiliations
- Macquarie University (AU)
- Sydney School of Public Health, The University of Sydney, Sydney, NSW, Australia
- Federation University (AU)
- Linköping University (SE)
- MindSpot Clinic, Sydney, NSW, Australia
- Corresponding author
- Titov, Nickolai
- ORCID
- Venue
- Australian & New Zealand Journal of Psychiatry
- Publisher
- SAGE Publications
- Published
- 2016-10-12
- Volume
- 51
- Issue
- 12
- Pages
- 1227-1239
- ISSN
- 0004-8674 (ISSN-L)
- 1440-1614
- OpenAlex
- W2529880502
- Semantic Scholar
- 8c82411cd6c51f502d68d97f8bd0aec6e28eeb25
- Cited by
- 183
- References
- 40
- Citations by year
- 2026: 8 · 2025: 10 · 2024: 9 · 2023: 10 · 2022: 18 · 2021: 14 · 2020: 74 · 2019: 19 · 2018: 13 · 2017: 8
- FWCI
- 20.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Australian & New Zealand Journal of Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- FedUni ResearchOnline (Federation University Australia) (submittedVersion)
- Funders
- Australian Government
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- online mental health services, e-mental health, anxiety, depression, access to mental health care, service utilization, website traffic, treatment outcomes, symptom relief, rural and remote populations, Aboriginal and Torres Strait Islander peoples, help-seeking
- MeSH terms
- Adolescent, Adult, Aged, Aged, 80 and over, Anxiety Disorders, Australia, Depressive Disorder, Female, Health Services Accessibility, Humans, Male, Mental Health Services, Middle Aged, Outcome and Process Assessment, Health Care, Cognitive Behavioral Therapy, Telemedicine, Consumer Health Information, Evidence-Based Practice, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The first 30 months of the MindSpot Clinic: Evaluation of a national e-mental health service against project objectives. https://app.cochat.ai/papers/10.1177/0004867416671598
- The paper
- Titov, N., Dear, B. F., Staples, L. G., Bennett-Levy, J., Klein, B., Rapee, R. M., Andersson, G., Purtell, C., Bezuidenhout, G., & Nielssen, O. B. (2017). The first 30 months of the MindSpot Clinic: Evaluation of a national e-mental health service against project objectives. Australian & New Zealand Journal of Psychiatry. https://doi.org/10.1177/0004867416671598
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.