Feasibility and Acceptability of the Aboriginal and Islander Mental Health Initiative for Youth App: Nonrandomized Pilot With First Nations Young People
Open accessPublished version of a preprint
The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index; 50 of the 79 sources its claims cite were checked for support.
Abstract
Background: Despite young First Nations Australians being typically healthy, happy, and connected to family and culture, high rates of emotional distress, suicide, and self-harm are also observed. Differing worldviews of service providers and First Nations young people regarding illness and treatment practices, language differences, culturally inappropriate service models, geographical remoteness, and stigma can all inhibit access to appropriate mental health support. Mental health treatments delivered digitally (digital mental health; dMH) offer flexible access to evidence-based, nonstigmatizing, low-cost treatment and early intervention on a broad scale. There is a rapidly growing use and acceptance of these technologies among young First Nations people. Objective: The objective was to assess the feasibility, acceptability, and use of the newly developed Aboriginal and Islander Mental Health Initiative for Youth (AIMhi-Y) app and determine the feasibility of study procedures in preparation for future assessments of effectiveness. Methods: This was a nonrandomized pre-post study using mixed methods. First Nations young people aged 12-25 years who provided consent (with parental consent where appropriate) and possessed the ability to navigate a simple app with basic English literacy were included. Researchers conducted one face-to-face 20-minute session with participants to introduce and orient them to the AIMhi-Y app. The app integrates culturally adapted low-intensity cognitive behavioral therapy (CBT), psychoeducation, and mindfulness-based activities. Participants received supportive text messages weekly throughout the 4-week intervention period and completed assessments of psychological distress, depression, anxiety, substance misuse, help-seeking, service use, and parent-rated strengths and difficulties at baseline and 4 weeks. Qualitative interviews and rating scales were completed at 4 weeks to gain feedback on subjective experience, look and style, content, overall rating, check-ins, and involvement in the study. App use data were collected. Results: Thirty young people (17 males and 13 females) aged between 12 and 18 (mean 14.0, SD 1.55) years were assessed at baseline and 4 weeks. Repeated measures 2-tailed t tests showed improvements in well-being measures that were statistically and clinically significant for psychological distress (Kessler Psychological Distress Scale, 10-item) and depressive symptoms (Patient Health Questionnaire, 2-item). Participants spent on average 37 minutes in the app. The app was rated positively, with mean ratings of 4 out of 5 points (on scales of 1-5). Participants reported that they found the app easy to use, culturally relevant, and useful. The feasibility of the study was demonstrated with a 62% recruitment rate, a 90% retention rate, and high study acceptability ratings. Conclusions: This study supports earlier research suggesting that dMH apps that are appropriately designed with and for the target populations are a feasible and acceptable means of lowering symptoms for mental health disorders among First Nations youth. ©Kylie M Dingwall, Josie Povey, Michelle Sweet, Jaylene Friel, Fiona Shand, Nickolai Titov, Julia Wormer, Tamoor Mirza, Tricia Nagel.
Overview
CoChat Summary
## TL;DR
This nonrandomized 4-week pilot found that the AIMhi-Y app was feasible and acceptable for First Nations young people, with positive user ratings and modest engagement. The study also observed statistically and clinically significant improvements in psychological distress and depressive symptoms, but the lack of a control group limits causal inference.
## Key findings
- Among 30 participants aged 12-18 years (17 males, 13 females), recruitment was 62.5% of those referred (35/56) and retention was 90% (30/33) after screening.
- Repeated-measures t tests showed statistically and clinically significant improvements in psychological distress (K10/K5) and depressive symptoms (PHQ-2) after 4 weeks; the K5 change remained significant (t29=5.07; P<.001) with mean scores falling from 11.97 to 9.07 and a large effect size (0.93).
- App engagement was modest: participants spent an average of 37 minutes in the app, with an average of 6 app opens over 4 weeks; 16 (55%) completed all 10 levels.
- Acceptability was high: the app received mean ratings of about 4/5 for look and style, content, overall rating, check-in text messages, and study acceptability, and participants described it as easy to use, culturally relevant, and useful.
## Methods
- Nonrandomized, uncontrolled single-group pre-post pilot using mixed methods over a 4-week intervention period.
- Convenience sample of First Nations young people aged 12-25 years referred from services in Darwin, Northern Territory; 30 participants were analyzed at follow-up, and eligibility required basic English literacy and ability to navigate a simple app.
- Main analyses included descriptive statistics, paired-sample t tests with Cohen d effect sizes for completers, and deductive thematic analysis of exit interviews; app-use data were also collected.
## Limitations
- The paper states that the lack of a control group limits the ability to attribute outcome changes to the app.
- The sample was relatively homogenous, drawn primarily from First Nations young people engaged in school and living in an urban setting (Darwin), which limits generalizability; this is stated in the paper.
- The sample may have had selection bias because participants were willing volunteers referred by site contacts; this is stated in the paper.
- Evident from the text: some measures had limited follow-up data—for example, the parent-rated SDQ was completed at both time points by only 4 parents or caregivers, making that outcome hard to interpret.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
37 Valid · 2 Not valid · 24 Not checked · 130 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The time and resources required for planning and undertaking an RCT are not always appropriate for the assessment of dMH tools due to their rapid development and the accelerating time to the obsolescence of technological innovations [9,22,23].”
§ Feasibility and Acceptability of the Aboriginal and Islander Mental Health Initiative for Youth App: Nonrandomized Pilot With First Nations Young People > Introduction
What the sources say
- Partly supportedcites [9] sourceExperimental — accuracy not yet measured
In “Do They Really Work? High Availability But Low Evidence Base” (page unavailable), the paper says the time needed to conduct and publish an RCT does not align with apps’ rapid development cycle, supporting the central point. It does not address the resources required or say that the time to technological obsolescence is accelerating. (LLM, conf=0.82)
- Supportedcites [22] source
The Introduction states that the time and resources needed for traditional evaluations can make RCTs disproportionate to the rapid development and obsolescence of digital technologies, especially self-help apps. This supports the citing sentence’s qualified claim that RCTs are not always appropriate for assessing digital mental health tools. (LLM, conf=0.94)
- Supportedcites [23] source
In “Misconception 2: Efficacy trials provide the needed validation,” the paper says technology develops faster than research methods, so mental health technologies are often obsolete by the time they are validated. Its proposed use of pragmatic, adaptable trial designs also supports the claim that conventional trials are not always well suited to evaluating these tools. (LLM, conf=0.90)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“A score of 3 or above has been shown to have a sensitivity of 83% and a specificity of 90% for the detection of major depressive disorder (MDD) [40].”
§ Feasibility and Acceptability of the Aboriginal and Islander Mental Health Initiative for Youth App: Nonrandomized Pilot With First Nations Young People > Methods > Outcomes Outcome measures were completed at baseline and 4 weeks. The primary outcome, psychological distress, was measured by the K10 [30]. The K10 is a 10-item measure of psychological distress that is sensitive to symptoms of both anxiety and depression [30]. Responses are on a 5-point Likert scale. K10 is one of the Australian Mental Health routine outcome measures and has been used in full and abbreviated forms (eg, K5, K6) in state- and nation-wide First Nations surveys [26,27,31,32]. For the period July 2012-June 2013, the Australian Mental Health Outcomes and Classification Network (AMHOCN) reports mean K10 scores for ambulatory patients with mood disorders (ie, outpatients returning to community after being treated acutely) across Australia of 27.6 (SD 8.5) upon return to community, 22.0 (SD 8.5) at a 91-day review, and 18.4 (7.6) upon discharge from outpatient service [33]. Considering these findings and those of our previous study with an Australian First Nations sample [18], a change or difference in K10 scores of 5 points would be considered clinically significant. Secondary outcome measures included the 2-question Patient Health Questionnaire (PHQ-2) with wording adapted by Brown and colleagues for First Nations Australians [34,35], the Generalized Anxiety Disorder short form (GAD-2) [35], the Leeds Dependence Questionnaire (LDQ) [36], the short form of the Alcohol Use Disorders Identification Test (AUDIT-C), the Drug Use Disorders Identification Test (DUDIT), the parent-rated Strengths and Difficulties Questionnaire (SDQ) [37], the General Help Seeking Questionnaire (GHSQ) [38], and a question adapted from the Client Service Receipt Inventory (CSRI) to determine the degree of concurrent mental health service use [39]. The PHQ-2 is a short-form version of the PHQ-9, which is designed to establish a psychiatric diagnosis of depression and has shown diagnostic, criterion, and construct validity [40,41]. The PHQ-9 has been tested in Indigenous groups and adapted to include simplified response categories [34,42,43], as well as specifically adapted for the central Australian context [34]. The 2-item PHQ-2 asks respondents to estimate the frequency of 2 symptoms (low mood and anhedonia) over the past 2 weeks on a 4-point Likert scale (0-3), with increasing scores indicating greater symptom severity. Total scores range from 0 to 6. A score of 3 or above has been shown to have a sensitivity of 83% and a specificity of 90% for the detection of major depressive disorder (MDD) [40]. The tool has also demonstrated utility for adolescent samples [44]. The GAD-2 asks respondents to estimate the frequency of 2 symptoms (nervousness and the ability to control worrying) over the past 2 weeks, with the 4 options and total scores ranging from 0 to 6 [45]. A cutoff score of 3 has been shown to have a sensitivity of 0.76 and a specificity of 0.81 [45]. The brief versions of the tools (ie, the PHQ-2 and the GAD-2) have previously been demonstrated to be reliable and valid for assessing change over time in clinical samples, with test-retest reliability of 0.79 for the PHQ-2 and 0.81 for the GAD-2 [35]. Three substance misuse screening tools were trialed. The LDQ was identified as a relatively brief (10-item) self-report measure sensitive to mild, moderate, and severe levels of dependence on alcohol and other drugs. Scores range from 0 to 30 and are intended to capture the graded intensity of the dependence syndrome. The ability to capture dependence severity simultaneously across all substance classes, including alcohol, sensitivity to change, high internal consistency (α=.93), and clinical and research utility for young adults were identified as advantages [36,46]. The AUDIT-C is a shortened version of the AUDIT [47], which is the best practice tool currently recommended for alcohol screening in the general population and performs well for adolescents [48,49] and across ethnic groups [50]. The AUDIT-C consists of 3 items to determine the risk of hazardous and harmful drinking and alcohol dependence [47]. The AUDIT-C is scored on a scale of 0-12 points (scores of 0 reflect no alcohol use in the past year), and a cutoff score of 3 or more has been proposed when used with adolescents. As the AUDIT-C only examines alcohol use, the DUDIT was also trialed as a similar, 11-item tool for identifying other drug use patterns and drug-related problems. The first 9 items are scored on a 5-point scale ranging from 0 to 4, and the last 2 are scored on a 3-point scale with values of 0, 2, and 4. Total scores range from 0 to 44, with higher scores suggesting a more severe drug problem. The cutoff score for any type of problematic use (ie, harmful use, substance abuse, or dependency) is generally recommended as 6 for men and 2 for women. The DUDIT is reported to have adequate internal consistency (α≈.9+) and test-retest reliability (ICC=0.91; Pearson r=0.77), with favorable sensitivity and specificity reported in a review of its psychometric properties [51]. The parent-rated SDQ was trialed as an externally rated measure to minimize participant burden. The SDQ has been used with First Nations children in national Australian surveys and consists of 25 items measuring 5 areas of psychological adjustment: emotional symptoms, conduct problems, hyperactivity, peer problems, and prosocial behavior [52,53]. Evaluation of the psychometric properties for First Nations children recommended focusing on the total difficulties score and minimizing reliance on the peer relationships subscale [53]. Demographic information was collected at baseline. App feasibility and acceptability were assessed through app use data (including number of app opens, minutes spent in the app, page visits, help accessed, etc) and qualitative interviews at 4 weeks, exploring subjective experience. App ratings (ie, from 1=“didn’t like it at all” to 5=“liked it a lot”), look and style, content, overall app rating, supportive text message check-ins, and involvement in the study were also collected to assess acceptability. Study feasibility was assessed through recruitment and retention rates. Exit interviews investigated participants’ subjective experiences, likes and dislikes in terms of content, feel, look, and style, barriers and facilitators to use, suggested improvements, and engagement with the app. They also explored participants’ experiences of being involved in the study. Interview transcripts were analyzed by 4 authors (KD, JP, MS, and JF) using a deductive approach consistent with the above categories in line with research questions [54].
What the sources say
- Could not verifycites [40] sourceExperimental — accuracy not yet measured
The Results (Table 3; page unavailable) report sensitivity and specificity for PHQ-9 cutoffs, not a PHQ-2 cutoff of 3. Searches for PHQ-2 and a two-item cutoff found no passage in our copy reporting the claimed 83% sensitivity and 90% specificity. (LLM, conf=0.76)
boostedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In 2020, three years of co-design workshops with First Nations youth resulted in the development of the first version of a new mental health app, the AIMhi for Youth (AIMhi-Y) app [24,25].”
§ Feasibility and Acceptability of the Aboriginal and Islander Mental Health Initiative for Youth App: Nonrandomized Pilot With First Nations Young People > Introduction
What the sources say
- Partly supportedcites [24] sourceExperimental — accuracy not yet measured
The Introduction (Objective) and Results (Outcome: AIMhi-Y App, Version 1.0) say that participatory design with Aboriginal and Torres Strait Islander young people produced the app’s first version. The Methods (Study Design) describe the second-phase project as lasting two years, not three years of co-design workshops. The copy also does not explicitly date completion of version 1.0 to 2020. (LLM, conf=0.84)
- Partly supportedcites [25] sourceExperimental — accuracy not yet measured
The Results (Participant demographics) say that Aboriginal and Torres Strait Islander youth took part in co-design workshops over eight months in 2018, not three years. The Discussion (Key findings) says the project produced a first draft of AIMhi-Y, but describes the prototype as still under development, with a further co-design phase completed in 2019; it does not establish that a first app version was developed in 2020. (LLM, conf=0.90)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The brief versions of the tools (ie, the PHQ-2 and the GAD-2) have previously been demonstrated to be reliable and valid for assessing change over time in clinical samples, with test-retest reliability of 0.79 for the PHQ-2 and 0.81 for the GAD-2 [35].”
§ Feasibility and Acceptability of the Aboriginal and Islander Mental Health Initiative for Youth App: Nonrandomized Pilot With First Nations Young People > Methods > Outcomes Outcome measures were completed at baseline and 4 weeks. The primary outcome, psychological distress, was measured by the K10 [30]. The K10 is a 10-item measure of psychological distress that is sensitive to symptoms of both anxiety and depression [30]. Responses are on a 5-point Likert scale. K10 is one of the Australian Mental Health routine outcome measures and has been used in full and abbreviated forms (eg, K5, K6) in state- and nation-wide First Nations surveys [26,27,31,32]. For the period July 2012-June 2013, the Australian Mental Health Outcomes and Classification Network (AMHOCN) reports mean K10 scores for ambulatory patients with mood disorders (ie, outpatients returning to community after being treated acutely) across Australia of 27.6 (SD 8.5) upon return to community, 22.0 (SD 8.5) at a 91-day review, and 18.4 (7.6) upon discharge from outpatient service [33]. Considering these findings and those of our previous study with an Australian First Nations sample [18], a change or difference in K10 scores of 5 points would be considered clinically significant. Secondary outcome measures included the 2-question Patient Health Questionnaire (PHQ-2) with wording adapted by Brown and colleagues for First Nations Australians [34,35], the Generalized Anxiety Disorder short form (GAD-2) [35], the Leeds Dependence Questionnaire (LDQ) [36], the short form of the Alcohol Use Disorders Identification Test (AUDIT-C), the Drug Use Disorders Identification Test (DUDIT), the parent-rated Strengths and Difficulties Questionnaire (SDQ) [37], the General Help Seeking Questionnaire (GHSQ) [38], and a question adapted from the Client Service Receipt Inventory (CSRI) to determine the degree of concurrent mental health service use [39]. The PHQ-2 is a short-form version of the PHQ-9, which is designed to establish a psychiatric diagnosis of depression and has shown diagnostic, criterion, and construct validity [40,41]. The PHQ-9 has been tested in Indigenous groups and adapted to include simplified response categories [34,42,43], as well as specifically adapted for the central Australian context [34]. The 2-item PHQ-2 asks respondents to estimate the frequency of 2 symptoms (low mood and anhedonia) over the past 2 weeks on a 4-point Likert scale (0-3), with increasing scores indicating greater symptom severity. Total scores range from 0 to 6. A score of 3 or above has been shown to have a sensitivity of 83% and a specificity of 90% for the detection of major depressive disorder (MDD) [40]. The tool has also demonstrated utility for adolescent samples [44]. The GAD-2 asks respondents to estimate the frequency of 2 symptoms (nervousness and the ability to control worrying) over the past 2 weeks, with the 4 options and total scores ranging from 0 to 6 [45]. A cutoff score of 3 has been shown to have a sensitivity of 0.76 and a specificity of 0.81 [45]. The brief versions of the tools (ie, the PHQ-2 and the GAD-2) have previously been demonstrated to be reliable and valid for assessing change over time in clinical samples, with test-retest reliability of 0.79 for the PHQ-2 and 0.81 for the GAD-2 [35]. Three substance misuse screening tools were trialed. The LDQ was identified as a relatively brief (10-item) self-report measure sensitive to mild, moderate, and severe levels of dependence on alcohol and other drugs. Scores range from 0 to 30 and are intended to capture the graded intensity of the dependence syndrome. The ability to capture dependence severity simultaneously across all substance classes, including alcohol, sensitivity to change, high internal consistency (α=.93), and clinical and research utility for young adults were identified as advantages [36,46]. The AUDIT-C is a shortened version of the AUDIT [47], which is the best practice tool currently recommended for alcohol screening in the general population and performs well for adolescents [48,49] and across ethnic groups [50]. The AUDIT-C consists of 3 items to determine the risk of hazardous and harmful drinking and alcohol dependence [47]. The AUDIT-C is scored on a scale of 0-12 points (scores of 0 reflect no alcohol use in the past year), and a cutoff score of 3 or more has been proposed when used with adolescents. As the AUDIT-C only examines alcohol use, the DUDIT was also trialed as a similar, 11-item tool for identifying other drug use patterns and drug-related problems. The first 9 items are scored on a 5-point scale ranging from 0 to 4, and the last 2 are scored on a 3-point scale with values of 0, 2, and 4. Total scores range from 0 to 44, with higher scores suggesting a more severe drug problem. The cutoff score for any type of problematic use (ie, harmful use, substance abuse, or dependency) is generally recommended as 6 for men and 2 for women. The DUDIT is reported to have adequate internal consistency (α≈.9+) and test-retest reliability (ICC=0.91; Pearson r=0.77), with favorable sensitivity and specificity reported in a review of its psychometric properties [51]. The parent-rated SDQ was trialed as an externally rated measure to minimize participant burden. The SDQ has been used with First Nations children in national Australian surveys and consists of 25 items measuring 5 areas of psychological adjustment: emotional symptoms, conduct problems, hyperactivity, peer problems, and prosocial behavior [52,53]. Evaluation of the psychometric properties for First Nations children recommended focusing on the total difficulties score and minimizing reliance on the peer relationships subscale [53]. Demographic information was collected at baseline. App feasibility and acceptability were assessed through app use data (including number of app opens, minutes spent in the app, page visits, help accessed, etc) and qualitative interviews at 4 weeks, exploring subjective experience. App ratings (ie, from 1=“didn’t like it at all” to 5=“liked it a lot”), look and style, content, overall app rating, supportive text message check-ins, and involvement in the study were also collected to assess acceptability. Study feasibility was assessed through recruitment and retention rates. Exit interviews investigated participants’ subjective experiences, likes and dislikes in terms of content, feel, look, and style, barriers and facilitators to use, suggested improvements, and engagement with the app. They also explored participants’ experiences of being involved in the study. Interview transcripts were analyzed by 4 authors (KD, JP, MS, and JF) using a deductive approach consistent with the above categories in line with research questions [54].
What the sources say
- Supportedcites [35] source
Section 3.3 reports test–retest reliability of 0.79 for the PHQ-2 and 0.81 for the GAD-2 in the research trial sample, measured 1–4 weeks before treatment. The Discussion describes the measures as useful for monitoring symptoms and outcomes in treatment-seeking adults. (LLM, conf=0.94)
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“iBobbly demonstrated significant improvements after 6 weeks”
§ Feasibility and Acceptability of the Aboriginal and Islander Mental Health Initiative for Youth App: Nonrandomized Pilot With First Nations Young People > Discussion > Comparison With Prior Work
What the sources say
- Supportedcites [16] source
The Intervention section says the app was completed over 6 weeks. The Depression (PHQ-9) and General psychological distress (K10) sections report statistically significant improvements compared with waitlist controls. The Abstract clarifies that suicidal ideation did not improve significantly relative to waitlist. (LLM, conf=0.91)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
76 more claims · 4 with their cited sources checked
Create a free account to see all 193 claims and every source verdict.
- It may state two separate claims as one. 54
- Probably not a substantial claim. 78
- The quote only partly states this claim. 1
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Psychometric properties of the strengths and difficulties questionnaire
GOODMAN, R. (2001) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200111000-00015 · Cited by 6,813 · cited 1×
“…Identification Test (AUDIT-C), the Drug Use Disorders Identification Test (DUDIT), the parent-rated Strengths and Difficulties Questionnaire (SDQ) [37], the General Help Seeking Questionnaire (GHSQ) [38], and a question adapted from the Client Service Receipt Inventory (CSRI) to determine the…”
Interpreting scores on the Kessler Psychological Distress Scale (K10)
Andrews, G., & Slade, T. (2001) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1467-842x.2001.tb00310.x · Cited by 2,021 · cited 2×
“The K10 is a 10-item measure of psychological distress that is sensitive to symptoms of both anxiety and depression [30].”
Plummer, F., Manea, L., Trepel, D., & McMillan, D. (2016) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2015.11.005 · Cited by 1,882 · cited 2×
“A cutoff score of 3 has been shown to have a sensitivity of 0.76 and a specificity of 0.81 [45].”
InfluentialGilbody, S., Richards, D., Brealey, S., & Hewitt, C. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0333-y · Cited by 1,290 · cited 1×
“The PHQ-2 is a short-form version of the PHQ-9, which is designed to establish a psychiatric diagnosis of depression and has shown diagnostic, criterion, and construct validity [40,41].”
Purdie, N., Dudgeon, P., & Walker, R. (2014) · Murdoch University Research Portal · Cited by 1,186
Torous, J., Nicholas, J., Larsen, M. E., Firth, J., & Christensen, H. (2018) · Evidence Based Mental Health · doi:10.1136/eb-2018-102891 · Cited by 790 · cited 2×
“Issues with intervention engagement are not restricted to digital interventions, and similar challenges can occur with face-to-face delivery [58].”
Mental health interventions in schools in high-income countries
Fazel, M., Hoagwood, K., Stephan, S., & Ford, T. (2014) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)70312-8 · Cited by 730
Chisholm, D., Knapp, M. R. J., Knudsen, H. C., Amaddeo, F., Gaite, L., van Wijngaarden, B., & EPSILON Study Group (2000) · British Journal of Psychiatry · doi:10.1192/bjp.177.39.s28 · Cited by 480 · cited 1×
“…Identification Test (DUDIT), the parent-rated Strengths and Difficulties Questionnaire (SDQ) [37], the General Help Seeking Questionnaire (GHSQ) [38], and a question adapted from the Client Service Receipt Inventory (CSRI) to determine the degree of concurrent mental health service use [39].”
Langley, A. K., Nadeem, E., Kataoka, S. H., Stein, B. D., & Jaycox, L. H. (2010) · School Mental Health · doi:10.1007/s12310-010-9038-1 · Cited by 477
Mohr, D. C., Lyon, A. R., Lattie, E. G., Reddy, M., & Schueller, S. M. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7725 · Cited by 432 · cited 2×
“This is particularly important as research suggests that optimization of the design of human support services may have a greater impact on clinical outcomes than does the design of the technologies [62].”
Liverpool, S., Mota, C. P., Sales, C. M. D., Čuš, A., Carletto, S., Hancheva, C., Sousa, S., Cerón, S. C., Moreno-Peral, P., Pietrabissa, G., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/16317 · Cited by 408 · cited 2×
“Acceptability and engagement are often measured through the extent of use (eg, app opens, minutes spent in the app), along with user-reported subjective views and experiences [21,22].”
Staples, L. G., Dear, B. F., Gandy, M., Fogliati, V., Fogliati, R., Karin, E., Nielssen, O., & Titov, N. (2019) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2018.11.003 · Cited by 405 · cited 5×
“…(PHQ-2) with wording adapted by Brown and colleagues for First Nations Australians [34,35], the Generalized Anxiety Disorder short form (GAD-2) [35], the Leeds Dependence Questionnaire (LDQ) [36], the short form of the Alcohol Use Disorders Identification Test (AUDIT-C), the Drug Use Disorders…”
InfluentialSelf-citationGarrido, S., Millington, C., Cheers, D., Boydell, K., Schubert, E., Meade, T., & Nguyen, Q. V. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00759 · Cited by 400 · cited 1×
“While optimizing the human support component and considering ease of implementation are important, there is also a need to further develop the appeal of dMH interventions such as this to increase reach to the 80% of young people who are not already accessing professional treatment [63].”
Evaluation of the PHQ-2 as a Brief Screen for Detecting Major Depression Among Adolescents
Richardson, L. P., Rockhill, C., Russo, J. E., Grossman, D. C., Richards, J., McCarty, C., McCauley, E., & Katon, W. (2010) · Pediatrics · doi:10.1542/peds.2009-2712 · Cited by 377 · cited 1×
“The tool has also demonstrated utility for adolescent samples [44].”
Mohr, D. C., Weingardt, K. R., Reddy, M., & Schueller, S. M. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600541 · Cited by 365 · cited 7×
“Overwhelmingly, playing the games (P5, 9, 22, 23, 24, 25, 26, 29, 31,32, 33, 35, 38) was mentioned as a favorite part of the app, as was watching the videos (P9, 11, 22, 24, 26,27, 29, 38).”
InfluentialEffectiveness of the AUDIT-C as a Screening Test for Alcohol Misuse in Three Race/Ethnic Groups
Frank, D., DeBenedetti, A. F., Volk, R. J., Williams, E. C., Kivlahan, D. R., & Bradley, K. A. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0594-0 · Cited by 336 · cited 1×
“The AUDIT-C is a shortened version of the AUDIT [47], which is the best practice tool currently recommended for alcohol screening in the general population and performs well for adolescents [48,49] and across ethnic groups [50].”
User engagement in mental health apps: A review of measurement, reporting, and validity
Ng, M. M., Firth, J., Minen, M., & Torous, J. (2019) · Psychiatric Services · doi:10.1176/appi.ps.201800519 · Cited by 293 · cited 2×
“…effectiveness is generally assessed through an RCT, evaluation of the feasibility, acceptability, and engagement with dMH interventions requires varied methodologies, and a combination of both subjective and objective criteria are suggested as appropriate for understanding user engagement [20].”
Gamification in apps and Technologies for Improving Mental Health and Well-Being: systematic review
Cheng, V. W. S., Davenport, T., Johnson, D., Vella, K., & Hickie, I. B. (2019) · JMIR Mental Health · doi:10.2196/13717 · Cited by 280 · cited 1×
“…leaderboards, badges, customizable avatars, personalization, social interaction, competition, or user choice) need to be well designed, integrate seamlessly with the technology, and have a clear purpose and user involvement early in their design for greatest feasibility and acceptability [60,61].”
Analyzing and Interpreting Qualitative Research: After the Interview
Vanover, C., Mihas, P., & Saldaña, J. (2021) · Cited by 252
State of the Field of Mental Health Apps
Neary, M., & Schueller, S. M. (2018) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2018.01.002 · Cited by 247 · cited 3×
“Overwhelmingly, playing the games (P5, 9, 22, 23, 24, 25, 26, 29, 31,32, 33, 35, 38) was mentioned as a favorite part of the app, as was watching the videos (P9, 11, 22, 24, 26,27, 29, 38).”
Tighe, J., Shand, F., Ridani, R., Mackinnon, A., De La Mata, N., & Christensen, H. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-013518 · Cited by 227 · cited 3×
“In Australia, recent randomized controlled trials (RCTs) have promoted culturally adapted mental health apps as a feasible and acceptable means of lowering symptoms of mental illness for First Nations young people [16] and adults [14].”
Self-citationGamification and Adherence to Web-Based Mental Health Interventions: A Systematic Review
Brown, M., O'Neill, N., van Woerden, H., Eslambolchilar, P., Jones, M., & John, A. (2016) · JMIR Mental Health · doi:10.2196/mental.5710 · Cited by 178 · cited 1×
“…use of game design elements and features in nongame contexts) is commonly offered as a key opportunity to improve both appeal and adherence, which fits with the preferences of participants in this study, who favored gamification elements such as rewards, mini-games, and character stories [29,59].”
Hildebrand, M. (2015) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2015.01.008 · Cited by 177 · cited 1×
“77), with favorable sensitivity and specificity reported in a review of its psychometric properties [51].”
Serious Games, Gamification, and Serious Mental Illness: A Scoping Review
Fitzgerald, M., & Ratcliffe, G. (2019) · Psychiatric Services · doi:10.1176/appi.ps.201800567 · Cited by 171 · cited 1×
“Gamification features (eg, a narrative or theme, progress feedback, rewards, leaderboards, badges, customizable avatars, personalization, social interaction, competition, or user choice) need to be well designed, integrate seamlessly with the technology, and have a clear purpose and user involvement early in their des…”
Azzopardi, P. S., Sawyer, S. M., Carlin, J. B., Degenhardt, L. J., Brown, N. J., Brown, A. D. H., & Patton, G. C. (2017) · The Lancet · doi:10.1016/s0140-6736(17)32141-4 · Cited by 170 · cited 1×
“Young First Nations Australians are typically healthy, happy, and connected to family and culture [1,2].”
Povey, J., Mills, P. P. J. R., Dingwall, K. M., Lowell, A., Singer, J., Rotumah, D., Bennett-Levy, J., & Nagel, T. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5314 · Cited by 121 · cited 1×
“These were MindSpot, iBobbly, and Aboriginal and Islander Mental Health Initiative’s (AIMhi) Stay Strong, each with some level of evidence for their acceptability and effectiveness [6,13-17].”
Self-citationAUDIT and AUDIT-C as screening instruments for alcohol problem use in adolescents
Liskola, J., Haravuori, H., Lindberg, N., Niemelä, S., Karlsson, L., Kiviruusu, O., & Marttunen, M. (2018) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2018.04.015 · Cited by 120 · cited 1×
“The AUDIT-C is a shortened version of the AUDIT [47], which is the best practice tool currently recommended for alcohol screening in the general population and performs well for adolescents [48,49] and across ethnic groups [50].”
Nagel, T., Robinson, G., Condon, J., & Trauer, T. (2009) · Australian Journal of Rural Health · doi:10.1111/j.1440-1584.2009.01060.x · Cited by 108 · cited 4×
“This involves the identification of (1) supportive people, (2) strengths, (3) worries, and (4) lifestyle changes or goals, which are interspersed with psychoeducational videos and games (as separate levels) [13,18,24,25].”
InfluentialSelf-citationTitov, N., Dear, B. F., Nielssen, O., Wootton, B., Kayrouz, R., Karin, E., Genest, B., Bennett-Levy, J., Purtell, C., Bezuidenhout, G., et al. (2020) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30224-7 · Cited by 108 · cited 1×
“One particular benefit is that they can extend therapeutic activities such as assessments, monitoring, support, and interventions into real-world settings [9,10].”
Self-citationEngaging Australian Aboriginal youth in mental health services
Westerman, T. (2010) · Australian Psychologist · doi:10.1080/00050060903451790 · Cited by 103 · cited 1×
“Constraints include stigma, discrimination, differing worldviews, language differences, cost, and transport issues [3,4].”
Depression in Aboriginal men in central Australia: adaptation of the Patient Health Questionnaire 9
Brown, A. D., Mentha, R., Rowley, K. G., Skinner, T., Davy, C., & O’Dea, K. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-271 · Cited by 99 · cited 2×
“…measures included the 2-question Patient Health Questionnaire (PHQ-2) with wording adapted by Brown and colleagues for First Nations Australians [34,35], the Generalized Anxiety Disorder short form (GAD-2) [35], the Leeds Dependence Questionnaire (LDQ) [36], the short form of the Alcohol Use…”
Esler, D., Johnston, F. H., Thomas, D., & Davis, B. A. (2008) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1753-6405.2008.00247.x · Cited by 98 · cited 1×
“The PHQ-9 has been tested in Indigenous groups and adapted to include simplified response categories [34,42,43], as well as specifically adapted for the central Australian context [34].”
Rapee, R. M., Wignall, A., Sheffield, J., Kowalenko, N., Davis, A., McLoone, J., & Spence, S. H. (2006) · Prevention Science · doi:10.1007/s11121-006-0035-4 · Cited by 87
Nandakumar, A. L., Voort, J. L. V., Nakonezny, P. A., Orth, S. S., Romanowicz, M., Sonmez, A. I., Ward, J. A., Rackley, S. J., Huxsahl, J. E., & Croarkin, P. E. (2018) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/cap.2018.0112 · Cited by 78 · cited 1×
“(from the PHQ-9 modified for teens [28]) and “Have you been thinking about hurting yourself or killing yourself TODAY?””
Dingwall, K. M., Puszka, S., Sweet, M., & Nagel, T. (2015) · Australian Psychologist · doi:10.1111/ap.12100 · Cited by 71 · cited 2×
“This involves the identification of (1) supportive people, (2) strengths, (3) worries, and (4) lifestyle changes or goals, which are interspersed with psychoeducational videos and games (as separate levels) [13,18,24,25].”
Self-citationSchueller, S. M., Tomasino, K. N., & Mohr, D. C. (2017) · Clinical Psychology: Science and Practice · doi:10.1037/h0101740 · Cited by 70 · cited 3×
“They can be used as a stand-alone treatment or augment existing treatments through blended care or fully supported treatments [8].”
InfluentialEsler, D., Johnston, F. H., & Thomas, D. (2007) · Australian and New Zealand Journal of Public Health · doi:10.1111/j.1467-842x.2007.00058.x · Cited by 68 · cited 1×
“The PHQ-9 has been tested in Indigenous groups and adapted to include simplified response categories [34,42,43], as well as specifically adapted for the central Australian context [34].”
Tighe, J., Shand, F., McKay, K., Mcalister, T.-J., Mackinnon, A., & Christensen, H. (2020) · JMIR Mental Health · doi:10.2196/14296 · Cited by 63 · cited 2×
“Use was comparable to a previous study of another First Nations–specific app targeting suicide prevention (ie, iBobbly), in which participants used the app on average for 73 minutes with 12 logins on average over 6 weeks [15].”
Self-citationDigital Health Solutions for Indigenous Mental Well-Being
Hensel, J. M., Ellard, K., Koltek, M., Wilson, G., & Sareen, J. (2019) · Current Psychiatry Reports · doi:10.1007/s11920-019-1056-6 · Cited by 61 · cited 2×
“A recent review identified 3 individual-directed web-based apps available in the Australian First Nations context [7].”
Williamson, A., Mcelduff, P., Dadds, M., D'Este, C., Redman, S., Raphael, B., Daniels, J., & Eades, S. (2014) · Australian Psychologist · doi:10.1111/ap.12045 · Cited by 60
Povey, J., Sweet, M., Nagel, T., Mills, P. P. J. R., Stassi, C. P., Puruntatameri, A. M. A., Lowell, A., Shand, F., & Dingwall, K. (2020) · Internet Interventions · doi:10.1016/j.invent.2020.100318 · Cited by 48 · cited 5×
“Overwhelmingly, playing the games (P5, 9, 22, 23, 24, 25, 26, 29, 31,32, 33, 35, 38) was mentioned as a favorite part of the app, as was watching the videos (P9, 11, 22, 24, 26,27, 29, 38).”
InfluentialSelf-citationThe role of gamification in digital mental health
Fleming, T., Poppelaars, M., & Thabrew, H. (2023) · World Psychiatry · doi:10.1002/wps.21041 · Cited by 45 · cited 5×
“Overwhelmingly, playing the games (P5, 9, 22, 23, 24, 25, 26, 29, 31,32, 33, 35, 38) was mentioned as a favorite part of the app, as was watching the videos (P9, 11, 22, 24, 26,27, 29, 38).”
InfluentialYoung, C., Craig, J. C., Clapham, K. F., Banks, S., & Williamson, A. B. (2018) · Australian and New Zealand Journal of Public Health · doi:10.1111/1753-6405.12853 · Cited by 45
Titov, N., Schofield, C., Staples, L., Dear, B. F., & Nielssen, O. (2019) · Australasian Psychiatry · doi:10.1177/1039856218789784 · Cited by 43 · cited 2×
“There is increasing recognition of the potential for digital mental health (dMH) interventions to overcome access issues and address the unique and significant mental health needs of First Nations people in rural and remote areas [6].”
Self-citationLi, J., & Brar, A. (2022) · Computers in Human Behavior · doi:10.1016/j.chb.2021.106988 · Cited by 42 · cited 2×
“Overwhelmingly, playing the games (P5, 9, 22, 23, 24, 25, 26, 29, 31,32, 33, 35, 38) was mentioned as a favorite part of the app, as was watching the videos (P9, 11, 22, 24, 26,27, 29, 38).”
Dingwall, K. M., Sweet, M., Cass, A., Hughes, J. T., Kavanagh, D., Howard, K., Barzi, F., Brown, S., Sajiv, C., Majoni, S. W., et al. (2021) · BMC Nephrology · doi:10.1186/s12882-021-02344-8 · Cited by 38 · cited 4×
“Similarly, the AIMhi Stay Strong app (and the paper-based Stay Strong Plan) is a culturally adapted motivational care planning (MCP) therapy that has demonstrated effectiveness in reducing psychological distress, depressive symptoms, and substance misuse among First Nations adults [14,18].”
InfluentialSelf-citationToombs, E., Kowatch, K. R., Dalicandro, L., McConkey, S., Hopkins, C., & Mushquash, C. J. (2021) · Journal of Telemedicine and Telecare · doi:10.1177/1357633x19899231 · Cited by 35 · cited 1×
“A recent study found over 1500 apps publicly available for addressing depressive symptoms; however, only 32 studies were presented in the academic literature [12].”
Psychometric validation of the Leeds Dependence Questionnaire (LDQ) in a young adult clinical sample
Kelly, J. F., Magill, M., Slaymaker, V., & Kahler, C. (2010) · Addictive Behaviors · doi:10.1016/j.addbeh.2009.11.005 · Cited by 32 · cited 2×
“The ability to capture dependence severity simultaneously across all substance classes, including alcohol, sensitivity to change, high internal consistency ( α =.93), and clinical and research utility for young adults were identified as advantages [36,46].”
Knapp, A. A., Cohen, K. A., Nicholas, J., Mohr, D. C., Carlo, A. D., Skerl, J. J., & Lattie, E. G. (2021) · JMIR Mental Health · doi:10.2196/27379 · Cited by 31
Povey, J., Sweet, M., Nagel, T., Lowell, A., Shand, F., Vigona, J., & Dingwall, K. M. (2022) · JMIR Formative Research · doi:10.2196/28342 · Cited by 26 · cited 6×
“Overwhelmingly, playing the games (P5, 9, 22, 23, 24, 25, 26, 29, 31,32, 33, 35, 38) was mentioned as a favorite part of the app, as was watching the videos (P9, 11, 22, 24, 26,27, 29, 38).”
InfluentialSelf-citationDingwall, K. M., Nagel, T., Hughes, J. T., Kavanagh, D. J., Cass, A., Howard, K., Sweet, M., Brown, S., Sajiv, C., & Majoni, S. W. (2019) · BMC Psychology · doi:10.1186/s40359-018-0264-x · Cited by 24 · cited 1×
“We anticipated a difference of at least 5 points would be indicative of clinically significant change [14,55].”
Self-citationThe predictive capacity of AUDIT and AUDIT-C among adolescents in a one-year follow-up study
Liskola, J., Haravuori, H., Lindberg, N., Kiviruusu, O., Niemelä, S., Karlsson, L., & Marttunen, M. (2021) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2020.108424 · Cited by 23 · cited 2×
“The AUDIT-C is a shortened version of the AUDIT [47], which is the best practice tool currently recommended for alcohol screening in the general population and performs well for adolescents [48,49] and across ethnic groups [50].”
Utility of routine alcohol screening for monitoring changes in alcohol consumption
Rubinsky, A. D., Chavez, L. J., Berger, D., Lapham, G. T., Hawkins, E. J., Williams, E. C., & Bradley, K. A. (2019) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2019.03.010 · Cited by 20 · cited 1×
“Previous research has demonstrated that changes in AUDIT-C scores over one year do reflect changes in drinking for adults and can predict future problematic drinking in adolescents [48,56].”
A history of health services for Aboriginal and Torres Strait Islander people
Lovett, R. W., & Brinckley, M. (2018) · Cambridge University Press eBooks · doi:10.1017/9781009626897.002 · Cited by 16
Proportionate methods for evaluating a simple digital mental health tool
Davies, E. B., Craven, M. P., Martin, J. L., & Simons, L. (2017) · Evidence Based Mental Health · doi:10.1136/eb-2017-102755 · Cited by 15 · cited 5×
“Overwhelmingly, playing the games (P5, 9, 22, 23, 24, 25, 26, 29, 31,32, 33, 35, 38) was mentioned as a favorite part of the app, as was watching the videos (P9, 11, 22, 24, 26,27, 29, 38).”
InfluentialMeasuring Outcomes in a Health Service Addiction Clinic
Tober, G., Brearley, R., Kenyon, R., Raistrick, D., & Morley, S. (2000) · Addiction Research · doi:10.3109/16066350009004418 · Cited by 11 · cited 1×
“93), and clinical and research utility for young adults were identified as advantages [36,46].”
Gulliver, A., Banfield, M., Morse, A. R., Reynolds, J., Miller, S., & Galati, C. (2019) · JMIR Formative Research · doi:10.2196/12550 · Cited by 11 · cited 1×
“Constraints include stigma, discrimination, differing worldviews, language differences, cost, and transport issues [3,4].”
Ward, R. (2018) · Cambridge University Press eBooks · doi:10.1017/cbo9781316151112.008 · Cited by 3
Research works printed but not linked: 3
- Wilson, CJ, 2005, Can J Couns Psychother, 39, 15
- Babor, TF, 2001, AUDIT: The Alcohol Use Disorders Identification Test : Guidelines for Use in Primary Health Care
- Zubrick, S, 2005, The Western Australian Aboriginal Child Health Survey: The Social and Emotional Wellbeing of Aboriginal Children and Young People
Cited by
Chinsen, A., Berg, A., Nielsen, S., Trewella, K., Cronin, T. J., Pace, C. C., Pang, K. C., & Tollit, M. A. (2025) · The Lancet Child & Adolescent Health · doi:10.1016/s2352-4642(25)00063-x · Cited by 63
Wanniarachchi, V. U., Greenhalgh, C., Choi, A., & Warren, J. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1500220 · Cited by 46
Zhu, S., Wang, Y., & Hu, Y. (2025) · Journal of Medical Internet Research · doi:10.2196/62870 · Cited by 36
“Nonuse or noncompletion of DMHIs was often attributed to doubts regarding their helpfulness, validity, and usefulness, as well as low priority, low interest, and a lack of persistence [5,8,14,17,33,43,45,49,53].”
InfluentialPovey, J., Raphiphatthana, B., Torok, M. H., Nagel, T. M., Mills, P. P. J. R., Sells, J. R. H., Shand, F., Sweet, M., Lowell, A., & Dingwall, K. M. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02262-w · Cited by 15
Self-citationThapa, S., Ahmed, K. Y., Giri, S., Anyasodor, A. E., Huda, M. M., Gibbs, P., Mahmood, S., Astawesegn, F. H., Newman, J., & Ross, A. G. (2024) · The Lancet Regional Health - Western Pacific · doi:10.1016/j.lanwpc.2024.101203 · Cited by 8
Metadata
- Authors
- Dingwall, K. M., Povey, J., Sweet, M., Friel, J., Shand, F., Titov, N., Wormer, J., Mirza, T., & Nagel, T.
- Affiliations
- Charles Darwin University (AU)
- Black Dog Institute (AU)
- Macquarie University (AU)
- Corresponding author
- Dingwall, Kylie M
- ORCID
- Venue
- JMIR Human Factors
- Publisher
- JMIR Publications Inc.
- Published
- 2023-06-07
- Volume
- 10
- Pages
- e40111
- ISSN
- 2292-9495 (ISSN-L)
- PMC
- PMC10285623
- OpenAlex
- W4366153167
- Semantic Scholar
- f3048e5170729da687b8af7dbfe4d5e4e052fa22
- Cited by
- 21
- References
- 56
- Citations by year
- 2026: 5 · 2025: 12 · 2024: 3 · 2023: 1
- FWCI
- 5.41
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Human Factors (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Suicide Prevention Australia
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Health › Indigenous Health, Education, and Rights
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- First Nations youth, digital mental health, mobile health apps, psychoeducation, mindfulness, psychological distress, depression, anxiety, substance abuse, help-seeking, feasibility, acceptability, Indigenous mental health, remote communities, Aboriginal and Torres Strait Islander Australians, strengths and difficulties
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.