CoChat

Trouble with the curve: the 90-9-1 rule to measure volitional participation inequalities among Royal Canadian Mounted Police cadets during training

Open access

The DOI matches its Crossref record; 61 of the 67 references it cites were found in a registry or an index; 13 of the 34 sources its claims cite were checked for support.

Abstract

Objective: The Royal Canadian Mounted Police (RCMP) Study includes longitudinal multimodal assessments of RCMP cadets from pre-training (i.e., starting the Cadet Training Program [CTP]) to post-deployment and for five years thereafter. The data allow for investigating the multidimensionality of volitional participation in digital health data collection frameworks within serial data collection platforms and the impact of participation inequalities by classifying cadets using the 90-9-1 rule. By classifying cadets as Lurkers, Contributors, and Superusers formally described by the 90-9-1 rule, where 90% of actors do not participate, 9% seldom contribute, and 1% contribute substantially allows for the assessing of relationships between participation inequalities in self-monitoring behaviors as well as whether mental health disorder symptoms at pre-training (i.e., starting the CTP) were associated with subsequent participation. Methods: Participants were asked to complete a Full Assessment prior to their training at CTP, as well as short daily surveys throughout their training. Participation frequency was described using a process where participants were rank ordered by the number of daily surveys completed and classified into one of three categories. Full assessment surveys completed prior to their training at CTP included screening tools for generalized anxiety disorder (GAD), major depressive disorder (MDD), posttraumatic stress disorder (PTSD), alcohol use disorder (AUD), and panic disorder (PD). The Kruskal-Wallis H test was used to assess differences in participation rates between mental health disorder symptom screening groups for each measure at pre-training, and Spearman’s Rho was used to test for associations amongst self-reported Full Assessment screening tool responses and the number of daily surveys completed during CTP. Results: There were 18557 daily survey records collected from 772 participants. The rank-ordering of cadets by the number of daily surveys completed produced three categories in line with the 90-9-1 rule: Superusers who were the top 1% of cadets (n=8) and produced 6.4% of all recordings; Contributors who were the next 9% of cadets (n=68) and produced 49.2% of the recordings; and Lurkers who were the next 90% of cadets (n=695) and produced 44.4% of daily survey recordings. Lurkers had the largest proportion of positive screens for self-reported mental health disorders at pre-training. Conclusion: The creation of highly individualized, population-based mental health injury programs has been limited by an incomplete understanding of the causal relationships between protective factors and mental health. Disproportionate rates of disengagement from persons who screen positive for mental health disorders further compounds the difficulty in understanding the relationships between training programs and mental health. The current results suggest persons with mental health challenges may be less likely to engage in some forms of proactive mental health training. The current results also provide useful information about participation, adherence, and engagement that can be used to inform evidence-based paradigm shifts in health-related data collection in occupational populations. Copyright © 2024 Teckchandani, Shields, Andrews, Maguire, Jamshidi, Nisbet, Afifi, Lix, Stewart, Sauer-Zavala, Krakauer, Neary, Krätzig and Carleton.

Overview

CoChat Summary

## TL;DR

This study used RCMP cadet daily survey data during the 26-week Cadet Training Program to classify participation with the 90–9–1 rule and test whether pre-training mental health symptoms were related to later self-monitoring. The main pattern was that cadets with the most daily survey completion had fewer positive mental health screens, although most groupwise differences were not statistically significant.

## Key findings

  • The study analyzed 18,557 daily survey records from 772 cadets; the 90–9–1 classification yielded 8 Superusers (1%), 68 Contributors (9%), and 695 Lurkers (90%).
  • Superusers produced 6.4% of all daily survey recordings, Contributors produced 49.2%, and Lurkers produced 44.4%.
  • Lurkers had the largest proportion of positive pre-training screens: 31 (4.5%) PTSD, 49 (7.1%) MDD, 58 (8.3%) GAD, 28 (4.0%) SAD, and 12 (1.7%) PD.
  • Bivariate correlations showed a statistically significant inverse relationship between pre-training PCL-5 total scores and the number of daily surveys completed at the aggregate sample level (p < .05), but no other statistically significant relationships were found; Kruskal-Wallis tests also found no statistically significant differences in daily survey completion across screening groups for AUDIT, PDSS-SR, GAD-7, PHQ-9, or PCL-5.

## Methods

  • Design/data: Longitudinal analysis of the RCMP Study using online self-report data from RCMP cadets (n = 772; 72% male) completing a 26-week Cadet Training Program; pre-training mental health screening was paired with daily surveys during training.
  • Measures: Pre-training screening used PCL-5, PHQ-9, PDSS-SR, GAD-7, SIPS, and AUDIT; daily surveys were brief 20-item smartphone self-reports completed over the previous 24 hours.
  • Analysis: Cadets were rank-ordered by number of daily surveys completed and grouped as Superusers, Contributors, or Lurkers; analyses included Kruskal-Wallis H tests for group differences and Spearman’s rho for associations between pre-training symptom scores and daily survey completion, with Holm-Bonferroni correction.

## Limitations

  • The paper states there was a lack of data about cadets prior to their pre-screening surveys, creating potential left censorship bias.
  • The paper states cadets with more mental health symptoms may have left the RCMP Study or the CTP because of worse mental health, creating self-selection bias; it also notes that most attrition reports cited insufficient time to participate.
  • The paper states that replicability and generalizability to a general community sample using a digital health platform are limited by the structured, serial data collection environment of the CTP.
  • Evident from the text: the study’s participation categories are based on completed daily surveys only, so the findings speak to survey adherence/engagement, not direct clinical outcomes or causation.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.3389/fpsyt.2024.1297953

Cites

61 of 62 references verified0 citation errors · 1 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

6 Valid · 1 Not valid · 6 Not checked · 39 Own results and interpretations

24 more claims

Create a free account to see all 52 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 18
  • It may state two separate claims as one. 12
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Research works printed but not linked: 3

  1. Hembroff, 2020, A 5-year perspective of attrition in relation to employment equity
  2. Weathers, 2013, PTSD checklist for military, Natl Cent PTSD, 94
  3. 2013, Diagnostic and statistical manual of mental disorders

Cited by

See all 3

Metadata

Authors
Teckchandani, T. A., Shields, R. E., Andrews, K. L., Maguire, K. Q., Jamshidi, L., Nisbet, J., Afifi, T. O., Lix, L. M., Stewart, S. H., Sauer-Zavala, S., Krakauer, R. L., Neary, J. P., Krätzig, G. P., & Carleton, R. N.
Affiliations
  • University of Regina (CA)
  • University of Manitoba (CA)
  • Dalhousie University (CA)
  • University of Kentucky (US)
Corresponding author
Teckchandani, Taylor A.
Venue
Frontiers in Psychiatry
Published
2024-05-28
Volume
15
Pages
1297953-1297953
ISSN
1664-0640 (ISSN-L)
OpenAlex
W4399084043
Cited by
3
References
67
Citations by year
2025: 2
FWCI
0.81
Type
journal article
Language
en
Open access
Locations
  • Frontiers in Psychiatry (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • UKnowledge (University of Kentucky) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • oURspace (University of Regina) (submittedVersion, cc-by)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
  • Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
  • Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
Keywords
participation inequality, self-monitoring, police training, mental health screening, generalized anxiety disorder, major depressive disorder, post-traumatic stress disorder, alcoholism, panic disorder, workplace mental health

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.