Trouble with the curve: the 90-9-1 rule to measure volitional participation inequalities among Royal Canadian Mounted Police cadets during training
Open accessThe DOI matches its Crossref record; 61 of the 67 references it cites were found in a registry or an index; 13 of the 34 sources its claims cite were checked for support.
Abstract
Objective: The Royal Canadian Mounted Police (RCMP) Study includes longitudinal multimodal assessments of RCMP cadets from pre-training (i.e., starting the Cadet Training Program [CTP]) to post-deployment and for five years thereafter. The data allow for investigating the multidimensionality of volitional participation in digital health data collection frameworks within serial data collection platforms and the impact of participation inequalities by classifying cadets using the 90-9-1 rule. By classifying cadets as Lurkers, Contributors, and Superusers formally described by the 90-9-1 rule, where 90% of actors do not participate, 9% seldom contribute, and 1% contribute substantially allows for the assessing of relationships between participation inequalities in self-monitoring behaviors as well as whether mental health disorder symptoms at pre-training (i.e., starting the CTP) were associated with subsequent participation. Methods: Participants were asked to complete a Full Assessment prior to their training at CTP, as well as short daily surveys throughout their training. Participation frequency was described using a process where participants were rank ordered by the number of daily surveys completed and classified into one of three categories. Full assessment surveys completed prior to their training at CTP included screening tools for generalized anxiety disorder (GAD), major depressive disorder (MDD), posttraumatic stress disorder (PTSD), alcohol use disorder (AUD), and panic disorder (PD). The Kruskal-Wallis H test was used to assess differences in participation rates between mental health disorder symptom screening groups for each measure at pre-training, and Spearman’s Rho was used to test for associations amongst self-reported Full Assessment screening tool responses and the number of daily surveys completed during CTP. Results: There were 18557 daily survey records collected from 772 participants. The rank-ordering of cadets by the number of daily surveys completed produced three categories in line with the 90-9-1 rule: Superusers who were the top 1% of cadets (n=8) and produced 6.4% of all recordings; Contributors who were the next 9% of cadets (n=68) and produced 49.2% of the recordings; and Lurkers who were the next 90% of cadets (n=695) and produced 44.4% of daily survey recordings. Lurkers had the largest proportion of positive screens for self-reported mental health disorders at pre-training. Conclusion: The creation of highly individualized, population-based mental health injury programs has been limited by an incomplete understanding of the causal relationships between protective factors and mental health. Disproportionate rates of disengagement from persons who screen positive for mental health disorders further compounds the difficulty in understanding the relationships between training programs and mental health. The current results suggest persons with mental health challenges may be less likely to engage in some forms of proactive mental health training. The current results also provide useful information about participation, adherence, and engagement that can be used to inform evidence-based paradigm shifts in health-related data collection in occupational populations. Copyright © 2024 Teckchandani, Shields, Andrews, Maguire, Jamshidi, Nisbet, Afifi, Lix, Stewart, Sauer-Zavala, Krakauer, Neary, Krätzig and Carleton.
Overview
CoChat Summary
## TL;DR
This study used RCMP cadet daily survey data during the 26-week Cadet Training Program to classify participation with the 90–9–1 rule and test whether pre-training mental health symptoms were related to later self-monitoring. The main pattern was that cadets with the most daily survey completion had fewer positive mental health screens, although most groupwise differences were not statistically significant.
## Key findings
- The study analyzed 18,557 daily survey records from 772 cadets; the 90–9–1 classification yielded 8 Superusers (1%), 68 Contributors (9%), and 695 Lurkers (90%).
- Superusers produced 6.4% of all daily survey recordings, Contributors produced 49.2%, and Lurkers produced 44.4%.
- Lurkers had the largest proportion of positive pre-training screens: 31 (4.5%) PTSD, 49 (7.1%) MDD, 58 (8.3%) GAD, 28 (4.0%) SAD, and 12 (1.7%) PD.
- Bivariate correlations showed a statistically significant inverse relationship between pre-training PCL-5 total scores and the number of daily surveys completed at the aggregate sample level (p < .05), but no other statistically significant relationships were found; Kruskal-Wallis tests also found no statistically significant differences in daily survey completion across screening groups for AUDIT, PDSS-SR, GAD-7, PHQ-9, or PCL-5.
## Methods
- Design/data: Longitudinal analysis of the RCMP Study using online self-report data from RCMP cadets (n = 772; 72% male) completing a 26-week Cadet Training Program; pre-training mental health screening was paired with daily surveys during training.
- Measures: Pre-training screening used PCL-5, PHQ-9, PDSS-SR, GAD-7, SIPS, and AUDIT; daily surveys were brief 20-item smartphone self-reports completed over the previous 24 hours.
- Analysis: Cadets were rank-ordered by number of daily surveys completed and grouped as Superusers, Contributors, or Lurkers; analyses included Kruskal-Wallis H tests for group differences and Spearman’s rho for associations between pre-training symptom scores and daily survey completion, with Holm-Bonferroni correction.
## Limitations
- The paper states there was a lack of data about cadets prior to their pre-screening surveys, creating potential left censorship bias.
- The paper states cadets with more mental health symptoms may have left the RCMP Study or the CTP because of worse mental health, creating self-selection bias; it also notes that most attrition reports cited insufficient time to participate.
- The paper states that replicability and generalizability to a general community sample using a digital health platform are limited by the structured, serial data collection environment of the CTP.
- Evident from the text: the study’s participation categories are based on completed daily surveys only, so the findings speak to survey adherence/engagement, not direct clinical outcomes or causation.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 1 Not valid · 6 Not checked · 39 Own results and interpretations
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“RCMP Cadet participation does not differ from the general population”
§ Trouble with the curve: the 90–9-1 rule to measure volitional participation inequalities among Royal Canadian Mounted Police cadets during training > Conclusion
What the sources say
- Could not verifycites [17] Van Mierlo, 2012, Superusers in social networks for smoking cessation: Analysis of demographic characteristics and posting behavior from the canadian cancer society’s smokers’ helpline online and stopsmokingcenter.net, J Med Internet Res sourceExperimental — accuracy not yet measured
The Methods (Data Collection) describe a registration questionnaire for users of two smoking-cessation websites, and the Results (Comparison of SHO and SSC Superusers) compare those sites’ superusers. Searches for RCMP cadets and daily survey participation found no passage addressing whether cadet participation differs from that of the general population. (LLM, conf=0.76)
- Could not verifycites [42] Van Mierlo, 2015, Mapping power law distributions in digital health social networks: Methods, interpretations, and practical implications, J Med Internet Res sourceExperimental — accuracy not yet measured
The Methods (Overview) and Results examine posting in four digital health social networks, not RCMP Cadets or daily surveys. Searches for RCMP Cadets, daily surveys, and a comparison with the general population found no passage addressing the claim. (LLM, conf=0.78)
- Could not verifycites [43] Carron-Arthur, 2014, Describing the distribution of engagement in an Internet support group by post frequency: A comparison of the 90–9-1 Principle and Zipf’s Law, Internet Interv sourceExperimental — accuracy not yet measured
The Method section describes posts by members of the BlueBoard internet support group, and the Results section analyzes their posting frequency. Searches for RCMP cadets, daily surveys, and a comparison with the general population found no passage addressing the claim. (LLM, conf=0.78)
- Not checked — no full text of the sourcecites [63] Jennings, 2021, Activity participation patterns of community mental health consumers, Br J Occup Ther source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“fewer than 5 screened positive for PTSD, SAD, or MDD”
§ Trouble with the curve: the 90–9-1 rule to measure volitional participation inequalities among Royal Canadian Mounted Police cadets during training > Results > Participation classifications
plainn = 69- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Lurkers had the largest proportion of positive screens for self-reported mental health disorders at pre-training.”
§ Trouble with the curve: the 90–9-1 rule to measure volitional participation inequalities among Royal Canadian Mounted Police cadets during training > Abstract > Results
plainstates an associationn = 695- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“There were 26 (37.7%) Contributors who screened positive for GAD”
§ Trouble with the curve: the 90–9-1 rule to measure volitional participation inequalities among Royal Canadian Mounted Police cadets during training > Results > Participation classifications
plainn = 69- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Bivariate nonparametric within participant correlations indicated a statistically significant inverse relationship between pre-training PCL-5 total scores and the number of daily surveys completed at an aggregate sample level (p<.05)”
§ Trouble with the curve: the 90–9-1 rule to measure volitional participation inequalities among Royal Canadian Mounted Police cadets during training > Results > Daily survey participation
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
24 more claims
Create a free account to see all 52 claims and every source verdict.
- Probably not a substantial claim. 18
- It may state two separate claims as one. 12
- The quote only partly states this claim. 1
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Trouble with the curve: the 90–9-1 rule to measure volitional participation inequalities among Royal Canadian Mounted Police cadets during training > Abstract > Results
“Contributors who were the next 9% of cadets (n=68) and produced 49.2% of the recordings;”
§ Trouble with the curve: the 90–9-1 rule to measure volitional participation inequalities among Royal Canadian Mounted Police cadets during training > Results > Participation classifications
“The participants designated as “Contributors” (n=69; i.e., next 9%) were mutually exclusive from the Superusers and contributed to 49.2% of all daily survey recordings during the CTP.”
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · cited 1×
“…Health Questionnaire (PHQ-9; 28); the 7-item Panic Disorders Symptoms Severity Scale, Self-Report (PDSS-SR; 29); the 7-item Generalized Anxiety Disorder scale (GAD-7; 30); the 14-item Social Interaction Phobia Scale (SIPS; 31); and the 10-item Alcohol Use Disorders Identi fi cation Test (AUDIT; 32).”
MethodStatistical Power Analysis for the Behavioral Sciences
Cohen, J. (2013) · doi:10.4324/9780203771587 · Cited by 25,373
The Structure and Function of Complex Networks
Newman, M. E. J. (2003) · SIAM Review · doi:10.1137/s003614450342480 · Cited by 18,719
SAUNDERS, J. B., AASLAND, O. G., BABOR, T. F., DE LA FUENTE, J. R., & GRANT, M. (1993) · Addiction · doi:10.1111/j.1360-0443.1993.tb02093.x · Cited by 13,597
The brief resilience scale: Assessing the ability to bounce back
Smith, B. W., Dalen, J., Wiggins, K., Tooley, E., Christopher, P., & Bernard, J. (2008) · International Journal of Behavioral Medicine · doi:10.1080/10705500802222972 · Cited by 6,439 · cited 1×
“Poor emotional awareness is also a latent cause factor for symptoms of mood-and anxiety-related disorders (52, 53).”
BackgroundBlevins, C. A., Weathers, F. W., Davis, M. T., Witte, T. K., & Domino, J. L. (2015) · Journal of Traumatic Stress · doi:10.1002/jts.22059 · Cited by 5,233 · cited 1×
“For the PCL-5, per the Diagnostic and Statistical Manual of Mental Disorders, 5th edition (DSM-5; 33), participants reported on their lifetime exposures (i.e., exposures prior to attending the CTP) to a speci fi c list of PPTEs provided by the Life Events Checklist for the DSM-5 (LEC-5; 27, 34 – 36).”
MethodGulliver, A., Griffiths, K. M., & Christensen, H. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-113 · Cited by 3,292
Bovin, M. J., Marx, B. P., Weathers, F. W., Gallagher, M. W., Rodriguez, P., Schnurr, P. P., & Keane, T. M. (2016) · Psychological Assessment · doi:10.1037/pas0000254 · Cited by 2,532
Barrett, L. F., Gross, J., Christensen, T. C., & Benvenuto, M. (2001) · Cognition & Emotion · doi:10.1080/02699930143000239 · Cited by 1,077
Research works printed but not linked: 3
- Hembroff, 2020, A 5-year perspective of attrition in relation to employment equity
- Weathers, 2013, PTSD checklist for military, Natl Cent PTSD, 94
- 2013, Diagnostic and statistical manual of mental disorders
Cited by
Shields, R. E., Teckchandani, T. A., Asmundson, G. J. G., Nisbet, J., Krakauer, R. L., Andrews, K. L., Maguire, K. Q., Jamshidi, L., Afifi, T. O., Lix, L. M., et al. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1145194 · Cited by 13
Self-citationCarleton, R. N., Teckchandani, T. A., Neary, J. P., Samayoa, J., Khoury, J. M. B., Maguire, K. Q., Krätzig, G. P., & Asmundson, G. J. G. (2025) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2025.10.044 · Cited by 2
Self-citationTeckchandani, T. A., Shields, R. E., Andrews, K. L., Nisbet, J., Afifi, T. O., Asmundson, G. J. G., Maguire, K. Q., Jamshidi, L., Neary, J. P., Krätzig, G. P., et al. (2025) · International Journal of Cognitive Behavioral Therapy · doi:10.1007/s41811-025-00231-w · Cited by 4
“Fluctuating training demands may have dramatically influenced daily survey completion (Shields et al., 2023; Teckchandani et al., 2024) and the results remain to be replicated with pending data from serving RCMP (Carleton et al., 2022a).”
Self-citation
Metadata
- Authors
- Teckchandani, T. A., Shields, R. E., Andrews, K. L., Maguire, K. Q., Jamshidi, L., Nisbet, J., Afifi, T. O., Lix, L. M., Stewart, S. H., Sauer-Zavala, S., Krakauer, R. L., Neary, J. P., Krätzig, G. P., & Carleton, R. N.
- Affiliations
- University of Regina (CA)
- University of Manitoba (CA)
- Dalhousie University (CA)
- University of Kentucky (US)
- Corresponding author
- Teckchandani, Taylor A.
- ORCID
- Venue
- Frontiers in Psychiatry
- Publisher
- Frontiers Media SA
- Published
- 2024-05-28
- Volume
- 15
- Pages
- 1297953-1297953
- ISSN
- 1664-0640 (ISSN-L)
- PMC
- PMC11165702
- OpenAlex
- W4399084043
- Semantic Scholar
- b30d0ab2713602bab94f5b8811bf3fa62f39ba89
- Cited by
- 3
- References
- 67
- Citations by year
- 2025: 2
- FWCI
- 0.81
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Frontiers in Psychiatry (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- UKnowledge (University of Kentucky) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- oURspace (University of Regina) (submittedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Keywords
- participation inequality, self-monitoring, police training, mental health screening, generalized anxiety disorder, major depressive disorder, post-traumatic stress disorder, alcoholism, panic disorder, workplace mental health
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Trouble with the curve: the 90-9-1 rule to measure volitional participation inequalities among Royal Canadian Mounted Police cadets during training. https://app.cochat.ai/papers/10.3389/fpsyt.2024.1297953
- The paper
- Teckchandani, T. A., Shields, R. E., Andrews, K. L., Maguire, K. Q., Jamshidi, L., Nisbet, J., Afifi, T. O., Lix, L. M., Stewart, S. H., Sauer-Zavala, S., Krakauer, R. L., Neary, J. P., Krätzig, G. P., & Carleton, R. N. (2024). Trouble with the curve: the 90-9-1 rule to measure volitional participation inequalities among Royal Canadian Mounted Police cadets during training. Frontiers in Psychiatry. https://doi.org/10.3389/fpsyt.2024.1297953
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.