Cited by 151Digital Mental Health InterventionsMental Health Research TopicsContext-Aware Activity Recognition Systems

Digital Biomarkers for Depression Screening With Wearable Devices: Cross-sectional Study With Machine Learning Modeling

Open access
Rykov, Yuri, Thach, Thuan-Quoc, Bojic, Iva, Christopoulos, George, Car, Josip·2021·JMIR mHealth and uHealth

Published version of a preprint

Abstract

Background: Depression is a prevalent mental disorder that is undiagnosed and untreated in half of all cases. Wearable activity trackers collect fine-grained sensor data characterizing the behavior and physiology of users (ie, digital biomarkers), which could be used for timely, unobtrusive, and scalable depression screening. Objective: The aim of this study was to examine the predictive ability of digital biomarkers, based on sensor data from consumer-grade wearables, to detect risk of depression in a working population. Methods: This was a cross-sectional study of 290 healthy working adults. Participants wore Fitbit Charge 2 devices for 14 consecutive days and completed a health survey, including screening for depressive symptoms using the 9-item Patient Health Questionnaire (PHQ-9), at baseline and 2 weeks later. We extracted a range of known and novel digital biomarkers characterizing physical activity, sleep patterns, and circadian rhythms from wearables using steps, heart rate, energy expenditure, and sleep data. Associations between severity of depressive symptoms and digital biomarkers were examined with Spearman correlation and multiple regression analyses adjusted for potential confounders, including sociodemographic characteristics, alcohol consumption, smoking, self-rated health, subjective sleep characteristics, and loneliness. Supervised machine learning with statistically selected digital biomarkers was used to predict risk of depression (ie, symptom severity and screening status). We used varying cutoff scores from an acceptable PHQ-9 score range to define the depression group and different subsamples for classification, while the set of statistically selected digital biomarkers remained the same. For the performance evaluation, we used k-fold cross-validation and obtained accuracy measures from the holdout folds. Results: A total of 267 participants were included in the analysis. The mean age of the participants was 33 (SD 8.6, range 21-64) years. Out of 267 participants, there was a mild female bias displayed (n=170, 63.7%). The majority of the participants were Chinese (n=211, 79.0%), single (n=163, 61.0%), and had a university degree (n=238, 89.1%). We found that a greater severity of depressive symptoms was robustly associated with greater variation of nighttime heart rate between 2 AM and 4 AM and between 4 AM and 6 AM; it was also associated with lower regularity of weekday circadian rhythms based on steps and estimated with nonparametric measures of interdaily stability and autocorrelation as well as fewer steps-based daily peaks. Despite several reliable associations, our evidence showed limited ability of digital biomarkers to detect depression in the whole sample of working adults. However, in balanced and contrasted subsamples comprised of depressed and healthy participants with no risk of depression (ie, no or minimal depressive symptoms), the model achieved an accuracy of 80%, a sensitivity of 82%, and a specificity of 78% in detecting subjects at high risk of depression. Conclusions: Digital biomarkers that have been discovered and are based on behavioral and physiological data from consumer wearables could detect increased risk of depression and have the potential to assist in depression screening, yet current evidence shows limited predictive ability. Machine learning models combining these digital biomarkers could discriminate between individuals with a high risk of depression and individuals with no risk.

AI snapshot

Written from the paper’s full text.

TL;DR

This cross-sectional study of 267 working adults using Fitbit Charge 2 and PHQ-9 found several wearable digital biomarkers associated with depressive symptom severity, especially nighttime heart-rate variation and lower weekday circadian rhythm regularity. Machine learning had limited ability to detect depression in the whole sample but achieved 80% accuracy, 82% sensitivity, and 78% specificity in balanced contrasted subsamples.

Key findings

  • Greater depressive symptom severity was robustly associated with greater variation of nighttime heart rate between 2 AM and 4 AM and between 4 AM and 6 AM, lower regularity of weekday circadian rhythms based on steps (interdaily stability and autocorrelation), and fewer steps-based daily peaks.
  • In fully adjusted models, three digital biomarkers remained consistently associated with symptom severity: weekday steps-based interdaily stability (β=−0.30 per 10% change, 95% CI −0.51 to −0.08, P=.01), weekday steps-based autocorrelation (β=−0.38 per 10% change, 95% CI −0.75 to −0.01, P=.04), and coefficient of variation of nighttime heart rate between 4 AM and 6 AM (β=0.90 per 10% change, 95% CI 0.04-1.78, P=.04).
  • Of 126 extracted digital biomarkers, 36 were significantly correlated with average PHQ-9 score (absolute Spearman coefficients 0.12-0.26), and 17 remained significant after false discovery rate correction.
  • Whole-sample machine learning performance was poor: for the default PHQ-9 cutoff of ≥10 at either assessment, accuracy was 86% (equal to the no information rate), sensitivity ranged from 3% to 13%, specificity from 98% to 100%, and AUC from 0.51 to 0.66. In balanced contrasted subsamples, the best model achieved 80% accuracy, 82% sensitivity, and 78% specificity; the top 20% versus bottom 20% subsample achieved an AUC of 0.8 with accuracy, sensitivity, and specificity of 77% each.

Methods

  • Cross-sectional study of 290 recruited healthy working adults in Singapore; 267 were included in analysis after exclusions. Participants wore Fitbit Charge 2 devices for at least 14 days and completed PHQ-9 screening at baseline and 2 weeks later.
  • The authors extracted 126 digital biomarkers characterizing physical activity, sleep, circadian rhythms, and heart rate from steps, heart rate, energy expenditure, and sleep data. Associations with depressive symptom severity were examined using Spearman correlation with FDR correction and multiple hierarchical linear regression adjusted for sociodemographic, lifestyle, health, sleep, and loneliness covariates.
  • Supervised machine learning used extreme gradient boosting (DART) to predict symptom severity and depression screening status. Digital biomarkers were selected by Spearman correlation at different significance levels; performance was evaluated with repeated k-fold cross-validation (4 folds, 25 repeats) and holdout-fold accuracy, sensitivity, specificity, and AUC.

Limitations

  • The paper states that participants were working adults without diagnosed clinical depression, which may reduce contrast between depressed and healthy participants; PHQ-9 is a self-reported scale with limited accuracy; participants were mostly highly educated university employees with sedentary jobs; the cross-sectional design prevents causal inference; whole-sample predictability was poor; and models retrained on balanced contrasted subsamples probably suffer from overfitting and would perform worse on new samples.
  • The text also makes evident that the depressed groups were small (e.g., 38 participants with PHQ-9 ≥10 at either assessment, 22 with ≥8 at both assessments, 42 with average ≥8), and class imbalance was substantial in the whole sample.
  • Feature selection for the contrasted-subsample models was performed using the entire sample rather than within each cross-validation fold, which the authors describe as a way to avoid arbitrary feature sets but which may still limit generalizability.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.2196/24872

Cites

73 of 73 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 50 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    38 out of 267 (14.2%) participants had PHQ-9 scores of ≥10 at either of the two assessments and were identified as depressed.

    “In total, 38 out of 267 (14.2%) participants had PHQ-9 scores of ≥10 at either of the two assessments and were identified as depressed.”
    Quote in the paperSubstantial claim
  • Findingown data

    Participants experienced an overall decrease in depressive symptoms over the 2-week period.

    “However, participants experienced an overall decrease in depressive symptoms over time; for example, 20 participants with moderate (score 10-14) depressive symptoms at the first assessment shifted to the mild range (score 5-9) at the second assessment, while just 5 participants with mild symptoms at the first assessment appeared to have moderate symptoms at the second assessment.”
    Quote in the paperNot a substantial claim
  • Findingown data

    A total of 267 participants were included in the analysis.

    “A total of 267 participants were included in the analysis.”
    • Also stated in: § Characteristics of the Data and Participants · plain
      “The final sample comprised of 267 participants with 14 days of tracking data, on average; the participant flowchart is presented in Multimedia Appendix 4.”
    Quote in the paperSubstantial claim
  • Findingown data

    PHQ-9 scores at the two assessments are highly and linearly correlated (r=0.73, P<.001).

    “PHQ-9 scores are highly and linearly correlated (r=0.73, P<.001), showing that the change in depressive symptoms over time is quite smooth and gradual rather than quick and sharp.”
    Quote in the paperSubstantial claim
  • Findingown data

    Only 8 participants had PHQ-9 scores of ≥10 at both assessments.

    “Hence, using the widely adopted cutoff score of ≥10 for both assessments significantly reduced the prevalence rate of depressed participants: only 8 participants had PHQ-9 scores of ≥10 at both assessments.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. 33
  • May combine two claims. 28
  • The quote only partly states this claim. 2
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    In total, we extracted 126 digital biomarkers.

    “In total, we extracted 126 digital biomarkers.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Among models trained without statistical feature selection but with different feature subsets, the model with heart rate metrics had the best accuracy, sensitivity, and AUC-70%, 71%, and 72%, respectively-and the model with nonparametric circadian rhythm metrics had the best specificity of 76%.

    “Among these models, the model with heart rate metrics had the best accuracy, sensitivity, and AUC—70%, 71%, and 72%, respectively—and the model with nonparametric circadian rhythm metrics had the best specificity of 76% (see Table S9 in Multimedia Appendix 1); however, models with correlation-based feature selection outperformed all of these models.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: Excluding participants with midrange (borderline) PHQ-9 scores results in a larger difference between groups and increases the discriminatory power of digital biomarkers.
  • May combine two claims.

    Findingown data

    The model based on the subsample comprised of the top 20% and bottom 20% of participants by average PHQ-9 score achieved the highest AUC of 0.8, with accuracy, sensitivity, and specificity values of 77% each.

    “Alternatively, the model based on the subsample comprised of the top 20% and bottom 20% of participants by average PHQ-9 score achieved the highest AUC of 0.8, and had accuracy, sensitivity, and specificity values of 77% each (Table 7 and Figure 3, C and D).”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: Excluding participants with midrange (borderline) PHQ-9 scores results in a larger difference between groups and increases the discriminatory power of digital biomarkers.
  • The quote only partly states this claim.

    Findingown data

    The digital biomarker heart rate variation between 4 AM and 6 AM correlated with depressive symptoms independent of sleep offset time.

    “This digital biomarker correlated to depressive symptoms independent of sleep offset time, which might cause greater variation (Table S3 in Multimedia Appendix 1).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The best model, based on the contrasted subsample with default cutoff point (either baseline or follow-up PHQ-9 score ≥10), correctly predicted depression screening status in 80% of participants from holdout folds, with sensitivity 82% and specificity 78%.

    “The best model was based on the contrasted subsample with default cutoff point (ie, either baseline or follow-up PHQ-9 score of ≥10) and has correctly predicted the depression screening status in 80% of participants from holdout folds, with a sensitivity of 82% and a specificity of 78% (Table 7 and Figure 3, A and B).”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Excluding participants with midrange (borderline) PHQ-9 scores results in a larger difference between groups and increases the discriminatory power of digital biomarkers.
  • May combine two claims.

    Findingown data

    Subsamples mainly did not differ from the whole sample in terms of sociodemographic characteristics, with two exceptions: the second subsample had a slightly younger age, and the fourth subsample did not have a gender bias.

    “Subsamples mainly did not differ from the whole sample in terms of sociodemographic characteristics, with two exceptions: the second subsample had a slightly younger age, and the fourth subsample did not have a gender bias (see Tables S5 to S8 in Multimedia Appendix 1).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    In balanced and contrasted subsamples of depressed and healthy participants with no risk of depression, the model achieved an accuracy of 80%, a sensitivity of 82%, and a specificity of 78% in detecting subjects at high risk of depression.

    “However, in balanced and contrasted subsamples comprised of depressed and healthy participants with no risk of depression (ie, no or minimal depressive symptoms), the model achieved an accuracy of 80%, a sensitivity of 82%, and a specificity of 78% in detecting subjects at high risk of depression.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Severity of depressive symptoms was correlated with variation in nighttime heart rate in several time intervals, regularity of circadian rhythms measured with nonparametric and cosinor measures, daily peaks, and timing and variation in sleep offset and midpoint.

    “Severity of depressive symptoms was correlated to variation in nighttime heart rate in several time intervals, regularity of circadian rhythms measured with nonparametric and cosinor measures, daily peaks, and timing and variation in sleep offset and midpoint.”
    Quote in the paperSubstantial claim
  • May combine two claims. The quote only partly states this claim.

    Findingown data

    Lower regularity of heart rate circadian rhythm, fewer steps-based daily peaks, greater steepness of the heart rate rhythm curve, later sleep midpoint, and greater variation of sleep offset time were associated with a greater severity of depressive symptoms.

    “Additionally, we found that lower regularity of heart rate circadian rhythm, fewer steps-based daily peaks, greater steepness of the heart rate rhythm curve, later sleep midpoint, and greater variation of sleep offset time were associated with a greater severity of depressive symptoms, yet these associations were less reliable and became nonsignificant in regression models with covariates.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Rhythm stability metrics based on heart rate were correlated to severity of depressive symptoms, but these associations became nonsignificant in fully adjusted regression models.

    “Rhythm stability metrics based on heart rate were also correlated to severity of depressive symptoms, yet these associations became nonsignificant in fully adjusted regression models.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Shortened sleep duration, increased SOL, lower SE, and longer WASO were not related to more severe depressive symptoms.

    “we did not find that shortened sleep duration, increased SOL, lower SE, and longer WASO were related to more severe symptoms”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Among cosinor-based metrics, lower pseudo-F statistic values and later acrophase, both based on steps and heart rate, were associated with more severe symptoms, but these correlations became nonsignificant after FDR correction and in multiple regression analysis.

    “our data indicated lower pseudo-F statistic values and later acrophase, both based on steps and heart rate, in participants with more severe symptoms, which is consistent with existing evidence [22,23,25,26,29,30], yet these correlations became nonsignificant after the FDR correction and in multiple regression analysis.”
    Quote in the paperNot a substantial claim0 of 6 sources checked
    • cites [22] source

      Not checked in the free run.

    • cites [23] source

      Not checked in the free run.

    • cites [25] source

      Not checked in the free run.

    • cites [26] source

      Not checked in the free run.

    • cites [29] source

      Not checked in the free run.

    • cites [30] source

      Not checked in the free run.

  • May combine two claims.

    Findingown data

    Our data did not show a relationship with cosinor-based metrics estimating the level of activity, including mesor and rhythm amplitude, or with nonparametric measures, including M10, L5, and RA.

    “our data did not show a relationship with cosinor-based metrics estimating the level of activity, including mesor and rhythm amplitude [24,25], or with nonparametric measures, including M10, L5, and RA.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [24] source

      Not checked in the free run.

    • cites [25] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Depression remains undiagnosed and untreated in half of all cases.

    “Despite its high prevalence, depression remains undiagnosed and untreated in half of all cases [2,3].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [2] source

      Not checked in the free run.

    • cites [3] Kohn, R, 2004, Bull World Health Organ

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Sleep-staging Fitbit devices, such as the Charge 2, show no significant difference in measured values of WASO, TST, and SE, but slightly underestimate SOL in comparison to the gold standard PSG.

    “According to a recent meta-analysis, sleep-staging Fitbit devices, such as the Charge 2, showed no significant difference in measured values of WASO, TST, and SE, but they slightly underestimated SOL in comparison to the gold standard PSG [45].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [45] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The study protocol and informed consent form were approved by the NTU Institutional Review Board.

    “The study protocol and informed consent form were approved by the NTU Institutional Review Board (application reference: RB-2016-03-033).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Fitbit devices are likely to provide accurate measures of daily step counts.

    “According to a systematic review [42], studies have consistently indicated that Fitbit devices were likely to provide accurate measures of daily step counts.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [42] source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    People with clinically significant depressive symptoms have lower interdaily stability (IS) and higher intradaily variability (IV) of circadian activity rhythm.

    “Few studies using nonparametric rhythm measures demonstrated that participants with more severe depressive symptoms had lower interdaily stability (IS) and higher intradaily variability (IV) of circadian activity rhythm [31,34], reduced relative amplitude (RA) between the highest and the lowest activity levels [28,35], and reduced RA of skin temperature [36].”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [31] source

      Not checked in the free run.

    • cites [34] source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    For the performance evaluation, we used k-fold cross-validation and obtained accuracy measures from the holdout folds.

    “For the performance evaluation, we used k-fold cross-validation and obtained accuracy measures from the holdout folds.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductown data

    Associations between severity of depressive symptoms and digital biomarkers were examined with multiple regression analyses adjusted for potential confounders including sociodemographic characteristics, alcohol consumption, smoking, self-rated health, subjective sleep characteristics, and loneliness.

    “Associations between severity of depressive symptoms and digital biomarkers were examined with Spearman correlation and multiple regression analyses adjusted for potential confounders, including sociodemographic characteristics, alcohol consumption, smoking, self-rated health, subjective sleep characteristics, and loneliness.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    We collected a range of covariates to control for possible confounders.

    “We collected a range of covariates to control for possible confounders.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductcitation

    The false discovery rate (FDR) was used for multiple testing correction of P values.

    “The false discovery rate (FDR) was used for multiple testing correction of P values [57].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [57] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Sleep-stage transition dynamics measured by Fitbit devices are inaccurate compared to PSG.

    “Also sleep-stage transition dynamics measured by Fitbit devices were found to be inaccurate compared to PSG [46].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [46] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Physical activity has a protective effect against the future onset of depression.

    “Meta-analyses of prospective cohort studies showed that physical activity had a protective effect against the future onset of depression [17], while sedentary time increased the risk of depression [18].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [17] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductown data

    The total fraction of complete data was 84.0%.

    “The mean compliance with wearing the activity tracker among participants within the observation period was 84.8% (SD 10.4), whereas the total fraction of complete data was 84.0% (6,265,469 minutes of complete data from 5180 days).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    The first stream of evidence from actigraphy and PSG studies lacks research on the predictive ability of various metrics to assess the risk of depression.

    “The first stream of evidence from actigraphy and PSG studies lacks research on the predictive ability of various metrics to assess the risk of depression, whereas the other stream of data-driven studies often ignores established risk markers and leaves associations between depressive symptomatology and wearable data uninterpreted.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Wearable activity trackers are increasingly widely used.

    “Wearable activity trackers are increasingly widely used and provide an opportunity to harness sensor data for detection of different health conditions [7].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [7] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Participants were excluded due to outlying heart rate (n=1), exceeding average steps (n=4), and insufficient sleep data (n=5).

    “Further, we identified and excluded outliers: 1 participant was excluded due to outlying heart rate, 4 participants were excluded due to exceeding average steps, and another 5 participants were excluded due to insufficient sleep data with less than three nights on weekdays.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Sedentary time increases the risk of depression.

    “Meta-analyses of prospective cohort studies showed that physical activity had a protective effect against the future onset of depression [17], while sedentary time increased the risk of depression [18].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [18] source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    Extreme gradient boosting algorithm (DART) was the most efficient method in similar studies.

    “Extreme gradient boosting algorithm (DART [Dropouts meet Multiple Additive Regression Trees]) was used for model training, as it was the most efficient method in similar studies [33,37,58].”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [33] source

      Not checked in the free run.

    • cites [37] source

      Not checked in the free run.

    • cites [58] OlsonRSCavaWLMustahsanZVarikAMooreJHData-driven advice for applying machine learning to bioinformatics problemsProceedings of the Pacific Symposium on Biocomputing 20182018Pacific Symposium on Biocomputing 2018January 3-7, 2018Big Island, Hawaii192203 source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Depressive symptoms are associated with increased heart rate in the night and morning hours.

    “Depressive symptoms were also associated with heart rate–based mesor [32] and amplitude [32] as well as increased heart rate in the night and morning hours [33].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [33] source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Energy expenditure is less accurately estimated by Fitbit devices.

    “However, energy expenditure is less accurately estimated by Fitbit devices.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based). May combine two claims.

    Premisenone given

    The other stream of data-driven studies often ignores established risk markers and leaves associations between depressive symptomatology and wearable data uninterpreted.

    “The first stream of evidence from actigraphy and PSG studies lacks research on the predictive ability of various metrics to assess the risk of depression, whereas the other stream of data-driven studies often ignores established risk markers and leaves associations between depressive symptomatology and wearable data uninterpreted.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    We used validated self-report questionnaires for depression screening and to collect sociodemographic, lifestyle, and health characteristics.

    “We used validated self-report questionnaires for depression screening and to collect sociodemographic, lifestyle, and health characteristics.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Study design and conductnone given

    For performance evaluation of these models, stratified repeated cross-validation with 4 folds and 25 repeats was used.

    “For performance evaluation of these models, we used stratified repeated cross-validation with 4 folds and 25 repeats.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Study design and conductreasoning

    Feature selection for the contrasted subsample models was done using the entire sample, and selected digital biomarkers remained the same for all models.

    “Importantly, feature selection for these models was done using the entire sample (ie, selected digital biomarkers were based on statistical associations found in the entire sample, not in subsamples, and remained the same for all models).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    Digital biomarkers based on behavioral and physiological data from consumer wearables could detect increased risk of depression and have the potential to assist in depression screening, yet current evidence shows limited predictive ability.

    “Digital biomarkers that have been discovered and are based on behavioral and physiological data from consumer wearables could detect increased risk of depression and have the potential to assist in depression screening, yet current evidence shows limited predictive ability.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Patients with major depression have elevated nocturnal body temperature, increased cortisol, lower melatonin, and lower norepinephrine levels.

    “It has been documented that patients with major depression have elevated nocturnal body temperature, increased cortisol, lower melatonin, and lower norepinephrine levels [70,71].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [70] source

      Not checked in the free run.

    • cites [71] source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Disturbed rest-activity rhythms lead to desynchronization of internal molecular clocks, thereby disturbing circadian biochemical processes, secretion of hormones, metabolic functions, and physiological parameters.

    “Existing evidence shows that disturbed rest-activity rhythms, as, for example, in shift workers, lead to desynchronization of internal molecular clocks, thereby disturbing circadian biochemical processes, secretion of hormones, metabolic functions, and physiological parameters [66-68].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [66] source

      Not checked in the free run.

    • cites [67] source

      Not checked in the free run.

    • cites [68] source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    The key novel approach in this study, compared to existing efforts, was the use of data from widespread consumer wearables and the use of circadian rhythm metrics as digital biomarkers in predictive modeling with machine learning.

    “the key novel approach in our study, as compared to existing efforts, was the use of data from widespread consumer wearables and the use of circadian rhythm metrics as digital biomarkers in predictive modeling with machine learning.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The study used correction for multiple testing in statistical analysis.

    “use of correction for multiple testing in statistical analysis”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The relationships between depression and circadian rhythms in behavior and physiology are probably bidirectional.

    “The relationships between depression and circadian rhythms in behavior and physiology are probably bidirectional”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [64] source

      Not checked in the free run.

    • cites [65] source

      Not checked in the free run.

  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Fewer steps-based daily peaks reflect fewer distinct activities happening over a day, indicating a diagnostic symptom of anhedonia.

    “which perhaps reflects fewer distinct activities happening over a day, indicating a diagnostic symptom of anhedonia (ie, loss of interest in activities).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Disturbed master clocks at the molecular level could lead to neurobiological dysfunction that may generate depressive mood.

    “In turn, disturbed master clocks at the molecular level could lead to neurobiological dysfunction that may generate depressive mood [69].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [69] source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    The ability to adherently follow weekday routine better discriminates between depressed and healthy individuals, with healthy people demonstrating greater regularity.

    “Although weekday rhythm is mainly determined by work routine, the ability to adherently follow this routine better discriminates between depressed and healthy individuals, where healthy people demonstrated a greater regularity.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The study used a wide range of covariates for model adjustments in regression analysis.

    “use of a wide range of covariates for model adjustments in regression analysis”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The study used cross-validation with multiple resampling in machine learning modeling.

    “use of cross-validation with multiple resampling in machine learning modeling”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationnone given

    Participants were mostly highly educated university employees with sedentary jobs who might have specific psycho-behavioral characteristics.

    “our participants were mostly highly educated university employees with sedentary jobs who might have specific psycho-behavioral characteristics.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductnone given

    The digital biomarkers used were only metrics that meaningfully characterize everyday behavior and human physiology relevant to depressive disorder, avoiding extraction of a multitude of uninterpretable features and black box approaches.

    “we used only metrics that meaningfully characterize everyday behavior and human physiology relevant to depressive disorder, avoiding extraction of a multitude uninterpretable features and black box approaches.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationnone given

    The study population was working adults who represent the generally healthy population and had not been diagnosed with depression.

    “we studied working adults who represent the generally healthy population and had not been diagnosed with depression.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Predictive models retrained using balanced and contrasted subsamples probably suffer from overfitting and would perform worse on new samples.

    “predictive models were retrained using balanced and contrasted subsamples equally comprised of depressed participants and healthy participants with no risk of depression; therefore, they probably suffer from overfitting and would perform worse on new samples.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The cross-sectional design of the study does not allow causal inferences.

    “the cross-sectional design of the study does not allow causal inferences.”
    Quote in the paperNot a substantial claim
52 of 52
  • The paper relies on this without support.

    The sample of full-time employees at Nanyang Technological University is representative of the working population in Singapore.

    “In a cross-sectional study, we collected data from a multiethnic working population in Singapore. A total of 290 adult volunteers (aged ≥21 years) among full-time employees of Nanyang Technological University (NTU) were recruited to participate in the study from August to October 2019.”
  • The paper relies on this without support.

    The 2-week observation period is sufficient to capture stable behavioral and physiological patterns relevant to depression.

    “Participants responded to online questionnaires and wore activity trackers for at least 14 days.”
  • The authors state this as an assumption.

    Excluding participants with midrange (borderline) PHQ-9 scores results in a larger difference between groups and increases the discriminatory power of digital biomarkers.

    “We believe that excluding participants with midrange (ie, borderline) PHQ-9 scores results in the larger difference between groups and, therefore, increases the discriminatory power of digital biomarkers.”
  • The paper relies on this without support.

    Participants with zero PHQ-9 scores may have responded dishonestly.

    “We excluded participants with zero scores (n=24) due to concerns in honesty of their responses to minimize the bias in self-reported outcome.”
4 of 4

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The use of digital technologies for depression, including telehealth and telemedicine, also increased during the pandemic; patients with depression were three times more likely to use telehealth than those without.

    “The use of digital technologies for depression, including telehealth and telemedicine, also increased during the pandemic; patients with depression were three times more likely to use telehealth than those without.68,69”

    From Digital health technologies and major depressive disorder (2023) · cites this paper as [68]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Good and very good health counts are reversed in Table 1

    Minor

    The text assigns 124 participants to "good" health and 105 to "very good"; Table 1 assigns those counts to the opposite categories.

  • The ≥8 depression group is labeled "either assessment" instead of "both"

    Minor

    The text defines the 22-person group as scoring ≥8 at both assessments, but the model tables label that same 22-person group as scoring ≥8 at assessment 1 or 2. The latter definition would include at least the 38 participants reported to have scored ≥10 at either assessment.

  • Included complete minutes are not 83.7% of complete data

    Minor

    The included 5,464,248 minutes are 87.21% of the 6,265,469 complete minutes reported, not 83.7%. The stated 801,221 discarded minutes account for the remaining 12.79%.

    Reported 83.7 · recomputed 87.212115

3 of 3

Cites

Flagged first, then by citations

Research works printed but not linked: 2

  1. Kohn, R, 2004, Bull World Health Organ, 82, 858
  2. 1999, Promoting Physical Activity: A Guide for Community Action

Cited by

Sorted by citations

Authors
Rykov, Y., Thach, T.-Q., Bojic, I., Christopoulos, G., & Car, J.
Affiliations
Nanyang Technological University (SG)
Corresponding author
Car, Josip
Venue
JMIR mHealth and uHealth
Published
2021-10-25
Volume
9
Issue
10
Pages
e24872
ISSN
2291-5222 (ISSN-L)
OpenAlex
W3183239414
Cited by
151
References
73
Citations by year
2026: 37 · 2025: 47 · 2024: 27 · 2023: 20 · 2022: 17 · 2021: 3
FWCI
15.04
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • JMIR mhealth and uhealth (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • The HKU Scholars Hub (University of Hong Kong) (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • DR-NTU (Nanyang Technological University) (submittedVersion, cc-by)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
Keywords
depression screening, digital biomarkers, wearable activity trackers, Fitbit, PHQ-9, depressive symptoms, circadian rhythm, sleep patterns, physical activity, energy expenditure, machine learning prediction, working adults, loneliness
MeSH terms
Machine Learning, Fitness Trackers, Adult, Cross-Sectional Studies, Depression, Female, Humans, Middle Aged, Biomarkers, Young Adult

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-10.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-10.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review