A Randomized Evaluation of MoodFX, a Patient-Centred e-Health Tool to Support Outcome Measurement for Depression: Une évaluation randomisée de MoodFX, un outil de santé en ligne centré sur le patient pour soutenir la mesure du résultat dans la dépression.
Open accessAbstract
Background: e-Health tools using validated questionnaires to assess outcomes may facilitate measurement-based care for psychiatric disorders. MoodFX was created as a free online symptom tracker to support patients for outcome measurement in their depression treatment. We conducted a pilot randomized evaluation to examine its usability, and clinical utility. Methods: Patients presenting with a major depressive episode (within a major depressive or bipolar disorder) were randomly assigned to receive either MoodFX or a health information website as the intervention and control condition, respectively, with follow-up assessment surveys conducted online at baseline, 8 weeks and 6 months. The primary usability outcomes included the percentage of patients with self-reported use of MoodFX 3 or more times during follow up (indicating minimally adequate usage) and usability measures based on the System Usability Scale (SUS). Secondary clinical outcomes included the Quick Inventory of Depressive Symptomatology, Self-Rated (QIDS-SR) and Patient Health Questionnaire (PHQ-9). Results: Forty-nine participants were randomized (24 to MoodFX and 25 to the control condition). Of the 23 participants randomized to MoodFX who completed the user survey, 18 (78%) used MoodFX 3 or more times over the 6 months of the study. The mean SUS score of 72.7 (65th–69th percentile) represents good usability. Compared to the control group, the MoodFX group had significantly better improvement on QIDS-SR and PHQ-9 scores, with large effect sizes and higher response rates at 6 months. There were no differences between conditions on other secondary outcomes such as functioning and quality of life. Conclusion: MoodFX demonstrated good usability and was associated with reduction in depressive symptoms. This pilot study supports the use of digital tools in depression treatment.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Remote recording tools via the internet or smartphones allow patients to complete self-assessments at home and reduce participant burden and the need for frequent clinic visits.
“Remote recording tools via the internet or smartphones allow patients to complete self-assessments at home27,28 and reduce participant burden and the need for frequent clinic visits.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910 · see citing works
A Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765 · see citing works
Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L)
Herdman, M., Gudex, C., Lloyd, A., Janssen, M., Kind, P., Parkin, D., Bonsel, G., & Badia, X. (2011) · Quality of Life Research · doi:10.1007/s11136-011-9903-x · Cited by 9,795 · see citing works
Usability Evaluation In Industry
(1996) · CRC Press eBooks · doi:10.1201/9781498710411 · Cited by 4,400 · see citing works
Rush, A. J., Trivedi, M. H., Ibrahim, H. M., Carmody, T. J., Arnow, B., Klein, D. N., Markowitz, J. C., Ninan, P. T., Kornstein, S., Manber, R., et al. (2003) · Biological Psychiatry · doi:10.1016/s0006-3223(02)01866-8 · Cited by 3,829 · see citing works
(1993) · PubMed · Cited by 1,900 · see citing works
Assessing Psychiatric Impairment in Primary Care with the Sheehan Disability Scale
Leon, A. C., Olfson, M., Portera, L., Farber, L., & Sheehan, D. V. (1997) · The International Journal of Psychiatry in Medicine · doi:10.2190/t8em-c8yh-373n-1uwd · Cited by 987 · see citing works
Implementing Measurement-Based Care in Behavioral Health: A Review
Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H., Hoffman, M., Scott, K., Lyon, A., Douglas, S., et al. (2019) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.3329 · Cited by 605 · see citing works
Disparities in Health Care and the Digital Divide
Saeed, S. A., & Masters, R. M. (2021) · Current Psychiatry Reports · doi:10.1007/s11920-021-01274-4 · Cited by 578 · cited 1× · see citing works
“31 While access to the internet is almost ubiquitous in Canada and else-where, technological literacy may be more of an issue.”
BackgroundReducing the global burden of depression: a Lancet–World Psychiatric Association Commission
Herrman, H., Kieling, C., McGorry, P. D., Horton, R., Sargent, J., & Patel, V. (2018) · The Lancet · doi:10.1016/s0140-6736(18)32408-5 · Cited by 422 · see citing works
McKnight, P. E., & Kashdan, T. B. (2009) · Clinical Psychology Review · doi:10.1016/j.cpr.2009.01.005 · Cited by 400 · see citing works
Guo, T., Xiang, Y.-T., Xiao, L., Hu, C.-Q., Chiu, H. F. K., Ungvari, G. S., Correll, C. U., Lai, K. Y. C., Feng, L., Geng, Y., et al. (2015) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.14050652 · Cited by 308 · see citing works
Self-Rated Global Measure of the Frequency, Intensity, and Burden of Side Effects
Wisniewski, S. R., Rush, A. J., Balasubramani, G. K., Trivedi, M. H., & Nierenberg, A. A. (2006) · Journal of Psychiatric Practice · doi:10.1097/00131746-200603000-00002 · Cited by 288 · see citing works
Moore, R. C., Depp, C. A., Wetherell, J. L., & Lenze, E. J. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.01.011 · Cited by 274 · see citing works
Torous, J., Staples, P., Shanahan, M., Lin, C., Peck, P., Keshavan, M., & Onnela, J.-P. (2015) · JMIR Mental Health · doi:10.2196/mental.3889 · Cited by 258 · see citing works
Why Don't Psychiatrists Use Scales to Measure Outcome When Treating Depressed Patients?
Zimmerman, M., & McGlinchey, J. B. (2008) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v69n1209 · Cited by 179 · see citing works
Lam, R., Lamy, F.-X., Danchenko, N., Yarlas, A., White, M. K., Rive, B., & Saragoussi, D. (2018) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s175188 · Cited by 101 · see citing works
Self-citationLam, R. W. M., Michalak, E. E., & Yatham, L. N. (2009) · BMC Psychiatry · doi:10.1186/1471-244x-9-78 · Cited by 88 · see citing works
Self-citationOur Digital Moment: Innovations and Opportunities in Digital Mental Health Care
Gratzer, D., Torous, J. B., Lam, R. W. M., Patten, S. B., Kutcher, S., Chan, S. R., Vigo, D., PAJER, K. A., & Yatham, L. N. (2020) · The Canadian Journal of Psychiatry · doi:10.1177/0706743720937833 · Cited by 86 · see citing works
Self-citationDahne, J., Lejuez, C. W., Diaz, V. A., Player, M. S., Kustanowitz, J., Felton, J. W., & Carpenter, M. J. (2019) · Behavior Therapy · doi:10.1016/j.beth.2018.12.003 · Cited by 78 · cited 1× · see citing works
“22 Compared to other symptom tracking apps, 23 – 26 MoodFX has more questions and takes longer to complete.”
BackgroundThe Efficacy of Measurement-Based Care for Depressive Disorders
Zhu, M., Hong, R. H., Yang, T., Yang, X., Wang, X., Liu, J., Murphy, J., Michalak, E. E., Wang, Z., Yatham, L. N., et al. (2021) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.21r14034 · Cited by 69 · see citing works
Self-citationLam, R. W., Parikh, S. V., Michalak, E. E., Dewa, C. S., & Kennedy, S. H. (2015) · Annals of Clinical Psychiatry · doi:10.1177/104012371502700209 · Cited by 62 · see citing works
Self-citationHong, R. H., Murphy, J., Michalak, E. E., Chakrabarty, T., Wang, Z., Parikh, S. V., Culpepper, L., Yatham, L. N., Lam, R. W. M., & Chen, J. (2021) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s283731 · Cited by 58 · see citing works
Self-citationEngagement with mobile health interventions for depression: A systematic review
Molloy, A. G., & Anderson, P. L. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100454 · Cited by 58 · see citing works
Hung, S., Li, M.-S., Chen, Y.-L., Chiang, J.-H., Chen, Y.-Y., & Hung, G. C.-L. (2016) · Asian Journal of Psychiatry · doi:10.1016/j.ajp.2016.08.003 · Cited by 46 · see citing works
Haberer, J. E., Trabin, T., & Klinkman, M. (2013) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2013.03.009 · Cited by 39 · see citing works
Murphy, J., Khan, A., Sun, Q., Minas, H., Hatcher, S., Ng, C. H., Withers, M. H., Greenshaw, A. J., Michalak, E. E., Chakraborty, P. A., et al. (2021) · International Journal for Equity in Health · doi:10.1186/s12939-021-01484-5 · Cited by 32 · see citing works
Self-citationMurphy, J., Michalak, E. E., Liu, J., Colquhoun, H. L., Burton, H., Yang, X., Yang, T., Wang, X., Fei, Y., He, Y., et al. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03442-5 · Cited by 20 · see citing works
Self-citationMorton, E. E., Bhat, V., Giacobbe, P., Lou, W. Y. W., Michalak, E. E., Chakrabarty, T., Frey, B. N., Milev, R. V., Müller, D. J., Parikh, S. V., et al. (2021) · Pharmacopsychiatry · doi:10.1055/a-1385-0263 · Cited by 4 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 2
- [21]Lewis JR Sauro J. Item benchmarks for the system usability scale. J Usability Studies. 2018; 13: 158– 167.
- [22]Bangor A Kortum PT Miller JT. Determining what individual SUS scores mean: adding an adjective rating scale. J Usability Stud Arch. 2009; 4: 114– 123.
Cited by
Sorted by citations
Garzón‐Partida, A. P., Padilla-Gómez, C. B., Martínez-Fernández, D. E., Garcı́a‐Estrada, J., Luquı́n, S., & Fernández-Quezada, D. (2025) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1595243 · Cited by 8 · see citing works
Lam, R. W., Rnic, K., Nunez, J.-J., Ho, K., LeMoult, J., Nunes, A., Chakrabarty, T., Foster, J. A., Frey, B. N., Harkness, K. L., et al. (2025) · The Canadian Journal of Psychiatry · doi:10.1177/07067437251337603 · Cited by 6 · see citing works
Self-citationAhmed, N., Reagu, S. M., Alkhoori, S. A., Cherchali, A., Purushottamahanti, P., & Siddiqui, U. (2024) · Journal of Multidisciplinary Healthcare · doi:10.2147/jmdh.s475078 · Cited by 2 · see citing works
Maheu, C., Parkinson, M., Johnson, K., Tock, W. L., Dolgoy, N. D., Dupuis, S.-P., & Singh, M. D. (2025) · Current Oncology · doi:10.3390/curroncol32050266 · Cited by 2 · see citing works
Lam, R. W. M., Michalak, E. E., Murphy, J., Colquhoun, H. L., Ng, C. H., Culpepper, L., Dewa, C. S., Greenshaw, A. J., He, Y., Kennedy, S. H., et al. (2025) · Cureus · doi:10.7759/cureus.90395
Self-citationDigital tools for assessing bipolar disorder: A scoping review of the current landscape
Jacobson, S., Carling, H., Sarraf, L., Draper, E., Jacobson, S., St-James, M., Misiasz, C., Williamson, S., Thibaudeau, É., Sauvé, G., et al. (2026) · Neuroscience Applied · doi:10.1016/j.nsa.2026.107004
Yrondi, A., Sauvaget, A., Stéphan, F., Bulteau, S., DOLIANITI, S., Daudet, C., El‐Hage, W., Amrani, H., Lele, N., Ionela, B. O. T. A., et al. (2026) · doi:10.2196/preprints.105519
Yrondi, A., Sauvaget, A., Stéphan, F., Bulteau, S., DOLIANITI, S., Daudet, C., El‐Hage, W., Amrani, H., Lele, N., Ionela, B. O. T. A., et al. (2026) · JMIR mhealth and uhealth · doi:10.2196/105519
- Authors
- Li, V. W., Sahota, J., Dev, D. K., Gill, D. D., Evans, V. C., Axler, A., Chakrabarty, T., Do, A., Keramatian, K., Nunez, J.-J., Tam, E. M., Yatham, L. N., Michalak, E. E., Murphy, J. K., & Lam, R. W.
- Affiliations
- University of British Columbia (CA)
- Université de Montréal (CA)
- University of British Columbia
- Corresponding author
- Lam, Raymond W.
- ORCID
- Venue
- The Canadian Journal of Psychiatry
- Publisher
- SAGE Publications
- Published
- 2024-04-11
- Volume
- 69
- Issue
- 7
- Pages
- 493-502
- ISSN
- 0706-7437 (ISSN-L)
- 1497-0015
- PMC
- PMC11168344
- OpenAlex
- W4394720832
- Cited by
- 8
- References
- 29
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 1
- FWCI
- 3.16
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- The Canadian Journal of Psychiatry (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Healthy Minds Canada (n/a)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- depression, e-health, outcome measurement, measurement-based care, usability, System Usability Scale, major depressive episode, bipolar disorder, depressive symptoms
- MeSH terms
- Adult, Bipolar Disorder, Major Depressive Disorder, Female, Humans, Male, Middle Aged, Pilot Projects, Outcome Assessment, Health Care, Telemedicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
