Short-term effect of a smartphone application on the mental health of university students: A pilot study using a user-centered design self-monitoring application for mental health
Open accessThe DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Despite the widespread recognition of the importance of mental health in young people, only a small proportion of young people with a mental disorder, including university students, receive mental health care. OBJECTIVE: We developed a smartphone application (Mental App) for the university students and examined the effects of the app on their mental health. METHODS: The app was designed according to a questionnaire survey conducted before this study. The Mental App was installed on the students' smartphone and the psychological tests (the Link Stigma Scale, the Center for Epidemiologic Studies Depression Scale, and the 12-item General Health Questionnaire) were performed on the same day. After using the App for two weeks, the students completed a questionnaire survey and underwent the same psychological tests. We compared the results between the app user and non-user group. RESULTS: A total of 68 students participated, of which 57 students completed the study (app user group, n = 28; control group, n = 29). The mean number of days spent using the app was 5.66 ± 3.16 (mean ± SD). The mean total screen time of the app was 9:03 ± 06:41(min:sec). The mean number of total actions (screen taps or swipes) was 161.91 ± 107.34. There were no significant between-group differences in the ΔLink Stigma Scale score (-0.11 ± 4.28 vs. -0.59 ± 3.30, p = 0.496) or the ΔCenter for Epidemiologic Studies Depression Scale score (-4.39 ± 7.13 vs. -2.07 ± 8.78, p = 0.143). There was a significant between-group difference in the ΔGeneral Health Questionnaire score (-2.21± 2.23 vs. -0.17 ± 2.69, p = 0.007). CONCLUSIONS: This non-randomized controlled pilot study indicates that the app we developed, may provide effective mental health care for university students, even in the short-term. Trial registration: UMIN000040332.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Current youth mHealth research often engages youths by asking for feedback in a survey or interview to test usability, feasibility, and acceptability [31,70,71], or by including young users as participants in experiments to evaluate the effectiveness and efficiency of an intervention.”
From Understanding Mobile Health and Youth Mental Health: Scoping Review (2023) · cites this paper as [71]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Five studies tested the effectiveness of their app on general health and found significant improvements in their participants’ symptoms from before to after intervention [17,20,22,23,25].”
From Analysis of Mobile App-Based Mental Health Solutions for College Students: A Rapid Review (2023) · cites this paper as [22]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267
Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.6.593 · Cited by 20,391
Whiteford, H. A., Degenhardt, L., Rehm, J., Baxter, A. J., Ferrari, A. J., Erskine, H. E., Charlson, F. J., Norman, R. E., Flaxman, A. D., Johns, N., et al. (2013) · The Lancet · doi:10.1016/s0140-6736(13)61611-6 · Cited by 6,006 · cited 1×
“Although the burden of mental health disorders spans across all age groups, the highest proportion of disability-adjusted life years occurs in adolescents and young to middle-aged adults (aged 10–29 years) [2].”
No health without mental health
Prince, M., Patel, V., Saxena, S., Maj, M., Maselko, J., Phillips, M. R., & Rahman, A. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61238-0 · Cited by 3,753 · cited 1×
“Around 14% of the global disease burden is attributed to neuropsychiatric disorders, which primarily include depression, alcohol-substance abuse, and psychosis [1].”
Age of onset of mental disorders: a review of recent literature
Kessler, R. C., Amminger, G. P., Aguilar-Gaxiola, S., Alonso, J., Lee, S., & ??st??n, T. B. (2007) · Current Opinion in Psychiatry · doi:10.1097/yco.0b013e32816ebc8c · Cited by 3,457 · cited 1×
“In addition, half of all lifetime mental disorders start by the mid-teens and three quarters by the mid-20s [4, 5].”
Child and adolescent mental health worldwide: evidence for action
Kieling, C., Baker-Henningham, H., Belfer, M., Conti, G., Ertem, I., Omigbodun, O., Rohde, L. A., Srinath, S., Ulkuer, N., & Rahman, A. (2011) · The Lancet · doi:10.1016/s0140-6736(11)60827-1 · Cited by 2,449
A Modified Labeling Theory Approach to Mental Disorders: An Empirical Assessment
Link, B. G., Cullen, F. T., Struening, E., Shrout, P. E., & Dohrenwend, B. P. (1989) · American Sociological Review · doi:10.2307/2095613 · Cited by 1,935
Link, B. G. (1987) · American Sociological Review · doi:10.2307/2095395 · Cited by 1,587 · cited 1×
“The LSS was originally developed by Link and colleagues to measure the public stigma [27, 28].”
Treatment gap in mental health care.
Abramowitz, M. Z., Greenberg, D., & Levav, I. (2008) · PubMed · Cited by 1,483
The treatment gap in mental health care.
(2004) · Europe PMC (PubMed Central) · Cited by 1,419
Prevalence and Treatment of Mental Disorders Among US Children in the 2001–2004 NHANES
Merikangas, K. R., He, J.-P., Brody, D., Fisher, P. W., Bourdon, K., & Koretz, D. S. (2010) · Pediatrics · doi:10.1542/peds.2008-2598 · Cited by 1,172
Psychiatric Illness in General Practice: A Detailed Study Using a New Method of Case Identification
Goldberg, D. P., & Blackwell, B. (1970) · BMJ · doi:10.1136/bmj.2.5707.439 · Cited by 1,121 · cited 1×
“The GHQ, developed by Goldberg, is one of the most widely used screening instruments for mental health [31].”
Firth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097 · cited 1×
“Overall, several interventional studies have examined the effect of CBT (in a broad sense) using smartphone apps and confirmed its efficacy [23, 39].”
Barrett, L. F., Gross, J., Christensen, T. C., & Benvenuto, M. (2001) · Cognition & Emotion · doi:10.1080/02699930143000239 · Cited by 1,077
Psychiatric diagnoses in 3275 suicides: a meta-analysis
Arsenault-Lapierre, G., Kim, C., & Turecki, G. (2004) · BMC Psychiatry · doi:10.1186/1471-244x-4-37 · Cited by 985
Mental Health Service Utilization Among College Students in the United States
Eisenberg, D., Hunt, J., Speer, N., & Zivin, K. (2011) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0b013e3182175123 · Cited by 633
Mental Health Service Use in the Community and Schools: Results from the Four-Community MECA Study
LEAF, P. J., ALEGRIA, M., COHEN, P., GOODMAN, S. H., HORWITZ, S. M., HOVEN, C. W., NARROW, W. E., VADEN-KIERNAN, M., & REGIER, D. A. (1996) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199607000-00014 · Cited by 609
Suicide and Youth: Risk Factors
Bilsen, J. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00540 · Cited by 584 · cited 1×
“Suicide is also a serious public health problem that affects many young people and is the second leading cause of mortality in people aged 10 to 24 years [6].”
Mental Health Mobile Apps for Preadolescents and Adolescents: A Systematic Review.
Grist, R., Porter, J., & Stallard, P. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7332 · Cited by 518
Rathbone, A. L., & Prescott, J. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7740 · Cited by 497
Huberty, J., Green, J., Glissmann, C., Larkey, L., Puzia, M., & Lee, C. (2019) · JMIR mHealth and uHealth · doi:10.2196/14273 · Cited by 488
Standalone smartphone apps for mental health—a systematic review and meta-analysis
Weisel, K. K., Fuhrmann, L. M., Berking, M., Baumeister, H., Cuijpers, P., & Ebert, D. D. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0188-8 · Cited by 447 · cited 1×
“There are now a variety of apps available for different purposes, including cognitive behavioral therapy (CBT), self-monitoring, screening of mental disorders, psychoeducation, and mindfulness [23–25].”
Kauer, S. D., Reid, S. C., Crooke, A. H. D., Khor, A., Hearps, S. J. C., Jorm, A. F., Sanci, L., & Patton, G. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1858 · Cited by 404 · cited 1×
“In contrast, an RCT conducted by Kauer et al. reported that self-monitoring mood, stress, and coping strategies by mobile phone increased ESA and that this ESA increase was associated with a significant decrease in depressive symptoms [42].”
Using smartphones and health apps to change and manage health behaviors: a population-based survey
Ernsting, C., Dombrowski, S. U., Oedekoven, M., O´Sullivan, J. L., Kanzler, M., Kuhlmey, A., & Gellert, P. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6838 · Cited by 400 · cited 1×
“With the advances in information and communications technology, digital tools provide new avenues for changing health-related behaviors and managing chronic conditions [16].”
The Use and Effectiveness of Mobile Apps for Depression: Results From a Fully Remote Clinical Trial
Arean, P. A., Hallgren, K. A., Jordan, J. T., Gazzaley, A., Atkins, D. C., Heagerty, P. J., & Anguera, J. A. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6482 · Cited by 376
Perceived barriers to psychological treatments and their relationship to depression
Mohr, D. C., Ho, J., Duffecy, J., Baron, K. G., Lehman, K. A., Jin, L., & Reifler, D. (2010) · Journal of Clinical Psychology · doi:10.1002/jclp.20659 · Cited by 347 · cited 1×
“…consultation systems including medical services; 3) They are embarrassed to consult with others about their personal problems (fear of stigmatization); 4) They are too busy to consult with mental health specialists; and 5) They have restricted mobility due to physical conditions or apathy [12, 13].”
Sano, A., Taylor, S., McHill, A. W., Phillips, A. J., Barger, L. K., Klerman, E., & Picard, R. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9410 · Cited by 333
Van Ameringen, M., Turna, J., Khalesi, Z., Pullia, K., & Patterson, B. (2017) · Depression and Anxiety · doi:10.1002/da.22657 · Cited by 234 · cited 1×
“Many studies have examined the effect of smart-phone apps for mental disorders, including depression, anxiety disorder, post-traumatic stress disorder (PTSD), addictive disorders (alcoholism and tobacco addiction), and developmental disorders [19–22].”
Bakker, D., & Rickard, N. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.11.016 · Cited by 231 · cited 1×
“In addition, the authors found that the app increased the mental well-being scale score and that these effects were mediated by increases in ESA [43].”
Faurholt-Jepsen, M., Frost, M., Ritz, C., Christensen, E. M., Jacoby, A. S., Mikkelsen, R. L., Knorr, U., Bardram, J. E., Vinberg, M., & Kessing, L. V. (2015) · Psychological Medicine · doi:10.1017/s0033291715000410 · Cited by 213 · cited 1×
“Faurholt-Jepsen et al. examined whether the use of daily electronic self-monitoring using smartphones could reduce depressive and manic symptoms in patients with bipolar disorder; however, there were no significant effects of self-monitoring on depressive or manic symptoms [41].”
Doi, Y., & Minowa, M. (2003) · Psychiatry and Clinical Neurosciences · doi:10.1046/j.1440-1819.2003.01135.x · Cited by 206 · cited 2×
“For example, Doi et al. performed GHQ-12 on the Japanese general adult population (1,808 subjects) and found that young adults (20–29 years) exhibited relatively high scores compared to the elders (men: 2.77 ± 2.86, women: 3.88 ± 3.16) [32].”
InfluentialReid, S. C., Kauer, S. D., Hearps, S. J., Crooke, A. H., Khor, A. S., Sanci, L. A., & Patton, G. C. (2011) · BMC Family Practice · doi:10.1186/1471-2296-12-131 · Cited by 192 · cited 1×
“The authors found no significant differences in depression, anxiety, or stress scores between an intervention and control group, although the use of the mobile phone program was significantly associated with an increase in the emotional self-awareness (ESA) score [40].”
Mantani, A., Kato, T., Furukawa, T. A., Horikoshi, M., Imai, H., Hiroe, T., Chino, B., Funayama, T., Yonemoto, N., Zhou, Q., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.8602 · Cited by 192
Kerst, A., Zielasek, J., & Gäebel, W. (2019) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-018-0974-3 · Cited by 184
Ivanova, E., Lindner, P., Ly, K. H., Dahlin, M., Vernmark, K., Andersson, G., & Carlbring, P. (2016) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2016.09.012 · Cited by 165
Students' benefits and barriers to mental health help-seeking
Vidourek, R. A., King, K. A., Nabors, L. A., & Merianos, A. L. (2014) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2014.963586 · Cited by 160 · cited 1×
“Without treatment, students with mental health disorders are at a higher risk for lower grade point averages, school dropout, and unemployment than those without such disorders [15].”
Users of the main smartphone operating systems (iOS, Android) differ only little in personality
Götz, F. M., Stieger, S., & Reips, U.-D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0176921 · Cited by 127 · cited 1×
“A previous study found that there may be minor differences in personality between iPhone and Android users and that such minor differences may reflect the differences in sociodemographic factors [53].”
Mak, W. W., Tong, A. C., Yip, S. Y., Lui, W. W., Chio, F. H., Chan, A. T., & Wong, C. C. (2018) · JMIR Mental Health · doi:10.2196/mental.8597 · Cited by 123 · cited 1×
“Meanwhile, Mak et al. found that only 23.5% (508/2161) of the participants completed the assessment after the 4-week program [50].”
InfluentialMental Health First Aid Training by e-Learning: A Randomized Controlled Trial
Jorm, A. F., Kitchener, B. A., Fischer, J.-A., & Cvetkovski, S. (2010) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048674.2010.516426 · Cited by 121
Common and specific emotion-related predictors of anxious and depressive symptoms in youth
Suveg, C., Hoffman, B., Zeman, J. L., & Thomassin, K. (2009) · Child Psychiatry and Human Development · doi:10.1007/s10578-008-0121-x · Cited by 101
Mobile phone mood charting for adolescents
Matthews, M., Doherty, G., Sharry, J., & Fitzpatrick, C. (2008) · British Journal of Guidance & Counselling · doi:10.1080/03069880801926400 · Cited by 98
Feasibility of "CopeSmart": A Telemental Health App for Adolescents
Kenny, R., Dooley, B., & Fitzgerald, A. (2015) · JMIR Mental Health · doi:10.2196/mental.4370 · Cited by 79 · cited 1×
“Concerning the number of days spent using apps, Kenny et al. reported that on average, participants used the app on 4 out of 7 days in their study; they examined the efficacy of an emotional self-monitoring app [51].”
Digital Technologies in the Treatment of Anxiety: Recent Innovations and Future Directions
Firth, J., Torous, J., Carney, R., Newby, J., Cosco, T. D., Christensen, H., & Sarris, J. (2018) · Current Psychiatry Reports · doi:10.1007/s11920-018-0910-2 · Cited by 70
Capon, H., Hall, W., Fry, C., & Carter, A. (2016) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2016.05.013 · Cited by 62
Stigma in Canada: Results from a Rapid Response Survey
Stuart, H., Patten, S. B., Koller, M., Modgill, G., & Liinamaa, T. (2014) · The Canadian Journal of Psychiatry · doi:10.1177/070674371405901s07 · Cited by 56
Holmes, E. (1964) · BMJ · doi:10.1136/bmj.1.5380.439-a · Cited by 47
Auerbach, R. P., Alonso, J., Axinn, W. G., Cuijpers, P. J., Ebert, D. D., Green, J. G., Hwang, I., Kessler, R. C., Liu, H., Mortier, P., et al. (2017) · Psychological Medicine · doi:10.1017/s0033291717001039 · Cited by 44
Powell, L., Parker, J., & Harpin, V. (2018) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-017-1092-x · Cited by 43
Geyer, E. C., Fua, K. C., Daniel, K. E., Chow, P. I., Bonelli, W., Huang, Y., Barnes, L. E., & Teachman, B. A. (2018) · Behavior Therapy · doi:10.1016/j.beth.2018.07.009 · Cited by 34 · cited 1×
“Geyer et al. also developed an app for college students to examine how emotional ratings during social interactions later predicted the perceptions of those interactions from the viewpoint of social anxiety [34]; however, this was also an observational study.”
Fushimi, M., Saito, S., & Shimizu, T. (2012) · Community Mental Health Journal · doi:10.1007/s10597-012-9542-x · Cited by 32
Mental health status among Japanese medical students: a cross-sectional survey of 20 universities.
Ohtsu, T., Kaneita, Y., Osaki, Y., Kokaze, A., Ochiai, H., Shirasawa, T., Nanri, H., & Ohida, T. (2014) · PubMed · doi:10.18926/amo/53022 · Cited by 15 · cited 1×
“Ohtsu et al. evaluated the mental health status of 1,619 medical students and found the mean ( ± SD) score of male students to be 3.00 ( ± 2.94) and that of female students to be 3.82 ( ± 3.10) [46].”
InfluentialKobayashi, K., Kobayashi, R., Kubo, S., Sonoda, T., & Mori, M. (2005) · PubMed · Cited by 6
Research works printed but not linked: 2
- K Kajitani, 2018, Development and experimental study of mental health app for University students: Improving the app through log analysis and questionnaire, J Health Sci, 40, 33
- S Shimotsu, 2006, Reliability and validity of the link’s devaluation-discrimination scale, Jpn J Psychiatr Treat, 21, 521
Cited by
Oti, O., & Pitt, I. J. (2021) · Internet Interventions · doi:10.1016/j.invent.2021.100468 · Cited by 80
Bear, H. A., Ayala Nunes, L., DeJesus, J., Liverpool, S., Moltrecht, B., Neelakantan, L., Harriss, E., Watkins, E., & Fazel, M. (2022) · Journal of Medical Internet Research · doi:10.2196/40347 · Cited by 51
Taylor, M. E., Liu, M., Abelson, S., Eisenberg, D., Lipson, S. K., & Schueller, S. M. (2024) · Current Psychiatry Reports · doi:10.1007/s11920-024-01545-w · Cited by 54
Conley, C. S., Raposa, E. B., Bartolotta, K., Broner, S. E., Hareli, M., Forbes, N., Christensen, K. M., & Assink, M. (2022) · JMIR Mental Health · doi:10.2196/34254 · Cited by 63
“Our sample also included 3 mTDIs that did not specify a guiding theoretical framework [154,166,171], and collectively, they did not significantly differ from zero in their impact on youth outcomes.”
BackgroundUnderstanding Mobile Health and Youth Mental Health: Scoping Review
Ding, X., Wuerth, K., Sakakibara, B., Schmidt, J., Parde, N., Holsti, L., & Barbic, S. (2023) · JMIR mHealth and uHealth · doi:10.2196/44951 · Cited by 30
“Current youth mHealth research often engages youths by asking for feedback in a survey or interview to test usability, feasibility, and acceptability [31,70,71], or by including young users as participants in experiments to evaluate the effectiveness and efficiency of an intervention.”
Metadata
- Authors
- Kajitani, K., Higashijima, I., Kaneko, K., Matsushita, T., Fukumori, H., & Kim, D.
- Affiliations
- Kyushu University (JP)
- Corresponding author
- Kajitani, Kosuke
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-09-25
- Volume
- 15
- Issue
- 9
- Pages
- e0239592
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W3088347366
- Semantic Scholar
- 66b430c601b0bb062fa77df719f8d238f1c0d5b4
- Cited by
- 22
- References
- 52
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 4 · 2023: 4 · 2022: 5 · 2021: 4
- FWCI
- 2.81
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- the Japan Society for the Promotion of Science KAKENHI (16K13031)
- Health Science Center (2018-1)
- Qdai-jump Research Program (28314)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Sociology and Political Science › Impact of Technology on Adolescents
- Keywords
- mobile application, mental health, university students, self-monitoring, user-centered design, depression, mental health stigma, health status, digital mental health interventions, app usage behavior
- MeSH terms
- Smartphone, Adult, Female, Humans, Male, Mental Health, Pilot Projects, Surveys and Questionnaires, Students, Universities, Young Adult, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.