Evaluation of the Effectiveness of Mobile App-Based Stress-Management Program: A Randomized Controlled Trial
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Improving mental healthcare using mobile apps might be an effective way to increase interest in mental health and respond to the demand for better psychological health. However, few studies have investigated the effectiveness of app-based stress-management programs. This study aimed to assess the efficacy of an app-based stress-management program. A non-equivalent comparison group pretest-posttest design was used. Participants were randomized into the experimental (n = 26) and control (n = 30) groups. The experimental group used an application developed for workers for four weeks. The results indicated that stress, emotional labor, self-efficacy, and well-being were significantly different in the experimental group, but the control group’s average scores did not change significantly. On average, the Perceived Stress Scale scores decreased by 1.5 points (p = 0.035) and the Korean Occupational Stress Scale scores decreased by 0.87 points (p = 0.4). However, depression and anxiety were not significantly different. Emotional labor decreased by 0.16 points (p = 0.027), and well-being and self-efficacy mean scores increased by 0.492 (p = 0.005) and 0.162 (p = 0.025), respectively. These findings support the developed application’s value for promoting mental health and healthy lifestyles. Further research and supplementation are needed for the application’s sustainability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Finally, effectiveness and feasibility of support in severe medical or psychological cases were questioned [33, 43, 56].”
From Advantages and disadvantages of mobile applications for workplace health promotion: A scoping review (2024) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Visualisation and self-monitoring, which often go hand-in-hand, also were identified as advantages in the literature on technology use in WHP [9, 33, 38, 47, 48, 53, 54, 56].”
From Advantages and disadvantages of mobile applications for workplace health promotion: A scoping review (2024) · cites this paper as [33]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Nine studies focussed on nurses or healthcare employees [29, 31, 33, 35, 37, 39, 41, 49, 56].”
From Advantages and disadvantages of mobile applications for workplace health promotion: A scoping review (2024) · cites this paper as [33]
The cited source says what the claim attributes to it.
In the citing paper
“One such study, by Hwang et al. (2019), found significant changes in the experimental group in terms of stress, emotional labour, well-being and self-efficacy.”
From Advantages and disadvantages of mobile applications for workplace health promotion: A scoping review (2024) · cites this paper as Hwang et al. (2019)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
A Global Measure of Perceived Stress
Cohen, S., Kamarck, T., & Mermelstein, R. (1983) · Journal of Health and Social Behavior · doi:10.2307/2136404 · Cited by 32,807 · cited 6×
“Perceived Stress and Job Stress A modified version of the Perceived Stress Scale (PSS) developed by Cohen et al. assessed self-awareness of stress (PSS-10) [17].”
InfluentialA Brief Measure for Assessing Generalized Anxiety Disorder: The GAD-7
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1092 · Cited by 31,765
Generation of stress in the course of unipolar depression.
Hammen, C. (1991) · Journal of Abnormal Psychology · doi:10.1037//0021-843x.100.4.555 · Cited by 1,446 · cited 1×
“In both stress-generation models [35], the increase in stress is related to the increase in depression, so it is important to manage them mutually.”
BackgroundmHealth for mental health: Integrating smartphone technology in behavioral healthcare.
Luxton, D. D., McCann, R. A., Bush, N. E., Mishkind, M. C., & Reger, G. M. (2011) · Professional Psychology: Research and Practice · doi:10.1037/a0024485 · Cited by 809 · cited 2×
“Consumers (patients) and healthcare providers can use apps without the limitations of time or space, and mental health apps could provide healthcare services for many problems, including depression, anxiety, and addiction, based on the WHO’s definition of mental health, which is “the status of being able to deal with…”
BackgroundThe Anxiety‐ and Pain‐Reducing Effects of Music Interventions: A Systematic Review
Nilsson, U. (2008) · AORN Journal · doi:10.1016/j.aorn.2007.09.013 · Cited by 766 · cited 1×
“Then, real-time observations of change and mental health were possible [32].”
BackgroundMobile medical and health apps: state of the art, concerns, regulatory control and certification
Kamel Boulos, M. N., Brewer, A. C., Karimkhani, C., Buller, D. B., & Dellavalle, R. P. (2014) · Online Journal of Public Health Informatics · doi:10.5210/ojphi.v5i3.4814 · Cited by 659 · cited 1×
“In response to this phenomenon, demand for mental healthcare using mobile communications and social networking technologies have increased [3,4].”
BackgroundEmpirical Studies on Usability of mHealth Apps: A Systematic Literature Review
Zapata, B. C., Fernández-Alemán, J. L., Idri, A., & Toval, A. (2015) · Journal of Medical Systems · doi:10.1007/s10916-014-0182-2 · Cited by 585 · cited 1×
“These apps have two important benefits: convenience and usefulness [12,13].”
BackgroundTam, C., Santos, D., & Oliveira, T. (2020) · Information Systems Frontiers · doi:10.1007/s10796-018-9864-5 · Cited by 567 · cited 1×
“Some previous studies found that using health-related apps directly related to satisfaction with and continued use of the apps [44,45].”
BackgroundDeveloping an Occupational Stress Scale for Korean Employees
Chang, S. J., Koh, S. B., Kang, D., Kim, S. A., Kang, M. G., Lee, C. G., Chung, J. J., Cho, J. J., Son, M., Chae, C. H., et al. (2005) · Korean Journal of Occupational and Environmental Medicine · doi:10.35371/kjoem.2005.17.4.297 · Cited by 526 · cited 2×
“The second measure of stress was job stress measured using the Korean Occupation l Stress Scale (KOSS) developed by Korean Occupational Safety and Health Association [18].”
MethodComputer‐Aided Psychotherapy for Anxiety Disorders: A Meta‐Analytic Review
Cuijpers, P., Marks, I. M., van Straten, A., Cavanagh, K., Gega, L., & Andersson, G. (2009) · Cognitive Behaviour Therapy · doi:10.1080/16506070802694776 · Cited by 429
Mobile Sensing and Support for People With Depression: A Pilot Trial in the Wild
Wahle, F., Kowatsch, T., Fleisch, E., Rufer, M., & Weidt, S. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.5960 · Cited by 333 · cited 1×
“However, some previous studies have found that results using the PHQ-9 to measure depression administered via mobile apps were more convenient for analysis than using the conventional PHQ-9 administration, and they were better at evaluating suicide or attempted suicide [37].”
ResultA Systematic Review of Cognitive Behavioral Therapy and Behavioral Activation Apps for Depression
Huguet, A., Rao, S., McGrath, P. J., Wozney, L., Wheaton, M., Conrod, J., & Rozario, S. (2016) · PLOS ONE · doi:10.1371/journal.pone.0154248 · Cited by 328 · cited 1×
“pointed out problems with treating depression using just remote treatment with mobile apps [39].”
BackgroundEffects of Brief and Sham Mindfulness Meditation on Mood and Cardiovascular Variables
Zeidan, F., Johnson, S. K., Gordon, N. S., & Goolkasian, P. (2010) · The Journal of Alternative and Complementary Medicine · doi:10.1089/acm.2009.0321 · Cited by 319
Finding a Depression App: A Review and Content Analysis of the Depression App Marketplace
Shen, N., Levitan, M.-J., Johnson, A., Bender, J. L., Hamilton-Page, M., Jadad, A. (. R., & Wiljer, D. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3713 · Cited by 282 · cited 1×
“Mobile mental health apps might be a very effective approach because they help identify people who need mental health services while protecting personal data [38].”
BackgroundPursuing happiness in everyday life: The characteristics and behaviors of online happiness seekers.
Parks, A. C., Della Porta, M. D., Pierce, R. S., Zilca, R., & Lyubomirsky, S. (2012) · Emotion · doi:10.1037/a0028587 · Cited by 263 · cited 1×
“The previous study found that happiness was improved after using the mobile app program, which possibly improved well-being [41].”
Stress, anxiety and coping: The multidimensional interaction model.
Endler, N. S. (1997) · Canadian Psychology / Psychologie canadienne · doi:10.1037/0708-5591.38.3.136 · Cited by 213
Ahtinen, A., Mattila, E., Välkkynen, P., Kaipainen, K., Vanhala, T., Ermes, M., Sairanen, E., Myllymäki, T., & Lappalainen, R. (2013) · JMIR mhealth and uhealth · doi:10.2196/mhealth.2596 · Cited by 173 · cited 1×
“pointed out that an app positively influenced the treatment of stress and improved the quality of life, which was similar to our overall results [33].”
ResultCole, D. A., Nolen-Hoeksema, S., Girgus, J., & Paul, G. (2006) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.115.1.40 · Cited by 170 · cited 1×
“However, the stress exposure model, the perspective that stress causes depression, and the situations in which the individual’s depressive symptoms and behaviors become stressful, are self-perpetuating, which in turn causes depression [27].”
BackgroundPisaniello, S. L., Winefield, H. R., & Delfabbro, P. (2012) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2012.01.015 · Cited by 162 · cited 1×
“found that emotional labor had a strong influence on health at the workplace and an impact on job satisfaction [40].”
BackgroundSchwarzer, R., Born, A., Iwawaki, S., Lee, Y.-M., Saito, E., & Yue, X. (1997) · Psychologica · Cited by 145
App-based psychological interventions: friend or foe?
Leigh, S., & Flatt, S. (2015) · Evidence Based Mental Health · doi:10.1136/eb-2015-102203 · Cited by 140 · cited 1×
“Demands for high-quality mental health have increased along with interest in mental health [1,2].”
BackgroundSelf-help stress management training through mobile phones: An experience with oncology nurses
Villani, D., Grassi, A., Cognetta, C., Toniolo, D., Cipresso, P., & Riva, G. (2013) · Psychological Services · doi:10.1037/a0026459 · Cited by 129
Carissoli, C., Villani, D., & Riva, G. (2015) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2014.0062 · Cited by 118 · cited 1×
“An interest in mobile mental health apps for well-being is growing in light of the many mobile physical healthcare apps becoming available [25].”
BackgroundMobile Tele-Mental Health: Increasing Applications and a Move to Hybrid Models of Care
Chan, S., Torous, J., Hinton, L., & Yellowlees, P. (2014) · Healthcare · doi:10.3390/healthcare2020220 · Cited by 108 · cited 3×
“1 [15] program, and 27 participants in both experimental and control groups were required, calculated using the effect size of 0.”
BackgroundMethodInfluentialDoes Interactive Media Enhance the Management of Stress? Suggestions from a Controlled Study
Villani, D., & Riva, G. (2012) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2011.0141 · Cited by 76
Lee, K. H., & Song, J. S. (2010) · Journal of Korean Academy of Nursing Administration · doi:10.11111/jkana.2010.16.1.17 · Cited by 68 · cited 1×
“In addition, Lee and Yu showed that job stress had an inverse correlation with self-efficacy, and higher job stress showed lower self-efficacy [42,43].”
BackgroundInternational Classification of Diseases (WHO)
Marín, J. R. (2004) · Elsevier eBooks · doi:10.1016/b0-12-657410-3/00144-6 · Cited by 34
Evidence-Based Protocol: Elderly Suicide - Secondary Prevention
Holkup, P. A. (2003) · Journal of Gerontological Nursing · doi:10.3928/0098-9134-20030601-05 · Cited by 28
Psychological Factors Influencing Continuous Use of Mobile Healthcare Applications
Lee, L.-S., Lee, S.-H., Jeong, J.-S., & Noh, K.-Y. (2017) · Journal of Digital Convergence · doi:10.14400/jdc.2017.15.7.445 · Cited by 17 · cited 1×
“found that the app would be useful when the users find it enjoyable, which would be likely to increase the amount of usage [46].”
BackgroundValidation of the Korean Version of the Emotional Labor Scale (ELS)
Lee, J.-E., 홍현기, Lee, I., & 한은미 (2016) · Korean Journal of Health Psychology · doi:10.17315/kjhp.2016.21.1.012 · Cited by 15
Park, D.-J., Choi, J., & Kim, D.-J. (2015) · Journal of Digital Convergence · doi:10.14400/jdc.2015.13.7.137 · Cited by 12 · cited 1×
“Some previous studies found that using health-related apps directly related to satisfaction with and continued use of the apps [44,45].”
BackgroundHwang, W. J., Kim, J. A., & Rankin, S. H. (2017) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph14121465 · Cited by 11 · cited 1×
“3%) reported that that they recognized the need for help from specialists, but had problems visiting or using the services [11].”
BackgroundSelf-citationAn, S., & Lee, H. (2018) · Korean Journal of Journalism & Communication Studies · doi:10.20879/kjjcs.2018.62.6.006 · Cited by 8
A Meta-Analysis on the Effect of the Workplace Stress Management Program
왕은자, 홍희정, & 전민아 (2016) · Korea Journal of Counseling · doi:10.15703/kjc.17.5.201610.487 · Cited by 7
Yu, S., & Suh, E. E. (2019) · Korean Journal of Adult Nursing · doi:10.7475/kjan.2019.31.3.303 · Cited by 6 · cited 1×
“In addition, Lee and Yu showed that job stress had an inverse correlation with self-efficacy, and higher job stress showed lower self-efficacy [42,43].”
BackgroundHee, K. K., & Jae, S. K. (2018) · Korean Journal of Journalism & Communication Studies · Cited by 1
Research works printed but not linked: 3
- Song S.-M. Stress Management: Health Consequences and Policy Implications Korea Health Promot. Forum 2017 4 4 17
- Jina J. Min-Hee L. Jin-Ho K. Recent Changes in Mental Health Policy in Korea Health Welf. Forum 2017 246 51 63
- Bech P. Measuring the dimension of psychological general well-being by the WHO-5 Qual. Life Newsl. 2004 32 15 16
Cited by
Eisenstadt, M., Liverpool, S., Infanti, E., Ciuvat, R. M., & Carlsson, C. (2021) · JMIR Mental Health · doi:10.2196/31170 · Cited by 182
“Two studies were judged as outliers [71,88].”
Gkintoni, E., Vantaraki, F., Skoulidi, C., Anastassopoulos, P., & Vantarakis, A. (2024) · Behavioral Sciences · doi:10.3390/bs14020102 · Cited by 137
“Privacy and data security are also crucial considerations, particularly when personal data are used in gamified applications [23].”
BackgroundInfluentialAdam, D., Berschick, J., Schiele, J. K., Bogdanski, M., Schröter, M., Steinmetz, M., Koch, A. K., Sehouli, J., Reschke, S., Stritter, W., et al. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1231266 · Cited by 102
Velana, M., & Rinkenauer, G. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.708696 · Cited by 97
Almuqrin, A., Hammoud, R., Terbagou, I., Tognin, S., & Mechelli, A. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-093932 · Cited by 61
Metadata
- Authors
- Hwang, W. J., & Jo, H. H.
- Affiliations
- Kyung Hee University (KR)
- Corresponding author
- Jo, Hyun Hee
- Venue
- International Journal of Environmental Research and Public Health
- Publisher
- MDPI AG
- Published
- 2019-11-03
- Volume
- 16
- Issue
- 21
- Pages
- 4270
- ISSN
- 1660-4601 (ISSN-L)
- PMC
- PMC6862035
- OpenAlex
- W2987507606
- Cited by
- 86
- References
- 37
- Citations by year
- 2026: 7 · 2025: 9 · 2024: 17 · 2023: 12 · 2022: 19 · 2021: 21 · 2020: 1
- FWCI
- 11.58
- Type
- journal article
- Language
- en
- Open access
- gold
- dx.doi.org
- Licence
- Locations
- International Journal of Environmental Research and Public Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Korea Health Industry Development Institute (HI18C1317)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Clinical Psychology › Mindfulness and Compassion Interventions
- Keywords
- mobile application, stress management, occupational stress, emotional labor, self-efficacy, well-being, mental health promotion, workers, depression, anxiety, Perceived Stress Scale, Korean Occupational Stress Scale
- MeSH terms
- Occupational Stress, Anxiety, Depression, Feasibility Studies, Health Promotion, Humans, Mental Health, Mental Health Services, Stress, Psychological, Republic of Korea, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


