Applications of Machine Learning in Real-Life Digital Health Interventions: Review of the Literature
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Machine learning has attracted considerable research interest toward developing smart digital health interventions. These interventions have the potential to revolutionize health care and lead to substantial outcomes for patients and medical professionals. OBJECTIVE: Our objective was to review the literature on applications of machine learning in real-life digital health interventions, aiming to improve the understanding of researchers, clinicians, engineers, and policy makers in developing robust and impactful data-driven interventions in the health care domain. METHODS: We searched the PubMed and Scopus bibliographic databases with terms related to machine learning, to identify real-life studies of digital health interventions incorporating machine learning algorithms. We grouped those interventions according to their target (ie, target condition), study design, number of enrolled participants, follow-up duration, primary outcome and whether this had been statistically significant, machine learning algorithms used in the intervention, and outcome of the algorithms (eg, prediction). RESULTS: Our literature search identified 8 interventions incorporating machine learning in a real-life research setting, of which 3 (37%) were evaluated in a randomized controlled trial and 5 (63%) in a pilot or experimental single-group study. The interventions targeted depression prediction and management, speech recognition for people with speech disabilities, self-efficacy for weight loss, detection of changes in biopsychosocial condition of patients with multiple morbidity, stress management, treatment of phantom limb pain, smoking cessation, and personalized nutrition based on glycemic response. The average number of enrolled participants in the studies was 71 (range 8-214), and the average follow-up study duration was 69 days (range 3-180). Of the 8 interventions, 6 (75%) showed statistical significance (at the P=.05 level) in health outcomes. CONCLUSIONS: This review found that digital health interventions incorporating machine learning algorithms in real-life studies can be useful and effective. Given the low number of studies identified in this review and that they did not follow a rigorous machine learning evaluation methodology, we urge the research community to conduct further studies in intervention settings following evaluation principles and demonstrating the potential of machine learning in clinical practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042 · cited 1×
“The systematic review was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [19].”
Wang, G., Ma, R., Qiao, G., Wada, K., Aizawa, Y., & Satoh, T. (2015) · Integrative Medicine International · doi:10.1159/000368408 · Cited by 18,657
Comparison of PubMed, Scopus, Web of Science, and Google Scholar: strengths and weaknesses
Falagas, M. E., Pitsouni, E. I., Malietzis, G. A., & Pappas, G. (2008) · The FASEB Journal · doi:10.1096/fj.07-9492lsf · Cited by 5,039
Self-management education: History, definition, outcomes, and mechanisms
Lorig, K. R., & Holman, H. R. (2003) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2601_01 · Cited by 4,094 · cited 1×
“These studies also demonstrated the latest efforts to promote individuals’ personalized self-management and to put them at the center of health care [38].”
BackgroundPredicting the future - big data, machine learning, and clinical medicine
Obermeyer, Z., & Emanuel, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmp1606181 · Cited by 3,652 · cited 1×
“With the advent of new tools and algorithms for machine learning, a new class of smart digital health interventions can be developed, which could revolutionize effective health care delivery [5].”
BackgroundPersonalized nutrition by prediction of glycemic responses
Zeevi, D., Korem, T., Zmora, N., Israeli, D., Rothschild, D., Weinberger, A., Ben-Yacov, O., Lador, D., Avnit-Sagi, T., Lotan-Pompan, M., et al. (2015) · Cell · doi:10.1016/j.cell.2015.11.001 · Cited by 2,929 · cited 8×
“In this context, the retrospective validation of algorithms and models, given the availability of one or more datasets, constitutes only the first step in the evaluation process [28].”
InfluentialDoes tailoring matter? Meta-analytic review of tailored print health behavior change interventions
Noar, S. M., Benac, C. N., & Harris, M. S. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.4.673 · Cited by 2,136 · cited 1×
“Considering the effectiveness of tailored messaging in influencing health behavior change [39], further research in this area is warranted.”
Blundell, J. E., Baker, J. L., Boyland, E., Blaak, E., Charzewska, J., de Henauw, S., Frühbeck, G., Gonzalez-Gross, M., Hebebrand, J., Holm, L., et al. (2017) · Obesity Facts · doi:10.1159/000455952 · Cited by 1,945
Miotto, R., Li, L., Kidd, B. A., & Dudley, J. T. (2016) · Scientific Reports · doi:10.1038/srep26094 · Cited by 1,710
Research works printed but not linked: 2
- Cruz, JA, 2007, Cancer Inform, 2, 59
- 2016, Monitoring and Evaluating Digital Health Interventions: A Practical Guide to Conducting Research and Assessment
Cited by
Muehlematter, U. J., Daniore, P., & Vokinger, K. N. (2021) · The Lancet Digital Health · doi:10.1016/s2589-7500(20)30292-2 · Cited by 665
Role of Artificial Intelligence Applications in Real-Life Clinical Practice: Systematic Review
Yin, J., Ngiam, K. Y., & Teo, H. H. (2021) · Journal of Medical Internet Research · doi:10.2196/25759 · Cited by 419
“In particular, AI applications have been applied to uncover information from clinical data and assist health care providers in a wide range of clinical tasks, such as disease diagnosis, triage or screening, risk analysis, and surgical operations [1-4].”
BackgroundGórriz, J. M., Ramírez, J., Ortíz, A., Martínez-Murcia, F. J., Segovia, F., Suckling, J., Leming, M., Zhang, Y.-D., Álvarez-Sánchez, J. R., Bologna, G., et al. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.05.078 · Cited by 319
“shown in section 10, allows for the translation of research output into interventions to make a difference in clinical practice [12, 13].”
BackgroundSelf-citationArtificial intelligence in healthcare: opportunities and risk for future
Sunarti, S., Fadzlul Rahman, F., Naufal, M., Risky, M., Febriyanto, K., & Masnina, R. (2021) · Gaceta Sanitaria · doi:10.1016/j.gaceta.2020.12.019 · Cited by 274
Machine learning and algorithmic fairness in public and population health
Mhasawade, V., Zhao, Y., & Chunara, R. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-021-00373-4 · Cited by 218
Artificial Intelligence in Food Safety: A Decade Review and Bibliometric Analysis
Liu, Z., Wang, S., Zhang, Y., Feng, Y., Liu, J., & Zhu, H. (2023) · Foods · doi:10.3390/foods12061242 · Cited by 172
“Dietary monitoring systems based on ML methods even could automatically assess dietary intake [44,113].”
BackgroundSwed, S., Alibrahim, H., Elkalagi, N. K. H., Nasif, M. N., Rais, M. A., Nashwan, A. J., Aljabali, A., Elsayed, M., Sawaf, B., Albuni, M. K., et al. (2022) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2022.1011524 · Cited by 185
“However, machine learning use in low-resource countries has remained comparatively slight (Wahl et al., 2018; Triantafyllidis and Tsanas, 2019).”
BackgroundBickman, L. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01065-8 · Cited by 184
“Triantafyllidis and Tsanas (2019) conducted a literature review of pragmatic evaluations of nonpharmacological applications of ML in real-life health interventions from January 2008 through November 2018, following PRISMA guidelines.”
BackgroundDiscovering topics and trends in the field of Artificial Intelligence: Using LDA topic modeling
Yu, D., & Xiang, B. (2023) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.120114 · Cited by 171
Machine Learning Techniques in Adaptive and Personalized Systems for Health and Wellness
Oyebode, O., Fowles, J. R., Steeves, D., & Orji, R. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2089085 · Cited by 192
“Other works focus on the effectiveness of digital interventions aided by ML algorithms without investigating for personalization (Triantafyllidis & Tsanas, 2019) or discuss ML-based disease profiling and personalized treatments for specific diseases only (Buettner et al., 2020).”
BackgroundAdly, A. S., Adly, A. S., & Adly, M. S. (2020) · Journal of Medical Internet Research · doi:10.2196/19104 · Cited by 138
“It is assumed that the accuracy of the achieved results will increase with increasing availability of processing power and data because it is desirable to perform machine learning using real-time data [52,53].”
BackgroundUsing artificial intelligence to improve pain assessment and pain management: a scoping review
Zhang, M., Zhu, L., Lin, S., Herr, K., Chi, C., Demir, İ., Lopez, K. D., & Chi, N. (2022) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocac231 · Cited by 146
Mazzetto, S. (2024) · Heritage · doi:10.3390/heritage7110300 · Cited by 157
Zhou, Q., Chen, Z.-H., Cao, Y.-H., & Peng, S. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00524-2 · Cited by 126
“In recent 2 years, a few studies have been published to review the current situation of AI-based interventional studies from RCTs to evaluate its effectiveness, quality, and methodology 11,38,39 .”
BackgroundMethodResultInfluentialImplementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework
van der Vegt, A. H., Scott, I. A., Dermawan, K., Schnetler, R. J., Kalke, V. R., & Lane, P. J. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad088 · Cited by 109
“Phases: (1) Choosing the right problem; (2) Developing a useful solution; (3) Considering ethical implications; (4) Rigorously evaluating the model; (5) Reporting results; (6) Deploying responsibly; (7) Making it to market 5 Assadi et al 2022,(60) Canada Source: Narrative review and expert consensus, based on systems…”
BackgroundMethodInfluentialSilva, K. D., Lee, W. K., Forbes, A., Demmer, R. T., Barton, C., & Enticott, J. (2020) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2020.104268 · Cited by 108
Success Factors of Artificial Intelligence Implementation in Healthcare
Wolff, J., Pauling, J., Keck, A., & Baumbach, J. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.594971 · Cited by 104
“However, the ones identified and analyzed were useful and effective (6).”
BackgroundTriantafyllidis, A., Kondylakis, H., Votis, K., Tzovaras, D., Maglaveras, N., & Rahimi, K. (2019) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2019.103984 · Cited by 98
“In this context, more studies would be needed to compare the efficacy between computerized goal setting alone (e.g., through rule-based [62] or machine learning approaches [63]) and collaborative goal setting with health professionals [64].”
BackgroundSelf-citationAguilera, A., Figueroa, C. A., Hernandez-Ramos, R., Sarkar, U., Cemballi, A. G., Pathak, L. E., Miramontes, J., Yom‐Tov, E., Chakraborty, B., Yan, X., et al. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-034723 · Cited by 110
Radiomics: a primer on high-throughput image phenotyping
Lafata, K. J., Wang, Y., Konkel, B., Yin, F.-F., & Bashir, M. R. (2021) · Abdominal Radiology · doi:10.1007/s00261-021-03254-x · Cited by 102
Cresswell, K., Callaghan, M., Khan, S., Sheikh, Z., Mozaffar, H., & Sheikh, A. (2020) · Health Informatics Journal · doi:10.1177/1460458219900452 · Cited by 87
“4,5 These systems are designed to emulate human performance typically by analysing large complex data sets.”
BackgroundApplications of Artificial Intelligence to Obesity Research: Scoping Review of Methodologies
An, R., Shen, J., & Xiao, Y. (2022) · Journal of Medical Internet Research · doi:10.2196/40589 · Cited by 99
“They found preliminary but promising evidence regarding the effectiveness of AI-powered tools in decision support and digital health interventions [22-24].”
Deep Learning Reader for Visually Impaired
Ganesan, J., Azar, A. T., Alsenan, S. A., Kamal, N. A., Qureshi, B., & Hassanien, A. E. (2022) · Electronics · doi:10.3390/electronics11203335 · Cited by 98
“Researchers are leveraging such advancements to continuously improve human quality of life, especially those with disabilities or alarming health conditions [1].”
BackgroundOr, C. K., Liu, K., So, M. K. P., Cheung, B., Yam, L. Y. C., Tiwari, A., Lau, Y. F. E., Lau, T., Hui, P. S. G., Cheng, H. C., et al. (2020) · Journal of Medical Internet Research · doi:10.2196/16769 · Cited by 72
“The increasing and increasingly successful applications of AI to health care point to a potentially fruitful direction for TSN paradigm development [41-44].”
BackgroundPatient Perspectives on AI for Mental Health Care: Cross-Sectional Survey Study
Benda, N. C., Desai, P., Reza, Z., Zheng, A., Kumar, S., Harkins, S., Hermann, A. D., Zhang, Y., Joly, R., Kim, J., et al. (2024) · JMIR Mental Health · doi:10.2196/58462 · Cited by 90
Mohsin, M., Ali, S. A., Shamim, S. K., & Ahmad, A. (2022) · Environmental Science and Pollution Research · doi:10.1007/s11356-021-17961-x · Cited by 72
Susanto, A. P., Lyell, D., Widyantoro, B., Berkovsky, S., & Magrabi, F. (2023) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocad180 · Cited by 52
Recent Advances in Artificial Intelligence and Wearable Sensors in Healthcare Delivery
Junaid, S. B., Imam, A. A., Abdulkarim, M., Surakat, Y. A., Balogun, A. O., Kumar, G., Shuaibu, A. N., Garba, A., Sahalu, Y., Mohammed, A., et al. (2022) · Applied Sciences · doi:10.3390/app122010271 · Cited by 65
Triantafyllidis, A. K., Polychronidou, E., Alexiadis, A., Rocha, C., Oliveira, D. N., da Silva, A. S., Freire, A. L., Macedo, C., Sousa, I. F., Werbet, E., et al. (2020) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2020.101844 · Cited by 65
Self-citationPreti, L. M., Ardito, V., Compagni, A., Petracca, F., & Cappellaro, G. (2024) · Journal of Medical Internet Research · doi:10.2196/55897 · Cited by 62
“Available studies have primarily focused on the quantitative impact of ML algorithms on health outcomes or accuracy, without examining the corresponding implementation processes [20].”
Machine Learning Techniques to Identify Antimicrobial Resistance in the Intensive Care Unit
Martínez-Agüero, S., Mora-Jiménez, I., Lérida-García, J., Álvarez-Rodríguez, J., & Soguero-Ruíz, C. (2019) · Entropy · doi:10.3390/e21060603 · Cited by 68
“The review of the scientific literature shows the promising results of the use of ML techniques in the healthcare domain [30], and specifically in the analysis of antimicrobial resistance [20,21,31–33].”
BackgroundOwais, M., Arsalan, M., Mahmood, T., Kim, Y. H., & Park, K. R. (2020) · JMIR Medical Informatics · doi:10.2196/21790 · Cited by 65
Selecting an appropriate machine-learning model for perovskite solar cell datasets
Salah, M. M., Ismail, Z. S., & Abdellatif, S. O. (2023) · Materials for Renewable and Sustainable Energy · doi:10.1007/s40243-023-00239-2 · Cited by 66
“With the increasing availability of large amounts of data and powerful computing resources, machine learning is becoming an increasingly important tool in healthcare, finance, and e-commerce [23].”
Artificial Intelligence Accelerated Transformation in The Healthcare Industry
Kaushik, P. (2023) · Amity Journal of Professional Practices · doi:10.55054/ajpp.v3i01.630 · Cited by 57
Salazar-Reyna, R., Aleu, F. G., Gutiérrez, E. M. A. G., Díaz-Ramírez, J., Garza‐Reyes, J. A., & Kumar, A. (2020) · Management Decision · doi:10.1108/md-01-2020-0035 · Cited by 63
Deep Learning in mHealth for Cardiovascular Disease, Diabetes, and Cancer: Systematic Review
Triantafyllidis, A. K., Kondylakis, H., Katehakis, D. G., Kouroubali, A., Koumakis, L., Marias, K., Alexiadis, A., Votis, K., & Tzovaras, D. K. (2022) · JMIR mhealth and uhealth · doi:10.2196/32344 · Cited by 67
“Other reviews have been broad [8,12], not closely related to mHealth [11,13], or not focused on major chronic diseases with the largest prevalence worldwide [14].”
BackgroundSelf-citationTsanas, A., Little, M. A., & Ramig, L. O. (2021) · IEEE Access · doi:10.1109/access.2021.3050524 · Cited by 60
“As we reported recently through a systematic review, there are relatively few paradigms where research findings are translated into digital health interventions to benefit patients [65].”
BackgroundSelf-citationThe role of digital transformation in improving the efficacy of healthcare: A systematic review
Dionisio, M. A., de Souza, S. J., Paula, F. D. O., & Pellanda, P. C. (2022) · The Journal of High Technology Management Research · doi:10.1016/j.hitech.2022.100442 · Cited by 54
Privacy-preserving federated machine learning on FAIR health data: A real-world application
Sınacı, A. A., Gençtürk, M., Álvarez-Romero, C., Ertürkmen, G. B. L., Martínez-García, A., Escalona-Cuaresma, M. J., & Parra-Calderón, C. L. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.02.014 · Cited by 53
“Machine learning algorithms greatly benefit from high-quality health data [10].”
BackgroundGuidelines os the Brazilian Society of Cardiology on Telemedicine in Cardiology - 2019
Lopes, M. A. C. Q., de Oliveira, G. M. M., Ribeiro, A. L. P., Pinto, F. J., Rey, H. C. V., o, A. ́. A. ́. B., Zimerman, L. I., Hajjar, L. A., Rochitte, C. E., Bacal, F., et al. (2019) · Arquivos Brasileiros de Cardiologia · doi:10.5935/abc.20190205 · Cited by 80
Figueroa, C. A., Deliu, N., Chakraborty, B., Modiri, A., Xu, J., Aggarwal, J., Williams, J. J., Lyles, C. R., & Aguilera, A. (2021) · Annals of Behavioral Medicine · doi:10.1093/abm/kaab028 · Cited by 55
“To date, mHealth studies using machine learning methods have shown promise, but the small number of studies impedes a rigorous evaluation [38].”
BackgroundFerrand, J. L., Hockensmith, R., Houghton, R. F., & Buhi, E. R. (2020) · Journal of Medical Internet Research · doi:10.2196/19018 · Cited by 51
“While considerable research has been conducted assessing digital health approaches, such as text message–based approaches and mobile apps for a range of health behaviors [7-9], few have included smart assistant responses to health-related queries.”
BackgroundBang, C. S., Ahn, J. Y., Kim, J.-H., Kim, Y.-I., Choi, I. J., & Shin, W. G. (2021) · Journal of Medical Internet Research · doi:10.2196/25053 · Cited by 46
“This study introduces the good performance of an ML model applied to the prediction of curative resection of U-EGC prior to ESD, suggesting the possibility of a beneficial effect of ML modeling for decision making in this part of clinical practice [22].”
MethodLewkowicz, D., Slosarek, T., Wernicke, S., Winne, A., Wohlbrandt, A. M., & Böttinger, E. P. (2021) · JMIR Rehabilitation and Assistive Technologies · doi:10.2196/26612 · Cited by 46
“Thus, novel add-on personalized decision support interventions provide the possibility of guiding the user through the program and achieving sustainable behavior change through, for instance, tailored feedback messages, push notifications, and data-driven activity recommendations [8].”
BackgroundMontano, I. H., Marques, G., Alonso, S. G., López-Coronado, M., & Díez, I. D. L. T. (2020) · Journal of Medical Systems · doi:10.1007/s10916-020-01626-2 · Cited by 43
“Furthermore, numerous healthcare applications have been designed using distinct machine learning algorithms to solve regression and classification problems with relevant accuracy rate [17, 18].”
A review on multimodal machine learning in medical diagnostics
Yan, K., Li, T., Marques, J. A. L., Gao, J. T., & Fong, S. J. (2023) · Mathematical Biosciences & Engineering · doi:10.3934/mbe.2023382 · Cited by 42
(2021) · doi:10.2196/24127 · Cited by 40
“This resonates with the findings of a recent review on AI clinical interventions in the context of other long-term conditions, such as depression, weight, nutrition, limb pain, and smoking cessation management [47].”
Detecting depression severity using weighted random forest and oxidative stress biomarkers
Bader, M., Abdelwanis, M., Maalouf, M., & Jelinek, H. F. (2024) · Scientific Reports · doi:10.1038/s41598-024-67251-y · Cited by 46
Abdollahi, J., Nouri-Moghaddam, B., & Ghazanfari, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2103.08182 · Cited by 53
Bucher, A., Blazek, E. S., & Symons, C. T. (2024) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2024.05.007 · Cited by 48
Jiang, F., Zhou, H., & Shen, H. (2022) · Frontiers in Immunology · doi:10.3389/fimmu.2022.925695 · Cited by 40
“ML is particularly important in the identification of the potential biomarkers for the diagnosis and prognosis of human diseases, which is why it is being studied more and more in this sector (13, 14).”
BackgroundAguilera, A., Avalos, M. R. A., Xu, J., Chakraborty, B., Figueroa, C. A., Garcia, F., Rosales, K., Hernandez-Ramos, R., Karr, C. J., Williams, J. J., et al. (2024) · Journal of Medical Internet Research · doi:10.2196/60834 · Cited by 55
Li, B., & Gilbert, S. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01345-9 · Cited by 53
Hurvitz, N., & Ilan, Y. (2023) · Clinics and Practice · doi:10.3390/clinpract13040089 · Cited by 36
Yuan, H. (2024) · Health Care Science · doi:10.1002/hcs2.114 · Cited by 37
“However, external validation using retrospective data, continual monitoring using prospective data, and randomized controlled trials (RCTs) using prospective data are important for the translation of ML models into real ‐ world clinical practice [2].”
MethodCombining Clinical Symptoms and Patient Features for Malaria Diagnosis: Machine Learning Approach
Mariki, M., Mkoba, E. S., & Mduma, N. (2022) · Applied Artificial Intelligence · doi:10.1080/08839514.2022.2031826 · Cited by 39
“…machine learning assisted other areas of the health-care system (Artificial Intelligence in Healthcare: Past, Present and Future, 2017; Davenport and Kalakota 2019; Khare et al. 2017; Shailaja, Seetharamulu, and Jabbar 2018; Sidey-Gibbons and Sidey-Gibbons 2019; Triantafyllidis and Tsanas 2019).”
BackgroundArvidsson, R., Gunnarsson, R. K., Entezarjou, A., Sundemo, D. S., & Wikberg, C. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-086148 · Cited by 36
Özdemir, V. (2019) · OMICS A Journal of Integrative Biology · doi:10.1089/omi.2019.0069 · Cited by 34
“N ew debates have recently emerged on an ‘‘AI turn’’ for digital health (Kerr et al., 2018; Triantafyllidis and Tsanas, 2019).”
Figueroa, C. A., Aguilera, A., Chakraborty, B., Modiri, A., Aggarwal, J., Deliu, N., Sarkar, U., Williams, J. J., & Lyles, C. R. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab001 · Cited by 47
“12 Guidelines for designing and using these algorithms in clinical settings are needed.”
BackgroundScarcity of publicly available oral cancer image datasets for machine learning research
Sengupta, N., Sarode, S. C., Sarode, G. S., & Ghone, U. (2022) · Oral Oncology · doi:10.1016/j.oraloncology.2022.105737 · Cited by 30
Bulaj, G. W., Clark, J. E., Ebrahimi, M., & Bald, E. M. (2021) · Frontiers in Pharmacology · doi:10.3389/fphar.2021.612602 · Cited by 32
Xiao, R., Ding, C., & Hu, X. (2022) · Journal of Imaging · doi:10.3390/jimaging8050120 · Cited by 37
“By leveraging big data analytical tools, particularly machine learning and deep learning, digital health helps shift healthcare toward prevention and the early detection of diseases [5,11,12].”
BackgroundSeguí, F. L., Aguilar, R. A.-E., de Maeztu, G., García‐Altés, A., Cuyàs, F. G., Walsh, S. M., Castro, M. S., & Vidal‐Alaball, J. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17031093 · Cited by 28
“…of changes in the biopsychosocial status of patients with multiple morbidities, stress control, the treatment of phantom limb pain, smoking cessation, personalized nutrition by prediction of glycaemic response, to try to detect signs of depression and in particular for reading medical images [2–6].”
Blood Uric Acid Prediction With Machine Learning: Model Development and Performance Comparison
Sampa, M. B., Hossain, N., Hoque, M. R., Islam, R., Yokota, F., Nishikitani, M., & Ahmed, A. (2020) · JMIR Medical Informatics · doi:10.2196/18331 · Cited by 29
“Machine learning has also been used in the health care field for the prevention, diagnosis, and treatment phases of various diseases such as diabetes, cancer, cardiology, and mental health [29,30].”
MethodUddin, M. S., Rahman, S. M. A., Rahman, M. A., Mia, S., Rahman, M. M., & Refat, M. S. E.-D. (2025) · Journal of Physics and Chemistry of Solids · doi:10.1016/j.jpcs.2025.112622 · Cited by 29
Automatic Assessment of Motor Impairments in Autism Spectrum Disorders: A Systematic Review
Gargot, T., Archambault, D., Chétouani, M., Cohen, D., Johal, W., & Anzalone, S. M. (2022) · Cognitive Computation · doi:10.1007/s12559-021-09940-8 · Cited by 32
Dimeglio, C., Bécouarn, G., Topart, P. A., Bodin, R., Buisson, J. C., & Ritz, P. (2019) · JMIR Medical Informatics · doi:10.2196/13672 · Cited by 26
“A machine learning process added to the application would provide evolutive classifications as the amount of data increases [17-19].”
MethodPelly, M. L., Fatehi, F., Liew, D., & Verdejo‐García, A. (2023) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2023.105041 · Cited by 31
Liu, W., Li, M.-X., Wu, S., Tong, W., Li, A., Sun, B.-L., Liu, Z., & Liu, J. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.922510 · Cited by 25
Rahayu, N. I., Suherman, A., & Muktiarni, M. (2023) · Journal of Advanced Research in Applied Sciences and Engineering Technology · doi:10.37934/araset.32.1.303314 · Cited by 28
History, current status, and future directions of artificial intelligence
Kubassova, O., Shaikh, F., Melus, C., & Mähler, M. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-820239-5.00002-4 · Cited by 38
Liao, P.-C., Chen, M.-S., Jhou, M.-J., Chen, T.-C., Yang, C.-T., & Lu, C.-J. (2022) · Diagnostics · doi:10.3390/diagnostics12081965 · Cited by 21
Shen, H., Hu, Y., Liu, X., Jiang, Z., Ye, H., Takshe, A. A., & Dulaimi, S. H. K. A. (2021) · Results in Physics · doi:10.1016/j.rinp.2021.104368 · Cited by 21
Faro, J. M., Chen, J., Flahive, J., Nagawa, C. S., Orvek, E., Houston, T. K., Allison, J. J., Person, S. D., Smith, B., Blok, A. C., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.50665 · Cited by 23
Kerr, J. I., Naegelin, M., Benk, M., von Wangenheim, F., Meins, E., Viganò, E., & Ferrario, A. (2023) · Journal of Medical Internet Research · doi:10.2196/44131 · Cited by 24
“To enable personalization, digital health interventions often integrate large amounts of health-related data with the help of machine learning (ML; for a review, refer to the study by Triantafyllidis and Tsanas [22]).”
Muniasamy, A., & Karunakaran, G. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-1087-9.ch012 · Cited by 20
Machine learning to predict overall short-term mortality in cutaneous melanoma
Cozzolino, C., Buja, A., Rugge, M., Miatton, A., Zorzi, M., Vecchiato, A., Fiore, P. D., Tropea, S., Brazzale, A. R., Damiani, G. B., et al. (2023) · Discover Oncology · doi:10.1007/s12672-023-00622-5 · Cited by 22
“…architectures, such as Convolutional Neural Networks, which have more parameters to be trained and As reported by Triantafyllidis and Tsanas [56], the incorporation of machine learning into clinical practice requires multiple steps: (1) a retrospective validation of the algorithm on an…”
MethodEiselt, A.-K., Kirkendall, S., Xiong, E., Langner, D., & Goldfarb, M. B. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2025.1713334 · Cited by 21
“Many DHIs operate on siloed, static data architectures that do not support the volume, velocity, or variety of data needed to power adaptive models (50, 206, 207).”
Huang, H.-H., Hsieh, S.-J., Chen, M.-S., Jhou, M.-J., Liu, T.-C., Shen, H.-L., Yang, C.-T., Hung, C.-C., Yu, Y., & Lu, C.-J. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12031220 · Cited by 19
A Wolf in Sheep’s Clothing: Reuse of Routinely Obtained Laboratory Data in Research
Overmars, L. M., Niemantsverdriet, M. S. A., Groenhof, T. K. J., de Groot, M., Hulsbergen-Veelken, C. A. R., van Solinge, W. W., Musson, R. E. A., ten Berg, M. J., Hoefer, I. E., & Haitjema, S. (2022) · Journal of Medical Internet Research · doi:10.2196/40516 · Cited by 19
“Moreover, the continuous increase of computing power and the introduction of new machine learning methods will likely further increase the reuse of the vast amounts of routine laboratory data to further personalize care [3].”
Ojurongbe, T. A., Afolabi, H. A., Bashiru, K. A., Sule, W. F., Akinde, S. B., Ojurongbe, O. D., & Adegoke, N. A. (2023) · Tropical Diseases Travel Medicine and Vaccines · doi:10.1186/s40794-023-00208-7 · Cited by 19
“Numerous studies have demonstrated machine-learning benefits for different healthcare systems [35–38].”
BackgroundImproving hospital readmission prediction using individualized utility analysis
Ko, M., Chen, E., Agrawal, A., Rajpurkar, P., Avati, A., Ng, A., Basu, S., & Shah, N. H. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103826 · Cited by 15
Personalized Dietary Recommendations Using Machine Learning: A Comprehensive Review
Varshney, N., Jadhav, N., Gupta, K., Mate, N. R., Rose, A., & Kumar, P. (2023) · International Conference on Artificial Intelligence for Innovations in Healthcare Industries (ICAIIHI) · doi:10.1109/icaiihi57871.2023.10489126 · Cited by 18
“The study uses a deductive methodology, whereby hypotheses are developed using accepted ideas as well as previous research findings as a basis [14].”
MethodOrganoLabeler: A Quick and Accurate Annotation Tool for Organoid Images
Kahveci, B., Polatlı, E., Baştanlar, Y., & Güven, S. (2024) · ACS Omega · doi:10.1021/acsomega.4c06450 · Cited by 15
Models for the solubility calculation of a CO2/polymer system: A review
Li, M., Zhang, J., Zou, Y., Wang, F., Chen, B., Guan, L., & Yan, W. (2020) · Materials Today Communications · doi:10.1016/j.mtcomm.2020.101277 · Cited by 16
Figueroa, C. A., Hernandez-Ramos, R., Boone, C. E., Pathak, L. E., Yip, V., Luo, T. C., de la Sierra, V. Q., Xu, J., Chakraborty, B., Darrow, S. M., et al. (2020) · JMIR Research Protocols · doi:10.2196/23592 · Cited by 16
“RL algorithms have the potential to greatly contribute to the effectiveness of digital mental health studies as well as to the personalization and tailoring of these studies [36,37].”
Hietbrink, E. A. G., Middelweerd, A., van Empelen, P., Preuhs, K., Konijnendijk, A., Nijeweme-d’Hollosy, W. O., Schrijver, L. K., Laverman, G. D., & Vollenbroek-Hutten, M. M. R. (2023) · JMIR Human Factors · doi:10.2196/40017 · Cited by 17
Allen, B., Neill, D. B., Schell, R. C., Ahern, J., Hallowell, B. D., Krieger, M. S., Jent, V. A., Goedel, W. C., Cartus, A. R., Yedinak, J. L., et al. (2023) · American Journal of Epidemiology · doi:10.1093/aje/kwad119 · Cited by 16
Cruz, M. J., Nieblas‐Bedolla, E., Young, C. C., Feroze, A. H., Williams, J. R., Ellenbogen, R. G., & Levitt, M. R. (2021) · Neurosurgery · doi:10.1093/neuros/nyab185 · Cited by 15
Identifying epilepsy based on machine‐learning technique with diffusion kurtosis tensor
Li, K., Chen, J., Huang, J., Zhang, T., & Xu, J. (2021) · CNS Neuroscience & Therapeutics · doi:10.1111/cns.13773 · Cited by 14
Disordering Datasets: Sociotechnical Misalignments in AI-Mediated Behavioral Health
Mathur, V., Lustig, C., & Kaziunas, E. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555141 · Cited by 22
Dallora, A. L., Kvist, O., Berglund, J. S., Ruiz, S. D., Boldt, M., Flodmark, C.-E., & Anderberg, P. (2020) · JMIR Medical Informatics · doi:10.2196/18846 · Cited by 13
“A technology that is able to work in this setting is machine learning (ML), which is already widely employed in diverse medical fields, such as diabetes, cancer, cardiology, mental health, and the analysis of clinical text data [29,30].”
BackgroundDehbaghi, H. A., & Khoshgard, K. (2025) · International Journal of Emergency Medicine · doi:10.1186/s12245-025-01049-1 · Cited by 21
Yi, S., Zhang, C., Li, M., Qu, T., & Wang, J. (2023) · Discover Oncology · doi:10.1007/s12672-023-00849-2 · Cited by 13
“This strategy may result in the diagnosis of cancer at an earlier stage, which will ultimately lead to improved patient outcomes [13, 14].”
BackgroundThe impact of digital health technologies on pharmacy services and patient care
Alsoweih, H. A., Fageehi, A. A., Hadadi, J. H., Sharahili, I. M., Alsubhi, F. A., & Aljabry, I. S. (2024) · International Journal of Community Medicine and Public Health · doi:10.18203/2394-6040.ijcmph20240954 · Cited by 13
Li, J., Wang, Z., & Wang, T. (2024) · Scientific Reports · doi:10.1038/s41598-024-60068-9 · Cited by 16
Lekkas, D., Price, G. D., McFadden, J. R., & Jacobson, N. C. (2021) · Mindfulness · doi:10.1007/s12671-021-01723-4 · Cited by 14
Prediction of obstructive sleep apnea using Fast Fourier Transform of overnight breath recordings
Molin, N. L., Molin, C., Dalpatadu, R. J., & Singh, A. K. (2021) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100022 · Cited by 18
Unsupervised Calibration under Covariate ShiftPreprint
Pampari, A., & Ermon, S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.16405 · Cited by 24
“Machine learning models are increasingly being entrusted with complex decisions in many applications such as medical diagnosis (Triantafyllidis & Tsanas, 2019), justice system (Berk & Hyatt, 2015), financial decisions (Heaton et al., 2017), human robot interaction (Modares et al., 2015), etc.”
BackgroundJhou, M.-J., Chen, M.-S., Lee, T., Yang, C.-T., Chiu, Y., & Lu, C.-J. (2022) · Healthcare · doi:10.3390/healthcare10122496 · Cited by 12
“They are often used to identify critical predictor variables or risk factors as they can effectively investigate the complex relationships between risk factors and outcomes, based on their promising predictive performance with vast amounts of medical data [16,22,23,25].”
Background
Metadata
- Authors
- Triantafyllidis, A. K., & Tsanas, A.
- Affiliations
- Aristotle University of Thessaloniki (GR)
- University of Oxford (GB)
- Corresponding author
- Triantafyllidis, Andreas K
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-04-05
- Volume
- 21
- Issue
- 4
- Pages
- e12286
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6473205
- OpenAlex
- W2926287779
- Cited by
- 243
- References
- 48
- Citations by year
- 2026: 17 · 2025: 29 · 2024: 36 · 2023: 44 · 2022: 40 · 2021: 40 · 2020: 29 · 2019: 8
- FWCI
- 1.40
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- Funders
- Wellcome Trust (098461/Z/12/Z)
- Scottish Government
- British Heart Foundation
- Department of Health and Social Care
- University of Oxford
- Public Health Agency
- Chief Scientist Office, Scottish Government Health and Social Care Directorate
- Medical Research Council (098461/Z/12/Z)
- Engineering and Physical Sciences Research Council
- Economic and Social Research Council
- Health and Social Care Research and Development Division
- Health Data Research UK
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- machine learning, digital health interventions, real-world applications, depression prediction, speech recognition, stress management, phantom limb pain, smoking cessation, personalized nutrition, glycemic response, speech disorders
- MeSH terms
- Machine Learning, Humans, Quality of Health Care, Telemedicine, Data Mining
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
