Multi-Modal Stacked Denoising Autoencoder for Handling Missing Data in Healthcare Big Data
Open accessAbstract
Supply and demand increase in response to healthcare trends. Moreover, personal health records (PHRs) are being managed by individuals. Such records are collected using different avenues and vary considerably in terms of their type and scope depending on the particular circumstances. As a result, some data may be missing, which has a negative effect on the data analysis, and such data should, therefore, be replaced with appropriate values. In this study, a method for estimating missing data using a multi-modal autoencoder applied to the field of healthcare big data is proposed. The proposed method uses a stacked denoising autoencoder to estimate the missing data that occur during the data collection and processing stages. Autoencoders are neural networks that output value of x^similar to an input value of x. In the present study, data from the Korean National Health Nutrition Examination Survey (KNHNES), conducted by the Korea Centers for Disease Control and Prevention (KCDC), are used. As representative healthcare data from South Korea, they contain a large number of parameters identical to those used in the PHRs. Based on this, models can be generated to estimate missing data occurring in PHRs. Furthermore, PHRs involve a multi-modality that allows the data to be collected from multiple sources for a single object. Therefore, the stacked denoising autoencoder applied is configured under a multi-modal setting. Through pre-processing, a set of data without missing value in KNHNES is designed. In the data set based learning, a label is set as original data, and an autoencoder input is set as noised input that additionally has as many random zero numbers as noise factor. In this way, the autoencoder learns in the way of making the zero-based noise value similar to the original label value. When the amount of missing data in a dataset reaches approximately 25%, the accuracy of the proposed method using a multi-modal stacked denoising autoencoder is 0.9217, which is higher than that achieved by other ordinary methods. For a single-modal denoising autoencoder, the accuracy is 0.932, with a slight difference of approximately 0.01, which falls within the allowable limits in data analysis. In terms of computational performance, a single-modal autoencoder has 10,384 parameters, which is 5,594 more than those used in a multi-modal stacked autoencoder. These parameters affect the speed of the model. Both models exhibit a significant difference in the number of parameters but demonstrate a relatively small difference in accuracy, suggesting that the proposed multi-modal stacked denoising autoencoder is advantageous over a single-modal model when used on a personal device. Moreover, a multi-modal model can save additional time when processing large amounts of data in locations such as hospitals and institutions.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Stacked-autoencoder-based multimodal systems compress each modality separately in the encoder and build a shared latent representation in the decoder without supervision.
“the authors of [210–212] designed multimodal systems based on SAEs, where the encoder side of the architecture represents and compresses each unimodal feature separately, and the decoder side constructs the latent (shared) representation of the inputs in a unsupervised manner.”
From A survey on deep multimodal learning for computer vision: advances, trends, applications, and datasets (2022) · cites this paper as [210]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155 · see citing works
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Data Mining: Practical Machine Learning Tools and Techniques
Witten, I. H., Frank, E., & Hall, M. A. (2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,493 · see citing works
Algorithm AS 136: A K-Means Clustering Algorithm
Hartigan, J. A., & Wong, M. A. (1979) · Applied Statistics · doi:10.2307/2346830 · Cited by 14,523 · see citing works
Extracting and composing robust features with denoising autoencoders
Vincent, P., Larochelle, H., Bengio, Y., & Manzagol, P.-A. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390294 · Cited by 7,436 · see citing works
(2011) · Cited by 6,993 · see citing works
A New Initiative on Precision Medicine
Collins, F. S., & Varmus, H. (2015) · New England Journal of Medicine · doi:10.1056/nejmp1500523 · Cited by 5,202 · see citing works
Agrawal, R., & Srikant, R. (2002) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde.1995.380415 · Cited by 5,150 · see citing works
Pearson Correlation Coefficient
(2020) · Definitions · doi:10.4135/9781412953948.n342 · Cited by 3,454 · see citing works
Recurrent Neural Networks for Multivariate Time Series with Missing Values
Che, Z., Purushotham, S., Cho, K., Sontag, D., & Liu, Y. (2018) · Scientific Reports · doi:10.1038/s41598-018-24271-9 · Cited by 2,370 · see citing works
Jang, J. R., Sun, C., & Mizutani, E. (1997) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1997.633847 · Cited by 1,681 · see citing works
Multiple imputation in health‐are databases: An overview and some applications
Rubin, D. B., & Nathaniel Schenker, A. (1991) · Statistics in Medicine · doi:10.1002/sim.4780100410 · Cited by 1,553 · see citing works
Generative adversarial networks: introduction and outlook
Wang, K., Gou, C., Duan, Y., Lin, Y., Zheng, X., & Wang, F. (2017) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2017.7510583 · Cited by 815 · see citing works
Data mining in soft computing framework: a survey
Mitra, S., Pal, S. K., & Mitra, P. (2002) · IEEE Transactions on Neural Networks · doi:10.1109/72.977258 · Cited by 617 · see citing works
Imputation of missing values for compositional data using classical and robust methods
Hron, K., Templ, M., & Filzmoser, P. (2009) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2009.11.023 · Cited by 301 · see citing works
Jiang, G., He, H., Xie, P., & Tang, Y. (2017) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/tim.2017.2698738 · Cited by 271 · see citing works
Luo, X., Zhou, M., Li, S., & Shang, M. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2766528 · Cited by 200 · see citing works
Effective multi-modal retrieval based on stacked auto-encoders
Wang, W., Ooi, B. C., Yang, X., et al. (2014) · Proceedings of the VLDB Endowment · doi:10.14778/2732296.2732301 · Cited by 144 · see citing works
Methods for large scale SVD with missing values
Kurucz, M., Benczúr, A. A., & Csalogány, K. (2007) · SZTAKI Publication Repository (Hungarian Academy of Sciences) · Cited by 138 · see citing works
An Effective Scheme for QoS Estimation via Alternating Direction Method-Based Matrix Factorization
Luo, X., Zhou, M., Wang, Z., Xia, Y., & Zhu, Q. (2016) · IEEE Transactions on Services Computing · doi:10.1109/tsc.2016.2597829 · Cited by 129 · see citing works
Locomotion Activity Recognition Using Stacked Denoising Autoencoders
Gu, F., Khoshelham, K., Valaee, S., Shang, J., & Zhang, R. (2018) · IEEE Internet of Things Journal · doi:10.1109/jiot.2018.2823084 · Cited by 122 · see citing works
Randomized latent factor model for high-dimensional and sparse matrices from industrial applications
Shang, M., Luo, X., Liu, Z., Chen, J., Yuan, Y., & Zhou, M. (2018) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2018.7511189 · Cited by 119 · see citing works
Knowledge-based dietary nutrition recommendation for obese management
Jung, H., & Chung, K. (2015) · Information Technology and Management · doi:10.1007/s10799-015-0218-4 · Cited by 110 · see citing works
Self-citationMulti-modal Auto-Encoders as Joint Estimators for Robotics Scene Understanding
Cadena, C., Dick, A., & D. Reid, I. (2016) · Robotics: Science and Systems XII · doi:10.15607/rss.2016.xii.041 · Cited by 93 · see citing works
An adaptive deep Q-learning strategy for handwritten digit recognition
Qiao, J., Wang, G., Li, W., & Chen, M. (2018) · Neural Networks · doi:10.1016/j.neunet.2018.02.010 · Cited by 93 · see citing works
Huang, L.-C., Chu, H.-C., Lien, C.-Y., Hsiao, C., & Kao, T. (2009) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2009.06.004 · Cited by 78 · see citing works
A Pythagorean-Type Fuzzy Deep Denoising Autoencoder for Industrial Accident Early Warning
Zheng, Y., Chen, S., Xue, Y., & Xue, J. (2017) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2017.2738605 · Cited by 78 · see citing works
García, S., Luengo, J., & Herrera, F. (2014) · Intelligent systems reference library · doi:10.1007/978-3-319-10247-4_4 · Cited by 63 · see citing works
Multimodal structural health monitoring based on active and passive sensing
Nasrollahi, A., Deng, W. Y., Ma, Z., & Rizzo, P. (2017) · Structural Health Monitoring · doi:10.1177/1475921717699375 · Cited by 59 · see citing works
Ontology driven interactive healthcare with wearable sensors
Kim, J., Kim, J., Lee, D., & Chung, K.-Y. (2014) · Multimedia Tools and Applications · doi:10.1007/s11042-012-1195-9 · Cited by 57 · see citing works
Self-citationMobile healthcare application with EMR interoperability for diabetes patients
Jung, E.-Y., Kim, J., Chung, K., et al. (2013) · Cluster Computing · doi:10.1007/s10586-013-0315-2 · Cited by 56 · see citing works
Self-citationKim, J.-C., & Chung, K. (2019) · KSII Transactions on Internet and Information Systems · doi:10.3837/tiis.2019.04.018 · Cited by 50 · see citing works
Self-citationHybrid clustering based health decision-making for improving dietary habits
Baek, J.-W., Kim, J.-C., Chun, J., et al. (2019) · Technology and Health Care · doi:10.3233/thc-191730 · Cited by 49 · see citing works
Self-citationKnowledge-based health service considering user convenience using hybrid Wi-Fi P2P
Chung, K., Kim, J.-C., & Park, R. C. (2015) · Information Technology and Management · doi:10.1007/s10799-015-0241-5 · Cited by 48 · see citing works
Self-citationNeural-network based adaptive context prediction model for ambient intelligence
Kim, J.-C., & Chung, K. (2018) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-018-0972-3 · Cited by 47 · see citing works
Self-citationMining-based lifecare recommendation using peer-to-peer dataset and adaptive decision feedback
Yoo, H., & Chung, K. (2017) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-017-0620-2 · Cited by 43 · see citing works
Self-citationPHR open platform based smart health service using distributed object group framework
Chung, K., & Park, R. C. (2016) · Cluster Computing · doi:10.1007/s10586-016-0531-7 · Cited by 40 · see citing works
Self-citationPHR Based Diabetes Index Service Model Using Life Behavior Analysis
Yoo, H., & Chung, K. (2016) · Wireless Personal Communications · doi:10.1007/s11277-016-3715-9 · Cited by 37 · see citing works
Self-citationMining health-risk factors using PHR similarity in a hybrid P2P network
Kim, J.-C., & Chung, K. (2018) · Peer-to-Peer Networking and Applications · doi:10.1007/s12083-018-0631-7 · Cited by 37 · see citing works
Self-citationMining Based Time-Series Sleeping Pattern Analysis for Life Big-Data
Kim, J.-C., & Chung, K. (2018) · Wireless Personal Communications · doi:10.1007/s11277-018-5983-z · Cited by 28 · see citing works
Self-citationDuffy, M. E. (2006) · Clinical Nurse Specialist · doi:10.1097/00002800-200611000-00005 · Cited by 24 · see citing works
Evolutionary rule decision using similarity based associative chronic disease patients
Jung, H., Yang, J., Woo, J., Lee, B.-M., Ouyang, J., Chung, K., & Lee, Y. (2014) · Cluster Computing · doi:10.1007/s10586-014-0376-x · Cited by 21 · see citing works
Self-citationActivity-based nutrition management model for healthcare using similar group analysis
Chung, K., & Kim, J. (2019) · Technology and Health Care · doi:10.3233/thc-191731 · Cited by 16 · see citing works
Self-citationTowards Ubiquitous Health with Convergence
Oh, S.-Y., Chung, K., & Han, J.-S. (2016) · Technology and Health Care · doi:10.3233/thc-151118 · Cited by 12 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 2
- S. García, J. Luengo, and F. Herrera, Data Preprocessing in Data Mining New York, NY, USA: Springer, 2015, pp. 59-139.
- J. Benesty, J. Chen, Y. Huang, and I. Cohen, ''Pearson correlation coef- ficient,'' in Noise Reduction in Speech Processing. Berlin, Germany: Springer, 2009, pp. 1-4.
Cited by
Sorted by citations
Bayoudh, K., Knani, R., Hamdaoui, F., & Mtibaa, A. (2022) · The Visual Computer · doi:10.1007/s00371-021-02166-7 · Cited by 456 · see citing works
- Authors
- Kim, J.-C., & Chung, K.
- Affiliations
- Kyonggi University (KR)
- Venue
- IEEE Access
- Published
- 2020
- Volume
- 8
- Pages
- 104933-104943
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W3033040110
- Cited by
- 56
- References
- 44
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 9 · 2023: 9 · 2022: 8 · 2021: 10 · 2020: 4
- FWCI
- 6.81
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Korea Agency for Infrastructure Technology Advancement
- Ministry of Land, Infrastructure, and Transport (20CTAP-C157011-01)
- Topics
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- missing data imputation, stacked denoising autoencoder, personal health records, big data in healthcare, missing data estimation, data processing errors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
