CoChat
Sign Up
PreprintCited by 59Adversarial Robustness in Machine LearningPrivacy-Preserving Technologies in DataArtificial Intelligence in Healthcare and Education

Secure and Robust Machine Learning for Healthcare: A Survey

Open access
Qayyum, Adnan, Qadir, Junaid, Bilal, Muhammad, Al-Fuqaha, Ala·2020·arXiv
DOI 10.48550/arxiv.2001.08103arXiv 2001.08103
Open this paper in CoChat — free accountOpen PDF

Abstract

Recent years have witnessed widespread adoption of machine learning (ML)/deep learning (DL) techniques due to their superior performance for a variety of healthcare applications ranging from the prediction of cardiac arrest from one-dimensional heart signals to computer-aided diagnosis (CADx) using multi-dimensional medical images. Notwithstanding the impressive performance of ML/DL, there are still lingering doubts regarding the robustness of ML/DL in healthcare settings (which is traditionally considered quite challenging due to the myriad security and privacy issues involved), especially in light of recent results that have shown that ML/DL are vulnerable to adversarial attacks. In this paper, we present an overview of various application areas in healthcare that leverage such techniques from security and privacy point of view and present associated challenges. In addition, we present potential methods to ensure secure and privacy-preserving ML for healthcare applications. Finally, we provide insight into the current research challenges and promising directions for future research.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2001.08103

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 206

  1. S. Latif, J. Qadir, S. Farooq, and M. Imran, "How 5G wireless (and con- comitant technologies) will revolutionize healthcare?" Future Internet, vol. 9, no. 4, p. 93, 2017.
  2. Z. Yan et al., "Multi-instance deep learning: Discover discriminative local anatomies for bodypart recognition," IEEE Trans. Med. Imag., vol. 35, no. 5, pp. 1332-1343, May 2016.
  3. M. Anthimopoulos, S. Christodoulidis, L. Ebner, A. Christe, and S. Mougiakakou, "Lung pattern classification for interstitial lung diseases using a deep convolutional neural network," IEEE Trans. Med. Imag., vol. 35, no. 5, pp. 1207-1216, May 2016.
  4. W. Shen, M. Zhou, F. Yang, C. Yang, and J. Tian, "Multi-scale convolu- tional neural networks for lung nodule classification," in Proc. Int. Conf. Inf. Process. Med. Imag., 2015, pp. 588-599.
  5. J. Schlemper, J. Caballero, J. V. Hajnal, A. Price, and D. Rueckert, "A deep cascade of convolutional neural networks for MR image reconstruc- tion," in Proc. Int. Conf. Inf. Process. Med. Imag., 2017, pp. 647-658.
  6. J. Mehta and A. Majumdar, "Rodeo: Robust de-aliasing autoencoder for real-time medical image reconstruction," Pattern Recognit., vol. 63, pp. 499-510, 2017.
  7. M. Havaei et al., "Brain tumor segmentation with deep neural networks," Med. Image Anal., vol. 35, pp. 18-31, 2017.
  8. K. Bourzac, "The computer will see you now," Nature, vol. 502, no. 3, pp. S92-S94, 2013.
  9. L. Xing, E. A. Krupinski, and J. Cai, "Artificial intelligence will soon change the landscape of medical physics research and practice," Med. Phys., vol. 45, no. 5, pp. 1791-1793, 2018.
  10. B. E. Bejnordi et al., "Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer," J. Amer. Med. Assoc., vol. 318, no. 22, pp. 2199-2210, 2017.
  11. P. Rajpurkar et al., "Chexnet: Radiologist-level pneumonia detection on chest x-rays with deep learning," 2017, arXiv:1711.05225. · arXiv
  12. V. Gulshan et al., "Development and validation of a deep learning algo- rithm for detection of diabetic retinopathy in retinal fundus photographs," J. Amer. Med. Assoc., vol. 316, no. 22, pp. 2402-2410, 2016.
  13. A. Esteva et al., "Dermatologist-level classification of skin cancer with deep neural networks," Nature, vol. 542, no. 7639, pp. 115-118, 2017.
  14. S. Latif, M. Asim, M. Usman, J. Qadir, and R. Rana, "Automating motion correction in multishot MRI using generative adversarial networks," in Proc. 32nd Conf. Neural Inf. Process. Syst., 2018.
  15. X.-W. Chen and X. Lin, "Big data deep learning: Challenges and per- spectives," IEEE Access, vol. 2, pp. 514-525, 2014.
  16. R. Miotto, F. Wang, S. Wang, X. Jiang, and J. T. Dudley, "Deep learning for healthcare: Review, opportunities and challenges," Briefings Bioin- format., vol. 19, no. 6, pp. 1236-1246, 2017.
  17. K. Papangelou, K. Sechidis, J. Weatherall, and G. Brown, "Toward an understanding of adversarial examples in clinical trials," in Proc. Joint Eur. Conf. Mach. Learn. Knowl. Discovery Databases, 2018, pp. 35-51.
  18. H. Kim, D. C. Jung, and B. W. Choi, "Exploiting the vulnerability of deep learning-based artificial intelligence models in medical imaging: Adversarial attacks," J. Korean Soc. Radiol., vol. 80, no. 2, pp. 259-273, 2019.
  19. X. Yuan, P. He, Q. Zhu, and X. Li, "Adversarial examples: Attacks and defenses for deep learning," IEEE Trans. Neural Netw. Learn. Syst., vol. 30, no. 9, pp. 2805-2824, Sep. 2019.
  20. C. Szegedy et al., "Intriguing properties of neural networks," 2013, arXiv:1312.6199. · arXiv
  21. A. Shafahi et al., "Poison frogs! Targeted clean-label poisoning attacks on neural networks," in Proc. Adv. Neural Inf. Process. Syst., 2018, pp. 6103-6113.
  22. S. G. Finlayson, J. D. Bowers, J. Ito, J. L. Zittrain, A. L. Beam, and I. S. Kohane, "Adversarial attacks on medical machine learning," Science, vol. 363, no. 6433, pp. 1287-1289, 2019.
  23. V. Chandola, A. Banerjee, and V. Kumar, "Anomaly detection: A survey," ACM Comput. Surv., vol. 41, no. 3, pp. 1-58, 2009.
  24. A. K. Pandey, P. Pandey, K. Jaiswal, and A. K. Sen, "Datamining clustering techniques in the prediction of heart disease using attribute selection method," Heart Disease, vol. 14, pp. 16-17, 2013.
  25. K. Polat and S. Güneş, "Prediction of hepatitis disease based on principal component analysis and artificial immune recognition system," Appl. Math. Comput., vol. 189, no. 2, pp. 1282-1291, 2007.
  26. M. Alloghani, D. Al-Jumeily, J. Mustafina, A. Hussain, and A. J. Aljaaf, "A systematic review on supervised and unsupervised machine learning algorithms for data science," in Supervised and Unsupervised Learning for Data Science. Berlin, Germany: Springer, 2020, pp. 3-21.
  27. M. N. Sohail, J. Ren, and M. U. Muhammad, "A Euclidean group assess- ment on semi-supervised clustering for healthcare clinical implications based on real-life data," Int. J. Environ. Res. Public Health, vol. 16, no. 9, p. 1581, 2019.
  28. A. Zahin, R. Q. Hu et al., "Sensor-based human activity recognition for smart healthcare: A semi-supervised machine learning," in Proc. Int. Conf. Artif. Intell. Commun. Netw., 2019, pp. 450-472.
  29. D. Mahapatra, "Semi-supervised learning and graph cuts for consen- sus based medical image segmentation," Pattern Recognit., vol. 63, pp. 700-709, 2017.
  30. W. Bai et al., "Semi-supervised learning for network-based cardiac MR image segmentation," in Proc. Int. Conf. Med. Image Comput. Comput.- Assisted Intervention, 2017, pp. 253-260.
  31. R. S. Sutton et al., Introduction to Reinforcement Learning, vol. 2. Cambridge, MA, USA: MIT Press, 1998.
  32. H.-C. Kao, K.-F. Tang, and E. Y. Chang, "Context-aware symptom check- ing for disease diagnosis using hierarchical reinforcement learning," in Proc. 32nd AAAI Conf. Artif. Intell., 2018.
  33. D. Silver et al., "Mastering the game of go with deep neural networks and tree search," Nature, vol. 529, no. 7587, pp. 484-489, 2016.
  34. A. Collins and Y. Yao, "Machine learning approaches: Data integration for disease prediction and prognosis," in Applied Comput. Genomics. Berlin, Germany: Springer, 2018, pp. 137-141.
  35. P. Afshar, A. Mohammadi, and K. N. Plataniotis, "Brain tumor type classification via capsule networks," in Proc. 25th IEEE Int. Conf. Image Process., 2018, pp. 3129-3133.
  36. W. Zhu, C. Liu, W. Fan, and X. Xie, "Deeplung: Deep 3D dual path nets for automated pulmonary nodule detection and classification," in Proc. IEEE Winter Conf. Appl. Comput. Vis., 2018, pp. 673-681.
  37. P. B. Jensen, L. J. Jensen, and S. Brunak, "Mining electronic health records: Towards better research applications and clinical care," Nature Rev. Genetics, vol. 13, no. 6, pp. 395-405, 2012.
  38. Z. Wang, A. D. Shah, A. R. Tate, S. Denaxas, J. Shawe-Taylor, and H. Hemingway, "Extracting diagnoses and investigation results from unstructured text in electronic health records by semi-supervised machine learning," PLoS One, vol. 7, no. 1, 2012, Art. no. e30412.
  39. T. Zheng et al., "A machine learning-based framework to identify type 2 diabetes through electronic health records," Int. J. Med. Informat., vol. 97, pp. 120-127, 2017.
  40. B. Nestor et al., "Feature robustness in non-stationary health records: Caveats to deployable model performance in common clinical machine learning tasks," 2019, arXiv:1908.00690. · arXiv
  41. S. M. Anwar, M. Majid, A. Qayyum, M. Awais, M. Alnowami, and M. K. Khan, "Medical image analysis using convolutional neural net- works: A review," J. Med. Syst., vol. 42, no. 11, p. 226, 2018.
  42. M. Lustig, D. L. Donoho, J. M. Santos, and J. M. Pauly, "Compressed sensing MRI," IEEE Signal Process. Mag., vol. 25, no. 2, pp. 72-82, Mar. 2008.
  43. L. Gondara, "Medical image denoising using convolutional denoising autoencoders," in Proc. IEEE 16th Int. Conf. Data Mining Workshops, 2016, pp. 241-246.
  44. Y. Chen, Y. Xie, Z. Zhou, F. Shi, A. G. Christodoulou, and D. Li, "Brain MRI super resolution using 3D deep densely connected neural networks," in Proc. IEEE 15th Int. Symp. Biomed. Imag., 2018, pp. 739-742.
  45. K. Sirinukunwattana, S. E. A. Raza, Y.-W. Tsang, D. R. Snead, I. A. Cree, and N. M. Rajpoot, "Locality sensitive deep learning for detection and classification of nuclei in routine colon cancer histol- ogy images," IEEE Trans. Med. Imag., vol. 35, no. 5, pp. 1196-1206, May 2016.
  46. H. Wang et al., "Mitosis detection in breast cancer pathology images by combining handcrafted and convolutional neural network features," J. Med. Imag., vol. 1, no. 3, 2014, Art. no. 034003.
  47. Y. Yu, H. Lin, J. Meng, X. Wei, H. Guo, and Z. Zhao, "Deep transfer learning for modality classification of medical images," Information, vol. 8, no. 3, p. 91, 2017.
  48. J. Antony, K. McGuinness, N. E. O'Connor, and K. Moran, "Quantify- ing radiographic knee osteoarthritis severity using deep convolutional neural networks," in Proc. 23rd Int. Conf. Pattern Recognit., 2016, pp. 1195-1200.
  49. E. Kim, M. Corte-Real, and Z. Baloch, "A deep semantic mobile ap- plication for thyroid cytopathology," in Proc. Med. Imag.: PACS Imag. Informat.: Next Gener. Innovations, 2016, vol. 9789, Art. no. 97890A.
  50. M. F. Stollenga, W. Byeon, M. Liwicki, and J. Schmidhuber, "Parallel multi-dimensional LSTM, with application to fast biomedical volumetric image segmentation," in Proc. Adv. Neural Inf. Process. Syst., 2015, pp. 2998-3006.
  51. O. Ronneberger, P. Fischer, and T. Brox, "U-net: Convolutional networks for biomedical image segmentation," in Proc. Int. Conf. Med. Image Comput. Comput.-Assisted Intervention, 2015, pp. 234-241.
  52. F. Milletari, N. Navab, and S.-A. Ahmadi, "V-Net: Fully convolutional neural networks for volumetric medical image segmentation," in Proc. 4th Int. Conf. 3D Vis., 2016, pp. 565-571.
  53. M. H. Hesamian, W. Jia, X. He, and P. Kennedy, "Deep learning tech- niques for medical image segmentation: Achievements and challenges," J. Digit. Imag., vol. 32, pp. 582-596, 2019.
  54. H. Chen et al., "Low-dose CT with a residual encoder-decoder con- volutional neural network," IEEE Trans. Med. Imag., vol. 36, no. 12, pp. 2524-2535, Dec. 2017.
  55. M. Usman, S. Latif, M. Asim, B. D. Lee, and J. Qadir, "Retrospective mo- tion correction in multishot MRI using generative adversarial network," Scientific Reports, vol. 10, no. 1, pp. 1-11, 2020.
  56. F. E.-Z. A. El-Gamal, M. Elmogy, and A. Atwan, "Current trends in medical image registration and fusion," Egyptian Informat. J., vol. 17, no. 1, pp. 99-124, 2016.
  57. J. Ker, L. Wang, J. Rao, and T. Lim, "Deep learning applications in medical image analysis," IEEE Access, vol. 6, pp. 9375-9389, 2017.
  58. X. Yang, R. Kwitt, M. Styner, and M. Niethammer, "Quicksilver: Fast predictive image registration-A deep learning approach," NeuroImage, vol. 158, pp. 378-396, 2017.
  59. S. Miao, Z. J. Wang, and R. Liao, "A CNN regression approach for real-time 2D/3D registration," IEEE Trans. Med. Imag., vol. 35, no. 5, pp. 1352-1363, May 2016.
  60. D. Shen, G. Wu, and H.-I. Suk, "Deep learning in medical image analy- sis," Annu. Rev. Biomed. Eng., vol. 19, pp. 221-248, 2017.
  61. A. Qayyum, S. M. Anwar, M. Awais, and M. Majid, "Medical image retrieval using deep convolutional neural network," Neurocomputing, vol. 266, pp. 8-20, 2017.
  62. J. Zech et al., "Natural language-based machine learning models for the annotation of clinical radiology reports," Radiology, vol. 287, no. 2, pp. 570-580, 2018.
  63. B. Jing, P. Xie, and E. Xing, "On the automatic generation of medical imaging reports," in Proc. 56th Annu. Meeting Assoc. Comput. Linguis- tics, 2018, pp. 2577-2586.
  64. X. Wang, Y. Peng, L. Lu, Z. Lu, and R. M. Summers, "Tienet: Text- image embedding network for common thorax disease classification and reporting in chest x-rays," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2018, pp. 9049-9058.
  65. Y. Xue et al., "Multimodal recurrent model with attention for automated radiology report generation," in Proc. Int. Conf. Med. Image Comput. Comput.-Assisted Intervention, 2018, pp. 457-466.
  66. V. Jindal, "Integrating mobile and cloud for PPG signal selection to monitor heart rate during intensive physical exercise," in Proc. Int. Conf. Mobile Softw. Eng. Syst., 2016, pp. 36-37.
  67. F. Attal, S. Mohammed, M. Dedabrishvili, F. Chamroukhi, L. Oukhellou, and Y. Amirat, "Physical human activity recognition using wearable sensors," Sensors, vol. 15, no. 12, pp. 31 314-31 338, 2015.
  68. S. F. Weng, J. Reps, J. Kai, J. M. Garibaldi, and N. Qureshi, "Can machine- learning improve cardiovascular risk prediction using routine clinical data?" PloS One, vol. 12, no. 4, 2017, Art. no. e0174944.
  69. M. Fatima and M. Pasha, "Survey of machine learning algorithms for disease diagnostic," J. Intell. Learn. Syst. Appl., vol. 9, no. 1, pp. 1-16, 2017.
  70. J. A. Cruz and D. S. Wishart, "Applications of machine learning in cancer prediction and prognosis," Cancer Informat., vol. 2, pp. 59-77, 2006.
  71. H.-Y. Ma, Z. Zhou, S. Wu, Y.-L. Wan, and P.-H. Tsui, "A computer-aided diagnosis scheme for detection of fatty liver in vivo based on ultrasound kurtosis imaging," J. Med. Syst., vol. 40, no. 1, p. 33, 2016.
  72. Z. Zhang et al., "Reinforcement learning in clinical medicine: A method to optimize dynamic treatment regime over time," Ann. Transl. Med., vol. 7, no. 14, 2019.
  73. A. Raghu, "Reinforcement learning for sepsis treatment: Baselines and analysis," in Proc. 36th Int. Conf. Mach. Learn., Long Beach, California, USA, 2019.
  74. H. Suresh, "Clinical event prediction and understanding with deep neural networks," Ph.D. dissertation, Massachusetts Institut. Technol., Cam- bridge, MA, USA, 2017.
  75. C.-S. Rau, P.-J. Kuo, P.-C. Chien, C.-Y. Huang, H.-Y. Hsieh, and C.-H. Hsieh, "Mortality prediction in patients with isolated moderate and severe traumatic brain injury using machine learning models," PloS One, vol. 13, no. 11, 2018, Art. no. e0207192.
  76. H. Song, D. Rajan, J. J. Thiagarajan, and A. Spanias, "Attend and diagnose: Clinical time series analysis using attention models," in Proc. 32nd AAAI Conf. Artif. Intell., 2018.
  77. O. Ren et al., "Predicting and understanding unexpected respira- tory decompensation in critical care using sparse and heterogeneous clinical data," in Proc. IEEE Int. Conf. Healthcare Informat., 2018, pp. 144-151.
  78. A. K. Jha, "The promise of electronic records: Around the corner or down the road?" J. Amer. Med. Assoc., vol. 306, no. 8, pp. 880-881, 2011.
  79. A. Névéol, H. Dalianis, S. Velupillai, G. Savova, and P. Zweigenbaum, "Clinical natural language processing in languages other than english: Opportunities and challenges," J. Biomed. Semantics, vol. 9, no. 1, p. 12, 2018.
  80. E. Soysal et al., "Clamp-A toolkit for efficiently building customized clinical natural language processing pipelines," J. Amer. Med. Informat. Assoc., vol. 25, no. 3, pp. 331-336, 2017.
  81. M. Ghassemi et al., "Learning to detect vocal hyperfunction from ambu- latory neck-surface acceleration features: Initial results for vocal fold nodules," IEEE Trans. Biomed. Eng., vol. 61, no. 6, pp. 1668-1675, Jun. 2014.
  82. C. Pou-Prom and F. Rudzicz, "Learning multiview embeddings for assessing dementia," in Proc. Conf. Empirical Methods Natural Lang. Process., 2018, pp. 2812-2817.
  83. K. C. Fraser, J. A. Meltzer, and F. Rudzicz, "Linguistic features identify alzheimer's disease in narrative speech," J. Alzheimer's Disease, vol. 49, no. 2, pp. 407-422, 2016.
  84. J. B. Andre et al., "Toward quantifying the prevalence, severity, and cost associated with patient motion during clinical MR examinations," J. Amer. College Radiol., vol. 12, no. 7, pp. 689-695, 2015.
  85. A. K. Manrai, G. Bhatia, J. Strymish, I. S. Kohane, and S. H. Jain, "Medicine's uncomfortable relationship with math: Calculating positive predictive value," JAMA Internal Med., vol. 174, no. 6, pp. 991-993, 2014.
  86. R. Caruana, Y. Lou, J. Gehrke, P. Koch, M. Sturm, and N. Elhadad, "Intelligible models for healthcare: Predicting pneumonia risk and hos- pital 30-day readmission," in Proc. 21st ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2015, pp. 1721-1730.
  87. X. A. Li et al., "Variability of target and normal structure delineation for breast cancer radiotherapy: An RTOG multi-institutional and mul- tiobserver study," Int. J. Radiat. Oncol. Biol. Phys., vol. 73, no. 3, pp. 944-951, 2009.
  88. F. Xia and M. Yetisgen-Yildiz, "Clinical corpus annotation: Challenges and strategies," in Proc. 3rd Workshop Building Evaluating Resour. Biomed. Text Mining Conjunction Int. Conf. Lang. Resour. Eval., Istanbul, Turkey, 2012.
  89. S. T. M. Ataky, J. de Matos, A. d. S. Britto Jr, L. E. Oliveira, and A. L. Koerich, "Data augmentation for histopathological images based on Gaussian-Laplacian pyramid blending," in Proc. IEEE Int. Joint Conf. Neural Netw., Glasgow, U.K., 2020.
  90. J. F. R. Rochac, L. Liang, N. Zhang, and T. Oladunni, "A Gaussian data augmentation technique on highly dimensional, limited labeled data for multiclass classification using deep learning," in Proc. 10th Int. Conf. Intell. Control Inf. Process., 2019, pp. 145-151.
  91. N. Carlini and D. Wagner, "Magnet and 'efficient defenses against adversarial attacks' are not robust to adversarial examples," 2017, arXiv:1711.08478. · arXiv
  92. B. Biggio, B. Nelson, and P. Laskov, "Poisoning attacks against sup- port vector machines," in Proc. 29th Int. Conf. Mach. Learn., 2012, pp. 1807-1814.
  93. S. Alfeld, X. Zhu, and P. Barford, "Data poisoning attacks against autoregressive models," in Proc. 30th AAAI Conf. Artif. Intell., 2016, pp. 1452-1458.
  94. N. Papernot, P. McDaniel, A. Sinha, and M. Wellman, "Towards the science of security and privacy in machine learning," 2016, arXiv:1611.03814. · arXiv
  95. T. J. Pollard et al., "Turning the crank for machine learning: Ease, at what expense?" Lancet Digit. Health, vol. 1, no. 5, pp. e198-e199, 2019.
  96. M. Fredrikson, S. Jha, and T. Ristenpart, "Model inversion attacks that exploit confidence information and basic countermeasures," in Proc. 22nd ACM SIGSAC Conf. Comput. Commun. Secur., 2015, pp. 1322-1333.
  97. I. J. Goodfellow, J. Shlens, and C. Szegedy, "Explaining and harnessing adversarial examples," in Proc. Int. Conf. Learn. Representat., 2015.
  98. N. Papernot, P. McDaniel, S. Jha, M. Fredrikson, Z. B. Celik, and A. Swami, "The limitations of deep learning in adversarial settings," in Proc. IEEE Eur. Symp. Secur. Privacy, 2016, pp. 372-387.
  99. N. Papernot, P. McDaniel, I. Goodfellow, S. Jha, Z. B. Celik, and A. Swami, "Practical black-box attacks against machine learning," in Proc. ACM Asia Conf. Comput. Commun. Secur., 2017, pp. 506-519.
  100. M. Usama, J. Qadir, A. Al-Fuqaha, and M. Hamdi, "The adversarial ma- chine learning conundrum: Can the insecurity of ML become the achilles' heel of cognitive networks?" IEEE Netw., vol.34, no. 1, pp. 196-203, 2019.
  101. B. Biggio et al., "Evasion attacks against machine learning at test time," in Proc. Joint Eur. Conf. Mach. Learn. Knowl. Discovery Databases, 2013, pp. 387-402.
  102. M. Mozaffari-Kermani, S. Sur-Kolay, A. Raghunathan, and N. K. Jha, "Systematic poisoning attacks on and defenses for machine learning in healthcare," IEEE J. Biomed. Health Informat., vol. 19, no. 6, pp. 1893-1905, Nov. 2015.
  103. S. G. Finlayson, H. W. Chung, I. S. Kohane, and A. L. Beam, "Adversarial attacks against medical deep learning systems," 2018, arXiv:1804.05296. · arXiv
  104. N. Karimian, M. Tehranipoor, D. Woodard, and D. Forte, "Unlock your heart: Next generation biometric in resource-constrained health- care systems and IoT," IEEE Access, vol. 7, pp. 49 135-49 149, 2019.
  105. U. Kumar, E. Tripathi, S. P. Tripathi, and K. K. Gupta, "Deep learning for healthcare biometrics," in Design and Implementation of Healthcare Biometric Systems. Pennsylvania, US: IGI Global, 2019, pp. 73-108.
  106. S.-K. Kim, C. Y. Yeun, E. Damiani, and N.-W. Lo, "A machine learning framework for biometric authentication using electrocardiogram," IEEE Access, vol. 7, pp. 94 858-94 868, 2019.
  107. L. Wieclaw, Y. Khoma, P. Fałat, D. Sabodashko, and V. Herasymenko, "Biometrie identification from raw ECG signal using deep learning techniques," in Proc. 9th IEEE Int. Conf. Intell. Data Acquisition Adv. Comput. Syst.: Technol. Appl., 2017, vol. 1, pp. 129-133.
  108. M. Al-Rubaie and J. M. Chang, "Privacy-preserving machine learning: Threats and solutions," IEEE Secur. Privacy, vol. 17, no. 2, pp. 49-58, Mar./Apr. 2019.
  109. J. Chaudhry, "Securing healthcare data using biometric authentication," in Security and Privacy in Communication Networks. Berlin, Germany: Springer, 2018, pp. 123-132.
  110. A. Mohsin et al., "Real-time medical systems based on human biometric steganography: A systematic review," J. Med. Syst., vol. 42, no. 12, p. 245, 2018.
  111. Y. Sun, F. P.-W. Lo, and B. Lo, "Security and privacy for the internet of medical things enabled healthcare systems: A survey," IEEE Access, vol. 7, pp. 183 339-183 355, 2019.
  112. J. Zhang and E. Bareinboim, "Fairness in decision-making-The causal explanation formula," in Proc. 32nd AAAI Conf. Artif. Intell., 2018.
  113. P. Schulam and S. Saria, "Reliable decision support using counterfactual models," in Proc. Adv. Neural Inf. Process. Syst., 2017, pp. 1697-1708.
  114. M. Ghassemi, T. Naumann, P. Schulam, A. L. Beam, and R. Ranganath, "A review of challenges and opportunities in machine learning for health," in Proc. AMIA Summits Transl. Sci., 2020, p. 191.
  115. E. Begoli, T. Bhattacharya, and D. Kusnezov, "The need for uncertainty quantification in machine-assisted medical decision making," Nature Mach. Intell., vol. 1, no. 1, pp. 20-23, 2019.
  116. A. Khademi, S. Lee, D. Foley, and V. Honavar, "Fairness in algorithmic decision making: An excursion through the lens of causality," in Proc. World Wide Web Conf., 2019, pp. 2907-2914.
  117. N. Kilbertus, M. R. Carulla, G. Parascandolo, M. Hardt, D. Janzing, and B. Schölkopf, "Avoiding discrimination through causal reasoning," in Proc. Adv. Neural Inf. Process. Syst., 2017, pp. 656-666.
  118. B. David, R. Dowsley, R. Katti, and A. C. Nascimento, "Efficient un- conditionally secure comparison and privacy preserving machine learn- ing classification protocols," in Proc. Int. Conf. Provable Secur., 2015, pp. 354-367.
  119. M. Jagielski, A. Oprea, B. Biggio, C. Liu, C. Nita-Rotaru, and B. Li, "Manipulating machine learning: Poisoning attacks and countermeasures for regression learning," in Proc. IEEE Symp. Secur. Privacy, 2018, pp. 19-35.
  120. M. Liu, H. Jiang, J. Chen, A. Badokhon, X. Wei, and M.-C. Huang, "A collaborative privacy-preserving deep learning system in distributed mobile environment," in Proc. Int. Conf. Comput. Sci. Comput. Intell., 2016, pp. 192-197.
  121. D. Malathi, R. Logesh, V. Subramaniyaswamy, V. Vijayakumar, and A. K. Sangaiah, "Hybrid reasoning-based privacy-aware disease pre- diction support system," Comput. Elect. Eng., vol. 73, pp. 114-127, 2019.
  122. H. Takabi, E. Hesamifard, and M. Ghasemi, "Privacy preserving multi- party machine learning with homomorphic encryption," in 29th Annu. Conf. Neural Inf. Process. Syst., 2016.
  123. M. Kim, Y. Song, S. Wang, Y. Xia, and X. Jiang, "Secure logistic regression based on homomorphic encryption: Design and evaluation," JMIR Med. Informat., vol. 6, no. 2, p. e19, 2018.
  124. D. Bogdanov, L. Kamm, S. Laur, and V. Sokk, "Implementation and evaluation of an algorithm for cryptographically private principal com- ponent analysis on genomic data," IEEE/ACM Trans. Comput. Biol. Bioinformat., vol. 15, no. 5, pp. 1427-1432, Sep./Oct. 2018.
  125. M. Min et al., "Learning-based privacy-aware offloading for healthcare IoT with energy harvesting," IEEE Internet Things J., vol. 6, no. 3, pp. 4307-4316, Jun. 2019.
  126. B. K. Beaulieu-Jones, W. Yuan, S. G. Finlayson, and Z. S. Wu, "Privacy- preserving distributed deep learning for clinical data," in Proc. Mach. Learn. Health Workshop NeurIPS, 2018.
  127. H. Zhu, X. Liu, R. Lu, and H. Li, "Efficient and privacy-preserving online medical prediagnosis framework using nonlinear svm," IEEE J. Biomed. Health Informat., vol. 21, no. 3, pp. 838-850, May 2017.
  128. O. Choudhury et al., "Differential privacy-enabled federated learning for sensitive health data," Workshop Paper at Mach. Learn. Health (ML4H) Workshop at Neural Information Processing Systems (NeurIPS), 2019.
  129. D. Liu, T. Miller, R. Sayeed, and K. Mandl, "FADL: Federated- autonomous deep learning for distributed electronic health record," in Mach. Learn. Health Workshop NeurIPS, 2018.
  130. L. Faes et al., "Automated deep learning design for medical image classification by health-care professionals with no coding experience: A feasibility study," Lancet Digit. Health, vol. 1, no. 5, pp. e232-e242, 2019.
  131. N. O'Reilly, "Challenges to AI in healthcare," Accessed: Oct. 16, 2019. [Online]. Available: https://crcaustralia.com/media-releases/page/2/
  132. I. Chen, F. D. Johansson, and D. Sontag, "Why is my classifier discrim- inatory?" in Proc. Adv. Neural Inf. Process. Syst., 2018, pp. 3539-3550.
  133. M. Ghassemi, T. Naumann, P. Schulam, A. L. Beam, I. Y. Chen, and R. Ranganath, "Practical guidance on artificial intelligence for health-care data," Lancet Digit. Health, vol. 1, no. 4, pp. e157-e159, 2019.
  134. T. Panch, H. Mattie, and L. A. Celi, "The 'inconvenient truth' about AI in healthcare," NPJ Digit. Med., vol. 2, no. 1, pp. 1-3, 2019.
  135. C. S. Perone, P. Ballester, R. C. Barros, and J. Cohen-Adad, "Un- supervised domain adaptation for medical imaging segmentation with self-ensembling," NeuroImage, vol. 194, pp. 1-11, 2019.
  136. P. Mohassel and Y. Zhang, "SecureML: A system for scalable privacy- preserving machine learning," in Proc. IEEE Symp. Secur. Privacy, 2017, pp. 19-38.
  137. Y. Aono et al., "Privacy-preserving deep learning via additively homo- morphic encryption," IEEE Trans. Inf. Forensics Secur., vol. 13, no. 5, pp. 1333-1345, May 2018.
  138. S. Carpov, T. H. Nguyen, R. Sirdey, G. Constantino, and F. Mar- tinelli, "Practical privacy-preserving medical diagnosis using homomor- phic encryption," in Proc. IEEE 9th Int. Conf. Cloud Comput., 2016, pp. 593-599.
  139. D. Kahrobaei, A. Wood, and K. Najarian, "Homomorphic encryption for machine learning in medicine and bioinformatics," ACM Comput. Surv., p. 1, 2020, doi: 10.1145/3394658. · DOI · Paper page
  140. K. Bonawitz et al., "Practical secure aggregation for privacy-preserving machine learning," in Proc. ACM SIGSAC Conf. Comput. Commun. Secur, 2017, pp. 1175-1191.
  141. M. S. Hossain and G. Muhammad, "Emotion recognition using secure edge and cloud computing," Inf. Sci., vol. 504, pp. 589-601, 2019.
  142. R. Bost, R. A. Popa, S. Tu, and S. Goldwasser, "Machine learning classification over encrypted data," in Proc. Netw. Distrib. Syst. Secur. Symp., 2015, vol. 4324, p. 4325.
  143. A. Gribov et al., "Medical diagnostics based on encrypted medical data," in Proc. Int. Conf. Bio-Inspired Inf. Commun., 2019, pp. 98-111.
  144. O. Ohrimenko et al., "Oblivious multi-party machine learning on trusted processors," in Proc. 25th USENIX Secur. Symp., 2016, pp. 619-636.
  145. F. Shaon, M. Kantarcioglu, Z. Lin, and L. Khan, "SGX-bigmatrix: A practical encrypted data analytic framework with trusted proces- sors," in Proc. ACM SIGSAC Conf. Comput. Commun. Secur., 2017, pp. 1211-1228.
  146. R. Kunkel, D. L. Quoc, F. Gregor, S. Arnautov, P. Bhatotia, and C. Fetzer, "Tensorscone: A secure tensorflow framework using intel SGX," 2019, arXiv:1902.04413. · arXiv
  147. Z. Sun, Y. Wang, M. Shu, R. Liu, and H. Zhao, "Differential privacy for data and model publishing of medical data," IEEE Access, vol. 7, pp. 152 103-152 114, 2019.
  148. W. Huang, S. Zhou, Y. Liao, and H. Chen, "An efficient differential privacy logistic classification mechanism," IEEE Internet Things J., vol. 6, no. 6, pp. 10 620-10 626, Dec. 2019.
  149. T. S. Brisimi, R. Chen, T. Mela, A. Olshevsky, I. C. Paschalidis, and W. Shi, "Federated learning of predictive models from federated electronic health records," Int. J. Med. Informat., vol. 112, pp. 59-67, 2018.
  150. P. Vepakomma, O. Gupta, T. Swedish, and R. Raskar, "Split learning for health: Distributed deep learning without sharing raw patient data," in Proc. 32nd Conf. Neural Inf. Process. Syst., 2018.
  151. C. Dwork, "Differential privacy," in Encyclopedia of Cryptography and Security. Boston, MA, USA: Springer, 2011, pp. 338-340.
  152. M. Abadi et al., "Deep learning with differential privacy," in Proc. ACM SIGSAC Conf. Comput. Commun. Secur., 2016, pp. 308-318.
  153. M. McDermott, S. Wang, N. Marinsek, R. Ranganath, M. Ghassemi, and L. Foschini, "Reproducibility in machine learning for health," Presented at Internation Conf. Learn. Representative Reproducibility Mach. Learn. Workshop, 2019.
  154. N. Papernot, S. Song, I. Mironov, A. Raghunathan, K. Talwar, and Ú. Erlingsson, "Scalable private learning with pate," in Proc. Int. Conf. Learn. Representat., 2018.
  155. Y. X. Wang, B. Balle, and S. P. Kasiviswanathan, "Subsampled Rényi differential privacy and analytical moments accountant," in Proc. 22nd Int. Conf. Artif. Intell. Statist., Apr. 2019, pp. 1226-1235.
  156. H. B. McMahan et al., "A general approach to adding differential pri- vacy to iterative training procedures," Proc. NeurIPS Workshop Privacy Preserving Mach. Learn., 2018.
  157. N. Phan, X. Wu, H. Hu, and D. Dou, "Adaptive laplace mechanism: Differential privacy preservation in deep learning," in Proc. IEEE Int. Conf. Data Mining, 2017, pp. 385-394.
  158. F. McSherry and K. Talwar, "Mechanism design via differential privacy," in Proc. Symp. Found. Comput. Sci., 2007, vol. 7, pp. 94-103.
  159. H. B. McMahan et al., "Communication-efficient learning of deep net- works from decentralized data," in Proc. 20th Inf. Conf. Artif. Intell. Statist. JMLR: W&CP, Apr. 2017, pp. 1273-1282.
  160. A. Qayyum, M. Usama, J. Qadir, and A. Al-Fuqaha, "Securing connected & autonomous vehicles: Challenges posed by adversarial machine learn- ing and the way forward," IEEE Commun. Surv. Tut., vol. 22, no. 2, pp. 998-1026, 2020.
  161. G. Hinton, O. Vinyals, and J. Dean, "Distilling the knowledge in a neural network," in Proc. Deep Learn. Workshop, NIPS, 2014.
  162. N. Papernot, P. McDaniel, X. Wu, S. Jha, and A. Swami, "Distillation as a defense to adversarial perturbations against deep neural networks," in Proc. IEEE Symp. Secur. Privacy, 2016, pp. 582-597.
  163. N. Carlini and D. Wagner, "Adversarial examples are not easily detected: Bypassing ten detection methods," in Proc. 10th ACM Workshop Artif. Intell. Secur, 2017, pp. 3-14.
  164. G. Katz, C. Barrett, D. L. Dill, K. Julian, and M. J. Kochenderfer, "Reluplex: An efficient SMT solver for verifying deep neural networks," in Proc. Int. Conf. Comput. Aided Verification, 2017, pp. 97-117.
  165. A. S. Ross and F. Doshi-Velez, "Improving the adversarial robustness and interpretability of deep neural networks by regularizing their input gradients," in Proc. 32nd AAAI Conf. Artif. Intell., 2018.
  166. J. Bradshaw, A. G. D. G. Matthews, and Z. Ghahramani, "Adversarial examples, uncertainty, and transfer testing robustness in Gaussian process hybrid deep networks," 2017, arXiv:1707.02476. · arXiv
  167. G. Tao, S. Ma, Y. Liu, and X. Zhang, "Attacks meet interpretability: Attribute-steered detection of adversarial samples," in Proc. Adv. Neural Inf. Process. Syst., 2018, pp. 7717-7728.
  168. N. Carlini, "Is ami (attacks meet interpretability) robust to adversarial examples?" 2019, arXiv:1902.02322. · arXiv
  169. L. Nguyen, S. Wang, and A. Sinha, "A learning and masking approach to secure learning," in Proc. Int. Conf. Decis. Game Theory Secur., 2018, pp. 453-464.
  170. R. Huang, B. Xu, D. Schuurmans, and C. Szepesvári, "Learning with a strong adversary," 2015, arXiv:1511.03034. · arXiv
  171. A. Kurakin, I. J. Goodfellow, and S. Bengio, "Adversarial examples in the physical world," in Artificial Intelligence Safety and Security. London, U.K.: Chapman & Hall, 2018, pp. 99-112.
  172. S. Gu and L. Rigazio, "Towards deep neural network architectures robust to adversarial examples," in Proc. Int. Conf. Learn. Representat., 2015.
  173. W. Xu, D. Evans, and Y. Qi, "Feature squeezing: Detecting adversarial examples in deep neural networks," in Proc. 25th Annu. Netw. Distrib. Syst. Secur. Symp., San Diego, CA, USA, Feb. 2018.
  174. W. He, J. Wei, X. Chen, N. Carlini, and D. Song, "Adversarial example defense: Ensembles of weak defenses are not strong," in Proc. 11th USENIX Workshop Offensive Technol., 2017.
  175. J. Gao, B. Wang, Z. Lin, W. Xu, and Y. Qi, "Deepcloak: Masking deep neural network models for robustness against adversarial samples," in Proc. Int. Conf. Learn. Representat., 2017.
  176. S. Garg, V. Sharan, B. Zhang, and G. Valiant, "A spectral view of adversarially robust features," in Proc. Adv. Neural Inf. Process. Syst., 2018, pp. 10 159-10 169.
  177. Y. Song, T. Kim, S. Nowozin, S. Ermon, and N. Kushman, "Pix- eldefend: Leveraging generative models to understand and defend against adversarial examples," in Proc. Int. Conf. Learn. Representat., 2018.
  178. G. Jin, S. Shen, D. Zhang, F. Dai, and Y. Zhang, "APE-GAN: Adversarial perturbation elimination with GAN," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., 2019, pp. 3842-3846.
  179. J. Lu, T. Issaranon, and D. Forsyth, "Safetynet: Detecting and rejecting adversarial examples robustly," in Proc. IEEE Int. Conf. Comput. Vis., 2017, pp. 446-454.
  180. D. Gopinath, G. Katz, C. S. Pasareanu, and C. Barrett, "Deepsafe: A data- driven approach for checking adversarial robustness in neural networks," Int. Symp. Autom. Techn. Verification Anal., Oct. 2018, pp. 3-19.
  181. J. H. Metzen, T. Genewein, V. Fischer, and B. Bischoff, "On detecting adversarial perturbations," in Proc. Int. Conf. Learn. Representat., 2017.
  182. F. Tramer, A. Kurakin, N. Papernot, I. Goodfellow, D. Boneh, and P. McDaniel, "Ensemble adversarial training: Attacks and defenses," in Proc. Int. Conf. Learn. Representat., 2018.
  183. G. K. Santhanam and P. Grnarova, "Defending against adversarial attacks by leveraging an entire GAN," 2018, arXiv:1805.10652. · arXiv
  184. P. Samangouei, M. Kabkab, and R. Chellappa, "Defense-GAN: Protect- ing classifiers against adversarial attacks using generative models," in Proc. Int. Conf. Learn. Representat., 2018.
  185. L. Schott, J. Rauber, M. Bethge, and W. Brendel, "Towards the first adversarially robust neural network model on MNIST," in Proc. 7th Int. Conf. Learn. Representat., 2019, pp. 1-17.
  186. P. Schulam and S. Saria, "What-if reasoning with counterfactual Gaussian processes," History, vol. 100, pp. 1696-1706, 2017.
  187. R. C. Sato and G. T. K. Sato, "Probabilistic graphic models applied to identification of diseases," Einstein (São Paulo), vol. 13, no. 2, pp. 330-333, 2015.
  188. C. Glymour, K. Zhang, and P. Spirtes, "Review of causal discov- ery methods based on graphical models," Frontiers Genetics, vol. 10, 2019.
  189. J. Yosinski, J. Clune, Y. Bengio, and H. Lipson, "How transferable are features in deep neural networks?" in Proc. Adv. Neural Inf. Process. Syst., 2014, pp. 3320-3328.
  190. M. Ghafoorian et al., "Transfer learning for domain adaptation in MRI: Application in brain lesion segmentation," in Proc. Inf. Conf. Med. Image Comput. Comput.-Assisted Intervention, 2017, pp. 516-524.
  191. A. Madani, M. Moradi, A. Karargyris, and T. Syeda-Mahmood, "Semi- supervised learning with generative adversarial networks for chest X-ray classification with ability of data domain adaptation," in Proc. IEEE 15th Int. Symp. Biomed. Imag., 2018, pp. 1038-1042.
  192. C. Wachinger et al., "Domain adaptation for Alzheimer's disease diag- nostics," Neuroimage, vol. 139, pp. 470-479, 2016.
  193. G. Wilson and D. J. Cook, "A survey of unsupervised deep domain adaptation," ACM Trans. Intell. Syst. Technol., vol. 11, no. 5, pp. 1-46, 2020.
  194. F. Mahmood, R. Chen, and N. J. Durr, "Unsupervised reverse domain adaptation for synthetic medical images via adversarial training," IEEE Trans. Med. Imag., vol. 37, no. 12, pp. 2572-2581, Dec. 2018.
  195. J. Xu, L. Xiao, and A. M. López, "Self-supervised domain adaptation for computer vision tasks," IEEE Access, vol. 7, pp. 156 694-156 706, 2019.
  196. J. Wiens et al., "Do no harm: A roadmap for responsible machine learning for health care," Nature Med., vol. 25, no. 9, pp. 1337-1340, 2019.
  197. S. Latif, A. Qayyum, M. Usama, J. Qadir, A. Zwitter, and M. Shahzad, "Caveat emptor: The risks of using big data for human development," IEEE Technol. Soc. Mag., vol. 38, no. 3, pp. 82-90, Sep. 2019.
  198. X. Jia, L. Ren, and J. Cai, "Clinical implementation of AI technologies will require interpretable AI models," Med. Phys., vol. 47, no. 1, pp. 1-4, 2020.
  199. S. Bach, A. Binder, G. Montavon, F. Klauschen, K.-R. Müller, and W. Samek, "On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation," PloS One, vol. 10, no. 7, 2015, Art. no. e0130140.
  200. O. Lahav, N. Mastronarde, and M. van der Schaar, "What is interpretable? using machine learning to design interpretable decision-support sys- tems," in Proc. Mach. Learn. Health Workshop NeurIPS, 2018.

200 of 206 shown

Cited by

Sorted by citations

Authors
Qayyum, A., Qadir, J., Bilal, M., & Al-Fuqaha, A.
Affiliations
  • Information Technology University (PK)
  • University of the West of England (GB)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2020
Volume
14
Pages
156-180
ISSN
1937-3333 (ISSN-L)
DOI
10.48550/arxiv.2001.08103
arXiv
2001.08103
OpenAlex
W3001584199
Cited by
59
References
0
Citations by year
2026: 1 · 2025: 5 · 2024: 13 · 2023: 14 · 2022: 11 · 2021: 9 · 2020: 6
FWCI
0.34
Type
journal article
Language
en
Open access
Licence
Locations
  • IEEE Reviews in Biomedical Engineering (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • Figshare (submittedVersion, cc-by)
  • arXiv (Cornell University)
Funders
Qatar National Library
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
secure machine learning, privacy-preserving machine learning, adversarial attacks, medical applications, computer-aided diagnosis, medical image analysis, cardiac arrest prediction, medical data privacy
MeSH terms
Machine Learning, Confidentiality, Diagnosis, Computer-Assisted, Humans, Electronic Health Records

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review