The DOI matches its Crossref record; 253 of the 253 references it cites were found in a registry or an index.
Deep learning modelling techniques: current progress, applications, advantages, and challenges
Open accessAbstract
Deep learning (DL) is revolutionizing evidence-based decision-making techniques that can be applied across various sectors. Specifically, it possesses the ability to utilize two or more levels of non-linear feature transformation of the given data via representation learning in order to overcome limitations posed by large datasets. As a multidisciplinary field that is still in its nascent phase, articles that survey DL architectures encompassing the full scope of the field are rather limited. Thus, this paper comprehensively reviews the state-of-art DL modelling techniques and provides insights into their advantages and challenges. It was found that many of the models exhibit a highly domain-specific efficiency and could be trained by two or more methods. However, training DL models can be very time-consuming, expensive, and requires huge samples for better accuracy. Since DL is also susceptible to deception and misclassification and tends to get stuck on local minima, improved optimization of parameters is required to create more robust models. Regardless, DL has already been leading to groundbreaking results in the healthcare, education, security, commercial, industrial, as well as government sectors. Some models, like the convolutional neural network (CNN), generative adversarial networks (GAN), recurrent neural network (RNN), recursive neural networks, and autoencoders, are frequently used, while the potential of other models remains widely unexplored. Pertinently, hybrid conventional DL architectures have the capacity to overcome the challenges experienced by conventional models. Considering that capsule architectures may dominate future DL models, this work aimed to compile information for stakeholders involved in the development and use of DL models in the contemporary world.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“AI-personalized recommendation is based on deep learning technology, which includes algorithms such as multi-layer perception, convolutional neural network, recursive neural network, generative adversarial network, and graph neural network [67][68][69][70], and performs potential analysis of characteristics around the consumer's basic information, behavior, socialization, similar groups of people,”
From The Impact of AI-Personalized Recommendations on Clicking Intentions: Evidence from Chinese E-Commerce (2025) · cites this paper as [67]
In the citing paper
“AI-personalized recommendation is based on deep learning technology, which includes algorithms such as multi-layer perception, convolutional neural network, recursive neural network, generative adversarial network, and graph neural network [67][68][69][70], and performs potential analysis of characteristics around the consumer's basic information, behavior, socialization, similar groups of people,”
From The Impact of AI-Personalized Recommendations on Clicking Intentions: Evidence from Chinese E-Commerce (2025) · cites this paper as [67]
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
Advances in neural information processing systems 7
Cios, K., & Shields, M. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,059
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Research works printed but not linked: 54
- Adhikari A, Ram A, Tang R, Lin J (2019) DocBERT: BERT for document classification. arXiv:1904.08398 · arXiv
- Alain G, Bengio Y, Courville A, Fergus R, Manning C (2014) What regularized auto-encoders learn from the data-generating distribution. J Mach Learn Res 15(1):3563–3593
- Alpaydin E (2020) Introduction to machine learning. MIT Press, Cambridge
- Arora S, Ma T, Moitra A (2015) Simple, efficient, and neural algorithms for sparse coding. PMLR, pp 113–149
- Ba J, Hinton G, Mnih V, Leibo JZ, Ionescu C (2016) Using fast weights to attend to the recent past. Adv Neural Inf Process Syst 29:4338–4346
- Bartunov S, Rae JW, Osindero S, Lillicrap TP (2019) Meta-learning deep energy-based memory models. https://arXiv.org/1910.02720
- Bau D, Zhu JY, Strobelt H, Zhou B, Tenenbaum JB, Freeman WT, Torralba A (2019) GaN dissection: visualizing and understanding generative adversarial networks. In: 7th international conference on learning representations, ICLR 2019
- Bousmalis K, Trigeorgis G, Silberman N, Krishnan D, Erhan D (2016) Domain separation networks. In: Advances in neural information processing systems
- Brahma S (2018) Improved sentence modeling using suffix bidirectional LSTM. https://arXiv.org/1805.07340
- Brock A, Donahue J, Simonyan K (2019) Large scale GaN training for high fidelity natural image synthesis. In: 7th international conference on learning representations, ICLR 2019
- Case C, Casper J, Catanzaro B, Diamos G, Elsen E (2014) Deep speech: scaling up end-to-end speech recognition. https://arXiv.org/1412.5567
- Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P (2011) Natural language processing (Almost) from scratch. J Mach Learn Res 12:2493–2537
- Dahl GE, Ranzato M, Mohamed AR, Hinton G (2010) Phone recognition with the mean-covariance restricted Boltzmann machine. Adv Neural Inf Process Syst 23:469–477
- Demeester T, Sutskever I, Chen K, Dean J, Corado G (2016) Distributed representations of words and phrases and their compositionality. EMNLP 2016 - Conference empirical methods natural language process processing
- Deoras A, Povey D, Mikolov T, Burget L, Černocký J (2011) Strategies for training large scale neural network language models. In: IEEE workshop on automatic speech recognition and understanding pp 196–201
- Gallicchio C Micheli A Pedrelli L (2018a) Deep echo state networks for diagnosis of Parkinson’s disease. In: ESANN 2018a - Proceedings, European symposium on artificial neural networks, computational intelligence and machine learning
- Gehring J, Auli M, Grangier D, Yarats D, Dauphin YN (2017) Convolutional sequence to sequence learning. In: 34th International conference on machine learning, ICML 2017
- Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT Press, Cambridge
- Goodfellow IJ, Warde-Farley D, Mirza M, Courville A, Bengio Y (2013) Maxout networks. In: 30th International conference on machine learning, ICML 2013.
- Hamilton WL, Ying R, Leskovec J (2017) Representation learning on graphs: methods and applications. https://arXiv.org/1709.05584
- Irsoy O, Cardie C (2014) Deep recursive neural networks for compositionality in language. In: Advances in neural information processing systems
- Kaiser Ł, Sutskever I (2016) Neural GPUs learn algorithms. In: 4th International conference on learning representations, ICLR 2016 - conference track proceedings
- Karras T, Aila T, Laine S, Lehtinen J (2018) Progressive growing of GANs for improved quality, stability, and variation. In: 6th international conference on learning representations, ICLR 2018 - conference track proceedings
- Kim JH, On KW, Lim W, Kim J, Ha JW, Zhang BT (2017) Hadamard product for low-rank bilinear pooling. In: 5th international conference on learning representations, ICLR 2017 - conference track proceedings
- Kiros R, Zhu Y, Salakhutdinov R, Zemel RS, Torralba A, Urtasun R, Fidler S (2015) Skip-thought vectors. Advances in neural information processing systems
- Li JB, Schmidt FR, Kolter JZ (2019a) Adversarial camera stickers: a physical camera-based attack on deep learning systems. In: International conference on machine learning. pp 3896–3904
- Lin Z, Feng M, Dos Santos CN, Yu M, Xiang B, Zhou B, Bengio Y (2017) A structured self-attentive sentence embedding. In: 5th international conference on learning representations, ICLR 2017 - conference track proceedings
- Liu P, Qiu X, Xuanjing H (2016) Recurrent neural network for text classification with multi-task learning. In: IJCAI international joint conference on artificial intelligence
- Mesnil G, Dauphin Y, Yao K, Bengio Y, Deng L, Hakkani-tur D, He X (2015) Using recurrent neural networks for slot filling in spoken language understanding. IEEE/ACM trans audio, speech Lang Process 23:530–539
- Mikolov T, Chen K, Corrado G Dean J (2013) Efficient estimation of word representations in vector space. In: 1st international conference on learning representations, ICLR 2013 - workshop track proceedings
- Misra D (2019) Mish: a self regularized non-monotonic neural activation function. https://arXiv.org/1908.08681
- Miyato T, Kataoka T, Koyama M, Yoshida Y (2018) Spectral normalization for generative adversarial networks. In: 6th international conference on learning representations, ICLR 2018 - conference track proceedings
- Ngiam J, Chen Z, Wei Koh P, Ng AY (2011) Learning deep energy models. In: Proceedings of the 28th international conference on machine learning (ICML-11) pp 1105–1112
- Nwankpa CE, Ijomah W, Gachagan A, Marshall S (2018) Activation functions: comparison of trends in practice and research for deep learning. https://arXiv.org/1811.03378
- Odena A, Olah C, Shlens J (2017) Conditional image synthesis with auxiliary classifier gans. In: 34th International conference on machine learning, ICML 2017
- Oka A, Ishimura N, Ishihara S (2021) A new dawn for the use of artificial intelligence in gastroenterology. Hepatol Pancreatol Diagn 11:1719
- Oord VD, Dieleman S, Schrauwen B (2013) Deep content-based music recommendation. Neural Inform Process Syst 26:1–9
- Papineni K, Roukos S, Ward T, Zhu W-J (2001) BLEU: a method for automatic evaluation of machine translation. Assoc Comput Linguist. https://doi.org/10.3115/10730831073135 · doi:10.3115/10730831073135
- Paula EL, Ladeira M, Carvalho RN, Marzag T (2016) Deep learning anomaly detection as support fraud investigation in Brazilian exports and anti-money laundering. In: 2016 15th IEEE International conference on machine learning and applications (ICMLA) pp 954–960. https://doi.org/10.1109/ICMLA.2016.73 · doi:10.1109/icmla.2016.73
- Paulus R, Xiong C, Socher R (2018) A deep reinforced model for abstractive summarization. In: 6th international conference on learning representations, ICLR 2018 - conference track proceedings
- Saremi S, Mehrjou A, Schölkopf B, Hyvärinen A (2018) Deep energy estimator networks. https://arXiv.1805.08306
- Shoeibi A, Ghassemi N, Khodatars M, Jafari M, Hussain S, Alizadehsani R (2020) Application of deep learning techniques for automated detection of epileptic seizures: a Review. https://arXiv.org/2007.01276
- Socher R, Chen D, Manning CD, Ng AY (2013) Reasoning with neural tensor networks for knowledge base completion. Adv Neural Inf Proc Syst 1:e2
- Sønderby CK, Caballero J, Theis L, Shi W, Huszár F (2017) Amortised map inference for image super-resolution. In: 5th international conference on learning representations, ICLR 2017 - conference track proceedings
- Sutskever I, Vinyals O, Le QV (2014) Sequence to sequence learning with neural networks. In: Advances in neural information processing systems
- Sutskever I, Hinton G (2007) Learning multilevel distributed representations for high-dimensional sequences. J Machine Learn Res. 2:548–555
- Taigman Y, Polyak A, Wolf L (2017) Unsupervised cross-domain image generation. In: 5th international conference on learning representations, ICLR 2017 - conference track proceedings
- Tang Y (2013) Deep learning using linear support vector machines. https://arXiv.org/1306.0239
- Tkachenko Y (2015) Autonomous CRM control via CLV approximation with deep reinforcement learning in discrete and continuous action space. arXiv:1504.01840. https://arXiv.org/1504.01840 · arXiv
- Tompson J, Jain A, Lecun Y, Bregler C (2014) Joint training of a convolutional network and a graphical model for human pose estimation. 27:1–9 https://arXiv.org/1406.2984
- Trabelsi C, Bilaniuk O, Zhang Y, Serdyuk D, Subramanian S, Santos JF, Mehri S, Rostamzadeh N, Bengio, Y, Pal CJ (2018) Deep complex networks. In: 6th international conference on learning representations, ICLR 2018 - conference track proceedings
- Vaswani A (2017) Attention is all you need . Adv Neural Inf Process Syst 2017 pp 5999–6009 arXiv:1706.03762v5 · arXiv
- Wang X, Jiang, W, Luo Z (2016c) Combination of convolutional and recurrent neural network for sentiment analysis of short texts. In: COLING 2016 - 26th international conference on computational linguistics, proceedings of COLING 2016: technical papers
- Yang B, Yih W tau, He X, Gao J, Deng L (2015) Embedding entities and relations for learning and inference in knowledge bases. In: 3rd international conference on learning representations, ICLR 2015 - conference track proceedings
Cited by
Recurrent Neural Networks: A Comprehensive Review of Architectures, Variants, and Applications
Mienye, I. D., Swart, T. G., & Obaido, G. (2024) · Information · doi:10.3390/info15090517 · Cited by 732
The Impact of Artificial Intelligence on Language Translation: A Review
Mohamed, Y. A., Khanan, A., Bashir, M., Mohamed, A. H. H. M., Adiel, M. A. E., & Elsadig, M. A. (2024) · IEEE Access · doi:10.1109/access.2024.3366802 · Cited by 166
Chowdhury, M. S. (2024) · Environmental Challenges · doi:10.1016/j.envc.2023.100800 · Cited by 196
Shoaib, M. A., Sadeghi‐Niaraki, A., Ali, F., Hussain, I., & Khalid, S. (2025) · Frontiers in Plant Science · doi:10.3389/fpls.2025.1538163 · Cited by 200
AI-driven biomarker discovery: enhancing precision in cancer diagnosis and prognosis
Alum, E. U. (2025) · Discover Oncology · doi:10.1007/s12672-025-02064-7 · Cited by 172
Metadata
- Authors
- Ahmed, S. F., Alam, M. S. B., Hassan, M., Rozbu, M. R., Ishtiak, T., Rafa, N., Mofijur, M., Shawkat Ali, A. B. M., & Gandomi, A. H.
- Affiliations
- Asian University for Women (BD)
- Asian Institute of Technology (TH)
- Carnegie Mellon University (US)
- Carleton University (CA)
- University of Cambridge (GB)
- University of Technology Sydney (AU)
- Obuda University (HU)
- Corresponding author
- Ahmed, Shams Forruque
- Gandomi, Amir H.
- ORCID
- Venue
- Artificial Intelligence Review
- Published
- 2023-04-17
- Volume
- 56
- Issue
- 11
- Pages
- 13521-13617
- ISSN
- 0269-2821 (ISSN-L)
- 1573-7462
- OpenAlex
- W4366091323
- Cited by
- 1,079
- References
- 252
- Citations by year
- 2026: 337 · 2025: 500 · 2024: 222 · 2023: 20
- FWCI
- 101.71
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Artificial Intelligence Review (publishedVersion, cc-by)
- Apollo (University of Cambridge) (submittedVersion, cc-by)
- Funders
- University of Technology Sydney
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Keywords
- deep learning architectures, representation learning, convolutional neural networks, generative adversarial networks, recurrent neural networks, autoencoder, capsule networks, training problems, model robustness, local minima, deep learning applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Deep learning modelling techniques: current progress, applications, advantages, and challenges. https://app.cochat.ai/papers/10.1007/s10462-023-10466-8
- The paper
- Ahmed, S. F., Alam, M. S. B., Hassan, M., Rozbu, M. R., Ishtiak, T., Rafa, N., Mofijur, M., Shawkat Ali, A. B. M., & Gandomi, A. H. (2023). Deep learning modelling techniques: current progress, applications, advantages, and challenges. Artificial Intelligence Review. https://doi.org/10.1007/s10462-023-10466-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.