Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Sign Up
Cited by 432

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

A comprehensive survey and analysis of generative models in machine learning

GM, Harshvardhan, Gourisaria, Mahendra Kumar, Pandey, Manjusha, Rautaray, Siddharth Swarup·2020·Computer Science Review
DOI 10.1016/j.cosrev.2020.100285
Open this paper in CoChat — free account

Abstract

Abstract Generative models have been in existence for many decades. In the field of machine learning, we come across many scenarios when directly learning a target is intractable through discriminative models, and in such cases the joint distribution of the target and the training data is approximated and generated. These generative models help us better represent or model a set of data by generating data in the form of Markov chains or simply employing a generative iterative process to do the same. With the recent innovation of Generative Adversarial Networks (GANs), it is now possible to make use of AI to generate pieces of art, music, etc. with a high extent of realism. In this paper, we review and analyse critically all the generative models, namely Gaussian Mixture Models (GMM), Hidden Markov Models (HMM), Latent Dirichlet Allocation (LDA), Restricted Boltzmann Machines (RBM), Deep Belief Networks (DBN), Deep Boltzmann Machines (DBM), and GANs. We study their algorithms and implement each of the models to provide the reader some insights on which generative model to pick from while dealing with a problem. We also provide some noteworthy contributions done in the past to these models from the literature.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.cosrev.2020.100285

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 11 references

Research works printed but not linked: 41

  1. K. He, G. Gkioxari, P. Dollár, R. Girshick, Mask. r cnn, Mask r-cnn, in: Proceedings of the IEEE international conference on computer vision, 2017, pp. 2961-2969. · DOI · Paper page
  2. Nayak, 2013, Prediction of extreme rainfall event using weather pattern recognition and support vector machine classifier, Theor. Appl. Climatol., 114, 583, 10.1007/s00704-013-0867-3 · DOI
  3. Yang, 2001, An early warning system for loan risk assessment using artificial neural networks, Knowledge-Based Systems, 14, 303, 10.1016/S0950-7051(01)00110-1 · DOI
  4. Likas, 2003, The global k-means clustering algorithm, Pattern Recognit., 36, 451, 10.1016/S0031-3203(02)00060-2 · DOI
  5. Dupont, 2005, Links between probabilistic automata and hidden Markov models: probability distributions, learning models and induction algorithms, Pattern Recognit., 38, 1349, 10.1016/j.patcog.2004.03.020 · DOI
  6. Bahl, 1993, Estimating hidden Markov model parameters so as to maximize speech recognition accuracy, IEEE Trans. Speech Audio Process., 1, 77, 10.1109/89.221369 · DOI
  7. Lee, 1988, On large-vocabulary speaker-independent continuous speech recognition, Speech Commun., 7, 375, 10.1016/0167-6393(88)90053-2 · DOI
  8. Agazzi, 1993, Hidden markov model based optical character recognition in the presence of deterministic transformations, Pattern Recognit., 26, 1813, 10.1016/0031-3203(93)90178-Y · DOI
  9. Blei, 2003, Latent Dirichlet allocation, J. Mach. Learn. Res., 3, 993
  10. Lukins, 2010, Bug localization using latent Dirichlet allocation, Inf. Softw. Technol., 52, 972, 10.1016/j.infsof.2010.04.002 · DOI · Paper page
  11. Lienou, 2010, Semantic annotation of satellite images using latent Dirichlet allocation, IEEE Geosci. Remote Sens. Lett., 7, 28, 10.1109/LGRS.2009.2023536 · DOI · Paper page
  12. Georgiev, 2003, A non-iid framework for collaborative filtering with restricted boltzmann machines, ICML, 1148
  13. The, 2001, Rate-coded restricted Boltzmann machines for face recognition, Adv. Neural Inf. Process. Syst., 13, 908
  14. Wang, 2015, Sentiment-aspect extraction based on restricted Boltzmann machines, ACL
  15. Neal, 1992, Connectionist learning of belief networks, Artificial Intelligence, 56, 71, 10.1016/0004-3702(92)90065-6 · DOI
  16. Abdel-Zaher, 2016, Breast cancer classification using deep belief networks, Expert Syst. Appl., 46, 139, 10.1016/j.eswa.2015.10.015 · DOI · Paper page
  17. Kuremoto, 2014, Time series forecasting using a deep belief network with restricted Boltzmann machines, Neurocomputing, 137, 47, 10.1016/j.neucom.2013.03.047 · DOI · Paper page
  18. Zhang, 2013, Deep belief networks based voice activity detection, IEEE Trans. Audio Speech Lang. Process., 21, 697, 10.1109/TASL.2012.2229986 · DOI · Paper page
  19. H. Lee, Y. Largman, P. Pham, A.Y. Ng, Unsupervised feature learning for audio classification using convolutional deep belief networks, in: Proceedings of the 22nd International Conference on Neural Information Processing Systems (NIPS’09), 2009.
  20. R. Salakhutdinov, G. Hinton, Deep Boltzmann machines, in: Proceedings of the Twelth International Conference on Artificial Intelligence and Statistics, Vol. 5, 2009, pp. 448-455.
  21. Salakhutdinov, 2010, Efficient learning of deep boltzmann machines AISTATS, PMLR, 693
  22. Srivastava, 2014, Multimodal learning with deep Boltzmann machines, JMLR, 15, 2949
  23. Leng, 2015, A 3D model recognition mechanism based on deep Boltzmann machines, Neurocomputing, 151, 593, 10.1016/j.neucom.2014.06.084 · DOI
  24. Liu, 2018, Constrained graph variational autoencoders for molecule design, Adv. Neural Inf. Process. Syst., 7795
  25. A.L. Maas, A.Y. Hannun, A.Y. Ng, Rectifier nonlinearities improve neural network acoustic models, in: Proc. ICML, Vol. 30 (1) , 2013, p. 3.
  26. Fang, 2018, A method for improving CNN-based image recognition using DCGAN CMC: Comput, Mater. Continua, 57, 167, 10.32604/cmc.2018.02356 · DOI
  27. Fang, 2019, Gesture recognition based on CNN and DCGAN for calculation and text output, IEEE Access, 7, 28230, 10.1109/ACCESS.2019.2901930 · DOI
  28. D.D. Kim, M.T. Shahid, Y. Kim, W.J. Lee, H.C. Song, F. Piccialli, K.N. Choi, Generating pedestrian training dataset using DCGAN, in: Proceedings of the 2019 3rd International Conference on Advances in Image Processing, 2019, November, pp. 1-4. · DOI
  29. P.L. Suárez, A.D. Sappa, B.X. Vintimilla, Infrared image colorization based on a triplet dcgan architecture, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2017, pp. 18-23. · DOI
  30. Zhang, 2019, Image de-raining using a conditional generative adversarial network, IEEE Trans. Circuits Syst. Video Technol., 1, 1
  31. X. Huang, Y. Li, O. Poursaeed, J. Hopcroft, S. Belongie, Stacked generative adversarial networks, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 5077-5086. · DOI · Paper page
  32. Uria, 2016, Neural autoregressive distribution estimation, J. Mach. Learn. Res., 17, 7184
  33. Frey, 1996, Does the wake-sleep algorithm produce good density estimators?, Adv. Neural Inf. Process. Syst., 661
  34. Harper, 2019, ACM Trans. Interact. Intell. Syst. (TiiS), 5
  35. Deerwester, 1990, Indexing by latent semantic analysis, J. Amer. Soc. Inf. Sci., 41, 391, 10.1002/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO;2-9 · DOI
  36. T. Hofmann, Probabilistic latent semantic indexing, in: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, 1999, pp. 50-57. · DOI · Paper page
  37. L. Hong, B.D. Davison, Empirical study of topic modeling in twitter, in: Proceedings of the first workshop on social media analytics, 2010, pp. 80-88. · DOI · Paper page
  38. Wu, 2014, Topic evolution based on LDA and HMM and its application in stem cell research, J. Inf. Sci., 40, 611, 10.1177/0165551514540565 · DOI
  39. B.J.P. Hsu, J. Glass, . J, Style & topic language model adaptation using HMM-LDA, in: Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, 2006, pp. 373-381. · DOI
  40. H. Zhang, T. Xu, H. Li, S. Zhang, X. Wang, X. Huang, D.N. Metaxas, Stackgan: Text to photo-realistic image synthesis with stacked generative adversarial networks, in: Proceedings of the IEEE international conference on computer vision, 2017, pp. 5907-5915. · DOI · Paper page
  41. Prosvetov, 2019, GAN for recommendation system, J. Phys. Conf. Ser., 1405, 10.1088/1742-6596/1405/1/012005 · DOI

Cited by

See all 432

Metadata

Authors
GM, H., Gourisaria, M. K., Pandey, M., & Rautaray, S. S.
Venue
Computer Science Review
Publisher
Elsevier BV
Published
2020-11
Volume
38
Pages
100285
ISSN
1574-0137 (ISSN-L)
DOI
10.1016/j.cosrev.2020.100285
OpenAlex
W3046095786
Cited by
432
References
11
FWCI
13.73
Type
journal article
Language
en
Open access
closed
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A comprehensive survey and analysis of generative models in machine learning. https://app.cochat.ai/papers/10.1016/j.cosrev.2020.100285
The paper
GM, H., Gourisaria, M. K., Pandey, M., & Rautaray, S. S. (2020). A comprehensive survey and analysis of generative models in machine learning. Computer Science Review. https://doi.org/10.1016/j.cosrev.2020.100285

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.