The DOI matches its Crossref record; 76 of the 76 references it cites were found in a registry or an index.
Machine learning: Overview of the recent progresses and implications for the process systems engineering field
Abstract
Abstract Machine learning (ML) has recently gained in popularity, spurred by well-publicized advances like deep learning and widespread commercial interest in big data analytics. Despite the enthusiasm, some renowned experts of the field have expressed skepticism, which is justifiable given the disappointment with the previous wave of neural networks and other AI techniques. On the other hand, new fundamental advances like the ability to train neural networks with a large number of layers for hierarchical feature learning may present significant new technological and commercial opportunities. This paper critically examines the main advances in deep learning. In addition, connections with another ML branch of reinforcement learning are elucidated and its role in control and decision problems is discussed. Implications of these advances for the fields of process and energy systems engineering are also discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Neural networks and physical systems with emergent collective computational abilities.
Hopfield, J. J. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.8.2554 · Cited by 19,270
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Schölkopf, B., & Smola, A. J. (2001) · The MIT Press eBooks · doi:10.7551/mitpress/4175.001.0001 · Cited by 11,703
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Learning long-term dependencies with gradient descent is difficult
Bengio, Y., Simard, P., & Frasconi, P. (1994) · IEEE Transactions on Neural Networks · doi:10.1109/72.279181 · Cited by 8,542
Markov decision processes: Discrete stochastic dynamic programming
Hazeghi, K., & Puterman, M. L. (1995) · Journal of the American Statistical Association · doi:10.2307/2291177 · Cited by 8,037
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841
The Proper Orthogonal Decomposition in the Analysis of Turbulent Flows
Berkooz, G., Holmes, P., & Lumley, J. L. (1993) · Annual Review of Fluid Mechanics · doi:10.1146/annurev.fl.25.010193.002543 · Cited by 4,431
Learning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Williams, C. K. I. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s269 · Cited by 4,281
(1989) · neural information processing systems · Cited by 3,736
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318
Dueling Network Architectures for Deep Reinforcement Learning
Wang, Z., Schaul, T., Hessel, M., van Hasselt, H., Lanctot, M., & de Freitas, N. (2015) · arXiv · doi:10.48550/arxiv.1511.06581 · Cited by 3,300
Nonlinear principal component analysis using autoassociative neural networks
Kramer, M. A. (1991) · AIChE Journal · doi:10.1002/aic.690370209 · Cited by 3,037
A Survey of Monte Carlo Tree Search Methods
Browne, C. B., Powley, E., Whitehouse, D., Lucas, S. M., Cowling, P. I., Rohlfshagen, P., Tavener, S., Perez, D., Samothrakis, S., & Colton, S. (2012) · IEEE Transactions on Computational Intelligence and AI in Games · doi:10.1109/tciaig.2012.2186810 · Cited by 2,970
Bandit Based Monte-Carlo Planning
Kocsis, L., & Szepesvári, C. (2006) · Lecture Notes in Computer Science · doi:10.1007/11871842_29 · Cited by 2,855
Why Does Unsupervised Pre-training Help Deep Learning?
Erhan, D., Bengio, Y., Courville, A. C., Manzagol, P.-A., Vincent, P., & Samy Bengio, A. (2010) · Journal of Machine Learning Research · Cited by 2,631
Markov games as a framework for multi-agent reinforcement learning
Littman, M. L. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50027-1 · Cited by 2,614
Lee, H., Grosse, R., Ranganath, R., & Ng, A. Y. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553453 · Cited by 2,412
Reinforcement learning and adaptive dynamic programming for feedback control
Lewis, F. L., & Vrabie, D. (2009) · IEEE Circuits and Systems Magazine · doi:10.1109/mcas.2009.933854 · Cited by 1,558
Bandit processes and dynamic allocation indices
Gittins, J. C. (1979) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1979.tb01068.x · Cited by 1,487
Neural networks and principal component analysis: Learning from examples without local minima
Baldi, P., & Hornik, K. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90014-2 · Cited by 1,383
Efficient Selectivity and Backup Operators in Monte-Carlo Tree Search
Coulom, R. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-75538-8_7 · Cited by 1,240
Prokhorov, D. V., & Wunsch, D. C. (1997) · IEEE Transactions on Neural Networks · doi:10.1109/72.623201 · Cited by 1,186
An introduction to the proper orthogonal decomposition
Chatterjee, A. (2000) · Cited by 1,038
Approximate dynamic programming for real-time control and neural modeling
Werbos, P. J. (1992) · Medical Entomology and Zoology · Cited by 971
(2007) · Cited by 937
(1991) · The MIT Press eBooks · doi:10.7551/mitpress/4939.001.0001 · Cited by 873
Identifying and attacking the saddle point problem in high-dimensional non-convex optimization
Dauphin, Y., Pascanu, R., Gulcehre, C., Cho, K., Ganguli, S., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.2572 · Cited by 827
Multiple Object Recognition with Visual Attention
Ba, J., Mnih, V., & Kavukcuoglu, K. (2014) · arXiv · doi:10.48550/arxiv.1412.7755 · Cited by 808
Practical issues in temporal difference learning
Tesauro, G. (1992) · Machine Learning · doi:10.1007/bf00992697 · Cited by 787
Deep Reinforcement Learning: An Overview
Li, Y. (2017) · arXiv · doi:10.48550/arxiv.1701.07274 · Cited by 762
A Comprehensive Review of Stability Analysis of Continuous-Time Recurrent Neural Networks
Zhang, H., Wang, Z., & Liu, D. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2317880 · Cited by 654
A Menu of Designs for Reinforcement Learning Over Time
Werbos, P. J. (1991) · Neural Networks for Control · doi:10.7551/mitpress/4939.003.0007 · Cited by 605
Autoassociative neural networks
Kramer, M. A. (1992) · Computers & Chemical Engineering · doi:10.1016/0098-1354(92)80051-a · Cited by 532
Powell, W. B. (2007) · Cited by 471
A Knowledge-Gradient Policy for Sequential Information Collection
Frazier, P. I., Powell, W. B., & Dayanik, S. (2008) · SIAM Journal on Control and Optimization · doi:10.1137/070693424 · Cited by 447
The Knowledge-Gradient Policy for Correlated Normal Beliefs
Frazier, P., Powell, W., & Dayanik, S. (2009) · INFORMS Journal on Computing · doi:10.1287/ijoc.1080.0314 · Cited by 408
Learning hierarchical representations for face verification with convolutional deep belief networks
Huang, G. B., Lee, H., & Learned-Miller, E. (2012) · 2012 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2012.6247968 · Cited by 407
Dearden, R., Friedman, N., & Russell, S. (1998) · Cited by 363
A Bayesian Framework for Reinforcement Learning
Strens, M. J. A. (2000) · International Conference on Machine Learning · Cited by 358
An analytic solution to discrete Bayesian reinforcement learning
Poupart, P., Vlassis, N., Hoey, J., & Regan, K. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143932 · Cited by 278
Wave‐net: a multiresolution, hierarchical neural network with localized learning
Bakshi, B. R., & Stephanopoulos, G. (1993) · AIChE Journal · doi:10.1002/aic.690390108 · Cited by 249
Optimal learning: computational procedures for bayes-adaptive markov decision processes
Duff, M. O., & Barto, A. G. (2002) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 239
Model-Based Bayesian Exploration
Dearden, R., Friedman, N., & André, D. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1301.6690 · Cited by 221
Many regression algorithms, one unified model: A review
Stulp, F., & Sigaud, O. (2015) · Neural Networks · doi:10.1016/j.neunet.2015.05.005 · Cited by 220
(2009) · Control Theory · doi:10.1109/9780470544334.ch10 · Cited by 207
The Curse of Highly Variable Functions for Local Kernel Machines
Bengio, Y., Delalleau, O., & Roux, N. L. (2005) · Cited by 193
The Knowledge Gradient Algorithm for a General Class of Online Learning Problems
Ryzhov, I. O., Powell, W. B., & Frazier, P. I. (2012) · Operations Research · doi:10.1287/opre.1110.0999 · Cited by 159
Use of neural networks for sensor failure detection in a control system
Naidu, S. R., Zafiriou, E., & McAvoy, T. J. (1990) · IEEE Control Systems Magazine · doi:10.1109/37.55124 · Cited by 155
Bayesian Decision Problems and Markov Chains.
Olshen, R. A., & Martin, J. J. (1968) · Journal of the American Statistical Association · doi:10.2307/2285906 · Cited by 154
Discrete time recurrent neural network architectures: A unifying review
Tsoi, A. C., & Back, A. D. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)00161-6 · Cited by 141
An Adaptive Sampling Algorithm for Solving Markov Decision Processes
Chang, H. S., Fu, M. C., Hu, J., & Marcus, S. I. (2005) · Operations Research · doi:10.1287/opre.1040.0145 · Cited by 139
Lee, J. M., & Lee, J. H. (2005) · Automatica · doi:10.1016/j.automatica.2005.02.006 · Cited by 139
Self-citationThe Knowledge-Gradient Algorithm for Sequencing Experiments in Drug Discovery
Negoescu, D. M., Frazier, P. I., & Powell, W. B. (2010) · INFORMS journal on computing · doi:10.1287/ijoc.1100.0417 · Cited by 137
Forecasting and control using adaptive connectionist networks
Ydstie, B. E. (1990) · Computers & Chemical Engineering · doi:10.1016/0098-1354(90)87029-o · Cited by 121
Optimal learning and experimentation in bandit problems
Brezzi, M., & Lai, T. L. (2002) · Journal of Economic Dynamics and Control · doi:10.1016/s0165-1889(01)00028-8 · Cited by 109
Operational planning and optimal sizing of microgrid considering multi-scale wind uncertainty
Shin, J., Lee, J. H., & Realff, M. J. (2017) · Applied Energy · doi:10.1016/j.apenergy.2017.03.081 · Cited by 106
Self-citationIntegrating Sample-Based Planning and Model-Based Reinforcement Learning
Walsh, T., Goschin, S., & Littman, M. L. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7689 · Cited by 105
Lee, J. M., & Lee, J. H. (2004) · International Journal of Control Automation and Systems · Cited by 103
Self-citationFeature Selection as a One-Player Game
Gaudel, R., & Sébag, M. (2010) · Cited by 86
Approximate dynamic programming based approach to process control and scheduling
Lee, J. H., & Lee, J. M. (2006) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2006.05.043 · Cited by 69
Self-citationLee, J. M., Kaisare, N. S., & Lee, J. H. (2005) · Journal of Process Control · doi:10.1016/j.jprocont.2005.04.010 · Cited by 69
Self-citationApproximate dynamic programming approach for process control
Lee, J. H., & Wong, W. (2010) · Journal of Process Control · doi:10.1016/j.jprocont.2010.06.007 · Cited by 65
Self-citationBandit-based optimization on graphs with application to library performance tuning
de Mesmay, F., Rimmel, A., Voronenko, Y., & Püschel, M. (2009) · International Conference on Machine Learning · doi:10.1145/1553374.1553468 · Cited by 62
Monte-Carlo tree search in production management problems
Chaslot, G. M. J. B., de Jong, S., Saito, J.-T., & UITERWIJK, J. W. H. M. (2006) · Research Publications (Maastricht University) · Cited by 49
Information Collection on a Graph
Ryzhov, I. O., & Powell, W. B. (2011) · Operations Research · doi:10.1287/opre.1100.0873 · Cited by 44
(2019) · doi:10.1287/orms.2016.05.10 · Cited by 10
Cited by
A review On reinforcement learning: Introduction and applications in industrial process control
Nian, R., Liu, J., & Huang, B. (2020) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2020.106886 · Cited by 711
The promise of artificial intelligence in chemical engineering: Is it here, finally?
Venkatasubramanian, V. (2019) · AIChE Journal · doi:10.1002/aic.16489 · Cited by 664
Xia, K., Sacco, C., Kirkpatrick, M., Saidy, C., Nguyen, L., Kircaliali, A., & Harik, R. (2021) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2020.06.012 · Cited by 406
Continuum theory for dense gas-solid flow: A state-of-the-art review
Wang, J. (2020) · Chemical Engineering Science · doi:10.1016/j.ces.2019.115428 · Cited by 368
Forecasting yield by integrating agrarian factors and machine learning models: A survey
Elavarasan, D., Vincent, D. R., Sharma, V., Zomaya, A. Y., & Srinivasan, K. (2018) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2018.10.024 · Cited by 346
Metadata
- Authors
- Lee, J. H., Shin, J., & Realff, M. J.
- Venue
- Computers & Chemical Engineering
- Publisher
- Elsevier BV
- Published
- 2018-06
- Volume
- 114
- Pages
- 111-121
- ISSN
- 0098-1354 (ISSN-L)
- OpenAlex
- W2764120290
- Cited by
- 387
- References
- 76
- FWCI
- 16.07
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.