The DOI matches its Crossref record; 87 of the 88 references it cites were found in a registry or an index.
Advances and opportunities in machine learning for process data analytics
Abstract
Abstract In this paper we introduce the current thrust of development in machine learning and artificial intelligence, fueled by advances in statistical learning theory over the last 20 years and commercial successes by leading big data companies. Then we discuss the characteristics of process manufacturing systems and briefly review the data analytics research and development in the last three decades. We give three attributes for process data analytics to make machine learning techniques applicable in the process industries. Next we provide a perspective on the currently active topics in machine learning that could be opportunities for process data analytics research and development. Finally we address the importance of a data analytics culture. Issues discussed range from technology development to workforce education and from government initiatives to curriculum enhancement.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“artificial intelligence is proving to be an effective tool for predicting with great precision the possibility of an event occurring [60]”
From Burnout, Resilience, and COVID-19 among Teachers: Predictive Capacity of an Artificial Neural Network (2021) · cites this paper as [60]
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Cortes, C., & Vapnik, V. N. (1995) · Machine Learning · doi:10.1023/a:1022627411411 · Cited by 34,565
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 7,330
(2011) · Cited by 5,203
A survey of industrial model predictive control technology
Qin, S. J., & Badgwell, T. A. (2003) · Control Engineering Practice · doi:10.1016/s0967-0661(02)00186-7 · Cited by 5,111
Self-citationLearning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 5,050
Detecting influenza epidemics using search engine query data
Ginsberg, J., Mohebbi, M. H., Patel, R. S., Brammer, L., Smolinski, M. S., & Brilliant, L. (2009) · Nature · doi:10.1038/nature07634 · Cited by 4,295
Robust Recovery of Subspace Structures by Low-Rank Representation
Liu, G., Lin, Z., Yan, S., Sun, J., Yu, Y. H., & Ma, Y. (2012) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.88 · Cited by 3,585
Sparse Principal Component Analysis
Zou, H., Hastie, T., & Tibshirani, R. (2006) · Journal of Computational and Graphical Statistics · doi:10.1198/106186006x113430 · Cited by 3,152
Nonlinear principal component analysis using autoassociative neural networks
Kramer, M. A. (1991) · AIChE Journal · doi:10.1002/aic.690370209 · Cited by 3,037
The Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014) · Science · doi:10.1126/science.1248506 · Cited by 2,523
Simplified neuron model as a principal component analyzer
Oja, E. (1982) · Journal of Mathematical Biology · doi:10.1007/bf00275687 · Cited by 2,309
PCANet: A Simple Deep Learning Baseline for Image Classification?
Chan, T.-H., Jia, K., Gao, S., Lu, J., Zeng, Z., & Ma, Y. (2015) · IEEE Transactions on Image Processing · doi:10.1109/tip.2015.2475625 · Cited by 1,635
Statistical process monitoring: basics and beyond
Qin, S. J. (2003) · Journal of Chemometrics · doi:10.1002/cem.800 · Cited by 1,606
Self-citationA review on time series data mining
Fu, T.-C. (2010) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2010.09.007 · Cited by 1,565
Survey on data-driven industrial process monitoring and diagnosis
Qin, S. J. (2012) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2012.09.004 · Cited by 1,492
Self-citationMonitoring batch processes using multiway principal component analysis
Nomikos, P., & MacGregor, J. F. (1994) · AIChE Journal · doi:10.1002/aic.690400809 · Cited by 1,480
Fault Detection and Diagnosis in Industrial Systems
Chiang, E. L. R. A. R. D. B. L. H. (2001) · Measurement Science and Technology · doi:10.1088/0957-0233/12/10/706 · Cited by 1,424
Auto-association by multilayer perceptrons and singular value decomposition
Bourlard, H., & Kamp, Y. (1988) · Biological Cybernetics · doi:10.1007/bf00332918 · Cited by 1,391
IEEE Transactions on Pattern Analysis and Machine Intelligence
(1978) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.1978.308564 · Cited by 1,328
Fault Detection and Diagnosis in Industrial Systems
Chiang, L. H., Russell, E. L., & Braatz, R. D. (2001) · Advanced textbooks in control and signal processing · doi:10.1007/978-1-4471-0347-9 · Cited by 1,317
Self-citationStatistical process control of multivariate processes
MacGregor, J. F., & Kourti, T. (1995) · Control Engineering Practice · doi:10.1016/0967-0661(95)00014-l · Cited by 1,269
IEEE Transactions on Industrial Informatics
(2016) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2631734 · Cited by 1,218
A hybrid neural network‐first principles approach to process modeling
Psichogios, D. C., & Ungar, L. H. (1992) · AIChE Journal · doi:10.1002/aic.690381003 · Cited by 982
Review of Recent Research on Data-Based Process Monitoring
Ge, Z., Song, Z., & Gao, F. (2013) · Industrial & Engineering Chemistry Research · doi:10.1021/ie302069q · Cited by 969
(2015) · neural information processing systems · Cited by 912
On the Need for Time Series Data Mining Benchmarks: A Survey and Empirical Demonstration
Keogh, E., & Kasetty, S. (2003) · Data Mining and Knowledge Discovery · doi:10.1023/a:1024988512476 · Cited by 860
Principal components, minor components, and linear neural networks
Oja, E. (1992) · Neural Networks · doi:10.1016/s0893-6080(05)80089-9 · Cited by 826
The promise of artificial intelligence in chemical engineering: Is it here, finally?
Venkatasubramanian, V. (2018) · AIChE Journal · doi:10.1002/aic.16489 · Cited by 709
Sparse principal component analysis via regularized low rank matrix approximation
Shen, H., & Huang, J. Z. (2007) · Journal of Multivariate Analysis · doi:10.1016/j.jmva.2007.06.007 · Cited by 685
Chiang, L. H., Russell, E. L., & Braatz, R. D. (2000) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(99)00061-1 · Cited by 631
Self-citationNonlinear principal component analysis—Based on principal curves and neural networks
Dong, D., & McAvoy, T. J. (1996) · Computers & Chemical Engineering · doi:10.1016/0098-1354(95)00003-k · Cited by 630
Data-driven soft sensor development based on deep learning technique
Shang, C., Yang, F., Huang, D., & Lyu, W. (2014) · Journal of Process Control · doi:10.1016/j.jprocont.2014.01.012 · Cited by 551
Reinforcement learning is direct adaptive optimal control
Sutton, R. S., Barto, A. G., & Williams, R. J. (1992) · IEEE Control Systems · doi:10.1109/37.126844 · Cited by 537
Nonlinear PLS modeling using neural networks
Qin, S. J., & McAvoy, T. J. (1992) · Computers & Chemical Engineering · doi:10.1016/0098-1354(92)80055-e · Cited by 449
Self-citationData Preprocessing and Intelligent Data Analysis
Famili, A. F., SHEN, W., WEBER, R., & Simoudis, E. (1997) · Intelligent Data Analysis · doi:10.1016/s1088-467x(98)00007-9 · Cited by 418
Process data analytics in the era of big data
Qin, S. J. (2014) · AIChE Journal · doi:10.1002/aic.14523 · Cited by 388
Self-citationA new autocovariance least-squares method for estimating noise covariances
Odelson, B. J., Rajamani, M. R., & Rawlings, J. B. (2005) · Automatica · doi:10.1016/j.automatica.2005.09.006 · Cited by 383
Accurate estimation of influenza epidemics using Google search data via ARGO
Yang, S., Santillana, M., & Kou, S. (2015) · Proceedings of the National Academy of Sciences of the United States of America · doi:10.1073/pnas.1515373112 · Cited by 372
The Proceedings of the National Academy of Sciences
Wilson, E. B. (1918) · Science · doi:10.1126/science.47.1210.244 · Cited by 360
Reinforcement Learning – Overview of recent progress and implications for process control
Shin, J., Badgwell, T. A., Liu, K.-H., & Lee, J. H. (2019) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2019.05.029 · Cited by 322
Qin, S. J., & Zheng, Y. (2012) · AIChE Journal · doi:10.1002/aic.13959 · Cited by 266
Self-citationData Preprocessing and Intelligent Data Analysis
Famili, A. F., Shen, W., Weber, R. W., et al. (1997) · Intelligent Data Analysis · doi:10.3233/ida-1997-1102 · Cited by 260
Suykens, J. A. K., Vandewalle, J. P. L., & Moor, B. L. R. D. (1996) · Springer eBooks · doi:10.1007/978-1-4757-2493-6_4 · Cited by 212
A deep reinforcement learning approach for chemical production scheduling
Hubbs, C. D., Li, C., Sahinidis, N. V., Grossmann, I. E., & Wassick, J. M. (2020) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2020.106982 · Cited by 211
Big Data Analytics in Chemical Engineering
Chiang, L. H., Lu, B., & Castillo, I. (2017) · Annual Review of Chemical and Biomolecular Engineering · doi:10.1146/annurev-chembioeng-060816-101555 · Cited by 179
Self-citationReducing data dimensionality through optimizing neural network inputs
Tan, S., & Mayrovouniotis, M. L. (1995) · AIChE Journal · doi:10.1002/aic.690410612 · Cited by 175
Semiconductor manufacturing process control and monitoring: A fab-wide framework
Qin, S. J., Cherry, G. A., Good, R. P., Wang, J., & Harrison, C. A. (2005) · Journal of Process Control · doi:10.1016/j.jprocont.2005.06.002 · Cited by 170
Self-citationNonlinear Autoassociation Is Not Equivalent to PCA
Japkowicz, N., Hanson, S. J., & Gluck, M. A. (2000) · Neural Computation · doi:10.1162/089976600300015691 · Cited by 169
Soft-sensors for process estimation and inferential control
Tham, M. T., Montague, G. A., Morris, A. J., & Lant, P. A. (1991) · Journal of Process Control · doi:10.1016/0959-1524(91)87002-f · Cited by 164
Frontiers in Massive Data Analysis
National Research Council (2013) · National Academies Press eBooks · doi:10.17226/18374 · Cited by 164
Real-time fault detection and diagnosis using sparse principal component analysis
Gajjar, S., Külahçı, M., & Palazoğlu, A. (2017) · Journal of Process Control · doi:10.1016/j.jprocont.2017.03.005 · Cited by 155
Regression on dynamic PLS structures for supervised learning of dynamic data
Dong, Y., & Qin, S. J. (2018) · Journal of Process Control · doi:10.1016/j.jprocont.2018.04.006 · Cited by 142
Self-citationProcess control via artificial neural networks and reinforcement learning
Hoskins, J. C., & Himmelblau, D. M. (1992) · Computers & Chemical Engineering · doi:10.1016/0098-1354(92)80045-b · Cited by 121
Chemometrics and intelligent laboratory systems
(1988) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(88)80114-x · Cited by 119
Concurrent quality and process monitoring with canonical correlation analysis
Zhu, Q., Liu, Q., & Qin, S. J. (2017) · Journal of Process Control · doi:10.1016/j.jprocont.2017.06.017 · Cited by 119
Self-citationBakshi, B. R., & Stephanopoulos, G. N. (1994) · Computers & Chemical Engineering · doi:10.1016/0098-1354(94)85029-1 · Cited by 113
Deep Learning of Complex Batch Process Data and Its Application on Quality Prediction
Wang, K., Gopaluni, R. B., Chen, J., & Song, Z. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2018.2880968 · Cited by 107
Dynamic latent variable analytics for process operations and control
Dong, Y., & Qin, S. J. (2017) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2017.10.029 · Cited by 106
Self-citationNeural Networks for Intelligent Sensors and Control — Practical Issues and Some Solutions
Qin, S. J. (1997) · Elsevier eBooks · doi:10.1016/b978-012526430-3/50009-x · Cited by 86
Self-citationQuality Relevant and Independent Two Block Monitoring Based on Mutual Information and KPCA
Huang, J., & Yan, X. (2017) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2017.2682012 · Cited by 86
Wu, Q., & Vos, P. W. (2018) · Handbook of statistics · doi:10.1016/bs.host.2018.06.004 · Cited by 80
Pattern Matching in Multivariate Time Series Databases Using a Moving-Window Approach
Singhal, A. K., & Seborg, D. E. (2002) · Industrial & Engineering Chemistry Research · doi:10.1021/ie010517z · Cited by 79
Piovoso, M. J., Kosanovich, K. A., & Yuk, J. P. (1992) · IEEE Transactions on Instrumentation and Measurement · doi:10.1109/19.137358 · Cited by 70
determining model structure for neural models by network stripping
Bhat, N., & McAvoy, T. J. (1992) · Computers & Chemical Engineering · doi:10.1016/0098-1354(92)80047-d · Cited by 67
Chemical Process Performance Evaluation
Çınar, A., Palazoğlu, A., & Kayihan, F. (2007) · CRC Press eBooks · doi:10.1201/9781420020106 · Cited by 64
Multi-Label Dimensionality Reduction
Sun, L., Ji, S., & Ye, J. (2016) · Chapman & Hall/CRC eBooks · doi:10.1201/b16017 · Cited by 60
Li, G., Qin, S. J., & Zhou, D. (2010) · Industrial & Engineering Chemistry Research · doi:10.1021/ie901939n · Cited by 55
Self-citationMa, L., Dong, J., & Peng, K. (2018) · Neurocomputing · doi:10.1016/j.neucom.2018.01.028 · Cited by 55
Supervised linear dynamic system model for quality related fault detection in dynamic processes
Ge, Z., & Chen, X. (2016) · Journal of Process Control · doi:10.1016/j.jprocont.2016.06.003 · Cited by 51
Reinforcement Learning – Overview of Recent Progress and Implications for Process Control
Badgwell, T. A., Lee, J. H., & Liu, K.-H. (2018) · Computer-aided chemical engineering/Computer aided chemical engineering · doi:10.1016/b978-0-444-64241-7.50008-2 · Cited by 50
Total PLS Based Contribution Plots for Fault Diagnosis
.., L., Gäng, Qin, Q., Si-Zhao, Ji, Yin-Dong, Zhou, & Donghua (2009) · Acta Automatica Sinica · Cited by 47
Khare, S. K., Taran, S., & Jamthikar, A. D. (2024) · Institute of Physics eBooks · doi:10.1088/978-0-7503-5964-1 · Cited by 47
Deep learning for pyrolysis reactor monitoring: From thermal imaging toward smart monitoring system
Zhu, W., Ma, Y., Benton, M. G., Romagnoli, J. A., & Zhan, Y. (2018) · AIChE Journal · doi:10.1002/aic.16452 · Cited by 28
Total PLS Based Contribution Plots for Fault Diagnosis
Li, G., Qin, S. J., Ji, Y., & Zhou, D. (2009) · Acta Automatica Sinica · doi:10.1016/s1874-1029(08)60094-4 · Cited by 27
Self-citationRendall, R., Castillo, I., Lu, B., Colegrove, B. T., Broadway, M., Chiang, L. H., & Reis, M. S. (2018) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2018.07.001 · Cited by 26
Self-citationProceedings of 8th IEEE International Symposium on Intelligent Control
(1993) · The proceedings of the IEEE Conference on Control Applications/The proceedings of the ... IEEE Conference on Control Applications · doi:10.1109/isic.1993.397733 · Cited by 17
Quality-Relevant Monitoring and Diagnosis with Dynamic Concurrent Projection to Latent Structures
Liu, Q., Qin, S. J., & Chai, T. (2014) · IFAC Proceedings Volumes · doi:10.3182/20140824-6-za-1003.02329 · Cited by 16
Self-citationHierarchical Control for Large Scale Systems - A Survey
Williams, T. J. (1978) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)66100-7 · Cited by 16
Process Monitoring Using Model-Based PCA
Wachs, A., & Lewin, D. R. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)44911-1 · Cited by 13
A statistical perspective of neural networks for process modeling and control
Qin, S. J. (2002) · IEEE International Symposium on Intelligent Control · doi:10.1109/isic.1993.397629 · Cited by 11
Self-citationSpecial issue on big data: Data science for process control and operations
Qin, S. J. (2018) · Journal of Process Control · doi:10.1016/s0959-1524(18)30086-6 · Cited by 6
Self-citationQin, Y., & Zhao, C. (2018) · International Conference on Modelling, Identification and Control · doi:10.1109/icmic.2018.8529974 · Cited by 3
Research works printed but not linked: 4
- Colegrove, 2016, Big data - getting started on the journey, Chem. Eng. Prog., 41
- Kuo, C. C. J., Zhang, M., Li, S., Duan, J., & Chen, Y. (2018). Interpretable convolutional neural networks via feedforward design. arXiv:1810.02786. · DOI
- MacGregor, 1995, Statistical process control of multivariate processes, Control Eng. Practice, 3, 403, 10.1016/0967-0661(95)00014-L · DOI
- Reis, 2016, Big data challenges and future research directions, Chem. Eng. Progress, 46
Cited by
Sorted by citations
Stock price prediction using deep learning and frequency decomposition
Rezaei, H., Faaljou, H., & Mansourfar, G. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114332 · Cited by 398
Machine learning algorithms for social media analysis: A survey
T.K., B., Annavarapu, C. S. R., & Bablani, A. (2021) · Computer Science Review · doi:10.1016/j.cosrev.2021.100395 · Cited by 276
Artificial intelligence (AI) in augmented reality (AR)-assisted manufacturing applications: a review
Sahu, C. K., Young, C., & Rai, R. (2020) · International Journal of Production Research · doi:10.1080/00207543.2020.1859636 · Cited by 286
Perspectives on the integration between first-principles and data-driven modeling
Bradley, W., Kim, J., Kilwein, Z., Blakely, L., Eydenberg, M., Jalvin, J., Laird, C., & Boukouvala, F. (2022) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2022.107898 · Cited by 231
Bikmukhametov, T., & Jäschke, J. (2020) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2020.106834 · Cited by 202
Metadata
- Authors
- Qin, S. J., & Chiang, L. H.
- Affiliations
- University of Southern California (US)
- Dow Chemical (United States) (US)
- Corresponding author
- Qin, S. Joe
- Venue
- Computers & Chemical Engineering
- Publisher
- Elsevier BV
- Published
- 2019-07
- Volume
- 126
- Pages
- 465-473
- ISSN
- 0098-1354 (ISSN-L)
- OpenAlex
- W2941089296
- Semantic Scholar
- 36cfd68da9e0c521c8b09ecf9ca48e0dbf24cc19
- Cited by
- 351
- References
- 88
- Citations by year
- 2026: 21 · 2025: 39 · 2024: 52 · 2023: 75 · 2022: 58 · 2021: 53 · 2020: 39 · 2019: 14
- FWCI
- 22.71
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Computers & Chemical Engineering (publishedVersion)
- Funders
- University of Southern California
- Topics
- Physical Sciences › Engineering › Control and Systems Engineering › Fault Detection and Control Systems
- Social Sciences › Decision Sciences › Management Science and Operations Research › Impact of AI and Big Data on Business and Society
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Digital Transformation in Industry
- Keywords
- machine learning, process manufacturing, statistical learning theory, big data, workforce education, curriculum development, government initiatives, chemical process industry
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review