The DOI matches its Crossref record; 79 of the 79 references it cites were found in a registry or an index.
Data-driven performance analyses of wastewater treatment plants: A review
Open accessAbstract
Recent advancements in data-driven process control and performance analysis could provide the wastewater treatment industry with an opportunity to reduce costs and improve operations. However, big data in wastewater treatment plants (WWTP) is widely underutilized, due in part to a workforce that lacks background knowledge of data science required to fully analyze the unique characteristics of WWTP. Wastewater treatment processes exhibit nonlinear, nonstationary, autocorrelated, and co-correlated behavior that (i) is very difficult to model using first principals and (ii) must be considered when implementing data-driven methods. This review provides an overview of data-driven methods of achieving fault detection, variable prediction, and advanced control of WWTP. We present how big data has been used in the context of WWTP, and much of the discussion can also be applied to water treatment. Due to the assumptions inherent in different data-driven modeling approaches (e.g., control charts, statistical process control, model predictive control, neural networks, transfer functions, fuzzy logic), not all methods are appropriate for every goal or every dataset. Practical guidance is given for matching a desired goal with a particular methodology along with considerations regarding the assumed data structure. References for further reading are provided, and an overall analysis framework is presented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Standard methods: For the examination of water and waste water
(1990) · Analytical Biochemistry · doi:10.1016/0003-2697(90)90598-4 · Cited by 72,091
Adhi Harmoko, S., M.Komp, Jacquard, J. M., Zuse, K., & Eniac (2005) · Cited by 18,035
A fast learning algorithm for deep belief nets
Hinton, G. E., Osindero, S., & Teh, Y.-W. (2006) · Neural Computation · doi:10.1162/neco.2006.18.7.1527 · Cited by 16,336
An Introduction to Statistical Learning
James, G., Witten, D., Hastie, T., & Tibshirani, R. (2013) · Springer Texts in Statistics · doi:10.1007/978-1-4614-7138-7 · Cited by 12,106
Grossman, P. (2009) · Discrete Mathematics for Computing · doi:10.1007/978-0-230-37405-8_1 · Cited by 8,834
Outline of a New Approach to the Analysis of Complex Systems and Decision Processes
Zadeh, L. A. (1973) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1973.5408575 · Cited by 8,721
Introduction to Statistical Quality Control
Sauter, R. M., & Montgomery, D. C. (1992) · Technometrics · doi:10.2307/1269251 · Cited by 7,842
Time Series Analysis: Forecasting and Control.
Anderson, O. D., Box, G. E. P., & Jenkins, G. M. (1978) · The Statistician · doi:10.2307/2988198 · Cited by 5,298
(2011) · Cited by 5,203
Beyond the hype: Big data concepts, methods, and analytics
Gandomi, A., & Haider, M. (2015) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2014.10.007 · Cited by 4,226
A User's Guide to Principal Components
Leigh, S., & Jackson, J. E. (1993) · Technometrics · doi:10.2307/1269292 · Cited by 3,332
An Introduction to the Bootstrap.
Buckland, S. T., Efron, B., & Tibshirani, R. J. (1994) · Biometrics · doi:10.2307/2532810 · Cited by 3,103
Process fault detection based on modeling and estimation methods—A survey
Isermann, R. (1984) · Automatica · doi:10.1016/0005-1098(84)90098-0 · Cited by 2,364
Model predictive heuristic control
Richalet, J., Rault, A., Testud, J. L., & Papon, J. (1978) · Automatica · doi:10.1016/0005-1098(78)90001-8 · Cited by 2,088
Wastewater Engineering: Treatment and Resource Recovery
Burton, F. L., Stensel, H. D., & Tchobanoglous, G. (2013) · Medical Entomology and Zoology · Cited by 1,866
Data-driven Soft Sensors in the process industry
Kadlec, P., Gabrys, B., & Strandt, S. (2009) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2008.12.012 · Cited by 1,845
Control Chart Tests Based on Geometric Moving Averages
Roberts, S. W. (1959) · Technometrics · doi:10.1080/00401706.1959.10489860 · Cited by 1,530
Monitoring batch processes using multiway principal component analysis
Nomikos, P., & MacGregor, J. F. (1994) · AIChE Journal · doi:10.1002/aic.690400809 · Cited by 1,483
Disturbance detection and isolation by dynamic principal component analysis
Ku, W., Storer, R. H., & Georgakis, C. (1995) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(95)00076-3 · Cited by 1,483
Fault Detection and Diagnosis in Industrial Systems
Braatz, L. H. C. (2001) · Measurement Science and Technology · doi:10.1088/0957-0233/12/10/706 · Cited by 1,416
Issues of Fault Diagnosis for Dynamic Systems
(2000) · Springer eBooks · doi:10.1007/978-1-4471-3644-6 · Cited by 1,330
MVN: An R Package for Assessing Multivariate Normality
Korkmaz, S., Goksuluk, D., & Zararsiz, G. (2014) · The R Journal · doi:10.32614/rj-2014-031 · Cited by 1,287
Statistical process control of multivariate processes
MacGregor, J. F., & Kourti, T. (1995) · Control Engineering Practice · doi:10.1016/0967-0661(95)00014-l · Cited by 1,270
Control Chart Tests Based on Geometric Moving Averages
Roberts, S. W. (2000) · Technometrics · doi:10.2307/1271439 · Cited by 1,251
A Multivariate Exponentially Weighted Moving Average Control Chart
Lowry, C. A., Woodall, W. H., Champ, C. W., & Rigdon, S. E. (1992) · Technometrics · doi:10.1080/00401706.1992.10485232 · Cited by 1,230
Multi‐Way Analysis with Applications in the Chemical Sciences
Smilde, A., Bro, R., & Geladi, P. (2004) · Wiley eBooks · doi:10.1002/0470012110 · Cited by 1,176
The Exponentially Weighted Moving Average
Hunter, J. S. (1986) · Journal of Quality Technology · doi:10.1080/00224065.1986.11979014 · Cited by 1,136
Nonlinear process monitoring using kernel principal component analysis
Lee, J.-M., Yoo, C., Choi, S. W., Vanrolleghem, P. A., & Lee, I.-B. (2004) · Chemical Engineering Science · doi:10.1016/j.ces.2003.09.012 · Cited by 1,086
Challenges and opportunities with big data
Labrinidis, A., & Jagadish, H. V. (2012) · Proceedings of the VLDB Endowment · doi:10.14778/2367502.2367572 · Cited by 1,070
Time Series Analysis Forecasting and Control.
Chakravarti, I. M., Box, G. E. P., & Jenkins, G. M. (1973) · Journal of the American Statistical Association · doi:10.2307/2284112 · Cited by 972
The process chemometrics approach to process monitoring and fault detection
Wise, B. M., & Gallagher, N. B. (1996) · Journal of Process Control · doi:10.1016/0959-1524(96)00009-1 · Cited by 852
Techniques of Statistical Analysis.
Olds, E. G., Group, S. R., Eisenhart, C., Hastay, M. W., & Wallis, W. A. (1950) · The American Mathematical Monthly · doi:10.2307/2308320 · Cited by 829
Gujer, W., Henze, M., Mino, T., & van Loosdrecht, M. (1999) · Water Science and Technology · doi:10.2166/wst.1999.0039 · Cited by 751
Multi-way partial least squares in monitoring batch processes
Nomikos, P., & MacGregor, J. F. (1995) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(95)00043-7 · Cited by 737
An Introduction to the Bootstrap.
Marriott, P., Efron, B., & Tibshirani, R. J. (1995) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983304 · Cited by 737
Multivariate Generalizations of Cumulative Sum Quality-Control Schemes
Crosier, R. B. (1988) · Technometrics · doi:10.1080/00401706.1988.10488402 · Cited by 717
A hybrid neural network and ARIMA model for water quality time series prediction
Ömer Faruk, D. (2010) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2009.09.015 · Cited by 707
Statistical data preparation: management of missing values and outliers
Kwak, S. K., & Kim, J. H. (2017) · Korean Journal of Anesthesiology · doi:10.4097/kjae.2017.70.4.407 · Cited by 699
A Modern Approach to Regression with R
Sheather, S. (2009) · Springer Texts in Statistics · doi:10.1007/978-0-387-09608-7 · Cited by 692
Activated Sludge Model No.2d, ASM2D
Henze, M., Gujer, W., Mino, T., Matsuo, T., Wentzel, M. C., Marais, G. V. R., & Van Loosdrecht, M. C. M. (1999) · Water Science and Technology · doi:10.2166/wst.1999.0036 · Cited by 602
Hotelling, H. (1947) · Medical Entomology and Zoology · Cited by 551
Neural Networks and Deep Learning
(2016) · Computer Age Statistical Inference · doi:10.1017/cbo9781316576533.019 · Cited by 509
Activated Sludge Model No.2d, ASM2d
(1999) · Water Science and Technology · doi:10.1016/s0273-1223(98)00829-4 · Cited by 502
Introduction to Statistical Quality Control
Freund, R. A. (1987) · Journal of Quality Technology · doi:10.1080/00224065.1987.11979072 · Cited by 472
Neural Networks and Deep Learning: A Textbook
Aggarwal, C. C. (2018) · doi:10.1007/978-3-319-94463-0 · Cited by 417
Shewhart, W. A. (1926) · Bell System Technical Journal · doi:10.1002/j.1538-7305.1926.tb00125.x · Cited by 321
Data-derived soft-sensors for biological wastewater treatment plants: An overview
Haimi, H., Mulas, M., Corona, F., & Vahala, R. (2013) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2013.05.009 · Cited by 274
Modern Multivariate Statistical Techniques: Regression, Classification and Manifold Learning
Maindonald, J. (2009) · Journal of Statistical Software · doi:10.18637/jss.v029.b11 · Cited by 256
Exponentially weighted moving principal components analysis and projections to latent structures
Wold, S. (1994) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/0169-7439(93)e0075-f · Cited by 253
Henze, M. (1995) · OpenGrey (Institut de l'Information Scientifique et Technique) · Cited by 241
Partial Least Squares (PLS) Regression.
Abdi, H. (2003) · Cited by 237
Corominas, L., Garrido-Baserba, M., Villez, K., Olsson, G., Cortés, U., & Poch, M. (2018) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2017.11.023 · Cited by 218
On-line monitoring equipment for wastewater treatment processes: state of the art
Vanrolleghem, P. A., & Lee, D. S. (2003) · Water Science and Technology · doi:10.2166/wst.2003.0074 · Cited by 217
Benchmark Simulation Model No 2: finalisation of plant layout and default control strategy
Nopens, I., Benedetti, L., Jeppsson, U., Pons, M.-N., Alex, J., Copp, J. B., Gernaey, K. V., Rosen, C., Steyer, J.-P., & Vanrolleghem, P. A. (2010) · Water Science and Technology · doi:10.2166/wst.2010.044 · Cited by 203
A multiblock partial least squares algorithm for investigating complex chemical systems
Wangen, L. E., & Kowalski, B. R. (1989) · Journal of Chemometrics · doi:10.1002/cem.1180030104 · Cited by 191
Fault detection based on Kernel Principal Component Analysis
Nguyen, V. H., & Golinval, J.-C. (2010) · Engineering Structures · doi:10.1016/j.engstruct.2010.08.012 · Cited by 178
Han, H., & Qiao, J. (2014) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2013.2266086 · Cited by 177
Instrumentation, Control and Automation in Wastewater Systems
Olsson, G., Nielsen, M. K., Yuan, Z., Lynggaard-Jensen, A., & Steyer, J. (2015) · Water Intelligence Online · doi:10.2166/9781780402680 · Cited by 165
Software sensors in bioprocess engineering
Chéruy, A. (1997) · Journal of Biotechnology · doi:10.1016/s0168-1656(96)01644-6 · Cited by 142
A Modern Approach to Regression with R
Ugarte, M. D. (2010) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2010.00663_8.x · Cited by 130
Wastewater quality monitoring system using sensor fusion and machine learning techniques
Qin, X., Gao, F., & Chen, G. (2011) · Water Research · doi:10.1016/j.watres.2011.12.005 · Cited by 128
Predicting the total suspended solids in wastewater: A data-mining approach
Verma, A. P., Wei, X., & Kusiak, A. (2012) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2012.08.015 · Cited by 123
Hybrid neural network modeling of a full-scale industrial wastewater treatment process.
Lee, D., Jeon, C., Park, J. M., & Chang, K. S. (2002) · Biotechnology and Bioengineering · doi:10.1002/bit.10247 · Cited by 122
Predictive modeling for wastewater applications: Linear and nonlinear approaches
Dellana, S. A., & West, D. (2008) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2008.06.002 · Cited by 90
Computational Intelligence in Economics and Finance
(2004) · Springer eBooks · doi:10.1007/978-3-662-06373-6 · Cited by 85
Wallace, J., Champagne, P., & Hall, G. (2016) · Water Research · doi:10.1016/j.watres.2016.03.046 · Cited by 84
Lee, D. S., Lee, M. W., Woo, S. H., Kim, Y., & Park, J. M. (2006) · Process Biochemistry · doi:10.1016/j.procbio.2006.05.006 · Cited by 81
Xiao, H., Huang, D., Pan, Y., Liu, Y., & Song, K. (2016) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2016.12.009 · Cited by 81
Phase I Distribution-Free Analysis of Multivariate Data
Capizzi, G., & Masarotto, G. (2017) · Technometrics · doi:10.1080/00401706.2016.1272494 · Cited by 74
Adaptive predictive functional control of a class of nonlinear systems
Zhang, B., & Zhang, W. (2006) · ISA Transactions · doi:10.1016/s0019-0578(07)60188-8 · Cited by 73
Hadjimichael, A., Comas, J., & Corominas, L. (2016) · AI Communications · doi:10.3233/aic-160714 · Cited by 66
Wang, X., Ratnaweera, H. C., Holm, J. A., et al. (2017) · Journal of Environmental Management · doi:10.1016/j.jenvman.2017.01.079 · Cited by 66
Modeling and analysis of pumps in a wastewater treatment plant: A data-mining approach
Kusiak, A., Zeng, Y., & Zhang, Z. (2013) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2013.04.001 · Cited by 53
Vuono, D. C., Henkel, J., Benecke, J., Cath, T. Y., Reid, T., Johnson, L. W., & Drewes, J. E. (2013) · Journal of Membrane Science · doi:10.1016/j.memsci.2013.06.021 · Cited by 51
Self-citationLuccarini, L., Bragadin, G. L., Colombini, G., Mancini, M. L., Mello, P., Montali, M., & Sottara, D. (2009) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2009.05.013 · Cited by 48
Scott, D. W. (2017) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat07186.pub2 · Cited by 35
PCA and PLS monitoring approaches for fault detection of wastewater treatment process
Chen, A., Zhou, H., An, Y., & Sun, W. (2016) · IEEE International Symposium on Industrial Electronics (ISIE) · doi:10.1109/isie.2016.7745032 · Cited by 25
Data utilization at finnish water and wastewater utilities: Current practices vs. state of the art
Sirkiä, J., Laakso, T. I., Ahopelto, S., Ylijoki, O., Porras, J., & Vahala, R. (2017) · Utilities Policy · doi:10.1016/j.jup.2017.02.002 · Cited by 22
Dreyfus, G. (2005) · Springer eBooks · doi:10.1007/3-540-28847-3_1 · Cited by 18
Cited by
Machine Learning: New Ideas and Tools in Environmental Science and Engineering
Zhong, S., Zhang, K., Bagheri, M., Burken, J. G., Gu, A., Li, B., Ma, X., Marrone, B. L., Ren, Z. J., Schrier, J., et al. (2021) · Environmental Science & Technology · doi:10.1021/acs.est.1c01339 · Cited by 945
Digitalization to achieve sustainable development goals: Steps towards a Smart Green Planet
Mondejar, M. E., Avtar, R., Diaz, H. L. B., Dubey, R. K., Esteban, J., Gómez-Morales, A., Hallam, B., Mbungu, N. T., Okolo, C. C., Prasad, K. A., et al. (2021) · Science of The Total Environment · doi:10.1016/j.scitotenv.2021.148539 · Cited by 916
Data-Driven Machine Learning in Environmental Pollution: Gains and Problems
Liu, X., Lu, D., Zhang, A., Liu, Q., & Jiang, G. (2022) · Environmental Science & Technology · doi:10.1021/acs.est.1c06157 · Cited by 548
Sheik, A. G., Kumar, A., Patnaik, R., Kumari, S., & Bux, F. (2024) · Critical Reviews in Environmental Science and Technology · doi:10.1080/10643389.2023.2252313 · Cited by 47
Metadata
- Authors
- Newhart, K. B., Holloway, R. W., Hering, A. S., & Cath, T. Y.
- Venue
- Water Research
- Publisher
- Elsevier BV
- Published
- 2019-06
- Volume
- 157
- Pages
- 498-513
- ISSN
- 0043-1354 (ISSN-L)
- OpenAlex
- W2924962937
- Cited by
- 485
- References
- 79
- FWCI
- 24.00
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.