Water quality modeling: A review of the analysis of uncertainty
The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Abstract
This paper reviews the role of uncertainty in the identification of mathematical models of water quality and in the application of these models to problems of prediction. More specifically, four problem areas are examined in detail: uncertainty about model structure, uncertainty in the estimated model parameter values, the propagation of prediction errors, and the design of experiments in order to reduce the critical uncertainties associated with a model. The review is rather lengthy, and it has therefore been prepared in effect as two papers. There is a shorter, largely nontechnical version, which gives a quick impression of the current and future issues in the analysis of uncertainty in water quality modeling. Enclosed by this shorter discussion is the main body of the review dealing in turn with (1) identifiability and experimental design, (2) the generation of preliminary model hypotheses under conditions of sparse, grossly uncertain field data, (3) the selection and evaluation of model structure, (4) parameter estimation (model calibration), (5) checks and balances on the identified model, i.e., model “verification” and model discrimination, and (6) prediction error propagation. Much time is spent in discussing the algorithms of system identification, in particular, the methods of recursive estimation, and in relating these algorithms and the subject of identification to the problems of prediction uncertainty and first‐order error analysis. There are two obvious omissions from the review. It is not concerned primarily with either the development and solution of stochastic differential equations or the issue of decision making under uncertainty, although clearly some reference must be made to these topics. In brief, the review concludes (not surprisingly) that much work has been done on the analysis of uncertainty in the development of mathematical models of water quality, and much remains to be done. A lack of model identifiability has been an outstanding difficulty in the interpretation and explanation of past observed system behavior, and there is ample evidence to show that the “larger,” more “comprehensive” models are easily capable of generating highly uncertain predictions of future behavior. For the future of the subject, it is speculated that there is the possibility of progress in the development of novel algorithms for model structure identification, a need for new questions to be posed in the problem of prediction, and a distinct challenge to the conventional views of this review in the new forms of knowledge representation and manipulation now emerging from the field of artificial intelligence.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
THE STRUCTURE OF SCIENTIFIC REVOLUTIONS
MCGUIRE, J. E. (1963) · Philosophical Books · doi:10.1111/j.1468-0149.1963.tb00813.x · Cited by 8,424
Simple mathematical models with very complicated dynamics
May, R. M. (1976) · Nature · doi:10.1038/261459a0 · Cited by 7,001
Time Series Analysis Forecasting and Control.
Bartholomew, D. J., Box, G. E. P., & Jenkins, G. M. (1971) · Operational Research Quarterly (1970-1977) · doi:10.2307/3008255 · Cited by 6,716
Theory and Practice of Recursive Identification
Lennart Ljung, A., & Söderström, T. (1983) · Lund University Publications (Lund University) · Cited by 3,989
The Logic of Scientific Discovery.
Rescher, N., Popper, K. R., & Hanson, N. R. (1960) · Philosophy and Phenomenological Research · doi:10.2307/2104331 · Cited by 2,444
Adaptive environmental assessment and management
Jørgensen, S. E. (1980) · Ecological Modelling · doi:10.1016/0304-3800(80)90047-2 · Cited by 1,615
What is this thing called science?
(2014) · Choice Reviews Online · doi:10.5860/choice.51-6134 · Cited by 1,568
System identification—A survey
Åström, K. J., & Eykhoff, P. (1971) · Automatica · doi:10.1016/0005-1098(71)90059-8 · Cited by 1,495
Dynamic System Identification - Experiment Design and Data Analysis
(1977) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(08)x6188-0 · Cited by 1,398
Schweppe, F. C. (1973) · Medical Entomology and Zoology · Cited by 1,275
Against Method, Outline of an Anarchistic Theory of Knowledge.
Mitroff, I. I., & Feyerabend, P. (1976) · Contemporary Sociology · doi:10.2307/2064130 · Cited by 1,254
Asymptotic behavior of the extended Kalman filter as a parameter estimator for linear systems
Ljung, L. (1979) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1979.1101943 · Cited by 1,162
Review of Parameter Identification Procedures in Groundwater Hydrology: The Inverse Problem
Yeh, W. W. (1986) · Water Resources Research · doi:10.1029/wr022i002p00095 · Cited by 1,150
System Identification Parameter and State Estimation
Eykhoff, P. (1974) · Virtual Defense Library (Ministerio de Defensa) · Cited by 1,083
Bellman, R., & Åström, K. J. (1970) · Mathematical Biosciences · doi:10.1016/0025-5564(70)90132-x · Cited by 871
Probability, Statistics and Decision for Civil Engineers.
Mielke, P. W., Benjamin, J. R., & Cornell, C. A. (1971) · Journal of the American Statistical Association · doi:10.2307/2284265 · Cited by 723
Recursive Estimation and Time-Series Analysis
Young, P. (1984) · Springer eBooks · doi:10.1007/978-3-642-82336-7 · Cited by 678
A Study of the Pollution and Natural Purification of the Ohio River
Phelps, E. B., & Streeter, H. W. (1958) · Cited by 641
Spear, R. (1980) · Water Research · doi:10.1016/0043-1354(80)90040-8 · Cited by 604
Proceedings of the 2004 Winter Simulation Conference, 2004.
(2004) · doi:10.1109/wsc.2004 · Cited by 587
AN APPROACH TO THE PRELIMINARY ANALYSIS OF ENVIRONMENTAL SYSTEMS
Hornberger, G. M., & Spear, R. C. (1981) · Cited by 566
Parameter estimation for continuous-time models—A survey
Young, P. (1981) · Automatica · doi:10.1016/0005-1098(81)90082-0 · Cited by 545
Jazwinski, A. H. (1970) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(09)60368-4 · Cited by 515
Instrumental Variable Methods for System Identification
(1983) · Springer eBooks · doi:10.1007/bfb0009019 · Cited by 464
Numerical Identification of Linear Dynamic Systems from Normal Operating Records
Aström, K. G., & Bohlin, T. (1966) · Springer eBooks · doi:10.1007/978-1-4899-6289-8_12 · Cited by 435
Duda, R. O., & Shortliffe, E. H. (1983) · Science · doi:10.1126/science.6340198 · Cited by 396
Maximum likelihood and prediction error methods
Åström, K. J. (1980) · Automatica · doi:10.1016/0005-1098(80)90078-3 · Cited by 383
Refined instrumental variable methods of recursive time-series analysis Part III. Extensions
YOUNG, P., & JAKEMAN, A. (1980) · International Journal of Control · doi:10.1080/00207178008961080 · Cited by 291
Sorooshian, S., Gupta, V. K., & Fulton, J. L. (1983) · Water Resources Research · doi:10.1029/wr019i001p00251 · Cited by 291
Sorooshian, S., & Gupta, V. K. (1983) · Water Resources Research · doi:10.1029/wr019i001p00260 · Cited by 266
Experimental Lakes Area: Whole-Lake Experiments in Eutrophication
Schindler, D. W., & Fee, E. J. (1974) · Journal of the Fisheries Research Board of Canada · doi:10.1139/f74-110 · Cited by 239
A unified view of statistical forecasting procedures
Harvey, A. C. (1984) · Journal of Forecasting · doi:10.1002/for.3980030302 · Cited by 238
Parameter optimization for watershed models
Johnston, P. R., & Pilgrim, D. H. (1976) · Water Resources Research · doi:10.1029/wr012i003p00477 · Cited by 230
An instrumental variable method for model order identification
Young, P. C., Jakeman, A. J., & McMurtrie, R. E. (1980) · Automatica · doi:10.1016/0005-1098(80)90037-0 · Cited by 213
Hornberger, G. M., Beven, K. J., Cosby, B. J., & Sappington, D. E. (1985) · Water Resources Research · doi:10.1029/wr021i012p01841 · Cited by 183
Procedures for parameter and state estimation of microbial growth process models
Holmberg, A., & Ranta, J. (1982) · Automatica · doi:10.1016/0005-1098(82)90107-8 · Cited by 172
Identifiability of Model Parameter
Godfrey, K. R., & DiStefano, J. J. (1985) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)60544-5 · Cited by 170
On model structure testing in system identification
Söderström, T. (1977) · International Journal of Control · doi:10.1080/00207177708922285 · Cited by 164
Gupta, V. K., & Sorooshian, S. (1983) · Water Resources Research · doi:10.1029/wr019i001p00269 · Cited by 163
Schindler, D. W., Fee, E. J., & Ruszczynski, T. (1978) · Journal of the Fisheries Research Board of Canada · doi:10.1139/f78-031 · Cited by 162
Hornberger, G. (1980) · Water Research · doi:10.1016/0043-1354(80)90039-1 · Cited by 162
Practical aspects of process identification
Isermann, R. (1980) · Automatica · doi:10.1016/0005-1098(80)90079-5 · Cited by 140
Aggregation error in ecological models
O’Neill, R. V., & Rust, B. W. (1979) · Ecological Modelling · doi:10.1016/0304-3800(79)90001-2 · Cited by 129
Methodology in systems modelling and simulation.
(1980) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(80)90062-2 · Cited by 122
Modelling algal behaviour in the river thames
Whitehead, P. G. (1984) · Water Research · doi:10.1016/0043-1354(84)90244-6 · Cited by 120
Caswell, H. (1976) · Elsevier eBooks · doi:10.1016/b978-0-12-547204-3.50050-6 · Cited by 116
Geophysical model discrimination using the Akaike information criterion
Hipel, K. W. (1981) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1981.1102597 · Cited by 82
Aggregation error in nonlinear ecological models
Cale, W. G., O’Neill, R. V., & Gardner, R. H. (1983) · Journal of Theoretical Biology · doi:10.1016/0022-5193(83)90446-0 · Cited by 78
Evaluation of theories and calculation tools in ecology
Leohle, C. (1983) · Ecological Modelling · doi:10.1016/0304-3800(83)90041-8 · Cited by 77
Sorooshian, S., & Gupta, V. K. (1985) · Water Resources Research · doi:10.1029/wr021i004p00487 · Cited by 75
Engineering Approaches for Lake Management, Volume 2: Mechanistic Modeling
Reckhow, K. H., & Chapra, S. (1983) · Cited by 72
Observations and experiments on the phytoplankton of Blelham Tarn, English Lake District
Lack, T. J., & Lund, J. (1974) · Freshwater Biology · doi:10.1111/j.1365-2427.1974.tb00105.x · Cited by 71
Confirmation of water quality models
Reckhow, K. H., & Chapra, S. C. (1983) · Ecological Modelling · doi:10.1016/0304-3800(83)90002-9 · Cited by 64
Identification, estimation and control of biological waste-water treatment processes
Beck, M. B. (1986) · IEE Proceedings D Control Theory and Applications · doi:10.1049/ip-d.1986.0041 · Cited by 61
Self-citationParameter fitting in dynamic models
Benson, M. W. (1979) · Ecological Modelling · doi:10.1016/0304-3800(79)90029-2 · Cited by 55
Pickup, G. (1977) · Hydrological Sciences Bulletin · doi:10.1080/02626667709491716 · Cited by 55
Parameter Uncertainty and Model Predictions: A Review of Monte Carlo Results
Gardner, R. H., & O’Neill, R. V. (1983) · Springer eBooks · doi:10.1007/978-3-642-82054-0_11 · Cited by 50
Comparative Error Analysis of Six Predator‐Prey Models
Gardner, R. H., O’Neill, R. V., Mankin, J. B., & Kumar, D. (1980) · Ecology · doi:10.2307/1935191 · Cited by 50
Cosby, B. J., Hornberger, G. M., & Kelly, M. G. (1984) · Ecological Modelling · doi:10.1016/0304-3800(84)90117-0 · Cited by 39
Identification of photosynthesis-light models for aquatic systems I. Theory and simulations
Cosby, B. J., & Hornberger, G. M. (1984) · Ecological Modelling · doi:10.1016/0304-3800(84)90116-9 · Cited by 34
Development and application of desirable ecological models
Cale, W. G., O’Neill, R. V., & Shugart, H. H. (1983) · Ecological Modelling · doi:10.1016/0304-3800(83)90011-x · Cited by 33
Maximum Likelihood Estimation of Parameters and Uncertainty in Phytoplankton Models
Straten, G. V. (1983) · Springer eBooks · doi:10.1007/978-3-642-82054-0_6 · Cited by 30
VALIDATION OF ECOLOGICAL SYSTEM MODELS.
Miller, M. A., Butler, G. C., & Bramall, L. (1976) · Cited by 28
Formulation and Validation of a Mathematical Model of Phytoplankton Growth
Collins, C. D. (1980) · Ecology · doi:10.2307/1937430 · Cited by 27
Describing variance with a simple water quality model and hypothetical sampling programs
Moore, S. F., Dandy, G. C., & Delucia, R. J. (1976) · Water Resources Research · doi:10.1029/wr012i004p00795 · Cited by 16
Factors affecting the identifiability of compartmental models
Godfrey, K. R., Jones, R. P., Brown, R. F., & Norton, J. P. (1982) · Automatica · doi:10.1016/0005-1098(82)90088-7 · Cited by 15
A method for parameter sensitivity analysis in differential equation models
Kohberger, R. C., Scavia, D., & Wilkinson, J. W. (1978) · Water Resources Research · doi:10.1029/wr014i001p00025 · Cited by 11
Parameter identifiability, validation, and sensitivity analysis of large system models
Steinhorst, R. K. (1979) · Cited by 7
Cited by
Latin hypercube sampling and the propagation of uncertainty in analyses of complex systems
Helton, J. C., & Davis, F. J. (2003) · Reliability Engineering & System Safety · doi:10.1016/s0951-8320(03)00058-9 · Cited by 2,688
A manifesto for the equifinality thesis
Beven, K. (2006) · Journal of Hydrology · doi:10.1016/j.jhydrol.2005.07.007 · Cited by 2,581
Survey of sampling-based methods for uncertainty and sensitivity analysis
Helton, J. C., Johnson, J. D., Sallaberry, C. J., & Storlie, C. B. (2006) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2005.11.017 · Cited by 1,237
A review of erosion and sediment transport models
Merritt, W. S., Letcher, R. A., & Jakeman, A. J. (2003) · Environmental Modelling & Software · doi:10.1016/s1364-8152(03)00078-1 · Cited by 1,224
Uncertainty in the environmental modelling process – A framework and guidance
Refsgaard, J. C., van der Sluijs, J. P., Højberg, A. L., & Vanrolleghem, P. A. (2007) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2007.02.004 · Cited by 1,197
Metadata
- Authors
- Beck, M. B.
- Venue
- Water Resources Research
- Publisher
- American Geophysical Union (AGU)
- Published
- 1987-08
- Volume
- 23
- Issue
- 8
- Pages
- 1393-1442
- ISSN
- 0043-1397 (ISSN-L)
- 1944-7973
- OpenAlex
- W2146283576
- Cited by
- 954
- References
- 68
- FWCI
- 13.65
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.