Global Optimization for the Parameter Estimation of Differential-Algebraic Systems
The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
The estimation of parameters in semiempirical models is essential in numerous areas of engineering and applied science. In many cases these models are represented by a set of nonlinear differential-algebraic equations. This introduces difficulties from both a numerical and an optimization perspective. One such difficulty, which has not been adequately addressed, is the existence of multiple local minima. In this paper, two novel global optimization methods will be presented which offer a theoretical guarantee of convergence to the global minimum for a wide range of problems. The first is based on converting the dynamic system of equations into a set of algebraic constraints through the use of collocation methods. The reformulated problem has interesting mathematical properties which allow for the development of a deterministic branch and bound global optimization approach. The second method is based on the use of integration to solve the dynamic system of equations. Both methods will be applied to the problem of estimating parameters in differential-algebraic models through the error-in-variables approach. The mathematical properties of the formulation which lead to specialization of the algorithms will be discussed. Then, the computational aspects of both approaches will be presented and compared through their application to several problems involving reaction kinetics.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Deterministic approaches for global optimization in dynamic systems [107,108] can guarantee the global optimality of the solution, but the associated computational effort increases very rapidly with problem size.”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [107]
Citations
Cites
McCormick, G. P. (1976) · Mathematical Programming · doi:10.1007/bf01580665 · Cited by 2,281
Handbook of Test Problems in Local and Global Optimization
Floudas, C. A., Pardalos, P. M., Adjiman, C. S., Esposito, W. R., Gümüş, Z. H., Harding, S. T., Klepeis, J. L., Meyer, C. A., & Schweiger, C. A. (1999) · Nonconvex Optimization and Its Applications · doi:10.1007/978-1-4757-3040-1 · Cited by 636
Self-citationJointly Constrained Biconvex Programming
Al-Khayyal, F. A., & Falk, J. E. (1983) · Mathematics of Operations Research · doi:10.1287/moor.8.2.273 · Cited by 553
Vassiliadis, V. S., Sargent, R. W. H., & Pantelides, C. C. (1994) · Industrial & Engineering Chemistry Research · doi:10.1021/ie00033a014 · Cited by 530
Adjiman, C. S., Dallwig, S., Floudas, C. A., & Neumaier, A. (1998) · Computers & Chemical Engineering · doi:10.1016/s0098-1354(98)00027-1 · Cited by 526
Self-citationDeterministic Global Optimization
Floudas, C. A. (2000) · Nonconvex Optimization and Its Applications · doi:10.1007/978-1-4757-4949-6 · Cited by 493
Self-citation?BB: A global optimization method for general constrained nonconvex problems
Androulakis, I. P., Maranas, C. D., & Floudas, C. A. (1995) · Journal of Global Optimization · doi:10.1007/bf01099647 · Cited by 465
Self-citationOptimization by direct search and systematic reduction of the size of search region
Luus, R., & Jaakola, T. H. I. (1973) · AIChE Journal · doi:10.1002/aic.690190413 · Cited by 450
On the optimization of differential‐algebraic process systems
Cuthrell, J. E., & Biegler, L. T. (1987) · AIChE Journal · doi:10.1002/aic.690330804 · Cited by 450
Sensitivity analysis of initial value problems with mixed odes and algebraic equations
Caracotsios, M., & Stewart, W. E. (1985) · Computers & Chemical Engineering · doi:10.1016/0098-1354(85)85014-6 · Cited by 411
Adjiman, C. S., Androulakis, I. P., & Floudas, C. A. (1998) · Computers & Chemical Engineering · doi:10.1016/s0098-1354(98)00218-x · Cited by 349
Self-citationGlobal optimization of bilinear process networks with multicomponent flows
Quesada, I., & Grossmann, I. E. (1995) · Computers & Chemical Engineering · doi:10.1016/0098-1354(94)00123-5 · Cited by 287
A spline least squares method for numerical parameter estimation in differential equations
Varah, J. M. (1982) · SIAM Journal on Scientific and Statistical Computing · doi:10.1137/0903003 · Cited by 274
Leibman, M. J., Edgar, T. F., & Lasdon, L. S. (1992) · Computers & Chemical Engineering · doi:10.1016/0098-1354(92)80030-d · Cited by 258
Parameter estimation from multiresponse data
Stewart, W. E., Caracotsios, M., & Sørensen, J. P. (1992) · AIChE Journal · doi:10.1002/aic.690380502 · Cited by 240
Finding all solutions of nonlinearly constrained systems of equations
Maranas, C. D., & Floudas, C. A. (1995) · Journal of Global Optimization · doi:10.1007/bf01097059 · Cited by 219
Self-citationTjoa, I. B., & Biegler, L. T. (1991) · Industrial & Engineering Chemistry Research · doi:10.1021/ie00050a015 · Cited by 203
Global minimum potential energy conformations of small molecules
Maranas, C. D., & Floudas, C. A. (1994) · Journal of Global Optimization · doi:10.1007/bf01096720 · Cited by 185
Self-citationRigorous convex underestimators for general twice-differentiable problems
Adjiman, C. S., & Floudas, C. A. (1996) · Journal of Global Optimization · doi:10.1007/bf00121749 · Cited by 174
Self-citationA global optimization algorithm for linear fractional and bilinear programs
Quesada, I., & Grossmann, I. E. (1995) · Journal of Global Optimization · doi:10.1007/bf01106605 · Cited by 156
Zamora, J. M., & Grossmann, I. E. (1999) · Journal of Global Optimization · doi:10.1023/a:1008312714792 · Cited by 144
A global optimization method, αBB, for process design
Adjiman, C. S., Androulakis, I. P., Maranas, C. D., & Floudas, C. A. (1996) · Computers & Chemical Engineering · doi:10.1016/0098-1354(96)00080-4 · Cited by 117
Self-citationA hybrid genetic algorithm for the estimation of parameters in detailed kinetic models
Park, T.-Y., & Froment, G. F. (1998) · Computers & Chemical Engineering · doi:10.1016/s0098-1354(98)00043-x · Cited by 116
Esposito, W. R., & Floudas, C. A. (1998) · Industrial & Engineering Chemistry Research · doi:10.1021/ie970852g · Cited by 106
Self-citationA sequential error-in-variables method for nonlinear dynamic systems
Kim, I.-W., Liebman, M. J., & Edgar, T. F. (1991) · Computers & Chemical Engineering · doi:10.1016/0098-1354(91)87028-8 · Cited by 70
Quasilinearization and the estimation of chemical rate constants from raw kinetic data
Bellman, R., Jacquez, J. A., Kalaba, R. E., & Schwimmer, S. (1967) · Mathematical Biosciences · doi:10.1016/0025-5564(67)90027-2 · Cited by 66
Vasantharajan, S., & Biegler, L. T. (1990) · Computers & Chemical Engineering · doi:10.1016/0098-1354(90)85005-u · Cited by 60
Kinetics Analysis by Digital Parameter Estimation
Bard, Y., & Lapidus, L. (1969) · Catalysis Reviews · doi:10.1080/01614946908066540 · Cited by 59
A general strategy for parameter estimation in differential—algebraic systems
Bilardello, P., Joulia, X., Lann, J. M. L., Delmas, H., & Koehret, B. (1993) · Computers & Chemical Engineering · doi:10.1016/0098-1354(93)80040-t · Cited by 34
An adaptive strategy for solving kinetic model concomitant estimation — Reduction problems
Maria, G. C. (1989) · The Canadian Journal of Chemical Engineering · doi:10.1002/cjce.5450670514 · Cited by 33
A new method for the estimation of parameters in differential equations
Bosch, B. V. D., & HELLINCKX, L. J. (1974) · AIChE Journal · doi:10.1002/aic.690200207 · Cited by 32
A comparison of collocation methods for solving dynamic optimization problems
Tieu, D., Cluett, W. R., & Penlidis, A. (1995) · Computers & Chemical Engineering · doi:10.1016/0098-1354(94)00064-u · Cited by 30
Model reduction and kinetic parameters identification for the methanol conversion to olefins
Maria, G. C., & Muntean, O. (1987) · Chemical Engineering Science · doi:10.1016/0009-2509(87)85017-0 · Cited by 30
A new algorithm for the estimation of parameters in ordinary differential equations
Hwang, M., & Seinfeld, J. H. (1972) · AIChE Journal · doi:10.1002/aic.690180117 · Cited by 30
Wang, B., & Luus, R. (1980) · International Journal of Control · doi:10.1080/00207178008961094 · Cited by 20
A family of collocation based methods for parameter estimation in differential equations
Baden, N., & Villadsen, J. (1982) · The Chemical Engineering Journal · doi:10.1016/0300-9467(82)85001-6 · Cited by 19
Simplification of quasilinearization method for parameter estimation
Kalogerakis, N. E., & Luus, R. (1983) · AIChE Journal · doi:10.1002/aic.690290523 · Cited by 17
Research works printed but not linked: 13
- Bard Y., 1974, Nonlinear Parameter Estimation
- Luus R, 1998, Hung. J. Ind. Chem., 26, 287
- Wolf D., 1997, Comput. Chem. Eng., 52, 1189
- Villadsen J., 1978, Solution of Differential Equation Models by Polynomial Approximation
- Finlayson B. A., 1972, The Method of Weighted Residuals and Variational Principles
- Pontryagin L. S., 1962, Ordinary Differential Equations
- Brenan K. E., 1996, Numerical Solution of Initial-Value Problems in Differential-Algebraic Equations
- Schweiger C. A., 1998, 3rd
- Vassiliadis V. S., 1998, AIChE National Meeting
- Gill P. E., 1997, User's Guide for SNOPT 5.3: A Fortran Package for Large-Scale Nonlinear Programming
- Murtagh B. A., 1993, CA
- Gill P. E., 1986, Version 4.0
- Jarvis R. B., 1992, Technology, and Medicine: London
Cited by
Parameter estimation in biochemical pathways: a comparison of global optimization methods
Moles, C. G., Mendes, P., & Banga, J. R. (2003) · Genome Research · doi:10.1101/gr.1262503 · Cited by 858
“Deterministic methods are those that can provide a level of assurance that the global optimum will be located, and several important advances in the GO of certain types of nonlinear dynamic systems have been made recently (Esposito and Floudas 2000; Singer et al. 2001; Papamichail and Adjiman 2002).”
MethodAn overview of simultaneous strategies for dynamic optimization
Biegler, L. T. (2007) · Chemical Engineering and Processing: Process Intensification · doi:10.1016/j.cep.2006.06.021 · Cited by 520
A review of recent advances in global optimization
Floudas, C. A., & Gounaris, C. E. (2009) · Journal of Global Optimization · doi:10.1007/s10898-008-9332-8 · Cited by 455
Self-citationPenas, D. R., González, P., Egea, J. A., Doallo, R., & Banga, J. R. (2017) · BMC Bioinformatics · doi:10.1186/s12859-016-1452-4 · Cited by 385
A hybrid approach for efficient and robust parameter estimation in biochemical pathways
Rodriguez-Fernandez, M., Mendes, P., & Banga, J. R. (2006) · Biosystems · doi:10.1016/j.biosystems.2005.06.016 · Cited by 304
“In any case, several promising approaches for the use of deterministic global optimisation (GO) for parameter estimation in non-linear dynamic systems have appeared recently (Esposito and Floudas, 2000; Papamichail and Adjiman, 2002), so this is a promising avenue of research.”
Background
Metadata
- Authors
- Esposito, W. R., & Floudas, C. A.
- Affiliations
- Princeton University (US)
- Corresponding author
- Floudas, Christodoulos A.
- Venue
- Industrial & Engineering Chemistry Research
- Publisher
- American Chemical Society (ACS)
- Published
- 2000-03-25
- Volume
- 39
- Issue
- 5
- Pages
- 1291-1310
- ISSN
- 0888-5885 (ISSN-L)
- 1520-5045
- OpenAlex
- W2086309978
- Cited by
- 188
- References
- 37
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 5 · 2023: 3 · 2022: 6 · 2021: 3 · 2020: 5 · 2019: 4 · 2018: 9 · 2017: 7 · 2016: 6 · 2015: 10 · 2014: 6 · 2013: 11 · 2012: 13
- FWCI
- 5.47
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Industrial & Engineering Chemistry Research (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Numerical Analysis › Advanced Optimization Algorithms Research
- Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
- Physical Sciences › Mathematics › Applied Mathematics › Statistical and numerical algorithms
- Keywords
- global optimization, parameter estimation, descriptor systems, semi-empirical model, multiple local minima, collocation method, branch and bound, measurement error models, reaction kinetics, nonlinear dynamical systems
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.