Parameter Estimation and Model Selection in Computational Biology
Open accessThe DOI matches its Crossref record; 45 of the 48 references it cites were found in a registry or an index; 1 of the 13 sources its claims cite were checked for support.
Abstract
A central challenge in computational modeling of biological systems is the determination of the model parameters. Typically, only a fraction of the parameters (such as kinetic rate constants) are experimentally measured, while the rest are often fitted. The fitting process is usually based on experimental time course measurements of observables, which are used to assign parameter values that minimize some measure of the error between these measurements and the corresponding model prediction. The measurements, which can come from immunoblotting assays, fluorescent markers, etc., tend to be very noisy and taken at a limited number of time points. In this work we present a new approach to the problem of parameter selection of biological models. We show how one can use a dynamic recursive estimator, known as extended Kalman filter, to arrive at estimates of the model parameters. The proposed method follows. First, we use a variation of the Kalman filter that is particularly well suited to biological applications to obtain a first guess for the unknown parameters. Secondly, we employ an a posteriori identifiability test to check the reliability of the estimates. Finally, we solve an optimization problem to refine the first guess in case it should not be accurate enough. The final estimates are guaranteed to be statistically consistent with the measurements. Furthermore, we show how the same tools can be used to discriminate among alternate models of the same biological process. We demonstrate these ideas by applying our methods to two examples, namely a model of the heat shock response in E. coli, and a model of a synthetic gene regulation system. The methods presented are quite general and may be applied to a wide class of biological systems where noisy measurements are used for parameter estimation or model selection.
Overview
CoChat Summary
TL;DR
The paper proposes a three-stage method for parameter estimation and model selection in biological ODE models: constrained hybrid extended Kalman filtering, an a posteriori variance/identifiability test, and moment-matching refinement. It demonstrates the approach on an E. coli heat shock model and a generalized repressilator model, where moment matching passed the statistical test while least-squares and genetic-algorithm fits failed.
Key findings
- In the small-parameter heat shock case, the HEKF estimated two parameters whose true value was 3 for both; the text reports the estimation as very accurate despite high noise, and the a posteriori identifiability test at confidence coefficient 0.95 passed for both measurement-noise components.
- For the 6-parameter heat shock case, a single HEKF run failed the identifiability test; moment-matching refinement with BFGS found a minimum after 1560 iterations with cost 0.14 in about 3 hours on a MacBook Pro with a single 2.6 GHz processor, and the refined estimates passed the test.
- For the 18-parameter repressilator model, a single HEKF run failed the test; moment-matching refinement with BFGS took 720 iterations (about 26 minutes) and passed all three components, whereas Levenberg-Marquardt least-squares (129 iterations, about 3 minutes) and a genetic algorithm (101 iterations, about 4 minutes) failed.
- For model selection in the heat shock example, only model \(M_1\) produced variance interval estimates containing the real measurement-noise variances; model \(M_2\), which lacks the spike in the sigma factor, was rejected as inconsistent with the measurements.
Methods
- The model is written as a continuous-time ODE state-space system; parameters are treated as constant states via state extension, and a constrained hybrid extended Kalman filter (HEKF) handles continuous-time dynamics with discrete-time measurements and equality/inequality constraints solved as quadratic programming.
- An a posteriori identifiability test estimates measurement-noise variances from residuals, forms point and interval estimates using the chi-square distribution, and rejects estimates whose intervals do not contain the known real noise variances; if the test fails, a moment-matching optimization minimizes mean and variance mismatch, typically with BFGS.
- Model selection runs the HEKF on candidate models, computes measurement-noise variance estimates for each, discards models whose interval estimates exclude the real variances, and selects the model whose variances match best; examples use simulated noisy data from an E. coli heat shock model (2 and 6 parameters; 22 data points in the small case) and a generalized repressilator model (18 parameters; 30 equally spaced mRNA data points).
Limitations
- The paper states that the extended Kalman filter is not generally optimal for nonlinear systems, may diverge or give biased estimates, can suffer from loss of observability/non-uniqueness after state extension, and is subject to numerical ill-conditioning in covariance propagation; initial estimates too far off can also cause problems.
- The paper states that the process-noise covariance is chosen by the user, the measurement-noise statistics are assumed known, the moment-matching weights are user-selected, and the refinement optimization can be computationally expensive (e.g., about 3 hours for the 6-parameter heat shock case).
- Evident from the text: the demonstrations use in silico simulated measurements rather than real experimental data, and many numerical entries in the tables and some reported percentages are missing from the provided text, limiting independent verification of the exact estimates.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures







Verification
Claims the paper makes
1 Valid · 1 Not valid · 11 Not checked · 41 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“These and similar results indicate that the search for the exact individual values of the parameters is a hopeless task in most cases [6].”
§ Parameter Estimation and Model Selection in Computational Biology > Introduction
What the sources say
- Supportedcites [6] M Ashyraliyev, 2008, Parameter estimation and determinability analysis applied to Drosophila gap gene circuits., BMC Systems Biology source
The Background (page unavailable) says that determining all parameters accurately is usually not possible in practice. The Results and Discussion, under Parameter Determinability (page unavailable), further report that no parameter in the analyzed model could be determined individually to the chosen accuracy. Together, these support the citing sentence’s general point without implying that every parameter is indeterminable. (LLM, conf=0.90)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As in the large parameter space case for the heat shock model, a single run of the HEKF produces estimates that do not satisfy the identifiability test.”
§ Parameter Estimation and Model Selection in Computational Biology > Results > The repressilator
plainstates a causeSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is clear that only produces results that are compatible with the measurements.”
§ Parameter Estimation and Model Selection in Computational Biology > Results > A model of the heat shock response in E. coli
boosted- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“After a transient, the estimates keep oscillating around the true values of the parameters.”
§ Parameter Estimation and Model Selection in Computational Biology > Results > A model of the heat shock response in E. coli
plainstates an associationSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In this new example, a single run of the HEKF produces values that do not satisfy the identifiability test.”
§ Parameter Estimation and Model Selection in Computational Biology > Results > A model of the heat shock response in E. coli
plainSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
25 more claims
Create a free account to see all 54 claims and to verify the 12 references still open.
- Probably not a substantial claim. 10
- It may state two separate claims as one. 14
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The resulting approach may be used for obtaining more accurate estimates of the parameters as well as for model selection.”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [143]
In the citing paper
“To address the issues of sparse and noisy data, Lillacci & Khammash [143] propose a combination of an extended Kalman filter (a recursive estimator well known in control engineering) with a posteriori identifiability tests and moment-matching optimization.”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [143]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Parameter Estimation and Model Selection in Computational Biology > Results > A model of the heat shock response in E. coli
“we compute the point and interval estimates of the variances of the two components of the measurement noise according to (13) and (15) respectively.”
§ Parameter Estimation and Model Selection in Computational Biology > Methods > An a posteriori identifiability test
“Then, is in the interval(14)with a probability of .”
Citations
Cites
Optimization by Simulated Annealing
Kirkpatrick, S., Gelatt, C. D., & Vecchi, M. P. (1983) · Science · doi:10.1126/science.220.4598.671 · Cited by 45,134 · cited 1×
“Much research has been conducted on the applications to computational biology models of several optimization techniques, such as linear and nonlinear leastsquares fitting [3], simulated annealing [4], genetic algorithms [5], and evolutionary computation [6,7].”
BackgroundProbability, Random Variables, and Stochastic Processes.
Abrahams, J., & Papoulis, A. (1984) · Journal of the American Statistical Association · doi:10.2307/2288754 · Cited by 16,226
Probability, Random Variables, and Stochastic Processes
Miller, I. (1966) · Technometrics · doi:10.1080/00401706.1966.10490365 · Cited by 8,452
Practical Methods of Optimization
Fletcher, R. (2000) · Wiley eBooks · doi:10.1002/9781118723203 · Cited by 7,605
Optimal State Estimation: Kalman, H∞, and Nonlinear Approaches
Simon, D. (2006) · doi:10.1002/0470045345 · Cited by 4,875
A synthetic oscillatory network of transcriptional regulators
Elowitz, M. B., & Leibler, S. (2000) · Nature · doi:10.1038/35002125 · Cited by 4,630 · cited 1×
“The original model of Elowitz and Leibler [39] consists of six equations with four parameters, where all the three genes have the same production and degradation rates, and are affected in the same way by the corresponding repressor.”
BackgroundAnderson, B. D. O., Moore, J. B., & Eslami, M. (1982) · IEEE Transactions on Systems Man and Cybernetics · Cited by 3,195
(2007) · Springer eBooks · doi:10.1007/978-0-387-71107-2 · Cited by 2,687
Srinivas, M., & Patnaik, L. M. (1994) · Computer · doi:10.1109/2.294849 · Cited by 2,180 · cited 1×
“Much research has been conducted on the applications to computational biology models of several optimization techniques, such as linear and nonlinear leastsquares fitting [3], simulated annealing [4], genetic algorithms [5], and evolutionary computation [6,7].”
BackgroundGill, P. E., Murray, W., & Wright, M. H. (2019) · doi:10.1137/1.9781611975604 · Cited by 1,737
Cited by
Items 301–325 of 325
Stochastically modeling multiscale stationary biological processes
Rowland, M. A., Mayo, M. L., Perkins, E. J., & García‐Reyero, N. (2019) · PLoS ONE · doi:10.1371/journal.pone.0226687
Model structures for batch and fed-batch ethanol fermentations
Serebrinsky, K., Hirmas, B., Munizaga, J., & Pedreros, F. (2019) · IEEE CHILEAN Conference on Electrical, Electronics Engineering, Information and Communication Technologies (CHILECON) · doi:10.1109/chilecon47746.2019.8988018 · Cited by 1
Hybrid Modeling and Simulation of Stochastic Effects on Biochemical Regulatory Networks
Ahmadian, M. (2020) · VTechWorks (Virginia Tech)
Lopes, F. J. P., Barros, C. D. T., de Carvalho, J. X., Vieira, F. D. M. C., & Costa, C. N. (2020) · Computational biology · doi:10.1007/978-3-030-51862-2_7
Multi-Scale Modeling of the Innate Immune System: A Dynamic Investigation into Pathogenic Detection
Gregg, R. W. (2020) · D-Scholarship@Pitt (University of Pittsburgh)
Parameter Estimation for nonlinear sloppy model
WangHong, & Kangling (2020) · International Conference on Information Science, Parallel and Distributed Systems (ISPDS) · doi:10.1109/ispds51347.2020.00055 · Cited by 1
Inverse Gaussian Process regression for likelihood-free inferencePreprint
Wang, H., Ao, Z., Yu, T., & Li, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.10583 · Cited by 2
“This type of problems appear quite often in the field of computational biology ranging from population dynamics to biochemical networks [15, 8].”
BackgroundSystems biology in disease modeling and control, analysis and perspectivesPreprint
Yue, R., & Dutta, A. (2021) · Research Square · doi:10.21203/rs.3.rs-578017/v1
Shi, Z., Li, Y., & Jaberi‐Douraki, M. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009413
Identificabilidad de modelos matemáticos en procesos biotecnológicos
Rendón, S., & César, J. (2021)
Douilhet, G., Niranjan, M., Vallejo, A. F., Clayton, K., Davies, J., Sirvent, S., Pople, J., Ardern‐Jones, M. R., & Polak, M. E. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.02.22.481394
Science in support of a nonlinear non-equilibrium world: all articles
(2020) · ICES Journal of Marine Science · doi:10.1093/icesjms/fsaa144
Parameter Inference for an Astrocyte Model using Machine Learning ApproachesPreprint
Fritschi, L., & Lenk, K. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.05.16.540982 · Cited by 2
“, 2019], genetic algorithms [Mitchell, 1998], Bayesian inference 100 methods such as Markov Chain Monte Carlo (MCMC) [Valderrama-Bahamóndez and Fröhlich, 2019] or, 101 though more often used in robotics, Kalman filters [Lillacci and Khammash, 2010].”
MethodMargarit, D. H., Paccosi, G., Pagnani, A., Reale, M. V., Scagliotti, A. F., & Romanelli, L. (2024) · Journal of Biological Systems · doi:10.1142/s021833902550007x
Inverse Problem Antidote (IPA): Modeling of Systems Biology Model with Invertible Neural Networks
Li, L., Lu, S., Umulis, D. M., & Wang, X. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822632
Approximate Bayesian inference in a model for self-generated gradient collective cell movement
Devlin, J., Borowska, A., Husmeier, D., & Mackenzie, J. A. (2025) · Computational Statistics · doi:10.1007/s00180-025-01606-5
Dash, S., Kumar, A. S. S., & Dey, A. (2025) · International Conference on Control, Decision and Information Technologies (CoDIT) · doi:10.1109/codit66093.2025.11321810
“Hybrid Extended Kalman filter (HEKF) has been used for parameter estimation in heat shock response of E. coli [6].”
Correcting model error bias in estimations of neuronal dynamics from time series observations
Williams, I., Taylor, J. D., & Nogaret, A. (2026) · Scientific Reports · doi:10.1038/s41598-026-43346-6
“This is why we see that all ASVH-FH predictions, including a surrogate or reference model (Figs.1,4,5,7), remain remarkably stable and accurate over long time intervals.”
Computational modeling to design and analyze synthetic metabolic circuits
Koch, M. (2019) · theses.fr (ABES) · doi:10.70675/c62d36ffz8c11z4509zad56ze764c2cee027
Clairon, Q. (2015) · theses.fr (ABES) · doi:10.70675/8b8876bcz097cz46fbz9183z198a61ad8c86
Uddin, M. M., Sakib, M., Akter, S., & Kabir, M. H. (2026) · Engineering Reports · doi:10.1002/eng2.70943 · Cited by 1
A Bayesian Study to Optimally Unveil LDH Kinetic Mechanisms In VivoPreprint
Gomez-Cabeza, D., Mangas‐Florencio, L., Matajsz, G., Gonzalez, A., & Marco‐Rius, I. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.07.30.741466
“Besides the expertise needed to develop such models, parameters are hard or impractical to measure experimentally, leaving researchers to face complex optimisation problems to infer them [23].”
From prior knowledge to data-informed models: a review of Boolean network inference
Klemmer, P., Hemedan, A. A., Schneider, R., & Ostaszewski, M. (2026) · Briefings in Bioinformatics · doi:10.1093/bib/bbag499 · Cited by 1
“Also, computational models face scalability challenges related to parameterisation and computation time; in fact, the parameters required to calibrate such models are frequently unknown, prohibiting accurate simulation [ 15– 17].”
Systems Biology Studies of Gene Network and Cell Signaling Pathway in Cancer Research
Wang, J., Davidson, B., & Tian, T. (2013) · Translational bioinformatics · doi:10.1007/978-94-007-7975-4_6
Metadata
- Authors
- Lillacci, G., & Khammash, M.
- Affiliations
- University of California, Santa Barbara (US)
- Corresponding author
- Khammash, Mustafa
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2010-03-05
- Volume
- 6
- Issue
- 3
- Pages
- e1000696
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC2832681
- OpenAlex
- W2044278781
- Semantic Scholar
- 9a362ed58bcf80e6191bf963bfb5cc5a48f26719
- Cited by
- 325
- References
- 48
- Citations by year
- 2026: 4 · 2025: 13 · 2024: 18 · 2023: 11 · 2022: 16 · 2021: 24 · 2020: 21 · 2019: 29 · 2018: 27 · 2017: 21 · 2016: 19 · 2015: 28 · 2014: 29 · 2013: 34 · 2012: 14
- FWCI
- 8.46
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- National Science Foundation (0802008, DAAD19-03-D-0004, 0835847)
- Deutscher Akademischer Austauschdienst
- National Institutes of Health
- National Institute of General Medical Sciences (R01GM049831)
- Division of Electrical, Communications and Cyber Systems (0835847, ECCS-0802008)
- Army Research Office (DAAD 19-03-D-0004, ECCS-0835847)
- Institute for Collaborative Biotechnologies (ECCS-0835847, DAAD19-03-D-0004)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Microbial Metabolic Engineering and Bioproduction
- Keywords
- parameter estimation, model selection, extended Kalman filter, recursive parameter estimation, identifiability, heat shock response, Escherichia coli, synthetic gene regulation, rate constants, mathematical biology
- MeSH terms
- Algorithms, Animals, Computer Simulation, Gene Expression Regulation, Humans, Models, Biological, Signal Transduction, Proteome, Systems Biology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-05, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-05 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.