Stimulus Design for Model Selection and Validation in Cell Signaling
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
Mechanism-based chemical kinetic models are increasingly being used to describe biological signaling. Such models serve to encapsulate current understanding of pathways and to enable insight into complex biological processes. One challenge in model development is that, with limited experimental data, multiple models can be consistent with known mechanisms and existing data. Here, we address the problem of model ambiguity by providing a method for designing dynamic stimuli that, in stimulus-response experiments, distinguish among parameterized models with different topologies, i.e., reaction mechanisms, in which only some of the species can be measured. We develop the approach by presenting two formulations of a model-based controller that is used to design the dynamic stimulus. In both formulations, an input signal is designed for each candidate model and parameterization so as to drive the model outputs through a target trajectory. The quality of a model is then assessed by the ability of the corresponding controller, informed by that model, to drive the experimental system. We evaluated our method on models of antibody-ligand binding, mitogen-activated protein kinase (MAPK) phosphorylation and de-phosphorylation, and larger models of the epidermal growth factor receptor (EGFR) pathway. For each of these systems, the controller informed by the correct model is the most successful at designing a stimulus to produce the desired behavior. Using these stimuli we were able to distinguish between models with subtle mechanistic differences or where input and outputs were multiple reactions removed from the model differences. An advantage of this method of model discrimination is that it does not require novel reagents, or altered measurement techniques; the only change to the experiment is the time course of stimulation. Taken together, these results provide a strong basis for using designed input stimuli as a tool for the development of cell signaling models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures

![Figure 2 Analysis of Monovalent Antibody Binding (A) Two models of monovalent antibody binding, a one-step version with no intermediate, and a two-step version with an association intermediate C *. (B) The results of six simulated experiments are shown as designed in [3]. Each trace is the response of the system to a square pulse of ligand concentration. The width of the pulse varies from 400 s to 6,000 s. The pronounced elbow in the middle curves is indicative of the two-state model. The one-step model cannot have compound off kinetics. (C) The set of experiments designed by this algorithm as well as simulated results are shown. Each pulse was designed to produce a level output when applied to the correct model (yellow boxes), which was observed, and produced a distinctly different result when applied to the other model (blue boxes). The red lines are the inputs (unbound L) the blue lines are the output (C or C + C *). The smaller the gap between the blue and the black dashed line the better the model fits the real system. Looking across one row shows a pair of experiments that would be run together.](https://figures.cochat.ai/paper-figures/71c5566e02b64e659db6274285346b7f/stimulus-design-for-model-selection-and-validation-in-cell-signaling-figure-2.jpg)



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The approach we presented here yields the potential for model discrimination or checking the target of our analysis [48], [51], and, for example, choose experimental designs that maximize our ability to distinguish between competing alternative hypotheses or models.”
From Maximizing the information content of experiments in systems biology (2013) · cites this paper as [48]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Another common application of OED is discrimination among competing models [147].”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [147]
The cited source says what the claim attributes to it.
In the citing paper
“The topic of optimal design of dynamic experiments in biological systems is receiving increased attention [144–152].”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [147]
In the citing paper
“Small molecule inhibitors or activators also enable time-dependent perturbation, thereby providing important new degrees of freedom that may permit improved model calibration with fewer experimental manipulations.5”
From Sloppy models, parameter uncertainty, and the role of experimental design (2010) · cites this paper as [5]
In the citing paper
“our approach also readily incorporates different stimulus patterns [48].”
From Maximizing the information content of experiments in systems biology (2013) · cites this paper as [48]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2021) · A First Course in Statistical Programming with R · doi:10.1017/9781108993456.011 · Cited by 13,724
Bertsekas, D. P. (1997) · Journal of the Operational Research Society · doi:10.1038/sj.jors.2600425 · Cited by 11,726
(2006) · Springer Series in Operations Research and Financial Engineering · doi:10.1007/978-0-387-40065-5 · Cited by 9,008
Untangling the ErbB signalling network
Yarden, Y., & Sliwkowski, M. X. (2001) · Nature Reviews Molecular Cell Biology · doi:10.1038/35052073 · Cited by 6,974 · cited 1×
“Overexpression of EGFR family members is a marker of certain types of cancer, including head, neck, breast, bladder, and kidney [20].”
BackgroundLodish, H. F. (1986) · Cited by 5,650
Systems biology: a brief overview
Kitano, H. (2002) · Science · doi:10.1126/science.1069492 · Cited by 4,265
Shampine, L. F., & Reichelt, M. W. (1997) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827594276424 · Cited by 3,599
Global, In Vivo, and Site-Specific Phosphorylation Dynamics in Signaling Networks
Olsen, J. V., Blagoev, B., Gnad, F., Macek, B., Kumar, C., Mortensen, P., & Mann, M. (2006) · Cell · doi:10.1016/j.cell.2006.09.026 · Cited by 3,499
Weik, M. H. (2000) · Computer Science and Communications Dictionary · doi:10.1007/1-4020-0613-6_12436 · Cited by 2,570
Kronecker Products and Matrix Calculus: With Applications
Graham, A. (1981) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,630
Introduction to applied mathematics.
(1986) · Mathematics and Computers in Simulation · doi:10.1016/0378-4754(86)90036-4 · Cited by 1,495
The EGF receptor family as targets for cancer therapy
Mendelsohn, J., & Baselga, J. (2000) · Oncogene · doi:10.1038/sj.onc.1204082 · Cited by 1,340
A comprehensive pathway map of epidermal growth factor receptor signaling
Oda, K., Matsuoka, Y., Funahashi, A., & Kitano, H. (2005) · Molecular Systems Biology · doi:10.1038/msb4100014 · Cited by 1,158
Schoeberl, B., Eichler-Jonsson, C., Gilles, E. D., & Müller, G. (2002) · Nature Biotechnology · doi:10.1038/nbt0402-370 · Cited by 950
A proteomics strategy to elucidate functional protein-protein interactions applied to EGF signaling
Blagoev, B., Kratchmarova, I., Ong, S.-E., Nielsen, M., Foster, L. J., & Mann, M. (2003) · Nature Biotechnology · doi:10.1038/nbt790 · Cited by 689
Akaike's Information Criterion and Recent Developments in Information Complexity
Bozdogan, H. (2000) · Journal of Mathematical Psychology · doi:10.1006/jmps.1999.1277 · Cited by 674
Introduction to Applied Mathematics
Strang, G., & Freund, L. B. (1986) · Journal of Applied Mechanics · doi:10.1115/1.3171799 · Cited by 664
Quantification of Short Term Signaling by the Epidermal Growth Factor Receptor
Kholodenko, B. N., Demin, O. V., Moehren, G., & Hoek, J. B. (1999) · Journal of Biological Chemistry · doi:10.1074/jbc.274.42.30169 · Cited by 618
(1987) · International Journal of Biochemistry · doi:10.1016/0020-711x(87)90149-2 · Cited by 598
Zhang, Y., Wolf-Yadlin, A., Ross, P. L., Pappin, D. J., Rush, J., Lauffenburger, D. A., & White, F. M. (2005) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m500089-mcp200 · Cited by 541
Self-citationNeuregulins and Their Receptors: A Versatile Signaling Module in Organogenesis and Oncogenesis
Burden, S., & Yarden, Y. (1997) · Neuron · doi:10.1016/s0896-6273(00)80324-4 · Cited by 476
Discrimination Among Mechanistic Models
Box, G. E. P., & Hill, W. J. (1967) · Technometrics · doi:10.1080/00401706.1967.10490441 · Cited by 426
Cao, Y., Li, S., Petzold, L., & Serban, R. (2003) · SIAM Journal on Scientific Computing · doi:10.1137/s1064827501380630 · Cited by 407
Computational modeling of the EGF-receptor system: a paradigm for systems biology
Steven Wiley, H. (2003) · Trends in Cell Biology · doi:10.1016/s0962-8924(02)00009-0 · Cited by 345
Mechanistic Studies of the Dual Phosphorylation of Mitogen-activated Protein Kinase
Ferrell, J. E., & Bhatt, R. R. (1997) · Journal of Biological Chemistry · doi:10.1074/jbc.272.30.19008 · Cited by 344
van Riel, N. A. W. (2006) · Briefings in Bioinformatics · doi:10.1093/bib/bbl040 · Cited by 254
Linking data to models: data regression
Jaqaman, K., & Danuser, G. (2006) · Nature Reviews Molecular Cell Biology · doi:10.1038/nrm2030 · Cited by 243
Designing robust optimal dynamic experiments
Asprey, S. P., & Macchietto, S. (2002) · Journal of Process Control · doi:10.1016/s0959-1524(01)00020-8 · Cited by 199 · cited 1×
“Previous work in designing dynamic stimuli for the purpose of model discrimination in systems biology has focused on choosing input trajectories that maximize the expected difference in the output trajectories of competing models [4–10].”
BackgroundControl of MAPK signalling: from complexity to what really matters
Hornberg, J. J., Binder, B., Bruggeman, F. J., Schoeberl, B., Heinrich, R., & Westerhoff, H. V. (2005) · Oncogene · doi:10.1038/sj.onc.1208817 · Cited by 199
Kremling, A., Fischer, S., Gadkar, K., Doyle, F. J., Sauter, T., Bullinger, E., Allgöwer, F., & Gilles, E. D. (2004) · Genome Research · doi:10.1101/gr.1226004 · Cited by 127 · cited 1×
“Previous work in designing dynamic stimuli for the purpose of model discrimination in systems biology has focused on choosing input trajectories that maximize the expected difference in the output trajectories of competing models [4–10].”
BackgroundExperimental Design for Analysis of Complex Kinetics Using Surface Plasmon Resonance
Lipschultz, C. A., Li, Y., & Smith‐Gill, S. J. (2000) · Methods · doi:10.1006/meth.1999.0924 · Cited by 93
CRC standard curves and surfaces
(1994) · Choice Reviews Online · doi:10.5860/choice.32-0369 · Cited by 92
Casey, F. P., Baird, D., Feng, Q., Gutenkunst, R. N., Waterfall, J. J., Myers, C. R., Brown, K. S., Cerione, R. A., & Sethna, J. P. (2007) · IET Systems Biology · doi:10.1049/iet-syb:20060065 · Cited by 77
Systems biology—an engineering perspective
Kremling, A., & Saez-Rodriguez, J. (2007) · Journal of Biotechnology · doi:10.1016/j.jbiotec.2007.02.009 · Cited by 76
Chen, B. H., & Asprey, S. P. (2003) · Industrial & Engineering Chemistry Research · doi:10.1021/ie0203025 · Cited by 72
Investigating the dynamic behavior of biochemical networks using model families
Haunschild, M. D., Freisleben, B., Takors, R., & Wiechert, W. (2004) · Computer applications in the biosciences · doi:10.1093/bioinformatics/bti225 · Cited by 44
New targets and challenges in the molecular therapeutics of cancer
Eastman, A. R., & Perez, R. P. (2006) · British Journal of Clinical Pharmacology · doi:10.1111/j.1365-2125.2006.02720.x · Cited by 36
Optimal dynamic experiments for bioreactor model discrimination
Cooney, M. J., & McDonald, K. A. (1995) · Applied Microbiology and Biotechnology · doi:10.1007/bf02431915 · Cited by 33
Ternbach, M. B., Bollman, C., Wandrey, C., & Takors, R. (2005) · Biotechnology and Bioengineering · doi:10.1002/bit.20504 · Cited by 29
Current challenges in quantitative modeling of epidermal growth factor signaling
Breitling, R., & Hoeller, D. (2005) · FEBS Letters · doi:10.1016/j.febslet.2005.10.034 · Cited by 28
Some Improvements in the Identification of Bioprocesses
Munack, A. (1992) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)50331-6 · Cited by 15
Research works printed but not linked: 31
- Kitano, 2002, Science, 295, 1662
- Kremling, 2007, J Biotechnol, 129, 329
- Lipschultz, 2000, Methods, 20, 310
- Box, 1967, Technometrics, 9, 57
- Asprey, 2002, J Process Contr, 12, 545
- Cooney, 1995, Appl Microbiol Biot, 43, 826
- Munack, 1992, Modeling and control of biotechnical processes, 89
- Brik Ternbach, 2005, Biotechnol Bioeng, 91, 356
- Chen, 2003, Ind Eng Chem Res, 42, 1379
- Kremling, 2004, Genome Res, 14, 1773
- Jaqaman, 2006, Nat Rev Mol Cell Biol, 7, 813
- van Riel, 2006, Brief Bioinform, 7, 364
- Casey, 2007, IET Syst Biol, 1, 190
- Breitling, 2005, FEBS Lett, 579, 6289
- Wiley, 2003, Trends Cell Biol, 13, 43
- Hornberg, 2005, Oncogene, 24, 5533
- Kholodenko, 1999, J Biol Chem, 274, 30169
- Schoeberl, 2002, Nat Biotechnol, 20, 370
- Burden, 1997, Neuron, 18, 847
- Yarden, 2001, Nat Rev Mol Cell Biol, 2, 127
- Mendelsohn, 2000, Oncogene, 19, 6550
- Eastman, 2006, Br J Clin Pharmacol, 62, 5
- Zhang, 2005, Mol Cell Proteomics, 4, 1240
- Blagoev, 2003, Nat Biotechnol, 21, 315
- Olsen, 2006, Cell, 127, 635
- Ferrell, 1997, J Biol Chem, 272, 19008
- Cao, 2003, SIAM J Sci Comput, 24, 1076
- Shampine, 1997, SIAM J Sci Comput, 18, 1
- Bozdogan, 2000, J Math Psychol, 44, 62
- Haunschild, 2005, Bioinformatics, 21, 1617
- Oppenheim, 1997, Signals and systems
Cited by
Dynamical modeling and multi-experiment fitting with PottersWheel
Maiwald, T., & Timmer, J. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn350 · Cited by 231
Reverse engineering and identification in systems biology: strategies, perspectives and challenges
Villaverde, A. F., & Banga, J. R. (2014) · Journal of The Royal Society Interface · doi:10.1098/rsif.2013.0505 · Cited by 229
“Another common application of OED is discrimination among competing models [147].”
BackgroundUltra Low Power Bioelectronics: Fundamentals, Biomedical Applications, and Bio-Inspired Systems
Sarpeshkar, R. (2010) · Cited by 223
An iterative identification procedure for dynamic modeling of biochemical networks
Balsa-Canto, E., Alonso, A. A., & Banga, J. R. (2010) · BMC Systems Biology · doi:10.1186/1752-0509-4-11 · Cited by 202
Robust and efficient parameter estimation in dynamic models of biological systems
Gábor, A., & Banga, J. R. (2015) · BMC Systems Biology · doi:10.1186/s12918-015-0219-2 · Cited by 175
Metadata
- Authors
- Apgar, J. F., Toettcher, J. E., Endy, D., White, F. M., & Tidor, B.
- Affiliations
- MIT Computer Science and Artificial Intelligence Laboratory (US)
- Massachusetts Institute of Technology (US)
- Corresponding author
- Tidor, Bruce
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2008
- Volume
- 4
- Issue
- 2
- Pages
- e30
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC2323406
- OpenAlex
- W2051594535
- Cited by
- 79
- References
- 40
- Citations by year
- 2025: 1 · 2021: 1 · 2020: 7 · 2019: 1 · 2018: 5 · 2017: 4 · 2016: 3 · 2015: 4 · 2014: 11 · 2013: 7 · 2012: 7
- FWCI
- 3.84
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- National Institutes of Health (CA112967)
- National Cancer Institute (U54CA112967)
- National Institute of General Medical Sciences (R01GM058762, P50 GM58762)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Microbial Metabolic Engineering and Bioproduction
- Keywords
- stimulus design, model selection, model discrimination, signal transduction, chemical kinetic modeling, model-based control, model ambiguity, MAPK phosphorylation, EGFR signaling
- MeSH terms
- Computer Simulation, Models, Biological, Research Design, Signal Transduction, Proteome, Protein Interaction Mapping
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.