CoChat

Stimulus Design for Model Selection and Validation in Cell Signaling

Open access

The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.

Abstract

Mechanism-based chemical kinetic models are increasingly being used to describe biological signaling. Such models serve to encapsulate current understanding of pathways and to enable insight into complex biological processes. One challenge in model development is that, with limited experimental data, multiple models can be consistent with known mechanisms and existing data. Here, we address the problem of model ambiguity by providing a method for designing dynamic stimuli that, in stimulus-response experiments, distinguish among parameterized models with different topologies, i.e., reaction mechanisms, in which only some of the species can be measured. We develop the approach by presenting two formulations of a model-based controller that is used to design the dynamic stimulus. In both formulations, an input signal is designed for each candidate model and parameterization so as to drive the model outputs through a target trajectory. The quality of a model is then assessed by the ability of the corresponding controller, informed by that model, to drive the experimental system. We evaluated our method on models of antibody-ligand binding, mitogen-activated protein kinase (MAPK) phosphorylation and de-phosphorylation, and larger models of the epidermal growth factor receptor (EGFR) pathway. For each of these systems, the controller informed by the correct model is the most successful at designing a stimulus to produce the desired behavior. Using these stimuli we were able to distinguish between models with subtle mechanistic differences or where input and outputs were multiple reactions removed from the model differences. An advantage of this method of model discrimination is that it does not require novel reagents, or altered measurement techniques; the only change to the experiment is the time course of stimulation. Taken together, these results provide a strong basis for using designed input stimuli as a tool for the development of cell signaling models.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pcbi.0040030

Cites

41 of 41 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Schematic of Experimental Design (A) A feedback controller is used to solve for the stimulus u(t) that will drive the model system outputs y simulation(t) to follow the design trajectory y design(t). The inputs to the feedback controller are the deviation from the desired trajectory e design(t) as well as the model state x(t). (B) The designed stimulus can be applied to an unknown experimental system to assess the quality of the model. A stimulus based on a good model should be able to drive the experimental system output y(t) through the design trajectory.
Figure 1 Schematic of Experimental Design (A) A feedback controller is used to solve for the stimulus u(t) that will drive the model system outputs y simulation(t) to follow the design trajectory y design(t). The inputs to the feedback controller are the deviation from the desired trajectory e design(t) as well as the model state x(t). (B) The designed stimulus can be applied to an unknown experimental system to assess the quality of the model. A stimulus based on a good model should be able to drive the experimental system output y(t) through the design trajectory.CC BY · PubMed Central
Figure 2 Analysis of Monovalent Antibody Binding (A) Two models of monovalent antibody binding, a one-step version with no intermediate, and a two-step version with an association intermediate C *. (B) The results of six simulated experiments are shown as designed in [3]. Each trace is the response of the system to a square pulse of ligand concentration. The width of the pulse varies from 400 s to 6,000 s. The pronounced elbow in the middle curves is indicative of the two-state model. The one-step model cannot have compound off kinetics. (C) The set of experiments designed by this algorithm as well as simulated results are shown. Each pulse was designed to produce a level output when applied to the correct model (yellow boxes), which was observed, and produced a distinctly different result when applied to the other model (blue boxes). The red lines are the inputs (unbound L) the blue lines are the output (C or C + C *). The smaller the gap between the blue and the black dashed line the better the model fits the real system. Looking across one row shows a pair of experiments that would be run together.
Figure 2 Analysis of Monovalent Antibody Binding (A) Two models of monovalent antibody binding, a one-step version with no intermediate, and a two-step version with an association intermediate C *. (B) The results of six simulated experiments are shown as designed in [3]. Each trace is the response of the system to a square pulse of ligand concentration. The width of the pulse varies from 400 s to 6,000 s. The pronounced elbow in the middle curves is indicative of the two-state model. The one-step model cannot have compound off kinetics. (C) The set of experiments designed by this algorithm as well as simulated results are shown. Each pulse was designed to produce a level output when applied to the correct model (yellow boxes), which was observed, and produced a distinctly different result when applied to the other model (blue boxes). The red lines are the inputs (unbound L) the blue lines are the output (C or C + C *). The smaller the gap between the blue and the black dashed line the better the model fits the real system. Looking across one row shows a pair of experiments that would be run together.CC BY · PubMed Central
Figure 3 Analysis of MAPK Mechanisms (A) Four alternative MAPK reaction schemes are shown. These correspond to all combinations of processive and distributive kinase and phosphatase mechanisms. Model I is the canonical all-distributive mechanism. For each model the input is the concentration of activated kinase (K) and the output is the doubly phosphorylated substrate (S**). (B) All four MAPK models respond in very similar fashion to a step increase in kinase input (u = 1). (C) A set of 16 model-selection experiments. Each row is a different experimental system and each column is a different candidate model. Red lines are inputs (activated K), blue lines are outputs (S**), and the black dashed line is the design output trajectory. The experiments on the diagonal show that the correct model can control the system. The off-diagonal experiments show that the wrong model does a worse job. This difference can be used to select the correct model.
Figure 3 Analysis of MAPK Mechanisms (A) Four alternative MAPK reaction schemes are shown. These correspond to all combinations of processive and distributive kinase and phosphatase mechanisms. Model I is the canonical all-distributive mechanism. For each model the input is the concentration of activated kinase (K) and the output is the doubly phosphorylated substrate (S**). (B) All four MAPK models respond in very similar fashion to a step increase in kinase input (u = 1). (C) A set of 16 model-selection experiments. Each row is a different experimental system and each column is a different candidate model. Red lines are inputs (activated K), blue lines are outputs (S**), and the black dashed line is the design output trajectory. The experiments on the diagonal show that the correct model can control the system. The off-diagonal experiments show that the wrong model does a worse job. This difference can be used to select the correct model.CC BY · PubMed Central
Figure 4 Schematic of EGF-Induced Signaling This schematic shows the major steps in EGFR signaling. At the top of the pathway ligand binds to the receptor and induces receptor dimerization and activation. The signal is then transduced through a series of adaptor proteins SHC, GRB2, and SOS, which in turn activates the MAPK cascade RAF, MEK and ERK. There are two negative feedback loops: internalization and degradation of the receptor complex, and ERK deactivation of SOS.
Figure 4 Schematic of EGF-Induced Signaling This schematic shows the major steps in EGFR signaling. At the top of the pathway ligand binds to the receptor and induces receptor dimerization and activation. The signal is then transduced through a series of adaptor proteins SHC, GRB2, and SOS, which in turn activates the MAPK cascade RAF, MEK and ERK. There are two negative feedback loops: internalization and degradation of the receptor complex, and ERK deactivation of SOS.CC BY · PubMed Central
Figure 5 Comparison of Step Experiment to Designed Experiment for EGFR Pathway with Original and Modified Models (A) Both models respond similarly but not identically to a step input in EGF over a range of concentrations. The red lines are the outputs of the modified model and the blue lines are the outputs of the standard model. Often the blue lines are not visible because they are under the red lines. (B) Two designed dynamic stimuli were applied to two models of the EGFR pathway. The red lines show the input (EGF) concentration as a function of time. The blue lines show the output concentrations (ERKpp). The dashed black line shows the target ERKpp concentration. The controller for the standard model is unable to keep the output level high and saturates. In contrast, the modified model requires a more gradual increase in the input and can control the experiment over the entire time course. In both cases the controller based on the wrong model performs worse that the controller based on the correct model.
Figure 5 Comparison of Step Experiment to Designed Experiment for EGFR Pathway with Original and Modified Models (A) Both models respond similarly but not identically to a step input in EGF over a range of concentrations. The red lines are the outputs of the modified model and the blue lines are the outputs of the standard model. Often the blue lines are not visible because they are under the red lines. (B) Two designed dynamic stimuli were applied to two models of the EGFR pathway. The red lines show the input (EGF) concentration as a function of time. The blue lines show the output concentrations (ERKpp). The dashed black line shows the target ERKpp concentration. The controller for the standard model is unable to keep the output level high and saturates. In contrast, the modified model requires a more gradual increase in the input and can control the experiment over the entire time course. In both cases the controller based on the wrong model performs worse that the controller based on the correct model.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 31

  1. Kitano, 2002, Science, 295, 1662
  2. Kremling, 2007, J Biotechnol, 129, 329
  3. Lipschultz, 2000, Methods, 20, 310
  4. Box, 1967, Technometrics, 9, 57
  5. Asprey, 2002, J Process Contr, 12, 545
  6. Cooney, 1995, Appl Microbiol Biot, 43, 826
  7. Munack, 1992, Modeling and control of biotechnical processes, 89
  8. Brik Ternbach, 2005, Biotechnol Bioeng, 91, 356
  9. Chen, 2003, Ind Eng Chem Res, 42, 1379
  10. Kremling, 2004, Genome Res, 14, 1773
  11. Jaqaman, 2006, Nat Rev Mol Cell Biol, 7, 813
  12. van Riel, 2006, Brief Bioinform, 7, 364
  13. Casey, 2007, IET Syst Biol, 1, 190
  14. Breitling, 2005, FEBS Lett, 579, 6289
  15. Wiley, 2003, Trends Cell Biol, 13, 43
  16. Hornberg, 2005, Oncogene, 24, 5533
  17. Kholodenko, 1999, J Biol Chem, 274, 30169
  18. Schoeberl, 2002, Nat Biotechnol, 20, 370
  19. Burden, 1997, Neuron, 18, 847
  20. Yarden, 2001, Nat Rev Mol Cell Biol, 2, 127
  21. Mendelsohn, 2000, Oncogene, 19, 6550
  22. Eastman, 2006, Br J Clin Pharmacol, 62, 5
  23. Zhang, 2005, Mol Cell Proteomics, 4, 1240
  24. Blagoev, 2003, Nat Biotechnol, 21, 315
  25. Olsen, 2006, Cell, 127, 635
  26. Ferrell, 1997, J Biol Chem, 272, 19008
  27. Cao, 2003, SIAM J Sci Comput, 24, 1076
  28. Shampine, 1997, SIAM J Sci Comput, 18, 1
  29. Bozdogan, 2000, J Math Psychol, 44, 62
  30. Haunschild, 2005, Bioinformatics, 21, 1617
  31. Oppenheim, 1997, Signals and systems

Cited by

See all 79

Metadata

Authors
Apgar, J. F., Toettcher, J. E., Endy, D., White, F. M., & Tidor, B.
Affiliations
  • MIT Computer Science and Artificial Intelligence Laboratory (US)
  • Massachusetts Institute of Technology (US)
Corresponding author
Tidor, Bruce
Venue
PLoS Computational Biology
Published
2008
Volume
4
Issue
2
Pages
e30
ISSN
  • 1553-734X (ISSN-L)
  • 1553-7358
OpenAlex
W2051594535
Cited by
79
References
40
Citations by year
2025: 1 · 2021: 1 · 2020: 7 · 2019: 1 · 2018: 5 · 2017: 4 · 2016: 3 · 2015: 4 · 2014: 11 · 2013: 7 · 2012: 7
FWCI
3.84
Type
journal article
Language
en
Open access
Locations
  • PLoS Computational Biology (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Figshare (submittedVersion, cc-by)
Funders
  • National Institutes of Health (CA112967)
  • National Cancer Institute (U54CA112967)
  • National Institute of General Medical Sciences (R01GM058762, P50 GM58762)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
  • Physical Sciences › Engineering › Control and Systems Engineering › Control Systems and Identification
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Microbial Metabolic Engineering and Bioproduction
Keywords
stimulus design, model selection, model discrimination, signal transduction, chemical kinetic modeling, model-based control, model ambiguity, MAPK phosphorylation, EGFR signaling
MeSH terms
Computer Simulation, Models, Biological, Research Design, Signal Transduction, Proteome, Protein Interaction Mapping

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.