Relating simulation studies by provenance—Developing a family of Wnt signaling models
Open accessPublished version of a preprint
The DOI matches its Crossref record; 114 of the 115 references it cites were found in a registry or an index; 57 of the 143 sources its claims cite were checked for support.
Abstract
For many biological systems, a variety of simulation models exist. A new simulation model is rarely developed from scratch, but rather revises and extends an existing one. A key challenge, however, is to decide which model might be an appropriate starting point for a particular problem and why. To answer this question, we need to identify entities and activities that contributed to the development of a simulation model. Therefore, we exploit the provenance data model, PROV-DM, of the World Wide Web Consortium and, building on previous work, continue developing a PROV ontology for simulation studies. Based on a case study of 19 Wnt/β-catenin signaling models, we identify crucial entities and activities as well as useful metadata to both capture the provenance information from individual simulation studies and relate these forming a family of models. The approach is implemented in WebProv , a web application for inserting and querying provenance information. Our specialization of PROV-DM contains the entities Research Question, Assumption, Requirement, Qualitative Model, Simulation Model, Simulation Experiment, Simulation Data, and Wet-lab Data as well as activities referring to building, calibrating, validating, and analyzing a simulation model. We show that most Wnt simulation models are connected to other Wnt models by using (parts of) these models. However, the overlap, especially regarding the Wet-lab Data used for calibration or validation of the models is small. Making these aspects of developing a model explicit and queryable is an important step for assessing and reusing simulation models more effectively. Exposing this information helps to integrate a new simulation model within a family of existing ones and may lead to the development of more robust and valid simulation models. We hope that our approach becomes part of a standardization effort and that modelers adopt the benefits of provenance when considering or creating simulation models.
Overview
CoChat Summary
TL;DR
The paper develops a PROV-DM specialization for capturing provenance of simulation studies and uses it to relate 19 Wnt/β-catenin signaling models into a family. It shows most Wnt models are connected through reuse of models or model parts, while overlap in wet-lab data used for calibration or validation is small.
Key findings
- The PROV-DM specialization defines entities Research Question, Assumption, Requirement, Qualitative Model, Simulation Model, Simulation Experiment, Simulation Data, and Wet-lab Data, plus activities Building, Calibrating, Validating, and Analyzing Simulation Model, connected via `wasGeneratedBy` and `used`.
- In the case study of 19 Wnt/β-catenin simulation studies, all but two models are indirectly connected to Lee et al. (2003); the exceptions are Sick et al. (2006) and Rodríguez-González et al. (2007).
- Wet-lab data overlap is small: wet-lab data from just three studies ([105–107]) were reused by simulation studies, and only Lee et al. (2003), Kogan et al. (2012), and Haack et al. (2015) both calibrated and validated models based on wet-lab data.
- Of 106 collected assumptions, the three most used SBO categories were kinetic constants (13), transport (9), and equivalence (8); of 145 simulation experiments, most were parameter scans, followed by time course analyses and perturbations.
Methods
- Design: refine a PROV-DM ontology for cellular biochemical simulation studies, implemented in WebProv, a web application with a Vue/D3 frontend and Neo4j graph backend for storing, displaying, and querying provenance.
- Sample: from 31 found Wnt simulation studies, 19 were selected—all Wnt studies stored in BioModels (6), all published by the authors’ group (4), and nine selected randomly—plus referenced publications used by those studies.
- Analysis: provenance entities, activities, and relations were manually collected from publications and supporting materials; assumptions were categorized using the Systems Biology Ontology, simulation experiments were categorized by type, and provenance graphs were queried to identify relationships among models.
Limitations
- The paper states that manual provenance collection is demanding and requires interpretation because natural-language descriptions are ambiguous and nonlinear; this likely hampers text mining or machine learning replacement, and provenance should ideally be collected during the simulation study.
- The paper states that identifying assumptions involves uncertainty: authors may not state all assumptions, and the authors of this paper may have missed or over-interpreted some; two of 19 studies did not explicitly state assumptions.
- The paper states that Requirements were often not explicit and were identified only in four publications; the approach is coarse-grained, omits PROV-DM agent types and relations such as `WasInformedBy` and `WasDerivedFrom`, and some simulation or wet-lab data were not shown or lacked references.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
![Fig 1 Combined overview of all qualitative Wnt (sub-)models found within the 19 Wnt simulation studies. Depicted are the components (species, compartments, and reactions) of the canonical Wnt signaling pathway (a) and its crosstalk with other signaling pathways (b) found within the 19 Wnt simulation studies. Note that the overview is a simplified and condensed representation. Interactions are simplified and some components of the submodels that do not directly affect the Wnt signaling pathway are omitted. Activated/phosphorylated proteins are indicated by (*). Inactive/unphosphorylated states of proteins have been omitted when possible. Submodels involving membrane-mediated processes, such as receptor/ligand interactions, destruction complex recruitment and endocytosis [31, 45, 51, 56], or cadherin-mediated cell adhesion [34, 39, 49] are incorporated in (a). Submodels involving crosstalk with ERK/FGF/PI3K/Akt [32, 36, 53], Notch [33, 36, 48], and ROS/Dvl-mediated pathways [51, 57] are shown in the lower panels of (b), respectively.](https://figures.cochat.ai/paper-figures/2051bcc69f5c4ffca7f9a33862759a53/relating-simulation-studies-by-provenancedeveloping-a-family-of-wnt-signaling-figure-1.jpg)

![Fig 3 Provenance graph of the study by Lee et al. (2003) [28]. Besides the entities and activities that make up the provenance information from the study (see legend), additional entities from three other studies [64–66], which were used by Lee et al. (2003), are shown. The colors of the ellipses show different entity types, the borders of the rectangles visualize different activity types. The gray areas separate the individual studies. The graph displays, for example, that the Building Simulation Model activity BSM1 used, among others, the entity WD1 of type Wet-lab Data from Lee et al. 2001 [64]. This activity then generated the Simulation Model SM1.](https://figures.cochat.ai/paper-figures/21db0e094fed4305bc7d0235f8c72d1f/relating-simulation-studies-by-provenancedeveloping-a-family-of-wnt-signaling-figure-3.jpg)
![Fig 4 Screenshot of WebProv. This screenshot shows the provenance graph of the study by Lee et al. (2003) [28] with additional entities from three other studies [64–66], which are automatically colored differently. The node SD2 has been clicked on, which opens a box on the right with the stored and editable metadata.](https://figures.cochat.ai/paper-figures/a7328497dc864cc5872696ed82d055a3/relating-simulation-studies-by-provenancedeveloping-a-family-of-wnt-signaling-figure-4.jpg)

![Fig 6 Provenance graph of all Wnt/β-catenin simulation studies considered here (black outlines) as well as additionally used studies (gray outlines). The colors indicate the cell lines used in wet-lab experiments of that study (see legend below graph). Gray boxes represent pure Wnt/β-catenin simulation studies without acquiring wet-lab data. White boxes display publications used by some of the Wnt/β-catenin simulation studies that are either text books or simulation studies without published wet-lab data. The figure was created using the R package DiagrammeR [103]. The references to the additionally used studies are found in S1 Appendix.](https://figures.cochat.ai/paper-figures/64c2eac22441400fb2c4ef6d1ffb7b50/relating-simulation-studies-by-provenancedeveloping-a-family-of-wnt-signaling-figure-6.jpg)
Verification
Claims the paper makes
29 Valid · 6 Not valid · 27 Not checked · 76 Own results and interpretations
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“Some simulation studies resulted in the development of multiple simulation models that are neither extensions nor compositions but rather form a revision or alternative to other simulation models developed in the same study: [33, 39, 41, 46, 48, 49].”
§ Relating simulation studies by provenance—Developing a family of Wnt signaling models > Results and discussion > Exploring the provenance of and among the Wnt simulation models of 19 simulation studies
What the sources say
- Partly supportedcites [33] J Rodríguez-González, 2007, The segmentation clock in mice: interaction between the Wnt and Notch signalling pathways, Journal of theoretical biology sourceExperimental — accuracy not yet measured
Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
- Partly supportedcites [39] IMM van Leeuwen, 2009, An integrative computational model for intestinal tissue renewal, Cell Proliferation sourceExperimental — accuracy not yet measured
Our copy does show that this study contains more than one simulation model standing in an alternative relationship to another built in the same work: the Discussion states that the cylindrical crypt 'has the undesired effect of overestimating the number of stem cells' and that 'to improve the quality of our predictions, we have devised a second type of virtual crypt' (the projection model), and the Results run 'two equivalent crypt simulations, based on Hypothesis I (purely competitive scenario) and II (two molecular forms of β-catenin)' (Fig. 9). However, the rest of the attributed characterisation is not in the paper: it repeatedly frames its model as an adaptation/extension and composition of other, pre-existing models ('the lattice-free model of Meineke et al., which forms the basis for our multiscale intestinal crypt'; 'we explain how we have adapted this model'; the Wnt module from ref. 29 and the Swat et al. cell-cycle module from ref. 30), and the further models (DMC extended with edge-dependent adhesion and area-dependent drag; the geometry and cell-size work) are presented as 'refining the multiscale model', i.e. extensions/compositions rather than revisions or alternatives. The 'neither extensions nor compositions' classification is the citing authors', not something this paper states. (LLM, conf=0.65)
- Not checked — no full text of the sourcecites [41] GR Mirams, 2010, A multiple timescale analysis of a mathematical model of the Wnt/β-catenin signalling pathway, Journal of Mathematical Biology source
- Disputedcites [46] O Mazemondet, 2012, Elucidating the Sources of β-Catenin Dynamics in Human Neural Progenitor Cells, PLoS ONE sourceExperimental — accuracy not yet measured
The Introduction describes the study’s later models as extensions of its core model, including versions for cell-cycle asynchrony and self-induced signaling. The Results and Discussion section on self-induced Wnt signaling likewise says the authors extend their model with a Wnt-production reaction. That conflicts with classifying this study’s multiple models as neither extensions nor compositions. (LLM, conf=0.84)
Checked by a reasoning model — may be wrong.
- Disputedcites [48] Hy Wang, 2013, Mathematical models for the Notch and Wnt signaling pathways and the crosstalk between them during somitogenesis, Theoretical Biology and Medical Modelling sourceExperimental — accuracy not yet measured
Split into 2 atoms — 0 confirmed, 1 partially supported, 1 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Checked by a reasoning model — may be wrong.
- Disputedcites [49] J Chen, 2014, Computational Modeling of the Interplay between Cadherin-Mediated Cell Adhesion and Wnt Signaling Pathway, PLoS ONE sourceExperimental — accuracy not yet measured
The Models section describes one network model made of connected modules, not multiple models presented as revisions or alternatives to one another. It also explicitly says the Wnt-stimulation module extends Lee’s earlier model, contrary to the claim that these models are neither extensions nor compositions. (LLM, conf=0.86)
Checked by a reasoning model — may be wrong.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“The quantitative requirement that “Axin stimulates the phosphorylation of β-catenin by GSK3β at least 24,000-fold” [28] actually refers to the wet-lab data WD1 obtained in another study by Dajani et al. (2003) [65].”
§ Relating simulation studies by provenance—Developing a family of Wnt signaling models > Results and discussion > Further steps towards a PROV-DM ontology for cellular biochemical simulation models
What the sources say
- Supportedcites [28] E Lee, 2003, The Roles of APC and Axin Derived from Experimental and Theoretical Analysis of the Wnt Pathway, PLoS Biology source
In Results, “A Proposed Kinetic Pathway” (page unavailable), the paper states that axin stimulates β-catenin phosphorylation by GSK3β at least 24,000-fold and explicitly credits Dajani et al. (2003) for that figure. This supports the attribution to Lee et al. for the quoted statement and the clarification that Lee et al. drew it from Dajani et al.; the separate WD1 designation is not assessed under this citation. (LLM, conf=0.94)
- Supportedcites [65] R Dajani, 2003, Structural basis for recruitment of glycogen synthase kinase 3beta to the axin-APC scaffold complex, The EMBO Journal source
The section 'Contribution of axin scaffold to b-catenin phosphorylation' states that the authors compared b-catenin phosphorylation by GSK3b in free solution with that in an axin-scaffolded complex and that 'Based on these data, a scaffolding enhancement of 24 000-fold was calculated', with corroborating immunoblot and radiolabel data — i.e. the 24,000-fold figure is this paper's own wet-lab result, exactly as the citing sentence attributes it. Figure 5 legend ('Templating factor for axin phosphorylation of b-catenin') documents the underlying in vitro GST-axin pull-down/kinase assays, and the same section extends the figure to 720 000-fold when combined with CK1a phospho-priming. Only the 'at least' hedge in the quoted wording is not this paper's phrasing (it reports a calculated 24 000-fold enhancement), which does not affect the attribution being judged. (LLM, conf=0.88)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“In order to facilitate the analysis of assumptions, we adopted the Systems Biology Ontology (SBO) [68] to categorize the assumptions.”
§ Relating simulation studies by provenance—Developing a family of Wnt signaling models > Results and discussion > Further steps towards a PROV-DM ontology for cellular biochemical simulation models
What the sources say
- Supportedcites [68] M Courtot, 2011, Controlled vocabularies and semantics in systems biology, Molecular Systems Biology source
The cited paper’s “Model structure: SBO” section identifies SBO as an ontology for specifying concepts in computational models and says model formulae can embody implicit assumptions. The “Use of ontologies across the modeling and simulation pipeline” section says SBO terms help document the hypotheses behind mathematical representations. The citing authors’ decision to adopt SBO is their own method, not a claim that the source paper did so. (LLM, conf=0.91)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“We could only identify Requirements in the publications of Lee et al. (2003) [28], Wang et al. (2013) [48], Chen et al. (2014) [49], and Haack et al. (2020) [56].”
§ Relating simulation studies by provenance—Developing a family of Wnt signaling models > Results and discussion > Exploring the provenance of and among the Wnt simulation models of 19 simulation studies
What the sources say
- Supportedcites [28] E Lee, 2003, The Roles of APC and Axin Derived from Experimental and Theoretical Analysis of the Wnt Pathway, PLoS Biology source
The Introduction (page unavailable) identifies measurements needed to define the Wnt pathway model and a criterion for testing its validity. The Results, under “Experimental Evaluation of the Reference and Stimulated States” (page unavailable), also specifies constraints on estimated parameters. These are requirements the citing authors could identify in Lee et al.; their statement that they found requirements in only four publications is their own assessment, not a claim attributed to Lee et al. (LLM, conf=0.84)
- Supportedcites [48] Hy Wang, 2013, Mathematical models for the Notch and Wnt signaling pathways and the crosstalk between them during somitogenesis, Theoretical Biology and Medical Modelling source
The citing authors’ statement that they identified requirements in Wang et al. is supported by the paper’s explicit modeling hypotheses. In Results, ‘The model for the Notch pathway in isolation’ (page unavailable), Wang et al. specify assumptions about cell compartments, molecular transport, synthesis, and degradation that apply to their models. The word ‘only’ describes the citing authors’ survey, not a finding attributed to Wang et al. (LLM, conf=0.83)
- Supportedcites [49] J Chen, 2014, Computational Modeling of the Interplay between Cadherin-Mediated Cell Adhesion and Wnt Signaling Pathway, PLoS ONE source
The citation identifies Chen et al. (2014) as a publication in which the citing authors found requirements; it does not ask Chen et al. to substantiate the citing authors’ survey of other publications. In Results > Calibration of Wnt stimulation and β-catenin degradation module (page unavailable), Chen et al. state that model parameters need to be calibrated to reproduce experimental results, which is a modeling requirement. (LLM, conf=0.85)
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“When looking at the CSM and VSM activities, we detect that only a few simulation models were both calibrated and validated based on wet-lab data, namely those of Lee et al. (2003) [28], Kogan et al. (2012) [45], and Haack et al. (2015) [51].”
§ Relating simulation studies by provenance—Developing a family of Wnt signaling models > Results and discussion > Exploring the provenance of and among the Wnt simulation models of 19 simulation studies
What the sources say
- Supportedcites [28] E Lee, 2003, The Roles of APC and Axin Derived from Experimental and Theoretical Analysis of the Wnt Pathway, PLoS Biology source
The Introduction describes experimental measurements used to define the Lee et al. model and experimental tests of its predictions. The Results sections on the reference state and β-catenin degradation further describe parameter values derived from experimental data and simulations compared with biochemical experiments. This supports the citation's identification of Lee et al. as a model calibrated and validated with wet-lab data; it does not assess the citing authors' broader count of models. (LLM, conf=0.93)
- Not checked — no full text of the sourcecites [45] Y Kogan, 2012, A new validated mathematical model of the Wnt signalling pathway predicts effective combinational therapy by sFRP and Dkk, Biochemical Journal source
- Supportedcites [51] F Haack, 2015, Spatio-temporal Model of Endogenous ROS and Raft-Dependent WNT/Beta-Catenin Signaling Driving Cell Fate Commitment in Human Neural Progenitor Cells, PLoS Computational Biology source
In Results/Discussion, under “A comprehensive model of WNT/β-catenin signaling” (page unavailable), Haack et al. say they fitted model parameters to in-vitro measurements from human neural progenitor cells and validated the model against independent in-silico and in-vitro data. This supports citing Haack et al. as an example of a simulation model calibrated and validated using wet-lab data; the “only a few” assessment is the citing authors’ own framing. (LLM, conf=0.94)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
57 more claims · 12 with their cited sources checked
Create a free account to see all 138 claims and to verify the 16 references still open.
- It may state two separate claims as one. 32
- Probably not a substantial claim. 59
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Relating simulation studies by provenance—Developing a family of Wnt signaling models > References
“17. Peng D, Warnke T, Haack F, Uhrmacher AM. Reusing simulation experiment specifications in developing models by successive composition—a case study to support developing models by successive extension. Simulation Modelling Practice and Theory. 2017; 68: 33– 53. doi: 10.1016/j.simpat.2016.07.006”
§ Relating simulation studies by provenance—Developing a family of Wnt signaling models > References
“18. Peng D, Warnke T, Haack F, Uhrmacher AM. Reusing simulation experiment specifications to support developing models by successive extension. Simulation Modelling Practice and Theory. 2016; 68: 33– 53. doi: 10.1016/j.simpat.2016.07.006”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Relating simulation studies by provenance—Developing a family of Wnt signaling models > Results and discussion > Further steps towards a PROV-DM ontology for cellular biochemical simulation models
“For example, SE1 contains a parameter scan in order to validate the simulation model.”
§ Relating simulation studies by provenance—Developing a family of Wnt signaling models > Results and discussion > Further steps towards a PROV-DM ontology for cellular biochemical simulation models
“In the case of the activity CSM1 from Lee et al. (2003), several wet-lab data from their own experiments (WD1–WD5) as well as from Salic et al. (2000) [66] (WD1–WD3) are used during the calibration of the model SM1 which produces a Simulation Experiment SE1, the corresponding Simulation Data SD1 as well as the calibrated Simulation Model SM2.”
Citations
Cites
The FAIR Guiding Principles for scientific data management and stewardship
Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L. B., Bourne, P. E., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.18 · Cited by 18,423 · cited 1×
“accessible, interoperable and reusable [101].”
Wnt/β-Catenin Signaling: Components, Mechanisms, and Diseases
MacDonald, B. T., Tamai, K., & He, X. (2009) · Developmental Cell · doi:10.1016/j.devcel.2009.06.016 · Cited by 5,583 · cited 1×
“Among the different Wnt signaling pathways, the canonical Wnt or Wnt/β-catenin signaling pathway is the most intensively studied one, in vitro [22] as well as in silico [23].”
BackgroundWnt/β-catenin signaling and disease
Clevers, H., & Nusse, R. (2012) · Cell · doi:10.1016/j.cell.2012.05.012 · Cited by 5,554 · cited 1×
“In deregulated forms, it is involved in human cancers and developmental disorders [26, 27].”
BackgroundThe Wnt Signaling Pathway in Development and Disease
Logan, C. Y., & Nusse, R. (2004) · Annual Review of Cell and Developmental Biology · doi:10.1146/annurev.cellbio.20.010403.113126 · Cited by 5,325 · cited 1×
“In deregulated forms, it is involved in human cancers and developmental disorders [26, 27].”
BackgroundA theory of biological pattern formation
Gierer, A., & Meinhardt, H. (1972) · Kybernetik · doi:10.1007/bf00289234 · Cited by 3,158 · cited 1×
“(2006) use a reaction-diffusion system (Gierer-Meinhardt 608 equations [103]) to model the interplay between Wnt and its antagonist Dkk with just 609 two equations.”
MethodHucka, M., Finney, A., Sauro, H. M., Bolouri, H., Doyle, J. C., Kitano, H., Arkin, A. P., Bornstein, B. J., Bray, D., Cornish-Bowden, A., et al. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg015 · Cited by 3,060 · cited 2×
“Ideally, it is presented in a structured and widely accepted format 293 such as SBML [80] or CellML [81].”
BackgroundThe ODD protocol: A review and first update
Grimm, V., Berger, U., DeAngelis, D. L., Polhill, J. G., Giske, J., & Railsback, S. F. (2010) · Ecological Modelling · doi:10.1016/j.ecolmodel.2010.08.019 · Cited by 2,440 · cited 1×
“Depending on the application domain, different modeling approaches have their own documentation guidelines [4–6].”
MethodToni, T., Welch, D., Strelkowa, N., Ipsen, A., & Stumpf, M. P. H. (2009) · Journal of The Royal Society Interface · doi:10.1098/rsif.2008.0172 · Cited by 1,498 · cited 1×
“, individual rules or model components) or choosing between entire models can also be interpreted as a discrete parameter value to be determined using methods of model selection [87].”
MethodCaught up in a Wnt storm: Wnt signaling in cancer
Giles, R. H., van Es, J. H., & Clevers, H. (2003) · Biochimica et Biophysica Acta (BBA) - Reviews on Cancer · doi:10.1016/s0304-419x(03)00005-2 · Cited by 1,482 · cited 1×
“This pathway is considered to be one of the key pathways in development and regeneration, including cell fate, cell proliferation, cell migration and adult homeostasis [24, 25].”
BackgroundThe logical analysis of continuous, non-linear biochemical control networks
Glass, L., & Kauffman, S. A. (1973) · Journal of Theoretical Biology · doi:10.1016/0022-5193(73)90208-7 · Cited by 940 · cited 1×
“, using the Systems Biology Graphical Notation (SBGN) [70] or a Boolean network diagram [71]) or informal way.”
MethodThe systems biology graphical notation.
Novère, N. L., Hucka, M., Mi, H., Moodie, S., Schreiber, F., Sorokin, A., Demir, E., Wegner, K., Aladjem, M. I., Wimalaratne, S. M., et al. (2009) · Nature Biotechnology · doi:10.1038/nbt.1558 · Cited by 903 · cited 2×
“This diagram may be presented in a formal (e.g., using the Systems Biology Graphical Notation (SBGN) [70] or a Boolean network diagram [71]) or informal way.”
MethodWnt signaling in development and tissue homeostasis
Steinhart, Z., & Angers, S. (2018) · Development · doi:10.1242/dev.146589 · Cited by 821 · cited 2×
“This may be valid as the Wnt/β-catenin signaling pathway is evolutionarily conserved [24], which means that data can be shared.”
BackgroundNovel mechanism of Wnt signalling inhibition mediated by Dickkopf-1 interaction with LRP6/Arrow
Bafico, A., Liu, G., Yaniv, A., Gazit, A., & Aaronson, S. A. (2001) · Nature Cell Biology · doi:10.1038/35083081 · Cited by 772 · cited 1×
“A second 624 cluster forms around the simulation studies [46,47,52,57,58] and either includes the 625 same wet-lab data from [104,105], the Cell cycle [47] or ROS [52,58].”
BackgroundThe Roles of APC and Axin Derived from Experimental and Theoretical Analysis of the Wnt Pathway
Lee, E., Salic, A., Krüger, R., Heinrich, R., & Kirschner, M. W. (2003) · PLoS Biology · doi:10.1371/journal.pbio.0000010 · Cited by 708 · cited 10×
“The quantitative requirement that “Axin stimulates the phosphorylation of β-catenin by GSK3β at least 24,000-fold” [28] actually refers to the wet-lab data WD1 obtained in another study by Dajani et al.”
BackgroundMethodResultInfluentialMinimum information requested in the annotation of biochemical models (MIRIAM)
Novère, N. L., Finney, A., Hucka, M., Bhalla, U. S., Campagne, F., Collado-Vides, J., Crampin, E. J., Halstead, M., Klipp, E., Mendes, P., et al. (2005) · Nature Biotechnology · doi:10.1038/nbt1156 · Cited by 622 · cited 1×
“In the case of systems biology, the “Minimum Information Requested in the Annotation of Biochemical Models (MIRIAM)” [7] and the “Minimum Information About a Simulation Experiment (MIASE)” [8] are two community standards used for documenting simulation models and corresponding simulation experiments.”
MethodWNT and DKK determine hair follicle spacing through a reaction-diffusion mechanism
Sick, S., Reinker, S., Timmer, J., & Schlake, T. (2006) · Science · doi:10.1126/science.1130088 · Cited by 612
Fisher, J., & Henzinger, T. A. (2007) · Nature Biotechnology · doi:10.1038/nbt1356 · Cited by 538 · cited 1×
“The simulation model is the actual mathematical or computational model [74] that can be executed by a suitable tool.”
BackgroundCellML: its future, present and past
Lloyd, C. M., Halstead, M. D. B., & Nielsen, P. F. (2004) · Progress in Biophysics and Molecular Biology · doi:10.1016/j.pbiomolbio.2004.01.004 · Cited by 499 · cited 1×
“Ideally, it is presented in a structured and widely accepted format such as SBML [80] or CellML [81].”
BackgroundConceptual modelling for simulation Part I: definition and requirements
Robinson, S. (2008) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2602368 · Cited by 482 · cited 1×
“For simulation studies, it typically forms the starting point of the modeling and simulation life cycle [1, 67] and is key to interpreting its outputs such as simulation data or a simulation model.”
BackgroundDistinct Global Brain Dynamics and Spatiotemporal Organization of the Salience Network
Chen, T., Cai, W., Ryali, S., Supekar, K., & Menon, V. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002469 · Cited by 480
Boolean modeling in systems biology: an overview of methodology and applications
Wang, R.-S., Saadatpour, A., & Albert, R. (2012) · Physical Biology · doi:10.1088/1478-3975/9/5/055001 · Cited by 463
A Complex Oscillating Network of Signaling Genes Underlies the Mouse Segmentation Clock
Dequéant, M.-L., Glynn, E., Gaudenz, K., Wahl, M., Chen, J., Mushegian, A., & Pourquié, O. (2006) · Science · doi:10.1126/science.1133141 · Cited by 460
Petri net modelling of biological networks
Chaouiya, C. (2007) · Briefings in Bioinformatics · doi:10.1093/bib/bbm029 · Cited by 388 · cited 1×
“, Boolean models [78] or Petri nets [79]) come with their own means of analysis and are assigned to the Simulation Model entity as they are executable models.”
BackgroundFAIRsharing as a community approach to standards, repositories and policies
Community, T. F., Sansone, S.-A., McQuilton, P., Rocca-Serra, P., Gonzalez-Beltran, A., Izzo, M., Lister, A. L., & Thurston, M. (2019) · Nature Biotechnology · doi:10.1038/s41587-019-0080-8 · Cited by 364 · cited 2×
“In recent years, more and more journals, such as PLOS Computational 548 Biology, have been recommending (but not requiring) to adhere to checklists of the 549 FAIRsharing [100] portal when reporting data, with FAIR standing for: findable, 550”
MethodBioModels—15 years of sharing computational models in life science
Malik-Sheriff, R. S., Glont, M., Nguyen, T. V. N., Tiwari, K., Roberts, M. G., Xavier, A., Vu, M. T., Men, J., Maire, M., Kananathan, S., et al. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz1055 · Cited by 361 · cited 1×
“Model repositories such as BioModels [10, 11], JWS Online [12], or the Physiome Model Repository 2 (PMR2) [13] provide different means to retrieve and use simulation models.”
MethodControl of β-Catenin Stability
Salic, A., Lee, E., Mayer, L., & Kirschner, M. W. (2000) · Molecular Cell · doi:10.1016/s1097-2765(00)80446-3 · Cited by 335 · cited 1×
“(2000) [66] (WD1–WD3) are used during the calibration of the model SM1 which produces a Simulation Experiment SE1, the corresponding Simulation Data SD1 as well as the calibrated Simulation Model SM2.”
MethodBio-PEPA: A framework for the modelling and analysis of biological systems
Ciocchetta, F., & Hillston, J. (2009) · Theoretical Computer Science · doi:10.1016/j.tcs.2009.02.037 · Cited by 335 · cited 1×
“, in a quantitative process algebra [75, 76] or with a combination of multiple formalisms [77]).”
BackgroundWeb-based kinetic modelling using JWS Online
Olivier, B. G., & Snoep, J. L. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth200 · Cited by 326 · cited 1×
“Model repositories such as BioModels [10, 11], JWS Online [12], or the Physiome Model Repository 2 (PMR2) [13] provide different means to retrieve and use simulation models.”
MethodControlled vocabularies and semantics in systems biology
Courtot, M., Juty, N., Knüpfer, C., Waltemath, D., Zhukova, A., Dräger, A., Dumontier, M., Finney, A., Golebiewski, M., Hastings, J., et al. (2011) · Molecular Systems Biology · doi:10.1038/msb.2011.77 · Cited by 316 · cited 9×
“By using SBO, we are trying to answer which part of the model contains assumptions rather than what was assumed.”
MethodInfluentialStructural basis for recruitment of glycogen synthase kinase 3β to the axin—APC scaffold complex
Dajani, R., Fraser, E., Roe, S. M., Yeo, M., Good, V. M., Thompson, V., Dale, T. C., & Pearl, L. H. (2003) · The EMBO Journal · doi:10.1093/emboj/cdg068 · Cited by 315
Evidence that Fold-Change, and Not Absolute Level, of β-Catenin Dictates Wnt Signaling
Goentoro, L., & Kirschner, M. W. (2009) · Molecular Cell · doi:10.1016/j.molcel.2009.11.017 · Cited by 300 · cited 2×
“All other models are not part of a cluster and are either completely disconnected from the other studies [31] or include E-cad-herin and the cell cycle [39] or just E-cadherin [49].”
A Survey of Statistical Model Checking
Agha, G., & Palmskog, K. (2018) · ACM Transactions on Modeling and Computer Simulation · doi:10.1145/3158668 · Cited by 285 · cited 1×
“, in a temporal logic) and automatically be checked [90, 91].”
BackgroundBelhajjame, K., B'Far, R., Cheney, J., Coppens, S., Cresswell, S., Gil, Y., Groth, P., Klyne, G., Lebo, T., McCusker, J. P., et al. (2013) · ePrints Soton (University of Southampton) · Cited by 252
Verification validation and accreditation of simulation models
Balci, O. (1997) · Proceedings of the 29th conference on Winter simulation - WSC '97 · doi:10.1145/268437.268462 · Cited by 250
Strengthening the reporting of empirical simulation studies: Introducing the STRESS guidelines
Monks, T., Currie, C. S. M., Onggo, B. S., Robinson, S., Kunc, M., & Taylor, S. J. E. (2019) · Journal of Simulation · doi:10.1080/17477778.2018.1442155 · Cited by 248
A Bayesian Approach to Model Checking Biological Systems
Jha, S. K., Clarke, E. M., Langmead, C. J., Legay, A., Platzer, A., & Zuliani, P. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-03845-7_15 · Cited by 239
Considerations for reporting finite element analysis studies in biomechanics
Erdemir, A., Guess, T. M., Halloran, J., Tadepalli, S. C., & Morrison, T. M. (2012) · Journal of Biomechanics · doi:10.1016/j.jbiomech.2011.11.038 · Cited by 234
Beaudrot, L., Ahumada, J. A., O'Brien, T., Alvarez-Loayza, P., Boekee, K., Campos-Arceiz, A., Eichberg, D., Espinosa, S., Fegraus, E., Fletcher, C., et al. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002357 · Cited by 226
Ramis-Conde, I., Drasdo, D., Anderson, A. R. A., & Chaplain, M. A. J. (2008) · Biophysical Journal · doi:10.1529/biophysj.107.114678 · Cited by 224 · cited 1×
“Pathways/Models [29] X ODE det SC − − [30] − ODE det SC − − [31] − ODE det SC − − [32] − PDE det TOL − − [33] X ODE det SC Nuc MAPK/ERK [34] − ODE det SC − Notch [35] X ODE det SC − − [36] − ODE det SC − − [37] X ODE det SC Nuc Notch, MAPK/ERK [38] − PDE det&stoch MC − E-cadherin [39] − ODE det SC − − [40] − ODE det&s…”
Goldbeter, A., & Pourquié, O. (2008) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2008.01.006 · Cited by 176 · cited 7×
“Submodels involving crosstalk with ERK/FGF/PI3K/Akt [32, 36, 53], Notch [33, 36, 48], and ROS/ Dvl-mediated pathways [51, 57] are shown in the lower panels of (b), respectively. https://doi.org/10.1371/journal.pcbi.1009227.g001”
BackgroundInfluentialCOMBINE archive and OMEX format: one file to share all information to reproduce a modeling project
Bergmann, F. T., Adams, R., Moodie, S., Cooper, J., Glont, M., Golebiewski, M., Hucka, M., Laibe, C., Miller, A. K., Nickerson, D. P., et al. (2014) · BMC Bioinformatics · doi:10.1186/s12859-014-0369-z · Cited by 173 · cited 1×
“This could be achieved, for example, by publishing a COMBINE archive [61], which is a “single file that aggregates all data files and information necessary to reproduce a simulation study in computational biology” [102].”
BackgroundnoWorkflow: Capturing and Analyzing Provenance of Scripts
Murta, L., Braganholo, V. P., Chirigati, F., Koop, D., & Freire, J. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-16462-5_6 · Cited by 171 · cited 1×
“Other 455 approaches are based on automatically analyzing scripts, either with [93] or without [94] 456 the help of user annotations.”
MethodThe Physiome Model Repository 2
Yu, T., Lloyd, C. M., Nickerson, D. P., Cooling, M. T., Miller, A. K., Garny, A., Terkildsen, J. R., Lawson, J., Britten, R. D., Hunter, P. J., et al. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btq723 · Cited by 169
Minimum Information About a Simulation Experiment (MIASE)
Waltemath, D., Adams, R., Beard, D. A., Bergmann, F. T., Bhalla, U. S., Britten, R., Chelliah, V., Cooling, M. T., Cooper, J., Crampin, E. J., et al. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001122 · Cited by 168
Buske, P., Galle, J., Barker, N., Aust, G., Clevers, H., & Loeffler, M. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001045 · Cited by 167 · cited 3×
“A forth cluster forms around studies that include MAPK/ERK [32] or MAPK/ERK + PI3K/Akt [53].”
A hidden oncogenic positive feedback loop caused by crosstalk between Wnt and ERK pathways
Kim, D., Rath, O., Kolch, W., & Cho, K.-H. (2007) · Oncogene · doi:10.1038/sj.onc.1210230 · Cited by 166
A life cycle for modeling and simulation
Balci, O. (2012) · SIMULATION · doi:10.1177/0037549712438469 · Cited by 159
An integrative computational model for intestinal tissue renewal
Van Leeuwen, I. M. M., Mirams, G. R., Walter, A., Fletcher, A., Murray, P., Osborne, J., Varma, S., Young, S. J., Cooper, J., Doyle, B., et al. (2009) · Cell Proliferation · doi:10.1111/j.1365-2184.2009.00627.x · Cited by 159 · cited 8×
“(2007), [37]: Goldbeter and Pourquié (2008), [40] van Leeuwen et al.”
BackgroundMethodInfluentialThe impact of mathematical modeling on the understanding of diabetes and related complications
Ajmera, I., Swat, M., Laibe, C., Le Novère, N., & Chelliah, V (2013) · CPT: Pharmacometrics & Systems Pharmacology · doi:10.1038/psp.2013.30 · Cited by 153
Shin, S.-Y., Rath, O., Zebisch, A., Choo, S.-M., Kolch, W., & Cho, K.-H. (2010) · Cancer Research · doi:10.1158/0008-5472.can-10-1377 · Cited by 147 · cited 1×
“Pathways/Models [29] X ODE det SC − − [30] − ODE det SC − − [31] − ODE det SC − − [32] − PDE det TOL − − [33] X ODE det SC Nuc MAPK/ERK [34] − ODE det SC − Notch [35] X ODE det SC − − [36] − ODE det SC − − [37] X ODE det SC Nuc Notch, MAPK/ERK [38] − PDE det&stoch MC − E-cadherin [39] − ODE det SC − − [40] − ODE det&s…”
Physiological regulation of β-catenin stability by Tcf3 and CK1 ϵ
Lee, E., Salic, A., & Kirschner, M. W. (2001) · The Journal of Cell Biology · doi:10.1083/jcb.200102074 · Cited by 141
Protocols.io: Virtual Communities for Protocol Development and Discussion
Teytelman, L., Stoliartchouk, A., Kindler, L. J., & Hurwitz, B. L. (2016) · PLoS Biology · doi:10.1371/journal.pbio.1002538 · Cited by 118
The Kappa platform for rule-based modeling
Boutillier, P., Maasha, M., Li, X., Medina-Abarca, H. F., Krivine, J., Feret, J., Cristescu, I., Forbes, A. G., & Fontana, W. (2018) · Bioinformatics · doi:10.1093/bioinformatics/bty272 · Cited by 107 · cited 1×
“Although the Wnt signaling pathway has also been used to 527 illustrate features of rule-based modeling [95, 96], only few simulation models have been 528 developed based on a rule-based approach.”
MethodMcPhillips, T., Song, T., Kolisnik, T., Aulenbach, S., Belhajjame, K., Bocinsky, R. K., Cao, Y., Cheney, J., Chirigati, F., Dey, S., et al. (2015) · International Journal of Digital Curation · doi:10.2218/ijdc.v10i1.370 · Cited by 103 · cited 1×
“Other approaches are based on automatically analyzing scripts, either with [93] or without [94] the help of user annotations.”
MethodCarusi, A., Burrage, K., & Rodríguez, B. (2012) · American Journal of Physiology-Heart and Circulatory Physiology · doi:10.1152/ajpheart.01151.2011 · Cited by 102
BioModels: expanding horizons to include more modelling approaches and formats
Glont, M., Nguyen, T. V. N., Graesslin, M., Hälke, R., Ali, R., Schramm, J., Wimalaratne, S. M., Kothamachu, V. B., Rodriguez, N., Swat, M. J., et al. (2018) · Nucleic Acids Research · doi:10.1093/nar/gkx1023 · Cited by 89 · cited 4×
“For capturing provenance information from simulation A list of published simulation studies of the Wnt signaling pathway is presented showing the references, the availability of the simulation models in BioModels, the modeling approaches (MA), the simulation approaches (SA), the scale of the models, additional compart…”
MethodInfluentialThe principles of whole-cell modeling
Karr, J. R., Takahashi, K., & Funahashi, A. (2015) · Current Opinion in Microbiology · doi:10.1016/j.mib.2015.06.004 · Cited by 86 · cited 1×
“, in a quantitative process algebra [75, 76] or with a combination of multiple formalisms [77]).”
BackgroundThe (Mathematical) Modeling Process in Biosciences
Torres, N. V., & Santos, G. (2015) · Frontiers in Genetics · doi:10.3389/fgene.2015.00354 · Cited by 83 · cited 1×
“that the qualitative model is also called conceptual model [72] sometimes, whereas in other publications, the qualitative model forms part of the conceptual model [3].”
ResultSESSL: A domain-specific language for simulation experiments
Ewald, R., & Uhrmacher, A. M. (2014) · ACM Transactions on Modeling and Computer Simulation · doi:10.1145/2567895 · Cited by 81 · cited 2×
“, as a SED-ML [82] or SESSL [83] file or simply as the execution code in a general purpose programming language) and to documentation in a standard format that applies reporting guidelines such as MIASE for simulation experiments [8].”
MethodSelf-citationSED-ML – An XML Format for the Implementation of the MIASE Guidelines
Köhn, D., & Novère, N. G. L. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88562-7_15 · Cited by 77
Harmonizing semantic annotations for computational models in biology
Neal, M. L., König, M., Nickerson, D., Mısırlı, G., Kalbasi, R., Dräger, A., Atalag, K., Chelliah, V., Cooling, M. T., Cook, D. L., et al. (2019) · Briefings in Bioinformatics · doi:10.1093/bib/bby087 · Cited by 74 · cited 1×
“666 In conclusion, provenance information provides added value to the existing list of 667 documentation requirements and could complement and enrich the effort of 668 “harmonizing semantic annotations for computational models in biology” [107].”
BackgroundSolid immersion microscopy images cells under cryogenic conditions with 12 nm resolution
Wang, L., Bateman, B. C., Zanetti-Domingues, L. C., Moores, A. N., Astbury, S., Spindloe, C., Darrow, M. C., Romanò, M., Needham, S. R., Beis, K., et al. (2019) · Communications Biology · doi:10.1038/s42003-019-0317-6 · Cited by 72
Schmitz, Y., Rateitschak, K., & Wolkenhauer, O. (2013) · Cellular Signalling · doi:10.1016/j.cellsig.2013.07.005 · Cited by 69 · cited 1×
“Pathways/Models [29] X ODE det SC − − [30] − ODE det SC − − [31] − ODE det SC − − [32] − PDE det TOL − − [33] X ODE det SC Nuc MAPK/ERK [34] − ODE det SC − Notch [35] X ODE det SC − − [36] − ODE det SC − − [37] X ODE det SC Nuc Notch, MAPK/ERK [38] − PDE det&stoch MC − E-cadherin [39] − ODE det SC − − [40] − ODE det&s…”
Modelling Spatially Regulated β-Catenin Dynamics and Invasion in Intestinal Crypts
Murray, P. J., Kang, J.-W., Mirams, G. R., Shin, S., Byrne, H. M., Maini, P. K., & Cho, K. (2010) · Biophysical Journal · doi:10.1016/j.bpj.2010.05.016 · Cited by 67 · cited 1×
“Pathways/Models [29] X ODE det SC − − [30] − ODE det SC − − [31] − ODE det SC − − [32] − PDE det TOL − − [33] X ODE det SC Nuc MAPK/ERK [34] − ODE det SC − Notch [35] X ODE det SC − − [36] − ODE det SC − − [37] X ODE det SC Nuc Notch, MAPK/ERK [38] − PDE det&stoch MC − E-cadherin [39] − ODE det SC − − [40] − ODE det&s…”
Haack, F., Lemcke, H., Ewald, R., Rharass, T., & Uhrmacher, A. M. (2015) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1004106 · Cited by 66 · cited 6×
“Submodels involving crosstalk with ERK/FGF/PI3K/Akt [32, 36, 53], Notch [33, 36, 48], and ROS/ Dvl-mediated pathways [51, 57] are shown in the lower panels of (b), respectively. https://doi.org/10.1371/journal.pcbi.1009227.g001”
BackgroundInfluentialSelf-citationWnt pathway mutations selected by optimal β-catenin signaling for tumorigenesis
Cho, K.-H., Baek, S., & Sung, M.-H. (2006) · FEBS Letters · doi:10.1016/j.febslet.2006.05.053 · Cited by 62 · cited 4×
“(2003), [29]: Krüger and Heinrich (2004), [30]: Cho et al.”
BackgroundMethodInfluentialvan Leeuwen, I. M. M., Byrne, H. M., Jensen, O. E., & King, J. R. (2007) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2007.01.019 · Cited by 59 · cited 5×
“(2003) [28] as well as the studies [30, 34, 35, 41].”
BackgroundMethodInfluentialExtended analyses of the Wnt/β-catenin pathway: Robustness and oscillatory behaviour
Wawra, C., Kühl, M., & Kestler, H. A. (2007) · FEBS Letters · doi:10.1016/j.febslet.2007.07.043 · Cited by 56 · cited 2×
“Two simulation studies ([35, 41]) show disconnected graphs.”
BackgroundA Wnt Oscillator Model for Somitogenesis
Jensen, P. B., Pedersen, L., Krishna, S., & Jensen, M. H. (2010) · Biophysical Journal · doi:10.1016/j.bpj.2009.11.039 · Cited by 53 · cited 2×
“All other models are not part of a cluster and are either completely disconnected from the other studies [31] or include E-cad-herin and the cell cycle [39] or just E-cadherin [49].”
A multiple timescale analysis of a mathematical model of the Wnt/β-catenin signalling pathway
Mirams, G. R., Byrne, H. M., & King, J. R. (2010) · Journal of Mathematical Biology · doi:10.1007/s00285-009-0262-y · Cited by 53 · cited 8×
“(2010) [42], at least one Qualitative Model was used by a Building Simulation Model 521 activity to produce the first Simulation Model.”
BackgroundMethodInfluential(2004) · PubMed · Cited by 49
Parameter-free methods distinguish Wnt pathway models and guide design of experiments
MacLean, A. L., Rosen, Z., Byrne, H. M., & Harrington, H. A. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1416655112 · Cited by 48 · cited 3×
“A second cluster forms around the simulation studies [45, 46, 51, 56, 57] and either includes the same wet-lab data from [105, 106], the Cell cycle [46] or ROS [51, 57].”
InfluentialPyBioNetFit and the Biological Property Specification Language
Mitra, E. D., Suderman, R., Colvin, J., Ionkov, A., Hu, A., Sauro, H. M., Posner, R. G., & Hlavacek, W. S. (2019) · iScience · doi:10.1016/j.isci.2019.08.045 · Cited by 46
Best Practices for Making Reproducible Biochemical Models
Porubsky, V. L., Goldberg, A. P., Rampadarath, A. K., Nickerson, D. P., Karr, J. R., & Sauro, H. M. (2020) · Cell Systems · doi:10.1016/j.cels.2020.06.012 · Cited by 45 · cited 1×
“(2020) [9] looks at all stages of a biochemical simulation study and at tools supporting their reproducibility.”
BackgroundKinetics of Wnt-driven β-catenin stabilization revealed by quantitative and temporal imaging
Hannoush, R. N. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003498 · Cited by 42 · cited 1×
“A second cluster forms around the simulation studies [45, 46, 51, 56, 57] and either includes the same wet-lab data from [105, 106], the Cell cycle [46] or ROS [51, 57].”
BackgroundA Boolean network of the crosstalk between IGF and Wnt signaling in aging satellite cells
Siegle, L., Schwab, J. D., Werle, S. D., Lausser, L. M., Tümpel, S., Pfister, A. S., Kühl, M., & Kestler, H. A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0195126 · Cited by 42 · cited 1×
“[54] − Bool det SC − PI3K/AKT, MAPK/ERK, Rho/Rac”
The segmentation clock in mice: interaction between the Wnt and Notch signalling pathways
Rodríguez-González, J. G., Santillán, M., Fowler, A. C., & Mackey, M. C. (2007) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2007.05.003 · Cited by 41 · cited 12×
“Submodels involving crosstalk with ERK/FGF/PI3K/Akt [33,37,54], Notch [34,37,49], and ROS/Dvl-mediated pathways [52,58] are shown in the lower panels of (b), respectively.”
BackgroundMethodInfluentialBridging the gaps in systems biology
Cvijovic, M., Almquist, J., Hagmar, J., Hohmann, S., Kaltenbach, H.-M., Klipp, E., Krantz, M., Mendes, P., Nelander, S., Nielsen, J., et al. (2014) · Molecular Genetics and Genomics · doi:10.1007/s00438-014-0843-3 · Cited by 40 · cited 1×
“Particularly, larger models are usually not built from scratch [16].”
BackgroundKogan, Y., Halevi-Tobias, K. E., Hochman, G., Baczmanska, A. K., Leyns, L., & Agur, Z. (2012) · Biochemical Journal · doi:10.1042/bj20111887 · Cited by 39 · cited 3×
“A second cluster forms around the simulation studies [45, 46, 51, 56, 57] and either includes the same wet-lab data from [105, 106], the Cell cycle [46] or ROS [51, 57].”
BackgroundStaehlke, S., Haack, F., Waldner, A.-C., Koczan, D., Moerke, C., Mueller, P., Uhrmacher, A. M., & Nebe, J. B. (2020) · Cells · doi:10.3390/cells9081784 · Cited by 36 · cited 9×
“A second cluster forms around the simulation studies [46, 47, 52, 57, 58] and either includes the same wet-lab data from [104, 105], the Cell cycle [47] or ROS [52, 58].”
BackgroundMethodInfluentialSelf-citationStatistical Model Checking Based Calibration and Analysis of Bio-pathway Models
Palaniappan, S. K., Gyori, B. M., Liu, B., Hsu, D., & Thiagarajan, P. S. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-40708-6_10 · Cited by 35 · cited 1×
“Ideally, it also takes an explicit requirement into account, which, in some cases, if formally defined, can also be used for calibrating the simulation model [88, 89].”
MethodAnalysis of Wnt signaling β-catenin spatial dynamics in HEK293T cells
Tan, C. W., Gardiner, B. S., Hirokawa, Y., Smith, D. W., & Burgess, A. W. (2014) · BMC Systems Biology · doi:10.1186/1752-0509-8-44 · Cited by 34 · cited 2×
“All other models are not part of a cluster and are either completely disconnected from the other studies [31] or include E-cad-herin and the cell cycle [39] or just E-cadherin [49].”
Padala, R. R., Karnawat, R., Viswanathan, S. B., Thakkar, A. V., & Das, A. B. (2017) · Molecular BioSystems · doi:10.1039/c6mb00786d · Cited by 33 · cited 11×
“Submodels involving crosstalk with ERK/FGF/PI3K/Akt [32, 36, 53], Notch [33, 36, 48], and ROS/ Dvl-mediated pathways [51, 57] are shown in the lower panels of (b), respectively. https://doi.org/10.1371/journal.pcbi.1009227.g001”
BackgroundMethodInfluentialBioNetFit: a fitting tool compatible with BioNetGen, NFsim and distributed computing environments
Thomas, B. R., Chylek, L. A., Colvin, J., Sirimulla, S., Clayton, A. H. A., Hlavacek, W. S., & Posner, R. G. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btv655 · Cited by 32
Representing dynamic biological networks with multi-scale probabilistic models
Groß, A., Kracher, B., Kraus, J. M., Kühlwein, S. D., Pfister, A. S., Wiese, S., Luckert, K., Pötz, O., Joos, T., Van Daele, D., et al. (2019) · Communications Biology · doi:10.1038/s42003-018-0268-3 · Cited by 32 · cited 1×
“Although the Wnt signaling pathway has also been used to 527 illustrate features of rule-based modeling [95, 96], only few simulation models have been 528 developed based on a rule-based approach.”
MethodToward a quantitative understanding of the Wnt/β‐catenin pathway through simulation and experiment
Lloyd‐Lewis, B., Fletcher, A. G., Dale, T. C., & Byrne, H. M. (2013) · WIREs Systems Biology and Medicine · doi:10.1002/wsbm.1221 · Cited by 31 · cited 2×
“Some of these Wnt models have already been discussed in previous reviews [23, 59].”
BackgroundProvenance in modeling and simulation studies — Bridging gaps
Ruscheinski, A., & Uhrmacher, A. (2017) · 2017 Winter Simulation Conference (WSC) · doi:10.1109/wsc.2017.8247839 · Cited by 31
Self-citationMathematical modelling of Wnt/β-catenin signalling
Kofahl, B., & Wolf, J. (2010) · Biochemical Society Transactions · doi:10.1042/bst0381281 · Cited by 27 · cited 1×
“Some of these Wnt models have already been discussed in previous reviews [23, 59].”
BackgroundElucidating the Sources of β-Catenin Dynamics in Human Neural Progenitor Cells
Mazemondet, O., John, M., Leye, S., Rolfs, A., & Uhrmacher, A. M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0042792 · Cited by 25 · cited 8×
“A second cluster forms around the simulation studies [45, 46, 51, 56, 57] and either includes the same wet-lab data from [105, 106], the Cell cycle [46] or ROS [51, 57].”
BackgroundMethodInfluentialSelf-citationScharm, M., Wolkenhauer, O., & Waltemath, D. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btv484 · Cited by 24 · cited 2×
“Tools such as BiVeS [15] are helpful to compare different versions of one particular simulation model, but comparing different models—even of the same system—is a difficult task because the syntax of these models (e.”
MethodChen, J., Xie, Z.-R., & Wu, Y. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100702 · Cited by 22 · cited 6×
“All other models are not part of a cluster and are either completely disconnected from the other studies [31] or include E-cadherin and the cell cycle [39] or just E-cadherin [49].”
BackgroundMethodResultInfluentialWard, D., Montes-Olivas, S., Fletcher, A. G., Homer, M., & Marucci, L. (2020) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2019.12.015 · Cited by 22 · cited 1×
“[58] − ODE det&stoch MC − Cell cycle, Hippo”
Reusing simulation experiment specifications to support developing models by successive extension
Peng, D., Warnke, T., Haack, F., & Uhrmacher, A. M. (2016) · Simulation Modelling Practice and Theory · doi:10.1016/j.simpat.2016.07.006 · Cited by 21
Self-citationRuscheinski, A., Wilsdorf, P., Dombrowsky, M., & Uhrmacher, A. M. (2019) · ACM/IEEE/SCS Workshop on Principles of Advanced and Distributed Simulation (PADS) · doi:10.1145/3316480.3325514 · Cited by 20 · cited 3×
“This could be done, for example, within an artifact-based workflow system [2].”
BackgroundInfluentialSelf-citationThe Beacon Calculus: A formal method for the flexible and concise modelling of biological systems
Boemo, M. A., Cardelli, L., & Nieduszynski, C. A. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007651 · Cited by 20 · cited 1×
“, in a quantitative process algebra [75,76] or with a 280 combination of multiple formalisms [77]).”
BackgroundExploring the mechanistic and temporal regulation of LRP6 endocytosis in canonical WNT signaling
Haack, F., Budde, K., & Uhrmacher, A. M. (2020) · Journal of Cell Science · doi:10.1242/jcs.243675 · Cited by 18 · cited 5×
“A second cluster forms around the simulation studies [45, 46, 51, 56, 57] and either includes the same wet-lab data from [105, 106], the Cell cycle [46] or ROS [51, 57].”
BackgroundMethodInfluentialSelf-citationMathematical Modelling in Biomedicine: A Primer for the Curious and the Skeptic
Vera, J., Lischer, C., Nenov, M., Nikolov, S. G., Lai, X., & Eberhardt, M. (2021) · International Journal of Molecular Sciences · doi:10.3390/ijms22020547 · Cited by 17 · cited 1×
“Building Simulation Model [BSM]: The Building Simulation Model activity, also called model derivation [86], can use all entity types as any entity described above can contribute to the model building process, but it needs to have at least one link to a Research Question or Simulation Model.”
MethodJuty, N., & le Novère, N. (2013) · Encyclopedia of Systems Biology · doi:10.1007/978-1-4419-9863-7_1287 · Cited by 16
Hypothesis-driven experiment design in computer simulation studies
Lorig, F., Lebherz, D. S., Berndt, J. O., & Timm, I. J. (2017) · Winter Simulation Conference · doi:10.1109/wsc.2017.8247880 · Cited by 16 · cited 1×
“Each entity and activity has already been mentioned for provenance, modeling or documentation purposes, or experiment design of simulation studies [1, 3–5, 8, 20, 21, 60–63], but they have not all been used together.”
MethodProvenance in modeling and simulation studies: bridging gaps
Ruscheinski, A., & Uhrmacher, A. M. (2017) · Winter Simulation Conference · doi:10.5555/3242181.3242248 · Cited by 15
Self-citationConceptual Models in Simulation Studies: Making it Explicit
Wilsdorf, P., Haack, F., & Uhrmacher, A. M. (2020) · 2020 Winter Simulation Conference (WSC) · doi:10.1109/wsc48552.2020.9383984 · Cited by 15 · cited 3×
“Each entity and activity has already been mentioned for provenance, modeling or documentation purposes, or experiment design of simulation studies [1, 3–5, 8, 20, 21, 60–63], but they have not all been used together.”
BackgroundMethodResultSelf-citationWang, H.-Y., Huang, Y.-X., Qi, Y.-F., Zhang, Y., Bao, Y.-L., Sun, L.-G., Zheng, L.-H., Zhang, Y.-W., Ma, Z.-Q., & Li, Y.-X. (2013) · Theoretical Biology and Medical Modelling · doi:10.1186/1742-4682-10-27 · Cited by 14
Yilmaz, L., Chakladar, S., & Doud, K. (2016) · 2016 Winter Simulation Conference (WSC) · doi:10.1109/wsc.2016.7822160 · Cited by 14 · cited 1×
“Each entity and activity has already been mentioned for provenance, modeling or documentation purposes, or experiment design of simulation studies [1, 3–5, 8, 20, 21, 60–63], but they have not all been used together.”
MethodYılmaz, L., Chakladar, S., & Doud, K. (2016) · Winter Simulation Conference · doi:10.5555/3042094.3042229 · Cited by 13
Towards a PROV Ontology for Simulation Models
Ruscheinski, A., Gjorgevikj, D., Dombrowsky, M., Budde, K., & Uhrmacher, A. M. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-98379-0_17 · Cited by 13 · cited 2×
“Recently, Ruscheinski et al. (2018) [20] have applied PROV-DM for capturing provenance information from entire simulation studies and initiated a definition of a PROV-DM ontology for these studies.”
MethodSelf-citationScharm, M., & Waltemath, D. (2016) · F1000Research · doi:10.12688/f1000research.9379.1 · Cited by 11 · cited 1×
“This could be 553 achieved, for example, by publishing a COMBINE archive [61], which is a “single file 554 that aggregates all data files and information necessary to reproduce a simulation study 555 in computational biology” [102].”
BackgroundHaas, P. J., Henderson, S. G., & L’Ecuyer, P. (2014) · ACM Transactions on Modeling and Computer Simulation · doi:10.1145/2555690 · Cited by 10
Conducting systematic, partly automated simulation studies – Unde Venis et Quo Vadis
Wilsdorf, P., Haack, F., Budde, K., Ruscheinski, A., & Uhrmacher, A. M. (2020) · AIP conference proceedings · doi:10.1063/5.0026939 · Cited by 10 · cited 1×
“This would also help to exploit the provenance information effectively, for example, for automatically generating simulation experiments [84].”
BackgroundSelf-citationReproducible and flexible simulation experiments with ML-Rules and SESSL
Warnke, T., Helms, T., & Uhrmacher, A. M. (2018) · Bioinformatics · doi:10.1093/bioinformatics/btx741 · Cited by 9
Self-citationDelay-driven oscillations via Axin2 feedback in the Wnt/ β -catenin signalling pathway
Cavallo, J. C. N., Scholpp, S., & Flegg, M. B. (2020) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2020.110458 · Cited by 8 · cited 1×
“Pathways/Models [29] X ODE det SC − − [30] − ODE det SC − − [31] − ODE det SC − − [32] − PDE det TOL − − [33] X ODE det SC Nuc MAPK/ERK [34] − ODE det SC − Notch [35] X ODE det SC − − [36] − ODE det SC − − [37] X ODE det SC Nuc Notch, MAPK/ERK [38] − PDE det&stoch MC − E-cadherin [39] − ODE det SC − − [40] − ODE det&s…”
HYpothesis-driven experiment design in computer simulation studies
Lorig, F., Lebherz, D. S., Berndt, J. O., et al. (2017) · Winter Simulation Conference · doi:10.5555/3242181.3242290 · Cited by 7
Kinetic modelling of compartmentalised reaction networks
Hofmeyr, J. S. (2020) · Biosystems · doi:10.1016/j.biosystems.2020.104203 · Cited by 7
RKappa: Software for Analyzing Rule-Based Models
Sorokin, A., Sorokina, O., & Douglas Armstrong, J. (2019) · Methods in Molecular Biology · doi:10.1007/978-1-4939-9102-0_17 · Cited by 4
Untitled work
(2004) · doi:10.11234/gi1990.15.138
Research works printed but not linked: 1
- D Peng, 2016, Reusing simulation experiment specifications to support developing models by successive extension, Simulation Modelling Practice and Theory, 68, 33, 10.1016/j.simpat.2016.07.006 · DOI
Cited by
Towards Bayesian Model-Based Demography: Agency, Complexity and Uncertainty in Migration Studies
Bijak, J. (2021) · Methodos series · doi:10.1007/978-3-030-83039-7 · Cited by 47
Automatic Reuse, Adaption, and Execution of Simulation Experiments via Provenance Patterns
Wilsdorf, P., Wolpers, A., Hilton, J., Haack, F., & Uhrmacher, A. M. (2022) · ACM Transactions on Modeling and Computer Simulation · doi:10.1145/3564928 · Cited by 26
Self-citationContext, Composition, Automation, and Communication: The C 2 AC Roadmap for Modeling and Simulation
Uhrmacher, A. M., Frazier, P. I., Hähnle, R., Klügl, F., Lorig, F., Ludäscher, B., Nenzi, L., Ruiz-Martín, C., Rumpe⋆, B., Szabo, C., et al. (2024) · ACM Transactions on Modeling and Computer Simulation · doi:10.1145/3673226 · Cited by 27
Self-citationReceptor/Raft Ratio Is a Determinant for LRP6 Phosphorylation and WNT/β-Catenin Signaling
Haack, F., Köster, T., & Uhrmacher, A. M. (2021) · Frontiers in Cell and Developmental Biology · doi:10.3389/fcell.2021.706731 · Cited by 15
“The provenance graph also illuminates the relation to the earlier simulation study (Haack et al., 2015) (for more detailed provenance of this and other WNT signaling models see Budde et al., 2021). destruction complex.”
ResultSelf-citationAgent-Based Simulation Models in Fisheries Science
Haase, K., Reinhardt, O., Lewin, W., Weltersbach, M. S., Strehlow, H. V., & Uhrmacher, A. M. (2023) · Reviews in Fisheries Science & Aquaculture · doi:10.1080/23308249.2023.2201635 · Cited by 13
Self-citation
Metadata
- Authors
- Budde, K., Smith, J., Wilsdorf, P., Haack, F., & Uhrmacher, A. M.
- Affiliations
- University of Rostock (DE)
- University of New Brunswick (CA)
- Corresponding author
- Budde, Kai
- Venue
- PLOS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2021-08-05
- Volume
- 17
- Issue
- 8
- Pages
- e1009227
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC8407594
- OpenAlex
- W3191637716
- Cited by
- 23
- References
- 115
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 5 · 2023: 2 · 2022: 4 · 2021: 5
- FWCI
- 3.42
- Type
- journal article
- Language
- en
- Update notices
- new_version (2021-08-31)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Deutsche Forschungsgemeinschaft (SFB 1270/1—299150580, 320435134)
- Deutscher Akademischer Austauschdienst (57467143)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Keywords
- Wnt/β-catenin signaling, model reuse, model calibration, model validation, model families, model standardization
- MeSH terms
- Animals, Biochemical Phenomena, Computer Graphics, Computer Simulation, Humans, Models, Biological, Software, Computational Biology, Systems Biology, Wnt Signaling Pathway
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.