Cited by 361Scientific Computing and Data ManagementGene Regulatory Network AnalysisResearch Data Management Practices

BioModels—15 years of sharing computational models in life science

Open access
Malik-Sheriff, Rahuman S, Glont, Mihai, Nguyen, Tung V N, Tiwari, Krishna, Roberts, Matthew G, Xavier, Ashley, Vu, Manh T, Men, Jinghao +16 more·2019·Nucleic Acids Research

Abstract

Computational modelling has become increasingly common in life science research. To provide a platform to support universal sharing, easy accessibility and model reproducibility, BioModels (https://www.ebi.ac.uk/biomodels/), a repository for mathematical models, was established in 2005. The current BioModels platform allows submission of models encoded in diverse modelling formats, including SBML, CellML, PharmML, COMBINE archive, MATLAB, Mathematica, R, Python or C++. The models submitted to BioModels are curated to verify the computational representation of the biological process and the reproducibility of the simulation results in the reference publication. The curation also involves encoding models in standard formats and annotation with controlled vocabularies following MIRIAM (minimal information required in the annotation of biochemical models) guidelines. BioModels now accepts large-scale submission of auto-generated computational models. With gradual growth in content over 15 years, BioModels currently hosts about 2000 models from the published literature. With about 800 curated models, BioModels has become the world’s largest repository of curated models and emerged as the third most used data resource after PubMed and Google Scholar among the scientists who use modelling in their research. Thus, BioModels benefits modellers by providing access to reliable and semantically enriched curated models in standard formats that are easy to share, reproduce and reuse.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/nar/gkz1055

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Model repositories such as BioModels, JWS Online, or PMR2 provide different means to retrieve and use simulation models.

    “Model repositories such as BioModels [10, 11], JWS Online [12], or the Physiome Model Repository 2 (PMR2) [13] provide different means to retrieve and use simulation models.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 31

  1. [1]Le Novère N. Quantitative and logic modelling of molecular and gene networks. Nat. Rev. Genet. 2015; 16: 146– 158. 25645874 PMC4604653
  2. [2]Le Novère N., Bornstein B., Broicher A., Courtot M., Donizelli M., Dharuri H., Li L., Sauro H., Schilstra M., Shapiro B. et al. BioModels Database: a free, centralized database of curated, published, quantitative kinetic models of biochemical and cellular systems. Nucleic Acids Res. 2006; 34: D689– D691. 16381960 PMC1347454
  3. [6]Hucka M., Finney A., Sauro H.M., Bolouri H., Doyle J.C., Kitano H., Arkin A.P., Bornstein B.J., Bray D., Cornish-Bowden A. et al. The Systems Biology Markup Language (SBML): a medium for representation and exchange of biochemical network models. Bioinformatics. 2003; 19: 524– 531. 12611808
  4. [9]Swat M.J., Moodie S., Wimalaratne S.M., Kristensen N.R., Lavielle M., Mari A., Magni P., Smith M.K., Bizzotto R., Pasotti L. et al. Pharmacometrics Markup Language (PharmML): opening new perspectives for model exchange in drug development. CPT Pharmacometrics Syst. Pharmacol. 2015; 4: 316– 319. 26225259 PMC4505825
  5. [10]Glont M., Nguyen T.V.N., Graesslin M., Hälke R., Ali R., Schramm J., Wimalaratne S.M., Kothamachu V.B., Rodriguez N., Swat M.J. et al. BioModels: expanding horizons to include more modelling approaches and formats. Nucleic Acids Res. 2018; 46: D1248– D1253. 29106614 PMC5753244
  6. [11]Le Novère N., Finney A., Hucka M., Bhalla U.S., Campagne F., Collado-Vides J., Crampin E.J., Halstead M., Klipp E., Mendes P. et al. Minimum information requested in the annotation of biochemical models (MIRIAM). Nat. Biotechnol. 2005; 23: 1509– 1515. 16333295
  7. [13]Lloret-Villas A., Varusai T.M., Juty N., Laibe C., NovÈre N.L., Hermjakob H., Chelliah V. The impact of mathematical modeling in understanding the mechanisms underlying neurodegeneration: evolving dimensions and future directions. CPT Pharmacometrics Syst. Pharmacol. 2017; 6: 73– 86. 28063254 PMC5321808
  8. [14]Büchel F., Rodriguez N., Swainston N., Wrzodek C., Czauderna T., Keller R., Mittag F., Schubert M., Glont M., Golebiewski M. et al. Path2Models: large-scale generation of computational models from biochemical pathway maps. BMC Syst. Biol. 2013; 7: 116. 24180668 PMC4228421
  9. [16]Waltemath D., Adams R., Bergmann F.T., Hucka M., Kolpakov F., Miller A.K., Moraru I.I., Nickerson D., Sahle S., Snoep J.L. et al. Reproducible computational biology experiments with SED-ML—the Simulation Experiment Description Markup Language. BMC Syst. Biol. 2011; 5: 198. 22172142 PMC3292844
  10. [17]Bergmann F.T., Cooper J., König M., Moraru I., Nickerson D., Le N.N., Olivier B.G., Sahle S., Smith L., Waltemath D. Simulation Experiment Description Markup Language (SED-ML) Level 1 Version 3 (L1V3). J. Integr. Bioinform. 2018; 15: doi:10.1515/jib-2017-0086. PMC6167040 29550789 · DOI · Paper page
  11. [18]Hoops S., Sahle S., Gauges R., Lee C., Pahle J., Simus N., Singhal M., Xu L., Mendes P., Kummer U. COPASI—a complex pathway simulator. Bioinformatics. 2006; 22: 3067– 3074. 17032683
  12. [19]Schulz M., Krause F., Le Novère N., Klipp E., Liebermeister W. Retrieval, alignment, and clustering of computational models based on semantic annotations. Mol. Syst. Biol. 2011; 7: 512. 21772260 PMC3159965
  13. [20]Chelliah V., Juty N., Ajmera I., Ali R., Dumousseau M., Glont M., Hucka M., Jalowicki G., Keating S., Knight-Schrijver V. et al. BioModels: ten-year anniversary. Nucleic Acids Res. 2015; 43: D542– D548. 25414348 PMC4383975
  14. [21]Mardinoglu A., Agren R., Kampf C., Asplund A., Uhlen M., Nielsen J. Genome-scale metabolic modelling of hepatocytes reveals serine deficiency in patients with non-alcoholic fatty liver disease. Nat. Commun. 2014; 5: 3083. 24419221
  15. [22]Funahashi A., Matsuoka Y., Jouraku A., Morohashi M., Kikuchi N., Kitano H. CellDesigner 3.5: a versatile modeling tool for biochemical networks. Proc. IEEE. 2008; 96: 1254– 1265.
  16. [23]Resasco D.C., Gao F., Morgan F., Novak I.L., Schaff J.C., Slepchenko B.M. Virtual Cell: computational tools for modeling in cell biology. Wiley Interdiscip. Rev. Syst. Biol. Med. 2012; 4: 129– 140. 22139996 PMC3288182
  17. [24]Watanabe L., Nguyen T., Zhang M., Zundel Z., Zhang Z., Madsen C., Roehner N., Myers C. iBioSim 3: a tool for model-based genetic circuit design. ACS Synth. Biol. 2019; 8: 1560– 1563. 29944839
  18. [25]Medley J.K., Choi K., König M., Smith L., Gu S., Hellerstein J., Sealfon S.C., Sauro H.M. Tellurium notebooks—an environment for reproducible dynamical modeling in systems biology. PLoS Comput. Biol. 2018; 14: e1006220. 29906293 PMC6021116
  19. [26]Somogyi E.T., Bouteiller J.-M., Glazier J.A., König M., Medley J.K., Swat M.H., Sauro H.M. libRoadRunner: a high performance SBML simulation and analysis library. Bioinformatics. 2015; 31: 3315– 3321. 26085503 PMC4607739
  20. [27]Neal M.L., Thompson C.T., Kim K.G., James R.C., Cook D.L., Carlson B.E., Gennari J.H. SemGen: a tool for semantics-based annotation and composition of biosimulation models. Bioinformatics. 2019; 35: 1600– 1602. 30256901 PMC6499248
  21. [28]Coskun S.A., Cicek A.E., Lai N., Dash R.K., Ozsoyoglu Z.M., Ozsoyoglu G. An online model composition tool for system biology models. BMC Syst. Biol. 2013; 7: 88. 24006914 PMC3846440
  22. [29]König M., Dräger A., Holzhütter H.-G. CySBML: a Cytoscape plugin for SBML. Bioinformatics. 2012; 28: 2402– 2403. 22772946
  23. [30]Alm R., Waltemath D., Wolfien M., Wolkenhauer O., Henkel R. Annotation-based feature extraction from sets of SBML models. J. Biomed. Semantics. 2015; 6: 20. 25904997 PMC4405863
  24. [31]Lambusch F., Waltemath D., Wolkenhauer O., Sandkuhl K., Rosenke C., Henkel R. Identifying frequent patterns in biochemical reaction networks: a workflow. Database. 2018; 2018: bay051. PMC6030809 29992320
  25. [32]Li D., Gao J. Towards perturbation prediction of biological networks using deep learning. Sci. Rep. 2019; 9: 11941. 31420588 PMC6697687
  26. [33]Perez-Riverol Y., Zorin A., Dass G., Vu M.-T., Xu P., Glont M., Vizcaíno J.A., Jarnuczak A.F., Petryszak R., Ping P. et al. Quantifying the impact of public omics data. Nat. Commun. 2019; 10: 1– 10. 31383865 PMC6683138
  27. [34]McLaughlin J.A., Myers C.J., Zundel Z., Mısırlı G., Zhang M., Ofiteru I.D., Goñi-Moreno A., Wipat A. SynBioHub: a standards-enabled design repository for synthetic biology. ACS Synth. Biol. 2018; 7: 682– 688. 29316788
  28. [36]Peters M., Eicher J.J., van Niekerk D.D., Waltemath D., Snoep J.L. The JWS online simulation database. Bioinformatics. 2017; 33: 1589– 1590. 28130238
  29. [37]McDougal R.A., Morse T.M., Carnevale T., Marenco L., Wang R., Migliore M., Miller P.L., Shepherd G.M., Hines M.L. Twenty years of ModelDB and beyond: building essential modeling tools for the future of neuroscience. J. Comput. Neurosci. 2017; 42: 1– 10. 27629590 PMC5279891
  30. [38]King Z.A., Lu J., Dräger A., Miller P., Federowicz S., Lerman J.A., Ebrahim A., Palsson B.O., Lewis N.E. BiGG Models: a platform for integrating, standardizing and sharing genome-scale models. Nucleic Acids Res. 2016; 44: D515– D522. 26476456 PMC4702785
  31. [39]Gleeson P., Cantarelli M., Marin B., Quintana A., Earnshaw M., Sadeh S., Piasini E., Birgiolas J., Cannon R.C., Cayco-Gajic N.A. et al. Open Source Brain: a collaborative resource for visualizing, analyzing, simulating, and developing standardized models of neurons and circuits. Neuron. 2019; 103: 395– 411. 31201122 PMC6693896

Cited by

Sorted by citations

Authors
Malik-Sheriff, R. S., Glont, M., Nguyen, T. V. N., Tiwari, K., Roberts, M. G., Xavier, A., Vu, M. T., Men, J., Maire, M., Kananathan, S., Fairbanks, E. L., Meyer, J. P., Arankalle, C., Varusai, T. M., Knight-Schrijver, V., Li, L., Dueñas-Roca, C., Dass, G., Keating, S. M., Park, Y. M., Buso, N., Rodriguez, N., Hucka, M., & Hermjakob, H.
Affiliations
  • European Molecular Biology Laboratory, European Bioinformatics Institute (EMBL-EBI), Wellcome Trust Genome Campus, Hinxton, Cambridge CB10 1SD, UK
  • European Bioinformatics Institute (GB)
  • Babraham Institute (GB)
  • California Institute of Technology (US)
Venue
Nucleic Acids Research
Published
2019-11-08
Volume
48
Issue
D1
Pages
D407-D415
ISSN
  • 0305-1048 (ISSN-L)
  • 1362-4962
OpenAlex
W2988361147
Cited by
361
References
8
Citations by year
2026: 19 · 2025: 59 · 2024: 71 · 2023: 64 · 2022: 74 · 2021: 50 · 2020: 21 · 2019: 3
FWCI
43.80
Type
journal article
Language
en
Open access
Locations
  • Nucleic Acids Research (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • CaltechAUTHORS (California Institute of Technology) (submittedVersion, cc-by)
Funders
  • Biotechnology and Biological Sciences Research Council (BB/J019305/1, BB/J004456/1, BB/P013384/1, BB/P013406/1, BB/P013414/1, BB/L502224/1)
  • Innovative Medicines Initiative (115156, 116030)
  • European Molecular Biology Laboratory
Topics
  • Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
  • Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
Keywords
biomodels, mathematical model, computational model, model repository, model curation, model reproducibility, SBML, CellML, Miriam, controlled vocabulary, model annotation, model sharing, model reuse
MeSH terms
Biological Science Disciplines, Models, Biological, Programming Languages, Software, User-Computer Interface, Conflict of Interest

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review