The DOI matches its Crossref record; 43 of the 44 references it cites were found in a registry or an index.
COMBINE archive and OMEX format: one file to share all information to reproduce a modeling project
Open accessAbstract
BACKGROUND: With the ever increasing use of computational models in the biosciences, the need to share models and reproduce the results of published studies efficiently and easily is becoming more important. To this end, various standards have been proposed that can be used to describe models, simulations, data or other essential information in a consistent fashion. These constitute various separate components required to reproduce a given published scientific result. RESULTS: We describe the Open Modeling EXchange format (OMEX). Together with the use of other standard formats from the Computational Modeling in Biology Network (COMBINE), OMEX is the basis of the COMBINE Archive, a single file that supports the exchange of all the information necessary for a modeling and simulation experiment in biology. An OMEX file is a ZIP container that includes a manifest file, listing the content of the archive, an optional metadata file adding information about the archive and its content, and the files describing the model. The content of a COMBINE Archive consists of files encoded in COMBINE standards whenever possible, but may include additional files defined by an Internet Media Type. Several tools that support the COMBINE Archive are available, either as independent libraries or embedded in modeling software. CONCLUSIONS: The COMBINE Archive facilitates the reproduction of modeling and simulation experiments in biology by embedding all the relevant information in one file. Having all the information stored and exchanged at once also helps in building activity logs and audit trails. We anticipate that the COMBINE Archive will become a significant help for modellers, as the domain moves to larger, more complex experiments such as multi-scale models of organs, digital organisms, and bioengineering.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Each entity and activity has already been mentioned for provenance, modeling or documentation purposes, or experiment design of simulation studies [1, 3–5, 8, 20, 21, 60–63], but they have not all been used together.”
From Relating simulation studies by provenance—Developing a family of Wnt signaling models (2021) · cites this paper as [61]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“The inclusion of all necessary protocols and data needed to implement a model enables distribution of models via a single file encouraging reuse and improving reproducibility [55].”
From Adapting modeling and simulation credibility standards to computational systems biology (2023) · cites this paper as [55]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hucka, M., Finney, A., Sauro, H. M., Bolouri, H., Doyle, J. C., Kitano, H., Arkin, A. P., Bornstein, B. J., Bray, D., Cornish-Bowden, A., et al. (2003) · Bioinformatics · doi:10.1093/bioinformatics/btg015 · Cited by 3,060
Self-citationA standard protocol for describing individual-based and agent-based models
Grimm, V., Berger, U., Bastiansen, F., Eliassen, S., Ginot, V., Giske, J., GOSS‐CUSTARD, J. D., Grand, T. C., Heinz, S. K., Huse, G., et al. (2006) · Ecological Modelling · doi:10.1016/j.ecolmodel.2006.04.023 · Cited by 2,988
Uniform Resource Identifiers (URI): Generic Syntax
Berners‐Lee, T., Fielding, R. T., & Masinter, L. M. (1998) · doi:10.17487/rfc2396 · Cited by 1,757
A Whole-Cell Computational Model Predicts Phenotype from Genotype
Karr, J. R., Sanghvi, J. C., Macklin, D. N., Gutschow, M. V., Jacobs, J. M., Bolival, B., Assad-Garcia, N., Glass, J. I., & Covert, M. W. (2012) · Cell · doi:10.1016/j.cell.2012.05.044 · Cited by 1,300
A community-driven global reconstruction of human metabolism
Thiele, I., Swainston, N., Fleming, R. M. T., Hoppe, A., Sahoo, S., Aurich, M. K., Haraldsdottir, H., Mo, M. L., Rolfsson, O., Stobbe, M. D., et al. (2013) · Nature Biotechnology · doi:10.1038/nbt.2488 · Cited by 1,019
Self-citationUniform Resource Identifier (URI): Generic Syntax
Berners‐Lee, T., Fielding, R. T., & Masinter, L. M. (2005) · doi:10.17487/rfc3986 · Cited by 928
The systems biology graphical notation.
Novère, N. L., Hucka, M., Mi, H., Moodie, S., Schreiber, F., Sorokin, A., Demir, E., Wegner, K., Aladjem, M. I., Wimalaratne, S. M., et al. (2009) · Nature Biotechnology · doi:10.1038/nbt.1558 · Cited by 903
Self-citationTen Simple Rules for Reproducible Computational Research
Sandve, G. K., Nekrutenko, A., Taylor, J., & Hovig, E. (2013) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003285 · Cited by 880
Minimum information requested in the annotation of biochemical models (MIRIAM)
Novère, N. L., Finney, A., Hucka, M., Bhalla, U. S., Campagne, F., Collado-Vides, J., Crampin, E. J., Halstead, M., Klipp, E., Mendes, P., et al. (2005) · Nature Biotechnology · doi:10.1038/nbt1156 · Cited by 622
Self-citationLi, C., Donizelli, M., Rodríguez, N., Dharuri, H. K., Endler, L., Chelliah, V., Li, L., He, E., Henry, A., Stefan, M. I., et al. (2010) · BMC Systems Biology · doi:10.1186/1752-0509-4-92 · Cited by 561
Self-citationThe Virtual Cell: a software environment for computational cell biology
Loew, L. M., & Schaff, J. C. (2001) · Trends in biotechnology · doi:10.1016/s0167-7799(01)01740-1 · Cited by 412
Controlled vocabularies and semantics in systems biology
Courtot, M., Juty, N., Knüpfer, C., Waltemath, D., Zhukova, A., Dräger, A., Dumontier, M., Finney, A., Golebiewski, M., Hastings, J., et al. (2011) · Molecular Systems Biology · doi:10.1038/msb.2011.77 · Cited by 316 · cited 1×
“The modeling and simulation life cycle includes several steps [10] which need to be documented and described in order to be reproduced.”
BackgroundSelf-citationAccessible Reproducible Research
Mesirov, J. P. (2010) · Science · doi:10.1126/science.1179653 · Cited by 311
Galdzicki, M., Clancy, K., Oberortner, E., Pocock, M., Quinn, J. Y., Rodríguez, C., Roehner, N., Wilson, M., Adam, L., Anderson, J. C., et al. (2014) · Nature Biotechnology · doi:10.1038/nbt.2891 · Cited by 288
Self-citationWaltemath, D., Adams, R. R., Bergmann, F., Hucka, M., Kolpakov, F., Miller, A. K., Moraru, I. I., Nickerson, D. P., Sahle, S., Snoep, J. L., et al. (2011) · BMC Systems Biology · doi:10.1186/1752-0509-5-198 · Cited by 259
Self-citationIdentifiers.org and MIRIAM Registry: community resources to provide persistent identification
Juty, N., Novère, N. G. L., & Laibe, C. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkr1097 · Cited by 205
Self-citationModelling cellular systems with PySCeS
Olivier, B. G., Rohwer, J. M., & Hofmeyr, J. S. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bti046 · Cited by 180
Self-citationMinimum Information About a Simulation Experiment (MIASE)
Waltemath, D., Adams, R., Beard, D. A., Bergmann, F. T., Bhalla, U. S., Britten, R., Chelliah, V., Cooling, M. T., Cooper, J., Crampin, E. J., et al. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1001122 · Cited by 168
Self-citationTowards NeuroML: Model Description Methods for Collaborative Modelling in Neuroscience
Goddard, N., Hucka, M., Howell, F. W., Cornelis, H., Shankar, K., & Beeman, D. (2001) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2001.0910 · Cited by 131
Self-citationSchliess, F., Hoehme, S., Henkel, S., Ghallab, A., Driesch, D., Böttger, J., Guthke, R., Pfaff, M., Hengstler, J. G., Gebhardt, R., et al. (2014) · Hepatology · doi:10.1002/hep.27136 · Cited by 112
FieldML: concepts and implementation
Christie, G. R., Nielsen, P. M. F., Blackett, S. A., Bradley, C. P., & Hunter, P. J. (2009) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2009.0025 · Cited by 102
A short introduction to CellML
Hedley, W., Nelson, M. R., Bellivant, D. P., & Nielsen, P. F. (2001) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2001.0817 · Cited by 101
Software support for SBGN maps: SBGN-ML and LibSBGN
van Iersel, M., Villéger, A. C., Czauderna, T., Boyd, S. E., Bergmann, F., Luna, A., Demir, E., Sorokin, A., Doğrusöz, U., Matsuoka, Y., et al. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts270 · Cited by 90
Self-citationSBRML: a markup language for associating systems biology data with models
Dada, J. O., Spasić, ., Paton, N. W., & Mendes, P. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq069 · Cited by 64
Media Type Specifications and Registration Procedures
Freed, N., & Klensin, J. (2005) · doi:10.17487/rfc4288 · Cited by 64
Wolstencroft, K., Owen, S., du Preez, F. B., Krebs, O., Müller, W., Goble, C., & Snoep, J. L. (2011) · Methods in enzymology on CD-ROM/Methods in enzymology · doi:10.1016/b978-0-12-385118-5.00029-3 · Cited by 57
High-throughput functional curation of cellular electrophysiology models
Cooper, J., Mirams, G. R., & Niederer, S. (2011) · Progress in Biophysics and Molecular Biology · doi:10.1016/j.pbiomolbio.2011.06.003 · Cited by 49
Self-citationJSim, an open-source modeling system for data analysis
Butterworth, E. A., Jardine, B., Raymond, G. M., Neal, M. L., & Bassingthwaighte, J. B. (2013) · F1000Research · doi:10.12688/f1000research.2-288.v1 · Cited by 48
SBML Level 3 package: Hierarchical Model Composition, Version 1 Release 3
Smith, L. P., Hucka, M., Hoops, S., Finney, A., Ginkel, M., Myers, C. J., Moraru, I. I., & Liebermeister, W. (2015) · Berichte aus der medizinischen Informatik und Bioinformatik/Journal of integrative bioinformatics · doi:10.1515/jib-2015-268 · Cited by 48
Self-citationSBML Level 3 package: Hierarchical Model Composition, Version 1 Release 3
Smith, L. P., Hucka, M., Hoops, S., Finney, A., Ginkel, M., Myers, C. J., Moraru, I. I., & Liebermeister, W. (2015) · PubMed · doi:10.2390/biecoll-jib-2015-268 · Cited by 41
Self-citationMattioni, M., & Novère, N. G. L. (2013) · PLoS ONE · doi:10.1371/journal.pone.0066811 · Cited by 40
Simulation Experiment Description Markup Language (SED-ML) Level 1 Version 3 (L1V3)
Bergmann, F. T., Cooper, J., König, M., Moraru, I., Nickerson, D., Le Novère, N., Olivier, B. G., Sahle, S., Smith, L., & Waltemath, D. (2018) · Journal of Integrative Bioinformatics · doi:10.1515/jib-2017-0086 · Cited by 37
Self-citationWolf, M., & Wicksteed, C. (1997) · Cited by 32
Perreault, S. (2011) · doi:10.17487/rfc6350 · Cited by 27
Nickerson, D. P., & Buist, M. L. (2008) · Progress in Biophysics and Molecular Biology · doi:10.1016/j.pbiomolbio.2008.05.006 · Cited by 26
Self-citationHettne, K. M., Dharuri, H. K., Zhao, J., Wolstencroft, K., Belhajjame, K., Soiland‐Reyes, S., Mina, E., Thompson, M., Cruickshank, D. G., Verdes-Montenegro, L. L., et al. (2014) · Journal of Biomedical Semantics · doi:10.1186/2041-1480-5-41 · Cited by 25
Self-citationImproving the reuse of computational models through version control
Waltemath, D., Henkel, R., Hälke, R., Scharm, M., & Olaf Wolkenhauer, A. (2013) · Bioinformatics · doi:10.1093/bioinformatics/btt018 · Cited by 23
Self-citationRevision history aware repositories of computational models of biological systems
Miller, A. K., Yu, T., Britten, R. D., Cooling, M. T., Lawson, J., Cowan, D., Garny, A., Halstead, M. D. B., Hunter, P. J., Nickerson, D. P., et al. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-22 · Cited by 19
Self-citationSimulation Experiment Description Markup Language (SED-ML) : Level 1 Version 1Preprint
Novere, N. L., Novere, N. L., Waltemath, D., Bergmann, F., & Adams, R. (2011) · Nature Precedings · doi:10.1038/npre.2011.5846.1 · Cited by 17
Self-citationStriking a balance with Recon 2.1Preprint
B, K. S. A. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1311.5696 · Cited by 10
Henkel, R., Novère, N. G. L., Olaf Wolkenhauer, A., & Waltemath, D. (2012) · Cited by 10
Self-citationSoiland‐Reyes, S., & Gamble, M. (2014) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.10439 · Cited by 1
Self-citationThe CombineArchive Toolkit - facilitating the transfer of research resultsPreprint
Scharm, M., Wendland, F., Peters, M., Wolfien, M., Theile, T., & Waltemath, D. (2014) · doi:10.7287/peerj.preprints.514v1 · Cited by 1
Self-citation
Cited by
Sorted by citations
BioModels—15 years of sharing computational models in life science
Malik-Sheriff, R. S., Glont, M., Nguyen, T. V. N., Tiwari, K., Roberts, M. G., Xavier, A., Vu, M. T., Men, J., Maire, M., Kananathan, S., et al. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz1055 · Cited by 361
Self-citationSBML Level 3: an extensible format for the exchange and reuse of biological models
Keating, S., Waltemath, D., König, M., Zhang, F., Dräger, A., Chaouiya, C., Bergmann, F., Finney, A., Gillespie, C. S., Helikar, T., et al. (2020) · Molecular Systems Biology · doi:10.15252/msb.20199110 · Cited by 301
Self-citationProceedings of the 2017 Winter Simulation Conference
Chan, W.-M., D’Ambrogio, A., Zacharewicz, G., Mustafee, N., Wainer, G., & Page, E. (2017) · HAL · Cited by 251
Tellurium: An extensible python-based modeling environment for systems and synthetic biology
Choi, K., Medley, K., König, M., Stocking, K., Smith, L. P., Gu, S., & Sauro, H. M. (2018) · Biosystems · doi:10.1016/j.biosystems.2018.07.006 · Cited by 164
Self-citationHucka, M., Nickerson, D. P., Bader, G. D., Bergmann, F., Cooper, J., Demir, E., Garny, A., Golebiewski, M., Myers, C. J., Schreiber, F., et al. (2015) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2015.00019 · Cited by 118
Self-citation
Metadata
- Authors
- Bergmann, F. T., Adams, R., Moodie, S., Cooper, J., Glont, M., Golebiewski, M., Hucka, M., Laibe, C., Miller, A. K., Nickerson, D. P., Olivier, B. G., Rodriguez, N., Sauro, H. M., Scharm, M., Soiland-Reyes, S., Waltemath, D., Yvon, F., & Le Novère, N.
- Affiliations
- Heidelberg University (DE)
- Research Space (United Kingdom) (GB)
- European Bioinformatics Institute (GB)
- University of Oxford (GB)
- Heidelberg Institute for Theoretical Studies (DE)
- California Institute of Technology (US)
- University of Auckland (NZ)
- Vrije Universiteit Amsterdam (NL)
- University of Washington (US)
- University of Rostock (DE)
- ORCID
- Venue
- BMC Bioinformatics
- Published
- 2014-12
- Volume
- 15
- Issue
- 1
- Pages
- 369-369
- ISSN
- 1471-2105 (ISSN-L)
- PMC
- PMC4272562
- OpenAlex
- W2096951208
- Cited by
- 173
- References
- 44
- Citations by year
- 2026: 10 · 2025: 10 · 2024: 19 · 2023: 23 · 2022: 16 · 2021: 25 · 2020: 18 · 2019: 10 · 2018: 15 · 2017: 6 · 2016: 11 · 2015: 7 · 2014: 2
- FWCI
- 16.81
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- BMC Bioinformatics (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Explorer (The University of Manchester) (publishedVersion, cc-by)
- VU Research Portal (publishedVersion, other-oa)
- arXiv (Cornell University) (submittedVersion)
- CaltechAUTHORS (California Institute of Technology) (submittedVersion, cc-by)
- UCL Discovery (University College London) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- Microsoft Research
- European Commission (283359, 270192)
- ZonMw (40-41009-98-10038)
- Bundesministerium für Bildung und Forschung (FKZ 031, FKZ 0316194, 0316194)
- Innovative Medicines Initiative (115156)
- Maurice Wilkins Centre for Molecular Biodiscovery
- National Institutes of Health (NIH P50, GM094503)
- Engineering and Physical Sciences Research Council (EP/I017909, EP/I017909/1)
- Biotechnology and Biological Sciences Research Council (BB/M013189/1, BBS/E/B/000C0419)
- National Institute of General Medical Sciences (GM070923, R01GM070923, P50GM094503, R01GM081070)
- FP7 Information and Communication Technologies
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Keywords
- model exchange, model reproducibility, model metadata, audit trail, multiscale modeling, digital organisms
- MeSH terms
- Archives, Computer Simulation, Humans, Software, Information Storage and Retrieval, Computational Biology, Internet, Databases, Nucleic Acid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
