CoChat

Open is not enough

Open access
Chen, Xiaoli, Dallmeier-Tiessen, Sünje, Dasler, Robin, Feger, Sebastian, Fokianos, Pamfilos, Gonzalez, Jose Benito, Hirvonsalo, Harri, Kousidis, Dinos, Lavasa, Artemis, Mele, Salvatore, Rodriguez, Diego Rodriguez, Šimko, Tibor, Smith, Tim, Trisovic, Ana, Trzcinska, Anna, Tsanaktsidis, Ioannis, Zimmermann, Markus, Cranmer, Kyle, Heinrich, Lukas, Watts, Gordon, Hildreth, Michael, Lloret Iglesias, Lara, Lassila-Perini, Kati, Neubert, Sebastian · 2019 · Nature Physics
Cited by 114

The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.

Abstract

The solutions adopted by the high-energy physics community to foster reproducible research are examples of best practices that could be embraced more widely. This first experience suggests that reproducibility requires going beyond openness. The solutions adopted by the high-energy physics community to foster reproducible research are examples of best practices that could be embraced more widely. This first experience suggests that reproducibility requires going beyond openness.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41567-018-0342-2

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 3 references

Research works printed but not linked: 19

  1. Boulton, G. Reproducibility: International accord on open data. Nature 530, 281 (2016). · doi:10.1038/530281c
  2. Barba, L. A. Terminologies for reproducible research. Preprint at https://arxiv.org/abs/1802.03311 (2018). · arXiv
  3. Brun, R. in From the Web to the Grid and Beyond (eds Brun, R., Carminati, F. & Galli-Carminati, G.) 1–53 (Springer, Berlin, Heidelberg, 2011). · doi:10.1007/978-3-642-23157-5
  4. Pasquier, T. et al. If these data could talk. Sci. Data 4, 170114 (2017). · DOI
  5. Boisot, M., Nordberg, M., Yami, S. & Nicquevert, B. Collisions and Collaboration: The Organization of Learning in the ATLAS Experiment at the LHC (Oxford Univ. Press, Oxford, 2011). · DOI
  6. Albrecht, J. et al. A roadmap for HEP software and computing R&D for the 2020s. Preprint at https://arxiv.org/abs/1712.06982 (2017). · arXiv
  7. Elmer, P., Neubauer, M. & Sokoloff, M. D. Strategic plan for a scientific software innovation institute (S2I2) for high energy physics. Preprint at https://arxiv.org/abs/1712.06592 (2017). · arXiv
  8. ATLAS Collaboration. ATLAS data access policy. CERN Open Data Portal https://doi.org/10.7483/opendata.atlas.t9yr.y7mz (2014). · doi:10.7483/opendata.atlas.t9yr.y7mz
  9. Clarke, P. & LHCb Collaboration. LHCb external data access policy. CERN Open Data Portal https://doi.org/10.7483/opendata.lhcb.hkjw.twsz (2013). · doi:10.7483/opendata.lhcb.hkjw.twsz
  10. CMS Collaboration. CMS data preservation, re-use and open access policy. CERN Open Data Portal https://doi.org/10.7483/opendata.cms.udbf.jkr9 (2012). · doi:10.7483/opendata.cms.udbf.jkr9
  11. ALICE Collaboration. ALICE data preservation strategy. CERN Open Data Portal https://doi.org/10.7483/opendata.alice.54ne.x2ea (2013). · doi:10.7483/opendata.alice.54ne.x2ea
  12. Cranmer, K. & Heinrich, L. Yadage and Packtivity – analysis preservation using parameterized workflows. J. Phys. Conf. Ser. 898, 102019 (2017). · DOI
  13. Cranmer, K. & Yavin, I. RECAST — extending the impact of existing analyses. J. High Energy Phys. 2011, 38 (2011). · DOI
  14. Larkoski, A., Marzani, S., Thaler, J., Tripathee, A. & Xue, W. Exposing the QCD splitting function with CMS open data. Phys. Rev. Lett. 119, 132003 (2017). · doi:10.1103/physrevlett.119.132003
  15. Tripathee, A., Wei, X., Larkoski, A., Marzani, S. & Thaler, J. Jet substructure studies with CMS open data. Phys. Rev. D 96, 074003 (2017). · doi:10.1103/physrevd.96.074003
  16. Jomhari, N. Z., Geiser, A. & Bin Anuar, A. A. Higgs-to-four-lepton analysis example using 2011–2012 data. CERN Open Data Portal https://doi.org/10.7483/opendata.cms.jkb8.rr42 (2017). · doi:10.7483/opendata.cms.jkb8.rr42
  17. Chatrchyan, S. et al. (CMS Collaboration) Observation of a new boson at a mass of 125 GeV with the CMS experiment at the LHC. Phys. Lett. B 716, 30–61 (2012). · DOI · Paper page
  18. Schiermeier, Q. Data management made simple. Nature 555, 403–405 (2018). · doi:10.1038/d41586-018-03071-1
  19. Goodman, A. et al. Ten simple rules for the care and feeding of scientific data. PLoS Comput. Biol. 10, e1003542 (2014). · DOI · Paper page

Cited by

See all 114

Metadata

Authors
Chen, X., Dallmeier-Tiessen, S., Dasler, R., Feger, S., Fokianos, P., Gonzalez, J. B., Hirvonsalo, H., Kousidis, D., Lavasa, A., Mele, S., Rodriguez, D. R., Šimko, T., Smith, T., Trisovic, A., Trzcinska, A., Tsanaktsidis, I., Zimmermann, M., Cranmer, K., Heinrich, L., Watts, G., Hildreth, M., Lloret Iglesias, L., Lassila-Perini, K., & Neubert, S.
Venue
Nature Physics
Published
2018-11-15
Volume
15
Issue
2
Pages
113-119
ISSN
  • 1745-2473 (ISSN-L)
  • 1745-2481
OpenAlex
W2900265028
Cited by
114
References
3
FWCI
29.57
Type
journal article
Language
en
Open access
hybrid
Licence
creativecommons.org/licenses/by/4.0 (tdm)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Open is not enough. https://app.cochat.ai/papers/10.1038/s41567-018-0342-2
The paper
Chen, X., Dallmeier-Tiessen, S., Dasler, R., Feger, S., Fokianos, P., Gonzalez, J. B., Hirvonsalo, H., Kousidis, D., Lavasa, A., Mele, S., Rodriguez, D. R., Šimko, T., Smith, T., Trisovic, A., Trzcinska, A., Tsanaktsidis, I., Zimmermann, M., Cranmer, K., Heinrich, L., . . . Neubert, S. (2019). Open is not enough. Nature Physics. https://doi.org/10.1038/s41567-018-0342-2

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.