How will astronomy archives survive the data tsunami?
Open accessAbstract
Astronomers are collecting more data than ever. What practices can keep them ahead of the flood?
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Archives routinely host millions of such files, pushing total data volumes into the petabyte and exabyte scales.
“Archives routinely host millions of such files, pushing total data volumes into the petabyte and exabyte scales (Berriman and Groom, 2011).”
From A high-throughput AES-GCM implementation on GPUs for secure, policy-based access to massive astronomical catalogs (2026) · cites this paper as Berriman and Groom, 2011
The opening discussion (page not specified) says that 1 PB of public astronomy data was accessible and projects more than 60 PB of archived data by 2020, supporting the petabyte-scale part. Our copy does not say that archives routinely host millions of files or that their holdings reach exabyte scale; its reference to millions in the Innovations in Serving and Discovering Data section (p. 55) counts queries per year, not files. (LLM, conf=0.88)
Experimental — accuracy not yet measuredModern astronomy is generating petabyte-scale image catalogs.
“Modern astronomy, driven by large-scale surveys such as the Legacy Survey of Space and Time (LSST), is generating petabyte-scale image catalogs (Ivezi´ c et al., 2019; Berriman and Groom, 2011).”
From A high-throughput AES-GCM implementation on GPUs for secure, policy-based access to massive astronomical catalogs (2026) · cites this paper as Berriman and Groom, 2011
The paper reports that astronomy already had 1 PB of accessible public data and discusses discovering images across PB-sized data sets (Innovations in Serving and Discovering Data). But it describes LSST as a project yet to move into operation, and its examples of implemented image and catalog databases are TB-scale; it does not establish that LSST was already generating petabyte-scale image catalogs. (LLM, conf=0.86)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
No references could be resolved yet.
Research works printed but not linked: 8
- barsdell, b.r., barnes, D.g. and fluke, C. J. analysing astronomy algorithms for graphics processing units and beyond. Monthly Notices of the Royal Astronomical Society 408, 3 (2010), 1936-1944.
- berriman, g.b., Deelman, e., Juve, g., regelson, m. and plavchan, p. the application of cloud computing to astronomy: a study of cost and performance. accepted for publication in Proceedings of the e-Science in Astronomy Conference (brisbane, au, 2011).
- berriman, g.b., good, J., Deelman, e. and alexov, a. ten years of software sustainability at the Infrared processing and analysis Center. Phil. Trans. R. Soc. 369 (2011), 3384-3397
- Canon, s. Debunking some common misconceptions of science in the cloud. presented at scienceCloud2011: 2nd workshop on scientific Cloud Computing (san Jose, Ca); http://datasys.cs.iit.edu/events/ scienceCloud2011/.
- I. evans et al., eds. ASP Conference Series 442, 471 (2010).
- fluke, C.J., barnes, D.g., barsdell, b.r., hassan, a.h. astrophysical supercomputing with gpus: critical decisions for early adopters. Publications of the Astronomical Society of Australia 28, 15 (2011).
- Loffler, f., allen, g., benger, w., hutanu, a., Jha, s. and schnetter, e. using the teragrid to teach scientific computing. teragrid '11: extreme Digital Discovery Conference (salt Lake City, ut; July 18-21, 2011); https://www.teragrid.org/web/tg11/home.
- National radio astronomy observatory. Innovations in Data-intensive astronomy workshop (green bank, wV, may 3-5, 2011); http://www.nrao.edu/meetings/ bigdata/index.shtml.
Cited by
Sorted by citations
Lemes-Perera, S., R. Alarcon, M., Caballero-Gil, P., & Serra-Ricart, M. (2026) · Astronomy and Computing · doi:10.1016/j.ascom.2026.101153 · Cited by 1 · see citing works
- Authors
- Berriman, G. B., & Groom, S. L.
- Affiliations
- Infrared Processing and Analysis Center (US)
- Venue
- Communications of the ACM
- Published
- 2011-12
- Volume
- 54
- Issue
- 12
- Pages
- 52-56
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2147680441
- Cited by
- 50
- References
- 0
- Citations by year
- 2026: 1 · 2022: 1 · 2021: 2 · 2020: 3 · 2019: 1 · 2018: 6 · 2017: 4 · 2016: 5 · 2015: 6 · 2014: 4 · 2013: 4 · 2012: 13
- FWCI
- 133.23
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Communications of the ACM (publishedVersion, other-oa)
- arXiv (Cornell University) (submittedVersion)
- CaltechAUTHORS (California Institute of Technology) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Social Sciences › Arts and Humanities › Conservation › Digital and Traditional Archives Management
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Sociology and Political Science › Data Analysis and Archiving
- Keywords
- astronomical data archive, data storage, data management, data volume growth, data preservation, astronomical data
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
