The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Reproducible Epidemiologic Research
Abstract
The replication of important findings by multiple independent investigators is fundamental to the accumulation of scientific evidence. Researchers in the biologic and physical sciences expect results to be replicated by independent data, analytical methods, laboratories, and instruments. Epidemiologic studies are commonly used to quantify small health effects of important, but subtle, risk factors, and replication is of critical importance where results can inform substantial policy decisions. However, because of the time, expense, and opportunism of many current epidemiologic studies, it is often impossible to fully replicate their findings. An attainable minimum standard is "reproducibility," which calls for data sets and software to be made available for verifying published findings and conducting alternative analyses. The authors outline a standard for reproducibility and evaluate the reproducibility of current epidemiologic research. They also propose methods for reproducible research and implement them by use of a case study in air pollution and health.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bioconductor: open software development for computational biology and bioinformatics
Gentleman, R. C., Carey, V. J., Bates, D. M., Bolstad, B., Dettling, M., Dudoit, S., Ellis, B., Gautier, L., Ge, Y., Gentry, J., et al. (2004) · Genome Biology · doi:10.1186/gb-2004-5-10-r80 · Cited by 12,172
R: A Language for Data Analysis and Graphics
Ihaka, R., & Gentleman, R. (1996) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1996.10474713 · Cited by 11,220
Lung cancer, cardiopulmonary mortality, and long-term exposure to fine particulate air pollution
Pope III, C. A. (2002) · JAMA · doi:10.1001/jama.287.9.1132 · Cited by 8,447
An association between air pollution and mortality in six U.S. cities
Dockery, D. W., Pope, C. A., Xu, X., Spengler, J. D., Ware, J. H., Fay, M. E., Ferris, B. G., & Speizer, F. E. (1993) · New England Journal of Medicine · doi:10.1056/nejm199312093292401 · Cited by 8,018
Particulate air pollution as a predictor of mortality in a prospective study of U.S. adults.
Pope, C. A., Thun, M. J., Namboodiri, M. M., Dockery, D. W., Evans, J. S., Speizer, F. E., & Heath, C. W. (1995) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/ajrccm.151.3.7881654 · Cited by 2,911
Fine Particulate Air Pollution and Hospital Admission for Cardiovascular and Respiratory Diseases
Dominici, F., Peng, R. D., Bell, M. L., Pham, L., McDermott, A., Zeger, S. L., & Samet, J. M. (2006) · JAMA · doi:10.1001/jama.295.10.1127 · Cited by 2,634
Self-citationKnuth, D. E. (1984) · The Computer Journal · doi:10.1093/comjnl/27.2.97 · Cited by 1,467
Ozone and short-term mortality in 95 US urban communities, 1987–2000
Bell, M. L. (2004) · JAMA · doi:10.1001/jama.292.19.2372 · Cited by 1,202
Samet, J. M., Zeger, S. L., Dominici, F., Curriero, F. C., Coursac, I., Dockery, D. W., Schwartz, J. D., & Zanobetti, A. (2000) · PubMed · Cited by 843
Self-citation(1995) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2544-7 · Cited by 569
WaveLab and Reproducible Research
Buckheit, J. B., & Donoho, D. L. (1995) · Lecture Notes in Statistics · doi:10.1007/978-1-4612-2544-7_5 · Cited by 537
Data Withholding in Academic Genetics: Evidence From a National Survey
Campbell, E. G., Clarridge, B. R., Gokhale, M., Birenbaum, L., Hilgartner, S., Holtzman, N. A., & Blumenthal, D. (2002) · JAMA · doi:10.1001/jama.287.4.473 · Cited by 489
Seasonal analyses of air pollution and mortality in 100 US cities
Peng, R. D., Dominici, F., Pastor-Barriuso, R., Zeger, S. L., & Samet, J. M. (2005) · American Journal of Epidemiology · doi:10.1093/aje/kwi075 · Cited by 450
Self-citationStatistical Analyses and Reproducible Research
Gentleman, R., & Temple Lang, D. (2007) · Journal of Computational and Graphical Statistics · doi:10.1198/106186007x178663 · Cited by 348
The National Morbidity, Mortality, and Air Pollution Study. Part I: Methods and methodologic issues.
Samet, J. M., Dominici, F., Zeger, S. L., Schwartz, J. D., & Dockery, D. W. (2000) · PubMed · Cited by 251
Self-citationMaking scientific computations reproducible
Schwab, M., Karrenbach, N., & Claerbout, J. (2000) · Computing in Science & Engineering · doi:10.1109/5992.881708 · Cited by 226
Ball, C. A., Sherlock, G. J., Parkinson, H., Rocca‐Serra, P., Brooksbank, C., Causton, H. C., Cavalieri, D., Gaasterland, T., Hingamp, P., Holstege, F. C. P., et al. (2002) · Science · doi:10.1126/science.298.5593.539b · Cited by 157
Mounting Evidence Indicts Fine-Particle Pollution
Kaiser, J. (2005) · Science · doi:10.1126/science.307.5717.1858a · Cited by 152
Reproducible Research: A Bioinformatics Case Study
Gentleman, R. C. (2005) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1034 · Cited by 137
A Compendium to Ensure Computational Reproducibility in High-Dimensional Classification Tasks
Ruschhaupt, M., Huber, W. K., Poustka, A., & Mansmann, U. (2004) · Statistical Applications in Genetics and Molecular Biology · doi:10.2202/1544-6115.1078 · Cited by 104
Epidemiology and Policy: The Pump Handle Meets the New Millennium
Samet, J. M. (2000) · Epidemiologic Reviews · doi:10.1093/oxfordjournals.epirev.a018013 · Cited by 46
Software Glitch Threw Off Mortality Estimates
Kaiser, J. (2002) · Science · doi:10.1126/science.296.5575.1945 · Cited by 43
Publication Rights in the Era of Open Data Release Policies
Rowen, L., Wong, G. K., Lane, R. P., & Hood, L. (2000) · Science · doi:10.1126/science.289.5486.1881 · Cited by 37
Cited by
Radiomics: the bridge between medical imaging and personalized medicine
Lambin, P., Leijenaar, R. T. H., Deist, T. M., Peerlings, J., de Jong, E. E. C., van Timmeren, J., Sanduleanu, S., Larue, R. T. H. M., Even, A. J. G., Jochems, A., et al. (2017) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2017.141 · Cited by 5,688
Mohd Hanafiah, K., Groeger, J., Flaxman, A. D., & Wiersma, S. T. (2013) · Hepatology · doi:10.1002/hep.26141 · Cited by 2,515
Reproducible research in computational science
Peng, R. D. (2011) · Science · doi:10.1126/science.1213847 · Cited by 1,449
Self-citationWhat does research reproducibility mean?
Goodman, S. N., Fanelli, D., & Ioannidis, J. P. A. (2016) · Science Translational Medicine · doi:10.1126/scitranslmed.aaf5027 · Cited by 1,293
Reproducibility in Science: Improving the Standard for Basic and Preclinical Research
Begley, C. G., & Ioannidis, J. P. A. (2015) · Circulation Research · doi:10.1161/circresaha.114.303819 · Cited by 1,035
Metadata
- Authors
- Peng, R. D., Dominici, F., & Zeger, S. L.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2006-03-01
- Volume
- 163
- Issue
- 9
- Pages
- 783-789
- ISSN
- 0002-9262 (ISSN-L)
- 1476-6256
- OpenAlex
- W2169512394
- Cited by
- 292
- References
- 24
- FWCI
- 36.90
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.