The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Reproducible Epidemiologic Research
Abstract
The replication of important findings by multiple independent investigators is fundamental to the accumulation of scientific evidence. Researchers in the biologic and physical sciences expect results to be replicated by independent data, analytical methods, laboratories, and instruments. Epidemiologic studies are commonly used to quantify small health effects of important, but subtle, risk factors, and replication is of critical importance where results can inform substantial policy decisions. However, because of the time, expense, and opportunism of many current epidemiologic studies, it is often impossible to fully replicate their findings. An attainable minimum standard is "reproducibility," which calls for data sets and software to be made available for verifying published findings and conducting alternative analyses. The authors outline a standard for reproducibility and evaluate the reproducibility of current epidemiologic research. They also propose methods for reproducible research and implement them by use of a case study in air pollution and health.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bioconductor: open software development for computational biology and bioinformatics
Gentleman, R. C., Carey, V. J., Bates, D. M., Bolstad, B., Dettling, M., Dudoit, S., Ellis, B., Gautier, L., Ge, Y., Gentry, J., et al. (2004) · Genome Biology · doi:10.1186/gb-2004-5-10-r80 · Cited by 12,172
R: A Language for Data Analysis and Graphics
Ihaka, R., & Gentleman, R. (1996) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.1996.10474713 · Cited by 11,220
Lung cancer, cardiopulmonary mortality, and long-term exposure to fine particulate air pollution
Pope III, C. A. (2002) · JAMA · doi:10.1001/jama.287.9.1132 · Cited by 8,447
An association between air pollution and mortality in six U.S. cities
Dockery, D. W., Pope, C. A., Xu, X., Spengler, J. D., Ware, J. H., Fay, M. E., Ferris, B. G., & Speizer, F. E. (1993) · New England Journal of Medicine · doi:10.1056/nejm199312093292401 · Cited by 8,018
Particulate air pollution as a predictor of mortality in a prospective study of U.S. adults.
Pope, C. A., Thun, M. J., Namboodiri, M. M., Dockery, D. W., Evans, J. S., Speizer, F. E., & Heath, C. W. (1995) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/ajrccm.151.3.7881654 · Cited by 2,911
Fine Particulate Air Pollution and Hospital Admission for Cardiovascular and Respiratory Diseases
Dominici, F., Peng, R. D., Bell, M. L., Pham, L., McDermott, A., Zeger, S. L., & Samet, J. M. (2006) · JAMA · doi:10.1001/jama.295.10.1127 · Cited by 2,634
Self-citationKnuth, D. E. (1984) · The Computer Journal · doi:10.1093/comjnl/27.2.97 · Cited by 1,467
Ozone and short-term mortality in 95 US urban communities, 1987–2000
Bell, M. L. (2004) · JAMA · doi:10.1001/jama.292.19.2372 · Cited by 1,202
Samet, J. M., Zeger, S. L., Dominici, F., Curriero, F. C., Coursac, I., Dockery, D. W., Schwartz, J. D., & Zanobetti, A. (2000) · PubMed · Cited by 843
Self-citation
Cited by
Radiomics: the bridge between medical imaging and personalized medicine
Lambin, P., Leijenaar, R. T. H., Deist, T. M., Peerlings, J., de Jong, E. E. C., van Timmeren, J., Sanduleanu, S., Larue, R. T. H. M., Even, A. J. G., Jochems, A., et al. (2017) · Nature Reviews Clinical Oncology · doi:10.1038/nrclinonc.2017.141 · Cited by 5,688
Mohd Hanafiah, K., Groeger, J., Flaxman, A. D., & Wiersma, S. T. (2013) · Hepatology · doi:10.1002/hep.26141 · Cited by 2,515
Reproducible research in computational science
Peng, R. D. (2011) · Science · doi:10.1126/science.1213847 · Cited by 1,449
Self-citationWhat does research reproducibility mean?
Goodman, S. N., Fanelli, D., & Ioannidis, J. P. A. (2016) · Science Translational Medicine · doi:10.1126/scitranslmed.aaf5027 · Cited by 1,293
Reproducibility in Science: Improving the Standard for Basic and Preclinical Research
Begley, C. G., & Ioannidis, J. P. A. (2015) · Circulation Research · doi:10.1161/circresaha.114.303819 · Cited by 1,035
Eddy, D. M., Hollingworth, W., Caro, J. J., Tsevat, J., McDonald, K. M., & Wong, J. B. (2012) · Medical Decision Making · doi:10.1177/0272989x12454579 · Cited by 799
How to Make More Published Research True
Ioannidis, J. P. A. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001747 · Cited by 760
The Impact of Heat Waves on Mortality
Gasparrini, A., & Armstrong, B. (2011) · Epidemiology · doi:10.1097/ede.0b013e3181fdcd99 · Cited by 478
Projected increase in amyotrophic lateral sclerosis from 2015 to 2040
Arthur, K. C., Calvo, A., Price, T. R., Geiger, J. T., Chiò, A., & Traynor, B. J. (2016) · Nature Communications · doi:10.1038/ncomms12408 · Cited by 474
Eddy, D. M., Hollingworth, W., Caro, J. J., Tsevat, J., McDonald, K. M., & Wong, J. B. (2012) · Value in Health · doi:10.1016/j.jval.2012.04.012 · Cited by 466
Ecoinformatics: supporting ecology as a data-intensive science
Michener, W. K., & Jones, M. B. (2012) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2011.11.016 · Cited by 441
A review in radiomics: Making personalized medicine a reality via routine imaging
Guiot, J., Vaidyanathan, A., Deprez, L., Zerka, F., Danthine, D., Frix, A., Lambin, P., Bottari, F., Tsoutzidis, N., Miraglio, B., et al. (2022) · Medicinal Research Reviews · doi:10.1002/med.21846 · Cited by 337
The Peer Reviewers' Openness Initiative: incentivizing open research practices through peer review
Morey, R. D., Chambers, C. D., Etchells, P. J., Harris, C. R., Hoekstra, R., Lakens, D., Lewandowsky, S., Morey, C. C., Newman, D. P., Schönbrodt, F. D., et al. (2016) · Royal Society Open Science · doi:10.1098/rsos.150547 · Cited by 284
Reproducible research in signal processing
Vandewalle, P., Kovacevic, J., & Vetterli, M. (2009) · IEEE Signal Processing Magazine · doi:10.1109/msp.2009.932122 · Cited by 275
Pick, J. L., Nakagawa, S., & Noble, D. W. A. (2019) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.13118 · Cited by 257
Patil, P., Peng, R. D., & Leek, J. T. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616646366 · Cited by 243
Self-citationReproducible Research: Moving toward Research the Public Can Really Trust
Laine, C., Goodman, S. N., Griswold, M. E., & Sox, H. C. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-146-6-200703200-00154 · Cited by 213
Dominici, F., Peng, R. D., Zeger, S. L., White, R. H., & Samet, J. M. (2007) · American Journal of Epidemiology · doi:10.1093/aje/kwm222 · Cited by 158
Self-citationReproducible and replicable pain research: a critical review
Lee, H., Lamb, S. E., Bagg, M. K., Toomey, E., Cashin, A. G., & Moseley, G. L. (2018) · Pain · doi:10.1097/j.pain.0000000000001254 · Cited by 150
Liu, D. M., & Salganik, M. J. (2019) · Socius Sociological Research for a Dynamic World · doi:10.1177/2378023119849803 · Cited by 47
What is reproducibility in artificial intelligence and machine learning research?
Desai, A., Abdelhamid, M., & Padalkar, N. R. (2025) · AI Magazine · doi:10.1002/aaai.70004 · Cited by 42
What is Reproducibility in Artificial Intelligence and Machine Learning Research?
Desai, A., Abdelhamid, M., & Padalkar, N. R. (2024) · arXiv · doi:10.48550/arxiv.2407.10239 · Cited by 36
A glass half full interpretation of the replicability of psychological science
Leek, J. T., Patil, P., & Peng, R. D. (2015) · arXiv · doi:10.48550/arxiv.1509.08968 · Cited by 1
Self-citation
Metadata
- Authors
- Peng, R. D., Dominici, F., & Zeger, S. L.
- Venue
- American Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2006-03-01
- Volume
- 163
- Issue
- 9
- Pages
- 783-789
- ISSN
- 0002-9262 (ISSN-L)
- 1476-6256
- OpenAlex
- W2169512394
- Cited by
- 292
- References
- 24
- FWCI
- 36.90
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.