The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Recommendations for utilizing and reporting population genetic analyses: the reproducibility of genetic clustering using the program structure
Abstract
Reproducibility is the benchmark for results and conclusions drawn from scientific studies, but systematic studies on the reproducibility of scientific results are surprisingly rare. Moreover, many modern statistical methods make use of ‘random walk’ model fitting procedures, and these are inherently stochastic in their output. Does the combination of these statistical procedures and current standards of data archiving and method reporting permit the reproduction of the authors' results? To test this, we reanalysed data sets gathered from papers using the software package structure to identify genetically similar clusters of individuals. We find that reproducing structure results can be difficult despite the straightforward requirements of the program. Our results indicate that 30% of analyses were unable to reproduce the same number of population clusters. To improve this, we make recommendations for future use of the software and for reporting structure analyses and results in published works.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Inference of Population Structure Using Multilocus Genotype Data
Pritchard, J. K., Stephens, M., & Donnelly, P. (2000) · Genetics · doi:10.1093/genetics/155.2.945 · Cited by 33,908
Detecting the number of clusters of individuals using the software structure: a simulation study
EVANNO, G., REGNAUT, S., & GOUDET, J. (2005) · Molecular Ecology · doi:10.1111/j.1365-294x.2005.02553.x · Cited by 21,895
Earl, D. A., & vonHoldt, B. M. (2012) · Conservation Genetics Resources · doi:10.1007/s12686-011-9548-7 · Cited by 12,340
Falush, D., Stephens, M., & Pritchard, J. K. (2003) · Genetics · doi:10.1093/genetics/164.4.1567 · Cited by 7,959
The interplay between habitat availability and population differentiation
Verkuil, Y. I., Piersma, T., Jukema, J., Zwarts, L., Baker, A. J., & Hooijmeijer, J. C. E. W. (2012) · Biological Journal of the Linnean Society · Cited by 6,547
Jakobsson, M., & Rosenberg, N. A. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm233 · Cited by 6,290
ROGERS, S. M., & BERNATCHEZ, L. (2005) · Molecular Ecology · doi:10.1111/j.1365-294x.2004.02396.x · Cited by 5,088
distruct: a program for the graphical display of population structure
Rosenberg, N. A. (2004) · Molecular Ecology Notes · doi:10.1046/j.1471-8286.2003.00566.x · Cited by 4,950
Inference of population structure using multilocus genotype data: dominant markers and null alleles
FALUSH, D., STEPHENS, M., & PRITCHARD, J. K. (2007) · Molecular Ecology Notes · doi:10.1111/j.1471-8286.2007.01758.x · Cited by 3,466
Reproducible research in computational science
Peng, R. D. (2011) · Science · doi:10.1126/science.1213847 · Cited by 1,449 · cited 1×
“Full experimental replication provides the most thorough means of verifying published empirical results, but this approach can be impractical due to the difficulty in obtaining identical samples and large financial and time commitments (Peng 2011).”
MethodBayesian Analysis of Genetic Differentiation Between Populations
Corander, J., Waldmann, P., & Sillanpää, M. J. (2003) · Genetics · doi:10.1093/genetics/163.1.367 · Cited by 860
CHEN, C., DURAND, E., FORBES, F., & FRANÇOIS, O. (2007) · Molecular Ecology Notes · doi:10.1111/j.1471-8286.2007.01769.x · Cited by 784
Latch, E. K., Dharmarajan, G., Glaubitz, J. C., & Rhodes, O. E. (2006) · Conservation Genetics · doi:10.1007/s10592-005-9098-1 · Cited by 653
Bayesian identification of admixture events using multilocus molecular markers
CORANDER, J., & MARTTINEN, P. (2006) · Molecular Ecology · doi:10.1111/j.1365-294x.2006.02994.x · Cited by 651
Repeatability of published microarray gene expression analyses
Ioannidis, J. P. A., Allison, D. B., Ball, C. A., Coulibaly, I., Cui, X., Culhane, A. C., Falchi, M., Furlanello, C., Game, L., Jurman, G., et al. (2009) · Nature Genetics · doi:10.1038/ng.295 · Cited by 551 · cited 1×
“A previous investigation into the reproducibility of microarray studies found that few were fully repeatable, as many suffered from ambiguity in the methods, discrepancy in the results, and lack of available data or software (Ioannidis et al. 2009).”
MethodGao, H., Williamson, S., & Bustamante, C. D. (2007) · Genetics · doi:10.1534/genetics.107.072371 · Cited by 491
BAPS 2: enhanced possibilities for the analysis of genetic population structure
Corander, J., Waldmann, P., Marttinen, P., & Sillanpää, M. J. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth250 · Cited by 468
Spatially explicit Bayesian clustering models in population genetics
FRANÇOIS, O., & DURAND, E. (2010) · Molecular Ecology Resources · doi:10.1111/j.1755-0998.2010.02868.x · Cited by 362
Empirical Evaluation of Genetic Clustering Methods Using Multilocus Genotypes From 20 Chicken Breeds
Rosenberg, N. A., Burke, T., Elo, K., Feldman, M. W., Freidlin, P. J., Groenen, M. A. M., Hillel, J., Mäki-Tanila, A., Tixier-Boichard, M., Vignal, A., et al. (2001) · Genetics · doi:10.1093/genetics/159.2.699 · Cited by 361
Kumar, S., Skjæveland, Å., Orr, R. J., Enger, P., Ruden, T., Mevik, B.-H., Burki, F., Botnen, A., & Shalchian-Tabrizi, K. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-357 · Cited by 215
Whitlock, M. C., McPeek, M. A., Rausher, M. D., Rieseberg, L., & Moore, A. J. (2010) · The American Naturalist · doi:10.1086/650340 · Cited by 167
Wondji, C. S., Morgan, J. C., Coetzee, M., Hunt, R. H., Steen, K., Black, W. C., Hemingway, J., & Ranson, H. (2007) · BMC Genomics · doi:10.1186/1471-2164-8-34 · Cited by 112
Advances in global change research require open science by individual researchers
Wolkovich, E. M., Regetz, J., & O'Connor, M. I. (2012) · Global Change Biology · doi:10.1111/j.1365-2486.2012.02693.x · Cited by 111
Human population structure detection via multilocus genotype clustering
Gao, X., & Starmer, J. (2007) · BMC Genetics · doi:10.1186/1471-2156-8-34 · Cited by 78
To Replicate or Not To Replicate?
(2011) · AAAS Articles DO Group · doi:10.1126/science.caredit.a1100133 · Cited by 11
Cited by
Kopelman, N. M., Mayzel, J., Jakobsson, M., Rosenberg, N. A., & Mayrose, I. (2015) · Molecular Ecology Resources · doi:10.1111/1755-0998.12387 · Cited by 3,246
An introduction to Docker for reproducible research
Boettiger, C. (2015) · ACM SIGOPS Operating Systems Review · doi:10.1145/2723872.2723882 · Cited by 1,059
Janes, J. K., Miller, J. M., Dupuis, J. R., Malenfant, R. M., Gorrell, J. C., Cullingham, C. I., & Andrew, R. L. (2017) · Molecular Ecology · doi:10.1111/mec.14187 · Cited by 606
Self-citationChallenges in analysis and interpretation of microsatellite data for population genetic studies
Putman, A. I., & Carbone, I. (2014) · Ecology and Evolution · doi:10.1002/ece3.1305 · Cited by 409
An empirical analysis of journal policy effectiveness for computational reproducibility
Stodden, V., Seiler, J., & Ma, Z. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708290115 · Cited by 369
Metadata
- Authors
- Gilbert, K. J., Andrew, R. L., Bock, D. G., Franklin, M. T., Kane, N. C., Moore, J., Moyers, B. T., Renaut, S., Rennison, D. J., Veen, T., & Vines, T. H.
- Venue
- Molecular Ecology
- Publisher
- Wiley
- Published
- 2012-09-24
- Volume
- 21
- Issue
- 20
- Pages
- 4925-4930
- ISSN
- 0962-1083 (ISSN-L)
- 1365-294X
- OpenAlex
- W2115148249
- Cited by
- 290
- References
- 25
- FWCI
- 11.16
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.