NIST interlaboratory studies involving DNA mixtures (MIX13): A modern analysis
Open accessAbstract
MIX13 was an interlaboratory exercise directed by NIST in 2013. The goal of the exercise was to evaluate the general state of interpretation methods in use at the time across the forensic community within the US and Canada and to measure the consistency in mixture interpretation. The findings were that there was a large variation in analysts' interpretations between and within laboratories. Within this work, we sought to evaluate the same mock mixture cases analyzed in MIX13 but with a more current view of the state-of-the-science. Each of the five cases were analyzed using the Identifiler™ multiplex and interpreted with the combined probability of inclusion, CPI, and four different modern probabilistic genotyping systems. Cases 1-4 can be interpreted without difficulty by any of the four PG systems examined. Cases 1 and 4 could also be interpreted successfully with the CPI by assuming two donors. Cases 2 and 3 cannot be interpreted successfully with the CPI because of potential of allele dropout. Case 3 demonstrated the need to consider relevant background information before interpretation of the profile. This case does not show that there is some barrier to interpretation caused by relatedness beyond the increased allelic overlap that can occur. Had this profile been of better template it might have been interpreted using the CPI despite the (potential) relatedness of contributors. Case 5 suffers from over-engineering. It is unclear whether reference 5C, a non-donor, can be excluded by manual methods. Inclusion of reference 5C should be termed an adventitious match not a false inclusion. Beyond this statement this case does not contribute to the interlaboratory study of analyst/laboratory interpretation method performance, instead, it explores the limits of DNA analysis. Taken collectively the analysis of these five cases demonstrates the benefits of changing from CPI to a PG system.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Avoiding gathering excessive/inappropriate data mitigates privacy risks.
“Mitigates privacy risks”
From AI Fairness in Data Management and Analytics: A Review on Challenges, Methodologies and Applications (2023) · cites this paper as [248]
Avoiding gathering excessive/inappropriate data has potential loss of insights.
“Potential loss of insights”
From AI Fairness in Data Management and Analytics: A Review on Challenges, Methodologies and Applications (2023) · cites this paper as [248]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
An investigation of the rigor of interpretation rules for STRs derived from less than 100 pg of DNA
Gill, P., Whitaker, J., Flaxman, C. S., Brown, N., & Buckleton, J. (2000) · Forensic Science International · doi:10.1016/s0379-0738(00)00158-4 · Cited by 611 · see citing works
Self-citationBalding, D. J., & Nichols, R. A. (1994) · Forensic Science International · doi:10.1016/0379-0738(94)90222-4 · Cited by 497 · see citing works
Gill, P., Brenner, C. H., Buckleton, J., Carracedo, Á., Krawczak, M., Mayr, W. R., Morling, N., Prinz, M., Schneider, P. M., & Weir, B. S. (2006) · Forensic Science International · doi:10.1016/j.forsciint.2006.04.009 · Cited by 403 · see citing works
Self-citationThe interpretation of single source and mixed DNA profiles
Taylor, D., Bright, J., & Buckleton, J. (2013) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2013.05.011 · Cited by 279 · see citing works
Self-citationBleka, Ø., Storvik, G. O., & Gill, P. (2015) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2015.11.008 · Cited by 274 · see citing works
Advanced Topics in Forensic DNA Typing: Interpretation
(2015) · Elsevier eBooks · doi:10.1016/c2011-0-07649-4 · Cited by 236 · see citing works
Validating TrueAllele ® DNA Mixture Interpretation* ,†
Perlin, M. W., Legler, M. M., Spencer, C. E., Smith, J. L., Allan, W. P., Belrose, J. L., & Duceman, B. W. (2011) · Journal of Forensic Sciences · doi:10.1111/j.1556-4029.2011.01859.x · Cited by 228 · see citing works
U.S. population data for 29 autosomal STR loci
Hill, C. R., Duewer, D. L., Kline, M. C., Coble, M. D., & Butler, J. M. (2013) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2012.12.004 · Cited by 165 · see citing works
Self-citationBudowle, B., Onorato, A. J., Callaghan, T. F., Manna, A. D., Gross, A. M., Guerrieri, R. A., Luttman, J. C., & McClure, D. L. (2009) · Journal of Forensic Sciences · doi:10.1111/j.1556-4029.2009.01046.x · Cited by 147 · see citing works
Self-citationA new methodological framework to interpret complex DNA profiles using likelihood ratios
Gill, P., & Haned, H. (2012) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2012.11.002 · Cited by 139 · see citing works
Bieber, F. R., Buckleton, J., Budowle, B., Butler, J. M., & Coble, M. D. (2016) · BMC Genetics · doi:10.1186/s12863-016-0429-7 · Cited by 121 · see citing works
Self-citationInternal validation of STRmix™ for the interpretation of single source and mixed DNA profiles
Moretti, T. R., Just, R. S., Kehl, S. C., Willis, L. E., Buckleton, J., Bright, J., Taylor, D., & Onorato, A. J. (2017) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2017.04.004 · Cited by 102 · see citing works
Self-citationInternal validation of STRmix™ – A multi laboratory response to PCAST
Bright, J., Richards, R., Kruijver, M., Kelly, H., McGovern, C., Magee, A., McWhorter, A., Ciecko, A., Peck, B., Baumgartner, C., et al. (2018) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2018.01.003 · Cited by 99 · see citing works
Self-citationButler, J. M., Kline, M. C., & Coble, M. D. (2018) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2018.07.024 · Cited by 99 · see citing works
Self-citationMoretti, T. R., Moreno, L. I., Smerick, J. B., Pignone, M. L., Hizon, R., Buckleton, J., Bright, J., & Onorato, A. J. (2016) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2016.07.022 · Cited by 98 · see citing works
Self-citationBleka, Ø., Benschop, C. C. G., Storvik, G. O., & Gill, P. (2016) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2016.07.016 · Cited by 84 · see citing works
Allard, J. E. (1997) · Science & Justice · doi:10.1016/s1355-0306(97)72154-3 · Cited by 76 · see citing works
Swaminathan, H., Grgicak, C. M., Médard, M., & Lun, D. S. (2014) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2014.11.010 · Cited by 74 · see citing works
Searching mixed DNA profiles directly against profile databases
Bright, J., Taylor, D., Curran, J. M., & Buckleton, J. (2013) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2013.12.001 · Cited by 72 · see citing works
Self-citationMarciano, M. A., & Adelman, J. D. (2016) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2016.11.006 · Cited by 55 · see citing works
Prieto, L., Haned, H., Mosquera‐Miguel, A., Crespillo, M., Alemañ, M., Aler, M., Álvarez, F., Baeza, C., Domínguez, A. B. C., Doutremépuich, C., et al. (2013) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2013.10.011 · Cited by 53 · see citing works
Jeanguenat, A. M., Budowle, B., & Dror, I. E. (2017) · Science & Justice · doi:10.1016/j.scijus.2017.07.005 · Cited by 50 · see citing works
Self-citationOpen source software EuroForMix can be used to analyse complex SNP mixtures
Bleka, Ø., Eduardoff, M., Santos, C., Phillips, C., Parson, W., & Gill, P. (2017) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2017.08.001 · Cited by 50 · see citing works
Inman, K., Rudin, N., Cheng, K. K. M., Robinson, C., Kirschner, A., Inman-Semerau, L., & Lohmueller, K. E. (2015) · BMC Bioinformatics · doi:10.1186/s12859-015-0740-8 · Cited by 46 · see citing works
Self-citationUncertainty in the number of contributors in the proposed new CODIS set
Coble, M. D., Bright, J., Buckleton, J., & Curran, J. M. (2015) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2015.07.005 · Cited by 41 · see citing works
Self-citationCalculating the Weight of Evidence in Low‐Template Forensic DNA Casework
Lohmueller, K. E., & Rudin, N. (2012) · Journal of Forensic Sciences · doi:10.1111/1556-4029.12017 · Cited by 39 · see citing works
Considering relatives when assessing the evidential strength of mixed DNA profiles
Taylor, D., Bright, J., & Buckleton, J. (2014) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2014.08.015 · Cited by 33 · see citing works
Self-citationOn the exact distribution of the numbers of alleles in DNA mixtures
Tvedebrink, T. (2013) · International Journal of Legal Medicine · doi:10.1007/s00414-013-0951-3 · Cited by 22 · see citing works
Fatal Ischemic Enteritis with Hemorrhage—A Late Complication of Treated Wilms Tumor
Gilbert, J. D., & Byard, R. W. (2012) · Journal of Forensic Sciences · doi:10.1111/j.1556-4029.2012.02264.x · Cited by 20 · see citing works
On the exact distribution of the numbers of alleles in DNA mixtures
Tvedebrink, T. (2013) · Forensic science international. Genetics supplement series · doi:10.1016/j.fsigss.2013.10.142 · Cited by 8 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
DNA transfer in forensic science: A review
van Oorschot, R. A. H., Szkuta, B., Meakin, G. E., Kokshoorn, B., & Goray, M. (2018) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2018.10.014 · Cited by 316 · see citing works
Probabilistic genotyping software: An overview
Coble, M. D., & Bright, J. (2018) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2018.11.009 · Cited by 179 · see citing works
Self-citationAI Fairness in Data Management and Analytics: A Review on Challenges, Methodologies and Applications
Chen, P., Wu, L., & Wang, L. (2023) · Applied Sciences · doi:10.3390/app131810258 · Cited by 155 · see citing works
McCord, B., Gauthier, Q., Cho, S., Roig, M. N., Gibson-Daw, G. C., Young, B., Taglia, F., Zapico, S. C., Mariot, R., Lee, S. B., et al. (2018) · Analytical Chemistry · doi:10.1021/acs.analchem.8b05318 · Cited by 52 · see citing works
A Review of Probabilistic Genotyping Systems: EuroForMix, DNAStatistX and STRmix™
Gill, P., Benschop, C. C. G., Buckleton, J., Bleka, Ø., & Taylor, D. (2021) · Genes · doi:10.3390/genes12101559 · Cited by 75 · see citing works
Self-citationDNA Transfer in Forensic Science: Recent Progress towards Meeting Challenges
van Oorschot, R. A. H., Meakin, G. E., Kokshoorn, B., Goray, M., & Szkuta, B. (2021) · Genes · doi:10.3390/genes12111766 · Cited by 73 · see citing works
Interpol review of forensic biology and forensic DNA typing 2016-2019
Butler, J., & Willis, S. M. (2020) · Forensic Science International: Synergy · doi:10.1016/j.fsisyn.2019.12.002 · Cited by 53 · see citing works
STRmix™ collaborative exercise on DNA mixture interpretation
Bright, J., Cheng, K., Kerr, Z., McGovern, C., Kelly, H., Moretti, T. R., Smith, M. A., Bieber, F. R., Budowle, B., Coble, M. D., et al. (2019) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2019.01.006 · Cited by 50 · see citing works
Self-citationOptical tweezers as an effective tool for spermatozoa isolation from mixed forensic samples
Auka, N., Valle, M., Cox, B. D., Wilkerson, P. D., Cruz, T. D., Reiner, J. E., & Seashols‐Williams, S. J. (2019) · PLoS ONE · doi:10.1371/journal.pone.0211810 · Cited by 39 · see citing works
Riman, S., Iyer, H. K., & Vallone, P. M. (2021) · PLoS ONE · doi:10.1371/journal.pone.0256714 · Cited by 36 · see citing works
A comparison of software for the evaluation of complex DNA profiles
You, Y., & Balding, D. J. (2019) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2019.02.014 · Cited by 27 · see citing works
Thompson, W. C. (2023) · Journal of Forensic Sciences · doi:10.1111/1556-4029.15225 · Cited by 24 · see citing works
A top-down approach to DNA mixtures
Slooten, K. (2020) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2020.102250 · Cited by 22 · see citing works
Kruijver, M., Taylor, D., & Bright, J. (2021) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2021.102532 · Cited by 22 · see citing works
Self-citationBuckleton, J., Taylor, D., Bright, J., Hicks, T., & Curran, J. M. (2020) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2020.102406 · Cited by 21 · see citing works
Self-citation(Draft) DNA Mixture InterpretationPreprint
Butler, J. M. (2021) · doi:10.6028/nist.ir.8351-draft · Cited by 17 · see citing works
Exploring the probative value of mixed DNA profiles
Kruijver, M., Bright, J., Kelly, H., & Buckleton, J. (2019) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2019.03.010 · Cited by 16 · see citing works
Self-citationDuffy, K. R., Lun, D. S., Mulcahy, M. M., O’Donnell, L., Sheth, N., & Grgicak, C. M. (2023) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2023.102852 · Cited by 14 · see citing works
Forensic DNA Interpretation and Human Factors: Improving the Practice Through a Systems Approach
Taylor, M. K. (2024) · doi:10.6028/nist.ir.8503 · Cited by 14 · see citing works
Costa, C., Figueiredo, C., Amorim, A., Costa, S., Ferreira, P. M., & Pinto, N. (2022) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2022.102715 · Cited by 12 · see citing works
The interpretation of mixed DNA profiles from a mother, father, and child trio
Lin, M., Bright, J., Pugh, S. N., & Buckleton, J. (2019) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2019.102175 · Cited by 11 · see citing works
Self-citationA diagnosis of the primary difference between EuroForMix and STRmix ™
Buckleton, J., Susik, M., Curran, J. M., Cheng, K., Taylor, D., Bright, J., Kelly, H., & Wivell, R. (2023) · Journal of Forensic Sciences · doi:10.1111/1556-4029.15387 · Cited by 11 · see citing works
Self-citationBuckleton, J., Bright, J., Taylor, D., Wivell, R., Bleka, Ø., Gill, P., Benschop, C. C. G., Budowle, B., & Coble, M. D. (2022) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2022.102709 · Cited by 9 · see citing works
Self-citationSusik, M., Schönborn, H., & Sbalzarini, I. F. (2022) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2022.102744 · Cited by 7 · see citing works
Taylor, D., Buckleton, J., & Bright, J. (2019) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2019.02.022 · Cited by 7 · see citing works
Self-citationTigers, black swans, and unicorns: The need for feedback and oversight
Houck, M. M. (2019) · Forensic Science International Synergy · doi:10.1016/j.fsisyn.2019.04.002 · Cited by 6 · see citing works
McNevin, D. B., Wright, K. M., Barash, M., Gomes, S. L. B. T., Jamieson, A., & Chaseling, J. (2021) · Forensic Sciences · doi:10.3390/forensicsci1010006 · Cited by 6 · see citing works
Mallinder, B., Pope, S., Thomson, J., Beck, L. A., McDonald, A. J., Ramsbottom, D., Court, D. S., Vanhinsbergh, D., Barber, M., Evett, I. W., et al. (2022) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2022.102674 · Cited by 6 · see citing works
Riman, S., Bright, J., Huffman, K., Moreno, L. I., Liu, S., Sathya, A., & Vallone, P. M. (2024) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2024.103088 · Cited by 5 · see citing works
Self-citationNoël, J., Noël, S., Mailly, F., Granger, D., Lefebvre, J.-F., Milot, E., & Séguin, D. (2022) · Canadian Society of Forensic Science Journal · doi:10.1080/00085030.2022.2028359 · Cited by 5 · see citing works
Buckleton, J., Bright, J., Ciecko, A., Kruijver, M., Mallinder, B., Magee, A., Malsom, S., Moretti, T. R., Weitz, S. M., Bille, T. W., et al. (2019) · Forensic Science International Genetics · doi:10.1016/j.fsigen.2019.102198 · Cited by 4 · see citing works
Self-citationForensic Genetics, Ethics, Privacy, and Public Policy
White, T. J., & Lee, S. B. (2020) · doi:10.1093/oso/9780190909444.003.0016 · Cited by 3 · see citing works
A Study on DNA Profiling Techniques and Transnational Exchange of DNA Data from Databank
Padmanabhan, A. S., & Sapna, S. (2022) · Revue d intelligence artificielle · doi:10.18280/ria.360310 · Cited by 3 · see citing works
Warren, E. M., Handley, J. C., & Sheets, H. D. (2024) · Journal of Forensic Sciences · doi:10.1111/1556-4029.15686 · Cited by 3 · see citing works
Inter‐laboratory variation in interpretations, comparisons, and statistical analyses of DNA mixtures
Hicklin, R. A., Richetelli, N., Bever, R., & Davoren, J. M. (2025) · Journal of Forensic Sciences · doi:10.1111/1556-4029.70048 · Cited by 1 · see citing works
Harthun, M., Pflugbeil, A.-M., Jede, A., & Schönborn, H. (2019) · Forensic science international. Genetics supplement series · doi:10.1016/j.fsigss.2019.10.101 · Cited by 1 · see citing works
The effect of a user selected number of contributors within the LR assignment
Kelly, H., Bright, J., Kruijver, M., Taylor, D., & Buckleton, J. (2021) · Australian Journal of Forensic Sciences · doi:10.1080/00450618.2020.1865456 · Cited by 1 · see citing works
Self-citationPrinz, M., & Lessig, R. (2022) · Wiley eBooks · doi:10.1002/9781119648628.ch64 · Cited by 2 · see citing works
Coble, M. D., Budowle, B., & Erlich, H. (2020) · doi:10.1093/oso/9780190909444.003.0004
Self-citationQuality Control Measures in Short Tandem Repeat (STR) Analysis
Coyle, H. M. (2021) · Springer eBooks · doi:10.1007/978-981-15-9364-2_53-1
Quality Control Measures in Short Tandem Repeat (STR) Analysis
Coyle, H. M. (2022) · Springer eBooks · doi:10.1007/978-981-16-4318-7_53
- Authors
- Buckleton, J. S., Bright, J.-A., Cheng, K., Budowle, B., & Coble, M. D.
- Affiliations
- University of Auckland (NZ)
- New Zealand Institute for Public Health and Forensic Science (NZ)
- University of North Texas Health Science Center (US)
- Corresponding author
- Buckleton, John S.
- Venue
- Forensic Science International Genetics
- Publisher
- Elsevier BV
- Published
- 2018-11
- Volume
- 37
- Pages
- 172-179
- ISSN
- 1872-4973 (ISSN-L)
- OpenAlex
- W2888877551
- Cited by
- 40
- References
- 30
- Citations by year
- 2025: 1 · 2024: 2 · 2023: 4 · 2022: 8 · 2021: 8 · 2020: 5 · 2019: 9 · 2018: 3
- FWCI
- 3.83
- Type
- journal article
- Language
- en
- Open access
- green
- figshare.com
- Locations
- Forensic Science International Genetics (publishedVersion)
- PubMed (publishedVersion)
- Figshare (submittedVersion, cc-by)
- ESR Data and information Repository
- Funders
- National Institute of Justice (2017-DN-BX-0136)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Forensic and Genetic Research
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic diversity and population structure
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Molecular Biology Techniques and Applications
- Keywords
- DNA mixtures, probabilistic genotyping, allele dropout, forensic DNA interpretation
- MeSH terms
- Alleles, Canada, DNA, Genotype, Government Agencies, Humans, Laboratories, Probability, Software, United States, Likelihood Functions, Polymerase Chain Reaction, DNA Fingerprinting, Microsatellite Repeats, Forensic Genetics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
