The Tox21 10K Compound Library: Collaborative Chemistry Advancing Toxicology
Open accessThe DOI matches its Crossref record; 54 of the 54 references it cites were found in a registry or an index.
Abstract
Since 2009, the Tox21 project has screened ∼8500 chemicals in more than 70 high-throughput assays, generating upward of 100 million data points, with all data publicly available through partner websites at the United States Environmental Protection Agency (EPA), National Center for Advancing Translational Sciences (NCATS), and National Toxicology Program (NTP). Underpinning this public effort is the largest compound library ever constructed specifically for improving understanding of the chemical basis of toxicity across research and regulatory domains. Each Tox21 federal partner brought specialized resources and capabilities to the partnership, including three approximately equal-sized compound libraries. All Tox21 data generated to date have resulted from a confluence of ideas, technologies, and expertise used to design, screen, and analyze the Tox21 10K library. The different programmatic objectives of the partners led to three distinct, overlapping compound libraries that, when combined, not only covered a diversity of chemical structures, use-categories, and properties but also incorporated many types of compound replicates. The history of development of the Tox21 “10K” chemical library and data workflows implemented to ensure quality chemical annotations and allow for various reproducibility assessments are described. Cheminformatics profiling demonstrates how the three partner libraries complement one another to expand the reach of each individual library, as reflected in coverage of regulatory lists, predicted toxicity end points, and physicochemical properties. ToxPrint chemotypes (CTs) and enrichment approaches further demonstrate how the combined partner libraries amplify structure–activity patterns that would otherwise not be detected. Finally, CT enrichments are used to probe global patterns of activity in combined ToxCast and Tox21 activity data sets relative to test-set size and chemical versus biological end point diversity, illustrating the power of CT approaches to discern patterns in chemical–activity data sets. These results support a central premise of the Tox21 program: A collaborative merging of programmatically distinct compound libraries would yield greater rewards than could be achieved separately.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“With a similar reasoning, the Tox21 consortium was founded by a group of US agencies with the goal of using high throughput screening to generate data on data-poor compounds for safety assessment (Richard et al. 2021; Ngan et al. 2023; Sakamuru et al. 2022).”
From Bridging imaging-based in vitro methods from biomedical research to regulatory toxicology (2025) · cites this paper as Richard et al. 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PubChem Substance and Compound databases
Kim, S., Thiessen, P. A., Bolton, E. E., Chen, J., Fu, G., Gindulyte, A., Han, L., He, J., He, S., Shoemaker, B. A., et al. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkv951 · Cited by 5,436
DrugBank: a knowledgebase for drugs, drug actions and drug targets
Wishart, D. S., Knox, C., Guo, A. C., Cheng, D., Shrivastava, S., Tzur, D., Gautam, B., & Hassanali, M. (2008) · Nucleic Acids Research · doi:10.1093/nar/gkm958 · Cited by 2,861
CAESAR models for developmental toxicity
Cassano, A., Manganaro, A., Martin, T., Young, D., Piclin, N., Pintore, M., Bigoni, D., & Benfenati, E. (2010) · Chemistry Central Journal · doi:10.1186/1752-153x-4-s1-s4 · Cited by 1,589
PubChem: Integrated Platform of Small Molecules and Biological Activities
(2008) · Annual Reports in Computational Chemistry · doi:10.1016/s1574-1400(08)00012-1 · Cited by 1,263
Toxicity testing in the 21st century: A vision and a strategy
Gibb, S. (2008) · Reproductive Toxicology · doi:10.1016/j.reprotox.2007.10.013 · Cited by 1,257
The CompTox Chemistry Dashboard: a community data resource for environmental chemistry
Williams, A. J., Grulke, C. M., Edwards, J., McEachran, A. D., Mansouri, K., Baker, N. C., Patlewicz, G., Shah, I., Wambaugh, J. F., Judson, R. S., et al. (2017) · Journal of Cheminformatics · doi:10.1186/s13321-017-0247-6 · Cited by 1,143
Self-citationThe ToxCast Program for Prioritizing Toxicity Testing of Environmental Chemicals
Dix, D. J., Houck, K. A., Martin, M. T., Richard, A. M., Setzer, R. W., & Kavlock, R. J. (2007) · Toxicological Sciences · doi:10.1093/toxsci/kfl103 · Cited by 1,012
Self-citationToxCast Chemical Landscape: Paving the Road to 21st Century Toxicology
Richard, A. M., Judson, R. S., Houck, K. A., Grulke, C. M., Volarath, P., Thillainadarajah, I., Yang, C., Rathman, J., Martin, M. T., Wambaugh, J. F., et al. (2016) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.6b00135 · Cited by 709
Self-citationTransforming Environmental Health Protection
Collins, F. S., Gray, G. M., & Bucher, J. R. (2008) · Science · doi:10.1126/science.1154619 · Cited by 630
Self-citationOPERA models for predicting physicochemical properties and environmental fate endpoints
Mansouri, K., Grulke, C. M., Judson, R. S., & Williams, A. J. (2018) · Journal of Cheminformatics · doi:10.1186/s13321-018-0263-1 · Cited by 624
Self-citationImproving the Human Hazard Characterization of Chemicals: A Tox21 Update
Tice, R. R., Austin, C. P., Kavlock, R. J., & Bucher, J. R. (2013) · Environmental Health Perspectives · doi:10.1289/ehp.1205784 · Cited by 618
Self-citationKavlock, R., Chandler, K., Houck, K., Hunter, S., Judson, R., Kleinstreuer, N., Knudsen, T., Martin, M., Padilla, S., Reif, D., et al. (2012) · Chemical Research in Toxicology · doi:10.1021/tx3000939 · Cited by 494
Self-citationHuang, R., Southall, N., Wang, Y., Yasgar, A., Shinn, P., Jadhav, A., Nguyen, D.-T., & Austin, C. P. (2011) · Science Translational Medicine · doi:10.1126/scitranslmed.3001862 · Cited by 401
Self-citationCERAPP: Collaborative Estrogen Receptor Activity Prediction Project
Mansouri, K., Abdelaziz, A., Rybacka, A., Roncaglioni, A., Tropsha, A., Varnek, A., Zakharov, A., Worth, A., Richard, A. M., Grulke, C. M., et al. (2016) · Environmental Health Perspectives · doi:10.1289/ehp.1510267 · Cited by 375
Self-citationBenchmark Data Set for in Silico Prediction of Ames Mutagenicity
Hansen, K., Mika, S., Schroeter, T., Sutter, A., ter Laak, A., Steger-Hartmann, T., Heinrich, N., & Müller, K.-R. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci900161g · Cited by 370
NIH Molecular Libraries Initiative
Austin, C. P., Brady, L. S., Insel, T. R., & Collins, F. S. (2004) · Science · doi:10.1126/science.1105511 · Cited by 348
Self-citationMultidimensional In Vivo Hazard Assessment Using Zebrafish
Truong, L., Reif, D. M., St Mary, L., Geier, M. C., Truong, H. D., & Tanguay, R. L. (2014) · Toxicological Sciences · doi:10.1093/toxsci/kft235 · Cited by 328
Huang, R., Xia, M., Sakamuru, S., Zhao, J., Shahane, S. A., Attene-Ramos, M., Zhao, T., Austin, C. P., & Simeonov, A. (2016) · Nature Communications · doi:10.1038/ncomms10425 · Cited by 259
Self-citationEldridge, G. R., Vervoort, H. C., Lee, C. M., Cremin, P. A., Williams, C. T., Hart, S. M., Goering, M. G., O'Neil-Johnso, M., & Zeng, L. (2002) · Analytical Chemistry · doi:10.1021/ac025534s · Cited by 258
The Tox21 robotic platform for the assessment of environmental chemicals – from vision to reality
Attene-Ramos, M. S., Miller, N., Huang, R., Michael, S., Itkin, M., Kavlock, R. J., Austin, C. P., Shinn, P., Simeonov, A., Tice, R. R., et al. (2013) · Drug Discovery Today · doi:10.1016/j.drudis.2013.05.015 · Cited by 255 · cited 1×
“…used to add a degree of compound−well position variation to each of the full library plate sets, the 15 step dilution series, and plate storage and handling protocols used over the course of the Tox21 program, see Attene-Ramos et al.13 https://dx.doi.org/10.1021/acs.chemrestox.0c00264 Chem.”
MethodInfluentialSelf-citationCompound Cytotoxicity Profiling Using Quantitative High-Throughput Screening
Xia, M., Huang, R., Witt, K. L., Southall, N., Fostel, J., Cho, M.-H., Jadhav, A., Smith, C. S., Inglese, J., Portier, C. J., et al. (2008) · Environmental Health Perspectives · doi:10.1289/ehp.10727 · Cited by 255
Self-citationtcpl: the ToxCast pipeline for high-throughput screening data
Filer, D. L., Kothiya, P., Setzer, R. W., Judson, R. S., & Martin, M. T. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btw680 · Cited by 230
Self-citationThe US Federal Tox21 Program: A strategic and operational plan for continued leadership
Thomas, R. (2018) · ALTEX · doi:10.14573/altex.1803011 · Cited by 229
Self-citationHuang, R., Xia, M., Nguyen, D.-T., Zhao, T., Sakamuru, S., Zhao, J., Shahane, S. A., Rossoshek, A., & Simeonov, A. (2016) · Frontiers in Environmental Science · doi:10.3389/fenvs.2015.00085 · Cited by 227
Self-citationCombinatorial compound libraries for drug discovery: an ongoing challenge
Mario Geysen, H., Schoenen, F., Wagner, D., & Wagner, R. (2003) · Nature Reviews Drug Discovery · doi:10.1038/nrd1035 · Cited by 224
ACToR — Aggregated Computational Toxicology Resource
Judson, R., Richard, A., Dix, D., Houck, K., Elloumi, F., Martin, M., Cathey, T., Transue, T. R., Spencer, R., & Wolf, M. (2008) · Toxicology and Applied Pharmacology · doi:10.1016/j.taap.2007.12.037 · Cited by 214
Self-citationYang, C., Tarkhov, A., Marusczyk, J., Bienfait, B., Gasteiger, J., Kleinoeder, T., Magdziarz, T., Sacher, O., Schwab, C. H., Schwoebel, J., et al. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/ci500667v · Cited by 202
Self-citationChemical Genomics Profiling of Environmental Chemical Modulation of Human Nuclear Receptors
Huang, R., Xia, M., Cho, M.-H., Sakamuru, S., Shinn, P., Houck, K. A., Dix, D. J., Judson, R. S., Witt, K. L., Kavlock, R. J., et al. (2011) · Environmental Health Perspectives · doi:10.1289/ehp.1002952 · Cited by 196
Self-citationGrulke, C. M., Williams, A. J., Thillanadarajah, I., & Richard, A. M. (2019) · Computational Toxicology · doi:10.1016/j.comtox.2019.100096 · Cited by 179
Self-citationAttene-Ramos, M. S., Huang, R., Michael, S., Witt, K. L., Richard, A., Tice, R. R., Simeonov, A., Austin, C. P., & Xia, M. (2015) · Environmental Health Perspectives · doi:10.1289/ehp.1408642 · Cited by 172
Self-citationHuang, R., Sakamuru, S., Martin, M. T., Reif, D. M., Judson, R. S., Houck, K. A., Casey, W., Hsieh, J.-H., Shockley, K. R., Ceger, P., et al. (2014) · Scientific Reports · doi:10.1038/srep05664 · Cited by 167
Self-citationMcKee, R. H., Butala, J. H., David, R. M., & Gans, G. (2003) · Reproductive Toxicology · doi:10.1016/j.reprotox.2003.09.002 · Cited by 157
Zhu, H., Zhang, J., Kim, M. T., Boison, A., Sedykh, A., & Moran, K. (2014) · Chemical Research in Toxicology · doi:10.1021/tx500145h · Cited by 154
Suspect screening and non-targeted analysis of drinking water using point-of-use filters
Newton, S., McMahen, R. L., Sobus, J. R., Mansouri, K., Williams, A. J., McEachran, A. D., & Strynar, M. J. (2017) · Environmental Pollution · doi:10.1016/j.envpol.2017.11.033 · Cited by 145
Self-citationModeling Exposure in the Tox21 in Vitro Bioassays
Fischer, F. C., Henneberger, L., König, M., Bittermann, K., Linden, L., Goss, K.-U., & Escher, B. I. (2017) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.7b00023 · Cited by 143
Molecular complexity: a simplified formula adapted to individual atoms
Hendrickson, J. B., Huang, P., & Toczko, A. G. (1987) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci00054a004 · Cited by 130
Gold, L. S., Slone, T. H., Manley, N. B., Garfinkel, G. B., Hudes, E. S., Rohrbach, L., & Ames, B. N. (1991) · Environmental Health Perspectives · doi:10.1289/ehp.919611 · Cited by 106
CEBS: a comprehensive annotated database of toxicological data
Lea, I. A., Gong, H., Paleja, A., Rashid, A., & Fostel, J. M. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkw1077 · Cited by 80
Strickland, J. D., Martin, M. T., Richard, A. M., Houck, K. A., & Shafer, T. J. (2017) · Archives of Toxicology · doi:10.1007/s00204-017-2035-5 · Cited by 73
Self-citationHsieh, J., Sedykh, A., Huang, R., Xia, M., & Tice, R. R. (2015) · SLAS DISCOVERY · doi:10.1177/1087057115581317 · Cited by 72
Self-citationAbdelaziz, A., Spahn-Langguth, H., Schramm, K.-W., & Tetko, I. V. (2016) · Frontiers in Environmental Science · doi:10.3389/fenvs.2016.00002 · Cited by 65
Wang, J., Hallinger, D. R., Murr, A. S., Buckalew, A. R., Lougee, R. R., Richard, A. M., Laws, S. C., & Stoker, T. E. (2019) · Environment International · doi:10.1016/j.envint.2019.02.024 · Cited by 63
Self-citationArena, V. C., Sussman, N. B., Mazumdar, S., Yu, S., & Macina, O. T. (2004) · SAR and QSAR in environmental research · doi:10.1080/1062936032000169633 · Cited by 62
Huang, R., & Xia, M. (2017) · Frontiers in Environmental Science · doi:10.3389/fenvs.2017.00003 · Cited by 54
Self-citationCell-Based High-Throughput Screening for Aromatase Inhibitors in the Tox21 10K Library
Chen, S., Hsieh, J., Huang, R., Sakamuru, S., Hsin, L.-Y., Xia, M., Shockley, K. R., Auerbach, S. S., Kanaya, N., Lu, H., et al. (2015) · Toxicological Sciences · doi:10.1093/toxsci/kfv141 · Cited by 51
Self-citationMerrick, B. A., Paules, R. S., & Tice, R. R. (2015) · International Journal of Biotechnology · doi:10.1504/ijbt.2015.074797 · Cited by 50
Self-citationHuang, R., Xia, M., Sakamuru, S., Zhao, J., Lynch, C., Zhao, T., Zhu, H., Austin, C. P., & Simeonov, A. M. (2018) · Scientific Reports · doi:10.1038/s41598-018-22046-w · Cited by 50
Self-citationNelms, M., Pradeep, P., & Patlewicz, G. Y. (2019) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2019.104505 · Cited by 26
Dose-Response Modeling of High-Throughput Screening Data
Parham, F., Austin, C., Southall, N. T., Huang, R., Tice, R. R., & Portier, C. J. (2009) · SLAS DISCOVERY · doi:10.1177/1087057109349355 · Cited by 25
Self-citationTilley, S. K., Reif, D. M., & Fry, R. C. (2017) · Environment International · doi:10.1016/j.envint.2016.10.006 · Cited by 24
Monitoring Compound Integrity With Cytochrome P450 Assays and qHTS
MacArthur, R., Leister, W., Veith, H., Shinn, P., Southall, N., Austin, C. P., Inglese, J., & Auld, D. S. (2009) · SLAS Discovery · doi:10.1177/1087057109336954 · Cited by 23
Self-citationShockley, K. R. (2012) · Environmental Health Perspectives · doi:10.1289/ehp.1104688 · Cited by 17
Using Weighted Entropy to Rank Chemicals in Quantitative High-Throughput Screening Experiments
Shockley, K. R. (2013) · SLAS DISCOVERY · doi:10.1177/1087057113505325 · Cited by 10
Ngan, D. K., Ye, L., Wu, L., Xia, M., Rossoshek, A., Simeonov, A. M., & Huang, R. (2019) · Frontiers in Big Data · doi:10.3389/fdata.2019.00050 · Cited by 10
Self-citation
Research works printed but not linked: 1
- Richard A. M. (2004) DSSTox web site launch: Improving public access to databases for building structure-toxicity prediction models. Preclinica 2 (2), 103– 108.
Cited by
Han, R., Yoon, H., Kim, G., Lee, H., & Lee, Y. (2023) · Pharmaceuticals · doi:10.3390/ph16091259 · Cited by 176
Improving the generalizability of protein-ligand binding predictions with AI-Bind
Chatterjee, A., Walters, R., Shafi, Z., Ahmed, O. S., Sebek, M., Gysi, D., Yu, R., Eliassi-Rad, T., Barabási, A.-L., & Menichetti, G. (2023) · Nature Communications · doi:10.1038/s41467-023-37572-z · Cited by 153
Seal, S., Mahale, M., García-Ortegón, M., Joshi, C. K., Hosseini-Gerami, L., Beatson, A., Greenig, M., Shekhar, M., Patra, A., Weis, C., et al. (2025) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.5c00033 · Cited by 185
Jeong, J., & Choi, J. (2022) · Environmental Science & Technology · doi:10.1021/acs.est.1c07413 · Cited by 158
High-Resolution Mass Spectrometry for Human Exposomics: Expanding Chemical Space Coverage
Lai, Y., Koelmel, J. P., Walker, D. I., Price, E. J., Papazian, S., Manz, K. E., Castilla-Fernández, D., Bowden, J. A., Nikiforov, V. A., David, A., et al. (2024) · Environmental Science & Technology · doi:10.1021/acs.est.4c01156 · Cited by 152
Metadata
- Authors
- Richard, A. M., Huang, R., Waidyanatha, S., Shinn, P., Collins, B. J., Thillainadarajah, I., Grulke, C. M., Williams, A. J., Lougee, R. R., Judson, R. S., Houck, K. A., Shobair, M., Yang, C., Rathman, J. F., Yasgar, A., Fitzpatrick, S. C., Simeonov, A., Thomas, R. S., Crofton, K. M., Paules, R. S., Bucher, J. R., Austin, C. P., Kavlock, R. J., & Tice, R. R.
- Affiliations
- Environmental Protection Agency (US)
- National Center for Advancing Translational Sciences (US)
- National Institute of Environmental Health Sciences , , , ,
- National Institutes of Health (US)
- United States Environmental Protection Agency , , , ,
- Molecular Networks (Germany) (DE)
- Center for Food Safety and Applied Nutrition (US)
- Corresponding author
- Richard, Ann M.
- ORCID
- Richard, Ann M.
- Huang, Ruili
- Shinn, Paul
- Collins, Bradley J.
- Williams, Antony J.
- Lougee, Ryan R.
- Judson, Richard S.
- Houck, Keith A.
- Shobair, Mahmoud
- Yang, Chihae
- Rathman, James F.
- Yasgar, Adam
- Simeonov, Anton
- Thomas, Russell S.
- Crofton, Kevin M.
- Paules, Richard S.
- Bucher, John R.
- Austin, Christopher P.
- Tice, Raymond R.
- Venue
- Chemical Research in Toxicology
- Publisher
- American Chemical Society (ACS)
- Published
- 2020-11-03
- Volume
- 34
- Issue
- 2
- Pages
- 189-216
- ISSN
- 0893-228X (ISSN-L)
- 1520-5010
- PMC
- PMC7887805
- OpenAlex
- W3097280976
- Cited by
- 323
- References
- 54
- Citations by year
- 2026: 66 · 2025: 67 · 2024: 52 · 2023: 64 · 2022: 48 · 2021: 25 · 2020: 1
- FWCI
- 3.07
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Chemical Research in Toxicology (publishedVersion, public-domain)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Figshare (submittedVersion, cc-by)
- U.S. Environmental Protection Agency (public-domain)
- Funders
- U.S. Environmental Protection Agency
- U.S. Food and Drug Administration
- National Institutes of Health
- Topics
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- Physical Sciences › Environmental Science › Health, Toxicology and Mutagenesis › Environmental Toxicology and Ecotoxicology
- Physical Sciences › Environmental Science › Health, Toxicology and Mutagenesis › Effects and risks of endocrine disrupting chemicals
- Keywords
- Tox21, chemical toxicity, high-throughput screening, ToxCast, chemotypes, chemical annotation, reproducibility, physicochemical properties
- MeSH terms
- Humans, United States, United States Environmental Protection Agency, Toxicity Tests, Small Molecule Libraries, High-Throughput Screening Assays
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.