The DOI matches its Crossref record; 85 of the 85 references it cites were found in a registry or an index.
CERAPP: Collaborative Estrogen Receptor Activity Prediction Project
Open accessAbstract
Background: Humans are exposed to thousands of man-made chemicals in the environment. Some chemicals mimic natural endocrine hormones and, thus, have the potential to be endocrine disruptors. Most of these chemicals have never been tested for their ability to interact with the estrogen receptor (ER). Risk assessors need tools to prioritize chemicals for evaluation in costly in vivo tests, for instance, within the U.S. EPA Endocrine Disruptor Screening Program. Objectives: We describe a large-scale modeling project called CERAPP (Collaborative Estrogen Receptor Activity Prediction Project) and demonstrate the efficacy of using predictive computational models trained on high-throughput screening data to evaluate thousands of chemicals for ER-related activity and prioritize them for further testing. Methods: CERAPP combined multiple models developed in collaboration with 17 groups in the United States and Europe to predict ER activity of a common set of 32,464 chemical structures. Quantitative structure–activity relationship models and docking approaches were employed, mostly using a common training set of 1,677 chemical structures provided by the U.S. EPA, to build a total of 40 categorical and 8 continuous models for binding, agonist, and antagonist ER activity. All predictions were evaluated on a set of 7,522 chemicals curated from the literature. To overcome the limitations of single models, a consensus was built by weighting models on scores based on their evaluated accuracies. Results: Individual model scores ranged from 0.69 to 0.85, showing high prediction reliabilities. Out of the 32,464 chemicals, the consensus model predicted 4,001 chemicals (12.3%) as high priority actives and 6,742 potential actives (20.8%) to be considered for further testing. Conclusion: This project demonstrated the possibility to screen large libraries of chemicals using a consensus of different in silico approaches. This concept will be applied in future projects related to other end points. Citation: Mansouri K, Abdelaziz A, Rybacka A, Roncaglioni A, Tropsha A, Varnek A, Zakharov A, Worth A, Richard AM, Grulke CM, Trisciuzzi D, Fourches D, Horvath D, Benfenati E, Muratov E, Wedebye EB, Grisoni F, Mangiatordi GF, Incisivo GM, Hong H, Ng HW, Tetko IV, Balabin I, Kancherla J, Shen J, Burton J, Nicklaus M, Cassotti M, Nikolov NG, Nicolotti O, Andersson PL, Zang Q, Politi R, Beger RD, Todeschini R, Huang R, Farag S, Rosenberg SA, Slavov S, Hu X, Judson RS. 2016. CERAPP: Collaborative Estrogen Receptor Activity Prediction Project. Environ Health Perspect 124:1023–1033; http://dx.doi.org/10.1289/ehp.1510267
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The resulting consensus QSAR models leveraged knowledge from the groups and were used to predict ER and AR potentials of 32,464 new chemicals.”
From QSAR without borders (2020) · cites this paper as [89]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538 · cited 1×
“Some of the participants applied feature selection techniques, such as genetic algorithms (GAs) (Davi 1991) and random forest (RF) (Breiman 2001).”
Nearest neighbor pattern classification
Cover, T., & Hart, P. (1967) · IEEE Transactions on Information Theory · doi:10.1109/tit.1967.1053964 · Cited by 16,936 · cited 2×
“…al. 2001; Beger and Wilkes 2001; Slavov et al. 2013), support vector machines (SVM) (Cristianini and Shawe-Taylor 2000), k nearest neighbors (kNN) (Cover and Hart 1967; Kowalski and Bender 1972), associative artificial neural networks (ASNN) (Tetko 2002a, 2002b), PASS algorithm derived from Naïve…”
An Introduction to Support Vector Machines and Other Kernel-based Learning Methods
Cristianini, N., & Shawe-Taylor, J. (2000) · doi:10.1017/cbo9780511801389 · Cited by 13,855 · cited 3×
“…spectral data–activity relationship (QSDAR) (Beger et al. 2001; Beger and Wilkes 2001; Slavov et al. 2013), support vector machines (SVM) (Cristianini and Shawe-Taylor 2000), k nearest neighbors (kNN) (Cover and Hart 1967; Kowalski and Bender 1972), associative artificial neural…”
PLS-regression: a basic tool of chemometrics
Wold, S., Sjöström, M., & Eriksson, L. (2001) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/s0169-7439(01)00155-1 · Cited by 10,084
Handbook of Genetic Algorithms
Davis, L. D. (1991) · Cumulative Index of Computer Aided Architectural Design · Cited by 7,330
Endocrine-Disrupting Chemicals: An Endocrine Society Scientific Statement
Diamanti-Kandarakis, E., Bourguignon, J.-P., Giudice, L. C., Hauser, R., Prins, G. S., Soto, A. M., Zoeller, R. T., & Gore, A. C. (2009) · Endocrine Reviews · doi:10.1210/er.2009-0002 · Cited by 4,585 · cited 4×
“Exposure to EDCs can lead to adverse health effects involving developmental, neurological, reproductive, metabolic, cardiovascular, and immune systems in humans and wildlife (Colborn et al. 1993; Davis et al. 1993; Diamanti-Kandarakis et al. 2009).”
BackgroundInfluentialKuiper, G. G. J. M., Carlsson, B., Grandien, K., Enmark, E., Häggblad, J., Nilsson, S., & Gustafsson, J.-A. (1997) · Endocrinology · doi:10.1210/endo.138.3.4979 · Cited by 4,442 · cited 1×
“2015) ASNN DRAGON METI + (Kuiper et al. 1997; Taha et al. 2010) Categorical UNC_MML SVM+RF DRAGON ToxCastTM (120) Categorical UNIBA (Trisciuzzi et al.”
ChEMBL: a large-scale bioactivity database for drug discovery
Gaulton, A., Bellis, L. J., Bento, A. P., Chambers, J., Davies, M., Hersey, A., Light, Y., McGlinchey, S., Michalovich, D., Al-Lazikani, B., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gkr777 · Cited by 4,382 · cited 2×
“(Gaulton et al. 2012).”
Developmental Effects of Endocrine-Disrupting Chemicals in Wildlife and Humans
Colborn, T., Saal, F. S. V., & Soto, A. M. (1993) · Environmental Health Perspectives · doi:10.1289/ehp.93101378 · Cited by 3,570 · cited 1×
“Exposure to EDCs can lead to adverse health effects involving developmental, neurological, reproductive, metabolic, cardiovascular, and immune systems in humans and wildlife (Colborn et al. 1993; Davis et al. 1993; Diamanti-Kandarakis et al. 2009).”
PaDEL‐descriptor: An open source software to calculate molecular descriptors and fingerprints
Yap, C. W. (2010) · Journal of Computational Chemistry · doi:10.1002/jcc.21707 · Cited by 2,979
Research works printed but not linked: 3
- Hong H, Slavov S, Ge W, Qian F, Su Z, Fang H, et al, 2012, Mold2 molecular descriptors for QSAR., 65
- NIH (National Institutes of Health) . 2015. The PubChem Database.Available: http://pubchem.ncbi.nlm.nih.gov/ [accessed 26 January 2015].
- U.S. EPA, 2014, CPCat: Chemical and Product Categories. Exploring consumer exposure pathways and patterns of use for chemicals in the environment., Toxicology Reports, 2, 228
Cited by
Sorted by citations
Machine Learning: New Ideas and Tools in Environmental Science and Engineering
Zhong, S., Zhang, K., Bagheri, M., Burken, J. G., Gu, A. Z., Li, B., Ma, X., Marrone, B. L., Ren, Z. J., Schrier, J., et al. (2021) · Environmental Science & Technology · doi:10.1021/acs.est.1c01339 · Cited by 999
Muratov, E. N., Bajorath, J., Sheridan, R. P., Tetko, I. V., Filimonov, D., Poroikov, V., Oprea, T. I., Baskin, I. I., Varnek, A., Roitberg, A., et al. (2020) · Chemical Society Reviews · doi:10.1039/d0cs00098a · Cited by 913
Self-citationToxCast Chemical Landscape: Paving the Road to 21st Century Toxicology
Richard, A. M., Judson, R., Houck, K. A., Grulke, C., Volarath, P., Thillainadarajah, I., Yang, C., Rathman, J. F., Martin, M. T., Wambaugh, J. F., et al. (2016) · Chemical Research in Toxicology · doi:10.1021/acs.chemrestox.6b00135 · Cited by 714
Self-citationOPERA models for predicting physicochemical properties and environmental fate endpoints
Mansouri, K., Grulke, C., Judson, R., & Williams, A. J. (2018) · Journal of Cheminformatics · doi:10.1186/s13321-018-0263-1 · Cited by 650
Self-citationToxicity testing in the 21st century: progress in the past decade and future perspectives
Krewski, D. R., Andersen, M. E., Tyshenko, M. G., Krishnan, K., Härtung, T., Boekelheide, K., Wambaugh, J. F., Jones, D. P., Whelan, M., Thomas, R. S., et al. (2019) · Archives of Toxicology · doi:10.1007/s00204-019-02613-4 · Cited by 401
Metadata
- Authors
- Mansouri, K., Abdelaziz, A., Rybacka, A., Roncaglioni, A., Tropsha, A., Varnek, A., Zakharov, A., Worth, A., Richard, A. M., Grulke, C. M., Trisciuzzi, D., Fourches, D., Horvath, D., Benfenati, E., Muratov, E., Wedebye, E. B., Grisoni, F., Mangiatordi, G. F., Incisivo, G. M., Hong, H., Ng, H. W., Tetko, I. V., Balabin, I., Kancherla, J., Shen, J., Burton, J., Nicklaus, M., Cassotti, M., Nikolov, N. G., Nicolotti, O., Andersson, P. L., Zang, Q., Politi, R., Beger, R. D., Todeschini, R., Huang, R., Farag, S., Rosenberg, S. A., Slavov, S., Hu, X., & Judson, R. S.
- Affiliations
- Environmental Protection Agency (US)
- Helmholtz Munich (DE)
- Umeå University (SE)
- Mario Negri Institute for Pharmacological Research (IT)
- University of North Carolina at Chapel Hill (US)
- Université de Strasbourg (FR)
- National Institutes of Health (US)
- European Commission (BE)
- National Center for Computational Toxicology, U.S. Environmental Protection Agency, Research Triangle Park, North Carolina, USA
- University of Bari Aldo Moro (IT)
- Technical University of Denmark (DK)
- University of Milano-Bicocca (IT)
- National Center for Toxicological Research (US)
- Lockheed Martin (United States) (US)
- Research Institute for Fragrance Materials (US)
- Integrated Laboratory Systems, Inc. (US)
- Corresponding author
- Judson, Richard S.
- ORCID
- Mansouri, Kamel
- Roncaglioni, Alessandra
- Tropsha, Alexander
- Varnek, Alexandre
- Zakharov, Alexey
- Worth, Andrew
- Trisciuzzi, Daniela
- Fourches, Denis
- Horvath, Dragos
- Benfenati, Emilio
- Muratov, Eugene
- Wedebye, Eva Bay
- Grisoni, Francesca
- Mangiatordi, Giuseppe F.
- Hong, Huixiao
- Tetko, Igor V.
- Balabin, Ilya
- Kancherla, Jayaram
- Shen, Jie
- Nicklaus, Marc
- Cassotti, Matteo
- Nikolov, Nikolai G.
- Nicolotti, Orazio
- Andersson, Patrik L.
- Zang, Qingda
- Beger, Richard D.
- Todeschini, Roberto
- Huang, Ruili
- Rosenberg, Sine A.
- Slavov, Svetoslav
- Hu, Xin
- Judson, Richard S.
- Venue
- Environmental Health Perspectives
- Publisher
- American Chemical Society (ACS)
- Published
- 2016-02-23
- Volume
- 124
- Issue
- 7
- Pages
- 1023-1033
- ISSN
- 0091-6765 (ISSN-L)
- 1552-9924
- PMC
- PMC4937869
- OpenAlex
- W2394108223
- Cited by
- 375
- References
- 85
- Citations by year
- 2026: 26 · 2025: 46 · 2024: 35 · 2023: 32 · 2022: 36 · 2021: 41 · 2020: 35 · 2019: 30 · 2018: 38 · 2017: 29 · 2016: 27
- FWCI
- 38.02
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- public-domain
- creativecommons.org/licenses/by/4.0/ (vor, 675 d)
- Locations
- Environmental Health Perspectives (publishedVersion, public-domain)
- PubMed Central (publishedVersion, public-domain)
- PubMed (publishedVersion)
- PuSH - Publication Server of Helmholtz Zentrum München (submittedVersion, cc-by)
- KTH Publication Database DiVA (KTH Royal Institute of Technology) (submittedVersion, other-oa)
- HAL (submittedVersion, other-oa)
- BOA (University of Milano-Bicocca) (submittedVersion)
- Site cant be reached (submittedVersion, cc-by)
- Joint Research Centre (European Commission) (submittedVersion)
- Technical University of Denmark, DTU Orbit (Technical University of Denmark, DTU) (submittedVersion, other-oa)
- CINECA IRIS Institutional Research Information System (University of Bari Aldo Moro) (submittedVersion, other-oa)
- Funders
- National Institute of General Medical Sciences (T32GM067553)
- Topics
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- Physical Sciences › Environmental Science › Health, Toxicology and Mutagenesis › Effects and risks of endocrine disrupting chemicals
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Endocrinology › Estrogen and related hormone effects
- Keywords
- endocrine disruptors, estrogen receptor, QSAR, molecular docking, consensus model, chemical prioritization, high-throughput screening, chemical risk assessment
- MeSH terms
- Computer Simulation, Receptors, Estrogen, United States, Toxicity Tests, Quantitative Structure-Activity Relationship, Endocrine Disruptors, Environmental Policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review