Are Bigger Data Sets Better for Machine Learning? Fusing Single-Point and Dual-Event Dose Response Data for Mycobacterium tuberculosis
Open accessThe DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
Tuberculosis is a major, neglected disease for which the quest to find new treatments continues. There is an abundance of data from large phenotypic screens in the public domain against Mycobacterium tuberculosis (Mtb). Since machine learning methods can learn from past data, we were interested in addressing whether more data builds better models. We now describe using Bayesian machine learning to assess whether we can improve our models by combining the large quantities of single-point data with the much smaller (higher quality) dual-event data sets, which use both dose-response data for both whole-cell antitubercular activity and Vero cell cytotoxicity. We have evaluated 12 models ranging from different single-point, dual-event dose-response, single-point and dual-event dose-response as well as combined data sets for three distinct data sets from the same laboratory. We used a fourth data set of active and inactive compounds from the same group as well as a smaller set of 177 active compounds from GlaxoSmithKline as test sets. Our data suggest combining single-point with dual-event dose-response data does not diminish the internal or external predictive ability of the models based on the receiver operator curve (ROC) for these models (internal ROC range 0.83-0.91, external ROC range 0.62-0.83) compared to the orders of magnitude smaller dual-event models (internal ROC range 0.6-0.83 and external ROC 0.54-0.83). In conclusion, models developed with 1200-5000 compounds appear to be as predictive as those generated with 25 000-350 000 molecules. Our results have implications for justifying further high-throughput screening versus focused testing based on model predictions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Drugs for bad bugs: confronting the challenges of antibacterial discovery
Payne, D. J., Gwynn, M. N., Holmes, D. J., & Pompliano, D. L. (2007) · Nature Reviews Drug Discovery · doi:10.1038/nrd2201 · Cited by 2,512
A Diarylquinoline Drug Active on the ATP Synthase of Mycobacterium tuberculosis
Andries, K., Verhasselt, P., Guillemont, J., Göhlmann, H. W. H., Neefs, J.-M., Winkler, H., Van Gestel, J., Timmerman, P., Zhu, M., Lee, E., et al. (2005) · Science · doi:10.1126/science.1106753 · Cited by 2,191
Impact of high-throughput screening in biomedical research
Macarron, R., Banks, M. N., Bojanic, D., Burns, D. J., Cirovic, D. A., Garyantes, T., Green, D. V. S., Hertzberg, R. P., Janzen, W. P., Paslay, J. W., et al. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3368 · Cited by 1,364
Cited by
Concepts of Artificial Intelligence for Computer-Assisted Drug Discovery
Yang, X., Wang, Y., Byrne, R., Schneider, G., & Yang, S. (2019) · Chemical Reviews · doi:10.1021/acs.chemrev.8b00728 · Cited by 1,022
Korotcov, A., Tkachenko, V., Russo, D. P., & Ekins, S. (2017) · Molecular Pharmaceutics · doi:10.1021/acs.molpharmaceut.7b00578 · Cited by 352
Self-citationOpen Source Bayesian Models. 1. Application to ADME/Tox and Drug Discovery Datasets
Clark, A. M., Dole, K., Coulon-Spektor, A., McNutt, A., Grass, G., Freundlich, J. S., Reynolds, R. C., & Ekins, S. (2015) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.5b00143 · Cited by 114
Self-citationMachine Learning Models and Pathway Genome Data Base for Trypanosoma cruzi Drug Discovery
Ekins, S., Lage de Siqueira-Neto, J., McCall, L.-I., Sarker, M., Yadav, M., Ponder, E. L., Kallel, E. A., Kellar, D., Chen, S., Arkin, M., et al. (2015) · PLOS Neglected Tropical Diseases · doi:10.1371/journal.pntd.0003878 · Cited by 93
Self-citationMachine learning models identify molecules active against the Ebola virus in vitro
Ekins, S., Freundlich, J. S., Clark, A. M., Anantpadma, M., Davey, R. A., & Madrid, P. (2015) · F1000Research · doi:10.12688/f1000research.7217.1 · Cited by 84
Self-citation
Metadata
- Authors
- Ekins, S., Freundlich, J. S., & Reynolds, R. C.
- Venue
- Journal of Chemical Information and Modeling
- Publisher
- American Chemical Society (ACS)
- Published
- 2014-07-17
- Volume
- 54
- Issue
- 7
- Pages
- 2157-2165
- ISSN
- 1549-9596 (ISSN-L)
- 1549-960X
- OpenAlex
- W1990919689
- Cited by
- 40
- References
- 3
- FWCI
- 5.69
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.