Deep reinforcement learning for the control of microbial co-cultures in bioreactors
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Multi-species microbial communities are widespread in natural ecosystems. When employed for biomanufacturing, engineered synthetic communities have shown increased productivity in comparison with monocultures and allow for the reduction of metabolic load by compartmentalising bioprocesses between multiple sub-populations. Despite these benefits, co-cultures are rarely used in practice because control over the constituent species of an assembled community has proven challenging. Here we demonstrate, in silico, the efficacy of an approach from artificial intelligence-reinforcement learning-for the control of co-cultures within continuous bioreactors. We confirm that feedback via a trained reinforcement learning agent can be used to maintain populations at target levels, and that model-free performance with bang-bang control can outperform a traditional proportional integral controller with continuous control, when faced with infrequent sampling. Further, we demonstrate that a satisfactory control policy can be learned in one twenty-four hour experiment by running five bioreactors in parallel. Finally, we show that reinforcement learning can directly optimise the output of a co-culture bioprocess. Overall, reinforcement learning is a promising technique for the control of microbial communities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408
How biotech can transform biofuels
Lynd, L. R., Laser, M. S., Bransby, D., Dale, B. E., Davison, B., Hamilton, R., Himmel, M., Keller, M., McMillan, J. D., Sheehan, J., et al. (2008) · Nature Biotechnology · doi:10.1038/nbt0208-169 · Cited by 1,121
Synchronized cycles of bacterial lysis for in vivo delivery
Din, M. O., Danino, T., Prindle, A., Skalak, M., Selimkhanov, J., Allen, K., Julio, E., Atolia, E., Tsimring, L. S., Bhatia, S. N., et al. (2016) · Nature · doi:10.1038/nature18930 · Cited by 784
Evolutionary paths to antibiotic resistance under dynamically sustained drug selection
Toprak, E., Veres, A., Michel, J.-B., Chait, R., Hartl, D. L., & Kishony, R. (2012) · Nature Genetics · doi:10.1038/ng.1034 · Cited by 764 · cited 1×
“The development of a morbidostat facilitated the investigation into the evolution of resistance to antibiotics [48].”
Semi-synthetic artemisinin: a model for the use of synthetic biology in pharmaceutical development
Paddon, C. J., & Keasling, J. D. (2014) · Nature Reviews Microbiology · doi:10.1038/nrmicro3240 · Cited by 675 · cited 2×
“We repeated this process one hundred times for each of the following sampling times: [1, 2, 3, 4, 5, 10] minutes.”
Cited by
Machine learning for metabolic engineering: A review
Lawson, C. E., Martí, J. M., Radivojevic, T., Jonnalagadda, S. V. R., Gentz, R., Hillson, N. J., Peisert, S., Kim, J., Simmons, B. A., Petzold, C. J., et al. (2021) · Metabolic Engineering · doi:10.1016/j.ymben.2020.10.005 · Cited by 313
Microalgae with Artificial Intelligence: A Digitalized Perspective on Genetics, Systems and Products
Teng, S. Y., Yew, G. Y., Sukačová, K., Show, P. L., Máša, V., & Chang, J.-S. (2020) · Biotechnology Advances · doi:10.1016/j.biotechadv.2020.107631 · Cited by 145
Rodríguez-Rángel, H., Arias, D. M., Morales-Rosales, L. A., Gonzalez-Huitron, V., Valenzuela Partida, M., & García, J. (2022) · Energies · doi:10.3390/en15072500 · Cited by 56
“…Neural Network (ANN) and Convolutional Neural Networks (CNN) can be used for the prediction of genome interactions [24,25], microalgae flocculation [26] and biomass quantification [27], providing improvement in the processes by reducing the number of experiments and condition optimization [28].”
Understanding the Functionality of Probiotics on the Edge of Artificial Intelligence (AI) Era
Asar, R., Erenler, S., Devecioglu, D., Ispirli, H., Karbancioglu-Guler, F., Ozturk, H. I., & Dertli, E. (2025) · Fermentation · doi:10.3390/fermentation11050259 · Cited by 37
Metadata
- Authors
- Treloar, N. J., Fedorec, A. J. H., Ingalls, B., & Barnes, C. P.
- Venue
- PLOS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-04-10
- Volume
- 16
- Issue
- 4
- Pages
- e1007783
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- OpenAlex
- W3015713838
- Cited by
- 130
- References
- 6
- FWCI
- 4.29
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.