Machine Learning and Its Applications to Biology
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
The term machine learning refers to a set of topics dealing with the creation and evaluation of algorithms that facilitate pattern recognition, classification, and prediction, based on models derived from existing data. Two facets of mechanization should be acknowledged when considering machine learning in broad terms. Firstly, it is intended that the classification and prediction tasks can be accomplished by a suitably programmed computing machine. That is, the product of machine learning is a classifier that can be feasibly used on available hardware. Secondly, it is intended that the creation of the classifier should itself be highly mechanized, and should not involve too much human input. This second facet is inevitably vague, but the basic objective is that the use of automatic algorithm construction methods can minimize the possibility that human biases could affect the selection and performance of the algorithm. Both the creation of the algorithm and its operation to classify objects or predict events are to be based on concrete, observable data. The history of relations between biology and the field of machine learning is long and complex. An early technique [1] for machine learning called the perceptron constituted an attempt to model actual neuronal behavior, and the field of artificial neural network (ANN) design emerged from this attempt. Early work on the analysis of translation initiation sequences [2] employed the perceptron to define criteria for start sites in Escherichia coli. Further artificial neural network architectures such as the adaptive resonance theory (ART) [3] and neocognitron [4] were inspired from the organization of the visual nervous system. In the intervening years, the flexibility of machine learning techniques has grown along with mathematical frameworks for measuring their reliability, and it is natural to hope that machine learning methods will improve the efficiency of discovery and understanding in the mounting volume and complexity of biological data. This tutorial is structured in four main components. Firstly, a brief section reviews definitions and mathematical prerequisites. Secondly, the field of supervised learning is described. Thirdly, methods of unsupervised learning are reviewed. Finally, a section reviews methods and examples as implemented in the open source data analysis and visualization language R (http://www.r-project.org).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Machine learning methods have been widely used in bioinformatics [218,219] and computational and systems biology [220,221].”
From Reverse engineering and identification in systems biology: strategies, perspectives and challenges (2014) · cites this paper as [221]
The cited source says what the claim attributes to it.
In the citing paper
“For example, unsupervised machine learning methods can be used to detect clusters of participants that share similar patterns or combinations of various characteristics13.”
From Cluster-based psychological phenotyping and differences in anxiety treatment outcomes (2023) · cites this paper as [13]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Wu, Y. (1999) · Technometrics · doi:10.1080/00401706.1999.10485951 · Cited by 27,221 · cited 2×
“The optimization problem can be reduced to a dual problem with solutions given by solving a quadratic programming problem [23].”
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
Modern Applied Statistics with S
Venables, W. N., & Ripley, B. D. (2002) · Statistics and Computing · doi:10.1007/978-0-387-21706-2 · Cited by 24,305
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Learning Internal Representations by Error Propagation
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1985) · doi:10.21236/ada164453 · Cited by 16,172
Kohonen, T. (2001) · Springer Series in Information Sciences · doi:10.1007/978-3-642-56927-2 · Cited by 16,019
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280 · cited 1×
“An early technique [1] for machine learning called the perceptron constituted an attempt to model actual neuronal behavior, and the field of artificial neural network (ANN) design emerged from this attempt.”
MethodGolub, T. R., Slonim, D. K., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J. P., Coller, H., Loh, M. L., Downing, J. R., Caligiuri, M. A., et al. (1999) · Science · doi:10.1126/science.286.5439.531 · Cited by 11,516 · cited 1×
“For instance, marker genes for cancer prediction were chosen based on their correlation with the class distinction and then used as inputs in a classifier [ 24 ].”
MethodFinding groups in data: an introduction to cluster analysis
(1991) · Choice Reviews Online · doi:10.5860/choice.28-4558 · Cited by 10,474
Distinct types of diffuse large B-cell lymphoma identified by gene expression profiling
Alizadeh, A. A., Eisen, M. B., Davis, R. E., Ma, C., Lossos, I. S., Rosenwald, A., Boldrick, J. C., Sabet, H., Tran, T., Yu, X., et al. (2000) · Nature · doi:10.1038/35000501 · Cited by 9,925
Finding Groups in Data: An Introduction to Cluster Analysis
Kaufman, L., & Rousseeuw, P. J. (1990) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316801 · Cited by 7,344
Pattern Recognition and Neural Networks
Ripley, B. D. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511812651 · Cited by 6,459 · cited 1×
“For more details on theory and practical use of neural networks, please see Duda et al. [12], Ripley [ 21 ], Venables and Ripley [22], and references therein.”
BackgroundFukushima, K. (1980) · Biological Cybernetics · doi:10.1007/bf00344251 · Cited by 5,759 · cited 1×
“Further artificial neural network architectures such as the adaptive resonance theory (ART) [3] and neocognitron [4] were inspired from the organization of the visual nervous system.”
BackgroundAlon, U., Barkai, N., Notterman, D. A., Gish, K., Ybarra, S., Mack, D., & Levine, A. J. (1999) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.96.12.6745 · Cited by 4,167
Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data
Dudoit, S., Fridlyand, J., & Speed, T. P. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502753479248 · Cited by 2,672 · cited 1×
“Such a diagonal linear discriminant was found to outperform other types of classifiers on a variety of microarray analyses [16].”
BackgroundEstimating the error rate of a prediction rule: improvement on cross-validation
Efron, B. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477973 · Cited by 2,300
Systematic variation in gene expression patterns in human cancer cell lines
Ross, D. T., Scherf, U., Eisen, M. B., Perou, C. M., Rees, C., Spellman, P., Iyer, V., Jeffrey, S. S., Van de Rijn, M., Waltham, M., et al. (2000) · Nature Genetics · doi:10.1038/73432 · Cited by 2,088 · cited 1×
“For instance, gene expression data was successfully used to classify patients in different clinical groups and to identify new disease groups [6–9], while genetic code allowed prediction of the protein secondary structure [10].”
MethodPattern Classification (2nd Edition)
Duda, R. O., Hart, P. E., & Stork, D. G. (2000) · Wiley-Interscience eBooks · Cited by 2,070
Krämer, W. (2003) · Computational Statistics & Data Analysis · Cited by 1,858
Statistical Pattern Recognition
Webb, A. R. (2002) · Wiley eBooks · doi:10.1002/0470854774 · Cited by 1,459
Combining evolutionary information and neural networks to predict protein secondary structure
Rost, B., & Sander, C. (1994) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.340190108 · Cited by 1,452 · cited 1×
“For instance, gene expression data was successfully used to classify patients in different clinical groups and to identify new disease groups [6–9], while genetic code allowed prediction of the protein secondary structure [10].”
MethodDistinctive gene expression patterns in human mammary epithelial cells and breast cancers
Perou, C. M., Jeffrey, S. S., van de Rijn, M., Rees, C. A., Eisen, M. B., Ross, D. T., Pergamenschikov, A., Williams, C. F., Zhu, S. X., Lee, J. C. F., et al. (1999) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.96.16.9212 · Cited by 1,402 · cited 1×
“For instance, gene expression data was successfully used to classify patients in different clinical groups and to identify new disease groups [6–9], while genetic code allowed prediction of the protein secondary structure [10].”
MethodThe ART of adaptive pattern recognition by a self-organizing neural network
Carpenter, G. A., & Grossberg, S. (1988) · Computer · doi:10.1109/2.33 · Cited by 1,287
Prediction of cancer outcome with microarrays: a multiple random validation strategy
Michiels, S., Koscielny, S., & Hill, C. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17866-0 · Cited by 1,025 · cited 1×
“Because of inadequate validation schemes, many studies published in the literature as successful have been shown to be overoptimistic [40].”
BackgroundClassifier Technology and the Illusion of Progress
Hand, D. J. (2006) · Statistical Science · doi:10.1214/088342306000000060 · Cited by 723 · cited 1×
“It is argued [39] that the success or failure of machine learning approaches on a given problem is sometimes a matter of the quality indices used to evaluate the results, and these may vary strongly with the expertise of the user.”
BackgroundUse of the ‘Perceptron’ algorithm to distinguish translational initiation sites in E. coli
Stormo, G. D., Schneider, T. D., Gold, L., & Ehrenfeucht, A. (1982) · Nucleic Acids Research · doi:10.1093/nar/10.9.2997 · Cited by 651 · cited 1×
“Early work on the analysis of translation initiation sequences [ 2 ] employed the perceptron to define criteria for start sites in Escherichia coli.”
MethodRegularized linear discriminant analysis and its application in microarrays
Guo, Y., Hastie, T., & Tibshirani, R. (2007) · Biostatistics · doi:10.1093/biostatistics/kxj035 · Cited by 597 · cited 1×
“In very recent work, Guo and colleagues [17] have presented a regularized linear discriminant analysis procedure useful when the number of features far exceeds the number of samples.”
BackgroundKohonen, T. (2001) · Springer Series in Information Sciences · doi:10.1007/978-3-642-56927-2_6 · Cited by 438
Chiaretti, S., Li, X., Gentleman, R., Vitale, A., Vignetti, M., Mandelli, F., Ritz, J., & Foa, R. (2004) · Blood · doi:10.1182/blood-2003-09-3243 · Cited by 351 · cited 1×
“installs a data structure representing samples on 128 individuals with acute lymphocytic leukemia [35].”
BackgroundData Analysis Tools for DNA Microarrays
Draghici, S. (2003) · Chapman & Hall/CRC eBooks · doi:10.1201/9780203486078 · Cited by 345
Self-citationJirapech-Umpai, T., & Aitken, S. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-148 · Cited by 328
A new partitioning around medoids algorithm
Van der Laan, M., Pollard, K., & Bryan, J. (2003) · Journal of Statistical Computation and Simulation · doi:10.1080/0094965031000136012 · Cited by 287 · cited 1×
“The robustness is particularly important in the common situation in which many elements do not have a clearcut membership to any specific cluster [31].”
BackgroundSemi-supervised protein classification using cluster kernels
Weston, J., Leslie, C., Ie, E., Zhou, D., Elisseeff, A., & Noble, W. S. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti497 · Cited by 203 · cited 1×
“In such cases, semi-supervised techniques can be applied to obtain a better classifier than could be obtained if only the labeled samples were used [5].”
BackgroundAre clusters found in one dataset present in another dataset?
Kapp, A. V., & Tibshirani, R. (2007) · Biostatistics · doi:10.1093/biostatistics/kxj029 · Cited by 181
Systematic Management and Analysis of Yeast Gene Expression DataPreprint
Aach, J., Rindone, W. P., & Church, G. M. (2000) · Genome Research · doi:10.1101/gr.10.4.431 · Cited by 118 · cited 1×
“Clustering is a popular exploratory technique, especially with high dimensionality data such as microarray gene expression [28,29].”
MethodKohonen, T. (1988) · Neural Networks · doi:10.1016/0893-6080(88)90334-6 · Cited by 89
CLUSTER, FUNCTION AND PROMOTER: ANALYSIS OF YEAST EXPRESSION ARRAY
Zhu, J. K., & Zhang, M. Q. (1999) · Pacific Symposium on Biocomputing (PSB) · doi:10.1142/9789814447331_0045 · Cited by 40 · cited 1×
“Clustering is a popular exploratory technique, especially with high dimensionality data such as microarray gene expression [28,29].”
MethodTarca, A. L., Cooke, J. E. K., & Mackay, J. (2005) · Computer applications in the biosciences · doi:10.1093/bioinformatics/bti397 · Cited by 39 · cited 1×
“Continuous variable prediction with machine learning algorithms was used to estimate bias in cDNA microarray data [11].”
MethodSelf-citationDistance Measures in DNA Microarray Data Analysis
Gentleman, R. C., Ding, B., Dudoit, S., & Ibrahim, J. G. (2005) · Springer eBooks · doi:10.1007/0-387-29362-0_12 · Cited by 26 · cited 1×
“[18].”
Feature Selection Methods for Multiphase Reactors Data Classification
Tarca, L. A., Grandjean, B. P. A., & Larachi, F. (2005) · Industrial & Engineering Chemistry Research · doi:10.1021/ie049667a · Cited by 11 · cited 1×
“[16,26,27].”
Class Prediction with Microarray Datasets
Rogers, S., Williams, R. D., & Campbell, C. (2006) · Springer eBooks · doi:10.1007/10950913_6 · Cited by 9 · cited 1×
“[16,26,27].”
Machine Learning Concepts and Tools for Statistical Genomics
Carey, V. J. (2005) · Springer eBooks · doi:10.1007/0-387-29362-0_16 · Cited by 6 · cited 1×
“More details on machine learning applications with R can be found in the literature [38].”
BackgroundSelf-citation
Cited by
Saito, T., & Rehmsmeier, M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0118432 · Cited by 5,309
ilastik: interactive machine learning for (bio)image analysis
Berg, S., Kutra, D., Kroeger, T., Straehle, C. N., Kausler, B. X., Haubold, C., Schiegg, M., Ales, J., Beier, T., Rudy, M., et al. (2019) · Nature Methods · doi:10.1038/s41592-019-0582-9 · Cited by 3,368
State-of-the-art in artificial neural network applications: A survey
Abiodun, O. I., Jantan, A., Omolara, A. E., Dada, K. V., Mohamed, N. A., & Arshad, H. (2018) · Heliyon · doi:10.1016/j.heliyon.2018.e00938 · Cited by 3,054
A guide to machine learning for biologists
Greener, J. G., Kandathil, S. M., Moffat, L., & Jones, D. T. (2022) · Nature Reviews Molecular Cell Biology · doi:10.1038/s41580-021-00407-0 · Cited by 2,127
Applications of Support Vector Machine (SVM) Learning in Cancer Genomics
(2018) · Cancer Genomics & Proteomics · doi:10.21873/cgp.20063 · Cited by 1,528
Metadata
- Authors
- Tarca, A. L., Carey, V. J., Chen, X.-W., Romero, R., & Drăghici, S.
- Affiliations
- United States Department of Health and Human Services (US)
- Corresponding author
- Drăghici, Sorin
- Venue
- PLoS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2007-06-29
- Volume
- 3
- Issue
- 6
- Pages
- e116
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC1904382
- OpenAlex
- W2137219016
- Cited by
- 656
- References
- 46
- Citations by year
- 2026: 29 · 2025: 45 · 2024: 64 · 2023: 71 · 2022: 46 · 2021: 56 · 2020: 55 · 2019: 56 · 2018: 41 · 2017: 40 · 2016: 35 · 2015: 22 · 2014: 20 · 2013: 17 · 2012: 15
- FWCI
- 0.71
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Computational Biology (publishedVersion, public-domain)
- PubMed Central (publishedVersion, public-domain)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- KU ScholarWorks (University of Kansas) (submittedVersion, public-domain)
- Funders
- National Science Foundation (0644366, 0438970, 0234806)
- National Institutes of Health (CA022453, RR17708)
- National Human Genome Research Institute (R01HG003491, P41HG004059)
- National Cancer Institute (R21CA100740, U01CA117478, P30CA022453)
- National Institute of Neurological Disorders and Stroke (R01NS045207)
- National Institute of Biomedical Imaging and Bioengineering (R21EB000990)
- National Institute of Child Health and Human Development
- National Center for Research Resources (P20RR017708, RR17708)
- Division of Biological Infrastructure
- NHLBI Division of Intramural Research
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Applications
- Keywords
- machine learning, biological data analysis, supervised learning, unsupervised learning, pattern recognition, classification, prediction, perceptron, artificial neural networks, adaptive resonance theory, neocognitron, history of machine learning, R programming language
- MeSH terms
- Algorithms, Artificial Intelligence, Biology, Computer Simulation, Models, Biological, Pattern Recognition, Automated, Cluster Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.