The DOI matches its Crossref record; 276 of the 276 references it cites were found in a registry or an index.
Mathematics for Machine Learning
Abstract
The fundamental mathematical tools needed to understand machine learning include linear algebra, analytic geometry, matrix decompositions, vector calculus, optimization, probability and statistics. These topics are traditionally taught in disparate courses, making it hard for data science or computer science students, or professionals, to efficiently learn the mathematics. This self-contained textbook bridges the gap between mathematical and machine learning texts, introducing the mathematical concepts with a minimum of prerequisites. It uses these concepts to derive four central machine learning methods: linear regression, principal component analysis, Gaussian mixture models and support vector machines. For students and others with a mathematical background, these derivations provide a starting point to machine learning texts. For those learning the mathematics for the first time, the methods help build intuition and practical experience with applying mathematical concepts. Every chapter includes worked examples and exercises to test understanding. Programming tutorials are offered on the book's web site.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Items 201–276 of 276
Information and Exponential Families in Statistical Theory
Mathai, A. M. (1980) · Technometrics · doi:10.1080/00401706.1980.10486149 · Cited by 498
Multivariate Statistics: A Vector Space Approach.
Gleser, L. J., & Eaton, M. L. (1985) · Journal of the American Statistical Association · doi:10.2307/2288585 · Cited by 474
Axler, S. (2015) · Undergraduate Texts in Mathematics · doi:10.1007/978-3-319-11080-6 · Cited by 444
(2010) · Cited by 444
Information and Exponential Families: In Statistical Theory
Barndorff-Nielsen, O. E. (2014) · Wiley series in probability and statistics · doi:10.1002/9781118857281 · Cited by 434
A User's Guide to Measure Theoretic Probability
Pollard, D. (2001) · Cambridge University Press eBooks · doi:10.1017/cbo9780511811555 · Cited by 422
Çinlar, E. (2011) · Graduate Texts in Mathematics · doi:10.1007/978-0-387-87859-1 · Cited by 421
Bayesian Gaussian Process Latent Variable Model
Titsias, M. K., & Lawrence, N. D. (2010) · International Conference on Artificial Intelligence and Statistics · Cited by 378
Elements of causal inference: foundations and learning algorithms
Shanmugam, R. (2018) · Journal of Statistical Computation and Simulation · doi:10.1080/00949655.2018.1505197 · Cited by 378
Binary coding of speech spectrograms using a deep auto-encoder
Deng, L., Seltzer, M. L., Yu, D., Acero, A., Mohamed, A.-R., & Hinton, G. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-487 · Cited by 375
de Tejada, J. G. S., & Martìnez-Echevarrìa, J. S. (2007) · Computational Intelligence · doi:10.1007/0-387-37452-3_7 · Cited by 364
Introduction to Linear Algebra
Lesk, A. M. (2004) · Introduction to Symmetry and Group Theory for Chemists · doi:10.1007/1-4020-2151-8_5 · Cited by 361
Linear Dimensionality Reduction: Survey, Insights, and Generalizations
Cunningham, J. P., & Ghahramani, Z. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.0873 · Cited by 357
Sous-espaces hilbertiens d’espaces vectoriels topologiques et noyaux associés (Noyaux reproduisants)
Schwartz, L. (1964) · Journal d'Analyse Mathématique · doi:10.1007/bf02786620 · Cited by 344
Duality and Geometry in SVM Classifiers
Bennett, K. P., & Bredensteiner, E. J. (2000) · Cited by 342
O'Hagan, A. (1991) · Journal of Statistical Planning and Inference · doi:10.1016/0378-3758(91)90002-v · Cited by 342
Learning an Embedding Space for Transferable Robot Skills
Hausman, K., Springenberg, J. T., Wang, Z., Heess, N., & Riedmiller, M. (2018) · International Conference on Learning Representations · Cited by 341
Bayes Factors and Choice Criteria for Linear Models
Smith, A. F. M., & Spiegelhalter, D. J. (1980) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1980.tb01122.x · Cited by 333
Pardalos, P. M. (2010) · Optimization Methods and Software · doi:10.1080/10556781003625177 · Cited by 328
LIBLINEAR: A Library for Large Linear Classification
FanRong-En, ChangKai-Wei, HsiehCho-Jui, WangXiang-Rui, & LinChih-Jen (2008) · Journal of Machine Learning Research · doi:10.5555/1390681.1442794 · Cited by 328
Linear Dimensionality Reduction: Survey, Insights, and Generalizations
Cunningham, J., Ghahramani, Z., et al. (2015) · Cambridge University Engineering Department Publications Database · Cited by 326
Neural networks and machine learning
Bishop, C. (1998) · Springer eBooks · Cited by 316
Probabilistic Graphical Models
Koller, D., & Friedman, N. (2009) · Cited by 306
Handbook of the History of Logic
(2009) · Handbook of the history of logic · doi:10.1016/s1874-5857(09)70548-5 · Cited by 292
Wasserman, L. (2021) · Cited by 282
Introduction to Applied Linear Algebra: Vectors, Matrices, and Least Squares
Boyd, S., & Vandenberghe, L. (2018) · doi:10.1017/9781108583664 · Cited by 280
Dimension Reduction: A Guided Tour
Burges, C. J. C. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000002 · Cited by 271
Probability and Inductive Logic
Kyburg, H. E. (1970) · Medical Entomology and Zoology · Cited by 265
A review of optimization methodologies in support vector machines
Shawe-Taylor, J., & Sun, S. (2011) · Neurocomputing · doi:10.1016/j.neucom.2011.06.026 · Cited by 256
Raschka, S., & Mirjalili, V. (2017) · Cited by 255
Theory of reproducing kernels and its applications
齋藤, 三. (1988) · Longman Scientific & Technical , Wiley eBooks · Cited by 251
Random Number Generation and Monte Carlo Methods
(2003) · Statistics and Computing · doi:10.1007/b97336 · Cited by 250
Learning with non-positive kernels
Ong, C. S., Mary, X., Canu, S., & Smola, A. J. (2004) · International Conference on Machine Learning · doi:10.1145/1015330.1015443 · Cited by 237
Self-citationLearning Nonlinear Dynamical Systems Using an EM Algorithm
Ghahramani, Z., & Roweis, S. T. (1998) · Cited by 232
Ghahramani, Z., & Rasmussen, C. E. (2002) · neural information processing systems · Cited by 227
Bishop, C. (1998) · neural information processing systems · Cited by 224
How to Compare Different Loss Functions and Their Risks
Steinwart, I. (2007) · Constructive Approximation · doi:10.1007/s00365-006-0662-3 · Cited by 220
Linear Algebra and Matrix Analysis for Statistics
Banerjee, S., & Roy, A. (2014) · Chapman & Hall/CRC eBooks · doi:10.1201/b17040 · Cited by 218
Making sense of the Legendre transform
Zia, R. K. P., Redish, E. F., & McKay, S. R. (2009) · American Journal of Physics · doi:10.1119/1.3119512 · Cited by 213
A First Course in Machine Learning
Rogers, S., & Girolami, M. (2016) · Chapman & Hall/CRC eBooks · doi:10.1201/9781315382159 · Cited by 206
Data-Efficient Reinforcement Learning with Probabilistic Model Predictive ControlPreprint
Kamthe, S., & Deisenroth, M. P. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1706.06491 · Cited by 199
Self-citationHash Kernels for Structured Data
Shi, Q., PettersonJames, Dror, G., Langford, J. C., & Smola, A. J. (2009) · ANU Open Research (Australian National University) · doi:10.5555/1577069.1755873 · Cited by 194
Goh, G. (2017) · Distill · doi:10.23915/distill.00006 · Cited by 194
Statistical Learning Theory: Models, Concepts, and Results
Luxburg, U. V., & Schölkopf, B. (2011) · Handbook of the History of Logic · doi:10.1016/b978-0-444-52936-7.50016-1 · Cited by 189
Computing with Infinite Networks
Williams, C. K. I. (1996) · Aston Publications Explorer (Aston University) · Cited by 187
Neuts, M., Grimmett, G., & Welsh, D. (1988) · Journal of the American Statistical Association · doi:10.2307/2289326 · Cited by 185
Hilbert space embeddings and metrics on probability measures
Sriperumbudur, B. K., Gretton, A., Fukumizu, K., Schölkopf, B., & Lanckriet, G. R. G. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0907.5309 · Cited by 183
Information, Divergence and Risk for Binary ExperimentsPreprint
Reid, M. D., & Williamson, R. C. (2009) · arXiv (Cornell University) · doi:10.48550/arxiv.0901.0356 · Cited by 179
The numerical solution of variational problems
Dreyfus, S. (1962) · Journal of Mathematical Analysis and Applications · doi:10.1016/0022-247x(62)90004-5 · Cited by 172
Rasmussen, C. E., & Ghahramani, Z. (2000) · neural information processing systems · Cited by 172
Observation and Experiment: An Introduction to Causal Inference
Rosenbaum, P. (2017) · doi:10.4159/9780674982697 · Cited by 170
Introduction to Automatic Differentiation
Griewank, A., & Walther, A. (2003) · PAMM · doi:10.1002/pamm.200310012 · Cited by 163
Spectral methods in machine learning and new strategies for very large datasets
Belabbas, M.-A., & Wolfe, P. J. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0810600105 · Cited by 158
Causal Inference in Statistics
Pearl, J., Glymour, M., & Jewell, N. P. (2016) · Cited by 137
A user's guide to measure theoretic probability
(2002) · Choice Reviews Online · doi:10.5860/choice.40-1597 · Cited by 137
Quantile tomography: Using quantiles with multivariate dataPreprint
Kong, L., & Mizera, I. (n.d.) · Cited by 135
Lan, K. (2012) · Cited by 133
Eaton, M. L. (2007) · SPIE eBooks · doi:10.1214/lnms/1196285102 · Cited by 125
Contextual classification of multispectral pixel data
Kittler, J., & Föglein, J. (1984) · Image and Vision Computing · doi:10.1016/0262-8856(84)90040-4 · Cited by 121
Meta Reinforcement Learning with Latent Variable Gaussian Processes
Sæmundsson, S., Hofmann, K., & Deisenroth, M. P. (2018) · arXiv · doi:10.48550/arxiv.1803.07551 · Cited by 106
Self-citationLoosli, G., Canu, S., & Ong, C. S. (2015) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2015.2477830 · Cited by 99
Self-citationThe Ladder: A Reliable Leaderboard for Machine Learning Competitions
Blum, A., & Hardt, M. (2015) · arXiv · doi:10.48550/arxiv.1502.04585 · Cited by 92
Statistical Learning Theory: A Primer
Evgeniou, T., Pontil, M., & Poggio, T. (2000) · International Journal of Computer Vision · doi:10.1023/a:1008110632619 · Cited by 86
Chollet, F., & Allaire, J. (2018) · Cited by 83
Gaussian belief propagation solver for systems of linear equations
Shental, O., Siegel, P. H., Wolf, J. K., Bickson, D., & Dolev, D. (2008) · IEEE International Symposium on Information Theory (ISIT) · doi:10.1109/isit.2008.4595311 · Cited by 81
Gaussian belief propagation solver for systems of linear equations
Shental, O., Siegel, P. H., Wolf, J. K., Bickson, D., & Dolev, D. (2008) · Cited by 77
Value Regularization and Fenchel Duality
Rifkin, R. M., & Lippert, R. A. (2007) · doi:10.5555/1248659.1248676 · Cited by 75
A Robust-Equitable Measure for Feature Ranking and Selection
Ding, A. A., Dy, J., Li, Y., & Chang, Y. (2017) · Journal of Machine Learning Research · Cited by 69
A Primer on Reproducing Kernel Hilbert Spaces
Manton, J. H., & Amblard, P. (2015) · Foundations and Trends® in Signal Processing · doi:10.1561/2000000050 · Cited by 65
Deisenroth, M. P., & Ohlsson, H. (2011) · Proceedings of the ... American Control Conference/Proceedings of the American Control Conference · doi:10.1109/acc.2011.5990871 · Cited by 56
Self-citationElliott, C. M. (2009) · ACM SIGPLAN International Conference on Functional Programming (ICFP) · doi:10.1145/1596550.1596579 · Cited by 56
Advanced Structured Prediction
Nowozin, S. (2014) · The MIT Press eBooks · doi:10.7551/mitpress/9969.001.0001 · Cited by 54
Observation and Experiment: An Introduction to Causal Inference
Rosenbaum, P. R. (2017) · Cited by 42
Bayesian inference for latent variable models
Paquet, U. (2008) · CL Technical Reports · doi:10.48456/tr-724 · Cited by 29
The Legendre Transformation in Modern Optimization
Polyak, R. A. (2016) · Springer optimization and its applications · doi:10.1007/978-3-319-42056-1_15 · Cited by 20
Moustaki, I., Knott, M. J., & Bartholomew, D. J. (2015) · Wiley eBooks · doi:10.1002/9781118445112.stat02421.pub2 · Cited by 19
Cited by
Gradient Projection Memory for Continual Learning
Saha, G., Garg, I., & Roy, K. (2021) · arXiv · doi:10.48550/arxiv.2103.09762 · Cited by 129
Artificial Intelligence for Biology
Hassoun, S., Jefferson, F., Shi, X., Stucky, B., Wang, J., & Rosa, E. (2022) · Integrative and Comparative Biology · doi:10.1093/icb/icab188 · Cited by 64
Machine learning in the analysis of biomolecular simulations
Kaptan, S., & Vattulainen, I. (2022) · Advances in Physics: X · doi:10.1080/23746149.2021.2006080 · Cited by 31
Data Augmented Flatness-aware Gradient Projection for Continual Learning
Yang, E., Shen, L., Wang, Z., Liu, S., Guo, G., & Wang, X. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00518 · Cited by 18
Metadata
- Authors
- Deisenroth, M. P., Faisal, A. A., & Ong, C. S.
- Venue
- Cambridge University Press eBooks
- Publisher
- Cambridge University Press
- Published
- 2020-02-20
- OpenAlex
- W2974922583
- Cited by
- 573
- References
- 276
- FWCI
- 34.29
- Type
- book
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.