A few useful things to know about machine learning
The DOI matches its Crossref record; 29 of the 30 references it cites were found in a registry or an index.
Abstract
Tapping into the "folk knowledge" needed to advance machine learning applications.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“However, while effective for certain applications, feature engineering often lacks a formal statistical foundation, particularly in domains involving rare events or extreme values.”
From Advancing Heatwave Forecasting via Distribution Informed-Graph Neural Networks (DI-GNNs): Integrating Extreme Value Theory with GNNs (2024) · cites this paper as [37]
In the citing paper
“Indeed, the openendedness that characterizes such forms of translation work is often described as the 'art' of data mining [12].”
From Problem Formulation and Fairness (2019) · cites this paper as [12]
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482 · cited 1×
“A better approach is to control the fraction of falsely accepted non-null hypotheses, known as the false discovery rate [3].”
BackgroundThe Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
Data Mining: Practical Machine Learning Tools and Techniques
(2011) · Elsevier eBooks · doi:10.1016/c2009-0-19715-5 · Cited by 25,437
(1992) · Cited by 23,431
A Global Geometric Framework for Nonlinear Dimensionality Reduction
Tenenbaum, J. B., Silva, V. D., & Langford, J. C. (2000) · Science · doi:10.1126/science.290.5500.2319 · Cited by 13,585
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Proceedings of the 24th international conference on Machine learning
(2007) · doi:10.1145/1273496 · Cited by 11,630
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239 · cited 1×
“Finding methods to learn these deeper representations is one of the major research frontiers in machine learning [2].”
MethodWitten, I. H. (2008) · Cited by 9,143
(2011) · Cited by 5,203
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
CAUSALITY: MODELS, REASONING AND INFERENCE
Hitchcock, C. (2001) · The Philosophical Review · doi:10.1215/00318108-110-4-639 · Cited by 4,741
On the Optimality of the Simple Bayesian Classifier under Zero-One Loss
Domingos, P., & Pazzani, M. (1997) · Machine Learning · doi:10.1023/a:1007413511361 · Cited by 3,101
Self-citationCausality: models, reasoning, and inference
(2000) · Choice Reviews Online · doi:10.5860/choice.38-1494a · Cited by 2,873
Richardson, M., & Domingos, P. (2006) · Machine Learning · doi:10.1007/s10994-006-5833-1 · Cited by 2,676 · cited 1×
“, using first-order logic [21] or grammars [6]).”
MethodSelf-citationAn Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants
Bauer, E., & Kohavi, R. (1999) · Machine Learning · doi:10.1023/a:1007515423169 · Cited by 2,638
Bernardo, J. M., & Smith, A. F. M. (1994) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316870 · Cited by 2,178
The Lack of A Priori Distinctions Between Learning Algorithms
Wolpert, D. H. (1996) · Neural Computation · doi:10.1162/neco.1996.8.7.1341 · Cited by 1,647
Blumer, A., Ehrenfeucht, A., Haussler, D., & Warmuth, M. K. (1987) · Information Processing Letters · doi:10.1016/0020-0190(87)90114-1 · Cited by 1,054
Klockars, A., & Sax, G. (1986) · Sage eBooks · doi:10.4135/9781412985185 · Cited by 1,013
Controlled experiments on the web: survey and practical guide
Kohavi, R., Longbotham, R., Sommerfield, D., & Henne, R. M. (2009) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-008-0114-1 · Cited by 690 · cited 1×
“Second, if you can obtain experimental data (for example by randomly assigning visitors to different versions of a Web site), then by all means do so [14].”
The Role of Occam's Razor in Knowledge Discovery
Domingos, P. (1999) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009868929893 · Cited by 459 · cited 1×
“Domingos [7] surveys the main arguments and evidence on the issue of Occam’s razor in machine learning.”
BackgroundSelf-citationPreventing Overfitting of Cross-Validation Data
Ng, A. Y. (1997) · International Conference on Machine Learning · Cited by 187
Machine learning as an experimental science
Langley, P. (1988) · Machine Learning · doi:10.1007/bf00115008 · Cited by 187 · cited 1×
“So machine learning projects often wind up having a significant component of learner design, and practitioners need to have some expertise in it [12].”
BackgroundA Unifeid Bias-Variance Decomposition and its Applications
Domingos, P. (2000) · International Conference on Machine Learning · Cited by 167
Self-citationBayesian Averaging of Classifiers and the Overfitting Problem
Domingos, P. (2000) · Cited by 146
Self-citationON THE CONNECTION BETWEEN THE COMPLEXITY AND CREDIBILITY OF INFERRED MODELS
PEARL, J. (1978) · International Journal of General Systems · doi:10.1080/03081077808960690 · Cited by 93 · cited 2×
“As Pearl 18 points out, the size of the hypothesis space is only a rough guide to what really matters for relating training and test error: the procedure by which a hypothesis is chosen.”
BackgroundCohen, W. W. (1994) · Artificial Intelligence · doi:10.1016/0004-3702(94)90070-1 · Cited by 92 · cited 1×
“, using first-order logic [21] or grammars [6]).”
MethodMining complex models from arbitrarily large databases in constant time
Hulten, G., & Domingos, P. (2002) · Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/775047.775124 · Cited by 65 · cited 2×
“Part of the answer is to come up with fast ways to learn complex classifiers, and indeed there has been remarkable progress in this direction (for example, Hulten and Domingos 11 ).”
BackgroundSelf-citation
Research works printed but not linked: 2
- 10.5555/541177 · doi:10.5555/541177
- 10.5555/211359 · doi:10.5555/211359
Cited by
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567
“A machine learning algorithm applied to classification tasks, for example, typically consists of two components, a learner which produces a classifier , with the intention to develop classes that can generalise beyond the training data (Domingos, 2012).”
How the machine “thinks”: Understanding opacity in machine learning algorithms
Burrell, J. (2016) · Big Data & Society · doi:10.1177/2053951715622512 · Cited by 3,196
“In an article on the folk knowledge of applying machine learning , Domingos (2012) notes that ‘intu-ition fails at high-dimensions.’”
BackgroundAutomatic Chemical Design Using a Data-Driven Continuous Representation of Molecules
Gómez-Bombarelli, R., Wei, J. N., Duvenaud, D., Hernández-Lobato, J. M., Sánchez-Lengeling, B., Sheberla, D., Aguilera-Iparraguirre, J., Hirzel, T. D., Adams, R. P., & Aspuru-Guzik, A. (2018) · ACS Central Science · doi:10.1021/acscentsci.7b00572 · Cited by 3,106
“34 Interpolating linearly between two points might pass by an area of low probability, to keep the sampling on the areas of high probability we utilize spherical interpolation 35 ( slerp ).”
Deep learning applications and challenges in big data analytics
Najafabadi, M. M., Villanustre, F., Khoshgoftaar, T. M., Seliya, N., Wald, R., & Muharemagic, E. (2015) · Journal of Big Data · doi:10.1186/s40537-014-0007-7 · Cited by 2,594
“Thus, feature engineering, which focuses on constructing features and data representations from raw data [1], is an important element of machine learning.”
BackgroundChoosing Prediction Over Explanation in Psychology: Lessons From Machine Learning
Yarkoni, T., & Westfall, J. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617693393 · Cited by 1,916
“…a full treatment of these issues is beyond the scope of this paper (for excellent full-length introductions, see Browne, 2000; Bunea et al., 2011; Domingos, 2012; McNeish, 2015; an authoritative, freely available textbook is Hastie, Tibshirani, & Friedman, 2009), even a cursory familiarity with…”
BackgroundInfluential
Metadata
- Authors
- Domingos, P.
- Affiliations
- University of Washington (US)
- Corresponding author
- Domingos, Pedro
- ORCID
- Domingos, Pedro
- Venue
- Communications of the ACM
- Published
- 2012-10
- Volume
- 55
- Issue
- 10
- Pages
- 78-87
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2161336914
- Cited by
- 3,326
- References
- 30
- Citations by year
- 2026: 238 · 2025: 351 · 2024: 303 · 2023: 257 · 2022: 283 · 2021: 303 · 2020: 387 · 2019: 315 · 2018: 262 · 2017: 243 · 2016: 150 · 2015: 106 · 2014: 81 · 2013: 44 · 2012: 2
- FWCI
- 73.39
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Communications of the ACM (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Algorithms
- Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification
- Keywords
- machine learning, folk knowledge
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.