The DOI matches its Crossref record, with a small difference in title or year; 29 of the 29 references it cites were found in a registry or an index.
Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
Abstract
There are two cultures in the use of statistical modeling to reach conclusions from data. One assumes that the data are generated by a given stochastic data model. The other uses algorithmic models and treats the data mechanism as unknown. The statistical community has been committed to the almost exclusive use of data models. This commitment has led to irrelevant theory, questionable conclusions, and has kept statisticians from working on a large range of interesting current problems. Algorithmic modeling, both in theory and practice, has developed rapidly in fields outside statistics. It can be used both on large complex data sets and as a more accurate and informative alternative to data modeling on smaller data sets. If our goal as a field is to use data to solve problems, then we need to move away from exclusive dependence on data models and adopt a more diverse set of tools.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This is an instantiation of a phenomenon known as the Rashomon effect [20], namely that very different models can obtain a similar predictive accuracy and that small changes in a dataset may often lead to significant changes in a learned symbolic model.”
From An Empirical Comparison of Interpretable Models to Post-Hoc Explanations (2023) · cites this paper as [20]
In the citing paper
“This is an instantiation of a phenomenon known as the Rashomon effect [20], namely that very different models can obtain a similar predictive accuracy and that small changes in a dataset may often lead to significant changes in a learned symbolic model.”
From An Empirical Comparison of Interpretable Models to Post-Hoc Explanations (2023) · cites this paper as [20]
In the citing paper
“However, these techniques do not generally supply explanatory power . In other words, they are 'black boxes' which ingest data to produce predictive outputs. 26”
From Machine learning for large‐scale wearable sensor data in Parkinson's disease: Concepts, promises, pitfalls, and futures (2016) · cites this paper as [26]
In the citing paper
“This is despite the fact that the LR models were not trained to optimize predictive accuracy: they were conceived as explanatory models to understand past conflicts instead of predicting future ones.47,81,82”
From Leakage and the reproducibility crisis in machine-learning-based science (2023) · cites this paper as [82]
In the citing paper
“However, accuracy suffers as a result of this intrinsic interpretability [128].”
From Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence (2024) · cites this paper as [128]
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Self-citationThe Nature of Statistical Learning Theory
Vapnik, V. N. (1995) · doi:10.1007/978-1-4757-2440-0 · Cited by 39,138
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Breiman, L. (1996) · Machine Learning · doi:10.1007/bf00058655 · Cited by 16,325
Self-citationAn Introduction to Support Vector Machines and Other Kernel-based Learning Methods
Cristianini, N., & Shawe-Taylor, J. (2000) · doi:10.1017/cbo9780511801389 · Cited by 13,855
Classification And Regression Trees
Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (2017) · doi:10.1201/9781315139470 · Cited by 11,417
Self-citationCross validatory choice and assessment of statistical predictions
Stone, M. (1974) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1974.tb00994.x · Cited by 10,881
Friedman, J., Hastie, T., & Tibshirani, R. (2000) · The Annals of Statistics · doi:10.1214/aos/1016218223 · Cited by 6,884
The random subspace method for constructing decision forests
Ho, T. K. (1998) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.709601 · Cited by 6,842
Spline Models for Observational Data
Wahba, G. (1990) · doi:10.1137/1.9781611970128 · Cited by 4,184
Machine Learning, Neural and Statistical Classification
Fulkerson, B. (1995) · Technometrics · doi:10.1080/00401706.1995.10484383 · Cited by 2,209
Estimating Optimal Transformations for Multiple Regression and Correlation
Breiman, L., & Friedman, J. H. (1985) · Journal of the American Statistical Association · doi:10.1080/01621459.1985.10478157 · Cited by 1,710
Self-citationShape Quantization and Recognition with Randomized Trees
Amit, Y., & Geman, D. (1997) · Neural Computation · doi:10.1162/neco.1997.9.7.1545 · Cited by 1,275
Computer-Intensive Methods in Statistics
Diaconis, P., & Efron, B. (1983) · Scientific American · doi:10.1038/scientificamerican0583-116 · Cited by 1,144
Arcing classifier (with discussion and a rejoinder by the author)
Breiman, L. (1998) · The Annals of Statistics · doi:10.1214/aos/1024691079 · Cited by 1,105
Self-citationThe Role of Occam's Razor in Knowledge Discovery
Domingos, P. (1999) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009868929893 · Cited by 459
Estimating Optimal Transformations for Multiple Regression and Correlation
Breiman, L., & Friedman, J. H. (1985) · Journal of the American Statistical Association · doi:10.2307/2288473 · Cited by 452
Self-citationAs Others See Us: A Case Study in Path Analysis
Freedman, D. A. (1987) · Journal of Educational Statistics · doi:10.2307/1164888 · Cited by 372
Computer-Oriented Approaches to Pattern Recognition
(1972) · Mathematics in Science and Engineering · doi:10.1016/s0076-5392(08)x6008-4 · Cited by 360
Statistical models and shoe leather
Freedman, D. A. (1991) · Sociological Methodology · doi:10.2307/270939 · Cited by 333
Graphical Methods for Assessing Logistic Regression Models
Landwehr, J. M., Pregibon, D., & Shoemaker, A. C. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10477062 · Cited by 238
From Association to Causation via Regression
Freedman, D. (1997) · Advances in Applied Mathematics · doi:10.1006/aama.1996.0501 · Cited by 173
Tailor-made tests for goodness of fit to semiparametric hypotheses
Bickel, P. J., Ritov, Y., & Stoker, T. M. (2006) · The Annals of Statistics · doi:10.1214/009053606000000137 · Cited by 88
Occam's two razors: the sharp and the blunt
Domingos, P. (1998) · Cited by 82
Some issues in the foundation of statistics
Freedman, D. A. (1995) · Foundations of Science · doi:10.1007/bf00208723 · Cited by 81
Logicist statistics. I. Models and modeling
Dempster, A. P. (1998) · Statistical Science · doi:10.1214/ss/1028905887 · Cited by 26
A Combined Structural and Flexible Functional Approach for Modeling Energy Substitution
Mountain, D. C., & Hsiao, C. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478740 · Cited by 21
(1998)
(1996)
Research works printed but not linked: 5
- Gifi, A. (1990). Nonlinear Multivariate Analy sis. Wiley, New York.
- Arena, C., Sussman, N., Chiang, K., Mazumdar, S., Macina, O. and Li, W. (2000). Bagging Structure-Activity Relationships: A simulation study for assessing misclassification rates. Presented at the Second Indo-U.S. Workshop on Mathematical Chemistry, Duluth, MI. (Available at NSussman@server.ceoh.pitt.edu).
- Cristianini, N. and Shawe-Tay lor, J. (2000). An Introduction to Support Vector Machines. Cambridge Univ. Press.
- Daniel, C. and Wood, F. (1971). Fitting equations to data. Wiley, New York.
- Mosteller, F. and Tukey, J. (1977). Data Analy sis and Regression. Addison-Wesley, Redding, MA.
Cited by
Multimodel Inference: Understanding AIC and BIC in Model Selection
Burnham, K. P., & Anderson, D. R. (2004) · Sociological Methods & Research · doi:10.1177/0049124104268644 · Cited by 11,648
“…that has evaluated, or even considered, model averaged inferences compared to the best model strategy that model averaging is superior (e.g., Buckland et al. 1997; Hoeting et al. 1999; Wasserman 2000; Breiman 2001; Burnham and Anderson 2002; Hansen and Kooperberg 2002; Lukacs et al. in review).”
ResultEfron, B., Hastie, T., Johnstone, I., & Tibshirani, R. (2004) · The Annals of Statistics · doi:10.1214/009053604000000067 · Cited by 9,357
A working guide to boosted regression trees
Elith, J., Leathwick, J. R., & Hastie, T. (2008) · Journal of Animal Ecology · doi:10.1111/j.1365-2656.2008.01390.x · Cited by 6,484
“By contrast, ML avoids starting with a data model and rather uses an algorithm to learn the relationship between the response and its predictors (Breiman 2001).”
MethodPeeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
“They present the mathematical problems in interpretable ML so-called ‘‘the multiplicity of good models’’ [60].”
BackgroundMancia, G., Kreutz, R., Brunström, M., Burnier, M., Grassi, G., Januszewicz, A., Muiesan, M. L., Tsioufis, K., Agabiti-Rosei, E., Algharably, E. A. E., et al. (2023) · Journal of Hypertension · doi:10.1097/hjh.0000000000003480 · Cited by 3,473
Metadata
- Authors
- Breiman, L.
- Corresponding author
- Breiman, Leo
- Venue
- Statistical Science
- Publisher
- Institute of Mathematical Statistics
- Published
- 2001-08-01
- Volume
- 16
- Issue
- 3
- Pages
- 199-231
- ISSN
- 0883-4237 (ISSN-L)
- 2168-8745
- OpenAlex
- W2084341220
- Cited by
- 4,340
- References
- 27
- Citations by year
- 2026: 349 · 2025: 362 · 2024: 353 · 2023: 350 · 2022: 386 · 2021: 466 · 2020: 393 · 2019: 297 · 2018: 250 · 2017: 183 · 2016: 146 · 2015: 147 · 2014: 98 · 2013: 85 · 2012: 89
- FWCI
- 25.70
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Statistical Science (publishedVersion)
- Project Euclid (Cornell University) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- statistical modeling, data model, algorithmic models, statistical inference
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.