Data Mining: Statistics and More?
Abstract
Data mining is a new discipline lying at the interface of statistics, database technology, pattern recognition, machine learning, and other areas. It is concerned with the secondary analysis of large databases in order to find previously unsuspected relationships which are of interest or value to the database owners. New problems arise, partly as a consequence of the sheer size of the data sets involved, and partly because of issues of pattern matching. However, since statistics provides the intellectual glue underlying the effort, it is important for statisticians to become involved. There are very real opportunities for statisticians to make significant contributions.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
During data analysis, researchers must make many choices among statistical tests, inferential modes, evaluation criteria, and data-mining techniques.
“Second, during the data-analysis stage researchers must makenumerous choices among different statistical tests, inferential modes and practices, statistical evaluation criteria (e.g.,Bayesian versus frequentist inference, significance levels or p-values), as well as whether to use existing and emerging techniques developed by computer scientists for mining data (Hand 1998).”
From Data-Intensive Science and Research Integrity (2017) · cites this paper as Hand 1998
Cites
Journal of the Royal Statistical Society.
(1923) · The Economic Journal · doi:10.1093/ej/33.130.269 · Cited by 3,289 · see citing works
Advances in knowledge discovery and data mining
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90007-3 · Cited by 2,996 · see citing works
Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals
Gray, J., Chaudhuri, S., Bosworth, A., et al. (1996) · Proceedings of the Twelfth International Conference on Data Engineering · doi:10.1023/a:1009726021843 · Cited by 2,347 · see citing works
From data mining to knowledge discovery: an overview
Fayyad, U. M., Piatetsky-Shapiro, G., & Smyth, P. (1996) · Knowledge Discovery and Data Mining · Cited by 2,319 · see citing works
Knowledge discovery in databases
FrawleyWilliam, J., Piatetsky-ShapiroGregory, & MatheusChristopher, J. (1992) · AI Magazine · doi:10.5555/140629.140633 · Cited by 1,058 · see citing works
Encyclopedia of Biostatistics.
Kemp, C. D., Armitage, P., & Coulton, T. (1998) · Biometrics · doi:10.2307/2533871 · Cited by 674 · see citing works
Bayesian Networks for Data Mining
Heckerman, D. E. (1997) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009730122752 · Cited by 631 · see citing works
Construction and Assessment of Classification Rules
Wade, M. R., & Hand, D. J. (1999) · Technometrics · doi:10.2307/1270579 · Cited by 621 · see citing works
Self-citationArtificial Intelligence and Statistics
Ziegel, E. R. (1989) · Technometrics · doi:10.1080/00401706.1989.10488504 · Cited by 491 · see citing works
Construction and Assessment of Classification Rules.
Ringrose, T. J., & Hand, D. J. (1997) · Biometrics · doi:10.2307/2533581 · Cited by 490 · see citing works
Self-citationA database perspective on knowledge discovery
Imieliński, T., & Mannila, H. (1996) · Communications of the ACM · doi:10.1145/240455.240472 · Cited by 471 · see citing works
Explora: a multipattern and multistrategy discovery assistant
Klösgen, W. (1996) · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · Cited by 439 · see citing works
Inference for Non-random Samples
Copas, J. B., & Li, H. G. (1997) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/1467-9868.00055 · Cited by 398 · see citing works
A probabilistic approach to fast pattern matching in time series databases
Keogh, E., & Smyth, P. (1997) · Knowledge Discovery and Data Mining · Cited by 256 · see citing works
Role of Models in Statistical Analysis
Cox, D. R. (1990) · Statistical Science · doi:10.1214/ss/1177012165 · Cited by 181 · see citing works
The Experimental Study of Physical Mechanisms
Box, G. E. P., & Hunter, W. G. (1965) · Technometrics · doi:10.1080/00401706.1965.10490223 · Cited by 145 · see citing works
Advanced Scout: Data Mining and Knowledge Discovery in NBA Data
Bhandari, I., Colet, E., Parker, J., et al. (1997) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009782106822 · Cited by 141 · see citing works
Automating the analysis and cataloging of sky surveys
Fayyad, U. M., Djorgovski, S. G., & Weir, N. (1996) · Knowledge Discovery and Data Mining · Cited by 138 · see citing works
Statistics and the Scientific Method
Freedman, D. A. (1985) · Springer eBooks · doi:10.1007/978-1-4613-8536-3_11 · Cited by 84 · see citing works
A Support System for Interpreting Statistical Data.
Hoschka, P., & Klösgen, W. (1991) · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · Cited by 61 · see citing works
From data mining to knowledge discovery: current challenges and future directions
Uthurusamy, R. (1996) · Knowledge Discovery and Data Mining · Cited by 36 · see citing works
Fayyad, U. M. (1997) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009715820935 · Cited by 34 · see citing works
Selfridge, P. G., Srivastava, D., & Wilson, L. O. (1996) · Proceedings - ACM-SIGMOD International Conference on Management of Data · doi:10.1145/233269.233315 · Cited by 29 · see citing works
A Handbook of Small Data Sets.
Chatfield, C., Hand, D. J., Daly, F., et al. (1995) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.2307/2983307 · Cited by 26 · see citing works
Self-citationHandbook of Statistics 9: Computational Statistics
Weisberg, S., & Rao, C. R. (1994) · Technometrics · doi:10.2307/1269391 · Cited by 7 · see citing works
Selfridge, P. G., Srivastava, D., & Wilson, L. O. (1996) · ACM SIGMOD Record · doi:10.1145/235968.233315 · Cited by 6 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
A Reality Check for Data Snooping
White, H. (2000) · Econometrica · doi:10.1111/1468-0262.00152 · Cited by 1,851 · see citing works
Machine learning methods for solar radiation forecasting: A review
Voyant, C., Notton, G., Kalogirou, S., Nivet, M.-L., Paoli, C., Motte, F., & Fouilloy, A. (2017) · Renewable Energy · doi:10.1016/j.renene.2016.12.095 · Cited by 1,836 · see citing works
Predictive data mining in clinical medicine: Current issues and guidelines
BELLAZZI, R., & ZUPAN, B. (2008) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2006.11.006 · Cited by 823 · see citing works
Aldowah, H., Al-Samarraie, H., & Fauzy, W. M. (2019) · Telematics and Informatics · doi:10.1016/j.tele.2019.01.007 · Cited by 564 · see citing works
Forecasting and operational research: a review
Fildes, R., Nikolopoulos, K., Crone, S. F., & Syntetos, A. A. (2008) · Journal of the Operational Research Society · doi:10.1057/palgrave.jors.2602597 · Cited by 287 · see citing works
Grounding Interactive Machine Learning Tool Design in How Non-Experts Actually Build Models
Yang, Q., Suh, J., Chen, N.-C., & Ramos, G. (2018) · Proceedings of the 2018 Designing Interactive Systems Conference · doi:10.1145/3196709.3196729 · Cited by 156 · see citing works
Deep-learning-based risk stratification for mortality of patients with acute myocardial infarction
Kwon, J.-M., Jeon, K.-H., Kim, H. M., Kim, M. J., Lim, S., Kim, K.-H., Song, P. S., Park, J., Choi, R. K., & Oh, B.-H. (2019) · PLOS ONE · doi:10.1371/journal.pone.0224502 · Cited by 86 · see citing works
Data-Intensive Science and Research Integrity
Resnik, D. B., Elliott, K. C., Soranno, P. A., & Smith, E. M. (2017) · Accountability in Research · doi:10.1080/08989621.2017.1327813 · Cited by 38 · see citing works
“…different statistical tests, inferential modes and practices, statistical evaluation criteria (e.g., Bayesian versus frequentist inference, significance levels or p-values), as well as whether to use existing and emerging techniques developed by computer scientists for mining data (Hand 1998).”
MethodPractical versus moral identities in identity management
Manders-Huits, N. (2010) · Ethics and Information Technology · doi:10.1007/s10676-010-9216-8 · Cited by 31 · see citing works
- Authors
- Hand, D. J.
- Affiliations
- The Open University (GB)
- Corresponding author
- Hand, David J.
- ORCID
- Hand, David J.
- Venue
- The American Statistician
- Publisher
- Informa UK Limited
- Published
- 1998-05
- Volume
- 52
- Issue
- 2
- Pages
- 112-118
- ISSN
- 0003-1305 (ISSN-L)
- 1537-2731
- OpenAlex
- W2152064955
- Cited by
- 380
- References
- 26
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 5 · 2023: 13 · 2022: 17 · 2021: 15 · 2020: 10 · 2019: 13 · 2018: 17 · 2017: 10 · 2016: 13 · 2015: 15 · 2014: 23 · 2013: 9 · 2012: 12
- FWCI
- 53.40
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The American Statistician (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Information Systems › Data Mining Algorithms and Applications
- Physical Sciences › Computer Science › Information Systems › Data Mining and Machine Learning Applications
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- data mining, pattern recognition, machine learning, database technology, pattern matching, role of statisticians, large data sets
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
