The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
CRISP-DM Twenty Years Later: From Data Mining Processes to Data Science Trajectories
Open accessAbstract
CRISP-DM(CRoss-Industry Standard Process for Data Mining) has its origins in the second half of the nineties and is thus about two decades old. According to many surveys and user polls it is still the de facto standard for developing data mining and knowledge discovery projects. However, undoubtedly the field has moved on considerably in twenty years, with data science now the leading term being favoured over data mining. In this paper we investigate whether, and in what contexts, CRISP-DM is still fit for purpose for data science projects. We argue that if the project is goal-directed and process-driven the process model view still largely holds. On the other hand, when data science projects become more exploratory the paths that the project can take become more varied, and a more flexible model is called for. We suggest what the outlines of such a trajectory-based model might look like and how it can be used to categorise data science projects (goal-directed, exploratory or data management). We examine seven real-life exemplars where exploratory activities play an important role and compare them against 51 use cases extracted from the NIST Big Data Public Working Group. We anticipate this categorisation can help project planning in terms of time and cost characteristics.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1994) · Cited by 21,711
Wu, X., Zhu, X., Wu, G.-Q., & Ding, W. (2014) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2013.109 · Cited by 2,410
Big Data, new epistemologies and paradigm shifts
Kitchin, R. (2014) · Big Data & Society · doi:10.1177/2053951714528481 · Cited by 2,355
The KDD process for extracting useful knowledge from volumes of data
Fayyad, U., Piatetsky-Shapiro, G., & Smyth, P. (1996) · Communications of the ACM · doi:10.1145/240455.240464 · Cited by 1,934
Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data
Karpatne, A., Atluri, G., Faghmous, J. H., Steinbach, M., Banerjee, A., Ganguly, A., Shekhar, S., Samatova, N., & Kumar, V. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2720168 · Cited by 1,752
Auto-WEKA: combined selection and hyperparameter optimization of classification algorithms
Thornton, C., Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2013) · Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2487575.2487629 · Cited by 1,359
A Linear Non-Gaussian Acyclic Model for Causal Discovery
Shimizu, S., Hoyer, P. O., Hyvärinen, A., & Kerminen, A. (2006) · Cited by 1,152
"The End of Theory: The Data Deluge Makes the Scientific Method Obsolete"
Willighagen, E. (2008) · doi:10.59350/j4d10-0jt05 · Cited by 1,064
Visual Analytics: Definition, Process, and Challenges
Keim, D., Andrienko, G., Fekete, J.-D., Görg, C., Kohlhammer, J., & Melançon, G. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-70956-5_7 · Cited by 1,063
The Book of Why: The New Science of Cause and Effect
Pearl, J., & Mackenzie, D. N. (2018) · Cited by 1,001
Dhar, V. (2013) · Communications of the ACM · doi:10.1145/2500499 · Cited by 856
An overview of business intelligence technology
Chaudhuri, S., Dayal, U., & Narasayya, V. (2011) · Communications of the ACM · doi:10.1145/1978542.1978562 · Cited by 760
The seven tools of causal inference, with reflections on machine learning
Pearl, J. (2019) · Communications of the ACM · doi:10.1145/3241036 · Cited by 659 · cited 1×
“Causal inference from data focuses on answering questions of the type “what if” and relies on methods that incorporate causal knowledge (such as the Structural Causal Models [46], the Potential Outcomes Framework [47] or the Linear non-Gaussian acyclic models [48]).”
MethodWorkflow Management—Models, Methods and Systems
Quaglini, S. (2003) · Artificial Intelligence in Medicine · doi:10.1016/s0933-3657(03)00011-3 · Cited by 543
A Second Chance to Get Causal Inference Right: A Classification of Data Science Tasks
Hernán, M. A., Hsu, J., & Healy, B. (2019) · CHANCE · doi:10.1080/09332480.2019.1579578 · Cited by 495 · cited 1×
“Hernan et al. [49] discuss how data science can tackle causal inference from data by considering it as a new kind of data science task known as counterfactual prediction .”
BackgroundDiscovering data mining : from concept to implementation
Cabena, P., Hadjinian, P., Stadler, R., Verhees, J., & Zanasi, A. (1998) · University of Maribor digital library (University of Maribor) · Cited by 492
Data Science: A Comprehensive Overview
Cao, L. (2018) · ACM Computing Surveys · doi:10.1145/3076253 · Cited by 407
A survey of Knowledge Discovery and Data Mining process models
KURGAN, L. A., & MUSILEK, P. (2006) · The Knowledge Engineering Review · doi:10.1017/s0269888906000737 · Cited by 391
A survey of data mining and knowledge discovery process models and methodologies
Mariscal, G., Marbán, Ó., & Fernández, C. (2010) · The Knowledge Engineering Review · doi:10.1017/s0269888910000032 · Cited by 315
A machine learning framework for sport result prediction
Bunker, R. P., & Thabtah, F. (2019) · Applied Computing and Informatics · doi:10.1016/j.aci.2017.09.005 · Cited by 300
Huber, S., Wiemer, H., Schneider, D., & Ihlenfeldt, S. (2019) · Procedia CIRP · doi:10.1016/j.procir.2019.02.106 · Cited by 247
Introduction to Data Mining and Knowledge Discovery
Chung, H. M., Gray, P., & Mannino, M. (2005) · Proceedings of the Thirty-First Hawaii International Conference on System Sciences · doi:10.1109/hicss.1998.648318 · Cited by 218
Data Science: A Comprehensive Overview
Cao, L. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2007.03606 · Cited by 210
Goldberg, L. R. (2019) · Quantitative Finance · doi:10.1080/14697688.2019.1655928 · Cited by 206
Bernstein, A., Provost, F., & Hill, S. (2005) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2005.67 · Cited by 194
The process of knowledge discovery in databases
Brachman, R. J., & Anand, T. (1996) · Knowledge Discovery and Data Mining · Cited by 171
Robotics: Ethics of artificial intelligence
Russell, S., Hauert, S., Altman, R. B., & Veloso, M. (2015) · Nature · doi:10.1038/521415a · Cited by 155
Domain-Driven Data Mining: Challenges and Prospects
Cao, L. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.32 · Cited by 153
Analysis of the AutoML Challenge Series 2015–2018
Guyon, I., Sun-Hosoya, L., Boullé, M., Escalante, H. J., Escalera, S., Liu, Z., Jajetic, D., Ray, B., Saeed, M., Sébag, M., et al. (2019) · The Springer series on challenges in machine learning · doi:10.1007/978-3-030-05318-5_10 · Cited by 142
Trends in Data Mining and Knowledge Discovery
Cios, K. J., & Kurgan, L. (2007) · Springer eBooks · doi:10.1007/1-84628-183-0_1 · Cited by 131
MineSet: an integrated system for data mining
Brunk, C., Kelly, J. D., & Kohavi, R. (1997) · Cited by 94
Imbens, G. W., & Rubin, D. B. (2010) · Palgrave Macmillan UK eBooks · doi:10.1057/9780230280816_28 · Cited by 87
Comparing Data Science Project Management Methodologies via a Controlled Experiment
Saltz, J., Shamshurin, I., & Crowston, K. (2017) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2017.120 · Cited by 87
Synthesizing CRISP-DM and Quality Management: A Data Mining Approach for Production Processes
Schäfer, F., Zeiselmair, C., Becker, J., & Otten, H. (2018) · IEEE International Conference on Technology Management, Operations and Decisions (ICTMOD) · doi:10.1109/itmc.2018.8691266 · Cited by 83
A knowledge discovery approach to diagnosing myocardial perfusion
Cios, K. J., Teresińska, A., Konieczna, S., Potocka, J., & Sharma, S. (2000) · IEEE Engineering in Medicine and Biology Magazine · doi:10.1109/51.853478 · Cited by 74
Methodologies of Knowledge Discovery from Data and Data Mining Methods in Mechanical Engineering
Rogalewicz, M., & Sika, R. (2016) · Management and Production Engineering Review · doi:10.1515/mper-2016-0040 · Cited by 72
Defining the scientific method
(2009) · Nature Methods · doi:10.1038/nmeth0409-237 · Cited by 71
Introduction to Data Mining and Knowledge Discovery
Chakraborty, S., Islam, S. H., & Samanta, D. (2022) · EAI/Springer Innovations in Communication and Computing · doi:10.1007/978-3-030-93088-2_1 · Cited by 46
Skiena, S. (2017) · Texts in computer science · doi:10.1007/978-3-319-55444-0_1 · Cited by 40
An Internet-enabled Knowledge Discovery Process
Büchner, A., Mulvenna, M. D., Anand, S., et al. (1999) · Ulster University Research Portal (Ulster University) · Cited by 39
RAMSYS - A methodology for supporting rapid remote collaborative data mining projects
Moyle, S. (2001) · Cited by 34
An evolutionary game-theoretic analysis of poker strategies
Ponsen, M., Tuyls, K., Kaisers, M., & Ramon, J. (2009) · Entertainment Computing · doi:10.1016/j.entcom.2009.09.002 · Cited by 34
Software engineering for big data projects: Domains, methodologies and gaps
Kumar, V. D., & Alencar, P. (2016) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2016.7840938 · Cited by 32
CASP-DM: Context Aware Standard Process for Data MiningPreprint
Martínez‐Plumed, F., Contreras-Ochando, L., Ferri, C., Flach, P. A., Hernández‐Orallo, J., Kull, M., Lachiche, N., & Ramírez-Quintana, M. J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.09003 · Cited by 28
Self-citationRedefining the "Scientific Method"
Spiece, K. R., & Colosi, J. C. (2000) · The American Biology Teacher · doi:10.2307/4450823 · Cited by 22
Applying CRISP-DM in a KDD Process for the Analysis of Student Attrition
Rojas, L. F. C., Esperanza Espitia, P., & Montilla, A. F. (2018) · Communications in computer and information science · doi:10.1007/978-3-319-98998-3_30 · Cited by 20
APREP-DM: a Framework for Automating the Pre-Processing of a Sensor Data Analysis based on CRISP-DM
Nagashima, H., & Kato, Y. (2019) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomw.2019.8730785 · Cited by 20
Adapting CRISP-DM Process for Social Network Analytics: Application to Healthcare
Asamoah, D. A., & Sharda, R. (2015) · Journal of Bioresource Management · Cited by 10
Nabati, E. G., & Thoben, K. (2016) · IFIP advances in information and communication technology · doi:10.1007/978-3-319-54660-5_41 · Cited by 9
Cited by
van Giffen, B., Herhausen, D., & Fahse, T. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2022.01.076 · Cited by 230
An artificial intelligence life cycle: from conception to production
De Silva, D., & Alahakoon, D. (2022) · Patterns · doi:10.1016/j.patter.2022.100489 · Cited by 189
Sokol, K., Fackler, J., & Vogt, J. E. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01725-9 · Cited by 105
Zarifis, A., & Cheng, X. (2022) · Journal of Behavioral and Experimental Finance · doi:10.1016/j.jbef.2022.100739 · Cited by 93
Explainable machine learning practices: opening another black box for reliable medical AI
Ratti, E., & Graves, M. (2022) · AI and Ethics · doi:10.1007/s43681-022-00141-z · Cited by 61
Metadata
- Authors
- Martinez-Plumed, F., Contreras-Ochando, L., Ferri, C., Hernandez-Orallo, J., Kull, M., Lachiche, N., Ramirez-Quintana, M. J., & Flach, P.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2021-08-01
- Volume
- 33
- Issue
- 8
- Pages
- 3048-3061
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W2998701638
- Cited by
- 438
- References
- 49
- FWCI
- 38.43
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.