The DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Automated Discovery of Process Models from Event Logs: Review and Benchmark
Open accessAbstract
Process mining allows analysts to exploit logs of historical executions of business processes to extract insights regarding the actual performance of these processes. One of the most widely studied process mining operations is automated process discovery. An automated process discovery method takes as input an event log, and produces as output a business process model that captures the control-flow relations between tasks that are observed in or implied by the event log. Various automated process discovery methods have been proposed in the past two decades, striking different tradeoffs between scalability, accuracy, and complexity of the resulting models. However, these methods have been evaluated in an ad-hoc manner, employing different datasets, experimental setups, evaluation measures, and baselines, often leading to incomparable conclusions and sometimes unreproducible results due to the use of closed datasets. This article provides a systematic review and comparative evaluation of automated process discovery methods, using an open-source benchmark and covering 12 publicly-available real-life event logs, 12 proprietary real-life event logs, and nine quality metrics. The results highlight gaps and unexplored tradeoffs in the field, including the lack of scalability of some methods and a strong divergence in their performance with respect to the different quality metrics used.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Kohavi, R. (1995) · Zenodo · doi:10.5281/zenodo.19712698 · Cited by 10,909
(2004) · Cited by 5,198
Writing Integrative Literature Reviews: Guidelines and Examples
Torraco, R. J. (2005) · Human Resource Development Review · doi:10.1177/1534484305278283 · Cited by 3,534 · cited 1×
“ch. Given that [3] refers to studies published prior to 2012, our search returned a large number of publications not covered in [3]. 2.3 Study selection As a last step, as suggested by [5], [6], [7], [8], we defined inclusion and exclusion criteria to ensure an unbiased selection of relevant studies (to be retained, a…”
InfluentialWorkflow mining: discovering process models from event logs
van der Aalst, W., Weijters, T., & Maruster, L. (2004) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2004.47 · Cited by 2,203
Conducting research literature reviews: from the Internet to paper
(2005) · Choice Reviews Online · doi:10.5860/choice.42-6198 · Cited by 1,854
A Guide to Conducting a Systematic Literature Review of Information Systems Research
Okoli, C., & Schabram, K. (2011) · doi:10.2139/ssrn.1954824 · Cited by 1,849
van der Aalst, W. (2016) · CERN Document Server (European Organization for Nuclear Research) · doi:10.1007/978-3-662-49851-4 · Cited by 866
A Guide to Writing the Dissertation Literature Review
Randolph, J. (2020) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/b0az-8t74 · Cited by 722
DECLARE: Full Support for Loosely-Structured Processes
Pesic, M., Schonenberg, H., & van der Aalst, W. M. P. (2007) · 11th IEEE International Enterprise Distributed Object Computing Conference (EDOC 2007) · doi:10.1109/edoc.2007.14 · Cited by 561
Genetic process mining: an experimental evaluation
de Medeiros, A. K. A., Weijters, A. J. M. M., & van der Aalst, W. M. P. (2007) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-006-0061-7 · Cited by 490
Flexible Heuristics Miner (FHM)
Weijters, A. J. M. M., & Ribeiro, J. T. S. (2011) · 2011 IEEE Symposium on Computational Intelligence and Data Mining (CIDM) · doi:10.1109/cidm.2011.5949453 · Cited by 475
Mining process models with non-free-choice constructs
Wen, L., van der Aalst, W. M. P., Wang, J., & Sun, J. (2007) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-007-0065-y · Cited by 313
Buijs, J. C. A. M., van Dongen, B. F., & van der Aalst, W. M. P. (2014) · International Journal of Cooperative Information Systems · doi:10.1142/s0218843014400012 · Cited by 216
De Weerdt, J., De Backer, M., Vanthienen, J., & Baesens, B. (2012) · Information Systems · doi:10.1016/j.is.2012.02.004 · Cited by 215
Decomposing Petri nets for process mining: A generic approach
van der Aalst, W. M. P. (2013) · Distributed and Parallel Databases · doi:10.1007/s10619-013-7127-5 · Cited by 193
Comprehensible Predictive Models for Business Processes1
Breuker, D., Matzner, M., Delfmann, P., & Becker, J. (2016) · MIS Quarterly · doi:10.25300/misq/2016/40.4.10 · Cited by 187
Filtering Out Infrequent Behavior from Business Process Event Logs
Conforti, R., Rosa, M. L., & ter Hofstede, A. H. M. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2614680 · Cited by 182
Self-citationEvent correlation for process discovery from web service interaction logs
Motahari‐Nezhad, H. R., Saint-Paul, R., Casati, F., & Benatallah, B. (2010) · The VLDB Journal · doi:10.1007/s00778-010-0203-9 · Cited by 148
A genetic algorithm for discovering process trees
Buijs, J. C. A. M., van Dongen, B. F., & van der Aalst, W. M. P. (2012) · IEEE Congress on Evolutionary Computation (CEC) · doi:10.1109/cec.2012.6256458 · Cited by 148
On the Discovery of Declarative Control Flows for Artful Processes
Ciccio, C. D., & Mecella, M. (2015) · ACM Transactions on Management Information Systems · doi:10.1145/2629447 · Cited by 116
Self-citationData-Driven Process Discovery - Revealing Conditional Infrequent Behavior from Event Logs
Mannhardt, F., de Leoni, M., Reijers, H. A., & van der Aalst, W. M. P. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-59536-8_34 · Cited by 104
Discovery of Multi-perspective Declarative Process Models
Schönig, S., Ciccio, C. D., Maggi, F. M., & Mendling, J. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46295-0_6 · Cited by 76
Self-citationA Knowledge-Based Integrated Approach for Discovering and Repairing Declare Maps
Maggi, F. M., Bose, R. P. J. C., & van der Aalst, W. M. P. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-38709-8_28 · Cited by 63
Self-citationAugusto, A., Conforti, R., Dumas, M., Rosa, M. L., & Bruno, G. (2018) · Data & Knowledge Engineering · doi:10.1016/j.datak.2018.04.007 · Cited by 58
Self-citationA two-step fast algorithm for the automated discovery of declarative workflows
Ciccio, C. D., & Mecella, M. (2013) · IEEE Symposium on Computational Intelligence and Data Mining (CIDM) · doi:10.1109/cidm.2013.6597228 · Cited by 56
Self-citationEfficient discovery of Target-Branched Declare constraints
Ciccio, C. D., Maggi, F. M., & Mendling, J. (2015) · Information Systems · doi:10.1016/j.is.2015.06.009 · Cited by 52
Self-citationParallel algorithms for the automated discovery of declarative process models
Maggi, F. M., Ciccio, C. D., Francescomarino, C. D., & Kala, T. (2017) · Information Systems · doi:10.1016/j.is.2017.12.002 · Cited by 51
Self-citationAligning Modeled and Observed Behavior: A Compromise Between Computation Complexity and Quality
van Dongen, B. F., Carmona, J., Chatain, T., & Taymouri, F. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-59536-8_7 · Cited by 49
Process Mining and the ProM Framework: An Exploratory Survey
Claes, J., & Poels, G. (2013) · Lecture notes in business information processing · doi:10.1007/978-3-642-36285-9_19 · Cited by 36
Process Discovery and Conformance Checking Using Passages
van der Aalst, W. M. P., & Verbeek, H. M. W. (2014) · Fundamenta Informaticae · doi:10.3233/fi-2014-1006 · Cited by 32
Improving the quality of the Heuristics Miner in ProM 6.2
Cnudde, S. D., Claes, J., & Poels, G. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.05.055 · Cited by 31
Do activity lifecycles affect the validity of a business rule in a business process?
Bernardi, M. L., Cimitile, M., Francescomarino, C. D., & Maggi, F. M. (2016) · Information Systems · doi:10.1016/j.is.2016.06.002 · Cited by 27
Self-citationLogic-Based Incremental Process Mining in Smart Environments
Ferilli, S., Carolis, B. N. D., & Redavid, D. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-38577-3_40 · Cited by 8
Learning and Recognizing Routines and Activities in SOFiA
Carolis, B. N. D., Ferilli, S., & Mallardi, G. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-14112-1_16 · Cited by 6
Cited by
Process mining for healthcare: Characteristics and challenges
Munoz-Gama, J., Martin, N., Fernandez-Llatas, C., Johnson, O. A., Sepúlveda, M., Helm, E., Galvez-Yanjari, V., Rojas, E., Martinez-Millana, A., Aloini, D., et al. (2022) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2022.103994 · Cited by 287
Metadata
- Authors
- Augusto, A., Conforti, R., Dumas, M., Rosa, M. L., Maggi, F. M., Marrella, A., Mecella, M., & Soo, A.
- Venue
- IEEE Transactions on Knowledge and Data Engineering
- Published
- 2019-04-01
- Volume
- 31
- Issue
- 4
- Pages
- 686-705
- ISSN
- 1041-4347 (ISSN-L)
- 1558-2191
- 2326-3865
- OpenAlex
- W2613062404
- Cited by
- 438
- References
- 34
- FWCI
- 67.21
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.