The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Outcome-Oriented Predictive Process Monitoring: Review and Benchmark
Abstract
Predictive business process monitoring refers to the act of making predictions about the future state of ongoing cases of a business process, based on their incomplete execution traces and logs of historical (completed) traces. Motivated by the increasingly pervasive availability of fine-grained event data about business process executions, the problem of predictive process monitoring has received substantial attention in the past years. In particular, a considerable number of methods have been put forward to address the problem of outcome-oriented predictive process monitoring, which refers to classifying each ongoing case of a process according to a given set of possible categorical outcomes—e.g., Will the customer complain or not? Will an order be delivered, canceled, or withdrawn? Unfortunately, different authors have used different datasets, experimental settings, evaluation measures, and baselines to assess their proposals, resulting in poor comparability and an unclear picture of the relative merits and applicability of different methods. To address this gap, this article presents a systematic review and taxonomy of outcome-oriented predictive process monitoring methods, and a comparative experimental evaluation of eleven representative methods using a benchmark covering 24 predictive process monitoring tasks based on nine real-life event logs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
Scikit-learn: Machine Learning in Python
(2011) · Journal of Machine Learning Research · doi:10.5555/1953048.2078195 · Cited by 8,539
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217
The temporal logic of programs
Pnueli, A. (1977) · 18th Annual Symposium on Foundations of Computer Science (sfcs 1977) · doi:10.1109/sfcs.1977.32 · Cited by 5,689
(2004) · Cited by 5,198
(2011) · Cited by 3,939
Fundamentals of Business Process Management
Dumas, M., La Rosa, M., Mendling, J., & Reijers, H. A. (2018) · Springer eBooks · doi:10.1007/978-3-662-56509-4 · Cited by 1,822
Self-citationGraph-based approach for airborne light detection and ranging segmentation
Vilariño, D. L., Cabaleiro, J. C., Martínez, J., Rivera, F. F., & Pena, T. F. (2017) · Journal of Applied Remote Sensing · doi:10.1117/1.jrs.11.015020 · Cited by 1,721
Statistical Comparisons of Classifiers over Multiple Data Sets
DemšarJanez (2006) · Journal of Machine Learning Research · doi:10.5555/1248547.1248548 · Cited by 1,074
van der Aalst, W. (2016) · CERN Document Server (European Organization for Nuclear Research) · doi:10.1007/978-3-662-49851-4 · Cited by 866
A survey of online failure prediction methods
Salfner, F., Lenk, M., & Malek, M. (2010) · ACM Computing Surveys · doi:10.1145/1670679.1670680 · Cited by 560
Predictive Business Process Monitoring with LSTM Neural Networks
Tax, N., Verenich, I., La Rosa, M., & Dumas, M. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-59536-8_30 · Cited by 523
Self-citationProcess mining: a two-step approach to balance between underfitting and overfitting
van der Aalst, W. M. P., Rubin, V., Verbeek, H. M. W., van Dongen, B. F., Kindler, E., & Günther, C. (2008) · Software & Systems Modeling · doi:10.1007/s10270-008-0106-z · Cited by 456
Data-driven advice for applying machine learning to bioinformatics problems
Olson, R. S., Cava, W. L., Mustahsan, Z., Varik, A., & Moore, J. H. (2018) · Biocomputing 2018 · doi:10.1142/9789813235533_0018 · Cited by 287
Predictive Monitoring of Business Processes
Maggi, F. M., Francescomarino, C. D., Dumas, M., et al. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-07881-6_31 · Cited by 286
Self-citationde Leoni, M., van der Aalst, W. M. P., & Dees, M. (2016) · Information Systems · doi:10.1016/j.is.2015.07.003 · Cited by 251
Complex Symbolic Sequence Encodings for Predictive Monitoring of Business Processes
Leontjeva, A., Conforti, R., Di Francescomarino, C., Dumas, M., & Maggi, F. M. (2015) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-23063-4_21 · Cited by 178
Self-citationComparing and Combining Predictive Business Process Monitoring Techniques
Metzger, A., Leitner, P., Ivanović, D., Schmieders, E., Franklin, R., Carro, M., Dustdar, S., & Pohl, K. (2014) · IEEE Transactions on Systems Man and Cybernetics Systems · doi:10.1109/tsmc.2014.2347265 · Cited by 136
Cycle Time Prediction: When Will This Case Finally Be Finished?
van Dongen, B. F., Crooy, R. A., & van der Aalst, W. M. P. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-88871-0_22 · Cited by 132
Solti, A., & Weske, M. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-45005-1_27 · Cited by 126
A Deep Learning Approach for Predicting Process Behaviour at Runtime
Evermann, J., Rehse, J.-R., & Fettke, P. (2017) · Lecture notes in business information processing · doi:10.1007/978-3-319-58457-7_24 · Cited by 109
Predictive Business Process Monitoring with Structured and Unstructured Data
Teinemaa, I., Dumas, M., Maggi, F. M., & Francescomarino, C. D. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-45348-4_23 · Cited by 108
Self-citationDetecting Sudden and Gradual Drifts in Business Processes from Execution Traces
Maaradji, A., Dumas, M., Rosa, M. L., & Ostovar, A. (2017) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2017.2720601 · Cited by 108
Self-citationIntra and Inter-case Features in Predictive Process Monitoring: A Tale of Two Dimensions
Senderovich, A., Francescomarino, C. D., Ghidini, C., Jorbina, K., & Maggi, F. M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-65000-5_18 · Cited by 107
Self-citationImproving business process decision making based on past experience
Ghattas, J., Soffer, P., & Peleg, M. (2014) · Decision Support Systems · doi:10.1016/j.dss.2013.10.009 · Cited by 101
Detecting sudden and gradual drifts in business processes from execution traces
Maaradji, A., Dumas-Menijvar, M., Rosa, M. L., & Ostovar, A. (2017) · QUT ePrints (Queensland University of Technology) · Cited by 94
Self-citationMining Sequence Classifiers for Early Prediction
Xing, Z., Pei, J., Dong, G., & Yu, P. S. (2008) · SIAM International Conference on Data Mining · doi:10.1137/1.9781611972788.59 · Cited by 69
A General Framework for Correlating Business Process Characteristics
de Leoni, M., van der Aalst, W. M. P., & Dees, M. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-10172-9_16 · Cited by 64
Detecting Drift from Event Streams of Unpredictable Business Processes
Ostovar, A., Maaradji, A., Rosa, M. L., ter Hofstede, A. H. M., & van Dongen, B. F. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46397-1_26 · Cited by 59
Self-citationCharacterizing Drift from Event Streams of Business Processes
Ostovar, A., Maaradji, A., Rosa, M. L., & ter Hofstede, A. H. M. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-59536-8_14 · Cited by 36
Self-citationPredictive Analytics for Semi-structured Case Oriented Business Processes
Lakshmanan, G. T., Duan, S., Keyser, P. Τ., Curbera, F., & Khalaf, R. Y. (2011) · Lecture notes in business information processing · doi:10.1007/978-3-642-20511-8_59 · Cited by 26
preCEP: Facilitating Predictive Event-Driven Process Analytics
Schwegmann, B., Matzner, M., & Janiesch, C. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-38827-9_36 · Cited by 16
Exploring Disease Association from the NHANES Data
Xing, Z., & Pei, J. (2010) · International Journal of Data Warehousing and Mining · doi:10.4018/jdwm.2010070102 · Cited by 10
(2014) · doi:10.5555/2627435.2697065
Cited by
Seven Paradoxes of Business Process Management in a Hyper-Connected World
Beverungen, D., Buijs, J. C. A. M., Becker, J., Di Ciccio, C., van der Aalst, W. M. P., Bartelheimer, C., vom Brocke, J., Comuzzi, M., Kraume, K., Leopold, H., et al. (2021) · Business & Information Systems Engineering · doi:10.1007/s12599-020-00646-z · Cited by 89
DataStream XES Extension: Embedding IoT Sensor Data into Extensible Event Stream Logs
Mangler, J., Grüger, J., Malburg, L., Ehrendorfer, M., Bertrand, Y., Benzin, J.-V., Rinderle-Ma, S., Serral Asensio, E., & Bergmann, R. (2023) · Future Internet · doi:10.3390/fi15030109 · Cited by 33
“A survey on outcome-oriented predictive process monitoring presented in [48] compares different techniques.”
MethodZilker, S., Weinzierl, S., Kraus, M., Zschech, P., & Matzner, M. (2024) · Health Care Management Science · doi:10.1007/s10729-024-09673-8 · Cited by 29
Metadata
- Authors
- Teinemaa, I., Dumas, M., Rosa, M. L., & Maggi, F. M.
- Venue
- ACM Transactions on Knowledge Discovery from Data
- Published
- 2019-03-13
- Volume
- 13
- Issue
- 2
- Pages
- 1-57
- ISSN
- 1556-4681 (ISSN-L)
- 1556-472X
- OpenAlex
- W2964066696
- Cited by
- 351
- References
- 35
- FWCI
- 43.09
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.