FP-outlier: Frequent pattern based outlier detection
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
An outlier in a dataset is an observation or a point that is considerably dissimilar to or inconsistent with the remainder of the data. Detection of such outliers is important for many applications and has recently attracted much attention in the data mining research community. In this paper, we present a new method to detect outliers by discovering frequent patterns (or frequent itemsets) from the data set. The outliers are defined as the data transactions that contain less frequent patterns in their itemsets. We define a measure called FPOF (Frequent Pattern Outlier Factor) to detect the outlier transactions and propose the FindFPOF algorithm to discover outliers. The experimental results have shown that our approach outperformed the existing methods on identifying interesting outliers.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Moreover, the majority of these methods provide feature-based explanations (including pattern-based explanations), with the exception of References [46,75,83], which offer sample-based explanations, and References [41,53] generate explanations from both perspectives.”
From A Survey on Explainable Anomaly Detection (2024) · cites this paper as [83]
Citations
Cites
Fast algorithms for mining association rules
Agrawal, R., & Srikant, R. (1998) · Cited by 11,307
Mining frequent patterns without candidate generation
Han, J., Pei, J., & Yin, Y. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335372 · Cited by 6,402
LOF: identifying density-based local outliers
Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335388 · Cited by 5,207
Hawkins, D. M. (1980) · doi:10.1007/978-94-015-3994-4 · Cited by 2,982
Barnett, V., Lewis, T., & Abeles, F. (1979) · Physics Today · doi:10.1063/1.2995737 · Cited by 2,824
UCI Repository of Machine Learning Databases
Merz, C. J. (1996) · Medical Entomology and Zoology · Cited by 2,363
Integrating classification and association rule mining
Liu, B., Hsu, W., & Ma, Y. (1998) · Cited by 2,247
Efficient algorithms for mining outliers from large data sets
Ramaswamy, S., Rastogi, R., & Shim, K. (2000) · ACM SIGMOD Record · doi:10.1145/335191.335437 · Cited by 1,860
Scalable algorithms for association mining
Zaki, M. J. (2000) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.846291 · Cited by 1,751 · cited 2×
“• Our approach is efficient and easy to implement because we use the existing fast frequent-pattern mining algorithms [19-21].”
BackgroundMethodAtkinson, A., Barnett, V., & Lewis, T. (1995) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983451 · Cited by 1,682
Algorithms for Mining Distance-Based Outliers in Large Datasets
Knorr, E. M., & Ng, R. T. (1998) · Cited by 1,544
Discovering Frequent Closed Itemsets for Association Rules
Pasquier, N., Bastide, Y., Taouil, R., & Lakhal, L. (1999) · Lecture Notes in Computer Science · doi:10.1007/3-540-49257-7_25 · Cited by 1,378
Discovering cluster-based local outliers
He, Z., Xu, X., & Deng, S. (2003) · Pattern Recognition Letters · doi:10.1016/s0167-8655(03)00003-5 · Cited by 1,055 · cited 3×
“The authors in [16] further extended existing clustering based techniques by proposing the concept of the cluster-based local outlier, in which a measure for identifying the outlier-ness of each data object is defined.”
InfluentialSelf-citationOutlier detection for high dimensional data
Aggarwal, C. C., & Yu, P. S. (2001) · Proceedings of the 2001 ACM SIGMOD international conference on Management of data · doi:10.1145/375663.375668 · Cited by 1,029
Discretization: An Enabling Technique
Liu, H., Hussain, F., Tan, C. L., & Dash, M. (2002) · Data Mining and Knowledge Discovery · doi:10.1023/a:1016304305535 · Cited by 981 · cited 1×
“(See the work of Liu, et al.[23] for a more recent survey about the existing discretization methods).”
BackgroundLOCI: fast outlier detection using the local correlation integral
Papadimitriou, S., Kitagawa, H., Gibbons, P. B., & Faloutsos, C. (2004) · Proceedings 19th International Conference on Data Engineering (Cat. No.03CH37405) · doi:10.1109/icde.2003.1260802 · Cited by 846 · cited 2×
“This is important because the users who interpret the outliers discovered from data are usually business domain experts, not data miners [ 13 ].”
BackgroundMethodFast Outlier Detection in High Dimensional Spaces
Angiulli, F., & Pizzuti, C. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-45681-3_2 · Cited by 836 · cited 2×
“F. Angiulli, C. Pizzuti.”
MethodOutlier Detection Using Replicator Neural Networks
Hawkins, S., He, H., Williams, G., & Baxter, R. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-46145-0_17 · Cited by 710
Finding Intensional Knowledge of Distance-Based Outliers
Knorr, E. M., & Ng, R. T. (1999) · Very Large Data Bases · Cited by 535
On-Line Unsupervised Outlier Detection Using Finite Mixtures with Discounting Learning Algorithms
Yamanishi, K., Takeuchi, J.-I., Williams, G., & Milne, P. (2004) · Data Mining and Knowledge Discovery · doi:10.1023/b:dami.0000023676.72185.7c · Cited by 476 · cited 1×
“[10] used a Gaussian mixture model to present the normal behaviors and each datum is given a score on the basis of changes in the model.”
MethodA Linear Method for Deviation Detection in Large Databases
Arning, A., Agrawal, R., & Raghavan, P. (1996) · Cited by 363
Two-phase clustering process for outliers detection
Jiang, M. F., Tseng, S. S., & Su, C. M. (2001) · Pattern Recognition Letters · doi:10.1016/s0167-8655(00)00131-8 · Cited by 341 · cited 1×
“Clustering-based outlier detection techniques regarded small clusters as outliers [ 5 ] or identified outliers by removing clusters from the original dataset [8].”
BackgroundComputing depth contours of bivariate point clouds
Ruts, I., & Rousseeuw, P. J. (1996) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(96)00027-8 · Cited by 263
FindOut : Finding Outliers in Very Large Datasets
Yu, D., Sheikholeslami, G., & Zhang, A. (2002) · Knowledge and Information Systems · doi:10.1007/s101150200013 · Cited by 196
Yamanishi, K., & Takeuchi, J.-I. (2001) · Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/502512.502570 · Cited by 103 · cited 1×
“This approach has been combined with a supervised-based learning approach to obtain general patterns for outliers [12].”
MethodConcise representation of frequent patterns based on disjunction-free generators
Kryszkiewicz, M. (2002) · Proceedings · doi:10.1109/icdm.2001.989533 · Cited by 85 · cited 1×
“Two of such representations, namely the closed itemsets [26] and the generators representation [ 27 ], are of particular interest.”
BackgroundHOT: hypergraph-based outlier test for categorical data
Li, W., Qian, W., Zhou, A., Jin, W., & Yu, J. X. (2003) · doi:10.5555/1760894.1760948 · Cited by 44
Cited by
Know Abnormal, Find Evil: Frequent Pattern Mining for Ransomware Threat Hunting and Intelligence
Homayoun, S., Dehghantanha, A., Ahmadzadeh, M., Hashemi, S., & Khayami, R. (2020) · IEEE Transactions on Emerging Topics in Computing · doi:10.1109/tetc.2017.2756908 · Cited by 146
“Once all sequences are created, we have utilized the Find Frequent Pattern Outlier Factor (FindFPOF) [41] algorithm to remove any outlier sequence from our sequential dataset.”
MethodInformation-Theoretic Outlier Detection for Large-Scale Categorical Data
Wu, S., & Wang, S. (2011) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2011.261 · Cited by 168
“Frequent Pattern Outlier Factor (called the FIB method in this paper) [10] and Otey's Algorithm (called the OA method in this paper) [7] are two well-known rule-based techniques.”
MethodLoss of TAX1BP1-Directed Autophagy Results in Protein Aggregate Accumulation in the Brain
Sarraf, S. A., Shah, H. V., Kanfer, G., Pickrell, A. M., Holtzclaw, L. A., Ward, M. E., & Youle, R. J. (2020) · Molecular Cell · doi:10.1016/j.molcel.2020.10.041 · Cited by 143
“Outliers were detected and removed using interquartile range using the R Outliers package (He et al., 2005).”
MethodTrustworthy Recommender Systems
Wang, S., Zhang, X., Wang, Y., & Ricci⋆, F. (2023) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/3627826 · Cited by 195
“For instance, some data cleaning methods including pattern-based error detection [26] and machine learning based outlier detection [51] can be utilized to detect and remove those noisy and fake data in the raw dataset.”
A Survey on Explainable Anomaly Detection
Li, Z., Zhu, Y., & Van Leeuwen, M. (2024) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3609333 · Cited by 139
“Examples include Rule-based models [83].”
BackgroundInfluential
Metadata
- Authors
- He, Z., Xu, X., Huang, Z., & Deng, S.
- Affiliations
- Harbin Institute of Technology (CN)
- E-Business Technology Institute, The University of Hong Kong, Pokfulam, Hong Kong, China
- Venue
- Computer Science and Information Systems
- Publisher
- National Library of Serbia
- Published
- 2005
- Volume
- 2
- Issue
- 1
- Pages
- 103-118
- ISSN
- 1820-0214 (ISSN-L)
- 2406-1018
- OpenAlex
- W2079557269
- Cited by
- 188
- References
- 27
- Citations by year
- 2025: 8 · 2024: 4 · 2023: 7 · 2022: 9 · 2021: 12 · 2020: 12 · 2019: 23 · 2018: 14 · 2017: 7 · 2016: 17 · 2015: 10 · 2014: 15 · 2013: 15 · 2012: 6
- FWCI
- 2.47
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- Locations
- Computer Science and Information Systems (publishedVersion, cc-by-nc-nd)
- Funders
- National Natural Science Foundation of China
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
- Physical Sciences › Computer Science › Information Systems › Data Mining Algorithms and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Privacy-Preserving Technologies in Data
- Keywords
- outlier detection, frequent pattern mining, frequent itemsets, data mining
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.