Enhanced credit card fraud detection based on attention mechanism and LSTM deep model
Open accessThe DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
As credit card becomes the most popular payment mode particularly in the online sector, the fraudulent activities using credit card payment technologies are rapidly increasing as a result. For this end, it is obligatory for financial institutions to continuously improve their fraud detection systems to reduce huge losses. The purpose of this paper is to develop a novel system for credit card fraud detection based on sequential modeling of data, using attention mechanism and LSTM deep recurrent neural networks. The proposed model, compared to previous studies, considers the sequential nature of transactional data and allows the classifier to identify the most important transactions in the input sequence that predict at higher accuracy fraudulent transactions. Precisely, the robustness of our model is built by combining the strength of three sub-methods; the uniform manifold approximation and projection (UMAP) for selecting the most useful predictive features, the Long Short Term Memory (LSTM) networks for incorporating transaction sequences and the attention mechanism to enhance LSTM performances. The experimentations of our model give strong results in terms of efficiency and effectiveness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318 · cited 1×
“LSTMs were developed to overcome the problem of vanishing and exploding gradient that can be observed during the training of traditional RNNs [50].”
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865 · cited 4×
“In this paper, we aimed to improve the prediction efficiency during the identification of fraudulent transactions, by combining the strength of different Machine Learning techniques, namely: The Swarm intelligence based approach to select the optimal subset of relevant features, the Uniform Manifold Approximation and…”
MethodInfluentialLearning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892 · cited 1×
“Recently, deep learning methods based on recurrent neural networks (RNN) and specially its variant Long Short Term Memory Networks (LSTM), have been used in fraud detection field given their reputation as one of the most accurate learning algorithms in sequence analysis work [32–36].”
MethodNeural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213 · cited 2×
“It has been used to define context in machine translation [37] and image captioning [38] with great success.”
BackgroundMethodElman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
UMAP: Uniform Manifold Approximation and Projection
McInnes, L., Healy, J., Saul, N., & Großberger, L. (2018) · Journal of Open Source Software · doi:10.21105/joss.00861 · Cited by 9,826
Liu, F. T., Ting, K. M., & Zhou, Z.-H. (2008) · 2008 Eighth IEEE International Conference on Data Mining · doi:10.1109/icdm.2008.17 · Cited by 6,601 · cited 1×
“Unsupervised classification methods are used to detect unusual behavior of a sys-tem and to identify transactions that do not conform to the model as potential fraudulent cases [22–24].”
MethodDimensionality reduction for visualizing single-cell data using UMAP
Becht, E., McInnes, L., Healy, J., Dutertre, C.-A., Kwok, I. W. H., Ng, L. G., Ginhoux, F., & Newell, E. W. (2019) · Nature Biotechnology · doi:10.1038/nbt.4314 · Cited by 5,358 · cited 2×
“In this research, we employ three algorithms to reduce the dataset dimensionality, namely Principal Component Analysis (PCA) [44], t-distributed stochastic neighbor embedding (t-SNE) [45, 46], and uniform manifold approximation and projection (UMAP) [47, 49].”
MethodAttention-Based Models for Speech Recognition
Chorowski, J., Bahdanau, D., Serdyuk, D., Cho, K., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1506.07503 · Cited by 2,021
Proceedings of The 32nd International Conference on Machine Learning
Germain, M., Gregor, K., Murray, I., & Larochelle, H. (2015) · Cited by 2,020
EXPERT SYSTEMS WITH APPLICATIONS
(2005) · Expert Systems with Applications · doi:10.1016/j.eswa.2004.10.010 · Cited by 1,656
Data mining for credit card fraud: a comparative study
Bhattacharyya, S., Jha, S., Tharakunnel, K., & Westland, J. C. (2011) · Decision Support Systems · doi:10.1016/j.dss.2010.08.008 · Cited by 1,108 · cited 1×
“Some of these algorithms are support vector machines [10, 11], hidden Markov models [11, 12], logistic regression algorithms [10, 13], decision trees [14, 15], random forests [10, 16–19], and k-nearest neighbors [20, 21].”
MethodAnomaly Detection for Discrete Sequences: A Survey
Chandola, V., Banerjee, A., & Kumar, V. (2012) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2010.235 · Cited by 715 · cited 1×
“In payment industry, credit card fraud detection aims to decide whether a transaction is fraudulent or not based on historical data [3].”
BackgroundFraud detection system: A survey
Abdallah, A., Maarof, M. A., & Zainal, A. (2016) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2016.04.007 · Cited by 708 · cited 1×
“A wide range of machine learning approaches based on supervised learning, unsupervised learning, anomaly detection and ensemble learning have been used in payment card fraud detection [9].”
BackgroundCredit Card Fraud Detection: A Realistic Modeling and a Novel Learning Strategy
Dal Pozzolo, A., Boracchi, G., Caelen, O., Alippi, C., & Bontempi, G. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2736643 · Cited by 682 · cited 1×
“Such models are inadequate for credit card fraud detection, since they do not consider the consumer spending behavior, which is useful to discover relevant fraud patterns that evolves over time due to seasonality and new attack strategies [30, 31].”
BackgroundCalibrating Probability with Undersampling for Unbalanced Classification
Pozzolo, A. D., Caelen, O., Johnson, R. A., & Bontempi, G. (2015) · 2015 IEEE Symposium Series on Computational Intelligence · doi:10.1109/ssci.2015.33 · Cited by 667 · cited 1×
“com, consists of credit card transactions made by European cardholders occurring within two days in September 2013, where it has 492 frauds out of 284,807 transactions [54].”
BackgroundIntelligent financial fraud detection: A comprehensive review
West, J., & Bhattacharya, M. (2016) · Computers & Security · doi:10.1016/j.cose.2015.09.005 · Cited by 592 · cited 1×
“Also, since the profile of both a legitimate and fraudulent transaction tends to be constantly changing, optimal selection of variables that greatly differentiates both profiles is needed to achieve efficient classification of credit card transaction [40–42].”
BackgroundCredit Card Fraud Detection Using Hidden Markov Model
Srivastava, A., Kundu, A., Sural, S., & Majumdar, A. K. (2008) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2007.70228 · Cited by 535 · cited 1×
“Some of these algorithms are support vector machines [10, 11], hidden Markov models [11, 12], logistic regression algorithms [10, 13], decision trees [14, 15], random forests [10, 16–19], and k-nearest neighbors [20, 21].”
MethodFast interpolation-based t-SNE for improved visualization of single-cell RNA-seq data
Linderman, G. C., Rachh, M., Hoskins, J. G., Steinerberger, S., & Kluger, Y. (2019) · Nature Methods · doi:10.1038/s41592-018-0308-4 · Cited by 534 · cited 2×
“In this research, we employ three algorithms to reduce the dataset dimensionality, namely Principal Component Analysis (PCA) [44], t-distributed stochastic neighbor embedding (t-SNE) [45, 46], and uniform manifold approximation and projection (UMAP) [47, 49].”
BackgroundMethodLearned lessons in credit card fraud detection from a practitioner perspective
Dal Pozzolo, A., Caelen, O., Le Borgne, Y.-A., Waterschoot, S., & Bontempi, G. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.02.026 · Cited by 530
Sequence classification for credit-card fraud detection
Jurgovsky, J., Granitzer, M., Ziegler, K., Calabretto, S., Portier, P.-E., He-Guelton, L., & Caelen, O. (2018) · Expert Systems with Applications · doi:10.1016/j.eswa.2018.01.037 · Cited by 514 · cited 1×
“Recently, deep learning methods based on recurrent neural networks (RNN) and specially its variant Long Short Term Memory Networks (LSTM), have been used in fraud detection field given their reputation as one of the most accurate learning algorithms in sequence analysis work [32–36].”
MethodCombining unsupervised and supervised learning in credit card fraud detection
Carcillo, F., Le Borgne, Y.-A., Caelen, O., Kessaci, Y., Oblé, F., & Bontempi, G. (2021) · Information Sciences · doi:10.1016/j.ins.2019.05.042 · Cited by 478 · cited 1×
“…an increasingly sophisticated fraud detection system (FDS) to mitigate the prevailing menace of fraud and detect it immediately, with an objective to prevent fraud before it occurs, protect consumers’ interests and reduce the heavy annual financial losses caused by fraud around the world [4–8].”
BackgroundFeature engineering strategies for credit card fraud detection
Correa Bahnsen, A., Aouada, D., Stojanovic, A., & Ottersten, B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2015.12.030 · Cited by 451
A cost-sensitive decision tree approach for fraud detection
Sahin, Y., Bulkan, S., & Duman, E. (2013) · Expert Systems with Applications · doi:10.1016/j.eswa.2013.05.021 · Cited by 381 · cited 1×
“Some of these algorithms are support vector machines [10, 11], hidden Markov models [11, 12], logistic regression algorithms [10, 13], decision trees [14, 15], random forests [10, 16–19], and k-nearest neighbors [20, 21].”
MethodSwarm Intelligence Algorithms for Feature Selection: A Review
Brezočnik, L., Fister, I., & Podgorelec, V. (2018) · Applied Sciences · doi:10.3390/app8091521 · Cited by 374 · cited 1×
“Therefore, Swarm intelligence based feature selection approach [43] will be used to explore our datasets and study the influence of each feature in the prediction of the target class.”
MethodVan Vlasselaer, V., Bravo, C., Caelen, O., Eliassi-Rad, T., Akoglu, L., Snoeck, M., & Baesens, B. (2015) · Decision Support Systems · doi:10.1016/j.dss.2015.04.013 · Cited by 368
Credit card fraud detection using artificial neural network
RB, A., & KR, S. K. (2021) · Global Transitions Proceedings · doi:10.1016/j.gltp.2021.01.006 · Cited by 311
A Comprehensive Survey of Data Mining-based Fraud Detection Research
Phua, C., Lee, V., Smith, K., & Gayler, R. (2010) · arXiv · doi:10.48550/arxiv.1009.6119 · Cited by 285
Ensemble of deep sequential models for credit card fraud detection
Forough, J., & Momtazi, S. (2021) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106883 · Cited by 225
Dhankhad, S., Mohammed, E., & Far, B. (2018) · 2018 IEEE International Conference on Information Reuse and Integration (IRI) · doi:10.1109/iri.2018.00025 · Cited by 208
Detecting credit card fraud by Modified Fisher Discriminant Analysis
Mahmoudi, N., & Duman, E. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.10.037 · Cited by 188
Cost Sensitive Credit Card Fraud Detection Using Bayes Minimum Risk
Bahnsen, A. C., Stojanovic, A., Aouada, D., & Ottersten, B. (2013) · 2013 12th International Conference on Machine Learning and Applications · doi:10.1109/icmla.2013.68 · Cited by 173
Carcillo, F., Borgne, Y. L., Caelen, O., & Bontempi, G. (2018) · International Journal of Data Science and Analytics · doi:10.1007/s41060-018-0116-z · Cited by 167 · cited 1×
“Such extensive adoption of cashless transactions lead fraudsters to commit frequent fraud attacks and constantly change their strategies to avoid being detected [1, 2].”
BackgroundCredit Card Fraud Detection Model Based on LSTM Recurrent Neural Networks
Benchaji, I., Douzi, S., & Ouahidi, B. E. (2021) · Journal of Advances in Information Technology · doi:10.12720/jait.12.2.113-118 · Cited by 162
Self-citationA Survey on Credit Card Fraud Detection Using Machine Learning
Popat, R. R., & Chaudhary, J. (2018) · International Conference on Trends in Electronics and Informatics (ICOEI) · doi:10.1109/icoei.2018.8553963 · Cited by 152
Hybrid approaches for detecting credit card fraud
Kültür, Y., & Çağlayan, M. U. (2016) · Expert Systems · doi:10.1111/exsy.12191 · Cited by 105
(2014) · Wiley eBooks · doi:10.1002/9781118929773.oth1 · Cited by 97
Credit Card Fraud Detection using Big Data Analytics: Use of PSOAANN based One-Class Classification
Kamaruddin, S., & Ravi, V. (2016) · International Conference on Informatics and Analytics · doi:10.1145/2980258.2980319 · Cited by 79
Minimal infrequent pattern based approach for mining outliers in data streams
Hemalatha, C. S., Vaidehi, V., & Lakshmi, R. (2014) · Expert Systems with Applications · doi:10.1016/j.eswa.2014.09.053 · Cited by 66
Analysis of Credit Card Fraud Detection Using Fusion Classifiers
Kumari, P., & Mishra, S. P. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-981-10-8055-5_11 · Cited by 46 · cited 1×
“Thus, to enhance the classification performance ) [56, 57] to generate synthetic training instances from the minority class.”
BackgroundLOMA: A local outlier mining algorithm based on attribute relevance analysis
Zhao, X., Zhang, J., & Qin, X. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.05.009 · Cited by 36
Efficient big data model selection with applications to fraud detection
Vaughan, G. (2018) · International Journal of Forecasting · doi:10.1016/j.ijforecast.2018.03.002 · Cited by 32 · cited 1×
“This is a synthetic dataset created for financial fraud detection by using BankSim software, which is a simulation tool specifically designed to emulate fraud data [55].”
MethodFeature Selection Using Cooperative Game Theory and Relief Algorithm
Gore, S., & Govindaraju, V. (2016) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-19090-7_30 · Cited by 13 · cited 1×
“Feature selection and feature extraction are fundamental preprocessing steps in fraud detection systems [16, 39], to select the optimal subset of relevant features by removing redundant, noisy and irrelevant features from the original dataset, and decrease the computational cost without a negative…”
BackgroundNOVEL LEARNING STRATEGY BASED ON GENETIC PROGRAMMING FOR CREDIT CARD FRAUD DETECTION IN BIG DATA
Benchaji, I., Douzi, S., & Ouahidi, B. E. (2019) · doi:10.33965/bigdaci2019_201907l001 · Cited by 6 · cited 1×
“Thus, many of traditional classifiers fail to detect minority class objects for these skewed data sets [25, 26].”
BackgroundSelf-citation
Metadata
- Authors
- Benchaji, I., Douzi, S., El Ouahidi, B., & Jaafari, J.
- Venue
- Journal of Big Data
- Published
- 2021-12
- Volume
- 8
- Issue
- 1
- ISSN
- 2196-1115 (ISSN-L)
- OpenAlex
- W4200465265
- Cited by
- 185
- References
- 44
- FWCI
- 7.76
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.