Cited by 7Imbalanced Data Classification TechniquesAnomaly Detection Techniques and ApplicationsData Stream Mining Techniques

The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index; none of the 20 sources its claims cite is checked for support yet.

Real-Time Financial Fraud Detection: An Intelligent Data-Driven Framework Integrating Machine Learning, Stream Processing, and Big Data Analytics for High-Velocity Transaction Monitoring

Open access
Arzu, Farah, Bajwa, Muhammad Khurram Zahur, Obaidullah, Waheed, Abdul, Alam, Farooq, Ali, Muhammad, Khan, Ajab·2025·The Asian Bulletin of Big Data Management

Abstract

The exponential growth of online financial transactions has significantly increased the vulnerability of banking and e-commerce systems to fraudulent activities, demanding intelligent, adaptive, and real-time detection mechanisms. This study presents an intelligent data-driven framework integrating machine learning, stream processing, and big data analytics for high-velocity transaction monitoring. The proposed architecture harnesses distributed data ingestion pipelines and stream-oriented processing engines to capture and analyze massive, continuously generated financial data streams with minimal latency. Feature engineering modules are designed to extract transactional, behavioral, and temporal features from heterogeneous data sources, while big data technologies such as Apache Spark and Kafka enable scalable real-time data handling. At the analytical core, the framework employs a hybrid ensemble of supervised and unsupervised learning models Random Forest (RF), Gradient Boosting (GBM), and Autoencoders to achieve robust detection of both known and novel fraud patterns. The models are trained on large-scale transactional datasets using feature selection and hyperparameter optimization strategies to ensure accuracy, interpretability, and generalization across dynamic environments. Streaming analytics and online learning components allow continuous model adaptation to evolving fraudulent behaviors without retraining from scratch. Experimental evaluations conducted on benchmark and synthetic datasets demonstrate the superior performance of the proposed framework in terms of detection rate, false-positive reduction, and computational efficiency compared with conventional batch-learning systems. The system achieves real-time throughput exceeding 50,000 transactions per second with sub-second decision latency, illustrating its suitability for deployment in large-scale financial ecosystems. In addition, explainable AI (XAI) modules are integrated to interpret model predictions and provide transparency in decision-making, thereby facilitating regulatory compliance and user trust. This research contributes to the ongoing advancement of intelligent financial security systems by merging data-driven learning with scalable stream analytics. The proposed framework offers a practical and generalizable solution for banks, payment gateways, and fintech platforms to identify fraudulent transactions proactively and adaptively in dynamic, high-velocity data environments. Future work will focus on integrating blockchain-based audit trails and federated learning for enhanced privacy and cross-institutional fraud intelligence sharing.

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

The paper proposes a real-time financial fraud detection framework combining Kafka/Spark stream processing, hybrid supervised-unsupervised machine learning, online adaptation, and explainable AI. It reports high accuracy and sub-second performance on benchmark and synthetic high-velocity transaction data.

Key findings

  • The hybrid ensemble (RF + GBM + Autoencoder fusion) achieved 99.3% accuracy, 98.7% precision, 98.9% recall, 0.986 F1-score, 0.9% false-positive rate, and 0.995 AUC-ROC, outperforming standalone RF, GBM, and Autoencoder models.
  • The distributed Spark-Kafka pipeline sustained throughput exceeding 50,000 transactions per second, with stress-test peaks approaching 72,000 TPS, and end-to-end latency below 500 ms for 95% of transactions.
  • Under concept drift, adaptive recalibration improved accuracy from 93.4% to 98.6% for seasonal shopping surges, 88.1% to 97.9% for synthetic novel fraud, 86.7% to 96.8% for coordinated multi-device attacks, and 87.9% to 97.4% for geo-spoofing/IP rotation, with recovery times of 12.4–21.3 seconds.
  • In comparative evaluation, the proposed framework reached 99.3% accuracy, 0.9% false positives, and 350–500 ms latency, versus 82.7% accuracy and 9.1% false positives for a static rule engine, 92.4% and 4.7% for a batch ML system, and 90.1% and 6.2% for a streaming anomaly detector.

Methods

  • The framework integrates distributed ingestion via Apache Kafka, stream preprocessing with Apache Spark Structured Streaming or Flink, hybrid inference using Random Forest, Gradient Boosting Machines, and Autoencoders, online learning, drift detection, and XAI modules using SHAP and LIME.
  • Experiments were conducted in a distributed big-data environment with Kafka, Spark Structured Streaming, and containerized machine learning microservices, using benchmark datasets and synthetically generated high-velocity streams mimicking card-not-present fraud, rapid-location change fraud, multi-account coordination fraud, and identity spoofing.
  • Evaluation covered predictive performance, computational efficiency, scalability, concept-drift resilience, and interpretability, with comparisons against a static rule engine, a periodic batch ML model, and a streaming-only anomaly detector.

Limitations

  • The paper does not state a limitations section.
  • Evident from the text: evaluation relies on benchmark and synthetic datasets, with no real-world production deployment described.
  • Evident from the text: dataset sizes, train/test splits, hyperparameter settings, and statistical significance tests are not reported, limiting reproducibility.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.62019/f3c0g313

Cites

0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

90 Own interpretation · 20 Sources not found · 17 Own result · 5 No basis given · 1 Not checked yet

  • It may state two separate claims as one. 44
  • The quote only partly states this claim. 1
  • Probably not a substantial claim. 68
90 of 90
  • The paper relies on this without support.

    The benchmark and synthetic datasets used for evaluation adequately represent real-world high-velocity financial transaction environments.

    “Experimental evaluations conducted on benchmark and synthetic datasets demonstrate the superior performance of the proposed framework in terms of detection rate, false-positive reduction, and computational efficiency compared with conventional batch-learning systems.”
    “Through extensive experimentation on benchmark and synthetic datasets, the framework demonstrates superior accuracy, reduced latency, lower false-positive rates, and enhanced operational adaptability”
  • The paper relies on this without support.

    A throughput exceeding 50,000 transactions per second with sub-second decision latency is sufficient for deployment in large-scale financial ecosystems.

    “The system achieves real-time throughput exceeding 50,000 transactions per second with sub-second decision latency, illustrating its suitability for deployment in large-scale financial ecosystems.”
  • The paper relies on this without support.

    The benchmark and synthetic datasets contain both known and novel fraud patterns sufficient to evaluate the hybrid ensemble's detection of both.

    “At the analytical core, the framework employs a hybrid ensemble of supervised and unsupervised learning models Random Forest (RF), Gradient Boosting (GBM), and Autoencoders to achieve robust detection of both known and novel fraud patterns.”
    “Experimental evaluations conducted on benchmark and synthetic datasets demonstrate the superior performance of the proposed framework in terms of detection rate, false-positive reduction, and computational efficiency compared with conventional batch-learning systems.”
  • The paper relies on this without support.

    Fraud patterns evolve rapidly and continuously, so static or single-model detection systems often fail to generalize beyond previously observed attack strategies.

    “In modern financial landscapes, where fraud patterns evolve rapidly and continuously, static or single-model detection systems often fail to generalize beyond previously observed attack strategies.”
  • The paper relies on this without support.

    Conventional fraud detection architectures operate with each functional component in isolation.

    “Unlike conventional fraud detection architectures where each functional component operates in isolation, this system embraces a deeply interconnected design philosophy where data ingestion, transformation, enrichment, learning, inference, and interpretability are fused into a seamless workflow.”
  • The paper relies on this without support.

    Financial transactions must often be approved in under a second.

    “In modern, hyper-connected financial ecosystems where transactions must often be approved in under a second the decision engine must not only be analytically precise but must also deliver exceptional computational efficiency, ultra-low latency response times, and seamless scalability under fluctuating workloads.”
  • The paper relies on this without support.

    Behavioral shifts frequently emerge moments before fraudulent activity occurs.

    “These behavioral shifts frequently emerge moments before fraudulent activity occurs, making their real-time detection a vital analytical component.”
  • The paper relies on this without support.

    The synthetically generated high-velocity streams and benchmark datasets used in the evaluation adequately mimic real digital traffic patterns and fraud scenarios.

    “The predictive evaluation began with benchmark datasets and extended to synthetically generated high-velocity streams that mimic real digital traffic patterns such as card-not-present (CNP) fraud, rapid-location change fraud, multi-account coordination fraud, and identity spoofing attempts.”
  • The paper relies on this without support.

    The distributed big-data environment (Kafka, Spark, containerized ML microservices) closely replicates production-level workloads in large-scale banking, fintech, and digital payment ecosystems.

    “This environment closely replicates production-level workloads in large-scale banking, fintech, and digital payment ecosystems.”
  • The paper relies on this without support.

    The synthetic load generation and drift scenarios (seasonal shopping peaks, synthetic fraud patterns, device spoofing, rapid geographic shifts) adequately represent real-world concept drift.

    “Drift scenarios included seasonal shopping peaks, introduction of synthetic fraud patterns, device spoofing attacks, and rapid geographic shifts engineered through synthetic load generation.”
  • The paper relies on this without support.

    The three baseline systems (static rule engine, periodic batch ML, streaming-only anomaly detector) are representative of conventional fraud detection approaches.

    “To benchmark these improvements, a comparative evaluation was conducted against three established fraud detection approaches: a static rule engine, a periodic batch-based machine learning model, and a streaming-only anomaly detector.”
11 of 11

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

The publisher hasn’t deposited this paper’s reference list.

Research works printed but not linked: 16

  1. Abbas, T., & Eldred, A. (2025). AI-Powered Stream Processing: Bridging Real-Time Data Pipelines with Advanced Machine Learning Techniques. ResearchGate Journal of AI & Cloud Analytics.
  2. Adebowale, A. M., & Akinnagbe, O. B. (2021). Leveraging AI-driven data integration for predictive risk assessment in decentralized financial markets. Int J Eng Technol Res Manag, 5(12), 295.
  3. Ahmad, A. S. (2023). Application of big data and artificial intelligence in strengthening fraud analytics and cybersecurity resilience in global financial markets. International Journal of Advanced Cybersecurity Systems, Technologies, and Applications, 7(12), 11-23.
  4. Balogun, E. D., Ogunsola, K. O., & Samuel, A. D. E. B. A. N. J. I. (2021). A risk intelligence framework for detecting and preventing financial fraud in digital marketplaces. ICONIC RESEARCH AND ENGINEERING JOURNALS, 4(08), 134-149.
  5. Boppiniti, S. T. (2019). Machine learning for predictive analytics: Enhancing data-driven decision-making across industries. International Journal of Sustainable Development in Computing Science, 1(3), 13.
  6. Ejiofor, O. E. (2023). A comprehensive framework for strengthening USA financial cybersecurity: integrating machine learning and AI in fraud detection systems. European Journal of Computer Science and Information Technology, 11(6), 62-83.
  7. Jabed, M. M. I., Khawer, A. S., Ferdous, S., Niton, D. H., Gupta, A. B., & Hossain, M. S. (2023). Integrating Business Intelligence with AI-Driven Machine Learning for Next-Generation Intrusion Detection Systems. International Journal of Research and Applied Innovations, 6(6), 9834-9849.
  8. Kalusivalingam, A. K., Sharma, A., Patel, N., & Singh, V. (2020). Leveraging deep reinforcement learning and real-time stream processing for enhanced retail analytics. International Journal of AI and ML, 1(2).
  9. Machireddy, J. R. (2024). Integrating Machine Learning-Driven RPA with Cloud-Based Data Warehousing for Real-Time Analytics and Business Intelligence. Hong Kong Journal of AI and Medicine, 4(1), 98-121.
  10. Nwangene, C. R., Adewuyi, A. D. E. M. O. L. A., Ajuwon, A. Y. O. D. E. J. I., & Akintobi, A. O. (2021). Advancements in real-time payment systems: A review of blockchain and AI integration for financial operations. IRE Journals, 4(8), 206-221.
  11. Ogunwole, O., Onukwulu, E. C., Sam-Bulya, N. J., Joel, M. O., & Achumie, G. O. (2022). Optimizing automated pipelines for realtime data processing in digital media and e- commerce. International Journal of Multidisciplinary Research and Growth Evaluation, 3(1), 112-120.
  12. Owen, A., & Templer, S. (2022). Intelligent Fraud Detection: Design a machine learning framework for real-time fraud prevention in transactions.
  13. Popoola, N. T. (2023). Big data-driven financial fraud detection and anomaly detection systems for regulatory compliance and market stability. Int. J. Comput. Appl. Technol. Res, 12(09), 32-46.
  14. Rehan, H. (2021). Leveraging AI and cloud computing for Real-Time fraud detection in financial systems. Journal of Science & Technology, 2(5), 127.
  15. Tadi, S. R. C. C. T. (2024). Process Mining Driven by Deep Learning for Anomaly Detection in Intelligent Automation Systems. Journal of Scientific and Engineering Research, 11(1), 317-329. The Asian Bulletin of Big Data Management 5(4),124-154
  16. Yusof, Z. B. (2025). Integrating artificial intelligence in big data analytics: a framework for automated data processing and insight generation. Orient Journal of Emerging Paradigms in Artificial Intelligence and Autonomous Systems, 15(2), 10-19.

Cited by

Sorted by citations

See all 7

Metadata

Authors
Arzu, F., Bajwa, M. K. Z., Obaidullah, Waheed, A., Alam, F., Ali, M., & Khan, A.
Affiliations
  • Universiti Tun Abdul Razak (MY)
  • University of Salerno (IT)
  • University of Alabama at Birmingham (US)
  • New York University (US)
  • Mohammad Ali Jinnah University (PK)
  • International Institute of Social Studies (NL)
  • Abbottabad University of Science and Technology (PK)
Venue
The Asian Bulletin of Big Data Management
Published
2025-11-04
Volume
5
Issue
4
Pages
124-154
ISSN
  • 2959-0795 (ISSN-L)
  • 2959-0809
OpenAlex
W4416562548
Cited by
7
References
0
Citations by year
2026: 7
FWCI
2.99
Type
journal article
Open access
Locations
The Asian Bulletin of Big Data Management (publishedVersion, cc-by-nc-nd)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Imbalanced Data Classification Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Anomaly Detection Techniques and Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Data Stream Mining Techniques
Keywords
financial fraud detection, real-time transaction monitoring, stream processing, big data analytics, hybrid ensemble model, random forest, gradient boosting, autoencoder, online learning, explainable AI, Apache Spark, Apache Kafka, high-velocity data, banking security

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-10-20, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-20 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review