The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Are Machine Learning Models for Malware Detection Ready for Prime Time?
Open accessAbstract
We investigate why the performance of machine learning models for malware detection observed in a lab setting often cannot be reproduced in practice. We discuss how to set up experiments mimicking a practical deployment and how to measure the robustness of a model over time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Evidently, the infusion of machine learning into CTH tools has notably increased the incidence of false positives in real-world operational environments [9].”
From HuntGPT: Integrating Machine Learning-Based Anomaly Detection and Explainable AI with Large Language Models (LLMs) (2026) · cites this paper as [9]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“While ML models exhibit strong performance in controlled settings, their efficacy in real-world environments is perceived as a significant barrier to their adoption [9].”
From HuntGPT: Integrating Machine Learning-Based Anomaly Detection and Explainable AI with Large Language Models (LLMs) (2026) · cites this paper as [9]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Drebin: Effective and Explainable Detection of Android Malware in Your Pocket
Arp, D., Spreitzenbarth, M., Hübner, M., Gascon, H., & Rieck, K. (2014) · Proceedings 2014 Network and Distributed System Security Symposium · doi:10.14722/ndss.2014.23247 · Cited by 2,331
Leakage and the reproducibility crisis in machine-learning-based science
Kapoor, S., & Narayanan, A. (2023) · Patterns · doi:10.1016/j.patter.2023.100804 · Cited by 1,387
A unifying view on dataset shift in classification
Moreno-Torres, J. G., Raeder, T., Alaiz-Rodríguez, R., Chawla, N. V., & Herrera, F. (2012) · Pattern Recognition · doi:10.1016/j.patcog.2011.06.019 · Cited by 1,029
AndroZoo: collecting millions of Android apps for the research community
Allix, K., Bissyandé, T. F., Klein, J., & Le Traon, Y. (2016) · Proceedings of the 13th International Conference on Mining Software Repositories · doi:10.1145/2901739.2903508 · Cited by 825
The base-rate fallacy and the difficulty of intrusion detection
Axelsson, S. (2000) · ACM Transactions on Information and System Security · doi:10.1145/357830.357849 · Cited by 638
Malware Detection by Eating a Whole EXEPreprint
Raff, E., Barker, J., Sylvester, J., Brandon, R., Catanzaro, B., & Nicholas, C. (2017) · arXiv (Cornell University) · doi:10.13016/m2rt7w-bkok · Cited by 606
Adversarial Examples for Malware Detection
Grosse, K., Papernot, N., Manoharan, P., Backes, M., & McDaniel, P. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-66399-9_4 · Cited by 542
TESSERACT: Eliminating Experimental Bias in Malware Classification across Space and Time
Pendlebury, F., Pierazzi, F., Jordaney, R., Kinder, J., & Cavallaro, L. (2018) · Research Portal (King's College London) · doi:10.48550/arxiv.1807.07838 · Cited by 414
Self-citationOnwuzurike, L., Mariconti, E., Andriotis, P., Cristofaro, E. D., Ross, G., & Stringhini, G. (2019) · ACM Transactions on Privacy and Security · doi:10.1145/3313391 · Cited by 334
Intriguing Properties of Adversarial ML Attacks in the Problem Space
Pierazzi, F., Pendlebury, F., Cortellazzi, J., & Cavallaro, L. (2020) · 2020 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp40000.2020.00073 · Cited by 287
Self-citation
Research works printed but not linked: 1
- Saxe, 2018, Malware Data Science: Attack Detection and Attribution
Cited by
Ali, T., Kostakos, P., & Sheikhi, S. (2026) · Telecom · doi:10.3390/telecom7030073 · Cited by 104
Autonomous Federated Learning for Distributed Intrusion Detection Systems in Public Networks
Mahmoodi, A. B. Z., Sheikhi, S., Peltonen, E., & Kostakos, P. (2023) · IEEE Access · doi:10.1109/access.2023.3327922 · Cited by 36
Gibert, D. (2024) · Advances in information security · doi:10.1007/978-3-031-66245-4_6 · Cited by 16
(2022) · doi:10.1109/msec.2023.3287207 · Cited by 15
Self-citationA Review of Explainable AI for Android Malware Detection and Analysis
Tanha, M., & Kafaie, S. (2025) · IEEE Access · doi:10.1109/access.2025.3597575 · Cited by 11
Metadata
- Authors
- Cavallaro, L., Kinder, J., Pendlebury, F., & Pierazzi, F.
- Affiliations
- University College London (GB)
- Universität der Bundeswehr München (DE)
- King's College London (GB)
- Venue
- IEEE Security & Privacy
- Published
- 2023-03
- Volume
- 21
- Issue
- 2
- Pages
- 53-56
- ISSN
- 1540-7993 (ISSN-L)
- 1558-4046
- OpenAlex
- W4365505506
- Cited by
- 13
- References
- 15
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 5 · 2023: 2
- FWCI
- 1.58
- Type
- journal article
- Language
- en
- Open access
- green
- research.vu.nl
- Licence
- Locations
- IEEE Security & Privacy (publishedVersion)
- VU Research Portal (publishedVersion, other-oa)
- UCL Discovery (University College London) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Software › Advanced Malware Detection Techniques
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Physical Sciences › Computer Science › Hardware and Architecture › Security and Verification in Computing
- Keywords
- malware detection, machine learning models, reproducibility, practical deployment, model robustness, experimental setup
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Are Machine Learning Models for Malware Detection Ready for Prime Time? https://app.cochat.ai/papers/10.1109/msec.2023.3236543
- The paper
- Cavallaro, L., Kinder, J., Pendlebury, F., & Pierazzi, F. (2023). Are Machine Learning Models for Malware Detection Ready for Prime Time? IEEE Security & Privacy. https://doi.org/10.1109/msec.2023.3236543
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.