The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.
SoK: The Challenges, Pitfalls, and Perils of Using Hardware Performance Counters for Security
Open accessAbstract
Hardware Performance Counters (HPCs) have been available in processors for more than a decade. These counters can be used to monitor and measure events that occur at the CPU level. Modern processors provide hundreds of hardware events that can be monitored, and with each new processor architecture more are added. Yet, there has been little in the way of systematic studies on how performance counters can best be utilized to accurately monitor events in real-world settings. Especially when it comes to the use of HPCs for security applications, measurement imprecisions or incorrect assumptions regarding the measured values can undermine the offered protection. To shed light on this issue, we embarked on a year-long effort to (i) study the best practices for obtaining accurate measurement of events using performance counters, (ii) understand the challenges and pitfalls of using HPCs in various settings, and (iii) explore ways to obtain consistent and accurate measurements across different settings and architectures. Additionally, we then empirically evaluated the way HPCs have been used throughout a wide variety of papers. Not wanting to stop there, we explored whether these widely used techniques are in fact obtaining performance counter data correctly. As part of that assessment, we (iv) extended the seminal work of Weaver and McKee from almost 10 years ago on non-determinism in HPCs, and applied our findings to 56 papers across various application domains. In that follow-up study, we found the acceptance of HPCs in security applications is in stark contrast to other application areas - especially in the last five years. Given that, we studied an additional representative set of 41 works from the security literature that rely on HPCs, to better elucidate how the intricacies we discovered can impact the soundness and correctness of their approaches and conclusions. Toward that goal, we (i) empirically evaluated how failure to accommodate for various subtleties in the use of HPCs can undermine the effectiveness of security applications, specifically in the case of exploit prevention and malware detection. Lastly, we showed how (ii) an adversary can manipulate HPCs to bypass certain security defenses.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The WEKA data mining software: an update
Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I. H. (2009) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1656274.1656278 · Cited by 17,750
Research works printed but not linked: 120
- weaver, 2010, Can hardware performance counters produce expected, deterministic results?, The 3rd Workshop on Functionality of Hardware Performance Monitoring
- 10.1109/ISPASS.2009.4919635 · DOI
- 10.1109/IISWC.2008.4636099 · doi:10.1109/iiswc.2008.4636099
- 10.1007/978-3-319-15618-7_6 · doi:10.1007/978-3-319-15618-7_6
- 10.1145/2843859.2843865 · doi:10.1145/2843859.2843865
- 10.1145/2768566.2768575 · doi:10.1145/2768566.2768575
- levon, 2004, OProfile A system profiler for Linux
- russinovich, 2012, Windows Internals
- li, 2014, Transparent ROP Detection using CPU Performance Counters, Threads
- 10.1109/ISPASS.2013.6557172 · doi:10.1109/ispass.2013.6557172
- 10.1145/2046582.2046596 · doi:10.1145/2046582.2046596
- 10.7873/DATE.2013.194 · doi:10.7873/date.2013.194
- irazoqui, 2017, Cross-core Microarchitectural Side Channel Attacks and Countermeasures
- molnár, 2017, Measuring performance of processor instructions and operating system services in soft processor based systems in International Carpathian Control Conference, 381
- 10.1007/s11390-015-1503-8 · DOI
- lu, 2014, Efficient deterministic multithreading without global barriers, ACM SIGPLAN Notices, 49, 287, 10.1145/2692916.2555252 · doi:10.1145/2692916.2555252
- hussein, 2015, Impact of GC design on power and performance for Android in ACM International Systems and Storage Conference, 13:1
- 10.4018/978-1-5225-2845-6.ch013 · DOI
- payer, 2016, HexPADS: a platform to detect “stealth” attacks, International Symposium on Engineering Secure Software and Systems, 138, 10.1007/978-3-319-30806-7_9 · DOI
- 10.1109/IISWC.2012.6402920 · DOI
- gruss, 2016, Flush+ Flush: a fast and stealthy cache attack, Detection of Intrusions and Malware and Vulnerability Assessment, 279, 10.1007/978-3-319-40667-1_14 · DOI · Paper page
- davis, 2011, No hardware required: building and validating composable highly accurate OS-based power models, Microsofl Technical Report
- röhl, 2016, Tools for High Performance Computing, 17
- hoske, 2014, An experimental study of a nearly-linear time Laplacian solver
- 10.1145/2741948.2741960 · DOI
- 10.1145/2887746.2754182 · doi:10.1145/2887746.2754182
- 10.1137/120870761 · DOI
- wicht, 2014, Hardware counted profile-guided optimization, arXiv preprint arXiv 1411 6361
- 10.1109/IPDPSW.2016.126 · doi:10.1109/ipdpsw.2016.126
- 10.1145/2818950.2818957 · doi:10.1145/2818950.2818957
- 10.1145/3095770.3095773 · doi:10.1145/3095770.3095773
- born de oliveira, 2015, Measuring and predicting computer software performance Tools and approaches
- rohou, 2012, Tiptop Hardware performance counters for the masses in International Conference on Parallel Processing Workshops, 404
- 10.1145/2463209.2488831 · DOI
- zamani, 2012, A study of hardware performance monitoring counter selection in power modeling of computing systems in International Green Computing Conference, 1
- tang, 2014, Unsupervised anomalybased malware detection using hardware features in Symposium on Recent Advances in Attacks and Defenses, 109
- 10.1145/2508148.2485970 · DOI · Paper page
- weaver, 2013, Linux perf_event features and overhead in International Workshop on Performance Analysis of Workload Optimized Systems
- 10.1109/HPCA.2016.7446083 · DOI
- mucci, 1999, PAPI A portable interface to hardware performance counters in Department of Defense HPCMP Users Group Conference, 7
- malladi, 2009, Using Intel� VTuneTM Performance Analyzer Events/Ratios Optimizing Applications
- 10.1109/TC.2011.233 · doi:10.1109/tc.2011.233
- chen, 2010, Taming hardware event samples for FDO compilation, International Symposium on Code Generation and Optimization, 42
- 10.1145/2628071.2628099 · doi:10.1145/2628071.2628099
- tuduce, 2010, Asymmetries in multi-core systems-or why we need better performance measurement units, Exascale Evaluation and Research Techniques Workshop
- lim, 2014, Computationally efficient multiplexing of events on hardware counters, Linux Symposium, 101
- nowak, 2015, Establishing a Base of Trust with Performance Counters for Enterprise Workloads, USENIX Annual Technical Conference, 541
- o’callahan, 2017, Engineering record and replay for deployability, USENIX Annual Technical Conference, 377
- 10.1007/978-3-642-24403-2_23 · doi:10.1007/978-3-642-24403-2_23
- suciu, 2011, Unpredictable random number generator based on hardware performance counters, 189, 123
- 10.1016/j.suscom.2017.05.003 · doi:10.1016/j.suscom.2017.05.003
- singh, 2009, Prediction Strategies for Power-Aware Computing on Multicore Processors
- goel, 2011, Per-core power estimation and power aware scheduling strategies for CMPs
- 10.1145/3052973.3052999 · DOI
- zhou, 2014, HDROP: Detecting ROP attacks using performance monitoring counters, Proceedings of the 4th International Conference on Information Security Practice and Experience, 172, 10.1007/978-3-319-06320-1_14 · doi:10.1007/978-3-319-06320-1_14
- 10.1109/SYNASC.2012.64 · DOI
- 10.1109/ICPPW.2010.38 · DOI · Paper page
- wang, 2016, SIGDROP: Signature-based ROP Detection using Hardware Performance Counters, arXiv preprint arXiv 1609 09861
- 10.1016/j.cose.2017.11.011 · doi:10.1016/j.cose.2017.11.011
- 10.1016/j.future.2015.05.013 · doi:10.1016/j.future.2015.05.013
- 10.1109/TCAD.2014.2387856 · doi:10.1109/tcad.2014.2387856
- lundberg, 2017, Implementation of Fast Real-Time Control of Unstable Modes in Fusion Plasma Devices
- 10.1109/CLUSTER.2015.73 · doi:10.1109/cluster.2015.73
- 10.1145/2962564.2962573 · doi:10.1145/2962564.2962573
- al-hayanni, 2017, Speedup and Parallelization Models for Energy-Efficient Many-Core Systems Using Performance Counters, International Conference on High Performance Computing – Simulation, 410
- 10.4018/ijssoe.2014040103 · doi:10.4018/ijssoe.2014040103
- bergan, 2010, Deterministic Process Groups in dOS, OSDI, 177
- stefan, 2013, Eliminating cache-based timing attacks with instruction-based scheduling, European symposium on research in computer security, 718
- 10.1145/258916.258924 · DOI
- singh, 2009, Real time power estimation and thread scheduling via performance counters, ACM SIGARCH Computer Architecture News, 37, 46, 10.1145/1577129.1577137 · DOI
- 2016, IA-32 Inter Architecture Software Developer s Manual Volume 3 System Programming Guide
- spisak, 2016, Hardware-Assisted Rootkits: Abusing Performance Counters on the ARM and x86 Architectures, WOOT
- 10.1109/FDTC.2008.19 · DOI
- vogl, 2012, Using hardware performance events for instruction-level monitoring on the x86 architecture, European Workshop on System Security
- martin, 2012, TimeWarp: rethinking timekeeping and performance monitoring mechanisms to mitigate side-channel attacks, ACM SIGARCH Computer Architecture News, 40, 118, 10.1145/2366231.2337173 · DOI
- bruska, 2017, Verification of OpenSSL version via hardware performance counters, Disruptive Technologies in Sensors and Sensor Systems
- 10.1007/978-981-10-2209-8_5 · doi:10.1007/978-981-10-2209-8_5
- 10.1109/TMSCS.2016.2569467 · DOI
- 10.1145/3061639.3062202 · DOI
- 10.1109/ICCAD.2015.7372617 · DOI
- 10.1109/VLSID.2016.115 · doi:10.1109/vlsid.2016.115
- allaf, 2017, A comparison study on Flush+ Reload and Prime+ Probe attacks on AES using machine learning approaches, UK Workshop on Computational Intelligence, 203
- 10.1145/3052973.3052978 · DOI
- gulmezoglu, 2017, PerfWeb: How to violate web privacy with hardware performance events, European symposium on research in computer security, 80
- zhang, 2016, Cloudradar: A real-time side-channel attack detection system in clouds, Symposium on Recent Advances in Attacks and Defenses, 118
- heaven, 2014, Computer Virus Collection
- sebastián, 2016, Avclass: A tool for massive malware labeling, Symposium on Recent Advances in Attacks and Defenses, 230
- luk, 2005, Pin Building Customized Program Analysis Tools with Dynamic Instrumentation, 40, 190
- maurice, 2018, Reverse engineering Intel last-level cache complex addressing using performance counters, Symposium on Recent Advances in Attacks and Defenses, 48
- 10.1109/HPCA.2015.7056069 · DOI
- bhattacharya, 2015, Who watches the watchmen?: Utilizing Performance Monitors for Compromising keys of RSA on Intel Platforms, Conference on Cryptographic Hardware and Embedded Systems, 248
- chiappetta, 2016, Real time detection of cache-based side-channel attacks using hardware performance counters, Applied Soft Computing, 49, 1162, 10.1016/j.asoc.2016.09.014 · DOI · Paper page
- bird, 2010, Software knows best A case for hardware transparency and measurability
- 10.1016/j.procs.2015.05.498 · DOI
- 10.6028/jres.118.012 · doi:10.6028/jres.118.012
- lim, 2015, ldentifying optimization opportunities within kernel execution in GPU codes in European Conference on Parallel Processing, 185
- 10.1016/j.procs.2016.05.486 · doi:10.1016/j.procs.2016.05.486
- 10.1002/cpe.4401 · DOI
- weaver, 2015, Self-monitoring overhead of the Linux perf event performance counter interface, IEEE International Symposium on Performance Analysis of Systems and Software, 102
- doyle, 2017, Performance impacts and limitations of hardware memory access trace collection in Design Automation & Test in Europe, 506
- aweke, 2016, ANVIL: Software-based protection against next-generation rowhammer attacks, ACM SIGPLAN Notices, 51, 743, 10.1145/2954679.2872390 · doi:10.1145/2954679.2872390
- weaver, 2016, Advanced hardware profiling and sampling (PEBS IBS etc ) creating a new PAPI sampling interface
- zhou, 2012, Exploiting parallelism in deterministic shared memory multiprocessing, Journal of Parallel and Distributed Computing, 72, 716, 10.1016/j.jpdc.2012.02.008 · DOI
- 10.1145/2103799.2103807 · doi:10.1145/2103799.2103807
- mushtaq, 2012, DetLock portable and efficient deterministic execution for shared memory multicore systems in High Petformance Computing Networking Storage and Analysis, 721
- herath, 2015, These are Not Your Grand Daddys CPU Performance Counters-CPU Hardware Performance Counters for Security, Black Hat
- maxwell, 2002, Accuracy of performance monitoring hardware, Los Alamos Computer Science Institute Symposium
- pruitt, 2016, Preliminary investigation of mobile system features potentially relevant to HPC in International Workshop on Energy Efficient Supercomputing, 54
- 10.1145/2948618.2948620 · doi:10.1145/2948618.2948620
- 10.1109/SP.2012.14 · DOI · Paper page
- 10.1109/SP.2010.25 · DOI · Paper page
- xia, 2012, CFIMon: Detecting violation of control flow integrity using performance counters, IEEE/IFIP International Conference on Dependable Systems and Networks, 1
- bouckaert, 2010, WEKA Manual for Version 3 7 2, 588
- 10.1145/3196494.3196515 · DOI
- 2015, Anomaly detection for malware identification using hardware performance counters, arXiv preprint arXiv 1508 07482
- 10.1109/SP.2017.38 · DOI
- 10.1109/ICCKE.2014.6993402 · DOI
- 10.1109/TCAD.2015.2474374 · DOI
- 10.1145/2611765.2611767 · DOI
- 10.1145/2857055 · DOI
Cited by
Dynamic Malware Analysis in the Modern Era—A State of the Art Survey
Or-Meir, O., Nissim, N., Elovici, Y., & Rokach, L. (2020) · ACM Computing Surveys · doi:10.1145/3329786 · Cited by 384
Evaluating the Security Posture of Real-World FIDO2 Deployments
Kuchhal, D., Saad, M., Oest, A., & Li, F. (2023) · Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/3576915.3623063 · Cited by 22
“The FIDO2 Client’s privileged access could further be utilized to fingerprint the user’s presence via kernel-level events [28], device characteristics [29, 31], or even hardware-level features [35].”
Background
Metadata
- Authors
- Das, S., Werner, J., Antonakakis, M., Polychronakis, M., & Monrose, F.
- Venue
- 2019 IEEE Symposium on Security and Privacy (SP)
- Publisher
- IEEE
- Published
- 2019-05
- Pages
- 20-38
- ISSN
- 1081-6011 (ISSN-L)
- OpenAlex
- W2932551155
- Cited by
- 179
- References
- 1
- FWCI
- 9.12
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: SoK: The Challenges, Pitfalls, and Perils of Using Hardware Performance Counters for Security. https://app.cochat.ai/papers/10.1109/sp.2019.00021
- The paper
- Das, S., Werner, J., Antonakakis, M., Polychronakis, M., & Monrose, F. (2019). SoK: The Challenges, Pitfalls, and Perils of Using Hardware Performance Counters for Security. 2019 IEEE Symposium on Security and Privacy (SP). https://doi.org/10.1109/sp.2019.00021
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.