Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 179

The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.

SoK: The Challenges, Pitfalls, and Perils of Using Hardware Performance Counters for Security

Open access
Das, Sanjeev, Werner, Jan, Antonakakis, Manos, Polychronakis, Michalis, Monrose, Fabian·2019·2019 IEEE Symposium on Security and Privacy (SP)

Abstract

Hardware Performance Counters (HPCs) have been available in processors for more than a decade. These counters can be used to monitor and measure events that occur at the CPU level. Modern processors provide hundreds of hardware events that can be monitored, and with each new processor architecture more are added. Yet, there has been little in the way of systematic studies on how performance counters can best be utilized to accurately monitor events in real-world settings. Especially when it comes to the use of HPCs for security applications, measurement imprecisions or incorrect assumptions regarding the measured values can undermine the offered protection. To shed light on this issue, we embarked on a year-long effort to (i) study the best practices for obtaining accurate measurement of events using performance counters, (ii) understand the challenges and pitfalls of using HPCs in various settings, and (iii) explore ways to obtain consistent and accurate measurements across different settings and architectures. Additionally, we then empirically evaluated the way HPCs have been used throughout a wide variety of papers. Not wanting to stop there, we explored whether these widely used techniques are in fact obtaining performance counter data correctly. As part of that assessment, we (iv) extended the seminal work of Weaver and McKee from almost 10 years ago on non-determinism in HPCs, and applied our findings to 56 papers across various application domains. In that follow-up study, we found the acceptance of HPCs in security applications is in stark contrast to other application areas - especially in the last five years. Given that, we studied an additional representative set of 41 works from the security literature that rely on HPCs, to better elucidate how the intricacies we discovered can impact the soundness and correctness of their approaches and conclusions. Toward that goal, we (i) empirically evaluated how failure to accommodate for various subtleties in the use of HPCs can undermine the effectiveness of security applications, specifically in the case of exploit prevention and malware detection. Lastly, we showed how (ii) an adversary can manipulate HPCs to bypass certain security defenses.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1109/sp.2019.00021

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 1 references

Research works printed but not linked: 120

  1. weaver, 2010, Can hardware performance counters produce expected, deterministic results?, The 3rd Workshop on Functionality of Hardware Performance Monitoring
  2. 10.1109/ISPASS.2009.4919635 · DOI
  3. 10.1109/IISWC.2008.4636099 · doi:10.1109/iiswc.2008.4636099
  4. 10.1007/978-3-319-15618-7_6 · doi:10.1007/978-3-319-15618-7_6
  5. 10.1145/2843859.2843865 · doi:10.1145/2843859.2843865
  6. 10.1145/2768566.2768575 · doi:10.1145/2768566.2768575
  7. levon, 2004, OProfile A system profiler for Linux
  8. russinovich, 2012, Windows Internals
  9. li, 2014, Transparent ROP Detection using CPU Performance Counters, Threads
  10. 10.1109/ISPASS.2013.6557172 · doi:10.1109/ispass.2013.6557172
  11. 10.1145/2046582.2046596 · doi:10.1145/2046582.2046596
  12. 10.7873/DATE.2013.194 · doi:10.7873/date.2013.194
  13. irazoqui, 2017, Cross-core Microarchitectural Side Channel Attacks and Countermeasures
  14. molnár, 2017, Measuring performance of processor instructions and operating system services in soft processor based systems in International Carpathian Control Conference, 381
  15. 10.1007/s11390-015-1503-8 · DOI
  16. lu, 2014, Efficient deterministic multithreading without global barriers, ACM SIGPLAN Notices, 49, 287, 10.1145/2692916.2555252 · doi:10.1145/2692916.2555252
  17. hussein, 2015, Impact of GC design on power and performance for Android in ACM International Systems and Storage Conference, 13:1
  18. 10.4018/978-1-5225-2845-6.ch013 · DOI
  19. payer, 2016, HexPADS: a platform to detect “stealth” attacks, International Symposium on Engineering Secure Software and Systems, 138, 10.1007/978-3-319-30806-7_9 · DOI
  20. 10.1109/IISWC.2012.6402920 · DOI
  21. gruss, 2016, Flush+ Flush: a fast and stealthy cache attack, Detection of Intrusions and Malware and Vulnerability Assessment, 279, 10.1007/978-3-319-40667-1_14 · DOI · Paper page
  22. davis, 2011, No hardware required: building and validating composable highly accurate OS-based power models, Microsofl Technical Report
  23. röhl, 2016, Tools for High Performance Computing, 17
  24. hoske, 2014, An experimental study of a nearly-linear time Laplacian solver
  25. 10.1145/2741948.2741960 · DOI
  26. 10.1145/2887746.2754182 · doi:10.1145/2887746.2754182
  27. 10.1137/120870761 · DOI
  28. wicht, 2014, Hardware counted profile-guided optimization, arXiv preprint arXiv 1411 6361
  29. 10.1109/IPDPSW.2016.126 · doi:10.1109/ipdpsw.2016.126
  30. 10.1145/2818950.2818957 · doi:10.1145/2818950.2818957
  31. 10.1145/3095770.3095773 · doi:10.1145/3095770.3095773
  32. born de oliveira, 2015, Measuring and predicting computer software performance Tools and approaches
  33. rohou, 2012, Tiptop Hardware performance counters for the masses in International Conference on Parallel Processing Workshops, 404
  34. 10.1145/2463209.2488831 · DOI
  35. zamani, 2012, A study of hardware performance monitoring counter selection in power modeling of computing systems in International Green Computing Conference, 1
  36. tang, 2014, Unsupervised anomalybased malware detection using hardware features in Symposium on Recent Advances in Attacks and Defenses, 109
  37. 10.1145/2508148.2485970 · DOI · Paper page
  38. weaver, 2013, Linux perf_event features and overhead in International Workshop on Performance Analysis of Workload Optimized Systems
  39. 10.1109/HPCA.2016.7446083 · DOI
  40. mucci, 1999, PAPI A portable interface to hardware performance counters in Department of Defense HPCMP Users Group Conference, 7
  41. malladi, 2009, Using Intel� VTuneTM Performance Analyzer Events/Ratios Optimizing Applications
  42. 10.1109/TC.2011.233 · doi:10.1109/tc.2011.233
  43. chen, 2010, Taming hardware event samples for FDO compilation, International Symposium on Code Generation and Optimization, 42
  44. 10.1145/2628071.2628099 · doi:10.1145/2628071.2628099
  45. tuduce, 2010, Asymmetries in multi-core systems-or why we need better performance measurement units, Exascale Evaluation and Research Techniques Workshop
  46. lim, 2014, Computationally efficient multiplexing of events on hardware counters, Linux Symposium, 101
  47. nowak, 2015, Establishing a Base of Trust with Performance Counters for Enterprise Workloads, USENIX Annual Technical Conference, 541
  48. o’callahan, 2017, Engineering record and replay for deployability, USENIX Annual Technical Conference, 377
  49. 10.1007/978-3-642-24403-2_23 · doi:10.1007/978-3-642-24403-2_23
  50. suciu, 2011, Unpredictable random number generator based on hardware performance counters, 189, 123
  51. 10.1016/j.suscom.2017.05.003 · doi:10.1016/j.suscom.2017.05.003
  52. singh, 2009, Prediction Strategies for Power-Aware Computing on Multicore Processors
  53. goel, 2011, Per-core power estimation and power aware scheduling strategies for CMPs
  54. 10.1145/3052973.3052999 · DOI
  55. zhou, 2014, HDROP: Detecting ROP attacks using performance monitoring counters, Proceedings of the 4th International Conference on Information Security Practice and Experience, 172, 10.1007/978-3-319-06320-1_14 · doi:10.1007/978-3-319-06320-1_14
  56. 10.1109/SYNASC.2012.64 · DOI
  57. 10.1109/ICPPW.2010.38 · DOI · Paper page
  58. wang, 2016, SIGDROP: Signature-based ROP Detection using Hardware Performance Counters, arXiv preprint arXiv 1609 09861
  59. 10.1016/j.cose.2017.11.011 · doi:10.1016/j.cose.2017.11.011
  60. 10.1016/j.future.2015.05.013 · doi:10.1016/j.future.2015.05.013
  61. 10.1109/TCAD.2014.2387856 · doi:10.1109/tcad.2014.2387856
  62. lundberg, 2017, Implementation of Fast Real-Time Control of Unstable Modes in Fusion Plasma Devices
  63. 10.1109/CLUSTER.2015.73 · doi:10.1109/cluster.2015.73
  64. 10.1145/2962564.2962573 · doi:10.1145/2962564.2962573
  65. al-hayanni, 2017, Speedup and Parallelization Models for Energy-Efficient Many-Core Systems Using Performance Counters, International Conference on High Performance Computing – Simulation, 410
  66. 10.4018/ijssoe.2014040103 · doi:10.4018/ijssoe.2014040103
  67. bergan, 2010, Deterministic Process Groups in dOS, OSDI, 177
  68. stefan, 2013, Eliminating cache-based timing attacks with instruction-based scheduling, European symposium on research in computer security, 718
  69. 10.1145/258916.258924 · DOI
  70. singh, 2009, Real time power estimation and thread scheduling via performance counters, ACM SIGARCH Computer Architecture News, 37, 46, 10.1145/1577129.1577137 · DOI
  71. 2016, IA-32 Inter Architecture Software Developer s Manual Volume 3 System Programming Guide
  72. spisak, 2016, Hardware-Assisted Rootkits: Abusing Performance Counters on the ARM and x86 Architectures, WOOT
  73. 10.1109/FDTC.2008.19 · DOI
  74. vogl, 2012, Using hardware performance events for instruction-level monitoring on the x86 architecture, European Workshop on System Security
  75. martin, 2012, TimeWarp: rethinking timekeeping and performance monitoring mechanisms to mitigate side-channel attacks, ACM SIGARCH Computer Architecture News, 40, 118, 10.1145/2366231.2337173 · DOI
  76. bruska, 2017, Verification of OpenSSL version via hardware performance counters, Disruptive Technologies in Sensors and Sensor Systems
  77. 10.1007/978-981-10-2209-8_5 · doi:10.1007/978-981-10-2209-8_5
  78. 10.1109/TMSCS.2016.2569467 · DOI
  79. 10.1145/3061639.3062202 · DOI
  80. 10.1109/ICCAD.2015.7372617 · DOI
  81. 10.1109/VLSID.2016.115 · doi:10.1109/vlsid.2016.115
  82. allaf, 2017, A comparison study on Flush+ Reload and Prime+ Probe attacks on AES using machine learning approaches, UK Workshop on Computational Intelligence, 203
  83. 10.1145/3052973.3052978 · DOI
  84. gulmezoglu, 2017, PerfWeb: How to violate web privacy with hardware performance events, European symposium on research in computer security, 80
  85. zhang, 2016, Cloudradar: A real-time side-channel attack detection system in clouds, Symposium on Recent Advances in Attacks and Defenses, 118
  86. heaven, 2014, Computer Virus Collection
  87. sebastián, 2016, Avclass: A tool for massive malware labeling, Symposium on Recent Advances in Attacks and Defenses, 230
  88. luk, 2005, Pin Building Customized Program Analysis Tools with Dynamic Instrumentation, 40, 190
  89. maurice, 2018, Reverse engineering Intel last-level cache complex addressing using performance counters, Symposium on Recent Advances in Attacks and Defenses, 48
  90. 10.1109/HPCA.2015.7056069 · DOI
  91. bhattacharya, 2015, Who watches the watchmen?: Utilizing Performance Monitors for Compromising keys of RSA on Intel Platforms, Conference on Cryptographic Hardware and Embedded Systems, 248
  92. chiappetta, 2016, Real time detection of cache-based side-channel attacks using hardware performance counters, Applied Soft Computing, 49, 1162, 10.1016/j.asoc.2016.09.014 · DOI · Paper page
  93. bird, 2010, Software knows best A case for hardware transparency and measurability
  94. 10.1016/j.procs.2015.05.498 · DOI
  95. 10.6028/jres.118.012 · doi:10.6028/jres.118.012
  96. lim, 2015, ldentifying optimization opportunities within kernel execution in GPU codes in European Conference on Parallel Processing, 185
  97. 10.1016/j.procs.2016.05.486 · doi:10.1016/j.procs.2016.05.486
  98. 10.1002/cpe.4401 · DOI
  99. weaver, 2015, Self-monitoring overhead of the Linux perf event performance counter interface, IEEE International Symposium on Performance Analysis of Systems and Software, 102
  100. doyle, 2017, Performance impacts and limitations of hardware memory access trace collection in Design Automation & Test in Europe, 506
  101. aweke, 2016, ANVIL: Software-based protection against next-generation rowhammer attacks, ACM SIGPLAN Notices, 51, 743, 10.1145/2954679.2872390 · doi:10.1145/2954679.2872390
  102. weaver, 2016, Advanced hardware profiling and sampling (PEBS IBS etc ) creating a new PAPI sampling interface
  103. zhou, 2012, Exploiting parallelism in deterministic shared memory multiprocessing, Journal of Parallel and Distributed Computing, 72, 716, 10.1016/j.jpdc.2012.02.008 · DOI
  104. 10.1145/2103799.2103807 · doi:10.1145/2103799.2103807
  105. mushtaq, 2012, DetLock portable and efficient deterministic execution for shared memory multicore systems in High Petformance Computing Networking Storage and Analysis, 721
  106. herath, 2015, These are Not Your Grand Daddys CPU Performance Counters-CPU Hardware Performance Counters for Security, Black Hat
  107. maxwell, 2002, Accuracy of performance monitoring hardware, Los Alamos Computer Science Institute Symposium
  108. pruitt, 2016, Preliminary investigation of mobile system features potentially relevant to HPC in International Workshop on Energy Efficient Supercomputing, 54
  109. 10.1145/2948618.2948620 · doi:10.1145/2948618.2948620
  110. 10.1109/SP.2012.14 · DOI · Paper page
  111. 10.1109/SP.2010.25 · DOI · Paper page
  112. xia, 2012, CFIMon: Detecting violation of control flow integrity using performance counters, IEEE/IFIP International Conference on Dependable Systems and Networks, 1
  113. bouckaert, 2010, WEKA Manual for Version 3 7 2, 588
  114. 10.1145/3196494.3196515 · DOI
  115. 2015, Anomaly detection for malware identification using hardware performance counters, arXiv preprint arXiv 1508 07482
  116. 10.1109/SP.2017.38 · DOI
  117. 10.1109/ICCKE.2014.6993402 · DOI
  118. 10.1109/TCAD.2015.2474374 · DOI
  119. 10.1145/2611765.2611767 · DOI
  120. 10.1145/2857055 · DOI

Cited by

See all 179

Metadata

Authors
Das, S., Werner, J., Antonakakis, M., Polychronakis, M., & Monrose, F.
Venue
2019 IEEE Symposium on Security and Privacy (SP)
Publisher
IEEE
Published
2019-05
Pages
20-38
ISSN
1081-6011 (ISSN-L)
OpenAlex
W2932551155
Cited by
179
References
1
FWCI
9.12
Type
conference paper
Language
en
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: SoK: The Challenges, Pitfalls, and Perils of Using Hardware Performance Counters for Security. https://app.cochat.ai/papers/10.1109/sp.2019.00021
The paper
Das, S., Werner, J., Antonakakis, M., Polychronakis, M., & Monrose, F. (2019). SoK: The Challenges, Pitfalls, and Perils of Using Hardware Performance Counters for Security. 2019 IEEE Symposium on Security and Privacy (SP). https://doi.org/10.1109/sp.2019.00021

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.