The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Anomaly detection with density estimation
Open accessAbstract
We leverage recent breakthroughs in neural density estimation to propose a new unsupervised ANOmaly detection with Density Estimation (ANODE) technique. By estimating the conditional probability density of the data in a signal region and in sidebands, and interpolating the latter into the signal region, a fully data-driven likelihood ratio of data versus background can be constructed. This likelihood ratio is broadly sensitive to overdensities in the data that could be due to localized anomalies. In addition, a unique potential benefit of the ANODE method is that the background can be directly estimated using the learned densities. Finally, ANODE is robust against systematic differences between signal region and sidebands, giving it broader applicability than other methods. We demonstrate the power of this new approach using the LHC Olympics 2020 R dataset. We show how ANODE can enhance the significance of a dijet bump hunt by up to a factor of 7 with a 10% accuracy on the background prediction. While the LHC is used as the recurring example, the methods developed here have a much broader applicability to anomaly detection in physics and beyond.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
(2014) · Cited by 33,419
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,387
Advances in neural information processing systems 7
(1996) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(96)90463-0 · Cited by 14,281
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,886
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2002) · Advances in Neural Information Processing Systems 14 · doi:10.7551/mitpress/1120.003.0082 · Cited by 12,223
TensorFlow: A system for large-scale machine learning
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.08695 · Cited by 11,822
Sjöstrand, T., Mrenna, S., & Skands, P. (2006) · Journal of High Energy Physics · doi:10.1088/1126-6708/2006/05/026 · Cited by 8,952
The anti-ktjet clustering algorithm
Cacciari, M., Salam, G. P., & Soyez, G. (2008) · Journal of High Energy Physics · doi:10.1088/1126-6708/2008/04/063 · Cited by 7,140
A brief introduction to PYTHIA 8.1
Sjöstrand, T., Mrenna, S., & Skands, P. (2008) · Computer Physics Communications · doi:10.1016/j.cpc.2008.01.036 · Cited by 5,435
DELPHES 3: a modular framework for fast simulation of a generic collider experiment
The DELPHES 3 collaboration, de Favereau, J., Delaere, C., Demin, P., Giammanco, A., Lemaître, V., Mertens, A., & Selvaggi, M. (2014) · Journal of High Energy Physics · doi:10.1007/jhep02(2014)057 · Cited by 2,966
Generative Adversarial Networks
(2022) · The Science of Deep Learning · doi:10.1017/9781108891530.013 · Cited by 2,402
Proceedings of The 32nd International Conference on Machine Learning
Germain, M., Gregor, K., Murray, I., & Larochelle, H. (2015) · Cited by 2,020
ON THE PROBLEM OF THE MOST EFFICIENT TESTS OF STATISTICAL HYPOTHESES
(1967) · Joint Statistical Papers · doi:10.1525/9780520339897-008 · Cited by 1,504
Variational Inference with Normalizing Flows
Rezende, D. J., & Mohamed, S. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1505.05770 · Cited by 1,253
Identifying boosted objects with N-subjettiness
Thaler, J., & Van Tilburg, K. (2011) · Journal of High Energy Physics · doi:10.1007/jhep03(2011)015 · Cited by 881
Image datasets for Neural Spline Flows experimentsPreprint
Durkan, C., Bekasov, A., Murray, I., & Papamakarios, G. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.04032 · Cited by 502
MADE: Masked Autoencoder for Distribution Estimation
Germain, M., Gregor, K., Murray, I., & Larochelle, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1502.03509 · Cited by 448
Maximizing boosted top identification by minimizing N-subjettiness
Thaler, J., & Van Tilburg, K. (2012) · Journal of High Energy Physics · doi:10.1007/jhep02(2012)093 · Cited by 387
Paganini, M., de Oliveira, L., & Nachman, B. (2018) · Physical Review D · doi:10.1103/physrevd.97.014021 · Cited by 370
Self-citationAaboud, M., Aad, G., Abbott, B., Abdinov, O., Abeloos, B., Abhayasinghe, D. K., Abidi, S. H., AbouZeid, O. S., Abraham, N. L., Abramowicz, H., et al. (2018) · Physics Letters B · doi:10.1016/j.physletb.2018.07.035 · Cited by 355
Self-citationde Oliveira, L., Paganini, M., & Nachman, B. (2017) · Computing and Software for Big Science · doi:10.1007/s41781-017-0004-6 · Cited by 293
Self-citationClassification without labels: learning from mixed samples in high energy physics
Metodiev, E. M., Nachman, B., & Thaler, J. (2017) · Journal of High Energy Physics · doi:10.1007/jhep10(2017)174 · Cited by 287
Self-citationAad, G., Abbott, B., Abbott, D. C., Abud, A. A., Abeling, K., Abhayasinghe, D. K., Abidi, S. H., AbouZeid, O. S., Abraham, N. L., Abramowicz, H., et al. (2020) · Journal of High Energy Physics · doi:10.1007/jhep03(2020)145 · Cited by 283
Paganini, M., de Oliveira, L., & Nachman, B. (2018) · Physical Review Letters · doi:10.1103/physrevlett.120.042003 · Cited by 279
Self-citationHeimel, T., Kasieczka, G., Plehn, T., & Thompson, J. (2019) · SciPost Physics · doi:10.21468/scipostphys.6.3.030 · Cited by 279
Searching for new physics with deep autoencoders
Farina, M., Nakai, Y., & Shih, D. (2020) · Physical Review D · doi:10.1103/physrevd.101.075021 · Cited by 266
Self-citationAnomaly Detection for Resonant New Physics with Machine Learning
Collins, J., Howe, K., & Nachman, B. (2018) · Physical Review Letters · doi:10.1103/physrevlett.121.241803 · Cited by 248
Self-citationErdmann, M., Glombitza, J., & Quast, T. (2019) · Computing and Software for Big Science · doi:10.1007/s41781-018-0019-7 · Cited by 242
JUNIPR: a framework for unsupervised machine learning in particle physics
Andreassen, A., Feige, I., Frye, C., & Schwartz, M. D. (2019) · The European Physical Journal C · doi:10.1140/epjc/s10052-019-6607-9 · Cited by 222
Flow-based generative models for Markov chain Monte Carlo in lattice field theory
Albergo, M. S., Kanwar, G., & Shanahan, P. E. (2019) · Physical Review D · doi:10.1103/physrevd.100.034515 · Cited by 220
Learning new physics from a machine
D’Agnolo, R. T., & Wulzer, A. (2019) · Physical Review D · doi:10.1103/physrevd.99.015014 · Cited by 203
Extending the search for new resonances with machine learning
Collins, J. H., Howe, K., & Nachman, B. (2019) · Physical Review D · doi:10.1103/physrevd.99.014038 · Cited by 186
Self-citationSipio, R. D., Giannelli, M. F., Haghighat, S. K., & Palazzo, S. (2019) · Journal of High Energy Physics · doi:10.1007/jhep08(2019)110 · Cited by 185
Erdmann, M., Geiger, L., Glombitza, J., & Schmidt, D. M. (2018) · Computing and Software for Big Science · doi:10.1007/s41781-018-0008-x · Cited by 184
Variational autoencoders for new physics mining at the Large Hadron Collider
Cerri, O., Nguyen, T. Q., Maurizio Pierini, B., Spiropulu, M., & Vlimant, J.-R. (2019) · Journal of High Energy Physics · doi:10.1007/jhep05(2019)036 · Cited by 174
Butter, A., Plehn, T., & Winterhalder, R. (2019) · SciPost Physics · doi:10.21468/scipostphys.7.6.075 · Cited by 171
Novelty detection meets collider physics
Hajer, J., Li, Y.-Y., Liu, T., & Wang, H. (2020) · Physical review. D/Physical review. D. · doi:10.1103/physrevd.101.076015 · Cited by 166
Improving Variational Inference with Inverse Autoregressive Flow
Kingma, D. P., Salimans, T., Józefowicz, R., Chen, X., Sutskever, I., & Welling, M. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1606.04934 · Cited by 164
Aaboud, M., Aad, G., Abbott, B., Abdinov, O., Abeloos, B., Abidi, S. H., AbouZeid, O. S., Abraham, N. L., Abramowicz, H., Abreu, H., et al. (2018) · The European Physical Journal C · doi:10.1140/epjc/s10052-018-5686-3 · Cited by 159
Variational autoencoders for new physics mining at the Large Hadron Collider
Cerri, O. (2024) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · doi:10.1007/jhep05%282019%29036 · Cited by 151
Fast and Accurate Simulation of Particle Detectors Using Generative Adversarial Networks
Musella, P., & Pandolfi, F. (2018) · Computing and Software for Big Science · doi:10.1007/s41781-018-0015-y · Cited by 147
Adversarially-trained autoencoders for robust unsupervised new physics searches
Blance, A., Spannowsky, M., & Waite, P. (2019) · Journal of High Energy Physics · doi:10.1007/jhep10(2019)047 · Cited by 144
Guiding new physics searches with unsupervised learning
Andrea De Simone, A., & Jacques, T. (2019) · The European Physical Journal C · doi:10.1140/epjc/s10052-019-6787-3 · Cited by 140
Unfolding with Generative Adversarial NetworksPreprint
Datta, K., Kar, D., & Roy, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.00433 · Cited by 133
Simulation assisted likelihood-free anomaly detection
Andreassen, A., Nachman, B., & Shih, D. (2020) · Physical Review D · doi:10.1103/physrevd.101.095004 · Cited by 123
Self-citationDecorrelated jet substructure tagging using adversarial neural networks
Shimmin, C., Sadowski, P., Baldi, P., Weik, E., Whiteson, D., Goul, E., & Søgaard, A. (2017) · Physical Review D · doi:10.1103/physrevd.96.074034 · Cited by 121
Regressive and generative neural networks for scalar field theory
Zhou, K., Endrődi, G., Pang, L.-G., & Horst Stöcker, B. (2019) · Physical review. D/Physical review. D. · doi:10.1103/physrevd.100.011501 · Cited by 120
LHC analysis-specific datasets with Generative Adversarial NetworksPreprint
Hashemi, B., Amin, N., Datta, K., Olivito, D., & Maurizio Pierini, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1901.05282 · Cited by 117
Learning multivariate new physics
D’Agnolo, R. T., Grosso, G., Maurizio Pierini, B., Wulzer, A., & Zanetti, M. (2021) · The European Physical Journal C · doi:10.1140/epjc/s10052-021-08853-y · Cited by 117
Uncovering latent jet substructure
Dillon, B. M., Faroughy, D. A., & Kamenik, J. F. (2019) · Physical review. D/Physical review. D. · doi:10.1103/physrevd.100.056002 · Cited by 113
Mertens, A. (2015) · Journal of Physics Conference Series · doi:10.1088/1742-6596/608/1/012045 · Cited by 107
A robust anomaly finder based on autoencodersPreprint
Roy, T. S., & Vijay, A. H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.02032 · Cited by 107
Abbott, B., Abolins, M., Abramov, V., Acharya, B. S., Adams, D. L., Adams, M. R., Alves, G. A., Amos, N., Anderson, E. W., Baarmand, M. M., et al. (2000) · Physical review. D. Particles, fields, gravitation, and cosmology/Physical review. D. Particles and fields · doi:10.1103/physrevd.62.092004 · Cited by 94
Generative Models for Fast Calorimeter Simulation: the LHCb case>
Chekalina, V., Orlova, E., Ratnikov, F., Ulyanov, D., Ustyuzhanin, A., & Zakharov, E. (2019) · EPJ Web of Conferences · doi:10.1051/epjconf/201921402034 · Cited by 86
Robust Jet Classifiers through Distance Correlation
Kasieczka, G., & Shih, D. (2020) · Physical Review Letters · doi:10.1103/physrevlett.125.122001 · Cited by 76
Self-citationLund jet images from generative and cycle-consistent adversarial networks
Carrazza, S., & Dreyer, F. A. (2019) · The European Physical Journal C · doi:10.1140/epjc/s10052-019-7501-1 · Cited by 75
Machine learning uncertainties with adversarial neural networks
Englert, C., Galler, P., Harris, P., & Spannowsky, M. (2019) · The European Physical Journal C · doi:10.1140/epjc/s10052-018-6511-8 · Cited by 72
Modeling Smooth Backgrounds and Generic Localized Signals with Gaussian ProcessesPreprint
Frate, M., Whiteson, D., Kalia, S., Cranmer, K., & Vandenberg-Rodes, A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.05681 · Cited by 66
Fast simulation of muons produced at the SHiP experiment using Generative Adversarial Networks
Ahdida, C., Albanese, R., Alexandrov, A., Anokhina, A., Aoki, S., Arduini, G., Atkin, E., Azorskiy, N., Back, J. J., Bagulya, A., et al. (2019) · Journal of Instrumentation · doi:10.1088/1748-0221/14/11/p11028 · Cited by 63
uBoost: a boosting method for producing uniform selection efficiencies from multivariate classifiers
Stevens, J. R., & Williams, M. (2013) · Journal of Instrumentation · doi:10.1088/1748-0221/8/12/p12013 · Cited by 48
Xia, L. G. (2019) · Nuclear Instruments and Methods in Physics Research Section A Accelerators Spectrometers Detectors and Associated Equipment · doi:10.1016/j.nima.2019.03.088 · Cited by 35
binary junipr: An Interpretable Probabilistic Model for Discrimination
Andreassen, A., Feige, I., Frye, C., et al. (2019) · Physical Review Letters · doi:10.1103/physrevlett.123.182001 · Cited by 34
Generative models for fast cluster simulations in the TPC for the ALICE experiment
Deja, K. R., Trzcinski, T. P., & Graczykowski, L. K. (2019) · EPJ Web of Conferences · doi:10.1051/epjconf/201921406003 · Cited by 31
Wünsch, S., Jörger, S., Wolf, R., et al. (2020) · Repository KITopen (Karlsruhe Institute of Technology) · doi:10.5445/ir/1000123325 · Cited by 25
Machine learning templates for QCD factorization in the search for physics beyond the standard model
Lin, J., Bhimji, W., & Nachman, B. (2019) · Journal of High Energy Physics · doi:10.1007/jhep05(2019)181 · Cited by 24
Self-citationGenerative Models for Fast Cluster Simulations in the TPC for the ALICE Experiment
for the ALICE Collaboration, Deja, K. R., Trzcinski, T. P., & Graczykowski, L. K. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-18058-4_21 · Cited by 8
Cited by
A Unifying Review of Deep and Shallow Anomaly Detection
Ruff, L., Kauffmann, J. R., Vandermeulen, R. A., Montavon, G., Samek, W., Kloft, M., Dietterich, T. G., & Muller, K.-R. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3052449 · Cited by 914
Anomaly detection in time series: a comprehensive evaluation
Schmidl, S., Wenig, P., & Papenbrock, T. (2022) · Proceedings of the VLDB Endowment · doi:10.14778/3538598.3538602 · Cited by 590
Crowd Analysis in Video Surveillance: A Review
Tomar, A., Kumar, S., & Pant, B. (2022) · 2022 International Conference on Decision Aid Sciences and Applications (DASA) · doi:10.1109/dasa54658.2022.9765008 · Cited by 29
Metadata
- Authors
- Nachman, B., & Shih, D.
- Venue
- Physical Review D
- Publisher
- American Physical Society (APS)
- Published
- 2020-04-23
- Volume
- 101
- Issue
- 7
- ISSN
- 2470-0010 (ISSN-L)
- 2470-0029
- OpenAlex
- W2998758436
- Cited by
- 291
- References
- 68
- FWCI
- 22.10
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.