QCD-aware recursive neural networks for jet physics
Open accessThe DOI matches its Crossref record; 33 of the 37 references it cites were found in a registry or an index, and 4 are not checked yet.
Abstract
Recent progress in applying machine learning for jet physics has been built upon an analogy between calorimeters and images. In this work, we present a novel class of recursive neural networks built instead upon an analogy between QCD and natural languages. In the analogy, four-momenta are like words and the clustering history of sequential recombination jet algorithms is like the parsing of a sentence. Our approach works directly with the four-momenta of a variable-length set of particles, and the jet-based tree structure varies on an event-by-event basis. Our experiments highlight the flexibility of our method for building task-specific jet embeddings and show that recursive architectures are significantly more accurate and data efficient than previous image-based networks. We extend the analogy from individual jets (sentences) to full events (paragraphs), and show for the first time an event-level classifier operating on all the stable particles produced in an LHC event.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“RvNN has been employed in several applications [60–62].”
From Review of deep learning: concepts, CNN architectures, challenges, applications, future directions (2021) · cites this paper as [60]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1412.3555 · Cited by 11,008
Self-citationThe anti-ktjet clustering algorithm
Cacciari, M., Salam, G. P., & Soyez, G. (2008) · Journal of High Energy Physics · doi:10.1088/1126-6708/2008/04/063 · Cited by 7,140
Sjöstrand, T., Ask, S., Christiansen, J. R., Corke, R., Desai, N., Ilten, P., Mrenna, S., Prestel, S., Rasmussen, C. O., & Skands, P. Z. (2015) · Computer Physics Communications · doi:10.1016/j.cpc.2015.01.024 · Cited by 5,462
DELPHES 3: a modular framework for fast simulation of a generic collider experiment
The DELPHES 3 collaboration, de Favereau, J., Delaere, C., Demin, P., Giammanco, A., Lemaître, V., Mertens, A., & Selvaggi, M. (2014) · Journal of High Energy Physics · doi:10.1007/jhep02(2014)057 · Cited by 2,966
Deep Convolutional Networks on Graph-Structured Data
Henaff, M., Bruna, J., & LeCun, Y. (2015) · arXiv · doi:10.48550/arxiv.1506.05163 · Cited by 1,255
Longitudinally-invariant k⊥-clustering algorithms for hadron-hadron collisions
Catani, S., Dokshitzer, Y. L., Seymour, M. H., & Webber, B. R. (1993) · Nuclear Physics B · doi:10.1016/0550-3213(93)90166-m · Cited by 1,187
Better jet clustering algorithms
Dokshitzer, Y. L., Leder, G. D., Moretti, S., & Webber, B. R. (1997) · Journal of High Energy Physics · doi:10.1088/1126-6708/1997/08/001 · Cited by 1,062
Identifying boosted objects with N-subjettiness
Thaler, J., & Van Tilburg, K. (2011) · Journal of High Energy Physics · doi:10.1007/jhep03(2011)015 · Cited by 881
Learning task-dependent distributed representations by backpropagation through structure
Goller, C., & Kuchler, A. (2002) · Proceedings of International Conference on Neural Networks (ICNN'96) · doi:10.1109/icnn.1996.548916 · Cited by 581
Salam, G. P. (2010) · The European Physical Journal C · doi:10.1140/epjc/s10052-010-1314-6 · Cited by 431
Deep learning and its application to LHC physics
Guest, D., Cranmer, K., & Whiteson, D. (2018) · Annual Review of Nuclear and Particle Science · doi:10.1146/annurev-nucl-101917-021019 · Cited by 417
Self-citationDoes String-Based Neural MT Learn Source Syntax?
Shi, X., Padhi, I., & Knight, K. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1159 · Cited by 300
Deep learning in color: towards automated quark/gluon jet discrimination
Komiske, P. T., Metodiev, E. M., & Schwartz, M. D. (2017) · Journal of High Energy Physics · doi:10.1007/jhep01(2017)110 · Cited by 291
Classification without labels: learning from mixed samples in high energy physics
Metodiev, E. M., Nachman, B., & Thaler, J. (2017) · Journal of High Energy Physics · doi:10.1007/jhep10(2017)174 · Cited by 287
Jet-images — deep learning edition
de Oliveira, L., Kagan, M., Mackey, L., Nachman, B., & Schwartzman, A. (2016) · Journal of High Energy Physics · doi:10.1007/jhep07(2016)069 · Cited by 282
Deep-learning top taggers or the end of QCD?
Kasieczka, G., Plehn, T., Russell, M., & Schell, T. (2017) · Journal of High Energy Physics · doi:10.1007/jhep05(2017)006 · Cited by 276
Anomaly Detection for Resonant New Physics with Machine Learning
Collins, J., Howe, K., & Nachman, B. (2018) · Physical Review Letters · doi:10.1103/physrevlett.121.241803 · Cited by 248
Jet substructure classification in high-energy physics with deep neural networks
Baldi, P., Bauer, K., Eng, C., Sadowski, P., & Whiteson, D. (2016) · Physical Review D · doi:10.1103/physrevd.93.094034 · Cited by 248
Energy flow polynomials: a complete linear basis for jet substructure
Komiske, P., Metodiev, E. M., & Thaler, J. (2018) · Journal of High Energy Physics · doi:10.1007/jhep04(2018)013 · Cited by 244
Playing tag with ANN: boosted top identification with pattern recognition
Almeida, L. G., Backović, M., Cliche, M., Lee, S. J., & Perelstein, M. (2015) · Journal of High Energy Physics · doi:10.1007/jhep07(2015)086 · Cited by 211
Deep-learned Top Tagging with a Lorentz Layer
Butter, A., Kasieczka, G., Plehn, T., & Russell, M. (2018) · SciPost Physics · doi:10.21468/scipostphys.5.3.028 · Cited by 193
Jet flavor classification in high-energy physics with deep neural networks
Guest, D., Collado, J., Baldi, P., Hsu, S.-C., Urban, G., & Whiteson, D. (2016) · Physical Review D · doi:10.1103/physrevd.94.112002 · Cited by 178
Jet-images: computer vision inspired techniques for jet tagging
Cogan, J., Kagan, M., Strauss, E., & Schwarztman, A. (2015) · Journal of High Energy Physics · doi:10.1007/jhep02(2015)118 · Cited by 177
Neural networks and cellular automata in experimental high energy physics
Denby, B. (1988) · Computer Physics Communications · doi:10.1016/0010-4655(88)90004-5 · Cited by 167
Using neural networks to identify jets
Lönnblad, L., Peterson, C., & Rognvaldsson, T. S. (1991) · Nuclear Physics B · doi:10.1016/0550-3213(91)90392-b · Cited by 147
Fischer, N., Prestel, S., Ritzmann, M., & Skands, P. Z. (2016) · The European Physical Journal C · doi:10.1140/epjc/s10052-016-4429-6 · Cited by 135
Parton shower uncertainties in jet substructure analyses with deep neural networks
Barnard, J., Dawe, E., Dolan, M. J., & Rajcic, N. (2017) · Physical review. D/Physical review. D. · doi:10.1103/physrevd.95.014018 · Cited by 135
Recursive Neural Networks in Quark/Gluon Tagging
Cheng, T. (2018) · Computing and Software for Big Science · doi:10.1007/s41781-018-0007-y · Cited by 134
Learning to classify from impure samples with high-dimensional data
Komiske, P., Metodiev, E. M., Nachman, B. P., & Schwartz, M. D. (2018) · Physical review. D/Physical review. D. · doi:10.1103/physrevd.98.011502 · Cited by 128
Particle identification with neural networks using a rotational invariant moment representation
Sinkus, R., & Voss, T. (1997) · Nuclear Instruments and Methods in Physics Research Section A Accelerators Spectrometers Detectors and Associated Equipment · doi:10.1016/s0168-9002(97)00524-x · Cited by 123
Finding gluon jets with a neural trigger
Lönnblad, L., Peterson, C., & Rognvaldsson, T. S. (1990) · Physical Review Letters · doi:10.1103/physrevlett.65.1321 · Cited by 113
Jet charge and machine learning
Fraser, K., & Schwartz, M. D. (2018) · Journal of High Energy Physics · doi:10.1007/jhep10(2018)093 · Cited by 112
Novel jet observables from machine learning
Datta, K., & Larkoski, A. J. (2018) · Journal of High Energy Physics · doi:10.1007/jhep03(2018)086 · Cited by 97
Antenna showers with hadronic initial states
Ritzmann, M., Kosower, D. A., & Skands, P. Z. (2012) · Physics Letters B · doi:10.1016/j.physletb.2012.12.003 · Cited by 64
Spectral analysis of jet substructure with neural networks: boosted Higgs case
Lim, S. H., & Nojiri, M. M. (2018) · Journal of High Energy Physics · doi:10.1007/jhep10(2018)181 · Cited by 44
Sentence Modeling with Gated Recursive Neural Network
Chen, X., Qiu, X., Zhu, C., Wu, S., & Huang, X. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1092 · Cited by 33
Higgs search by neural networks at LHC
Chiappetta, P., Colangelo, P., Felice, P. D., Nardulli, G., & Pasquariello, G. (1994) · Physics Letters B · doi:10.1016/0370-2693(94)91110-x · Cited by 30
Research works printed but not linked: 25
- R. Socher, C.C. Lin, C. Manning and A.Y. Ng, Parsing natural scenes and natural language with recursive neural networks, in Proceedings of the 28th international conference on machine learning (ICML-11), Bellevue U.S.A. (2011), pg. 129.
- R. Socher, J. Pennington, E.H. Huang, A.Y. Ng and C.D. Manning, Semi-supervised recursive autoencoders for predicting sentiment distributions, in Proceedings of the Conference on Empirical Methods in Natural Language Processing, Edinburgh U.K. (2011), pg. 151.
- K. Cho, B. van Merriënboer, D. Bahdanau and Y. Bengio, On the properties of neural machine translation: Encoder-decoder approaches, arXiv:1409.1259. · arXiv
- K. Cho et al., Learning phrase representations using rnn encoder-decoder for statistical machine translation, arXiv:1406.1078. · arXiv
- I. Goodfellow, Y. Bengio and A. Courville, Deep Learning, MIT Press, Cambridge U.S.A. (2016).
- V. Nair and G.E. Hinton, Rectified linear units improve restricted boltzmann machines, in Proceedings of the 27th international conference on machine learning (ICML-10), Haifa Israel (2010), pg. 807.
- D.P. Kingma and J. Ba, Adam: A Method for Stochastic Optimization, arXiv:1412.6980 [INSPIRE]. · arXiv
- S. R. Bowman, C. D. Manning and C. Potts, Tree-structured composition in neural networks without tree-structured architectures, arXiv:1506.04834. · arXiv
- S.R. Bowman, Modeling natural language semantics in learned representations, Ph.D. Thesis, Stanford University, Stanford U.S.A. (2016).
- G. Louppe, M. Kagan and K. Cranmer, Learning to Pivot with Adversarial Networks, arXiv:1611.01046 [INSPIRE]. · arXiv
- A.J. Larkoski, I. Moult and B. Nachman, Jet Substructure at the Large Hadron Collider: A Review of Recent Advances in Theory and Machine Learning, arXiv:1709.04464 [INSPIRE]. · arXiv
- M. Russell, Top quark physics in the Large Hadron Collider era, Ph.D. Thesis, Glasgow University, Glasgow U.K. (2017) [arXiv:1709.10508] [INSPIRE]. · arXiv
- S. Egan, W. Fedorko, A. Lister, J. Pearkes and C. Gay, Long Short-Term Memory (LSTM) networks with jet constituents for boosted top tagging at the LHC, arXiv:1711.09059 [INSPIRE]. · arXiv
- I. Henrion et al., Neural Message Passing for Jet Physics, in Proceedings of the Deep Learning for Physical Sciences Workshop at NIPS (2017), Long Beach U.S.A. (2017), https://dl4physicalsciences.github.io/files/nips dlps 2017 29.pdf. JHEP01(2019)057
- S. Choi, S.J. Lee and M. Perelstein, Infrared Safety of a Neural-Net Top Tagging Algorithm, arXiv:1806.01263 [INSPIRE]. · arXiv
- R.T. D'Agnolo and A. Wulzer, Learning New Physics from a Machine, arXiv:1806.02350 [INSPIRE]. · arXiv
- A. Andreassen, I. Feige, C. Frye and M.D. Schwartz, JUNIPR: a Framework for Unsupervised Machine Learning in Particle Physics, arXiv:1804.09720 [INSPIRE]. · arXiv
- S.R. Bowman, J. Gauthier, A. Rastogi, R. Gupta, C.D. Manning and C. Potts, A fast unified model for parsing and sentence understanding, arXiv:1603.06021. · arXiv
- D. Yogatama, P. Blunsom, C. Dyer, E. Grefenstette and W. Ling, Learning to compose words into sentences with reinforcement learning, arXiv:1611.09100. · arXiv
- J. Bruna, W. Zaremba, A. Szlam and Y. LeCun, Spectral networks and locally connected networks on graphs, arXiv:1312.6203. · arXiv
- Y. Li, D. Tarlow, M. Brockschmidt and R.S. Zemel, Gated graph sequence neural networks, arXiv:1511.05493. · arXiv
- M. Niepert, M. Ahmed and K. Kutzkov, Learning convolutional neural networks for graphs, arXiv:1605.05273. · arXiv
- M. Defferrard, X. Bresson and P. Vandergheynst, Convolutional neural networks on graphs with fast localized spectral filtering, arXiv:1606.09375. · arXiv
- T.N. Kipf and M. Welling, Semi-supervised classification with graph convolutional networks, arXiv:1609.02907. · arXiv
- T.N. Kipf and M. Welling, Semi-supervised classification with graph convolutional networks, arXiv:1609.02907. · arXiv
Cited by
Review of deep learning: concepts, CNN architectures, challenges, applications, future directions
Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00444-8 · Cited by 7,906
Machine learning and the physical sciences
Carleo, G., Cirac, I., Cranmer, K., Daudet, L., Schuld, M., Tishby, N., Vogt-Maranto, L., & Zdeborová, L. (2019) · Reviews of Modern Physics · doi:10.1103/revmodphys.91.045002 · Cited by 2,417
Self-citationThe frontier of simulation-based inference
Cranmer, K., Brehmer, J., & Louppe, G. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1912789117 · Cited by 1,032
Self-citationScience Requirements and Detector Concepts for the Electron-Ion Collider
Abdul Khalek, R., Accardi, A., Adam, J., Adamiak, D., Akers, W., Albaladejo, M., Al-bataineh, A., Alexeev, M. G., Ameli, F., Antonioli, P., et al. (2022) · Nuclear Physics A · doi:10.1016/j.nuclphysa.2022.122447 · Cited by 913
Machine learning at the energy and intensity frontiers of particle physics
Radovic, A., Williams, M., Rousseau, D., Kagan, M., Bonacorsi, D., Himmel, A., Aurisano, A., Terao, K., & Wongjirad, T. (2018) · Nature · doi:10.1038/s41586-018-0361-2 · Cited by 475
Metadata
- Authors
- Louppe, G., Cho, K., Becot, C., & Cranmer, K.
- Affiliations
- New York University (US)
- Corresponding author
- Cranmer, Kyle
- Venue
- Journal of High Energy Physics
- Published
- 2019-01
- Volume
- 2019
- Issue
- 1
- ISSN
- 1029-8479 (ISSN-L)
- OpenAlex
- W2586765566
- Cited by
- 123
- References
- 36
- Citations by year
- 2026: 6 · 2025: 11 · 2024: 12 · 2023: 14 · 2022: 15 · 2021: 17 · 2020: 31 · 2019: 17
- FWCI
- 10.38
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0/ (tdm)
- creativecommons.org/licenses/by/4.0/ (vor, 6 d)
- Locations
- Journal of High Energy Physics (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- ORBi (University of Liège) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1505463, 1450310, 1205376)
- Topics
- Physical Sciences › Physics and Astronomy › Nuclear and High Energy Physics › Particle physics theoretical and experimental studies
- Physical Sciences › Physics and Astronomy › Nuclear and High Energy Physics › High-Energy Particle Collisions Research
- Physical Sciences › Physics and Astronomy › Nuclear and High Energy Physics › Particle Detector Development and Performance
- Keywords
- recursive neural networks, jet physics, QCD, four-momentum, jet clustering, data efficiency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.