CoChat
Sign Up
PreprintCited by 2Particle accelerators and beam dynamicsArtificial Intelligence ApplicationsReinforcement Learning in Robotics

Towards Agentic AI on Particle Accelerators

Open access
Sulc, Antonin, Hellert, Thorsten, Kammering, Raimund, Hoschouer, Hayden, John, Jason St.·2024·arXiv
DOI 10.48550/arxiv.2409.06336arXiv 2409.06336
Open this paper in CoChat — free accountOpen PDF

Abstract

As particle accelerators grow in complexity, traditional control methods face increasing challenges in achieving optimal performance. This paper envisions a paradigm shift: a decentralized multi-agent framework for accelerator control, powered by Large Language Models (LLMs) and distributed among autonomous agents. We present a proposition of a self-improving decentralized system where intelligent agents handle high-level tasks and communication and each agent is specialized to control individual accelerator components. This approach raises some questions: What are the future applications of AI in particle accelerators? How can we implement an autonomous complex system such as a particle accelerator where agents gradually improve through experience and human feedback? What are the implications of integrating a human-in-the-loop component for labeling operational data and providing expert guidance? We show three examples, where we demonstrate the viability of such architecture.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2409.06336

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Reflexive patterns support iterative improvement and adaptive replanning, particularly when integrated with memory logs or feedback queues.

    “Such patterns also support iterative improvement and adaptive replanning, particularly when integrated with memory logs or feedback queues [230,231].”

    From AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges (2026) · cites this paper as [231]

    Section 2.1 says Reflexion agents use task feedback and an episodic memory buffer to improve decisions in subsequent trials, supporting iterative improvement. Section 4.1 describes a proposed agent consulting a logbook before suggesting an action, but the paper does not specifically describe reflexive patterns enabling adaptive replanning or integration with feedback queues. The indexed passages provide no page numbers. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

  • Such patterns support iterative improvement and adaptive replanning, particularly when integrated with memory logs or feedback queues.

    “Such patterns also support iterative improvement and adaptive replanning, particularly when integrated with memory logs or feedback queues [233], [234].”

    From AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges (2025) · cites this paper as [234]

    Section 3 (Features of the System; page unavailable) proposes agents that improve through experience and learn from operational outcomes. Section 4.1 (ALS Example: Orbit Feedback; page unavailable) envisions a feedback agent consulting a logbook agent before recommending an action. These passages support iterative improvement and use of logs, but do not describe feedback queues or an adaptive replanning process. (LLM, conf=0.82)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 24

  1. Timofei Bolshakov, AD Petrov, and Sharon Lackey. Synoptic display-a client-server system for graphical data representation. proceedings of the 2003 ICALEPCS, Gyeongju, Korea, 2003.
  2. Weize Chen, Yusheng Su, Jingwei Zuo, Cheng Yang, Chenfei Yuan, Chi-Min Chan, Heyang Yu, Yaxi Lu, Yi-Hsin Hung, Chen Qian, et al. Agentverse: Facilitating multi-agent collaboration and exploring emergent behaviors. In The Twelfth International Conference on Learning Representations, 2023.
  3. Hannes Dinter. Longitudinal diagnostics for beam-based intra bunch-train feedback at FLASH and the European XFEL. PhD thesis, Staats-und Universitätsbibliothek Hamburg Carl von Ossietzky, 2018.
  4. Yilun Du, Shuang Li, Antonio Torralba, Joshua B Tenenbaum, and Igor Mordatch. Improv- ing factuality and reasoning in language models through multiagent debate. arXiv preprint arXiv:2305.14325, 2023. · arXiv
  5. Auralee Edelen, Christopher Mayes, Daniel Bowring, Daniel Ratner, Andreas Adelmann, Ras- mus Ischebeck, Jochem Snuverink, Ilya Agapov, Raimund Kammering, Jonathan Edelen, et al. Opportunities in machine learning for particle accelerators. arXiv preprint arXiv:1811.03172, 2018. · arXiv
  6. Annika Eichler, Florian Burkart, Jan Kaiser, Willi Kuropka, Oliver Stein, Erik Bründermann, Andrea Santamaria Garcia, and Chenran Xu. First steps toward an autonomous accelerator, a common project between desy and kit. Proc. IPAC'21, pages 2182-2185, 2021.
  7. Kairong Han, Kun Kuang, Ziyu Zhao, Junjian Ye, and Fei Wu. Causal agent based on large language model. arXiv preprint arXiv:2408.06849, 2024. · arXiv
  8. O Hensler and K Rehlich. Doocs: A distributed object oriented control system. In Proceedings of XV Workshop on Charged Particle Accelerators, Protvino, 1996.
  9. Shengran Hu, Cong Lu, and Jeff Clune. Automated design of agentic systems. arXiv preprint arXiv:2408.08435, 2024. · arXiv
  10. Juyong Jiang, Fan Wang, Jiasi Shen, Sungju Kim, and Sunghun Kim. A survey on large language models for code generation. arXiv preprint arXiv:2406.00515, 2024. · arXiv
  11. Raimund Kammering and Christian Schmidt. Feedbacks and automation at the free electron laser in hamburg (flash). Proc. ICALEPCS'13, pages 1345-1347, 2013.
  12. Yuhang Lai, Chengxi Li, Yiming Wang, Tianyi Zhang, Ruiqi Zhong, Luke Zettlemoyer, Wen- tau Yih, Daniel Fried, Sida Wang, and Tao Yu. Ds-1000: A natural and reliable benchmark for data science code generation. In International Conference on Machine Learning, pages 18319-18345. PMLR, 2023.
  13. Bo Liu, Yuqian Jiang, Xiaohan Zhang, Qiang Liu, Shiqi Zhang, Joydeep Biswas, and Peter Stone. Llm+ p: Empowering large language models with optimal planning proficiency. arXiv preprint arXiv:2304.11477, 2023. · arXiv
  14. Frank Mayet. Gaia: A general ai assistant for intelligent accelerator operations. arXiv preprint arXiv:2405.01359, 2024. · arXiv
  15. Joon Sung Park, Joseph O'Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. Generative agents: Interactive simulacra of human behavior. In Proceed- ings of the 36th annual acm symposium on user interface software and technology, pages 1-22, 2023.
  16. James Patrick. The fermilab accelerator control system. Proc. ICAP'06, pages 246-249, 2006.
  17. Chen Qian, Wei Liu, Hongzhang Liu, Nuo Chen, Yufan Dang, Jiahao Li, Cheng Yang, Weize Chen, Yusheng Su, Xin Cong, et al. Chatdev: Communicative agents for software development. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 15174-15186, 2024.
  18. Noah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao. Reflexion: Language agents with verbal reinforcement learning. Advances in Neural Information Processing Systems, 36, 2024.
  19. Antonin Sulc, Alex Bien, Annika Eichler, Daniel Ratner, Florian Rehm, Frank Mayet, Gregor Hartmann, Hayden Hoschouer, Henrik Tuennermann, Jan Kaiser, et al. Towards unlocking insights from logbooks using ai. arXiv preprint arXiv:2406.12881, 2024. · arXiv
  20. Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, and Anima Anandkumar. Voyager: An open-ended embodied agent with large language models. arXiv preprint arXiv:2305.16291, 2023. · arXiv
  21. Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Shaokun Zhang, Erkang Zhu, Beibin Li, Li Jiang, Xiaoyun Zhang, and Chi Wang. Autogen: Enabling next-gen llm applications via multi-agent conversation framework. arXiv preprint arXiv:2308.08155, 2023. · arXiv
  22. Zhiheng Xi, Wenxiang Chen, Xin Guo, Wei He, Yiwen Ding, Boyang Hong, Ming Zhang, Junzhe Wang, Senjie Jin, Enyu Zhou, et al. The rise and potential of large language model based agents: A survey. arXiv preprint arXiv:2309.07864, 2023. · arXiv
  23. Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. React: Synergizing reasoning and acting in language models. arXiv preprint arXiv:2210.03629, 2022. · arXiv
  24. Z. Zhang, M. Böse, A.L. Edelen, J.R. Garrahan, Y. Hidaka, C.E. Mayes, S.A. Miskovich, D.F. Ratner, R.J. Roussel, J. Shtalenkova, S. Tomin, and G.M. Wang. Badger: The Missing Optimizer in ACR. In Proc. IPAC'22, number 13 in International Particle Accelerator Conference, pages 999-1002. JACoW Publishing, Geneva, Switzerland, 07 2022.

Cited by

Sorted by citations

Authors
Sulc, A., Hellert, T., Kammering, R., Hoschouer, H., & John, J. S.
Affiliations
  • Helmholtz-Zentrum Berlin für Materialien und Energie (DE)
  • Lawrence Berkeley National Laboratory (US)
  • Deutsches Elektronen-Synchrotron DESY (DE)
  • Fermi National Accelerator Laboratory (US)
ORCID
Venue
arXiv
Publisher
arXiv
Published
2024
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2409.06336
arXiv
2409.06336
OpenAlex
W4403284028
Cited by
2
References
0
Citations by year
2025: 2
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) (submittedVersion, other-oa)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Engineering › Aerospace Engineering › Particle accelerators and beam dynamics
  • Physical Sciences › Computer Science › Artificial Intelligence › Artificial Intelligence Applications
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
Keywords
agentic AI, particle accelerators, accelerator control, large language models, multi-agent systems, decentralized control, autonomous systems, human-in-the-loop, expert guidance, self-improving systems

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review