The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Optimization of global production scheduling with deep reinforcement learning
Open accessAbstract
Industrie 4.0 introduces decentralized, self-organizing and self-learning systems for production control. At the same time, new machine learning algorithms are getting increasingly powerful and solve real world problems. We apply Google DeepMind’s Deep Q Network (DQN) agent algorithm for Reinforcement Learning (RL) to production scheduling to achieve the Industrie 4.0 vision for production control. In an RL environment cooperative DQN agents, which utilize deep neural networks, are trained with user-defined objectives to optimize scheduling. We validate our system with a small factory simulation, which is modeling an abstracted frontend-of-line semiconductor production facility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Mastering the game of Go without human knowledge
Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., et al. (2017) · Nature · doi:10.1038/nature24270 · Cited by 9,084
Building high-level features using large scale unsupervised learning
Le, Q. V. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639343 · Cited by 1,695
Resource Management with Deep Reinforcement Learning
Mao, H., Alizadeh, M., Menache, I., & Kandula, S. (2016) · Proceedings of the 15th ACM Workshop on Hot Topics in Networks · doi:10.1145/3005745.3005750 · Cited by 1,353
Cooperative Multi-Agent Learning: The State of the Art
Panait, L., & Luke, S. (2005) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-005-2631-2 · Cited by 1,237
A survey of dynamic scheduling in manufacturing systems
Ouelhadj, D., & Petrović, S. (2008) · Journal of Scheduling · doi:10.1007/s10951-008-0090-8 · Cited by 1,031
The Digital Twin: Realizing the Cyber-Physical Production System for Industry 4.0
Uhlemann, T. H.-J., Lehmann, C., & Steinhilper, R. (2017) · Procedia CIRP · doi:10.1016/j.procir.2016.11.152 · Cited by 994
Inceptionism: Going Deeper into Neural Networks
Mordvintsev, A., Olah, C., & Tyka, M. (2015) · Cited by 574
Cited by
Artificial Intelligence in Advanced Manufacturing: Current Status and Future Outlook
Arinez, J. F., Chang, Q., Gao, R. X., Xu, C., & Zhang, J. (2020) · Journal of Manufacturing Science and Engineering · doi:10.1115/1.4047855 · Cited by 584
Dynamic scheduling for flexible job shop with new job insertions by deep reinforcement learning
Luo, S. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106208 · Cited by 579
Cavalcante, I. M., Frazzon, E. M., Forcellini, F. A., & Ivanov, D. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2019.03.004 · Cited by 527
A survey on AI-driven digital twins in Industry 4.0: smart manufacturing and advanced robotics
Huang, Z., Shen, Y., Li, J., Fey, M., & Brecher, C. (2021) · Sensors · doi:10.3390/s21196340 · Cited by 418
Usuga Cadavid, J. P., Lamouri, S., Grabot, B., Pellerin, R., & Fortin, A. (2020) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-019-01531-7 · Cited by 387
Deep reinforcement learning in smart manufacturing: A review and prospects
Li, C., Zheng, P., Yin, Y., Wang, B., & Wang, L. (2023) · CIRP Journal of Manufacturing Science and Technology · doi:10.1016/j.cirpj.2022.11.003 · Cited by 327
Zafar, M. H., Langås, E. F., & Sanfilippo, F. (2024) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2024.102769 · Cited by 315
Deep reinforcement learning for dynamic scheduling of a flexible job shop
Liu, R., Piplani, R., & Toro, C. (2022) · International Journal of Production Research · doi:10.1080/00207543.2022.2058432 · Cited by 310
Multi-Objective Workflow Scheduling With Deep-Q-Network-Based Multi-Agent Reinforcement Learning
Wang, Y., Liu, H., Zheng, W., Xia, Y., Li, Y., Chen, P., Guo, K., & Xie, H. (2019) · IEEE Access · doi:10.1109/access.2019.2902846 · Cited by 288
Deep reinforcement learning in production systems: a systematic literature review
Panzer, M., & Bender, B. (2022) · International Journal of Production Research · doi:10.1080/00207543.2021.1973138 · Cited by 282
Fahle, S., Prinz, C., & Kuhlenkötter, B. (2020) · Procedia CIRP · doi:10.1016/j.procir.2020.04.109 · Cited by 257
Dynamic multi-objective scheduling for flexible job shop by deep reinforcement learning
Luo, S., Zhang, L., & Fan, Y. (2021) · Computers & Industrial Engineering · doi:10.1016/j.cie.2021.107489 · Cited by 255
Metadata
- Authors
- Waschneck, B., Reichstaller, A., Belzner, L., Altenmüller, T., Bauernhansl, T., Knapp, A., & Kyek, A.
- Venue
- Procedia CIRP
- Publisher
- Elsevier BV
- Published
- 2018
- Volume
- 72
- Pages
- 1264-1269
- ISSN
- 2212-8271 (ISSN-L)
- OpenAlex
- W2811338889
- Cited by
- 366
- References
- 17
- FWCI
- 26.17
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.