The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
First Steps Towards an Intelligent Laser Welding Architecture Using Deep Neural Networks and Reinforcement Learning
Open accessAbstract
To address control difficulties in laser welding, we propose the idea of a self-learning and self-improving laser welding system that combines three modern machine learning techniques. We first show the ability of a deep neural network to extract meaningful, low-dimensional features from high-dimensional laser-welding camera data. These features are then used by a temporal-difference learning algorithm to predict and anticipate important aspects of the system's sensor data. The third part of our proposed architecture suggests using these features and predictions to learn to deliver situation-appropriate welding power; preliminary control results are demonstrated using a laser-welding simulator. The intelligent laser-welding architecture introduced in this work has the capacity to improve its performance without further human assistance and therefore addresses key requirements of modern industry. To our knowledge, it is the first demonstrated combination of deep learning and Nexting with general value functions and also the first usage of deep learning for laser welding specifically and production engineering in general. This work also provides a unique example of how predictions can be explicitly learned using reinforcement learning to support laser welding. We believe that it would be straightforward to adapt our approach to other production engineering applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471
Whatever next? Predictive brains, situated agents, and the future of cognitive science
Clark, A. (2013) · Behavioral and Brain Sciences · doi:10.1017/s0140525x12000477 · Cited by 5,924
(2010) · Journal of Machine Learning Research · doi:10.5555/1756006.1953039 · Cited by 4,051
Barto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976
Practical Recommendations for Gradient-Based Training of Deep Architectures
Bengio, Y. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_26 · Cited by 2,259
The four faces of mass customization.
Gilmore, J. H., & Pine, B. J. (1997) · PubMed · Cited by 938
Reinforcement learning of motor skills with policy gradients
Peters, J., & Schaal, S. (2008) · Neural Networks · doi:10.1016/j.neunet.2008.02.003 · Cited by 831
The Limits of Mass Customization
Zipkin, P. H. (2001) · Dialnet (Universidad de la Rioja) · Cited by 473
Sutton, R. S., Modayil, J., Delp, M., Degris, T., Pilarski, P. M., White, A., & Precup, D. (2011) · doi:10.5555/2031678.2031726 · Cited by 283
Self-citationModel-Free reinforcement learning with continuous action in practice
Degris, T., Pilarski, P. M., & Sutton, R. S. (2012) · 2012 American Control Conference (ACC) · doi:10.1109/acc.2012.6315022 · Cited by 239
Self-citationAutonomous reinforcement learning on raw visual input data in a real world application
Lange, S., Riedmiller, M., & Voigtlander, A. (2012) · The 2012 International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2012.6252823 · Cited by 202
Online human training of a myoelectric prosthesis controller via actor-critic reinforcement learning
Pilarski, P. M., Dawson, M. R. W., Degris, T., Fahimi, F., Carey, J. P., & Sutton, R. S. (2011) · International Conference on Rehabilitation Robotics · doi:10.1109/icorr.2011.5975338 · Cited by 167
Self-citationOptical sensor for real-time monitoring of CO_2 laser welding process
Ancona, A., Spagnolo, V., Lugarà, P. M., & Ferrara, M. (2001) · Applied Optics · doi:10.1364/ao.40.006019 · Cited by 135
Review of techniques for on-line monitoring and inspection of laser welding
Shao, J., & Yan, Y. G. (2005) · Journal of Physics Conference Series · doi:10.1088/1742-6596/15/1/017 · Cited by 98
Reinforcement learning of walking behavior for a four-legged robot
Kimura, H., Yamashita, T., & Kobayashi, S. (2003) · Proceedings of the IEEE Conference on Decision & Control, including the Symposium on Adaptive Processes · doi:10.1109/cdc.2001.980135 · Cited by 93
Haykin, S., Fatemi, M., Setoodeh, P., & Xue, Y. (2012) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2215773 · Cited by 93
Multi-timescale nexting in a reinforcement learning robot
Modayil, J., White, A., & Sutton, R. S. (2014) · Adaptive Behavior · doi:10.1177/1059712313511648 · Cited by 72
Real-time prediction learning for the simultaneous actuation of multiple prosthetic joints
Pilarski, P. M., Dick, T., & Sutton, R. S. (2013) · International Conference on Rehabilitation Robotics · doi:10.1109/icorr.2013.6650435 · Cited by 35
Self-citationThomas, P. S., Branicky, M. S., van den Bogert, A. J., & Jagodnik, K. M. (2009) · PubMed · Cited by 26
Neural network model for time series prediction by reinforcement learning
Liu, F., Quek, C. H., & Ng, G. S. (2006) · IEEE International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2005.1555956 · Cited by 19
Acquiring a broad range of empirical knowledge in real time by temporal-difference learning
Modayil, J., White, A., Pilarski, P. M., & Sutton, R. S. (2012) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2012.6378016 · Cited by 10
Self-citationThe research of welding parameters on weld shape in the laser deep penetration welding
Min-ying, H., Shi-Junwei, Li-xin, C.-J., et al. (2010) · International Conference on Mechanic Automation and Control Engineering · doi:10.1109/mace.2010.5535453 · Cited by 2
Research works printed but not linked: 5
- Jaeger, 2008, Sputter tracking for the automatic monitoring of industrial laser-welding processes, IEEE Transactions on Industrial Electronics, 55, 2177, 10.1109/TIE.2008.918637 · doi:10.1109/tie.2008.918637
- Alippi, 2001, A methodological approach to multisensor classification for innovative laser material processing units, IMTC, 3, 1762
- Schroth, 2009, A cognitive system for autonomous robotic welding, IEEE/RSJ IROS, 3148
- Kroos, 1993, Dynamic behaviour of the keyhole in laser welding, Journal of Physics D: Applied Physics, 26, 481, 10.1088/0022-3727/26/3/022 · doi:10.1088/0022-3727/26/3/022
- Beersiek, 2001, A CMOS camera as tool for process analysis not only for laser beam welding, ICALEO, 92, 1185
Cited by
A survey of the recent architectures of deep convolutional neural networks
Khan, A., Sohail, A., Zahoora, U., & Qureshi, A. S. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09825-6 · Cited by 3,137
Machine learning in manufacturing: Advantages, challenges, and applications
Wuest, T., Weimer, D., Irgens, C., & Thoben, K.-D. (2016) · Production & Manufacturing Research · doi:10.1080/21693277.2016.1192517 · Cited by 1,319
Pruning and quantization for deep neural network acceleration: A survey
Liang, T., Glossner, J., Wang, L., Shi, S., & Zhang, X. (2021) · Neurocomputing · doi:10.1016/j.neucom.2021.07.045 · Cited by 943
Rajaraman, S., Antani, S. K., Poostchi, M., Silamut, K., Hossain, M. A., Maude, R. J., Jaeger, S., & Thoma, G. R. (2018) · PeerJ · doi:10.7717/peerj.4568 · Cited by 566
Breast cancer detection using deep convolutional neural networks and support vector machines
Ragab, D. A., Sharkas, M., Marshall, S., & Ren, J. (2019) · PeerJ · doi:10.7717/peerj.6201 · Cited by 513
Metadata
- Authors
- Günther, J., Pilarski, P. M., Helfrich, G., Shen, H., & Diepold, K.
- Venue
- Procedia Technology
- Publisher
- Elsevier BV
- Published
- 2014
- Volume
- 15
- Pages
- 474-483
- ISSN
- 2212-0173 (ISSN-L)
- OpenAlex
- W2088897029
- Cited by
- 303
- References
- 25
- FWCI
- 5.28
- Type
- journal article
- Language
- en
- Open access
- diamond
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- creativecommons.org/licenses/by-nc-nd/3.0/ (vor, 273 d)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.