The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Online Vehicle Routing With Neural Combinatorial Optimization and Deep Reinforcement Learning
Abstract
Online vehicle routing is an important task of the modern transportation service provider. Contributed by the ever-increasing real-time demand on the transportation system, especially small-parcel last-mile delivery requests, vehicle route generation is becoming more computationally complex than before. The existing routing algorithms are mostly based on mathematical programming, which requires huge computation time in city-size transportation networks. To develop routes with minimal time, in this paper, we propose a novel deep reinforcement learning-based neural combinatorial optimization strategy. Specifically, we transform the online routing problem to a vehicle tour generation problem, and propose a structural graph embedded pointer network to develop these tours iteratively. Furthermore, since constructing supervised training data for the neural network is impractical due to the high computation complexity, we propose a deep reinforcement learning mechanism with an unsupervised auxiliary network to train the model parameters. A multisampling scheme is also devised to further improve the system performance. Since the parameter training process is offline, the proposed strategy can achieve a superior online route generation speed. To assess the proposed strategy, we conduct comprehensive case studies with a real-world transportation network. The simulation results show that the proposed strategy can significantly outperform conventional strategies with limited computation time in both static and dynamic logistic systems. In addition, the influence of control parameters on the system performance is investigated.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Internet of Things for Smart Cities
Zanella, A., Bui, N., Castellani, A., Vangelista, L., & Zorzi, M. (2014) · IEEE Internet of Things Journal · doi:10.1109/jiot.2014.2306328 · Cited by 6,292
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
Williams, R. J. (1992) · Machine Learning · doi:10.1007/bf00992696 · Cited by 3,416
Vinyals, O., Fortunato, M., & Jaitly, N. (2015) · neural information processing systems · Cited by 2,043
OSMnx: New methods for acquiring, constructing, analyzing, and visualizing complex street networks
Boeing, G. (2017) · Computers, Environment and Urban Systems · doi:10.1016/j.compenvurbsys.2017.05.004 · Cited by 1,575
Learning Combinatorial Optimization Algorithms over Graphs
Dai, H., Khalil, E. B., Zhang, Y., Dilkina, B., & Song, L. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.01665 · Cited by 1,007
Wang, F.-Y. (2010) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2010.2060218 · Cited by 856
Towards a Reliable and Context-Based System Architecture for Autonomous Vehicles
Kain, T., Mundhenk, P., Müller, J.-S., Tompits, H., Wesche, M., & Decke, H. (2020) · OASIcs : OpenAccess Series in Informatics · doi:10.4230/oasics.asd.2020.1 · Cited by 797
Distributed Optimal Energy Management in Microgrids
Shi, W., Xie, X., Chu, C.-C., & Gadh, R. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2014.2373150 · Cited by 492
OSMnx: New Methods for Acquiring, Constructing, Analyzing, and Visualizing Complex Street Networks
Boeing, G. (2017) · eScholarship (California Digital Library) · Cited by 467
Discriminative Embeddings of Latent Variable Models for Structured Data
Dai, H., Dai, B., & Song, L. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1603.05629 · Cited by 454
Generation and Analysis of a Large-Scale Urban Vehicular Mobility Dataset
Uppoor, S., Trullols-Cruces, O., Fiore, M., & Barcelo-Ordinas, J. M. (2014) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2013.27 · Cited by 329
Energy Consumption Prediction for Electric Vehicles Based on Real-World Data
De Cauwer, C., Van Mierlo, J., & Coosemans, T. (2015) · Energies · doi:10.3390/en8088573 · Cited by 304
DC Microgrid for Wind and Solar Power Integration
Strunz, K., Abbasi, E., & Huu, D. N. (2014) · IEEE Journal of Emerging and Selected Topics in Power Electronics · doi:10.1109/jestpe.2013.2294738 · Cited by 275
Neural Combinatorial Optimization with Reinforcement Learning
Bello, I., Pham, H., Le, Q. V., Norouzi, M., & Bengio, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.09940 · Cited by 257
Optimal Vehicle Routing With Real-Time Traffic Information
Kim, S., Lewis, M. E., & White, C. C. (2005) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2005.848362 · Cited by 236
City Vehicle Routing Problem (City VRP): A Review
Kim, G., Ong, Y.-S., Heng, C. K., et al. (2015) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2015.2395536 · Cited by 215
Juan, A., Mendez, C., Faulin, J., De Armas, J., & Grasman, S. (2016) · Energies · doi:10.3390/en9020086 · Cited by 212
Autonomous Vehicle Logistic System: Joint Routing and Charging Strategy
Yu, J. J. Q., & Lam, A. Y. S. (2017) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2017.2766682 · Cited by 138
Self-citationQi, Y., Hou, Z., Li, H., Huang, J., & Li, X. (2015) · Computers & Operations Research · doi:10.1016/j.cor.2015.04.009 · Cited by 109
Nowakowski, P., Szwarc, K., & Boryczka, U. (2018) · Transportation Research Part D Transport and Environment · doi:10.1016/j.trd.2018.04.007 · Cited by 98
Delay Aware Power System Synchrophasor Recovery and Prediction Framework
Yu, J. J. Q., Lam, A. Y. S., Hill, D. J., Hou, Y., & Li, V. O. K. (2018) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2834543 · Cited by 78
Self-citationTwo-Stage Request Scheduling for Autonomous Vehicle Logistic System
Yu, J. J. Q. (2018) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2018.2849091 · Cited by 74
Self-citationTravel Time Prediction Using Floating Car Data Applied to Logistics Planning
Simroth, A., & Zähle, H. (2010) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2010.2090521 · Cited by 73
Duarte, G., Rolim, C. C., & Baptista, P. (2016) · Sustainable Energy Technologies and Assessments · doi:10.1016/j.seta.2016.03.006 · Cited by 70
Machine‐learning methodology for energy efficient routing
Masikos, M., Demestichas, K. P., Adamopoulou, E. F., & Theologou, M. (2013) · IET Intelligent Transport Systems · doi:10.1049/iet-its.2013.0006 · Cited by 40
Cited by
Privacy-Preserving Traffic Flow Prediction: A Federated Learning Approach
Liu, Y., Yu, J. J. Q., Kang, J., Niyato, D., & Zhang, S. (2020) · IEEE Internet of Things Journal · doi:10.1109/jiot.2020.2991401 · Cited by 712
“[23] and Yu and Gu [24] proposed a graph convolutional generative autoencoder to address the real-time”
BackgroundSelf-citationFinding key players in complex networks through deep reinforcement learning
Fan, C., Zeng, L., Sun, Y., & Liu, Y.-Y. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-0177-2 · Cited by 425
Deep Reinforcement Learning for Internet of Things: A Comprehensive Survey
Chen, W., Qiu, X., Cai, T., Dai, H.-N., Zheng, Z., & Zhang, Y. (2021) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2021.3073036 · Cited by 311
Zhang, Y., Zhu, H., Tang, D., Zhou, T., & Gui, Y. (2022) · Robotics and Computer-Integrated Manufacturing · doi:10.1016/j.rcim.2022.102412 · Cited by 259
Metadata
- Authors
- Yu, J. J. Q., Yu, W., & Gu, J.
- Venue
- IEEE Transactions on Intelligent Transportation Systems
- Published
- 2019-10
- Volume
- 20
- Issue
- 10
- Pages
- 3806-3817
- ISSN
- 1524-9050 (ISSN-L)
- 1558-0016
- OpenAlex
- W2938157874
- Cited by
- 338
- References
- 29
- FWCI
- 25.27
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.