Rebalancing shared mobility-on-demand systems: A reinforcement learning approach
Abstract
Shared mobility-on-demand systems have very promising prospects in making urban transportation efficient and affordable. However, due to operational challenges among others, many mobility applications still remain niche products. This paper addresses rebalancing needs that are critical for effective fleet management in order to offset the inevitable imbalance of vehicle supply and travel demand. Specifically, we propose a reinforcement learning approach which adopts a deep Q network and adaptively moves idle vehicles to regain balance. This innovative model-free approach takes a very different perspective from the state-of-the-art network-based methods and is able to cope with large-scale shared systems in real time with partial or full data availability. We apply this approach to an agent-based simulator and test it on a London case study. Results show that, the proposed method outperforms the local anticipatory method by reducing the fleet size by 14% while inducing little extra vehicle distance traveled. The performance is close to the optimal solution yet the computational speed is 2.5 times faster. Collectively, the paper concludes that the proposed rebalancing approach is effective under various demand scenarios and will benefit both travelers and operators if implemented in shared mobility-on-demand systems.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Shared mobility is disrupting travel and vehicle ownership, and ML plays an integral part in running and optimizing these services.
“In the passenger sector, shared mobility (such as on-demand ride services or vehicle-sharing 14 ), is undoubtedly disrupting the way people travel and think about vehicle ownership, and ML plays an integral part in running and optimizing these services (e.g., [768,837]).”
From Tackling climate change with machine learning (2023) · cites this paper as [837]
Cites
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946 · see citing works
Playing Atari with Deep Reinforcement Learning
Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471 · see citing works
Deep Reinforcement Learning with Double Q-Learning
Van Hasselt, H., Guez, A., & Silver, D. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.10295 · Cited by 3,318 · see citing works
On-demand high-capacity ride-sharing via dynamic trip-vehicle assignment
Alonso–Mora, J., Samaranayake, S., Wallar, A., Frazzoli, E., & Rus, D. L. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1611675114 · Cited by 1,196 · see citing works
Dynamic ride-sharing and fleet sizing for a system of shared autonomous vehicles in Austin, Texas
Fagnant, D. J., & Kockelman, K. M. (2018) · Transportation · doi:10.1007/s11116-016-9729-z · Cited by 616 · see citing works
An optimization framework for the development of efficient one-way car-sharing systems
Boyacı, B., Zografos, K. G., & Geroliminis, N. (2014) · European Journal of Operational Research · doi:10.1016/j.ejor.2014.07.020 · Cited by 453 · see citing works
Spieser, K., Treleaven, K., Zhang, R., Frazzoli, E., Morton, D., & Pavone, M. (2014) · Lecture notes in mobility · doi:10.1007/978-3-319-05990-7_20 · Cited by 442 · see citing works
Control of robotic mobility-on-demand systems: A queueing-theoretical perspective
Zhang, R., & Pavone, M. (2015) · The International Journal of Robotics Research · doi:10.1177/0278364915581863 · Cited by 371 · see citing works
The bike sharing rebalancing problem: Mathematical formulations and benchmark instances
Dell’Amico, M., Hadjicostantinou, E., Iori, M., et al. (2013) · Omega · doi:10.1016/j.omega.2013.12.001 · Cited by 363 · see citing works
Robotic load balancing for mobility-on-demand systems
Pavone, M., Smith, S. L., Frazzoli, E., & Rus, D. L. (2012) · The International Journal of Robotics Research · doi:10.1177/0278364912444766 · Cited by 288 · see citing works
Dynamic Pricing in a Labor Market
Chen, M. K. (2016) · ACM Conference on Economics and Computation (EC) · doi:10.1145/2940716.2940798 · Cited by 261 · see citing works
Traffic flow optimization: A reinforcement learning approach
Walraven, E., Spaan, M. T. J., & Bakker, B. (2016) · Engineering Applications of Artificial Intelligence · doi:10.1016/j.engappai.2016.01.001 · Cited by 183 · see citing works
Dynamic Repositioning to Reduce Lost Demand in Bike Sharing Systems
Ghosh, S. K., Varakantham, P. R., Adulyasak, Y., et al. (2017) · Journal of Artificial Intelligence Research · doi:10.1613/jair.5308 · Cited by 174 · see citing works
Chen, J., Low, K. H., Yao, Y., et al. (2015) · IEEE Transactions on Automation Science and Engineering · doi:10.1109/tase.2015.2422852 · Cited by 104 · see citing works
Dynamic Ride-Sharing and Optimal Fleet Sizing for a System of Shared Autonomous Vehicles
Fagnant, D. J., & Kockelman, K. M. (2015) · Transportation Research Board 94th Annual MeetingTransportation Research Board · Cited by 71 · see citing works
Shared-Vehicle Mobility-on-Demand Systems: A Fleet Operator's Guide to Rebalancing Empty Vehicles
Spieser, K., Samaranayake, S., Gruel, W., & Frazzoli, E. (2016) · Transportation Research Board 95th Annual MeetingTransportation Research Board · Cited by 69 · see citing works
Simulation Framework for Rebalancing of Autonomous Mobility on Demand Systems
Marczuk, K. A., Soh, H. S. H., Azevedo, C. L., et al. (2016) · MATEC Web of Conferences · doi:10.1051/matecconf/20168101005 · Cited by 43 · see citing works
Routing an Autonomous Taxi with Reinforcement Learning
Han, M., Senellart, P., Bressan, S., et al. (2016) · doi:10.1145/2983323.2983379 · Cited by 41 · see citing works
Privacy-preserving vehicle assignment for mobility-on-demand systems
Prorok, A., & Kumar, V. (2017) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2017.8206003 · Cited by 30 · see citing works
Performance Analysis of a Forecasting Relocation Model for One-Way Carsharing
Alfian, G., Rhee, J., Ijaz, M. F., et al. (2017) · Applied Sciences · doi:10.3390/app7060598 · Cited by 23 · see citing works
Dynamic arrival rate estimation for campus Mobility On Demand network graphs
Miller, J., Hasfura, A., Liu, S.-Y., et al. (2016) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2016.7759357 · Cited by 12 · see citing works
Embedding Autonomous Vehicle Sharing in Public Transit System: An Example of Last-Mile Problem
Shen, Y., Zhang, H., & Zhao, J. (2017) · Transportation Research Board 96th Annual MeetingTransportation Research Board · Cited by 9 · see citing works
Self-citationDynamic Pricing in Shared Mobility on Demand Service and its Social Impacts
Qiu, H., Li, R., & Zhao, J. (2018) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 4 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Shen, Y., Zhang, H., & Zhao, J. (2018) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2018.04.004 · Cited by 330 · see citing works
Self-citationTackling climate change with machine learning
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., et al. (2023) · ACM Computing Surveys · doi:10.1145/3485128 · Cited by 336 · see citing works
Gueriau, M., Cugurullo, F., Acheampong, R. A., & Dusparic, I. (2020) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2020.3014417 · Cited by 15 · see citing works
- Authors
- Wen, J., Zhao, J., & Jaillet, P.
- Affiliations
- Massachusetts Institute of Technology (US)
- Venue
- 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC)
- Publisher
- IEEE
- Published
- 2017-10
- Pages
- 220-225
- OpenAlex
- W2790769276
- Cited by
- 149
- References
- 23
- Citations by year
- 2026: 2 · 2025: 15 · 2024: 20 · 2023: 21 · 2022: 28 · 2021: 30 · 2020: 22 · 2019: 8 · 2018: 3
- FWCI
- 10.02
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Conference on Intelligent Transportation Systems (ITSC) (publishedVersion)
- Topics
- Physical Sciences › Engineering › Automotive Engineering › Transportation and Mobility Innovations
- Social Sciences › Transportation › Transportation Planning and Optimization
- Physical Sciences › Engineering › Building and Construction › Traffic Prediction and Management Techniques
- Keywords
- vehicle rebalancing, fleet management, deep Q-network, reinforcement learning, agent-based modeling, real-time decision making
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review