Incentive-based demand response for smart grid with reinforcement learning and deep neural network
The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index.
Abstract
Abstract Balancing electricity generation and consumption is essential for smoothing the power grids. Any mismatch between energy supply and demand would increase costs to both the service provider and customers and may even cripple the entire grid. This paper proposes a novel real-time incentive-based demand response algorithm for smart grid systems with reinforcement learning and deep neural network, aiming to help the service provider to purchase energy resources from its subscribed customers to balance energy fluctuations and enhance grid reliability. In particular, to overcome the future uncertainties, deep neural network is used to predict the unknown prices and energy demands. After that, reinforcement learning is adopted to obtain the optimal incentive rates for different customers considering the profits of both service provider and customers. Simulation results show that this proposed incentive-based demand response algorithm induces demand side participation, promotes service provider and customers profitabilities, and improves system reliability by balancing energy resources, which can be regarded as a win-win strategy for both service provider and customers.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Advances in Neural Information Processing Systems 7
Tesauro, G., Touretzky, D. S., & Leen, T. K. (1995) · Cited by 869
On the Convergence of Stochastic Iterative Dynamic Programming Algorithms
Jaakkola, T., Jordan, M. I., & Singh, S. P. (1994) · Neural Computation · doi:10.1162/neco.1994.6.6.1185 · Cited by 770
Xiong, R., Cao, J., & Yu, Q. (2018) · Applied Energy · doi:10.1016/j.apenergy.2017.11.072 · Cited by 564
Asynchronous stochastic approximation and Q-learning
Tsitsiklis, J. N. (1994) · Machine Learning · doi:10.1007/bf00993306 · Cited by 453
Wu, J., He, H., Peng, J., Li, Y., & Li, Z. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.03.104 · Cited by 431
A Dynamic pricing demand response algorithm for smart grid: Reinforcement learning approach
Lu, R., Hong, S. H., & Zhang, X. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.03.072 · Cited by 430
Self-citationNeural Networks (IJCNN), The 2011 International Joint Conference on
Pokharel, R., Seth, S., & Principe, J. C. (2011) · CiteSeer X (The Pennsylvania State University) · Cited by 429
Deep Neural Network Based Demand Side Short Term Load Forecasting
Ryu, S., Noh, J., & Kim, H. (2016) · Energies · doi:10.3390/en10010003 · Cited by 409
Coupon Incentive-Based Demand Response: Theory and Case Study
Zhong, H., Xie, L., & Xia, Q. (2013) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2012.2218665 · Cited by 354
Residential Demand Response of Thermostatically Controlled Loads Using Batch Reinforcement Learning
Ruelens, F., Claessens, B. J., Vandael, S., De Schutter, B., Babuska, R., & Belmans, R. (2017) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2517211 · Cited by 333
Panapakidis, I. P., & Dagoumas, A. S. (2016) · Applied Energy · doi:10.1016/j.apenergy.2016.03.089 · Cited by 317
Wang, D., Luo, H., Grunder, O., Lin, Y., & Guo, H. (2017) · Applied Energy · doi:10.1016/j.apenergy.2016.12.134 · Cited by 312
Wang, Y., Ai, X., Tan, Z., Yan, L., & Liu, S. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2409121 · Cited by 288
Extended forecast methods for day-ahead electricity spot prices applying artificial neural networks
Keles, D., Scelle, J., Paraschiv, F., & Fichtner, W. (2016) · Applied Energy · doi:10.1016/j.apenergy.2015.09.087 · Cited by 270
Optimal Demand Response Using Device-Based Reinforcement Learning
Wen, Z., O'Neill, D., & Maei, H. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2396993 · Cited by 266
Supply–demand balancing for power management in smart grid: A Stackelberg game approach
Yu, M., & Hong, S. H. (2016) · Applied Energy · doi:10.1016/j.apenergy.2015.12.039 · Cited by 243
Self-citationSamad, T., Koch, E., & Stluka, P. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2016.2520639 · Cited by 234
Demand Response for Residential Appliances via Customer Reward Scheme
Vivekananthan, C., Mishra, Y., Ledwich, G., & Li, F. (2014) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2014.2298514 · Cited by 222
Artificial neural networks for short-term load forecasting in microgrids environment
Hernández, L., Baladrón, C., Aguiar, J. M., Carro, B., Sánchez-Esguevillas, A., & Lloret, J. (2014) · Energy · doi:10.1016/j.energy.2014.07.065 · Cited by 220
Yu, M., & Hong, S. H. (2017) · Applied Energy · doi:10.1016/j.apenergy.2017.06.010 · Cited by 216
Self-citationShen, B., Ghatikar, G., Lei, Z., Li, J., Wikler, G., & Martin, P. (2014) · Applied Energy · doi:10.1016/j.apenergy.2013.12.069 · Cited by 194
Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems
Bazzan, A. L. C., Huhns, M. N., Lomuscio, A. R., & Scerri, P. (2014) · Cited by 192
Microgrid to enable optimal distributed energy retail and end-user demand response
Jin, M., Feng, W., Marnay, C., & Spanos, C. (2018) · Applied Energy · doi:10.1016/j.apenergy.2017.05.103 · Cited by 189
Ghasemi, A., Shayeghi, H., Moradzadeh, M., & Nooshyar, M. (2016) · Applied Energy · doi:10.1016/j.apenergy.2016.05.083 · Cited by 186
Optimal use of incentive and price based demand response to reduce costs and price volatility
Asadinejad, A., & Tomsovic, K. L. (2016) · Electric Power Systems Research · doi:10.1016/j.epsr.2016.12.012 · Cited by 186
Reinforcement Learning Applied to an Electric Water Heater: From Theory to Practice
Ruelens, F., Claessens, B. J., Quaiyum, S., De Schutter, B., Babuska, R., & Belmans, R. (2018) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2640184 · Cited by 173
An Incentive-Based Demand Response (DR) Model Considering Composited DR Resources
Yu, M., Hong, S. H., Ding, Y., & Ye, X. (2018) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2018.2826454 · Cited by 159
Self-citationGhazvini, M. A. F., Soares, J., Horta, N. C. G., Neves, R. F., Castro, R. M. G., & Vale, Z. (2015) · Applied Energy · doi:10.1016/j.apenergy.2015.04.067 · Cited by 141
2015 North American Power Symposium (NAPS)
(2015) · doi:10.1109/naps36459.2015 · Cited by 140
Ferreira, P. V. R., Paffenroth, R., Wyglinski, A. M., Hackett, T. M., Bilen, S. G., Reinhart, R. C., & Mortensen, D. J. (2018) · IEEE Journal on Selected Areas in Communications · doi:10.1109/jsac.2018.2832820 · Cited by 136
Evaluation of residential customer elasticity for incentive based demand response programs
Asadinejad, A., Rahimpour, A., Tomsovic, K. L., Qi, H., & Chen, C. (2018) · Electric Power Systems Research · doi:10.1016/j.epsr.2017.12.017 · Cited by 133
Alasseri, R., Tripathi, A., Rao, T. J., & Sreekanth, K. J. (2017) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2017.04.023 · Cited by 132
An Imaging and Measurement System for Robust Reconstruction of Weld Pool During Arc Welding
Wang, Z. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2015.2405494 · Cited by 101
Hour-Ahead Price Based Energy Management Scheme for Industrial Facilities
Huang, X., Hong, S. H., & Li, Y. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2711648 · Cited by 99
Self-citationResidential electrical demand forecasting in very small scale: An evaluation of forecasting methods
Marinescu, A., Harris, C., Dusparić, I., Clarke, S., & Cahill, V. (2013) · International Workshop on Software Engineering Challenges for the Smart Grid (SE4SG) · doi:10.1109/se4sg.2013.6596108 · Cited by 94
Ghazvini, M. A. F., Faria, P., Ramos, S., Morais, H. G. V., & Vale, Z. (2015) · Energy · doi:10.1016/j.energy.2015.01.090 · Cited by 93
A real-time decision model for industrial load management in a smart grid
Yu, M., Lu, R., & Hong, S. H. (2016) · Applied Energy · doi:10.1016/j.apenergy.2016.09.021 · Cited by 76
Self-citationPrediction-Based Multi-Agent Reinforcement Learning in Inherently Non-Stationary Environments
Marinescu, A., Dusparic, I., & Clarke, S. (2017) · ACM Transactions on Autonomous and Adaptive Systems · doi:10.1145/3070861 · Cited by 69
Limiting gaming opportunities on incentive-based demand response programs
Vuelvas, J., Ruíz, F., & Gruosso, G. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.05.050 · Cited by 68
Enabling Cooperative Behavior for Building Demand Response Based on Extended Joint Action Learning
Hurtado, L. A., Mocanu, E., Nguyen, P. H., Gibescu, M., & Kamphuis, R. I. G. (2018) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2753408 · Cited by 66
Multi-agent residential demand response based on load forecasting
Dusparic, I., Harris, C., Marinescu, A., Cahill, V., & Clarke, S. (2013) · 2013 1st IEEE Conference on Technologies for Sustainability (SusTech) · doi:10.1109/sustech.2013.6617303 · Cited by 54
Residential demand response: Experimental evaluation and comparison of self-organizing techniques
Dusparić, I., Taylor, A., Marinescu, A., Golpayegani, F., & Clarke, S. (2017) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2017.07.033 · Cited by 46
Maximizing renewable energy use with decentralized residential demand response
Dusparić, I., Taylor, A., Marinescu, A., Cahill, V., & Clarke, S. (2015) · IEEE International Smart Cities Conference (ISC2) · doi:10.1109/isc2.2015.7366212 · Cited by 38
Incentive-based demand response approach for aggregated demand side participation
Yu, M., Hong, S. H., & Kim, J. B. (2016) · IEEE International Conference on Smart Grid Communications (SmartGridComm) · doi:10.1109/smartgridcomm.2016.7778737 · Cited by 32
Self-citationScheduling a storage-augmented discrete production facility under incentive-based demand response
Weitzel, T., & Glock, C. H. (2018) · International Journal of Production Research · doi:10.1080/00207543.2018.1475764 · Cited by 29
P-MARL: Prediction-Based Multi-Agent Reinforcement Learning for Non-Stationary Environments
Marinescu, A., Dusparić, I., Taylor, A., et al. (2015) · Adaptive Agents and Multi-Agents Systems · doi:10.5555/2772879.2773492 · Cited by 9
Cited by
Applications of artificial intelligence and machine learning in smart cities
Ullah, Z., Al-Turjman, F., Mostarda, L., & Gagliardi, R. (2020) · Computer Communications · doi:10.1016/j.comcom.2020.02.069 · Cited by 756
Antonopoulos, I., Robu, V., Couraud, B., Kirli, D., Norbu, S., Kiprakis, A., Flynn, D., Elizondo-Gonzalez, S., & Wattam, S. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.109899 · Cited by 656
Quo vadis artificial intelligence?
Jiang, Y., Li, X., Luo, H., Yin, S., & Kaynak, O. (2022) · Discover Artificial Intelligence · doi:10.1007/s44163-022-00022-8 · Cited by 544
Machine learning driven smart electric power systems: Current trends and new perspectives
Ibrahim, M. S., Dong, W., & Yang, Q. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115237 · Cited by 435
Applications of reinforcement learning in energy systems
Perera, A. T. D., & Kamalaruban, P. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110618 · Cited by 420
Metadata
- Authors
- Lu, R., & Hong, S. H.
- Venue
- Applied Energy
- Publisher
- Elsevier BV
- Published
- 2019-02
- Volume
- 236
- Pages
- 937-949
- ISSN
- 0306-2619 (ISSN-L)
- OpenAlex
- W2904635416
- Cited by
- 394
- References
- 50
- FWCI
- 12.32
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.