The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
A Dynamic pricing demand response algorithm for smart grid: Reinforcement learning approach
Abstract
With the modern advanced information and communication technologies in smart grid systems, demand response (DR) has become an effective method for improving grid reliability and reducing energy costs due to the ability to react quickly to supply-demand mismatches by adjusting flexible loads on the demand side. This paper proposes a dynamic pricing DR algorithm for energy management in a hierarchical electricity market that considers both service provider’s (SP) profit and customers’ (CUs) costs. Reinforcement learning (RL) is used to illustrate the hierarchical decision-making framework, in which the dynamic pricing problem is formulated as a discrete finite Markov decision process (MDP), and Q-learning is adopted to solve this decision-making problem. Using RL, the SP can adaptively decide the retail electricity price during the on-line learning process where the uncertainty of CUs’ load demand profiles and the flexibility of wholesale electricity prices are addressed. Simulation results show that this proposed DR algorithm, can promote SP profitability, reduce energy costs for CUs, balance energy supply and demand in the electricity market, and improve the reliability of electric power systems, which can be regarded as a win-win strategy for both SP and CUs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Demand response and smart grids – a survey
Siano, P. (2014) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2013.10.022 · Cited by 2,411
A Survey on Demand Response Programs in Smart Grids: Pricing Methods and Optimization Algorithms
Vardakas, J. S., Zorba, N., & Verikoukis, C. V. (2015) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2014.2341586 · Cited by 953
Asynchronous stochastic approximation and Q-learning
Tsitsiklis, J. N. (1994) · Machine Learning · doi:10.1007/bf00993306 · Cited by 453
A game-theoretic approach for optimal time-of-use electricity pricing
Yang, P., Tang, G., & Nehorai, A. (2013) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2012.2207134 · Cited by 438
Demand response in electrical energy supply: An optimal real time pricing approach
Faria, P., & Vale, Z. (2011) · Energy · doi:10.1016/j.energy.2011.06.049 · Cited by 336
Residential Demand Response of Thermostatically Controlled Loads Using Batch Reinforcement Learning
Ruelens, F., Claessens, B. J., Vandael, S., De Schutter, B., Babuska, R., & Belmans, R. (2017) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2517211 · Cited by 333
Challenges and barriers to demand response deployment and evaluation
Nolan, S., & O’Malley, M. (2015) · Applied Energy · doi:10.1016/j.apenergy.2015.04.083 · Cited by 292
Reinforcement learning for microgrid energy management
Kuznetsova, E., Li, Y.-F., Ruiz, C., Zio, E., Ault, G., & Bell, K. (2013) · Energy · doi:10.1016/j.energy.2013.05.060 · Cited by 274
Optimal Demand Response Using Device-Based Reinforcement Learning
Wen, Z., O'Neill, D., & Maei, H. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2396993 · Cited by 266
Residential peak electricity demand response—Highlights of some behavioural issues
Gyamfi, S., Krumdieck, S., & Urmee, T. (2013) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2013.04.006 · Cited by 265
2018 Power Systems Computation Conference (PSCC)
(2018) · doi:10.23919/pscc41194.2018 · Cited by 251
A Demand Response Energy Management Scheme for Industrial Facilities in Smart Grid
Ding, Y. M., Hong, S. H., & Li, X. H. (2014) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2014.2330995 · Cited by 248
Self-citationSupply–demand balancing for power management in smart grid: A Stackelberg game approach
Yu, M., & Hong, S. H. (2016) · Applied Energy · doi:10.1016/j.apenergy.2015.12.039 · Cited by 243
Self-citationYu, M., & Hong, S. H. (2017) · Applied Energy · doi:10.1016/j.apenergy.2017.06.010 · Cited by 216
Self-citationReinforcement Learning of Heuristic EV Fleet Charging in a Day-Ahead Electricity Market
Vandael, S., Claessens, B., Ernst, D., Holvoet, T., & Deconinck, G. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2393059 · Cited by 208
Real-Time Opportunistic Scheduling for Residential Demand Response
Yi, P., Dong, X., Iwayemi, A., Zhou, C., & Li, S. (2013) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2012.2225155 · Cited by 199
Dynamic Pricing and Distributed Energy Management for Demand Response
Jia, L., & Tong, L. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2515641 · Cited by 196
Shen, B., Ghatikar, G., Lei, Z., Li, J., Wikler, G., & Martin, P. (2014) · Applied Energy · doi:10.1016/j.apenergy.2013.12.069 · Cited by 194
Microgrid to enable optimal distributed energy retail and end-user demand response
Jin, M., Feng, W., Marnay, C., & Spanos, C. (2018) · Applied Energy · doi:10.1016/j.apenergy.2017.05.103 · Cited by 189
Reinforcement Learning-Based Plug-in Electric Vehicle Charging with Forecasted Price
Chis, A., Lunden, J., & Koivunen, V. (2016) · IEEE Transactions on Vehicular Technology · doi:10.1109/tvt.2016.2603536 · Cited by 178
Reinforcement Learning Applied to an Electric Water Heater: From Theory to Practice
Ruelens, F., Claessens, B. J., Quaiyum, S., De Schutter, B., Babuska, R., & Belmans, R. (2018) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2640184 · Cited by 173
On the Convergence of Stochastic Iterative Dynamic Programming Algorithms
Jaakkola, T., Jordan, M. I., & Singh, S. P. (1993) · Defense Technical Information Center (DTIC) · doi:10.21236/ada276517 · Cited by 165
Short- and long-run time-of-use price elasticities in Swiss residential electricity demand
Filippini, M. (2011) · Energy Policy · doi:10.1016/j.enpol.2011.06.002 · Cited by 159
Residential Load Modeling of Price-Based Demand Response for Network Impact Studies
McKenna, K., & Keane, A. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2437451 · Cited by 156
Jiang, B., & Fei, Y. (2014) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2014.2347043 · Cited by 147
Miller, M., & Alberini, A. (2016) · Energy Policy · doi:10.1016/j.enpol.2016.07.031 · Cited by 146
Wang, Z., & Paranjape, R. B. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2479557 · Cited by 123
User-expected price-based demand response algorithm for a home-to-grid system
Li, X., & Hong, S. H. (2013) · Energy · doi:10.1016/j.energy.2013.11.049 · Cited by 118
Self-citationThimmapuram, P. R., & Kim, J. (2013) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2012.2234487 · Cited by 116
Behboodi, S., Chassin, D. P., Djilali, N., & Crawford, C. A. (2017) · Applied Energy · doi:10.1016/j.apenergy.2017.07.058 · Cited by 112
An Imaging and Measurement System for Robust Reconstruction of Weld Pool During Arc Welding
Wang, Z. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2015.2405494 · Cited by 101
Hour-Ahead Price Based Energy Management Scheme for Industrial Facilities
Huang, X., Hong, S. H., & Li, Y. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2711648 · Cited by 99
Self-citationAn automated residential demand response pilot experiment, based on day-ahead dynamic pricing
Vanthournout, K., Dupont, B., Foubert, W., Stuckens, C., & Claessens, S. (2015) · Applied Energy · doi:10.1016/j.apenergy.2015.05.100 · Cited by 96
Gao, D.-C., Sun, Y., & Lu, Y. (2015) · Energy · doi:10.1016/j.energy.2015.09.062 · Cited by 92
Optimal control in microgrid using multi-agent reinforcement learning
Li, F.-D., Wu, M., He, Y., & Chen, X. (2012) · ISA Transactions · doi:10.1016/j.isatra.2012.06.010 · Cited by 88
Ruelens, F., Claessens, B., Vandael, S., Iacovella, S., Vingerhoets, P., & Belmans, R. J. M. (2014) · Power Systems Computation Conference · doi:10.1109/pscc.2014.7038106 · Cited by 86
Real-time dynamic pricing in a non-stationary environment using model-free reinforcement learning
Rana, R., & Oliveira, F. S. (2013) · Omega · doi:10.1016/j.omega.2013.10.004 · Cited by 86
A real-time decision model for industrial load management in a smart grid
Yu, M., Lu, R., & Hong, S. H. (2016) · Applied Energy · doi:10.1016/j.apenergy.2016.09.021 · Cited by 76
Self-citationCommercial and Industrial Demand Response Under Mandatory Time‐of‐Use Electricity Pricing
Jessoe, K., & Rapson, D. S. (2015) · Journal of Industrial Economics · doi:10.1111/joie.12082 · Cited by 66
A Price-Based Demand Response Scheme for Discrete Manufacturing in Smart Grids
Luo, Z., Hong, S.-H., & Kim, J.-B. (2016) · Energies · doi:10.3390/en9080650 · Cited by 29
Self-citation
Cited by
Antonopoulos, I., Robu, V., Couraud, B., Kirli, D., Norbu, S., Kiprakis, A., Flynn, D., Elizondo-Gonzalez, S., & Wattam, S. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.109899 · Cited by 656
Machine learning driven smart electric power systems: Current trends and new perspectives
Ibrahim, M. S., Dong, W., & Yang, Q. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115237 · Cited by 435
Applications of reinforcement learning in energy systems
Perera, A. T. D., & Kamalaruban, P. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110618 · Cited by 420
A Multi-Agent Reinforcement Learning-Based Data-Driven Method for Home Energy Management
Xu, X., Jia, Y., Xu, Y., Xu, Z., Chai, S., & Lai, C. S. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2020.2971427 · Cited by 420
Incentive-based demand response for smart grid with reinforcement learning and deep neural network
Lu, R., & Hong, S. H. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.12.061 · Cited by 394
Self-citation
Metadata
- Authors
- Lu, R., Hong, S. H., & Zhang, X.
- Venue
- Applied Energy
- Publisher
- Elsevier BV
- Published
- 2018-06
- Volume
- 220
- Pages
- 220-230
- ISSN
- 0306-2619 (ISSN-L)
- OpenAlex
- W2795276745
- Cited by
- 430
- References
- 43
- FWCI
- 15.99
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.