The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Residential Demand Response Using Reinforcement Learning
Abstract
We present a novel energy management system for residential demand response. The algorithm, named CAES, reduces residential energy costs and smooths energy usage. CAES is an online learning application that implicitly estimates the impact of future energy prices and of consumer decisions on long term costs and schedules residential device usage. CAES models both energy prices and residential device usage as Markov, but does not assume knowledge of the structure or transition probabilities of these Markov chains. CAES learns continuously and adapts to individual consumer preferences and pricing modifications over time. In numerical simulations CAES reduced average end-user financial costs from 16% to 40% with respect to a price-unaware energy allocation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
(1995) · Cited by 10,558
Barto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976
(2020) · Machine Learning and Visual Perception · doi:10.1515/9783110595567-011 · Cited by 1,930
Approximate Dynamic Programming: Solving the Curses of Dimensionality
Powell, W. B. (2007) · Wiley Series in Probability and Statistics · doi:10.1002/9780470182963 · Cited by 1,566
Needham, D., & Lloyd, C. (1968) · Economica · doi:10.2307/2552169 · Cited by 1,278
Control Techniques for Complex Networks
Meyn, S. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511804410 · Cited by 528
Dynamic Pricing, Advanced Metering, and Demand Response in Electricity Markets
Borenstein, S., Jaske, M., & Rosenfeld, A. H. (2002) · eScholarship (California Digital Library) · Cited by 519
The O.D.E. Method for Convergence of Stochastic Approximation and Reinforcement Learning
Borkar, V. S., & Meyn, S. P. (2000) · SIAM Journal on Control and Optimization · doi:10.1137/s0363012997331639 · Cited by 499
(1997) · An Introduction to Natural Computation · doi:10.7551/mitpress/3917.003.0017 · Cited by 492
Cited by
Smart Grid — The New and Improved Power Grid: A Survey
Fang, X., Misra, S., Xue, G., & Yang, D. (2012) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2011.101911.00087 · Cited by 3,405
A Survey on Demand Response in Smart Grids: Mathematical Models and Approaches
Deng, R., Yang, Z., Chow, M.-Y., & Chen, J. (2015) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2015.2414719 · Cited by 917
Reinforcement learning for demand response: A review of algorithms and modeling techniques
Vázquez-Canteli, J. R., & Nagy, Z. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.11.002 · Cited by 883
Antonopoulos, I., Robu, V., Couraud, B., Kirli, D., Norbu, S., Kiprakis, A., Flynn, D., Elizondo-Gonzalez, S., & Wattam, S. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.109899 · Cited by 656
On-Line Building Energy Optimization Using Deep Reinforcement Learning
Mocanu, E., Mocanu, D. C., Nguyen, P. H., Liotta, A., Webber, M. E., Gibescu, M., & Slootweg, J. G. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2834219 · Cited by 649
Reinforcement learning for building controls: The opportunities and challenges
Wang, Z., & Hong, T. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115036 · Cited by 577
Review on the research and practice of deep learning and reinforcement learning in smart grids
China Electric Power Research Institute, Zhang, D., Han, X., Taiyuan University of Technology, Deng, C., & China Electric Power Research Institute (2018) · CSEE Journal of Power and Energy Systems · doi:10.17775/cseejpes.2018.00520 · Cited by 561
Hossain, E., Khan, I., Un-Noor, F., Sikander, S. S., & Sunny, M. S. H. (2019) · IEEE Access · doi:10.1109/access.2019.2894819 · Cited by 513
Du, Y., & Li, F. (2020) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2019.2930299 · Cited by 393
Residential Demand Response of Thermostatically Controlled Loads Using Batch Reinforcement Learning
Ruelens, F., Claessens, B. J., Vandael, S., De Schutter, B., Babuska, R., & Belmans, R. (2017) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2517211 · Cited by 333
Optimal scheduling of household appliances for demand response
Setlhaolo, D., Xia, X., & Zhang, J. (2014) · Electric Power Systems Research · doi:10.1016/j.epsr.2014.04.012 · Cited by 311
Deep Reinforcement Learning for Autonomous Internet of Things: Model, Applications and Challenges
Lei, L., Tan, Y., Zheng, K., Liu, S., Zhang, K., & Shen, X. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2988367 · Cited by 298
MPC-Based Appliance Scheduling for Residential Building Energy Management Controller
Chen, C., Wang, J., Heo, Y., & Kishore, S. (2013) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2013.2265239 · Cited by 287
Bakare, M. S., Abdulkarim, A., Zeeshan, M., & Shuaibu, A. N. (2023) · Energy Informatics · doi:10.1186/s42162-023-00262-7 · Cited by 283
Scheduling Power Consumption With Price Uncertainty
Kim, T. T., & Poor, H. V. (2011) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2011.2159279 · Cited by 274
Optimal Demand Response Using Device-Based Reinforcement Learning
Wen, Z., O'Neill, D., & Maei, H. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2396993 · Cited by 266
Self-citationA Gentle Introduction to Reinforcement Learning and its Application in Different Fields
Naeem, M., Rizvi, S. T. H., & Coronato, A. (2020) · IEEE Access · doi:10.1109/access.2020.3038605 · Cited by 257
Artificial Intelligence Enabled Demand Response: Prospects and Challenges in Smart Grid Environment
Khan, M. A., Saleh, A. M., Waseem, M., & Sajjad, I. A. (2023) · IEEE Access · doi:10.1109/access.2022.3231444 · Cited by 179
Charbonnier, F., Morstyn, T., & McCulloch, M. D. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.118825 · Cited by 78
Lahariya, M., Sadeghianpourhamami, N., & Develder, C. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4090508 · Cited by 6
Metadata
- Authors
- O'Neill, D., Levorato, M., Goldsmith, A., & Mitra, U.
- Venue
- 2010 First IEEE International Conference on Smart Grid Communications
- Publisher
- IEEE
- Published
- 2010-10
- Pages
- 409-414
- OpenAlex
- W2012160694
- Cited by
- 281
- References
- 19
- FWCI
- 26.20
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.