The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Residential Demand Response Using Reinforcement Learning
Abstract
We present a novel energy management system for residential demand response. The algorithm, named CAES, reduces residential energy costs and smooths energy usage. CAES is an online learning application that implicitly estimates the impact of future energy prices and of consumer decisions on long term costs and schedules residential device usage. CAES models both energy prices and residential device usage as Markov, but does not assume knowledge of the structure or transition probabilities of these Markov chains. CAES learns continuously and adapts to individual consumer preferences and pricing modifications over time. In numerical simulations CAES reduced average end-user financial costs from 16% to 40% with respect to a price-unaware energy allocation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
(1995) · Cited by 10,558
Barto, A. G. (1998) · IFAC Proceedings Volumes · doi:10.1016/s1474-6670(17)38315-5 · Cited by 2,976
(2020) · Machine Learning and Visual Perception · doi:10.1515/9783110595567-011 · Cited by 1,930
Approximate Dynamic Programming: Solving the Curses of Dimensionality
Powell, W. B. (2007) · Wiley Series in Probability and Statistics · doi:10.1002/9780470182963 · Cited by 1,566
Needham, D., & Lloyd, C. (1968) · Economica · doi:10.2307/2552169 · Cited by 1,278
Control Techniques for Complex Networks
Meyn, S. (2007) · Cambridge University Press eBooks · doi:10.1017/cbo9780511804410 · Cited by 528
Dynamic Pricing, Advanced Metering, and Demand Response in Electricity Markets
Borenstein, S., Jaske, M., & Rosenfeld, A. H. (2002) · eScholarship (California Digital Library) · Cited by 519
The O.D.E. Method for Convergence of Stochastic Approximation and Reinforcement Learning
Borkar, V. S., & Meyn, S. P. (2000) · SIAM Journal on Control and Optimization · doi:10.1137/s0363012997331639 · Cited by 499
(1997) · An Introduction to Natural Computation · doi:10.7551/mitpress/3917.003.0017 · Cited by 492
Residential implementation of critical-peak pricing of electricity
Herter, K. (2007) · Energy Policy · doi:10.1016/j.enpol.2006.06.019 · Cited by 350
Quantifying Customer Response to Dynamic Pricing
Faruqui, A., & George, S. (2005) · The Electricity Journal · doi:10.1016/j.tej.2005.04.005 · Cited by 261
Herter, K., McAuliffe, P., & Rosenfeld, A. (2007) · Energy · doi:10.1016/j.energy.2006.01.014 · Cited by 228
A Survey of Utility Experience with Real Time Pricing
Barbose, G., Goldman, C., & Neenan, B. (2004) · doi:10.2172/836966 · Cited by 188
Development and evaluation of fully automated demand response in large facilities
Piette, M. A., USDOE. Assistant Secretary for Energy Efficiency and Renewable Energy. Office of the Building Technologies Program, Sezgen, O., Watson, D., Motegi, N., Shockman, C., & ten Hope, L. (2004) · doi:10.2172/840331 · Cited by 113
An Integrated Architecture for Demand Response Communications and Control
LeMay, M., Nelli, R., Gross, G., et al. (2008) · Proceedings of the ... Annual Hawaii International Conference on System Sciences/Proceedings of the Annual Hawaii International Conference on System Sciences · doi:10.1109/hicss.2008.60 · Cited by 106
Industrial power demand response analysis for one-part real-time pricing
Roos, J. G., & Lane, I. E. (1998) · IEEE Transactions on Power Systems · doi:10.1109/59.651628 · Cited by 105
THE ROLE OF DEMAND RESPONSE IN ELECTRIC POWER MARKET DESIGN
Braithwait, S. D., Eakin, K., & Christensen, L. R. (2002) · Cited by 71
Intelligent Demand Response Scheme for Customer Side Load Management
Dam, Q. B., Mohagheghi, S., & Stoupis, J. (2008) · doi:10.1109/energy.2008.4781013 · Cited by 68
Cited by
Smart Grid — The New and Improved Power Grid: A Survey
Fang, X., Misra, S., Xue, G., & Yang, D. (2012) · IEEE Communications Surveys & Tutorials · doi:10.1109/surv.2011.101911.00087 · Cited by 3,405
A Survey on Demand Response in Smart Grids: Mathematical Models and Approaches
Deng, R., Yang, Z., Chow, M.-Y., & Chen, J. (2015) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2015.2414719 · Cited by 917
Reinforcement learning for demand response: A review of algorithms and modeling techniques
Vázquez-Canteli, J. R., & Nagy, Z. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.11.002 · Cited by 883
Antonopoulos, I., Robu, V., Couraud, B., Kirli, D., Norbu, S., Kiprakis, A., Flynn, D., Elizondo-Gonzalez, S., & Wattam, S. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.109899 · Cited by 656
On-Line Building Energy Optimization Using Deep Reinforcement Learning
Mocanu, E., Mocanu, D. C., Nguyen, P. H., Liotta, A., Webber, M. E., Gibescu, M., & Slootweg, J. G. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2834219 · Cited by 649
Metadata
- Authors
- O'Neill, D., Levorato, M., Goldsmith, A., & Mitra, U.
- Venue
- 2010 First IEEE International Conference on Smart Grid Communications
- Publisher
- IEEE
- Published
- 2010-10
- Pages
- 409-414
- OpenAlex
- W2012160694
- Cited by
- 281
- References
- 19
- FWCI
- 26.20
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.