The DOI matches its Crossref record; 87 of the 87 references it cites were found in a registry or an index.
A review of reinforcement learning for autonomous building energy management
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Human-level control through deep reinforcement learning
Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., Graves, A., Riedmiller, M., Fidjeland, A. K., Ostrovski, G., et al. (2015) · Nature · doi:10.1038/nature14236 · Cited by 30,357
Reinforcement Learning: An Introduction
(2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 24,496
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Electrical energy storage for the grid: A battery of choices
Dunn, B., Kamath, H., & Tarascon, J.-M. (2011) · Science · doi:10.1126/science.1212741 · Cited by 15,072
Continuous control with deep reinforcement learning
Lillicrap, T. P., Hunt, J. J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., & Wierstra, D. (2015) · arXiv · doi:10.48550/arxiv.1509.02971 · Cited by 10,782
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
A review on buildings energy consumption information
Pérez-Lombard, L., Ortiz, J., & Pout, C. (2008) · Energy and Buildings · doi:10.1016/j.enbuild.2007.03.007 · Cited by 6,649 · cited 1×
“ntensive consumers of energy in buildings. It is estimated that HVAC is responsible for 50% of building energy consumption in the US and between 10 - 20% of overall consumption in developed countries [7]. This is due to expectation of thermal comfort in developed countries, rather than it being regarded as a luxury [8…”
BackgroundAn Introduction to MultiAgent Systems
Wooldridge, M. (2002) · Cited by 5,394
Watkins, C. (1989) · OpenGrey (Institut de l'Information Scientifique et Technique) · doi:10.17863/cam.132164 · Cited by 5,297
Deep Reinforcement Learning: A Brief Survey
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · IEEE Signal Processing Magazine · doi:10.1109/msp.2017.2743240 · Cited by 4,733
A Brief Survey of Deep Reinforcement Learning
Arulkumaran, K., Deisenroth, M. P., Brundage, M., & Bharath, A. A. (2017) · arXiv · doi:10.48550/arxiv.1708.05866 · Cited by 4,733
Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1023/a:1022676722315 · Cited by 3,907
Coumou, D., & Rahmstorf, S. (2012) · Nature Climate Change · doi:10.1038/nclimate1452 · Cited by 2,289
Kempton, W., & Tomić, J. (2005) · Journal of Power Sources · doi:10.1016/j.jpowsour.2004.12.022 · Cited by 2,126
Nejat, P., Jomehzadeh, F., Taheri, M. M., Gohari, M., & Abd. Majid, M. Z. (2015) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2014.11.066 · Cited by 1,945
Temporal difference learning and TD-Gammon
Tesauro, G. (1995) · Communications of the ACM · doi:10.1145/203330.203343 · Cited by 1,618 · cited 1×
“s) = maxE[r t+1 + V ˇ(s t+1) js;ˇ ] (2) Figure 1: Agent Environment Interaction One of the first significant achievements of RL was its application to learn to play backgammon in 1995 by Gerald Tesauro [29]. Some of the more recent achievements include learning to play Atari games at a level comparable to 4 Initialize A…”
BackgroundTransfer Learning for Reinforcement Learning Domains: A Survey
Taylor, M. E., & Stone, P. (2009) · doi:10.5555/1577069.1755839 · Cited by 1,488
On-line Q-learning Using Connectionist Systems
Rummery, G. A. (1994) · Cited by 1,477
Thermal comfort and building energy consumption implications—A review
Yang, L., Yan, H., & Lam, J. C. (2014) · Applied Energy · doi:10.1016/j.apenergy.2013.10.062 · Cited by 1,448
A review of internet of things for smart home: challenges and solutions
Risteska Stojkoska, B. L., & Trivodaliev, K. V. (2017) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2016.10.006 · Cited by 1,397
Theory and applications of HVAC control systems – A review of model predictive control (MPC)
Afram, A., & Janabi-Sharifi, F. (2014) · Building and Environment · doi:10.1016/j.buildenv.2013.11.016 · Cited by 1,310
A review of the development of Smart Grid technologies
Tuballa, M. L., & Abundo, M. L. (2016) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2016.01.011 · Cited by 884
Multiagent cooperation and competition with deep reinforcement learning
Tampuu, A., Matiisen, T., Kodelja, D., Kuzovkin, I., Korjus, K., Aru, J., Aru, J., & Vicente, R. (2017) · PLOS ONE · doi:10.1371/journal.pone.0172395 · Cited by 877
Tan, K. M., Ramachandaramurthy, V. K., & Yong, J. Y. (2016) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2015.09.012 · Cited by 872
Smart home energy management systems: Concept, configurations, and scheduling strategies
Zhou, B., Li, W., Chan, K. W., Cao, Y., Kuang, Y., Liu, X., & Wang, X. (2016) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2016.03.047 · Cited by 845
Prioritized sweeping: Reinforcement learning with less data and less time
Moore, A. W., & Atkeson, C. G. (1993) · Machine Learning · doi:10.1007/bf00993104 · Cited by 823
Near-Optimal Reinforcement Learning in Polynomial Time
Kearns, M., & Singh, S. (2002) · Machine Learning · doi:10.1023/a:1017984413808 · Cited by 792
Dyna, an Integrated Architecture for Learning, Planning, and Reacting
Sutton, R. S. (1991) · ACM SIGART Bulletin · doi:10.1145/122344.122377 · Cited by 777
Multi-agent Reinforcement Learning: An Overview
Buşoniu, L., Babuška, R., & De Schutter, B. (2010) · Studies in Computational Intelligence · doi:10.1007/978-3-642-14435-6_7 · Cited by 741
On-Line Building Energy Optimization Using Deep Reinforcement Learning
Mocanu, E., Mocanu, D. C., Nguyen, P. H., Liotta, A., Webber, M. E., Gibescu, M., & Slootweg, J. G. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2834219 · Cited by 649
Dynamic energy-consumption indicators for domestic appliances: environment, behaviour and design
Wood, G., & Newborough, M. (2003) · Energy and Buildings · doi:10.1016/s0378-7788(02)00241-4 · Cited by 506
RL$^2$: Fast Reinforcement Learning via Slow Reinforcement Learning
Duan, Y., Schulman, J., Chen, X., Bartlett, P. L., Sutskever, I., & Abbeel, P. (2016) · arXiv · doi:10.48550/arxiv.1611.02779 · Cited by 503
Deep Reinforcement Learning for Building HVAC Control
Wei, T., Wang, Y., & Zhu, Q. (2017) · Proceedings of the 54th Annual Design Automation Conference 2017 · doi:10.1145/3061639.3062224 · Cited by 478
A Dynamic pricing demand response algorithm for smart grid: Reinforcement learning approach
Lu, R., Hong, S. H., & Zhang, X. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.03.072 · Cited by 430
Li, D. H. W., Yang, L., & Lam, J. C. (2012) · Energy · doi:10.1016/j.energy.2012.03.044 · Cited by 382
Metalearning: A survey of trends and technologies
Lemke, C., Budka, M., & Gabrys, B. (2015) · Artificial Intelligence Review · doi:10.1007/s10462-013-9406-y · Cited by 365
Partially Observable Markov Decision Processes
Spaan, M. T. J. (2012) · Adaptation, Learning, and Optimization · doi:10.1007/978-3-642-27645-3_12 · Cited by 315
Dynamic Pricing and Energy Consumption Scheduling With Reinforcement Learning
Kim, B.-G., Zhang, Y., van der Schaar, M., & Lee, J.-W. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2495145 · Cited by 299
A multi-agent based energy management solution for integrated buildings and microgrid system
Anvari-Moghaddam, A., Rahimi-Kian, A., Mirian, M. S., & Guerrero, J. M. (2017) · Applied Energy · doi:10.1016/j.apenergy.2017.06.007 · Cited by 290
Optimal control of HVAC and window systems for natural ventilation through reinforcement learning
Chen, Y., Norford, L. K., Samuelson, H. W., & Malkawi, A. (2018) · Energy and Buildings · doi:10.1016/j.enbuild.2018.03.051 · Cited by 289
An Experimental Review of Reinforcement Learning Algorithms for Adaptive Traffic Signal Control
Mannion, P., Duggan, J., & Howley, E. (2016) · Autonomic Road Transport Support Systems · doi:10.1007/978-3-319-25808-9_4 · Cited by 267
Optimal Demand Response Using Device-Based Reinforcement Learning
Wen, Z., O'Neill, D., & Maei, H. (2015) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2015.2396993 · Cited by 266
Smart meters for power grid — Challenges, issues, advantages and status
Depuru, S. S. S. R., Wang, L., Devabhaktuni, V., & Gudi, N. (2011) · 2011 IEEE/PES Power Systems Conference and Exposition · doi:10.1109/psce.2011.5772451 · Cited by 265
Hardware Design of Smart Home Energy Management System With Dynamic Price Response
Hu, Q., & Li, F. (2013) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2013.2258181 · Cited by 261
Autonomous Appliance Scheduling for Household Energy Management
Adika, C. O., & Wang, L. (2014) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2013.2271427 · Cited by 258
Oldewurtel, F., Ulbig, A., Parisio, A., Andersson, G., & Morari, M. (2010) · 49th IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2010.5717458 · Cited by 237
Wei, Q., Liu, D., & Shi, G. (2014) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2014.2361485 · Cited by 230
Multi-objective reinforcement learning using sets of pareto dominating policies
Moffaert, K. V., & Nowé, A. (2014) · doi:10.5555/2627435.2750356 · Cited by 230
Efficient Learning and Planning Within the Dyna Framework
Peng, J., & Williams, R. J. (1993) · Adaptive Behavior · doi:10.1177/105971239300100403 · Cited by 199
State of the Art and Trends Review of Smart Metering in Electricity Grids
Uribe-Pérez, N., Hernández, L., De la Vega, D., & Angulo, I. (2016) · Applied Sciences · doi:10.3390/app6030068 · Cited by 188
Reinforcement learning for optimal control of low exergy buildings
Yang, L., Nagy, Z., Goffin, P., & Schlueter, A. (2015) · Applied Energy · doi:10.1016/j.apenergy.2015.07.050 · Cited by 182
Decentralized control of partially observable Markov decision processes
Amato, C., Chowdhary, G. V., Geramifard, A., Üre, N. K., & Kochenderfer, M. J. (2013) · IEEE Conference on Decision and Control (CDC) · doi:10.1109/cdc.2013.6760239 · Cited by 180
Gram-Hanssen, K. (2013) · Energy Efficiency · doi:10.1007/s12053-012-9184-4 · Cited by 174
Reinforcement Learning Applied to an Electric Water Heater: From Theory to Practice
Ruelens, F., Claessens, B. J., Quaiyum, S., De Schutter, B., Babuska, R., & Belmans, R. (2018) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2640184 · Cited by 173
Reinforcement Learning Based Energy Management Algorithm for Smart Energy Buildings
Kim, S., & Lim, H. (2018) · Energies · doi:10.3390/en11082010 · Cited by 169
Economics of Residential Photovoltaic Battery Systems in Germany: The Case of Tesla’s Powerwall
Truong, C. N., Naumann, M., Karl, R. C., Müller, M., Jossen, A., & Hesse, H. C. (2016) · Batteries · doi:10.3390/batteries2020014 · Cited by 165
Claessens, B., Vrancx, P., & Ruelens, F. (2016) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2016.2629450 · Cited by 160
Wang, Y., Velswamy, K., & Huang, B. (2017) · Processes · doi:10.3390/pr5030046 · Cited by 157
Jiang, B., & Fei, Y. (2014) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2014.2347043 · Cited by 147
Autonomous HVAC Control, A Reinforcement Learning Approach
Barrett, E., & Linder, S. P. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-23461-8_1 · Cited by 135
Wang, Y., Lin, X., & Pedram, M. (2015) · IEEE Transactions on Sustainable Energy · doi:10.1109/tste.2015.2467190 · Cited by 132
Liu, S., & Henze, G. P. (2005) · Energy and Buildings · doi:10.1016/j.enbuild.2005.06.001 · Cited by 124
Reinforcement Learning in Continuous Action Spaces through Sequential Monte Carlo Methods
Lazaric, A., Restelli, M., & Bonarini, A. (2007) · Cited by 116
PHEV Home-Charging Model Based on Residential Activity Patterns
Grahn, P., Munkhammar, J., Widén, J., Alvehag, K., & Söder, L. (2013) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2012.2230193 · Cited by 110
Kazmi, H., Mehmood, F., Lodeweyckx, S., & Driesen, J. (2018) · Energy · doi:10.1016/j.energy.2017.12.019 · Cited by 109
Remani, T., Jasmin, E. A., & Ahamed, T. P. I. (2019) · IEEE Systems Journal · doi:10.1109/jsyst.2018.2855689 · Cited by 106
Ruelens, F., Claessens, B., Vandael, S., Iacovella, S., Vingerhoets, P., & Belmans, R. J. M. (2014) · Power Systems Computation Conference · doi:10.1109/pscc.2014.7038106 · Cited by 86
Multi-agent Deep Reinforcement Learning for Zero Energy Communities
Prasad, A., & Dusparić, I. (2019) · IEEE PES Innovative Smart Grid Technologies Europe · doi:10.1109/isgteurope.2019.8905628 · Cited by 85
Ruelens, F., Iacovella, S., Claessens, B., & Belmans, R. J. M. (2015) · Energies · doi:10.3390/en8088300 · Cited by 82
Somer, O. D., Soares, A., Vanthournout, K., Spiessens, F., Kuijpers, T., & Vossen, K. (2017) · IEEE PES Innovative Smart Grid Technologies Europe · doi:10.1109/isgteurope.2017.8260152 · Cited by 77
Anderson, C. W., Hittle, D. C., Katz, A. D., & Kretchmar, R. M. (1997) · Artificial Intelligence in Engineering · doi:10.1016/s0954-1810(97)00004-6 · Cited by 65
Demand-Side Management of Domestic Electric Water Heaters Using Approximate Dynamic Programming
Al-jabery, K. K., Xu, Z., Yu, W., et al. (2016) · IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems · doi:10.1109/tcad.2016.2598563 · Cited by 64
Residential Energy Management with Deep Reinforcement Learning
Wan, Z., Li, H., & He, H. (2018) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2018.8489210 · Cited by 60
Distributed Frequency Control of Prosumer-Based Electric Energy Systems
Nazari, M. H., Costello, Z., Feizollahi, M. J., Grijalva, S., & Egerstedt, M. (2014) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2014.2310176 · Cited by 57
Self-citationGuan, C., Wang, Y., Lin, X., Nazarian, S., & Pedram, M. (2015) · IEEE Consumer Communications and Networking Conference · doi:10.1109/ccnc.2015.7158054 · Cited by 55
Yu, Z., & Dexter, A. L. (2010) · Control Engineering Practice · doi:10.1016/j.conengprac.2010.01.018 · Cited by 52
Prosumer-based control architecture for the future electricity grid
Grijalva, S., Costley, M., & Ainsworth, N. (2011) · The proceedings of the IEEE Conference on Control Applications/The proceedings of the ... IEEE Conference on Control Applications · doi:10.1109/cca.2011.6044467 · Cited by 52
Self-citationPolicy invariance under reward transformations for multi-objective reinforcement learning
Mannion, P., Devlin, S., Mason, K., Duggan, J., & Howley, E. (2017) · Neurocomputing · doi:10.1016/j.neucom.2017.05.090 · Cited by 52
Self-citationDynamic load management for a residential customer; Reinforcement Learning approach
Sheikhi, A., Rayati, M., & Ranjbar, A. M. (2016) · Sustainable Cities and Society · doi:10.1016/j.scs.2016.04.001 · Cited by 38
Patyn, C., Ruelens, F., & Deconinck, G. (2018) · IEEE International Energy Conference (ENERGYCON) · doi:10.1109/energycon.2018.8398836 · Cited by 37
A learning agent for heat-pump thermostat control
Urieli, D., & Stone, P. (2013) · doi:10.5555/2484920.2485092 · Cited by 36
A two-layer networked learning control system using actor–critic neural network
Du, D., & Fei, M. (2008) · Applied Mathematics and Computation · doi:10.1016/j.amc.2008.05.062 · Cited by 30
A novel grid load management technique using electric water heaters and Q-learning
Al-jabery, K. K., Wunsch, D. C., Xiong, J., et al. (2014) · IEEE International Conference on Smart Grid Communications (SmartGridComm) · doi:10.1109/smartgridcomm.2014.7007742 · Cited by 21
Model-based and data-driven approaches for building automation and control
Wei, T., Chen, X., Li, X., et al. (2018) · doi:10.1145/3240765.3243485 · Cited by 12
Model-Based Reinforcement Learning
Ray, S., & Tadepalli, P. V. (2014) · Encyclopedia of Machine Learning and Data Mining · doi:10.1007/978-1-4899-7502-7_561-1 · Cited by 8
Advanced Planning of Home Appliances with Consumer’s Preference Learning
Bazenkov, N. I., & Goubko, M. (2018) · Communications in computer and information science · doi:10.1007/978-3-030-00617-4_23 · Cited by 3
Cited by
Digital twin: values, challenges and enablers from a modeling perspective
Rasheed, A., San, O., & Kvamsdal, T. (2020) · IEEE Access · doi:10.1109/access.2020.2970143 · Cited by 1,952
Reinforcement learning for building controls: The opportunities and challenges
Wang, Z., & Hong, T. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115036 · Cited by 577
A Review of Deep Reinforcement Learning for Smart Building Energy Management
Yu, L., Qin, S., Zhang, M., Shen, C., Jiang, T., & Guan, X. (2021) · IEEE Internet of Things Journal · doi:10.1109/jiot.2021.3078462 · Cited by 476
State-of-the-art on research and applications of machine learning in the building life cycle
Hong, T., Wang, Z., Luo, X., & Zhang, W. (2020) · Energy and Buildings · doi:10.1016/j.enbuild.2020.109831 · Cited by 333
Data-driven predictive control for unlocking building energy flexibility: A review
Kathirgamanathan, A., De Rosa, M., Mangina, E., & Finn, D. P. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110120 · Cited by 321
Metadata
- Authors
- Mason, K., & Grijalva, S.
- Venue
- Computers & Electrical Engineering
- Publisher
- Elsevier BV
- Published
- 2019-09
- Volume
- 78
- Pages
- 300-312
- ISSN
- 0045-7906 (ISSN-L)
- OpenAlex
- W2921267419
- Cited by
- 306
- References
- 87
- FWCI
- 20.21
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.