Fusing TensorFlow with building energy simulation for intelligent energy management in smart cities

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268

Technical Note: Q-Learning

Watkins, C., & Dayan, P. (1992) · Machine-mediated learning · doi:10.1023/a:1022676722315 · Cited by 14,277

Playing Atari with Deep Reinforcement Learning

Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471

TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems

Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408

Q-learning

Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083

Reinforcement Learning and Dynamic Programming Using Function Approximators

Buşoniu, L., Babuška, R., Schutter, B. D., & Ernst, D. (2010) · CRC Press eBooks · doi:10.1201/9781439821091 · Cited by 919

Reinforcement learning for demand response: A review of algorithms and modeling techniques

Vázquez-Canteli, J. R., & Nagy, Z. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.11.002 · Cited by 883

On-Line Building Energy Optimization Using Deep Reinforcement Learning

Mocanu, E., Mocanu, D. C., Nguyen, P. H., Liotta, A., Webber, M. E., Gibescu, M., & Slootweg, J. G. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2834219 · Cited by 649

The Neural Network House: An Environment that Adapts to its Inhabitants

Mozer, M. C. (1998) · Cited by 500

Building modeling as a crucial part for building predictive control

Prívara, S., Cigler, J., Váňa, Z., Oldewurtel, F., Sagerschnig, C., & Žáčeková, E. (2012) · Energy and Buildings · doi:10.1016/j.enbuild.2012.10.024 · Cited by 347

Comprehensive analysis of the relationship between thermal comfort and building control research - A data-driven literature review

Park, J. Y., & Nagy, Z. (2017) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2017.09.102 · Cited by 308

A stochastic reinforcement learning algorithm for learning real-valued functions

Gullapalli, V. (1990) · Neural Networks · doi:10.1016/0893-6080(90)90056-q · Cited by 292

The impact of occupants' behaviour on building energy demand

Haldi, F., & Robinson, D. (2011) · Journal of Building Performance Simulation · doi:10.1080/19401493.2011.558213 · Cited by 257

Machine Learning: ECML 2004

FANIZZI, N., SEMERARO, G., IANNONE, L., & Palmisano, I. (2004) · Lecture notes in computer science · doi:10.1007/b100702 · Cited by 217

Reinforcement learning for optimal control of low exergy buildings

Yang, L., Nagy, Z., Goffin, P., & Schlueter, A. (2015) · Applied Energy · doi:10.1016/j.apenergy.2015.07.050 · Cited by 183

Transition to Sustainable Buildings

International Energy Agency (2013) · OECD eBooks · doi:10.1787/9789264202955-en · Cited by 180

An integrated system for buildings’ energy-efficient automation: Application in the tertiary sector

Marinakis, V., Doukas, H., Karakosta, C., & Psarras, J. (2013) · Applied Energy · doi:10.1016/j.apenergy.2012.05.032 · Cited by 154

Optimal decarbonization pathways for urban residential building energy services

Leibowicz, B. D., Lanham, C. M., Brozynski, M. T., Vázquez-Canteli, J. R., Castejón, N. C., & Nagy, Z. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.09.046 · Cited by 142

Advances and challenges in building engineering and data mining applications for energy-efficient communities

Yu, Z. J., Haghighat, F., & Fung, B. C. M. (2015) · Sustainable Cities and Society · doi:10.1016/j.scs.2015.12.001 · Cited by 121

A verification of CitySim results using the BESTEST and monitored consumption values

Walter, E., & Kämpf, J. H. (2015) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 88

Computer Modelling for Sustainable Urban Design

(2012) · Routledge eBooks · doi:10.4324/9781849775403 · Cited by 78

Using reinforcement learning for demand response of domestic hot water buffers: A real-life demonstration

Somer, O. D., Soares, A., Vanthournout, K., Spiessens, F., Kuijpers, T., & Vossen, K. (2017) · IEEE PES Innovative Smart Grid Technologies Europe · doi:10.1109/isgteurope.2017.8260152 · Cited by 77

Learning Agent for a Heat-Pump Thermostat with a Set-Back Strategy Using Model-Free Reinforcement Learning

Ruelens, F., Iacovella, S., Claessens, B., & Belmans, R. J. M. (2015) · Energies · doi:10.3390/en8088300 · Cited by 74

Batch reinforcement learning in a complex domain

Kalyanakrishnan, S., & Stone, P. (2007) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/1329125.1329241 · Cited by 74

Demand response with locational dynamic pricing to support the integration of renewables

Dupont, B., Jonghe, C. D., Olmos, L., & Belmans, R. J. M. (2014) · Energy Policy · doi:10.1016/j.enpol.2013.12.058 · Cited by 70

Evaluation of Reinforcement Learning for Optimal Control of Building Active and Passive Thermal Storage Inventory

Liu, S., & Henze, G. P. (2006) · Journal of Solar Energy Engineering · doi:10.1115/1.2710491 · Cited by 59

Mining typical load profiles in buildings to support energy management in the smart city context

Capozzoli, A., Piscitelli, M. S., & Brandi, S. (2017) · Energy Procedia · doi:10.1016/j.egypro.2017.09.545 · Cited by 55

On-line Building Energy Optimization using Deep Reinforcement LearningPreprint

Mocanu, E., Mocanu, D. C., Nguyen, P. H., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.05878 · Cited by 45

A learning agent for heat-pump thermostat control

Urieli, D., & Stone, P. (2013) · doi:10.5555/2484920.2485092 · Cited by 36

Iteratively Extending Time Horizon Reinforcement Learning

Ernst, D., Geurts, P., & Wehenkel, L. A. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-39857-8_11 · Cited by 27

Using Reinforcement Learning for Demand Response of Domestic Hot Water Buffers: a Real-Life DemonstrationPreprint

Somer, O. D., Soares, A., Kuijpers, T., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.05486 · Cited by 17

Model-Based Reinforcement Learning in a Complex Domain

Kalyanakrishnan, S., Stone, P., & Liu, Y. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-68847-1_15 · Cited by 12

Massive 3D models and physical data for building simulation at the urban scale: a focus on Geneva and climate change scenarios

Vázquez-Canteli, J. R., & Kämpf, J. H. (2016) · WIT transactions on ecology and the environment · doi:10.2495/sc160041 · Cited by 9

Reinforcement learning for intelligent environments

Nagy, Z., Park, J. Y., & Vázquez-Canteli, J. R. (2018) · Routledge eBooks · doi:10.4324/9781315142074-37 · Cited by 8

Artificial intelligence for sustainability: Challenges, opportunities, and a research agenda

Nishant, R., Kennedy, M., & Corbett, J. (2020) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2020.102104 · Cited by 1,203

Reinforcement learning for demand response: A review of algorithms and modeling techniques

Vázquez-Canteli, J. R., & Nagy, Z. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.11.002 · Cited by 883

Reinforcement learning for building controls: The opportunities and challenges

Wang, Z., & Hong, T. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115036 · Cited by 590

Smarter eco-cities and their leading-edge artificial intelligence of things solutions for environmental sustainability: A comprehensive systematic review

Bibri, S. E., Krogstie, J., Kaboli, A., & Alahi, A. (2024) · Environmental Science and Ecotechnology · doi:10.1016/j.ese.2023.100330 · Cited by 536

Machine learning driven smart electric power systems: Current trends and new perspectives

Ibrahim, M. S., Dong, W., & Yang, Q. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115237 · Cited by 462

A Review on Machine/Deep Learning Techniques Applied to Building Energy Simulation, Optimization and Management

Villano, F., Mauro, G. M., & Pedace, A. (2024) · Thermo · doi:10.3390/thermo4010008 · Cited by 63

A simulation study on energy optimization in building control with reinforcement learning

Bolt, P., Ziebart, V., Jaeger, C., Schmid, N., Stadelmann, T., & Füchslin, R. M. (2024) · Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences) · doi:10.21256/zhaw-31129

Data-driven Urban Energy Simulation (DUE-S): A framework for integrating engineering simulation and machine learning methods in a multi-scale urban energy modeling workflow

Nutkiewicz, A., Yang, Z., & Jain, R. K. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.05.023 · Cited by 223

The CityLearn Challenge: Four Years of Advancing Common Task Frameworks for Energy Management in Smart Buildings

Nagy, Z., & Nweye, K. (2025) · ACM International Conference on Future Energy Systems (e-Energy) · doi:10.1145/3679240.3734667 · Cited by 2

PhD Forum Abstract: BESTOpt: A Physics-Informed Machine Learning Based Building Simulation, Control and Optimization Platform

Jiang, Z. (2025) · ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys) · doi:10.1145/3736425.3772192 · Cited by 1