Fusing TensorFlow with building energy simulation for intelligent energy management in smart cities

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225 · see citing works

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,263 · see citing works

Technical Note: Q-Learning

Watkins, C., & Dayan, P. (1992) · Machine-mediated learning · doi:10.1023/a:1022676722315 · Cited by 14,277 · see citing works

Playing Atari with Deep Reinforcement Learning

Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471 · see citing works

TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems

Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408 · see citing works

Q-learning

Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083 · see citing works

Reinforcement Learning and Dynamic Programming Using Function Approximators

Buşoniu, L., Babuška, R., Schutter, B. D., & Ernst, D. (2010) · CRC Press eBooks · doi:10.1201/9781439821091 · Cited by 919 · see citing works

Reinforcement learning for demand response: A review of algorithms and modeling techniques

Vázquez-Canteli, J. R., & Nagy, Z. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.11.002 · Cited by 883 · see citing works

On-Line Building Energy Optimization Using Deep Reinforcement Learning

Mocanu, E., Mocanu, D. C., Nguyen, P. H., Liotta, A., Webber, M. E., Gibescu, M., & Slootweg, J. G. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2834219 · Cited by 649 · see citing works

The Neural Network House: An Environment that Adapts to its Inhabitants

Mozer, M. C. (1998) · Cited by 500 · see citing works

Building modeling as a crucial part for building predictive control

Prívara, S., Cigler, J., Váňa, Z., Oldewurtel, F., Sagerschnig, C., & Žáčeková, E. (2012) · Energy and Buildings · doi:10.1016/j.enbuild.2012.10.024 · Cited by 347 · see citing works

Comprehensive analysis of the relationship between thermal comfort and building control research - A data-driven literature review

Park, J. Y., & Nagy, Z. (2017) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2017.09.102 · Cited by 301 · see citing works

A stochastic reinforcement learning algorithm for learning real-valued functions

Gullapalli, V. (1990) · Neural Networks · doi:10.1016/0893-6080(90)90056-q · Cited by 292 · see citing works

The impact of occupants' behaviour on building energy demand

Haldi, F., & Robinson, D. (2011) · Journal of Building Performance Simulation · doi:10.1080/19401493.2011.558213 · Cited by 257 · see citing works

Machine Learning: ECML 2004

FANIZZI, N., SEMERARO, G., IANNONE, L., & Palmisano, I. (2004) · Lecture notes in computer science · doi:10.1007/b100702 · Cited by 217 · see citing works

Reinforcement learning for optimal control of low exergy buildings

Yang, L., Nagy, Z., Goffin, P., & Schlueter, A. (2015) · Applied Energy · doi:10.1016/j.apenergy.2015.07.050 · Cited by 183 · see citing works

Transition to Sustainable Buildings

International Energy Agency (2013) · OECD eBooks · doi:10.1787/9789264202955-en · Cited by 180 · see citing works

An integrated system for buildings’ energy-efficient automation: Application in the tertiary sector

Marinakis, V., Doukas, H., Karakosta, C., & Psarras, J. (2013) · Applied Energy · doi:10.1016/j.apenergy.2012.05.032 · Cited by 154 · see citing works

Optimal decarbonization pathways for urban residential building energy services

Leibowicz, B. D., Lanham, C. M., Brozynski, M. T., Vázquez-Canteli, J. R., Castejón, N. C., & Nagy, Z. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.09.046 · Cited by 142 · see citing works

Advances and challenges in building engineering and data mining applications for energy-efficient communities

Yu, Z. J., Haghighat, F., & Fung, B. C. M. (2015) · Sustainable Cities and Society · doi:10.1016/j.scs.2015.12.001 · Cited by 121 · see citing works

A verification of CitySim results using the BESTEST and monitored consumption values

Walter, E., & Kämpf, J. H. (2015) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · Cited by 85 · see citing works

Computer Modelling for Sustainable Urban Design

(2012) · Routledge eBooks · doi:10.4324/9781849775403 · Cited by 78 · see citing works

Using reinforcement learning for demand response of domestic hot water buffers: A real-life demonstration

Somer, O. D., Soares, A., Vanthournout, K., Spiessens, F., Kuijpers, T., & Vossen, K. (2017) · IEEE PES Innovative Smart Grid Technologies Europe · doi:10.1109/isgteurope.2017.8260152 · Cited by 77 · see citing works

Learning Agent for a Heat-Pump Thermostat with a Set-Back Strategy Using Model-Free Reinforcement Learning

Ruelens, F., Iacovella, S., Claessens, B., & Belmans, R. J. M. (2015) · Energies · doi:10.3390/en8088300 · Cited by 74 · see citing works

Batch reinforcement learning in a complex domain

Kalyanakrishnan, S., & Stone, P. (2007) · Adaptive Agents and Multi-Agents Systems · doi:10.1145/1329125.1329241 · Cited by 74 · see citing works

Demand response with locational dynamic pricing to support the integration of renewables

Dupont, B., Jonghe, C. D., Olmos, L., & Belmans, R. J. M. (2014) · Energy Policy · doi:10.1016/j.enpol.2013.12.058 · Cited by 70 · see citing works

Evaluation of Reinforcement Learning for Optimal Control of Building Active and Passive Thermal Storage Inventory

Liu, S., & Henze, G. P. (2006) · Journal of Solar Energy Engineering · doi:10.1115/1.2710491 · Cited by 59 · see citing works

Mining typical load profiles in buildings to support energy management in the smart city context

Capozzoli, A., Piscitelli, M. S., & Brandi, S. (2017) · Energy Procedia · doi:10.1016/j.egypro.2017.09.545 · Cited by 55 · see citing works

On-line Building Energy Optimization using Deep Reinforcement LearningPreprint

Mocanu, E., Mocanu, D. C., Nguyen, P. H., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.05878 · Cited by 45 · see citing works

A learning agent for heat-pump thermostat control

Urieli, D., & Stone, P. (2013) · doi:10.5555/2484920.2485092 · Cited by 36 · see citing works

Iteratively Extending Time Horizon Reinforcement Learning

Ernst, D., Geurts, P., & Wehenkel, L. A. (2003) · Lecture notes in computer science · doi:10.1007/978-3-540-39857-8_11 · Cited by 27 · see citing works

Using Reinforcement Learning for Demand Response of Domestic Hot Water Buffers: a Real-Life DemonstrationPreprint

Somer, O. D., Soares, A., Kuijpers, T., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1703.05486 · Cited by 17 · see citing works

Model-Based Reinforcement Learning in a Complex Domain

Kalyanakrishnan, S., Stone, P., & Liu, Y. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-68847-1_15 · Cited by 12 · see citing works

Massive 3D models and physical data for building simulation at the urban scale: a focus on Geneva and climate change scenarios

Vázquez-Canteli, J. R., & Kämpf, J. H. (2016) · WIT transactions on ecology and the environment · doi:10.2495/sc160041 · Cited by 9 · see citing works

Reinforcement learning for intelligent environments

Nagy, Z., Park, J. Y., & Vázquez-Canteli, J. R. (2018) · Routledge eBooks · doi:10.4324/9781315142074-37 · Cited by 8 · see citing works

Artificial intelligence for sustainability: Challenges, opportunities, and a research agenda

Nishant, R., Kennedy, M., & Corbett, J. (2020) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2020.102104 · Cited by 1,203 · see citing works

Reinforcement learning for demand response: A review of algorithms and modeling techniques

Vázquez-Canteli, J. R., & Nagy, Z. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.11.002 · Cited by 883 · see citing works

Reinforcement learning for building controls: The opportunities and challenges

Wang, Z., & Hong, T. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115036 · Cited by 590 · see citing works

Smarter eco-cities and their leading-edge artificial intelligence of things solutions for environmental sustainability: A comprehensive systematic review

Bibri, S. E., Krogstie, J., Kaboli, A., & Alahi, A. (2024) · Environmental Science and Ecotechnology · doi:10.1016/j.ese.2023.100330 · Cited by 536 · see citing works

Machine learning driven smart electric power systems: Current trends and new perspectives

Ibrahim, M. S., Dong, W., & Yang, Q. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115237 · Cited by 437 · see citing works

Applications of reinforcement learning in energy systems

Perera, A. T. D., & Kamalaruban, P. (2021) · Renewable & Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110618 · Cited by 388 · see citing works

Whole building energy model for HVAC optimal control: A practical framework based on deep reinforcement learning

Zhang, Z., Chong, A., Pan, Y., Zhang, C., & Lam, K. P. (2019) · Energy and Buildings · doi:10.1016/j.enbuild.2019.07.029 · Cited by 343 · see citing works

State-of-the-art on research and applications of machine learning in the building life cycle

Hong, T., Wang, Z., Luo, X., & Zhang, W. (2020) · Energy and Buildings · doi:10.1016/j.enbuild.2020.109831 · Cited by 334 · see citing works

Data-driven predictive control for unlocking building energy flexibility: A review

Kathirgamanathan, A., De Rosa, M., Mangina, E., & Finn, D. P. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110120 · Cited by 321 · see citing works

A review of data mining technologies in building energy systems: Load prediction, pattern identification, fault detection and diagnosis

Zhao, Y., Zhang, C., Zhang, Y., Wang, Z., & Li, J. (2019) · Energy and Built Environment · doi:10.1016/j.enbenv.2019.11.003 · Cited by 303 · see citing works

An overview of machine learning applications for smart buildings

Alanne, K., & Sierla, S. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.103445 · Cited by 282 · see citing works

Deep reinforcement learning to optimise indoor temperature control and heating energy consumption in buildings

Brandi, S., Piscitelli, M. S., Martellacci, M., & Capozzoli, A. (2020) · Energy and Buildings · doi:10.1016/j.enbuild.2020.110225 · Cited by 263 · see citing works

An updated review on the properties, fabrication and application of hybrid-nanofluids along with their environmental effects

Yang, L., Ji, W., Mao, M., & Huang, J.-N. (2020) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.120408 · Cited by 262 · see citing works

Reinforced model predictive control (RL-MPC) for building energy management

Arroyo, J., Manna, C., Spiessens, F., & Helsen, L. (2022) · Applied Energy · doi:10.1016/j.apenergy.2021.118346 · Cited by 259 · see citing works

Reinforcement learning for whole-building HVAC control and demand response

Azuatalam, D., Lee, W.-L., de Nijs, F., & Liebman, A. (2020) · Energy and AI · doi:10.1016/j.egyai.2020.100020 · Cited by 256 · see citing works

Leveraging Machine Learning and Big Data for Smart Buildings: A Comprehensive Survey

Qolomany, B., Al‐Fuqaha, A., Gupta, A. K., Benhaddou, D., Alwajidi, S., Qadir, J., & Fong, A. C. M. (2019) · IEEE Access · doi:10.1109/access.2019.2926642 · Cited by 256 · see citing works

Optimization strategy based on deep reinforcement learning for home energy management

Liu, Y., Zhang, D., & Gooi, H. B. (2020) · CSEE Journal of Power and Energy Systems · doi:10.17775/cseejpes.2019.02890 · Cited by 196 · see citing works

Advanced data analytics for enhancing building performances: From data-driven to big data-driven approaches

Fan, C., Yan, D., Xiao, F., Li, A., An, J., & Kang, X. (2020) · Building Simulation · doi:10.1007/s12273-020-0723-1 · Cited by 190 · see citing works

A review of reinforcement learning methodologies for controlling occupant comfort in buildings

Han, M., May, R., Zhang, X., Wang, X., Pan, S., Yan, D., Jin, Y., & Xu, L. (2019) · Sustainable Cities and Society · doi:10.1016/j.scs.2019.101748 · Cited by 164 · see citing works

A systematic review towards integrative energy management of smart grids and urban energy systems

Zheng, Z., Shafique, M., Luo, X., & Wang, S. (2023) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2023.114023 · Cited by 161 · see citing works

A Scalable Privacy-Preserving Multi-Agent Deep Reinforcement Learning Approach for Large-Scale Peer-to-Peer Transactive Energy Trading

Ye, Y., Tang, Y. P., Wang, H., Zhang, X., & Štrbac, G. (2021) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2021.3103917 · Cited by 156 · see citing works

Applications of reinforcement learning for building energy efficiency control: A review

Fu, Q., Han, Z., Chen, J., Lu, Y., Wu, H., & Wang, Y. (2022) · Journal of Building Engineering · doi:10.1016/j.jobe.2022.104165 · Cited by 146 · see citing works

Automation systems in smart buildings: a review

Vijayan, D. S., Rose, A. L., Sivasuriyan, A., Jayaseelan, R., & Amuthadevi, C. (2020) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-020-02666-9 · Cited by 142 · see citing works

CityLearn v1.0

Vázquez-Canteli, J. R., Kämpf, J. H., Henze, G. P., & Nagy, Z. (2019) · ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys) · doi:10.1145/3360322.3360998 · Cited by 138 · see citing works

Multiagent Reinforcement Learning for Energy Management in Residential Buildings

Ahrarinouri, M., Rastegar, M., & Seifi, A. R. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2977104 · Cited by 132 · see citing works

Deep reinforcement learning optimal control strategy for temperature setpoint real-time reset in multi-zone building HVAC system

Fang, X., Gong, G., Li, G., Chun, L., Peng, P., Li, W., Shi, X., & Chen, X. (2022) · Applied Thermal Engineering · doi:10.1016/j.applthermaleng.2022.118552 · Cited by 132 · see citing works

Systematic Review of Deep Learning and Machine Learning for Building Energy

Ardabili, S., Abdolalizadeh, L., Makó, C., Torok, B., & Mosavi, A. H. (2022) · Frontiers in Energy Research · doi:10.3389/fenrg.2022.786027 · Cited by 130 · see citing works

Building performance simulation in the brave new world of artificial intelligence and digital twins: A systematic review

de Wilde, P. (2023) · Energy and Buildings · doi:10.1016/j.enbuild.2023.113171 · Cited by 132 · see citing works

Multi-Agent Deep Reinforcement Learning for Coordinated Energy Trading and Flexibility Services Provision in Local Electricity Markets

Ye, Y., Papadaskalopoulos, D. A., Yuan, Q., Tang, Y. P., & Štrbac, G. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3149266 · Cited by 124 · see citing works

Review on optimization techniques and role of Artificial Intelligence in home energy management systems

Nutakki, M., & Mandava, S. (2023) · Engineering applications of artificial intelligence · doi:10.1016/j.engappai.2022.105721 · Cited by 104 · see citing works

Mapping the Knowledge Domain of Smart-City Research: A Bibliometric and Scientometric Analysis

Zhao, L., Tang, Z., & Zou, X. (2019) · Sustainability · doi:10.3390/su11236648 · Cited by 122 · see citing works

Predicting city-scale daily electricity consumption using data-driven models

Wang, Z., Hong, T., Li, H., & Piette, M. A. (2021) · Advances in Applied Energy · doi:10.1016/j.adapen.2021.100025 · Cited by 118 · see citing works

Analysis of transport processes in a reacting flow of hybrid nanofluid around a bluff-body embedded in porous media using artificial neural network and particle swarm optimization

Abad, J. M. N., Alizadeh, R., Fattahi, A., Doranehgard, M. H., Hajri, E. A., & Karimi, N. (2020) · Journal of Molecular Liquids · doi:10.1016/j.molliq.2020.113492 · Cited by 116 · see citing works

Coordinated energy management for a cluster of buildings through deep reinforcement learning

Pinto, G., Piscitelli, M. S., Vázquez-Canteli, J. R., Nagy, Z., & Capozzoli, A. (2021) · Energy · doi:10.1016/j.energy.2021.120725 · Cited by 108 · see citing works

Online transfer learning strategy for enhancing the scalability and deployment of deep reinforcement learning control in smart buildings

Coraci, D., Brandi, S., Hong, T., & Capozzoli, A. (2023) · Applied Energy · doi:10.1016/j.apenergy.2022.120598 · Cited by 108 · see citing works

Real building implementation of a deep reinforcement learning controller to enhance energy efficiency and indoor temperature control

Silvestri, A., Coraci, D., Brandi, S., Capozzoli, A., Borkowski, E., Köhler, J., Wu, D., Zeilinger, M. N., & Schlueter, A. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.123447 · Cited by 104 · see citing works

Comparison of online and offline deep reinforcement learning with model predictive control for thermal energy management

Brandi, S., Fiorentini, M., & Capozzoli, A. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104128 · Cited by 99 · see citing works

Assessing environmental performance in early building design stage: An integrated parametric design and machine learning method

Feng, K., Lu, W., & Wang, Y. (2019) · Sustainable Cities and Society · doi:10.1016/j.scs.2019.101596 · Cited by 97 · see citing works

Multi-agent Deep Reinforcement Learning for Distributed Energy Management and Strategy Optimization of Microgrid Market

Fang, X., Zhao, Q., Wang, J., Han, Y., & Li, Y. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.103163 · Cited by 98 · see citing works

A comprehensive review of predictive control strategies in heating, ventilation, and air-conditioning (HVAC): Model-free VS model

Xin, X., Zhang, Z., Zhou, Y., Liu, Y., Wang, D., & Nan, S. (2024) · Journal of Building Engineering · doi:10.1016/j.jobe.2024.110013 · Cited by 101 · see citing works

Energy Consumption Prediction Using Machine Learning; A ReviewPreprint

Mosavi, A. H., & Bahmani, A. (2019) · Preprints.org · doi:10.20944/preprints201903.0131.v1 · Cited by 99 · see citing works

A systematic review of machine learning techniques related to local energy communities

Hernandez-Matheus, A., Löschenbrand, M., Berg, K., Fuchs, I., Aragüés‐Peñalba, M., Bullich‐Massagué, E., & Sumper, A. (2022) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2022.112651 · Cited by 97 · see citing works

Deep learning techniques for energy forecasting and condition monitoring in the manufacturing sector

Mawson, V. J., & Hughes, B. R. (2020) · Energy and Buildings · doi:10.1016/j.enbuild.2020.109966 · Cited by 96 · see citing works

A deep learning approach towards the detection and recognition of opening of windows for effective management of building ventilation heat losses and reducing space heating demand

Tien, P. W., Wei, S., Liu, T., Calautit, J. K., Darkwa, J., & Wood, C. J. (2021) · Renewable Energy · doi:10.1016/j.renene.2021.05.155 · Cited by 95 · see citing works

Reinforcement learning of room temperature set-point of thermal storage air-conditioning system with demand response

Li, Z., Sun, Z., Meng, Q., Wang, Y., & Li, Y. (2022) · Energy and Buildings · doi:10.1016/j.enbuild.2022.111903 · Cited by 90 · see citing works

Towards Nearly Zero-Energy Buildings: Smart Energy Management of Vehicle-to-Building (V2B) Strategy and Renewable Energy Sources

Lo, K.-Y., Yeoh, J. H., & Hsieh, I.-Y. L. (2023) · Sustainable Cities and Society · doi:10.1016/j.scs.2023.104941 · Cited by 89 · see citing works

Intelligent Controllers and Optimization Algorithms for Building Energy Management Towards Achieving Sustainable Development: Challenges and Prospects

Parvin, K., Lipu, M. S. H., Hannan, M. A., Abdullah, M. A., Ker, P. J., Begum, R. A., Mansur, M., Muttaqi, K. M., Mahlia, T. M. I., & Dong, Z. Y. (2021) · IEEE Access · doi:10.1109/access.2021.3065087 · Cited by 89 · see citing works

Artificial Intelligence in the Smart City — A Literature Review

Szpilko, D., Naharro, F. J., Lăzăroiu, G., Nica, E., & Gallegos, A. D. L. T. (2023) · Engineering Management in Production and Services · doi:10.2478/emj-2023-0028 · Cited by 103 · see citing works

Comprehensive system based on a DNN and LSTM for predicting sinter composition

Liu, S., Liu, X., Lyu, Q., & Li, F. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106574 · Cited by 82 · see citing works

Understanding Sustainable Energy in the Context of Smart Cities: A PRISMA Review

Cortese, T. T. P., de Almeida, J. F. S., Batista, G. Q., Storópoli, J., Liu, A., & Yiğitcanlar, T. (2022) · Energies · doi:10.3390/en15072382 · Cited by 87 · see citing works

Improving predicted mean vote with inversely determined metabolic rate

Zhang, S., Cheng, Y. C., Oladokun, M. O., Wu, Y., & Lin, Z. (2019) · Sustainable Cities and Society · doi:10.1016/j.scs.2019.101870 · Cited by 75 · see citing works

Managing smart cities through six sigma DMADICV method: A review-based conceptual framework

Qayyum, S., Ullah, F., Al-Turjman, F. M., & Mojtahedi, M. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.103022 · Cited by 76 · see citing works

Development of smart energy systems for communities: technologies, policies and applications

Razmjoo, A., Mirjalili, S., Ehyaei, M. A., Østergaard, P. A., Ahmadi, A., & Nezhad, M. M. (2022) · Energy · doi:10.1016/j.energy.2022.123540 · Cited by 71 · see citing works

State of the Art Survey of Deep Learning and Machine Learning Models for Smart Cities and Urban Sustainability

Nosratabadi, S., Mosavi, A., Keivani, R., Ardabili, S., & Aram, F. (2020) · Lecture notes in networks and systems · doi:10.1007/978-3-030-36841-8_22 · Cited by 70 · see citing works

A Review of Reinforcement Learning for Controlling Building Energy Systems From a Computer Science Perspective

Weinberg, D., Wang, Q., Timoudas, T. O., & Fischione, C. (2022) · Sustainable Cities and Society · doi:10.1016/j.scs.2022.104351 · Cited by 70 · see citing works

Machine Learning Technologies for Sustainability in Smart Cities in the Post-COVID Era

Heras, A. D. L., Sendra, A. L., & Zamora‐Polo, F. (2020) · Sustainability · doi:10.3390/su12229320 · Cited by 65 · see citing works

Application of two promising Reinforcement Learning algorithms for load shifting in a cooling supply system

Schreiber, T., Eschweiler, S., Baranski, M., & Müller, D. (2020) · Energy and Buildings · doi:10.1016/j.enbuild.2020.110490 · Cited by 66 · see citing works

Development of a Soft Actor Critic deep reinforcement learning approach for harnessing energy flexibility in a Large Office building

Kathirgamanathan, A., Mangina, E., & Finn, D. P. (2021) · Energy and AI · doi:10.1016/j.egyai.2021.100101 · Cited by 63 · see citing works

Effective pre-training of a deep reinforcement learning agent by means of long short-term memory models for thermal energy management in buildings

Coraci, D., Brandi, S., & Capozzoli, A. (2023) · Energy Conversion and Management · doi:10.1016/j.enconman.2023.117303 · Cited by 63 · see citing works

A Review of Reinforcement Learning Applications to Control of Heating, Ventilation and Air Conditioning Systems

Sierla, S., Ihasalo, H., & Vyatkin, V. V. (2022) · Energies · doi:10.3390/en15103526 · Cited by 60 · see citing works

Combining physical approaches with deep learning techniques for urban building energy modeling: A comprehensive review and future research prospects

Li, Z., Ma, J., Tan, Y., Guo, C., & Li, X. (2023) · Building and Environment · doi:10.1016/j.buildenv.2023.110960 · Cited by 60 · see citing works

A review of spatio-temporal urban energy system modeling for urban decarbonization strategy formulation

Horak, D., Hainoun, A., Neugebauer, G., & Stoeglehner, G. (2022) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2022.112426 · Cited by 59 · see citing works

Roles of Artificial Intelligence and Machine Learning in Enhancing Construction Processes and Sustainable Communities

Kazeem, K. O., Olawumi, T. O., & Osunsanmi, T. O. (2023) · Buildings · doi:10.3390/buildings13082061 · Cited by 59 · see citing works

An experimental evaluation of deep reinforcement learning algorithms for HVAC control

Manjavacas, A., Campoy-Nieves, A., Jiménez-Raboso, J., Molina-Solana, M., & Gómez‐Romero, J. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10819-x · Cited by 62 · see citing works

A Computer Vision-Based Occupancy and Equipment Usage Detection Approach for Reducing Building Energy Demand

Tien, P. W., Wei, S., & Calautit, J. K. (2020) · Energies · doi:10.3390/en14010156 · Cited by 57 · see citing works

State of the Art Survey of Deep Learning and Machine Learning Models for Smart Cities and Urban SustainabilityPreprint

Nosratabadi, S., Mosavi, A. H., Keivani, R., Ardabili, S., & Aram, F. (2019) · Preprints.org · doi:10.20944/preprints201908.0154.v1 · Cited by 55 · see citing works

A predictive and adaptive control strategy to optimize the management of integrated energy systems in buildings

Brandi, S., Gallo, A., & Capozzoli, A. (2022) · Energy Reports · doi:10.1016/j.egyr.2021.12.058 · Cited by 52 · see citing works

Trajectory Outlier Detection

Djenouri, Y., Djenouri, D., & Lin, J. C. (2021) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3425867 · Cited by 53 · see citing works

An Iterative Optimization and Learning-Based IoT System for Energy Management of Connected Buildings

Gao, Y., Li, S., Xiao, Y., Dong, W., Fairbank, M., & Lu, B. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3176306 · Cited by 51 · see citing works

Artificial Intelligence in the Construction Industry: A Systematic Review of the Entire Construction Value Chain Lifecycle

Egwim, C. N., Alaka, H., Demir, E., Balogun, H., Olu-Ajayi, R., Sulaimon, I. A., Wusu, G. E., Yusuf, W., & Adegoke, M. (2023) · Energies · doi:10.3390/en17010182 · Cited by 48 · see citing works

Energy management and demand response with intelligent learning for multi-thermal-zone buildings

Gao, Y., Li, S.-H., Fu, X.-G., Dong, W., Lu, B., & Li, Z.-W. (2020) · Energy · doi:10.1016/j.energy.2020.118411 · Cited by 46 · see citing works

Data-driven fault diagnosis for residential variable refrigerant flow system on imbalanced data environments

Zhou, Z., Chen, H., Li, G., Zhong, H., Zhang, M., & Wu, J. (2021) · International Journal of Refrigeration · doi:10.1016/j.ijrefrig.2021.01.009 · Cited by 48 · see citing works

Pattern-driven behaviour for demand-side management: An analysis of appliance use

Cruz, C., Tostado‐Véliz, M., Palomar, E., & Bravo, I. (2024) · Energy and Buildings · doi:10.1016/j.enbuild.2024.113988 · Cited by 46 · see citing works

Data Mining Algorithms for Smart Cities: A Bibliometric Analysis

Kousis, A., & Tjortjis, C. (2021) · Algorithms · doi:10.3390/a14080242 · Cited by 46 · see citing works

Novel data-driven energy management of a hybrid photovoltaic-reverse osmosis desalination system using deep reinforcement learning

Soleimanzade, M. A., Kumar, A., & Sadrzadeh, M. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.119184 · Cited by 46 · see citing works

Reinforcement learning for control of flexibility providers in a residential microgrid

Mbuwir, B. V., Geysen, D., Spiessens, F., & Deconinck, G. (2019) · IET Smart Grid · doi:10.1049/iet-stg.2019.0196 · Cited by 45 · see citing works

Are Pakistani homebuyers ready to adopt sustainable housing? An insight into their willingness to pay

Khan, R. A. J., Thaheem, M. J., & Ali, T. H. (2020) · Energy Policy · doi:10.1016/j.enpol.2020.111598 · Cited by 45 · see citing works

Community needs for the digital divide on the smart city policy

Aditya, T., Ningrum, S., Nurasa, H., & Irawati, I. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e18932 · Cited by 45 · see citing works

Enhancing Greenhouse Efficiency: Integrating IoT and Reinforcement Learning for Optimized Climate Control

Platero-Horcajadas, M., Pardo-Pina, S., Zapata, J. M. C., Brenes-Carranza, J.-A., & Pastor, F. J. F. (2024) · Sensors · doi:10.3390/s24248109 · Cited by 44 · see citing works

An innovative heterogeneous transfer learning framework to enhance the scalability of deep reinforcement learning controllers in buildings with integrated energy systems

Coraci, D., Brandi, S., Hong, T., & Capozzoli, A. (2024) · Building Simulation · doi:10.1007/s12273-024-1109-6 · Cited by 44 · see citing works

The assessment of smart city projects using zSlice type-2 fuzzy sets based Interval Agreement Method

Deveci, M., Pekaslan, D., & Canıtez, F. (2019) · Sustainable Cities and Society · doi:10.1016/j.scs.2019.101889 · Cited by 43 · see citing works

Transferability investigation of a Sim2Real deep transfer learning framework for cross-building energy prediction

Fang, X., Gong, G., Li, G., Chun, L., Peng, P., & Shi, X. (2023) · Energy and Buildings · doi:10.1016/j.enbuild.2023.112968 · Cited by 42 · see citing works

Leveraging Artificial Intelligence to Bolster the Energy Sector in Smart Cities: A Literature Review

Camacho, J. D. J., Aguirre, B., Ponce, P., Anthony, B., & Molina, A. (2024) · Energies · doi:10.3390/en17020353 · Cited by 42 · see citing works

Online Implementation of a Soft Actor-Critic Agent to Enhance Indoor Temperature Control and Energy Efficiency in Buildings

Coraci, D., Brandi, S., Piscitelli, M. S., & Capozzoli, A. (2021) · Energies · doi:10.3390/en14040997 · Cited by 41 · see citing works

AlphaBuilding ResCommunity: A multi-agent virtual testbed for community-level load coordination

Wang, Z., Chen, B., Li, H., & Hong, T. (2021) · Advances in Applied Energy · doi:10.1016/j.adapen.2021.100061 · Cited by 40 · see citing works

Reinforcement Learning-Based BEMS Architecture for Energy Usage Optimization

Park, S., Park, S., Choi, M.-I., Lee, S., Lee, T., Kim, S., Cho, K., & Park, S. (2020) · Sensors · doi:10.3390/s20174918 · Cited by 40 · see citing works

Energy optimization for regional buildings based on distributed reinforcement learning

Qin, Y., Ke, J., Wang, B., & Filaretov, G. F. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.103625 · Cited by 36 · see citing works

AI-Driven Multi-Objective Optimization and Decision-Making for Urban Building Energy Retrofit: Advances, Challenges, and Systematic Review

Shan, R., Jia, X., Su, X., Xu, Q., Ning, H., & Zhang, J. (2025) · Applied Sciences · doi:10.3390/app15168944 · Cited by 35 · see citing works

Using Deep Learning Neural Network in Artificial Intelligence Technology to Classify Beef Cuts

Sunil, G. C., Saidul, B., Zhang, Y., Reed, D. D., Ahsan, M., Berg, E. P., & Sun, X. (2021) · Frontiers in Sensors · doi:10.3389/fsens.2021.654357 · Cited by 35 · see citing works

Hyperparameter Optimization of Regression Model for Electrical Load Forecasting During the COVID-19 Pandemic Lockdown Period

(2023) · International journal of intelligent engineering and systems · doi:10.22266/ijies2023.0831.20 · Cited by 34 · see citing works

A Systematic Review on Demand Response Role Toward Sustainable Energy in the Smart Grids-Adopted Buildings Sector

Al-Ghaili, A. M., Ibrahim, Z.-A., Bakar, A. A., Kasim, H., Al‐Hada, N. M., Jôrgensen, B. N., Hassan, Z., Othman, M., Kasmani, R. M., & Shayea, I. A. M. (2023) · IEEE Access · doi:10.1109/access.2023.3287641 · Cited by 37 · see citing works

Reinforcement Learning: Theory and Applications in HEMS

Al-Ani, O., & Das, S. (2022) · Energies · doi:10.3390/en15176392 · Cited by 34 · see citing works

State of the Art Survey of Deep Learning and Machine Learning Models for Smart Cities and Urban SustainabilityPreprint

Nosratabadi, S., Mosavi, A. H., Keivani, R., Ardabili, S., & Aram, F. (2020) · doi:10.31219/osf.io/gmuzk · Cited by 32 · see citing works

BFA-YOLO: A balanced multiscale object detection network for building façade elements detection

Chen, Y., Wang, T., Chen, G., Zhu, K., Tan, X., Wang, J., Guo, W., Wang, Q., Luo, X., & Zhang, X. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103289 · Cited by 31 · see citing works

Review of load data analytics using deep learning in smart grids: Open load datasets, methodologies, and application challenges

Elahe, M. F., Jin, M., & Zeng, P. (2021) · International Journal of Energy Research · doi:10.1002/er.6745 · Cited by 33 · see citing works

Trade-off decisions in a novel deep reinforcement learning for energy savings in HVAC systems

Dawood, S. M., Hatami, A., & Homod, R. Z. (2022) · Journal of Building Performance Simulation · doi:10.1080/19401493.2022.2099465 · Cited by 30 · see citing works

Artificial Intelligence And Smart Cities: A Bibliometric Analysis

Gupta, A., Gupta, S. K., Memoria, M., Kumar, R., Kumar, S., Singh, D., Tyagi, S., & Ansari, N. (2022) · International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COM-IT-CON) · doi:10.1109/com-it-con54601.2022.9850656 · Cited by 30 · see citing works

An Hybrid Approach for Urban Traffic Prediction and Control in Smart Cities

Culiţă, J., Caramihai, S. I., Dumitrache, I., Moisescu, M. A., & Sacală, I. Ş. (2020) · Sensors · doi:10.3390/s20247209 · Cited by 29 · see citing works

Smart control of window and air cleaner for mitigating indoor PM2.5 with reduced energy consumption based on deep reinforcement learning

An, Y., Niu, Z., & Chen, C. (2022) · Building and Environment · doi:10.1016/j.buildenv.2022.109583 · Cited by 28 · see citing works

Interconnected hybrid AC-DC microgrids security enhancement using blockchain technology considering uncertainty

Li, Q., Li, A., Wang, T., & Cai, Y. (2021) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2021.107324 · Cited by 26 · see citing works

A Review on Machine/Deep Learning Techniques Applied to Building Energy Simulation, Optimization and Management

Villano, F., Mauro, G. M., & Pedace, A. (2024) · Thermo · doi:10.3390/thermo4010008 · Cited by 63 · see citing works

A simulation study on energy optimization in building control with reinforcement learning

Bolt, P., Ziebart, V., Jaeger, C., Schmid, N., Stadelmann, T., & Füchslin, R. M. (2024) · Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences) · doi:10.21256/zhaw-31129

Data-driven Urban Energy Simulation (DUE-S): A framework for integrating engineering simulation and machine learning methods in a multi-scale urban energy modeling workflow

Nutkiewicz, A., Yang, Z., & Jain, R. K. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.05.023 · Cited by 223 · see citing works

The CityLearn Challenge: Four Years of Advancing Common Task Frameworks for Energy Management in Smart Buildings

Nagy, Z., & Nweye, K. (2025) · ACM International Conference on Future Energy Systems (e-Energy) · doi:10.1145/3679240.3734667 · Cited by 2 · see citing works

PhD Forum Abstract: BESTOpt: A Physics-Informed Machine Learning Based Building Simulation, Control and Optimization Platform

Jiang, Z. (2025) · ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys) · doi:10.1145/3736425.3772192 · Cited by 1 · see citing works