Fusing TensorFlow with building energy simulation for intelligent energy management in smart cities

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. G. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.1998.712192 · Cited by 27,225

Reinforcement Learning: An Introduction

Sutton, R. S., & Barto, A. (2005) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2004.842673 · Cited by 25,268

Technical Note: Q-Learning

Watkins, C., & Dayan, P. (1992) · Machine-mediated learning · doi:10.1023/a:1022676722315 · Cited by 14,277

Playing Atari with Deep Reinforcement Learning

Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013) · arXiv · doi:10.48550/arxiv.1312.5602 · Cited by 9,471

TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems

Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., et al. (2016) · arXiv · doi:10.48550/arxiv.1603.04467 · Cited by 9,408

Q-learning

Watkins, C. J. C. H., & Dayan, P. (1992) · Machine Learning · doi:10.1007/bf00992698 · Cited by 9,083

Reinforcement Learning and Dynamic Programming Using Function Approximators

Buşoniu, L., Babuška, R., Schutter, B. D., & Ernst, D. (2010) · CRC Press eBooks · doi:10.1201/9781439821091 · Cited by 919

Reinforcement learning for demand response: A review of algorithms and modeling techniques

Vázquez-Canteli, J. R., & Nagy, Z. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.11.002 · Cited by 883

On-Line Building Energy Optimization Using Deep Reinforcement Learning

Mocanu, E., Mocanu, D. C., Nguyen, P. H., Liotta, A., Webber, M. E., Gibescu, M., & Slootweg, J. G. (2019) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2018.2834219 · Cited by 649

The Neural Network House: An Environment that Adapts to its Inhabitants

Mozer, M. C. (1998) · Cited by 500

Artificial intelligence for sustainability: Challenges, opportunities, and a research agenda

Nishant, R., Kennedy, M., & Corbett, J. (2020) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2020.102104 · Cited by 1,203

Reinforcement learning for demand response: A review of algorithms and modeling techniques

Vázquez-Canteli, J. R., & Nagy, Z. (2019) · Applied Energy · doi:10.1016/j.apenergy.2018.11.002 · Cited by 883

Reinforcement learning for building controls: The opportunities and challenges

Wang, Z., & Hong, T. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115036 · Cited by 590

Smarter eco-cities and their leading-edge artificial intelligence of things solutions for environmental sustainability: A comprehensive systematic review

Bibri, S. E., Krogstie, J., Kaboli, A., & Alahi, A. (2024) · Environmental Science and Ecotechnology · doi:10.1016/j.ese.2023.100330 · Cited by 536

Machine learning driven smart electric power systems: Current trends and new perspectives

Ibrahim, M. S., Dong, W., & Yang, Q. (2020) · Applied Energy · doi:10.1016/j.apenergy.2020.115237 · Cited by 462

Applications of reinforcement learning in energy systems

Perera, A. T. D., & Kamalaruban, P. (2020) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110618 · Cited by 457

Whole building energy model for HVAC optimal control: A practical framework based on deep reinforcement learning

Zhang, Z., Chong, A., Pan, Y., Zhang, C., & Lam, K. P. (2019) · Energy and Buildings · doi:10.1016/j.enbuild.2019.07.029 · Cited by 343

State-of-the-art on research and applications of machine learning in the building life cycle

Hong, T., Wang, Z., Luo, X., & Zhang, W. (2020) · Energy and Buildings · doi:10.1016/j.enbuild.2020.109831 · Cited by 334

Data-driven predictive control for unlocking building energy flexibility: A review

Kathirgamanathan, A., De Rosa, M., Mangina, E., & Finn, D. P. (2021) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2020.110120 · Cited by 321

A review of data mining technologies in building energy systems: Load prediction, pattern identification, fault detection and diagnosis

Zhao, Y., Zhang, C., Zhang, Y., Wang, Z., & Li, J. (2019) · Energy and Built Environment · doi:10.1016/j.enbenv.2019.11.003 · Cited by 319

An overview of machine learning applications for smart buildings

Alanne, K., & Sierla, S. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.103445 · Cited by 313

Deep reinforcement learning to optimise indoor temperature control and heating energy consumption in buildings

Brandi, S., Piscitelli, M. S., Martellacci, M., & Capozzoli, A. (2020) · Energy and Buildings · doi:10.1016/j.enbuild.2020.110225 · Cited by 269

An updated review on the properties, fabrication and application of hybrid-nanofluids along with their environmental effects

Yang, L., Ji, W., Mao, M., & Huang, J.-N. (2020) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.120408 · Cited by 270

Reinforced model predictive control (RL-MPC) for building energy management

Arroyo, J., Manna, C., Spiessens, F., & Helsen, L. (2022) · Applied Energy · doi:10.1016/j.apenergy.2021.118346 · Cited by 259

Reinforcement learning for whole-building HVAC control and demand response

Azuatalam, D., Lee, W.-L., de Nijs, F., & Liebman, A. (2020) · Energy and AI · doi:10.1016/j.egyai.2020.100020 · Cited by 256

Leveraging Machine Learning and Big Data for Smart Buildings: A Comprehensive Survey

Qolomany, B., Al‐Fuqaha, A., Gupta, A. K., Benhaddou, D., Alwajidi, S., Qadir, J., & Fong, A. C. M. (2019) · IEEE Access · doi:10.1109/access.2019.2926642 · Cited by 256

Optimization strategy based on deep reinforcement learning for home energy management

Liu, Y., Zhang, D., & Gooi, H. B. (2020) · CSEE Journal of Power and Energy Systems · doi:10.17775/cseejpes.2019.02890 · Cited by 206

Advanced data analytics for enhancing building performances: From data-driven to big data-driven approaches

Fan, C., Yan, D., Xiao, F., Li, A., An, J., & Kang, X. (2020) · Building Simulation · doi:10.1007/s12273-020-0723-1 · Cited by 201

A review of reinforcement learning methodologies for controlling occupant comfort in buildings

Han, M., May, R., Zhang, X., Wang, X., Pan, S., Yan, D., Jin, Y., & Xu, L. (2019) · Sustainable Cities and Society · doi:10.1016/j.scs.2019.101748 · Cited by 168

A systematic review towards integrative energy management of smart grids and urban energy systems

Zheng, Z., Shafique, M., Luo, X., & Wang, S. (2023) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2023.114023 · Cited by 172

A Scalable Privacy-Preserving Multi-Agent Deep Reinforcement Learning Approach for Large-Scale Peer-to-Peer Transactive Energy Trading

Ye, Y., Tang, Y. P., Wang, H., Zhang, X., & Štrbac, G. (2021) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2021.3103917 · Cited by 156

Applications of reinforcement learning for building energy efficiency control: A review

Fu, Q., Han, Z., Chen, J., Lu, Y., Wu, H., & Wang, Y. (2022) · Journal of Building Engineering · doi:10.1016/j.jobe.2022.104165 · Cited by 146

Automation systems in smart buildings: a review

Vijayan, D. S., Rose, A. L., Sivasuriyan, A., Jayaseelan, R., & Amuthadevi, C. (2020) · Journal of Ambient Intelligence and Humanized Computing · doi:10.1007/s12652-020-02666-9 · Cited by 142

CityLearn v1.0

Vázquez-Canteli, J. R., Kämpf, J. H., Henze, G. P., & Nagy, Z. (2019) · ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys) · doi:10.1145/3360322.3360998 · Cited by 138

Multiagent Reinforcement Learning for Energy Management in Residential Buildings

Ahrarinouri, M., Rastegar, M., & Seifi, A. R. (2020) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2020.2977104 · Cited by 132

Deep reinforcement learning optimal control strategy for temperature setpoint real-time reset in multi-zone building HVAC system

Fang, X., Gong, G., Li, G., Chun, L., Peng, P., Li, W., Shi, X., & Chen, X. (2022) · Applied Thermal Engineering · doi:10.1016/j.applthermaleng.2022.118552 · Cited by 132

Systematic Review of Deep Learning and Machine Learning for Building Energy

Ardabili, S., Abdolalizadeh, L., Makó, C., Torok, B., & Mosavi, A. H. (2022) · Frontiers in Energy Research · doi:10.3389/fenrg.2022.786027 · Cited by 130

Building performance simulation in the brave new world of artificial intelligence and digital twins: A systematic review

de Wilde, P. (2023) · Energy and Buildings · doi:10.1016/j.enbuild.2023.113171 · Cited by 132

Multi-Agent Deep Reinforcement Learning for Coordinated Energy Trading and Flexibility Services Provision in Local Electricity Markets

Ye, Y., Papadaskalopoulos, D. A., Yuan, Q., Tang, Y. P., & Štrbac, G. (2022) · IEEE Transactions on Smart Grid · doi:10.1109/tsg.2022.3149266 · Cited by 124

Review on optimization techniques and role of Artificial Intelligence in home energy management systems

Nutakki, M., & Mandava, S. (2023) · Engineering applications of artificial intelligence · doi:10.1016/j.engappai.2022.105721 · Cited by 104

Mapping the Knowledge Domain of Smart-City Research: A Bibliometric and Scientometric Analysis

Zhao, L., Tang, Z., & Zou, X. (2019) · Sustainability · doi:10.3390/su11236648 · Cited by 133

Predicting city-scale daily electricity consumption using data-driven models

Wang, Z., Hong, T., Li, H., & Piette, M. A. (2021) · Advances in Applied Energy · doi:10.1016/j.adapen.2021.100025 · Cited by 118

Analysis of transport processes in a reacting flow of hybrid nanofluid around a bluff-body embedded in porous media using artificial neural network and particle swarm optimization

Abad, J. M. N., Alizadeh, R., Fattahi, A., Doranehgard, M. H., Hajri, E. A., & Karimi, N. (2020) · Journal of Molecular Liquids · doi:10.1016/j.molliq.2020.113492 · Cited by 116

Coordinated energy management for a cluster of buildings through deep reinforcement learning

Pinto, G., Piscitelli, M. S., Vázquez-Canteli, J. R., Nagy, Z., & Capozzoli, A. (2021) · Energy · doi:10.1016/j.energy.2021.120725 · Cited by 108

Online transfer learning strategy for enhancing the scalability and deployment of deep reinforcement learning control in smart buildings

Coraci, D., Brandi, S., Hong, T., & Capozzoli, A. (2023) · Applied Energy · doi:10.1016/j.apenergy.2022.120598 · Cited by 110

Real building implementation of a deep reinforcement learning controller to enhance energy efficiency and indoor temperature control

Silvestri, A., Coraci, D., Brandi, S., Capozzoli, A., Borkowski, E., Köhler, J., Wu, D., Zeilinger, M. N., & Schlueter, A. (2024) · Applied Energy · doi:10.1016/j.apenergy.2024.123447 · Cited by 115

Comparison of online and offline deep reinforcement learning with model predictive control for thermal energy management

Brandi, S., Fiorentini, M., & Capozzoli, A. (2022) · Automation in Construction · doi:10.1016/j.autcon.2022.104128 · Cited by 99

Assessing environmental performance in early building design stage: An integrated parametric design and machine learning method

Feng, K., Lu, W., & Wang, Y. (2019) · Sustainable Cities and Society · doi:10.1016/j.scs.2019.101596 · Cited by 97

Multi-agent Deep Reinforcement Learning for Distributed Energy Management and Strategy Optimization of Microgrid Market

Fang, X., Zhao, Q., Wang, J., Han, Y., & Li, Y. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.103163 · Cited by 98

A comprehensive review of predictive control strategies in heating, ventilation, and air-conditioning (HVAC): Model-free VS model

Xin, X., Zhang, Z., Zhou, Y., Liu, Y., Wang, D., & Nan, S. (2024) · Journal of Building Engineering · doi:10.1016/j.jobe.2024.110013 · Cited by 101

Energy Consumption Prediction Using Machine Learning; A ReviewPreprint

Mosavi, A. H., & Bahmani, A. (2019) · Preprints.org · doi:10.20944/preprints201903.0131.v1 · Cited by 107

A systematic review of machine learning techniques related to local energy communities

Hernandez-Matheus, A., Löschenbrand, M., Berg, K., Fuchs, I., Aragüés‐Peñalba, M., Bullich‐Massagué, E., & Sumper, A. (2022) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2022.112651 · Cited by 97

Deep learning techniques for energy forecasting and condition monitoring in the manufacturing sector

Mawson, V. J., & Hughes, B. R. (2020) · Energy and Buildings · doi:10.1016/j.enbuild.2020.109966 · Cited by 96

A deep learning approach towards the detection and recognition of opening of windows for effective management of building ventilation heat losses and reducing space heating demand

Tien, P. W., Wei, S., Liu, T., Calautit, J. K., Darkwa, J., & Wood, C. J. (2021) · Renewable Energy · doi:10.1016/j.renene.2021.05.155 · Cited by 95

Reinforcement learning of room temperature set-point of thermal storage air-conditioning system with demand response

Li, Z., Sun, Z., Meng, Q., Wang, Y., & Li, Y. (2022) · Energy and Buildings · doi:10.1016/j.enbuild.2022.111903 · Cited by 90

Towards Nearly Zero-Energy Buildings: Smart Energy Management of Vehicle-to-Building (V2B) Strategy and Renewable Energy Sources

Lo, K.-Y., Yeoh, J. H., & Hsieh, I.-Y. L. (2023) · Sustainable Cities and Society · doi:10.1016/j.scs.2023.104941 · Cited by 89

Intelligent Controllers and Optimization Algorithms for Building Energy Management Towards Achieving Sustainable Development: Challenges and Prospects

Parvin, K., Lipu, M. S. H., Hannan, M. A., Abdullah, M. A., Ker, P. J., Begum, R. A., Mansur, M., Muttaqi, K. M., Mahlia, T. M. I., & Dong, Z. Y. (2021) · IEEE Access · doi:10.1109/access.2021.3065087 · Cited by 94

Artificial Intelligence in the Smart City — A Literature Review

Szpilko, D., Naharro, F. J., Lăzăroiu, G., Nica, E., & Gallegos, A. D. L. T. (2023) · Engineering Management in Production and Services · doi:10.2478/emj-2023-0028 · Cited by 110

Comprehensive system based on a DNN and LSTM for predicting sinter composition

Liu, S., Liu, X., Lyu, Q., & Li, F. (2020) · Applied Soft Computing · doi:10.1016/j.asoc.2020.106574 · Cited by 85

Understanding Sustainable Energy in the Context of Smart Cities: A PRISMA Review

Cortese, T. T. P., de Almeida, J. F. S., Batista, G. Q., Storópoli, J., Liu, A., & Yiğitcanlar, T. (2022) · Energies · doi:10.3390/en15072382 · Cited by 87

Improving predicted mean vote with inversely determined metabolic rate

Zhang, S., Cheng, Y. C., Oladokun, M. O., Wu, Y., & Lin, Z. (2019) · Sustainable Cities and Society · doi:10.1016/j.scs.2019.101870 · Cited by 75

Managing smart cities through six sigma DMADICV method: A review-based conceptual framework

Qayyum, S., Ullah, F., Al-Turjman, F. M., & Mojtahedi, M. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.103022 · Cited by 76

Development of smart energy systems for communities: technologies, policies and applications

Razmjoo, A., Mirjalili, S., Ehyaei, M. A., Østergaard, P. A., Ahmadi, A., & Nezhad, M. M. (2022) · Energy · doi:10.1016/j.energy.2022.123540 · Cited by 71

State of the Art Survey of Deep Learning and Machine Learning Models for Smart Cities and Urban Sustainability

Nosratabadi, S., Mosavi, A., Keivani, R., Ardabili, S., & Aram, F. (2020) · Lecture notes in networks and systems · doi:10.1007/978-3-030-36841-8_22 · Cited by 70

A Review of Reinforcement Learning for Controlling Building Energy Systems From a Computer Science Perspective

Weinberg, D., Wang, Q., Timoudas, T. O., & Fischione, C. (2022) · Sustainable Cities and Society · doi:10.1016/j.scs.2022.104351 · Cited by 70

Machine Learning Technologies for Sustainability in Smart Cities in the Post-COVID Era

Heras, A. D. L., Sendra, A. L., & Zamora‐Polo, F. (2020) · Sustainability · doi:10.3390/su12229320 · Cited by 68

Application of two promising Reinforcement Learning algorithms for load shifting in a cooling supply system

Schreiber, T., Eschweiler, S., Baranski, M., & Müller, D. (2020) · Energy and Buildings · doi:10.1016/j.enbuild.2020.110490 · Cited by 66

Development of a Soft Actor Critic deep reinforcement learning approach for harnessing energy flexibility in a Large Office building

Kathirgamanathan, A., Mangina, E., & Finn, D. P. (2021) · Energy and AI · doi:10.1016/j.egyai.2021.100101 · Cited by 63

Effective pre-training of a deep reinforcement learning agent by means of long short-term memory models for thermal energy management in buildings

Coraci, D., Brandi, S., & Capozzoli, A. (2023) · Energy Conversion and Management · doi:10.1016/j.enconman.2023.117303 · Cited by 66

A Review of Reinforcement Learning Applications to Control of Heating, Ventilation and Air Conditioning Systems

Sierla, S., Ihasalo, H., & Vyatkin, V. V. (2022) · Energies · doi:10.3390/en15103526 · Cited by 60

Combining physical approaches with deep learning techniques for urban building energy modeling: A comprehensive review and future research prospects

Li, Z., Ma, J., Tan, Y., Guo, C., & Li, X. (2023) · Building and Environment · doi:10.1016/j.buildenv.2023.110960 · Cited by 60

A review of spatio-temporal urban energy system modeling for urban decarbonization strategy formulation

Horak, D., Hainoun, A., Neugebauer, G., & Stoeglehner, G. (2022) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2022.112426 · Cited by 59

Roles of Artificial Intelligence and Machine Learning in Enhancing Construction Processes and Sustainable Communities

Kazeem, K. O., Olawumi, T. O., & Osunsanmi, T. O. (2023) · Buildings · doi:10.3390/buildings13082061 · Cited by 73

An experimental evaluation of deep reinforcement learning algorithms for HVAC control

Manjavacas, A., Campoy-Nieves, A., Jiménez-Raboso, J., Molina-Solana, M., & Gómez‐Romero, J. (2024) · Artificial Intelligence Review · doi:10.1007/s10462-024-10819-x · Cited by 68

A Computer Vision-Based Occupancy and Equipment Usage Detection Approach for Reducing Building Energy Demand

Tien, P. W., Wei, S., & Calautit, J. K. (2020) · Energies · doi:10.3390/en14010156 · Cited by 57

State of the Art Survey of Deep Learning and Machine Learning Models for Smart Cities and Urban SustainabilityPreprint

Nosratabadi, S., Mosavi, A. H., Keivani, R., Ardabili, S., & Aram, F. (2019) · Preprints.org · doi:10.20944/preprints201908.0154.v1 · Cited by 55

A predictive and adaptive control strategy to optimize the management of integrated energy systems in buildings

Brandi, S., Gallo, A., & Capozzoli, A. (2022) · Energy Reports · doi:10.1016/j.egyr.2021.12.058 · Cited by 58

Trajectory Outlier Detection

Djenouri, Y., Djenouri, D., & Lin, J. C. (2021) · ACM Transactions on Knowledge Discovery from Data · doi:10.1145/3425867 · Cited by 53

An Iterative Optimization and Learning-Based IoT System for Energy Management of Connected Buildings

Gao, Y., Li, S., Xiao, Y., Dong, W., Fairbank, M., & Lu, B. (2022) · IEEE Internet of Things Journal · doi:10.1109/jiot.2022.3176306 · Cited by 51

Artificial Intelligence in the Construction Industry: A Systematic Review of the Entire Construction Value Chain Lifecycle

Egwim, C. N., Alaka, H., Demir, E., Balogun, H., Olu-Ajayi, R., Sulaimon, I. A., Wusu, G. E., Yusuf, W., & Adegoke, M. (2023) · Energies · doi:10.3390/en17010182 · Cited by 83

Energy management and demand response with intelligent learning for multi-thermal-zone buildings

Gao, Y., Li, S.-H., Fu, X.-G., Dong, W., Lu, B., & Li, Z.-W. (2020) · Energy · doi:10.1016/j.energy.2020.118411 · Cited by 46

Data-driven fault diagnosis for residential variable refrigerant flow system on imbalanced data environments

Zhou, Z., Chen, H., Li, G., Zhong, H., Zhang, M., & Wu, J. (2021) · International Journal of Refrigeration · doi:10.1016/j.ijrefrig.2021.01.009 · Cited by 50

Pattern-driven behaviour for demand-side management: An analysis of appliance use

Cruz, C., Tostado‐Véliz, M., Palomar, E., & Bravo, I. (2024) · Energy and Buildings · doi:10.1016/j.enbuild.2024.113988 · Cited by 46

Data Mining Algorithms for Smart Cities: A Bibliometric Analysis

Kousis, A., & Tjortjis, C. (2021) · Algorithms · doi:10.3390/a14080242 · Cited by 50

Novel data-driven energy management of a hybrid photovoltaic-reverse osmosis desalination system using deep reinforcement learning

Soleimanzade, M. A., Kumar, A., & Sadrzadeh, M. (2022) · Applied Energy · doi:10.1016/j.apenergy.2022.119184 · Cited by 46

Reinforcement learning for control of flexibility providers in a residential microgrid

Mbuwir, B. V., Geysen, D., Spiessens, F., & Deconinck, G. (2019) · IET Smart Grid · doi:10.1049/iet-stg.2019.0196 · Cited by 45

Are Pakistani homebuyers ready to adopt sustainable housing? An insight into their willingness to pay

Khan, R. A. J., Thaheem, M. J., & Ali, T. H. (2020) · Energy Policy · doi:10.1016/j.enpol.2020.111598 · Cited by 45

Community needs for the digital divide on the smart city policy

Aditya, T., Ningrum, S., Nurasa, H., & Irawati, I. (2023) · Heliyon · doi:10.1016/j.heliyon.2023.e18932 · Cited by 45

Enhancing Greenhouse Efficiency: Integrating IoT and Reinforcement Learning for Optimized Climate Control

Platero-Horcajadas, M., Pardo-Pina, S., Zapata, J. M. C., Brenes-Carranza, J.-A., & Pastor, F. J. F. (2024) · Sensors · doi:10.3390/s24248109 · Cited by 44

An innovative heterogeneous transfer learning framework to enhance the scalability of deep reinforcement learning controllers in buildings with integrated energy systems

Coraci, D., Brandi, S., Hong, T., & Capozzoli, A. (2024) · Building Simulation · doi:10.1007/s12273-024-1109-6 · Cited by 47

The assessment of smart city projects using zSlice type-2 fuzzy sets based Interval Agreement Method

Deveci, M., Pekaslan, D., & Canıtez, F. (2019) · Sustainable Cities and Society · doi:10.1016/j.scs.2019.101889 · Cited by 43

Transferability investigation of a Sim2Real deep transfer learning framework for cross-building energy prediction

Fang, X., Gong, G., Li, G., Chun, L., Peng, P., & Shi, X. (2023) · Energy and Buildings · doi:10.1016/j.enbuild.2023.112968 · Cited by 43

Leveraging Artificial Intelligence to Bolster the Energy Sector in Smart Cities: A Literature Review

Camacho, J. D. J., Aguirre, B., Ponce, P., Anthony, B., & Molina, A. (2024) · Energies · doi:10.3390/en17020353 · Cited by 42

Online Implementation of a Soft Actor-Critic Agent to Enhance Indoor Temperature Control and Energy Efficiency in Buildings

Coraci, D., Brandi, S., Piscitelli, M. S., & Capozzoli, A. (2021) · Energies · doi:10.3390/en14040997 · Cited by 41

AlphaBuilding ResCommunity: A multi-agent virtual testbed for community-level load coordination

Wang, Z., Chen, B., Li, H., & Hong, T. (2021) · Advances in Applied Energy · doi:10.1016/j.adapen.2021.100061 · Cited by 40

Reinforcement Learning-Based BEMS Architecture for Energy Usage Optimization

Park, S., Park, S., Choi, M.-I., Lee, S., Lee, T., Kim, S., Cho, K., & Park, S. (2020) · Sensors · doi:10.3390/s20174918 · Cited by 40

Energy optimization for regional buildings based on distributed reinforcement learning

Qin, Y., Ke, J., Wang, B., & Filaretov, G. F. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2021.103625 · Cited by 36

AI-Driven Multi-Objective Optimization and Decision-Making for Urban Building Energy Retrofit: Advances, Challenges, and Systematic Review

Shan, R., Jia, X., Su, X., Xu, Q., Ning, H., & Zhang, J. (2025) · Applied Sciences · doi:10.3390/app15168944 · Cited by 35

Using Deep Learning Neural Network in Artificial Intelligence Technology to Classify Beef Cuts

Sunil, G. C., Saidul, B., Zhang, Y., Reed, D. D., Ahsan, M., Berg, E. P., & Sun, X. (2021) · Frontiers in Sensors · doi:10.3389/fsens.2021.654357 · Cited by 40

Hyperparameter Optimization of Regression Model for Electrical Load Forecasting During the COVID-19 Pandemic Lockdown Period

(2023) · International journal of intelligent engineering and systems · doi:10.22266/ijies2023.0831.20 · Cited by 34

A Systematic Review on Demand Response Role Toward Sustainable Energy in the Smart Grids-Adopted Buildings Sector

Al-Ghaili, A. M., Ibrahim, Z.-A., Bakar, A. A., Kasim, H., Al‐Hada, N. M., Jôrgensen, B. N., Hassan, Z., Othman, M., Kasmani, R. M., & Shayea, I. A. M. (2023) · IEEE Access · doi:10.1109/access.2023.3287641 · Cited by 37

Reinforcement Learning: Theory and Applications in HEMS

Al-Ani, O., & Das, S. (2022) · Energies · doi:10.3390/en15176392 · Cited by 35

State of the Art Survey of Deep Learning and Machine Learning Models for Smart Cities and Urban SustainabilityPreprint

Nosratabadi, S., Mosavi, A. H., Keivani, R., Ardabili, S., & Aram, F. (2020) · doi:10.31219/osf.io/gmuzk · Cited by 32

BFA-YOLO: A balanced multiscale object detection network for building façade elements detection

Chen, Y., Wang, T., Chen, G., Zhu, K., Tan, X., Wang, J., Guo, W., Wang, Q., Luo, X., & Zhang, X. (2025) · Advanced Engineering Informatics · doi:10.1016/j.aei.2025.103289 · Cited by 34

Review of load data analytics using deep learning in smart grids: Open load datasets, methodologies, and application challenges

Elahe, M. F., Jin, M., & Zeng, P. (2021) · International Journal of Energy Research · doi:10.1002/er.6745 · Cited by 33

Trade-off decisions in a novel deep reinforcement learning for energy savings in HVAC systems

Dawood, S. M., Hatami, A., & Homod, R. Z. (2022) · Journal of Building Performance Simulation · doi:10.1080/19401493.2022.2099465 · Cited by 30

Artificial Intelligence And Smart Cities: A Bibliometric Analysis

Gupta, A., Gupta, S. K., Memoria, M., Kumar, R., Kumar, S., Singh, D., Tyagi, S., & Ansari, N. (2022) · International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COM-IT-CON) · doi:10.1109/com-it-con54601.2022.9850656 · Cited by 30

An Hybrid Approach for Urban Traffic Prediction and Control in Smart Cities

Culiţă, J., Caramihai, S. I., Dumitrache, I., Moisescu, M. A., & Sacală, I. Ş. (2020) · Sensors · doi:10.3390/s20247209 · Cited by 31

Smart control of window and air cleaner for mitigating indoor PM2.5 with reduced energy consumption based on deep reinforcement learning

An, Y., Niu, Z., & Chen, C. (2022) · Building and Environment · doi:10.1016/j.buildenv.2022.109583 · Cited by 28

Interconnected hybrid AC-DC microgrids security enhancement using blockchain technology considering uncertainty

Li, Q., Li, A., Wang, T., & Cai, Y. (2021) · International Journal of Electrical Power & Energy Systems · doi:10.1016/j.ijepes.2021.107324 · Cited by 26

A Review on Machine/Deep Learning Techniques Applied to Building Energy Simulation, Optimization and Management

Villano, F., Mauro, G. M., & Pedace, A. (2024) · Thermo · doi:10.3390/thermo4010008 · Cited by 63

A simulation study on energy optimization in building control with reinforcement learning

Bolt, P., Ziebart, V., Jaeger, C., Schmid, N., Stadelmann, T., & Füchslin, R. M. (2024) · Zürcher Hochschule für Angewandte Wissenschaften digital collection (Zurich University of Applied Sciences) · doi:10.21256/zhaw-31129

Data-driven Urban Energy Simulation (DUE-S): A framework for integrating engineering simulation and machine learning methods in a multi-scale urban energy modeling workflow

Nutkiewicz, A., Yang, Z., & Jain, R. K. (2018) · Applied Energy · doi:10.1016/j.apenergy.2018.05.023 · Cited by 223

The CityLearn Challenge: Four Years of Advancing Common Task Frameworks for Energy Management in Smart Buildings

Nagy, Z., & Nweye, K. (2025) · ACM International Conference on Future Energy Systems (e-Energy) · doi:10.1145/3679240.3734667 · Cited by 2

PhD Forum Abstract: BESTOpt: A Physics-Informed Machine Learning Based Building Simulation, Control and Optimization Platform

Jiang, Z. (2025) · ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys) · doi:10.1145/3736425.3772192 · Cited by 1