Intelligent Harmony: Harnessing Deep Reinforcement Learning for Smart Home Energy Management
Keywords:
Deep Reinforcement Learning, Smart home, Energy management, Artificial intelligenceAbstract
This review examines the intricate developments and challenges in smart home energy management systems, with a particular focus on the integration of cutting-edge technologies and innovative methodologies aimed at addressing the rapidly evolving landscape of energy use. Despite significant strides in the field, there remain critical gaps that require further attention. Chief among these are ensuring data privacy and security, which have become increasingly important with the proliferation of interconnected devices, managing the complexity of heterogeneous data from diverse sources, and overcoming persistent interoperability issues that hinder seamless communication among various smart devices. To address these challenges, this review outlines several promising directions for future research. These include the implementation of robust encryption techniques to protect sensitive information, the development of scalable storage solutions to handle the ever-growing volume of data, and the deployment of advanced analytics algorithms capable of real-time processing and decision-making. Additionally, the review emphasizes the need to explore the socio-economic implications of smart energy management systems, particularly in light of global crises such as the COVID-19 pandemic, which have underscored the importance of resilient and sustainable energy infrastructures. By providing a comprehensive overview of both the current state of smart home energy management and the areas that require further exploration, this review aims to foster advancements that will lead to the creation of more efficient, secure, and adaptable systems. Ultimately, addressing these challenges will contribute to the development of sustainable solutions that align with broader societal goals, enhancing the resilience of energy infrastructures while promoting environmental stewardship.
References
Ahmad, F., Alam, M. S., & Asaad, M. (2017). Developments in xEVs charging infrastructure and energy management system for smart microgrids including xEVs. Sustainable cities and society, 35, 552-564. https://doi.org/10.1016/j.scs.2017.09.008
Ahmed, T., Mekhilef, S., Shah, R., Mithulananthan, N., Seyedmahmoudian, M., & Horan, B. (2017). ASEAN power grid: A secure transmission infrastructure for clean and sustainable energy for South-East Asia. Renewable and Sustainable Energy Reviews, 67, 1420-1435. https://doi.org/10.1016/j.rser.2016.09.055
Al-Ali, A., El-Hag, A., Bahadiri, M., Harbaji, M., & El Haj, Y. A. (2011). Smart home renewable energy management system. Energy Procedia, 12, 120-126. https://doi.org/10.1016/j.egypro.2011.10.017
Aliero, M. S., Qureshi, K. N., Pasha, M. F., & Jeon, G. (2021). Smart Home Energy Management Systems in Internet of Things networks for green cities demands and services. Environmental Technology & Innovation, 22, 101443. https://doi.org/10.1016/j.eti.2021.101443
Almaiah, M. A., Yelisetti, S., Arya, L., Babu Christopher, N. K., Kaliappan, K., Vellaisamy, P., Hajjej, F., & Alkdour, T. (2023). A Novel Approach for Improving the Security of IoT–Medical Data Systems Using an Enhanced Dynamic Bayesian Network. Electronics, 12(20), 4316. https://www.mdpi.com/2079-9292/12/20/4316
Alzoubi, A. (2022). Machine learning for intelligent energy consumption in smart homes. International Journal of Computations, Information and Manufacturing (IJCIM), 2(1). https://doi.org/10.54489/ijcim.v2i1.75
Ayub, S., Ayob, S. M., Tan, C. W., Taimoor, M., Ayub, L., Bukar, A. L., & Daud, M. (2022). Analysis of energy management schemes for renewable-energy-based smart homes against the backdrop of COVID-19. Sustainable Energy Technologies and Assessments, 52, 102136. https://doi.org/10.1016/j.seta.2022.102136
Batista, N., Melício, R., Matias, J., & Catalão, J. (2013). Photovoltaic and wind energy systems monitoring and building/home energy management using ZigBee devices within a smart grid. Energy, 49, 306-315. https://doi.org/10.1016/j.energy.2012.11.002
Beaudin, M., & Zareipour, H. (2015). Home energy management systems: A review of modelling and complexity. Renewable and Sustainable Energy Reviews, 45, 318-335. https://doi.org/10.1016/j.rser.2015.01.046
Carreiro, A. M., Jorge, H. M., & Antunes, C. H. (2017). Energy management systems aggregators: A literature survey. Renewable and Sustainable Energy Reviews, 73, 1160-1172. https://doi.org/10.1016/j.rser.2017.01.179
de Normalisation, C. E. (2012). Energy Performance of Buildings—Impact of Building Automation, Control, and Building Management; European Technical Standard EN 15232; CEN: Brussels, Belgium. 2012. In: CEN: Brussels, Belgium.
Dreidy, M., Mokhlis, H., & Mekhilef, S. (2017). Inertia response and frequency control techniques for renewable energy sources: A review. Renewable and Sustainable Energy Reviews, 69, 144-155. https://doi.org/10.1016/j.rser.2016.11.170
Durai, K. N., Subha, R., & Haldorai, A. (2021). A Novel Method to Detect and Prevent SQLIA Using Ontology to Cloud Web Security. Wireless Personal Communications, 117(4), 2995-3014. https://doi.org/10.1007/s11277-020-07243-z
El-Azab, R. (2021). Smart homes: Potentials and challenges. Clean Energy, 5(2), 302-315. https://doi.org/10.1093/ce/zkab010
Gariba, D., & Pipaliya, B. (2016). Modelling human behaviour in smart home energy management systems via machine learning techniques. 2016 International Automatic Control Conference (CACS), https://doi.org/10.1109/CACS.2016.7973883
Gholinejad, H. R., Adabi, J., & Marzband, M. (2021). An energy management system structure for Neighborhood Networks. Journal of Building Engineering, 41, 102376. https://doi.org/10.1016/j.jobe.2021.102376
GoogleTrends. (2024). https://trends.google.com/trends/explore?date=now%201-d&q=smarthome&hl=en-US
Gupta, S., Sarkar, B., Saha, S., Sarkar, I., Chakrabarti, P., Sahana, S., Chakrabarti, T., & Elngar, A. A. (2022). A Novel Approach Toward the Prevention of the Side Channel Attacks for Enhancing the Network Security. https://doi.org/10.21203/rs.3.rs-2074983/v1
He, Q., & He, H. (2021). A Novel Method to Enhance Sustainable Systems Security in Cloud Computing Based on the Combination of Encryption and Data Mining. Sustainability, 13(1), 101. https://www.mdpi.com/2071-1050/13/1/101
Hosseini, S. S., Agbossou, K., Kelouwani, S., & Cardenas, A. (2017). Non-intrusive load monitoring through home energy management systems: A comprehensive review. Renewable and Sustainable Energy Reviews, 79, 1266-1274. https://doi.org/10.1016/j.rser.2017.05.096
Hu, H., Xie, N., Fang, D., & Zhang, X. (2018). The role of renewable energy consumption and commercial services trade in carbon dioxide reduction: Evidence from 25 developing countries. Applied Energy, 211, 1229-1244. https://doi.org/10.1016/j.apenergy.2017.12.019
Kazmi, H., Mehmood, F., & Amayri, M. (2017). Smart home futures: Algorithmic challenges and opportunities. 2017 14th International Symposium on Pervasive Systems, Algorithms and Networks & 2017 11th International Conference on Frontier of Computer Science and Technology & 2017 Third International Symposium of Creative Computing (ISPAN-FCST-ISCC), https://doi.org/10.1109/ISPAN-FCST-ISCC.2017.60
Khayyat, M. M., & Sami, B. (2024). Energy Community Management Based on Artificial Intelligence for the Implementation of Renewable Energy Systems in Smart Homes. Electronics, 13(2), 380. https://doi.org/10.3390/electronics13020380
Kuzlu, M., Pipattanasomporn, M., & Rahman, S. (2015). Review of communication technologies for smart homes/building applications. 2015 IEEE Innovative Smart Grid Technologies-Asia (ISGT ASIA), https://doi.org/10.1109/ISGT-Asia.2015.7437036
Lashkari, B., Chen, Y., & Musilek, P. (2019). Energy Management for Smart Homes—State of the Art. Applied Sciences, 9(17), 3459. https://www.mdpi.com/2076-3417/9/17/3459
Lee, D., & Cheng, C.-C. (2016). Energy savings by energy management systems: A review. Renewable and Sustainable Energy Reviews, 56, 760-777. https://doi.org/10.1016/j.rser.2015.11.067
Leitao, J., Gil, P., Ribeiro, B., & Cardoso, A. (2020). A survey on home energy management. IEEE Access, 8, 5699-5722. https://doi.org/10.1109/ACCESS.2019.2963502
Lokeshgupta, B., & Sivasubramani, S. (2019). Multi-objective home energy management with battery energy storage systems. Sustainable cities and society, 47, 101458. https://doi.org/10.1016/j.scs.2019.101458
Makhadmeh, S. N., Khader, A. T., Al-Betar, M. A., Naim, S., Abasi, A. K., & Alyasseri, Z. A. A. (2019). Optimization methods for power scheduling problems in smart home: Survey. Renewable and Sustainable Energy Reviews, 115, 109362. https://doi.org/10.1016/j.rser.2019.109362
Mariano-Hernández, D., Hernández-Callejo, L., Zorita-Lamadrid, A., Duque-Pérez, O., & García, F. S. (2021). A review of strategies for building energy management system: Model predictive control, demand side management, optimization, and fault detect & diagnosis. Journal of Building Engineering, 33, 101692. https://doi.org/10.1016/j.jobe.2020.101692
McIlvennie, C., Sanguinetti, A., & Pritoni, M. (2020). Of impacts, agents, and functions: An interdisciplinary meta-review of smart home energy management systems research. Energy Research & Social Science, 68, 101555. https://doi.org/10.1016/j.erss.2020.101555
Mir, U., Abbasi, U., Mir, T., Kanwal, S., & Alamri, S. (2021). Energy management in smart buildings and homes: current approaches, a hypothetical solution, and open issues and challenges. IEEE Access, 9, 94132-94148. https://doi.org/10.1109/ACCESS.2021.3092304
Mishra, K. N., & Chakraborty, C. (2020). A Novel Approach Toward Enhancing the Quality of Life in Smart Cities Using Clouds and IoT-Based Technologies. In M. Farsi, A. Daneshkhah, A. Hosseinian-Far, & H. Jahankhani (Eds.), Digital Twin Technologies and Smart Cities (pp. 19-35). Springer International Publishing. https://doi.org/10.1007/978-3-030-18732-3_2
Nacer, A., Marhic, B., & Delahoche, L. (2017). Smart Home, Smart HEMS, Smart heating: An overview of the latest products and trends. 2017 6th international conference on systems and control (ICSC), https://doi.org/10.1109/ICoSC.2017.7958713
Olatomiwa, L., Mekhilef, S., Ismail, M. S., & Moghavvemi, M. (2016). Energy management strategies in hybrid renewable energy systems: A review. Renewable and Sustainable Energy Reviews, 62, 821-835. https://doi.org/10.1016/j.rser.2016.05.040
Praveen, S. P., Thati, B., Anuradha, C., Sindhura, S., & Altaee, M. (2023). A Novel Approach for Enhance Fusion Based Healthcare System In Cloud Computing. Full Length Article, 9(1), 84-84-96. https://doi.org/10.54216/JISIoT.090106
Qela, B., & Mouftah, H. T. (2012). Observe, learn, and adapt (OLA)—An algorithm for energy management in smart homes using wireless sensors and artificial intelligence. IEEE transactions on smart grid, 3(4), 2262-2272. https://doi.org/10.1109/TSG.2012.2209130
Raya-Armenta, J. M., Bazmohammadi, N., Avina-Cervantes, J. G., Sáez, D., Vasquez, J. C., & Guerrero, J. M. (2021). Energy management system optimization in islanded microgrids: An overview and future trends. Renewable and Sustainable Energy Reviews, 149, 111327. https://doi.org/10.1016/j.rser.2021.111327
Robles, R. J., & Kim, T.-h. (2010). Applications, systems and methods in smart home technology: A. Int. Journal of Advanced Science And Technology, 15, 37-48. https://www.researchgate.net/publication/242630611_Applications_Systems_and_Methods_in_Smart_Home_Technology_A_Review
Rocha, H. R. O., Honorato, I. H., Fiorotti, R., Celeste, W. C., Silvestre, L. J., & Silva, J. A. L. (2021). An Artificial Intelligence based scheduling algorithm for demand-side energy management in Smart Homes. Applied Energy, 282, 116145. https://doi.org/https://doi.org/10.1016/j.apenergy.2020.116145
Schieweck, A., Uhde, E., Salthammer, T., Salthammer, L. C., Morawska, L., Mazaheri, M., & Kumar, P. (2018). Smart homes and the control of indoor air quality. Renewable and Sustainable Energy Reviews, 94, 705-718. https://doi.org/10.1016/j.rser.2018.05.057
Sierla, S., Pourakbari-Kasmaei, M., & Vyatkin, V. (2022). A taxonomy of machine learning applications for virtual power plants and home/building energy management systems. Automation in Construction, 136, 104174. https://doi.org/10.1016/j.autcon.2022.104174
Skea, J. (2012). Roadmap 2050: A Practical Guide to a Prosperous, Low-Carbon Europe, European Climate Foundation (2010). In: Elsevier.
Sowah, R. A., Ofoli, A. R., Tetteh, M. K., Opoku, R. A., & Armoo, S. K. (2018). Demand side management of smart homes using OpenHAB framework for interoperability of devices. 2018 IEEE 7th International Conference on Adaptive Science & Technology (ICAST), https://doi.org/10.1109/ICASTECH.2018.8506917
Wang, H., Bao, Q., Shui, Z., Li, L., & Ji, H. (2024). A Novel Approach to Credit Card Security with Generative Adversarial Networks and Security Assessment. https://www.researchgate.net/publication/385863015_A_Novel_Approach_to_Credit_Card_Security_with_Generative_Adversarial_Networks_and_Security_Assessment
Whiffen, T., Naylor, S., Hill, J., Smith, L., Callan, P., Gillott, M., Wood, C., & Riffat, S. (2016). A concept review of power line communication in building energy management systems for the small to medium sized non-domestic built environment. Renewable and Sustainable Energy Reviews, 64, 618-633. https://doi.org/10.1016/j.rser.2016.06.069
Wilson, C., Hargreaves, T., & Hauxwell-Baldwin, R. (2015). Smart homes and their users: a systematic analysis and key challenges. Personal and Ubiquitous Computing, 19, 463-476. https://doi.org/10.1007/s00779-014-0813-0
Yan, X., Ozturk, Y., Hu, Z., & Song, Y. (2018). A review on price-driven residential demand response. Renewable and Sustainable Energy Reviews, 96, 411-419. https://doi.org/10.1016/j.rser.2018.08.003
Yuan, X., Han, P., Duan, Y., Alden, R. E., Rallabandi, V., & Ionel, D. M. (2020). Residential electrical load monitoring and modeling–state of the art and future trends for smart homes and grids. Electric Power Components and Systems, 48(11), 1125-1143. https://doi.org/10.1080/15325008.2020.1834019
Zafar, U., Bayhan, S., & Sanfilippo, A. (2020). Home energy management system concepts, configurations, and technologies for the smart grid. IEEE Access, 8, 119271-119286. https://doi.org/10.1109/ACCESS.2020.3005244
Zangheri, P., Castellazzi, L., D’Agostino, D., Economidou, M., Ruggieri, G., Tsemekidi-Tzeiranaki, S., Maduta, C., & Bertoldi, P. (2021). Progress of the Member States in implementing the Energy Performance of Building Directive. Joint Research Centre Science for Policy Report (JRC122347), EUR30469 EN. https://publications.jrc.ec.europa.eu/repository/handle/JRC122347
Zhou, B., Li, W., Chan, K. W., Cao, Y., Kuang, Y., Liu, X., & Wang, X. (2016). Smart home energy management systems: Concept, configurations, and scheduling strategies. Renewable and Sustainable Energy Reviews, 61, 30-40. https://doi.org/10.1016/j.rser.2016.03.047
Zia, M. F., Elbouchikhi, E., & Benbouzid, M. (2018). Microgrids energy management systems: A critical review on methods, solutions, and prospects. Applied Energy, 222, 1033-1055. https://doi.org/10.1016/j.apenergy.2018.04.103
Downloads
Published
Submitted
Revised
Accepted
Issue
Section
License
Copyright (c) 2026 Mohammadreza Ganjian (Author); Mohammad Tabrizian; Naser Khodabakhshi-Javinani, Meqdad Ansarian (Author)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
