DOI QR코드

DOI QR Code

Reinforcement Learning-Based Illuminance Control Method for Building Lighting System

강화학습 기반 빌딩의 방별 조명 시스템 조도값 설정 기법

  • Received : 2021.12.27
  • Accepted : 2022.03.21
  • Published : 2022.03.31

Abstract

Various efforts have been made worldwide to respond to environmental problems such as climate change. Research on artificial intelligence (AI)-based energy management has been widely conducted as the most effective way to alleviate the climate change problem. In particular, buildings that account for more than 20% of the total energy delivered worldwide have been focused as a target for energy management using the building energy management system (BEMS). In this paper, we propose a multi-armed bandit (MAB)-based energy management algorithm that can efficiently decide the energy consumption level of the lighting system in each room of the building, while minimizing the discomfort levels of occupants of each room.

전 세계적으로 에너지 사용량이 증가함에 따라 지구온난화와 같은 환경문제가 초래되었으며, 이에 각국은 협정·협약을 통한 에너지 산업의 탈탄소화와 함께 화석 에너지를 신재생에너지로 빠르게 전환 중이다. 발전량이 급변하는 신재생에너지 보급 확대에 따라 효율적인 에너지 관리의 필요성이 대두되는 한편, AI 기술이 발전함에 따라 에너지 관리 분야와 결합한 AI 기반 빌딩 에너지 관리 시스템(Building Energy Management System, BEMS)의 연구 및 개발이 활발히 이루어지고 있다. 본 논문에서는 강화학습 기법중 Multi-Armed Bandit(MAB) 알고리즘을 활용하여 빌딩 각 방의 조명시스템 전력사용량을 효율적으로 관리함과 동시에 사용자들의 불쾌지수를 최소화할 수 있는 알고리즘을 제안하고, 시뮬레이션을 통해 성능을 검증한다.

Keywords

Acknowledgement

This work was supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT) (No. 2022R1G1A1011513)

References

  1. The Economist Special Report, "Invisible Fuel", 2015. (https://www.economist.com/special-report/2015/01/15/invisible-fuel)
  2. S. Kim and H. Lim, "Reinforcement learning based energy management algorithm for smart energy buildings," Energies, vol.11, no.8, 2018. DOI: 10.3390/en11082010
  3. S. Park et al. "Reinforcement Learning-Based BEMS Architecture for Energy Usage Optimization," Sensors, vol.20, no.17, 2020. DOI: 10.3390/s20174918
  4. DeepMind Blog Post, "DeepMind AI Reduces Google Data Centre Cooling Bill by 40%", 2016. (https://deepmind.com/blog/article/deepmind-ai-reduces-google-data-centre-cooling-bill-40)
  5. Business Korea News, "KT Launches AI-based Energy Management Service for Buildings," 2019. (http://www.businesskorea.co.kr/news/articleView.html?idxno=37865)
  6. A. T. Eseye and M. Lehtonen, "Short-term forecasting of heat demand of buildings for efficient and optimal energy management based on integrated machine learning models," IEEE Transactions on Industrial Informatics, vol.16, no.12, 2020. DOI: 10.1109/TII.2020.2970165
  7. J. H. Kim, N. C. Seong and W. Choi, "Modeling and optimizing a chiller system using a machine learning algorithm," Energies, vol.12, no.15, 2019. DOI: 10.3390/en12152860
  8. "How to convert lux to watts", https://www.rapidtables.com/calc/light/index.html
  9. R. S. Sutton and A. G. Barto, Reinforcement learning: An introduction, MIT press, 2018.
  10. T. Murphy, "Maximum Efficiency of White Light." Department of physics UC San Diego, 2011.