DOI QR코드

DOI QR Code

Development of Semi-Active Control Algorithm Using Deep Q-Network

Deep Q-Network를 이용한 준능동 제어알고리즘 개발

  • Received : 2021.01.27
  • Accepted : 2021.02.02
  • Published : 2021.03.15

Abstract

Control performance of a smart tuned mass damper (TMD) mainly depends on control algorithms. A lot of control strategies have been proposed for semi-active control devices. Recently, machine learning begins to be applied to development of vibration control algorithm. In this study, a reinforcement learning among machine learning techniques was employed to develop a semi-active control algorithm for a smart TMD. The smart TMD was composed of magnetorheological damper in this study. For this purpose, an 11-story building structure with a smart TMD was selected to construct a reinforcement learning environment. A time history analysis of the example structure subject to earthquake excitation was conducted in the reinforcement learning procedure. Deep Q-network (DQN) among various reinforcement learning algorithms was used to make a learning agent. The command voltage sent to the MR damper is determined by the action produced by the DQN. Parametric studies on hyper-parameters of DQN were performed by numerical simulations. After appropriate training iteration of the DQN model with proper hyper-parameters, the DQN model for control of seismic responses of the example structure with smart TMD was developed. The developed DQN model can effectively control smart TMD to reduce seismic responses of the example structure.

Keywords

References

  1. Cioffi, R., Travaglioni, M., Piscitelli, G., Petrillo, A., & Felice, D. F., "Artificial Intelligence and Machine Learning Applications in Smart Production: Progress, Trends, and Directions", Sustainability, Vol.12, No.2, 2020, doi: 10.3390/su12020492
  2. Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., ... Hassabis, D., "Human-level control through deep reinforcement learning", Nature, Vol.518, pp.529-533, 2015, doi: 10.1038/nature14236
  3. Busoniu, L., de Bruin, T., Tolic, D., Kober, J., & Palunko, I., "Reinforcement learning for control: Performance, stability, and deep approximators", Annual Reviews in Control, Vol.46, pp.8-28, 2018, doi: 10.1016/j.arcontrol.2018.09.005
  4. Van Hasselt, H., Guez, A., & Silver, D. (2016). Deep Reinforcement Learning with Double Q-learning. Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, USA, Retrieved from file:///C:/Users/user/Downloads/12389-55999-1-PB.pdf
  5. Bathaei, A., Zahrai, S. M., & Ramezani, M., "Semi-active seismic control of an 11-DOF building model with TMD+MR damper using type-1 and -2 fuzzy algorithms", Journal of Vibration and Control, Vol.24, No.13, pp.2938-2953, 2018 https://doi.org/10.1177/1077546317696369
  6. Clifton, J., & Laber, E., "Q-Learning: Theory and Applications", Annual Review of Statistics and Its Application, Vol.7, pp.279-301, 2020, doi: 10.1146/annurevstatistics-031219-041220
  7. Sues, R. H., Mau, S. T., & Wen, Y. -K., "Systems Identification of Degrading Hysteretic Restoring Forces", Journal of Engineering Mechanics, Vol.114, No.5, pp.833-846, 1988, doi: 10.1061/(ASCE) 0733-9399(1988)114:5(833)
  8. Pastia, C., & Luca, S. -G., "Vibration control of a frame structure using semi-active tuned mass damper", Bulletin of the Polytechnic Institute of Jassy, Vol.59, No.4, 2013, Retrieved from http://www.bipcons.ce.tuiasi.ro/Archive/392.pdf
  9. Nagarajaiah, S., & Narasimhan, S., "Smart base-isolated benchmark building. Part II: phase I sample controllers for linear isolation systems", The Journal of the International Association for Structural Control and Health Monitoring, Vol.13, No.2-3, pp.589-604, 2006, doi: 10.1002/stc.100