Browse > Article
http://dx.doi.org/10.9708/jksci.2021.26.06.001

Low Resolution Infrared Image Deep Convolution Neural Network for Embedded System  

Hong, Yong-hee (Dept. of PGM Seeker Lab, LIG Nex1)
Jin, Sang-hun (Dept. of PGM Seeker Lab, LIG Nex1)
Kim, Dae-hyeon (Dept. of PGM Seeker Lab, LIG Nex1)
Jhee, Ho-Jin (Dept. of PGM Seeker Lab, LIG Nex1)
Abstract
In this paper, we propose reinforced VGG style network structure for low performance embedded system to classify low resolution infrared image. The combination of reinforced VGG style network structure and global average pooling makes lower computational complexity and higher accuracy. The proposed method classify the synthesize image which have 9 class 3,723,328ea images made from OKTAL-SE tool. The reinforced VGG style network structure composed of 4 filters on input and 16 filters on output from max pooling layer shows about 34% lower computational complexity and about 2.4% higher accuracy then the first parameter minimized network structure made for embedded system composed of 8 filters on input and 8 filters on output from max pooling layer. Finally we get 96.1% accuracy model. Additionally we confirmed the about 31% lower inference lead time in ported C code.
Keywords
Deep Learning; CNN; VGG; Low Resolution; Infrared; Synthesize Image;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Mark Sandler, Andrew Howard, Menglong Zhu, Andrey Zhmoginov, Liang-Chieh Chen, "MobileNetV2: Inverted Residuals and Linear Bottlenecks," The IEEE Conference on Computer Vision and Pattern Recognition, pp. 4510-4520, 2018.
2 Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton, "ImageNet Classification with Deep Convolutional Neural Networks," Communications of the ACM, Vol. 60, No. 6, pp 84-90, May. 2017.   DOI
3 Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, Andrew Rabinovich, "Going Deeper with Convolutions," IEEE Conference on Computer Vision and Pattern Recognition, Jun. 2015.
4 Pilwon Kwak, Kiduck Kim, Hyochoong Bang, "Deep Transfer Learning Between Heterogeneous Data for Automatic Target Recognition," Journal of Institute of Control, Robotics and Systems, Vol. 24, No. 10, pp. 954-961, Oct. 2018.   DOI
5 SungMok Yang, JinKyu Choe, "A Study on Improvement of Human Sensing System Reliability Using Thermal Image," Korean Institute of Information Technology, Vol. 17, No. 1, pp. 35-40, Jan. 2020.
6 Andrew G. Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, Hartwig Adam, "MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications," Computer Vision and Pattern Recognition, Apr. 2017.
7 Antoine d'Acremont, Ronan Fablet, Alexandre Baussard, Guillaume Quin, "CNN-Based Target Recognition and Identification for Infrared Imaging in Defense Systems," Multidisciplinary Digital Publishing Institute, Vol.19, No.9, Apr. 2019.
8 Aparna Akula, Anuj K Shah, Ripul Ghosh, "Deep Learning Approach for Human Action Recognition in Infrared Images," Cognitive Systems Research, Vol. 80, pp. 146-154, Aug.. 2018.
9 Matthew D. Zeiler, Rob Fergus, "Visualizing and Understanding Convolutional Networks," European Conference on Computer Vision, pp. 818-833, Nov. 2014.
10 D. A. Scribner, M. Kruer, and J. Killiany, "Infrared focal plane array technology," Proc. IEEE, vol. 79, no. 1, pp. 66-85, Jan 1991.   DOI
11 Karen Simonyan, Andrew Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition" International Conference on Learning Representations, Apr. 2015.
12 Gao Huang, Zhuang Liu, Laurens van der Maaten, Kilian Q. Weinberger, "Densely Connected Convolutional Networks," Computer Vision and Pattern Recognition, Machine Learning, Jan. 2018.
13 Junhwan Ryu, Sungho Kim, "Data Driven Proposal and Deep Learning-based Small Infrared Drone Detection," Institute of Control, Robotics and Systems, Vol. 24, No. 12, pp. 1146-1151, Dec. 2018.   DOI
14 Xiangyu Zhang, Xinyu Zhou, Mengxiao Lin, Jian Sun, "ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile," Computer Vision and Pattern Recognition, Dec. 2017.
15 Sungho Kim, Woo-Jin Song, So-Hyun Kim, "Infrared Variation Optimized Deep Convolutional Neural Network for Robust Automatic Ground Target Recognition," IEEE Conference on Computer Vision and Pattern Recognition Workshops, Jul. 2017.
16 Jisoo Park, Jingdao Chen, Yong K. Cho, Dae Y. Kang, Byung J. Son, "CNN-Based Person Detection Using Infrared Images for Night-Time Intrusion Warning Systems," IEEE Conference on Computer Vision and Pattern Recognition Workshops, Dec. 2019.
17 Wonsik Oh, Ugwiyeon Lee, Jeongseok Oh, "Deep Learning(CNN) based Worker Detection on Infrared Radiation Image Analysis," Journal of the Korean Institute of Gas, Vol. 22, No. 6, pp. 8-15, 2018.   DOI
18 Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun, "Deep Residual Learning for Image Recognition" IEEE Conference on Computer Vision and Pattern Recognition, pp.770-778, Vol.1, 2016.