Browse > Article
http://dx.doi.org/10.56977/jicce.2022.20.3.212

A 4K-Capable Hardware Accelerator of Haze Removal Algorithm using Haze-relevant Features  

Lee, Seungmin (Department of Electronics Engineering, Dong-A University)
Kang, Bongsoon (Department of Electronics Engineering, Dong-A University)
Abstract
The performance of vision-based intelligent systems, such as self-driving cars and unmanned aerial vehicles, is subject to weather conditions, notably the frequently encountered haze or fog. As a result, studies on haze removal have garnered increasing interest from academia and industry. This paper hereby presents a 4K-capable hardware implementation of an efficient haze removal algorithm with the following two improvements. First, the depth-dependent haze distribution is predicted using a linear model of four haze-relevant features, where the model parameters are obtained through maximum likelihood estimates. Second, the approximated quad-decomposition method is adopted to estimate the atmospheric light. Extensive experimental results then follow to verify the efficacy of the proposed algorithm against well-known benchmark methods. For real-time processing, this paper also presents a pipelined architecture comprised of customized macros, such as split multipliers, parallel dividers, and serial dividers. The implementation results demonstrated that the proposed hardware design can handle DCI 4K videos at 30.8 frames per second.
Keywords
Field-programmable gate array; Hardware accelerator; Haze removal; Real-time processing;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 C. O. Ancuti, C. Ancuti, R. Timofte, and C. D. Vleeschouwer, "O-HAZE: A dehazing benchmark with real hazy and haze-free outdoor images," in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City: UT, USA, pp. 867-875, 2018. DOI: 10.1109/CVPRW.2018.00119.   DOI
2 J. -P. Tarel and N. Hautiere, "Fast visibility restoration from a single color or gray level image," in 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan, pp. 2201-2208, 2009. DOI: 10.1109/ICCV.2009.5459251.   DOI
3 D. Park, H. Park, D. K. Han, and H. Ko, "Single Image dehazing with image entropy and information fidelity," in 2014 IEEE International Conference on Image Processing (ICIP), Paris, France, pp. 4037-4041, 2014. DOI: 10.1109/ICIP.2014.7025820.   DOI
4 H. Cho, G. -J. Kim, K. Jang, S. Lee, and B. Kang, "Color image enhancement based on adaptive nonlinear curves of luminance features," Journal of Semiconductor Technology and Science, vol. 15, no. 1, pp. 60-67, Feb. 2015. DOI: 10.5573/JSTS.2015.15.1.060.   DOI
5 Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: from error visibility to structural similarity," IEEE Transactions on. Image Processing, vol. 13, no. 4, pp. 600-612, Apr. 2004. DOI: 10.1109/TIP.2003.819861.   DOI
6 L. Zhang, L. Zhang, X. Mou, and D. Zhang, "FSIM: A feature similarity index for image quality assessment," IEEE Transactions on Image Processing, vol. 20, no. 8, pp. 2378-2386, Aug. 2011. DOI: 10.1109/TIP.2011.2109730.   DOI
7 H. Yeganeh and W. Zhou, "Objective quality assessment of tone-mapped images," IEEE Transactions on Image Processing, vol. 22, no. 2, pp. 657-667, Feb. 2012. DOI: 10.1109/TIP.2012.2221725.   DOI
8 C. Ancuti, C. O. Ancuti, R. Timofte, and C. D. Vleeschouwer, "I-HAZE: A dehazing benchmark with real hazy and haze-free indoor images," in Advanced Concepts for Intelligent Vision Systems, Poitiers, France, vol. 11182, pp. 620-631, 2018. DOI: 10.1007/978-3-030-01449-0_52.   DOI
9 Q. Zhu, J. Mai, and L. Shao, "A fast single image haze removal algorithm using color attenuation prior," IEEE Transactions on Image Processing, vol. 24, no. 11, pp. 3522-3533, Nov. 2015. DOI: 10.1109/TIP.2015.2446191.   DOI
10 D. Ngo, G. -D. Lee, and B. Kang, "A 4K-capable FPGA implementation of single image haze removal using hazy particle maps," Applied Sciences, vol. 9, no. 17, p. 3443, Aug. 2019. DOI: 10.3390/app9173443.   DOI
11 D. Ngo, S. Lee, T. M. Ngo, G. -D. Lee, and B. Kang, "Visibility restoration: A systematic review and meta-analysis," Sensors, vol. 21, no. 8, p. 2625, Apr. 2021. DOI: 10.3390/s21082625.   DOI
12 K. He, J. Sun, and X. Tang, "Single image haze removal using dark channel prior," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 12, pp. 2341-2353, Dec. 2011. DOI: 10.1109/TPAMI.2010.168.   DOI
13 K. Ma, W. Liu, and Z. Wang, "Perceptual evaluation of single image dehazing algorithms," in 2015 IEEE International Conference on Image Processing (ICIP), Quebec City: QC, Canada, pp. 3600-3604, 2015. DOI: 10.1109/ICIP.2015.7351475.   DOI
14 K. Jack, "Chapter 9: NTSC and PAL digital encoding and decoding," in Video Demystified, 4th ed. Elsevier India, pp. 394-471, 2004.
15 Z. Lee and S. Shang, "Visibility: How applicable is the century-old koschmieder model?," Journal of the Atmospheric Sciences, vol. 73, no. 11, pp. 4573-4581, Nov. 2016. DOI: 10.1175/JAS-D-16-0102.1.   DOI
16 B. Li, W. Ren, D. Fu, D. Tao, D. Feng, W. Zeng, and Z. Wang, "Benchmarking single-image dehazing and beyond," IEEE Transactions on Image Processing, vol. 28, no. 1, pp. 492-505, Jan. 2019. DOI: 10.1109/TIP.2018.2867951.   DOI
17 D. Ngo, G. -D. Lee, and B. Kang, "Haziness degree evaluator: A knowledge-driven approach for haze density estimation," Sensors, vol. 21, no. 11, Jun. 2021. DOI: 10.3390/s21113896.   DOI
18 [D. Ngo, S. Lee, G. -D. Lee, and B. Kang, "Single-image visibility restoration: A machine learning approach and its 4K-capable hardware accelerator," Sensors, vol. 20, no. 20, p. 5795, Oct. 2020. DOI: 10.3390/s20205795.   DOI
19 D. Ngo, G. -D. Lee, and B. Kang, "Improved color attenuation prior for single-image haze removal," Applied Sciences, vol. 9, no. 19, p. 4011, Sep. 2019. DOI: 10.3390/app9194011.   DOI
20 B. Cai, X. Xu, K. Jia, C. Qing, and D. Tao, "DehazeNet: An end-to-end system for single image haze removal," IEEE Transactions on Image Processing, vol. 25, no. 11, pp. 5187-5198, Nov. 2016. DOI: 10.1109/TIP.2016.2598681.   DOI
21 G. -J. Kim, S. Lee, and B. Kang, "Single image haze removal using hazy particle maps," IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences, vol. E101-A, no. 11, pp. 1999-2002, Nov. 2018. DOI: 10.1587/transfun.E101.A.1999.   DOI