Journal of information and communication convergence engineering

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

A 4K-Capable Hardware Accelerator of Haze Removal Algorithm using Haze-relevant Features

  • Lee, Seungmin (Department of Electronics Engineering, Dong-A University) ;
  • Kang, Bongsoon (Department of Electronics Engineering, Dong-A University)
  • Received : 2022.01.03
  • Accepted : 2022.08.17
  • Published : 2022.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

The performance of vision-based intelligent systems, such as self-driving cars and unmanned aerial vehicles, is subject to weather conditions, notably the frequently encountered haze or fog. As a result, studies on haze removal have garnered increasing interest from academia and industry. This paper hereby presents a 4K-capable hardware implementation of an efficient haze removal algorithm with the following two improvements. First, the depth-dependent haze distribution is predicted using a linear model of four haze-relevant features, where the model parameters are obtained through maximum likelihood estimates. Second, the approximated quad-decomposition method is adopted to estimate the atmospheric light. Extensive experimental results then follow to verify the efficacy of the proposed algorithm against well-known benchmark methods. For real-time processing, this paper also presents a pipelined architecture comprised of customized macros, such as split multipliers, parallel dividers, and serial dividers. The implementation results demonstrated that the proposed hardware design can handle DCI 4K videos at 30.8 frames per second.

Keywords

Acknowledgement

This research was funded by research funds from Dong-A University, Busan, Korea.

References

  1. Z. Lee and S. Shang, "Visibility: How applicable is the century-old koschmieder model?," Journal of the Atmospheric Sciences, vol. 73, no. 11, pp. 4573-4581, Nov. 2016. DOI: 10.1175/JAS-D-16-0102.1.
  2. D. Ngo, S. Lee, T. M. Ngo, G. -D. Lee, and B. Kang, "Visibility restoration: A systematic review and meta-analysis," Sensors, vol. 21, no. 8, p. 2625, Apr. 2021. DOI: 10.3390/s21082625.
  3. K. He, J. Sun, and X. Tang, "Single image haze removal using dark channel prior," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 12, pp. 2341-2353, Dec. 2011. DOI: 10.1109/TPAMI.2010.168.
  4. G. -J. Kim, S. Lee, and B. Kang, "Single image haze removal using hazy particle maps," IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences, vol. E101-A, no. 11, pp. 1999-2002, Nov. 2018. DOI: 10.1587/transfun.E101.A.1999.
  5. D. Ngo, G. -D. Lee, and B. Kang, "A 4K-capable FPGA implementation of single image haze removal using hazy particle maps," Applied Sciences, vol. 9, no. 17, p. 3443, Aug. 2019. DOI: 10.3390/app9173443.
  6. Q. Zhu, J. Mai, and L. Shao, "A fast single image haze removal algorithm using color attenuation prior," IEEE Transactions on Image Processing, vol. 24, no. 11, pp. 3522-3533, Nov. 2015. DOI: 10.1109/TIP.2015.2446191.
  7. D. Ngo, G. -D. Lee, and B. Kang, "Improved color attenuation prior for single-image haze removal," Applied Sciences, vol. 9, no. 19, p. 4011, Sep. 2019. DOI: 10.3390/app9194011.
  8. B. Cai, X. Xu, K. Jia, C. Qing, and D. Tao, "DehazeNet: An end-to-end system for single image haze removal," IEEE Transactions on Image Processing, vol. 25, no. 11, pp. 5187-5198, Nov. 2016. DOI: 10.1109/TIP.2016.2598681.
  9. B. Li, W. Ren, D. Fu, D. Tao, D. Feng, W. Zeng, and Z. Wang, "Benchmarking single-image dehazing and beyond," IEEE Transactions on Image Processing, vol. 28, no. 1, pp. 492-505, Jan. 2019. DOI: 10.1109/TIP.2018.2867951.
  10. D. Ngo, G. -D. Lee, and B. Kang, "Haziness degree evaluator: A knowledge-driven approach for haze density estimation," Sensors, vol. 21, no. 11, Jun. 2021. DOI: 10.3390/s21113896.
  11. [D. Ngo, S. Lee, G. -D. Lee, and B. Kang, "Single-image visibility restoration: A machine learning approach and its 4K-capable hardware accelerator," Sensors, vol. 20, no. 20, p. 5795, Oct. 2020. DOI: 10.3390/s20205795.
  12. J. -P. Tarel and N. Hautiere, "Fast visibility restoration from a single color or gray level image," in 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan, pp. 2201-2208, 2009. DOI: 10.1109/ICCV.2009.5459251.
  13. D. Park, H. Park, D. K. Han, and H. Ko, "Single Image dehazing with image entropy and information fidelity," in 2014 IEEE International Conference on Image Processing (ICIP), Paris, France, pp. 4037-4041, 2014. DOI: 10.1109/ICIP.2014.7025820.
  14. H. Cho, G. -J. Kim, K. Jang, S. Lee, and B. Kang, "Color image enhancement based on adaptive nonlinear curves of luminance features," Journal of Semiconductor Technology and Science, vol. 15, no. 1, pp. 60-67, Feb. 2015. DOI: 10.5573/JSTS.2015.15.1.060.
  15. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: from error visibility to structural similarity," IEEE Transactions on. Image Processing, vol. 13, no. 4, pp. 600-612, Apr. 2004. DOI: 10.1109/TIP.2003.819861.
  16. L. Zhang, L. Zhang, X. Mou, and D. Zhang, "FSIM: A feature similarity index for image quality assessment," IEEE Transactions on Image Processing, vol. 20, no. 8, pp. 2378-2386, Aug. 2011. DOI: 10.1109/TIP.2011.2109730.
  17. H. Yeganeh and W. Zhou, "Objective quality assessment of tone-mapped images," IEEE Transactions on Image Processing, vol. 22, no. 2, pp. 657-667, Feb. 2012. DOI: 10.1109/TIP.2012.2221725.
  18. C. Ancuti, C. O. Ancuti, R. Timofte, and C. D. Vleeschouwer, "I-HAZE: A dehazing benchmark with real hazy and haze-free indoor images," in Advanced Concepts for Intelligent Vision Systems, Poitiers, France, vol. 11182, pp. 620-631, 2018. DOI: 10.1007/978-3-030-01449-0_52.
  19. C. O. Ancuti, C. Ancuti, R. Timofte, and C. D. Vleeschouwer, "O-HAZE: A dehazing benchmark with real hazy and haze-free outdoor images," in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City: UT, USA, pp. 867-875, 2018. DOI: 10.1109/CVPRW.2018.00119.
  20. K. Ma, W. Liu, and Z. Wang, "Perceptual evaluation of single image dehazing algorithms," in 2015 IEEE International Conference on Image Processing (ICIP), Quebec City: QC, Canada, pp. 3600-3604, 2015. DOI: 10.1109/ICIP.2015.7351475.
  21. K. Jack, "Chapter 9: NTSC and PAL digital encoding and decoding," in Video Demystified, 4th ed. Elsevier India, pp. 394-471, 2004.