Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지
DOI QR코드

DOI QR Code

Low-Light Invariant Video Enhancement Scheme Using Zero Reference Deep Curve Estimation

Zero Deep Curve 추정방식을 이용한 저조도에 강인한 비디오 개선 방법

  • Choi, Hyeong-Seok (Department of Information and Telecommication Eng. The University of Suwon) ;
  • Yang, Yoon Gi (Department of Information and Telecommication Eng. The University of Suwon)
  • Received : 2022.08.12
  • Accepted : 2022.08.23
  • Published : 2022.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, object recognition using image/video signals is rapidly spreading on autonomous driving and mobile phones. However, the actual input image/video signals are easily exposed to a poor illuminance environment. A recent researches for improving illumination enable to estimate and compensate the illumination parameters. In this study, we propose VE-DCE (video enhancement zero-reference deep curve estimation) to improve the illumination of low-light images. The proposed VE-DCE uses unsupervised learning-based zero-reference deep curve, which is one of the latest among learning based estimation techniques. Experimental results show that the proposed method can achieve the quality of low-light video as well as images compared to the previous method. In addition, it can reduce the computational complexity with respect to the existing method.

Keywords

References

  1. C. Li, C. Guo, and C.C. Loy, "Learning to Enhance Low-Light Image Via Zero-Reference Deep Curve Estimation," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 44, No. 8, pp. 4225-4238, 2022.
  2. J.-G. Oh and M.-C. Hong, "Low- Light Image Enhancement Method Using Decomposition-Based Deep-Learning," Journal of IKEE (Institute of Korean Electrical and Electronics Engineers), Vol. 25, No. 1, pp. 139-147, 2021.
  3. H. Lee, K. Sohn, and D. Min, "Unsupervised Learning with Natural Low-light Image Enhancement," Journal of Korea Multimedia Society, Vol. 23, No. 2, pp. 135-145, 2020. https://doi.org/10.9717/KMMS.2020.23.2.135
  4. C. Li, et. al., "Low-Light Image and Video Enhancement Using Deep Learning: A Survey," IEEE Transactions on Pattern Analysis and Machine Intelligence, Early Access, DOI:10.1109/TPAMI.2021.3126387.
  5. S. Park, K. Kim, S. Yu, and J. Paik, "Contrast Enhancement for Low-Light Image Enhancement: A Survey," IEIE Transactions on Smart Processing and Computing, Vol. 7, No. 1, pp. 36-48, February 2018. https://doi.org/10.5573/IEIESPC.2018.7.1.036
  6. W. Wang, X. Wu, X. Yuan, and Z. Gao, "An Experiment-Based Review of Low-Light Image Enhancement Method," IEEE Access, Vol. 8, pp. 87884-87917, 2020. https://doi.org/10.1109/ACCESS.2020.2992749
  7. E.H. Land and J.J. McCann, "Lightness and Retinex Theory," Journal of Optics Society of America, Vol. 61, No. 1, pp. 1-11, 1971. https://doi.org/10.1364/JOSA.61.000001
  8. D.J. Jobson, Z. Rahman and G.A. Woodell, "Properties and Performance of a Center/Surround Retinex," IEEE Transactions on Image Processing, Vol. 6, No. 3, pp. 451-461, 1997. https://doi.org/10.1109/83.557356
  9. D.J. Jobson, Z. Rahman and G.A. Woodell, "A Multi-Scale Retinex for Bridging the Gap Between Color Images and the Human Observation of Scenes," IEEE Transactions on Image Processing, Vol. 6, No. 7, pp. 965-976, 1997. https://doi.org/10.1109/83.597272
  10. F. Yu et al., "BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learning," arXiv Preprint, arXiv:1805.04687, 2018.
  11. K. Gu, W. Lin, G. Zhai, X. Yang, W. Zhang, and C.W. Chen, "No-Reference Quality Metric of Contrast Distorted Images Based on Information Maximization," IEEE Transactions on Cybernetics, Vol. 37, No. 12, pp. 4559-4565, 2017.
  12. A. Mittal, R. Soundararajan, and A.C. Bovik, "Making a Completely Blind Image Quality Analyzer," IEEE Signal Processing Letters, Vol. 22, No. 3, pp. 209-212, 2013.
  13. M.-K. Kim, "Traffic Light Recognition Based on the Glow Effect at Night Image," Journal of Korea Multimedia Society, Vol. 20, No. 12, pp. 1901-1912, 2017. https://doi.org/10.9717/KMMS.2017.20.12.1901
  14. T.H. Hwang and J.H. Kim, "A Weight Map Based on the Local Brightness Method for Aaptive Usharp Msking," Journal of Korea Multimedia Society, Vol. 21, No 8, pp. 821-828, 2018. https://doi.org/10.9717/KMMS.2018.21.8.821