Browse > Article
http://dx.doi.org/10.15701/kcgs.2022.28.3.45

Non-Homogeneous Haze Synthesis for Hazy Image Depth Estimation Using Deep Learning  

Choi, Yeongcheol (POSCO ICT)
Paik, Jeehyun (POSCO ICT)
Ju, Gwangjin (POSTECH)
Lee, Donggun (POSTECH)
Hwang, Gyeongha (Yeungnam University)
Lee, Seungyong (POSTECH)
Publication Information
Journal of the Korea Computer Graphics Society / v.28, no.3, 2022 , pp. 45-54 More about this Journal
Abstract
Image depth estimation is a technology that is the basis of various image analysis. As analysis methods using deep learning models emerge, studies using deep learning in image depth estimation are being actively conducted. Currently, most deep learning-based depth estimation models are being trained with clean and ideal images. However, due to the lack of data on adverse conditions such as haze or fog, the depth estimation may not work well in such an environment. It is hard to sufficiently secure an image in these environments, and in particular, obtaining non-homogeneous haze data is a very difficult problem. In order to solve this problem, in this study, we propose a method of synthesizing non-homogeneous haze images and a learning method for a monocular depth estimation deep learning model using this method. Considering that haze mainly occurs outdoors, datasets mainly containing outdoor images are constructed. Experiment results show that the model with the proposed method is good at estimating depth in both synthesized and real haze data.
Keywords
depth estimation; non-homogeneous haze; haze synthesis; deep learning;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 Liu, Chunxiao, et al., "Non-homogeneous haze data synthesis based real-world image dehazing with enhancement-and-restoration fused CNNs," Computers & Graphics, 2022.
2 Geiger, Andreas, et al., "Vision meets robotics: The kitti dataset," The International Journal of Robotics Research, 32.11, 1231-1237, 2013.   DOI
3 Ancuti, C., Ancuti, C.O., De Vleeschouwer, C., "D-hazy: A dataset to evaluate quantitatively dehazing algorithms," In: 2016 IEEE international conference on image processing (ICIP), pp. 2226-2230, 2016.
4 Li, B., et al., "Benchmarking single-image dehazing and beyond," IEEE Transactions on Image Processing, 28(1), pp. 492-505, 2018.   DOI
5 He, K., Sun, J., Tang, X., "Single image haze removal using dark channel prior," IEEE transactions on pattern analysis and machine intelligence, 33(12), pp. 2341-2353, 2010.   DOI
6 Ancuti, Codruta O., et al., "O-haze: a dehazing benchmark with real hazy and haze-free outdoor images," Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 2018.
7 Saxena, Ashutosh, Sung Chung, and Andrew Ng., "Learning depth from single monocular images," Advances in neural information processing systems, 18, 2005.
8 Saxena, Ashutosh, Min Sun, and Andrew Y. Ng., "Make3d: Learning 3d scene structure from a single still image," IEEE transactions on pattern analysis and machine intelligence, 31.5, 824-840, 2008.   DOI
9 FATTAL, R., "Single image dehazing," ACM Transactions on Graphics, vol. 27., 2008.
10 Tankovich, V., et al., "Hitnet: Hierarchical iterative tile refinement network for real-time stereo matching," In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 14362-14372, 2021.
11 Shamsafar, F., et al., "MobileStereoNet: Towards Lightweight Deep Networks for Stereo Matching," In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 2417-2426, 2022.
12 Khamis, S., et al., "Stereonet: Guided hierarchical refinement for real-time edge-aware depth prediction," In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 573-590, 2018.
13 Song, M., Lim, S., Kim, W., "Monocular Depth Estimation Using Laplacian Pyramid-Based Depth Residuals," IEEE Transactions on Circuits and Systems for Video Technology, 2021.
14 PNVR, K., Zhou, H., Jacobs, D., "Sharingan: Combining synthetic and real data for unsupervised geometry estimation," In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 13974-13983, 2020.
15 Ranftl, R., Bochkovskiy, A., Koltun, V., "Vision transformers for dense prediction," In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 12179-12188, 2021.
16 Ancuti, Codruta O., Cosmin Ancuti, and Radu Timofte., "NH-HAZE: An image dehazing benchmark with non-homogeneous hazy and haze-free images," Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, 2020.
17 Narasimhan, S.G., Nayar, S.K., "Chromatic framework for vision in bad weather," In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2000 (Cat. No. PR00662), pp. 598-605, 2000.
18 Lee, Jonghyeop, et al., "Slow Sync Image Synthesis from Short Exposure Flash Smartphone Images," Journal of the Korea Computer Graphics Society, 27.3, 1-11, 2021.
19 Yin, W., et al., "Learning to recover 3d scene shape from a single image," In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 204-213, 2021.
20 Lee, Jonghyeop, et al., "SINGLE PANORAMA DEPTH ESTIMATION USING DOMAIN ADAPTATION," Journal of the Korea Computer Graphics Society, 26.3, 61-68, 2020.   DOI
21 Narasimhan, S.G., Nayar, S.K., "Vision and the atmosphere," International journal of computer vision, 48(3), pp. 233-254, 2002.   DOI
22 Li, Boyi, et al., "Benchmarking single-image dehazing and beyond," IEEE Transactions on Image Processing, 28.1, 492-505, 2018.   DOI
23 Miangoleh, S.M.H., et al., "Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive MultiResolution Merging," In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 9685-9694, 2021.
24 Godard, C., et al., "Digging into self-supervised monocular depth estimation," In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 3828-3838, 2019.