Browse > Article
http://dx.doi.org/10.7474/TUS.2022.32.2.131

A Study for Generation of Artificial Lunar Topography Image Dataset Using a Deep Learning Based Style Transfer Technique  

Na, Jong-Ho (Department of Future & Smart Construction Research, Korea Institute of Civil Engineering and Building Technology)
Lee, Su-Deuk (Department of Future & Smart Construction Research, Korea Institute of Civil Engineering and Building Technology)
Shin, Hyu-Soung (Department of Future & Smart Construction Research, Korea Institute of Civil Engineering and Building Technology)
Publication Information
Tunnel and Underground Space / v.32, no.2, 2022 , pp. 131-143 More about this Journal
Abstract
The lunar exploration autonomous vehicle operates based on the lunar topography information obtained from real-time image characterization. For highly accurate topography characterization, a large number of training images with various background conditions are required. Since the real lunar topography images are difficult to obtain, it should be helpful to be able to generate mimic lunar image data artificially on the basis of the planetary analogs site images and real lunar images available. In this study, we aim to artificially create lunar topography images by using the location information-based style transfer algorithm known as Wavelet Correct Transform (WCT2). We conducted comparative experiments using lunar analog site images and real lunar topography images taken during China's and America's lunar-exploring projects (i.e., Chang'e and Apollo) to assess the efficacy of our suggested approach. The results show that the proposed techniques can create realistic images, which preserve the topography information of the analog site image while still showing the same condition as an image taken on lunar surface. The proposed algorithm also outperforms a conventional algorithm, Deep Photo Style Transfer (DPST) in terms of temporal and visual aspects. For future work, we intend to use the generated styled image data in combination with real image data for training lunar topography objects to be applied for topographic detection and segmentation. It is expected that this approach can significantly improve the performance of detection and segmentation models on real lunar topography images.
Keywords
Artificial lunar surface image generation; Data augmentation; Style transfer;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Yijun, L., Chen, F., Jimei, Y., Zhaowen, W., Xin, L. and Ming-Hsuan, Y., 2017, "Universal style transfer via feature transforms," In Proceedings of the Neural Information Proceeding Systems.
2 Williams, T. and Li, R., 2018, "Wavelet pooling for convolutional neural networks," In International Conference on Learning Representations.
3 Ju, G., 2016, "Development status of domestic & overseas space exploration & associated technology," Journal of the Korean Society for Aeronautical & Space Sciences, 44(8): 741-757.   DOI
4 Lee, K., Hong, S., Park, J. and Shin, H., 2019, "Deep-learning based automatic recognition and digitization of targeted objects/regions on analogue lunar surface", KSCE Conference of Civil and Environmental Engineering Research, pp. 1297-1298.
5 NASA, 2021, Apollo 11 Mission Overview, https://www.nasa.gov/mission_pages/apollo/missions/apollo11.html.
6 Stankovic, R.S. and Falkowski, B.J., 2003, "The Haar wavelet transform: its status and achievements," Computers & Electrical Engineering, 29(1):25-44.   DOI
7 Basilevsky, A.T., Abdrakhimov, A.M, Head, J.W., Pieters, C.M., Wu, Y. and Xiao, L., 2015, "Geologic characteristics of the Luna 17/Lunokhod 1 and Chang'E-3/Yutu landing sites, Northwest Mare Imbrium of the Moon". Planetary and Space Science, 117: 385-400.   DOI
8 Yoo, J., Uh, Y., Chun, S., Kang, B. and Ha, J.W., 2019, "Photorealistic style transfer via wavelet transforms." In Proceedings of the IEEE International Conference on Computer Vision , pp. 9036-9045.
9 Bengio, Y., 2009, "Learning deep architectures for AI," Now Publishers Inc.
10 Deng, J., Dong, W., Socher, R., Li, L. and FeiFei, L., 2009, "Imagenet: A large-scale hierarchical image database." In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 248-255.
11 Hong, S., Chung, T., Park, J. and Shin, H., 2019, "Research on development of construction spatial information technology, using rover's camera system," Journal of the Korea Academia-Industrial cooperation Society, 20(7): 630-637.   DOI
12 Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B. and Hochreiter, S., 2017, "Gans trained by a two time-scale update rule converge to a local nash equilibrium," In Proceedings of the NIPS, vol. 30.
13 Park, J., Hong, S., Choi, K., Kim, C. and Shin, H., 2020, "Experiment on calibration of multi-camera system mounted on rover for extreme region exploration." Journal of Korean Society for Geospatial Information Science, 28(2): 21-28.
14 Di, K., Liu, Z., Wan, W., Peng, M., Liu, B., Wang, Y., Gou, S. and Yue, Z., 2020, "Geospatial technologies for Chang'e-3 and Chang'e-4 lunar rover missions," Geo-spatial Information Science, 23(1): 87-97.   DOI
15 Gatys, L.A., Ecker, A.S., Bethge, M., 2016, " Image style transfer using convolutional neural networks," In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4990-4998.
16 Hong, S. and Shin, H., 2018, "Trend analysis of lunar exploration missions for lunar base construction," Journal of the Korea Academia-Industrial Cooperation Society, 19(7): 144-152.   DOI
17 Hong, S., Bangunharcana, A., Park, J.M., Choi, M. and Shin, H.S., 2021, "Visual SLAM-Based Robotic Mapping Method for Planetary Construction," Sensors, 21(22): 7715-7732.   DOI
18 Labelme, 2021, https://github.com/wkentaro/labelme.
19 Li, Y., Fang, C., Yang, J., Wang, Z., Lu, X. and Yang, M.H., 2017, "Universal style transfer viafeature transforms," In Proceedings of the NIPS, pp. 386-396.
20 Lee, H., Park, J., Hong, S. and Shin, H., 2020, "Low Light Image Enhancement to Construct Terrain Information from Permanently Shadowed Region on the Moon," Journal of Korean Society for Geospatial Information Science, 28(4): 41-48.
21 Luan, F., Paris, S., Shechtman, E. and Bala, K., 2017, "Deep photo style transfer," In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4990-4998.
22 Simonyan, K. and Zisserman, A., 2014, "Very deep convolutional networks for large-scale image recognition," arXiv preprint arXIV,:1409.1556.