Browse > Article
http://dx.doi.org/10.9708/jksci.2021.26.01.019

A research on the possibility of restoring cultural assets of artificial intelligence through the application of artificial neural networks to roof tile(Wadang)  

Kim, JunO (Dept. of Multimedia, Dongguk University)
Lee, Byong-Kwon (Dept. of Multimedia, Seowon University)
Abstract
Cultural assets excavated in historical areas have their own characteristics based on the background of the times, and it can be seen that their patterns and characteristics change little by little according to the history and the flow of the spreading area. Cultural properties excavated in some areas represent the culture of the time and some maintain their intact appearance, but most of them are damaged/lost or divided into parts, and many experts are mobilized to research the composition and repair the damaged parts. The purpose of this research is to learn patterns and characteristics of the past through artificial intelligence neural networks for such restoration research, and to restore the lost parts of the excavated cultural assets based on Generative Adversarial Network(GAN)[1]. The research is a process in which the rest of the damaged/lost parts are restored based on some of the cultural assets excavated based on the GAN. To recover some parts of dammed of cultural asset, through training with the 2D image of a complete cultural asset. This research is focused on how much recovered not only damaged parts but also reproduce colors and materials. Finally, through adopted this trained neural network to real damaged cultural, confirmed area of recovered area and limitation.
Keywords
GAN; Machine learning; Cultural properties; Restoration; Auto-encoder;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Tero Karras, Samuli Laine, Miika Aittala, Janne Hellsten, Jaakko Lehtinen, Timo Aila, Analyzing and improving the image quality of stylegan, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 8110-8119, 2020
2 Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio, "Generative Adversarial Nets", Advances in Neural Information Processing Systems 27 (NIPS 2014)
3 Kang Woo-bang Shin Yong-cheol, Top, (Rediscovery of Korean Beauty 5), Sol, 2003
4 Jiahong Ouyang, Guanhua Wang, Enhao Gong, Kevin Chen, John Pauly and Greg Zaharchuk, Task-GAN for Improved GAN based Image Restoration, ICLR 2019 Conference Blind Submission, 2018
5 David Berthelot, Thomas Schumm, Luke Metz, BEGAN: Boundary Equilibrium Generative Adversarial Networks, Machine Learning (cs.LG); Machine Learning, 1703.10717, 2017
6 Tero Karras, Timo Aila, Samuli Laine, Jaakko Lehtinen, Progressive Growing of GANs for Improved Quality, Stability, and Variation, Neural and Evolutionary Computing (cs.NE); Machine Learning, 1710.10196, 2017
7 Jyostna Devi Bodapati, N. Veeranjaneyulu, "Feature Extraction and Classification Using Deep Convolutional Neural Networks", Journal of Cyber Security and Mobility, Vol: 8 Issue: 2, Article No: 5, Page: 261-276, April 2019   DOI
8 Encyclopedia of Korean Folk Culture (Wadang)
9 Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton, "ImageNet Classification with Deep Convolutional Neural Networks", Part of Advances in Neural Information Processing Systems 25 (NIPS 2012)
10 C Xing, L Ma, X Yang, "Stacked denoise autoencoder based feature extraction and classification for hyperspectral images", Journal of Sensors, 2016
11 Zhang, Wei "Shift-invariant pattern recognition neural network and its optical architecture". Proceedings of Annual Conference of the Japan Society of Applied Physics. (1988).
12 Pascal Vincent, Hugo Larochelle, Isabelle Lajoie, Yoshua Bengio, Pierre-Antoine Manzagol, Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion, The Journal of Machine Learning Research, 2010
13 MNIST handwritten digit database, Yann LeCun, Corinna Cortes and Chris Burges
14 Ruben Villegas, Jimei Yang, Seunghoon Hong, Xunyu Lin, Honglak Lee, "Decomposing Motion and Content for Natural Video Sequence Prediction", Computer Vision and Pattern Recognition, 2018
15 Tero Karras, Samuli Laine, Timo Aila, A Style-Based Generator Architecture for Generative Adversarial Networks, Neural and Evolutionary Computing, Machine Learning, 1812.04948, 2018
16 Yuzhen Lu, Food Image Recognition by Using Convolutional Neural Networks (CNNs), Computer Vision and Pattern Recognition (cs.CV), 1612.00983, 2016