Journal of Information Processing Systems

  • 제20권1호
  • /
  • Pages.53-66
  • /
  • 2024
  • /
  • 1976-913X(pISSN)
  • /
  • 2092-805X(eISSN)
한국정보처리학회 (Korea Information Processing Society)
권호 표지
DOI QR코드

DOI QR Code

Applications of a Deep Neural Network to Illustration Art Style Design of City Architectural

  • Yue Wang (School of Arts, Qingdao Agricultural University) ;
  • Jia-Wei Zhao (School of Arts, Qingdao Agricultural University) ;
  • Ming-Yue Zheng (School of Arts, Qingdao Agricultural University) ;
  • Ming-Yu Li (School of Law, Dalian Maritime University) ;
  • Xue Sun (The College of Ocean Science and Engineering, Shandong University of Science and Technology) ;
  • Hao Liu (The College of Ocean Science and Engineering, Shandong University of Science and Technology) ;
  • Zhen Liu (The College of Ocean Science and Engineering, Shandong University of Science and Technology)
  • 투고 : 2023.02.03
  • 심사 : 2023.04.25
  • 발행 : 2024.02.29
PDF 다운로드
⟨ 이전 논문 다음 논문 ⟩

초록

With the continuous advancement of computer technology, deep learning models have emerged as innovative tools in shaping various aspects of architectural design. Recognizing the distinctive perspective of children, which differs significantly from that of adults, this paper contends that conventional standards may not always be the most suitable approach in designing urban structures tailored for children. The primary objective of this study is to leverage neural style networks within the design process, specifically adopting the artistic viewpoint found in children's illustrations. By combining the aesthetic paradigm of urban architecture with inspiration drawn from children's aesthetic preferences, the aim is to unearth more creative and subversive aesthetics that challenge traditional norms. The selected context for exploration is the landmark buildings in Qingdao City, Shandong Province, China. Employing the neural style network, the study uses architectural elements of the chosen buildings as content images while preserving their inherent characteristics. The process involves artistic stylization inspired by classic children's illustrations and images from children's picture books. Acting as a conduit for deep learning technology, the research delves into the prospect of seamlessly integrating architectural design styles with the imaginative world of children's illustrations. The outcomes aim to provide fresh perspectives and effective support for the artistic design of contemporary urban buildings.

키워드

과제정보

This work was supported by the Qingdao Social Science Planning Project (Grant No. QDSKL2201279).

참고문헌

  1. L. A. Gatys, A. S. Ecker, and M. Bethge, "A neural algorithm of artistic style," 2015 [Online]. Available: https://arxiv.org/abs/1508.06576.
  2. X. Xu, J. Chang, and S. Ding, "Image style transfering based on StarGAN and class encoder," International Journal of Software & Informatics, vol. 12, no. 2, pp. 245-258, 2022. http://dx.doi.org/10.21655/ijsi.1673-7288.00267
  3. J. S. Ubhi and A. K. Aggarwal, "Neural style transfer for image within images and conditional GANs for destylization," Journal of Visual Communication and Image Representation, vol. 85, article no. 103483, 2022. https://doi.org/10.1016/j.jvcir.2022.103483
  4. R. Dinesh Kumar, E. Golden Julie, Y. Harold Robinson, S. Vimal, G. Dhiman, and M. Veerasamy, "Deep convolutional nets learning classification for artistic style transfer," Scientific Programming, vol. 2022, article no. 2038740, 2022. https://doi.org/10.1155/2022/2038740
  5. D. Kang and S. Seo, "Mosaic stylization using Andamento," Human-centric Computing and Information Sciences, vol. 12, article no. 9, 2022. https://doi.org/10.22967/HCIS.2022.12.009
  6. J. Lee and K. I. Hwang, "RAVIP: real-time AI vision platform for heterogeneous multi-channel video stream," Journal of Information Processing Systems, vol. 17, no. 2, pp. 227-241, 2021. http://doi.org/10.3745/JIPS.02.0154
  7. L. A. Gatys, A. S. Ecker, and M. Bethge, "Image style transfer using convolutional neural networks," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 2016, pp. 2414-2423. https://doi.org/10.1109/CVPR.2016.265
  8. Y. Li, N. Wang, J. Liu, and X. Hou, "Demystifying neural style transfer," 2017 [Online]. Available: https://arxiv.org/abs/1701.01036.
  9. E. Risser, P. Wilmot, and C. Barnes, "Stable and controllable neural texture synthesis and style transfer using histogram losses," 2017 [Online]. Available: https://arxiv.org/abs/1701.08893.
  10. S. Li, X. Xu, L. Nie, and T. S. Chua, "Laplacian-steered neural style transfer," in Proceedings of the 25th ACM International Conference on Multimedia, Mountain View, CA, USA, 2017, pp. 1716-1724. https://doi.org/10.1145/3123266.3123425
  11. C. Li and M. Wand, "Combining Markov random fields and convolutional neural networks for image synthesis," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 2016, pp. 2479-2486. https://doi.org/10.1109/CVPR.2016.272
  12. D. Ulyanov, V. Lebedev, A. Vedaldi, and V. Lempitsky, "Texture networks: feed-forward synthesis of textures and stylized images," in Proceedings of the 33nd International Conference on Machine Learning (ICML), New York City, NY, USA, 2016, pp. 1349-1357.
  13. D. Ulyanov, A. Vedaldi, and V. Lempitsky, "Improved texture networks: maximizing quality and diversity in feed-forward stylization and texture synthesis," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 2017, pp. 4105-4113. https://doi.org/10.1109/CVPR.2017.437
  14. J. Johnson, A. Alahi, and L. Fei-Fei, "Perceptual losses for real-time style transfer and super-resolution," in Computer Vision-ECCV 2016. Cham, Switzerland: Springer, 2016, pp. 694-711. https://doi.org/10.1007/978-3-319-46475-6_43
  15. M. Mirza and S. Osindero, "Conditional generative adversarial nets," 2015 [Online]. Available: https://arxiv.org/abs/1411.1784.
  16. Y. Choi, M. Choi, M. Kim, J. W. Ha, S. Kim, and J. Choo, "StarGAN: unified generative adversarial networks for multi-domain image-to-image translation," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 2018, pp. 8789-8797. https://doi.org/10.1109/cvpr.2018.00916
  17. E. Reinhard, M. Adhikhmin, B. Gooch, and P. Shirley, "Color transfer between images," IEEE Computer Graphics and Applications, vol. 21, no. 5, pp. 34-41, 2001. https://doi.org/10.1109/38.946629
  18. A. Souri and R. Hosseini, "A state-of-the-art survey of malware detection approaches using data mining techniques," Human-centric Computing and Information Sciences, vol. 8, article no. 3, 2018. https://doi.org/10.1186/s13673-018-0125-x
  19. M. D. Campo, S. Manninger, and A. Carlson, "Hallucinating cities: a posthuman design method based on neural networks," in Proceedings of the 11th Annual Symposium on Simulation for Architecture and Urban Design, Virtual Event, Austria, 2020, pp. 1-8.
  20. K. H. Liu, T. J. Liu, C. C. Wang, H. H. Liu, and S. C. Pei, "Modern architecture style transfer for ruin or old buildings," in Proceedings of 2019 IEEE International Symposium on Circuits and Systems (ISCAS), Sapporo, Japan, 2019, pp. 1-5. https://doi.org/10.1109/ISCAS.2019.8702121
  21. J. Kang and J. H. Park, "Integration of cloud and big data analytics for future smart cities," Journal of Information Processing Systems, vol. 15, no. 6, pp. 1259-1264, 2019. https://doi.org/10.3745/JIPS.04.0145
  22. G. Ozel and B. Ennemoser, "Interdisciplinary AI: a machine learning system for streamlining external aesthetic and cultural influences in architecture," in Proceedings of the 39th Annual Conference of the Association for Computer Aided Design in Architecture (ACADIA), Austin, TX, USA, 2019, pp. 381-391. https://doi.org/10.52842/conf.acadia.2019.380
  23. D. H. Cho and S. L. Lee, "Object feature extraction and matching for effective multiple vehicles tracking," KIPS Transactions on Software and Data Engineering, vol. 2, no. 11, pp. 789-794, 2013. https://doi.org/10.3745/ktsde.2013.2.11.789
  24. C. Ren, D. K. Kim, and D. Jeong, "A survey of deep learning in agriculture: techniques and their applications," Journal of Information Processing Systems, vol. 16, no. 5, pp. 1015-1033, 2020. https://doi.org/10.3745/JIPS.04.0187
  25. Y. Xu, Y. Li, and B. S. Shin, "Medical image processing with contextual style transfer," Human-centric Computing and Information Sciences, vol. 10, article no. 46, 2020. https://doi.org/10.1186/s13673-020-00251-9
  26. E. Haeckel, Art Forms in Nature. Mineola, NY: Dover Publications, 2012.