Browse > Article
http://dx.doi.org/10.7472/jksii.2019.20.6.55

CNN-based Shadow Detection Method using Height map in 3D Virtual City Model  

Yoon, Hee Jin (City & Transportation ICT Research Department Electronics and Telecommunication Research Institute)
Kim, Ju Wan (City & Transportation ICT Research Department Electronics and Telecommunication Research Institute)
Jang, In Sung (City & Transportation ICT Research Department Electronics and Telecommunication Research Institute)
Lee, Byung-Dai (Department of Computer Science, Kyonggi University)
Kim, Nam-Gi (Department of Computer Science, Kyonggi University)
Publication Information
Journal of Internet Computing and Services / v.20, no.6, 2019 , pp. 55-63 More about this Journal
Abstract
Recently, the use of real-world image data has been increasing to express realistic virtual environments in various application fields such as education, manufacturing, and construction. In particular, with increasing interest in digital twins like smart cities, realistic 3D urban models are being built using real-world images, such as aerial images. However, the captured aerial image includes shadows from the sun, and the 3D city model including the shadows has a problem of distorting and expressing information to the user. Many studies have been conducted to remove the shadow, but it is recognized as a challenging problem that is still difficult to solve. In this paper, we construct a virtual environment dataset including the height map of buildings using 3D spatial information provided by VWorld, and We propose a new shadow detection method using height map and deep learning. According to the experimental results, We can observed that the shadow detection error rate is reduced when using the height map.
Keywords
Shadow detection; Deep-learning;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Y. Vicente, F. Tomas, L. Hou, C.-P. Yu, M. Hoai, and D. Samaras. "Large-scale training of shadow detectors with noisily-annotated shadow examples." In European Conference on Computer Vision (ECCV), Springer, pp. 816-832, 2016. https://doi.org/10.1007/978-3-319-46466-4_49
2 J. Zhu, K. G. Samuel, S. Z. Masood, and M. F. Tappen. "Learning to recognize shadows in monochromatic natural images." In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 223-230, 2010. https://doi.org/10.1109/cvpr.2010.5540209
3 J. Wang, X. Li, and J. Yang. "Stacked conditional generative adversarial networks for jointly learning shadow detection and shadow removal." In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018. https://doi.org/10.1109/cvpr.2018.00192
4 Finlayson, G. D., Hordley, S. D., Drew, M. S. "Removing Shadows from Images." Proceedings of the 7th European Conference on Computer Vision, pp.823-836. 2002, https://doi.org/10.1007/3-540-47979-1_55
5 Murali, S., Govindan, V. K. "Shadow Detection and Removal from a Single Image Using LAB Color Space." Cybernetics and Information Technologies, vol. 13(1) pp. 95-103, 2013. https://doi.org/10.2478/cait-2013-0009   DOI
6 Roy S. Berns, "Principles of Color Technology" 3rd Edition, John Wiley & Sons, Inc., 2000 https://pdfs.semanticscholar.org/090f/87f92965a376fa311 f2bdf27e295953ac7b2.pdf
7 Gong, H., Cosker, D. P. "Interactive Shadow Removal and Ground Truth for Variable Scene Categories." Proceedings of the British Machine Vision Conference, 2014. http://dx.doi.org/10.5244 /C.28.36
8 Guo, R., Dai, Q., Hoiem, D. "Paired Regions for Shadow Detection and Removal." IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.35 (12), pp. 2956-2967, 2013. http://doi.org/10.1109/TPA MI.2012.214   DOI
9 X. Hu, L. Zhu, C.-W. Fu, J. Qin, and P.-A. Heng. "Direction aware spatial context features for shadow detection." In CVPR, pp.7454-7462. 2018. http://doi.org/10.1109/cvpr.2018.00778
10 L. Zhu, Z. Deng, X. Hu, C.-W. Fu, X. Xu, J. Qin, and P.-A. Heng. "Bidirectional feature pyramid network with recurrent attention residual modules for shadow detection." In ECCV, 2018. http://doi.org/10.1007/978-3-030-01231-1_8
11 TY Lee, TJ Kim, YJ Lim "Extraction of 3D Building Information using Shadow Analysis from Single High Resolution Satellite Images", Journal of the korean society for geospatial information science vol. 14, No. 2, pp.3-13. 2006. http://www.riss.kr/link?id=A99950696
12 KB Seo, KD Song, "Development Algorithms to Predict the Luminous Flux Transfer Rates of Vertical Rectangular Daylight Duct Systems with the Consideration of Direct Sunlight Incidence.", Journal The Korean Society of Living Environmental System, vol.3, no.3, pp.21-34, 1996 http://www.dbpia.co.kr/journal/articleDetail?nodeId=NO DE06546663&language=ko_KR
13 Bretagnon, P., "Theory for the motion of all the planets- The VSOP82 solution.", Astronomy and Astrophysics, vol.114, no.2,p.278-288, Oct.1982 http://adsabs.harvard.edu/full/1982A%26A...114..278B
14 Z. Wu, L. Su, and Q. Huang, "Cascaded partial decoder for fast and accurate salient object detection." arXiv preprint arXiv:1904.08739, 2019
15 J. Hu, L. Shen, and G. Sun. "Squeeze-and-excitation networks." arXiv preprint arXiv:1709.01507, 2017. https://doi.org/10.1109/CVPR.2018.00745
16 P. Isola, J.-Y. Zhu, T. Zhou, and A. A. Efros. "Image-to-image translation with conditional adversarial networks." In CVPR, 2017 https://doi.org/10.1109/cvpr.2017.632
17 VWorld, https://www.vworld.kr.
18 L. Qu, J. Tian, S. He, Y. Tang, and R. W. Lau. "Deshadownet: A multi-context embedding deep network for shadow removal." In CVPR. 2017. http://doi.org/10.1109/cvpr.2017.248