Journal of Digital Contents Society (디지털콘텐츠학회 논문지)

Digital Contents Society (한국디지털콘텐츠학회)
권호 표지
DOI QR코드

DOI QR Code

Development of the Location Mapping Content Services Platform

로케이션 매핑 영상 콘텐츠 서비스 플랫폼 개발

  • Lee, Seong-Ho (Embedded System Research Group, SW.Content Research Laboratory, ETRI) ;
  • Chang, Yoon-Seop (IOT Research Division, Hyper-connected Communication Research Laboratory, ETRI) ;
  • Ryu, Keun Ho (Database/Bioinformatics Lab., Chungbuk National University)
  • 이성호 (한국전자통신연구원 SW.콘텐츠연구소 SW기반기술연구본부 임베디드시스템연구그룹) ;
  • 장윤섭 (한국전자통신연구원 초연결통신연구소 IOT연구본부) ;
  • 류근호 (충북대학교 데이터베이스/바이오인포매틱스 연구실)
  • Received : 2018.07.18
  • Accepted : 2018.08.28
  • Published : 2018.08.31
⟨ Previous Next ⟩

Abstract

In recent years, In recent years, research on geo-tagged image contents has defined a view frustum based on filming location and direction data and has studied indexes and various query search techniques for efficient search. The existing view frustum model has a limit of using the static visible distance and provides a simple service that displays the huge image contents on the digital map. We show a method to acquire filming location and attitude data and propose a view frustum model that can change the visible distance using geospatial object data. In addition, we describe the augmented reality service that combines the image matching technique so that it can be mapped in the scene where the image contents are captured.

지난 수년간 지오태깅된 영상 콘텐츠에 대한 연구는 촬영위치와 방향 데이터를 기반으로 가시영역 모델(view frustum)을 정의 하였고, 효율적으로 검색하기 위한 색인 및 질의 검색기법을 연구해왔다. 기존 가시영역 모델이 정적인 가시거리 값을 사용하고 있는 한계를 가지고 있으며 영상 콘텐츠를 지도위에 표시하는 단편적인 서비스만을 제공하고 있다. 이 논문에서는 촬영위치자세 데이터를 획득할 수 있는 방법을 제시하고, 공간객체 데이터를 이용하여 가시거리가 변경될 수 있는 가시영역 모델을 제안한다. 또한, 영상 콘텐츠를 촬영한 현장에서 더욱 실감나게 매핑할 수 있도록 영상정합 기법을 접목한 증강현실 서비스를 설명한다.

Keywords

Acknowledgement

Supported by : 한국콘텐츠진흥원, 충북대 학술진흥재단

References

  1. 100M geotagged photos (plus). http://code.flickr.net/2009/02/04/100000000-geotagged-photos-plus/ .
  2. Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., and Jain, R., "Content-based image retrieval at the end of the early years," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, No. 12, pp. 1349-1380, 2000. https://doi.org/10.1109/34.895972
  3. H. Ma, S. A. Ay, R. Zimmermann, and S. H. Kim., "Large-scale geo-tagged video indexing and queries," GeoInformatica, Vol. 18, No. 4, pp. 671-697, October 2014. https://doi.org/10.1007/s10707-013-0199-6
  4. Toyama, K., Logan, R., Roseway, A., and Anandan, P., "Geographic location tags on digital images," in Proceeding of the 11th ACM International Conference on Multimedia, Berkeley:CA, pp.156-166, 2003.
  5. Lee, Y.H. and Rhee, S.B., “ Efficient Photo Image Retrieval System Based on Combination of Smart Sensing and Visual Descriptor,” Intelligent Automation & Soft Computing, Vol. 21, No. 1, pp. 39-50, May 2014. https://doi.org/10.1080/10798587.2014.914274
  6. Jaffe, A., Naaman, M., Tassa, T., and Davis, M., "Generating summaries and visualization for large collections of geo-referenced photographs," In Proceeding of the 8th ACM International Workshop on Multimedia Information Retrieval, Santa Barbara:CA, pp. 89-98, 2006.
  7. Yang, D.S. and Lee, Y.H., "Mobile Image Retrieval Using Integration of Geo-sensing and Visual Descriptor," In Proceeding of the 15th International Conference on Network-Based Information Systems, Melbourne, pp. 742-748, 2012.
  8. Arslan Ay, S., Zimmermann, R.b, and Kim, S.H., "Viewable scene modeling for geospatial video search," in Proceeding of the 16th ACM international conference on Multimedia, Vancouver, pp. 309-318, 2008.
  9. Cai, Y., Lu, Y., Kim, S.H., Nocera, L., and Shahabi, C., "Querying geo-tagged videos for vision applications using spatial metadata," Eurasip Journal on Image and Video Processing, Vol. 2017, No. 1, December 2017.
  10. Kim, S.H., Lu, Y., Constantinou, G., Shahabi, C., Wang, G., and Zimmermann, R., "MediaQ: Mobile multimedia management system," in Proceeding of the 5th ACM Multimedia Systems Conference, Singapore, pp. 224-235, 2014.
  11. Lee, D., Oh, J., Loh, W.-K., and Yu, H. "GeoVideoIndex: Indexing for georeferenced videos," Information Sciences, Vol. 374, pp. 210-223, December 2016.
  12. Kim, Y., Kim, J., and Yu, H., "GeoTree: Using spatial information for georeferenced video search," Knowledge-Based Systems, Vol. 61, pp. 1-12, May 2014. https://doi.org/10.1016/j.knosys.2014.01.026
  13. Lu, Y., Shahabi, C., Kim, and S.H., “Efficient indexing and retrieval of large-scale geo-tagged video databases,” GeoInformatica, Vol. 20, No. 4, pp. 829-857, October 2016. https://doi.org/10.1007/s10707-016-0250-5
  14. Alfarrarjeh, A., Shahabi, C., Kim, S.H., "Hybrid indexes for spatial-visual search", in Proceedings of the Thematic Workshops of ACM Multimedia 2017, co-located with MM 2017, Mountain View:CA, pp. 75-83, October 2017.
  15. Autopano Video, http://www.kolor.com/autopano-video/.