Journal of the Institute of Electronics Engineers of Korea SP (대한전자공학회논문지SP)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

3D image mosaicking technique using multiple planes for urban visualization

복수 투영면을 사용한 도심지 가시화용 3 차원 모자이크 기술

  • Published : 2005.05.01
Download PDF
⟨ Previous Next ⟩

Abstract

A novel image mosaicking technique suitable for 3D urban visualization is proposed. It is not effective to apply 2D image mosaicking techniques for urban visualization when, for example, one is filming a sequence of images from a side-looking video camera along a road in an urban area. The proposed method presents the roadside scene captured by a side-looking video camera as a continuous set of textured planar faces, which are termed 'multiple planes' in this paper. The exterior parameters of each frame are first calculated through automatically selected matching feature points. The matching feature points are also used to estimate a plane approximation of the scene geometry for each frame. These planes are concatenated to create an approximate model on which images are back-projected as textures. Here, we demonstrate algorithm that creates efficient image mosaics in 3D space from a sequence of real images.

도심지 풍경을 3 차원 가시화 하는데 적합한 새로운 모자이크 방법을 제안하였다. 도심지에서 도로를 따라 촬영한 일련의 영상들을 2 차원 모자이크하면 입체감이 느껴지지 않는다. 제안한 방법은 도심지의 도로를 따라 나타나는 물체들을 연속 촬영하여, 이 영상들을 대표하는 복수의 투영평면들을 구한 후, 도로를 따라 촬영한 영상들을 이 복수의 평면들에 투영함으로써 입체감을 얻게 하는 것이다. 이를 위해서 연속 촬영한 영상들 간의 특징 점들을 정합함으로써 3 차원으로 표현된 복수의 투영면을 우선 얻는다. 이 복수의 평면들은 인접 평면 간에 상호 연결하여 물체들의 개략적 윤곽 면을 구성하는데, 이 복수 평면에 2 차원 영상들을 투영함으로써 영상에 대한 입체감을 부여하는 기술이다. 이 논문에서 실제 도심지 영상을 3 차원 가시화 시키는 알고리즘에 대한 데모를 보였다.

Keywords

References

  1. Web addresses for visualization projects in cities, http://www.casa.ucl.ac.uk
  2. Zhao, H. and R. Shibasaki, 'A vehicle-borne urban 3D acquisition system using single-row laser range scanners,' IEEE Transaction onSMC Part B: Cybernetics, vol.33, no. 4, 2003 https://doi.org/10.1109/TSMCB.2003.814280
  3. Fruh, C. and A.Zakhor, 'Data processing algorithms for generating textured 3D building faade meshes from laser scans and camera images', Proc. 3D Data Processing, Visualization and Transmission 2002, Padua, Italy, 2003
  4. Pollefeys, M., R. Koch, M. Vergauwen, L. Van Gool, 'Automated reconstruction of 3D scenes from sequences of images',ISPRS Journal Of Photogrammetry And Remote Sensing (55) 4, pp. 251-267, 2000 https://doi.org/10.1016/S0924-2716(00)00023-X
  5. Sato, T., M.kanbara and N. yokoya, 'Dense 3D reconstruction of an outdoor scene by hundreds-baseline stereo using a hand-held video camera', In IJCV,47(1/2/3), pp. 119-129, 2002 https://doi.org/10.1023/A:1014537706773
  6. USGS Hurricane mitch program projects, http://mitchnts1.cr.usgs.gov/projects/ aerial.html
  7. Szeliski,R., 'Video mosaic for virtual environment', Comput. Graph. Applicat., pp. 22-30, 1996 https://doi.org/10.1109/38.486677
  8. Chou, J.S., J.Qian, Z.Wu, H.Schramm, 'Automatic mosaic and display from a sequence of peripheral angiographic images', Proc. SPIE, vol. 3034, pp. 1077-1087, Medical Imaging,1997 https://doi.org/10.1117/12.274088
  9. Standard MPEG4, Information technology-coding of audio-visual objects, ver. 1. ISO/IEC 14 496, 1999
  10. Shum, H.-Y.,R. Szeliski, 'Systems and experiment paper construction of panoramic image mosaics with global and local alignment', In IJCV, 36(2), pp. 101-130, 2000 https://doi.org/10.1023/A:1008195814169
  11. S. Coorg, S. Teller, 'Spherical mosaics with quaternions and dense correlation' In IJCV, vol. 37, No. 3, pp. 259-273, June 2000 https://doi.org/10.1023/A:1008184124789
  12. Zhu, Z., Hanson, A.R. and Riseman, E.M., 'Generalized parallel-perspective stereo mosaics from airborne video', IEEE Transactions on PAMI, 26(2), pp. 226-237, 2004 https://doi.org/10.1109/TPAMI.2004.1262190
  13. Assaf Zomet, Doron Feldman, Shmuel Peleg, and Daphna Weinshall, 'Mosaicing new views: the crossed-slits projection', IEEE Transactions on PAMI, 25(6), 2003 https://doi.org/10.1109/TPAMI.2003.1201823
  14. Smith, S.M., J.M. Brady, 1997. SUSAN - a new approach to low level image processing. International Journal of Computer Vision, 23(1), pp. 45-78, 1997 https://doi.org/10.1023/A:1007963824710
  15. Han, J. H, Park, J. S., 'Contour matching using epipolar geometry', IEEE Transactions on PAMI, 22(4), 2000 https://doi.org/10.1109/34.845378
  16. Zheng, Z. and Wang, X, 'A general solution of a closed-form space resection',PE&RS, 58(3), pp.327-338, 1992
  17. Edward M. Mikhail, James S. Bethel and J. Chris McGlone, 'Introduction to modern photogrammetry', John wiley & sons, Inc., pp. 80-151, 2001