Journal of information and communication convergence engineering

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

City-Scale Modeling for Street Navigation

  • Huang, Fay (Institute of Computer Science and Information Engineering, National Ilan University) ;
  • Klette, Reinhard (Department of Computer Science, The University of Auckland)
  • Received : 2012.09.18
  • Accepted : 2012.11.28
  • Published : 2012.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

This paper proposes a semi-automatic image-based approach for 3-dimensional (3D) modeling of buildings along streets. Image-based urban 3D modeling techniques are typically based on the use of aerial and ground-level images. The aerial image of the relevant area is extracted from publically available sources in Google Maps by stitching together different patches of the map. Panoramic images are common for ground-level recording because they have advantages for 3D modeling. A panoramic video recorder is used in the proposed approach for recording sequences of ground-level spherical panoramic images. The proposed approach has two advantages. First, detected camera trajectories are more accurate and stable (compared to methods using multi-view planar images only) due to the use of spherical panoramic images. Second, we extract the texture of a facade of a building from a single panoramic image. Thus, there is no need to deal with color blending problems that typically occur when using overlapping textures.

Keywords

Acknowledgement

Supported by : National Science Council

References

  1. F. Huang, R. Klette, and K. Scheibe, Panoramic Imaging: Sensor- Line Cameras and Laser Range-Finders, Chichester, UK: John Wiley & Sons, 2008.
  2. A. Gruen, "Automation in building reconstruction," in Photogrammetric Week 1997, Heidelberg, Germany: Wichmann Verlag, pp. 175-186, 1997.
  3. C. Brenner and N. Haala, "Fast production of virtual reality city models," in Proceedings of the IAPRS: ISPRS Commission IV Symposium on GIS - Between Visions and Applications, Stuttgart, Germany, pp. 77-84, 1998.
  4. H. G. Maas, "The suitability of airborne laser scanner data for automatic 3D object reconstruction," in Automatic Extraction of Man-Made Objects from Aerial and Space Images (III), Lisse, Netherlands: A. A. Balkema, pp. 291-296, 2001.
  5. C. Vestri and F. Devernay, "Using robust methods for automatic extraction of buildings," in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai: HI, pp. 133-138, 2001.
  6. C. Fruh and A. Zakhor, "3D model generation for cities using aerial photographs and ground level laser scans," in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai: HI, pp. 31-38, 2001.
  7. C. Fruh and A. Zakhor, "Constructing 3D city models by merging aerial and ground views," IEEE Computer Graphics and Applications, vol. 23, no. 6, pp. 52-61, 2003. https://doi.org/10.1109/MCG.2003.1242382
  8. C. Fruh and A. Zakhor, "An automated method for large-scale, ground-based city model acquisition," International Journal of Computer Vision, vol. 60, no. 1, pp. 5-24, 2004. https://doi.org/10.1023/B:VISI.0000027787.82851.b6
  9. J. Hu, S. You, and U. Neumann, "Automatic pose recovery for highquality textures generation," in Proceedings of the 18th International Conference on Pattern Recognition, Hong Kong, China, pp. 561-565, 2006.
  10. L. Liu, G. Yu, G. Wolberg, and S. Zokai, "Multiview geometry for texture mapping 2D images onto 3D range data," in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York: NY, pp. 2293-2300, 2006.
  11. I. Stamos and P. K. Allen, "Geometry and texture recovery of scenes of large scale," Computer Vision and Image Understanding, vol. 88, no. 2, pp. 94-118, 2002. https://doi.org/10.1006/cviu.2002.0963
  12. B. Micusik and J. Kosecka, "Piecewise planar city 3D modeling from street view panoramic sequences," in Proceeding of the IEEE Conference on Computer Vision and Pattern Recognition, Miami: FL, pp. 2906-2912, 2009.
  13. M. Pollefeys, D. Nister, J. M. Frahm, A. Akbarzadeh, P. Mordohai, B. Clipp, C. Engels, D. Gallup, S. J. Kim, P. Merrell, C. Salmi, S. Sinha, B. Talton, L. Wang, Q. Yang, H. Stewenius, R. Yang, G. Welch, and H. Towles, "Detailed real-time urban 3D reconstruction from video," International Journal of Computer Vision, vol. 78, no. 2-3, pp. 143-167, 2008. https://doi.org/10.1007/s11263-007-0086-4
  14. H. Y. Shum, M. Han, and R. Szeliski, "Interactive construction of 3D models from panoramic mosaics," in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Santa Barbara: CA, pp. 427-433, 1998.
  15. L. Wang, S. You, and U. Newmann, "Semiautomatic registration between ground-level panoramas and an orthorectified aerial image for building modeling," in Proceedings of the IEEE International Conference on Computer Vision, Rio de Janeiro, Brazil, pp. 1-8, 2007.
  16. S. B. Kang, R. Szeliski, and M. Uyttendaele, "Seamless stitching using multi-perspective plane sweep," Microsoft Research, Redmond, WA, Technical Report MSR-TR-2004-48, 2004.
  17. D. Lowe, Demo Software: SIFT keypoint detector [Internet], Available: http://www.cs.ubc.ca/-lowe/keypoints/.
  18. C. R. Wren, Perspective transform estimation [Internet], Available: http://alumni.media.mit.edu/-cwren/interpolator/.