• Title/Summary/Keyword: Multiview image

Search Result 71, Processing Time 0.047 seconds

Normalized Cross Correlation-based Multiview background Subtraction for 3D Object Reconstruction (3차원 객체 복원을 위한 정규 상관도 기반 다중 시점 배경 차분 기법)

  • Paeng, Kyunghyun;Hwang, Sung Soo;Kim, Hee-Dong;Kim, Sujung;Yoo, Jisung;Kim, Seong Dae
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.6
    • /
    • pp.228-237
    • /
    • 2013
  • In this paper, we propose a normalized cross correlation(NCC)-based multiview background subtraction method which is robust when an object and background have similar color. When the background of the capturing environment is not artificially composed, the regions in the background images which would be occluded by an object tends to have difference colors. The colors of those regions, however, becomes similar when an object enters the capturing environment. Based on this assumption, this paper proposes a concept of GoNCC(Graph of Normalized Cross Correlation). GoNCC is the distribution of NCC between a pixel in an image and pixels related by epipolar constraints with the pixel. The proposed multiview background subtraction method is performed by comparing GoNCC of the current images with the background images. To reduce computational complexity, we perform multiview background subtraction only to the pixels undetermined by single view background subtraction. Experimental results show that the proposed method is more robust to color similarity between an object and background than a single-view background subtraction method and a previous multiview background subtraction method.

A New Camera System Implementation for Realistic Media-based Contents (실감미디어 기반의 콘텐츠를 위한 카메라 시스템의 구현)

  • Seo, Young Ho;Lee, Yoon Hyuk;Koo, Ja Myung;Kim, Woo Youl;Kim, Bo Ra;Kim, Moon Seok;Kim, Dong Wook
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.9 no.2
    • /
    • pp.99-109
    • /
    • 2013
  • In this paper, we propose a new system which captures real depth and color information from natural scene and implemented it. Based on it, we produced stereo and multiview images for 3-dimensional stereoscopic contents and introduced the production of a digital hologram which is considered to the next-generation image. The system consists of both a camera system for capturing images which correspond to RGB and depth images and softwares (SWs) for various image processings which consist of pre-processing such as rectification and calibration, 3D warping, and computer generated hologram (CGH). The camera system use a vertical rig with two paris of depth and RGB camera and a specially manufactured cold mirror which has the different transmittance according to wavelength for obtaining images with the same view point. The wavelength of our mirror is about 850nm. Each algorithm was implemented using C and C++ and the implemented system can be operated in real-time.

Stereoscopic Sequence Coding Using MPEG-2 MVP (MPEG-2 UP를 이용한 스테레오 동영상부호화)

  • Bae, Tae-Min;Park, Jin-U;Lee, Ho-Geun;Ha, Yeong-Ho
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.38 no.4
    • /
    • pp.353-361
    • /
    • 2001
  • A new stereoscopic codec. structure using MPEG-2 multiview profile is presented in this paper. In the suggested codec., the left image is coded with motion estimation in the base layer and the right image is coded with disparity estimation in the enhancement layer. Since it is possible to calculate rough motion of the right image sequence with disparity and motion of the left image sequence, motion compensation of the enhancement layer is performed without motion estimation. To apply this mathod to MVP codec., the prediction mode of base layer and enhancement layer is restricted, and B picture mode in the base layer is removed. Since the proposed codec. does not perform motion estimation in the enhancement layer encoding and prediction mode of base layer is restricted, it's structure is simple and reduces the encoding time. We compared the SNR of encoded image with three different structured codec., and the experimental results show suggested codec. have comparable result.

  • PDF

A Study on Improving the Quality of DIBR Intermediate Images Using Meshes (메쉬를 활용한 DIBR 기반 중간 영상 화질 향상 방법 연구)

  • Kim, Jiseong;Kim, Minyoung;Cho, Yongjoo
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2014.10a
    • /
    • pp.822-823
    • /
    • 2014
  • The usual method of generating an image for a multiview display system requires acquiring a color image and depth information of a reference camera. Then, intermediate images, generated using DIBR method, will be captured at a number of different viewpoints and composed to construct an multiview image. When such intermediate views are generated, several holes would be shown because some hidden parts are shown when the screenshot is taken at different angle. Previous research tried to solve this problem by creating a new hole-filling algorithm or enhancing the depth information. This paper describes a new method of enhancing the intermediate view images by applying the Ball Pivoting algorithm, which constructs meshes from a point cloud. When the new method is applied to the Microsoft's "Ballet" and "Break Dancer" data sets, PSNR comparison shows that about 0.18~1.19 increasement. This paper will explaing the new algorithm and the experiment method and results.

  • PDF

High-qualtiy 3-D Video Generation using Scale Space (계위 공간을 이용한 고품질 3차원 비디오 생성 방법 -다단계 계위공간 개념을 이용해 깊이맵의 경계영역을 정제하는 고화질 복합형 카메라 시스템과 고품질 3차원 스캐너를 결합하여 고품질 깊이맵을 생성하는 방법-)

  • Lee, Eun-Kyung;Jung, Young-Ki;Ho, Yo-Sung
    • 한국HCI학회:학술대회논문집
    • /
    • 2009.02a
    • /
    • pp.620-624
    • /
    • 2009
  • In this paper, we present a new camera system combining a high-quality 3-D scanner and hybrid camera system to generate a multiview video-plus-depth. In order to get the 3-D video using the hybrid camera system and 3-D scanner, we first obtain depth information for background region from the 3-D scanner. Then, we get the depth map for foreground area from the hybrid camera system. Initial depths of each view image are estimated by performing 3-D warping with the depth information. Thereafter, multiview depth estimation using the initial depths is carried out to get each view initial disparity map. We correct the initial disparity map using a belief propagation algorithm so that we can generate the high-quality multiview disparity map. Finally, we refine depths of the foreground boundary using extracted edge information. Experimental results show that the proposed depth maps generation method produces a 3-D video with more accurate multiview depths and supports more natural 3-D views than the previous works.

  • PDF

Stereoscopic Sequence Coding Using MPEG-2 MVP (MPEG-2 MVP를 이용한 스테레오 동영상부호화)

  • 배태면;권동현한규필하영호
    • Proceedings of the IEEK Conference
    • /
    • 1998.10a
    • /
    • pp.143-146
    • /
    • 1998
  • A new stereoscopic codec. structure using MPEG-2 multiview profile is presented in this paper. In the suggested codec., the left image is coded with motion estimation in the base layerand the right image is coded with disparity estimation in the enhancement layer. Since it is possible to calculate rough motion of the right image sequence with disparity and motion of the left image sequence, motion compensation of the enhancement layer is performed without motion estimation. Since the proposed codec. does not perform motion estimation in the enhancement layer encoding, it is simple and reduces the encoding time. We compared the PSNR of encoded image with three different structured codec., and the experimental results show that suggested codec. has comparable with other codecs.

  • PDF

Study on the Methods of Enhancing the Quality of DIBR-based Multiview Intermediate Images using Depth Expansion and Mesh Construction (깊이 정보 확장과 메쉬 구성을 이용한 DIBR 기반 다시점 중간 영상 화질 향상 방법에 관한 연구)

  • Park, Kyoung Shin;Kim, Jiseong;Cho, Yongjoo
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.19 no.1
    • /
    • pp.127-135
    • /
    • 2015
  • In this research, we conducted an experiment on evaluating the extending depth information method and surface reconstruction method and the interaction of these two methods in order to enhance the final intermediate view images, which are acquired using DIBR (Depth-Image-Based Rendering) method. We evaluated the experimental control groups using the Microsoft's "Ballet" and "Break Dancer" data sets with three different hole-filling algorithms. The result revealed that the quality was improved the most by applying both extending depth information and surface reconstruction method as compared to the previous point clouds only. In addition, it found that the quality of the intermediate images was improved vastly by only applying extending depth information when using no hole-filling algorithm.

Multi-view video coding using efficient disparity vector prediction (다시점 동영상에서의 효율적인 변이 벡터 압축 기법)

  • Kim, Yong-Tae;Sohn, Kwang-Hoon
    • Journal of Broadcast Engineering
    • /
    • v.10 no.4 s.29
    • /
    • pp.621-631
    • /
    • 2005
  • To enhance the performance of multi-view sequence CODEC, an efficient disparity vector coding method fur multiview sequences is proposed herein. For higher coding efficiency, we encode the differential vectors acquired by subtracting the original vectors from the predicted ones. To enhance the performance of disparity vector coding, it is essential to predict the disparity vectors accurately. The prediction by this proposed method utilizes the correlation among the multiview images, while conventional methods exploit the correlation among the causal blocks. Experiments were performed fur three different 5 view sequences. We were able to confirm that the proposed method predicts disparity vectors accurately by comparing the entropy and the mean absolute values for differential vectors with conventional methods. Its performance is superior to vector coding methods used in MPEG-4 which uses only a spatial correlation. The proposed method increases the coding efficiency by a factor of $30{\~}45\%$ while preserving image quality.

Autostereoscopic Multiview 3D Display System based on Volume Hologram (체적 홀로그램을 이용한 무안경 다안식 3D 디스플레이 시스템)

  • 이승현;이상훈
    • Journal of the Korea Computer Industry Society
    • /
    • v.2 no.12
    • /
    • pp.1609-1616
    • /
    • 2001
  • We present an autostereoscopic 3D display system using volume hologram. In this proposed system, the interference pattern of angular multiplexed plane reference and object beams are recorded into a volume hologram, which plays a role of guiding object beams of multi-view images into the desired perspective directions. For reconstruction, object beams containing the desired multi-view image information, which satisfy Bragg matching condition, are illuminated in the time-division multiplexed manner onto the crystal. Then multiple stereoscopic images are projected to the display plane for autostereoscopic 3D viewing. It is possible to make a high resolution multiview 3D display system independent upon the viewpoint.

  • PDF