• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2005.11a
• /
• pp.21-24
• /
• 2005

본 논문에서는 3DTV를 위한 다시점 동영상 부호화 기법을 제안한다. 제안하는 다시점 동영상 부호화기는 다수의 카메라 입력에 대하여 기존의 MPEG 기반의 부호화 기법에서 사용된 시 ${\cdot}$ 공간적 중복성 제거와 각 시점에 해당하는 영상간의 공간적 중복성을 제거하여 부호화효율을 개선할 수 있다. 각 시점 영상간의 공간적 중복성을 효율적으로 제거하기 위하여 전역 시차보상(global disparity compensation)된 집적영상(Accumulated Image)를 사용하였다. 또한 기존의 디지털 TV 전송 표준인 MPEG-2를 기반으로 하였기 때문에 기존의 디지털 TV 표준을 크게 수정하지 않고 3DTV를 구현 할 수 있다. 제안하는 기법은 기존의 MPEG-2 기법으로 각 시점에 해당하는 영상을 각각 부호화한(simulcast 기법) 결과와 비교하여 객관적 화질면에서 우수하였으며, 각 시점간의 동기화 문제도 해결 할 수 있었다.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2014.10a
• /
• pp.822-823
• /
• 2014

The usual method of generating an image for a multiview display system requires acquiring a color image and depth information of a reference camera. Then, intermediate images, generated using DIBR method, will be captured at a number of different viewpoints and composed to construct an multiview image. When such intermediate views are generated, several holes would be shown because some hidden parts are shown when the screenshot is taken at different angle. Previous research tried to solve this problem by creating a new hole-filling algorithm or enhancing the depth information. This paper describes a new method of enhancing the intermediate view images by applying the Ball Pivoting algorithm, which constructs meshes from a point cloud. When the new method is applied to the Microsoft's "Ballet" and "Break Dancer" data sets, PSNR comparison shows that about 0.18~1.19 increasement. This paper will explaing the new algorithm and the experiment method and results.

• KIPS Transactions on Software and Data Engineering
• /
• v.2 no.7
• /
• pp.495-502
• /
• 2013

Motion estimation (ME) that limits the performance of image quality and encoding speed has been developed to reduce temporal redundancy in video sequences and plays an important role in digital video compression. But it is computational demanding part of the encoder. Multi-view video is obtained by capturing one three-dimensional scene with many cameras at different positions. ME for Multi-view video requires high computational complexity. To reduce computational complexity and maintain the image quality, a fast motion estimation method is proposed in this paper. The proposed method uses a hierarchical search strategy. This strategy method consists of modified diamond search patten, multi gird diamond search pattern, and raster search pattern. These search patterns place search points symmetrically and evenly that can cover the overall search area not to fall into the local minimum or exploits the characteristics of the distribution of motion vectors to place the search points. Experiment results show that the speedup improvement of the proposed method over TZ search method (JMVC) can be up to 1.2 ~3 times faster while maintaining similar video quality and bit rates.

• Journal of Broadcast Engineering
• /
• v.16 no.2
• /
• pp.258-273
• /
• 2011

This paper designs and implements a multi-view 3D video player system which is operated faster than existing video player systems. The structure for obtaining the near optimum speed in a multi-processor environment by parallelizing the component modules is proposed to process large volumes of multi-view image data at high speed. In order to use the concurrency of bottleneck, we designed image decoding, synthesis and rendering modules in a pipeline structure. For load balancing, the decoder module is divided into the unit of viewpoint, and the image synthesis module is geometrically divided based on synthesized images. As a result of this experiment, multi-view images were correctly synthesized and the 3D sense could be felt when watching the images on the multi-view autostereoscopic display. The proposed application processing structure could be used to process large volumes of multi-view image data at high speed, using the multi-processors to their maximum capacity.

• Korean Journal of Optics and Photonics
• /
• v.24 no.5
• /
• pp.237-244
• /
• 2013

Supermultiview and electro-holographic displays are promising displays for the future because they provide continuous parallaxes as their depth cue. But they are still in the early development stage due to the lack of supporting technologies. Achieving the continuous parallax in the supermultiview relies more on the number and size of pixels in the pixel cell/elemental image rather than the number of different view images. For the electro-holographic display, it also relies on the number and size of pixels in the panel. So these two methods share the same requirements for achieving the parallax. But the image displayed on the holographic display provides more impressive visual appeal than that on the supermultiview because the image can be floated on the front space of the display.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2010.07a
• /
• pp.415-416
• /
• 2010

이 논문에서 우리는 텍스쳐 정보가 적은 영역이 존재하는 입력 영상들에 대해서도 안정적인 복원을 도출하는 새로운 다시 점 스테레오 방법을 제시한다. 제안된 방법에서는 입력 영상들을 인접한 픽셀간의 색 유사성을 이용하여 세그먼테이션한 후, 세그먼트 단위로 다시점 스테레오를 수행한다. 특히 그 과정에서 한 영상 내의 이웃한 세그먼트들의 깊이 값 유사성, 그리고 서로 다른 시점에서 상응하는 세그먼트 간의 깊이 값 일관성을 가정하여, 텍스쳐 정보가 적은 영역에 대해서도 안정적으로 3D 점들을 생성해준다. 생성된 3D 점들은 그래프 컷 기반의 복원 알고리즘을 통해 일관된 3D 표면으로 복원 되었고, 복원 결과는 제안된 방법이 실제로 기존의 다른 다시점 스테레오에 비해 보다 안정적으로 깊이 정보를 추출할 수 있음을 보여준다. 결과적으로 제안된 방법은 보다 일반적이고 실생활에 가까운 입력 영상들에 대해서도 3D 복원을 수행할 수 있는 방향을 제시한다.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.48 no.3
• /
• pp.13-18
• /
• 2011

In this paper, we explain capturing, postprocessing, and depth generation methods using multiple color and depth cameras. Although the time-of-flight (TOF) depth camera measures the scene's depth in real-time, there are noises and lens distortion in the output depth images. The correlation between the multi-view color images and depth images is also low. Therefore, it is essential to correct the depth images and then we use them to generate the depth information of the scene. The results of stereo matching based on the disparity information from the depth cameras showed the better performance than the previous method. Moreover, we obtained the accurate depth information even at the occluded or textureless regions which are the weaknesses of stereo matching.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.9 no.1
• /
• pp.53-59
• /
• 2009

Multi-view video is necessary to develop a new compression encoding technique for storage and transmission, because of a huge amount of data. Layered depth image is an efficient representation method of multi-view video data. This method makes a data structure that is synthesis of multi-view color and depth image. This paper proposed enhanced compression method by presentation of efficient layered depth image using real distance comparison, solution of overlap problem, and interpolation. In experimental results, confirmed high compression performance.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.34 no.2C
• /
• pp.186-193
• /
• 2009

Multi-view video is necessary to develop a new compression encoding technique for storage and transmission, because of a huge amount of data. Layered depth image is an efficient representation method of multi-view video data. This method makes a data structure that is synthesis of multi-view color and depth image. This paper proposed enhanced compression method by presentation of efficient layered depth image using real distance comparison, solution of overlap problem, and YCrCb color transformation. In experimental results, confirmed high compression performance and good reconstructed image.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.37 no.4A
• /
• pp.239-249
• /
• 2012

Recently, the virtual view generation method using depth data is employed to support the advanced stereoscopic and auto-stereoscopic displays. Although depth data is invisible to user at 3D video rendering, its accuracy is very important since it determines the quality of generated virtual view image. Many works are related to such depth enhancement exploiting a time-of-flight (TOF) camera. In this paper, we propose a fast 3D scene capturing system using one TOF camera at center and two high-resolution cameras at both sides. Since we need two depth data for both color cameras, we obtain two views' depth data from the center using the 3D warping technique. Holes in warped depth maps are filled by referring to the surrounded background depth values. In order to reduce mismatches of object boundaries between the depth and color images, we used the joint bilateral filter on the warped depth data. Finally, using two color images and depth maps, we generated 10 additional intermediate images. To realize fast capturing system, we implemented the proposed system using multi-threading technique. Experimental results show that the proposed capturing system captured two viewpoints' color and depth videos in real-time and generated 10 additional views at 7 fps.