• Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
• /
• v.22 no.7
• /
• pp.37-42
• /
• 2008

In this paper, a real-time multiview video coding system using fast disparity estimation is proposed. In the multiview encoder, adaptive disparity-motion estimation (DME) for an effective 3-dimensional (3D) processing are proposed. That is, by adaptively predicting the mutual correlation between stereo images in the key-frame using the proposed algorithm, the bandwidth of stereo input images can be compressed to the level of a conventional 2D image and a predicted image also can be effectively reconstructed using a reference image and adaptive disparity vectors. Also, in multiview decoder, intermediate view reconstruction (IVR) using adaptive disparity search algorithm (DSA) for real-time multiview video processing is proposed. The proposed IVR can reduce a processing time of disparity estimation by selecting adaptively disparity search range. Accordingly, the proposed multiview video coding system is able to increase the efficiency of the coding rate and improve the resolution.

• ETRI Journal
• /
• v.31 no.2
• /
• pp.151-161
• /
• 2009

In this paper, we propose an adaptive multiview video coding scheme based on spatiotemporal correlation analyses using hierarchical B picture (AMVC-HBP) for the integrative encoding performances, including high compression efficiency, low complexity, fast random access, and view scalability, by integrating multiple prediction structures. We also propose an in-coding mode-switching algorithm that enables AMVC-HBP to adaptively select a better prediction structure in the encoding process without any additional complexity. Experimental results show that AMVC-HBP outperforms the previous multiview video coding scheme based on H.264/MPEG-4 AVC using the hierarchical B picture (MVC-HBP) on low complexity for 21.5%, on fast random access for about 20%, and on view scalability for 11% to 15% on average. In addition, distinct coding gain can be achieved by AMVC-HBP for dense and fast-moving sequences compared with MVC-HBP.

• ETRI Journal
• /
• v.32 no.4
• /
• pp.566-576
• /
• 2010

In a multiview video system, interactivity is important for users and should be considered in the design of multiview video coding (MVC). In this paper, we present an interactivity evaluation model for MVC schemes by using both weighted random graph and Markov approaches. The main factors that affect both the interactivity and rate-distortion (RD) performances of MVC schemes are analyzed and discussed in detail. By taking these factors into consideration, a new MVC scheme is proposed for high interactivity and RD gains. Experimental results show that the proposed scheme has a significant interactivity gain with little coding loss, compared to the state-of-the-art benchmark. As an extension to RD performance analysis, the interactivity evaluation model can be used as a design tool of alternative schemes for a future interactive multiview video system.

• Proceedings of the IEEK Conference
• /
• 2008.06a
• /
• pp.57-60
• /
• 2008

In this paper, we describe the technology about multiview video coding which is a hot issue in diqital video coding. A multiview video coding (MVC) is able to provide a free view point and 3-D effect, resulting that it gives more realism to users. Now, the MVC has been standardized as an amendment of H.264/AVC. In this paper, we present not only the MVC standard but also relevant techniques which were under consideration in the MVC standardization.

• Journal of Broadcast Engineering
• /
• v.13 no.3
• /
• pp.401-410
• /
• 2008

Multiview Video Coding contains a macroblock-based illumination compensation tool which can compensate the variations of illuminations according to view or temporal directions. Thanks to illumination compensation tool, the coding efficiency of Multiview Video Coding has been enhanced. However illumination compensation tool also generates additional subjective drawbacks of the blocking artifacts due to macroblock-based compensations of mean values. A deblocking filtering method for Multiview Video Coding which is the same as in H.264/AVC does not consider illumination difference between the illumination compensated blocks, thus it can not effectively eliminate the blocking artifacts. Therefore, this paper analyzes the phenomena of blocking artifacts caused by illumination compensation and proposes a method which can effectively eliminate the blocking artifacts with the minimum changes of the H.264 deblockding filtering method. In the simulation results, it can be easily found the blocking artifacts are clearly eliminated in the subjective comparisons, and the average bit-rate reduction is up to 1.44%.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.5 no.2
• /
• pp.408-427
• /
• 2011

Intensive computational complexity is an obstacle of enabling multiview video coding for real-time applications. In this paper, we present a fast macroblock (MB) mode selection algorithm for B frames which are based on the computational complexity analyses between the MB mode selection and reference frame selection. Three strategies are proposed to reduce the coding complexity jointly. First, the temporal correlation of MB modes between current MB and its temporal corresponding MBs is utilized to reduce computational complexity in determining the optimal MB mode. Secondly, Lagrangian cost of SKIP mode is compared with that of Inter $16{\times}16$ modes to early terminate the mode selection process. Thirdly, reference frame correlation among different Inter modes is exploited to reduce the number of reference frames. Experimental results show that the proposed algorithm can promote the encoding speed by 3.71~7.22 times with 0.08dB PSNR degradation and 2.03% bitrate increase on average compared with the joint multiview video model.

• Journal of Broadcast Engineering
• /
• v.13 no.3
• /
• pp.388-400
• /
• 2008

This paper introduces a cost-effective method fur improving anchor picture quality of a multiview video coding scheme that is mainly based on chroma compensation. Proposed method is applied to both INTER $16{\times}16$ and SKIP modes in only anchor P-pictures. By testing using JVT common test conditions, simulation results show that proposed method can obtain the average BD-PSNR gains fur U and V as 0.136 dB and 0.127 dB, respectively, while maintaining almost same performance for Y (luminance). For the range of low bit-rates, it is observed that average BD-PSNR gains of Y, U, and V are 0.141 dB, 0.494 dB and 0.525 dB, respectively. Necessary computational complexity is very marginal because the number of anchor P-pictures is only 4.18% in comparison with whole coded sequences, however it can be found that the proposed method can significantly improve the coding efficiencies of color components.

• Journal of Broadcast Engineering
• /
• v.13 no.3
• /
• pp.328-338
• /
• 2008

Multi-view video coding (MVC) based on H.264/AVC encodes multiple views efficiently by using a prediction scheme that exploits inter-view correlation among multiple views. However, with the increase of the number of views and use of inter-view prediction among views, total encoding time will be increased in multiview video coding. In this paper, we propose a fast mode decision using both MB(Macroblock)-based region segmentation information corresponding to each view in multiple views and global disparity vector among views in order to reduce encoding time. The proposed method achieves on average 40% reduction of total encoding time with the objective video quality degradation of about 0.04 dB peak signal-to-noise ratio (PSNR) by using joint multi-view video model (JMVM) 4.0 that is the reference software of the multiview video coding standard.

• Information and Communications Magazine
• /
• v.27 no.3
• /
• pp.29-35
• /
• 2010

디지털 영상 기술의 발전과 함께 최근 3차원 영상 기술에 대한 관심이 높아지고 있다. 3차원 비디오는 고성능 비디오(high-performance video)와 함께 차세대 영상 기술로 각광받고 있다. 3차원 비디오는 사용자에게 자유로운 임의의 시점에서 입체감 있는 영상을 제공할 수 있다. 이 논문은 멀티미디어 전송에 관한 국제 표준화 기구인 MPEG의 다시점 비디오 부호화(multiview video coding, MVC)그룹과 3차원 비디오 부호화(3D video coding, 3DVC)그룹에서 다뤄진 3차원 비디오 부호화 기술을 소개한다.

• Journal of Broadcast Engineering
• /
• v.9 no.3
• /
• pp.236-245
• /
• 2004

A multiview sequence CODEC with view scaiability is proposed in this paper. We define a GGOP (Group of GOP) structure as a basic coding unit to efficiently code multiview sequences. 7he proposed CODEC provides flexible GGOP structures based on the number of views and baseline distances among cameras. Multiview sequences encode consists of disparity estimation/compensation, motion estimation/compensation, residual coding and rate control and generates multiview sequence bitstream. The main bitstream is the same as an MPEG-2 mono-sequence bitstream for MPEG-2 compatibility. The auxiliary bitstream contains information concerning the remaining multiview sequences except for the reference sequences. The proposed CODEC with view scalability provides that a number of view flints are selectively determined at the receiver according to the type of display modes. The proposed multiview sequence CODEC is tested with several multiview sequences to determine its flexibility. compatibility with MPEG-2 and view scaiability. In addition, we subjectively confirm that the decoded bitstreams with view scaiability can be Properly displayed by several types of display modes. including 3D monitors.