• Journal of Broadcast Engineering
• /
• v.25 no.5
• /
• pp.709-722
• /
• 2020

Point Cloud which is a cluster of numerous points can express 3D object beyond the 2D plane. Each point contains 3D coordinate and color data basically, reflectance or etc. additionally. Point Cloud demand research and development much higher effective compression technology. Video-based Point Cloud Compression (V-PCC) technology in development and standardization based on the established video codec. Despite its high effective compression technology, point cloud service will be limited by terminal spec and network conditions. 2D video had the same problems. To remedy this kind of problem, 2D video is using Scalable High efficiency Video Coding (SHVC), Dynamic Adaptive Streaming over HTTP (DASH) or diverse technology. This paper proposed a density scalability method using SHVC codec in V-PCC.

• 전자공학회논문지 IE
• /
• v.43 no.4
• /
• pp.105-114
• /
• 2006

In this paper, 3D input and output systems for a web-based real-time 3D video communication system using IEEE 1394 digital cameras, Intel Xeon Server system and Microsoft Directshow library is proposed. And some conditions for optimizing the operations of the stereo camera, 3D display and signal processing system are analyzed. Input & output systems are carefully selected, which can satisfy the required optimization conditions and the final 3D video communication system is implemented by using three optimized devices. The overall control system is developed with Microsoft Visual C++.Net and Microsoft DirectX 9.1 SDK. Some experimental results show that the observer can feel the natural presence from multi-view(4-view) 3D video of server system in real-time and also can feel the natural presence from 3D video of client system and finally suggest an application possibility of the proposed web-based real-time 3D video communication in real fields.

• Journal of Korea Multimedia Society
• /
• v.23 no.12
• /
• pp.1447-1453
• /
• 2020

In this paper, we propose a method for no-reference quality assessment of sports videos using 3D shearlet transform and deep residual neural networks. In the proposed method, 3D shearlet transform-based spatiotemporal features are extracted from the overlapped video blocks and applied to logistic regression concatenated with a deep residual neural network based on a conditional video block-wise constraint to learn the spatiotemporal correlation and predict the quality score. Our evaluation reveals that the proposed method predicts the video quality with higher accuracy than the conventional no-reference video quality assessment methods.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.12 no.4
• /
• pp.1730-1747
• /
• 2018

Multi-view video plus depth (MVD) is a mainstream format of 3D scene representation in free viewpoint video systems. The advanced 3D extension of the high efficiency video coding (3D-HEVC) standard introduces new prediction tools to improve the coding performance of depth video. However, the depth video in 3D-HEVC is time consuming. To reduce the complexity of the depth video inter coding, we propose a fast coding unit (CU) size and mode decision algorithm. First, an off-line trained Bayesian model is built which the feature vector contains the depth levels of the corresponding spatial, temporal, and inter-component (texture-depth) neighboring largest CUs (LCUs). Then, the model is used to predict the depth level of the current LCU, and terminate the CU recursive splitting process. Finally, the CU mode search process is early terminated by making use of the mode correlation of spatial, inter-component (texture-depth), and inter-view neighboring CUs. Compared to the 3D-HEVC reference software HTM-10.0, the proposed algorithm reduces the encoding time of depth video and the total encoding time by 65.03% and 41.04% on average, respectively, with negligible quality degradation of the synthesized virtual view.

• Journal of Broadcast Engineering
• /
• v.18 no.6
• /
• pp.850-858
• /
• 2013

In this paper, we propose a method of frame synchronization for stereoscopic 3D video to solve the viewing problem caused by synchronization errors between a left video and a right video using the temporal frame difference image depending on the movement of objects. Firstly, we compute two temporal frame difference images from the left video and the right video which are corrected the vertical parallax between two videos using rectification, and calculate two horizontal projection profiles of two temporal frame difference images. Then, we find a pair of synchronized frames of the two videos by measuring the mean of absolute difference (MAD) of two horizontal projection profiles. Experimental results show that the proposed method can be used for stereoscopic 3D video, and is robust against Gaussian noise and video compression by H.264/AVC.

• Journal of Broadcast Engineering
• /
• v.18 no.3
• /
• pp.416-424
• /
• 2013

Recently, efforts have been made to develop international standards related to 3DTV quality assessment underway in International Telecommunication Union and Video Quality Experts Group. Unlike conventional 2D displays, there are several types of 3D display monitors: passive glasses, active glasses and auto-stereoscopic. In this paper, we performed subjective video quality tests using various 3D display monitors, in order to examine whether these display monitors can produce consistent perceptual video quality scores for processed video sequences. The experimental results show that the subjective scores of those 3D monitors are highly correlated and it appears that similar subjective scores will be obtained even when different types of 3D displays are used.

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.54 no.11
• /
• pp.673-679
• /
• 2005

This Paper presents the 3D wavelet transformation based video compression system, which possesses the capability of progressive transmission by increasing resolution and increasing rate for multimedia applications. The 3D wavelet packet based video compression system removes the temporal correlation of the input sequences using the motion compensation filter and decomposes the spatio-temporal subband using the spatial wavelet packet transformation. The proposed system allocates the higher bit rate to the low frequency image of the 3D wavelet sequences and improves the 0.49dB PSNR performance of the reconstructed image in comparison with that of H.263. In addition to the limitation on the propagation of the motion compensation error by the 3D wavelet transformation, the proposed system progressively transmits the input sequence according to the resolution and rate scalability.

• Journal of the Korean Society for Computer Game
• /
• v.31 no.4
• /
• pp.61-70
• /
• 2018

In this paper, we propose a synchronized playback method of 3D reference model and video by extracting golf swing information from learner's golf video to precisely compare and analyze each motion in each position and time in the golf swing, and present the implementation result. In order to synchronize the 3D model with the learner's swing video, the learner's golf swing movie is first photographed and relative time information is extracted from the photographed video according to the position of the golf club from the address posture to the finishing posture. Through applying time information from learners' swing video to a 3D reference model that rigs the motion information of a pro-golfer's captured swing motion at 120 frames per second through high-quality motion capture equipment into a 3D model and by synchronizing the 3D reference model with the learner's swing video, the learner can correct or learn his / her posture by precisely comparing his or her posture with the reference model at each position of the golf swing. Synchronized playback can be used to improve the functionality of manually adjusting system for comparing and analyzing the reference model and learner's golf swing. Except for the part where the image processing technology that detects each position of the golf posture is applied, It is expected that the method of automatically extracting the time information of each location from the video and of synchronized playback can be extended to general life sports field.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.34 no.10B
• /
• pp.1093-1103
• /
• 2009

In this paper, we propose a new depth map based distributed multi-view video coding algorithm through an efficient side information generation. A distributed video coding scheme corrects errors between an original image and side information generated at a decoder by using channel coding techniques. Therefore, the more accurate side information is generated, the better performance of distributed video coding scheme is achieved. In the proposed algorithm, a distributed video coding scheme is applied to multi-view video coding based on depth map. Side information is also generated from images of adjacent views through 3D warping by using a depth map and is also combined with MCTI(motion compensated temporal interpolation) which uses images on a temporal axis, and 3D warping. Experimental results show that side information generated by using the proposed algorithm has 0.97dB better average PSNR compared with using MCTI and 3D warping separated. In addition, 8.01% of average bit-rate has been decreased while the same PSNR in R-D curves is kept.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2012.11a
• /
• pp.40-41
• /
• 2012

양안식 3D 영상 시청 안정성에 대해 제기되고 있는 지속적인 이슈는 3D 영상 시장 활성화를 위해 반드시 선결 되어야 하는 과제이다. 최근, 이를 위해 양안식 3D 영상이 유발하는 시각적 불편함을 측정하고 이를 예측하는 연구가 활발히 진행되고 있다. 본 논문에서는 양안식 3D 영상에서 시각적 불편함을 야기하는 문제 영역의 양안 시차 변화에 따른 주관적 시각적 불편함을 측정한다. 이를 통하여 양안식 3D 영상에서 시각적 불편함을 주는 문제 영역의 영상 특성이 시청자가 인지하는 시각 피로에 지배적인 영향을 미칠 수 있음을 실험적으로 증명한다.