• Journal of Broadcast Engineering
• /
• v.16 no.2
• /
• pp.216-225
• /
• 2011

Following the proliferation of three-dimensional video contents and displays, many terrestrial broadcasting companies have been preparing for stereoscopic 3DTV service. In terrestrial stereoscopic broadcast, it is a difficult task to code and transmit two video sequences while sustaining as high quality as 2DTV broadcast due to the limited bandwidth defined by the existing digital TV standards such as ATSC. Thus, a terrestrial 3DTV broadcasting with a heterogeneous video codec system, where the left image and right images are based on MPEG-2 and H.264/AVC, respectively, is considered in order to achieve both high quality broadcasting service and compatibility for the existing 2DTV viewers. Without significant change in the current terrestrial broadcasting systems, we propose a joint rate control scheme for stereoscopic 3DTV service based on the heterogeneous dual codec systems. The proposed joint rate control scheme applies to the MPEG-2 encoder a quadratic rate-quantization model which is adopted in the H.264/AVC. Then the controller is designed for the sum of the left and right bitstreams to meet the bandwidth requirement of broadcasting standards while the sum of image distortions is minimized by adjusting quantization parameter obtained from the proposed optimization scheme. Besides, we consider a condition on maintaining quality difference between the left and right images around a desired level in the optimization in order to mitigate negative effects on human visual system. Experimental results demonstrate that the proposed bit rate control scheme outperforms the rate control method where each video coding standard uses its own bit rate control algorithm independently in terms of the increase in PSNR by 2.02%, the decrease in the average absolute quality difference by 77.6% and the reduction in the variance of the quality difference by 74.38%.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.26 no.6
• /
• pp.599-609
• /
• 2008

Development of computer and electronic technology leads innovative progress in spatial informatics and successful commercialization. Geospatial information technology plays an important role in decision making in various applications. However, information display media are two-dimensional plane that limits visual perception. Understanding human visual processing mechanism to percept stereo vision makes possible to implement three-dimensional stereo image display. This paper proposes on-the-fly stereo image generation methods that are involved with various exterior and camera parameters including exposure station, viewing direction, image size, overlap and focal length. Collinearity equations and parameters related with stereo viewing conditions were solved to generate realisitc stereo imagery. In addition stereo flying simulation scenery was generated with different viewing locations and directions. The stereo viewing is based on the parallax principle of two veiwing locations. This study implemented anaglyphic stereogram, polarization and lenticular stereo display methods. Existing display technology has limitation to provide visual information of three-dimensional and dynamic nature of the real world because the 3D spatial information is projected into 2D plane. Therefore, stereo display methods developed in this study improves geospatial information and applications of GIS by realistic stereo visualization.

• Korean Journal of Human Ecology
• /
• v.23 no.4
• /
• pp.653-663
• /
• 2014

In the design of stereoscopic clothing items, the 3D shapes of the space between clothing and body (SCB; Space shape between Clothing and Body) can be very important clues to improve the fit for various body shapes. Therefore, this research suggests a method for extracting the shape of SCB using the mold bra cup as an example. The SCBs were extracted from two kinds of 3D images, a small-breasted women's nude breast images and bra-wearing images. The the mold bra cups were compressed by wearing, and the outer and lower part of the SCBs could not be obtained because of the movement of the breast volume in the bras. Therefore, the SCBs could not be applied to the design of the mold bra cups directly. However, the suggested method can be useful when it is applied to stiffer clothing items and body parts whose shapes are not changed easily, such as a helmet or other body protectors.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.12 no.12
• /
• pp.2146-2152
• /
• 2008

In In this paper, we proposed a new JPEG2000 codec using multiresolution-based rendering (MRBR) technique for video compression of 3-dimensional digital cinema. We introduced discrete wavelet transform (DWT) for stereoscopic image and stereo matching technique in the wavelet domain. The disparity was extracted using stereo matching and transmitted with the reference (left) image. Since the generated right image was degraded by the occlusion lesion, the residual image which is generated from difference between the original right image and the generated one was transmitted at the same tine. The disparity data was extracted using the dynamic programming method in the disparity domain. There is high correlation between the higher and lower subbands. Therefore we decreased the calculation amount and enhanced accuracy by restricting the search window and applying the disparity information generated from higher subband.

• Journal of Broadcast Engineering
• /
• v.23 no.2
• /
• pp.316-319
• /
• 2018

When a terrestrial UHD broadcasting service and a mobile HD broadcasting service are provided using the PLP function provided by ATSC 3.0 and domestic UHD broadcasting standard, a small amount of data may be additionally transmitted to further provide high quality UHD-3D broadcasting service. The left and right images of the stereoscopic image are input, one view image is encoded by the SHVC method, and the other view images are encoded by the SHVC method of the two-view cross-referencing method. However, since the base layers (BL) of the two encoders are mutually common, the two encoders correspond to encoders that generate one BL stream and two enhancement layer (EL) streams. The average encoding efficiency is 16% more efficient compared to the third independent HEVC encoding for the UHD-3D broadcast service. The proposed scheme reduces the fluctuation of PSNR per image frame and increases the image quality of minimum PSNR frame by 0.6dB.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.21 no.2
• /
• pp.153-158
• /
• 2011

This paper presents subjective experimental results to understand how audio should be changed when a video clip is watched in 3D than 2D. This paper divided auditory perceptual information into two categories; distance and azimuth that a sound source contributes mostly, and spaciousness that scene or environment contribute mostly. According to the experiment for distance and azimuth, i.e. sound localization, we found that distance and azimuth of sound sources were magnified when heard with 3D than 2D video. This lead us to conclude 3D sound for localization should be designed to have more distance and azimuth than 2D sound. Also we found 3D sound are preferred to be played with not only 3D video clip but also 2D video clip. According to the experiment for spaciousness, we found people prefer sound with more reverberation when they watch 3D video clips than 2D video clips. This can be understood that 3D video provides more spacial information than 2D video. Those subjective experimental results can help audio engineer familiar with 2D audio to create 3D audio, and be fundamental information of future research to make 2D to 3D audio conversion system. Furthermore when designing 3D broadcasting system with limited bandwidth and with 2D TV supportive, we propose to consider transmitting stereoscopic video, audio with enhanced localization, and metadata for TV sets to generate reverberation for spaciousness.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.38 no.5
• /
• pp.538-547
• /
• 2001

Currently, 2D real-time image coding techniques had great developments and many related products were commercially developed. However, these techniques lack the capability of handling 3D actuality, occurred by the advent of virtual reality, because they handle only the temporal transmission for 2D image. Besides, many 3D virtual reality researches have been studied in computer graphics. Since the graphical researches were limited to the application of artificial models, the 3D actuality for real scene images could not be managed also. Therefore, a new 3D model extraction method based on stereo vision, that can deal with real scene virtual reality, is proposed in this paper. The proposed method adapted a compact genetic algorithm using population-based incremental learning (PBIL) to matching environments, in order to reduce memory consumption and computational time of conventional genetic algorithms. Since the PBIL used a probability vector and competitive learning, the matching algorithm became simple and the computation load was considerably reduced. Moreover, the matching quality was superior than conventional methods. Even if the characteristics of images are changed, stable outputs were obtained without the modification of the matching algorithm.

• Journal of Broadcast Engineering
• /
• v.17 no.2
• /
• pp.305-315
• /
• 2012

Color correction between two or multiple images is very crucial for the development of subsequent algorithms and stereoscopic 3D camera system. Even though various color correction methods are proposed recently, there are few methods for measuring the performance of these methods. In addition, when two images have view variation by camera positions, previous methods for the performance measurement may not be appropriate. In this paper, we propose a method of measuring color difference between corresponding images for color correction. This method finds matching points that have the same colors between two scenes to consider the view variation by correspondence searches. Then, we calculate statistics from neighbor regions of these matching points to measure color difference. From this approach, we can consider misalignment of corresponding points contrary to conventional geometric transformation by a single homography. To handle the case that matching points cannot cover the whole regions, we calculate statistics of color difference from the whole image regions. Finally, the color difference is computed by the weighted summation between correspondence based and the whole region based approaches. This weight is determined by calculating the ratio of occupying regions by correspondence based color comparison.

• The KIPS Transactions:PartB
• /
• v.13B no.3 s.106
• /
• pp.295-300
• /
• 2006

The integral imaging system is an auto-stereoscopic display that allows users to see 3D images without wearing special glasses. In the integral imaging system, the 3D object information is taken from several view points and stored as elemental images. Then, users can see a 3D reconstructed image by the elemental images displayed through a lens array. The elemental images can be created by computer graphics, which is referred to the computer-generated integral imaging. The process of creating the elemental images is called image mapping. There are some image mapping methods proposed in the past, such as PRR(Point Retracing Rendering), MVR(Multi-Viewpoint Rendering) and PGR(Parallel Group Rendering). However, they have problems with heavy rendering computations or performance barrier as the number of elemental lenses in the lens array increases. Thus, it is difficult to use them in real-time graphics applications, such as virtual reality or real-time, interactive games. In this paper, we propose a new image mapping method named VVR(Viewpoint Vector Rendering) that improves real-time rendering performance. This paper describes the concept of VVR first and the performance comparison of image mapping process with previous methods. Then, it discusses possible directions for the future improvements.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2012.11a
• /
• pp.42-43
• /
• 2012

최근 양안식 3D 디스플레이의 시청 안정성 문제가 대두됨에 따라, 어떠한 요인들이 시각피로와 시각적 불편함을 야기하는지 밝히는 연구의 필요성이 증가하고 있다. 시각적 불편함은 양안식 3D 영상에서 과도한 양안 시차, 양안 시차의 빠른 변화, 양안 불일치 등에 의해 야기될 수 있다. 그러나 시각적 불편함은 시각시스템의 복잡한 메커니즘에 의한 결과이므로 알려진 양안 시차 등의 요인 외에도 밝혀지지 않은 요인들이 더 존재할 수 있다. 본 논문은 기존 연구로부터 시각적 불편함과 관련 있을 것으로 추정되는 요인으로 시각자극의 너비와 시각적 불편함에 대한 민감도를 선택하였다. 이들의 영향을 밝히기 위한 실험으로서, 편안한 양안 시차 범위 내에서 시각자극의 너비와 시각적 불편함에 대한 민감도에 따라 양안 융합 시간이 어떻게 달라지는지를 관찰하였다. 실험 결과로부터 편안한 양안 시차 범위 내에서도 시각자극의 너비와 시각적 불편함에 대한 민감도에 따라 양안 융합 시간이 크게 달라짐을 확인할 수 있었다. 이러한 결과들은 시각자극의 너비가 주요한 시각적 불편함의 3D 콘텐츠 요인이 될 수 있음을 암시한다.