• Smart Media Journal
• /
• v.2 no.4
• /
• pp.27-33
• /
• 2013

Multi-view video system provides both realistic 3D feelings and free-view navigation. But it is hard to transmit too huge data, so we send only two or three view images and generate intermediate view image using depth information. In this paper, we propose high quality multi-view image generation method from stereoscopic images. Since the stereo matching method does not provide accurate disparity values for all the pixels, especially at the occlusion area, we propose an occlusion handling method using the background pixels at first. We also apply a joint bilateral filtering to enhance the disparity map at the object boundary since it can affect the quality of synthesized images significantly. Finally, we can generate virtual view images at intermediate view positions using confidence map to reduce bad pixel and hole's error. Experimental results show the proposed method performs better than the conventional method.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2012.07a
• /
• pp.40-43
• /
• 2012

3차원 영상 기술은 방송, 영화, 게임, 의료, 국방 등 다양한 기존 산업들과 융합하며 새로운 패러다임을 형성하고 있으며, 고품질 및 고해상도의 3차원 영상 획득에 대한 필요성이 강조되고 있다. 이에 따라, 최근에는 3차원 입체 영상을 제작 하는 방법 중 하나인 2D-plus-Depth 구조에 대한 연구가 활발히 진행되고 있다. 2D-plus-Depth 구조는 Charge-Coupled Device(CCD) 센서 등을 이용한 일반 카메라와 깊이 카메라를 결합한 형태로써 이 구조로부터 얻은 깊이 영상의 해상도를 상향 변환하기 위해서 Joint Bilateral Upsampling(JBU)[1], 컬러 영상의 정보를 활용한 보간법[2] 등의 방법들이 사용된다. 하지만 이 방법들은 깊이 영상을 높은 배율로 상향 변환할 경우 텍스처가 복사되거나 흐림 및 블록화 현상이 발생하는 문제점이 있다. 본 논문에서는 2D-plus-Depth 구조에서 얻은 고해상도 컬러 영상에서 보간 정보를 구하고 이 정보를 저해상도의 깊이 영상에 적용하여 상향 변환된 가이드 깊이 영상을 제작한다. 이 가이드 깊이 영상을 Bilateral Filtering[8]을 이용함으로써 고품질의 고해상도 깊이 영상을 획득한다. 실험 결과 제안하는 방법으로 해상도를 상향 변환을 할 경우에 기존의 보간법들에 비해 깊이 영상의 특성을 잘 보존함을 확인할 수 있고, 가이드 깊이 영상에 필터링을 처리한 결과가 JBU의 결과보다 향상됨을 확인할 수 있다.

• Journal of Astronomy and Space Sciences
• /
• v.26 no.1
• /
• pp.31-46
• /
• 2009

An Unscented Kalman Filter (UKF) for estimation of the attitude and rate of a spacecraft using only magnetometer vector measurement is developed. The attitude dynamics used in the estimation is the nonlinear Euler's rotational equation which is augmented with the quaternion kinematics to construct a process model. The filter is designed for small satellite in low Earth orbit, so the disturbance torques include gravity-gradient torque, magnetic disturbance torque, and aerodynamic drag torque. The magnetometer measurements are simulated based on time-varying position of the spacecraft. The filter has been tested not only in the standby mode but also in the detumbling mode. Two types of actuators have been modeled and applied in the simulation. The PD controller is used for the two types of actuators (reaction wheels and thrusters) to detumble the spacecraft. The estimation error converged to within 5 deg for attitude and 0.1 deg/s for rate respectively when the two types of actuators were used. A joint state parameter estimation has been tested and the effect of the process noise covariance on the parameter estimation has been indicated. Also, Monte-Carlo simulations have been performed to test the capability of the filter to converge with the initial conditions sampled from a uniform distribution. Finally, the UKF performance has been compared to that of the EKF and it demonstrates that UKF slightly outperforms EKF. The developed algorithm can be applied to any type of small satellites that are actuated by magnetic torquers, reaction wheels or thrusters with a capability of magnetometer vector measurements for attitude and rate estimation.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.37 no.4C
• /
• pp.277-282
• /
• 2012

In this paper, we present a real-time eye contact system for realistic telepresence using a Kinect depth camera. In order to generate the eye contact image, we capture a pair of color and depth video. Then, the foreground single user is separated from the background. Since the raw depth data includes several types of noises, we perform a joint bilateral filtering method. We apply the discontinuity-adaptive depth filter to the filtered depth map to reduce the disocclusion area. From the color image and the preprocessed depth map, we construct a user mesh model at the virtual viewpoint. The entire system is implemented through GPU-based parallel programming for real-time processing. Experimental results have shown that the proposed eye contact system is efficient in realizing eye contact, providing the realistic telepresence.

• Journal of KIISE
• /
• v.43 no.7
• /
• pp.773-780
• /
• 2016

Semantic information and features are very important for Semantic Role Labeling(SRL) though many SRL systems based on machine learning mainly adopt lexical and syntactic features. Previous SRL research based on semantic information is very few because using semantic information is very restricted. We proposed the SRL system which adopts semantic information, such as named entity, word sense disambiguation, filtering adjunct role based on sense, synonym cluster, frame extension based on synonym dictionary and joint rule of syntactic-semantic information, and modified verb-specific numbered roles, etc. According to our experimentations, the proposed present method outperforms those of lexical-syntactic based research works by about 3.77 (Korean Propbank) to 8.05 (Exobrain Corpus) F1-scores.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.17 no.8
• /
• pp.2068-2082
• /
• 2023

With the rapid development of deep learning, Depth Map Super-Resolution (DMSR) method has achieved more advanced performances. However, when the upsampling rate is very large, it is difficult to capture the structural consistency between color features and depth features by these DMSR methods. Therefore, we propose a color-image guided DMSR method based on iterative depth feature enhancement. Considering the feature difference between high-quality color features and low-quality depth features, we propose to decompose the depth features into High-Frequency (HF) and Low-Frequency (LF) components. Due to structural homogeneity of depth HF components and HF color features, only HF color features are used to enhance the depth HF features without using the LF color features. Before the HF and LF depth feature decomposition, the LF component of the previous depth decomposition and the updated HF component are combined together. After decomposing and reorganizing recursively-updated features, we combine all the depth LF features with the final updated depth HF features to obtain the enhanced-depth features. Next, the enhanced-depth features are input into the multistage depth map fusion reconstruction block, in which the cross enhancement module is introduced into the reconstruction block to fully mine the spatial correlation of depth map by interleaving various features between different convolution groups. Experimental results can show that the two objective assessments of root mean square error and mean absolute deviation of the proposed method are superior to those of many latest DMSR methods.

• Journal of Advanced Navigation Technology
• /
• v.21 no.4
• /
• pp.413-421
• /
• 2017

In this paper, we designed and fabricated a compact UHF receive module for efficient operation such as tactical and operation situation, target location information confirmation, target reset using Link-K(Korean joint tactical data link system). And the effect of target reset was analyzed by simulation. The designed module consists of UHF(ultra high frequency) receiver section, control section, and power distribution section. The UHF receiver section performs frequency down conversion, filtering and automatic gain control, etc. The control section demodulates frequency down-converted signals, extracts information, and performs external interworking. The power distribution section supplies external power, generates and supplies the power required by each section. The fabricated module was dimension of $105{\times}105{\times}80mm$ and weighed 1.10 kg and The receiving distance is more than 50 km.