• Science of Emotion and Sensibility
• /
• v.16 no.2
• /
• pp.207-220
• /
• 2013

For video reality improvement, there has been much advancement in the methods of providing visual, auditory, and tactile information. On the other hand, there is little research on olfaction for video reality because it is difficult to define and knotty to manipulate. As a first step for video reality improvement using olfactory information, this research investigated users' acceptability of smell when they watch videos of various kinds and then classified the video clips based on their acceptability of different criteria. To do so, we first selected three questions of whether the scene in the video appears to have an odor (odor presence), whether a matching odor is likely to improve a sense of reality (effect on sense of reality), and whether s/he would like a matching odor to be present (preference for the matching odor). Then after collecting 51 video clips of various genres that would receive either high or low ratings for the questions above, we had participants to watch the videos and rate them for the above three questions on 7-point scale. For video classification, we paired each two questions to construct 2D space to draw scatterplot of video clips where the scales of the two questions represent X or Y axis. Clusters of video clips that locate at different quadrants of the 2D space would provide important insights in providing olfactory information for video reality improvement.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.21 no.6
• /
• pp.1361-1369
• /
• 1996

Motion estimation is one of the key components for high quality video coding. In this paper, a new motion estimation scheme for MPEG-like video coder is suggested. The proposed temporally adaptive motion estimation scheme consists of five functional blocks: Temporal subband analysis (TSBA), extraction of temporal information, scene change detection (SCD), picture type replacement (PTR), and temporally adapted block matching algorithm (TABMA). Here all the functional components are based on the temporal subband analysis. In this papre, we applied the analysis part of subband decompostion to the temporal axis of moving picture sequence, newly defined the temporal activity distribution (TAD) and average TAD, and proposed the temporally adapted block matching algorithm, the scene change detection algorithm and picture type replacement algorithm which employed the results of the temporal subband analysis. A new block matching algorithm TABMA is capable of controlling the block matching area. According to the temporal activity distribution of objects, it allocates the search areas nonuniformly. The proposed SCD and PTR can prevent unavailable motion prediction for abrupt scene changes. Computer simulation results show that the proposed motion estimation scheme improve the quality of reconstructed sequence and reduces the number of block matching trials to 40% of the numbers of trials in conventional methods. The TSBA based scene change detection algorithm can detect the abruptly changed scenes in the intentionally combined sequence of this experiment without additional computations.

• ETRI Journal
• /
• v.37 no.4
• /
• pp.772-779
• /
• 2015

This paper presents a power-efficient hardware realization for a motion estimation technique that is based on the full-search block matching algorithm (FSBMA). The considered input is the quarter common intermediate format of digital video. The mean of absolute difference (MAD) is the distortion criteria employed for the block matching process. The conventional architecture considered for the hardware realization of FSBMA is that of the shift register-based 2-D systolic array. For this architecture, a conservative approximation technique is adapted to eliminate unnecessary MAD computations involved in the block matching process. Upon introducing the technique to the conventional architecture, the power and complexity of its implantation is reduced, while the accuracy of the motion vector extracted from the block matching process is preserved. The proposed architecture is verified for its functional specifications. A performance evaluation of the proposed architecture is carried out using parameters such as power, area, operating frequency, and efficiency.

• Journal of KIISE:Computing Practices and Letters
• /
• v.10 no.3
• /
• pp.273-281
• /
• 2004

There is the temporal correlation of the video sequence between the motion vector of current block and the motion vector of previous block. In this paper, we propose the prediction search algorithm for block matching using the temporal correlation of the video sequence and the center-biased property of motion vectors. The proposed algorithm determines the location of a better starting point for the search of an exact motion vector using the point of the smallest SAD(sum of absolute difference) value by the predicted motion vector from the same block of the previous frame and the predictor candidate point on each search region. Simulation results show that PSNR(Peak-to-Signal Noise Ratio) values are improved up to the 1.06㏈ as depend on the video sequences and improved about 0.19∼0.46㏈ on an average except the full search(FS) algorithm.

• Proceedings of the IEEK Conference
• /
• 2004.08c
• /
• pp.819-822
• /
• 2004

To transmit MPEG-2 video on an erroneous channel, a number of error control techniques He needed. Especially, error concealment techniques which can be implemented on receivers independent of transmitters are essential to obtain good video quality. In this paper, a motion adaptive boundary matching algorithm (MA-BMA) is presented for temporal error concealment. Before carrying out BMA, we perform error concealmmt by a motion vector prediction using neighboring motion vectors. If the candidate of error concealment is rot satisfied, search range and reliable boundary pixels are selected by the motion activity or motion vectors ane a damaged macroblock is concealed by applying the MA-BMA. This error concealment technique reduces the complexity and maintains PSNR gain of 0.3 0.7dB compared to the conventional BMA.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2016.06a
• /
• pp.204-206
• /
• 2016

본 논문에서는 template matching을 이용한 PMMVD(Pattern Matched Motion Vector Derivation)기술에 대해 움직임 추정 방식에 따라 복잡도를 분석한다. PMMVD 기술은 HEVC의 화면 간 예측 기술과는 다르게 움직임과 관련된 정보를 부호화하지 않으며, 복호화기에서 움직임 벡터를 추정하는 방식이다. 따라서 종래의 기술 대비 높은 효율이 발생하지만 복호화기의 복잡도는 급격히 증가하게 된다. 이러한 이유로 다양한 움직임 추정 방식에 따라 성능을 분석하여 최적의 조합을 찾는 것은 매우 중요한 이슈임을 알 수 있다. 이를 위하여 현재 JVET(Joint Video Exploration Team)에서 FVC(Future Video Coding)를 위해 발표한 참조 소프트웨이인 JEM 2.0(Joint Exploration Test Model 2)을 이용하여 실험을 수행하고 향후 연구 방향을 논의한다.

• Proceedings of the IEEK Conference
• /
• 2000.07a
• /
• pp.278-281
• /
• 2000

Matching pursuit algorithm is a signal expansion technique whose efficiency for motion compensated residual image has already been demonstrated in the MPEG-4 framework. However, one of the practical concerns related to applying matching pursuit algorithm to real-time scalable video coding is its massive computation required for finding dictionary elements. In this respective, this paper proposes a fast algorithm, which is composed of three sub-methods. The first method utilizes the property of symmetry in 1-D dictionary element and the second uses mathematical elimination of inner product calculation in advance, and the last one uses frequency property of 2-D dictionary. Experimental results show that our algorithm needs about 30% computational load compared to the conventional fast algorithm using separable property of 2-D gabor dictionary with negligible quality degradation.

• Journal of Industrial Technology
• /
• v.29 no.A
• /
• pp.47-54
• /
• 2009

In this paper, we proposed hand detection and hand gesture recognition from USB camera video. Firstly, we extract hand region extraction using skin color information from a difference images. Background image is initially stored and extracted from the input images in order to reduce problems from complex backgrounds. After that, 16-directional chain code sequence is computed from the tracking of hand motion. These chain code sequences are compared with pre-trained models using DP matching. Our hand gesture recognition system can be used to control PowerPoint slides or applied to multimedia education systems. We got 92% hand region extraction accuracy and 82.5% gesture recognition accuracy, respectively.

• International Journal of Contents
• /
• v.6 no.3
• /
• pp.5-9
• /
• 2010

To manage large database system with video, effective video indexing and retrieval are required. A large number of video retrieval algorithms have been presented for frame-wise user query or video content query, whereas a few video identification algorithms have been proposed for video sequence query. In this paper, we propose an effective video identification algorithm for video sequence query that employs the Cauchy function of histograms between successive frames and the modified Hausdorff distance. To effectively match the video sequences with a low computational load, we make use of the key frames extracted by the cumulative Cauchy function and compare the set of key frames using the modified Hausdorff distance. Experimental results with several color video sequences show that the proposed algorithm for video identification yields remarkably higher performance than conventional algorithms such as Euclidean metric, and directed divergence methods.

• Proceedings of the IEEK Conference
• /
• 2005.11a
• /
• pp.549-552
• /
• 2005

This paper presents a 3D video content generation technique and system that uses the multi-view images and the depth map. The proposed uses 3-view video and depth inputs from the 3-view video camera and depth camera for the 3D video content production. Each camera is calibrated using Tsai's calibration method, and its parameters are used to rectify multi-view images for the multi-view stereo matching. The depth and disparity maps for the center-view are obtained from both the depth camera and the multi-view stereo matching technique. These two maps are fused to obtain more reliable depth map. Obtained depth map is not only used to insert a virtual object to the scene based on the depth key, but is also used to synthesize virtual viewpoint images. Some preliminary test results are given to show the functionality of the proposed technique.