• Journal of the Institute of Electronics and Information Engineers
• /
• v.51 no.3
• /
• pp.112-118
• /
• 2014

As higher quality of image is required for digital image scaling, longer processing time is required. Therefore the technology that can make higher quality image quickly is needed. We propose the double linear-cubic convolution interpolation which creates the high quality image with low complexity and hardware resources. The proposed interpolation methods which are made up of four one-dimensional linear interpolations and one one-dimensional cubic convolution perform linear-cubic convolution interpolation in horizontal and vertical direction. When compared in aspects of peak signal-to-noise ratio(PSNR), performance time and amount of hardware resources, the proposed interpolation provided better PSNR, low complexity and less hardware resources than bicubic convolution interpolation.

• The Transactions of the Korea Information Processing Society
• /
• v.13 no.4
• /
• pp.189-198
• /
• 2024

Lipreading is one of the important parts of speech recognition, and several studies have been conducted to improve the performance of lipreading in lipreading systems for speech recognition. Recent studies have used method to modify the model architecture of lipreading system to improve recognition performance. Unlike previous research that improve recognition performance by modifying model architecture, we aim to improve recognition performance without any change in model architecture. In order to improve the recognition performance without modifying the model architecture, we refer to the cues used in human lipreading and set other regions such as chin and cheeks as regions of interest along with the lip region, which is the existing region of interest of lipreading systems, and compare the recognition rate of each region of interest to propose the highest performing region of interest In addition, assuming that the difference in normalization results caused by the difference in interpolation method during the process of normalizing the size of the region of interest affects the recognition performance, we interpolate the same region of interest using nearest neighbor interpolation, bilinear interpolation, and bicubic interpolation, and compare the recognition rate of each interpolation method to propose the best performing interpolation method. Each region of interest was detected by training an object detection neural network, and dynamic time warping templates were generated by normalizing each region of interest, extracting and combining features, and mapping the dimensionality reduction of the combined features into a low-dimensional space. The recognition rate was evaluated by comparing the distance between the generated dynamic time warping templates and the data mapped to the low-dimensional space. In the comparison of regions of interest, the result of the region of interest containing only the lip region showed an average recognition rate of 97.36%, which is 3.44% higher than the average recognition rate of 93.92% in the previous study, and in the comparison of interpolation methods, the bilinear interpolation method performed 97.36%, which is 14.65% higher than the nearest neighbor interpolation method and 5.55% higher than the bicubic interpolation method. The code used in this study can be found a https://github.com/haraisi2/Lipreading-Systems.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2017.05a
• /
• pp.343-345
• /
• 2017

In digital era image processing has been utilized in a variety of media such as TV, camera and smart phone. However, in the process of analyzing, recognizing, and processing image data, deterioration occurs due to various causes and Salt & Pepper noise occurs. Typical methods for removing such noise include SMF, CWMF, and SWMF. However, existing methods have a somewhat poor noise canceling characteristic in Salt & Pepper noise environment. Therefore, in this paper, we propose an algorithm to remove Salt & Pepper noise effectively by using bilinear interpolation method and median filter according to noise density of local mask. And using the PSNR(Peak Signal to Noise Ratio) it compared to the existing methods and their performance in order to determine the performance of the proposed method.

• Proceedings of the Korean Information Science Society Conference
• /
• 2007.10c
• /
• pp.443-446
• /
• 2007

원영상과 목적영상 사이의 원근 변환(projective transform)에 의해서 생성되는 조강도 영상은 영상의 확대와 축소가 동시에 일어나는 특징을 가지고 있다. 조감도 영상을 구성하는 과정은 원영상의 위치에 따라서 원영상을 확대하거나 축소하여 목적영상을 만들어 내기 때문에, 원영상의 확대와 축소영역을 목적영상에 적합하게 나타내기 위한 보간법이 필요하다. 이중선형 보간법(bilinear interpolation)은 낮은 연산량 때문에 영상변환에 많이 사용되는 보간법이다. 하지만 영상의 확대와 축소 영역에서는 흐려지거나 에일리어싱(aliasing) 효과에 의한 아티팩트(artifact)가 일어나는 문제점을 가지고 있다. 이러한 문제점을 개선하기 위해서 고주파성분을 유지하는 에지(edge)정보 기반의 변형된 EWA를 사용 한다. 그리고 엔티 에일리어싱(anti-aliasing)을 수행하는 MIP-mapping을 이용한 보간법을 통해서 축소 영역에서 발생하는 에일리어싱 문제를 해결하여 조감도 영상의 화질을 개선한다.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.4 no.1
• /
• pp.58-71
• /
• 1986

A Digital Terrain Model (DTM) consists of two components;one is sampling of the terrain imformation, and the other is interpolation. The present study aims at the investigation of the accuracy and efficiency of Moving Average and Linear Prediction interpolation methods by numerical experiment. Basic input data are the elerations in square grid which procured by photogrammetry, and the accuracy of each interpolation is investigated on different grid size, terrain type and pattern of reference points.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2011.11a
• /
• pp.139-142
• /
• 2011

본 논문에서는 이산 웨이블릿 변환(Discrete Wavelet Transform : DWT)을 이용한 새로운 초고해상도 기법을 제안한다. 제안된 기법에서는 DWT 수행 시 수반되는 다운 샘플링 과정을 수행하지 않음으로써 입력 받은 영상과 동일한 크기의 고주파 부대역(sub-band)들을 생성하고, 이 부대역들과 입력 받은 영상을 조합하여 이산 웨이블릿 역변환(Inverse Discrete Wavelet Transform : Inverse DWT)을 수행함으로써 고해상도의 영상을 획득한다. 실험을 통하여 제안된 기법이 이중 선형 보간법(bilinear interpolation)에 비해 향상된 효율을 보이며, 확률 기반의 기법들에 비해 처리시간도 줄어드는 것을 확인하였다.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.38A no.2
• /
• pp.164-173
• /
• 2013

In this paper, we propose multi-frame based super resolution algorithm by using motion vector normalization and edge pattern analysis. Existing algorithms have constraints of sub-pixel motion and global translation between frames. Thus, applying of algorithms is limited. And single-frame based super resolution algorithm by using discrete wavelet transform which robust to these problems is proposed but it has another problem that quantity of information for interpolation is limited. To solve these problems, we propose motion vector normalization and edge pattern analysis for 2*2 block motion estimation. The experimental results show that the proposed algorithm has better performance than other conventional algorithms.

• 한국HCI학회:학술대회논문집
• /
• 2008.02a
• /
• pp.607-611
• /
• 2008

This paper proposes new video signature using spatio-temporal information for copy detection. The proposed video copy detection method is based on concentric circle partitioning method for each key frame. Firstly, key frames are extracted from whole video using temporal bilinear interpolation periodically and each frame is partitioned as a shape of concentric circle. For the partitioned sub-regions, 4 feature distributions of average intensity, its difference, symmetric difference and circular difference distributions are obtained by using the relation between the sub-regions. Finally these feature distributions are converted into binary signature by using simple hash function and merged together. For the proposed video signature, the similarity distance is calculated by simple Hamming distance so that its matching speed is very fast. From experiment results, the proposed method shows high detection success ratio of average 97.4% for various modifications. Therefore it is expected that the proposed method can be utilized for video copy detection widely.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.50 no.9
• /
• pp.194-200
• /
• 2013

In this paper, we propose a multi-scale crack detection method using scaling. It is based on morphology algorithm, crack features, and scaling. We use a morphology operator which extracts patterns of crack. It segments cracks and background using opening and closing operations. Morphology based segmentation is better than existing integration methods using subtraction in detecting a crack it has small width. However, morphology methods using only one structure element could detect only fixed width crack. Thus, we use a scaling method. We use bilinear interpolation for scaling. Our method calculates values of properties such as the number of pixels and the maximum length of the segmented region. We decide whether the segmented region belongs to cracks according to those data. Experimental results show that our proposed multi-scale crack detection method has better results than those of existing detection methods.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.37 no.6A
• /
• pp.464-472
• /
• 2012

In this paper, we propose a new super-resolution algorithm that uses successive frames by applying the block matching motion estimation algorithm. Usually, single frame super-resolution algorithms are based on probability or discrete wavelet transform (DWT) approach to extract high-frequency components of the input image, but only limited information is available for these algorithms. To solve this problem, various multiple-frame based super-resolution algorithms are proposed. The accuracy of registration between frames is a very important factor for the good performance of an algorithm. We therefore propose an algorithm using 6-Tap FIR filter to increase the accuracy of the image registration with sub-pixel unit. Proposed algorithm shows better performance than other conventional interpolation based algorithms such as nearest neighborhood, bi-linear and bi-cubic methods and results in about the same image quality as DWT based super-resolution algorithm.