• Journal of Electrical Engineering and Technology
• /
• v.9 no.1
• /
• pp.363-371
• /
• 2014

In this paper, a new super-resolution algorithm is proposed by using successive frames for generating high-resolution frames with better quality than those generated by other conventional interpolation methods. Generally, each frame used for super-resolution must only have global translation and motions of sub-pixel unit to generate good result. However, the newly proposed MSR algorithm in this paper is exempt from such constraints. The proposed algorithm consists of three main processes; motion estimation for image registration, normalization of motion vectors, and pattern analysis of edges. The experimental results show that the proposed algorithm has better performance than other conventional algorithms.

• Journal of Broadcast Engineering
• /
• v.24 no.5
• /
• pp.775-784
• /
• 2019

Image stitching is a technique for solving the problem of narrow field of view of a camera by composing multiple images. Recently, as the use of content such as Panorama, Super Resolution, and 360 VR increases, the need for faster and more accurate image stitching technology is increasing. So far, many algorithms have been proposed to satisfy the required performance, but the objective evaluation method for measuring the accuracy has not been standardized. In this paper, we present the problems of PSNR and SSIM(Structural similarity index method) measurement methods and propose a Local Differential Pixel Mean method. The LDPM evaluation method that includes geometric similarity and brightness measurement information is proved through a test, and the advantages of the evaluation method are revealed through comparison with SSIM.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.17 no.1
• /
• pp.72-79
• /
• 2007

In this paper, It propose a new restoration algorithm of high resolution, which is reconstructed to high resolution image using low resolution image informations. The proposed algorithm is constructed based on super resolution theory, it is consisted of progressive steps of the integration and construction. It reduced a lot of data-processing capacity and noise with integration through sub-pixel movement and wavelet basis through a higher resolution. As a result, it is shown that the main information is maintained and the error rate is improved. Using expansion fuzzy wavelet B-spline interpolation in stage of construction, it is confirmed that we can achieve smoothing image and good resolution without blur and block.

• Journal of Korea Multimedia Society
• /
• v.17 no.10
• /
• pp.1150-1159
• /
• 2014

This paper proposes a method for extracting tissue cells from an organism image by an electron microscope and getting the whole cell number and the area from the cell. In general, the difference between the cell color and the background is used to extract tissue cell. However, there may be a problem when overlapped cells are seen as a single cell. To solve the problem, we split them by using cell size and curvature. This method has a 99% accuracy rate. To measure the cell area, we compute two areas, the inside and boundary of the cell. The inside is simply calculated by the number of pixels. The cell boundary is obtained by applying super sampling, linear interpolation, and cubic spline interpolation. It improves the error rate, 18%, 19%, and 120% respectively, in comparison to the counting method that counts a pixel area as 1.

• The Journal of Korea Robotics Society
• /
• v.18 no.3
• /
• pp.260-270
• /
• 2023

We introduce a novel Visual Inertial Odometry (VIO) algorithm designed to improve the performance of thermal-inertial odometry. Thermal infrared image, though advantageous for feature extraction in low-light conditions, typically suffers from a high noise level and significant information loss during the 8-bit conversion. Our algorithm overcomes these limitations by approximating a 14-bit raw pixel histogram into a Gaussian mixture model. The conversion method effectively emphasizes image regions where texture for visual tracking is abundant while reduces unnecessary background information. We incorporate the robust learning-based feature extraction and matching methods, SuperPoint and SuperGlue, and zero velocity detection module to further reduce the uncertainty of visual odometry. Tested across various datasets, the proposed algorithm shows improved performance compared to other state-of-the-art VIO algorithms, paving the way for robust thermal-inertial odometry.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.22 no.5
• /
• pp.185-191
• /
• 2022

In this study, we propose a novel super-resolution neural network based on U-Net, residual neural network, and sub-pixel convolution. To prevent the loss of detailed information due to the max pooling of U-Net, we propose down-sampling and connection using sub-pixel convolution. This uses all pixels in the filter, unlike the max pooling that creates a new feature map with only the max value in the filter. As a 2×2 size filter passes, it creates a feature map consisting only of pixels in the upper left, upper right, lower left, and lower right. This makes it half the size and quadruple the number of feature maps. And we propose two methods to reduce the computation. The first uses sub-pixel convolution, which has no computation, and has better performance, instead of up-convolution. The second uses a layer that adds two feature maps instead of the connection layer of the U-Net. Experiments with a banchmark dataset show better PSNR values on all scale and benchmark datasets except for set5 data on scale 2, and well represent local area patterns.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.17 no.7
• /
• pp.1672-1686
• /
• 2013

In this paper, we propose a hybrid super-resolution algorithm robust to cut-change. Existing single-frame based super-resolution algorithms are usually fast, but quantity of information for interpolation is limited. Although the existing multi-frame based super-resolution algorithms generally robust to this problem, the performance of algorithm strongly depends on motions of input video. Furthemore at boundary of cut, applying of the algorithm is limited. In the proposed method, we detect a define boundary of cut using cut-detection algorithm. Then we adaptively apply a single-frame based super-resolution method to detected cut. Additionally, we propose algorithms of normalizing motion vector and analyzing pattern of edge to solve various problems of existing super-resolution algorithms. The experimental results show that the proposed algorithm has better performance than other conventional interpolation methods.

• Journal of Advanced Navigation Technology
• /
• v.18 no.2
• /
• pp.151-157
• /
• 2014

Recently UAV(unmanned aerial vehicle) is frequently used not only for military purpose but also for civil purpose. UAV automatically navigates following the coordinates input in advance using GPS information. However it is impossible when GPS cannot be received because of jamming or external interference. In order to solve this problem, we propose a real-time segmentation and classification algorithm for the specific regions from UAV image in this paper. We use the super-pixels algorithm using graph-based image segmentation as a pre-processing stage for the feature extraction. We choose the most ideal model by analyzing various color models and mixture color models. Also, we use support vector machine for classification, which is one of the machine learning algorithms and can use small quantity of training data. 18 color and texture feature vectors are extracted from the UAV image, then 3 classes of regions; river, vinyl house, rice filed are classified in real-time through training and prediction processes.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.31 no.6_2
• /
• pp.559-565
• /
• 2013

Spatial resolution of land covers from remotely sensed images can be increased using super-resolution mapping techniques for soft-classified land cover proportions. A further development of super-resolution mapping technique is downscaling the original remotely sensed image using super-resolution mapping techniques with a forward model. In this paper, the model for increasing spatial resolution of remote sensing multispectral image is tested with real SPOT 5 imagery at 10m spatial resolution for an area in Bac Giang Province, Vietnam in order to evaluate the feasibility of application of this model to the real imagery. The soft-classified land cover proportions obtained using a fuzzy c-means classification are then used as input data for a Hopfield neural network (HNN) to predict the multispectral images at sub-pixel spatial resolution. The 10m SPOT multispectral image was improved to 5m, 3,3m and 2.5m and compared with SPOT Panchromatic image at 2.5m resolution for assessment.Visually, the resulted image is compared with a SPOT 5 panchromatic image acquired at the same time with the multispectral data. The predicted image is apparently sharper than the original coarse spatial resolution image.

• Journal of the Korea Convergence Society
• /
• v.11 no.3
• /
• pp.19-26
• /
• 2020

In this paper, we propose a method to analyze the loss region of the dictionary-based super resolution result learned for image quality improvement and to map the learning data according to the analyzed loss region. In the conventional learned dictionary-based method, a result different from the feature configuration of the input image may be generated according to the learning image, and an unintended artifact may occur. The proposed method estimate loss information of low resolution images by analyzing the reconstructed contents to reduce inconsistent feature composition and unintended artifacts in the example-based super resolution process. By mapping the training data according to the final interpolation feature map, which improves the noise and pixel imbalance of the estimated loss information using a Gaussian-based kernel, it generates super resolution with improved noise, artifacts, and staircase compared to the existing super resolution. For the evaluation, the results of the existing super resolution generation algorithms and the proposed method are compared with the high-definition image, which is 4% better in the PSNR (Peak Signal to Noise Ratio) and 3% in the SSIM (Structural SIMilarity Index).