• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.47 no.4
• /
• pp.1-8
• /
• 2010

This paper proposes a new frame rate up-conversion method. First, the proposed triple frame-based bidirectional motion estimation method reduce block artifacts in the interpolated frame by solving the wrong motion estimation in the area with similar characteristics. Second, the proposed motion vector smoothing reduces outliers, which result in block artifacts, considering the spatio-temporal neighboring motion vectors. In the experiments, the proposed frame rate up-conversion method improves the average PSNR and SSIM by up to 4.337 dB and 0.089, respectively, compared to the existing methods.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.46 no.3
• /
• pp.28-36
• /
• 2009

In this paper, we propose a frame-rate up-conversion method for temporal quality enhancement. The proposed method adaptively changes search range during hierarchical motion estimation and reconstructs hole regions using the proposed bi-direction prediction and linear interpolation. In order to alleviate errors due to inaccurate motion vector estimation, search range is adaptively changed based on reliability and for more accurate, motion estimation is performed in descending order of block variance. After segmentation of background and object regions, for filling hole regions, the pixel values of background regions are reconstructed using linear interpolation and those of object regions are compensated based on the proposed hi-directional prediction. The proposed algorithm is evaluated in terms of PSNR with original uncompressed sequences. Experimental results show that the proposed algorithm is better than conventional methods by around 2dB, and blocky artifacts and blur artifacts are significantly diminished.

• Proceedings of the KIEE Conference
• /
• 1995.11a
• /
• pp.502-504
• /
• 1995

In video image compression, it is important to extract the exact notion information from image sequence in order to perform the data compression, the field rate conversion, and the motion compensated interpolation effectively. It is well known that the location of the smallest sum of absolute difference(SAD) does not always give the true motion vector(MV) since the MV obtained via full block search is often corrupted by noise. In this paper, we first classifies the input blocks into 3 categories : the background, the shade-motion, and the edge-motion. According to the characteristics of the classified blocks, multiple locations of relatively small SAD are searched with an adaptive search window by using the proposed method. The proposed method picks MVs among those candidates by using temporal correlation. Since temporal correlation reveals the noise level in a particular region of the video image sequence, we are able to reduce the search are very effectively.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.33 no.4C
• /
• pp.312-320
• /
• 2008

The macroblock-based adaptive interpolation filter method has been considered to be able to achieve high coding efficiency in H.264/AVC. In this method, although the filter selection criterion considered in terms of rate and distortion have showed a good performance, it still leaves room for improvement. To improve high coding efficiency better than conventional method, we propose a new filter selection criterion which considers two bit rates, motion vector and prediction error, and reconstruction error. In addition, the algorithm for reducing the overhead of transmitting the selected filter information is presented. Experimental results show that the proposed method significantly improves the coding efficiency compared to ones using conventional criterion. It leads to about a 5.19% (1 reference frame) and 5.14% (5 reference frames) bit rate savings on average compared to H.264/AVC, respectively.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.44 no.5
• /
• pp.73-83
• /
• 2007

In this paper, we propose macroblock(MB)-based adaptive interpolation filter method for improving coding efficiency in H.264/AVC. In the proposed method, nine separable two-dimensional(2D) interpolation filters are applied for precisely compensating motions in various directions. The optimal cost function which considers the bit rate and distortion for coding the MB is defined. The filter is adaptively selected per MB for minimizing the defined cost function. In the experimental results, the proposed method shows more excellent in coding efficiency than the conventional methods for the various standard $QCIF(176{\times}144)/CIF(352{\times}288)$ video test sequences. It leads to about 6.25%(1 reference frame) and 3.46%(5 reference frames) bit rate reduction on average compared to the H.264/AVC.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.35 no.3C
• /
• pp.278-286
• /
• 2010

Motion Compensated Frame Interpolation(MCFI) has been used to reduce motion jerkiness for dynamic scenes and motion blurriness for LCD-panel display as post processing for large screen and full HD(high definition) display. Conventionally, block matching algorithms (BMA) are widely used to do motion estimation for simplicity of implementation. However, there are still several drawbacks. So in this paper, we propose a novel shape-based ME algorithm to increase accuracy and reduce ME computational cost. To increase ME accuracy, we do motion estimation based on shape of moving objects. And only moving areas are included for motion estimation to reduce computational cost. The results show that the computational cost is 25 % lower than full search BMA, while the performance is similar or is better, especially in the fast moving region.

• The Journal of the Acoustical Society of Korea
• /
• v.35 no.2
• /
• pp.125-133
• /
• 2016

In order to obtain high-resolution seafloor images, research on SA (Synthetic Aperture) processing and the development of related underwater systems have been performed in many countries. Recently the SA processing is also recognized as an important technique in Korea and researchers started related basic study. However, most previous studies ignored the Doppler effect by a moving receiver array. In this paper reconstructed SAS (Synthetic Aperture Sonar) images and position errors are analyzed according to the speed of a moving array for understanding its moving effect on the SAS images. In the analysis the spatial frequency domain interpolation algorithm is used. The results show that as the moving speed of the array increases the estimated position error also increases and image distortion gets worse when we do not consider the array motion. However, if the compensated receiver signals considering the array motion are used the position error and image distortion can be eliminated. In conclusion a signal processing scheme which compensates the Doppler effect is necessary especially in the condition where the array speed is over 1 m/s.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.35 no.11C
• /
• pp.940-947
• /
• 2010

Motion Compensated Frame Interpolation(MCFI) has been used to reduce motion jerkiness for dynamic scenes and motion blurriness for LCD-panel display as post processing for high quality display. However, MCFI that directly uses the motion information often suffers from annoying artifacts such as blockiness, ghost effects, and deformed structures. So in this paper, we propose a novel edge-based adaptively weighted vector median filter as post-processing. At first, the proposed method generates an edge direction map through a sobel mask and a weighted maximum frequent filter. And then, outlier MVs are removed by average of angle difference and replaced by a median MV of $3{\times}3$ window. Finally, weighted vector median filter adjusts the weighting values based on edge direction derived from spatial coherence between the edge direction continuity and motion vector. The results show that the performance of PSNR and SSIM are higher up to 0.5 ~ 1 dB and 0.4 ~ 0.8 %, respectively.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.43 no.2 s.308
• /
• pp.12-18
• /
• 2006

This paper presents a method to extract a good high-resolution image from a low-resolution video in an automatic manner. Since a high-resolution image reconstruction method utilizing several low-resolution input images works better than a conventional interpolation method utilizing single low-resolution input image only if the input images are well registered onto a common high-resolution grid, low-resolution input images should be carefully chosen so that the registration errors can be carefully considered. In this paper, the statistics obtained from the motion-compensated low-resolution images are utilized to evaluate the feasibility of the input image candidates. Maximum motion-compensation error is estimated from the high-resolution image observation model. U the motion-compensation error of the input image candidate is greater than the estimated maximum motion-compensation error, the input image candidate is discarded. The number of good input image candidates and the statistics of the motion-compensation errors are used to choose final input images. The final input images chosen from the input image selection block are given to the following high-resolution image reconstruction block. It is expected that the proposed method is utilized to extract a good high-resolution image efficiently from a low-resolution video without any user intervention.

• Journal of the Korean Institute of Telematics and Electronics S
• /
• v.36S no.12
• /
• pp.85-96
• /
• 1999

In a number of predictive video compression standards, the motion is compensated by the block-based motion compensation (BMC). The effective motion field used for the prediction by the BMC is obviously discontinuous since one motion vector is used for the entire macro-block. The usage of discontinuous motion field for the prediction causes the blocky artifacts and one obvious approach for eliminating such artifacts is to use a smoothed motion field. The optimal procedure will depend on the type of motion within the video. In this paper, several procedures for the motion vectors are considered. For any interpolation or approaches, however, the motion vectors as provided by the block matching algorithm(BMA) are no longer optimal. The optimum motion vectors(still one per macro-block) must minimize the of the displaced frame difference (DFD). We propose a unified algorithm that computes the optimum motion vectors to minimize the of the DFD using a conjugate gradient search. The proposed algorithm has been implemented and tested for the affine transformation based motion compensation (ATMC), the bilinear transformation based motion compensation (BTMC) and our own filtered motion compensation(FMC). The performance of these different approaches will be compared against the BMC.