• Proceedings of the IEEK Conference
• /
• 2008.06a
• /
• pp.927-928
• /
• 2008

In this paper, a interpolation error concealment algorithm of motion compensated interpolated frame for motion compensated frame rate conversion to reduce the block artifacts caused by failure of conventional motion estimation based on block matching algorithm is proposed. Experimental results show good performance of the proposed scheme with significant reduction of the block artifacts.

• Journal of Web Engineering
• /
• v.20 no.8
• /
• pp.2413-2432
• /
• 2021

Recently, the demand for high-quality video content has rapidly been increasing, led by the development of network technology and the growth in video streaming platforms. In particular, displays with a high refresh rate, such as 120 Hz, have become popular. However, the visual quality is only enhanced if the video stream is produced at the same high frame rate. For the high quality, conventional videos with a low frame rate should be converted into a high frame rate in real time. This paper introduces a bidirectional intermediate flow estimation method for real-time video frame interpolation. A bidirectional intermediate optical flow is directly estimated to predict an accurate intermediate frame. For real-time processing, multiple frames are interpolated with a single intermediate optical flow and parts of the network are implemented in 16-bit floating-point precision. Perceptual loss is also applied to improve the cognitive performance of the interpolated frames. The experimental results showed a high prediction accuracy of 35.54 dB on the Vimeo90K triplet benchmark dataset. The interpolation speed of 84 fps was achieved for 480p resolution.

• Proceedings of the IEEK Conference
• /
• 2000.09a
• /
• pp.429-432
• /
• 2000

We propose a new frame rate up-conversion algorithm for high quality video. In the proposed scheme bidirectional motion estimation (ME) is performed to construct the motion vector. (MV) field for the frame to be interpolated. Unlike conventional motion-compensated interpolation (MCI) algorithms, the proposed technique does not produce any overlapped pixel and hole region in the interpolated frame, and thus can utilize the overlapped block motion compensation technique to reduce the blocking artifacts. The proposed algoritm is very simple to implement on consumer products when compared to conventional MCI methods. Computer simulation shows a high visual performance of the proposed frame rate up-conversion algorithm.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.7 no.10
• /
• pp.2448-2463
• /
• 2013

The traditional block-based motion compensation methods in frame rate up-conversion (FRUC) only use a single uniquely motion vector field. However, there will always be some mistakes in the motion vector field whether the advanced motion estimation (ME) and motion vector analysis (MA) algorithms are performed or not. Once the motion vector field has many mistakes, the quality of the interpolated frame is severely affected. In order to solve the problem, this paper proposes a novel joint overlapped block motion compensation method (8J-OBMC) which adopts motion vectors of the interpolated block and its 8-neighbor blocks to jointly interpolate the target block. Since the smoothness of motion filed makes the motion vectors of 8-neighbor blocks around the interpolated block quite close to the true motion vector of the interpolated block, the proposed compensation algorithm has the better fault-tolerant capability than traditional ones. Besides, the annoying blocking artifacts can also be effectively suppressed by using overlapped blocks. Experimental results show that the proposed method is not only robust to motion vectors estimated wrongly, but also can to reduce blocking artifacts in comparison with existing popular compensation methods.

• Journal of Broadcast Engineering
• /
• v.21 no.4
• /
• pp.472-483
• /
• 2016

This paper proposes a blocking artifacts detection algorithm in frequency domain for MC-FRUC (Motion Compensated Frame Rate Up-Conversion). Conventional MC-FRUC algorithms occur blocking artifacts near interpolated block boundaries since motion compensation is performed from block-based motion vector. For efficiently decreasing blocking artifacts, this paper analyses frequency characteristics of the interpolated frame and reduces blocking artifacts on block boundaries. In experimental results the proposed method shows better subjective quality than some conventional FRUC method and also increases the PSNR(Peak Signal to Noise Ratio) value on average 0.45 dB compared with BDMC(Bi-Directional Motion Compensation).

• Journal of Korea Multimedia Society
• /
• v.17 no.7
• /
• pp.797-805
• /
• 2014

In this paper we propose a new frame rate up conversion scheme which is used to overcome the motion blur problem of liquid crystal display caused by its slow response. The conventional bilateral motion estimation method which is mainly used in the frame rate up conversion scheme has a drawback that it cannot find true motion vector if there are blocks with simple texture in the search range. To solve this problem, a texture adaptive bilateral motion estimation method that increases cost value of block with simple texture is proposed. Also a motion estimation scheme that utilizes neighboring motion vector effectively is proposed to reduce computation time required to estimate motion. Since the proposed scheme does not apply all available motion vectors within the search range, the execution time of frame rate up conversion can be reduced dramatically. Experimental results show that the interpolated frame image quality of the proposed method is improved in subjective as well as objective view point compared with that of the conventional method.

• The Journal of the Korea Contents Association
• /
• v.12 no.3
• /
• pp.1-8
• /
• 2012

Video FRUC (Frame Rate Up Conversion) has been a technique of great interest due to its diversified applications in consumer electronics. Most advanced FRUC algorithms adopt a motion interpolation technique to determine the motion vector field of interpolated frames. But, in some applications, it is necessary to evaluate how well the MCI (Motion Compensated Interpolation) frame is reconstructed. For this aim, this paper proposes a distortion estimation for motion compensated interpolation frame using frame-adaptive distortion estimation. The proposed method is applied for the symmetric motion estimation and compensated scheme and then analyzed by three different approaches, that is, forward estimation, backward estimation and adaptive bi-directional estimation schemes. Through computer simulations, it is shown that the proposed bi-directional estimation method outperforms others and can be effectively applied for FRUC.

• ETRI Journal
• /
• v.33 no.2
• /
• pp.295-298
• /
• 2011

We propose a motion-compensated frame interpolation method in which an accurate backward/forward motion vector pair (MVP) is estimated based on a parabolic motion model. A reliability measure for an MVP is also proposed to select the most reliable MVP for each interpolated block. The possibility of deformation of bidirectional corresponding blocks is estimated from the selected MVP. Then, each interpolated block is produced by combining corresponding blocks with the weights based on the possibility of deformation. Experimental results show that the proposed method improves PSNR performance by up to 2.8 dB as compared to conventional methods and achieves higher visual quality without annoying blockiness artifacts.

• The Journal of the Korea Contents Association
• /
• v.13 no.5
• /
• pp.28-36
• /
• 2013

Motion-compensated frame interpolation (MCFI) techniques in video signal processing have many application areas. Frame rate up-conversion (FRUC) or distributed video coding (DVC) technique needs an effective MCFI algorithm. For these applications, it is necessary to develop an effective post-processing technique to improve visual qualities or to reduce virtual channel noises, resulting in the reduced channel bit rate. This paper proposes a reliability evaluation method based on spatio-temporal characteristics for motion-compensated interpolated blocks. The proposed algorithm investigates the temporal matching characteristics for current frame and then is designed in such a way that it can measure temporal characteristics as well as the spatial ones. Through computer simulations, it is shown that the proposed method outperforms the conventional temporal matching method.

• Journal of Korea Society of Industrial Information Systems
• /
• v.24 no.1
• /
• pp.1-12
• /
• 2019

This paper proposes a new motion vector smoothing and motion compensation method to increase the frame rate of videos. The proposed method reduces false motion vector smoothing by improving the weight with reflecting accuracy to overcome the limitation of the conventional motion vector smoothing using the adaptively weighted vector median. Also, to improve the interpolated image quality of the conventional OBMC(Overlapped Block Motion Compensation), a scheme that divides an original block into 4 sub-blocks and then generates the interpolated frame using the reestimated motion vector for each sub-block is proposed. The simulation results prove that the proposed method can provide much better objective and subjective image quality than the conventional method.