• Title/Summary/Keyword: 계층적 비디오 부호화

Search Result 102, Processing Time 0.023 seconds

Intra Prediction Using Multiple Models Based on Fully Connected Neural Network (다중 모델을 이용한 완전연결 신경망 기반 화면내 예측)

  • Moon, Gihwa;Park, Dohyeon;Kim, Minjae;Kwon, Hyoungjin;Kim, Jae-Gon
    • Journal of Broadcast Engineering
    • /
    • v.26 no.6
    • /
    • pp.758-765
    • /
    • 2021
  • Recently, various research on the application of deep learning to video encoding for enhancing coding efficiency are being actively studied. This paper proposes a deep learning based intra prediction which uses multiple models by extending Matrix-based Intra Prediction(MIP) that is a neural network-based technology adopted in VVC. It also presents an efficient learning method for the multi-model intra prediction. To evaluate the performance of the proposed method, we integrated the VVC MIP and the proposed fully connected layer based multi-model intra prediction into HEVC reference software, HM16.19 as an additional intra prediction mode. As a result of the experiments, the proposed method can obtain bit-saving coding gain up to 0.47% and 0.19% BD-rate, respectively, compared to HM16.19 and VVC MIP.

A New Scanning Method for Network-adaptive Scalable Streaming Video Coding (네트워크에 적응적인 스케일러블 스트리밍 비디오 코딩을 위한 새로운 스캔 방법)

  • Park, Gwang-Hoon;Cheong, Won-Sik
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.8 no.3
    • /
    • pp.318-327
    • /
    • 2002
  • This paper Introduces a new scanning method for network-adaptive scalable streaming video coding methodologies such as the MPEG-4 Fine Granular Scalable (FGS) Coding. Proposed scanning method can guarantee the subjectively improved picture quality of the region of the interest in the decoded video by managing the image information of that interested region to be encoded and transmitted most-preferentially, and also to be decoded most-preferentially. Proposed scanning method can lead the FGS coding method to achieve improved picture quality, in about 1dB ~ 3dB better, especially on the region of interest.

Adaptive Hierarchical Hexagon Search Using Spatio-temporal Motion Activity (시공간 움직임 활동도를 이용한 적응형 계층 육각 탐색)

  • Kwak, No-Yoon
    • Journal of Digital Contents Society
    • /
    • v.8 no.4
    • /
    • pp.441-449
    • /
    • 2007
  • In video coding, motion estimation is a process to estimate the pixel of the current frame from the reference frame, which affects directly the predictive quality and the encoding time. This paper is related to AHHS(Adaptive Hierarchical Hexagon Search) using spatio-temporal motion activity for fast motion estimation. The proposed method defines the spatio-temporal motion activity of the current macroblock using the motion vectors of its spatio-temporally adjacent macroblocks, and then conventional AHS(Adaptive Hexagon Search) is performed if the spatio-temporal motion activity is lower, otherwise, hierarchical hexagon search is performed on a multi-layered hierarchical space constructed by multiple sub-images with low frequency in wavelet transform. In the paper, based on computer simulation results for multiple video sequences with different motion characteristics, the performance of the proposed method was analysed and assessed in terms of the predictive quality and the computational time. Experimental results indicate that the proposed method is both suitable for (quasi-) stationary and large motion searches. The proposed method could keep the merit of the adaptive hexagon search capable of fast estimating motion vectors and also adaptively reduce the local minima occurred in the video sequences with higher spatio-temporal motion activity.

  • PDF

A Fine Granular Scalable Video Coding Algorithm using Frequency Weighting (주파수 특성을 이용한 미세 계위적 동영상 부호화 방법)

  • 김승환;호요성
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.40 no.6
    • /
    • pp.124-131
    • /
    • 2003
  • In this paper, we propose a Progressive scalable video coding algorithm using frequency weighting in the DCT domain. Since the human visual system (HVS) can be modeled as a nonlinear point transformation, called the modulation transfer function (MTF), we tan use the frequency weighting matrix to enhance the video image quality. We change this frequency weighting matrix into the frequency shift matrix to apply to the bit-plane coding method for the fine granular scalable (FGS) video coding We also define a new error metric JNDE (just noticeable difference) to measure the perceptual image quality in terms of human vision.

Design and Performance Analysis of Exclusive-OR Based FEC Coding System for Error Resilient SVC Video Transmission (오류 강인 SVC 비디오 전송을 위한 Exclusive-OR 기반의 FEC 부호화 시스템 설계 및 성능 분석)

  • Lee, Hong-Rae;Jung, Tae-Jun;Shim, Sang-Woo;Kim, Jin-Soo;Seo, Kwang-Deok
    • Journal of Broadcast Engineering
    • /
    • v.18 no.6
    • /
    • pp.872-883
    • /
    • 2013
  • In this paper, we design and analyze performance of Exclusive-OR based FEC (Forward error correction) system to deploy SVC video transmission service over packet-loss prone IP network. In the designed system, we adopt standard compliant Exclusive-OR based FEC scheme and apply it to be appropriate to the hierarchical layer structure of SVC video. To verify the performance of the designed Exclusive-OR based FEC system for SVC video transmission, we employ NIST-NET based transport simulator. By the SVC video transmission using the NIST-NET based simulator, we confirm the error resilient transmission performance of the designed Exclusive-OR based FEC system.

Overview of Inter-Component Coding in 3D-HEVC (3D-HEVC를 위한 인터-컴포넌트 부호화 방법)

  • Park, Min Woo;Lee, Jin Young;Kim, Chanyul
    • Journal of Broadcast Engineering
    • /
    • v.20 no.4
    • /
    • pp.545-556
    • /
    • 2015
  • A HEVC-compatible 3D video coding method (3D-HEVC) has been recently developed as an extension of the high efficiency video coding (HEVC) standard. In order to efficiently deal with the multi-view video plus depth (MVD) format, 3D-HEVC exploits an inter-component prediction which allows the prediction between texture and depth map images in addition to a temporal prediction used in the conventional single layer video coding such as H.264/AVC and HEVC. The performance of the inter-component prediction is normally affected by the accuracy of the disparity vector, and thus it is important to have an accurate disparity vector used for the inter-component prediction. This paper, therefore, introduces a disparity derivation method and inter-component algorithms using the disparity vector for the efficient 3D video coding. Simulation results show that the 3D-HEVC provides higher coding performance compared with the simulcast approach using HEVC and the simple multi-view extension (MH-HEVC).

Study on Low Delay and Adaptive Video Transmission for a Surveillance System in Visual Sensor Networks (비디오 센서 망에서의 감시 체계를 위한 저지연/적응형 영상전송 기술 연구)

  • Lee, In-Woong;Kim, Hak-Sub;Oh, Tae-Geun;Lee, Sang-Hoon
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.39C no.5
    • /
    • pp.435-446
    • /
    • 2014
  • Even if it is important to transmit high rate multimedia information without any transmission errors for surveillance systems, it is difficult to achieve error-free transmission due to infra-less adhoc networks. In order to reduce the transmission errors furthermore, additional signal overheads or retransmission of signals should be required, but they may lead to transmission delay. This paper represents a study on low delay and adaptive video transmission for the unmanned surveillance systems by developing system protocols. In addition, we introduce an efficient and adaptive control algorithm using system parameters for exploiting unmanned surveillance system properly over multi-channels.

Channel-Adaptive Streaming Scheme to Guarantee Media Quality in Mobile WiMAX (모바일 와이맥스에서 채널 적응적인 미디어 품질 보장 기법)

  • Kim, Dong-Chil;Chung, Kwang-Sue
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.16 no.10
    • /
    • pp.990-994
    • /
    • 2010
  • Mobile WiMAX does not guarantee the media qualities because it does not consider the characteristics of video coding techniques. In this paper, PC-MCA(Priority-based Combining adaptive Modulation and Coding with ARQ), a priority based channel-adaptive streaming scheme, is proposed to guarantee media qualities. PC-MCA uses QoS scheduler by scheduling priority of the media and differentially controls modulation and coding schemes according to wireless channel condition and frame priorities. It also guarantees multimedia service quality through video decoding reliability.

Fast Motion Estimation for Variable Motion Block Size in H.264 Standard (H.264 표준의 가변 움직임 블록을 위한 고속 움직임 탐색 기법)

  • 최웅일;전병우
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.41 no.6
    • /
    • pp.209-220
    • /
    • 2004
  • The main feature of H.264 standard against conventional video standards is the high coding efficiency and the network friendliness. In spite of these outstanding features, it is not easy to implement H.264 codec as a real-time system due to its high requirement of memory bandwidth and intensive computation. Although the variable block size motion compensation using multiple reference frames is one of the key coding tools to bring about its main performance gain, it demands substantial computational complexity due to SAD (Sum of Absolute Difference) calculation among all possible combinations of coding modes to find the best motion vector. For speedup of motion estimation process, therefore, this paper proposes fast algorithms for both integer-pel and fractional-pel motion search. Since many conventional fast integer-pel motion estimation algorithms are not suitable for H.264 having variable motion block sizes, we propose the motion field adaptive search using the hierarchical block structure based on the diamond search applicable to variable motion block sizes. Besides, we also propose fast fractional-pel motion search using small diamond search centered by predictive motion vector based on statistical characteristic of motion vector.

Image Enhancement Techniques for MPEG-4 (MPEG-4 영상의 화질 개선에 관한 연구)

  • 김태근;신정호;백준기
    • Journal of Broadcast Engineering
    • /
    • v.2 no.2
    • /
    • pp.169-181
    • /
    • 1997
  • In this paper, we propose and discuss about image enhancement techniques for MPEG-4. which represents very low bit-rate, content-based. and object-based hierarchical audio-visual coding standard. The proposed enhancement technique removes undesired artifacts arising in the compression procedure and increase resolution in both spatial and temporal domains. In order to remove undesired artifacts. we divide the MPEG-4 video algorithm in two parts: MPEG-2 like part and the new part. For removing artifacts caused by the first part. we adopt the conventional blocking artifacts algorithm developed for MPEG-2. On the other hand for removing artifacts caused by the second part. we provide a new degradation model. and propose the corresponding image restoration method. For increasing resolution of the MPEG-4 images, we propose a general framework of multichannel image interpolation process. which includes both spatial and temporal interpolations. As the MPEG-4 standard is under development. various sophisticated techniques are considered. but research on image enhancement techniques is relatively underestimated. By this reason. additional image enhancement techniques will become very important issue in realization phase of MPEG-4.

  • PDF