Content-Adaptive Model Update of Convolutional Neural Networks for Super-Resolution

  • Ki, Sehwan (Korea Advanced Institute of Science and Technology Dep. Of Electronic Engineering) ;
  • Kim, Munchurl (Korea Advanced Institute of Science and Technology Dep. Of Electronic Engineering)
  • 기세환 (한국과학기술원 전기 및 전자 공학과) ;
  • 김문철 (한국과학기술원 전기 및 전자 공학과)
  • Published : 2020.11.28

Abstract

Content-adaptive training and transmission of the model parameters of neural networks can boost up the SR performance with higher restoration fidelity. In this case, efficient transmission of neural network parameters are essentially needed. Thus, we propose a novel method of compressing the network model parameters based on the training of network model parameters in the sense that the residues of filter parameters and content loss are jointly minimized. So, the residues of filter parameters are only transmitted to receiver sides for different temporal portions of video under consideration. This is advantage for image restoration applications with receivers (user terminals) of low complexity. In this case, the user terminals are assumed to have a limited computation and storage resource.

Keywords