Weight Distribution of Neural Networks in Computer Vision

컴퓨터 비전에서 신경망의 가중치 분포

Over the last decades, deep neural networks have demonstrated significant success in various tasks. To address the special vision task, choosing a hot network as backbone to extract feature is a common way in both research and industry project. However, the choice of backbone usually requires the expert experience and affects the performance of the classification task. In this work, we propose a novel idea to support backbone decision-making by exploring the feature attribution and weights distribution of hidden layers from various backbones. We first analyze the visualization of feature maps on different size object and different depth layers to observe learning ability. Then, we compared the variance of weights and feature in last three layers. Based on analysis of the feature and wights, we summarize the traits and commonalities of existing networks.