• Title/Summary/Keyword: Neural Network Compression

Search Result 120, Processing Time 0.026 seconds

Predicting concrete properties using neural networks (NN) with principal component analysis (PCA) technique

  • Boukhatem, B.;Kenai, S.;Hamou, A.T.;Ziou, Dj.;Ghrici, M.
    • Computers and Concrete
    • /
    • v.10 no.6
    • /
    • pp.557-573
    • /
    • 2012
  • This paper discusses the combined application of two different techniques, Neural Networks (NN) and Principal Component Analysis (PCA), for improved prediction of concrete properties. The combination of these approaches allowed the development of six neural networks models for predicting slump and compressive strength of concrete with mineral additives such as blast furnace slag, fly ash and silica fume. The Back-Propagation Multi-Layer Perceptron (BPMLP) with Bayesian regularization was used in all these models. They are produced to implement the complex nonlinear relationship between the inputs and the output of the network. They are also established through the incorporation of a huge experimental database on concrete organized in the form Mix-Property. Thus, the data comprising the concrete mixtures are much correlated to each others. The PCA is proposed for the compression and the elimination of the correlation between these data. After applying the PCA, the uncorrelated data were used to train the six models. The predictive results of these models were compared with the actual experimental trials. The results showed that the elimination of the correlation between the input parameters using PCA improved the predictive generalisation performance models with smaller architectures and dimensionality reduction. This study showed also that using the developed models for numerical investigations on the parameters affecting the properties of concrete is promising.

Discrimination of Multi-PD sources using wavelet 2D compression for T-F distribution of PD pulse waveform (부분방전 펄스파형의 시간-주파수분포의 웨이블렛 2D 압축기술을 이용한 복합부분방전원의 식별)

  • Lee, K.W.;Kim, M.Y.;Baik, K.S.;Kang, S.H.;Lim, K.J.
    • Proceedings of the KIEE Conference
    • /
    • 2004.07c
    • /
    • pp.1784-1786
    • /
    • 2004
  • PD(Partial Discharge) signal emitted from PD sources has their intrinsic features in the region of time and frequency. STFT(Short Time Fourier Transform) shows time-frequency distribution at the same time. 2-Dimensional matrices(33${\times}$77) from STFT for PD pulse signals are a good feature vectors and can be decreased in dimension by wavelet 2D data compression technique. Decreased feature vectors(13${\times}$24) were used as inputs of Back-propagation ANN(Artificial Neural Network) for discrimination of Multi-PD sources(air discharge sources(3), surface discharge(1)). They are a good feature vectors for discriminating Multi-PD sources.

  • PDF

Efficient 2D Smoke Synthesis with Cartesian Coordinates System Based Node Compression (데카르트 좌표계 기반 노드 압축을 이용한 효율적인 2차원 연기 합성)

  • Kim, Donghui;Kim, Jong-Hyun
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2021.07a
    • /
    • pp.659-660
    • /
    • 2021
  • 본 논문에서는 데카르트 좌표계 기반으로 노드를 압축함으로써 SR(Super-resolution) 기반 연기 합성을 효율적으로 처리할 수 있는 방법을 제안한다. 제안하는 방법은 다운 스케일링과 이진화를 통하여 연기 시뮬레이션의 계산 공간을 효율적으로 줄이고, 데카르트 좌표계 축을 기준으로 쿼드트리의 말단 노드를 압축함으로써 네트워크의 입력으로 전달하는 데이터 개수를 줄인다. 학습에 사용된 데이터는 COCO 2017 데이터셋이며, 인공신경망은 VGG19 기반 네트워크를 사용한다. 컨볼루션 계층을 거칠 때 데이터의 손실을 막기 위해 잔차(Residual)방식과 유사하게 이전 계층의 출력 값을 더해주며 학습한다. 결과적으로 제안하는 방법은 이전 결과에 비해 네트워크로 전달해야 하는 데이터가 압축되어 개수가 줄어드는 결과를 얻었으며, 그로 인해 네트워크 단계에서 필요한 I/O 과정을 효율적으로 처리할 수 있게 되었다.

  • PDF

Compression of CNN Using Local Nonlinear Quantization in MPEG-NNR (MPEG-NNR 의 지역 비선형 양자화를 이용한 CNN 압축)

  • Lee, Jeong-Yeon;Moon, Hyeon-Cheol;Kim, Sue-Jeong;Kim, Jae-Gon
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2020.07a
    • /
    • pp.662-663
    • /
    • 2020
  • 최근 MPEG 에서는 인공신경망 모델을 다양한 딥러닝 프레임워크에서 상호운용 가능한 포맷으로 압축 표현할 수 있는 NNR(Compression of Neural Network for Multimedia Content Description and Analysis) 표준화를 진행하고 있다. 본 논문에서는 MPEG-NNR 에서 CNN 모델을 압축하기 위한 지역 비선형 양자화(Local Non-linear Quantization: LNQ) 기법을 제시한다. 제안하는 LNQ 는 균일 양자화된 CNN 모델의 각 계층의 가중치 행렬 블록 단위로 추가적인 비선형 양자화를 적용한다. 또한, 제안된 LNQ 는 가지치기(pruning)된 모델의 경우 블록내의 영(zero) 값의 가중치들은 그대로 전송하고 영이 아닌 가중치만을 이진 군집화를 적용한다. 제안 기법은 음성 분류를 위한 CNN 모델(DCASE Task)의 압축 실험에서 기존 균일 양자화를 대비 동일한 분류 성능에서 약 1.78 배 압축 성능 향상이 있음을 확인하였다.

  • PDF

Detection of Frame Deletion Using Convolutional Neural Network (CNN 기반 동영상의 프레임 삭제 검출 기법)

  • Hong, Jin Hyung;Yang, Yoonmo;Oh, Byung Tae
    • Journal of Broadcast Engineering
    • /
    • v.23 no.6
    • /
    • pp.886-895
    • /
    • 2018
  • In this paper, we introduce a technique to detect the video forgery by using the regularity that occurs in the video compression process. The proposed method uses the hierarchical regularity lost by the video double compression and the frame deletion. In order to extract such irregularities, the depth information of CU and TU, which are basic units of HEVC, is used. For improving performance, we make a depth map of CU and TU using local information, and then create input data by grouping them in GoP units. We made a decision whether or not the video is double-compressed and forged by using a general three-dimensional convolutional neural network. Experimental results show that it is more effective to detect whether or not the video is forged compared with the results using the existing machine learning algorithm.

Flow Softening Behavior during the High Temperature Deformation of AZ31 Mg alloy (AZ31 Mg 합금의 고온 변형 시의 동적 연화 현상)

  • Lee, Byoung-Ho;Reddy, N.S.;Yeom, Jong-Teak;Lee, Chong-Soo
    • Proceedings of the Korean Society for Technology of Plasticity Conference
    • /
    • 2006.05a
    • /
    • pp.70-73
    • /
    • 2006
  • In the present study, the flow-softening behavior occurring during high temperature deformation of AZ31 Mg alloy was investigated. Flow softening of AZ31 Mg alloy was attributed to (1) thermal softening by deformation heating and (2) microstructural softening by dynamic recrystallization. Artificial neural networks method was used to derive the accurate amounts of thermal softening by deformation heating. A series of mechanical tests (High temperature compression and load relaxation tests) was conducted at various temperatures ($250^{\circ}C{\sim}500^{\circ}C$) and strain rates ($10^{-4}/s{\sim}100/s$) to formulate the recrystallization kinetics and grain size relation. The effect of DRX kinetics on microstructure evolution (fraction of recrystallization) was evaluated by the unified SRX/DRX (static recrystallization/dynamic recrystallization) approaches

  • PDF

Lightweight CNN-based Expression Recognition on Humanoid Robot

  • Zhao, Guangzhe;Yang, Hanting;Tao, Yong;Zhang, Lei;Zhao, Chunxiao
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.3
    • /
    • pp.1188-1203
    • /
    • 2020
  • The human expression contains a lot of information that can be used to detect complex conditions such as pain and fatigue. After deep learning became the mainstream method, the traditional feature extraction method no longer has advantages. However, in order to achieve higher accuracy, researchers continue to stack the number of layers of the neural network, which makes the real-time performance of the model weak. Therefore, this paper proposed an expression recognition framework based on densely concatenated convolutional neural networks to balance accuracy and latency and apply it to humanoid robots. The techniques of feature reuse and parameter compression in the framework improved the learning ability of the model and greatly reduced the parameters. Experiments showed that the proposed model can reduce tens of times the parameters at the expense of little accuracy.

Fault Detection and Diagnosis of an Agitator Using the Wavelet Transform (웨이브렛 변환을 이용한 교반기의 고장감지 및 진단)

  • 서동욱;전도영
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.8 no.10
    • /
    • pp.851-855
    • /
    • 2002
  • This paper proposes a method of fault detection and diagnosis of agitators based on the wavelet analysis of the current and vibration signals. The wavelet transform has received considerable interest in the fields of acoustics, communication, image compression, vision. and seismic since it provides the fast and effective means of analyzing signals recorded during operation. Neural network is used to diagnose the fault. Specifically, the proposed approach consists of (i) fault detection, (ii) feature extraction, and (iii) classification of fault types. The results show an effective application of the wavelet analysis on the monitoring of an agitator.

Detection of MIsfired Engine Cylinder by Using Directional Power Spectra of Vibration Signals (진동 신호의 방향 파워 스펙트럼을 이용한 엔진의 실화 실린더 탐지)

  • 한윤식;한우섭;이종원
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.1 no.2
    • /
    • pp.49-59
    • /
    • 1993
  • A new signal processing technique is applied to four-cylinder spark and compression ignition engines for the diagnosis of power faults inside the cylinders. This technique utilizes two-sided directional power spectra(예S) of complex vibration signals measured from engine blocks as the patterns for engine cylinder power faults. The dPSs feature that they give not only the frequency contents but also the directivity of the engine block motion. For the automatic detection/diagnosis of cylinder power faults, pattern recognition method using multi-layer neural networks is employed. Experimental results show that the sucess rate for diagnosis of cylinder power faults using dPSs is higher than that using the conventional one-sided power spectra. The proposed technique is also tested to check the robustness to the sensor position and the engine rotational speed.

  • PDF

Deep Learning based HEVC Double Compression Detection (딥러닝 기술 기반 HEVC로 압축된 영상의 이중 압축 검출 기술)

  • Uddin, Kutub;Yang, Yoonmo;Oh, Byung Tae
    • Journal of Broadcast Engineering
    • /
    • v.24 no.6
    • /
    • pp.1134-1142
    • /
    • 2019
  • Detection of double compression is one of the most efficient ways of remarking the validity of videos. Many methods have been introduced to detect HEVC double compression with different coding parameters. However, HEVC double compression detection under the same coding environments is still a challenging task in video forensic. In this paper, we introduce a novel method based on the frame partitioning information in intra prediction mode for detecting double compression in with the same coding environments. We propose to extract statistical feature and Deep Convolution Neural Network (DCNN) feature from the difference of partitioning picture including Coding Unit (CU) and Transform Unit (TU) information. Finally, a softmax layer is integrated to perform the classification of the videos into single and double compression by combing the statistical and the DCNN features. Experimental results show the effectiveness of the statistical and the DCNN features with an average accuracy of 87.5% for WVGA and 84.1% for HD dataset.