• Title/Summary/Keyword: DNN Model

Search Result 230, Processing Time 0.021 seconds

DNN based Binary Classification Model by Particular Matter Concentration (DNN 기반의 미세먼지 농도별 이진 분류 모델)

  • Lee, Jong-sung;Jung, Yong-jin;Oh, Chang-heon
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2021.05a
    • /
    • pp.277-279
    • /
    • 2021
  • There is a problem that learning of a prediction model is not well performed depending on the characteristics of each particular matter concentration. To solve this problem, it is necessary to design a prediction model for low concentration and high concentration separately. Therefore, a classification model is needed to classify the concentration of particular matter into low and high concentrations. This paper proposes a classification model to classify low and high concentrations based on the concentration of particular matter. DNN was used as the classification model algorithm, and the classification model was designed by applying the optimal parameters after searching for hyper parameters. As for the result of evaluating the performance of the model, 97.54% of the low concentration classification was measured. And in the case of high concentration classification, 85.51% was measured.

  • PDF

Indoor Space Recognition using Super-pixel and DNN (DNN과 슈퍼픽셀을 이용한 실내 공간 인식)

  • Kim, Kisang;Choi, Hyung-Il
    • Journal of Internet Computing and Services
    • /
    • v.19 no.3
    • /
    • pp.43-48
    • /
    • 2018
  • In this paper, we propose an indoor-space recognition using DNN and super-pixel. In order to recognize the indoor space from the image, segmentation process is required for dividing an image Super-pixel is performed algorithm which can be divided into appropriate sizes. In order to recognize each segment, features are extracted using a proposed method. Extracted features are learned using DNN, and each segment is recognized using the DNN model. Experimental results show the performance comparison between the proposed method and existing algorithms.

Bit Operation Optimization and DNN Application using GPU Acceleration (GPU 가속기를 통한 비트 연산 최적화 및 DNN 응용)

  • Kim, Sang Hyeok;Lee, Jae Heung
    • Journal of IKEEE
    • /
    • v.23 no.4
    • /
    • pp.1314-1320
    • /
    • 2019
  • In this paper, we propose a new method for optimizing bit operations and applying them to DNN(Deep Neural Network) in software environment. As a method for this, we propose a packing function for bitwise optimization and a masking matrix multiplication operation for application to DNN. The packing function converts 32-bit real value to 2-bit quantization value through threshold comparison operation. When this sequence is over, four 32-bit real values are changed to one 8-bit value. The masking matrix multiplication operation consists of a special operation for multiplying the packed weight value with the normal input value. And each operation was then processed in parallel using a GPU accelerator. As a result of this experiment, memory saved about 16 times than 32-bit DNN Model. Nevertheless, the accuracy was within 1%, similar to the 32-bit model.

A study on user defined spoken wake-up word recognition system using deep neural network-hidden Markov model hybrid model (Deep neural network-hidden Markov model 하이브리드 구조의 모델을 사용한 사용자 정의 기동어 인식 시스템에 관한 연구)

  • Yoon, Ki-mu;Kim, Wooil
    • The Journal of the Acoustical Society of Korea
    • /
    • v.39 no.2
    • /
    • pp.131-136
    • /
    • 2020
  • Wake Up Word (WUW) is a short utterance used to convert speech recognizer to recognition mode. The WUW defined by the user who actually use the speech recognizer is called user-defined WUW. In this paper, to recognize user-defined WUW, we construct traditional Gaussian Mixture Model-Hidden Markov Model (GMM-HMM), Linear Discriminant Analysis (LDA)-GMM-HMM and LDA-Deep Neural Network (DNN)-HMM based system and compare their performances. Also, to improve recognition accuracy of the WUW system, a threshold method is applied to each model, which significantly reduces the error rate of the WUW recognition and the rejection failure rate of non-WUW simultaneously. For LDA-DNN-HMM system, when the WUW error rate is 9.84 %, the rejection failure rate of non-WUW is 0.0058 %, which is about 4.82 times lower than the LDA-GMM-HMM system. These results demonstrate that LDA-DNN-HMM model developed in this paper proves to be highly effective for constructing user-defined WUW recognition system.

River streamflow prediction using a deep neural network: a case study on the Red River, Vietnam

  • Le, Xuan-Hien;Ho, Hung Viet;Lee, Giha
    • Korean Journal of Agricultural Science
    • /
    • v.46 no.4
    • /
    • pp.843-856
    • /
    • 2019
  • Real-time flood prediction has an important role in significantly reducing potential damage caused by floods for urban residential areas located downstream of river basins. This paper presents an effective approach for flood forecasting based on the construction of a deep neural network (DNN) model. In addition, this research depends closely on the open-source software library, TensorFlow, which was developed by Google for machine and deep learning applications and research. The proposed model was applied to forecast the flowrate one, two, and three days in advance at the Son Tay hydrological station on the Red River, Vietnam. The input data of the model was a series of discharge data observed at five gauge stations on the Red River system, without requiring rainfall data, water levels and topographic characteristics. The research results indicate that the DNN model achieved a high performance for flood forecasting even though only a modest amount of data is required. When forecasting one and two days in advance, the Nash-Sutcliffe Efficiency (NSE) reached 0.993 and 0.938, respectively. The findings of this study suggest that the DNN model can be used to construct a real-time flood warning system on the Red River and for other river basins in Vietnam.

Predicting the maximum lateral load of reinforced concrete columns with traditional machine learning, deep learning, and structural analysis software

  • Pelin Canbay;Sila Avgin;Mehmet M. Kose
    • Computers and Concrete
    • /
    • v.33 no.3
    • /
    • pp.285-299
    • /
    • 2024
  • Recently, many engineering computations have realized their digital transformation to Machine Learning (ML)-based systems. Predicting the behavior of a structure, which is mainly computed with structural analysis software, is an essential step before construction for efficient structural analysis. Especially in the seismic-based design procedure of the structures, predicting the lateral load capacity of reinforced concrete (RC) columns is a vital factor. In this study, a novel ML-based model is proposed to predict the maximum lateral load capacity of RC columns under varying axial loads or cyclic loadings. The proposed model is generated with a Deep Neural Network (DNN) and compared with traditional ML techniques as well as a popular commercial structural analysis software. In the design and test phases of the proposed model, 319 columns with rectangular and square cross-sections are incorporated. In this study, 33 parameters are used to predict the maximum lateral load capacity of each RC column. While some traditional ML techniques perform better prediction than the compared commercial software, the proposed DNN model provides the best prediction results within the analysis. The experimental results reveal the fact that the performance of the proposed DNN model can definitely be used for other engineering purposes as well.

Water level prediction in Taehwa River basin using deep learning model based on DNN and LSTM (DNN 및 LSTM 기반 딥러닝 모형을 활용한 태화강 유역의 수위 예측)

  • Lee, Myungjin;Kim, Jongsung;Yoo, Younghoon;Kim, Hung Soo;Kim, Sam Eun;Kim, Soojun
    • Journal of Korea Water Resources Association
    • /
    • v.54 no.spc1
    • /
    • pp.1061-1069
    • /
    • 2021
  • Recently, the magnitude and frequency of extreme heavy rains and localized heavy rains have increased due to abnormal climate, which caused increased flood damage in river basin. As a result, the nonlinearity of the hydrological system of rivers or basins is increasing, and there is a limitation in that the lead time is insufficient to predict the water level using the existing physical-based hydrological model. This study predicted the water level at Ulsan (Taehwagyo) with a lead time of 0, 1, 2, 3, 6, 12 hours by applying deep learning techniques based on Deep Neural Network (DNN) and Long Short-Term Memory (LSTM) and evaluated the prediction accuracy. As a result, DNN model using the sliding window concept showed the highest accuracy with a correlation coefficient of 0.97 and RMSE of 0.82 m. If deep learning-based water level prediction using a DNN model is performed in the future, high prediction accuracy and sufficient lead time can be secured than water level prediction using existing physical-based hydrological models.

LFMMI-based acoustic modeling by using external knowledge (External knowledge를 사용한 LFMMI 기반 음향 모델링)

  • Park, Hosung;Kang, Yoseb;Lim, Minkyu;Lee, Donghyun;Oh, Junseok;Kim, Ji-Hwan
    • The Journal of the Acoustical Society of Korea
    • /
    • v.38 no.5
    • /
    • pp.607-613
    • /
    • 2019
  • This paper proposes LF-MMI (Lattice Free Maximum Mutual Information)-based acoustic modeling using external knowledge for speech recognition. Note that an external knowledge refers to text data other than training data used in acoustic model. LF-MMI, objective function for optimization of training DNN (Deep Neural Network), has high performances in discriminative training. In LF-MMI, a phoneme probability as prior probability is used for predicting posterior probability of the DNN-based acoustic model. We propose using external knowledges for training the prior probability model to improve acoustic model based on DNN. It is measured to relative improvement 14 % as compared with the conventional LF-MMI-based model.

Deep neural networks trained by the adaptive momentum-based technique for stability simulation of organic solar cells

  • Xu, Peng;Qin, Xiao;Zhu, Honglei
    • Structural Engineering and Mechanics
    • /
    • v.83 no.2
    • /
    • pp.259-272
    • /
    • 2022
  • The branch of electronics that uses an organic solar cell or conductive organic polymers in order to yield electricity from sunlight is called photovoltaic. Regarding this crucial issue, an artificial intelligence-based predictor is presented to investigate the vibrational behavior of the organic solar cell. In addition, the generalized differential quadrature method (GDQM) is utilized to extract the results. The validation examination is done to confirm the credibility of the results. Then, the deep neural network with fully connected layers (DNN-FCL) is trained by means of Adam optimization on the dataset whose members are the vibration response of the design-points. By determining the optimum values for the biases along with weights of DNN-FCL, one can predict the vibrational characteristics of any organic solar cell by knowing the properties defined as the inputs of the mentioned DNN. To assess the ability of the proposed artificial intelligence-based model in prediction of the vibrational response of the organic solar cell, the authors monitored the mean squared error in different steps of the training the DNN-FCL and they observed that the convergency of the results is excellent.

Query-Efficient Black-Box Adversarial Attack Methods on Face Recognition Model (얼굴 인식 모델에 대한 질의 효율적인 블랙박스 적대적 공격 방법)

  • Seo, Seong-gwan;Son, Baehoon;Yun, Joobeom
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.32 no.6
    • /
    • pp.1081-1090
    • /
    • 2022
  • The face recognition model is used for identity recognition of smartphones, providing convenience to many users. As a result, the security review of the DNN model is becoming important, with adversarial attacks present as a well-known vulnerability of the DNN model. Adversarial attacks have evolved to decision-based attack techniques that use only the recognition results of deep learning models to perform attacks. However, existing decision-based attack technique[14] have a problem that requires a large number of queries when generating adversarial examples. In particular, it takes a large number of queries to approximate the gradient. Therefore, in this paper, we propose a method of generating adversarial examples using orthogonal space sampling and dimensionality reduction sampling to avoid wasting queries that are consumed to approximate the gradient of existing decision-based attack technique[14]. Experiments show that our method can reduce the perturbation size of adversarial examples by about 2.4 compared to existing attack technique[14] and increase the attack success rate by 14% compared to existing attack technique[14]. Experimental results demonstrate that the adversarial example generation method proposed in this paper has superior attack performance.