• Title/Summary/Keyword: Layer-By-Layer Training

Search Result 300, Processing Time 0.024 seconds

Layered Authoring of Cyber Warfare Training Scenario (계층적 사이버전 훈련 시나리오 저작)

  • Song, Uihyeon;Kim, Donghwa;Ahn, Myung Kil
    • Journal of Internet Computing and Services
    • /
    • v.21 no.1
    • /
    • pp.191-199
    • /
    • 2020
  • Cyber warfare training is a key factor for boosting cyber warfare competence. In general, cyber warfare training is conducted by scenarios, and the effects of training can be enhanced by including various elements in the scenarios that can improve the quality of training. In this paper, we introduce the training information, network map, traffic generation policy, threat/defense behavior identified as elements to be included in training scenarios, and propose a method of authoring training scenarios by layering and combining them. We also propose a database design for integrated management of each scenario layer. The layered training scenario authoring method has the advantage of increasing convenience of authoring by reusing existing layers and extending training scenarios based on various combinations between the layers.

Robust Multi-Layer Hierarchical Model for Digit Character Recognition

  • Yang, Jie;Sun, Yadong;Zhang, Liangjun;Zhang, Qingnian
    • Journal of Electrical Engineering and Technology
    • /
    • v.10 no.2
    • /
    • pp.699-707
    • /
    • 2015
  • Although digit character recognition has got a significant improvement in recent years, it is still challenging to achieve satisfied result if the data contains an amount of distracting factors. This paper proposes a novel digit character recognition approach using a multi-layer hierarchical model, Hybrid Restricted Boltzmann Machines (HRBMs), which allows the learning architecture to be robust to background distracting factors. The insight behind the proposed model is that useful high-level features appear more frequently than distracting factors during learning, thus the high-level features can be decompose into hybrid hierarchical structures by using only small label information. In order to extract robust and compact features, a stochastic 0-1 layer is employed, which enables the model's hidden nodes to independently capture the useful character features during training. Experiments on the variations of Mixed National Institute of Standards and Technology (MNIST) dataset show that improvements of the multi-layer hierarchical model can be achieved by the proposed method. Finally, the paper shows the proposed technique which is used in a real-world application, where it is able to identify digit characters under various complex background images.

Improving the Water Level Prediction of Multi-Layer Perceptron with a Modified Error Function

  • Oh, Sang-Hoon
    • International Journal of Contents
    • /
    • v.13 no.4
    • /
    • pp.23-28
    • /
    • 2017
  • Of the total economic loss caused by disasters, 40% are due to floods and floods have a severe impact on human health and life. So, it is important to monitor the water level of a river and to issue a flood warning during unfavorable circumstances. In this paper, we propose a modified error function to improve a hydrological modeling using a multi-layer perceptron (MLP) neural network. When MLP's are trained to minimize the conventional mean-squared error function, the prediction performance is poor because MLP's are highly tunned to training data. Our goal is achieved by preventing overspecialization to training data, which is the main reason for performance degradation for rare or test data. Based on the modified error function, an MLP is trained to predict the water level with rainfall data at upper reaches. Through simulations to predict the water level of Nakdong River near a UNESCO World Heritage Site "Hahoe Village," we verified that the prediction performance of MLP with the modified error function is superior to that with the conventional mean-squared error function, especially maximum error of 40.85cm vs. 55.51cm.

Diagnosis of a Pump by Frequency Analysis of Operation Sound (펌프의 작동음 주파수 분석에 의한 진단)

  • 이신영;박순재
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 2003.10a
    • /
    • pp.137-142
    • /
    • 2003
  • A fundamental study for developing a system of fault diagnosis of a pump is performed by using neural network. The acoustic signals were obtained and converted to frequency domain for normal products and artificially deformed products. The signals were obtained in various driving frequencies in order to obtain many types of data from a limited number of pumps. The acoustic data in frequency domain were managed to multiples of real driving frequency with the aim of easy comparison. The neural network model used in this study was 3-layer type composed of input, hidden, and output layer. The normalized amplitudes at the multiples of real driving frequency were chosen as units of input layer, Various sets of teach signals made from original data by eliminating some random cases were used in the training. The average errors were approximately proportional to the number of untaught data. The results showed neural network trained by acoustic signals can be used as a simple method far a detection of machine malfunction or fault diagnosis.

  • PDF

Diagnosis of a Pump by Frequency Analysis of Operation Sound (펌프의 작동음 주파수 분석에 의한 진단)

  • Lee Sin-Young
    • Transactions of the Korean Society of Machine Tool Engineers
    • /
    • v.13 no.5
    • /
    • pp.81-86
    • /
    • 2004
  • A fundamental study for developing a system of fault diagnosis of a pump is performed by using neural network. The acoustic signals were obtained and converted to frequency domain for normal products and artificially deformed products. The signals were obtained in various driving frequencies in order to obtain many types of data from a limited number of pumps. The acoustic data in frequency domain were managed to multiples of real driving frequency with the aim of easy comparison. The neural network model used in this study was 3-layer type composed of input, hidden, and output layer. The normalized amplitudes at the multiples of real driving frequency were chosen as units of input layer. Various sets of teach signals made from original data by eliminating some random cases were used in the training. The average errors were approximately proportional to the number of untaught data. The results showed neural network trained by acoustic signals can be used as a simple method for a detection of machine malfuction or fault diagnosis.

Segment unit shuffling layer in deep neural networks for text-independent speaker verification (문장 독립 화자 인증을 위한 세그멘트 단위 혼합 계층 심층신경망)

  • Heo, Jungwoo;Shim, Hye-jin;Kim, Ju-ho;Yu, Ha-Jin
    • The Journal of the Acoustical Society of Korea
    • /
    • v.40 no.2
    • /
    • pp.148-154
    • /
    • 2021
  • Text-Independent speaker verification needs to extract text-independent speaker embedding to improve generalization performance. However, deep neural networks that depend on training data have the potential to overfit text information instead of learning the speaker information when repeatedly learning from the identical time series. In this paper, to prevent the overfitting, we propose a segment unit shuffling layer that divides and rearranges the input layer or a hidden layer along the time axis, thus mixes the time series information. Since the segment unit shuffling layer can be applied not only to the input layer but also to the hidden layers, it can be used as generalization technique in the hidden layer, which is known to be effective compared to the generalization technique in the input layer, and can be applied simultaneously with data augmentation. In addition, the degree of distortion can be adjusted by adjusting the unit size of the segment. We observe that the performance of text-independent speaker verification is improved compared to the baseline when the proposed segment unit shuffling layer is applied.

Object Recognition Using the Edge Orientation Histogram and Improved Multi-Layer Neural Network

  • Kang, Myung-A
    • International Journal of Advanced Culture Technology
    • /
    • v.6 no.3
    • /
    • pp.142-150
    • /
    • 2018
  • This paper describes the algorithm that lowers the dimension, maintains the object recognition and significantly reduces the eigenspace configuration time by combining the edge orientation histogram and principle component analysis. By using the detected object region as a recognition input image, in this paper the object recognition method combined with principle component analysis and the multi-layer network which is one of the intelligent classification was suggested and its performance was evaluated. As a pre-processing algorithm of input object image, this method computes the eigenspace through principle component analysis and expresses the training images with it as a fundamental vector. Each image takes the set of weights for the fundamental vector as a feature vector and it reduces the dimension of image at the same time, and then the object recognition is performed by inputting the multi-layer neural network.

Application of Back-propagation Algorithm for the forecasting of Temperature and Humidity (온도 및 습도의 단기 예측에 있어서 역전파 알고리즘의 적용)

  • Jeong, Hyo-Joon;Hwang, Won-Tae;Suh, Kyung-Suk;Kim, Eun-Han;Han, Moon-Hee
    • Journal of Environmental Impact Assessment
    • /
    • v.12 no.4
    • /
    • pp.271-279
    • /
    • 2003
  • Temperature and humidity forecasting have been performed using artificial neural networks model(ANN). We composed ANN with multi-layer perceptron which is 2 input layers, 2 hidden layers and 1 output layer. Back propagation algorithm was used to train the ANN. 6 nodes and 12 nodes in the middle layers were appropriate to the temperature model for training. And 9 nodes and 6 nodes were also appropriate to the humidity model respectively. 90% of the all data was used learning set, and the extra 10% was used to model verification. In the case of temperature, average temperature before 15 minute and humidity at present constituted input layer, and temperature at present constituted out-layer and humidity model was vice versa. The sensitivity analysis revealed that previous value data contributed to forecasting target value than the other variable. Temperature was pseudo-linearly related to the previous 15 minute average value. We confirmed that ANN with multi-layer perceptron could support pollutant dispersion model by computing meterological data at real time.

Neural Network Training Using a GMDH Type Algorithm

  • Pandya, Abhijit S.;Gilbar, Thomas;Kim, Kwang-Baek
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.5 no.1
    • /
    • pp.52-58
    • /
    • 2005
  • We have developed a Group Method of Data Handling (GMDH) type algorithm for designing multi-layered neural networks. The algorithm is general enough that it will accept any number of inputs and any sized training set. Each neuron of the resulting network is a function of two of the inputs to the layer. The equation for each of the neurons is a quadratic polynomial. Several forms of the equation are tested for each neuron to make sure that only the best equation of two inputs is kept. All possible combinations of two inputs to each layer are also tested. By carefully testing each resulting neuron, we have developed an algorithm to keep only the best neurons at each level. The algorithm's goal is to create as accurate a network as possible while minimizing the size of the network. Software was developed to train and simulate networks using our algorithm. Several applications were modeled using our software, and the result was that our algorithm succeeded in developing small, accurate, multi-layer networks.

Study on Teaching and Learning Methods of Embedded Application Software Using Elevator Simulator (엘리베이터 시뮬레이터를 활용한 임베디드 어플리케이션 소프트웨어 교수학습방법 연구)

  • Ko, Seokhoon
    • The Journal of Korean Association of Computer Education
    • /
    • v.21 no.6
    • /
    • pp.27-37
    • /
    • 2018
  • In this paper, we propose a design and development method of an elevator simulator that can be used as an embedded application layer software learning tool and a teaching and learning method using it. The simulator provides students with an environment to implement the operating principle and control method of the elevator system in the application layer excluding the issues of hardware and embedded OS layer. This allows students to have a reactive and real-time embedded application development experience. In addition, we present a four-week embedded application software training course with hands-on exercises that add step-by-step functionality using a simulator. As a result of training for actual students, we obtained 83.3 points of learning achievement score and proved that the curriculum has a significant effect on embedded application learning.