• Title/Summary/Keyword: Multi-layer. perceptron (MLP)

Search Result 234, Processing Time 0.028 seconds

Development of Marine Debris Monitoring Methods Using Satellite and Drone Images (위성 및 드론 영상을 이용한 해안쓰레기 모니터링 기법 개발)

  • Kim, Heung-Min;Bak, Suho;Han, Jeong-ik;Ye, Geon Hui;Jang, Seon Woong
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.6_1
    • /
    • pp.1109-1124
    • /
    • 2022
  • This study proposes a marine debris monitoring methods using satellite and drone multispectral images. A multi-layer perceptron (MLP) model was applied to detect marine debris using Sentinel-2 satellite image. And for the detection of marine debris using drone multispectral images, performance evaluation and comparison of U-Net, DeepLabv3+ (ResNet50) and DeepLabv3+ (Inceptionv3) among deep learning models were performed (mIoU 0.68). As a result of marine debris detection using satellite image, the F1-Score was 0.97. Marine debris detection using drone multispectral images was performed on vegetative debris and plastics. As a result of detection, when DeepLabv3+ (Inceptionv3) was used, the most model accuracy, mean intersection over union (mIoU), was 0.68. Vegetative debris showed an F1-Score of 0.93 and IoU of 0.86, while plastics showed low performance with an F1-Score of 0.5 and IoU of 0.33. However, the F1-Score of the spectral index applied to generate plastic mask images was 0.81, which was higher than the plastics detection performance of DeepLabv3+ (Inceptionv3), and it was confirmed that plastics monitoring using the spectral index was possible. The marine debris monitoring technique proposed in this study can be used to establish a plan for marine debris collection and treatment as well as to provide quantitative data on marine debris generation.

Energy Demand/Supply Prediction and Simulator UI Design for Energy Efficiency in the Industrial Complex (산업단지 에너지 효율화를 위한 에너지 수요/공급 예측 및 시뮬레이터 UI 설계)

  • Hyungah Lee;Jong-hyeok Park;Woojin Cho;Dongju Kim;Jae-hoi Gu
    • The Journal of the Convergence on Culture Technology
    • /
    • v.10 no.4
    • /
    • pp.693-700
    • /
    • 2024
  • As of the end of March 2022, the total area of domestic industrial complexes is 606 km2, which is only about 0.6% of the total land area. However, as of 2018, the annual energy consumption of domestic industrial complexes is 110,866.1 thousand TOE, accounting for 53.5% of the country's total energy consumption and 83.1% of the entire industrial sector energy consumption. In addition, industrial complexes have a significant impact on the environment, accounting for 45.1% of the country's total greenhouse gas emissions and 76.8% of industrial sector greenhouse gas emissions. Under this background, in this study, in order to contribute to the energy efficiency of industrial complexes, a prediction study on energy demand and supply for an industrial complex in Korea using machine learning was conducted. In addition, a simulator UI screen was designed to more efficiently convey information on energy demand/supply prediction results and energy consumption status. Among the machine learning algorithms, Multi-Layer Perceptron (MLP) was used, and Bayesian Optimization was applied as an optimization technique for the prediction model. The energy prediction model for the industrial complex built in this study showed a prediction accuracy of 87.90% for compressed air demand and 99.54% for the flow rate available for the public air compressor.

A Study on Application of ARIMA and Neural Networks for Time Series Forecasting of Port Traffic (항만물동량 예측력 제고를 위한 ARIMA 및 인공신경망모형들의 비교 연구)

  • Shin, Chang-Hoon;Jeong, Su-Hyun
    • Journal of Navigation and Port Research
    • /
    • v.35 no.1
    • /
    • pp.83-91
    • /
    • 2011
  • The accuracy of forecasting is remarkably important to reduce total cost or to increase customer services, so it has been studied by many researchers. In this paper, the artificial neural network (ANN), one of the most popular nonlinear forecasting methods, is compared with autoregressive integrated moving average(ARIMA) model through performing a prediction of container traffic. It uses a hybrid methodology that combines both the linear ARIAM and the nonlinear ANN model to improve forecasting performance. Also, it compares the methodology with other models in performance for prediction. In designing network structure, this work specially applies the genetic algorithm which is known as the effectively optimal algorithm in the huge and complex sample space. It includes the time delayed neural network (TDNN) as well as multi-layer perceptron (MLP) which is the most popular neural network model. Experimental results indicate that both ANN and Hybrid models outperform ARIMA model.

Structural monitoring of movable bridge mechanical components for maintenance decision-making

  • Gul, Mustafa;Dumlupinar, Taha;Hattori, Hiroshi;Catbas, Necati
    • Structural Monitoring and Maintenance
    • /
    • v.1 no.3
    • /
    • pp.249-271
    • /
    • 2014
  • This paper presents a unique study of Structural Health Monitoring (SHM) for the maintenance decision making about a real life movable bridge. The mechanical components of movable bridges are maintained on a scheduled basis. However, it is desired to have a condition-based maintenance by taking advantage of SHM. The main objective is to track the operation of a gearbox and a rack-pinion/open gear assembly, which are critical parts of bascule type movable bridges. Maintenance needs that may lead to major damage to these components needs to be identified and diagnosed timely since an early detection of faults may help avoid unexpected bridge closures or costly repairs. The fault prediction of the gearbox and rack-pinion/open gear is carried out using two types of Artificial Neural Networks (ANNs): 1) Multi-Layer Perceptron Neural Networks (MLP-NNs) and 2) Fuzzy Neural Networks (FNNs). Monitoring data is collected during regular opening and closing of the bridge as well as during artificially induced reversible damage conditions. Several statistical parameters are extracted from the time-domain vibration signals as characteristic features to be fed to the ANNs for constructing the MLP-NNs and FNNs independently. The required training and testing sets are obtained by processing the acceleration data for both damaged and undamaged condition of the aforementioned mechanical components. The performances of the developed ANNs are first evaluated using unseen test sets. Second, the selected networks are used for long-term condition evaluation of the rack-pinion/open gear of the movable bridge. It is shown that the vibration monitoring data with selected statistical parameters and particular network architectures give successful results to predict the undamaged and damaged condition of the bridge. It is also observed that the MLP-NNs performed better than the FNNs in the presented case. The successful results indicate that ANNs are promising tools for maintenance monitoring of movable bridge components and it is also shown that the ANN results can be employed in simple approach for day-to-day operation and maintenance of movable bridges.

Neural-network-based Driver Drowsiness Detection System Using Linear Predictive Coding Coefficients and Electroencephalographic Changes (선형예측계수와 뇌파의 변화를 이용한 신경회로망 기반 운전자의 졸음 감지 시스템)

  • Chong, Ui-Pil;Han, Hyung-Seob
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.13 no.3
    • /
    • pp.136-141
    • /
    • 2012
  • One of the main reasons for serious road accidents is driving while drowsy. For this reason, drowsiness detection and warning system for drivers has recently become a very important issue. Monitoring physiological signals provides the possibility of detecting features of drowsiness and fatigue of drivers. One of the effective signals is to measure electroencephalogram (EEG) signals and electrooculogram (EOG) signals. The aim of this study is to extract drowsiness-related features from a set of EEG signals and to classify the features into three states: alertness, drowsiness, sleepiness. This paper proposes a neural-network-based drowsiness detection system using Linear Predictive Coding (LPC) coefficients as feature vectors and Multi-Layer Perceptron (MLP) as a classifier. Samples of EEG data from each predefined state were used to train the MLP program by using the proposed feature extraction algorithms. The trained MLP program was tested on unclassified EEG data and subsequently reviewed according to manual classification. The classification rate of the proposed system is over 96.5% for only very small number of samples (250ms, 64 samples). Therefore, it can be applied to real driving incident situation that can occur for a split second.

Classification of Fiber Tracts Changed by Nerve Injury and Electrical Brain Stimulation Using Machine Learning Algorithm in the Rat Brain (신경 손상과 전기 뇌 자극에 의한 흰쥐의 뇌 섬유 경로 변화에 대한 기계학습 판별)

  • Sohn, Jin-Hun;Eum, Young-Ji;Cheong, Chaejoon;Cha, Myeounghoon;Lee, Bae Hwan
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2021.07a
    • /
    • pp.701-702
    • /
    • 2021
  • The purpose of the study was to identify fiber changes induced by electrical stimulation of a certain neural substrate in the rat brain. In the stimulation group, the peripheral nerve was injured and the brain area associated to inhibit sensory information was electrically stimulated. There were sham and sham stimulation groups as controls. Then high-field diffusion tensor imaging (DTI) was acquired. 35 features were taken from the DTI measures from 7 different brain pathways. To compare the efficacy of the classification for 3 animal groups, the linear regression analysis (LDA) and the machine learning technique (MLP) were applied. It was found that the testing accuracy by MLP was about 77%, but that of accuracy by LDA was much higher than MLP. In conclusion, machine learning algorithm could be used to identify and predict the changes of the brain white matter in some situations. The limits of this study will be discussed.

  • PDF

Transformer-Based MUM-T Situation Awareness: Agent Status Prediction (트랜스포머 기반 MUM-T 상황인식 기술: 에이전트 상태 예측)

  • Jaeuk Baek;Sungwoo Jun;Kwang-Yong Kim;Chang-Eun Lee
    • The Journal of Korea Robotics Society
    • /
    • v.18 no.4
    • /
    • pp.436-443
    • /
    • 2023
  • With the advancement of robot intelligence, the concept of man and unmanned teaming (MUM-T) has garnered considerable attention in military research. In this paper, we present a transformer-based architecture for predicting the health status of agents, with the help of multi-head attention mechanism to effectively capture the dynamic interaction between friendly and enemy forces. To this end, we first introduce a framework for generating a dataset of battlefield situations. These situations are simulated on a virtual simulator, allowing for a wide range of scenarios without any restrictions on the number of agents, their missions, or their actions. Then, we define the crucial elements for identifying the battlefield, with a specific emphasis on agents' status. The battlefield data is fed into the transformer architecture, with classification headers on top of the transformer encoding layers to categorize health status of agent. We conduct ablation tests to assess the significance of various factors in determining agents' health status in battlefield scenarios. We conduct 3-Fold corss validation and the experimental results demonstrate that our model achieves a prediction accuracy of over 98%. In addition, the performance of our model are compared with that of other models such as convolutional neural network (CNN) and multi layer perceptron (MLP), and the results establish the superiority of our model.

A Study on the Implementation of Hybrid Learning Rule for Neural Network (다층신경망에서 하이브리드 학습 규칙의 구현에 관한 연구)

  • Song, Do-Sun;Kim, Suk-Dong;Lee, Haing-Sei
    • The Journal of the Acoustical Society of Korea
    • /
    • v.13 no.4
    • /
    • pp.60-68
    • /
    • 1994
  • In this paper we propose a new Hybrid learning rule applied to multilayer feedforward neural networks, which is constructed by combining Hebbian learning rule that is a good feature extractor and Back-Propagation(BP) learning rule that is an excellent classifier. Unlike the BP rule used in multi-layer perceptron(MLP), the proposed Hybrid learning rule is used for uptate of all connection weights except for output connection weigths becase the Hebbian learning in output layer does not guarantee learning convergence. To evaluate the performance, the proposed hybrid rule is applied to classifier problems in two dimensional space and shows better performance than the one applied only by the BP rule. In terms of learning speed the proposed rule converges faster than the conventional BP. For example, the learning of the proposed Hybrid can be done in 2/10 of the iterations that are required for BP, while the recognition rate of the proposed Hybrid is improved by about $0.778\%$ at the peak.

  • PDF

Improvements of an English Pronunciation Dictionary Generator Using DP-based Lexicon Pre-processing and Context-dependent Grapheme-to-phoneme MLP (DP 알고리즘에 의한 발음사전 전처리와 문맥종속 자소별 MLP를 이용한 영어 발음사전 생성기의 개선)

  • 김회린;문광식;이영직;정재호
    • The Journal of the Acoustical Society of Korea
    • /
    • v.18 no.5
    • /
    • pp.21-27
    • /
    • 1999
  • In this paper, we propose an improved MLP-based English pronunciation dictionary generator to apply to the variable vocabulary word recognizer. The variable vocabulary word recognizer can process any words specified in Korean word lexicon dynamically determined according to the current recognition task. To extend the ability of the system to task for English words, it is necessary to build a pronunciation dictionary generator to be able to process words not included in a predefined lexicon, such as proper nouns. In order to build the English pronunciation dictionary generator, we use context-dependent grapheme-to-phoneme multi-layer perceptron(MLP) architecture for each grapheme. To train each MLP, it is necessary to obtain grapheme-to-phoneme training data from general pronunciation dictionary. To automate the process, we use dynamic programming(DP) algorithm with some distance metrics. For training and testing the grapheme-to-phoneme MLPs, we use general English pronunciation dictionary with about 110 thousand words. With 26 MLPs each having 30 to 50 hidden nodes and the exception grapheme lexicon, we obtained the word accuracy of 72.8% for the 110 thousand words superior to rule-based method showing the word accuracy of 24.0%.

  • PDF

Feasibility of Deep Learning Algorithms for Binary Classification Problems (이진 분류문제에서의 딥러닝 알고리즘의 활용 가능성 평가)

  • Kim, Kitae;Lee, Bomi;Kim, Jong Woo
    • Journal of Intelligence and Information Systems
    • /
    • v.23 no.1
    • /
    • pp.95-108
    • /
    • 2017
  • Recently, AlphaGo which is Bakuk (Go) artificial intelligence program by Google DeepMind, had a huge victory against Lee Sedol. Many people thought that machines would not be able to win a man in Go games because the number of paths to make a one move is more than the number of atoms in the universe unlike chess, but the result was the opposite to what people predicted. After the match, artificial intelligence technology was focused as a core technology of the fourth industrial revolution and attracted attentions from various application domains. Especially, deep learning technique have been attracted as a core artificial intelligence technology used in the AlphaGo algorithm. The deep learning technique is already being applied to many problems. Especially, it shows good performance in image recognition field. In addition, it shows good performance in high dimensional data area such as voice, image and natural language, which was difficult to get good performance using existing machine learning techniques. However, in contrast, it is difficult to find deep leaning researches on traditional business data and structured data analysis. In this study, we tried to find out whether the deep learning techniques have been studied so far can be used not only for the recognition of high dimensional data but also for the binary classification problem of traditional business data analysis such as customer churn analysis, marketing response prediction, and default prediction. And we compare the performance of the deep learning techniques with that of traditional artificial neural network models. The experimental data in the paper is the telemarketing response data of a bank in Portugal. It has input variables such as age, occupation, loan status, and the number of previous telemarketing and has a binary target variable that records whether the customer intends to open an account or not. In this study, to evaluate the possibility of utilization of deep learning algorithms and techniques in binary classification problem, we compared the performance of various models using CNN, LSTM algorithm and dropout, which are widely used algorithms and techniques in deep learning, with that of MLP models which is a traditional artificial neural network model. However, since all the network design alternatives can not be tested due to the nature of the artificial neural network, the experiment was conducted based on restricted settings on the number of hidden layers, the number of neurons in the hidden layer, the number of output data (filters), and the application conditions of the dropout technique. The F1 Score was used to evaluate the performance of models to show how well the models work to classify the interesting class instead of the overall accuracy. The detail methods for applying each deep learning technique in the experiment is as follows. The CNN algorithm is a method that reads adjacent values from a specific value and recognizes the features, but it does not matter how close the distance of each business data field is because each field is usually independent. In this experiment, we set the filter size of the CNN algorithm as the number of fields to learn the whole characteristics of the data at once, and added a hidden layer to make decision based on the additional features. For the model having two LSTM layers, the input direction of the second layer is put in reversed position with first layer in order to reduce the influence from the position of each field. In the case of the dropout technique, we set the neurons to disappear with a probability of 0.5 for each hidden layer. The experimental results show that the predicted model with the highest F1 score was the CNN model using the dropout technique, and the next best model was the MLP model with two hidden layers using the dropout technique. In this study, we were able to get some findings as the experiment had proceeded. First, models using dropout techniques have a slightly more conservative prediction than those without dropout techniques, and it generally shows better performance in classification. Second, CNN models show better classification performance than MLP models. This is interesting because it has shown good performance in binary classification problems which it rarely have been applied to, as well as in the fields where it's effectiveness has been proven. Third, the LSTM algorithm seems to be unsuitable for binary classification problems because the training time is too long compared to the performance improvement. From these results, we can confirm that some of the deep learning algorithms can be applied to solve business binary classification problems.