• Title/Summary/Keyword: multilayer perceptron (MLP)

Search Result 135, Processing Time 0.025 seconds

Prediction of Air Temperature and Relative Humidity in Greenhouse via a Multilayer Perceptron Using Environmental Factors (환경요인을 이용한 다층 퍼셉트론 기반 온실 내 기온 및 상대습도 예측)

  • Choi, Hayoung;Moon, Taewon;Jung, Dae Ho;Son, Jung Eek
    • Journal of Bio-Environment Control
    • /
    • v.28 no.2
    • /
    • pp.95-103
    • /
    • 2019
  • Temperature and relative humidity are important factors in crop cultivation and should be properly controlled for improving crop yield and quality. In order to control the environment accurately, we need to predict how the environment will change in the future. The objective of this study was to predict air temperature and relative humidity at a future time by using a multilayer perceptron (MLP). The data required to train MLP was collected every 10 min from Oct. 1, 2016 to Feb. 28, 2018 in an eight-span greenhouse ($1,032m^2$) cultivating mango (Mangifera indica cv. Irwin). The inputs for the MLP were greenhouse inside and outside environment data, and set-up and operating values of environment control devices. By using these data, the MLP was trained to predict the air temperature and relative humidity at a future time of 10 to 120 min. Considering typical four seasons in Korea, three-day data of the each season were compared as test data. The MLP was optimized with four hidden layers and 128 nodes for air temperature ($R^2=0.988$) and with four hidden layers and 64 nodes for relative humidity ($R^2=0.990$). Due to the characteristics of MLP, the accuracy decreased as the prediction time became longer. However, air temperature and relative humidity were properly predicted regardless of the environmental changes varied from season to season. For specific data such as spray irrigation, however, the numbers of trained data were too small, resulting in poor predictive accuracy. In this study, air temperature and relative humidity were appropriately predicted through optimization of MLP, but were limited to the experimental greenhouse. Therefore, it is necessary to collect more data from greenhouses at various places and modify the structure of neural network for generalization.

An Improvement of the Outline Mede Error Backpropagation Algorithm Learning Speed for Pattern Recognition (패턴인식에서 온라인 오류역전파 알고리즘의 학습속도 향상방법)

  • 이태승;황병원
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2002.04b
    • /
    • pp.616-618
    • /
    • 2002
  • MLP(multilayer perceptron)는 다른 패턴인식 방법에 비해 몇 가지 이점이 있어 다양한 문제영역에서 사용되고 있다 그러나 MLP의 학습에 일반적으로 사용되는 EBP(error backpropagation) 알고리즘은 학습시간이 비교적 오래 걸린다는 단점이 있으며, 이는 실시간 처리를 요구하는 문제나 대규모 데이터 및 MLP 구조로 인해 학습시간이 상당히 긴 문제에서 제약으로 작용한다. 패턴인식에 사용되는 학습데이터는 풍부한 중복특성을 내포하고 있으므로 패턴마다 MLP의 내부변수를 갱신하는 은라인 계열의 학습방식이 속도의 향상에 상당한 효과가 있다. 일반적인 온라인 EBP 알고리즘에서는 내부 가중치 갱신시 고정된 학습률을 적용한다. 고정 학습률을 적절히 선택함으로써 패턴인식 응용에서 상당한 속도개선을 얻을 수 있지만, 학습률을 고정함으로써 온라인 방식에서 패턴별 갱신의 특성을 완전히 활용하지 못하는 비효율성이 발생한다. 또한, 학습도중 패턴군이 학습된 패턴과 그렇지 못한 패턴으로 나뉘고 이 가운데 학습된 패턴은 학습을 위한 계산에 포함될 필요가 없음에도 불구하고, 기존의 온라인 EBP에서는 에폭에 할당된 모든 패턴을 일률적으로 계산에 포함시킨다. 이 문제에 대해 본 논문에서는 학습이 진행됨에 따라 패턴마다 적절한 학습률을 적용하고 필요한 패턴만을 학습에 반영하는 패턴별 가변학습률 및 학습생략(COIL) 방댑을 제안한다. 제안한 COIL의 성능을 입증하기 위해 화자증명과 음성인식을 실험하고 그 결과를 제시한다.

  • PDF

Comparison of Artificial Neural Networks for Low-Power ECG-Classification System

  • Rana, Amrita;Kim, Kyung Ki
    • Journal of Sensor Science and Technology
    • /
    • v.29 no.1
    • /
    • pp.19-26
    • /
    • 2020
  • Electrocardiogram (ECG) classification has become an essential task of modern day wearable devices, and can be used to detect cardiovascular diseases. State-of-the-art Artificial Intelligence (AI)-based ECG classifiers have been designed using various artificial neural networks (ANNs). Despite their high accuracy, ANNs require significant computational resources and power. Herein, three different ANNs have been compared: multilayer perceptron (MLP), convolutional neural network (CNN), and spiking neural network (SNN) only for the ECG classification. The ANN model has been developed in Python and Theano, trained on a central processing unit (CPU) platform, and deployed on a PYNQ-Z2 FPGA board to validate the model using a Jupyter notebook. Meanwhile, the hardware accelerator is designed with Overlay, which is a hardware library on PYNQ. For classification, the MIT-BIH dataset obtained from the Physionet library is used. The resulting ANN system can accurately classify four ECG types: normal, atrial premature contraction, left bundle branch block, and premature ventricular contraction. The performance of the ECG classifier models is evaluated based on accuracy and power. Among the three AI algorithms, the SNN requires the lowest power consumption of 0.226 W on-chip, followed by MLP (1.677 W), and CNN (2.266 W). However, the highest accuracy is achieved by the CNN (95%), followed by MLP (76%) and SNN (90%).

Machine Printed Character Recognition Based on the Combination of Recognition Units Using Multiple Neural Networks (다중 신경망을 이용한 인식단위 결합 기반의 인쇄체 문자인식)

  • Lim, Kil-Taek;Kim, Ho-Yon;Nam, Yun-Seok
    • The KIPS Transactions:PartB
    • /
    • v.10B no.7
    • /
    • pp.777-784
    • /
    • 2003
  • In this Paper. we propose a recognition method of machine printed characters based on the combination of recognition units using multiple neural networks. In our recognition method, the input character is classified into one of 7 character types among which the first 6 types are for Hangul character and the last type is for non-Hangul characters. Hangul characters are recognized by several MLP (multilayer perceptron) neural networks through two stages. In the first stage, we divide Hangul character image into two or three recognition units (HRU : Hangul recognition unit) according to the combination fashion of graphemes. Each recognition unit composed of one or two graphemes is recognized by an MLP neural network with an input feature vector of pixel direction angles. In the second stage, the recognition aspect features of the HRU MLP recognizers in the first stage are extracted and forwarded to a subsequent MLP by which final recognition result is obtained. For the recognition of non-Hangul characters, a single MLP is employed. The recognition experiments had been performed on the character image database collected from 50,000 real letter envelope images. The experimental results have demonstrated the superiority of the proposed method.

Artificial neural network calculations for a receding contact problem

  • Yaylaci, Ecren Uzun;Yaylaci, Murat;Olmez, Hasan;Birinci, Ahmet
    • Computers and Concrete
    • /
    • v.25 no.6
    • /
    • pp.551-563
    • /
    • 2020
  • This paper investigates the artificial neural network (ANN) to predict the dimensionless parameters for the maximum contact pressures and contact areas of a contact problem. Firstly, the problem is formulated and solved theoretically by using Theory of Elasticity and Integral Transform Technique. Secondly, the contact problem has been extended based on the ANN. The multilayer perceptron (MLP) with three-layer was used to calculate the contact distances. External load, distance between the two quarter planes, layer heights and material properties were created by giving examples of different values were used at the training and test stages of ANN. Program code was rewritten in C++. Different types of network structures were used in the training process. The accuracy of the trained neural networks for the case was tested using 173 new data which were generated via theoretical solutions so as to determine the best network model. As a result, minimum deviation value (difference between theoretical and C++ ANN results) of was obtained for the network model. Theoretical results were compared with artificial neural network results and well agreements between them were achieved.

Development of Multi-DoFs Prosthetic Forearm based on EMG Pattern Recognition and Classification (근전도 패턴 인식 및 분류 기반 다자유도 전완 의수 개발)

  • Lee, Seulah;Choi, Yuna;Yang, Sedong;Hong, Geun Young;Choi, Youngjin
    • The Journal of Korea Robotics Society
    • /
    • v.14 no.3
    • /
    • pp.228-235
    • /
    • 2019
  • This paper presents a multiple DoFs (degrees-of-freedom) prosthetic forearm and sEMG (surface electromyogram) pattern recognition and motion intent classification of forearm amputee. The developed prosthetic forearm has 9 DoFs hand and single-DoF wrist, and the socket is designed considering wearability. In addition, the pattern recognition based on sEMG is proposed for prosthetic control. Several experiments were conducted to substantiate the performance of the prosthetic forearm. First, the developed prosthetic forearm could perform various motions required for activity of daily living of forearm amputee. It was able to control according to shape and size of the object. Additionally, the amputee was able to perform 'tying up shoe' using the prosthetic forearm. Secondly, pattern recognition and classification experiments using the sEMG signals were performed to find out whether it could classify the motions according to the user's intents. For this purpose, sEMG signals were applied to the multilayer perceptron (MLP) for training and testing. As a result, overall classification accuracy arrived at 99.6% for all participants, and all the postures showed more than 97% accuracy.

Using multivariate regression and multilayer perceptron networks to predict soil shear strength parameters

  • Ahmed Cemiloglu
    • Geomechanics and Engineering
    • /
    • v.39 no.2
    • /
    • pp.129-142
    • /
    • 2024
  • The most significant soil parameters that are utilized in geotechnical engineering projects' design and implementations are soil strength parameters including friction (ϕ), cohesion (c), and uniaxial compressive strength (UCS). Understanding soil shear strength parameters can be guaranteed the design success and stability of structures. In this regard, professionals always looking for ways to get more accurate estimations. The presented study attempted to investigate soil shear strength parameters by using multivariate regression and multilayer perceptron predictive models which were implemented on 100 specimens' data collected from the Tabriz region (NW of Iran). The uniaxial (UCS), liquid limit (LL), plasticity index (PI), density (γ), percentage of fine-grains (pass #200), and sand (pass #4) which are used as input parameters of analysis and shear strength parameters predictions. A confusion matrix was used to validate the testing and training data which is controlled by the coefficient of determination (R2), mean absolute (MAE), mean squared (MSE), and root mean square (RMSE) errors. The results of this study indicated that MLP is able to predict the soil shear strength parameters with an accuracy of about 93.00% and precision of about 93.5%. In the meantime, the estimated error rate is MAE = 2.0231, MSE = 2.0131, and RMSE = 2.2030. Additionally, R2 is evaluated for predicted and measured values correlation for friction angle, cohesion, and UCS are 0.914, 0.975, and 0.964 in the training dataset which is considerable.

Neural-based prediction of structural failure of multistoried RC buildings

  • Hore, Sirshendu;Chatterjee, Sankhadeep;Sarkar, Sarbartha;Dey, Nilanjan;Ashour, Amira S.;Balas-Timar, Dana;Balas, Valentina E.
    • Structural Engineering and Mechanics
    • /
    • v.58 no.3
    • /
    • pp.459-473
    • /
    • 2016
  • Various vague and unstructured problems encountered the civil engineering/designers that persuaded by their experiences. One of these problems is the structural failure of the reinforced concrete (RC) building determination. Typically, using the traditional Limit state method is time consuming and complex in designing structures that are optimized in terms of one/many parameters. Recent research has revealed the Artificial Neural Networks potentiality in solving various real life problems. Thus, the current work employed the Multilayer Perceptron Feed-Forward Network (MLP-FFN) classifier to tackle the problem of predicting structural failure of multistoried reinforced concrete buildings via detecting the failure possibility of the multistoried RC building structure in the future. In order to evaluate the proposed method performance, a database of 257 multistoried buildings RC structures has been constructed by professional engineers, from which 150 RC structures were used. From the structural design, fifteen features have been extracted, where nine features of them have been selected to perform the classification process. Various performance measures have been calculated to evaluate the proposed model. The experimental results established satisfactory performance of the proposed model.

Performance Improvement of Automatic Basal Cell Carcinoma Detection Using Half Hanning Window (Half Hanning 윈도우 전처리를 통한 기저 세포암 자동 검출 성능 개선)

  • Park, Aa-Ron;Baek, Seong-Joong;Min, So-Hee;You, Hong-Yoen;Kim, Jin-Young;Hong, Sung-Hoon
    • The Journal of the Korea Contents Association
    • /
    • v.6 no.12
    • /
    • pp.105-112
    • /
    • 2006
  • In this study, we propose a simple preprocessing method for classification of basal cell carcinoma (BCC), which is one of the most common skin cancer. The preprocessing step consists of data clipping with a half Hanning window and dimension reduction with principal components analysis (PCA). The application of the half Hanning window deemphasizes the peak near $1650cm^{-1}$ and improves classification performance by lowering the false negative ratio. Classification results with various classifiers are presented to show the effectiveness of the proposed method. The classifiers include maximum a posteriori probability (MAP), k-nearest neighbor (KNN), probabilistic neural network (PNN), multilayer perceptron(MLP), support vector machine (SVM) and minimum squared error (MSE) classification. Classification results with KNN involving 216 spectra preprocessed with the proposed method gave 97.3% sensitivity, which is very promising results for automatic BCC detection.

  • PDF

Image Mood Classification Using Deep CNN and Its Application to Automatic Video Generation (심층 CNN을 활용한 영상 분위기 분류 및 이를 활용한 동영상 자동 생성)

  • Cho, Dong-Hee;Nam, Yong-Wook;Lee, Hyun-Chang;Kim, Yong-Hyuk
    • Journal of the Korea Convergence Society
    • /
    • v.10 no.9
    • /
    • pp.23-29
    • /
    • 2019
  • In this paper, the mood of images was classified into eight categories through a deep convolutional neural network and video was automatically generated using proper background music. Based on the collected image data, the classification model is learned using a multilayer perceptron (MLP). Using the MLP, a video is generated by using multi-class classification to predict image mood to be used for video generation, and by matching pre-classified music. As a result of 10-fold cross-validation and result of experiments on actual images, each 72.4% of accuracy and 64% of confusion matrix accuracy was achieved. In the case of misclassification, by classifying video into a similar mood, it was confirmed that the music from the video had no great mismatch with images.