• International journal of advanced smart convergence
• /
• v.13 no.2
• /
• pp.80-87
• /
• 2024

This paper focuses on improving accuracy in constrained computing settings by employing the ReLU (Rectified Linear Unit) activation function. The research conducted involves modifying parameters of the ReLU function and comparing performance in terms of accuracy and computational time. This paper specifically focuses on optimizing ReLU in the context of a Multilayer Perceptron (MLP) by determining the ideal values for features such as the dimensions of the linear layers and the learning rate (Ir). In order to optimize performance, the paper experiments with adjusting parameters like the size dimensions of linear layers and Ir values to induce the best performance outcomes. The experimental results show that using ReLU alone yielded the highest accuracy of 96.7% when the dimension sizes were 30 - 10 and the Ir value was 1. When combining ReLU with the Adam optimizer, the optimal model configuration had dimension sizes of 60 - 40 - 10, and an Ir value of 0.001, which resulted in the highest accuracy of 97.07%.

• Asian Journal of Atmospheric Environment
• /
• v.9 no.1
• /
• pp.12-21
• /
• 2015

Air pollution is a challenging issue in some of the large cities in developing countries. In this regard, data interpretation is one of the most important parts of air quality management. Several methods exist to analyze air quality; among these, we applied the Multilayer Perceptron (MLP) and Radial Basis Function (RBF) methods to predict the hourly air concentration of benzene in 14 districts in the municipality of Tehran. Input data were hourly temperature, wind speed and relative humidity. Both methods determined reliable results. However, the RBF neural network performance was much closer to observed benzene data than the MLP neural network. The correlation determination resulted in 0.868 for MLP and 0.907 for RBF, while the Index of Agreement (IA) was 0.889 for MLP and 0.937 for RBF. The sensitivity analysis related to the MLP neural network indicated that the temperature had the greatest effect on prediction of benzene in comparison with the wind speed and humidity in the study area. The temperature was the most significant factor in benzene production because benzene is a volatile liquid.

• Advances in environmental research
• /
• v.4 no.4
• /
• pp.219-231
• /
• 2015

In recent years, raising air pollutants has become as a big concern, especially in metropolitan cities such as Tehran. Therefore, forecasting the level of pollutants plays a significant role in air quality management. One of the forecasting tools that can be used is an artificial neural network which is able to model the complicated process of air pollution. In this study, we applied two different methods of artificial neural networks, the Multilayer Perceptron (MLP) and Radial Basis Function (RBF), to predict the hourly air concentrations of toluene in Tehran. Hourly temperature, wind speed, humidity and $NO_x$ were selected as inputs. Both methods had acceptable results; however, the RBF neural network produced better results. The coefficient of determination ($R^2$) between the observed and predicted data was 0.9642 and 0.99 for MLP and RBF neural networks, respectively. The results of the mean bias errors (MBE) were 0.00 and -0.014 for RBF and MLP, respectively which indicate the adequacy of the models. The index of agreement (IA) between the observed and predicted data was 0.999 and 0.994 in the RBF and the MLP, respectively which indicates the efficiency of the models. Finally, sensitivity analysis related to the MLP neural network determined that temperature was the most significant factor in air concentration of toluene in Tehran which may be due to the volatile nature of toluene.

• The KIPS Transactions:PartB
• /
• v.18B no.6
• /
• pp.341-348
• /
• 2011

ECG(Electrocardiogram), a field of Bio-signal, is generally experimented with classification algorithms most of which are SVM(Support Vector Machine), MLP(Multilayer Perceptron). But this study modified the Random Forest Algorithm along the basis of signal characteristics and comparatively analyzed the accuracies of modified algorithm with those of SVM and MLP to prove the ability of modified algorithm. The R-R interval extracted from ECG is used in this study and the results of established researches which experimented co-equal data are also comparatively analyzed. As a result, modified RF Classifier showed better consequences than SVM classifier, MLP classifier and other researches' results in accuracy category. The Band-pass filter is used to extract R-R interval in pre-processing stage. However, the Wavelet transform, median filter, and finite impulse response filter in addition to Band-pass filter are often used in experiment of ECG. After this study, selection of the filters efficiently deleting the baseline wandering in pre-processing stage and study of the methods correctly extracting the R-R interval are needed.

• Science of Emotion and Sensibility
• /
• v.27 no.1
• /
• pp.59-68
• /
• 2024

This study aimed to develop a soft fabric-based elbow-bending angle sensor that can replace conventional hard-type inertial sensors and a system for estimating bending angles using it. To enhance comfort during exercise, this study treated four fabrics (Bergamo, E-band, span cushion, and polyester) by single-walled carbon nanotube dip coating to create conductive textiles. Subsequently, one fabric was selected based on performance evaluations, and an elbow flexion angle sensor was fabricated. Gauge factor, hysteresis, and sensing range were employed as performance evaluation metrics. The data obtained using the fabricated sensor showed different trends in sensor values for the changes in the angle during bending and extending movements. Because of this divergence, the two movements were separated, and this constituted the one-step process. In the two-step process, multilayer perceptron (MLP) was employed to handle the complex nonlinear relationships and achieve high data accuracy. Based on the results of this study, we anticipate effective utilization in various smart wearable and healthcare domains. Consequently, a soft- fabric bending angle sensor was developed, and using MLP, nonlinear relationships can be addressed, enabling angle estimation. Based on the results of this study, we anticipate the effective utilization of the developed system in smart wearables and healthcare.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.28 no.3C
• /
• pp.271-278
• /
• 2003

In this paper, we propose a new MLP based detector which has low circuit complexity and fast adaptation capability for CDMA downlink in frequency selective fading, and is easy for parameter optimization. The simplified structure of the proposed MLP is designed by making use of transmission characteristics of downlinks such that all users signals transmitted over same propagation paths and the number of channelization codes are limited. Significant performance improvement over Rake receiver can be obtained with the proposed MLP and the efficiency of the proposed MLP was compared with that of conventional MLP.

• Proceedings of the Korea Institutes of Information Security and Cryptology Conference
• /
• 1997.11a
• /
• pp.345-353
• /
• 1997

Password checking is the most popular user authentication method. The keystroke dynamics can be combined to result in a more secure system. We propose an autoassociator multilayer perceptron which is trained with the timing vectors of the owner's keystroke dynamics and then used to discriminate between the owner and an imposter. An imposter typing the correct password can be detected with a very high accuracy using the proposed approach. The approach can also be used over the internet such as World Wide Web when implemented using a Java applet.

• The Journal of Korea Robotics Society
• /
• v.12 no.2
• /
• pp.206-216
• /
• 2017

This paper proposes a method to simultaneously estimate two degrees of freedom in wrist forces (extension - flexion, adduction - abduction) and one degree of freedom in grasping forces using Electromyography (EMG) signals of the forearms. To correlate the EMG signals with the forces, we applied a multi - layer perceptron(MLP), which is a machine learning method, and used the characteristics of the muscles constituting the forearm to generate learning data. Through the experiments, the similarity between the MLP target value and the estimated value was investigated by applying the coefficient of determination ($R^2$) and root mean square error (RMSE) to evaluate the performance of the proposed method. As a result, the $R^2$ values with respect to the wrist flexion-extension, adduction - abduction and grasping forces were 0.79, 0.73 and 0.78 and RMSE were 0.12, 0.17, 0.13 respectively.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2003.10a
• /
• pp.1015-1020
• /
• 2003

Among the techniques to protect private information by adopting biometrics, speaker verification is expected to be widely used due to advantages in convenient usage and implementation cost. Speaker verification should achieve a high degree of the reliability in the verification score, the flexibility in speech text usage, and the efficiency in verification system complexity. Continuants have excellent speaker-discriminant power and the modest number of phonemes in the category, and multilayer perceptrons (MLPs) have superior recognition ability and fast operation speed. In consequence, the two provide viable ways for speaker verification system to obtain the above properties. This paper implements a system to which continuants and MLPs are applied, and evaluates the system using a Korean speech database. The results of the experiment prove that continuants and MLPs enable the system to acquire the three properties.

• Journal of Bio-Environment Control
• /
• v.28 no.2
• /
• pp.95-103
• /
• 2019

Temperature and relative humidity are important factors in crop cultivation and should be properly controlled for improving crop yield and quality. In order to control the environment accurately, we need to predict how the environment will change in the future. The objective of this study was to predict air temperature and relative humidity at a future time by using a multilayer perceptron (MLP). The data required to train MLP was collected every 10 min from Oct. 1, 2016 to Feb. 28, 2018 in an eight-span greenhouse ($1,032m^2$) cultivating mango (Mangifera indica cv. Irwin). The inputs for the MLP were greenhouse inside and outside environment data, and set-up and operating values of environment control devices. By using these data, the MLP was trained to predict the air temperature and relative humidity at a future time of 10 to 120 min. Considering typical four seasons in Korea, three-day data of the each season were compared as test data. The MLP was optimized with four hidden layers and 128 nodes for air temperature ($R^2=0.988$) and with four hidden layers and 64 nodes for relative humidity ($R^2=0.990$). Due to the characteristics of MLP, the accuracy decreased as the prediction time became longer. However, air temperature and relative humidity were properly predicted regardless of the environmental changes varied from season to season. For specific data such as spray irrigation, however, the numbers of trained data were too small, resulting in poor predictive accuracy. In this study, air temperature and relative humidity were appropriately predicted through optimization of MLP, but were limited to the experimental greenhouse. Therefore, it is necessary to collect more data from greenhouses at various places and modify the structure of neural network for generalization.