• Journal of Applied Reliability
• /
• v.18 no.1
• /
• pp.20-32
• /
• 2018

Purpose: The purpose of this study is to set up an anomaly detection criteria for sensor data coming from a motorcycle. Methods: Five sensor values for accelerator pedal, engine rpm, transmission rpm, gear and speed are obtained every 0.02 second from a motorcycle. Exploratory data analysis is used to find any pattern in the data. Traditional process control methods such as X control chart and time series models are fitted to find any anomaly behavior in the data. Finally unsupervised learning algorithm such as k-means clustering is used to find any anomaly spot in the sensor data. Results: According to exploratory data analysis, the distribution of accelerator pedal sensor values is very much skewed to the left. The motorcycle seemed to have been driven in a city at speed less than 45 kilometers per hour. Traditional process control charts such as X control chart fail due to severe autocorrelation in each sensor data. However, ARIMA model found three abnormal points where they are beyond 2 sigma limits in the control chart. We applied a copula based Markov chain to perform statistical process control for correlated observations. Copula based Markov model found anomaly behavior in the similar places as ARIMA model. In an unsupervised learning algorithm, large sensor values get subdivided into two, three, and four disjoint regions. So extreme sensor values are the ones that need to be tracked down for any sign of anomaly behavior in the sensor values. Conclusion: Exploratory data analysis is useful to find any pattern in the sensor data. Process control chart using ARIMA and Joe's copula based Markov model also give warnings near similar places in the data. Unsupervised learning algorithm shows us that the extreme sensor values are the ones that need to be tracked down for any sign of anomaly behavior.

• ETRI Journal
• /
• v.44 no.5
• /
• pp.733-745
• /
• 2022

In software-defined wireless networking (SDWN), the optimal routing technique is one of the effective solutions to improve its performance. This routing technique is done by many different methods, with the most common using integer linear programming problem (ILP), building optimal routing metrics. These methods often only focus on one routing objective, such as minimizing the packet blocking probability, minimizing end-to-end delay (EED), and maximizing network throughput. It is difficult to consider multiple objectives concurrently in a routing algorithm. In this paper, we investigate the application of machine learning to control routing in the SDWN. An intelligent routing algorithm is then proposed based on the machine learning to improve the network performance. The proposed algorithm can optimize multiple routing objectives. Our idea is to combine supervised learning (SL) and reinforcement learning (RL) methods to discover new routes. The SL is used to predict the performance metrics of the links, including EED quality of transmission (QoT), and packet blocking probability (PBP). The routing is done by the RL method. We use the Q-value in the fundamental equation of the RL to store the PBP, which is used for the aim of route selection. Concurrently, the learning rate coefficient is flexibly changed to determine the constraints of routing during learning. These constraints include QoT and EED. Our performance evaluations based on OMNeT++ have shown that the proposed algorithm has significantly improved the network performance in terms of the QoT, EED, packet delivery ratio, and network throughput compared with other well-known routing algorithms.

• Proceedings of the KIEE Conference
• /
• 2005.05a
• /
• pp.15-17
• /
• 2005

Recently genetic algorithm techniques have widely used in adaptive and control schemes for production systems. However, generally it costs a lot of time for learning in the case applied in control system. Furthermore, the physical meaning of genetic algorithm constructed as a result is not obvious. And this method has been used as a learning algorithm to estimate the parameter of a genetic algorithm used for identification of the process dynamics of nonlinear IIR filter and it was shown that this method offered superior capability over the genetic algorithm. A genetic algorithm is used to solve the parameter identification problem for linear and nonlinear digital filters. This paper goal estimate nonlinear IIR filter parameter using the genetic algorithm.

• Proceedings of the KIEE Conference
• /
• 2005.10b
• /
• pp.502-504
• /
• 2005

Recently genetic algorithm techniques have widely used in adaptive and control schemes for production systems. However, generally it costs a lot of time for learning in the case applied in control system. Furthermore, the physical meaning of genetic algorithm constructed as a result is not obvious. And this method has been used as a learning algorithm to estimate the parameter of a genetic algorithm used for identification of the process dynamics of FIR filter and it was shown that this method offered superior capability over the genetic algorithm. A genetic algorithm is used to solve the parameter identification problem for linear and nonlinear digital filters. This paper goal estimate FIR filter parameter using the genetic algorithm.

• Structural Engineering and Mechanics
• /
• v.87 no.4
• /
• pp.305-315
• /
• 2023

The idea of the combination of the fractional-order operators with the brain emotional learning-based intelligent controller (BELBIC) is developed for implementation in seismic-excited structures equipped with active mass damper (AMD). For this purpose, a new design framework of the mentioned combination namely fractional-order BEBIC (FOBELBIC) is proposed based on a modified-teaching-learning-based optimization (MTLBO) algorithm. The seismic performance of the proposed controller is then evaluated for a 15-story building equipped with AMD subjected to two far-field and two near-field earthquakes. An optimal BELBIC based on the MTLBO algorithm is also introduced for comparison purposes. In comparison with the structure equipped with a passive tuned mass damper (TMD), an average reduction of 44.7% and 42.8% are obtained in terms of the maximum absolute and RMS top floor displacement for FOBELBIC, while these reductions are obtained as 30.4% and 30.1% for the optimal BELBIC, respectively. Similarly, the optimal FOBELBIC results in an average reduction of 42.6% and 39.4% in terms of the maximum absolute and RMS top floor acceleration, while these reductions are given as 37.9% and 30.5%, for the optimal BELBIC, respectively. Consequently, the superiority of the FOBELBIC over the BELBIC is concluded in the reduction of maximum and RMS seismic responses.

• International Journal of Air-Conditioning and Refrigeration
• /
• v.14 no.4
• /
• pp.138-146
• /
• 2006

Recently, a technology based on the proportional integral (PI) control have grown rapidly owing to the needs for the robust capacity of the controllers from industrial building sectors. However, PI controller generally requires tuning of gains for optimal control when the outside weather condition changes. The present study presents the possibility of reinforcement learning (RL) control algorithm with PI controller adapted in the HVAC system. The optimal design criteria of RL controller was proposed in the environment chamber experiment and a theoretical analysis was also conducted using TRNSYS program.

• 제어로봇시스템학회:학술대회논문집
• /
• 1989.10a
• /
• pp.1097-1112
• /
• 1989

An iterative learning control scheme is incorporated to the computed torque method as a means to enhance the accuracy and the flexibility. A learning rule is constructed by utilizing a gradient descent algorithm and data compressing techniques are illustrated. Computer simulation results show a good performance of the scheme under a relatively high speed and a heavy payload condition.

• Proceedings of the KIEE Conference
• /
• 2006.07d
• /
• pp.1868-1870
• /
• 2006

Neural network is used in many fields of control systems, but input-output patterns of a control system are not easy to be obtained and by using as single feedback neural network controller. And also it is difficult to get a satisfied performance when the changes of rapid load and disturbance are applied. To resolve those problems, this paper proposes a new algorithm which is the neural network controller. The new algorithm uses the neural network instead of activation function to control object at the output node. Therefore, control object is composed of neural network controller unifying activation function, and it supplies the error back propagation path to calculate the error at the output node. As a result, the input-output pattern problem of the controller which is resigned by the simple structure of neural network is solved, and real-time learning can be possible in general back propagation algorithm. Application of the new algorithm of neural network controller gives excellent performance for initial and tracking response and it shows the robust performance for rapid load change and disturbance. The proposed control algorithm is implemented on a high speed DSP, TMS320C32, for the speed of 3-phase induction motor. Enhanced performance is shown in the test of the speed control.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.8 no.2
• /
• pp.464-470
• /
• 2004

We propose an enhanced backpropagation algorithm by auto-tuning of learning rate using fuzzy control system for performance improvement of backpropagation algorithm. We propose two methods, which improve local minima and loaming times problem. First, if absolute value of difference between target and actual output value is smaller than $\varepsilon$ or the same, we define it as correctness. And if bigger than $\varepsilon$, we define it as incorrectness. Second, instead of choosing a fixed learning rate, the proposed method is used to dynamically adjust learning rate using fuzzy control system. The inputs of fuzzy control system are number of correctness and incorrectness, and the output is the Loaming rate. For the evaluation of performance of the proposed method, we applied the XOR problem and numeral patterns classification The experimentation results showed that the proposed method has improved the performance compared to the conventional backpropagatiot the backpropagation with momentum, and the Jacob's delta-bar-delta method.

• 제어로봇시스템학회:학술대회논문집
• /
• 1993.10b
• /
• pp.345-350
• /
• 1993

This paper presents an on-line feedback error learning control algorithm for a magnetic levitation system. It will be shown that even in the case of abrupt changes of the system parameters and disturbanes, the control performance is still very satisfactory.