• Journal of IKEEE
• /
• v.24 no.4
• /
• pp.991-997
• /
• 2020

Reinforcement learning has been applied mainly in sequential decision-making problems. Especially in recent years, reinforcement learning combined with neural networks has brought successful results in previously unsolved fields. However, reinforcement learning using deep neural networks has the disadvantage that it is too complex for immediate use in the field. In this paper, we implemented path planning algorithm for mobile robots using Q-learning, one of the easy-to-learn reinforcement learning algorithms. We used real-time Q-learning to update the Q-table in real-time since the Q-learning method of generating Q-tables in advance has obvious limitations. By adjusting the exploration strategy, we were able to obtain the learning speed required for real-time Q-learning. Finally, we compared the performance of real-time Q-learning and DQN.

• Proceedings of the KSME Conference
• /
• 2001.06b
• /
• pp.724-729
• /
• 2001

This paper discusses the composition of the theory of reinforcement learning, which is applied in real-time learning, and evolutionary strategy, which proves its the superiority in the finding of the optimal solution at the off-line learning method. The individuals are reduced in order to learn the evolutionary strategy in real-time, and new method that guarantee the convergence of evolutionary mutations are proposed. It possible to control the control object varied as time changes. As the state value of the control object is generated, applied evolutionary strategy each sampling time because the learning process of an estimation, selection, mutation in real-time. These algorithms can be applied, the people who do not have knowledge about the technical tuning of dynamic systems could design the controller or problems in which the characteristics of the system dynamics are slightly varied as time changes. In the future, studies are needed on the proof of the theory through experiments and the characteristic considerations of the robustness against the outside disturbances.

• Proceedings of the KSME Conference
• /
• 2001.06b
• /
• pp.105-109
• /
• 2001

This paper discuss the real-time self-tuning learning control based on evolutionary computation, which proves its the superiority in the finding of the optimal solution at the off-line learning method. The individuals are reduced in order to learn the evolutionary strategy in real-time, and new method that guarantee the convergence of evolutionary mutations are proposed. It possible to control the control object varied as time changes. As the state value of the control object is generated, applied evolutionary strategy each sampling time because the learning process of an estimation, selection, mutation in real-time. These algorithms can be applied, the people who do not have knowledge about the technical tuning of dynamic systems could design the controller or problems in which the characteristics of the system dynamics are slightly varied as time changes.

• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.27 no.9
• /
• pp.1463-1468
• /
• 2003

This paper presented the real-time self-tuning learning control based on evolutionary computation, which proves its superiority in finding of the optimal solution at the off-line learning method. The individuals of the populations are reduced in order to learn the evolutionary strategy in real-time, and new method that guarantee the convergence of evolutionary mutations is proposed. It is possible to control the control object slightly varied as time changes. As the state value of the control object is generated, evolutionary strategy is applied each sampling time because the learning process of an estimation, selection, mutation is done in real-time. These algorithms can be applied; the people who do not have knowledge about the technical tuning of dynamic systems could design the controller or problems in which the characteristics of the system dynamics are slightly varied as time changes.

• Journal of Satellite, Information and Communications
• /
• v.12 no.3
• /
• pp.69-73
• /
• 2017

In this paper, we developed a real-time image recognition algorithm based on machine learning and tested the performance of the algorithm. The real-time image recognition algorithm recognizes the input image in real-time based on the machine-learned image data. In order to test the performance of the real-time image recognition algorithm, we applied the real-time image recognition algorithm to the autonomous vehicle and showed the performance of the real-time image recognition algorithm through the application of the autonomous vehicle.

• Fourth Industrial Review
• /
• v.3 no.1
• /
• pp.13-20
• /
• 2023

Purpose - By designing a PEF(Personalized Education Feedback) system for real-time prediction of learning achievement and motivation through real-time EEG analysis of learners, this system provides some modules of a personalized adaptive learning system. By applying these modules to e-learning and offline learning, they motivate learners and improve the quality of learning progress and effective learning outcomes can be achieved for immersive self-directed learning Research design, data, and methodology - EEG data were collected simultaneously as the English test was given to the experimenters, and the correlation between the correct answer result and the EEG data was learned with a machine learning algorithm and the predictive model was evaluated.. Result - In model performance evaluation, both artificial neural networks(ANNs) and support vector machines(SVMs) showed high accuracy of more than 91%. Conclusion - This research provides some modules of personalized adaptive learning systems that can more efficiently complete by designing a PEF system for real-time learning achievement prediction and learning motivation through an adaptive learning system based on real-time EEG analysis of learners. The implication of this initial research is to verify hypothetical situations for the development of an adaptive learning system through EEG analysis-based learning achievement prediction.

• The Transactions of the Korean Institute of Electrical Engineers P
• /
• v.57 no.2
• /
• pp.109-114
• /
• 2008

In this paper, a dynamic learning controller for robot manipulator is implemented using real-time operating system with capabilities of multitasking, intertask communication and synchronization, event-driven, priority-driven scheduling, real-time clock control, etc. The controller hardware system with VME bus and related devices is developed and applied to implement a dynamic learning control scheme for robot manipulator. Real-time performance of the proposed dynamic learning controller is tested and evaluated for tracking of the desired trajectory and compared with the conventional servo controller.

• Corrosion Science and Technology
• /
• v.18 no.6
• /
• pp.253-257
• /
• 2019

A deep learning based real-time painting surface inspection algorithm is proposed herein, designed for developing an autonomous inspection drone. The painting surface inspection is usually conducted manually. However, the manual inspection has a limitation in obtaining accurate data for correct judgement on the surface because of human error and deviation of individual inspection experiences. The best method to replace manual surface inspection is the vision-based inspection method with a camera, using various image processing algorithms. Nevertheless, the visual inspection is difficult to apply to surface inspection due to diverse appearances of material, hue, and lightning effects. To overcome technical limitations, a deep learning-based pattern recognition algorithm is proposed, which is specialized for painting surface inspections. The proposed algorithm functions in real time on the embedded board mounted on an autonomous inspection drone. The inspection results data are stored in the database and used for training the deep learning algorithm to improve performance. The various experiments for pre-inspection of painting processes are performed to verify real-time performance of the proposed deep learning algorithm.

• IEMEK Journal of Embedded Systems and Applications
• /
• v.19 no.3
• /
• pp.151-158
• /
• 2024

Although on-device artificial intelligence (AI) has gained attention to diagnosing machine faults in real time, most previous studies did not consider the model retraining and redeployment processes that must be performed in real-world industrial environments. Our study addresses this challenge by proposing an on-device AI-based real-time machine fault diagnosis system that utilizes continual learning. Our proposed system includes a lightweight convolutional neural network (CNN) model, a continual learning algorithm, and a real-time monitoring service. First, we developed a lightweight 1D CNN model to reduce the cost of model deployment and enable real-time inference on the target edge device with limited computing resources. We then compared the performance of five continual learning algorithms with three public bearing fault datasets and selected the most effective algorithm for our system. Finally, we implemented a real-time monitoring service using an open-source data visualization framework. In the performance comparison results between continual learning algorithms, we found that the replay-based algorithms outperformed the regularization-based algorithms, and the experience replay (ER) algorithm had the best diagnostic accuracy. We further tuned the number and length of data samples used for a memory buffer of the ER algorithm to maximize its performance. We confirmed that the performance of the ER algorithm becomes higher when a longer data length is used. Consequently, the proposed system showed an accuracy of 98.7%, while only 16.5% of the previous data was stored in memory buffer. Our lightweight CNN model was also able to diagnose a fault type of one data sample within 3.76 ms on the Raspberry Pi 4B device.

• Korea Real Estate Review
• /
• v.27 no.3
• /
• pp.71-86
• /
• 2017

The purpose of this study was to apply the deep running method to real estate price index predicting and to compare it with the time series analysis method to test the possibility of its application to real estate market forecasting. Various real estate price indices were predicted using the DNN (deep neural networks) and LSTM (long short term memory networks) models, both of which draw on the deep learning method, and the ARIMA (autoregressive integrated moving average) model, which is based on the time seies analysis method. The results of the study showed the following. First, the predictive power of the deep learning method is superior to that of the time series analysis method. Second, among the deep learning models, the predictability of the DNN model is slightly superior to that of the LSTM model. Third, the deep learning method and the ARIMA model are the least reliable tools for predicting the housing sales prices index among the real estate price indices. Drawing on the deep learning method, it is hoped that this study will help enhance the accuracy in predicting the real estate market dynamics.