• Journal of IKEEE
• /
• v.23 no.4
• /
• pp.1187-1194
• /
• 2019

This paper proposes a CNN architecture as value function network of an artificial intelligence Othello game agent and its learning scheme using reinforcement learning algorithm. We propose an approach to construct the value function network by using CNN to learn the records of professional players' real game and an approach to enhance the network parameter by learning from self-play using reinforcement learning algorithm. The performance of value function network CNN was compared with existing ANN by letting two agents using each network to play games each other. As a result, the winning rate of the CNN agent was 69.7% and 72.1% as black and white, respectively. In addition, as a result of applying the reinforcement learning, the performance of the agent was improved by showing 100% and 78% winning rate, respectively, compared with the network-based agent without the reinforcement learning.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2001.12a
• /
• pp.267-270
• /
• 2001

In this paper, we propose the self-autonomous algorithm for mobile robot system. The proposed mobile robot system which is teamed by learning with the neural networks can trace the target at the same distances. The mobile robot can evaluate the distance between robot and target with ultrasonic sensors. By teaming the setup distance, current distance and command velocity, the robot can do intelligent self-autonomous drive. We use the neural network and back-propagation algorithm as a tool of learning. As a result, we confirm the ability of tracing the target with proposed mobile robot.

• Proceedings of the IEEK Conference
• /
• 2002.07c
• /
• pp.1889-1892
• /
• 2002

In this paper, we propose the self-autonomous algorithm for mobile robot system (MRS). The proposed mobile robot system which is learned by learning with the neural network can trace the target at the same distances. The mobile robot can use ultrasonic sensors and calculate the distance between target and mobile robot. By teaming the setup distance, current distance and command velocity, the robot can do intelligent self-autonomous drive. We use the neural network and back-propagation algorithm as a tool of learning. As a result, we confirm the ability of tracing the target with proposed mobile robot.

• ETRI Journal
• /
• v.41 no.5
• /
• pp.574-584
• /
• 2019

A new Mirai variant found recently was equipped with a dynamic update ability, which increases the level of difficulty for DDoS mitigation. Continuous development of 5G technology and an increasing number of Internet of Things (IoT) devices connected to the network pose serious threats to cyber security. Therefore, researchers have tried to develop better DDoS mitigation systems. However, the majority of the existing models provide centralized solutions either by deploying the system with additional servers at the host site, on the cloud, or at third party locations, which may cause latency. Since Internet service providers (ISP) are links between the internet and users, deploying the defense system within the ISP domain is the panacea for delivering an efficient solution. To cope with the dynamic nature of the new DDoS attacks, we utilized an unsupervised artificial neural network to develop a hierarchical two-layered self-organizing map equipped with a twofold feature selection for DDoS mitigation within the ISP domain.

• Nuclear Engineering and Technology
• /
• v.47 no.5
• /
• pp.624-632
• /
• 2015

A self-diagnostic monitoring system is a system that has the ability to measure various physical quantities such as temperature, pressure, or acceleration from sensors scattered over a mechanical system such as a power plant, in order to monitor its various states, and to make a decision about its health status. We have developed a self-diagnostic monitoring system for an air-operated valve system to be used in a nuclear power plant. In this study, we have tried to improve the self-diagnostic monitoring system to increase its reliability. We have implemented three different machine learning algorithms, i.e., logistic regression, an artificial neural network, and a support vector machine. After each algorithm performs the decision process independently, the decision-making module collects these individual decisions and makes a final decision using a majority vote scheme. With this, we performed some simulations and presented some of its results. The contribution of this study is that, by employing more robust and stable algorithms, each of the algorithms performs the recognition task more accurately. Moreover, by integrating these results and employing the majority vote scheme, we can make a definite decision, which makes the self-diagnostic monitoring system more reliable.

• International Journal of Computer Science & Network Security
• /
• v.24 no.6
• /
• pp.131-140
• /
• 2024

The outbreak of Covid-19 has forced teachers of special education in Saudi Arabia to keep to themselves to live in a technology-infused society throughout the virtual teaching and learning process. This study set out to explore the competence, self-efficacy, and autonomy in using information communication technology (ICT) of special education teachers in Saudi Arabia. A total of 244 special education teachers in Saudi Arabia participated in this study. This study adopted the New General Self-Efficacy Scale developed and validated by Chen, Gully, and Eden (2001), as well as the Basic Psychological Needs in Exercise Scale (BPNES) developed and validated by Vlachopoulos and Michailidou (2006). Confirmatory factor analysis (CFA) and multivariate analysis of variance (MANOVA) were used as the main data analysis in this study. The findings showed that special education teachers in Saudi Arabia possessed competence, self-efficacy, and autonomy in using ICT in their teaching and learning process. All the factor loadings in each factor were.75 or higher, indicating good factor loadings. The results of the MANOVA indicated that special education teachers in Saudi Arabia do not report different perceptions of their competence, self-efficacy, and autonomy despite their different gender, age group, academic background, and teaching experiences.

• Journal of KSNVE
• /
• v.10 no.2
• /
• pp.331-337
• /
• 2000

The necessity of diagnosis of the rotating machinery which is widely used in the industry is increasing. Many research has been conducted to manipulate field vibration signal data for diagnosing the fault of designated machinery. As the pattern recognition tool of that signal, neural network which use usually back-propagation algorithm was used in the diagnosis of rotating machinery. In this paper, self-organizing feature map(SOFM) which is unsupervised learning algorithm is used in the abnormal defect diagnosis of rotating machinery and then learning vector quantization(LVQ) which is supervised learning algorithm is used to improve the quality of the classifier decision regions.

• Transactions of the Korean Society of Mechanical Engineers
• /
• v.18 no.8
• /
• pp.1939-1951
• /
• 1994

This study introduces a new tool breakage detecting technology comprised of an unsupervised neural network combined with adaptive time series autoregressive(AR) model where parameters are estimated recursively at each sampling instant using a parameter adaptation algorithm based on an RLS(Recursive Least Square). Experiment indicates that AR parameters are good features for tool breakage, therefore it can be detected by tracking the evolution of the AR parameters during milling process. an ART 2(Adaptive Resonance Theory 2) neural network is used for clustering of tool states using these parameters and the network is capable of self organizing without supervised learning. This system operates successfully under the wide range of cutting conditions without a priori knowledge of the process, with fast monitoring time.

• Journal of the Institute of Electronics Engineers of Korea SC
• /
• v.40 no.4
• /
• pp.264-274
• /
• 2003

This paper presents a direct generalized minimum-variance self tuning controller with a PID structure using neural network which adapts to the changing parameters of the nonlinear system with nonminimum phase behavior, noises and time delays. The self-tuning controller with a PID structure is a combination of the simple structure of a PID controller and the characteristics of a self-tuning controller that can adapt to changes in the environment. The self-tuning control effect is achieved through the RLS (recursive least square) algorithm at the parameter estimation stage as well as through the Robbins-Monro algorithm at the stage of optimizing the design parameter of the controller. The neural network control effect which compensates for nonlinear factor is obtained from the learning algorithm which the learning error between the filtered reference and the auxiliary output of plant becomes zero. Computer simulation has shown that the proposed method works effectively on the nonlinear nonminimum phase system with time delays and changed system parameter.

• International Journal of Control, Automation, and Systems
• /
• v.6 no.3
• /
• pp.453-459
• /
• 2008

The neural network is currently being used throughout numerous control system fields. However, it is not easy to obtain an input-output pattern when the neural network is used for the system of a single feedback controller and it is difficult to obtain satisfactory performance with when the load changes rapidly or disturbance is applied. To resolve these problems, this paper proposes a new mode to implement a neural network controller by installing a real object for control and an algorithm for this, which can replace the existing method of implementing a neural network controller by utilizing activation function at the output node. The real plant object for controlling of this mode implements a simple neural network controller replacing the activation function and provides the error back propagation path to calculate the error at the output node. As the controller is designed using a simple structure neural network, the input-output pattern problem is solved naturally and real-time learning becomes possible through the general error back propagation algorithm. The new algorithm applied neural network controller gives excellent performance for initial and tracking response and shows a robust performance for rapid load change and disturbance, in which the permissible error surpasses the range border. The effect of the proposed control algorithm was verified in a test that controlled the speed of a motor equipped with a high speed computing capable DSP on which the proposed algorithm was loaded.