• Title/Summary/Keyword: Learning Control Algorithm

Search Result 947, Processing Time 0.031 seconds

A NARX Dynamic Neural Network Platform for Small-Sat PDM (동적신경망 NARX 기반의 SAR 전력모듈 안전성 연구)

  • Lee, Hae-Jun
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.24 no.6
    • /
    • pp.809-817
    • /
    • 2020
  • In the design and development process of Small-Sat power distribution and transmission module, the stability of dynamic resources was evaluated by a deep learning algorithm. The requirements for the stability evaluation consisted of the power distribution function of the power distribution module and demand module to the SAR radar in Small-Sat. To verify the performance of the switching power components constituting the power module PDM, the reliability was verified using a dynamic neural network. The adoption material of deep learning for reliability verification is the power distribution function of the payload to the power supplied from the small satellite main body. Modeling targets for verifying the performance of this function are output voltage (slew rate control), voltage error, and load power characteristics. First, to this end, the Coefficient Structure area was defined by modeling, and PCB modules were fabricated to compare stability and reliability. Second, Levenberg-Marquare based Two-Way NARX neural network Sigmoid Transfer was used as a deep learning algorithm.

Automatic Assembly Task of Electric Line Using 6-Link Electro-Hydraulic Manipulators

  • Kyoungkwan Ahn;Lee, Byung-Ryong;Yang, Soon-Yong
    • Journal of Mechanical Science and Technology
    • /
    • v.16 no.12
    • /
    • pp.1633-1642
    • /
    • 2002
  • Uninterrupted power supply has become indispensable during the maintenance task of active electric power lines as a result of today's highly information-oriented society and increasing demand of electric utilities. The maintenance task has the risk of electric shock and the danger of falling from high place. Therefore it is necessary to realize an autonomous robot system using electro-hydraulic manipulator because hydraulic manipulators have the advantage of electric insulation. Meanwhile it is relatively difficult to realize autonomous assembly tasks particularly in the case of manipulating flexible objects such as electric lines. In this report, a discrete event control system is introduced for automatic assembly task of electric lines into sleeves as one of the typical task of active electric power lines. In the implementation of a discrete event control system, LVQNN (linear vector quantization neural network) is applied to the insertion task of electric lines to sleeves. In order to apply these proposed control system to the unknown environment, virtual learning data for LVQNN is generated by fuzzy inference. By the experimental results of two types of electric lines and sleeves, these proposed discrete event control and neural network learning algorithm are confirmed very effective to the insertion tasks of electric lines to sleeves as a typical task of active electric power maintenance tasks.

Adaptive Learning Control of Neural Network Using Real-Time Evolutionary Algorithm (실시간 진화 알고리듬을 통한 신경망의 적응 학습제어)

  • Chang, Sung-Ouk;Lee, Jin-Kul
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.26 no.6
    • /
    • pp.1092-1098
    • /
    • 2002
  • This paper discusses the composition of the theory of reinforcement teaming, which is applied in real-time teaming, and evolutionary strategy, which proves its the superiority in the finding of the optimal solution at the off-line teaming method. The individuals are reduced in order to team the evolutionary strategy in real-time, and new method that guarantee the convergence of evolutionary mutations are proposed. It is possible to control the control object varied as time changes. As the state value of the control object is generated, applied evolutionary strategy each sampling time because of the teaming process of an estimation, selection, mutation in real-time. These algorithms can be applied, the people who do not have knowledge about the technical tuning of dynamic systems could design the controller or problems in which the characteristics of the system dynamics are slightly varied as time changes. In the future, studies are needed on the proof of the theory through experiments and the characteristic considerations of the robustness against the outside disturbances.

A Learning-based Power Control Scheme for Edge-based eHealth IoT Systems

  • Su, Haoru;Yuan, Xiaoming;Tang, Yujie;Tian, Rui;Sun, Enchang;Yan, Hairong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.12
    • /
    • pp.4385-4399
    • /
    • 2021
  • The Internet of Things (IoT) eHealth systems composed by Wireless Body Area Network (WBAN) has emerged recently. Sensor nodes are placed around or in the human body to collect physiological data. WBAN has many different applications, for instance health monitoring. Since the limitation of the size of the battery, besides speed, reliability, and accuracy; design of WBAN protocols should consider the energy efficiency and time delay. To solve these problems, this paper adopt the end-edge-cloud orchestrated network architecture and propose a transmission based on reinforcement algorithm. The priority of sensing data is classified according to certain application. System utility function is modeled according to the channel factors, the energy utility, and successful transmission conditions. The optimization problem is mapped to Q-learning model. Following this online power control protocol, the energy level of both the senor to coordinator, and coordinator to edge server can be modified according to the current channel condition. The network performance is evaluated by simulation. The results show that the proposed power control protocol has higher system energy efficiency, delivery ratio, and throughput.

In-process Truing of Metal-bonded Diamond Wheels for Electrolytic In-process Dressing (ELID) Grinding

  • Saleh, Tanveer;Biswas, Indraneel;Lim, Han-Seok;Rahman, Mustafizur
    • International Journal of Precision Engineering and Manufacturing
    • /
    • v.9 no.3
    • /
    • pp.3-6
    • /
    • 2008
  • Electrolytic in-process dressing (ELID) grinding is a new technique for achieving a nanoscale surface finish on hard and brittle materials such as optical glass and ceramics. This process applies an electrochemical dressing on the metal-bonded diamond wheels to ensure constant protrusion of sharp cutting grits throughout the grinding cycle. In conventional ELID grinding, a constant source of pulsed DC power is supplied to the ELID cell, but a feedback mechanism is necessary to control the dressing power and obtain better performance. In this study, we propose a new closed-loop wheel dressing technique for grinding wheel truing that addresses the efficient correction of eccentric wheel rotation and the nonuniformity in the grinding wheel profile. The technique relies on an iterative control algorithm for the ELID power supply. An inductive sensor is used to measure the wheel profile based on the gap between the sensor head and wheel edge, and this is used as the feedback signal to control the pulse width of the power supply. We discuss the detailed mathematical design of the control algorithm and provide simulation results that were confirmed experimentally.

Computational Model of a Mirror Neuron System for Intent Recognition through Imitative Learning of Objective-directed Action (목적성 행동 모방학습을 통한 의도 인식을 위한 거울뉴런 시스템 계산 모델)

  • Ko, Kwang-Eun;Sim, Kwee-Bo
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.20 no.6
    • /
    • pp.606-611
    • /
    • 2014
  • The understanding of another's behavior is a fundamental cognitive ability for primates including humans. Recent neuro-physiological studies suggested that there is a direct matching algorithm from visual observation onto an individual's own motor repertories for interpreting cognitive ability. The mirror neurons are known as core regions and are handled as a functionality of intent recognition on the basis of imitative learning of an observed action which is acquired from visual-information of a goal-directed action. In this paper, we addressed previous works used to model the function and mechanisms of mirror neurons and proposed a computational model of a mirror neuron system which can be used in human-robot interaction environments. The major focus of the computation model is the reproduction of an individual's motor repertory with different embodiments. The model's aim is the design of a continuous process which combines sensory evidence, prior task knowledge and a goal-directed matching of action observation and execution. We also propose a biologically inspired plausible equation model.

Time-varying Proportional Navigation Guidance using Deep Reinforcement Learning (심층 강화학습을 이용한 시변 비례 항법 유도 기법)

  • Chae, Hyeok-Joo;Lee, Daniel;Park, Su-Jeong;Choi, Han-Lim;Park, Han-Sol;An, Kyeong-Soo
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • v.23 no.4
    • /
    • pp.399-406
    • /
    • 2020
  • In this paper, we propose a time-varying proportional navigation guidance law that determines the proportional navigation gain in real-time according to the operating situation. When intercepting a target, an unidentified evasion strategy causes a loss of optimality. To compensate for this problem, proper proportional navigation gain is derived at every time step by solving an optimal control problem with the inferred evader's strategy. Recently, deep reinforcement learning algorithms are introduced to deal with complex optimal control problem efficiently. We adapt the actor-critic method to build a proportional navigation gain network and the network is trained by the Proximal Policy Optimization(PPO) algorithm to learn an evasion strategy of the target. Numerical experiments show the effectiveness and optimality of the proposed method.

Defect Detection of Steel Wire Rope in Coal Mine Based on Improved YOLOv5 Deep Learning

  • Xiaolei Wang;Zhe Kan
    • Journal of Information Processing Systems
    • /
    • v.19 no.6
    • /
    • pp.745-755
    • /
    • 2023
  • The wire rope is an indispensable production machinery in coal mines. It is the main force-bearing equipment of the underground traction system. Accurate detection of wire rope defects and positions exerts an exceedingly crucial role in safe production. The existing defect detection solutions exhibit some deficiencies pertaining to the flexibility, accuracy and real-time performance of wire rope defect detection. To solve the aforementioned problems, this study utilizes the camera to sample the wire rope before the well entry, and proposes an object based on YOLOv5. The surface small-defect detection model realizes the accurate detection of small defects outside the wire rope. The transfer learning method is also introduced to enhance the model accuracy of small sample training. Herein, the enhanced YOLOv5 algorithm effectively enhances the accuracy of target detection and solves the defect detection problem of wire rope utilized in mine, and somewhat avoids accidents occasioned by wire rope damage. After a large number of experiments, it is revealed that in the task of wire rope defect detection, the average correctness rate and the average accuracy rate of the model are significantly enhanced with those before the modification, and that the detection speed can be maintained at a real-time level.

Maximum Torque Control of SynRM Drive with Artificial Intelligent Controller (인공지능 제어기에 의한 SynRM 드라이브의 최대토크 제어)

  • Ko, Jae-Sub;Choi, Jung-Sik;Kim, Kil-Bong;Chung, Dong-Hwa
    • Proceedings of the KIEE Conference
    • /
    • 2006.10c
    • /
    • pp.257-259
    • /
    • 2006
  • The paper is proposed maximum torque control of SynRM drive using adaptive learning mechanism-fuzzy neural network(ALM-FNN) controller and artificial neural network(ANN). The control method is applicable over the entire speed range and considered the limits of the inverter's current and voltage rated value. For each control mode, a condition that determines the optimal d-axis current $^{i}d$ for maximum torque operation is derived. The proposed control algorithm is applied to SynRM drive system controlled ALM-FNN and ANN controller, the operating characteristics controlled by maximum torque control are examined in detail. Also, this paper is proposed the analysis results to verify the effectiveness of the ALM-FNN and ANN controller.

  • PDF

Direct Adaptive Control of Chaotic Nonlinear Systems Using a Feedforward Neural Network (신경 회로망을 이용한 혼돈 비선형 시스템의 직접 적응 제어)

  • Kim, Se-Min;Choi, Yoon-Ho;Park, Jin-Bae;Joo, Young-Hoon
    • Proceedings of the KIEE Conference
    • /
    • 1998.07b
    • /
    • pp.401-403
    • /
    • 1998
  • This paper describes the neural network control method for the identification and control of chaotic nonlinear dynamical systems effectively. In our control method, the controlled system is modeled by an unknown NARMA model, and a feedforward neural network is used for identifying the chaotic system. The control signals are directly obtained by minimizing the difference between a setpoint and the output of the neural network model. Since learning algorithm guarantees that the output of the neural network model approaches that of the actual system, it is shown that the control signals obtained can also make the real system output close to the setpoint.

  • PDF