• Title/Summary/Keyword: Learning Control Algorithm

Search Result 948, Processing Time 0.028 seconds

Analysis and study of Deep Reinforcement Learning based Resource Allocation for Renewable Powered 5G Ultra-Dense Networks

  • Hamza Ali Alshawabkeh
    • International Journal of Computer Science & Network Security
    • /
    • v.24 no.1
    • /
    • pp.226-234
    • /
    • 2024
  • The frequent handover problem and playing ping-pong effects in 5G (5th Generation) ultra-dense networking cannot be effectively resolved by the conventional handover decision methods, which rely on the handover thresholds and measurement reports. For instance, millimetre-wave LANs, broadband remote association techniques, and 5G/6G organizations are instances of group of people yet to come frameworks that request greater security, lower idleness, and dependable principles and correspondence limit. One of the critical parts of 5G and 6G innovation is believed to be successful blockage the board. With further developed help quality, it empowers administrator to run many systems administration recreations on a solitary association. To guarantee load adjusting, forestall network cut disappointment, and give substitute cuts in case of blockage or cut frustration, a modern pursuing choices framework to deal with showing up network information is require. Our goal is to balance the strain on BSs while optimizing the value of the information that is transferred from satellites to BSs. Nevertheless, due to their irregular flight characteristic, some satellites frequently cannot establish a connection with Base Stations (BSs), which further complicates the joint satellite-BS connection and channel allocation. SF redistribution techniques based on Deep Reinforcement Learning (DRL) have been devised, taking into account the randomness of the data received by the terminal. In order to predict the best capacity improvements in the wireless instruments of 5G and 6G IoT networks, a hybrid algorithm for deep learning is being used in this study. To control the level of congestion within a 5G/6G network, the suggested approach is put into effect to a training set. With 0.933 accuracy and 0.067 miss rate, the suggested method produced encouraging results.

Development of Neuro-Fuzzy System for Cold Storage Facility (저온저장고의 뉴로-퍼지 제어시스템 개발)

  • 양길모;고학균;홍지향
    • Journal of Biosystems Engineering
    • /
    • v.28 no.2
    • /
    • pp.117-126
    • /
    • 2003
  • This study was conducted to develop precision control system fur cold storage facility that could offer safe storage environment for green grocery. For that reason of neuro-fuzzy control system with learning ability algorithm and single chip neuro-fuzzy micro controller was developed for cold storage facility. Dynamic characteristics and hunting of neuro-fuzzy control system were far superior to on-off and fuzzy control system. Dynamic characteristics of temperature were faster than on-off control system by 1,555 seconds(123% faster) and fuzzy control system by 460 seconds(36.4% faster). When system was arrived at steady state. hunting was ${\pm}$0.5$^{\circ}C$ in on-off control system, ${\pm}$0.4$^{\circ}C$ in fuzzy control system, and ${\pm}$0.3$^{\circ}C$ in neuro-fuzzy control system. Hunting of humidity and wind velocity was also controlled precisely by 70 to 72.5% and 1m/s For storage experiment with onion, characteristics of neuro-fuzzy control system were tested. Dynamic characteristics of neuro-fuzzy control system made cold storage facility conducted precooling ability and minimized hunting.

Implementation of the Adaptive-Neuro Controller of Industrial Robot Using DSP(TMS320C50) Chip (DSP(TMS320C50) 칩을 사용한 산업용 로봇의 적응-신경제어기의 실현)

  • 김용태;정동연;한성현
    • Transactions of the Korean Society of Machine Tool Engineers
    • /
    • v.10 no.2
    • /
    • pp.38-47
    • /
    • 2001
  • In this paper, a new scheme of adaptive-neuro control system is presented to implement real-time control of robot manipulator using Digital Signal Processors. Digital signal processors, DSPs, are micro-processors that are particularly developed for fast numerical computations involving sums and products of measured variables, thus it can be programmed and executed through DSPs. In addition, DSPs are as fast in computation as most 32-bit micro-processors and yet at a fraction of therir prices. These features make DSPs a viable computational tool in digital implementation of sophisticated controllers. Unlike the well-established theory for the adaptive control of linear systems, there exists relatively little general theory for the adaptive control of nonlinear systems. Adaptive control technique is essential for providing a stable and robust perfor-mance for application of robot control. The proposed neuro control algorithm is one of learning a model based error back-propagation scheme using Lyapunov stability analysis method.The proposed adaptive-neuro control scheme is illustrated to be a efficient control scheme for the implementation of real-time control of robot system by the simulation and experi-ment.

  • PDF

The Adaptive-Neuro Controller Design of Industrial Robot Using TMS320C3X Chip (TMS320C30칩을 사용한 산업용 로봇의 적응-신경제어기 설계)

  • 하석흥
    • Proceedings of the Korean Society of Machine Tool Engineers Conference
    • /
    • 1999.10a
    • /
    • pp.162-169
    • /
    • 1999
  • In this paper, it is presented a new scheme of adaptive-neuro control system to implement real-time control of robot manipulator using digital Signal Processors. Digital signal processors DSPs. are micro-processors that are particularly developed for variables. Digital version of most advanced control algorithms can be defined as sums and products of measured variables, thus it can be programmed and executed through DSPs. In addition, DSPs are as fast in computation as most 32-bit micro-processors and yet at a fraction of their prices. These features make DSPs a biable computatinal tool in digital implementation of sophisticated controllers. Unlike the well-established theory for the adaptive control of linear systems, there exists relatively little general theory for the adaptive control of nonlinear systems. Adaptive control technique is essential for providing a stable and robust performance for application of robot control. The proposed neuro control algorithm is one of learning a model based error back-propagation scheme using Lyapunov stability analysis method. The proposed adaptive-neuro control scheme is illustrated to be a efficient control scheme for implementation of real-time control of robot system by the simulation and experiment.

  • PDF

Maximum Torque Control of IPMSM Drive with LM-FNN Controller (LM-FNN 제어기에 의한 IPMSM 드라이브의 최대토크 제어)

  • Nam Su-Myung;Choi Jung-Sik;Chung Dong-Hwa
    • The Transactions of the Korean Institute of Electrical Engineers B
    • /
    • v.55 no.2
    • /
    • pp.89-97
    • /
    • 2006
  • Interior permanent magnet synchronous motor(IPMSM) has become a popular choice in electric vehicle applications, due to their excellent power to weight ratio. The paper is proposed maximum torque control of IPMSM drive using learning mechanism-fuzzy neural network(LM-FNN) controller and artificial neural network(ANN). The control method is applicable over the entire speed range and considered the limits of the inverter's current and voltage rated value. For each control mode, a condition that determines the optimal d-axis current $i_{d}$ for maximum torque operation is derived. This paper considers the design and implementation of novel technique of high performance speed control for IPMSM using LM-FNN controller and ANN controller. The hybrid combination of neural network and fuzzy control will produce a powerful representation flexibility and numerical processing capability. Also, this paper is proposed speed control of IPMSM using LM-FNN and estimation of speed using ANN controller. The back propagation neural network technique is used to provide a real time adaptive estimation of the motor speed. The proposed control algorithm is applied to IPMSM drive system controlled LM-FNN and ANN controller, the operating characteristics controlled by maximum torque control are examined in detail. Also, this paper is proposed the analysis results to verify the effectiveness of the LM-FNN and ANN controller.

Data-Based Model Approach to Predict Internal Air Temperature in a Mechanically-Ventilated Broiler House (데이터 기반 모델에 의한 강제환기식 육계사 내 기온 변화 예측)

  • Choi, Lak-yeong;Chae, Yeonghyun;Lee, Se-yeon;Park, Jinseon;Hong, Se-woon
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.64 no.5
    • /
    • pp.27-39
    • /
    • 2022
  • The smart farm is recognized as a solution for future farmers having positive effects on the sustainability of the poultry industry. Intelligent microclimate control can be a key technology for broiler production which is extremely vulnerable to abnormal indoor air temperatures. Furthermore, better control of indoor microclimate can be achieved by accurate prediction of indoor air temperature. This study developed predictive models for internal air temperature in a mechanically-ventilated broiler house based on the data measured during three rearing periods, which were different in seasonal climate and ventilation operation. Three machine learning models and a mechanistic model based on thermal energy balance were used for the prediction. The results indicated that the all models gave good predictions for 1-minute future air temperature showing the coefficient of determination greater than 0.99 and the root-mean-square-error smaller than 0.306℃. However, for 1-hour future air temperature, only the mechanistic model showed good accuracy with the coefficient of determination of 0.934 and the root-mean-square-error of 0.841℃. Since the mechanistic model was based on the mathematical descriptions of the heat transfer processes that occurred in the broiler house, it showed better prediction performances compared to the black-box machine learning models. Therefore, it was proven to be useful for intelligent microclimate control which would be developed in future studies.

Reinforcement Learning with Clustering for Function Approximation and Rule Extraction (함수근사와 규칙추출을 위한 클러스터링을 이용한 강화학습)

  • 이영아;홍석미;정태충
    • Journal of KIISE:Software and Applications
    • /
    • v.30 no.11
    • /
    • pp.1054-1061
    • /
    • 2003
  • Q-Learning, a representative algorithm of reinforcement learning, experiences repeatedly until estimation values about all state-action pairs of state space converge and achieve optimal policies. When the state space is high dimensional or continuous, complex reinforcement learning tasks involve very large state space and suffer from storing all individual state values in a single table. We introduce Q-Map that is new function approximation method to get classified policies. As an agent learns on-line, Q-Map groups states of similar situations and adapts to new experiences repeatedly. State-action pairs necessary for fine control are treated in the form of rule. As a result of experiment in maze environment and mountain car problem, we can achieve classified knowledge and extract easily rules from Q-Map

Equal Energy Consumption Routing Protocol Algorithm Based on Q-Learning for Extending the Lifespan of Ad-Hoc Sensor Network (애드혹 센서 네트워크 수명 연장을 위한 Q-러닝 기반 에너지 균등 소비 라우팅 프로토콜 기법)

  • Kim, Ki Sang;Kim, Sung Wook
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.10 no.10
    • /
    • pp.269-276
    • /
    • 2021
  • Recently, smart sensors are used in various environments, and the implementation of ad-hoc sensor networks (ASNs) is a hot research topic. Unfortunately, traditional sensor network routing algorithms focus on specific control issues, and they can't be directly applied to the ASN operation. In this paper, we propose a new routing protocol by using the Q-learning technology, Main challenge of proposed approach is to extend the life of ASNs through efficient energy allocation while obtaining the balanced system performance. The proposed method enhances the Q-learning effect by considering various environmental factors. When a transmission fails, node penalty is accumulated to increase the successful communication probability. Especially, each node stores the Q value of the adjacent node in its own Q table. Every time a data transfer is executed, the Q values are updated and accumulated to learn to select the optimal routing route. Simulation results confirm that the proposed method can choose an energy-efficient routing path, and gets an excellent network performance compared with the existing ASN routing protocols.

A Study on Motion Planning Generation of Jumping Robot Control Using Model Transformation Method (모델 변환법을 이용한 점핑 로봇 제어의 운동경로 생성에 관한 연구)

  • 서진호;산북창의;이권순
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.21 no.4
    • /
    • pp.120-131
    • /
    • 2004
  • In this paper, we propose the method of a motion planning generation in which the movement of the 3-link leg subsystem is constrained to a slider-link and a singular posture can be easily avoided. The proposed method is the jumping control moving in vertical direction which mimics a cat's behavior. That is, it is jumping toward wall and kicking it to get a higher-place. Considering the movement from the point of constraint mechanical system, the robotic system which realizes the motion changes its configuration according to the position and it has several phases such as; ⅰ) an one-leg phase, ⅱ) in an air-phase. In other words, the system is under nonholonomic constraint due to the reservation of its momentum. Especially, in an air-phase, we will use a control method using state transformation and linearization in order to control the landing posture. Also, an iterative learning control algorithm is applied in order to improve the robustness of the control. The simulation results for jumping control will illustrate the effectiveness of the proposed control method.

The Development of EMG-based Powered Wheelchair Controller for Users with High-level Spinal Cord Injury using a Proportional Control Scheme (중증 장애인을 위한 근전도 기반 비례제어 방식의 전동 휠체어 제어기 개발)

  • Song, Jae-Hoon;Han, Jeong-Su;Oh, Young-Joon;Lee, He-Young;Bien, Zeung-Nam
    • Proceedings of the KIEE Conference
    • /
    • 2004.11c
    • /
    • pp.6-8
    • /
    • 2004
  • The objective of this paper is to develop a powered wheelchair controller based on EMG for users with high-level spinal cord injury using a proportional control scheme. An advantage of EMG is relative convenience of acquisition by a surface electrode to users. Direction information can be easily extracted from two EMG channels and force information can be acquired by proportional relationship between the amplitude of EMG and user's power, respectively. Pattern classification algorithm is a threshold method with a supervised learning process. Furthermore, the emergency situation can be avoided using an interrupt function. We evaluated the performance of powered wheelchair controller by navigating a pre-defined path with three non-handicapped people. The results show the feasibility of EMG as an input interface for powered wheelchair and other devices for the seriously disabled.

  • PDF