• Title/Summary/Keyword: Learning Control Algorithm

Search Result 949, Processing Time 0.031 seconds

Stochastic MAC-layer Interference Model for Opportunistic Spectrum Access: A Weighted Graphical Game Approach

  • Zhao, Qian;Shen, Liang;Ding, Cheng
    • Journal of Communications and Networks
    • /
    • v.18 no.3
    • /
    • pp.411-419
    • /
    • 2016
  • This article investigates the problem of distributed channel selection in opportunistic spectrum access networks from a perspective of interference minimization. The traditional physical (PHY)-layer interference model is for information theoretic analysis. When practical multiple access mechanisms are considered, the recently developed binary medium access control (MAC)-layer interference model in the previous work is more useful, in which the experienced interference of a user is defined as the number of competing users. However, the binary model is not accurate in mathematics analysis with poor achievable performance. Therefore, we propose a real-valued one called stochastic MAC-layer interference model, where the utility of a player is defined as a function of the aggregate weight of the stochastic interference of competing neighbors. Then, the distributed channel selection problem in the stochastic MAC-layer interference model is formulated as a weighted stochastic MAC-layer interference minimization game and we proved that the game is an exact potential game which exists one pure strategy Nash equilibrium point at least. By using the proposed stochastic learning-automata based uncoupled algorithm with heterogeneous learning parameter (SLA-H), we can achieve suboptimal convergence averagely and this result can be verified in the simulation. Moreover, the simulated results also prove that the proposed stochastic model can achieve higher throughput performance and faster convergence behavior than the binary one.

Extraction of Motor Modules by Autoencoder to Identify Trained Motor Control Ability

  • LEE, Jae-Hyuk
    • Journal of Wellbeing Management and Applied Psychology
    • /
    • v.5 no.2
    • /
    • pp.15-19
    • /
    • 2022
  • Purpose: This pilot study aimed to clarify features of motor module during walking in exercise experts who experienced lately repeated training for sports skill. To identify motor modules, autoencoder machine learning algorithm was used, and modules were extracted from muscle activities of lower extremities. Research design, data and methodology: A total of 10 university students were participated. 5 students did not experience any sports training before, and 5 students did experience sports training more than 5 years. Eight muscle activities of dominant lower extremity were measured. After modules were extracted by autoencoder, the numbers of modules and spatial muscle weight values were compared between two groups. Results: There was no significant difference in the minimal number of motor modules that explain more than 90% of original data between groups. However, in similarity analysis, three motor modules were shown high similarity (r>0.8) while one module was shown low similarity (r<0.5). Conclusions: This study found not only common motor modules between exercise novice and expert during walking, but also found that a specific motor module, which would be associated with high motor control ability to distinguish the level of motor performance in the field of sports.

Reinforcement Learning-Based Illuminance Control Method for Building Lighting System (강화학습 기반 빌딩의 방별 조명 시스템 조도값 설정 기법)

  • Kim, Jongmin;Kim, Sunyong
    • Journal of IKEEE
    • /
    • v.26 no.1
    • /
    • pp.56-61
    • /
    • 2022
  • Various efforts have been made worldwide to respond to environmental problems such as climate change. Research on artificial intelligence (AI)-based energy management has been widely conducted as the most effective way to alleviate the climate change problem. In particular, buildings that account for more than 20% of the total energy delivered worldwide have been focused as a target for energy management using the building energy management system (BEMS). In this paper, we propose a multi-armed bandit (MAB)-based energy management algorithm that can efficiently decide the energy consumption level of the lighting system in each room of the building, while minimizing the discomfort levels of occupants of each room.

Detection Ability of Occlusion Object in Deep Learning Algorithm depending on Image Qualities (영상품질별 학습기반 알고리즘 폐색영역 객체 검출 능력 분석)

  • LEE, Jeong-Min;HAM, Geon-Woo;BAE, Kyoung-Ho;PARK, Hong-Ki
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.22 no.3
    • /
    • pp.82-98
    • /
    • 2019
  • The importance of spatial information is rapidly rising. In particular, 3D spatial information construction and modeling for Real World Objects, such as smart cities and digital twins, has become an important core technology. The constructed 3D spatial information is used in various fields such as land management, landscape analysis, environment and welfare service. Three-dimensional modeling with image has the hig visibility and reality of objects by generating texturing. However, some texturing might have occlusion area inevitably generated due to physical deposits such as roadside trees, adjacent objects, vehicles, banners, etc. at the time of acquiring image Such occlusion area is a major cause of the deterioration of reality and accuracy of the constructed 3D modeling. Various studies have been conducted to solve the occlusion area. Recently the researches of deep learning algorithm have been conducted for detecting and resolving the occlusion area. For deep learning algorithm, sufficient training data is required, and the collected training data quality directly affects the performance and the result of the deep learning. Therefore, this study analyzed the ability of detecting the occlusion area of the image using various image quality to verify the performance and the result of deep learning according to the quality of the learning data. An image containing an object that causes occlusion is generated for each artificial and quantified image quality and applied to the implemented deep learning algorithm. The study found that the image quality for adjusting brightness was lower at 0.56 detection ratio for brighter images and that the image quality for pixel size and artificial noise control decreased rapidly from images adjusted from the main image to the middle level. In the F-measure performance evaluation method, the change in noise-controlled image resolution was the highest at 0.53 points. The ability to detect occlusion zones by image quality will be used as a valuable criterion for actual application of deep learning in the future. In the acquiring image, it is expected to contribute a lot to the practical application of deep learning by providing a certain level of image acquisition.

The Speed Control of an Induction Motor Based on Neural Networks (뉴럴 네트워크를 이용한 유도 전동기의 속도 제어)

  • Lee, Dong-Bin;Ryu, Chang-Wan;Hong, Dae-Seung;Ko, Jae-Ho;Yim, Wha-Yeong
    • Proceedings of the KIEE Conference
    • /
    • 1999.07b
    • /
    • pp.516-518
    • /
    • 1999
  • This paper presents an feed-forward neural network design instead PI controller for the speed control of an Induction Motor. The design employs the training strategy with Neural Network Controller(NNC) and Neural Network Emulator(NNE). Emulator identifies the motor by simulating the input and output map. In order to update the weights of the Controller. Emulator supplies the error path to the output stage of the controller using backpropagation algorithm. and then Controller produces an adequate output to the system due to neural networks learning capability. Therefore it becomes adjustable to the system with changing characteristics caused by a load. The speed control based on neural networks for induction motor is implemented by a vector controlled induction motor. The simulation results demonstrate that actual motor speed with neural network system well follows the reference speed minimizing the error and is available to implement on the vector control theory.

  • PDF

Maximum Torque Control of IPMSM Drive with LM-FNN Controller (LM-FNN 제어기에 의한 IPMSM 드라이브의 최대토크 제어)

  • Nam, Su-Myeong;Ko, Jae-Sub;Choi, Jung-Sik;Chung, Dong-Hwa
    • Proceedings of the KIEE Conference
    • /
    • 2005.10b
    • /
    • pp.566-569
    • /
    • 2005
  • Interior permanent magnet synchronous motor(IPMSM) has become a popular choice in electric vehicle applications, due to their excellent power to weight ratio. The paper is proposed maximum torque control of IPMSM drive using artificial intelligent(AI) controller. The control method is applicable over the entire speed range and considered the limits of the inverter's current and voltage rated value. For each control mode, a condition that determines the optimal d-axis current $i_d$ for maximum torque operation is derived. This paper considers the design and implementation of novel technique of high performance speed control for IPMSM using AI controller. This paper is proposed speed control of IPMSM using learning mechanism fuzzy neural network(LM-FNN) and estimation of speed using artificial neural network(ANN) controller. The back propagation neural network technique is used to provide a real time adaptive estimation of the motor speed. The proposed control algorithm is applied to IPMSM drive system controlled LM-FNN and ANN controller, the operating characteristics controlled by maximum torque control are examined in detail. Also. this paper is proposed the experimental results to verify the effectiveness of AI controller.

  • PDF

Preliminary Test of Adaptive Neuro-Fuzzy Inference System Controller for Spacecraft Attitude Control

  • Kim, Sung-Woo;Park, Sang-Young;Park, Chan-Deok
    • Journal of Astronomy and Space Sciences
    • /
    • v.29 no.4
    • /
    • pp.389-395
    • /
    • 2012
  • The problem of spacecraft attitude control is solved using an adaptive neuro-fuzzy inference system (ANFIS). An ANFIS produces a control signal for one of the three axes of a spacecraft's body frame, so in total three ANFISs are constructed for 3-axis attitude control. The fuzzy inference system of the ANFIS is initialized using a subtractive clustering method. The ANFIS is trained by a hybrid learning algorithm using the data obtained from attitude control simulations using state-dependent Riccati equation controller. The training data set for each axis is composed of state errors for 3 axes (roll, pitch, and yaw) and a control signal for one of the 3 axes. The stability region of the ANFIS controller is estimated numerically based on Lyapunov stability theory using a numerical method to calculate Jacobian matrix. To measure the performance of the ANFIS controller, root mean square error and correlation factor are used as performance indicators. The performance is tested on two ANFIS controllers trained in different conditions. The test results show that the performance indicators are proper in the sense that the ANFIS controller with the larger stability region provides better performance according to the performance indicators.

Maximum Torque Control of IPMSM Drive with ALM-FNN Controller (ALM-FNN 제어기에 의한 IPMSM 드라이브의 최대토크 제어)

  • Chung, Dong-Hwa
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.55 no.3
    • /
    • pp.110-114
    • /
    • 2006
  • Interior permanent magnet synchronous motor(IPMSM) has become a popular choice in electric vehicle applications, due to their excellent power to weight ratio. In this paper maximum torque control of IPMSM drive using artificial intelligent(AI) controller is proposed. The control method is applicable over the entire speed range and considered the limits of the inverter's current and voltage rated value. For each control mode, a condition that determines the optimal d-axis current $i_d$ for maximum torque operation is derived. This paper considers the design and implementation of novel technique of high performance speed control for IPMSM using AI controller. This paper is proposed speed control of IPMSM using adaptive learning mechanism fuzzy neural network(ALM-FNN) and estimation of speed using artificial neural network(ANN) controller. The back propagation neural network technique is used to provide a real time adaptive estimation of the motor speed. The proposed control algorithm is applied to IPMSM drive system controlled ALM-FNN and ANN controller, the operating characteristics controlled by maximum torque control are examined in detail. Also, this paper is proposed the experimental results to verify the effectiveness of AI controller.

SynRM Driving CVT System Using an ARGOPNN with MPSO Control System

  • Lin, Chih-Hong;Chang, Kuo-Tsai
    • Journal of Power Electronics
    • /
    • v.19 no.3
    • /
    • pp.771-783
    • /
    • 2019
  • Due to nonlinear-synthetic uncertainty including the total unknown nonlinear load torque, the total parameter variation and the fixed load torque, a synchronous reluctance motor (SynRM) driving a continuously variable transmission (CVT) system causes a lot of nonlinear effects. Linear control methods make it hard to achieve good control performance. To increase the control performance and reduce the influence of nonlinear time-synthetic uncertainty, an admixed recurrent Gegenbauer orthogonal polynomials neural network (ARGOPNN) with a modified particle swarm optimization (MPSO) control system is proposed to achieve better control performance. The ARGOPNN with a MPSO control system is composed of an observer controller, a recurrent Gegenbauer orthogonal polynomial neural network (RGOPNN) controller and a remunerated controller. To insure the stability of the control system, the RGOPNN controller with an adaptive law and the remunerated controller with a reckoned law are derived according to the Lyapunov stability theorem. In addition, the two learning rates of the weights in the RGOPNN are regulating by using the MPSO algorithm to enhance convergence. Finally, three types of experimental results with comparative studies are presented to confirm the usefulness of the proposed ARGOPNN with a MPSO control system.

An Auto-Tunning Fuzzy Rule-Based Visual Servoing Algorithm for a Alave Arm (자동조정 퍼지룰을 이용한 슬레이브 암의 시각서보)

  • Kim, Ju-Gon;Cha, Dong-Hyeok;Kim, Seung-Ho
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.20 no.10
    • /
    • pp.3038-3047
    • /
    • 1996
  • In telerobot systems, visual servoing of a task object for a slave arm with an eye-in-hand has drawn an interesting attention. As such a task ingenerally conducted in an unstructured environment, it is very difficult to define the inverse feature Jacobian matrix. To overcome this difficulty, this paper proposes an auto-tuning fuzzy rule-based visual servo algorithm. In this algorithm, a visual servo controller composed of fuzzy rules, receives feature errors as inputs and generates the change of have position as outputs. The fuzzy rules are tuned by using steepest gradient method of the cost function, which is defined as a quadratic function of feature errors. Since the fuzzy rules are tuned automatically, this method can be applied to the visual servoing of a slave arm in real time. The effctiveness of the proposed algorithm is verified through a series of simulations and experiments. The results show that through the learning procedure, the slave arm and track object in real time with reasonable accuracy.