• Title/Summary/Keyword: balancing control

Search Result 636, Processing Time 0.025 seconds

Balancing a seesaw with reinforcement learning

  • Tengis, Ts.;Uurtsaikh, L.;Batminkh, A.
    • International Journal of Advanced Culture Technology
    • /
    • v.8 no.4
    • /
    • pp.51-57
    • /
    • 2020
  • A propeller-based seesaw system is a system that can represent one of axis of four propeller drones and its stabilization has been replaced by intelligent control system instead of often used control methods such as PID and state space. Today, robots are increasingly use machine learning methods to adapt to their environment and learn to perform the right actions. In this article, we propose a Q-learning-based approach to control the stability of a seesaw system with a propeller. From the experimental results that it is possible to fully learn the balance control of a seesaw system by correctly defining the state of the system, the actions to be performed, and the reward functions. Our proposed method solves the seesaw stabilization.

A Fast Sorting Strategy Based on a Two-way Merge Sort for Balancing the Capacitor Voltages in Modular Multilevel Converters

  • Zhao, Fangzhou;Xiao, Guochun;Liu, Min;Yang, Daoshu
    • Journal of Power Electronics
    • /
    • v.17 no.2
    • /
    • pp.346-357
    • /
    • 2017
  • The Modular Multilevel Converter (MMC) is particularly attractive for medium and high power applications such as High-Voltage Direct Current (HVDC) systems. In order to reach a high voltage, the number of cascaded submodules (SMs) is generally very large. Thus, in the applications with hundreds or even thousands of SMs such as MMC-HVDCs, the sorting algorithm of the conventional voltage balancing strategy is extremely slow. This complicates the controller design and increases the hardware cost tremendously. This paper presents a Two-Way Merge Sort (TWMS) strategy based on the prediction of the capacitor voltages under ideal conditions. It also proposes an innovative Insertion Sort Correction for the TWMS (ISC-TWMS) to solve issues in practical engineering under non-ideal conditions. The proposed sorting methods are combined with the features of the MMC-HVDC control strategy, which significantly accelerates the sorting process and reduces the implementation efforts. In comparison with the commonly used quicksort algorithm, it saves at least two-thirds of the sorting execution time in one arm with 100 SMs, and saves more with a higher number of SMs. A 501-level MMC-HVDC simulation model in PSCAD/EMTDC has been built to verify the validity of the proposed strategies. The fast speed and high efficiency of the algorithms are demonstrated by experiments with a DSP controller (TMS320F28335).

The Influences of the Intensive Ankle Joint Strategy Training on the Muscular Strength and Balancing Ability in the Elderly Women (발목관절 전략 집중 훈련이 노인여성의 근력과 균형능력에 미치는 영향)

  • Cho, Sung-Hyoun;Kim, Cheol-Yong
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.13 no.12
    • /
    • pp.5909-5919
    • /
    • 2012
  • The purpose of this study was to compare the effects of the intensive ankle joint strategy training on the muscular strength and balancing ability in the elderly women. The subject of this study were 30 elderly women aged from 65 to 80 and randomly assigned to three groups. For 6 weeks, two experimental groups took the training an hour every 3 days of a week. The results that measured the dynamometer, FRT, and SEBT after implementing general lower limbs exercise and the intensive ankle joint strategy training for 6 weeks showed that the changes in the control and experimental group I were not statistically significant while the changes in the experimental group II were statistically significant (p<.05). For the prevention of the elderlies from fall and the treatment approaches, it is deemed to be necessary additional studies on the diverse variables through the intensive training of the ankle strategy.

User Association and Base Station Sleep Management in Dense Heterogeneous Cellular Networks

  • Su, Gongchao;Chen, Bin;Lin, Xiaohui;Wang, Hui;Li, Lemin
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.11 no.4
    • /
    • pp.2058-2074
    • /
    • 2017
  • Dense Heterogeneous Cellular Networks(HCNs) offer a promising approach to meet the target of 1000x increase in aggregate data rates in 5G wireless communication systems. However how to best utilize the available radio resources at densely deployed small cells remains an open problem as those small cells are typically unplanned. In this paper we focus on balancing loads across macro cells and small cells by offloading users to small cells, as well as dynamically switching off underutilized small cells. We propose a joint user association and base station(BS) sleep mangement(UA-BSM) scheme that proactively offloads users to a fraction of the densely deployed small cells. We propose a heuristic algorithm that iteratively solves the user association problem and puts BSs with low loads into sleep. An interference relation matrix(IRM) is constructed to help us identify the candidate BSs that can be put into sleep. User associations are then aggregated to selected small cells that remain active. Simulation results show that our proposed approach achieves load balancing across macro and small cells and reduces the number of active BSs. Numerical results show user signal to interference ratio(SINR) can be improved by small cell sleep control.

A Research on the Balancing among the Users of MMORPG through Analyzing the Preferences of Playing Game for the Types of Individual Characteristics (개인의 성격유형별 게임플레이의 선호도 분석을 통한 MMORPG의 유저 간 밸런싱 연구)

  • Kim, Jung-Hyun;Kim, Kyung-Sik
    • Journal of Korea Game Society
    • /
    • v.9 no.6
    • /
    • pp.3-10
    • /
    • 2009
  • what is the elements letting users play games consistently other than the growth of the computer technology? What sort of elements can games give to control the balances in the various features of users? The subject of this study was set up for these questions. Examining the result of this study, the analysis of the types of individual characteristics as well as their preferences of playing games in the level of game design in the process of game development can be utilized as a fundamental data for the design of game contents based on user's propensity. Also it can provide the most effective method for controlling the balance of the game world. Moreover, it can be utilized to set up directions for updating the games based on user's propensity. If it can be counted for the potential users' preferences, the result of analysis of individual characteristic would act as good basic data for the balancing of game among various types of users.

  • PDF

A Scheduling Algorithm for Performance Enhancement of Science Data Center Network based on OpenFlow (오픈플로우 기반의 과학실험데이터센터 네트워크의 성능 향상을 위한 스케줄링 알고리즘)

  • Kong, Jong Uk;Min, Seok Hong;Lee, Jae Yong;Kim, Byung Chul
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.21 no.9
    • /
    • pp.1655-1665
    • /
    • 2017
  • Recently data centers are being constructed actively by many cloud service providers, enterprises, research institutes, etc. Generally, they are built on tree topology using ECMP data forwarding scheme for load balancing. In this paper, we examine data center network topologies like tree topology and fat-tree topology, and load balancing technologies like MLAG and ECMP. Then, we propose a scheduling algorithm to efficiently transmit particular files stored on the hosts in the data center to the destination node outside the data center, where fat-tree topology and OpenFlow protocol between infrastructure layer and control layer are used. We run performance analysis by numerical method, and compare the analysis results with those of ECMP. Through the performance comparison, we show the outperformance of the proposed algorithm in terms of throughput and file transfer completion time.

Power Loss Modeling of Individual IGBT and Advanced Voltage Balancing Scheme for MMC in VSC-HVDC System

  • Son, Gum Tae;Lee, Soo Hyoung;Park, Jung-Wook
    • Journal of Electrical Engineering and Technology
    • /
    • v.9 no.5
    • /
    • pp.1471-1481
    • /
    • 2014
  • This paper presents the new power dissipation model of individual switching device in a high-level modular multilevel converter (MMC), which can be mostly used in voltage sourced converter (VSC) based high-voltage direct current (HVDC) system and flexible AC transmission system (FACTS). Also, the voltage balancing method based on sorting algorithm is newly proposed to advance the MMC functionalities by effectively adjusting switching variations of the sub-module (SM). The proposed power dissipation model does not fully calculate the average power dissipation for numerous switching devices in an arm module. Instead, it estimates the power dissipation of every switching element based on the inherent operational principle of SM in MMC. In other words, the power dissipation is computed in every single switching event by using the polynomial curve fitting model with minimum computational efforts and high accuracy, which are required to manage the large number of SMs. After estimating the value of power dissipation, the thermal condition of every switching element is considered in the case of external disturbance. Then, the arm modeling for high-level MMC and its control scheme is implemented with the electromagnetic transient simulation program. Finally, the case study for applying to the MMC based HVDC system is carried out to select the appropriate insulated-gate bipolar transistor (IGBT) module in a steady-state, as well as to estimate the proper thermal condition of every switching element in a transient state.

Deposition Process Load Balancing Analysis through Improved Sequence Control using the Internet of Things (사물인터넷을 이용한 증착 공정의 개선된 순서제어의 부하 균등의 해석)

  • Jo, Sung-Euy;Kim, Jeong-Ho;Yang, Jung-Mo
    • Journal of Digital Convergence
    • /
    • v.15 no.12
    • /
    • pp.323-331
    • /
    • 2017
  • In this paper, four types of deposition control processes such as temperature, pressure, input/output(I/O), and gas were replaced by the Internet of Things(IoT) to analyze the data load and sequence procedure before and after the application of it. Through this analysis, we designed the load balancing in the sensing area of the deposition process by creating the sequence diagram of the deposition process. In order to do this, we were modeling of the sensor I/O according to the arrival process and derived the result of measuring the load of CPU and memory. As a result, it was confirmed that the reliability on the deposition processes were improved through performing some functions of the equipment controllers by the IoT. As confirmed through this paper, by applying the IoT to the deposition process, it is expected that the stability of the equipment will be improved by minimizing the load on the equipment controller even when the equipment is expanded.

A study on improving fairness and congestion control of DQDB using buffer threshold value (버퍼의 문턱치값을 이용한 DQDB망의 공평성 개선 및 혼잡 제어에 관한 연구)

  • 고성현;조진교
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.22 no.4
    • /
    • pp.618-636
    • /
    • 1997
  • DQDB(Distributed Queue Dual Bus) protocol, the IEEE 802.6 standard protocol for metropolitan area networks, does not fully take advantage of the capabilities of dual bus architecture. Although fairness in bandwidth distribution among nodes is improved when using so called the bandwidth balancing mechanism, the protocol requires a considerable amount of time to adjust to changes in the network load. Additionally, the bandwidth balancing mechanism leaves a portion of the available bandwidth unused. In a high-speed backbone network, each node may act as a bridge/ router which connects several LANs as well as hosts. However, Because the existence of high speed LANs becomes commonplace, the congestionmay occur on a node because of the limitation on access rate to the backbone network and on available buffer spaces. to release the congestion, it is desirable to install some congestion control algorithm in the node. In this paper, we propose an efficient congestion control mechanism and fair and waster-free MAC protocol for dual bus network. In this protocol, all the buffers in the network can be shared in such a way that the transmission rate of each node can be set proportional to its load. In other words, a heavily loaded node obtains a larger bandwidth to send the sements so tht the congestion can be avoided while the uncongested nodes slow down their transmission rate and store the incoming segments into thier buffers. this implies that the buffers on the network can be shared dynamically. Simulation results show that the proposed probotol significantly reduces the segment queueing delay of a heavily loaded node and segment loss rate when compared with original DQDB. And it enables an attractive high throughput in the backbone network. Because in the proposed protocol, each node does not send a requet by the segment but send a request one time in the meaning of having segments, the frequency of sending requests is very low in the proposed protocol. so the proposed protocol signigificantly reduces the segment queuing dely. and In the proposed protocol, each node uses bandwidth in proportion to its load. so In case of limitation of available buffer spaces, the proposed protocol reduces segment loss rate of a heavily loaded node. Bandwidth balancing DQDB requires the wastage of bandwidth to be fair bandwidth allocation. But the proposed DQDB MAC protocol enables fair bandwidth without wasting bandwidth by using bandwidth one after another among active nodes.

  • PDF

A Flow Quantity Distribution Characteristics of the Hot Water Header for Individual Room Control System (실별제어 온수분배기의 유량분배 특성)

  • Sung, Sun-Kyung
    • Korean Journal of Air-Conditioning and Refrigeration Engineering
    • /
    • v.20 no.3
    • /
    • pp.175-180
    • /
    • 2008
  • Flow quantity to supply to a coil in floor heating system is important to achieve comfortable indoor air condition in the winter season. The hot water header is used to distribute the water into the coil. Experimental study has been performed using the water header that have 5 branches consisted of flow control valves and automatic shut-off valves. Each branch line connected it with X-L pipe. Experimental tests accomplished it to investigate the flow distribution characteristics of the hot water header. Experimental results show that the selection of the pump head and differential pressure are very important to save running energy of the system, and high differential pressure needs more friction loss in the case of suitable differential pressure for balancing of the header.