• Title/Summary/Keyword: Incremental Algorithm

Search Result 371, Processing Time 0.025 seconds

Fault-tolerant control system for once-through steam generator based on reinforcement learning algorithm

  • Li, Cheng;Yu, Ren;Yu, Wenmin;Wang, Tianshu
    • Nuclear Engineering and Technology
    • /
    • v.54 no.9
    • /
    • pp.3283-3292
    • /
    • 2022
  • Based on the Deep Q-Network(DQN) algorithm of reinforcement learning, an active fault-tolerance method with incremental action is proposed for the control system with sensor faults of the once-through steam generator(OTSG). In this paper, we first establish the OTSG model as the interaction environment for the agent of reinforcement learning. The reinforcement learning agent chooses an action according to the system state obtained by the pressure sensor, the incremental action can gradually approach the optimal strategy for the current fault, and then the agent updates the network by different rewards obtained in the interaction process. In this way, we can transform the active fault tolerant control process of the OTSG to the reinforcement learning agent's decision-making process. The comparison experiments compared with the traditional reinforcement learning algorithm(RL) with fixed strategies show that the active fault-tolerant controller designed in this paper can accurately and rapidly control under sensor faults so that the pressure of the OTSG can be stabilized near the set-point value, and the OTSG can run normally and stably.

Accelerated Loarning of Latent Topic Models by Incremental EM Algorithm (점진적 EM 알고리즘에 의한 잠재토픽모델의 학습 속도 향상)

  • Chang, Jeong-Ho;Lee, Jong-Woo;Eom, Jae-Hong
    • Journal of KIISE:Software and Applications
    • /
    • v.34 no.12
    • /
    • pp.1045-1055
    • /
    • 2007
  • Latent topic models are statistical models which automatically captures salient patterns or correlation among features underlying a data collection in a probabilistic way. They are gaining an increased popularity as an effective tool in the application of automatic semantic feature extraction from text corpus, multimedia data analysis including image data, and bioinformatics. Among the important issues for the effectiveness in the application of latent topic models to the massive data set is the efficient learning of the model. The paper proposes an accelerated learning technique for PLSA model, one of the popular latent topic models, by an incremental EM algorithm instead of conventional EM algorithm. The incremental EM algorithm can be characterized by the employment of a series of partial E-steps that are performed on the corresponding subsets of the entire data collection, unlike in the conventional EM algorithm where one batch E-step is done for the whole data set. By the replacement of a single batch E-M step with a series of partial E-steps and M-steps, the inference result for the previous data subset can be directly reflected to the next inference process, which can enhance the learning speed for the entire data set. The algorithm is advantageous also in that it is guaranteed to converge to a local maximum solution and can be easily implemented just with slight modification of the existing algorithm based on the conventional EM. We present the basic application of the incremental EM algorithm to the learning of PLSA and empirically evaluate the acceleration performance with several possible data partitioning methods for the practical application. The experimental results on a real-world news data set show that the proposed approach can accomplish a meaningful enhancement of the convergence rate in the learning of latent topic model. Additionally, we present an interesting result which supports a possible synergistic effect of the combination of incremental EM algorithm with parallel computing.

A Hierarchical and Incremental MOS Circuit Extractor (계층 구조와 Incremental 기능을 갖는 MOS 회로 추출기)

  • 이건배;정정화
    • Journal of the Korean Institute of Telematics and Electronics
    • /
    • v.25 no.8
    • /
    • pp.1010-1018
    • /
    • 1988
  • This paper proposes a MOS circuit extractor which extracts a netlist from the hierarchical mask information, for the verification tools. To utilize the regularity and the simple representation of the hierarchical circuit, and to reduce the debug cycle of design, verification, and modification, we propose a hierarvhical and incremental circuit extraction algorithm. In flat circuit extraction stage, the multiple storage quad tree is used as an internal data structure. Incremental circuit extraction using the hierarchical structure is made possible, to reduce the re-extraction time of the modified circuit.

  • PDF

A new object recognition algorithm using generalized incremental circle transform

  • Han, Dong-Il;You, Bum-Jae;Zeungnam Bien
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1990.10b
    • /
    • pp.933-938
    • /
    • 1990
  • A method of recognizing 2-dimensional polygonal object is proposed by using a concept of generalized incremental circle transform. The generalized incremental circle transform, which maps boundaries of an object into a circular disc, represents efficiently the shape of the boundaries that are obtained from digirized binary images of the objects. It is proved that the generalized incremental circle transform of an object is invariant to object translation, rotation, and size, and can be used as feature information for recognizing two dimensional polygonal object efficiently.

  • PDF

An Online Response System for Anomaly Traffic by Incremental Mining with Genetic Optimization

  • Su, Ming-Yang;Yeh, Sheng-Cheng
    • Journal of Communications and Networks
    • /
    • v.12 no.4
    • /
    • pp.375-381
    • /
    • 2010
  • A flooding attack, such as DoS or Worm, can be easily created or even downloaded from the Internet, thus, it is one of the main threats to servers on the Internet. This paper presents an online real-time network response system, which can determine whether a LAN is suffering from a flooding attack within a very short time unit. The detection engine of the system is based on the incremental mining of fuzzy association rules from network packets, in which membership functions of fuzzy variables are optimized by a genetic algorithm. The incremental mining approach makes the system suitable for detecting, and thus, responding to an attack in real-time. This system is evaluated by 47 flooding attacks, only one of which is missed, with no false positives occurring. The proposed online system belongs to anomaly detection, not misuse detection. Moreover, a mechanism for dynamic firewall updating is embedded in the proposed system for the function of eliminating suspicious connections when necessary.

A finite element algorithm for contact problems with friction

  • Liu, C.H.;Hofstetter, G.;Mang, H.A.
    • Structural Engineering and Mechanics
    • /
    • v.3 no.3
    • /
    • pp.289-297
    • /
    • 1995
  • A finite element algorithm for consideration of contact constraints is presented. It is characterized by introducing the geometric constraints, resulting from contact conditions, directly into the algebraic system of equations for the incremental displacements of an incremental iterative solution procedure. The usefulness of the proposed algorithm for efficient solutions of contact problems involving large displacements and large strains is demonstrated in the numerical investigation.

KAIST ARM의 고속동작제어를 위한 하드웨어 좌표변환기의 개발

  • 박서욱;오준호
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 1992.04a
    • /
    • pp.127-132
    • /
    • 1992
  • To relize the future intelligent robot the development of a special-purpose processor for a coordinate transformation is evidently challenging task. In this case the complexity of a hardware architecture strongly depends on the adopted algorithm. In this paper we have used an inverse kinemetics algorithm based on incremental unit computation method. This method considers the 3-axis articulated robot as the combination of two types of a 2-axis robot: polar robot and 2-axis planar articulated one. For each robot incremental units in the joint and Cartesian spaces are defined. With this approach the calculation of the inverse Jacobian matrix can be realized through a simple combinational logic gate. Futhermore, the incremental computation of the DDA integrator can be used to solve the direct kinematics. We have also designed a hardware architecture to implement the proposed algorithm. The architecture consists of serveral simple unitsl. The operative unit comprises several basic operators and simple data path with a small bit-length. The hardware architecture is realized byusing the EPLD. For the straight-line motion of the KAIST arm we have obtained maximum end effector's speed of 12.6 m/sec by adopting system clock of 8 MHz.

On Design and Implementation of Incremental LR Parsing Algorithm Using Changed Threed Tree (변화된 스레드 트리를 이용한 점진적 LR 파싱 알고리즘 구현 및 설계)

  • Lee, Dae-Sik
    • Convergence Security Journal
    • /
    • v.5 no.4
    • /
    • pp.19-25
    • /
    • 2005
  • Threaded Tree is the data structure that can express parse stack as well as parse tree with LR parsing table. $Larchev\^{e}que$ makes Threaded Tree and Incremental Parsing with stack. This paper suggests the algorithm consisting of changed threaded tree without stack in order to reduce reparsing node and parsing speed. Also, it suggests incremental parsing algorithm to get rid of the reparsing process in node.

  • PDF

Automatic Load and Displacement Incremental Algorithm for Geometric Non-Linear Finite Element Analysis of the Structure subjected to Conservative and Non-conservative Forces (보존력(保存力) 및 비보존력(非保存力)을 받는 구조물(構造物)의 기하적(幾何的) 비선형(非線形) 유한요소해석(有限要素解析)을 위한 하중(荷重) 및 변위증분(變位增分) 알고리즘의 개발(開發))

  • Kim, Moon Young;Chang, Sung Pil
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.10 no.2
    • /
    • pp.11-22
    • /
    • 1990
  • An automatic incremental algorithm for geometric non-linear finite element analysis of the structures subjected to the conservative and non-conservative forces is presented. By making efficient combination of the load incremental method and the displacement incremental method, this scheme can trace various post-buckling equilibrium path such as snap-through and turning-back. Several numerical examples to demonstrate the feasibility of the present algorithm, over ranges of deformation that are well beyond those likely to occur in practical structures, are given and discussed.

  • PDF

A Novel Maximum Power Point Tracking Control Algorithm for Photovoltaic System (태양광 발전 시스템을 위한 새로운 최대 출력점 추종 제어 알고리즘)

  • Kim, Tae-Yeop;Lee, Yun-Gyu;An, Ho-Gyun;Park, Seung-Gyu
    • The Transactions of the Korean Institute of Electrical Engineers B
    • /
    • v.51 no.3
    • /
    • pp.133-141
    • /
    • 2002
  • Most maximum power point tracking(MPPT) control algorithm is based on Perturb and Observe(P&O) and Incremental Conductance(IncCond). In comparison with P&O and IncCond algorithm, the dynamic and tracking characteristic of IncCond algorithm is better than P&O algorithm in condition of rapidly changing solar radiation. But in the case of digital implementation, the InCond algorithm has error en decision of maximum power operation point(MPOP). To solve this problem, this paper proposes a improved IncCond algorithm, which can determine the MPOP correctly by inserting the test signal in control input. This paper proposes a novel MPPT control algorithm for the digitally implemented photovoltaic system in condition of rapidly changing solar radiation. To verify the validity of the proposed control algorithm. the computer simulation and experiment are carried out.