• Title/Summary/Keyword: Continuous function

Search Result 1,808, Processing Time 0.027 seconds

Function Approximation for Reinforcement Learning using Fuzzy Clustering (퍼지 클러스터링을 이용한 강화학습의 함수근사)

  • Lee, Young-Ah;Jung, Kyoung-Sook;Chung, Tae-Choong
    • The KIPS Transactions:PartB
    • /
    • v.10B no.6
    • /
    • pp.587-592
    • /
    • 2003
  • Many real world control problems have continuous states and actions. When the state space is continuous, the reinforcement learning problems involve very large state space and suffer from memory and time for learning all individual state-action values. These problems need function approximators that reason action about new state from previously experienced states. We introduce Fuzzy Q-Map that is a function approximators for 1 - step Q-learning and is based on fuzzy clustering. Fuzzy Q-Map groups similar states and chooses an action and refers Q value according to membership degree. The centroid and Q value of winner cluster is updated using membership degree and TD(Temporal Difference) error. We applied Fuzzy Q-Map to the mountain car problem and acquired accelerated learning speed.

Improvement of Analytical Probabilistic Model for Urban Storm Water Simulation using 3-parameter Mixed Exponential Probability Density Function (3변수 혼합 지수 확률밀도함수를 이용한 도시지역 강우유출수의 해석적 확률모형 개선)

  • Choi, Daegyu;Jo, Deok Jun;Han, Suhee;Kim, Sangdan
    • Journal of Korean Society on Water Environment
    • /
    • v.24 no.3
    • /
    • pp.345-353
    • /
    • 2008
  • In order to design storage-based non-point source management facilities, the aspect of statistical features of the entire precipitation time series should be considered since non-point source pollutions are delivered by continuous rainfall runoffs. The 3-parameter mixed exponential probability density function instead of traditional single-parameter exponential probability density function is applied to represent the probabilistic features of long-term precipitation time series and model urban stormwater runoff. Finally, probability density functions of water quality control basin overflow are derived under two extreme intial conditions. The 31-year continuous precipitation time series recorded in Busan are analyzed to show that the 3-parameter mixed exponential probability density function gives better resolution.

ON TOPOLOGICAL ENTROPY AND TOPOLOGICAL PRESSURE OF NON-AUTONOMOUS ITERATED FUNCTION SYSTEMS

  • Ghane, Fatemeh H.;Sarkooh, Javad Nazarian
    • Journal of the Korean Mathematical Society
    • /
    • v.56 no.6
    • /
    • pp.1561-1597
    • /
    • 2019
  • In this paper we introduce the notions of topological entropy and topological pressure for non-autonomous iterated function systems (or NAIFSs for short) on countably infinite alphabets. NAIFSs differ from the usual (autonomous) iterated function systems, they are given [32] by a sequence of collections of continuous maps on a compact topological space, where maps are allowed to vary between iterations. Several basic properties of topological pressure and topological entropy of NAIFSs are provided. Especially, we generalize the classical Bowen's result to NAIFSs ensures that the topological entropy is concentrated on the set of nonwandering points. Then, we define the notion of specification property, under which, the NAIFSs have positive topological entropy and all points are entropy points. In particular, each NAIFS with the specification property is topologically chaotic. Additionally, the ${\ast}$-expansive property for NAIFSs is introduced. We will prove that the topological pressure of any continuous potential can be computed as a limit at a definite size scale whenever the NAIFS satisfies the ${\ast}$-expansive property. Finally, we study the NAIFSs induced by expanding maps. We prove that these NAIFSs having the specification and ${\ast}$-expansive properties.

A novel method for solving structural problems: Elastoplastic analysis of a pressurized thick heterogeneous sphere

  • Abbas Heydari
    • Advances in Computational Design
    • /
    • v.9 no.1
    • /
    • pp.39-52
    • /
    • 2024
  • If the governing differential equation arising from engineering problems is treated as an analytic, continuous and derivable function, it can be expanded by one point as a series of finite numbers. For the function to be zero for each value of its domain, the coefficients of each term of the same power must be zero. This results in a recursive relationship which, after applying the natural conditions or the boundary conditions, makes it possible to obtain the values of the derivatives of the function with acceptable accuracy. The elastoplastic analysis of an inhomogeneous thick sphere of metallic materials with linear variation of the modulus of elasticity, yield stress and Poisson's ratio as a function of radius subjected to internal pressure is presented. The Beltrami-Michell equation is established by combining equilibrium, compatibility and constitutive equations. Assuming axisymmetric conditions, the spherical coordinate parameters can be used as principal stress axes. Since there is no analytical solution, the natural boundary conditions are applied and the governing equations are solved using a proposed new method. The maximum effective stress of the von Mises yield criterion occurs at the inner surface; therefore, the negative sign of the linear yield stress gradation parameter should be considered to calculate the optimal yield pressure. The numerical examples are performed and the plots of the numerical results are presented. The validation of the numerical results is observed by modeling the elastoplastic heterogeneous thick sphere as a pressurized multilayer composite reservoir in Abaqus software. The subroutine USDFLD was additionally written to model the continuous gradation of the material.

Design of a CDBC Using Multirate Sampling (Multirate 샘플링을 이용한 CDBC의 설계)

  • 김진용;김성열;이금원
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.4 no.4
    • /
    • pp.47-51
    • /
    • 2003
  • Due to the asymptotic property, deadbeat control which is well used in digital control system can not be applied to the continuous time system. But recently by use of the finite Laplace Transform to transfer function and establishment of some settling conditions, CDBC(Continuous time Deadbeat Control) is studied. For CDBC design, transfer function is constituted with delay elements and then order and interpolation conditions are derived. In other way, digital deadbeat controller is implemented and it's output is changed to continuous type by smoothing elements. In this paper multirate sampling is used and so inner controller is sampled faster than output feedback loop. And End order smoothing elements is placed to the output of digital deadbeat controller. By the multirate sampling overall output response is improved. The controller is impleneted as a serial integral compensator in the forward path and a local feedback compensator introduced into the outpute feedback loop. Matlab Simulink is used for simulation.

  • PDF

Dynamic Optimal Design of Continuous Beams (연속보의 동적 최적설계에 관한 연구)

  • 이병구;오상진;모정만
    • Computational Structural Engineering
    • /
    • v.10 no.2
    • /
    • pp.233-242
    • /
    • 1997
  • The main purpose of this paper is to investigate the dynamic optimal design of continuous beams. The computer-aided optimization technique is used to obtain the near-optimal parameters of continuous beam. The computer program is developed to obtain the natural frequency parameters and the forced vibration responses to a transit point load for the continuous beam with variable support spacing, mass and stiffness. The model test data is in good agreement with the computer calculation, which serves to validate the mathematical analysis. The optimization function to describe the design efficiency is defined as a linear combination of four dimensionless span characteristics; the maximum dynamic stress; the stress difference between span segments; the rms deflection under the transit point load; and the total span mass. Studies of three span beams show that the beam with near-optimal parameters can improve design efficiency when compared to a uniform beam with even spacing of the same total span length.

  • PDF

CFD Analysis on the Continuous and Variable Damping Characteristics of a Semi-Active Shock Absorber (반능동형 충격흡수기의 연속가변 감쇠특성에 대한 CFD 해석)

  • 윤준원
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.12 no.2
    • /
    • pp.101-108
    • /
    • 2004
  • Recently, a semi-active shock absorber has been taking interest because of its low cost and simple structure than the active one. CFD analysis has been conducted to investigate the continuous and variable damping characteristics of the semi-active shock absorber. Also, the flow resistance characteristics of a spool valve has been examined to identify individual parameters(namely, exponent and discharge coefficient) of pressure-flow rate relation needed for the accurate valve modeling. The flow field in the damping valve was simulated using the commercial code, CFX-5.3. The numerical results showed reasonable agreement with the experimental outputs. The pressure distribution with the variation of spool opening length and volume flow rate were discussed in detail. And the continuous and variable damping performance was found clearly. The individual parameters of spool valve were obtained as a function of orifice area. The exponent and discharge coefficient were fitted in with the first and the third polynomial respectively.