• 제목/요약/키워드: Initial Value

검색결과 3,458건 처리시간 0.032초

Q-value Initialization을 이용한 Reinforcement Learning Speedup Method (Reinforcement learning Speedup method using Q-value Initialization)

  • 최정환
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2001년도 하계종합학술대회 논문집(3)
    • /
    • pp.13-16
    • /
    • 2001
  • In reinforcement teaming, Q-learning converges quite slowly to a good policy. Its because searching for the goal state takes very long time in a large stochastic domain. So I propose the speedup method using the Q-value initialization for model-free reinforcement learning. In the speedup method, it learns a naive model of a domain and makes boundaries around the goal state. By using these boundaries, it assigns the initial Q-values to the state-action pairs and does Q-learning with the initial Q-values. The initial Q-values guide the agent to the goal state in the early states of learning, so that Q-teaming updates Q-values efficiently. Therefore it saves exploration time to search for the goal state and has better performance than Q-learning. 1 present Speedup Q-learning algorithm to implement the speedup method. This algorithm is evaluated. in a grid-world domain and compared to Q-teaming.

  • PDF

인도 소프트웨어 산업의 혁신클러스터 형성 과정: 개발인가, 진화인가? (Innovation Cluster of Indian Software Industry: Is It Evolved or Developed\ulcorner)

  • 임덕순
    • 기술혁신학회지
    • /
    • 제5권2호
    • /
    • pp.167-188
    • /
    • 2002
  • Summary: This paper analyzes Indian software industry in the perspective of innovation cluster. The research shows that the software industry has been following an upstream clustering process, where the major value activity is expanding from low value product/services to high value product/services. The growth of software industry could be successful because there was appropriate initial condition of Bangalore, such as the availability of high qualified human resources, excellent research institutes, small high-tech companies. The role of government was helpful for the late growth of software industry but not a critical factor for the initial development of the S/W cluster. It is suggested that government should consider the initial condition of a concerned location critically to implement a cluster-type innovation policy.

  • PDF

AN INITIAL VALUE METHOD FOR SINGULARLY PERTURBED SYSTEM OF REACTION-DIFFUSION TYPE DELAY DIFFERENTIAL EQUATIONS

  • Subburayan, V.;Ramanujam, N.
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • 제17권4호
    • /
    • pp.221-237
    • /
    • 2013
  • In this paper an asymptotic numerical method named as Initial Value Method (IVM) is suggested to solve the singularly perturbed weakly coupled system of reaction-diffusion type second order ordinary differential equations with negative shift (delay) terms. In this method, the original problem of solving the second order system of equations is reduced to solving eight first order singularly perturbed differential equations without delay and one system of difference equations. These singularly perturbed problems are solved by the second order hybrid finite difference scheme. An error estimate for this method is derived by using supremum norm and it is of almost second order. Numerical results are provided to illustrate the theoretical results.

Exponentially Fitted Error Correction Methods for Solving Initial Value Problems

  • Kim, Sang-Dong;Kim, Phil-Su
    • Kyungpook Mathematical Journal
    • /
    • 제52권2호
    • /
    • pp.167-177
    • /
    • 2012
  • In this article, we propose exponentially fitted error correction methods(EECM) which originate from the error correction methods recently developed by the authors (see [10, 11] for examples) for solving nonlinear stiff initial value problems. We reduce the computational cost of the error correction method by making a local approximation of exponential type. This exponential local approximation yields an EECM that is exponentially fitted, A-stable and L-stable, independent of the approximation scheme for the error correction. In particular, the classical explicit Runge-Kutta method for the error correction not only saves the computational cost that the error correction method requires but also gives the same convergence order as the error correction method does. Numerical evidence is provided to support the theoretical results.

MOTION IN PARABOLIC CYLINDRICAL COORDINATES: APPLICATION TO J2 GRAVITY PERTURBED TRAJECTORIES

  • Sharaf, M.A.;Selim, H.H.;Saad, A.S.
    • 천문학회지
    • /
    • 제39권4호
    • /
    • pp.147-150
    • /
    • 2006
  • In this paper, initial value problem for dynamical astronomy will be established using parabolic cylindrical coordinates. Computation algorithm is developed for the initial value problem of gravity perturbed trajectories. Applications of the algorithm for the problem of final state predication are illustrated by numerical examples of seven test orbits of different eccentricities. The numerical results are extremely accurate and efficient in predicating final state for gravity perturbed trajectories which is of extreme importance for scientific researches as well as for military purposes. Moreover, an additional efficiency of the algorithm is that, for each of the test orbits, the step size used for solving the differential equations of motion is larger than 70% of the step size used for obtaining its reference final state solution.

Analytical solutions of in-plane static problems for non-uniform curved beams including axial and shear deformations

  • Tufekci, Ekrem;Arpaci, Alaeddin
    • Structural Engineering and Mechanics
    • /
    • 제22권2호
    • /
    • pp.131-150
    • /
    • 2006
  • Exact analytical solutions for in-plane static problems of planar curved beams with variable curvatures and variable cross-sections are derived by using the initial value method. The governing equations include the axial extension and shear deformation effects. The fundamental matrix required by the initial value method is obtained analytically. Then, the displacements, slopes and stress resultants are found analytically along the beam axis by using the fundamental matrix. The results are given in analytical forms. In order to show the advantages of the method, some examples are solved and the results are compared with the existing results in the literature. One of the advantages of the proposed method is that the high degree of statically indeterminacy adds no extra difficulty to the solution. For some examples, the deformed shape along the beam axis is determined and plotted and also the slope and stress resultants are given in tables.

An Error Embedded Runge-Kutta Method for Initial Value Problems

  • Bu, Sunyoung;Jung, WonKyu;Kim, Philsu
    • Kyungpook Mathematical Journal
    • /
    • 제56권2호
    • /
    • pp.311-327
    • /
    • 2016
  • In this paper, we propose an error embedded Runge-Kutta method to improve the traditional embedded Runge-Kutta method. The proposed scheme can be applied into most explicit embedded Runge-Kutta methods. At each integration step, the proposed method is comprised of two equations for the solution and the error, respectively. These solution and error are obtained by solving an initial value problem whose solution has the information of the error at each integration step. The constructed algorithm controls both the error and the time step size simultaneously and possesses a good performance in the computational cost compared to the original method. For the assessment of the effectiveness, the van der Pol equation and another one having a difficulty for the global error control are numerically solved. Finally, a two-body Kepler problem is also used to assess the efficiency of the proposed algorithm.

ERROR ESTIMATES OF PHYSICS-INFORMED NEURAL NETWORKS FOR INITIAL VALUE PROBLEMS

  • JIHAHM YOO;JAYWON KIM;MINJUNG GIM;HAESUNG LEE
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • 제28권1호
    • /
    • pp.33-58
    • /
    • 2024
  • This paper reviews basic concepts for Physics-Informed Neural Networks (PINN) applied to the initial value problems for ordinary differential equations. In particular, using only basic calculus, we derive the error estimates where the error functions (the differences between the true solution and the approximations expressed by neural networks) are dominated by training loss functions. Numerical experiments are conducted to validate our error estimates, visualizing the relationship between the error and the training loss for various first-order differential equations and a second-order linear equation.

ECC를 적용한 DRAM의 초기화 시간 최소화 방법 (Minimizing method of initial time for ECC DRAM)

  • 노종성;김종태
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2006년 학술대회 논문집 정보 및 제어부문
    • /
    • pp.446-448
    • /
    • 2006
  • DRAM with ECC is used widely and the size of DRAW increases. According to this, DRAM initial time, especially the time to make the whole area typical value, 0, increases. This paper introduces the method that without any additional hardware, using characteristic of DRAM and DRAM controller, minimize that memory initial time. Conservative reordering - it eliminates DRAM read time and makes write buffer used - reduces initial time to make the whole DRAM area 0, by 95.36% for DDR DRAM. 9341% for Rambus DRAM.

  • PDF

특성이 다른 지게차 적재 중량 센서의 초기 값 오차 보정 (Error Calibration of Initial Value of Weight Measuring Sensors with Different Feature of Forklift)

  • 한치문;임춘식;이성렬
    • 한국항행학회논문지
    • /
    • 제23권2호
    • /
    • pp.214-220
    • /
    • 2019
  • 산업현장에서의 안전사고 빈도가 높은 지게차 전복의 주요 원인인 과적을 방지하기 위해 개발된 앵커(anchor) 볼트 형태의 strain 게이지 센서의 초기 값 오차를 보정하는 방법을 제안하였다. Strain 게이지 센서의 초기 값 오차는 앵커 볼트의 물리적이고 기계적 오차와 환경적 문제에기인하는 것을 확인하였다. 이러한 원인들을 제조 공정에서 제거하는 것은 본 연구의 범위를 벗어나는 것이기 때문에 제반 원인들을 고려한 보정 값을 찾고, 이 보정 값으로 strain 게이지 센서부를 구성하는 ADC 모듈의 초기 값을 보정하는 방법을 적용하였다. 보정 값 도출을 위하여 선형 보간법을 채택하였다. 도출한 보정 값을 4개의 strain 게이지 센서에 적용하여 시험한 결과 4개의 센서 모두 실제 중량 값과의 차이가 5% 이내가 되는 것을 확인하였다. 아울러 초기 값 보정 전에는 센서들의 ADC 값과 적재 중량 실제 값의 상관성이 없었던 점도 동시에 해결할 수 있었다.