• Title/Summary/Keyword: Convergence Proof

Search Result 149, Processing Time 0.028 seconds

Barycentric Approximator for Reinforcement Learning Control

  • Whang Cho
    • International Journal of Precision Engineering and Manufacturing
    • /
    • v.3 no.1
    • /
    • pp.33-42
    • /
    • 2002
  • Recently, various experiments to apply reinforcement learning method to the self-learning intelligent control of continuous dynamic system have been reported in the machine learning related research community. The reports have produced mixed results of some successes and some failures, and show that the success of reinforcement learning method in application to the intelligent control of continuous control systems depends on the ability to combine proper function approximation method with temporal difference methods such as Q-learning and value iteration. One of the difficulties in using function approximation method in connection with temporal difference method is the absence of guarantee for the convergence of the algorithm. This paper provides a proof of convergence of a particular function approximation method based on \"barycentric interpolator\" which is known to be computationally more efficient than multilinear interpolation .

THE STEEPEST DESCENT METHOD AND THE CONJUGATE GRADIENT METHOD FOR SLIGHTLY NON-SYMMETRIC, POSITIVE DEFINITE MATRICES

  • Shin, Dong-Ho;Kim, Do-Hyun;Song, Man-Suk
    • Communications of the Korean Mathematical Society
    • /
    • v.9 no.2
    • /
    • pp.439-448
    • /
    • 1994
  • It is known that the steepest descent(SD) method and the conjugate gradient(CG) method [1, 2, 5, 6] converge when these methods are applied to solve linear systems of the form Ax = b, where A is symmetric and positive definite. For some finite difference discretizations of elliptic problems, one gets positive definite matrices that are almost symmetric. Practically, the SD method and the CG method work for these matrices. However, the convergence of these methods is not guaranteed theoretically. The SD method is also called Orthores(1) in iterative method papers. Elman [4] states that the convergence proof for Orthores($\kappa$), with $\kappa$ a positive integer, is not heard. In this paper, we prove that the SD method and the CG method converge when the $\iota$$^2$ matrix norm of the non-symmetric part of a positive definite matrix is less than some value related to the smallest and the largest eigenvalues of the symmetric part of the given matrix.(omitted)

  • PDF

Similarity Measure Design on High Dimensional Data

  • Nipon, Theera-Umpon;Lee, Sanghyuk
    • Journal of the Korea Convergence Society
    • /
    • v.4 no.1
    • /
    • pp.43-48
    • /
    • 2013
  • Designing of similarity on high dimensional data was done. Similarity measure between high dimensional data was considered by analysing neighbor information with respect to data sets. Obtained result could be applied to big data, because big data has multiple characteristics compared to simple data set. Definitely, analysis of high dimensional data could be the pre-study of big data. High dimensional data analysis was also compared with the conventional similarity. Traditional similarity measure on overlapped data was illustrated, and application to non-overlapped data was carried out. Its usefulness was proved by way of mathematical proof, and verified by calculation of similarity for artificial data example.

HMD Type SMV 3Ddisplay System (HMD 형태의 초다시점 3차원 영상 표시 장치)

  • 김성규
    • Journal of Broadcast Engineering
    • /
    • v.7 no.4
    • /
    • pp.362-367
    • /
    • 2002
  • The 3-dimensional image display system using only binocular disparity can induce the eye fatigue because of the mismatch between the accommodation of eye and the convergence of two eyes. A new 3-dimensional display system for one observer that can solve eye fatigue caused by mismatch between accommodation and convergence was introduced in this paper. A proof about the possibility of satisfaction of accommodation of one eye was given as the experimental result in this 3-dimensional display system.

A security implementation based on the sensor tag (센서 태그를 이용한 보안 장치 구현)

  • Kim, Sang-Choon;Park, Ji-Mann
    • Convergence Security Journal
    • /
    • v.11 no.1
    • /
    • pp.19-24
    • /
    • 2011
  • This paper describes a passive SID sensor tag that provide physical security functions based on a sensor interface module. It elementarily consists of a serial I/O interface, control module, and sensor module. In this paper, it show tamper-proof security functions by comparison and encryption with the sensor signal data using the physical resistors. The passive SID sensor tag can be realized by the real time management for the safety, forgery, and so on. The proposed SID tag embedded with a sensor module is expected to find wide physical security applications.

Study of the Qualification Test Procedure for the General Avionic Computer for Aircraft (항공기용 임무 통제 컴퓨터(General Avionic Computer)의 품질인증시험절차 수립에 관한 연구)

  • Jo, Jang-Hyen
    • Journal of the Korean Society of Industry Convergence
    • /
    • v.4 no.2
    • /
    • pp.119-125
    • /
    • 2001
  • This paper discuss the Qualification Test Procedure which is composed of main functional and environmental tests for the localizing avionics and subsystems, especially the detail test approaches of General Avionics Computed(GAC) through the analysis of related technical data packages for the purpose of performance proof of final products. Quality assurance procedures are properly established with the several kinds of inspections and functional test items. They are called as process inspections, functional test, acceptance test procedure and qualification test procedure. The Qualification test procedure are composed of the analysis of original engineering design concept and shall be performed for the acquisition of the certification of the GAC's quality as well as the aquisition of the related techniques and engineering know-how items.

  • PDF

Research on Finite-Time Consensus of Multi-Agent Systems

  • Chen, Lijun;Zhang, Yu;Li, Yuping;Xia, Linlin
    • Journal of Information Processing Systems
    • /
    • v.15 no.2
    • /
    • pp.251-260
    • /
    • 2019
  • In order to ensure second-order multi-agent systems (MAS) realizing consensus more quickly in a limited time, a new protocol is proposed. In this new protocol, the gradient algorithm of the overall cost function is introduced in the original protocol to enhance the connection between adjacent agents and improve the moving speed of each agent in the MAS. Utilizing Lyapunov stability theory, graph theory and homogeneity theory, sufficient conditions and detailed proof for achieving a finite-time consensus of the MAS are given. Finally, MAS with three following agents and one leading agent is simulated. Moreover, the simulation results indicated that this new protocol could make the system more stable, more robust and convergence faster when compared with other protocols.

A study on the Comparison Analysis for Messenger Evidence Using Mobile Forensics (모바일 포렌식을 이용한 메신저 증거 비교 분석 연구)

  • Hwang, Taejin;Won, Dongho;Lee, Youngsook
    • Convergence Security Journal
    • /
    • v.18 no.2
    • /
    • pp.25-32
    • /
    • 2018
  • As the use of smartphones become more common, the communication via instant messenger becomes natural. However, it is important to secure the relevant information promptly since the chat room between participants can be used as a space for a criminal conspiracy, and crime-related contents can be stored and deleted easily on smartphones. Therefore, this study aims to identify the available data and to use it as proof by comparing and analyzing the instant messengers with high usage rate.

  • PDF

Experiment of proof-of-principle on prompt gamma-positron emission tomography (PG-PET) system for in-vivo dose distribution verification in proton therapy

  • Bo-Wi Cheon ;Hyun Cheol Lee;Sei Hwan You;Hee Seo ;Chul Hee Min ;Hyun Joon Choi
    • Nuclear Engineering and Technology
    • /
    • v.55 no.6
    • /
    • pp.2018-2025
    • /
    • 2023
  • In our previous study, we proposed an integrated PG-PET-based imaging method to increase the prediction accuracy for patient dose distributions. The purpose of the present study is to experimentally validate the feasibility of the PG-PET system. Based on the detector geometry optimized in the previous study, we constructed a dual-head PG-PET system consisting of a 16 × 16 GAGG scintillator and KETEK SiPM arrays, BaSO4 reflectors, and an 8 × 8 parallel-hole tungsten collimator. The performance of this system as equipped with a proof of principle, we measured the PG and positron emission (PE) distributions from a 3 × 6 × 10 cm3 PMMA phantom for a 45 MeV proton beam. The measured depth was about 17 mm and the expected depth was 16 mm in the computation simulation under the same conditions as the measurements. In the comparison result, we can find a 1 mm difference between computation simulation and measurement. In this study, our results show the feasibility of the PG-PET system for in-vivo range verification. However, further study should be followed with the consideration of the typical measurement conditions in the clinic application.

Application of linearization method for large-scale structure optimizations (구조물 최적화를 위한 선형화 기법)

  • 이희각
    • Computational Structural Engineering
    • /
    • v.1 no.1
    • /
    • pp.87-94
    • /
    • 1988
  • The linerization method as one of the recursive quadratic programming method is applied for the optimal design of a large-scale structure supported by Pshenichny's proof of global convergence of the algorithm and convergence rate estimates. The linearization method transforms all constants of the design problem into an equivalent linearized constraint and employs the active-set strategy. This results in substantial computational savings by reducing the number of sate and adjoint to be solved at every design iteration. The illustrative example of plates with beams supported by columns is the typical one of a large-scale structure to give successful optimum solutions with satisfactory convergence criteria. Hopefully, the method may be applicable to all classes of optimization problems.

  • PDF