• Title/Summary/Keyword: good pairs

Search Result 187, Processing Time 0.024 seconds

Reinforcement learning Speedup method using Q-value Initialization (Q-value Initialization을 이용한 Reinforcement Learning Speedup Method)

  • 최정환
    • Proceedings of the IEEK Conference
    • /
    • 2001.06c
    • /
    • pp.13-16
    • /
    • 2001
  • In reinforcement teaming, Q-learning converges quite slowly to a good policy. Its because searching for the goal state takes very long time in a large stochastic domain. So I propose the speedup method using the Q-value initialization for model-free reinforcement learning. In the speedup method, it learns a naive model of a domain and makes boundaries around the goal state. By using these boundaries, it assigns the initial Q-values to the state-action pairs and does Q-learning with the initial Q-values. The initial Q-values guide the agent to the goal state in the early states of learning, so that Q-teaming updates Q-values efficiently. Therefore it saves exploration time to search for the goal state and has better performance than Q-learning. 1 present Speedup Q-learning algorithm to implement the speedup method. This algorithm is evaluated. in a grid-world domain and compared to Q-teaming.

  • PDF

Boolean Factorization Technique Using Two-cube Terms (2개의 곱항에서 공통인수를 이용한 논리 분해식 산출)

  • Kwon, Oh-Hyeong
    • Proceedings of the IEEK Conference
    • /
    • 2005.11a
    • /
    • pp.849-852
    • /
    • 2005
  • A factorization is an extremely important part of multi-level logic synthesis. The number of literals in a factored from is a good estimate of the complexity of a logic function, and can be translated directly into the number of transistors required for implementation. Factored forms are described as either algebraic or Boolean, according to the trade-off between run-time and optimization. A Boolean factored form contains fewer number of literals than an algebraic factored form. In this paper, we present a new method for a Boolean factorization. The key idea is to identify two-cube Boolean subexpression pairs from given expression. Experimental results on various benchmark circuits show the improvements in literal counts over the algebraic factorization based on Brayton's co-kernel cube matrix.

  • PDF

Spectrophotometric Determination of Trace Lead(II) After Extraction of Lead-Thiosulfate Complex into Aliquat336-CHCl$_3$ and Replacement by Cu (납-티오황산 착물생성과 구리치환에 의한 미량 납(II)의 비색분석에 관한 연구)

  • Lee, Seok-Ki;Joung, Chang-Ung
    • Journal of Environmental Health Sciences
    • /
    • v.24 no.3
    • /
    • pp.1-5
    • /
    • 1998
  • A spectrophotometric method was developed for the acidic solution stripped after an extraction of 0.5 to 2.5 ppm of Lead(II) from 50 mL of $Na_2S_2O_3$ solution into chloroform as the ion-pairs formed between their thiosulfate complexes and alkylamine, Aliquat336. Pb(II) in the stripped solution forms an complex with DDTC in pH 7.3 buffer solution, and was developed in yellow by copper replacement. The ydlow-colored solution have the maximum absorbance at 435 nm in the measurement of absorbance by UV-Visible spectrophotometer. The interference ions such as Fe(III), Hg (II), Al(III), Co, Cu, Ni, Zn, Ca, Sn, have great effects on the extraction, but they were overcomed by the usage of adequate masking agents before an extraction. At last, a good result was obtained in applying this method to synthetic water.

  • PDF

Study on the Characteristics of Hydride Heat Pump Using the Zr-based Laves Phase Alloys (Zr-based 합금을 이용한 hydride heat pump의 작동 특성에 관한 연구)

  • Lee, Soo-Geun;Lee, Jai-Young
    • Journal of Hydrogen and New Energy
    • /
    • v.2 no.1
    • /
    • pp.39-46
    • /
    • 1990
  • In order to improve the power of hydride heat pump, prototype heat pump was constructed using $Zr_{0.95}Ti_{0.05}Cr_{0.9}Fe_{1.1}$-$Zr_{0.9}Ti_{0.1}Cr_{0.6}Fe_{1.4}$ which had very good hydrogenation properties. The power changed with operating parameter such as cycle time, air flow rate, and temperature of hot air was investigated. The power shows maximum value with cycle time. The power increased with air flow rate and temperature of hot air. The power of the heat pump was $65-72 Kcal/Kg-alloy{\cdot}h$ under optimum operating condition, which was superior to that the system using $LaNi_{0.9}Al_{0.3}-MmNi_{4.15}Al_{0.66}Fe_{0.2}$ alloy pairs.

  • PDF

A Study on the In-Situ Measurement of the Deformation and the Back Calculation of the Load in the Mine Roadway Over-Stressed Rocks (중지압 운반 갱도내 변형계측 및 하중역산에 관한 연구)

  • Cho, Young-Soo;Kim, Hong-Woo;Shin, Hee-Soon;Chung, So-Keul;Lee, Hi-Keun
    • Tunnel and Underground Space
    • /
    • v.3 no.1
    • /
    • pp.40-49
    • /
    • 1993
  • In this study, the indirect estimation method of the support load which is based upon the integrated measuring technique suggested by Kovari was applied to the calculation of support load in the mine roadway. Four test supports were installed in the area where they had to be replaed. Two of those were GI-130 rigid supports and the others were U-26 yieldable supports. The vibrating wire strain gages which were attached inpairs on the steel arch support were used to provide an accurate measurement. Bending moments and normal forces obtained from strain gage pairs were used to calculate the support load. This method was also verified by laboratory bending tests. The results obtained from the back-calculction method showed relatively good agreement with the measured convergence for each crossection.

  • PDF

Infrared Rainfall Estimates Using the Probability Matching Method Applied to Coincident SSM/I and GMS-5 Data

  • Oh, Hyun-Jong;Sohn, Byung-Ju;Chung, Hyo-Sang
    • Proceedings of the KSRS Conference
    • /
    • 1999.11a
    • /
    • pp.117-121
    • /
    • 1999
  • Relations between GMS-5 infrared brightness temperature with SSM/I retrieved rain rate are determined by a probability matching method similar to Atlas et al. and Crosson et al. For this study, coincident data sets of the GMS-5 infrared measurements and SSM/I data during two summer seasons of 1997 and 1998 are constructed. The cumulative density functions (CDFs) of infrared brightness temperature and rain rate are matched at pairs of two variables which give the same percentile contribution. The method was applied for estimating rain rate on 31 July 1998, examining heavy rainfall estimation of a flash flood event over Mt. Jiri. Results were compared with surface gauge observations run by Korean Meteorological Administration. It was noted that the method produced reasonably good quality of rain estimate, however, there was large area giving false rain due to the anvil type clouds surrounding deep convective clouds. Extensive validation against surface rain observation is currently under investigation.

  • PDF

An Integer Programming Approach to Packing Lightpaths on WDM Networks (파장분할다중화망의 광경로 패킹에 대한 정수계획 해법)

  • Lee, Kyungsik;Lee, Taehan;Park, Sungsoo
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.32 no.3
    • /
    • pp.219-225
    • /
    • 2006
  • We consider a routing and wavelength assignment (RWA) for the efficient operation of WDM networks. For a given physical network, a set of selected pairs of nodes, the number of required connections for each selected pair of nodes, and a set of available wavelengths, the RWA is to realize as many connections as possible without wavelength collision. We give an integer programming formulation and an algorithm based on column generation. Though the proposed algorithm does not guarantee optimal solutions, test results show that the algorithm gives probably good solutions.

Evaluation of the Operation Quality of Port Using AHP

  • Thao, Ngo Phuong;Yoon, Dae-Gwun
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • 2016.05a
    • /
    • pp.239-241
    • /
    • 2016
  • The success or failure of businesses affected by the decision makers, when good decisions go in the direction of social development, the ability to be more successful, while one bad decision away contrary to the trend of social development are less likely to succeed. Today AHP method is widely used to solve critical problems in many areas of life. Analytic Hierarchy Process (AHP) is a quantitative comparison method is used to select a preferred solution using comparable pairs of solutions based on their relative effectiveness against criteria. The purpose of this study is provide an overview of the application of hierarchical analysis methods to solve many different important issues in the field of supply chain management.

  • PDF

A Watermarking Technique Using Means and Differences of Neighboring Wavelet Transform Coefficient Pairs (이웃한 웨이브릿 변환 계수 쌍의 평균과 차이를 이용한 워터마킹 기법)

  • Kim, Hyeon-Sun;Bae, Seong-Ho;Park, Gil-Heum
    • The Transactions of the Korea Information Processing Society
    • /
    • v.7 no.6
    • /
    • pp.1980-1987
    • /
    • 2000
  • In this paper, an efficient watermarking technique in wavelet transform domain is proposed. Watermarking is embedding a digital signal called as 'watermark' into images to claim the ownership. In the proposed method, the image is 1-level wavelet transformed, and then the watermark with a binary stamp is embedded into the baseband. The watermark is embedded by inverting the polarities of he selected coefficient paris. In the inverting process, we can increase image quality by finding means and differences of the selected neighboring coefficient paris, and then adding values, which are inversely proportional to the differences, to th means. The experimental results show that the proposed method has good quality and is robust to various attacks such as the JPEG lossy comparison, noise addition, clipping, blurring, etc.

  • PDF

Minimum Cost Layout (Expansion) Planning for Telephone Cable Networks of a Single Exchange Area (전화케이블네트워크의 최적 배치(증설) 계획)

  • 차동원;정승학
    • Journal of the Korean Operations Research and Management Science Society
    • /
    • v.5 no.1
    • /
    • pp.39-51
    • /
    • 1980
  • This paper deals with the problem of determining the capacity expansion timing and sizes of conduits and feeder cables for a given cable network configuration of a single exchange ares, which minimizes the present worth of total costs. The planning horizon is infinite and the demand of line pairs at each cabinet is assumed to be determininstically growing. As a solution method, the heuristic branch-and-bound algorithm of Freidenfelds and Mclaughlin is elaborated by adding details and some minor modifications, which generates a good near-optimal solution with far less computation than would otherwise be possible. We also develop a computer program, which is shown to be effective and efficient through the test run of an illustrative example.

  • PDF