• Title/Summary/Keyword: 스텝 차

Search Result 40, Processing Time 0.022 seconds

Max-Mean N-step Temporal-Difference Learning Using Multi-Step Return (멀티-스텝 누적 보상을 활용한 Max-Mean N-Step 시간차 학습)

  • Hwang, Gyu-Young;Kim, Ju-Bong;Heo, Joo-Seong;Han, Youn-Hee
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.10 no.5
    • /
    • pp.155-162
    • /
    • 2021
  • n-step TD learning is a combination of Monte Carlo method and one-step TD learning. If appropriate n is selected, n-step TD learning is known as an algorithm that performs better than Monte Carlo method and 1-step TD learning, but it is difficult to select the best values of n. In order to solve the difficulty of selecting the values of n in n-step TD learning, in this paper, using the characteristic that overestimation of Q can improve the performance of initial learning and that all n-step returns have similar values for Q ≈ Q*, we propose a new learning target, which is composed of the maximum and the mean of all k-step returns for 1 ≤ k ≤ n. Finally, in OpenAI Gym's Atari game environment, we compare the proposed algorithm with n-step TD learning and proved that the proposed algorithm is superior to n-step TD learning algorithm.

The optimal compensation gain algorithm using variable step for buck-type active power decoupling circuits (벅-타입 능동 전력 디커플링을 위한 가변 스텝을 적용한 최적 보상 이득 알고리즘)

  • Baek, Ki-Ho;Kim, Seung-Gwon;Park, Sung-Min
    • Proceedings of the KIPE Conference
    • /
    • 2017.11a
    • /
    • pp.177-178
    • /
    • 2017
  • 본 논문에서는 벅-타입 능동 전력 디커플링 회로의 단순화된 제어 방법을 위한 가변 스텝을 적용한 최적 보상 이득 알고리즘을 제안한다. 고정 스텝을 사용한 기존의 최적 보상 이득 알고리즘보다 유동적인 보상 이득 변화를 통해 DC링크 전압 리플을 효과적으로 줄일 수 있다. 기존의 방법보다 최적 보상 이득을 추적하는 시간이 줄어들어 갑작스런 부하 변동이나 이상 상황에 빠른 대응이 가능하다. 벅-타입 능동 전력 디커플링 회로는 전류 불연속 모드로 동작하며, 전류 지령치는 DC링크 전류의 1차 리플 성분에 전류 이득을 유동적으로 보상하여 생성하기 때문에 모든 구간에서 효과적으로 DC링크의 전압 리플을 줄일 수 있고 빠른 대응이 가능하다. 제안하는 가변 스텝을 적용한 최적 보상 알고리즘의 효과는 MATLAB-Simulink 시뮬레이션을 통해 검증하였다.

  • PDF

New Double-Connected Multi-Step Inverter for High Power Motor Drive Applications (대용량 모터드라이브 적용을 위한 새로운 이중접속방식의 멀티스뎁 인버터)

  • Yang S.U.;Mok H.S.;Choe G.H.;Choi S.W.
    • Proceedings of the KIPE Conference
    • /
    • 2003.07b
    • /
    • pp.598-601
    • /
    • 2003
  • 본 논문에서는 전압원 인버터의 출력전압 파형을 개선하여 중 $\cdot$ 대용량급 모터드라이버 및 UPS, STATCOM, SVC등에 적용하기 위한 새로운 3상 전압원 인버터를 제안한다. 보조회로로서 사용한 컨버터로 리플전압을 발생시키고 이를 기존의 12-스텝 인버터에 주입하는데 한대의 링크를 사용하면 12-스텝 동작이 24-스텝으로 전환되며 보조 변압기의 1차 권선을 2N(N=1,2,3...)으로 늘리면 24N-스텝으로 전환된다. 본 방식의 타당성을 실험 및 시뮬레이션을 통하여 입증하였다.

  • PDF

Phase Offset Estimation Based on Turbo Decoding in Digital Broadcasting System (차세대 고속무선 DTV를 위한 터보복호기반의 위상 옵셋 추정 기법)

  • Park, Jae-Sung;Cha, Jae-Sang;Lee, Chong-Hoon;Kim, Heung-Mook;Choi, Sung-Woong;Cho, Ju-Phill;Park, Yong-Woon;Kim, Jin-Young
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.9 no.2
    • /
    • pp.111-116
    • /
    • 2009
  • In this paper, we propose a phase offset estimation algorithm which is based on turbo coded digital broadcasting system. The phase estimator is an estimator outside turbo code decoder using LMS (Least Mean Square) algorithm to estimate the phase of next state. While the conventional LMS algorithm with a fixed step size is easy implemented, it has weak points that are difficult the channel estimation and tracking in the multipath environment. To resolve this problem, we propose new phase offset estimation method with a variable step size LMS (VS-LMS). Additionally, we propose a scheme which consists of a conventional LMS. The performance is verified by computer simulation according to a fixed phase offset and a increased phase offset, the proposed algorithm improve the bit error rate performance than the conventional algorithm.

  • PDF

New Double-Connected Multi-Step Inverter for High Power Motor Drive Applications (대용량 모터드라이브 적용을 위한 새로운 이중접속방식의 멀티스텝 인버터)

  • Yang, Seung-Uk;Choe, Gyu-Ha;Mok, Hyung-Soo
    • The Transactions of the Korean Institute of Power Electronics
    • /
    • v.11 no.3
    • /
    • pp.209-215
    • /
    • 2006
  • Now, in this paper, going to present you with an Idea related to a new inverter of multi-step voltage source, that Is, the double-connected 12-step inverter with an auxiliary circuit. It possibly can be 24-step inverter with 3-phase voltage source which will enable us make full application even to medium and high power-level Motor drive, UPS, STATCOM, SVC, etc. in which the PWM method could not be employed. 24-step operation can be obtained from the link between the existing 12-step inverter and the additional auxiliary circuit in which the transformer of auxiliary circuit generates ripple voltage delivered to the inverter. Through a lot of experiments and simulations, (from which the validity of this scheme is confirmed,) we came to the conclusion that the increase of the primary winding number on transformer by 2N(N=1,2,3....) leads to the 12M-step(M=2,3,4...) inverter. The validity of the proposed scheme is confirmed by the simulated and experimental results.

Developing a Security Systems Operation Cost Estimation Model : A Transformation Model to Function Point (증권시스템 운영비용 산정 모델 개발 : 프로그램 본수의 기능점수 변환 모델)

  • Choi, Won-Young;Kim, Hyun-Soo
    • 한국IT서비스학회:학술대회논문집
    • /
    • 2003.05a
    • /
    • pp.145-152
    • /
    • 2003
  • 본 연구의 선행 연구에서는 증권시스템의 기능점수를 직접 구하여 기능점수와 운영비용과의 회귀분석을 실시하였다. 수집된 자료의 건수가 적었던 관계로 통계적 유의성을 충분하게 확보하지 못하였다. 따라서 본 연구에서는 증권시스템의 기능점수를 직접 측정하는 것이 현실적으로 많은 제약이 있음을 감안하여, 비교적 자료 수집이 용이한 프로그램 본 수를 측정하였다. 이러한 프로그램 본 수는 스텝 수로 1차 변환이 되었고, 스텝 수는 다시 기능점수로 2차 변환이 되었다. 이렇게 변환된 기능점수와 운영비용과의 회귀분석을 실시하였으며, 증권정보시스템 운영비용 추정 모델을 제시하였다.

  • PDF

Analysis of Periodic Stepped Impedance Ring Resonator by the Effect of Step Perturbation and Application of Dual-Mode Bandpass Filter (스텝 Perturbation의 영향에 따른 주기적 스텝 임피던스 링 공진기의 해석 및 이중 모드 대역 통과 필터의 적용)

  • Lee, Ju-Gab;Lee, Wu-Seong;Ryu, Jae-Jong;Moon, Yeon-Kwan;Kim, Ha-Chul;Choi, Hyun-Chul
    • The Journal of Korean Institute of Electromagnetic Engineering and Science
    • /
    • v.18 no.7
    • /
    • pp.739-747
    • /
    • 2007
  • Dual-mode bandpass filter was designed by using periodic stepped impedance ring resonator with step perturbation. The periodic stepped impedance ring resonator has the effects of size reduction and $2^{nd}$ harmonic suppression by changing characteristic impedance ratio. The perturbation for dual-mode generation was also easily controlled by characteristic impedance ratio, and the variation of dual-mode resonant frequencies and attenuation pole frequencies were analyzed by the effect of step perturbation. Chip capacitors were used for input/output coupling, and the variation of center frequency by the coupling capacitance and step perturbation was also considered. From the results, two types of 2 GHz dual-mode bandpass filter were fabricated in size of $14{\times}14mm^2$, those have different attenuation poles and bandwidths. The measured results of proposed bandpass filters showed a good agreement with the calculated estimations, and those have insertion loss of 2.52, 0.52 dB and 3 dB bandwidth of 4.03, 15.02 %, respectively.

Analysis of the Movement and Anatomical Angular Motion of the Joints of the Lower Extremities in Soccer Instep Kick (축구 인스텝 킥의 하지관절 움직임과 해부학적 각운동 분석)

  • Kang, Sang-Hack;Son, Won-Il
    • Korean Journal of Applied Biomechanics
    • /
    • v.18 no.1
    • /
    • pp.1-10
    • /
    • 2008
  • This study analyzed the rear foot angle of the supporting leg and the anatomical rotation angle of the kicking angle in soccer instep kick and drew conclusions as follows. When the supporting leg was landing on the ground, the valgus angle of the ankle joint reached the maximum peak, and plantar flexion was slightly different in the timing of the maximum peak between the two groups. The flexion angle of the rear foot was statistically significantly different between the two groups, and the movement of the crus on the landing of the supporting foot did not show a statistically significant difference between the groups. The crus leaned backward most before the impact, and the side to side gradient of the crus on impact was $22^{\circ}$. The flexion/extension of the hip joint of the kicking leg reached the maximum peak when the supporting foot was landing on the ground, and at the moment, the maximum extension angle of the hip joint was over $30^{\circ}$. The flexion angle of the knee joint of the kicking leg was largest after landing. While the maximum plantar flexion angle and maximum valgus angle of the ankle joint were not significantly different between the two groups, the maximum external rotation angle was significantly different.

Dynamic Instability and Multi-step Taylor Series Analysis for Space Truss System under Step Excitation (스텝 하중을 받는 공간 트러스 시스템의 멀티스텝 테일러 급수 해석과 동적 불안정)

  • Lee, Seung-Jae;Shon, Su-Deok
    • Journal of Korean Society of Steel Construction
    • /
    • v.24 no.3
    • /
    • pp.289-299
    • /
    • 2012
  • The goal of this paper is to apply the multi-step Taylor method to a space truss, a non-linear discrete dynamic system, and analyze the non-linear dynamic response and unstable behavior of the structures. The accurate solution based on an analytical approach is needed to deal with the inverse problem, or the dynamic instability of a space truss, because the governing equation has geometrical non-linearity. Therefore, the governing motion equations of the space truss were formulated by considering non-linearity, where an accurate analytical solution could be obtained using the Taylor method. To verify the accuracy of the applied method, an SDOF model was adopted, and the analysis using the Taylor method was compared with the result of the 4th order Runge-Kutta method. Moreover, the dynamic instability and buckling characteristics of the adopted model under step excitation was investigated. The result of the comparison between the two methods of analysis was well matched, and the investigation shows that the dynamic response and the attractors in the phase space can also delineate dynamic snapping under step excitation, and damping affects the displacement of the truss. The analysis shows that dynamic buckling occurs at approximately 77% and 83% of the static buckling in the undamped and damped systems, respectively.

Racial Triangulation in Steph Cha's Your House Will Pay (스텝 차의 『너의 집이 대가를 치를 것이다』 에 나타난 인종 삼각구도)

  • Yim Jin-Hee
    • The Journal of the Convergence on Culture Technology
    • /
    • v.9 no.2
    • /
    • pp.19-27
    • /
    • 2023
  • This paper is aimed at exploring a multi-racial, multi-ethnic, and multi-cultural trianglulation of Black, White, and Korean American race relations connected to a large-scale disturbance in the 1992 Los Angeles riots. The second generation Korean American Steph Cha's Your House Will Pay (2019) focuses on a social portrait of the racially marginalized beings as Korean immigrant merchants and African American native consumers. This family saga explores issues resulting from racial hierarchy, racialized stereotypes, and historical marginalization in the internalized sociometry of race and class inequality. This work grapples with issues involved in a sociocultural web of racial triangulation under the white dominant structure, and ensuing intergroup conflicts of social minorities in the economic geography of urban space. It opens up civil discussions for transracial, transethnic, and transcultural interactions and coexistence. It ultimately leads to extending young people's minds for a deep understanding of the socioecomonic landscape of racial matrix, and enhancing the cultural literacy for a better awareness of social empathy and the communal respect of life.