• 한국항행학회논문지
• /
• 제26권2호
• /
• pp.72-77
• /
• 2022

강화학습의 기법 중 Q-Learning은 주어진 상태에서 행동을 수행하면서 미래의 효율적인 기댓값을 예측하는 Q 함수를 학습하면서 최적의 정책을 학습하는 것이다. Q-Learning은 강화학습의 기본적인 알고리즘으로 많이 활용하고 있다. 본 논문에서는 Q-Learning을 바탕으로 정책과 보상을 설계하여 효율적인 경로를 선택하고 학습하는 효용성에 대하여 연구하였다. 또한 Frozen Lake 게임의 8x8 그리드 환경에 동일한 학습 횟수를 적용하여 기존 알고리즘 및 처벌 보상 정책과 제시한 처벌강화 정책의 결과를 비교하였다. 해당 비교를 통해 본 논문에서 제시한 Q-Learning의 처벌강화 정책이 통상적인 알고리즘의 적용보다 학습 속도를 상당히 높일 수 있는 것으로 분석되었다.

• 자원환경지질
• /
• 제55권3호
• /
• pp.231-239
• /
• 2022

The irregular shape of the disturbances is a fundamental issue for mining engineers at the Sidi Chennane phosphate deposit in Morocco. A precise classification of disturbed areas is therefore necessary to understand their part in the overall volume of phosphate. In this paper, we investigate the theoretical and practical aspects of studying and measuring multifractal spectrums as a defining and representative parameter for distinguishing between the phosphate deposit of a low rate of disturbances and the deposit of a high rate. An empirical multifractal approach was used by analyzing the disturbed areas through the geoelectric images of an area located in the Sidi Chennane phosphate deposit. The Generalized fractal dimension, D(q), the Singularities of strength, α(q), the local dimension, f(α) and their conjugate parameter the mass exponent, τ(q) as well as f(α)-α spectrum were the common multifractal parameters used. The results reported show wide variations of the analyzed images, indicating that the multifractal analysis is an indicator for evaluate and characterize the disturbed areas within the phosphates deposits through the studied geoelectric images. This could be the starting point for future work aimed at improving phosphate exploration planning.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제18권3호
• /
• pp.779-800
• /
• 2024

Unmanned Aerial Vehicle (UAV) networks, also known as drone networks, have gained significant attention for their potential in various applications, including communication. UAV networks for communication involve using a fleet of drones to establish wireless connectivity and provide communication services in areas where traditional infrastructure is lacking or disrupted. UAV communication networks need to be highly secured to ensure the technology's security and the users' safety. The proposed survey provides a comprehensive overview of the current state-of-the-art UAV network security solutions. In this paper, we analyze the existing literature on UAV security and identify the various types of attacks and the underlying vulnerabilities they exploit. Detailed mitigation techniques and countermeasures for the protection of UAVs are described in this paper. The survey focuses on the implementation of novel technologies like Q-learning, blockchain, IRS, and mmWave. This paper discusses network simulation tools that range in complexity, features, and programming capabilities. Finally, future research directions and challenges are highlighted.

• 전기학회논문지
• /
• 제60권1호
• /
• pp.50-62
• /
• 2011

In this paper, analytical techniques for performance characteristics analysis of wind power generator with outer permanent magnet rotor are proposed. Furthermore, the proposed analytical techniques are validated by performance experiments of the manufactured generator. In this part, characteristic equations of losses such as copper loss, core loss are derived. Using the derived loss characteristic equations, electrical parameters obtained in [15] and d-q axes method, constant load and constant speed characteristics of wind power generator are analyzed. And then, to analyze performance of wind power system according to wind speed, d-q analysis model considering wind turbine characteristics is proposed. Finally, the obtained performance characteristics results are validated in comparison with those by experiments.

• Journal of applied mathematics & informatics
• /
• 제5권2호
• /
• pp.373-382
• /
• 1998

Most of the works in Time Series Analysis are based on the Auto Regressive Integrated Moving Average (ARIMA) models presented by Box and Jeckins(1976). If the data exhibits no ap-parent deviation from stationarity and if it has rapidly decreasing autocorrelation function then a suitable ARIMA(p,q) model is fit to the given data. Selection of the orders of p and q is one of the crucial steps in Time Series Analysis. Most of the methods to determine p and q are based on the autocorrelation function and partial autocor-relation function as suggested by Box and Jenkins (1976). many new techniques have emerged in the literature and it is found that most of them are over very little use in determining the orders of p and q when both of them are non-zero. The Durbin-Levinson algorithm and Innovation algorithm (Brockwell and Davis 1987) are used as recur-sive methods for computing best linear predictors in an ARMA(p,q)model. These algorithms are modified to yield an effective method for ARMA model identification so that the values of order p and q can be determined from them. The new method is developed and its validity and usefulness is illustrated by many theoretical examples. This method can also be applied to an real world data.

• 대한교통학회지
• /
• 제6권1호
• /
• pp.43-53
• /
• 1988

This study is to find the proper method of estimating urban road traffic capacity. To estimate road traffic capacity, the following methods are chosen ; 1) crossing point of Q-V and S-V, 2) critical velocity and density of Q-V-K model, 3) V-K model with density parameter. The density estimated through S-V relation is 174 veh./km. The methods used in this paper yields more stable values with 2286 veh./h/ in average. The estimated average capacity by three methods are 2272 veh./h. in multilane road. 2411 veh./h in three lane road and 2185 veh./h. in two lane road.

• Journal of information and communication convergence engineering
• /
• 제3권3호
• /
• pp.137-141
• /
• 2005

The paper presents some methods to improve characteristics of film bulk acoustic resonator (FBAR) devices. The FBAR devices were fabricated on Bragg reflectors. Thermal treatments were done by sintering and/or annealing processes. The measurement showed a considerable improvement of return loss $(S_{11})$ and quality factor $(Q_{s/p}).$ These thermal treatment techniques seem very promising for enhancing FBAR resonance performance.

• Clinical and Experimental Reproductive Medicine
• /
• 제41권2호
• /
• pp.68-74
• /
• 2014

Objective: In search of an ideal method of assisted hatching (AH), we compared the effects of conventional micropipette-AH and laser-AH on the blastocyst formation rate (BFR) and blastocyst cell numbers. Methods: Four-to five-week-old ICR female mice were paired with male mice after superovulation using Pregnant mare's serum gonadotropin (PMSG) and hCG. The two-cell embryos were flushed from the oviducts of female mice. The retrieved two-cell embryos underwent one of five AH procedures: single mechanical assisted hatching (sMAH); cross mechanical assisted hatching (cMAH); single laser assisted hatching (sLAH); quarter laser assisted hatching (qLAH); and quarter laser zona thinning assisted hatching (qLZT-AH). After 72 hours incubation, double immunofluorescence staining was performed. Results: Following a 72 hours incubation, a higher hatching BFR was observed in the control, sMAH, cMAH, and sLAH groups, compared to those in the qLAH and qLZT-AH groups (p<0.05). The hatched BFR was significantly higher in the qLAH and qLZT-AH groups than in the others (p<0.05 for each group). The inner cell mass (ICM) was higher in the control and sMAH group (p<0.05). The trophectoderm cell number was higher in the cMAH and qLAH groups (p<0.05). Conclusion: Our results showed that the hatched BFR was higher in groups exposed the the qLAH and qLZT-AH methods compared to groups exposed to other AH methods. In the qLAH group, although the total cell number was significantly higher than in controls, the ICM ratio was significantly lower in than controls.

• Journal of Genetic Medicine
• /
• 제8권1호
• /
• pp.62-66
• /
• 2011

14q32.33을 포함한 14번 염색체 장완 결실은 드문 질환이다. 14번 염색체의 말단 결실은 여러 임상증상을 공통적으로 보일 수 있으나 결실 절단부 (breakpoint)에 따라 표현형이 다양하게 발생할 수 있다. 저자들은 경련을 동반한 5세 여아에서 array comparative genomic hybridization (array-CGH)와 fluorescence in situ hybridization (FISH) 방법을 이용하여 이전 보고에 비해 가장 작은 14q32.33부위의 0.33 Mb 크기의 말단 결실과 심하지 않은 표현형을 보이는 1례를 경험 하였기에 문헌고찰과 함께 보고하는 바이다.

• 한국환경생태학회지
• /
• 제6권2호
• /
• pp.134-146
• /
• 1993

소백산 천동계곡 삼림의 식물군집구조분석을 위하여 20개소에 조사구(1개조사구당 20$\times$25m)를 설정하고 식생조사를 실시하여 얻은 자료에 대하여 TWINSPAM에 의한 classification과 DCA ordination기법을 적용하여 분석하였고 환경인자와 식생과의 관계를 CCA기법으로 분석하였다. TWINSPAN 과 DCA에 의하여 4개 군집인 소나무군집, 굴참나무-신갈나무-소나무군집, 신갈나무군집, 물푸레나무군집으로 분리되었다. 교목상층군의 천이는 소나무$\longrightarrow$신갈나무, 굴참나무$\longrightarrow$물푸레나무로 추정되었다. CCA에 의한 ordination분석에서는 토양내의 pH. 유기물함량, $Ca^{++}$함량, $Mg^{++}$함량과 제 1, 2축과의 상관성이 인정되었고, 유기물, $Mg^{++}$함량과 물푸레나무군집 그리고 pH와 소나무군집과의 상관관계가 인정되었다. 그러나 환경인자와 수종과의 관계는 명료하지 않았다.