• Title/Summary/Keyword: Markov

Search Result 2,429, Processing Time 0.024 seconds

Task offloading scheme based on the DRL of Connected Home using MEC (MEC를 활용한 커넥티드 홈의 DRL 기반 태스크 오프로딩 기법)

  • Ducsun Lim;Kyu-Seek Sohn
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.23 no.6
    • /
    • pp.61-67
    • /
    • 2023
  • The rise of 5G and the proliferation of smart devices have underscored the significance of multi-access edge computing (MEC). Amidst this trend, interest in effectively processing computation-intensive and latency-sensitive applications has increased. This study investigated a novel task offloading strategy considering the probabilistic MEC environment to address these challenges. Initially, we considered the frequency of dynamic task requests and the unstable conditions of wireless channels to propose a method for minimizing vehicle power consumption and latency. Subsequently, our research delved into a deep reinforcement learning (DRL) based offloading technique, offering a way to achieve equilibrium between local computation and offloading transmission power. We analyzed the power consumption and queuing latency of vehicles using the deep deterministic policy gradient (DDPG) and deep Q-network (DQN) techniques. Finally, we derived and validated the optimal performance enhancement strategy in a vehicle based MEC environment.

The Case Study of High School On-demand Linear Algebra Course : Mixed Traditional and Flipped Learning Methods ans Signal Processing Applications (고등학교 주문형 강좌 선형대수 교과목 운영사례 : 전통적 방식과 플립러닝 방식의 혼합수업 형태 및 신호처리 응용)

  • Jae-Ha Yoo
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.24 no.3
    • /
    • pp.147-152
    • /
    • 2023
  • This paper is a study of a linear algebra course taught in a high school on-demand course. Compared to the regular course, flipped learning was added to the course, and applications to signal processing related problems were covered in consideration of students' career aspirations. Overall, the class was a mixture of traditional lectures and flipped learning. Flipped learning was implemented twice. The flipped class consisted of pre-class, in-class and post-class. To verify the effectiveness of the course, a survey was conducted and most of the evaluation items were above 4. The topics of the flipped learning were Markov chains and least squares problem, which are very important in the field of signal processing.

A Search for Exoplanets around Northern Circumpolar Stars. IX. A Multi-Period Analysis of the M Giant HD 135438

  • Byeong-Cheol Lee;Jae-Rim Koo;Yeon-Ho Choi;Tae-Yang Bang;Beomdu Lim;Myeong-Gu Park;Gwanghui Jeong
    • Journal of The Korean Astronomical Society
    • /
    • v.56 no.2
    • /
    • pp.277-286
    • /
    • 2023
  • It is difficult to distinguish the pure signal produced by an orbiting planetary companion around giant stars from other possible sources, such as stellar spots, pulsations, or certain activities. Since 2003, we have obtained radial (RV) data from evolved stars using the high-resolution, fiber-fed Bohyunsan Observatory Echelle Spectrograph (BOES) at the Bohyunsan Optical Astronomy Observatory (BOAO). Here, we report the results of RV variations in the binary star HD 135438. We found two significant periods: 494.98 d with eccentricity of 0.23 and 8494.1 d with eccentricity of 0.83. Considering orbital stability, it is impossible to have two companions in such close orbits with high eccentricity. To determine the nature of the changes in the RV variability, we analyzed indicators of stellar spot and stellar chromospheric activity to find that there are no signals related to the significant period of 494.98 d. However, we calculated the upper limits of rotation period of the rotational velocity and found this to be 478-536 d. One possible interpretation is that this may be closely related to the rotational modulation of an orbital inclination at 67-90 degrees. The other signal corresponding to the period of 8494.1 d is probably associated with a stellar companion orbiting the giant star. A Markov Chain Monte Carlo (MCMC) simulation considering a single companion indicates that HD 135438 system hosts a stellar companion with 0.57+0.017 -0.017 M with an orbital period of 8498 d.

A Study of Reinforcement Learning-based Cyber Attack Prediction using Network Attack Simulator (NASim) (네트워크 공격 시뮬레이터를 이용한 강화학습 기반 사이버 공격 예측 연구)

  • Bum-Sok Kim;Jung-Hyun Kim;Min-Suk Kim
    • Journal of the Semiconductor & Display Technology
    • /
    • v.22 no.3
    • /
    • pp.112-118
    • /
    • 2023
  • As technology advances, the need for enhanced preparedness against cyber-attacks becomes an increasingly critical problem. Therefore, it is imperative to consider various circumstances and to prepare for cyber-attack strategic technology. This paper proposes a method to solve network security problems by applying reinforcement learning to cyber-security. In general, traditional static cyber-security methods have difficulty effectively responding to modern dynamic attack patterns. To address this, we implement cyber-attack scenarios such as 'Tiny Alpha' and 'Small Alpha' and evaluate the performance of various reinforcement learning methods using Network Attack Simulator, which is a cyber-attack simulation environment based on the gymnasium (formerly Open AI gym) interface. In addition, we experimented with different RL algorithms such as value-based methods (Q-Learning, Deep-Q-Network, and Double Deep-Q-Network) and policy-based methods (Actor-Critic). As a result, we observed that value-based methods with discrete action spaces consistently outperformed policy-based methods with continuous action spaces, demonstrating a performance difference ranging from a minimum of 20.9% to a maximum of 53.2%. This result shows that the scheme not only suggests opportunities for enhancing cybersecurity strategies, but also indicates potential applications in cyber-security education and system validation across a large number of domains such as military, government, and corporate sectors.

  • PDF

Lip-Synch System Optimization Using Class Dependent SCHMM (클래스 종속 반연속 HMM을 이용한 립싱크 시스템 최적화)

  • Lee, Sung-Hee;Park, Jun-Ho;Ko, Han-Seok
    • The Journal of the Acoustical Society of Korea
    • /
    • v.25 no.7
    • /
    • pp.312-318
    • /
    • 2006
  • The conventional lip-synch system has a two-step process, speech segmentation and recognition. However, the difficulty of speech segmentation procedure and the inaccuracy of training data set due to the segmentation lead to a significant Performance degradation in the system. To cope with that, the connected vowel recognition method using Head-Body-Tail (HBT) model is proposed. The HBT model which is appropriate for handling relatively small sized vocabulary tasks reflects co-articulation effect efficiently. Moreover the 7 vowels are merged into 3 classes having similar lip shape while the system is optimized by employing a class dependent SCHMM structure. Additionally in both end sides of each word which has large variations, 8 components Gaussian mixture model is directly used to improve the ability of representation. Though the proposed method reveals similar performance with respect to the CHMM based on the HBT structure. the number of parameters is reduced by 33.92%. This reduction makes it a computationally efficient method enabling real time operation.

Automatic Classification of Continuous Heart Sound Signals Using the Statistical Modeling Approach (통계적 모델링 기법을 이용한 연속심음신호의 자동분류에 관한 연구)

  • Kim, Hee-Keun;Chung, Yong-Joo
    • The Journal of the Acoustical Society of Korea
    • /
    • v.26 no.4
    • /
    • pp.144-152
    • /
    • 2007
  • Conventional research works on the classification of the heart sound signal have been done mainly with the artificial neural networks. But the analysis results on the statistical characteristic of the heart sound signal have shown that the HMM is suitable for modeling the heart sound signal. In this paper, we model the various heart sound signals representing different heart diseases with the HMM and find that the classification rate is much affected by the clustering of the heart sound signal. Also, the heart sound signal acquired in real environments is a continuous signal without any specified starting and ending points of time. Hence, for the classification based on the HMM, the continuous cyclic heart sound signal needs to be manually segmented to obtain isolated cycles of the signal. As the manual segmentation will incur the errors in the segmentation and will not be adequate for real time processing, we propose a variant of the ergodic HMM which does not need segmentation procedures. Simulation results show that the proposed method successfully classifies continuous heart sounds with high accuracy.

Methodology to Verify the Unpredictability of True Random Number Generators (실난수 발생기 통계적 예측 불가능성 확인 방법)

  • Moon-Seok Kim;Seung-Bae Jeon
    • Convergence Security Journal
    • /
    • v.24 no.2
    • /
    • pp.123-132
    • /
    • 2024
  • In the era of the Internet of Things, 7 billion diverse devices have been interconnected worldwide. Ensuring information security across these varied devices is crucial in this hyper-connected age. To achieve essential security functions such as confidentiality, integrity, and authentication, it is imperative to implement true random number generators (TRNGs). Therefore, this study proposes a method to rapidly characterize the randomness of TRNGs. While there are international standards for formally characterizing the randomness of TRNGs, adhering to these standards often requires significant time and resources. This study aims to help TRNG developers enhance efficiency in both time and cost by characterizing rough randomness and unpredictability. Firstly, we propose applying auto-correlation and cross-correlation metrics for analog signals. Secondly, we suggest adopting joint entropy and mutual information metrics for digital signals.

Simulation of the Phase-Type Distribution Based on the Minimal Laplace Transform (최소 표현 라플라스 변환에 기초한 단계형 확률변수의 시뮬레이션에 관한 연구)

  • Sunkyo Kim
    • Journal of the Korea Society for Simulation
    • /
    • v.33 no.1
    • /
    • pp.19-26
    • /
    • 2024
  • The phase-type, PH, distribution is defined as the time to absorption into a terminal state in a continuous-time Markov chain. As the PH distribution includes family of exponential distributions, it has been widely used in stochastic models. Since the PH distribution is represented and generated by an initial probability vector and a generator matrix which is called the Markovian representation, we need to find a vector and a matrix that are consistent with given set of moments if we want simulate a PH distribution. In this paper, we propose an approach to simulate a PH distribution based on distribution function which can be obtained directly from moments. For the simulation of PH distribution of order 2, closed-form formula and streamlined procedures are given based on the Jordan decomposition and the minimal Laplace transform which is computationally more efficient than the moment matching methods for the Markovian representation. Our approach can be used more effectively than the Markovian representation in generating higher order PH distribution in queueing network simulation.

Assessing Future Climate Change Impact on Hydrologic Components of Gyeongancheon Watershed (기후변화가 경안천 유역의 수문요소에 미치는 영향 평가)

  • Ahn, So-Ra;Park, Min-Ji;Park, Geun-Ae;Kim, Seong-Joon
    • Journal of Korea Water Resources Association
    • /
    • v.42 no.1
    • /
    • pp.33-50
    • /
    • 2009
  • The impact on hydrologic components considering future potential climate, land use change and vegetation cover information was assessed using SLURP (Semi-distributed Land-Use Runoff Process) continuous hydrologic model. The model was calibrated (1999 - 2000) and validated (2001 - 2002) for the upstream watershed ($260.4\;km^2$) of Gyeongancheon water level gauging station with the coefficient of determination and Nash-Sutcliffe efficiency ranging from 0.77 to 0.60 and 0.79 to 0.60, respectively. Two GCMs (MIROC3.2hires, ECHAM5-OM) future weather data of high (A2), middle (A1B) and low (B1) emission scenarios of the IPCC (Intergovernmental Panel on Climate Change) were adopted and the data was corrected by 20C3M (20th Century Climate Coupled Model) and downscaled by Change Factor (CF) method using 30 years (1977 - 2006, baseline period) weather data. Three periods data of 2010 - 2039 (2020s), 2040 - 2069 (2050s), 2070 - 2099 (2080s) were prepared. To reduce the uncertainty of land surface conditions, future land use and vegetation canopy prediction were tried by CA-Markov technique and NOAA NDVI-Temperature relationship respectively. MIROC3.2 hires and ECHAM5-OM showed increase tendency in annual streamflow up to 21.4 % for 2080 A1B and 8.9 % for 2050 A1B scenario respectively. The portion of future predicted ET about precipitation increased up to 3 % in MIROC3.2 hires and 16 % in ECHAM5-OM respectively. The future soil moisture content slightly increased compared to 2002 soil moisture.

A Study on derivation of drought severity-duration-frequency curve through a non-stationary frequency analysis (비정상성 가뭄빈도 해석 기법에 따른 가뭄 심도-지속기간-재현기간 곡선 유도에 관한 연구)

  • Jeong, Minsu;Park, Seo-Yeon;Jang, Ho-Won;Lee, Joo-Heon
    • Journal of Korea Water Resources Association
    • /
    • v.53 no.2
    • /
    • pp.107-119
    • /
    • 2020
  • This study analyzed past drought characteristics based on the observed rainfall data and performed a long-term outlook for future extreme droughts using Representative Concentration Pathways 8.5 (RCP 8.5) climate change scenarios. Standardized Precipitation Index (SPI) used duration of 1, 3, 6, 9 and 12 months, a meteorological drought index, was applied for quantitative drought analysis. A single long-term time series was constructed by combining daily rainfall observation data and RCP scenario. The constructed data was used as SPI input factors for each different duration. For the analysis of meteorological drought observed relatively long-term since 1954 in Korea, 12 rainfall stations were selected and applied 10 general circulation models (GCM) at the same point. In order to analyze drought characteristics according to climate change, trend analysis and clustering were performed. For non-stationary frequency analysis using sampling technique, we adopted the technique DEMC that combines Bayesian-based differential evolution ("DE") and Markov chain Monte Carlo ("MCMC"). A non-stationary drought frequency analysis was used to derive Severity-Duration-Frequency (SDF) curves for the 12 locations. A quantitative outlook for future droughts was carried out by deriving SDF curves with long-term hydrologic data assuming non-stationarity, and by quantitatively identifying potential drought risks. As a result of performing cluster analysis to identify the spatial characteristics, it was analyzed that there is a high risk of drought in the future in Jeonju, Gwangju, Yeosun, Mokpo, and Chupyeongryeong except Jeju corresponding to Zone 1-2, 2, and 3-2. They could be efficiently utilized in future drought management policies.