• Title/Summary/Keyword: 마르코프 과정

Search Result 61, Processing Time 0.025 seconds

An Efficient Path Planning Algorithm for Partially Observable Maps Based on Value Iteration Algorithm (부분관측가능 환경의 경로 계획을 위한 효율적인 가치 반복 알고리즘)

  • Kim, Young Ki;Kim, Hae-Cheon;Lee, Jaesung
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2019.05a
    • /
    • pp.412-414
    • /
    • 2019
  • 경로 계획은 에이전트가 로봇이 특정 목적지에 도착할 수 있도록 에이전트가 수집한 정보를 바탕으로 경로를 설정하는 작업을 뜻한다. 부분 관측만 가능한 맵인 경우 에이전트 이동마다 새로 수집되는 정보들을 바탕으로 마르코프 의사결정 과정을 사용한 가치 반복 알고리즘이 널리 사용되지만, 제안된 가치 반복 알고리즘 사용 시 매 행동마다 모든 공간의 최적 경로를 계산하기 때문에 시간이 오래 걸리는 문제점이 있다. 이에 본 논문에서는 에이전트가 한 번에 탐색하는 범위가 제한되어 있다는 점에 착안하여 탐색 반경 내에 속하는 공간의 가치 함수 값을 미리 추정하여 효율적으로 최적의 경로를 추정하는 가치 반복 알고리즘을 제안한다.

Emotional Human Body Recognition by Using Extraction of Human Body from Image (인간의 움직임 추출을 이용한 감정적인 행동 인식 시스템 개발)

  • Song, Min-Kook;Park, Jin-Bae;So, Je-Yoon;Joo, Young-Hoon
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2006.11a
    • /
    • pp.348-351
    • /
    • 2006
  • 영상을 통한 감정 인식 기술은 사회의 여러 분야에서 필요성이 대두되고 있음에도 불구하고 인식 과정의 어려움으로 인해 풀리지 않는 문제로 남아 있다. 인간의 움직임을 이용한 감정 인식 기술은 많은 응용이 가능하기 때문에 개발의 필요성이 증대되고 있다. 영상을 통해 감정을 인식하는 시스템은 매우 다양한 기법들이 사용되는 복합적인 시스템이다. 본 논문에서는 이전에 연구된 움직임 추출 방법들을 바탕으로 한 새로운 감정 인식 시스템을 제안한다. 제안된 시스템은 은닉 마르코프 모델을 통해 동정된 분류기를 이용하여 감정을 인식한다. 제안된 시스템의 성능을 평가하기 위해 평가데이터 베이스가 구축되었으며, 이를 통해 제안된 감정 인식 시스템의 성능을 확인하였다.

  • PDF

User Independent On-line Handwritten Numeral Recognition in Table Top Display (테이블 탑 디스플레이에서 사용자 독립적인 온라인 필기 숫자 인식)

  • Kim, Ji-Woong;Kim, Eui-Chul;Kim, Soo-Hyung
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2008.05a
    • /
    • pp.182-185
    • /
    • 2008
  • 테이블 탑 디스플레이는 사람에게 친숙한 상호작용의 수단인 손을 인터페이스 수단으로 이용하는 일종의 탁자형 터치스크린이다. 본 논문에서는 이러한 환경에서 사용자 독립적인 온라인 필기 숫자를 인식하는 연구를 수행하였다. 이로 인해 추후 진행될 다중 사용자의 한글, 영문, 특수기호의 인식 가능성을 확인하였다. 실험 과정은 테이블 탑 디스플레이의 표면을 통해 입력된 사용자별 손가락 궤적으로 기준점을 잡고, 각 사용자별 필기궤적에서 대표점 추출과 16-방향 체인코드변환을 수행하였다, 변환된 체인코드의 학습 및 필기숫자 인식에 확률 통계적 모델인 은닉 마르코프 모델을 이용하였다. 실험에 사용된 데이터는 총 300개의 데이터를 사용 하였고, 학습은 10회 복제하여 총 3000개의 데이터로 수행하였다. 각 사용자별 데이터를 100개씩 인식 실험에 사용하여 각각 93%, 94%의 정인식율을 보였다.

Locational Characteristics of Knowledge Service Industry and Related Employment Opportunity Estimation in the Seoul Metropolitan Area (서울대도시권 지식서비스산업의 입지적 특성과 관련 업종별 고용기회 예측)

  • Park, So Hyun;Lee, Keumsook
    • Journal of the Economic Geographical Society of Korea
    • /
    • v.19 no.4
    • /
    • pp.694-711
    • /
    • 2016
  • This study analyzes the spatial characteristics of knowledge industry which has shown relatively rapid growth in the low-growth economy situation in recent years. In particular, we catch hold of the locational characteristics of the knowledge service industry which occupies the highest ratio by professional-expert jobs favoured by young generations, as well as estimate their occupational employment opportunities. By applying Location Quotient(LQ) and LISA, we reveal the spatial distribution patterns of publishing business, information service business and education service business in the Seoul Metropolitan area, and examine the changes in the spatial patterns during the last ten years. In order to understand the socio-economic factors which explain their locations, we apply the stepwise multiple regression analysis. Furthermore, we predict the changes distribution of Knowledge service industrial employment by applying Markov Chain Model. As the result, we found their clusters at the specific locations, while there is the significant variations in the socio-economic variables related their locations respectively. The related job opportunities of the knowledge service businesses in the Seoul Metropolitan area are predicted steady growth trend for the next four years, even though dull or stagnant trend is expected for other industries. This study provides basic resources to the planning for young generation employment problem.

Throughput analysis of packet applied to the transmission probability for CSMA/CA protocol in wireless LAN (CSMA/CA에 적합한 전송확률을 고려한 무선 LAN의 패킷 처리율 분석)

  • Ha, Eun-Sil
    • Journal of Internet Computing and Services
    • /
    • v.10 no.1
    • /
    • pp.51-61
    • /
    • 2009
  • This paper analyzes the throughput of DCF protocol at the MAC layer in the 802.11a wireless LAN. The throughput of DCF protocol is related on probability of backoff, depends on retransmission of each terminal. This paper applied to nonmarcov discrete model for each terminal BER in the base station versus the packet throughput is progressing with the data rate of 6,12,24,54 Mbps, We find the fact that the less the data rate be the higher the throughput. We also find from the throughput calculation by means of traffic intensity in OFDM wireless LAN.

  • PDF

Implementation of the Agent using Universal On-line Q-learning by Balancing Exploration and Exploitation in Reinforcement Learning (강화 학습에서의 탐색과 이용의 균형을 통한 범용적 온라인 Q-학습이 적용된 에이전트의 구현)

  • 박찬건;양성봉
    • Journal of KIISE:Software and Applications
    • /
    • v.30 no.7_8
    • /
    • pp.672-680
    • /
    • 2003
  • A shopbot is a software agent whose goal is to maximize buyer´s satisfaction through automatically gathering the price and quality information of goods as well as the services from on-line sellers. In the response to shopbots´ activities, sellers on the Internet need the agents called pricebots that can help them maximize their own profits. In this paper we adopts Q-learning, one of the model-free reinforcement learning methods as a price-setting algorithm of pricebots. A Q-learned agent increases profitability and eliminates the cyclic price wars when compared with the agents using the myoptimal (myopically optimal) pricing strategy Q-teaming needs to select a sequence of state-action fairs for the convergence of Q-teaming. When the uniform random method in selecting state-action pairs is used, the number of accesses to the Q-tables to obtain the optimal Q-values is quite large. Therefore, it is not appropriate for universal on-line learning in a real world environment. This phenomenon occurs because the uniform random selection reflects the uncertainty of exploitation for the optimal policy. In this paper, we propose a Mixed Nonstationary Policy (MNP), which consists of both the auxiliary Markov process and the original Markov process. MNP tries to keep balance of exploration and exploitation in reinforcement learning. Our experiment results show that the Q-learning agent using MNP converges to the optimal Q-values about 2.6 time faster than the uniform random selection on the average.

Long-Term Arrival Time Estimation Model Based on Service Time (버스의 정차시간을 고려한 장기 도착시간 예측 모델)

  • Park, Chul Young;Kim, Hong Geun;Shin, Chang Sun;Cho, Yong Yun;Park, Jang Woo
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.6 no.7
    • /
    • pp.297-306
    • /
    • 2017
  • Citizens want more accurate forecast information using Bus Information System. However, most bus information systems that use an average based short-term prediction algorithm include many errors because they do not consider the effects of the traffic flow, signal period, and halting time. In this paper, we try to improve the precision of forecast information by analyzing the influencing factors of the error, thereby making the convenience of the citizens. We analyzed the influence factors of the error using BIS data. It is shown in the analyzed data that the effects of the time characteristics and geographical conditions are mixed, and that effects on halting time and passes speed is different. Therefore, the halt time is constructed using Generalized Additive Model with explanatory variable such as hour, GPS coordinate and number of routes, and we used Hidden Markov Model to construct a pattern considering the influence of traffic flow on the unit section. As a result of the pattern construction, accurate real-time forecasting and long-term prediction of route travel time were possible. Finally, it is shown that this model is suitable for travel time prediction through statistical test between observed data and predicted data. As a result of this paper, we can provide more precise forecast information to the citizens, and we think that long-term forecasting can play an important role in decision making such as route scheduling.

Modeling and Performance Analysis of Communication Channels for Multimedia System (멀티미디어 시스템의 통신 채널 모델링 및 성능분석)

  • Bang Suk-Yoon;Ro Cheul-Woo
    • The Journal of the Korea Contents Association
    • /
    • v.5 no.1
    • /
    • pp.147-155
    • /
    • 2005
  • In this paper, communication channels for the transmission of multimedia packets are modeled and evaluated. The multimedia packet traffic characterized by on-off and MMPP process for voice and data, respectively, dynamic channel allocation, queueing of data packets due to unavailability of channels and dropping of queued data packets over timeout, and guard channel for voice packets are modeled. The performance indices adopted in the evaluation of SRN model includes blocking and dropping probabilities. The SRN uses rewards concepts instead of the complicate numerical analysis required for the Markov chain. It is shown that our SRN modeling techniques provide an easier way to carry out performance analysis.

  • PDF

HMM-based Motion Recognition with 3-D Acceleration Signal (3차원 가속도 데이터를 이용한 HMM 기반의 동작인식)

  • Kim, Sang-Ki;Park, Gun-Hyuk;Jeon, Seok-Hee;Yim, Sung-Hoon;Han, Gab-Jong;Choi, Seung-Moon;Choi, Seung-Jin
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.15 no.3
    • /
    • pp.216-220
    • /
    • 2009
  • In this paper we propose a motion recognition method for handheld controller 3-D acceleration signals, generated by 3 axis accelerometer in the controller, are transmitted to the computer by Bluetooth communication. We extract motion segments from continuous acceleration signals and apply to each motion model, which is trained in training phase. Hidden Markov Model was used to model each motion. We applied proposed method to three motion sets, the recognition result was good enough to practical use.

Efficient Bayesian Inference on Asymmetric Jump-Diffusion Models (비대칭적 점프확산 모형의 효율적인 베이지안 추론)

  • Park, Taeyoung;Lee, Youngeun
    • The Korean Journal of Applied Statistics
    • /
    • v.27 no.6
    • /
    • pp.959-973
    • /
    • 2014
  • Asset pricing models that account for asymmetric volatility in asset prices have been recently proposed. This article presents an efficient Bayesian method to analyze asset-pricing models. The method is developed by devising a partially collapsed Gibbs sampler that capitalizes on the functional incompatibility of conditional distributions without complicating the updates of model components. The proposed method is illustrated using simulated data and applied to daily S&P 500 data observed from September 1980 to August 2014.