• Title/Summary/Keyword: 마르코프 게임

Search Result 8, Processing Time 0.022 seconds

Learning Multi-Character Competition in Markov Games (마르코프 게임 학습에 기초한 다수 캐릭터의 경쟁적 상호작용 애니메이션 합성)

  • Lee, Kang-Hoon
    • Journal of the Korea Computer Graphics Society
    • /
    • v.15 no.2
    • /
    • pp.9-17
    • /
    • 2009
  • Animating multiple characters to compete with each other is an important problem in computer games and animation films. However, it remains difficult to simulate strategic competition among characters because of its inherent complex decision process that should be able to cope with often unpredictable behavior of opponents. We adopt a reinforcement learning method in Markov games to action models built from captured motion data. This enables two characters to perform globally optimal counter-strategies with respect to each other. We also extend this method to simulate competition between two teams, each of which can consist of an arbitrary number of characters. We demonstrate the usefulness of our approach through various competitive scenarios, including playing-tag, keeping-distance, and shooting.

  • PDF

A Markov Game based QoS Control Scheme for the Next Generation Internet of Things (미래 사물인터넷을 위한 마르코프 게임 기반의 QoS 제어 기법)

  • Kim, Sungwook
    • Journal of KIISE
    • /
    • v.42 no.11
    • /
    • pp.1423-1429
    • /
    • 2015
  • The Internet of Things (IoT) is a new concept associated with the future Internet, and it has recently become a popular concept to build a dynamic, global network infrastructure. However, the deployment of IoT creates difficulties in satisfying different Quality of Service (QoS) requirements and achieving rapid service composition and deployment. In this paper, we propose a new QoS control scheme for IoT systems. The Markov game model is applied in our proposed scheme to effectively allocate IoT resources while maximizing system performance. The results of our study are validated by running a simulation to prove that the proposed scheme can promptly evaluate current IoT situations and select the best action. Thus, our scheme approximates the optimum system performance.

Human Primitive Motion Recognition Based on the Hidden Markov Models (은닉 마르코프 모델 기반 동작 인식 방법)

  • Kim, Jong-Ho;Yun, Yo-Seop;Kim, Tae-Young;Lim, Cheol-Su
    • Journal of Korea Multimedia Society
    • /
    • v.12 no.4
    • /
    • pp.521-529
    • /
    • 2009
  • In this paper, we present a vision-based human primitive motion recognition method. It models the reference motion patterns, recognizes a user's motion, and measures the similarity between the reference action and the user's one. In order to recognize a motion, we provide a pattern modeling method based on the Hidden Markov Models. In addition, we provide a similarity measurement method between the reference motion and the user's one using the editing distance algorithm. Experimental results show that the recognition rate of ours is above 93%. Our method can be used in the motion recognizable games, the motion recognizable postures, and the rehabilitation training systems.

  • PDF

Implementation of Wavelet-based detector of Microcalcifications in Mammogram (맘모그램에서 마이크로캘시피케이션을 검출하기 위한 웨이블릿 검출기의 구현)

  • Han, Hui Il
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.38 no.4
    • /
    • pp.1-1
    • /
    • 2001
  • 본 논문에서는 웨이블릿 변환을 멀티스케일 매치 필터의 관점에서 해석하고, 이를 위하여 마르코프 랜덤 필드에 묻혀있는 가우시안 형태의 작은 물체를 검출하는 이론적 근거를 제시하며, 이의 응용으로 맘모그램에 존재하는 마이크로캘시피케이션을 검출하는 알고리즘을 제안한다. 검출하고자 하는 물체가 가우시안 형태이고 그 스케일이 웨이블릿 변환에 의해 계산된 것과 일치하며, 그 주변의 잡영이 마르코프 프로세스이면, LoG(Laplacian of Gaussian) 웨이블릿은 멀티스케일 매치 필터로 작용하며, 적절한 디테일 이미지를 단순히 이진화함으로써 최적의 검출기를 구현할 수 있다. 그런데, 마이크로캘시피케이션은 정확한 가우시안 형태를 갖지 않고, 게다가 맘모그램의 배경이미지도 마르코프 프로세스라는 가정에서 벗어난다. 이러한 불일치를 해결하기 위하여, 본 논문에서는 멀티스케일 웨이블릿 계수에서 추출한 특징벡터를 Hotelling observer에 입력하여 처리함으로써 이를 보상하고자 하였다.

Implementation of Wavelet-based detector of Microcalcifications in Mammogram (맘모그램에서 마이크로캘시피케이션을 검출하기 위한 웨이블릿 검출기의 구현)

  • Han, Hui-Il
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.38 no.4
    • /
    • pp.325-334
    • /
    • 2001
  • It is shown that the multiscale prewhitening matched filter for detecting Gaussian objects in Markov noise can be implemented by the undecimated wavelet transform with a biorthogonal spline wavelet. If the object to be detected is Gaussian shaped and its scale coincides with one of those computed by the wavelet transform, and if the background noise is truly Markov, then optimum detection is realized by thresholding the appropriate details image. Our detection algorithm is applied to the digitized mammograms for detecting microcalcifications. However, microcalcifications are not exactly Gaussian shaped and its background noise may not be Markov. In order to campensate for these discrepancy, Hotelling observer is employed, which is applied to feature vectors comprised of 3-octave wavelet coefficients.

  • PDF

Efficient Approximation of State Space for Reinforcement Learning Using Complex Network Models (복잡계망 모델을 사용한 강화 학습 상태 공간의 효율적인 근사)

  • Yi, Seung-Joon;Eom, Jae-Hong;Zhang, Byoung-Tak
    • Journal of KIISE:Software and Applications
    • /
    • v.36 no.6
    • /
    • pp.479-490
    • /
    • 2009
  • A number of temporal abstraction approaches have been suggested so far to handle the high computational complexity of Markov decision problems (MDPs). Although the structure of temporal abstraction can significantly affect the efficiency of solving the MDP, to our knowledge none of current temporal abstraction approaches explicitly consider the relationship between topology and efficiency. In this paper, we first show that a topological measurement from complex network literature, mean geodesic distance, can reflect the efficiency of solving MDP. Based on this, we build an incremental method to systematically build temporal abstractions using a network model that guarantees a small mean geodesic distance. We test our algorithm on a realistic 3D game environment, and experimental results show that our model has subpolynomial growth of mean geodesic distance according to problem size, which enables efficient solving of resulting MDP.

Hidden Markov Model for Gesture Recognition (제스처 인식을 위한 은닉 마르코프 모델)

  • Park, Hye-Sun;Kim, Eun-Yi;Kim, Hang-Joon
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.43 no.1 s.307
    • /
    • pp.17-26
    • /
    • 2006
  • This paper proposes a novel hidden Markov model (HMM)-based gesture recognition method and applies it to an HCI to control a computer game. The novelty of the proposed method is two-fold: 1) the proposed method uses a continuous streaming of human motion as the input to the HMM instead of isolated data sequences or pre-segmented sequences of data and 2) the gesture segmentation and recognition are performed simultaneously. The proposed method consists of a single HMM composed of thirteen gesture-specific HMMs that independently recognize certain gestures. It takes a continuous stream of pose symbols as an input, where a pose is composed of coordinates that indicate the face, left hand, and right hand. Whenever a new input Pose arrives, the HMM continuously updates its state probabilities, then recognizes a gesture if the probability of a distinctive state exceeds a predefined threshold. To assess the validity of the proposed method, it was applied to a real game, Quake II, and the results demonstrated that the proposed HMM could provide very useful information to enhance the discrimination between different classes and reduce the computational cost.

Game Interface using Robust Skin Color Detection (조명 변화에 강건한 피부색 검출을 사용한 게 임 인터페이스)

  • 장상수;박혜선;김항준
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2004.10b
    • /
    • pp.736-738
    • /
    • 2004
  • 최근 사용자의 제스처를 이용한 게임 시스템에 대한 연구가 많은 관심을 받고 있다. 사용자의 얼굴 및 손의 움직임을 이용하여 게임을 제어하기 위해서는 복잡한 배경 및 조명에 강건한 얼굴 및 손 영역의 추출이 필수적이다. 본 논문에서는 조명 변화에 강건한 피부색 검출을 이용한 게임 인터페이스를 제안한다. 이를 위해 제안된 시스템은 다음의 두 단계로부터 얼굴 및 손 영역을 추출한다. 먼저, 피부색과 유사한 물건들을 제거하기 위해 배경 영상과 현재 영상의 차영상으로부터 전경물체를 추출한다. 그 다음, 조명에 의한 깜박임이나 잡음을 줄이기 위해서 SCT 알고리즘을 이용하여 전경물체 영역 안에서 피부색 영역만을 정확하게 검출한다. 추출된 얼굴 및 손의 움직임으로부터 얻어지는 제스처는 은닉마르코프 모델을 사용하여 인식된다. 복잡한 환경에서 실험한 결과, 제안된 시스템은 정확한 피부색 영역 검출을 제공하고 이를 통한 보다 정확한 인식률을 제공할 수 있다는 것이 증명되었다.

  • PDF