• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.508-511
• /
• 2009

In Interactive Storytelling, storyline is developed according to the user's interaction. Diffrerent from linear, fixed storytelling, users may select an event or make decisions which affect on the story plotting. Therefore user's feeling of immersion and interest may be greatly enhanced. In this paper, we used markers and multi-touch pad for user's interaction for interactive storytelling. Users could present his/her level of interest and provide feedback through markers and multi-touch pad, through which storyline was differently developed.

• Journal of Korea Multimedia Society
• /
• v.16 no.6
• /
• pp.720-734
• /
• 2013

In this paper, we suggest an augmented reality authoring tool system that users can easily make augmented reality contents using hand gesture and marker-based interaction methods. The previous augmented reality authoring tools are focused on augmenting a virtual object and to interact with this kind of augmented reality contents, user used the method utilizing marker or sensor. We want to solve this limited interaction method problem by applying marker based interaction method and gesture interaction method using depth sensing camera, Kinect. In this suggested system, user can easily develop simple form of marker based augmented reality contents through interface. Also, not just providing fragmentary contents, this system provides methods that user can actively interact with augmented reality contents. This research provides two interaction methods, one is marker based method using two markers and the other is utilizing marker occlusion. In addition, by recognizing and tracking user's bare hand, this system provides gesture interaction method which can zoom-in, zoom-out, move and rotate object. From heuristic evaluation about authoring tool and compared usability about marker and gesture interaction, this study confirmed a positive result.

• The Optical Journal
• /
• s.123
• /
• pp.57-57
• /
• 2009

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2010.05a
• /
• pp.617-620
• /
• 2010

최근 증강현실(Augmented Reality)에 대한 관심이 증대되고, 이와 관련된 기술들이 발전함에 따라서 증강현실이 다양한 분야에 적용하려는 시도가 늘어나고 이에 대한 활용에도 기대가 모아지고 있다. 본 논문에서는 증강현실을 이용하여 유아용 학습 콘텐츠를 제작하고 구현하였다. 구현한 콘텐츠는 가상세계와 실제세계의 정확한 상호작용을 위하여 도서의 표지에 있는 마커에 유아에게 친숙한 캐릭터를 띄우므로 집중력을 높임과 동시에 학습보조자가 원활하게 콘텐츠를 사용할 수 있도록 하였다. 또한 콘텐츠의 페이지마다 여러 마커를 동시에 두어 콘텐츠의 일부분이 장애물에 의해 가려지더라도 원활한 마커 인식을 할 수 있도록 하였고 상황에 맞게 3D 모델(2D, 동영상 포함)이 증강되는 동시에 사운드가 재생되도록 하여 학습에서의 현존감과 몰입을 높여 학습효과를 극대화하는 결과를 얻을 수 있도록 제작하였다.

• Proceedings of the Korea Multimedia Society Conference
• /
• 2003.05b
• /
• pp.559-562
• /
• 2003

본 논문에서는 실시간 마커프리 모션캡쳐 시스템으로 캡쳐된 동작자의 Root와 End-effector 위치 데이터를 이용하여 가상 캐릭터의 동작을 생성하는 방법에 0해 기술한다. 동작자의 신체중심이 되는 Root와 머리, 손, 발과 같은 End-effector의 위치 데이터는 동작자의 전방 좌, 우에 위치한 동기화된 2대의 컬러 CCD 카메라를 이용하여 3차원 위치를 캡쳐한다. 영상으로부터 추출되지 않은 중간관절의 위치를 생성하기 위해 Root와 End-effector의 3차원 위치값들을 IK( Inverse Kinematics) 알고리듬에 적용하고, 생성된 위치값들에 다양한 신체의 제약조건을 고려하여 정밀하게 계산한다. 이러한 과정을 거치므로 서 20개 관절의 위치값을 생성할 수 있으며, 생성된 관절의 위치값을 가상 캐릭터에 적용하므로 서 캐릭터의 움직임을 실시간으로 생성할 수 있다.

• Journal of Korea Multimedia Society
• /
• v.16 no.2
• /
• pp.254-268
• /
• 2013

This paper presents an augmented reality (AR) based rehabilitation exercise system to enhance the motor function of the hands for the paretic/hemi-paretic patient. The existing rehabilitation systems rely on mechanical apparatus for palsy rehabilitation, but we aim to use the rehabilitation system at home with easy configuration and minimized equipment by the computer vision based approach. The proposed method evaluates the interaction status of the fingertip action by using the position and the contact of the fingertip markers. We obtain the 2D positions of the fingertip markers from a single camera, and then transform the 3D positions from the calibrated camera space by using an ARToolKit marker. We adopt simple geometric calculation by the conversion of the 2D interest points into the 3D interaction points for the simple interactive task in AR environment. Some experimental results show that the proposed method is practical and simply applicable to the applications with personal AR interaction.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.11 no.3
• /
• pp.93-98
• /
• 2011

In this paper, we propose a game type cognitive rehabilitation system using marker-based augmented reality system for intelligence development of user. Existing cognitive rehabilitation with the help of others, or a keyboard or mouse operation required to relieve the discomfort, the marker card only control it led and is advanced the method which it applied. As a result, obtained through the camera calibration for image processing, and a Augmented Reality as well as mark detection. In this paper we presented a complete rotation of the model after checking through the whole form, through a combination of multiple markers by completing the interactive objects proceed with the rehabilitation process in a manner required by the target of interest to human rehabilitation and treatment.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.493-496
• /
• 2009

Many AR (Augmented Reality) applications have been interested in a marker-less tracking since the tracking methods give camera poses without attaching explicit markers. In this paper, we propose a new marker-less page recognition and tracking algorithm for an AR book application such as DigilogBook. The proposed method only requires orthogonal images of pages, which need not to be trained for a long time, and the algorithm works in real-time. The page recognition is done in two steps by using SIFT (Scale Invariant Feature Transform) descriptors and the comparison evaluation function. And also, the method provides real-time tracking with 25fps ~ 30fps by separating the page recognition and the frame-to-frame matching into two multi-cores. The proposed algorithm will be extended to various AR applications that require multiple objects tracking.

• Journal of Internet Computing and Services
• /
• v.15 no.3
• /
• pp.11-19
• /
• 2014

The natural user interface/experience (NUI/NUX) is used for the natural motion interface without using device or tool such as mice, keyboards, pens and markers. Up to now, typical motion recognition methods used markers to receive coordinate input values of each marker as relative data and to store each coordinate value into the database. But, to recognize accurate motion, more markers are needed and much time is taken in attaching makers and processing the data. Also, as NUI/NUX framework being developed except for the most important intuition, problems for use arise and are forced for users to learn many NUI/NUX framework usages. To compensate for this problem in this paper, we didn't use markers and implemented for anyone to handle it. Also, we designed multi-modal NUI/NUX framework controlling voice, body motion, and facial expression simultaneously, and proposed a new algorithm of mouse operation by recognizing intuitive hand gesture and mapping it on the monitor. We implement it for user to handle the "hand mouse" operation easily and intuitively.

• Proceedings of the Korea Multimedia Society Conference
• /
• 2000.04a
• /
• pp.474-477
• /
• 2000

최근 3D 애니메이션 , 영화 특수효과 그리고 게임제작시 모션 캡처 시스템(Motion Capture System)을 통하여 실제 인간의 동작 및 표정을 수치적으로 측정해내어 이를 실제 애니메이션에 직접 사용함으로써 막대한 작업시간 및 인력 드리고 자본을 획기적으로 줄이고 있다. 그러나 기존의 모션 캡처 시스템은 고속 카메라를 이용함으로써 가격이 고가이고 움직임 추적에서도 여러 가지 문제점을 가지고 있다. 본 논문에서는 일반 저가의 카메라와 신경회로망 및 영상처리를 이용하여 얼굴 애니메이션용 모션 캡처 시스템에 적용할 수 있는 경제적이고 효율적인 얼굴 움직임 추적 기법을 제안한다.