• 한국CDE학회논문집
• /
• 제16권4호
• /
• pp.277-284
• /
• 2011

In tangible augmented reality (AR) environments for virtual prototyping, the user interacts with virtual products by manipulating tangible objects with his or her hands, but the user often encounter awkward situations in which his or her hands are occluded by augmented virtual objects, which reduces both immersion and ease of interaction. In this paper, we present how to resolve such hand region occlusion in order to enhance natural interaction and immersive visualization. In the AR environment considered, we use two types (product-type and pointer-type) of tangible objects for tangible user interaction with a virtual product of interest. Holding the tangible objects with his or her hands, the user can create input events by touching specified regions of the product-type tangible object with the pointer-type tangible object. We developed a method for resolving hand region occlusion frequently arising during such user interaction, It first detect hand region in a real image and refines the rendered image of the virtual object by subtracting the hand region from the rendered image, Then, it superimposes the refined image onto the real image to obtain an image in which the occlusion is resolved. Incorporated into tangible AR interaction for virtual prototyping of handheld products such as cellular phones and MP3 players, the method has been found by a preliminary user study that it is not only useful to improve natural interaction and immersive visualization of virtual products, but also helpful for making the users experience the products' shapes and functions better.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제4권4호
• /
• pp.618-632
• /
• 2010

This paper presents a novel approach to control the augmented reality (AR) objects robustly in a marker-less AR system by fingertip tracking and hand pattern recognition. It is known that one of the promising ways to develop a marker-less AR system is using human's body such as hand or face for replacing traditional fiducial markers. This paper introduces a real-time method to manipulate the overlaid virtual objects dynamically in a marker-less AR system using both hands with a single camera. The left bare hand is considered as a virtual marker in the marker-less AR system and the right hand is used as a hand mouse. To build the marker-less system, we utilize a skin-color model for hand shape detection and curvature-based fingertip detection from an input video image. Using the detected fingertips the camera pose are estimated to overlay virtual objects on the hand coordinate system. In order to manipulate the virtual objects rendered on the marker-less AR system dynamically, a vision-based hand control interface, which exploits the fingertip tracking for the movement of the objects and pattern matching for the hand command initiation, is developed. From the experiments, we can prove that the proposed and developed system can control the objects dynamically in a convenient fashion.

• Current Optics and Photonics
• /
• 제1권6호
• /
• pp.642-648
• /
• 2017

Involuntary hand tremor has been a serious challenge in micromanipulation tasks and thus draws a significant amount of attention from related fields. To minimize the effect of the hand tremor, a variety of mechanically assistive solutions have been proposed. However, approaches increasing human awareness of their own hand tremor have not been extensively studied. In this paper, a head mount display based virtual reality (VR) system to increase human self-awareness of hand tremor is proposed. It shows a user a virtual image of a handheld device with emphasized hand tremor information. Provided with this emphasized tremor information, we hypothesize that subjects will control their hand tremor more effectively. Two methods of emphasizing hand tremor information are demonstrated: (1) direct amplification of tremor and (2) magnification of virtual object, in comparison to the controlled condition without emphasized tremor information. A human-subject study with twelve trials was conducted, with four healthy participants who performed a task of holding a handheld gripper device in a specific direction. The results showed that the proposed methods achieved a reduced level of hand tremor compared with the control condition.

• 한국게임학회 논문지
• /
• 제17권6호
• /
• pp.113-120
• /
• 2017

최근 가상현실 기술의 발전으로 가상의 3D 객체와 자연스러운 상호작용이 가능하도록 하는 사용자 친화적인 손 제스처 인터페이스에 대한 연구가 활발히 진행되고 있다. 그러나 대부분의 연구는 단순하고 적은 종류의 손 제스처만 지원되고 있는 실정이다. 본 논문은 가상환경에서 3D 객체와 보다 직관적인 방식의 손 제스처 인터페이스 방법을 제안한다. 손 제스처 인식을 위하여 먼저 전처리 과정을 거친 다양한 손 데이터를 이진 결정트리로 1차 분류를 한다. 분류된 데이터는 리샘플링을 한 다음 체인코드를 생성하고 이에 대한 히스토그램으로 특징 데이터를 구성한다. 이를 기반으로 학습된 MCSVM을 통해 2차 분류를 수행하여 제스처를 인식한다. 본 방법의 검증을 위하여 3D 블록을 손 제스처를 통하여 조작하는 'Virtual Block'이라는 게임을 구현하여 실험한 결과 16개의 제스처에 대해 99.2%의 인식률을 보였으며 기존의 인터페이스보다 직관적이고 사용자 친화적임을 알 수 있었다.

• 한국감성과학회:학술대회논문집
• /
• 한국감성과학회 2003년도 춘계학술대회 논문집
• /
• pp.84-89
• /
• 2003

The virtual reality(VR) technology can provide various stimuli, including, visual and auditory stimuli, simultaneously in the virtual environment and encourage the user to interact. Virtual reality is a set of computer technologies, which when combined, provide an interactive interface to a computer generated world. In this world the subject can see, hear and navigate in a dynamically changing environment in which he participates as an active player, by modifying the environment according to his will. Moreover, the subject can get a feeling for the virtual environment in much the same way as one feels real life situations. In the real world, a plethora of information from various modalities may be in conflict, and modulate each other to form an illusion. In this study we investigated whether a tactile illusion on a real hand could be evoked by a virtual stimulus, the time required to generate this illusion and its duration. This study shows that the illusion occurred, and that was correlated with presence score in the virtual environment.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2001년도 ICCAS
• /
• pp.89.3-89
• /
• 2001

Recently computer graphic technology has achieved remarkable development. Applications of this technology to various fields are expected. In this study, one application of computer graphics to the medical field is shown. We developed a rehabilitation system of hand manipulation using virtual reality aiming to offer enjoyable rehabilitation training to physically handicapped people with upper limb disabilities. This rehabilitation system generates training environments for upper limbs, such as moving balls in virtual space of computer. And by using data glove as a sophisticated input device, a user can manipulate objects in virtual space by his hand. By using this rehabilitation system, a user can have rehabilitation training under various conditions without feeling tedious.

• 한국게임학회 논문지
• /
• 제10권2호
• /
• pp.49-56
• /
• 2010

본 논문에서는 사용자의 손을 인식하여 가상현실 게임 환경에서 가상의 손을 제어할 수 있는 방법을 제안한다. 카메라를 통해 획득한 영상을 통하여 사용자의 손 이동과 가리키는 방향에 대한 정보를 획득하고 이를 이용하여 가상의 손을 게임 화면에 나타낸다. 사용자의 손의 움직임은 가상의 손이 물건을 선택하고 옮기도록 하는 입력 인터페이스로 활용할 수 있다. 제안하는 방법은 비전 기반 손 인식 기법으로 먼저 RGB 컬러영역에서 HSV 컬러영역으로 입력영상을 변환하고 H, S 값에 대한 이중 임계값과 연결 요소 분석을 이용하여 손 영역을 분할한다. 다음으로 분할된 영역에 대하여 0, 1차 모멘트를 적용하고 이를 이용하여 손 영역에 대한 무게 중심점을 구한다. 구해진 무게중심점은 손의 중심에 위치하게 되며, 분할된 손 영역의 픽셀 집합 중 무게중심점으로부터 멀리 떨어진 픽셀들을 손가락의 끝점으로 인식한다. 마지막으로 무게중심점과 손 끝점에 대한 벡터를 통하여 손의 축을 구한다. 인식 안정성과 성능을 높이기 위하여 누적 버퍼를 이용한 떨림 보정과 경계상자를 이용한 처리 영역을 설정하였다. 본 논문의 방법은 기존의 비전 기술을 통한 손 인식 방법들에 비하여 별도의 착용 마커를 두지 않고 실시간으로 처리가 가능하다. 다양한 입력 영상들에 대한 실험 결과는 제안 기법으로 정확하게 손을 분할하고, 안정된 인식 결과를 고속으로 처리할 수 있음을 보여주었다.

• 한국디지털건축인테리어학회논문집
• /
• 제6권2호
• /
• pp.17-23
• /
• 2006

The purpose of this study was to investigate how student felt the strengths and shortness of presentation methods for formation of interior spaces. For this study, the process of the interior architecture design class was divided into three stages: the programming. the design development, and the design completion. In the design development stage, students used presentation methods: hand sketch, scale model, computer modeling, and virtual realty. The strengths of hand sketch was that quick expression. Models provided three-dimensional feelings. Computer modelling provide realistic color and texture. Virtual reality provided three-dimensional immersion and real scale. It is effective that students collect brain storm images using quick hand sketch in the beginning of design development stage. After that, they compose interior spaces in study models with small scale. Watching the models, they design details of spaces by using hand sketch and computer modelling. Using virtual reality, they can check the scale and circulation. Finally, they complete computer modelling by texture mapping and check the final design in virtual reality.

• 대한통합의학회지
• /
• 제11권1호
• /
• pp.53-62
• /
• 2023

Purpose : This study evaluated the effects of transcranial direct current stimulation and a virtual reality program on the depression, hand functions, cognitive function, and activities of daily living of patients with mild cognitive impairment by dividing 20 patients with mild cognitive impairment and depression. The 20 patients were divided into a treatment group (transcranial direct current stimulation + a virtual reality program) and a control group (placebo transcranial direct current stimulation + a placebo virtual reality program). Methods : This study allocated ten subjects to the treatment group and ten subjects to the control group. The treatment was given five times per week for six weeks (30 sessions), and each session was 30 minutes. This study screened depression by using SGDS-K, a short geriatric depression scale, to examine depression before and after treatment intervention. This study also used the box and block test, NCSE, and FIM to evaluate hand functions, cognitive function, and activities of daily living, respectively. Results : The results showed that depression significantly decreased, hand functions significantly increased, cognitive function significantly improved, and activities of daily living significantly increased after intervention in the treatment and control groups. The magnitude of changes in depression, hand functions, cognitive function, and activities of daily living was significantly different between the two groups after intervention (p>.05). Conclusion : The results showed that the application of transcranial direct current stimulation and a virtual reality program could improve cognitive function, hand functions, and activities of daily living by decreasing depression. Therefore, it can be concluded that the simultaneous application of transcranial direct current stimulation and a virtual reality program is an intervention method, which can be applied for decreasing depression, enhancing hand functions, improving cognitive function, and increasing activities of daily living in patients with mild cognitive impairment.

• 한국CDE학회논문집
• /
• 제21권1호
• /
• pp.20-30
• /
• 2016

Recently immersive virtual reality (VR) becomes popular due to the advanced development of I/O interfaces and related SWs for effectively constructing VR environments. In particular, natural and intuitive manipulation of 3D virtual objects is still considered as one of the most important user interaction issues. This paper presents a comparative study on the manipulation and interaction of 3D virtual objects using different interfaces and interactions in three VR environments. The comparative study includes both quantitative and qualitative aspects. Three different experimental setups are 1) typical desktop-based VR using mouse and keyboard, 2) hand gesture-supported desktop VR using a Leap Motion sensor, and 3) immersive VR by wearing an HMD with hand gesture interaction using a Leap Motion sensor. In the desktop VR with hand gestures, the Leap Motion sensor is put on the desk. On the other hand, in the immersive VR, the sensor is mounted on the HMD so that the user can manipulate virtual objects in the front of the HMD. For the quantitative analysis, a task completion time and success rate were measured. Experimental tasks require complex 3D transformation such as simultaneous 3D translation and 3D rotation. For the qualitative analysis, various factors relating to user experience such as ease of use, natural interaction, and stressfulness were evaluated. The qualitative and quantitative analyses show that the immersive VR with the natural hand gesture provides more intuitive and natural interactions, supports fast and effective performance on task completion, but causes stressful condition.