• 로봇학회논문지
• /
• 제8권3호
• /
• pp.197-205
• /
• 2013

This paper presents a robotic system that provides telepresence to the visually impaired by combining real-time haptic rendering with multi-modal interaction. A virtual-proxy based haptic rendering process using a RGB-D sensor is developed and integrated into a unified framework for control and feedback for the telepresence robot. We discuss the challenging problem of presenting environmental perception to a user with visual impairments and our solution for multi-modal interaction. We also explain the experimental design and protocols, and results with human subjects with and without visual impairments. Discussion on the performance of our system and our future goals are presented toward the end.

• 융합신호처리학회논문지
• /
• 제14권4호
• /
• pp.212-216
• /
• 2013

As virtual reality technologies are advanced rapidly, how to render 3D objects across modalities is becoming an important issue. This study is therefore aimed to investigate human discriminability on the curvature of 3D polygonal surfaces with focusing on the vision and touch senses because they are most dominant when explore 3D shapes. For the study, we designed a psychophysical experiment using signal detection theory to determine curvature discrimination for three conditions: haptic only, visual only, and both haptic and visual. The results show that there is no statistically significant difference among the conditions although the threshold in the haptic condition is the lowest. The results also indicate that rendering using both visual and haptic channels could degrade the performance of discrimination on a 3D global shape. These results must be considered when a multimodal rendering system is designed in near future.

• 한국정밀공학회:학술대회논문집
• /
• 한국정밀공학회 2004년도 추계학술대회 논문집
• /
• pp.737-741
• /
• 2004

A mobile robot system is developed which is remotely controlled by a haptic master called ‘PHANTOM’. The mobile robot has 4 ultrasonic sensors and single CCD camera which detects the distance from a mobile robot to obstacles in the environment and sends this information to a haptic master. For more convenient remote control, haptic rendering process is performed like viscosity forces and obstacle avoidance forces. In order to show the effectiveness of the developed system, we experiment that the mobile robot runs through the maze and the time is checked to complete the path of the maze with/without the haptic information. Through this repeated experiments, haptic information proves to be useful for remote control of a mobile robot.

• 한국인터넷방송통신학회논문지
• /
• 제18권3호
• /
• pp.35-41
• /
• 2018

본 논문에서는 햅틱 렌더링을 위한 동영상의 장면을 정의하고 그 중 정지 상태의 객체와 단일 객체가 충돌하는 상황에 대한 햅틱 렌더링 알고리즘을 제안한다. 객체의 움직임을 크게 네 가지 상황으로 분류하였으며 동영상에서 쉽게 볼 수 있는 장면들을 활용하였다. 제안하는 알고리즘은 움직임 예측과 객체 추적을 활용하여 객체의 방향 변화와 모양 변화를 검출함으로써 햅틱 렌더링을 하기에 적합한 프레임인지 판별할 수 있도록 하였다. 알고리즘 실행을 통해 샘플 동영상에서 총 13개의 프레임을 추출하였으며 해당 프레임이 재생되는 시간을 계산하였다. 햅틱 편집 프로그램을 통해 상황에 알맞은 햅틱 생성 파형을 추가함으로써 계산된 재생 시간에 햅틱 효과가 나타나는 것을 확인하였다.

• International Journal of CAD/CAM
• /
• 제8권1호
• /
• pp.41-44
• /
• 2009

This paper describes an implementation of virtual teeth modeling for a haptic dental simulation. The system allows dental students to practice dental procedures with realistic tactual feelings. The system requires fast and stable haptic rendering and volume modeling techniques working on the virtual tooth. In our implementation, a volumetric implicit surface is used for intuitive shape modification without topological constraints and haptic rendering. The volumetric implicit surface is generated from input geometric model by using a closest point transformation algorithm. And for visual rendering, we apply an adaptive polygonization method to convert volumetric teeth model to geometric model. We improve our previous system using new octree design to save memory requirement while increase the performance and visual quality.

• International Journal of CAD/CAM
• /
• 제9권1호
• /
• pp.93-102
• /
• 2010

Shaping realistic hairstyles for digital characters is a difficult, long and tedious task. The lack of appropriate interaction metaphors enabling efficient and simple, yet accurate hair modeling further aggravates the situation. This paper presents 3D interaction metaphors for modeling virtual hair using haptic interfaces. We discuss user tasks, ergonomic aspects, as well as haptics-based styling and fine-tuning tools on an experimental prototype. In order to achieve faster haptic rates with respect to the hair simulation and obtain a transparent rendering, we adapt our simulation models to comply with the specific requirements of haptic hairstyling actions and decouple the simulation of the hair strand dynamics from the haptic rendering while relying on the same physiochemical hair constants. Besides the direct use of the discussed interaction metaphors in the 3D modeling area, the presented results have further application potential in hair modeling facilities for the entertainment industry and the cosmetic sciences.

• 한국HCI학회:학술대회논문집
• /
• 한국HCI학회 2008년도 학술대회 1부
• /
• pp.65-71
• /
• 2008

본 논문에서는 협업 가상 환경이 보다 더 높은 현실감을 제공하도록 고해상도 tiled-display 에 기반을 둔 촉감 협업 시스템의 구조 및 구현 방법을 제안한다. 또한 이 시스템에서 QoE (quality of experience)의 수준을 높일 수 있는 기법을 제안한다. 촉각 기반 시스템과 고해상도 tiled-display를 위한 시스템은 각각 컴퓨터의 자원에 대한 요구조건이 있다. 촉각 시스템의 요구조건은 햅틱 디바이스의 햅틱 렌더링 반복 속도이다. 1kHz 이상의 렌더링 속도를 만족시키지 못하면 햅틱 장비는 불안정해지며 촉감 기반 협업을 방해한다. 그리고 tiled-display는 동영상을 디스플레이하기 위해서 일정 속도 이상으로 새로운 화면을 갱신 시켜야 한다. 일반적으로 햅틱 시스템과 tiled-display 시스템을 각각 사용하면 각각의 요구들을 만족시킬 수 있지만 두 시스템을 함께 사용하면 컴퓨터의 지원 부족에 의해 전체 시스템 성능이 저하되고 사용자의 QoE를 만족시키기 어려워진다. 따라서 본 논문에서는 QoE 를 높일 수 있는 구조로 tiled-display 기반 햅틱 협업 시스템을 구현하고 또한 상황에 따른 사용자의 감각적 우선순위를 파악하여 디스플레이 업데이트 주기와 햅틱 렌더링 주기를 선택적으로 조율함으로써 제한된 지원을 효율적으로 이용하고 시스템 전체의 QoE를 높일 수 있는 기법을 제안한다.

• 대한전기학회논문지:시스템및제어부문D
• /
• 제50권5호
• /
• pp.211-217
• /
• 2001

In this paper, we have developed the 6 DOF force display system to be based on the single PC. The system is composed of the force display device, the force reflecting rendering algorithm and the high-speed controller. The previous systems had a problem, that must adopt high performance workstation or 2-PC in order to control the graphics speedily and stably. In this paper, it is possible to improve the problem as to develop its exclusive controller and new rendering algorithm. The proposed new rendering algorithm is based on the Proxy algorithm, which can convert information of the position, the velocity, and the haptic information into the force-data. Especially, as to use the proxy algorithm, we can construct dynamical virtual-environment with the elasticity, the viscosity, the mass, and the friction force. As the result of the experiment, we found that our system has much superior characteristics than some other haptic interfaces, because it can control of 30,000 polygon model constructed virtual object with 1[kHz] haptic interrupt cycle and 20[Hz] graphic interrupt cycle in the single PC based system.

• 한국가시화정보학회지
• /
• 제15권1호
• /
• pp.32-40
• /
• 2017

Interaction between fluid and a rigid object is frequently observed in everyday life. However, it is difficult to simulate their interaction as the medium and the object have different representations. One of the challenging issues arises especially in handling deformation of the object visually as well as rendering haptic feedback. In this paper, we propose a real-time simulation technique for multimodal interaction between particle-based fluids and soluble solids. We have developed the dissolution behavior model of solids, which is discretized based on the idea of smoothed particle hydrodynamics, and the changes in physical properties accompanying dissolution is immediately reflected to the object. The user is allowed to intervene in the simulation environment anytime by manipulating the solid object, where both visual and haptic feedback are delivered to the user on the fly. For immersive visualization, we also adopt the screen space fluid rendering technique which can balance realism and performance.

• 로봇학회논문지
• /
• 제15권4호
• /
• pp.316-322
• /
• 2020

Endoscopic spine surgery is an advanced surgical technique for spinal surgery since it minimizes skin incision, muscle damage, and blood loss compared to open surgery. It requires, however, accurate positioning of an endoscope to avoid spinal nerves and to locate the endoscope near the target disk. Before the insertion of the endoscope, a guide needle is inserted to guide it. Also, the result of the surgery highly depends on the surgeons' experience and the patients' CT or MRI images. Thus, for the training, a number of haptic simulators for spinal needle insertion have been developed. But, still, it is difficult to be used in the medical field practically because previous studies require manual segmentation of vertebrae from CT images, and interaction force between the needle and soft tissue has not been considered carefully. This paper proposes AI-based automatic vertebrae CT-image segmentation and haptic rendering method using the proposed need-tissue interaction model. For the segmentation, U-net structure was implemented and the accuracy was 93% in pixel and 88% in IoU. The needle-tissue interaction model including puncture force and friction force was implemented for haptic rendering in the proposed spinal needle insertion simulator.