• ETRI Journal
• /
• 제38권6호
• /
• pp.1085-1094
• /
• 2016

In this work, we present interactive automultiscopic content with mobile surface haptics for multimodal interaction. Our system consists of a 40-view automultiscopic display and a tablet supporting surface haptics in an immersive room. Animated graphics are projected onto the walls of the room. The 40-view automultiscopic display is placed at the center of the front wall. The haptic tablet is installed at the mobile station to enable the user to interact with the tablet. The 40-view real-time rendering and multiplexing technology is applied by establishing virtual cameras in the convergence layout. Surface haptics rendering is synchronized with three-dimensional (3D) objects on the display for real-time haptic interaction. We conduct an experiment to evaluate user experiences of the proposed system. The results demonstrate that the system's multimodal interaction provides positive user experiences of immersion, control, user interface intuitiveness, and 3D effects.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 2004년도 ICCAS
• /
• pp.1131-1135
• /
• 2004

In the virtual environment, force feedback to the human operator makes virtual experiences more realistic. However, the force feedback using active actuators such as motors can make the system active and sometimes unstable. To ensure the safe operation and enhance the haptic feeling, stability should be guaranteed. Both motors and brakes are commonly used for haptic device. A brake can generate a torque only against its rotation, but it is intrinsically stable. Consequently, motors and brakes are complementing each other. In this research, a two degree-of-freedom (DOF) haptic device equipped with both motors and brakes has been developed to provide better haptic effects. Each DOF is actuated by a pair of motor and brake. Modeling of the environment and the control method are needed to utilize both actuators. For various haptic effects, contact with the virtual wall and representation of friction effect are extensively investigated in this paper. It is shown that the hybrid haptic system is more suited to some applications than the motor-based active haptic system.

• Transactions on Control, Automation and Systems Engineering
• /
• 제4권1호
• /
• pp.2-8
• /
• 2002

This paper discusses haptic display for grasping a virtual object by two fingers. Much research has been done on fundamental analysis for stability of haptic display. But it is difficult to apply the results immediately to grasping situations by two fingers, since the studies usually deal with a single device and a single object and the fingertip force in grasping situations has two components, internal and external components. The conventional methods, which specify the coupling impedance at each contact point separately, have no other alternative but to specify the impedance for the sum of the internal and external components. So even if only the impedance for the external force should be changed, the impedance for the internal force is also changed at the same time. In this paper, a new method, in which the coupling impedance is specified separately for the internal and external forces, is proposed and the stability of the proposed method is discussed using passivity analysis for 1 -DOF(Degree-Of-Freedom) system. Finally, some experiments are performed to study the effects of the proposed method.

• 대한기계학회:학술대회논문집
• /
• 대한기계학회 2008년도 추계학술대회A
• /
• pp.1594-1599
• /
• 2008

Haptic rendering is a process that provides force feedback during interactions between a user and an object. This paper presents a haptic rendering technique for a telemanipulation system of deformable objects using image processing and physically based modeling techniques. The interaction forces between an instrument driven by a haptic device and a deformable object are inferred in real time based on a continuum mechanics model of the object, which consists of a boundary element model and ${\alpha}$ priori knowledge of the object's mechanical properties. Macro- and micro-scale experimental systems, equipped with a telemanipulation system and a commercial haptic display, were developed and tested using silicone (macro-scale) and zebrafish embryos (micro-scale). The experimental results showed the effectiveness of the algorithm in different scales: two experimental systems applied the same algorithm provided haptic feedback regardless of the system scale.

• 로봇학회논문지
• /
• 제8권3호
• /
• pp.156-163
• /
• 2013

This paper describes a flexible visuo-haptic display module. We have developed a flexible electro-active polymer (EAP) actuator and a thin flexible visual display with $3{\times}3$ array configuration via polymer technology. The flexible actuator consists of nine EAP cells vertically moving in response to change in their thickness. The flexible display uses polymer based optical waveguide allowing light to scatter only at specific area. The display film is transparent and identically designed to the array pattern to fit for the arrangement of actuator cells. A pressure sensor is installed under the integrated module. The performance of the actuator is proved to be sufficient for satisfying perceivable range of human touch sense. The integrated system can provide interactive haptic feedback such as key pressing, contact vibration sensations, and etc. in accordance with user input.

• 전자공학회논문지CI
• /
• 제48권2호
• /
• pp.1-8
• /
• 2011

본 논문에서는 시각장애인에게 점자 및 촉도(점자 그림)를 거의 실시간으로 촉각정보(촉각으로 인지할 수 있는 정보)로 변환하여 제공할 수 있는 햅틱 디스플레이 시스템을 제안한다. 제안한 시스템은 시각장애인에게 촉각정보를 전달하는 햅틱 디스플레이 장치와 점자 및 촉도 정보를 촉각신호로 변환하여 장치에 전달하는 장치 제어 소프트웨어 프로그램으로 구성된다. 제안한 시스템의 성능평가는 10인의 시각장애인들을 통해 진행하였다. 실험결과 제안한 시스템은 기존 점자정보단말기들과 유사한 점자 인지율 및 인지속도를 제공하였다. 또한 촉도 정보를 최대 1.1초 이내에 촉각정보로 변환하여 출력함으로써 기존 점자프린터에서는 불가능한 실시간 그래픽 정보 전달이 가능하였다.

• 전기학회논문지P
• /
• 제51권3호
• /
• pp.149-154
• /
• 2002

In this paper, we propose a new graphic deformation algorithm for haptic interface system. Our deformable model is based on non-linear elasticity, anisotropy behavior and the finite element method. Also we developed controller for high-speed communication. The proposed controller is based on the PCI/FPGA technology, which could progress the capability of the position calculating and the force data transmitting. The haptic system is composed of the 6DOF force display device, the high-speed controller, HIR library for 3D graphic deformation algorithm and the haptic rendering algorithm. The developed system will be used on constructing the dynamical virtual environment. We demonstrate the relevance of this approach for the real-time simulating deformations of elastic objects. To show the efficiency of our system, we programmed the simulation of force reflecting. As the result of experiment, we found that it has high stability and easy to control for deformable object than some other systems.

• 전기학회논문지P
• /
• 제52권3호
• /
• pp.121-126
• /
• 2003

In this paper, we propose the haptic system for the real-time virtual environment-control, which controls the sense of sight, hearing and touch. In order to maintain the stable haptic system in this study, we apply the proxy force rendering algorithm and the real-time graphic deformation algorithm based on the FEM. The applied proxy algorithm makes the system possible to be more stable and prompt with a virtual object. Moreover, the haptic rendering algorithm is applied to work out a problem that the tactual transaction-period is different from the graphic transaction- period. The graphic deformation algorithm is developed in the real-time using the deformed FEM. To apply the FEM, a deformed material-model is produced and then the graphic deformation with this model is able to force. Consequently, the graphic rendering algorithm is deduced by the real-time calculation and simplification because the purpose of this system is to transact in the real time. Applying this system to the PC, we prove that it is possible to deform the graphics and transact the haptic. Finally we suggest the variable simulation program to show the efficiency of this system.

• 한국콘텐츠학회논문지
• /
• 제11권12호
• /
• pp.94-102
• /
• 2011

본 논문에서는 전맹 시각장애인(전맹인)의 교육환경을 개선하기 위한 햅틱 디스플레이 기반의 실시간 교육보조공학 시스템을 제안하였다. 제안한 시스템은 교육자용 강의 및 저작 S/W와 기존에 개발한 전맹인용 햅틱 디스플레이 H/W로 구성된다. 교육자용 강의 및 저작 S/W는 전맹인에게 제공할 교육자료를 익숙한 UI(User Interface)를 통해 빠르고 편리하게 저작하는 것을 주 기능으로 하며, 전맹인용 햅틱 디스플레이 H/W는 교육자료를 전맹인이 인지할 수 있는 형태(촉각정보)로 출력하는 것을 주 기능으로 한다. 제안한 시스템을 구현한 결과에서는 기존의 점자정보단말기나 점자프린터 등을 이용했을 때와 유사한 결과를 전맹인에게 제공할 수 있을 뿐만 아니라 저작한 교육자료를 실시간으로 출력할 수 있어 그 성능과 기능이 효과적임을 보여주었다.

• 국제학술발표논문집
• /
• The 9th International Conference on Construction Engineering and Project Management
• /
• pp.1179-1186
• /
• 2022

Building Information Modeling (BIM) is widely used to efficiently share, utilize and manage information generated in every phase of a construction project. Recently, mixed reality (MR) technologies have been introduced to more effectively utilize BIM elements. This study deals with the haptic interactions between humans and BIM elements in MR to improve BIM usability. As the first step in interacting with virtual objects in mixed reality, we challenged moving a virtual object to the desired location using finger-pointing. This paper presents the procedure of developing a haptic interface system where users can interact with a BIM object to move it to the desired location in MR. The interface system consists of an MR-based head-mounted display (HMD) and a mobile application developed using Unity 3D. This study defined two segments to compute the scale factor and rotation angle of the virtual object to be moved. As a result of testing a cuboid, the user can successfully move it to the desired location. The developed MR-based haptic interface can be used for aligning BIM elements overlaid in the real world at the construction site.