• Electronics and Telecommunications Trends
• /
• v.39 no.2
• /
• pp.12-23
• /
• 2024

The Metaverse industry is developing rapidly, and related technologies are being actively improved. Tools such as controllers, keyboards, and mouses are used to interact in the Metaverse, but they are not natural and intuitive interfaces to resemble real-world interactions. Immersive interaction in a Metaverse space requires the engagement of various senses such as vision, touch, and proprioception. Moreover, in terms of body senses, it requires a sense of body ownership and agency. In addition, eliciting cognitive and emotional empathy based on non-verbal expression, which cannot be suitably conveyed to the digital world, requires higher-level technologies than existing emotion measurement solutions. This diversity of technologies can converge to build an immersive realistic Metaverse environment. We review the latest research trends in technologies related to immersive interactions and analyze future development prospects.

• Science of Emotion and Sensibility
• /
• v.13 no.3
• /
• pp.429-440
• /
• 2010

It is known that as many as 1 in 91 children are diagnosed with an autistic spectrum disorder, and the incidence rate of the autistic spectrum disorder is much higher than that of cancer in Korea. It is necessary to develop a novel technology to sense their emotional status and give proper psychological diagnosis and therapy, since the children with autistic spectrum disorder usually do not express their own emotional status. This article presents the state-of-the-arts on the affective computing technologies that include recognition of emotional status through bio-sensing and virtual affective agent modeling, and then proposes a novel system architecture for diagnosis and therapy of autistic spectrum disorder. The diagnosis and therapy system of autistic spectrum disorder is composed of bio-sensing module, virtual environment module with affective agents, and haptic interface module. The architecture proposed in this paper will enhance the objectivity to diagnose autism spectrum disorders, and enable continuous treatment in daily life.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.158-162
• /
• 2009

Sound effects coming with appropriate tactile stimuli can strengthen its reality. For example, gunfire in games and movies, if it is accompanied by vibrating effects, can enhance the impressiveness. On a similar principle, adding the vibration information to existing sound data file and playing sound while generating vibration effects through haptic interfaces can augment the sound experience. In this paper, we propose a method to generate vibration information by analyzing the sound. The vibration information consists of vibration patterns and the timing within a sound file. Adding the vibration information is labor-intensive if it is done manually. We propose a sound detection algorithm to search the moments when specific sounds occur in a sound file and a method to create vibration effects at those moments. The sound detection algorithm compares the frequency characteristic of specific sounds and finds the moments which have similar frequency characteristic within a sound file. The detection ratio of the algorithm was 98% for five different kinds of gunfire. We also develop a GUI based vibrating pattern editor to easily perform the sound search and vibration generation.

• 한국HCI학회:학술대회논문집
• /
• 2007.02a
• /
• pp.373-378
• /
• 2007

최근 들어 햅틱 분야는 디지털 콘텐츠를 만질 수 있게 촉감을 제공함으로써 의학, 교육, 군사, 엔터테인먼트, 방송 분야 등에서 널리 연구되고 있다. 그러나 햅틱 분야가 사용자에게 시청각 정보와 더불어 추가적인 촉감을 제공함으로써 보다 실감 있고 자연스러운 상호작용을 제공하는 등 여러 가지 장점을 가진 것에 비해 아직은 일반 사용자들에게 생소한 분야다. 그 이유 중 하나로 촉감 상호작용이 가능한 콘텐츠의 부재를 들 수 있다. 또한 최근에 가상환경(Virtual Environment, VR)에 관심이 증가 되고, 가상환경에 햅틱이라는 기술을 접목시키는 시도가 많이 일어나고 있어서, 촉감 모델링에 대한 욕구 또한 증대 되고 있다. 일반적으로 촉감 모델링은 Material properties를 가지고 있는 그래픽 모델들로 구성이 된다. 그래픽 모델링은 일반적인 모델링툴 (MAYA, 3D MAX, 기타 등)으로 할 수 있다. 하지만 촉감 관련된 촉감 모델들은 콘텐츠를 제작한 이후에 일일이 수작업으로 넣어 주어야 한다. 그래픽 모델링에서는 사용자가 직접 눈으로 확인 하면서 작업을 이루어 지기 때문에 직관적으로 이루어질 수 있다. 이와 비슷하게 촉감 모델링은 직관적인 모델링을 하기 위해서 사용자가 직접 촉감을 느껴 보면서 진행이 되어야 한다. 또한 그래픽 모델링과 촉감 모델링이 동시에 진행이 되지 않기 때문에 촉감 콘텐츠를 만드는데 시간이 많이 걸리게 되고 직관적이지 못하는 단점이 있다. 더 나아가서 이런 촉감 모델링을 포함한 모델링 높은 생산성을 위해서 신속히 이루어져야 한다. 이런 이유들 때문에 촉감 모델링을 위한 새로운 인터페이스가 필요하다. 본 논문에서는 촉감 상호작용이 가능한 촉감 콘텐츠를 직관적으로 생성하고 조작할 수 있게 하는 촉감 모델러를 기술한다. 촉감 모델러에서 사용자는 3 자유도 촉감 장치를 사용하여 3 차원의 콘텐츠 (정적 이거나 동적이거나 Deformation이 가능한 2D, 2.5D, 3D Scene)를 실시간으로 만져보면서 생성, 조작할 수 있는 촉감 사용자 인터페이스 (Haptic User Interface, HUI)를 통해서 콘텐츠의 표면 촉감 특성을 직관적으로 편집할 수 있다. 촉감 사용자인터페이스는 마우스로 조작하는 기존의 2 차원 그래픽 사용자 인터페이스를 포함하여 3 차원으로 사용자 인터페이스도 추가되어 있고 그 형태는 촉감 장치로 조작할 수 있는 버튼, 라디오버튼, 슬라이더, 조이스틱의 구성요소로 이루어져있다. 사용자는 각각의 구성요소를 조작하여 콘텐츠의 표면 촉감 특성 값을 바꾸고 촉감 사용자 인터페이스의 한 부분을 만져 그 촉감을 실시간으로 느껴봄으로써 직관적으로 특성 값을 정할 수 있다. 또한, XML 기반의 파일포맷을 제공함으로써 생성된 콘텐츠를 저장할 수 있고 저장된 콘텐츠를 불러오거나 다른 콘텐츠에 추가할 수 있다. 이러한 시스템은 햅틱이라는 분야를 잘 모르는 사람들도 직관적으로 촉감 모델링을 하는데 큰 도움을 줄 수 있을 것이다.

• Journal of the HCI Society of Korea
• /
• v.1 no.2
• /
• pp.19-26
• /
• 2006

This paper presents a novel pneumatic tactile display that can deliver some useful information. The air-jet display forms 5 by 5 arrays and features air nozzles with an external diameter of 2.4mm and internal diameter of 1.5 mm. In comparison with other tactile displays such as vibrotactile, there is little concrete psychophysical data relating to pneumatic displays, a fact which hinders their adoption. This paper addresses this challenge, and presents brief psychophysical studies examining localization rate, the two point threshold, stimulus intensity and the temporal threshold of cues produced by pneumatic air jets. Two groups of subjects were used in these studies, subsequently termed groups A and B. Both were comprised of eight participants. In the case of localization study we obtained 58.13% and 85.9% of localization rates each for dense display and sparse display. Two-points threshold test showed the length of gap between two air-jet stimuli which subjects can detect. However, it was formidable to find out precise temporal resolution of PTI owing to the limitation of capability of the pneumatic valves. Lastly, the results of stimulus intensity study suggest that by varying the size of a pneumatically created tactile stimulus, we can effectively vary its perceived magnitude.

• Science of Emotion and Sensibility
• /
• v.5 no.4
• /
• pp.77-84
• /
• 2002

In this paper, we propose the NAVER, a general framework for multipurpose virtual environments, and introduce the case study of evaluating car prototypes using cave-like systems. As a framework to implement variant applications in virtual environment, NAVER is extensible, reconfigurable and scalable. NAVER consists of several external modules (Render Server, Control Server and Device Server), which communicate each other to share states and user-provided data and to perform their own functions. NAVER supports its own scripting language based on XML which allows a user to define variant interactions between objects in virtual environments as well as describe the scenario of an application. We used NAVER to implement the system for evaluating car prototyes in a CAVE-like virtual environment system. The CAVE-like virtual environment system at KIST consists three side screens and a floor screen (each of them is a square with side of 2.2m), four CRT projectors displays stereoscopic images to the screens, a haptic armmaster, and a 5.1 channel sound system. The system can provide a sense of reality by displaying auditory and tactile senses as well as visual images at the same time. We evaluate car prototypes in a CAVE-like system in which a user can observe, touch and manipulate the virtual installation of car interior.

• Science of Emotion and Sensibility
• /
• v.26 no.1
• /
• pp.43-54
• /
• 2023

In this study, we assessed how participants represent various sensory stimuli experiences through behavioral ratings and physiological measurements. Utilizing intersubject correlation (ISC) analysis, we evaluated whether individuals' affective responses of dominance, arousal, and valence differed when stimuli of three modality conditions (auditory, visual, and haptic) were presented. ISC analyses were used to measure the similarities between one participant's responses and those of the others. To calculate the intersubject correlation, we divided the entire dataset into one subject and all other subject datasets and then correlated the two for all possible stimulus pair combinations. The results revealed that for dominance, ISCs of the visual modality condition were greater than the auditory modality condition, whereas, for arousal, the auditory condition was greater than the visual modality. Last, negative valence conditions had the greater consistency of the participants' reactions than positive conditions in each of the sensory modalities. When comparing modalities, greater ISCs were observed in haptic modality conditions than in visual and auditory modality conditions, regardless of the affective categories. We discussed three core affective representations of multiple modalities and proposed ISC analysis as a tool for examining differences in individuals' affective representations.

• Journal of Advanced Marine Engineering and Technology
• /
• v.33 no.8
• /
• pp.1196-1202
• /
• 2009

In this paper, an estimator design of underwater environment changes is proposed by using observer techniques for ROV control system. The underwater environment changes are considered as an external disturbance term for ROV model and it is added into the input term of ROV model. To estimate the environment changes, a PI observer which does not effect the external disturbance input term is proposed. To verify the effectiveness of the proposed method, the step and the sinusoidal environment changes are considered in simulation. The proposed method will be applied to design the haptic controller for ROV in future.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 2009.11a
• /
• pp.99-102
• /
• 2009

본 연구에서는 실제 기증받은 시체를 이용하여 인체의 각 구조물을 실제 모습 그대로 3D 이미지화하는 과정에 대해 알아보았다. 인체의 구조물을 3D 로 이미지화하는 과정은 다음과 같다. 먼저 시체를 0.2mm 간격으로 절단하여 절단면의 사진을 찍은 후, 각 절단면의 사진에서 각각의 구조물을 구역화하여 색칠을 한 후, 구역화한 이미지에서 외곽선을 추출하여 벡터 이미지를 만든다. 이 외곽선을 1mm 간격으로 쌓아 올린 후 그 표면을 재구성하여 3D 이미지로 변환하는 과정으로 진행되었다. 3D 이미지의 제작은 가슴 부위에 한정하여 이루어졌다. 인체의 해부학적인 모형을 3D 이미지로 시각화함으로써 얻는 효과는 일반인을 대상으로 인체의 내부에 대한 시각적인 호기심을 충족시켜주고 의학 상식을 넓히는데 도움을 줄 수 있을 것 이다. 또한 의대생들을 비롯한 의학 전문가들에게는 생생한 해부학 강의용으로도 활용 가능하다. 향후 Haptic 시스템을 이용한 의료 실습 어플리케이션과 접목될 수도 있을것이고, fMRI 데이터를 비롯한 타 데이터와의 융합을 통해 시각화하여 서비스 할 수도 있다. 이처럼 인체의 3D 모형은 의료분야에서 광범위하게 활용될 수 있는 데이터로써 그 가치를 지닐 것이다.

• 제어로봇시스템학회:학술대회논문집
• /
• 2003.10a
• /
• pp.2051-2056
• /
• 2003

In this paper, a tele-manipulation in explosive ordnance disposal(EOD) applications is discussed. The ROBHAZ-DT2 is developed as a teleoperated mobile manipulator for EOD. In general, it has been thought that the robot must have appropriate functions and accuracy enough to handle the complicated and dangerous mission. However, the research on the ROBHAZ-DT2 revealed that the teleoperation causes more restrictions and difficulties in EOD mission. Thus to solve the problem, a novel user interface for the ROBHAZ-DT2 is developed, in which the operator can interact with various human senses (i.e. visual, auditory and haptic sense). It enables an operator to control the ROBHAZ-DT2 simply and intuitively. A tele-manipulation control scheme for the ROBHAZ-DT2 is also proposed including compliance control via force feedback. It makes the robot adapt itself to circumstances, while the robot faithfully follows a command of the operator. This paper deals with a detailed description on the user interface and the tele-manipulation control for the ROBHAZ-DT2. An EOD demonstration is conducted to verify the validity of the proposed interface and the control scheme.