• 한국HCI학회:학술대회논문집
• /
• 2008.02b
• /
• pp.109-114
• /
• 2008

We have long kept our Cartesian tradition in which Mind privileges over Body; the invention of printing technology has accelerated the tradition in which the intelligence and legibility of media were considered as a higher human value. However, the development of media and technology are supporting the multisensory mechanisms of the body as it was in preliterate era when we communicated with our whole bodily experiences. The development and spread of mass-media and new technologies have broaden the boundary of human sensory that are largely dominated by visual information and expanded it to auditory, olfactory and even gustatory sensation. Since 1960's, some philosophers and artists have recognized the human body as a subjective matter, starting the movement in which the body plays a role as an essential factor in study of human perception and cognition, aesthetics in art, and sociology, and the changed perspectives are practiced vigorously in the field of new media art; the theory of Maurice Merleau-Ponty who clarified the body as a general means for the body's possession of world, so that recognize the importance of cognition of one's body and approved the embodiment could be applied and practiced here. Therefore, we discuss how Merleau-Ponty's philosophical theory can be practiced and how McLuhan's perspective could be applied on the notion of body's extension in media by analysing some new media art cases.

• Proceedings of the Korean Information Science Society Conference
• /
• 2008.06a
• /
• pp.92-97
• /
• 2008

적절한 촉각자극과 결합된 효과음은 실감성을 향상시킨다고 알려져 있다. 예를 들어, 영화나 게임의 총소리 효과음에 진동자극이 결합되면 훨씬 몰입감이 증진된다. 영화의 경우, 미디어 파일 내에 진동효과 관련한 정보를 부가하는 연구가 진행되기도 하였으나 대중화되지는 못했다. 게임의 경우, 진동을 유발시키도록 프로그래밍하는 방식을 사용하기도 한다. 하지만 진동을 고려하여 개발하는 게임은 전체 10% 미만일 정도로 일반화되어 있지 않다. 따라서 효과음향을 실시간으로 감지하여 진동을 발생시키는 시스템이 바람직하다. 본 논문에서는 이러한 시스템에서 특정 효과음을 실시간으로 감지하는 알고리즘을 제안한다. 이 알고리즘에서는 감지하고자 하는 효과음의 주파수 분포를 미리 분석해서 저장해 놓는다. 입력되는 효과음에 대해 실시간으로 주파수를 분석하여 저장된 값과의 차이를 비교하여 특정 효과음을 감지하게 된다. 실시간 주파수 분포에는 sliding fast Fourier transform (SFFT)를 사용한다. 이는 특정 효과음의 시작순간을 명확히 알 수 없기 때문이다. 제안 알고리즘을 First Person Shooting (FPS) 게임에 적용하여 성능분석을 하였다. 소음이 없을 경우, 감지율은 $80{\sim}90%$였으나, 소음 정도가 커질수록 감지율이 선형적으로 반비례하였다. 또한 감지에 걸리는 시간은 효과음 발생순간부터 0.45초 이내였다.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.99-104
• /
• 2009

최근 멀티미디어 기술과 가상/증강현실 기술의 발전으로 사용자에게 몰입감 있는 콘텐츠를 제공하는 여러 시스템들이 제안되고 있다. 또한 기존의 시각과 음향효과만으로 이루어진 시스템의 한계를 넘어서 실제와 같은 느낌을 전달할 수 있는 햅틱기술을 적용하여 보다 몰입감있는 체험형 실감책들이 고안되고 있다. 본 논문은 과학교과서를 중심으로 과학적 이론을 보다 효과적으로 가르치고 배우기 위해 필요한 다양한 촉감(Haptic)을 분류하고, 이를 실감책에 적용하여 책이 담고 있는 주요 내용 또는 삽화와 관련된 다양한 멀티미디어 콘텐츠를 가상/증강환경에서 시청각정보와 함께 촉각콘텐츠를 독자에게 제공함으로써 보고, 듣고 만질 수 있는 적극적인 촉감 상호작용이 가능한 실감책 ('Sil-Gam' Book) 시스템의 기본 프레임워크를 제시한다. 제시된 실감책은 크게 세 부분으로 구성된다. 첫째, 실감책을 읽고 있는 사용자의 손가락의 위치, 시선과 같은 사용자의 움직임을 추적하고 책의 크기, 페이지 등을 인식하는 센서가 부착된 센싱 부; 둘째, 장비에 따라 적용 가능한 촉감 속성, 물체의 움직임에 따라 적용할 수 있는 촉감 속성등 다양한 촉감콘텐츠의 속성을 저작하고 편집하는 소프트웨어 부; 마지막으로 사용자에게 저작된 실감 콘텐츠를 사용자가 쉽고 직관적으로 체험하게 하기 위한 디스플레이부로 구성된다. 여기서 디스플레이 부는 세부적으로 시청각 콘텐츠를 전달하는 시청각 디스플레이 부와 역촉감 콘텐츠를 전달하는 역촉감 디스플레이부로 구성된다. 본 논문에서는 또한 실감책 촉감 저작도구를 사용하여 제시할 수 있는 다양한 촉감을 중고등학교 교육과정에서 배우는 과학 이론에 적용하여 과학 실험시 경험할 수 있는 다양한 역/촉감을 전달하는 몇 가지 시나리오를 예시하였다.

• Journal of Korea Multimedia Society
• /
• v.15 no.6
• /
• pp.711-721
• /
• 2012

The objective of this study is to propose an efficient 3D reconstruction method for developing a stereo-vision-based haptics system which can replace "robotic eyes" and "robotic touch." The haptic rendering for 3D images requires to capture depth information and edge information of stereo images. This paper proposes the 3D reconstruction methods using LoG(Laplacian of Gaussian) algorithm and DoG(Difference of Gaussian) algorithm for edge detection in addition to the basic 3D depth extraction method for better haptic rendering. Also, some experiments are performed for evaluating the CPU time and the error rates of those methods. The experimental results lead us to conclude that the DoG method is more efficient for haptic rendering. This paper may contribute to investigate the effective methods for 3D image reconstruction such as in improving the performance of mobile patrol robots.

• Journal of Korea Multimedia Society
• /
• v.13 no.5
• /
• pp.691-701
• /
• 2010

We propose a haptic rendering technology for touchable video. Our touchable video technique allows users for feeling the sense of touch while probing directly on 2D objects in video scenes or manipulating 3D objects brought out from video scenes using haptic devices. In our technique, a server sends video and haptic data as well as the information of 3D model objects. The clients receive video and haptic data from the server and render 3D models. A video scene is divided into small grids, and each cell has its tactile information which corresponds to a specific combination of four attributes: stiffness, damping, static friction, and dynamic friction. Users can feel the sense of touch when they touch directly cells of a scene using a haptic device. Users can also examine objects by touching or manipulating them after bringing out the corresponding 3D objects from the screen. Our touchable video technique proposed in this paper can lead us to feel maximum satisfaction the haptic-audio-vidual effects directly on the video scenes of movies or home-shopping video contents.

• Smart Media Journal
• /
• v.10 no.1
• /
• pp.70-78
• /
• 2021

The auditory information is used for urgent notification or warning in vehicle because it is not restricted by the direction compared to the visual. However, since the hearing impaired drivers cannot recognize sound signal, various methods of visualizing the auditory information have been attempted to replace it. When visualizing auditory information, only important information should be selected and provided to prevent cognitive overload concentrated on the vision. For this purpose, analysis of the type of auditory information in vehicle should be given in advance. In this study, the types of auditory information in vehicle were analyzed based on the user experience of hearing impaired drivers. Through the observation of the driving behavior of hearing impaired drivers, 33 auditory informations experienced in vehicle were collected. The collected auditory informations were classified into 12 groups through open card sorting by an expert group, and the types of auditory information in vehicle consisting of four levels were presented through a relative comparison of importance between groups. The presented type of auditory information in vehicle can be used as a guideline for selecting important information when the auditory information is converted into visual or tactile. This study is meaningful in that the user experience analysis was conducted by observing actual driving in daily life of hearing impaired drivers.

• The Journal of the Korea Contents Association
• /
• v.15 no.7
• /
• pp.664-673
• /
• 2015

The assistive devices for disabled people are being highlighted even in industrial aspects through the policy and support for disabled people, enactment of regulation for the improvement of accessibility of disabled, technological innovation and product development. Recently, internet access with the sense of touch and hearing and utilizing electronic publishing contents and e-mailing are being convenient through the product of ICT development such as screen reader for visually impaired people, braille display, screen enlarger, text converter and others. Even so, in rapidly changing digital media smart era, the accessibility of visually impaired people is still poor and assistive devices and alternative formats are in need of improvement. Therefore, in aspect of the research and development innovation, this study proposes the implementation directions for improvement of accessibility by analyzing the current situation and structure of alternative formats and assistive devices for visually impaired people. As a result, in the future, various types of digital information are expected to be converted into a customized and realistic forms and distributed through a dedicated disability products or smart devices.

• Journal of The Korean Association of Information Education
• /
• v.11 no.3
• /
• pp.299-306
• /
• 2007

It is urgent to have learning support for children with learning disability according to the survey made by the government educational organization. To this end, we developed a learning support system for children with learning disability. First, the system diagnoses the children with learning disability using a decision tree based on the pre-test results. Secondly, it supports for children with learning disability one of audio-, vision- and tactility-oriented learning types according to the results from the psychological learning style test. Thirdly, one-to-one study is supported for failed students at the achievement test. For the evaluation of the system, the children with disability were divided into an experimental group and a control group and the educational achievement was evaluated. We found that 10% on the average was improved in case that learning was made after the psychological test for learning styles.

• Journal of Digital Convergence
• /
• v.15 no.5
• /
• pp.373-380
• /
• 2017

Recently, virtual reality contents are being experimented and introduced in various fields such as game, education, medical, exhibition, movie, SNS. However, research on virtual reality is mainly focused on industrial and technological perspectives, so contents-centric or contents-oriented research is on virtual reality is very rare. In order to prepare for the future of virtual reality properly, content-oriented research is very much needed. The purpose of this study is to investigate the types, characteristics, and possibilities of virtual reality contents applied to theme parks. For this purpose, we tried to classify the contents type of virtual reality based theme park. The criteria of type classification are divided into 'fixed type', 'continuous moving type', and 'segmented moving type' according to the player's position movement possibility and movement type, here we combine the senses such as tactile, taste, smell, balance etc.

• Journal of Digital Contents Society
• /
• v.15 no.5
• /
• pp.587-594
• /
• 2014

Owing to supply of smart phones and the diffusion of SNS, the number of peoples who are living, linked with us, is incomparably more than in the past. The continuous communication is essential in maintaining good relationship, so peoples have no choice but to seek for most efficient communication method in order to maintain good relationship. This thesis intended to advise how to construct next generation immersive multi-media system, using augmented reality and MPEG-V that have come to the fore recently. In addition, the SNS platform service of new type was suggested in this thesis, in connection with the pairing service. Now, we can create a town in a specific space like the real world, if we utilize the augmented reality that became possible by SNS service and we can talk and exchange informations in that space. This system would provide various services peoples wish to have, interlocking experiences through five senses like sense of vision, sense of hearing, sense of touch and etc..