• Journal of the Korean Institute of Intelligent Systems
• /
• v.24 no.5
• /
• pp.462-469
• /
• 2014

As a basic study on both engineering applications and representation methods of synesthesia, this paper aims at building basic system which converts a muscular sense into both visual and auditory elements. As for the building method, data of the muscular sense can be acquired through roll and pitch signals which are calculated from both three-axis acceleration sensor and the two-axis gyro sensor. The roll and pitch signals are then converted into both visual and auditory information as outputs. The roll signals are converted into both intensity elements of the HSI color model and octaves as one of auditory elements. In addition, the pitch signals are converted into both hue elements of the HSI color model and scales as another one of auditory elements. Each of the extracted elements of the HSI color model is converted into each of the three elements of the RGB color model respectively, so that the real-time output color signals can be obtained. Octaves and scales are also converted and synthesized into MIDI signals, so that the real-time sound signals can be obtained as anther one of output signals. In experiments, the results revealed that normal color and sound output signals were successfully obtained from roll and pitch values that represent muscular senses or physical movements, depending on the conversion relationship based on the similarity between color and sound.

• Proceedings of the Korean Society for Emotion and Sensibility Conference
• /
• 1999.03a
• /
• pp.261-264
• /
• 1999

복합 감각 자극하의 감성정보를 도출하기 위한 기초연구로서 시각과 청각자극에 따른 주관적 평가 및 생리신호를 계측하였다. 심리적 평가와 생리신호 계측으로 단일 자극에 더하여 동적, 정적감성의 심화를 유도하는 결과를 보였고, 부가된 자극을 반영하는 생리신호로 HRV가 유용함을 발견하였다.

• The Journal of the Korea Contents Association
• /
• v.16 no.8
• /
• pp.427-434
• /
• 2016

This paper focuses on a real-time hardware processing by implementing the ARM Cortex-M4 based embedded system, using a conversion algorithm from a muscular sense to both visual and auditory elements, which recognizes rotations of a human body, directional changes and motion amounts out of human senses. As an input method of muscular sense, AHRS(Attitude Heading Reference System) was used to acquire roll, pitch and yaw values in real time. These three input values were converted into three elements of HSI color model such as intensity, hue and saturation, respectively. Final color signals were acquired by converting HSI into RGB color model. In addition, Three input values of muscular sense were converted into three elements of sound such as octave, scale and velocity, which were synthesized to give an output sound using MIDI(Musical Instrument Digital Interface). The analysis results of both output color and sound signals revealed that input signals of muscular sense were correctly converted into both color and sound in real time by the proposed conversion method.

• The Journal of Korean Academy of Sensory Integration
• /
• v.8 no.1
• /
• pp.41-49
• /
• 2010

Objective : Multisensory integration (MSI) is the essential process to use diverse sensory information for cognitive task or execution of motor action. Especially, visual and somatosensory integration is critical for motor behavior and coordination. This study was designed to explain spatial and temporal characteristics of visual and somatosensory integration by neurophysiological research method that identifies the time course and brain location of the SI process. Methods : Electroencephalography (EEG) and event-related potential (ERP) is used in this study in order to observe neural activities when integrating visual and tactile input. We calculate the linear summation (SUM) of visual-related potentials (VEPs) and somatosensory-related potentials (SEPs), and compared the SUM with simultaneously presented visual-tactile ERPs(SIM) Results : There were significant differences between the SIM and SUM in later time epochs (about 200-300ms) at contralateral somatosensory areas (C4) and occipital cortices (O1&O2). The amplitude of the SIM was mathematically larger than the summed signals, implying that the integration made some extra neural activities. Conclusion : This study provides some empirical neural evidence of that multisensory integration is more powerful than just combing two unisensory inputs in the brain and ERP data reveals neural signature relating to multisensory integrative process. Since this study is preliminary pilot study, larger population and criteria are needed for level of the significance. Further study is recommended to consider issues including effect of internally-driven attention and laterality of interaction to make the evidence by this study solid.

• Proceedings of the ESK Conference
• /
• 1995.04a
• /
• pp.35-39
• /
• 1995

인간의 감성평가 기술은 제품설계에 필요한 중요한 기술로 인식되고있다. 정량적이고 객 관적인 감성평가를 위한 구체적인 연구가 요구된다. 본 연구는 생리신호가 인간감성에 따라 변화한 다는 가정아래 인간 오감(청각, 시각, 후각, 미각, 촉각)에 대한 생리신호 (EEG, ECG, GSR, FEMG)의 변화를 측정하였다. 감각종류로 긍정적 감성과 부정적 감성을 유발할 4개의 자극이 피실험자에게 제시되었고, 모든 생리신호를 동기화하여 측정하였다. 측정된 신호는 통계처리하여 주관적으로 평가한 감성과의 상관성을 분석하였고 긍정적인 감성과 부정적인 감성에 따른 신호변화의 특성을 파악하여 감 성평가를 위한 상관성을 관찰했다.

• Proceedings of the Korean Society of Food Science and Nutrition Conference
• /
• 2000.11a
• /
• pp.115-123
• /
• 2000

식품의 관능검사는 인간의 의식과 식품간의 반응결과를 객관적으로 나타내는 방법으로 수치, 언어적 묘사, 도표 등의 표현법을 사용하고 있으며 검사 요원들 간의 오차를 발생한다. 이 오차를 줄이기 위하여 통계 및 심리학적으로 접근하여 해결을 시도해 오고 있으며 오차를 심리적 잡음 (psychological noise)이라고 주장되고 있다. 식품의 기호도는 감각신경세포에서 전기적 신호로 전환되어 뇌에 전달되고 의식의 분석과 해석을 거쳐 얻어지는 것이므로 전기적 신호처리가 포함된다. 그러나 현재의 관능검사 방법들은 시간의 함수관계를 중시하고 있지 않다. 감각신경의 신호 전달체계의 유사성을 바탕으로 관능검사과정에 시간함수를 도인하는 개념이 요구된다. 시간을 개입하는 방법론으로 의식과 식품간의 일어나는 순차적 또는 병열적 행동과 의식체계를 분석하고 시간인자의 중요성을 부각시켰다. 시간함수의 도입방법으로 관능영향인자 표의 구성하고 bar-code를 생성하는 프로그램과 파형곡선으로 전환하는 개념을 제안하였다.

• Journal of the Korea Society of Computer and Information
• /
• v.16 no.1
• /
• pp.117-124
• /
• 2011

This study was realized the home network system for home care by bio-physical sensor system, to convey for the remote physical signal. The composition condition has four functions of displacement point for a Vision, Somatosensory, Vestibular and CNS that the basic measurement used to a Heart Rate, Temperature, Weight. Physical signal are decided to search a max and min point with adjustment of 0.01 unit in the reference level. There were checked physical condition of body balance to compounded a physical neuroceptor of sensory organ for the measurement such as a Vision, Somatosensory, Vestibular, CNS, BMI. There are to check a health care condition through a combination of physical organ with a posturography of a exercise. The service of home network system can be used to support health care management system through health assistants in health care center and central health care system. It was expected to monitor a physical parameter for the remote control health management system.

• The Magazine of the IEIE
• /
• v.38 no.11
• /
• pp.23-29
• /
• 2011

• Korean journal of applied entomology
• /
• v.50 no.4
• /
• pp.383-393
• /
• 2011

Because communication facilitates behaviors that are critical for survival and reproduction, it is central to the study of behavior and evolution. One of the most important and difficult issues with respect to communication has been the definition of communication itself. Broadly, it can be defined as an exchange of information from a signaler to a receiver. However, evolution of a signal is likely possible only under conditions in which both the signaler and receiver increase fitness from the exchange of information, often referred to as "true communication." The three primary sensory channels of communication used by animals are chemical, visual, and acoustic. Chemical signals are the oldest and most widespread method of communication. Visual and acoustic signals convey a great deal of information due to ease of modulation, flexibility of signal production, and fast transmission. The most widespread contexts in which animals communicate are sexual interaction and conflict resolution. Signals used for sexual interaction typically contain information about species identity and sexual attractiveness, whereas signals used for conflict resolution may contain information about resource holding potential. Other contexts under which animals communicate include territorial defense, parent-offspring interactions, social integration, sharing of environmental information, and auto-communication.

• KSBB Journal
• /
• v.13 no.6
• /
• pp.631-637
• /
• 1998

The theoretical research of olfaction began about a hundred years ago and the electrophysiological expermental techniques have been used for the olfaction research from 1950's. However, olfaction has not been studied so much as other senses. Recently interest in the offaction mereases for its industrial applications. We descenbe the companson of vertibrate and insect olfactory organs, smell perception mechanism, olfactory signaing transduction, and industnal applications f olfactory system, it is expected that the vanous ongeing researches on the olfactory system will contribute to sensor and scent industnes.