• Title/Summary/Keyword: Auditory Information

Search Result 313, Processing Time 0.031 seconds

FTFM: An Object Linkage Model for Virtual Reality (가상현실을 위한 객체 연결 모델)

  • Ju, U-Seok;Choe, Seong-Un;Park, Gyeong-Hui;Lee, Hui-Seung
    • The Transactions of the Korea Information Processing Society
    • /
    • v.3 no.1
    • /
    • pp.95-106
    • /
    • 1996
  • The most fundamental difference between general three dimensional computer graphics technology and virtual reality technology lies in the degree of realism as we feel, and thus the virtual reality method heavily relies on such tolls as data gloves, 3D auditory system to enhance human perception and recognition. Although these tolls are valid for such purpose, more essential ingredient. This paper provides further realism by modeling active interactions between the objects inside scenes. For this purpose, this paper proposes and implements a field model where the virtual reality space is treated as a physical field defined on the characteristic radius of stimulus and sense corresponding to the individual object. In the field model, the rule of cause and effect as an essential feature of the realism can be interpreted simply as an energy exchange between objects and consequently, variation on the radius information together with behavioral logic alone can build the virtual environment where each object can react to other objects actively and controllably.

  • PDF

A Study on Tactile Sensation Application for Computer Game and Virtual Reality (컴퓨터게임과 가상현실을 위한 촉각 응용에 관한 연구)

  • 이영재
    • Journal of Korea Multimedia Society
    • /
    • v.5 no.6
    • /
    • pp.646-654
    • /
    • 2002
  • The human sense of touch provides us with an important source of information about our surroundings. Because of its unique position at interface between our bodies and the out world, touch sensation supplies sensory data which helps us manipulate and recognize objects and warn of harmful situation. But tactile sensation was recognized less important than visual sense and auditory sense but it plays an important immersing role in virtual reality and computer game. Tactile sensation can be used to influence to objects according to power and supplied sensory feedback to the player in a virtual environment. This paper investigated the characteristics of tactile sensation of human being and proposed method of sturdy using force sensing sensor, simple force modeling and data structure form for virtual reality and computer game. As a result, force distribution, depth, center point can be calculated using sensor output and this information is very effective to specific position for actions and reactions. This study can used as basic information for tactile sensation and it's application in computer game and virtual realty.

  • PDF

Development of Edutainment platform for Developmental Disability Children (발달장애 아동을 위한 에듀테인먼트 플랫폼 개발)

  • Kim, Jung-Eun;Choi, Ei-Kyu;Shin, Byeong-Seok
    • Journal of Korea Game Society
    • /
    • v.8 no.4
    • /
    • pp.65-73
    • /
    • 2008
  • In this paper, we designed and implemented edutainment platform that can be effectively applied to developmental disabilities for their education and treatment of sensibility and intelligence training. We developed embedded hardware and contents authoring tool to make multimedia contents operated on the hardware, a management tool to provide result of training, and a real-time monitoring tool for observing the state of study. The hardware is designed by considering the characteristics of developmental disabilities and provides visual, auditory and tactile sense to assist sensibility training for their attention. User-friendly and easy-to-use authoring tool enable teachers and non-specialist to make educational contents. Also the real-time monitoring tool make us to observe user's status even in the outside of classroom. The management tool stores result of training and make us to review the result for further steps. Using this edutainment platform, efficient repetitive training is possible without restriction of time and location. Also when it applied to practical education, we can recognize that our system is effective on improving the ability of attention and studying.

  • PDF

Audio-Visual Fusion for Sound Source Localization and Improved Attention (음성-영상 융합 음원 방향 추정 및 사람 찾기 기술)

  • Lee, Byoung-Gi;Choi, Jong-Suk;Yoon, Sang-Suk;Choi, Mun-Taek;Kim, Mun-Sang;Kim, Dai-Jin
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.35 no.7
    • /
    • pp.737-743
    • /
    • 2011
  • Service robots are equipped with various sensors such as vision camera, sonar sensor, laser scanner, and microphones. Although these sensors have their own functions, some of them can be made to work together and perform more complicated functions. AudioFvisual fusion is a typical and powerful combination of audio and video sensors, because audio information is complementary to visual information and vice versa. Human beings also mainly depend on visual and auditory information in their daily life. In this paper, we conduct two studies using audioFvision fusion: one is on enhancing the performance of sound localization, and the other is on improving robot attention through sound localization and face detection.

보편 양화사 (UNIVERSAL QUANTIFIER)에 대한 아동들의 해석 양상

  • 강혜경
    • Proceedings of the Korean Society for Language and Information Conference
    • /
    • 2001.06a
    • /
    • pp.237-257
    • /
    • 2001
  • This paper investigates the idiosyncratic understanding of universal quantifiers such as every, each or all by young children at the ages of 4 to 7, and argues that the phenomenon is explicable in terms of the maturation of both the cognitive system and the linguistic system. Evidence for this dual explanation comes from the fact that the visual input, a picture, plays a key role in determining the children’s conceptual representation, suggesting the need for the central integration of visual and linguistic elements; and from the fact that a quantifier in the linguistic input has an intrinsic property, i.e. a <+focus> feature. I have tried to explain the nature of the cognitive factors in terms of the function of the central system, suggesting a modified form of Smith & Tsimpli’s (1995) version of Fodor’s (1983) modularity hypothesis. Conceptual representations of two kinds are in competition with each other and they are integrated into a neutral LOT (Language of Thought) representation at some point . In the process of this integration, the representations from the visual input predominate over those from the auditory input, though the quantize. (treated as new information provided by the latter) is salient in the final representations. When visual conceptual representations predominate over purely linguistic ones, quantifier spreading errors occur. By contrast, when the relevant grammatical knowledge has developed sufficiently to counteract the conceptual representations, this peculiar behaviour by children should disappear. It is argued that children have to learn two kinds of grammatical fact with regard to universal quantification: (i) they have to learn the status of the quantifier as a functional head of DP so that it has to be positioned inside DP; and (ii) they have to learn the Left-Branch Condition which specifies that movement of an element in the left-branch position is possible only by pied-piping the entire phrase.

  • PDF

Performance Enhancement of Phoneme and Emotion Recognition by Multi-task Training of Common Neural Network (공용 신경망의 다중 학습을 통한 음소와 감정 인식의 성능 향상)

  • Kim, Jaewon;Park, Hochong
    • Journal of Broadcast Engineering
    • /
    • v.25 no.5
    • /
    • pp.742-749
    • /
    • 2020
  • This paper proposes a method for recognizing both phoneme and emotion using a common neural network and a multi-task training method for the common neural network. The common neural network performs the same function for both recognition tasks, which corresponds to the structure of multi-information recognition of human using a single auditory system. The multi-task training conducts a feature modeling that is commonly applicable to multiple information and provides generalized training, which enables to improve the performance by reducing an overfitting occurred in the conventional individual training for each information. A method for increasing phoneme recognition performance is also proposed that applies weight to the phoneme in the multi-task training. When using the same feature vector and neural network, it is confirmed that the proposed common neural network with multi-task training provides higher performance than the individual one trained for each task.

Analysis of Korea's Artificial Intelligence Competitiveness Based on Patent Data: Focusing on Patent Index and Topic Modeling (특허데이터 기반 한국의 인공지능 경쟁력 분석 : 특허지표 및 토픽모델링을 중심으로)

  • Lee, Hyun-Sang;Qiao, Xin;Shin, Sun-Young;Kim, Gyu-Ri;Oh, Se-Hwan
    • Informatization Policy
    • /
    • v.29 no.4
    • /
    • pp.43-66
    • /
    • 2022
  • With the development of artificial intelligence technology, competition for artificial intelligence technology patents around the world is intensifying. During the period 2000 ~ 2021, artificial intelligence technology patent applications at the US Patent and Trademark Office have been steadily increasing, and the growth rate has been steeper since the 2010s. As a result of analyzing Korea's artificial intelligence technology competitiveness through patent indices, it is evaluated that patent activity, impact, and marketability are superior in areas such as auditory intelligence and visual intelligence. However, compared to other countries, overall Korea's artificial intelligence technology patents are good in terms of activity and marketability, but somewhat inferior in technological impact. While noise canceling and voice recognition have recently decreased as topics for artificial intelligence, growth is expected in areas such as model learning optimization, smart sensors, and autonomous driving. In the case of Korea, efforts are required as there is a slight lack of patent applications in areas such as fraud detection/security and medical vision learning.

Development of Concrete Sensory Information for Patients Undergoing Cardiac Catheterization (심도자 검사 환자를 위한 구체적 감각 정보의 개발)

  • 김조자;김화순
    • Journal of Korean Academy of Nursing
    • /
    • v.27 no.2
    • /
    • pp.433-443
    • /
    • 1997
  • Cardiac catheterization is a diagnostic procedure which is intrusive and anxiety provoking. Patient education and information offer have been suggested as effective nursing interventions to reduce patients' anxiety and stress. Main objectives of this study are : 1) to develop concrete objective information for patients undergoing cardiac catheterization : 2) to analyze the types of information included in the newly developed concrete objective information. The subjects of this study are 11 patients who were admitted to the CCU of a general hospital in Seoul. The subjects were provided with preparatory information about cardiac catheterization by using interview and a booklet. After the procedure, the subjects were asked to describe additional information which they suggest to be added into the booklet and the physical sensations felt during the procedure. The results of the study are summarized as follows : Most subjects were satisfied with the preparatory information that was provided by interview and the booklet before the procedure. But patients suggested several problems related to the content of the booklet. First, they reported difficulty to differentiate the terms -coronary angio gram and cardiac catheterization. Also, some patients expressed that they feared after reading the information about the incision of inguinal area. Subjects responded that the information about the direct process of the test did not reduce their anxiety and the information was not detail enough. Next, most subjects would want to know about the monitor and the sound from monitor. They said that they could not hear instructions from doctor or nurse during the procedure due to tension. Considering above response results, the need for more effective way to provide information, like visual and auditory information through video tape for giving information is suggested. Sensations related to the procedure were the smell coming from sterilization of inguinal area, stinging pain in groin when the doctor inserts a needle into artery, and the sensation of pressure and moving of vessels surrounding neck when the catheter was inserted and visualized on fluoroscopy. Besides, subject reported hot sensation and burning feeling in face and chest area, and nausea when dye is injected by hand. In the analysis of information content, there was 79% agreement on the actual units of analysis that were coded. In the analysis of type of information, procedural information was 60.4%. Concrete objective information was 28.1%. and other information was 11.5%. Agreement of the coders in categorizing the units of information was determined by using Cohen's kappa which corrects for chance agreement. Cohen's kappa was .84.

  • PDF

Speaker Independent Recognition Algorithm based on Parameter Extraction by MFCC applied Wiener Filter Method (위너필터법이 적용된 MFCC의 파라미터 추출에 기초한 화자독립 인식알고리즘)

  • Choi, Jae-Seung
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.21 no.6
    • /
    • pp.1149-1154
    • /
    • 2017
  • To obtain good recognition performance of speech recognition system under background noise, it is very important to select appropriate feature parameters of speech. The feature parameter used in this paper is Mel frequency cepstral coefficient (MFCC) with the human auditory characteristics applied to Wiener filter method. That is, the feature parameter proposed in this paper is a new method to extract the parameter of clean speech signal after removing background noise. The proposed method implements the speaker recognition by inputting the proposed modified MFCC feature parameter into a multi-layer perceptron network. In this experiments, the speaker independent recognition experiments were performed using the MFCC feature parameter of the 14th order. The average recognition rates of the speaker independent in the case of the noisy speech added white noise are 94.48%, which is an effective result. Comparing the proposed method with the existing methods, the performance of the proposed speaker recognition is improved by using the modified MFCC feature parameter.

A Study on the healing factors of Forest Sound

  • Yi, Eun-Young;Bae, Myung-Jin
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.9 no.2
    • /
    • pp.70-77
    • /
    • 2017
  • Where there are all the flowers, the songs of all kinds of insects and birds are put in, the sunshine and shadows flicker The forest through which the water sound flows is an optimum resting space. All living creatures in these spaces will awaken the five senses of humans and perhaps turn the sensibility index (EQ). The forest meditation in the forest, which can be an optimal shelter for the people who need it, needs to feel the reverence of nature, to refine emotions, to be a self-reflection, to have a mind to respect, Have an important meaning. In this paper, we tried to consider the cause of the influence of forest sounds on human hearing from the acoustical aspect. The type of sound source of forest was divided into four seasons of spring, summer, autumn, winter. And the change in the duration of the sound during the four seasons, so that the general characteristics of the sounds of the four seasons are as follows: It can be seen that the change in the ratio of sub-band energy is almost equal to the change in dB in frequency of the equal-light curve. To compare this phenomenon, the criterion for changing the sound duration of each forest is natural The main forms of the luminance curve, such as the change in the duration of the white signal in the sound, are determined by the minimum, maximum audible frequency and the most sensitive frequency band, and the auditory characteristics of the other three inflection points Determines the overall shape of the equal-light curve.