• Title/Summary/Keyword: Auditory system

Search Result 369, Processing Time 0.028 seconds

Real Time Environmental Classification Algorithm Using Neural Network for Hearing Aids (인공 신경망을 이용한 보청기용 실시간 환경분류 알고리즘)

  • Seo, Sangwan;Yook, Sunhyun;Nam, Kyoung Won;Han, Jonghee;Kwon, See Youn;Hong, Sung Hwa;Kim, Dongwook;Lee, Sangmin;Jang, Dong Pyo;Kim, In Young
    • Journal of Biomedical Engineering Research
    • /
    • v.34 no.1
    • /
    • pp.8-13
    • /
    • 2013
  • Persons with sensorineural hearing impairment have troubles in hearing at noisy environments because of their deteriorated hearing levels and low-spectral resolution of the auditory system and therefore, they use hearing aids to compensate weakened hearing abilities. Various algorithms for hearing loss compensation and environmental noise reduction have been implemented in the hearing aid; however, the performance of these algorithms vary in accordance with external sound situations and therefore, it is important to tune the operation of the hearing aid appropriately in accordance with a wide variety of sound situations. In this study, a sound classification algorithm that can be applied to the hearing aid was suggested. The proposed algorithm can classify the different types of speech situations into four categories: 1) speech-only, 2) noise-only, 3) speech-in-noise, and 4) music-only. The proposed classification algorithm consists of two sub-parts: a feature extractor and a speech situation classifier. The former extracts seven characteristic features - short time energy and zero crossing rate in the time domain; spectral centroid, spectral flux and spectral roll-off in the frequency domain; mel frequency cepstral coefficients and power values of mel bands - from the recent input signals of two microphones, and the latter classifies the current speech situation. The experimental results showed that the proposed algorithm could classify the kinds of speech situations with an accuracy of over 94.4%. Based on these results, we believe that the proposed algorithm can be applied to the hearing aid to improve speech intelligibility in noisy environments.

A Study on the Tinnitus of Huangdi's Internal Classic $\ll$황제내경(黃帝內經)$\gg$ ($\ll$소문(素問).영추(靈樞)$\gg$에 나타난 이명(耳鳴)에 대한 연구(硏究))

  • Byun, Seok-Mi;Tark, Myoung-Rim;Kang, Na-Ru;Ko, Woo-Shin;Yoon, Hwa-Jung
    • The Journal of Korean Medicine Ophthalmology and Otolaryngology and Dermatology
    • /
    • v.23 no.1
    • /
    • pp.224-252
    • /
    • 2010
  • Objective : The purpose of this study is to investigate tinnitus of Plain Questions $\ll$素問$\gg$ and Miraculous Pivot $\ll$靈樞$\gg$. Methods : We conducted a study on the original text paragraphs of Internal Classic $\ll$內經$\gg$ containing the tinnitus and analysis of Yang, Ma, Zhang, Wang etc. We drew a parallel between tinnitus from Internal Classic $\ll$內經$\gg$ and matching diagnoses from western medicine. Results : The results were as follows. 1. Tinnitus in Plain Questions $\ll$素問$\gg$Tong Pyeong Heo Sil Ron <通評虛實論> was similar to the symptoms of diabetes mellitus complication and schizophreniform disorder in western medicine. 2. Liver fire tinnitus in Plain Questions $\ll$素問$\gg$ Yuk Won Jeong Gi Dae Ron <六元正紀大論> was similar to the symptoms of psychological distress in western medicine. 3. Phlegm fire tinnitus in Plain Questions $\ll$素問$\gg$ Ji Jin Yo Dae Ron <至眞要大論> was similar to the symptoms of meniere's disease and malfunction of autonomic nervous system in western medicine. 4. Blood deficiency tinnitus in Miraculous Pivot $\ll$靈樞$\gg$ Sa Gi Jang Bu Byeong Hyeong <邪氣藏府病形> was similar to the symptoms of anemia in western medicine. 5. Tinnitus in Miraculous Pivot $\ll$靈樞$\gg$ Gyeong Geun <經筋> was similar to the myofacial pain syndrome of the sternocleidomastoid muscle and the masseter muscle in western medicine. 6. Gallbladder deficiency tinnitus in Miraculous Pivot $\ll$靈樞$\gg$ Gwol Hyeong <厥病> was similar to the symptoms of otitis media and labyrinthitis in western medicine. 7. Kidney deficiency tinnitus in Miraculous Pivot $\ll$靈樞$\gg$ Gyeol Gi <決氣> and Hai Ron <海論> was similar to the symptoms of degenerative auditory organ in western medicine. 8. Tinnitus in Internal Classic $\ll$內經$\gg$ showed close relations with the symptoms of the wind character. Conclusion : We analyzed the original text paragraphs of Internal Classic $\ll$內經$\gg$ and explanations about tinnitus. Further studies are needed to compare oriental medicine and western medicine diagnoses to develop better treatments for tinnitus.

Dual CNN Structured Sound Event Detection Algorithm Based on Real Life Acoustic Dataset (실생활 음향 데이터 기반 이중 CNN 구조를 특징으로 하는 음향 이벤트 인식 알고리즘)

  • Suh, Sangwon;Lim, Wootaek;Jeong, Youngho;Lee, Taejin;Kim, Hui Yong
    • Journal of Broadcast Engineering
    • /
    • v.23 no.6
    • /
    • pp.855-865
    • /
    • 2018
  • Sound event detection is one of the research areas to model human auditory cognitive characteristics by recognizing events in an environment with multiple acoustic events and determining the onset and offset time for each event. DCASE, a research group on acoustic scene classification and sound event detection, is proceeding challenges to encourage participation of researchers and to activate sound event detection research. However, the size of the dataset provided by the DCASE Challenge is relatively small compared to ImageNet, which is a representative dataset for visual object recognition, and there are not many open sources for the acoustic dataset. In this study, the sound events that can occur in indoor and outdoor are collected on a larger scale and annotated for dataset construction. Furthermore, to improve the performance of the sound event detection task, we developed a dual CNN structured sound event detection system by adding a supplementary neural network to a convolutional neural network to determine the presence of sound events. Finally, we conducted a comparative experiment with both baseline systems of the DCASE 2016 and 2017.

The effects of PM driving direction and alert sound type on risk perception and awareness of PM driver of pedestrians (개인형 이동장치(PM)의 주행 방향과 경고방식의 차이가 보행자의 위험 지각과 주행자에 대한 인식에 미치는 영향)

  • Jung, Yoon-Hyun;Lee, Soo-Ji;Kang, Hyunmin
    • Journal of Digital Convergence
    • /
    • v.19 no.7
    • /
    • pp.217-226
    • /
    • 2021
  • The use of personal mobility(PM) is increasing because of preading shared mobility, but, it causes risk of accidents and fear to pedestrians because of lack of sound. The purpose of this study is to find out the effects of the alert sound in PM and driving direction on risk perception of pedestrians, awareness on PM driver, and allowance for driving on each road. The 8 videos were produced from a pedestrian perspective, depending on the alert sound type(silent, vess, bell, voice) and direction of driving(front, back). After watching each video, participants completed surveys. There was a non-effect on the driving direction. Regardless of the alert sound type, all of the sounds reduced the risk perception. Also, the awareness of PM drivers and allowance for driving on each road were positive. This study found that PM needed an alert sound for pedestrian safety. We expect the results of the study to help improve awareness of PM and make policies and regulations.

Immersive Smart Balance Board with Multiple Feedback (다중 피드백을 지원하는 몰입형 스마트 밸런스 보드)

  • Seung-Yong Lee;Seonho Lee;Junesung Park;Min-Chul Shin;Seung-Hyun Yoon
    • Journal of the Korea Computer Graphics Society
    • /
    • v.30 no.3
    • /
    • pp.171-178
    • /
    • 2024
  • Exercises using a Balance Board (BB) are effective in developing balance, strengthening core muscles, and improving physical fitness and concentration. In particular, the Smart Balance Board (SBB), which integrates with various digital content, provides appropriate feedback compared to traditional balance boards, maximizing the effectiveness of the exercise. However, most systems only offer visual and auditory feedback, failing to evaluate the impact on user engagement, interest, and the accuracy of exercise postures. This study proposes an Immersive Smart Balance Board (I-SBB) that utilizes multiple sensors to enable training with various feedback mechanisms and precise postures. The proposed system, based on Arduino, consists of a gyro sensor for measuring the board's posture, a communication module for wired/wireless communication, an infrared sensor to guide the user's foot placement, and a vibration motor for tactile feedback. The board's posture measurements are smoothly corrected using a Kalman Filter, and the multi-sensor data is processed in real-time using FreeRTOS. The proposed I-SBB is shown to be effective in enhancing user concentration and engagement, as well as generating interest, by integrating with diverse content.

Landscape Composition Based on Placement and Harmony in the Namgea Suhwon (치(置)와 화(和)의 개념으로 분석한 남계서원의 경관짜임)

  • Rho, Jae-Hyun;Shin, Sang-Sup
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.37 no.4
    • /
    • pp.72-85
    • /
    • 2009
  • This study attempts to examine the principles of landscape composition for a 'Suhwon(書院)' and the meaning and value of its traditional landscape architecture, in order to apply the results to the design of modern landscape architecture. A 'Suhwon' is a vital space containing the form and meaning of human activity. This study analyzes the characteristics of landscape composition in the construction of the Namgea Suhwon, located in Hamyang, by examining the form and meaning of its area and composition. The Namgea Suhwon was constructed with a suitable configuration and harmony in a good location, neither field nor mountain, and which encompasses transcendence and a return after passage through a period of birth and abundance. Its appearance means 'life existence and hidden death(生居死幽)'. Its spatial system is a reflection of the idea of Samshinoje(三神五帝: The three abilities of Providence and its five subjects) connected with Ilsangje -Samshin -Ohje. It was built based on the idea of Biryebudong(非禮不動) meaning that one should follow only good decorum and avoid discourtesy, complying with "the frame of decorum" developed by the family rites of Chu Hsi. The environmental design of the Namgea Suhwon was interrupted by the material confrontation between mountains and water and a binary code system, such as front to rear, length to breadth, and movement to stillness. The design did not adhere to stiff axes, but pursued the harmonic principles of asymmetric balance in the building and the yard, which are very naturalistic. The name 'Namgea Suhwon' is closely related with the view of placement(置) and harmony(和), which are unified with the function and meaning formed by connecting Sung Confucianism with the Pungsu-Sasinsa structure in the layout of the grounds. When examining the D/H ratio of the building and yard, it can be seen that the spaces of Ganghak, Yusang and Jehyang were built appropriately, according to the natural characteristics of each space, such as a sense of openness, enclosure, tension, relief, enhancement, and hierarchical order. The spaces also reflect human scale concepts that take advantage of auditory features. The transition process after the construction of 'Namgea Suhwon' reveals the intentions of the builder to create an ecological landscape composition based on Placement and Harmony. Placement embodies' a purposeful space in which nature and the building are connected naturally, 'incomplete open space pursuing completion', and 'potential beauty in which tension and relaxation are repeated'. Harmony embodies 'order and continuity having a sense of unity with the natural environment' and the 'sharing of daily life and memory'. 'Namgea Suhwon' contains many ideas for landscape planning, land use and the design of a campus environment.

A Systematic Review on the Effects of Virtual reality-based Telerehabilitation for Stroke Patients (뇌졸중 환자를 위한 가상현실 기반의 원격재활 효과에 관한 체계적 고찰)

  • Lim, Young-Myoung;Lee, ji-Yong;Jo, Seong-Jun;Ahn, Ye-Seul;Yoo, Doo-Han
    • The Journal of Korean society of community based occupational therapy
    • /
    • v.7 no.1
    • /
    • pp.59-70
    • /
    • 2017
  • Objective : The purpose of this study was to examine the effect of virtual reality-based remote rehabilitation on stroke patients systematically and to look for its effect and how to apply it domestically. Methods : In order to search data, EMBASE and CINAHL database were used. Relevant research used those terms of virtual reality, telerehabilitation, and stroke. A total of 10 studies satisfying the selection criteria was analyzed according to their qualitative level, general characteristics, and PICO method. Results : Based on the selected 10 studies, virtual reality-based telerehabilitation system was applied. Sensory and motor feedback was provided with inputting visual and auditory senses through a video in the home environment, and it stimulated changes in the client's nervous system. Tools to measure the results were upper extremity function, balance and gait, activities of daily living, etc. Those virtual reality-based telerehabilitation method had an effect on upper extremity function and ability of sense of balance in all studies, and on the activities of daily living partially. Telerehabilitation service to make up environmental specificity improved satisfaction of client. That meaned the effect of the intervention to maintain the function. Conclusion : The virtual reality-based telerehabilitation system was applied to upper extremity function, sense of balance, and activities of daily living largely, and it showed that it helped to improve functions through intervention, supervision, and training of therapist in the home environment as well. This study suggests the basis and possibility of clinical application on virtual-reality based telerehabilitation. Additional research is needed to diverse virtual reality intervention methods and the effect of telerehabilitation in the future.

Methodologies for Enhancing Immersiveness in AR-based Product Design (증강현실 기반 제품 디자인의 몰입감 향상 기법)

  • Ha, Tae-Jin;Kim, Yeong-Mi;Ryu, Je-Ha;Woo, Woon-Tack
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.44 no.2 s.314
    • /
    • pp.37-46
    • /
    • 2007
  • In this paper, we propose technologies for enhancing the immersive realization of virtual objects in AR-based product design. Generally, multimodal senses such as visual/auditory/tactile feedback are well known as a method for enhancing the immersion in case of interaction with virtual objects. By adapting tangible objects we can provide touch sensation to users. A 3D model of the same scale overlays the whole area of the tangible object so the marker area is invisible. This contributes to enhancing immersion. Also, the hand occlusion problem when the virtual objects overlay the user's hands is partially solved, providing more immersive and natural images to users. Finally, multimodal feedback also creates better immersion. In our work, both vibrotactile feedback through page motors, pneumatic tactile feedback, and sound feedback are considered. In our scenario, a game-phone model is selected, by way of proposed augmented vibrotactile feedback, hands occlusion-reduced visual effects and sound feedback are provided to users. These proposed methodologies will contribute to a better immersive realization of the conventional AR system.

A Study on the Meaning Landscape and Environmental Design Techniques of Yoohoedang Garden(Hageowon : 何去園) of Byulup(別業) Type Byulseo(別墅) (별업(別業) '유회당' 원림 하거원(何去園)의 의미경관 해석과 환경설계기법)

  • Shin, Sang-sup;Kim, Hyun-wuk
    • Korean Journal of Heritage: History & Science
    • /
    • v.46 no.2
    • /
    • pp.46-69
    • /
    • 2013
  • The results of study on the meaning landscape and environmental design techniques of the Byulup, Yoohoedang garden(Hageowon) based on the story in the collection of Kwon Yi-jin (Yoohoedangjip, 有懷堂集), are as below. First, Yoohoedang Kwon Yi-jin (有懷堂 權以鎭 : 1668~1734) constructed a Byulup garden consisting of ancestor grave, Byulup, garden, and a school, through 3 steps for 20 years in the back hill area of Moosoo-dong village, south of Mountain Bomun in Daejeon. In other words, he built the Byulup(別業, Yoohoedang) by placing his father's grave in the back hill of the village, and then constructed Yoegeongam(餘慶菴) and Geoupjae(居業齋) for protection of the pond(Napoji, 納汚池), garden(Banhwanwon, 盤桓園), and ancestor graves, and descendants' studying in the middle stage. He built an extension in Yoohoedang and finally completed the large-size garden (Hageowon) by extending the east area. Second, in terms of geomancy sense, Yoohoedang Byulup located in Moosoo-dong village area is the representative example including all space elements such as main living house (the head family house of Andong Kwon family), Byulup (Yoohoedang), ancestor graves, Hagoewon (garden) and Yoegeongam (cemetery management and school) which byulup type Byulseo should be equipped with. Thirdly, there are various meaning landscape elements combining the value system of Confucianism, Buddhism and Taoism value, including; (1) remembering parents, (2) harmonious family, (3) integrity, (4) virtue, (5) noble personality, (6) good luck, (7) hermit life, (8) family prosperity and learning development, (9) grace from ancestors, (10) fairyland, (11) guarding ancestor graves, and (12) living ever-young. Fourth, after he arranged ancestor graveyard in the back of the village, he used surrounding natural landscapes to construct Hagoewon garden with water garden consisting of 4 mountain streams and 3 ponds for 13 years, and finally completed a beautiful fairyland with 5 platforms, 3 bamboo forests, as well as the Seokgasan(石假山, artificial hill). Fifth, he adopted landscape plantation (28 kinds; pine, maple, royal azalea, azalea, persimmon tree, bamboo, willow, pomegranate tree, rose, chinensis, chaenomeles speciosa, Japanese azalea, peach tree, lotus, chrysanthemum, peony, and Paeonia suffruticosa, etc.) to apply romance from poetic affection, symbol and ideal from personification, as well as plantation plan considering seasonal landscapes. Landscape rocks were used by intact use of natural rocks, connecting with water elements, garden ornament method using Seokyeonji and flower steps, and mountain Seokga method showing the essence of landscape meanings. In addition, waterscape are characterized by active use of water considering natural streams and physio-graphic condition (eastern valley), ecological corridor role that rhythmically connects each space of the garden and waterways following routes, landscape meaning introduction connecting 'gaining knowledge by the study of things' values including Hwalsoodam(活水潭, pond), Mongjeong(蒙井, spring), Hosoo(濠水, stream), and Boksoo(?水, stream), and sensuous experience space construction with auditory and visualization using properties of landscape matters.