• 산업경영시스템학회지
• /
• 제28권4호
• /
• pp.55-62
• /
• 2005

This paper describes the experiment that investigated the possibility of design and evaluation of the usability of earcon applied to voice menu. The earcon has functions in providing navigational cue in the hierarchical menu, and also can be applied to voice menu for improving the recall rate and the response time. In this experiment, participants identified their location with the help of earcon applied to the voice menu with the various earcon parameters. In detail some participants listened to the good quality sound of voice menu using the structured earcon, and they recalled the location they heard. Other participants listened to the good quality sound of voice menu without earcon, and they recalled the location they heard in the same manner. And the response times were checked through their answers. On analyzing the results, we found the earcon applied to voice menu showed the increase of recalling rate from what they heard during experiment. That is the performance of task was better with earcon applied to voice menu than with voice menu without earcon. In the earcon applied to voice menu test, it showed the accuracy of 92.50%, but in voice menu without earcon test, people could only recall 66.25% among given questions. The response time was reduced from 4.98 sec to 3.85 sec. In addition, this experiment showed the 87.5% of participants preferred the earcon applied to voice menu.

• 한국멀티미디어학회논문지
• /
• 제22권11호
• /
• pp.1215-1222
• /
• 2019

Recently, people with disabilities also search for and collect information from the web through smart devices, and save collected information on smart devices or take notes. For non-disabled people, various memo applications are provided on the market, so it is more convenient to choose according to their preference. However, existing memo services are limited for use by blind people due to the importance of visual information. The problem with blind people when using smart devices is that the screen is not recognized, so it is not possible to check in which location the menu of the application exists. In addition, it is difficult to input and manipulate text, and systematic file management and control are not possible. Therefore, in this paper, we propose the development of voice memo service that blind people can use only voice and hearing information and can operate menu with Bluetooth remote controller. We will develop a system that includes a comprehensive voice file management function for storing, searching, playing, and deleting files, rather than simply storing voice files.

• 한국정보통신학회논문지
• /
• 제15권2호
• /
• pp.462-470
• /
• 2011

음성자동응답시스템(Automatic Response Systems, ARS)은 VUI(Voice User Interface)와 TTI(Touch Tone Interface)를 기반으로 하고 있으며, 현재 가장 널리 사용되는 커뮤니케이션 시스템 중 하나이다. 그러나 많은 사용에도 불구하고, ARS에 대한 불편 사항들이 끊임없이 지적되고 있다. 이는 기술 개발을 넘어, 사용자와 사용성에 대한 체계적인 연구 부족에서 기인한 측면이 있다. 본 논문에서는 ARS 메뉴체계에서의 사용성 저해 요소를 발견 분석하여, ARS 설계를 위한 개선의 지침을 제공한다. 두 개의 인터넷 서점 ARS를 선정하여 피실험자들이 "도서 반품 신청하기"라는 작업을 실행한 후 정해진 설문조사 결과와 인터뷰 내용을 분석하였다. 본 연구에서 메뉴 구조의 복잡성, 메뉴명의 대표성 부족, 사용자 위치인지의 어려움, 메뉴간 이동의 어려움 등 네 가지 문제들을 발견하였고, 이를 피할 수 있는 방법들을 논의하였다.

• 한국정보과학회논문지:컴퓨팅의 실제 및 레터
• /
• 제11권2호
• /
• pp.101-111
• /
• 2005

현재의 웹정보들은 주로 HTML로 기술되어 있으며, 이러한 정보를 얻기 위해 사용자들은 마우스와 키보드와 같은 입력장치를 사용한다. 이와 같이 기존의 GUI 환경은 인간의 가장 자연스러운 정보획득 수단의 하나인 음성을 지원하지 못하고 있다. 이러한 문제를 해결하기 위해 음성 인터페이스를 가진 여러 제품들이 개발되고 있다. 하지만 이들은 상호대화성이나 기존 웹환경을 수용한다는 측면에서 부족한 면을 가지고 있다. 본 논문에서는 현재 무르익어 가는 음성인식 기술과 XML의 파생언어인 VoiceXML을 이용하여, 기존의 인터페이스 환경을 XML 기반의 대화형 음성인터페이스 환경으로 대체하고자 한다. 이를 통해 기존의 인터페이스 환경을 수용한 VUI(Voice User Interface) 환경을 사용자에게 제공할 수 있다. 기존의 환경을 수용하기 위해 "XML Island" 기술을 이용하여 VoiceXML 문서를 HTML 문서에 포함시키며, 대표적인 정보획득화면인 메뉴, 게시판, 검색 엔진에 대한 대화형 음성 시나리오를 제안하고 있다.

• 대한인간공학회지
• /
• 제32권6호
• /
• pp.517-528
• /
• 2013

Objective: The objective of this study was to suggest a multi-modal controller type for Smart TV Control. Background: Recently, many issues regarding the Smart TV are arising due to the rising complexity of features in a Smart TV. One of the specific issues involves what type of controller must be utilized in order to perform regulated tasks. This study examines the ongoing trend of the controller. Method: The selected participants had experiences with the Smart TV and were 20 to 30 years of age. A pre-survey determined the first independent variable of five tasks(Live TV, Record, Share, Web, App Store). The second independent variable was the type of controllers(Conventional, Mouse, Voice-Based Remote Controllers). The dependent variables were preference, task completion time, and error rate. The experiment consist a series of three experiments. The first experiment utilized a uni-modal Controller for tasks; the second experiment utilized a dual-modal Controller, while the third experiment utilized a triple-modal Controller. Results: The first experiment revealed that the uni-modal Controller (Conventional, Voice Controller) showed the best results for the Live TV task. The second experiment revealed that the dual-modal Controller(Conventional-Voice, Conventional-Mouse combinations) showed the best results for the Share, Web, App Store tasks. The third experiment revealed that the triple-modal Controller among all the level had not effective compared with dual-modal Controller. Conclusion: In order to control simple tasks in a smart TV, our results showed that a uni-modal Controller was more effective than a dual-modal controller. However, the control of complex tasks was better suited to the dual-modal Controller. User preference for a controller differs according the Smart TV functions. For instance, there was a high user preference for the uni-Controller for simple functions while high user preference appeared for Dual-Controllers when the task was complex. Additionally, in accordance with task characteristics, there was a high user preference for the Voice Controller for channel and volume adjustment. Furthermore, there was a high user preference for the Conventional Controller for menu selection. In situations where the user had to input text, the Voice Controller had the highest preference among users while the Mouse Type, Voice Controller had the highest user preference for performing a search or selecting items on the menu. Application: The results of this study may be utilized in the design of a controller which can effectively carry out the various tasks of the Smart TV.

• 실천공학교육논문지
• /
• 제14권1호
• /
• pp.99-108
• /
• 2022

최근에 늘어가는 키오스크(KIOSK)의 수요에 따라 불편함을 호소하는 이용자가 많아졌다. 이에 음성 기반 대화형 서비스를 구현하여 손쉽게 메뉴 선택 및 주문을 가능하게 해주는 키오스크를 제작해 웹의 형태로 제공한다. Annyang API와 SpeechSynthesis API를 바탕으로 음성 기능을 구현하고 Dialogflow를 통해 사용자의 의도를 파악하는 과정을 Rest API를 기반으로 구현하는 방법에 대해 논한다. 또한 협업 필터링을 기반으로 추천 시스템을 적용하여 기존 키오스크의 낮은 소비자 접근성을 개선하였고, 음성인식 서비스 이용 도중 발생하는 비말로 인한 감염을 예방하기 위해 서비스 이용 전 마스크 착용을 확인하는 기능을 제공한다.

• 사상체질의학회지
• /
• 제16권1호
• /
• pp.61-73
• /
• 2004

This study was prepared to investigate the correlation between Sasang constitutional groups and voice characteristics using voice analysis system(in this study, CSL). I focused on the voice characteristics in terms of harmonics, Formant frequency and Formant Bandwidth. The subjects were 71 males. I classified them into three groups, that is Soeumin group, Soyangin group and Taeumin group. The classification method of Constitution used two ways, QSCCII(Questionnarie for the Sasang Constitution Classification II) and Interview with a specialist in Sasang Constitution. So 71 people were categorized into 31 Soeumin(people), 18 Soyangin(people) and 22 Taeumin(people). Pitch is approximately similar to the fundamental frequency(F0) in voices. Shimmer in dB gives an evaluation of the period-to-period variability of the peak-to-peak amplitude within the analyzed voice sample. FFT(Fast Fourier Transform) method in CSL can display sampled voices into harmonics. H1 is the first peak and h2 is the second peak in the harmonics. The amplitude difference of h1 and h2(h1-h2) can be explained as the speaker's phonation type, And Formant frequency and bandwidth can be explained as the speaker's vocal tract. So I checked the harmonics and Formant frequency and Bandwidth as the voice parameters. First I have captured /e/ voices from all subjects using microphone. And then I analyzed /e/ voices with CSL. Power Spectrum and Formant History is the menu in the CSL which can display harmonics and Formant frequency and bandwidth. The results about the correlation between Sasang Constitutional Groups and voice parameters are as follows; 1. There is no significant amplitude difference of harmonics(h1-h2) among three groups. 2. There is the significant difference between Soeumin Group and Soyangin Group in Formant Frequency 1 and Formant Bandwidth 1(p<0.05). Any other parameters have no significance. I assume that Soyangin Group has clearer and brighter voice than Soeumin Group according to the Formant Bandwidth difference. And I think its result has coincidence with the context of "Dongyi Suse Bowon" and "Sasangimhejinam".

• 한국멀티미디어학회논문지
• /
• 제23권12호
• /
• pp.1454-1463
• /
• 2020

An important factor in eye-tracking PC interface for general paralyzed patients is the implementation of the mouse interface, for manipulating the GUI. With a successfully implemented mouse interface, users can generate mouse events exactly at the point of their choosing. However, it is difficult to define this interaction in the eye-tracking interface. This problem has been defined as the Midas touch problem and has been a major focus of eye-tracking research. There have been many attempts to solve this problem using blink, voice input, etc. However, it was not suitable for general paralyzed patients because some of them cannot wink or speak. In this paper, we propose a mouth-pop-up, eye-tracking mouse interface that solves the Midas touch problem as well as becoming a suitable interface for general paralyzed patients using a common RGB camera. The interface presented in this paper implements a mouse interface that detects the opening and closing of the mouth to activate a pop-up menu that the user can select the mouse event. After implementation, a performance experiment was conducted. As a result, we found that the number of malfunctions and the time to perform tasks were reduced compared to the existing method.

• 한국전자통신학회논문지
• /
• 제17권6호
• /
• pp.1121-1128
• /
• 2022

본 논문에서는 일상생활 마이크에 원하는 정보를 입력했을 때 스피커를 통해 그에 대한 정보를 출력하는 스마트 미러를 제작하였다. 스마트 미러의 화면은 LCD 모니터를 사용하여 아크릴판이 결합하여 있는 액자에 하프미러를 붙여 디스플레이를 제외한 공간에는 빛이 투과되지 않도록 하여 거울 기능을 할 수 있게 만들었다. 소프트웨어 구성 중 Raspbian을 이용하여 시스템 환경을 구축하였다. 기본 메뉴는 실제 기능적인 부분에 있어서 사용되는 거울을 통해 다양한 정보를 제공할 수 있는 스마트 미러를 라즈베리 파이를 이용하여 개발하였다. 개발된 스마트 미러는 시간, 날씨, 구글 캘린더, 유튜브 음악, 웹브라우저 검색 기능 등의 다양한 정보를 제공하며, 핸드폰 무선 충전도 가능하게 하드웨어를 제작하였다. 기존의 스마트 미러는 미리 입력된 데이터 혹은 GUI 기능만 수행할 수 있었다면 본 논문의 스마트 미러는 'Google Assistant'를 연동하여 기존의 설정한 기능뿐만 아니라 알고리즘 검색을 활용하여 웹사이트 정보를 제공한다.

• 음성과학
• /
• 제9권4호
• /
• pp.237-252
• /
• 2002

MIT has been applied for nonfluent aphasic patients on the basis of lateralization of brain hemisphere. However, its applications for different languages have some inquiry for aphasic patients because of prosodic and rhythmic differences. The purpose of this study is to develop the Korean Melodic Intonation Therapy program using personal computer and its clinical effects for nonfluent aphasic patients. The algorithm was composed to voice analog signal, PCM, AMDF, Short-time autocorrelation function and center clipping. The main menu contains pitch, waveform, sound intensity and speech files on window. Aphasic patients' intonation patterns overlay on selected kMIT patterns. Three aphasic patients with or without kMIT training participated in this study. Four affirmative sentences and two interrogative sentences were uttered on CSL by stimulus of ST. VOT, VD, Hold and TD were measured on Spectrogram. In addition, articulation disorders and intonation patterns were evaluated objectively on spectrogram. The results indicated that nonfluent aphasic patients with kMIT training group showed some clinical effects of speech intelligibility based on VOT, TD values, articulation evaluation and prosodic pattern changes.