• 한국HCI학회:학술대회논문집
• /
• 2007.02b
• /
• pp.226-232
• /
• 2007

모바일폰의 LCD 전면화 추세로 인해 터치스크린을 기반으로 하는 모바일폰이 컨셉폰의 형태로 선보여지고 있고, 부분적으로 터치스크린을 차용한 모바일폰이 국내, 국외에 출시되고 있다. 터치스크린은 간편하고 직관적인 조작감을 제공하며 유동적인 인터페이스를 가능하게 하는 장점이 있다. 그리고 이러한 터치스크린의 장점을 적극적으로 활용할 수 있도록 하는 진보된 인터랙션 스타일도 다양하게 제안되고 있다. 하지만 기존의 터치스크린 기반의 모바일폰은 스타일러스를 그대로 사용하듯, 제한적이고 전형적인 인터렉션만을 제공하고 있고, 제안된 진보된 인터렉션 스타일들도 터치스크린 기반의 모바일폰에 직접적으로 활용하기는 어려운 실정이다. 본 연구는 진보된 인터랙션 스타일 중에서, 원 포인팅과 2개 이상의 포인팅이 가능한 멀티 포인팅 인터랙션을 연구하여 터치스크린기반의 Full LCD 모바일폰에 적합한 인터랙션 스타일을 제안한다. 이를 위해, 인터랙션에 대한 문헌연구와 함께 터치스크린을 기반으로 하는 다양한 디지털기기를 검토해보고, 터치스크린에 적용 가능한 진보된 인터랙션 사례들을 조사하였다. 그 후 터치디스크린 기반의 디지털기기를 사용하는 사용자의 행태를 파악하기 위한 유저테스트 및 인터뷰를 실시하여, 터치스크린 기반의 모바일폰에서 구현되어야 할 상세 인터랙션 스타일을 도출하였다. 본 연구에서 제안된 인터랙션 스타일은 다양한 사용자 경험을 가능하게 하여 고기능, 고사양화 되어가는 모바일폰의 UI를 보다 효과적으로 사용하는데 도움을 줄 것으로 기대된다.

• Phonetics and Speech Sciences
• /
• v.6 no.4
• /
• pp.141-148
• /
• 2014

Voice is the most common means for communication, but some people have difficulties in generating voice due to their congenital or acquired disorders. Individuals with speech disorders might lose their speaking ability due to hearing impairment, encephalopathy or cerebral palsy accompanied by motor skill impairments, or autism caused by mental problems. However, they have needs for communication, so some of them use various types of AAC (Augmentative & Alternative Communication) devices in order to meet their communication needs. In this paper, a mobile application for literate people having speech disorder was designed and implemented by developing accurate and fast sentence-completion functions for efficient user interaction. From a user study and the previous study on Korean text-based communication for adults having difficulty in speech communication, we identified functionality and usability requirements. Specifically, the user interface with scanning features was designed by considering the users' motor skills in using the touch-screen of a mobile device. Finally, we conducted the usability test for the application. The results of the usability test show that the application is easy to learn and efficient to use in communication with people with speech disorders.

• Journal of the HCI Society of Korea
• /
• v.2 no.2
• /
• pp.27-34
• /
• 2007

In ubiquitous computing, there is increasing demand for ubiquitous displays that react to a user's actions. We propose a method of navigating pictures on an ambient display using implicit interactions. The ambient display can identify the user and measure how far away they are using an RFID reader and ultrasonic sensors. When the user is a long way from the display, it acts as a digital picture and does not attract attention. When the user comes within an appropriate range for interaction, the display shows pictures that are related to the user and provides quasi-3D navigation using the TIP(tour into the picture) method. In addition, menus can be manipulated directly on a touch-screen or remotely using an air mouse. In an emergency, LEDs around the display flash to alert the user.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.36 no.6B
• /
• pp.674-682
• /
• 2011

The multi-function console system in ships has currently exposed operational difficulties due to its complex interfaces although it supports a variety of functionalities. In this paper the concept of a human computer interaction (HCI) based multi-function console system is proposed, which can support intuitive operation environments by the analysis of users' needs to shipboard systems. Expert interviews and surveys are carried out in order to obtain users' requirements. Through the survey results, the HCI based multi-function console system is conceptually designed, which is optimized to the input of multi-touch screen. It is expected that the HCI based multi-function console system can provide ship operators with easy interfaces to the console system as well as safe operation in a rough ocean environment.

• Journal of the HCI Society of Korea
• /
• v.11 no.2
• /
• pp.15-22
• /
• 2016

The ways to interact with digital appliances are becoming more diverse. Users can control appliances using a remote control and a touch-screen, and appliances can send users feedback through various ways such as sound, voice, and visual signals. However, there is little research on how to define which output method to use for providing feedback according to the user' input method. In this study, we designed an experimental study that seeks to identify how to appropriately match the output method - voice and sound - based on the user input - voice and button. We made four types of interaction with two kinds input methods and two kinds of output methods. For the four interaction types, we compared the usability, perceived satisfaction, preference and suitability. Results reveals that the output method affects the ease of use and perceived satisfaction of the input method. The voice input method with sound feedback was evaluated more satisfying than with the voice feedback. However, the keying input method with voice feedback was evaluated more satisfying than with sound feedback. The keying input method was more dependent on the output method than the voice input method. We also found that the feedback method of appliances determines the perceived appropriateness of the interaction.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2008.05a
• /
• pp.209-212
• /
• 2008

During several years, lots of industrial and individual products have been developed based on the text or graphic LCD module which has been gave the short developing period to the developer. With the advent of home networks and intelligent robots, the need for interaction between human and instruments has been increased. Recently, goods with a TFT-LCD come out. But in spite of a simple required performance, the complicated microprocessor, such as ARM processor, is required to interface the TFT-LCD and touch screen. Our research and development is to develope an embedded TFT-LCD module in order to use or apply to the goods through the simple interface by the general users as well as the developers. We adopt the RTOS(real time operating system) in order to operate TFT-LCD independently and various communication protocols are provided in order to offer the simple interface to users and developers.

• Journal of Intelligence and Information Systems
• /
• v.17 no.1
• /
• pp.53-69
• /
• 2011

Vision and voice-based technologies are commonly utilized for human-robot interaction. But it is widely recognized that the performance of vision and voice-based interaction systems is deteriorated by a large margin in the real-world situations due to environmental and user variances. Human users need to be very cooperative to get reasonable performance, which significantly limits the usability of the vision and voice-based human-robot interaction technologies. As a result, touch screens are still the major medium of human-robot interaction for the real-world applications. To empower the usability of robots for various services, alternative interaction technologies should be developed to complement the problems of vision and voice-based technologies. In this paper, we propose the use of accelerometer-based gesture interface as one of the alternative technologies, because accelerometers are effective in detecting the movements of human body, while their performance is not limited by environmental contexts such as lighting conditions or camera's field-of-view. Moreover, accelerometers are widely available nowadays in many mobile devices. We tackle the problem of classifying acceleration signal patterns of 26 English alphabets, which is one of the essential repertoires for the realization of education services based on robots. Recognizing 26 English handwriting patterns based on accelerometers is a very difficult task to take over because of its large scale of pattern classes and the complexity of each pattern. The most difficult problem that has been undertaken which is similar to our problem was recognizing acceleration signal patterns of 10 handwritten digits. Most previous studies dealt with pattern sets of 8~10 simple and easily distinguishable gestures that are useful for controlling home appliances, computer applications, robots etc. Good features are essential for the success of pattern recognition. To promote the discriminative power upon complex English alphabet patterns, we extracted 'motion trajectories' out of input acceleration signal and used them as the main feature. Investigative experiments showed that classifiers based on trajectory performed 3%~5% better than those with raw features e.g. acceleration signal itself or statistical figures. To minimize the distortion of trajectories, we applied a simple but effective set of smoothing filters and band-pass filters. It is well known that acceleration patterns for the same gesture is very different among different performers. To tackle the problem, online incremental learning is applied for our system to make it adaptive to the users' distinctive motion properties. Our system is based on instance-based learning (IBL) where each training sample is memorized as a reference pattern. Brute-force incremental learning in IBL continuously accumulates reference patterns, which is a problem because it not only slows down the classification but also downgrades the recall performance. Regarding the latter phenomenon, we observed a tendency that as the number of reference patterns grows, some reference patterns contribute more to the false positive classification. Thus, we devised an algorithm for optimizing the reference pattern set based on the positive and negative contribution of each reference pattern. The algorithm is performed periodically to remove reference patterns that have a very low positive contribution or a high negative contribution. Experiments were performed on 6500 gesture patterns collected from 50 adults of 30~50 years old. Each alphabet was performed 5 times per participant using $Nintendo{(R)}$ $Wii^{TM}$ remote. Acceleration signal was sampled in 100hz on 3 axes. Mean recall rate for all the alphabets was 95.48%. Some alphabets recorded very low recall rate and exhibited very high pairwise confusion rate. Major confusion pairs are D(88%) and P(74%), I(81%) and U(75%), N(88%) and W(100%). Though W was recalled perfectly, it contributed much to the false positive classification of N. By comparison with major previous results from VTT (96% for 8 control gestures), CMU (97% for 10 control gestures) and Samsung Electronics(97% for 10 digits and a control gesture), we could find that the performance of our system is superior regarding the number of pattern classes and the complexity of patterns. Using our gesture interaction system, we conducted 2 case studies of robot-based edutainment services. The services were implemented on various robot platforms and mobile devices including $iPhone^{TM}$. The participating children exhibited improved concentration and active reaction on the service with our gesture interface. To prove the effectiveness of our gesture interface, a test was taken by the children after experiencing an English teaching service. The test result showed that those who played with the gesture interface-based robot content marked 10% better score than those with conventional teaching. We conclude that the accelerometer-based gesture interface is a promising technology for flourishing real-world robot-based services and content by complementing the limits of today's conventional interfaces e.g. touch screen, vision and voice.

• KIPS Transactions on Computer and Communication Systems
• /
• v.9 no.11
• /
• pp.281-290
• /
• 2020

With the spread of smartphones, services that want to use personalized data are increasing. In particular, healthcare-related services deal with a variety of data, and data visualization techniques are used to effectively show this. As data visualization techniques are used, interactions in visualization are also naturally emphasized. In the PC environment, since the interaction for data visualization is performed with a mouse, various filtering for data is provided. On the other hand, in the case of interaction in a mobile environment, the screen size is small and it is difficult to recognize whether or not the interaction is possible, so that only limited visualization provided by the app can be provided through a button touch method. In order to overcome the limitation of interaction in such a mobile environment, we intend to enable data visualization interactions through conversations with chatbots so that users can check individual data through various visualizations. To do this, it is necessary to convert the user's query into a query and retrieve the result data through the converted query in the database that is storing data periodically. There are many studies currently being done to convert natural language into queries, but research on converting user queries into queries based on visualization has not been done yet. Therefore, in this paper, we will focus on query generation in a situation where a data visualization technique has been determined in advance. Supported interactions are filtering on task x-axis values and comparison between two groups. The test scenario utilized data on the number of steps, and filtering for the x-axis period was shown as a bar graph, and a comparison between the two groups was shown as a line graph. In order to develop a natural language processing model that can receive requested information through visualization, about 15,800 training data were collected through a survey of 1,000 people. As a result of algorithm development and performance evaluation, about 89% accuracy in classification model and 99% accuracy in query generation model was obtained.

• Asia Marketing Journal
• /
• v.14 no.1
• /
• pp.25-51
• /
• 2012

Researches about the relationship between SST(Self Service Technology) and TRI(Technology Readiness Index) have been carried out after TRI was developed by Parasuraman and his colleagues(2000). We hypothesize Consumer Readiness can also influence consumer's motivation, attitude, and intent to use SST. Currently, there has been no research on this subject. In this study, we investigated the relationship between TR, Consumer Readiness and SST Core Attitudinal Model which Dabholkar & Bagozzi(1994) proposed. The researchers also investigated moderating effects of consumer traits and situational factors to verify the acceptance of such forms of service delivery by all kinds of consumers and under different situational contexts. Self consciousness, the need for interaction with an employee, and the technology anxiety were used as consumer trait variables. Perceived waiting time and perceived crowding were used as situational variables. 380 questionnaires were distributed to a sample group of people in their 20's and 30's, and the data were analyzed with structural equation model using AMOS 18.0 program. All of Cronbach's alpha values representing reliabilities were satisfactory. The values of Composite Reliability(CR) and Average Variance Extracted(AVE) also showed the above criteria, thus providing evidence of convergent validity. To confirm discriminant validity among the constructs, confirmatory factor analysis and correlations among all the variables were examined. The results were satisfactory. The results of this study are summarized as follows. 1. Optimism and innovativeness of TR partially influenced the motivation to use SST. People who tend to be optimistic use SST because of ease of use and fun. The innovative however, usually use SST due to its performance. However, consumer readiness of role clarity, ability and self-efficacy influence all the components of motivation to use SST, ease of use, performance and fun. The relative effect of consumer readiness on the motivation to use SST was much stronger and more significant than that of TR. No other previous studies have examined the effects of Consumer Readiness on SST usage motivation, attitude and intention. It is academically meaningful that the researchers verified that Consumer Readiness is the important precedent construct influencing the self service technology core Attitudinal Model. Our findings suggest that marketers should consider fun and ease of use attributes to promote the use of self service technology. In addition, the SST usage frequency will rise rapidly when role clarity, ability, and self-efficacy which anybody can easily handle SST is assured. If the SST usage rate is increased, waiting times for customers could be decreased. Shorter waiting time could lead to higher customer satisfaction. It may also result in making a long-term profit owing to the reduced number of employees. Thus, presentation of using SST by employees or videos showing how to use it will promote the usage attitude and intent. 2. In SST core attitudinal model, performance and fun factors among SST usage motivation affected attitudes of using SST. The attitude of using SST highly influenced intent to use SST. This result is consistent with previous researches that dealt with the relationship between motivation, attitude and intention. Expectation of using SST could result in good performance just like the effect of ordering menu to service employees and to have fun since fun during its use could promote more SST usage rate. 3. In the relationship among motivation, attitude and intent in SST core attitudinal model, the moderating effect of consumer traits(self-consciousness, need for interaction with service employees and technology anxiety) and situational factors(perceived crowding and perceived waiting time) were tested. The results also supported the hypothesized moderating effects except perceived crowding. The highly self-conscious tended to form attitudes to use SST because of its fun compared to those who were less self-conscious because of its performance. People who had a high need for interaction with service employees tended to use SST for its performance. This result indicates that if ordering results are assured, SST is easily accessible to even consumers who have a high need for interaction with a service employee. When SST is easy to use, attitudes strengthen intent among people who had a high level of anxiety of technology. People who had low technology anxiety formed attitudes to use SST because of its performance. Service firms must ensure their self service technology is designed to be easy to use for those who have a high level of technology anxiety. Shorter perceived waiting times strengthened the attitude to use self service technology because of its fun. If the fun aspect is assured, people willing to use self service technology even perceive waiting time to be shorter than it actually is. Greater perceived waiting times form higher level of intent to use self service technology than those of shorter perceived waiting times. This implies that people view self service technology as a faster alternative to ordering service employees. The fun aspect of self service technology will attract a higher rate of usage for self service technology. 4. It has been proven that ease of use, performance and fun aspects are very important factors in motivation to form attitudes and intent to use self service technology regardless of the amount of perceived waiting time, self-consciousness, need for interaction with service employees, and technology anxiety. Service firms must consider these motivation aspects(ease of use, performance and fun)strongly in their promotion to use self service technology. Ease of use, assuring absolute performance compared to interaction with service employees', and adding a fun aspect will positively strengthen consumers' attitudes and intent to use self service technology. Summarizing the moderating effects, fun is the most valuable factor triggering SST usage attitude and intention. Therefore, designing self service technology to be fun will be the key to its success. This study focused on the touch screen self service technology in fast food restaurant. Although it has its limits due to the fact that it is hard to generalize the results to any other self service technology, the conceptual framework of this study can be applied to future research of any other service site.

• Cartoon and Animation Studies
• /
• s.41
• /
• pp.533-552
• /
• 2015

The environment of images in VR-based animation is constructed to generate and promote interactivity between the images and the viewer without any physical space like a screen, or a monitor. In this process, the images and the viewer are combined as a complex through the media technology, that is, an interface. And it is far more in the case of the animation consisted of the bio-feedback interface closely connecting with the body of viewer. As a result, the viewer experiences a permeable interaction between ego and images world, namely virtual reality. That is different from the way of seeing and interpreting the images from a distance. So it needs to analyse the perception of viewer in the world of virtual images. This paper examines the complex phenomena of both the VR-based animation and the viewer mediated by the interface in light of Media Aesthetics. Media Aesthetics is effective in analysing the phenomena of VR-based animation, for it is concerned with the perception of viewer mediated by the media technology. The perception in VR-based animation is a full-body immersion, or embodied immersion, and it is different from the contemplative immersion in that it is remediated continuously by the technological apparatus. The viewer as an immersant, especially with a bio-feedback interface, can immediately touch and control the images in VR-based animation. Such an immersion, therefore, is new every single moment. And the world of VR-based animation is ultimately constructed through the viewer's full-body, or embodied immersion crossing between the virtual and the real. So the animation is not interpreted, but embodied. And the meaning of it is constructed and reconstructed by the viewer's embodied immersion as an immersant. Here, a new frame of animation more oriented to the viewer's participation as an full-body immersant can be created.