• Journal of Intelligence and Information Systems
• /
• v.17 no.1
• /
• pp.53-69
• /
• 2011

Vision and voice-based technologies are commonly utilized for human-robot interaction. But it is widely recognized that the performance of vision and voice-based interaction systems is deteriorated by a large margin in the real-world situations due to environmental and user variances. Human users need to be very cooperative to get reasonable performance, which significantly limits the usability of the vision and voice-based human-robot interaction technologies. As a result, touch screens are still the major medium of human-robot interaction for the real-world applications. To empower the usability of robots for various services, alternative interaction technologies should be developed to complement the problems of vision and voice-based technologies. In this paper, we propose the use of accelerometer-based gesture interface as one of the alternative technologies, because accelerometers are effective in detecting the movements of human body, while their performance is not limited by environmental contexts such as lighting conditions or camera's field-of-view. Moreover, accelerometers are widely available nowadays in many mobile devices. We tackle the problem of classifying acceleration signal patterns of 26 English alphabets, which is one of the essential repertoires for the realization of education services based on robots. Recognizing 26 English handwriting patterns based on accelerometers is a very difficult task to take over because of its large scale of pattern classes and the complexity of each pattern. The most difficult problem that has been undertaken which is similar to our problem was recognizing acceleration signal patterns of 10 handwritten digits. Most previous studies dealt with pattern sets of 8~10 simple and easily distinguishable gestures that are useful for controlling home appliances, computer applications, robots etc. Good features are essential for the success of pattern recognition. To promote the discriminative power upon complex English alphabet patterns, we extracted 'motion trajectories' out of input acceleration signal and used them as the main feature. Investigative experiments showed that classifiers based on trajectory performed 3%~5% better than those with raw features e.g. acceleration signal itself or statistical figures. To minimize the distortion of trajectories, we applied a simple but effective set of smoothing filters and band-pass filters. It is well known that acceleration patterns for the same gesture is very different among different performers. To tackle the problem, online incremental learning is applied for our system to make it adaptive to the users' distinctive motion properties. Our system is based on instance-based learning (IBL) where each training sample is memorized as a reference pattern. Brute-force incremental learning in IBL continuously accumulates reference patterns, which is a problem because it not only slows down the classification but also downgrades the recall performance. Regarding the latter phenomenon, we observed a tendency that as the number of reference patterns grows, some reference patterns contribute more to the false positive classification. Thus, we devised an algorithm for optimizing the reference pattern set based on the positive and negative contribution of each reference pattern. The algorithm is performed periodically to remove reference patterns that have a very low positive contribution or a high negative contribution. Experiments were performed on 6500 gesture patterns collected from 50 adults of 30~50 years old. Each alphabet was performed 5 times per participant using $Nintendo{(R)}$ $Wii^{TM}$ remote. Acceleration signal was sampled in 100hz on 3 axes. Mean recall rate for all the alphabets was 95.48%. Some alphabets recorded very low recall rate and exhibited very high pairwise confusion rate. Major confusion pairs are D(88%) and P(74%), I(81%) and U(75%), N(88%) and W(100%). Though W was recalled perfectly, it contributed much to the false positive classification of N. By comparison with major previous results from VTT (96% for 8 control gestures), CMU (97% for 10 control gestures) and Samsung Electronics(97% for 10 digits and a control gesture), we could find that the performance of our system is superior regarding the number of pattern classes and the complexity of patterns. Using our gesture interaction system, we conducted 2 case studies of robot-based edutainment services. The services were implemented on various robot platforms and mobile devices including $iPhone^{TM}$. The participating children exhibited improved concentration and active reaction on the service with our gesture interface. To prove the effectiveness of our gesture interface, a test was taken by the children after experiencing an English teaching service. The test result showed that those who played with the gesture interface-based robot content marked 10% better score than those with conventional teaching. We conclude that the accelerometer-based gesture interface is a promising technology for flourishing real-world robot-based services and content by complementing the limits of today's conventional interfaces e.g. touch screen, vision and voice.

• KIPS Transactions on Computer and Communication Systems
• /
• v.9 no.11
• /
• pp.281-290
• /
• 2020

With the spread of smartphones, services that want to use personalized data are increasing. In particular, healthcare-related services deal with a variety of data, and data visualization techniques are used to effectively show this. As data visualization techniques are used, interactions in visualization are also naturally emphasized. In the PC environment, since the interaction for data visualization is performed with a mouse, various filtering for data is provided. On the other hand, in the case of interaction in a mobile environment, the screen size is small and it is difficult to recognize whether or not the interaction is possible, so that only limited visualization provided by the app can be provided through a button touch method. In order to overcome the limitation of interaction in such a mobile environment, we intend to enable data visualization interactions through conversations with chatbots so that users can check individual data through various visualizations. To do this, it is necessary to convert the user's query into a query and retrieve the result data through the converted query in the database that is storing data periodically. There are many studies currently being done to convert natural language into queries, but research on converting user queries into queries based on visualization has not been done yet. Therefore, in this paper, we will focus on query generation in a situation where a data visualization technique has been determined in advance. Supported interactions are filtering on task x-axis values and comparison between two groups. The test scenario utilized data on the number of steps, and filtering for the x-axis period was shown as a bar graph, and a comparison between the two groups was shown as a line graph. In order to develop a natural language processing model that can receive requested information through visualization, about 15,800 training data were collected through a survey of 1,000 people. As a result of algorithm development and performance evaluation, about 89% accuracy in classification model and 99% accuracy in query generation model was obtained.

• Cartoon and Animation Studies
• /
• s.41
• /
• pp.533-552
• /
• 2015

The environment of images in VR-based animation is constructed to generate and promote interactivity between the images and the viewer without any physical space like a screen, or a monitor. In this process, the images and the viewer are combined as a complex through the media technology, that is, an interface. And it is far more in the case of the animation consisted of the bio-feedback interface closely connecting with the body of viewer. As a result, the viewer experiences a permeable interaction between ego and images world, namely virtual reality. That is different from the way of seeing and interpreting the images from a distance. So it needs to analyse the perception of viewer in the world of virtual images. This paper examines the complex phenomena of both the VR-based animation and the viewer mediated by the interface in light of Media Aesthetics. Media Aesthetics is effective in analysing the phenomena of VR-based animation, for it is concerned with the perception of viewer mediated by the media technology. The perception in VR-based animation is a full-body immersion, or embodied immersion, and it is different from the contemplative immersion in that it is remediated continuously by the technological apparatus. The viewer as an immersant, especially with a bio-feedback interface, can immediately touch and control the images in VR-based animation. Such an immersion, therefore, is new every single moment. And the world of VR-based animation is ultimately constructed through the viewer's full-body, or embodied immersion crossing between the virtual and the real. So the animation is not interpreted, but embodied. And the meaning of it is constructed and reconstructed by the viewer's embodied immersion as an immersant. Here, a new frame of animation more oriented to the viewer's participation as an full-body immersant can be created.

• Journal of Intelligence and Information Systems
• /
• v.19 no.3
• /
• pp.45-55
• /
• 2013

Thereby using smartphone and mobile device be more popular the more people utilize mobile device in many area such as education, news, financial. In January, 2007 Apple release i-phone it touch off rapid increasing in user of smartphone and it create new market and these broaden its utilization area. Smartphone use WiFi or 3G mobile radio communication network and it has a feature that can access to internet whenever and anywhere. Also using smartphone application people can search arrival time of public transportation in real time and application is used in mobile banking and stock trading. Computer's function is replaced by smartphone so it involves important user's information such as financial and personal pictures, videos. Present smartphone security systems are not only too simple but the unlocking methods are spreading out covertly. I-phone is secured by using combination of number and character but USA's IT magazine Engadget reveal that it is easily unlocked by using combination with some part of number pad and buttons Android operation system is using pattern system and it is known as using 9 point dot so user can utilize various variable but according to Jonathan smith professor of University of Pennsylvania Android security system is easily unlocked by tracing fingerprint which remains on the smartphone screen. So both of Android and I-phone OS are vulnerable at security threat. Compared with problem of password and pattern finger recognition has advantage in security and possibility of loss. The reason why current using finger recognition smart phone, and device are not so popular is that there are many problem: not providing reasonable price, breaching human rights. In addition, finger recognition sensor is not providing reasonable price to customers but through continuous development of the smartphone and device, it will be more miniaturized and its price will fall. So once utilization of finger recognition is actively used in smartphone and if its utilization area broaden to financial transaction. Utilization of biometrics in smart device will be debated briskly. So in this thesis we will propose fingerprint numbering system which is combined fingerprint and password to fortify existing fingerprint recognition. Consisted by 4 number of password has this kind of problem so we will replace existing 4number password and pattern system and consolidate with fingerprint recognition and password reinforce security. In original fingerprint recognition system there is only 10 numbers of cases but if numbering to fingerprint we can consist of a password as a new method. Using proposed method user enter fingerprint as invested number to the finger. So attacker will have difficulty to collect all kind of fingerprint to forge and infer user's password. After fingerprint numbering, system can use the method of recognization of entering several fingerprint at the same time or enter fingerprint in regular sequence. In this thesis we adapt entering fingerprint in regular sequence and if in this system allow duplication when entering fingerprint. In case of allowing duplication a number of possible combinations is $\sum_{I=1}^{10}\;{_{10}P_i}$ and its total cases of number is 9,864,100. So by this method user retain security the other hand attacker will have a number of difficulties to conjecture and it is needed to obtain user's fingerprint thus this system will enhance user's security. This system is method not accept only one fingerprint but accept multiple finger in regular sequence. In this thesis we introduce the method in the environment of smartphone by using multiple numbered fingerprint enter to authorize user. Present smartphone authorization using pattern and password and fingerprint are exposed to high risk so if proposed system overcome delay time when user enter their finger to recognition device and relate to other biometric method it will have more concrete security. The problem should be solved after this research is reducing fingerprint's numbering time and hardware development should be preceded. If in the future using fingerprint public certification becomes popular. The fingerprint recognition in the smartphone will become important security issue so this thesis will utilize to fortify fingerprint recognition research.

• Trans-
• /
• v.9
• /
• pp.17-36
• /
• 2020

This study is aimed at discussing the possibility of content production, utilization and expansion, focusing on the exhibition case of Danwon Art Museum run by Ansan Cultural Foundation. In 1991, the Ministry of Culture, Sports and Tourism named Ansan as the City of Danwon since it is believed to be the hometown of Danwon Kim Hong-do (1745~?), a painter of the late Joseon Dynasty and a well-known master of genre painting. As a result, Ansan is making various efforts to utilize Danwon Kim Hong-do for its unique resource through internal and external business such as the creation of Danwon Sculpture Park, the operation of Danwon Art Museum, and the planning of Danwon Kim Hong-do Festival. However, the biggest problem with Ansan is that there are not many collections of Kim Hong-do. Ansan has owned a total of six works as of May this year: a deer and a boy, flowers and a bird, A view of clouds on the water, Daegwallyeong, Yeodongbin, A way to Singwangsa. Accordingly, Danwon Contents Center has set up a vision to systematically collect, preserve, and display various visual and artistic materials related to Kim Hong-do, offering high-quality information based on digital data. In other words, it is a complex cultural information agency of One-Source Multi-Use, which combines the functions of libraries, archives and art galleries so that visitors' desire is satisfied. It reflects the contemporary trend of overcoming the limitations of the ancient paintings and satisfying the role and function of the art museum. From the opening of the Danwon Contents Hall, the original work of Kim Hong-do has been interpreted and produced as media contents or recreated as a new form of art by modern artists. Exhibition using technologies such as touch screen and 'deep zoom' helps visitors to heighten their experience of the archives and get inside the world of the genius painter.

• Asia Marketing Journal
• /
• v.14 no.1
• /
• pp.25-51
• /
• 2012

Researches about the relationship between SST(Self Service Technology) and TRI(Technology Readiness Index) have been carried out after TRI was developed by Parasuraman and his colleagues(2000). We hypothesize Consumer Readiness can also influence consumer's motivation, attitude, and intent to use SST. Currently, there has been no research on this subject. In this study, we investigated the relationship between TR, Consumer Readiness and SST Core Attitudinal Model which Dabholkar & Bagozzi(1994) proposed. The researchers also investigated moderating effects of consumer traits and situational factors to verify the acceptance of such forms of service delivery by all kinds of consumers and under different situational contexts. Self consciousness, the need for interaction with an employee, and the technology anxiety were used as consumer trait variables. Perceived waiting time and perceived crowding were used as situational variables. 380 questionnaires were distributed to a sample group of people in their 20's and 30's, and the data were analyzed with structural equation model using AMOS 18.0 program. All of Cronbach's alpha values representing reliabilities were satisfactory. The values of Composite Reliability(CR) and Average Variance Extracted(AVE) also showed the above criteria, thus providing evidence of convergent validity. To confirm discriminant validity among the constructs, confirmatory factor analysis and correlations among all the variables were examined. The results were satisfactory. The results of this study are summarized as follows. 1. Optimism and innovativeness of TR partially influenced the motivation to use SST. People who tend to be optimistic use SST because of ease of use and fun. The innovative however, usually use SST due to its performance. However, consumer readiness of role clarity, ability and self-efficacy influence all the components of motivation to use SST, ease of use, performance and fun. The relative effect of consumer readiness on the motivation to use SST was much stronger and more significant than that of TR. No other previous studies have examined the effects of Consumer Readiness on SST usage motivation, attitude and intention. It is academically meaningful that the researchers verified that Consumer Readiness is the important precedent construct influencing the self service technology core Attitudinal Model. Our findings suggest that marketers should consider fun and ease of use attributes to promote the use of self service technology. In addition, the SST usage frequency will rise rapidly when role clarity, ability, and self-efficacy which anybody can easily handle SST is assured. If the SST usage rate is increased, waiting times for customers could be decreased. Shorter waiting time could lead to higher customer satisfaction. It may also result in making a long-term profit owing to the reduced number of employees. Thus, presentation of using SST by employees or videos showing how to use it will promote the usage attitude and intent. 2. In SST core attitudinal model, performance and fun factors among SST usage motivation affected attitudes of using SST. The attitude of using SST highly influenced intent to use SST. This result is consistent with previous researches that dealt with the relationship between motivation, attitude and intention. Expectation of using SST could result in good performance just like the effect of ordering menu to service employees and to have fun since fun during its use could promote more SST usage rate. 3. In the relationship among motivation, attitude and intent in SST core attitudinal model, the moderating effect of consumer traits(self-consciousness, need for interaction with service employees and technology anxiety) and situational factors(perceived crowding and perceived waiting time) were tested. The results also supported the hypothesized moderating effects except perceived crowding. The highly self-conscious tended to form attitudes to use SST because of its fun compared to those who were less self-conscious because of its performance. People who had a high need for interaction with service employees tended to use SST for its performance. This result indicates that if ordering results are assured, SST is easily accessible to even consumers who have a high need for interaction with a service employee. When SST is easy to use, attitudes strengthen intent among people who had a high level of anxiety of technology. People who had low technology anxiety formed attitudes to use SST because of its performance. Service firms must ensure their self service technology is designed to be easy to use for those who have a high level of technology anxiety. Shorter perceived waiting times strengthened the attitude to use self service technology because of its fun. If the fun aspect is assured, people willing to use self service technology even perceive waiting time to be shorter than it actually is. Greater perceived waiting times form higher level of intent to use self service technology than those of shorter perceived waiting times. This implies that people view self service technology as a faster alternative to ordering service employees. The fun aspect of self service technology will attract a higher rate of usage for self service technology. 4. It has been proven that ease of use, performance and fun aspects are very important factors in motivation to form attitudes and intent to use self service technology regardless of the amount of perceived waiting time, self-consciousness, need for interaction with service employees, and technology anxiety. Service firms must consider these motivation aspects(ease of use, performance and fun)strongly in their promotion to use self service technology. Ease of use, assuring absolute performance compared to interaction with service employees', and adding a fun aspect will positively strengthen consumers' attitudes and intent to use self service technology. Summarizing the moderating effects, fun is the most valuable factor triggering SST usage attitude and intention. Therefore, designing self service technology to be fun will be the key to its success. This study focused on the touch screen self service technology in fast food restaurant. Although it has its limits due to the fact that it is hard to generalize the results to any other self service technology, the conceptual framework of this study can be applied to future research of any other service site.