• Journal of Korea Game Society
• /
• v.15 no.5
• /
• pp.79-87
• /
• 2015

Education tools expressed in texts and images turned into the edutainment such as a education and playing experience. Augmented reality(AR) technology in the field of edutainment was possible to have an amused-education by maximizing experiences. Recently, it is also served in a variety of mobile applications which exploit AR technology. The paper is to describe on the practical measures for the experience of education through designing and implementing edutainment contents. The implementation makes use of a engine 'Vuforia', and a platform 'Unity 3D'.

• 한국HCI학회:학술대회논문집
• /
• 2008.02a
• /
• pp.168-173
• /
• 2008

Recently, many researchers have studied on agent-based edutainment systems to improve students' learning experience. In this paper, we present AR Gardening which makes users experience interactive flower gardening with a bluebird, a learning companion agent, squatting in an augmented picture. The proposed system augments the animated bluebird to support interactive edutainment experiences. The bluebird perceives users' actions as well as environmental situations. It then appraises situational information to provide participants with problem-solving guidelines. Moreover, the bluebird responds like a companion than an instructor through anthropomorphic expression. To demonstrate our work, we exhibited the implemented AR Gardening and reviewed participants' responses to the system. In this exhibition, we could find that the learning companion-like bluebird helped users experience how to properly grow the flower in our educational setting. Ultimately, we expect that an augmented peer learning agent is one of the key factors for developing effective edutainment applications.

• Proceedings of the Korea Contents Association Conference
• /
• 2005.11a
• /
• pp.518-522
• /
• 2005

This paper demonstrates the use of student model in order to develop a strategy for enhancing the student's proficiency and learning motivation in Web-based edutainment applications.

• Journal of Information Processing Systems
• /
• v.1 no.1 s.1
• /
• pp.107-111
• /
• 2005

When a pedagogical agent system aims to provide students with interactive help, it needs to know what knowledge the student has and what goals the student is currently trying to achieve. That is, it must do both assessment and plan recognition. These modeling tasks involve a high level of uncertainty when students are allowed to follow various lines of reasoning and are not required to show all their reasoning explicitly. In this paper, the student model for interactive edutainment applications is proposed. This model is based on Bayesian Networks to expose constructs and parameters of rules and propositions pertaining to game and problem solving activities. This student model could be utilized as the emotion generation model for student and agent as well.

• The Journal of the Korea Contents Association
• /
• v.13 no.5
• /
• pp.146-158
• /
• 2013

The purpose of this study is to analyze the story-retelling structure of tablet PC-based applications that designed to help infants to create stories. Owing to the popularization and the usability of smart devices, infants have become from content consumers to creators who reconstruct stories in creative ways, based on the stories they heard. In those participatory process, infants experience enjoying stories independently and expanding the meaning of texts. Story-retelling is an adequate methodology that cultivates creativity, expressiveness, and literacy ability to infant. Consequently, this study investigates three types of story-retelling in , , and , and searches structure elements and methods of story-retelling in integrated approach. In conclusion, the story-retelling applications that provide 'creative gap' have educational value, because they allow infants to demonstrate imagination by filling in the gap and to realize the rule of stories.

• International Journal of Automotive Technology
• /
• v.7 no.4
• /
• pp.509-517
• /
• 2006

In the mid 1990s, the combination of vehicles and communication was expected to bolster the stagnant car industry by offering a flood of new revenues. In-vehicle computing systems provide safety and control systems needed to operate the vehicle as well as infotainment, edutainment, entertainment, and mobile commerce services in a safe and responsible manner. Since 1980 the word "telematics" has meant the blending of telecommunications and informatics. Lately, telematics has been used more and more to mean "automotive telematics" which use informatics and telecommunications to enhance the functionality of motor vehicles such as wireless data applications, intelligent cruise control, and GPS in vehicles. This definition identifies telecommunications transferring information as the key enabling technology to provide these advanced services. In this paper, a possible framework for future telematics, which called an Intelligent Vehicle Network(IVN), is proposed. The paper also introduces and compares a number of existing technologies and the terms of their capabilities to support a suite of services. The paper additionally the paper suggests and analyzes possible directions for future telematics from current telematics techniques.

• The Journal of the Korea Contents Association
• /
• v.16 no.2
• /
• pp.449-455
• /
• 2016

Times have changed and using smart phones is common to everyone, regardless of men and women of all ages. Especially, making educational applications is on a rising trend. This report aims to build a program, which makes young children easily meet and learn Hangul anytime, anywhere, to keep pace with the change and trend. As everyone knows, young children's Hangul learning process is changing with smart phone generalization. Young children usually learned Hangul based on paper books but now times have changed, instead, smart phones can be used to learn Hangul anytime, anywhere, and this trend is seen everywhere easily. This report explains how to build smart phone applications to make it easier to learn and understand educational Hangul plays.

• Journal of KIISE:Computing Practices and Letters
• /
• v.9 no.4
• /
• pp.420-430
• /
• 2003

This paper presents an immersive multimodal Gumdo simulation game that allows a user to experience the whole body interaction with an intelligent cyber fencer. The proposed system consists of three modules: (i) a nondistracting multimodal interface with 3D vision and speech (ii) an intelligent cyber fencer and (iii) an immersive feedback by a big screen and sound. First, the multimodal Interface with 3D vision and speech allows a user to move around and to shout without distracting the user. Second, an intelligent cyber fencer provides the user with intelligent interactions by perception and reaction modules that are created by the analysis of real Gumdo game. Finally, an immersive audio-visual feedback by a big screen and sound effects helps a user experience an immersive interaction. The proposed system thus provides the user with an immersive Gumdo experience with the whole body movement. The suggested system can be applied to various applications such as education, exercise, art performance, etc.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.45 no.5
• /
• pp.63-73
• /
• 2008

Recent years have seen an explosion of interest in interactive agents motivating human learners to engage in edutainment systems which are designed to be entertaining and educational at the same time. Especially, work on socio-emotional processes has focus on understanding of human's social behavior in training and entertainment a applications. In contrast with work on social emotion, where research groups have developed detailed models of emotional processes, models of personality have emphasized shallow surface behavior. Here, we build on computational appraisal models of emotion to better characterize dispositional differences in how people come to understand social situations. Known as explanatory style, this dispositional factor plays a key role in social interactions and certain socio-emotional disorders, such as depression. Building on appraisal and attribution theories, we model key conceptual variables underlying the explanatory style, and enable agents to exhibit different explanatory tendencies with respect to their personalities. Furthermore, we developed an interactive AR agent based on our framework and applied it into an interactive teaming system that allows participants to explore individual differences in the explanation of social events, with the goal of encouraging the development of perspective laking and emotion-regulatory skills.

• Journal of Intelligence and Information Systems
• /
• v.17 no.1
• /
• pp.53-69
• /
• 2011

Vision and voice-based technologies are commonly utilized for human-robot interaction. But it is widely recognized that the performance of vision and voice-based interaction systems is deteriorated by a large margin in the real-world situations due to environmental and user variances. Human users need to be very cooperative to get reasonable performance, which significantly limits the usability of the vision and voice-based human-robot interaction technologies. As a result, touch screens are still the major medium of human-robot interaction for the real-world applications. To empower the usability of robots for various services, alternative interaction technologies should be developed to complement the problems of vision and voice-based technologies. In this paper, we propose the use of accelerometer-based gesture interface as one of the alternative technologies, because accelerometers are effective in detecting the movements of human body, while their performance is not limited by environmental contexts such as lighting conditions or camera's field-of-view. Moreover, accelerometers are widely available nowadays in many mobile devices. We tackle the problem of classifying acceleration signal patterns of 26 English alphabets, which is one of the essential repertoires for the realization of education services based on robots. Recognizing 26 English handwriting patterns based on accelerometers is a very difficult task to take over because of its large scale of pattern classes and the complexity of each pattern. The most difficult problem that has been undertaken which is similar to our problem was recognizing acceleration signal patterns of 10 handwritten digits. Most previous studies dealt with pattern sets of 8~10 simple and easily distinguishable gestures that are useful for controlling home appliances, computer applications, robots etc. Good features are essential for the success of pattern recognition. To promote the discriminative power upon complex English alphabet patterns, we extracted 'motion trajectories' out of input acceleration signal and used them as the main feature. Investigative experiments showed that classifiers based on trajectory performed 3%~5% better than those with raw features e.g. acceleration signal itself or statistical figures. To minimize the distortion of trajectories, we applied a simple but effective set of smoothing filters and band-pass filters. It is well known that acceleration patterns for the same gesture is very different among different performers. To tackle the problem, online incremental learning is applied for our system to make it adaptive to the users' distinctive motion properties. Our system is based on instance-based learning (IBL) where each training sample is memorized as a reference pattern. Brute-force incremental learning in IBL continuously accumulates reference patterns, which is a problem because it not only slows down the classification but also downgrades the recall performance. Regarding the latter phenomenon, we observed a tendency that as the number of reference patterns grows, some reference patterns contribute more to the false positive classification. Thus, we devised an algorithm for optimizing the reference pattern set based on the positive and negative contribution of each reference pattern. The algorithm is performed periodically to remove reference patterns that have a very low positive contribution or a high negative contribution. Experiments were performed on 6500 gesture patterns collected from 50 adults of 30~50 years old. Each alphabet was performed 5 times per participant using $Nintendo{(R)}$ $Wii^{TM}$ remote. Acceleration signal was sampled in 100hz on 3 axes. Mean recall rate for all the alphabets was 95.48%. Some alphabets recorded very low recall rate and exhibited very high pairwise confusion rate. Major confusion pairs are D(88%) and P(74%), I(81%) and U(75%), N(88%) and W(100%). Though W was recalled perfectly, it contributed much to the false positive classification of N. By comparison with major previous results from VTT (96% for 8 control gestures), CMU (97% for 10 control gestures) and Samsung Electronics(97% for 10 digits and a control gesture), we could find that the performance of our system is superior regarding the number of pattern classes and the complexity of patterns. Using our gesture interaction system, we conducted 2 case studies of robot-based edutainment services. The services were implemented on various robot platforms and mobile devices including $iPhone^{TM}$. The participating children exhibited improved concentration and active reaction on the service with our gesture interface. To prove the effectiveness of our gesture interface, a test was taken by the children after experiencing an English teaching service. The test result showed that those who played with the gesture interface-based robot content marked 10% better score than those with conventional teaching. We conclude that the accelerometer-based gesture interface is a promising technology for flourishing real-world robot-based services and content by complementing the limits of today's conventional interfaces e.g. touch screen, vision and voice.