• IEMEK Journal of Embedded Systems and Applications
• /
• v.6 no.3
• /
• pp.174-182
• /
• 2011

Conventional home audio system (e.g. AV Receiver, CD Player etc) has a various functionality of audio play, channel mixing, but the remote controller of these audio players is too complex, difficult for user to manage them effectively. Users want to use these functionalities with more easy, comprehensible way. In this study, "intelligent real-sound presentation technology" that support high quality, realistic audio and the "design of complex information and controller of real sound using intelligent real sound play and control interface" will be introduced. So user can actively, realistically enjoy and play real sound based on user's preference, emotion and circumstance, instead of user's passive service.

• Journal of Digital Contents Society
• /
• v.9 no.2
• /
• pp.203-211
• /
• 2008

Due to the advance of H/W and S/W techniques to play 3D sound, the virtual space contented by 3D graphics and sounds can provide users more improved realities and vividness. However for the small 3D contents developers and companies, it is hard to implement 3D sound techniques because the implementation requires expensive sound engines, 3D sound technical understanding and 3D sound programming skills. Therefore 3D-sound-playing-interface is necessary to easy and cost-effective 3D sound implementation. Using this interface, graphics experts can easily add 3D sound techniques to their applications. In this paper, the followings are designed and implemented as a preliminary stage in the way of developing the 3D sound playing interface. First, we develop 3D sound S/W modules converting mono to 3D sound in PC based systems. Second, we develop the interconnection modules to map 3D graphic objects and sound sources. The developed modules in this paper can allow the user to percept sound source position and surround effect at the moving positions in the virtual world. In the coming works, we are going to develop the more completed 3D sound playing interface consisted of the synchronization technique for sound and moving objects, and HRTF.

• Journal of the Ergonomics Society of Korea
• /
• v.25 no.2
• /
• pp.125-134
• /
• 2006

Most users learn new, complex systems through trial-and-error experience rather than referring to the manuals in a cognitive process that is called 'exploratory learning'. While exploring a system, people find prototypical rules for using the system based especially on frequent tasks. The rules are formed from consistent task procedures and well-expected interface elements on the designed system. These rules play the role of the basis of users' knowledge for performing tasks. The decision making to select and apply those rules interacting with an interface can be aided by properly provided hints on the interface. With appropriate hints, users can learn new systems easily and use them with reduced usability problems. This paper first reports an observation of user behavior performing tasks with prototypical interaction rules and finds a sound set of criteria to extract prototypical interaction rules systematically. Two types of hints are defined. Extending hints prompt users to apply prototypical interaction rules beyond well-known tasks. Preventive hints guide users out of possible capture errors by drawing attention to the variation of rules. A systematic and practical method is proposed to identify the opportunities for both types in designing interfaces. It is then verified through a usability test that the proposed method is effective in identifying the locations and types of appropriate hints to reduce or mitigate usability problems.

• 한국HCI학회:학술대회논문집
• /
• 2008.02b
• /
• pp.405-410
• /
• 2008

There is always a rhythm in our language and speech. As soon as we speech out, even just simple words and voice we make are edited as various emotions and information. Through this process we succeed or fail in our communication, and it becomes a fun communication or a monotonous delivery. Even with the same music, impression of the play can be different according to each musician' s emotion and their understanding. We 'play' our language in the same way as that. However, I think, people are used to the variety, which is, in fact, the variation of a set format covered with hollow variety. People might have been living loosing or limiting their own creative way to express themselves by that hollow variety. SPACIAL POEM started from this point. This is a new type of 'real-time visual interaction' expressing our own creative narrative as real-time visual by playing a musical instrument which is an emotional human behavior. Producing many kinds of sound by playing musical instruments is the same behavior with which we express our emotions through. There are sensors on each hole on the surface of the musical instrument. When you play it, sensors recognize that you have covered the holes. All sensors are connected to a keyboard, which means your playing behavior becomes a typing action on the keyboard. And I programmed the visual of your words to spread out in a virtual 3D space when you play the musical instrument. The behavior when you blow the instrument, to make sounds, changes into the energy that makes you walk ahead continuously in a virtual space. I used a microphone sensor for this. After all by playing musical instrument, we get back the emotion we forgot so far, and my voice is expressed with my own visual language in virtual space.

• The Journal of the Korea Contents Association
• /
• v.11 no.3
• /
• pp.116-127
• /
• 2011

This paper proposes interactive game elements for children : contents, design, sound, gesture recognition, and speech recognition. Interactive games for early children must use the contents which reflect the educational needs and the design elements which are all bright, friendly, and simple to use. Also the games should consider the background music which is familiar with children and the narration which make easy to play the games. In gesture recognition and speech recognition, the interactive games must use gesture and voice data which hits to the age of the game user. Also, this paper introduces the development process for the interactive skipping game and applies the child-oriented contents, gestures, and voices to the game.

• Journal of Korea Game Society
• /
• v.13 no.6
• /
• pp.15-26
• /
• 2013

In recent years, studies in BCI game with popular BCI devices are progressing actively by the development of BCI(Brain Computer Interface) techniques. Most of BCI games have developed as experimental contents for researching. On the game control paradigm, it is insufficient to conduct a study about induced methods of proper barinwave to control the BCI game. In this study, we suggest a rhythm game using BCI which has a new play element that visualizes the rhythm of music and represents the notes of music in sound and a generation method of visual-auditory feedback through the synchronization of the tempo of music with brainwave. Experimental Results make certain that our suggestion is possible for the improvement of game score through the induction of brainwave that is necessary to control the game.

• Journal of The Korean Association of Information Education
• /
• v.17 no.4
• /
• pp.421-432
• /
• 2013

The purpose of this study is to develop contents and an instructional model that support children's dramatic play by integrating the robot and augmented reality technology. In order to support the dramatic play, the robot shows various facial expressions and actions, serves as a narrator and a sound manager, supports the simultaneous interaction by using the camera and recognizing the markers and children's motions, records children's activities as a photo and a video that can be used for further activities. The robot also uses a projector to allow children to directly interact with the video object. On the other hand, augmented reality offers a variety of character changes and props, and allows various effects of background and foreground. Also it allows natural interaction between the contents and children through the real-type interface, and provides the opportunities for the interaction between actors and audiences. Along with these, augmented reality provides an experience-based learning environment that induces a sensory immersion by allowing children to manipulate or choose the learning situation and experience the results. In addition, the instructional model supporting dramatic play consists of 4 stages(i.e., teachers' preparation, introducing and understanding a story, action plan and play, evaluation and wrapping up). At each stage, detailed activities to decide or proceed are suggested.

• Electronics and Telecommunications Trends
• /
• v.33 no.6
• /
• pp.69-80
• /
• 2018

Sensory devices have been developed to help people with disabled or weakened sensory functions. Such devices play a role in collecting and transferring data for the five senses (vision, sound, smell, taste, and tactility) and also stimulating nerves. To provide brain or prosthesis devices with more sophisticated senses, hyper sensory devices with a high resolution comparable to or even better than the human system based on individual neuron cells are essential. As for data collecting components, technologies for sensors with higher resolution and sensitivity, and the conversion of algorithms from physical sensing data to human neuron signals, are needed. Converted data can be transferred to neurons that are responsible for human senses through communication with high security, and neural interfaces with high resolution. When communication deals with human data, security is the most important consideration, and intra-body communication is expected to be a candidate with high priority. To generate sophisticated human senses by modulating neurons, neural interfaces should modulate individual neurons, and therefore a high resolution compared to human neurons (~ several tens of um) with a large area covering neuron cells for human senses (~ several tens of mm) should be developed. The technological challenges for developing sensory devices with human and even beyond-human capabilities have been tackled by various research groups, the details of which are described in this paper.

• The Transactions of the Korea Information Processing Society
• /
• v.6 no.4
• /
• pp.877-890
• /
• 1999

In this paper, a multimedia mail including video, sound, graphic data has been proposed as the next generation mail of the text based mail. In order to develop the multimedia mail, the most outstanding problem is the fact that the multimedia data are too huge to send them to the receiving end directly. The fact of big data may cause many problems in both transferring and storing the data of the multimedia mail. Our main idea is to separate between a control program for the multimedia presentation and multimedia data. Since the size of a control program is as small as a plain text mail, it has no problem to send it attached to the internet mail to the receiver directly. Instead, the big multimedia data themselves may remain on the sender's computer or be sent to a designated server so that the data may be transferred to the receiver only when the receiver activates the play of the multimedia mail. In this scheme, our research focus is paced on the buffer management and the thread scheduling for the real time play of the multimedia mail on internet. Another problem is to provide an easy way of editing a multimedia presentation for an ordinary people having no programming knowledge. For the purposed, VIP(Visual Interface Player) has been used and the results or multimedia mail implemented on LAN has been described.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.16 no.12
• /
• pp.8933-8939
• /
• 2015

In this paper, we designed a multi humanoid robot control method for performing an exhibition that will maximize the efficiency and user convenience and implementation. In recent years, an increasing number of case and to take advantage of the robots in the field performances and exhibitions, plays, musicals, orchestra performances are also various genres. In concert with the existing small humanoid exhibition to source from outside by using a computer and MP3 player and play, while pressing the start button of communication equipment for the show to start the robot began performing with the zoom. Thus, due to the dual source and robot operation and synchronization does not work well is the synchronization of the start of the concert sound starting point of the robot and robot motion and sound are reproduced separately were frequently occurs when you need to restart the show. In addition, when the center of gravity or lose the robots who were present during the performance problems such as performance or intervene to restart the show. In order to overcome this, in this paper, Multi-small humanoid robot was designed to control the efficiency and the user of the GUI-based human interface S/W to maximize convenience, Zigbee communication to transmit a plurality of data in al small humanoid It was used. In addition, targeting a number of the small humanoid robot demonstrated the effectiveness and validity of the user's convenience by gender actual implementation.