• IEMEK Journal of Embedded Systems and Applications
• /
• v.6 no.3
• /
• pp.174-182
• /
• 2011

Conventional home audio system (e.g. AV Receiver, CD Player etc) has a various functionality of audio play, channel mixing, but the remote controller of these audio players is too complex, difficult for user to manage them effectively. Users want to use these functionalities with more easy, comprehensible way. In this study, "intelligent real-sound presentation technology" that support high quality, realistic audio and the "design of complex information and controller of real sound using intelligent real sound play and control interface" will be introduced. So user can actively, realistically enjoy and play real sound based on user's preference, emotion and circumstance, instead of user's passive service.

• ETRI Journal
• /
• v.35 no.6
• /
• pp.960-968
• /
• 2013

To implement a cloud game service platform supporting multiple users and devices based on real-time streaming, there are many technical needs, including game screen and sound capturing, audio/video encoding in real time created by a high-performance server-generated game screen, and real-time streaming to client devices, such as low-cost PCs, smart devices, and set-top boxes. We therefore present a game service platform for the running and management of the game screen, as well as running the sound on the server, in which the captured and encoded game screen and sound separately provide client devices through real-time streaming. The proposed platform offers Web-based services that allow game play on smaller end devices without requiring the games to be installed locally.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2011.04a
• /
• pp.689-691
• /
• 2011

Due to the rapid development of Information and communication, the technology of multimedia presentation technology is evolving into the service that user can actively, realistically enjoy and play based on user's preference and taste not only for User's passive service. Especially, the industry related the realistic multimedia service that supports targeting Human emotion with the property of Human hearing is expected to be formed of the high value-added premium market. Audio technology is affected on human's emotion and the viewing environment around than video technology. Also the audio technology compared to video technology is a research part that appeals to human emotion and emphasize on psychological aspects. With this viewpoint, the development of intelligent and realistic audio technology needs highly specialty. In this study, "intelligent real-sound presentation technology" that support high quality and realistic audio and the "core technologies" that are composing of this will be introduced.

• Proceedings of the IEEK Conference
• /
• 2000.07a
• /
• pp.306-309
• /
• 2000

We developed an electronic music glove (EMG) system that could play musical scores in real time processing. The EMG system interfaces with the signal coming from the controller to the sound card in the computer. The computer, according to the status of the finger and foot switches, generates the signals to the speaker systems using the application C++ program by making use of MIDI message. The EMG systems can control up to several octave notes and duration of sound, and several musical performance expressions such as chorus, reverberation, rhythm, and volume. Finally, our EMG could play the performance of simple music depending on the choice of any kind of musical instruments in the sound card in computer systems.

• Proceedings of the Korean Society for Noise and Vibration Engineering Conference
• /
• 2014.10a
• /
• pp.141-145
• /
• 2014

A minimally appropriate time delay of audio data processing is investigated for rendering virtual sound source direction in real-time head-tracking environment under headphone listening. Less than 3.7 degree of angular mismatch should be maintained in order to keep desired sound source directions in virtually fixed while listeners are rotating their head in a horizontal plane. The angular mismatch is proportional to speed of head rotation and data processing delay. For 20 degree/s head rotation, which is a relatively slow head-movement case, less than total of 63ms data processing delay should be considered.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.15 no.12
• /
• pp.2705-2711
• /
• 2011

The recent development in multimedia technology such as audio technology needs high quality audio system. Especially, Real Audio Technology is to be developed to play realistic sound. To meet this demands, researches on 3-Dimensional Audio which provides realistic audio effect in virtual reality and augmented reality are conducted. In this paper, how to provide realistic audio effect by using better audio technologies in augmented reality was investigated. In the study, the movements of the 3-Dimensional model on the markers were used to provide the sense of reality in virtual and real world. Namely, the sound was modified according to the movement of the model. The change in distance and angle of the model affected the sound volume and the pitch.

• The Journal of the Korea Contents Association
• /
• v.10 no.4
• /
• pp.91-97
• /
• 2010

Recently, Internet users have an interest about Social Media Service in Web2.0 environment. We suggest the orchestra service as social media service to meet user satisfactions in changed web environment. We accept a concept of the MMMD (Multiple Media Multiple Devices). In other words, Internet users listen to the music not only one device but multiple devices. Each one of multiple devices can play a sound source under earmark instruments for providing users with actual feeling like an orchestra. To meet the purpose, we define 3 steps. First, we separate the sound source based on instrument information. Second, we exact the suitable sound source for play orchestra. In final step, the sound source transmits to each suitable playing device. We named the 3 step for AET process. Beside we suggest synchronization method using rest point in the MIDI file for control sound sources. Using the AET process and synchronization method we provide the orchestra service for meet user's satisfactions to users.

• 한국HCI학회:학술대회논문집
• /
• 2008.02a
• /
• pp.184-189
• /
• 2008

In this paper, the sound data either from the sampled or streamed source are utilized for generating a map in the video game play for the dynamiccal use of sound data and synesthesia to users. When users can generate sound in real-time or put the sampled source, it is analyzed and re-processed through Fourier transformation to show the 3D map in dynamic shape over time. We interpolate the generated data to enable the game agents and objects to move.

• Journal of Korea Multimedia Society
• /
• v.23 no.4
• /
• pp.615-624
• /
• 2020

By enabling musicians to freely control the elements involved in sound production and tone generation with a variety of timbre, synthesizers have revolutionized and permanently changed music since the 1960s. Paik-Abe Video Synthesizer, a masterpiece of video art maestro Nam June Paik, is a prominent example of re-interpretation of this new musical instrument in the realm of video and audio. This article examines Paik-Abe Video Synthesizer as an innovative instrument to play videos from the perspective of audiovisual art, and establishes its aesthetic value and significance through both artistic and technical analysis. The instrument, which embodied the concept of image sampling and real-time interactive video as an image-based multi-channel music production tool, contributed to establishing a new relationship between sound and image within the realm of audiovisual art. The fact that his video synthesizer not only adds image to sound, but also presents a complete fusion of image and sound as an image instrument with musical characteristics, becomes highly meaningful in this age of synesthesia.

• 한국HCI학회:학술대회논문집
• /
• 2008.02b
• /
• pp.405-410
• /
• 2008

There is always a rhythm in our language and speech. As soon as we speech out, even just simple words and voice we make are edited as various emotions and information. Through this process we succeed or fail in our communication, and it becomes a fun communication or a monotonous delivery. Even with the same music, impression of the play can be different according to each musician' s emotion and their understanding. We 'play' our language in the same way as that. However, I think, people are used to the variety, which is, in fact, the variation of a set format covered with hollow variety. People might have been living loosing or limiting their own creative way to express themselves by that hollow variety. SPACIAL POEM started from this point. This is a new type of 'real-time visual interaction' expressing our own creative narrative as real-time visual by playing a musical instrument which is an emotional human behavior. Producing many kinds of sound by playing musical instruments is the same behavior with which we express our emotions through. There are sensors on each hole on the surface of the musical instrument. When you play it, sensors recognize that you have covered the holes. All sensors are connected to a keyboard, which means your playing behavior becomes a typing action on the keyboard. And I programmed the visual of your words to spread out in a virtual 3D space when you play the musical instrument. The behavior when you blow the instrument, to make sounds, changes into the energy that makes you walk ahead continuously in a virtual space. I used a microphone sensor for this. After all by playing musical instrument, we get back the emotion we forgot so far, and my voice is expressed with my own visual language in virtual space.