• 대한임베디드공학회논문지
• /
• 제6권3호
• /
• pp.174-182
• /
• 2011

Conventional home audio system (e.g. AV Receiver, CD Player etc) has a various functionality of audio play, channel mixing, but the remote controller of these audio players is too complex, difficult for user to manage them effectively. Users want to use these functionalities with more easy, comprehensible way. In this study, "intelligent real-sound presentation technology" that support high quality, realistic audio and the "design of complex information and controller of real sound using intelligent real sound play and control interface" will be introduced. So user can actively, realistically enjoy and play real sound based on user's preference, emotion and circumstance, instead of user's passive service.

• ETRI Journal
• /
• 제35권6호
• /
• pp.960-968
• /
• 2013

To implement a cloud game service platform supporting multiple users and devices based on real-time streaming, there are many technical needs, including game screen and sound capturing, audio/video encoding in real time created by a high-performance server-generated game screen, and real-time streaming to client devices, such as low-cost PCs, smart devices, and set-top boxes. We therefore present a game service platform for the running and management of the game screen, as well as running the sound on the server, in which the captured and encoded game screen and sound separately provide client devices through real-time streaming. The proposed platform offers Web-based services that allow game play on smaller end devices without requiring the games to be installed locally.

• 한국정보처리학회:학술대회논문집
• /
• 한국정보처리학회 2011년도 춘계학술발표대회
• /
• pp.689-691
• /
• 2011

Due to the rapid development of Information and communication, the technology of multimedia presentation technology is evolving into the service that user can actively, realistically enjoy and play based on user's preference and taste not only for User's passive service. Especially, the industry related the realistic multimedia service that supports targeting Human emotion with the property of Human hearing is expected to be formed of the high value-added premium market. Audio technology is affected on human's emotion and the viewing environment around than video technology. Also the audio technology compared to video technology is a research part that appeals to human emotion and emphasize on psychological aspects. With this viewpoint, the development of intelligent and realistic audio technology needs highly specialty. In this study, "intelligent real-sound presentation technology" that support high quality and realistic audio and the "core technologies" that are composing of this will be introduced.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 2000년도 ITC-CSCC -1
• /
• pp.306-309
• /
• 2000

We developed an electronic music glove (EMG) system that could play musical scores in real time processing. The EMG system interfaces with the signal coming from the controller to the sound card in the computer. The computer, according to the status of the finger and foot switches, generates the signals to the speaker systems using the application C++ program by making use of MIDI message. The EMG systems can control up to several octave notes and duration of sound, and several musical performance expressions such as chorus, reverberation, rhythm, and volume. Finally, our EMG could play the performance of simple music depending on the choice of any kind of musical instruments in the sound card in computer systems.

• 한국소음진동공학회:학술대회논문집
• /
• 한국소음진동공학회 2014년도 추계학술대회 논문집
• /
• pp.141-145
• /
• 2014

A minimally appropriate time delay of audio data processing is investigated for rendering virtual sound source direction in real-time head-tracking environment under headphone listening. Less than 3.7 degree of angular mismatch should be maintained in order to keep desired sound source directions in virtually fixed while listeners are rotating their head in a horizontal plane. The angular mismatch is proportional to speed of head rotation and data processing delay. For 20 degree/s head rotation, which is a relatively slow head-movement case, less than total of 63ms data processing delay should be considered.

• 한국정보통신학회논문지
• /
• 제15권12호
• /
• pp.2705-2711
• /
• 2011

최근 멀티미디어 기술의 발달, 특히 음향 기술의 급격한 발달과 더불어 고품질 오디오에 대한 요구와 함께보다 현실감 있는 오디오를 재생하기 위한 실감 오디오기술 개발이 요구되고 있다. 이러한 요구를 만족시키기 위해 사용자의 가상현실 및 증강현실에서 실감나는 오디오 효과를 제공해 줄 수 있는 3차원 오디오에 대한 연구가 활발히 진행되고 있다. 본 논문에서는 증강현실에서 좀 더 나은 오디오 기술을 적용하여 실감나는 오디오 효과를 제공해 줄 수 있는 방법을 연구하고자 하였다. 연구한 내용은 가상세계와 실제세계의 현실감을 제공하기 위하여 마커 위에 띄워진 3D 모델의 움직임에 따라서 움직임에 맞는 사운드. 즉, 거리, 각도 등의 변화에 따른 사운드의 크기 및 피치 변화를 줄 수 있도록 하였다.

• 한국콘텐츠학회논문지
• /
• 제10권4호
• /
• pp.91-97
• /
• 2010

Web 2.0 시대를 맞아 최근 웹상에는 소셜 미디어 서비스(Social Media Service)가 각광받고 있다. 환경적 변화에 맞춰 사용자의 요구를 충족시키는 소셜 미디어 서비스로써 합주서비스를 제공하고자 한다. 합주서비스는 MMMD(Multi Media Multi Device) 개념으로 음원을 제공하고자 한다. 즉, 합주곡을 하나의 재생장치를 통해 듣는 것이 아니라, 악기 별로 재생장치를 선택해 연주함으로써 오케스트라에서 음악을 감상하는 것 같은 실감을 부여할 수 있다. 목표를 충족시키기 위해서 합주곡을 구성하는 악기 별 음원을 분리하고 연주를 위해 필요한 음원을 추출하고 음원을 각 재생장치로 전달하는 작업을 AET Process로 정의하였다. 음원 간의 동기화를 제어하기 위해서 쉼표를 이용한 동기화 알고리즘을 제안하였다. AET Process와 쉼표를 이용한 동기화 처리 방법을 이용하여 사용자에게 실감 있는 합주 서비스를 제공할 수 있다.

• 한국HCI학회:학술대회논문집
• /
• 한국HCI학회 2008년도 학술대회 1부
• /
• pp.184-189
• /
• 2008

본 연구는 기존에 저장되어 있는 응원이나 입력되는 사운드 데이터를 사용하여 게임 플레이상에 지형을 생성함으로서 사운드의 적극적인 황용을 도모하고 렌더링되는 화면과 입출력되는 오디오 간의 동기화를 통해 사용자들에게 공감각적인 상호작용을 제공한다. 사용자가 직접 사운드를 발생시키거나 원하는 음원을 입력하면 그 입력받은 사운드 진폭 데이터를 푸리에 변환하여 주파수 데이터로 변환하고 취득한 데이터로 분석 및 재가공하여 시간에 따라 변화하는 3차원 지형을 만든다. 지형이 생성될 때는 여러 가지 보간 처리를 통하여 에이전트들과 오브젝트들이 활동 가능하도록 지형을 보정하며, 확장 역시 용이하도록 디자인한다.

• 한국멀티미디어학회논문지
• /
• 제23권4호
• /
• pp.615-624
• /
• 2020

By enabling musicians to freely control the elements involved in sound production and tone generation with a variety of timbre, synthesizers have revolutionized and permanently changed music since the 1960s. Paik-Abe Video Synthesizer, a masterpiece of video art maestro Nam June Paik, is a prominent example of re-interpretation of this new musical instrument in the realm of video and audio. This article examines Paik-Abe Video Synthesizer as an innovative instrument to play videos from the perspective of audiovisual art, and establishes its aesthetic value and significance through both artistic and technical analysis. The instrument, which embodied the concept of image sampling and real-time interactive video as an image-based multi-channel music production tool, contributed to establishing a new relationship between sound and image within the realm of audiovisual art. The fact that his video synthesizer not only adds image to sound, but also presents a complete fusion of image and sound as an image instrument with musical characteristics, becomes highly meaningful in this age of synesthesia.

• 한국HCI학회:학술대회논문집
• /
• 한국HCI학회 2008년도 학술대회 2부
• /
• pp.405-410
• /
• 2008

There is always a rhythm in our language and speech. As soon as we speech out, even just simple words and voice we make are edited as various emotions and information. Through this process we succeed or fail in our communication, and it becomes a fun communication or a monotonous delivery. Even with the same music, impression of the play can be different according to each musician' s emotion and their understanding. We 'play' our language in the same way as that. However, I think, people are used to the variety, which is, in fact, the variation of a set format covered with hollow variety. People might have been living loosing or limiting their own creative way to express themselves by that hollow variety. SPACIAL POEM started from this point. This is a new type of 'real-time visual interaction' expressing our own creative narrative as real-time visual by playing a musical instrument which is an emotional human behavior. Producing many kinds of sound by playing musical instruments is the same behavior with which we express our emotions through. There are sensors on each hole on the surface of the musical instrument. When you play it, sensors recognize that you have covered the holes. All sensors are connected to a keyboard, which means your playing behavior becomes a typing action on the keyboard. And I programmed the visual of your words to spread out in a virtual 3D space when you play the musical instrument. The behavior when you blow the instrument, to make sounds, changes into the energy that makes you walk ahead continuously in a virtual space. I used a microphone sensor for this. After all by playing musical instrument, we get back the emotion we forgot so far, and my voice is expressed with my own visual language in virtual space.