• Broadcasting and Media Magazine
• /
• v.11 no.4
• /
• pp.118-131
• /
• 2006

With rapid development in ultra fast communication and digital multimedia, the realistic broadcasting technology, that can stimulate five human senses beyond the conventional audio-visual service is emerging as a new generation broadcasting technology. In this paper, we introduce a haptic broadcasting system and related core system and component techniques by which we can 'touch and feel' objects in an audio-visual scene. The system is composed of haptic media acquisition and creation, contents authoring, in the haptic broadcasting, the haptic media can be 3-D geometry, dynamic properties, haptic surface properties, movement, tactile information to enable active touch and manipulation and passive movement following and tactile effects. In the proposed system, active haptic exploration and manipulation of a 3-D mesh, active haptic exploration of depth video, passive kinesthetic interaction, and passive tactile interaction can be provided as potential haptic interaction scenarios and a home shopping, a movie with tactile effects, and conducting education scenarios are produced to show the feasibility of the proposed system.

• Journal of Internet Computing and Services
• /
• v.11 no.1
• /
• pp.77-84
• /
• 2010

Children, who have a language disorder, have difficulty in expressing their reaction about stimulus of sound and vision. So it is very hard to grasp that they recognize external stimulus or not. For solving these problem, we can check response time and make them to choose stimulus by giving stimulus of sound and vision to them through Audio and Visual Stimulus and Reaction Meter System. Additionally, We can help them by improving response time by repeated study based on the results and making them to recognize and choose stimulus faster without aversion about external stimulus. It would make them not to feel uncomfortable and isolated because they are unfamiliar with external stimulus.

• 한국HCI학회:학술대회논문집
• /
• 2008.02b
• /
• pp.140-145
• /
• 2008

Mobile device has a constraint such as a small physical display size and interaction. One of the most important issues in mobile devices is the express an identity of one's products company. It can be appeal to the user in side of consistency. Thus, we integrate and extract an identity element from user experience including, Graphical User Interface, Information Architecture and Audio User Interface. The study was conducted by a task force team with User Interface practitioners of managing divisions of each product. In this study, methods and processes that were attempted in order to establish consistency principles of user experiences, enhancing the various characteristics of each product, are described. The results and practical experiences obtained through the processes are introduced.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.14 no.1
• /
• pp.129-137
• /
• 2010

There are a lot of multimedia functions getting included in mobile devices recently, not only simple audio but visual functions as well, such as video playing, game and web browsing. Such the visual multimedia functions brought the strong requirement for much bigger LCD Display and high resolution. And the brightness of LCD is also one of major requirements and it is required to be more bright. However, LCD brightness is limited to increase because of power consumption. It occupies nearly 30% of the whole system power. This thesis suggests an effective and simple method of adjusting the LCD backlight brightness, considering a characteristic of battery and user pattern.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2009.05a
• /
• pp.451-454
• /
• 2009

There are a lot of multimedia functions getting included in mobile devices recently, not only simple audio but visual functions as well, such as video playing, game and web browsing. Such the visual multimedia functions brought the strong requirement for much bigger LCD Display and high resolution. And the brightness of LCD is also one of major requirements and it is required to be more bright However, LCD brightness is limited to increase because of power consumption. It occupies nearly 30% of the whole system power. This thesis suggests an effective and simple method of adjusting the LCD backlight brightness, considering a characteristic of battery and user pattern.

• Journal of Broadcast Engineering
• /
• v.23 no.2
• /
• pp.197-205
• /
• 2018

Panoramic image is one of the technologies that are commonly used today. However, technical difficulties still exist in panoramic video production. Without a special camera such as a 360-degree camera, making panoramic video becomes more difficult. In order to make a panoramic video, it is necessary to synchronize the timeline of multiple videos shot at multiple locations. However, the timeline synchronization method using the internal clock of the camera may cause an error due to the difference of the internal hardware. In order to solve this problem, timeline synchronization between multiple videos using visual information or auditory information has been studied. However, there is a problem in accuracy and processing time when using video information, and there is a problem in that, when using audio information, there is no synchronization when there is sensitivity to noise or there is no melody. Therefore, in this paper, we propose a timeline synchronization method between multiple video using audio waveform. It shows higher synchronization accuracy and temporal efficiency than the video information based time synchronization method.

• Journal of Satellite, Information and Communications
• /
• v.11 no.4
• /
• pp.102-106
• /
• 2016

With the popularity of smart phones and the help of high-speed wireless communication technology, high-quality multimedia contents have become common in mobile devices. Especially, the release of Oculus Rift opens a new era of virtual reality technology in consumer market. At the same time, 3D audio technology which is currently used to make computer games more realistic will soon be applied to the next generation of mobile phone and expected to offer a more expansive experience than its visual counterpart. This paper surveys concepts, algorithms, and systems for modeling 3D sound virtual environment applications. To do this, we first introduce an important design principle for audio rendering based on physics-based geometric algorithms and multichannel technologies, and introduce an audio rendering pipeline to a scene graph-based virtual reality system and a hardware architecture to model sound propagation.

• Journal of Internet Computing and Services
• /
• v.23 no.2
• /
• pp.71-77
• /
• 2022

In this paper, a database is collected for extending the speech synthesis model to a model that synthesizes speech according to emotions and generating facial expressions. The database is divided into male and female data, and consists of emotional speech and facial expressions. Two professional actors of different genders speak sentences in Korean. Sentences are divided into four emotions: happiness, sadness, anger, and neutrality. Each actor plays about 3300 sentences per emotion. A total of 26468 sentences collected by filming this are not overlap and contain expression similar to the corresponding emotion. Since building a high-quality database is important for the performance of future research, the database is assessed on emotional category, intensity, and genuineness. In order to find out the accuracy according to the modality of data, the database is divided into audio-video data, audio data, and video data.

• MALSORI
• /
• no.43
• /
• pp.73-88
• /
• 2002

In this paper, for natural facial synthesis, lip-synch algorithm based on key-frame method using RBF(radial bases function) is presented. For lips synthesizing, we make viseme range parameters from phoneme and its duration information that come out from the text-to-speech(TTS) system. And we extract viseme information from Av DB that coincides in each phoneme. We apply dominance function to reflect coarticulation phenomenon, and apply bilinear interpolation to reduce calculation time. At the next time lip-synch is performed by playing the synthesized images obtained by interpolation between each phonemes and the speech sound of TTS.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2013.01a
• /
• pp.271-272
• /
• 2013

The music with the times, evolved from analogous tape music to digital music. New authoring tools, interfaces, and applications make us to produce high quality music using cheap equipments. Inspired by this concept, we design an classical chinese style-instrument with the audio-visual interactive function. It enables a user to compose music and to see a vivid picture at the same time.