• Journal of KIISE:Computing Practices and Letters
• /
• v.16 no.6
• /
• pp.737-741
• /
• 2010

When implementing Enhanced TV services, the time synchronization between the video stream that forms the background and the data contents overlaid on audio/video is an important issue. Currently, however, the basic method of synchronizing the data in the MPEG-4 environment is based on absolute time values. For more efficient synchronization when developing Enhanced TV content, this paper proposes a content-based synchronization in which the data content varies depending on the video content. The proposed content-based synchronization method is implemented by defining BIFS nodes more widely, based on scene keywords, and then using the metadata of MPEG7.

• ETRI Journal
• /
• v.38 no.5
• /
• pp.868-878
• /
• 2016

A multi-screen environment provides a new opportunity for digital signage applications, where various irregularly shaped screens are employed as an effective means for advertisements and information. A formation method applicable to numerous irregularly shaped screens is proposed to provide a new perspective on digital signage applications. The crucial part of the proposed method comes from the geometric sensing of each screen and the formation of a virtual screen where geometrically aligned content extraction and encoding are employed for content transmission to each screen. In addition, a software-based synchronization method for the proposed system is proposed to address the frame-level synchronization between screens. The experimental results of the proposed method show an improved performance of the frame-level synchronization, where the inconsistency between frames is not identified.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.14 no.8
• /
• pp.3473-3487
• /
• 2020

In this paper, we present a new approach to creating speech animation with emotional expressions using a small set of example models. To generate realistic facial animation, two example models called key visemes and expressions are used for lip-synchronization and facial expressions, respectively. The key visemes represent lip shapes of phonemes such as vowels and consonants while the key expressions represent basic emotions of a face. Our approach utilizes a text-to-speech (TTS) system to create a phonetic transcript for the speech animation. Based on a phonetic transcript, a sequence of speech animation is synthesized by interpolating the corresponding sequence of key visemes. Using an input parameter vector, the key expressions are blended by a method of scattered data interpolation. During the synthesizing process, an importance-based scheme is introduced to combine both lip-synchronization and facial expressions into one animation sequence in real time (over 120Hz). The proposed approach can be applied to diverse types of digital content and applications that use facial animation with high accuracy (over 90%) in speech recognition.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.37C no.12
• /
• pp.1185-1194
• /
• 2012

This paper proposes a new terrestrial 3DTV broadcasting standard specification based on synchronization with non-real-time contents in order to overcome quality limitations of the current 3DTV services that are arisen from the limited bandwidth of the legacy broadcasting channel. In the services using the proposed specification, one view sequence of a stereoscopic video content is delivered as a non-real-time content in idle time, and the other view sequence is transmitted in real time broadcasting signal, thereafter two sequences are synchronized in a receiver for display. Thus, it is possible to provide higher-quality stereoscopic video content services than the current 3DTV services. In order to realize these services, a new mechanism is required which enables synchronization between the data that are from different transmission media and time. Therefore, this paper suggests a solution by multiplexing the synchronization signals of non-real-time contents into broadcasting signals with real-time streams together. This solution can provide a accurate synchronization mechanism by minimum updates of legacy broadcasting systems while maintaining compatibility with legacy services.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.66 no.3
• /
• pp.575-580
• /
• 2017

In these days, the big-size and high resolution multimedia file is widely used through networks. To transfer and service effectively, the internet network technology is necessary to substitute broadcasting. Normally Content Delivery Network(CDN) is widely used in conventional internet for multimedia services. But it has a small bandwidth to service. So to solve this problems, many researchers have suggest the protocol for download, content distribution/saving, server synchronization, caching, pushing rate, and streaming etc. But all of these has some defects like low resolution, packets loss and delay, real application implementations etc. So, this paper suggests a new method of network protocol based on P2P collaboration and user's content using information. And it evaluated the performance of suggested method. As the results, it showed the effectiveness of 4 performances indices : download speed, decreasing rate of connected user in same time, adaptive hit ratio, traffic decreasing rate.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.11 no.8
• /
• pp.4077-4091
• /
• 2017

This paper presents the design of a broadcasting scenario and system for an 8K-resolution content. Due to an 8K content is four times larger than the 4K content in terms of size, many technologies such as content acquisition, video coding, and transmission are required to deal with it. Therefore, high-quality video and audio for 8K (ultra-high definition television) service is not possible to be transmitted only using the current terrestrial broadcasting system. The proposed broadcasting system divides the 8K content into four 4K contents by area, and each area is hierarchically encoded by Scalable High-efficiency Video Coding (SHVC) into three layers: L0, L1, and L2. Every part of the 8K video content divided into areas and hierarchy is independently treated. These parts are transmitted over heterogeneous networks such as digital broadcasting and broadband networks after going through several processes of generating signal messages, encapsulation, and packetization based on MPEG media transport. We propose three methods of generating streams at the sending entity to merge the divided streams into the original content at the receiving entity. First, we design the composition information, which defines the presentation structure for displays. Second, a descriptor for content synchronization is included in the signal message. Finally, we define the rules for generating "packet_id" among the packet header fields and design the transmission scheduler to acquire the divided streams quickly. We implement the 8K broadcasting system by adapting the proposed methods and show that the 8K-resolution contents are stably received and serviced with a low delay.

• Journal of Korea Multimedia Society
• /
• v.13 no.2
• /
• pp.308-315
• /
• 2010

User Generated contents(UGC) interchange with internet users actively in Web2.0 environment. According to growth of content sharing site, the number of non-expert's contents increased. But non-expert's contents have a simple media just recorded. For providing actual feeling like effects and actions to non-expert's contents, we suggest Fusion Media Middleware(FMM). The FMM can increase user satisfaction by providing actual feeling. Furthermore, The content changes advanced media that has emotional impression. The FMM for providing actual feeling classify the inputted media as a scene based on MPEG-7. The FMM provide an actual feeling to simple media by inserting effects like a sound, image and text among the classified media. Using the BSD code of MPEG-21, the FMM can link up with inputted media and effects. Through the mapping BSD code the FMM control synchronization between media and effects. In this paper, Using the Fusion Media Middleware, the non-expert's contents express value as multimedia that has an actual feeling. Futhermore, the FMM creates flow of new media circulation.

• Journal of the Korea Society of Computer and Information
• /
• v.17 no.10
• /
• pp.137-143
• /
• 2012

The learners using learning content through the smart devices can access to the Internet from anytime and anywhere. However, with the rapid increase of learning content on the Web, it will be time-consuming for learners to find contents they really want to and need to study. Therefore, e-learning systems should not only provide flexible content delivery, but support adaptive harmonizing fusion content. The harmonizing fusion content it is a very important in fusion e-learning service. The representative method to provide synchronization between fusion content is a provide absolute time value between of the contents. However, this method is occurs a problem transferring time delay. Also, to enter an absolute time value for the duration of the each content is several problems arise. In this paper introduces a new smart e-smart service support the harmonizing media based technology to create synchronized learning presentation.

• Journal of KIISE:Databases
• /
• v.27 no.2
• /
• pp.185-198
• /
• 2000

Recently the technological advance in the hardware dealing with multimedia data as well as the explosive increase of the volume of multimedia data bring about new interest in the use of multimedia presentations in many application domains. To use multimedia presentations efficiently, the integration of multimedia presentations into DBMS is necessary. This paper presents a multimedia presentatation query language based on contents and query processing techniques. Presently, multimedia presentation authoring tools denote a multimedia presentation using a presentation graph which is a DAG. A Node in the graph is a same type of media stream and edges denote a play-out order and a synchronization way among nodes. The contents of presentations graphs are the information of each stream, the sequential order of the information inside each stream and the play-out order among the streams. GCalculus/S is a calculus-based query language and can deal with the contents of a presentation graph and physical characteristics of multimedia data. It expresses the sequential order of information inside each stream and the play-out order of streams of a presentation graph using temporal operators Next, Connected and Until. O-Algebra, which is object algebra, is extended to process GCalculus/S queries.

• Journal of Broadcast Engineering
• /
• v.24 no.2
• /
• pp.329-340
• /
• 2019

Recently, broadcasting technologies have evolved as high-quality AV services such as domestic terrestrial UHD(Ultra-High Definition) broadcasting have been increasing, and broadcasting standards have been newly defined. Also, as network technology develops, contents are consumed not only in the country but also the world. Accordingly, content insertion technology, which is a method of providing suitable contents in accordance with the national and local environments, will be needed. This paper proposes a content insertion service system model and synchronization scheme using ATSC(Advanced Television Systems Committee) 3.0 Event Signaling standard under heterogeneous network environment of broadcasting network and internet network based on transmission standard DASH(Dynamic Adaptive Streaming over HTTP)/ROUTE(Real time Object delivery Over Unidirectional Transport) and MMT(MPEG Media Transport) of terrestrial UHD broadcasting. It also verifies that the service operates in an environment that meets the broadcast standard.