• ETRI Journal
• /
• v.39 no.4
• /
• pp.502-513
• /
• 2017

For video understanding, namely analyzing who did what in a video, actions along with objects are primary elements. Most studies on actions have handled recognition problems for a well-trimmed video and focused on enhancing their classification performance. However, action detection, including localization as well as recognition, is required because, in general, actions intersect in time and space. In addition, most studies have not considered extensibility for a newly added action that has been previously trained. Therefore, proposed in this paper is an extensible hierarchical method for detecting generic actions, which combine object movements and spatial relations between two objects, and inherited actions, which are determined by the related objects through an ontology and rule based methodology. The hierarchical design of the method enables it to detect any interactive actions based on the spatial relations between two objects. The method using object information achieves an F-measure of 90.27%. Moreover, this paper describes the extensibility of the method for a new action contained in a video from a video domain that is different from the dataset used.

• Journal of Korea Society of Industrial Information Systems
• /
• v.12 no.1
• /
• pp.54-60
• /
• 2007

The Digital Multimedia Broadcasting(DMB) system is developed to offer high quality multimedia content to the mobile environment. The system adopts the MPEG-4 standard for the main video, audio and other media format. For providing interactive contents, it also adopts the MPEG-4 scene description that refers to the spatio-temporal specifications and behaviors of individual objects. With more interactive contents, the scene description also needs higher bitrate. However, the bandwidth for allocating meta data, such as scene description is restrictive in the mobile environment. On one hand, the DMB terminal renders each media stream according to the scene description. Thus the binary format for scene(BIFS) stream corresponding to the scene description should be decoded and parsed in advance when presenting media data. With this reasoning, the transmission delay of the BIFS stream would cause the delay in transmitting whole audio-visual scene presentations, although the audio or video streams are encoded in very low bitrate. This paper presents the effective optimization technique in adapting the BIFS stream into the expected bitrate without any waste in bandwidth and avoiding transmission delays inthe initial scene description for interactive DMB content.

• Journal of the HCI Society of Korea
• /
• v.2 no.1
• /
• pp.1-12
• /
• 2007

In this paper, we propose a video service system that reflects user interaction in the multimedia contents to increase user satisfaction in the restricted content consumption environment. The proposed system is based on the multiple ROI(Region of Interest) coding in H.264/AVC Scalable Video Coding (SVC). The proposed system provides scalable video quality by adopting SVC. And by bidirectional communication between user and video server, it enables user to select meaningful ROI among multiple ROIs by user interaction. To verify the usefulness of the proposed system, we demonstrate it with a test-bed on which user interactive ROIs are implemented.

• Journal of KIISE
• /
• v.44 no.5
• /
• pp.545-552
• /
• 2017

Because of the explosive growth of mobile devices and development of network technologies, HTTP (Hypertext Transfer Protocol) adaptive streaming has become a new trend in video delivery to provide efficient multimedia streaming services. As interest in personalized broadcasting grows, the study of interactive multimedia has been actively pursued. The interactive multimedia service is a method of playing media according to a scenario selected by the user. Providing the interactive multimedia service with the existing HTTP adaptive streaming causes switching delay and buffer underflow according to the point in time when the user selects the scenario while the client streams the interactive multimedia and therefore decreases the user QoE (Quality of Experience). In this paper, we propose an adaptive streaming scheme for interactive multimedia service in HTTP adaptive streaming to provide seamless playback. We design the architecture and prefetching scheme for interactive multimedia streaming.

• Journal of KIISE:Information Networking
• /
• v.28 no.4
• /
• pp.508-516
• /
• 2001

This paper proposes multicast routing algorithm that operates for non-interactive multimedia applications such as VOD(Video On Demand) and real-time data broadcasting. It is possible that there exist multiple senders in non-interactive multimedia applications. This paper designs multicast routing algorithm in this environment. The simulation of algorithm proposed in this paper shows much better performancetcost, delay) than that of only one source. To guarantee the performance of algorithm, Broadband ATM network is modelled in simulation.

• Journal of Broadcast Engineering
• /
• v.14 no.1
• /
• pp.85-88
• /
• 2009

Recently "DMB Video-Associated Stereoscopic Data Services" standard has been published by TTA. The standard enables DMB broadcasters to provide 3D or stereoscopic interactive data services based on MPEG-4 BIFS (Binary Format for Scenes). The purpose is to entice viewers to utilize DMB interactive data services more often by providing realistic and protrusive image objects overlaid on top of the main video in the background. This paper provides the background, technical analysis, and in-depth considerations for the standard. Also the results of standard verification are provided including the results of interoperability test with the existing terrestrial DMB receivers.

• The KIPS Transactions:PartB
• /
• v.8B no.5
• /
• pp.507-514
• /
• 2001

In VOD(Video-on-Demand) system, the real-time interactive service is one of the most important factor to determine the degree of QoS(Quality of Service). In this paper, we propose the head-end system consisted of switching agent and head-end node, which needs to receive the only video stream for multiple users which have requested the same video, to serve the unlimited interactive service which has no service delay and block. The unlimited VCR services can be served by storing the video stream with buffer at client and head-end node. And the proposed algorithm presents the method to enhance the efficiency by buffer, offer the true interactive VOD services to users because all of service requested by clients are processed immediately. In this paper, we implemented the VOD system which has the VCR functions without service delay and block. Simulation results indicate that the proposed algorithm has better performance in the number of service request and time interval.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 1999.06b
• /
• pp.103-108
• /
• 1999

방송 환경의 디지털화와 더불어 단순히 단방향 방송 정보만을 시청하던 기존의 방식을 넘어 사용자의 다양한 욕구를 수용할 수 있는 대화형 방송 서비스(interactive broadcasting service)가 시작되고 있다. 대화형 방송 환경에서는 특히 사용자 측에 제공된 방대한 양의 디지털 멀티미디어 자료에 대한 효과적인 접근이 요구되는데, 본 논문에서는 이를 위하여 방송 비디오를 효과적으로 브라우징(browsing) 및 검색하고 전체의 내용을 짧은 시간 내에 개관할 수 있도록 하는 동적 비디오 요약(dynamic video abstraction) 기법에 관하여 고찰한다. 동적 비디오 요약에 의한 요약 비디오(skim video)는 전체 비디오를 내용에 기반하여 효과적으로 표현할 수 있도록 동영상 내의 주요 구간만으로 구성된 것으로, 대화형 방송에서 새로운 형태의 프로그램 안내 및 사용자 저장 자료에 대한 브라우징 도구 등으로써 매우 유용하게 사용할 수 있다. 본 논문에서는 자동으로 비디오 요약을 구현하기 위한 접근 방법과 전체 기능 구성 및 각 기능들의 구현 방법에 대하여 기술한다.

• Journal of Internet Computing and Services
• /
• v.18 no.1
• /
• pp.37-41
• /
• 2017

In this paper, a platform was proposed that can service the streaming of location based real-time video-clip for smart-travel-services to work with PPL(Product Placement). The location information of drama like as LTE GPS and Beacon were used to provide the drama video with the PUSH service. And PPL DB with the attributes like as picture, video, music and URI(Uniform resource Identifier) was designed. As a result, this platform could provide the location based video streaming service that could replace the original PPL properties, color or shape, with the other properties by the interactive tagging the PPL DB in drama scenes. The proposed platform could provide the location based real-time video streaming service that can alter the PPL properties with the request of service provider.

• 제어로봇시스템학회:학술대회논문집
• /
• 2004.08a
• /
• pp.1191-1194
• /
• 2004

We describe the development of an interactive aerobic training system using vision-based motion capture and multimedia technology. Unlike the traditional one-way aerobic training on TV, the proposed system allows the virtual trainer to observe and interact with the user in real-time. The system is composed of a web camera connected to a PC watching the user moves. First, the animated character on the screen makes a move, and then instructs the user to follow its movement. The system applies a robust statistical background subtraction method to extract a silhouette of the moving user from the captured video. Subsequently, principal body parts of the extracted silhouette are located using model-based approach. The motion of these body parts is then analyzed and compared with the motion of the animated character. The system provides audio feedback to the user according to the result of the motion comparison. All the animation and video processing run in real-time on a PC-based system with consumer-type camera. This proposed system is a good example of applying vision algorithms and multimedia technology for intelligent interactive home entertainment systems.