• Title/Summary/Keyword: Video Enhancement

Search Result 273, Processing Time 0.02 seconds

GAN-based Quality Enhancement of Compressed Video (GAN 을 이용한 압축된 동영상 품질 향상)

  • Yongseong Kim;Yujin Lee;Bumyoon Kim;Byeungwoo Jeon
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2022.11a
    • /
    • pp.191-192
    • /
    • 2022
  • 본 논문에서는 딥러닝의 주요 기법 중 하나인 GAN 을 활용하여 압축된 영상의 품질을 개선하는 방법을 제안한다. 제안하는 GAN 의 생성자는 U-Net 과 ResNet 을 기반으로 구성되었으며, 판별자는 합성곱층과 전연결층으로 구성하였다. 네트워크의 학습은 HEVC (High Efficiency Video Coding)의 테스트 모델인 HM16.25 를 사용하여 RA (Random Access) 구성하에 양자화 계수 37 로 압축된 영상을 입력으로 하여 수행되었다. 제안하는 네트워크의 성능 확인을 위해 학습 시와 동일한 조건으로 압축된 다른 영상을 입력으로 하여 실험하였다. 실험 결과 영상의 평균 PSNR 은 34.20dB 에서 34.24dB 로 0.04dB 의 품질 향상이 이루어진 것을 확인할 수 있었다.

  • PDF

The Effects of Social Media Advertising on Social Search in China: Evidence from Luxury Brand

  • GAO, XING;Kim, Sang Yong;Kim, Da Yeon;Lee, Seung Min
    • Asia Marketing Journal
    • /
    • v.21 no.3
    • /
    • pp.65-82
    • /
    • 2019
  • This study examines the relationship between social media advertisement and customer interest in the context of luxury brands. Further, this study investigates the effective ways to utilize visual types (pictorial advertisement and video advertisement) and contents types (website link and hash-tag) in social media advertising by proposing a time-series model to estimate the long-term effect of social media advertising on social search. We find that the pictorial advertisements are more effective than video advertisements, which provides a different result from previous existing research. In addition, advertisements using hashtags are more effective than web links due to efficiency of the search feature. Finally, since the number of brand fans also have a positive effect on advertising interest, it is essential to utilize social media advertising for the enhancement of customers' interests. Confirming that the effectiveness of social media advertising varies depending on how the visual contents and text are presented, this research can help marketing managers to assess predicted outcomes of using various methods of social media advertising.

The Design and Implementation of MPEG-2 Video Temporal Layered Coding for Scalable Transmission (스케러블 전송을 위한 MPEG-2 비디오 Temporal Layered Coding에 대한 설계 및 구현)

  • 김태영;유우종;김형철;궁상한;유관종
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 1998.10a
    • /
    • pp.462-464
    • /
    • 1998
  • 이질적인 환경 (Heterogoneous Environments)에서 실시간 멀티미디어 서비스가 확산됨에 따라 비디오 데이터로 인한 트래픽이 통신망을 오가는 트래픽의 대부분을 차지하게 되었다. 이에 통신망 자원의 효율화를 위해서 사용자의 통신망 환경을 고려한, 비디오 데이터 스케러블 전송이 필요하다. 이를 위해 MPEG-2에서는 비디오 데이터를 Base layer와 Enhancement layer로 나누는 layered coding 방식을 채택할 수 있게 하여 낮은 대역폭인 경우는 Base layer만 보내고 높은 대역폭인 경우 Base layer와 Enhancement layer를 모두 보내는 방식을 사용할 수 있도록 하였으나, 실질적으로는 Base layer만으로도 데어터 량이 많아 이를 적용하는 인코더는 현재 전무한 실정이다. 따라서 본 논문에서는 Base layer를 MPEG-2비디오 데이터 스케러블 전송에 맞게 초당 디스플레이하는 프레임 수를 동적으로 조정하는 temporal layered coding을 통해 사용자 통신망 환경에 맞게 비디오 데이터를 보내는 방법을 제안한다.

  • PDF

A Scalable Satellite Broadcasting System in 21GHz Band (21GHz 대역 스케일러블 위성방송 시스템 구현)

  • Kim, Dong-Hwan;Chung, Beob-Ki;Lee, Woo-Geun;Kim, Seung-Chul;Chang, Tae-Gyu
    • Proceedings of the KIEE Conference
    • /
    • 2008.10b
    • /
    • pp.513-514
    • /
    • 2008
  • A scalable satellite broadcasting system is designed to guarantee quality of multimedia service cooperatively utilizing both Ku Band and Ka band. In the system, video streams are separated into a base layer and an enhancement layer, and are transmitted over the two channels, Ku Band and Ka band, respectively. A basic quality of service using the base layer stream can be provided even when the enhancement layer stream over Ka band channel is unavailable by rain attenuation. A rain fall model is simulated using Barlett-Lewis Pulse model and is used in the operation test of the implemented sacalable satellite broadcasting system.

  • PDF

Layer Selection Algorithms of H.264/SVC Streams for Network Congestion Control (네트워크 혼잡 제어를 위한 H.264/SVC 스트림의 계층 선택 알고리즘)

  • Kim, Nam-Yun;Hwang, Ki-Tae
    • Journal of Korea Multimedia Society
    • /
    • v.14 no.1
    • /
    • pp.44-53
    • /
    • 2011
  • H.264/SVC provides scalable video streams which consist of a base layer and one or more enhancement layers. Thus, it can efficiently adapt encoded streams to individual network conditions by dropping some layers of bit streams. However, on a dynamic environment such as the Internet, random packet losses due to network congestion can cause drastic effect on SVC quality. To avoid network congestion, the rate of video streams should be adjusted by carefully selecting a layer of each stream. In this paper, we propose three layer selection algorithms which can avoid network congestion by using the rate-distortion characteristics of streams. Simulation results show that FS(Far-Sighted) algorithm can maximize the overall PSNR value of streams by efficiently using the characteristics of video streams.

Enhancement of 3D Point Cloud Contents Using 2D Image Super Resolution Network

  • Seonghwan Park;Junsik Kim;Yonghae Hwang;Doug Young Suh;Kyuheon Kim
    • Journal of Web Engineering
    • /
    • v.21 no.2
    • /
    • pp.425-442
    • /
    • 2021
  • Media technology has been developed to give users a sense of immersion. Recent media using 3D spatial data, such as augmented reality and virtual reality, has attracted attention. A point cloud is a data format that consists of a number of points, and thus can express 3D media using coordinates and color information for each point. Since a point cloud has a larger capacity than 2D images, a technology to compress the point cloud is required, i.e., standardized in the international standard organization MPEG as a video-based point cloud compression (V-PCC). V-PCC decomposes 3D point cloud data into 2D patches along orthogonal directions, and those patches are placed into a 2D image sequence, and then compressed using existing 2D video codecs. However, data loss may occur while converting a 3D point cloud into a 2D image sequence and encoding this sequence using a legacy video codec. This data loss can cause deterioration in the quality of a reconstructed point cloud. This paper proposed a method of enhancing a reconstructed point cloud by applying a super resolution network to the 2D patch image sequence of a 3D point cloud.

Mechanisms of Convective and Boiling Heat Transfer Enhancement via Ultrasonic Vibration (초음파 진동에 의한 대류 및 비등 열전달 촉진 원리에 관한 연구)

  • Kim, Yi-Gu;Kim, Ho-Young;Kang, Seoung-Min;Kang, Byung-ha;Lee, Jin-Ho
    • Transactions of the Korean Society of Mechanical Engineers B
    • /
    • v.27 no.5
    • /
    • pp.612-619
    • /
    • 2003
  • This work experimentally studies the fundamental mechanisms by which the ultrasonic vibration enhances convection and pool boiling heat transfer. A thin platinum wire is used as both a heat source and a temperature sensor. A high speed video imaging system is employed to observe the behavior of cavitation and thermal bubbles. It is found that when the liquid temperature is below its boiling point, cavitation takes place due to ultrasonic vibration while cavitation disappears when the liquid reaches the boiling point. Moreover, when the gas dissolved in liquid is removed by pre-degassing, the cavitation arises only locally. Depending on the liquid temperature, heat transfer rates in convection, subcooled boiling and saturated boiling regimes are examined. In convection heat transfer regime, fully agitated cavitation is the most efficient heat transfer enhancement mechanism. Subcooled boiling is most enhanced when tile local cavitation is induced after degassing. In saturated boiling regime, acoustic pressure is shown to be a dominant heat transfer enhancement mechanism.

Adaptive QoS Study for Video Streaming Service In MMT Protocol (비디오 스트리밍 서비스를 위한 MMT 기반 적응적 QoS 연구)

  • Jo, Bokyun;Lee, Doohyun;Suh, Doug Young
    • Journal of Broadcast Engineering
    • /
    • v.20 no.1
    • /
    • pp.40-47
    • /
    • 2015
  • This paper discusses QoS enhancement in the Best-effort services of the service plan provided by MPEG Media Transport (MMT) systems for video streaming applications. Among MMT services, i.e. per-flow, per-class, and best-effort services, the server does not provide guaranteed bandwidth for the best-effort service only. Therefore, in the best-effort services, a bandwidth access priority is defined for various services, where the lowest priority is assigned to the low-level video services. To alleviate the issue of bandwidth limitation in the best-effort services, this paper investigates transmission of low-resolution video with low bitrate and up-sampling. Our experimental results prove the superiority of the proposed method in terms of delivered video quality.

An Intelligent Video Streaming Mechanism based on a Deep Q-Network for QoE Enhancement (QoE 향상을 위한 Deep Q-Network 기반의 지능형 비디오 스트리밍 메커니즘)

  • Kim, ISeul;Hong, Seongjun;Jung, Sungwook;Lim, Kyungshik
    • Journal of Korea Multimedia Society
    • /
    • v.21 no.2
    • /
    • pp.188-198
    • /
    • 2018
  • With recent development of high-speed wide-area wireless networks and wide spread of highperformance wireless devices, the demand on seamless video streaming services in Long Term Evolution (LTE) network environments is ever increasing. To meet the demand and provide enhanced Quality of Experience (QoE) with mobile users, the Dynamic Adaptive Streaming over HTTP (DASH) has been actively studied to achieve QoE enhanced video streaming service in dynamic network environments. However, the existing DASH algorithm to select the quality of requesting video segments is based on a procedural algorithm so that it reveals a limitation to adapt its performance to dynamic network situations. To overcome this limitation this paper proposes a novel quality selection mechanism based on a Deep Q-Network (DQN) model, the DQN-based DASH ABR($DQN_{ABR}$) mechanism. The $DQN_{ABR}$ mechanism replaces the existing DASH ABR algorithm with an intelligent deep learning model which optimizes service quality to mobile users through reinforcement learning. Compared to the existing approaches, the experimental analysis shows that the proposed solution outperforms in terms of adapting to dynamic wireless network situations and improving QoE experience of end users.

Adaptive Inter-layer Filter Selection Mechanism for Improved Scalable Extensions of High Efficiency Video Coding (SHVC) (스케일러블 HEVC 부호화 효율 개선을 위한 계층 간 적응적 필터 선택 알고리즘)

  • Lee, Jong-Hyeok;Kim, Byung-Gyu
    • Journal of Digital Contents Society
    • /
    • v.18 no.1
    • /
    • pp.141-147
    • /
    • 2017
  • Scalable extension of High Efficiency Video Coding (SHVC) standard uses the up-sampled residual data from the base layer to make a residual data in the enhancement layer. This paper describes an efficient algorithm for improving coding gain by using the filtered residual signal of base layer in the Scalable extension of High Efficiency Video Coding (SHVC). The proposed adaptive filter selection mechanism uses the smoothing and sharpening filters to enhance the quality of inter-layer prediction. Based on two filters and the existing up-sampling filter, a rate-distortion (RD)-cost fuction-based competitive scheme is proposed to get better quality of video. Experimental results showed that average BD-rate gains of 1.5%, 2.1%, and 1.7% for Y, U and V components, respectively, were achieved, compared with SHVC reference software 5.0, which is based on HEVC reference model (HM) 13.