• Title/Summary/Keyword: Depth Video

Search Result 450, Processing Time 0.03 seconds

2D-to-3D Stereoscopic conversion: Depth estimation in monoscopic soccer videos (단일 시점 축구 비디오의 3차원 영상 변환을 위한 깊이지도 생성 방법)

  • Ko, Jae-Seung;Kim, Young-Woo;Jung, Young-Ju;Kim, Chang-Ick
    • Journal of Broadcast Engineering
    • /
    • v.13 no.4
    • /
    • pp.427-439
    • /
    • 2008
  • This paper proposes a novel method to convert monoscopic soccer videos to stereoscopic videos. Through the soccer video analysis process, we detect shot boundaries and classify soccer frames into long shot or non-long shot. In the long shot case, the depth mapis generated relying on the size of the extracted ground region. For the non-long shot case, the shot is further partitioned into three types by considering the number of ground blocks and skin blocks which is obtained by a simple skin-color detection method. Then three different depth assignment methods are applied to each non-long shot types: 1) Depth estimation by object region extraction, 2) Foreground estimation by using the skin block and depth value computation by Gaussian function, and 3)the depth map generation for shots not containing the skin blocks. This depth assignment is followed by stereoscopic image generation. Subjective evaluation comparing generated depth maps and corresponding stereoscopic images indicate that the proposed algorithm can yield the sense of depth from a single view images.

Depth-based Mesh Modeling for Virtual Environment Generation (가상 환경 생성을 위한 깊이 기반 메쉬 모델링)

  • 이원우;우운택
    • Proceedings of the IEEK Conference
    • /
    • 2003.11b
    • /
    • pp.111-114
    • /
    • 2003
  • In this paper, we propose a depth-based mesh modeling method to generate virtual environment. The proposed algorithm constructs mesh model from unorganized point cloud obtained from a multi-view camera. We separate the point cloud consisting objects from the background. Then, we apply triangulation to each object and background. Since the objects and the background are modeled independently, it is possible to construct effective virtual environment. The application of proposed modeling method is applicable to entertainment, such as movie and video game and effective virtual environment generation.

  • PDF

Real-time Stereo Video Generation using Graphics Processing Unit (GPU를 이용한 실시간 양안식 영상 생성 방법)

  • Shin, In-Yong;Ho, Yo-Sung
    • Journal of Broadcast Engineering
    • /
    • v.16 no.4
    • /
    • pp.596-601
    • /
    • 2011
  • In this paper, we propose a fast depth-image-based rendering method to generate a virtual view image in real-time using a graphic processor unit (GPU) for a 3D broadcasting system. Before the transmission, we encode the input 2D+depth video using the H.264 coding standard. At the receiver, we decode the received bitstream and generate a stereo video using a GPU which can compute in parallel. In this paper, we apply a simple and efficient hole filling method to reduce the decoder complexity and reduce hole filling errors. Besides, we design a vertical parallel structure for a forward mapping process to take advantage of the single instruction multiple thread structure of GPU. We also utilize high speed GPU memories to boost the computation speed. As a result, we can generate virtual view images 15 times faster than the case of CPU-based processing.

Evaluation for User Experience about Interface Design of Video-Sharing Website -Mainly with Analysis on 'YouTube' and 'Vimeo'- (영상 공유 사이트의 인터페이스 디자인에 따른 사용자 경험 연구 -유튜브(YouTube)와 비메오(Vimeo)를 중심으로-)

  • Lee, Seung-Yun;Kim, Seung-In
    • Journal of Digital Convergence
    • /
    • v.14 no.8
    • /
    • pp.423-429
    • /
    • 2016
  • The study evaluates user experiences of YouTube and Vimeo, typical Video-sharing websites, to suggest guidelines that are more user-cantered and useful. I did some literature research followed with evaluation of theoretical backgrounds, present conditions and future services. Also, I used the six principles of "Creating Pleasurable Interface" by Stephen Anderson to conduct an in-depth interview. The results indicate that YouTube needs to improve availability of its functions and usability by reducing advertisement. Vimeo needs to improve its popularity by increasing popular contents and add relationship service such as personal broadcasting system and community services. I expect this study will become a good resource for upgrading user experiences of Video-sharing websites. I also believe that this study can guide other studies about user experience in other fields.

A Study on Sound Synchronized Out-Focusing Techniques for 3D Animation (음원 데이터를 활용한 3D 애니메이션 카메라 아웃포커싱 표현 연구)

  • Lee, Junsang;Lee, Imgeun
    • Journal of the Korea Society of Computer and Information
    • /
    • v.19 no.2
    • /
    • pp.57-65
    • /
    • 2014
  • The role of sound in producing 3D animation clip is one of the important factor to maximize the immersive effects of the scene. Especially interaction between video and sound makes the scene expressions more apparent, which is diversely applied in video production. One of these interaction techniques, the out-focussing technique is frequently used in both real video and 3D animation field. But in 3D animation, out-focussing is not easily implemented as in music videos or explosion scenes in real video shots. This paper analyzes the sound data to synchronize the depth of field with it. The novel out-focussing technique is proposed, where the object's field of depth is controlled by beat rhythm in the sound data.

Types of Video Content for SMEs' Digital Marketing (중소기업 디지털 마케팅을 위한 영상 콘텐츠 유형 연구)

  • Jung, Hoe-Kyung;Lee, Sung-Mi
    • Journal of Digital Convergence
    • /
    • v.16 no.11
    • /
    • pp.441-446
    • /
    • 2018
  • The purpose of this study is to investigate the digital media strategies for small business branding. To understand the effective strategies for promoting small business through digital content marketing, we conducted in-depth interview with small business managers. The results of in-depth interview revealed that it is critical for small businesses to start creating and including video marketing as part of their entire content strategy. Especially, small business managers considered that video that provides rich media content can boost consumer engagement and increase the time spent on a branded contents. From a managerial perspective, this study provides guide on what small businesses should consider when developing and implementing digital strategies. For future research, this study provides the guide to investigate the effects of digital contents on the brand equity of small business.

Proposal of design plan to improve immersion in online video education -Focusing on Zoom and Webex- (온라인 화상 교육 몰입도 향상을 위한 디자인 방안 제안 -줌(Zoom)과 웹엑스(Webex)를 중심으로-)

  • Lee, Kaha;Kim, Seung-In
    • Journal of Digital Convergence
    • /
    • v.19 no.7
    • /
    • pp.341-348
    • /
    • 2021
  • This study identified learners' immersion, focusing on online video education platforms, Zoom and Webex, used in colleges after the 'Covid-19', and suggested design improvement measures to improve immersion. Through prior research and literature research, the components of immersion and screen components of the online distance education platform were identified, and measures to improve immersion were suggested through questionnaire surveys and in-depth interviews. The research method was conducted for 5 days from April 7 to 12, 2021 for 50 college students and graduate students in their 20s and 30s who are receiving online education through Zoom and Webex, and 6 people were interviewed in-depth. As a result of the experiment, the communication between learners and lecturers was deduced as the biggest factor, so a design plan to facilitate communication between learners and lecturers was proposed based on Gutenberg's diagram. As online video education is predicted to continue even after the Covid-19, continuous online video education immersion research is needed, and we hope that it can contribute to the direction of the research.

An efficient multi-view video coding using correlation between multi-view video and depth map (다시점 비디오와 깊이 정보의 상판도를 이용한 효율적인 다시점 비디오 부호화 기법)

  • Bae, Byung-Kyu;Yun, Jung-Hwan;Kim, Dong-Wook;Yoo, Ji-Sang
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2008.11a
    • /
    • pp.259-262
    • /
    • 2008
  • 본 논문에서는 다시점 비디오와 깊이 정보의 상관도를 이용해서 현재 JVT(joint video team)에서 표준화 된 다시점 비디오 부호화 (multi-view video coding : MVC)의 참조 소프트웨어인 JMVM(joint multi-view video model)을 기반으로 하여 효율적인 다시점 비디오 압축 방법을 제안한다. 기존의 일반적인 비디오 부호화 방식은 단일 시점에 대한 비디오 부호화 기술이기 때문에 다시점 비디오 전송을 위해서는 시점 당 각각 전송 채널에 필요하다. 하지만 다시점 비디오 부호화 기법을 이용하게 되면, 단일 전송 채널을 이용하여 전송이 가능하다. 본 논문에서 제안된 방법은 입력된 다시점 입력 영상과 해당 하는 깊이 정보를 이용하여 시점 간의 예측 방법의 효율성을 높였다. 다시점 입력 영상과 깊이 정보의 전역 변이 벡터 (global disparity vector : GDV)의 상관도를 이용하였으며, 다시점 영상과 깊이 정보를 동시에 전송해야 할 경우 복잡도를 낮출 수 있고, 약 $0.01{\sim}0.1dB$의 PSNR 이득을 얻을 수 있다.

  • PDF

Floop: An efficient video coding flow for unmanned aerial vehicles

  • Yu Su;Qianqian Cheng;Shuijie Wang;Jian Zhou;Yuhe Qiu
    • ETRI Journal
    • /
    • v.45 no.4
    • /
    • pp.615-626
    • /
    • 2023
  • Under limited transmission conditions, many factors affect the efficiency of video transmission. During the flight of an unmanned aerial vehicle (UAV), frequent network switching often occurs, and the channel transmission condition changes rapidly, resulting in low-video transmission efficiency. This paper presents an efficient video coding flow for UAVs working in the 5G nonstandalone network and proposes two bit controllers, including time and spatial bit controllers, in the flow. When the environment fluctuates significantly, the time bit controller adjusts the depth of the recursive codec to reduce the error propagation caused by excessive network inference. The spatial bit controller combines the spatial bit mask with the channel quality multiplier to adjust the bit allocation in space to allocate resources better and improve the efficiency of information carrying. In the spatial bit controller, a flexible mini graph is proposed to compute the channel quality multiplier. In this study, two bit controllers with end-to-end codec were combined, thereby constructing an efficient video coding flow. Many experiments have been performed in various environments. Concerning the multi-scale structural similarity index and peak signal-to-noise ratio, the performance of the coding flow is close to that of H.265 in the low bits per pixel area. With an increase in bits per pixel, the saturation bottleneck of the coding flow is at the same level as that of H.264.

A Depth-based Disocclusion Filling Method for Virtual Viewpoint Image Synthesis (가상 시점 영상 합성을 위한 깊이 기반 가려짐 영역 메움법)

  • Ahn, Il-Koo;Kim, Chang-Ick
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.6
    • /
    • pp.48-60
    • /
    • 2011
  • Nowadays, the 3D community is actively researching on 3D imaging and free-viewpoint video (FVV). The free-viewpoint rendering in multi-view video, virtually move through the scenes in order to create different viewpoints, has become a popular topic in 3D research that can lead to various applications. However, there are restrictions of cost-effectiveness and occupying large bandwidth in video transmission. An alternative to solve this problem is to generate virtual views using a single texture image and a corresponding depth image. A critical issue on generating virtual views is that the regions occluded by the foreground (FG) objects in the original views may become visible in the synthesized views. Filling this disocclusions (holes) in a visually plausible manner determines the quality of synthesis results. In this paper, a new approach for handling disocclusions using depth based inpainting algorithm in synthesized views is presented. Patch based non-parametric texture synthesis which shows excellent performance has two critical elements: determining where to fill first and determining what patch to be copied. In this work, a noise-robust filling priority using the structure tensor of Hessian matrix is proposed. Moreover, a patch matching algorithm excluding foreground region using depth map and considering epipolar line is proposed. Superiority of the proposed method over the existing methods is proved by comparing the experimental results.