• Title/Summary/Keyword: Scene Matching

Search Result 156, Processing Time 0.023 seconds

Multi-view Video Coding using View Interpolation (영상 보간을 이용한 다시점 비디오 부호화 방법)

  • Lee, Cheon;Oh, Kwan-Jung;Ho, Yo-Sung
    • Journal of Broadcast Engineering
    • /
    • v.12 no.2
    • /
    • pp.128-136
    • /
    • 2007
  • Since the multi-view video is a set of video sequences captured by multiple array cameras for the same three-dimensional scene, it can provide multiple viewpoint images using geometrical manipulation and intermediate view generation. Although multi-view video allows us to experience more realistic feeling with a wide range of images, the amount of data to be processed increases in proportion to the number of cameras. Therefore, we need to develop efficient coding methods. One of the possible approaches to multi-view video coding is to generate an intermediate image using view interpolation method and to use the interpolated image as an additional reference frame. The previous view interpolation method for multi-view video coding employs fixed size block matching over the pre-determined disparity search range. However, if the disparity search range is not proper, disparity error may occur. In this paper, we propose an efficient view interpolation method using initial disparity estimation, variable block-based estimation, and pixel-level estimation using adjusted search ranges. In addition, we propose a multi-view video coding method based on H.264/AVC to exploit the intermediate image. Intermediate images have been improved about $1{\sim}4dB$ using the proposed method compared to the previous view interpolation method, and the coding efficiency have been improved about 0.5 dB compared to the reference model.

Multi-view Generation using High Resolution Stereoscopic Cameras and a Low Resolution Time-of-Flight Camera (고해상도 스테레오 카메라와 저해상도 깊이 카메라를 이용한 다시점 영상 생성)

  • Lee, Cheon;Song, Hyok;Choi, Byeong-Ho;Ho, Yo-Sung
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.37 no.4A
    • /
    • pp.239-249
    • /
    • 2012
  • Recently, the virtual view generation method using depth data is employed to support the advanced stereoscopic and auto-stereoscopic displays. Although depth data is invisible to user at 3D video rendering, its accuracy is very important since it determines the quality of generated virtual view image. Many works are related to such depth enhancement exploiting a time-of-flight (TOF) camera. In this paper, we propose a fast 3D scene capturing system using one TOF camera at center and two high-resolution cameras at both sides. Since we need two depth data for both color cameras, we obtain two views' depth data from the center using the 3D warping technique. Holes in warped depth maps are filled by referring to the surrounded background depth values. In order to reduce mismatches of object boundaries between the depth and color images, we used the joint bilateral filter on the warped depth data. Finally, using two color images and depth maps, we generated 10 additional intermediate images. To realize fast capturing system, we implemented the proposed system using multi-threading technique. Experimental results show that the proposed capturing system captured two viewpoints' color and depth videos in real-time and generated 10 additional views at 7 fps.

A study on the distribution of glitter particles from an university building (대학 강의실에서 글리터의 분포 연구)

  • Hong, Sungwook;Cho, Hyoung-Woo;Son, Da-som;Lee, Seul-Bi
    • Analytical Science and Technology
    • /
    • v.28 no.4
    • /
    • pp.288-298
    • /
    • 2015
  • A distribution study of glitter was conducted from a local university building. The potential recipient surfaces chosen were the 1,000 chairs kept in 16 separate classrooms of the building. The surface of chairs contacting with buttocks and back of users were tape lifted with commercial adhesive tapes, and the surface of adhesive tapes were examined with a stereomicroscope to locate the glitters. 12 glitter particles were found from 11 chairs kept in 16 classrooms of a building. This result indicates that the possibility of glitter finding from Korean violent crime scene is high. The 12 glitters found from the chairs were analyzed with a stereomicroscope and an FTIR spectrophotometer to find the matching glitter. The stereomicroscope was used for the observation of the shapes, dimensions, colors and holograms of each glitter, and the FTIR spectrophotometer was used for the analysis of the chemical composition of the coating material of each glitter. The examination results revealed that 8 glitters out of 12 glitters were not sharing the common origin each other. Also, two glitters found from two separate classroom chairs share common microscopic and FTIR spectroscopic characteristics which indicating two glitters share common origin. The record of the students who had used the classrooms was traced and the authors could find that the classrooms where the same glitters were found were shared by a group of students who listen to the same class. This result implies that the path of the involved people should be considered while assessing the value of trace evidence.

Automatic Video Editing Technology based on Matching System using Genre Characteristic Patterns (장르 특성 패턴을 활용한 매칭시스템 기반의 자동영상편집 기술)

  • Mun, Hyejun;Lim, Yangmi
    • Journal of Broadcast Engineering
    • /
    • v.25 no.6
    • /
    • pp.861-869
    • /
    • 2020
  • We introduce the application that automatically makes several images stored in user's device into one video by using the different climax patterns appearing for each film genre. For the classification of the genre characteristics of movies, a climax pattern model style was created by analyzing the genre of domestic movie drama, action, horror and foreign movie drama, action, and horror. The climax pattern was characterized by the change in shot size, the length of the shot, and the frequency of insert use in a specific scene part of the movie, and the result was visualized. The model visualized by genre developed as a template using Firebase DB. Images stored in the user's device were selected and matched with the climax pattern model developed as a template for each genre. Although it is a short video, it is a feature of the proposed application that it can create an emotional story video that reflects the characteristics of the genre. Recently, platform operators such as YouTube and Naver are upgrading applications that automatically generate video using a picture or video taken by the user directly with a smartphone. However, applications that have genre characteristics like movies or include video-generation technology to show stories are still insufficient. It is predicted that the proposed automatic video editing has the potential to develop into a video editing application capable of transmitting emotions.

Stereoscopic depth of surfaces lying in the same visual direction depends on the visual direction of surface features (표면 요소의 시선방향에 의한 동일시선 상에 놓여있는 표면의 입체시 깊이 변화)

  • Kham Keetaek
    • Korean Journal of Cognitive Science
    • /
    • v.15 no.4
    • /
    • pp.1-14
    • /
    • 2004
  • When two objects are tying in the same visual direction there occurs abrupt depth change between two objects, which is against the assumption of the computational model for stereopsis on the surfaces in a natural scene. For this reason, this stimulus configuration is popularly used in the studies for the effectiveness of the constraints employed in the computational model. Contrary to the results from two nails (or objects) tying in the same visual direction, the two different surfaces from random-dot stereogram (RDS) in the same situation can be seen simultaneously in the different depth. The seemingly contradictory results between two situations my reflect the different strategies imposed by binocular mechanism for each situation during binocular matching process. Otherwise, the surfaces tying in the same visual direction is not equivalent situation to two objects tying in the same visual direction with regards to matching process. In order to examine above possibilities, the stereoscopic depth of the surface was measured after manipulating the visual direction of the surface elements. The visual direction of each dot pair from different surfaces in RDS (in Experiment 1) or the visual direction of line (hawing rectangle with regard to that of the vertical line (in Experiment 2) was manipulated. The stereoscopic depth of the surface was found to be varied depending on visual direction of the surface elements in both RDS and line hawing stimulus. Similar to the results from two nails situation depth of the surface was greatly reduced when each surface element was tying in the same visual direction as that of the other surface element or the other object. These results suggest that binocular mechanism imposes no different strategy in resolving correspondence problem in both two objects and two surfaces situation. And the results were discussed in the context of usefulness of the constraints employed in the computational model for stereopsis.

  • PDF

Study for making movie poster applied Augmented Reality (증강현실 영화포스터 제작연구)

  • Lee, Ki Ho
    • Cartoon and Animation Studies
    • /
    • s.48
    • /
    • pp.359-383
    • /
    • 2017
  • 3,000 years ago, since the first poster of humanity appeared in Egypt, the invention of printing technique and the development of civilization have accelerated the poster production technology. In keeping with this, the expression of poster has also been developed as an attempt to express artistic sensibility in a simple arrangement of characters, and now it has become an art form that has become a domain of professional designers. However, the technological development in the expression of poster is keep staying in two-dimensional, and is dependent on printing only that it is irrelevant to the change of ICT environment based on modern multimedia. Especially, among the many kinds of posters, the style of movie posters, which are the only objects for video, are still printed on paper, and many attempts have been made so far, but the movie industry still does not consider ICT integration at all. This study started with the feature that the object of the movie poster dealt with the video and attempted to introduce the augmented reality to apply the dynamic image of the movie to the static poster. In the graduation work of the media design major of a university in Korea, the poster of each works for promoting the visual work of the students was designed and printed in the form of a commercial film poster. Among them, 6 artworks that are considered to be suitable for augmented reality were selected and augmented reality was introduced and exhibited. Content that appears matched to the poster through the mobile device is reproduced on a poster of a scene of the video, but the text informations of the original poster are kept as they are, so that is able to build a moving poster looked like a wanted from the movie "Harry Potter". In order to produce this augmented reality poster, we applied augmented reality to posters of existing commercial films produced in two different formats, and found a way to increase the characteristics of AR contents. Through this, we were able to understand poster design suitable for AR representation, and technical expression for stable operation of augmented reality can be summarized in the matching process of augmented reality contents production.