• Title/Summary/Keyword: 라이트 필드

Search Result 35, Processing Time 0.03 seconds

Analysis of Affine Motion Compensation for Light Field Image Compression (라이트필드 영상 압축을 위한 Affine 움직임 보상 분석)

  • Huu, Thuc Nguyen;Duong, Vinh Van;Xu, Motong;Jeon, Byeungwoo
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2019.06a
    • /
    • pp.216-217
    • /
    • 2019
  • Light Field (LF) image can be understood as a set of images captured by a multi-view camera array at the same time. The changes among views can be modeled by a general motion model such as affine motion model. In this paper, we study the impact of affine coding tool of Versatile Video Coding (VVC) on LF image compression. Our experimental results show a small contribution by affine coding tool in overall LF image compression of roughly 0.2% - 0.4%.

  • PDF

Improving View-consistency on 4D Light Field Superpixel Segmentation (라이트필드 영상 슈퍼픽셀 분할의 시점간 일관성 개선)

  • Yim, Jonghoon;Duong, Vinh Van;Huu, Thuc Ngyuen;Jeon, Byeungwoo
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2021.06a
    • /
    • pp.97-100
    • /
    • 2021
  • Light field (LF) superpixel segmentation aims to group the similar pixels not only in the single image but also in the other views to improve the computational efficiency of further applications like object detection and pattern recognition. Among the state-of-the-art methods, there is an approach to segment the LF images while enforcing the view consistency. However, it leaves too much noise and inaccuracy in the shape of superpixels. In this paper, we modify the process of the clustering step. Experimental results demonstrate that our proposed method outperforms the existing method in terms of view-consistency.

  • PDF

Light Field Image Spatial Resolution Enhancement: A Review (라이트 필드 영상의 공간해상도 개선: 리뷰)

  • Yim, Jonghoon;Van Duong, Vinh;Jeon, Byeungwoo
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2020.07a
    • /
    • pp.272-275
    • /
    • 2020
  • Light Field (LF) cameras capture both spatial and directional information of light rays. Current LF cameras have a problem of a low spatial resolution. There have been lots of existing works carried out to improve the resolution of LF images. In this paper, those existing works will be divided into two categories: hardware-based approaches and software-based approaches, and we will look into and compare several experiment results in order for LF spatial resolution enhancement. Finally, the direction for the future spatial resolution enhancement will be suggested.

  • PDF

Limiting Motion Search Range for the Pseudo Video Sequence-based Light Field Image Coding (유사 비디오 시퀀스 기반의 라이트필드 영상 부호화를 위한 움직임 탐색 영역 제한)

  • Yim, Jonghoon;Duong, Vinh Van;Huu, Thuc Nguyen;Jeon, Byeungwoo
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2022.06a
    • /
    • pp.182-183
    • /
    • 2022
  • The large data volume of light field (LF) image has motivated much research on how to compress the data volume more efficiently. One of the approaches is to compress LF images after representing them in the form of pseudo video sequence. In this way, the pseudo temporal redundancy between views can be exploited by motion estimation and compensation. Based on our observation that images obtained by LF cameras have small range of disparity values between adjacent views, we propose to limit the motion search range to reduce the time complexity of motion estimation. Our experimental results show that a smaller motion search range reduces the encoding time while not affecting the bitrate of H.266/VVC much.

  • PDF

LFFCNN: Multi-focus Image Synthesis in Light Field Camera (LFFCNN: 라이트 필드 카메라의 다중 초점 이미지 합성)

  • Hyeong-Sik Kim;Ga-Bin Nam;Young-Seop Kim
    • Journal of the Semiconductor & Display Technology
    • /
    • v.22 no.3
    • /
    • pp.149-154
    • /
    • 2023
  • This paper presents a novel approach to multi-focus image fusion using light field cameras. The proposed neural network, LFFCNN (Light Field Focus Convolutional Neural Network), is composed of three main modules: feature extraction, feature fusion, and feature reconstruction. Specifically, the feature extraction module incorporates SPP (Spatial Pyramid Pooling) to effectively handle images of various scales. Experimental results demonstrate that the proposed model not only effectively fuses a single All-in-Focus image from images with multi focus images but also offers more efficient and robust focus fusion compared to existing methods.

  • PDF

Performance Prediction for Plenoptic Microscopy Under Numerical Aperture Unmatching Conditions (수치 구경 불일치 플렌옵틱 현미경 성능 예측 방안 연구)

  • Ha Neul Yeon;Chan Lee;Seok Gi Han;Jun Ho Lee
    • Korean Journal of Optics and Photonics
    • /
    • v.35 no.1
    • /
    • pp.9-17
    • /
    • 2024
  • A plenoptic optical system for microscopy comprises an objective lens, tube lens, microlens array (MLA), and an image sensor. Numerical aperture (NA) matching between the tube lens and MLA is used for optimal performance. This paper extends performance predictions from NA matching to unmatching cases and introduces a computational technique for plenoptic configurations using optical analysis software. Validation by fabricating and experimenting with two sample systems at 10× and 20× magnifications resulted in predicted spatial resolutions of 12.5 ㎛ and 6.2 ㎛ and depth of field (DOF) values of 530 ㎛ and 88 ㎛, respectively. The simulation showed resolutions of 11.5 ㎛ and 5.8 ㎛, with DOF values of 510 ㎛ and 70 ㎛, while experiments confirmed predictions with resolutions of 11.1 ㎛ and 5.8 ㎛ and DOF values of 470 ㎛ and 70 ㎛. Both formula-based prediction and simulations yielded similar results to experiments that were suitable for system design. However, regarding DOF values, simulations were closer to experimental values in accuracy, recommending reliance on simulation-based predictions before fabrication.

Automatic Genre Classification of Sports News Video Using Features of Playfield and Motion Vector (필드와 모션벡터의 특징정보를 이용한 스포츠 뉴스 비디오의 장르 분류)

  • Song, Mi-Young;Jang, Sang-Hyun;Cho, Hyung-Je
    • The KIPS Transactions:PartB
    • /
    • v.14B no.2
    • /
    • pp.89-98
    • /
    • 2007
  • For browsing, searching, and manipulating video documents, an indexing technique to describe video contents is required. Until now, the indexing process is mostly carried out by specialists who manually assign a few keywords to the video contents and thereby this work becomes an expensive and time consuming task. Therefore, automatic classification of video content is necessary. We propose a fully automatic and computationally efficient method for analysis and summarization of spots news video for 5 spots news video such as soccer, golf, baseball, basketball and volleyball. First of all, spots news videos are classified as anchor-person Shots, and the other shots are classified as news reports shots. Shot classification is based on image preprocessing and color features of the anchor-person shots. We then use the dominant color of the field and motion features for analysis of sports shots, Finally, sports shots are classified into five genre type. We achieved an overall average classification accuracy of 75% on sports news videos with 241 scenes. Therefore, the proposed method can be further used to search news video for individual sports news and sports highlights.

Automatic Indexing Algorithm of Golf Video Using Audio Information (오디오 정보를 이용한 골프 동영상 자동 색인 알고리즘)

  • Kim, Hyoung-Gook
    • The Journal of the Acoustical Society of Korea
    • /
    • v.28 no.5
    • /
    • pp.441-446
    • /
    • 2009
  • This paper proposes an automatic indexing algorithm of golf video using audio information. In the proposed algorithm, the input audio stream is demultiplexed into the stream of video and audio. By means of Adaboost-cascade classifier, the continuous audio stream is classified into announcer's speech segment recorded in studio, music segment accompanied with players' names on TV screen, reaction segment of audience according to the play, reporter's speech segment with field background, filed noise segment like wind or waves. And golf swing sound including drive shot, iron shot, and putting shot is detected by the method of impulse onset detection and modulation spectrum verification. The detected swing and applause are used effectively to index action or highlight unit. Compared with video based semantic analysis, main advantage of the proposed system is its small computation requirement so that it facilitates to apply the technology to embedded consumer electronic devices for fast browsing.

An Approach to Estimate Dielectric Constant of Low-Loss Materials Using Dielectric Slab Loaded Cylindrical Cavity Resonators (유전체 슬랩이 삽입된 원통형 공진기를 이용한 저손실 물질의 유전 상수 측정)

  • Lee, Won-Hui
    • The Journal of Korean Institute of Electromagnetic Engineering and Science
    • /
    • v.19 no.10
    • /
    • pp.1115-1121
    • /
    • 2008
  • In this paper, dielectric slab loaded cylindrical cavity resonator measurement technique is presented to determine the dielectric constant of a dielectric material. The dielectric constant is measured by the resonant frequency deviation of empty and dielectric slab loaded cavity. Characteristic equations are derived by th exact field analysis. The measurement configurations are formed using HP8719A vector network analyzer and an experimental cylindrical metallic cavity with circular cross-section. The validity of the theory is confirmed by experiments and CST MWS 4.0(3D simulator). The results were in the whole satisfactory. The measured dielectric constant of teflon and bakelite are 2.03 and 4.44, respectively.

Light Field Image Compression using Versatile Video Coding Intra Prediction (VVC 인트라 부호화기술을 이용한 라이트필드 영상 부호화)

  • Duong, Vinh Van;Nguyen, Thuc Huu;Lee, Jaelin;Jeon, Byeungwoo
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2019.06a
    • /
    • pp.222-224
    • /
    • 2019
  • Light Field (LF) camera captures not only the light intensity but also the light direction coming to camera. While the rich information captured by LF camera enables many interesting applications such as digital refocusing, viewpoint changing, and 3D reconstruction, but it also requires powerful coding tools to reduce its large volume of data. In this paper, we investigate using the intra prediction scheme of the versatile video coding (VVC), which is the most recent video coding technology currently under developing, to compress the LF image. The Intra Block Copy (IBC) technique in VVC is exploited considering special LF image structure. The experimental result shows that VVC intra predict ion outperforms the H.265/HEVC intra coding technique in encoding LF data irrespective of using the IBC mode or not.

  • PDF