• Title/Summary/Keyword: RGB-D 영상

Search Result 138, Processing Time 0.025 seconds

Stereoscopic Video Compositing with a DSLR and Depth Information by Kinect (키넥트 깊이 정보와 DSLR을 이용한 스테레오스코픽 비디오 합성)

  • Kwon, Soon-Chul;Kang, Won-Young;Jeong, Yeong-Hu;Lee, Seung-Hyun
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.38C no.10
    • /
    • pp.920-927
    • /
    • 2013
  • Chroma key technique which composes images by separating an object from its background in specific color has restrictions on color and space. Especially, unlike general chroma key technique, image composition for stereo 3D display requires natural image composition method in 3D space. The thesis attempted to compose images in 3D space using depth keying method which uses high resolution depth information. High resolution depth map was obtained through camera calibration between the DSLR and Kinect sensor. 3D mesh model was created by the high resolution depth information and mapped with RGB color value. Object was converted into point cloud type in 3D space after separating it from its background according to depth information. The image in which 3D virtual background and object are composed obtained and played stereo 3D images using a virtual camera.

Using Skeleton Vector Information and RNN Learning Behavior Recognition Algorithm (스켈레톤 벡터 정보와 RNN 학습을 이용한 행동인식 알고리즘)

  • Kim, Mi-Kyung;Cha, Eui-Young
    • Journal of Broadcast Engineering
    • /
    • v.23 no.5
    • /
    • pp.598-605
    • /
    • 2018
  • Behavior awareness is a technology that recognizes human behavior through data and can be used in applications such as risk behavior through video surveillance systems. Conventional behavior recognition algorithms have been performed using the 2D camera image device or multi-mode sensor or multi-view or 3D equipment. When two-dimensional data was used, the recognition rate was low in the behavior recognition of the three-dimensional space, and other methods were difficult due to the complicated equipment configuration and the expensive additional equipment. In this paper, we propose a method of recognizing human behavior using only CCTV images without additional equipment using only RGB and depth information. First, the skeleton extraction algorithm is applied to extract points of joints and body parts. We apply the equations to transform the vector including the displacement vector and the relational vector, and study the continuous vector data through the RNN model. As a result of applying the learned model to various data sets and confirming the accuracy of the behavior recognition, the performance similar to that of the existing algorithm using the 3D information can be verified only by the 2D information.

Hand-Object 3D Reconstruction Based on 2D Rendering (2D 렌더링 정보를 활용한 손-객체의 3D 복원)

  • Nam, Hyeongil;Park, Jong-Il
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2021.06a
    • /
    • pp.327-330
    • /
    • 2021
  • 본 논문은 RGB 영상 데이터셋의 일부만을 지도학습하여(Sparsely-supervised learning) Annotation 되지 않은 영상에 대해 손-객체의 3D 포즈를 복원하기 위한 방법을 제안한다. 기존의 연구에서는 손-객체의 포즈에 해당하는 6DoF 만을 학습 데이터로 활용한다. 이와 달리, 본 논문에서는 정확도 향상을 위해 복원된 결과를 동일한 입력 영상 내에서 비교 가능하도록 3D 모델로 복원한 결과를 입력 영상의 마스크로 만들어 학습에 반영하였다. 구체적으로 추정된 포즈로 만들어낸 마스크를 입력 영상에 적용한 결과와 Ground-truth 포즈를 적용한 영상을 학습 시에 손실 함수에 반영하였다. 비교 실험을 통해 제안된 방법이 해당 방법을 적용하지 않은 경우 보다 3D 매쉬 오차가 적었음을 확인할 수 있었다.

  • PDF

Effective Ray-tracing based Rendering Methods for Point Cloud Data in Mobile Environments (모바일 환경에서 점 구름 데이터에 대한 효과적인 광선 추적 기반 렌더링 기법)

  • Woong Seo;Youngwook Kim;Kiseo Park;Yerin Kim;Insung Ihm
    • Journal of the Korea Computer Graphics Society
    • /
    • v.29 no.3
    • /
    • pp.93-103
    • /
    • 2023
  • The problem of reconstructing three-dimensional models of people and objects from color and depth images captured by low-cost RGB-D cameras has long been an active research area in computer graphics. Color and depth images captured by low-cost RGB-D cameras are represented as point clouds in three-dimensional space, which correspond to discrete values in a continuous three-dimensional space and require additional surface reconstruction compared to rendering using polygonal models. In this paper, we propose an effective ray-tracing based technique for visualizing point clouds rather than polygonal models. In particular, our method shows the possibility of an effective rendering method even in mobile environment which has limited performance due to processor heat and lack of battery.

Colormap Construction and Combination Method between Colormaps (컬러맵의 생성과 컬러맵간의 결합 방법)

  • Kim, Jin-Hong;Jo, Cheol-Hyo;Kim, Du-Yeong
    • The Transactions of the Korea Information Processing Society
    • /
    • v.1 no.4
    • /
    • pp.541-550
    • /
    • 1994
  • A true color image is needed many data on the occasion of the transmission and storage. Therefore, we want to describe color image by a minority data without unreasonableness at eyesight. In this paper, it is presented 256 colormap construction method in RGB, YIQ/YUV space and common colormap expression method at merge between colormaps by reason of dissimilar original color image to display at a monitor for each other colormap at the same time. In comparison with processed result in RGB, YIQ/YUV space, it was measured by PSNR, standard variation, and edge preservation rate using sobel operator. Process time is 3second in colormap construction and 2second in merge between colormaps. In the PSNR value, RGB space has higher 0.15, 0.34 on an average than YIQ and YUV spae. Standard variation has lower in 0.15, 0.41 on an average than Yiq and YUV space. But in the data compression, YIQ/YUV space have about 1/3 compression efficiency than RGB space by reason of use to only 4bit of 8bit in color component.

  • PDF

Development and Performance Evaluation of an Image Detection System for Efficient 4D Images (효율적인 4D 영상을 위한 영상 검출 시스템 개발 및 성능평가)

  • Cho, Kyoung-Woo;Liu, Ze-Qi;Jeon, Min-Ho;Oh, Chang-Heon
    • Journal of Advanced Navigation Technology
    • /
    • v.17 no.6
    • /
    • pp.792-797
    • /
    • 2013
  • 4D film is just a film that made by adding some physical effects to 3D film or general film. In order to provide physical effects to the audience, the data that make the physical effect must be added to each frames. In this paper, we proposed a video detection system that can efficiently provide physical effects by assessing the present situation such as explosion scene, snowing scene. The proposed video detection system contains an algorithm for fire detection by using R color and $C_r$ value, and also an algorithm for snow detection by using RGB color model. The system constitutes in a MCU that from 8051 family. In the performance evaluations, the result shows that 91% of detection rate in case of fire and 25% of false detection rate in case of snow. Also the system is capable of providing physical effects automatically.

A Gray Image to Pseudocoloring Conversion and Enhancement Using FWT and CIT (FWT-CIT를 적용한 그레이 영상의 의사컬러 변환 및 향상)

  • Ryu Kwang-ryol
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.8 no.7
    • /
    • pp.1464-1468
    • /
    • 2004
  • The color conversion and color enhancement on gray image is presented in this paper. The pseudocoloring for RCB color components extraction from gray image is used the 2D U(Fast Wavelet Transform) for fille. bank and re-array. The each post processing is used the median filtering for noise reduction and the discrete color histogram equalization for CIT(Color Intensity Transformation). The experiment result has enhanced pseudocoloring image as PSNR 30dB over compared the processing of normal wavelet transform.

Point Cloud Registration using Feature Point (특징점을 사용한 포인트 클라우드 정합)

  • Kim, Kyung Jin;Park, Byung Seo;Kim, Dong Wook;Seo, Young Ho
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2019.11a
    • /
    • pp.219-220
    • /
    • 2019
  • 본 논문에서는 특징점 기반의 포인트 클라우드 정합 알고리즘을 제안한다. 컴퓨터 비전 분야에서 각각 다른 카메라에서 획득한 데이터를 하나의 통합된 데이터로 정합하는 문제에 많은 관심을 두고 있다. 기존의 방법들은 큰 오차를 가지고 있거나 많은 카메라 대수나 고가의 RGB-D 카메라를 필요로 한다. 본 논문에서는 깊이 카메라에서 얻은 깊이 영상과 색상 영상을 이용하고 함수 최적화 알고리즘을 적용해 저가의 RGB-D 카메라 8대를 이용하여 오차가 적은 포인트 클라우드 정합 방법을 제안한다.

  • PDF

A Study on the Psuedocolor Image Enhancement of Infrared Image using B-Spline Wavelet Transform. (B-스플라인 웨이블릿 변환을 적용한 적외선 이미지의 의사컬러)

  • 유병근;김정태;류광렬
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2003.05a
    • /
    • pp.192-195
    • /
    • 2003
  • This paper is a study on the psuedocolor image enhancement of infrared image using B-spline wavelet transform. The psuedocolor enhancement is that the frequency lose on the minimum, the decomposition enhancement is realized by B-spline and RGB image is extracted by wavelet transform. The result of experiment increases enhanced infrared image as 3dB by processing of B-spline and wavelet transform.

  • PDF

The Psuedocolor Image Enhancement on Gray Image with Wavelet Filter Coefficients (웨이블릿 필터계수를 적용한 그레이 이미지의 의사컬러 향상에 관한 연구)

  • 유병근;김윤호;류광렬
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2003.10a
    • /
    • pp.260-263
    • /
    • 2003
  • The pseudocolor mage enhancement of gray image using wavelet filter coefficients is presented. The psuedocolor enhancement is that the decomposition enhancement is realized by wavelet transform and RGB image is extracted by wavelet filter coefficients with norma waveletl. The result of experiment an increases enhanced gray image as 30dB compared the processing of wavelet filter coefficients.

  • PDF