• Title/Summary/Keyword: Depth camera

Search Result 716, Processing Time 0.034 seconds

Generation of an eye-contacted view using color and depth cameras (컬러와 깊이 카메라를 이용한 시점 일치 영상 생성 기법)

  • Hyun, Jee-Ho;Han, Jae-Young;Won, Jong-Pil;Yoo, Ji-Sang
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.16 no.8
    • /
    • pp.1642-1652
    • /
    • 2012
  • Generally, a camera isn't located at the center of display in a tele-presence system and it causes an incorrect eye contact between speakers which reduce the realistic feeling during the conversation. To solve this incorrect eye contact problem, we newly propose an intermediate view reconstruction algorithm using both a color camera and a depth camera and applying for the depth image based rendering (DIBR) algorithm. In the proposed algorithm, an efficient hole filling method using the arithmetic mean value of neighbor pixels and an efficient boundary noise removal method by expanding the edge region of depth image are included. We show that the generated eye-contacted image has good quality through experiments.

A Study on Depth Information Acquisition Improved by Gradual Pixel Bundling Method at TOF Image Sensor

  • Kwon, Soon Chul;Chae, Ho Byung;Lee, Sung Jin;Son, Kwang Chul;Lee, Seung Hyun
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.7 no.1
    • /
    • pp.15-19
    • /
    • 2015
  • The depth information of an image is used in a variety of applications including 2D/3D conversion, multi-view extraction, modeling, depth keying, etc. There are various methods to acquire depth information, such as the method to use a stereo camera, the method to use the depth camera of flight time (TOF) method, the method to use 3D modeling software, the method to use 3D scanner and the method to use a structured light just like Microsoft's Kinect. In particular, the depth camera of TOF method measures the distance using infrared light, whereas TOF sensor depends on the sensitivity of optical light of an image sensor (CCD/CMOS). Thus, it is mandatory for the existing image sensors to get an infrared light image by bundling several pixels; these requirements generate a phenomenon to reduce the resolution of an image. This thesis proposed a measure to acquire a high-resolution image through gradual area movement while acquiring a low-resolution image through pixel bundling method. From this measure, one can obtain an effect of acquiring image information in which illumination intensity (lux) and resolution were improved without increasing the performance of an image sensor since the image resolution is not improved as resolving a low-illumination intensity (lux) in accordance with the gradual pixel bundling algorithm.

Calibration of the depth measurement system with a laser pointer, a camera and a plain mirror

  • Kim, Hyong-Suk;Lin, Chun-Shin;Gim, Seong-Chan;Chae, Hee-Sung
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2005.06a
    • /
    • pp.1994-1998
    • /
    • 2005
  • Characteristic analysis of the depth measurement system with a laser, a camera and a rotating mirror has been done and the parameter calibration technique for it has been proposed. In the proposed depth measurement system, the laser beam is reflected to the object by the rotating mirror and again the position of the laser beam is observed through the same mirror by the camera. The depth of the object pointed by the laser beam is computed depending on the pixel position on the CCD. There involved several number of internal and external parameters such as inter-pixel distance, focal length, position and orientation of the system components in the depth measurement error. In this paper, it is shown through the error sensitivity analysis of the parameters that the most important parameters in the sense of error sources are the angle of the laser beam and the inter pixel distance. The calibration techniques to minimize the effect of such major parameters are proposed.

  • PDF

Fusion System of Time-of-Flight Sensor and Stereo Cameras Considering Single Photon Avalanche Diode and Convolutional Neural Network (SPAD과 CNN의 특성을 반영한 ToF 센서와 스테레오 카메라 융합 시스템)

  • Kim, Dong Yeop;Lee, Jae Min;Jun, Sewoong
    • The Journal of Korea Robotics Society
    • /
    • v.13 no.4
    • /
    • pp.230-236
    • /
    • 2018
  • 3D depth perception has played an important role in robotics, and many sensory methods have also proposed for it. As a photodetector for 3D sensing, single photon avalanche diode (SPAD) is suggested due to sensitivity and accuracy. We have researched for applying a SPAD chip in our fusion system of time-of-fight (ToF) sensor and stereo camera. Our goal is to upsample of SPAD resolution using RGB stereo camera. Currently, we have 64 x 32 resolution SPAD ToF Sensor, even though there are higher resolution depth sensors such as Kinect V2 and Cube-Eye. This may be a weak point of our system, however we exploit this gap using a transition of idea. A convolution neural network (CNN) is designed to upsample our low resolution depth map using the data of the higher resolution depth as label data. Then, the upsampled depth data using CNN and stereo camera depth data are fused using semi-global matching (SGM) algorithm. We proposed simplified fusion method created for the embedded system.

Volumetric Visualization using Depth Information of Stereo Images (스테레오 영상에서의 깊이정보를 이용한 3차원 입체화)

  • 이성재;김정훈;윤성원;최종주;이명호
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.541-541
    • /
    • 2000
  • This paper Presents the method of 3D reconstruction of the depth information from the endoscopic stereo scopic images. After camera modeling to find camera parameters, we peformed feature-point based stereo matching to find depth information. Acquired some depth information is finally 3D reconstructed using the NURBS(Non Uniform Rational B-Spline) algorithm. The final result image is helpful for the understanding of depth information visually.

  • PDF

A Region Depth Estimation Algorithm using Motion Vector from Monocular Video Sequence (단안영상에서 움직임 벡터를 이용한 영역의 깊이추정)

  • 손정만;박영민;윤영우
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.5 no.2
    • /
    • pp.96-105
    • /
    • 2004
  • The recovering 3D image from 2D requires the depth information for each picture element. The manual creation of those 3D models is time consuming and expensive. The goal in this paper is to estimate the relative depth information of every region from single view image with camera translation. The paper is based on the fact that the motion of every point within image which taken from camera translation depends on the depth. Motion vector using full-search motion estimation is compensated for camera rotation and zooming. We have developed a framework that estimates the average frame depth by analyzing motion vector and then calculates relative depth of region to average frame depth. Simulation results show that the depth of region belongs to a near or far object is consistent accord with relative depth that man recognizes.

  • PDF

Obstacle Avoidance Method for UAVs using Polar Grid

  • Pant, Sudarshan;Lee, Sangdon
    • Journal of Korea Multimedia Society
    • /
    • v.23 no.8
    • /
    • pp.1088-1098
    • /
    • 2020
  • This paper proposes an obstacle avoidance method using a depth polar grid. Depth information is a crucial factor for determining the safe path for collision-free navigation of unmanned aerial vehicles (UAVs) as it can perceive the distance to the obstacles effectively. However, the existing depth-camera-based approaches for obstacle avoidance require computational y expensive path planning algorithms. We propose a simple navigation method using the polar-grid of the depth information obtained from the camera with narrow field-of-view(FOV). The effectiveness of the approach was validated by a series of experiments using software-in-the-loop simulation in a realistic outdoor environment. The experimental results show that the proposed approach successfully avoids obstacles using a single depth camera with limited FOV.

A study on the EDOF(Extended depth of field) camera module performance optimization (EDOF 카메라 모듈의 성능 최적화에 대한 연구)

  • Choi, Kyung-Hoon;Kim, Young-Gil
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2011.05a
    • /
    • pp.313-315
    • /
    • 2011
  • Smart phone camera module are mounted on the focus are 2 types depending on the behavior. AF (Auto focus) camera module and the FF (Fixed focus) camera module two are different types. AF camera module to move the location of the lens and is a way to automatically focus, FF camera module lens position of the focus is the way to a fixed state. EDOF camera module the location of the lens as a frozen state EDOF AF module using the algorithm to focus on applied technology is a module. In this paper, optimization EDOF camera module implementation of the resolution.

  • PDF

Development of a Serious Game for Rehabilitation Training using 3D Depth Camera (3D depth 카메라를 이용한 재활훈련 기능성 게임 개발)

  • Kang, Sun-Kyung;Jung, Sung-Tae
    • Journal of Korea Game Society
    • /
    • v.13 no.1
    • /
    • pp.19-30
    • /
    • 2013
  • This paper proposes a serious game for rehabilitation training targeting old persons and patients for rehabilitation. The serious game suggested for rehabilitation training provides the whole body movement recognition-based interface using the 3D depth camera. When the user stands before the camera, it distinguishes the user from the background and then recognizes the user's whole body with 15 joints. By analyzing the changes of location and direction of each joint, it recognizes gestures needed for the game. The game contents consist of the games for upper limb training, lower limb training, whole body training, and balance training, and it was realized in both 2D and 3D games. The system suggested in this article works robustly even with the environmental changes using the 3D depth camera. Even with no separate device, the game recognizes the gestures only using the whole body movement, and this enhances the effect of rehabilitation.

Depth Estimation Through the Projection of Rotating Mirror Image unto Mono-camera (회전 평면경 영상의 단일 카메라 투영에 의한 거리 측정)

  • Kim, Hyeong-Seok;Song, Jae-Hong;Han, Hu-Seok
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.7 no.9
    • /
    • pp.790-797
    • /
    • 2001
  • A simple computer vision technology to measure the middle-ranged depth with a mono camera and a plain mirror is proposed. The proposed system is structured with the rotating mirror in front of the fixed mono camera. In contrast to the previous stereo vision system in which the disparity of the closer object is larger than that of the distant object, the pixel movement caused by the rotating mirror is bigger for the pixels of the distant object in the proposed system. Being inspired by such distinguished feature in the proposed system, the principle of the depth measurement based on the relation of the pixel movement and the distance of object is investigated. Also, the factors to influence the precision of the measurement are analysed. The benefits of the proposed system are low price and less chance of occlusion. The robustness for practical usage is an additional benefit of the proposed vision system.

  • PDF