• Title/Summary/Keyword: depth estimation

Search Result 1,125, Processing Time 0.024 seconds

SuperDepthTransfer: Depth Extraction from Image Using Instance-Based Learning with Superpixels

  • Zhu, Yuesheng;Jiang, Yifeng;Huang, Zhuandi;Luo, Guibo
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.11 no.10
    • /
    • pp.4968-4986
    • /
    • 2017
  • In this paper, we primarily address the difficulty of automatic generation of a plausible depth map from a single image in an unstructured environment. The aim is to extrapolate a depth map with a more correct, rich, and distinct depth order, which is both quantitatively accurate as well as visually pleasing. Our technique, which is fundamentally based on a preexisting DepthTransfer algorithm, transfers depth information at the level of superpixels. This occurs within a framework that replaces a pixel basis with one of instance-based learning. A vital superpixels feature enhancing matching precision is posterior incorporation of predictive semantic labels into the depth extraction procedure. Finally, a modified Cross Bilateral Filter is leveraged to augment the final depth field. For training and evaluation, experiments were conducted using the Make3D Range Image Dataset and vividly demonstrate that this depth estimation method outperforms state-of-the-art methods for the correlation coefficient metric, mean log10 error and root mean squared error, and achieves comparable performance for the average relative error metric in both efficacy and computational efficiency. This approach can be utilized to automatically convert 2D images into stereo for 3D visualization, producing anaglyph images that are visually superior in realism and simultaneously more immersive.

Robust Estimation of Hand Poses Based on Learning (학습을 이용한 손 자세의 강인한 추정)

  • Kim, Sul-Ho;Jang, Seok-Woo;Kim, Gye-Young
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.23 no.12
    • /
    • pp.1528-1534
    • /
    • 2019
  • Recently, due to the popularization of 3D depth cameras, new researches and opportunities have been made in research conducted on RGB images, but estimation of human hand pose is still classified as one of the difficult topics. In this paper, we propose a robust estimation method of human hand pose from various input 3D depth images using a learning algorithm. The proposed approach first generates a skeleton-based hand model and then aligns the generated hand model with three-dimensional point cloud data. Then, using a random forest-based learning algorithm, the hand pose is strongly estimated from the aligned hand model. Experimental results in this paper show that the proposed hierarchical approach makes robust and fast estimation of human hand posture from input depth images captured in various indoor and outdoor environments.

High-Quality Depth Map Generation of Humans in Monocular Videos (단안 영상에서 인간 오브젝트의 고품질 깊이 정보 생성 방법)

  • Lee, Jungjin;Lee, Sangwoo;Park, Jongjin;Noh, Junyong
    • Journal of the Korea Computer Graphics Society
    • /
    • v.20 no.2
    • /
    • pp.1-11
    • /
    • 2014
  • The quality of 2D-to-3D conversion depends on the accuracy of the assigned depth to scene objects. Manual depth painting for given objects is labor intensive as each frame is painted. Specifically, a human is one of the most challenging objects for a high-quality conversion, as a human body is an articulated figure and has many degrees of freedom (DOF). In addition, various styles of clothes, accessories, and hair create a very complex silhouette around the 2D human object. We propose an efficient method to estimate visually pleasing depths of a human at every frame in a monocular video. First, a 3D template model is matched to a person in a monocular video with a small number of specified user correspondences. Our pose estimation with sequential joint angular constraints reproduces a various range of human motions (i.e., spine bending) by allowing the utilization of a fully skinned 3D model with a large number of joints and DOFs. The initial depth of the 2D object in the video is assigned from the matched results, and then propagated toward areas where the depth is missing to produce a complete depth map. For the effective handling of the complex silhouettes and appearances, we introduce a partial depth propagation method based on color segmentation to ensure the detail of the results. We compared the result and depth maps painted by experienced artists. The comparison shows that our method produces viable depth maps of humans in monocular videos efficiently.

2D-to-3D Stereoscopic conversion: Depth estimation in monoscopic soccer videos (단일 시점 축구 비디오의 3차원 영상 변환을 위한 깊이지도 생성 방법)

  • Ko, Jae-Seung;Kim, Young-Woo;Jung, Young-Ju;Kim, Chang-Ick
    • Journal of Broadcast Engineering
    • /
    • v.13 no.4
    • /
    • pp.427-439
    • /
    • 2008
  • This paper proposes a novel method to convert monoscopic soccer videos to stereoscopic videos. Through the soccer video analysis process, we detect shot boundaries and classify soccer frames into long shot or non-long shot. In the long shot case, the depth mapis generated relying on the size of the extracted ground region. For the non-long shot case, the shot is further partitioned into three types by considering the number of ground blocks and skin blocks which is obtained by a simple skin-color detection method. Then three different depth assignment methods are applied to each non-long shot types: 1) Depth estimation by object region extraction, 2) Foreground estimation by using the skin block and depth value computation by Gaussian function, and 3)the depth map generation for shots not containing the skin blocks. This depth assignment is followed by stereoscopic image generation. Subjective evaluation comparing generated depth maps and corresponding stereoscopic images indicate that the proposed algorithm can yield the sense of depth from a single view images.

Level Set based Respiration Rate Estimation using Depth Camera (레벨 셋 기반의 깊이 카메라를 이용한 호흡수 측정)

  • Oh, Kyeong Taek;Shin, Cheung Soo;Kim, Jeongmin;Yoo, Sun Kook
    • Journal of Korea Multimedia Society
    • /
    • v.20 no.9
    • /
    • pp.1491-1501
    • /
    • 2017
  • In this paper, we propose a method to measure respiration rate by dividing the respiration related region in depth image using level set method. In the conventional method, the respiration related region was separated using the pre-defined region designated by the user. We separate the respiration related region using level set method combining shape prior knowledge. Median filter and clipping are performed as a preprocessing method for noise reduction in the depth image. As a feasibility test, respiration activity was recorded using depth camera in various environments with arm movements or body movements during breathing. Respiration activity was also measured simultaneously using a chest belt to verify the accuracy of calculated respiration rate. Experimental results show that our proposed method shows good performance for respiration rate estimation in various situation compared with the conventional method.

Estimation of Runoff Depth and Peak Discharge by SCS Curve Numbers and Time Variation of curve Numbers (SCS곡선번호에 의한 유출고 및 첨두유량의 산정과 곡선번호의 시변성)

  • 윤태훈
    • Water for future
    • /
    • v.25 no.4
    • /
    • pp.87-95
    • /
    • 1992
  • The validity of the estimate of runoff depth and peak runoff by the basin runoff curve numbers(CN-II for AMC-II condition and CN-III for AMC-III condition) obtained from hydrologic soil-cover complexs is investigated by making use of the observed curve numbers(median curve number and optimum curve number) computed from rainfall-runoff records. For gaged basins the median curve numbers are recommended for the estimation of runoff depth and peak runoff. For ungaged basins, found is that for the estimate of runoff depth CN-III is adequate and for the peak runoff CN-II is adequate. Also investigated is the variation of curve numbers during rainfall, which is turned out to improve the estimates of both depth and peak of runoff.

  • PDF

Underwater Localization using EM Wave Attenuation with Depth Information (전자기파의 감쇠패턴 및 깊이 정보 취득을 이용한 수중 위치추정 기법)

  • Kwak, Kyungmin;Park, Daegil;Chung, Wan Kyun;Kim, Jinhyun
    • The Journal of Korea Robotics Society
    • /
    • v.11 no.3
    • /
    • pp.156-162
    • /
    • 2016
  • For the underwater localization, acoustic sensor systems are widely used due to greater penetration properties of acoustic signals in underwater environments. On the other hand, the good penetration property causes multipath and interference effects in structured environment too. To overcome this demerit, a localization method using the attenuation of electro-magnetic(EM) waves was proposed in several literatures, in which distance estimation and 2D-localization experiments show remarkable results. However, in 3D-localization application, the estimation difficulties increase due to the nonuniform (doughnut like) radiation pattern of an omni-directional antenna related to the depth direction. For solving this problem, we added a depth sensor for improving underwater 3D-localization with the EM wave method. A micro scale pressure sensor is located in the mobile node antenna, and the depth data from the pressure sensor is calibrated by the curve fitting algorithm. We adapted the depth(z) data to 3D EM wave pattern model for the error reduction of the localization. Finally, some experiments were executed for 3D localization with the fast calculation and less errors.

Depth Map Completion using Nearest Neighbor Kernel (최근접 이웃 커널을 이용한 깊이 영상 완성 기술)

  • Taehyun, Jeong;Kutub, Uddin;Byung Tae, Oh
    • Journal of Broadcast Engineering
    • /
    • v.27 no.6
    • /
    • pp.906-913
    • /
    • 2022
  • In this paper, we propose a new deep network architecture using nearest neighbor kernel for the estimation of dense depth map from its sparse map and corresponding color information. First, we propose to decompose the depth map signal into the structure and details for easier prediction. We then propose two separate subnetworks for prediction of both structure and details using classification and regression approaches, respectively. Moreover, the nearest neighboring kernel method has been newly proposed for accurate prediction of structure signal. As a result, the proposed method showed better results than other methods quantitatively and qualitatively.

Distance Measurement Using the Kinect Sensor with Neuro-image Processing

  • Sharma, Kajal
    • IEIE Transactions on Smart Processing and Computing
    • /
    • v.4 no.6
    • /
    • pp.379-383
    • /
    • 2015
  • This paper presents an approach to detect object distance with the use of the recently developed low-cost Kinect sensor. The technique is based on Kinect color depth-image processing and can be used to design various computer-vision applications, such as object recognition, video surveillance, and autonomous path finding. The proposed technique uses keypoint feature detection in the Kinect depth image and advantages of depth pixels to directly obtain the feature distance in the depth images. This highly reduces the computational overhead and obtains the pixel distance in the Kinect captured images.

Estimation of Depth Effect on the Bending Strength of Domestic Japanese Larch Structural Lumber using Weibull Weakest Link Theory

  • Oh, Sei Chang
    • Journal of the Korean Wood Science and Technology
    • /
    • v.42 no.2
    • /
    • pp.112-118
    • /
    • 2014
  • The depth effect on bending strength of Japanese larch structural lumber was investigated by using the published data of two different depth lumbers with the same length. Depth effect parameters were derived from Weibull's weakest link theory and compared to the results from other researches. Depth effect on bending strength was significant for No.1 and No.3 lumber, but not insignificant for No.2 lumber. Calculated value of the depth effect adjustment factors was 0.21, 0.11 and 0.22 by lumber grade, respectively. These results were similar to those results from previous researches and supported depth effect on bending strength of lumber. An apparent depth adjustment factor has been proposed to 0.2 in the literatures. Based on this study, depth adjustment factor was considered to 0.2 as a conservative optimum design value that should be incorporated in domestic building code (KBC) for structural lumber.