• Title/Summary/Keyword: 3D Depth Estimation

Search Result 197, Processing Time 0.032 seconds

Stereo Vision Based 3-D Motion Tracking for Human Animation

  • Han, Seung-Il;Kang, Rae-Won;Lee, Sang-Jun;Ju, Woo-Suk;Lee, Joan-Jae
    • Journal of Korea Multimedia Society
    • /
    • v.10 no.6
    • /
    • pp.716-725
    • /
    • 2007
  • In this paper we describe a motion tracking algorithm for 3D human animation using stereo vision system. This allows us to extract the motion data of the end effectors of human body by following the movement through segmentation process in HIS or RGB color model, and then blob analysis is used to detect robust shape. When two hands or two foots are crossed at any position and become disjointed, an adaptive algorithm is presented to recognize whether it is left or right one. And the real motion is the 3-D coordinate motion. A mono image data is a data of 2D coordinate. This data doesn't acquire distance from a camera. By stereo vision like human vision, we can acquire a data of 3D motion such as left, right motion from bottom and distance of objects from camera. This requests a depth value including x axis and y axis coordinate in mono image for transforming 3D coordinate. This depth value(z axis) is calculated by disparity of stereo vision by using only end-effectors of images. The position of the inner joints is calculated and 3D character can be visualized using inverse kinematics.

  • PDF

Engineering J-Integral Estimation for Internal Axial Surface Cracks in Cylinders (I) -Deformation Plasticity Based Estimation- (실린더에 존재하는 축방향 표면균열에 대한 공학적 J-적분식 (I) - 변형소성에 기초한 방법-)

  • Kim, Jin-Su;Kim, Yun-Jae;Park, Yeong-Jae;Kim, Yeong-Jin
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.26 no.8
    • /
    • pp.1672-1679
    • /
    • 2002
  • This paper provides an engineering J estimation equation for cylinders with finite internal axial surfacecracks under internal pressure. The proposed equation is the J estimation equation based on deformation plasticity using Ramberg-Osgood (R-O) materials. Based on detailed 3-D FE results using deformation plasticity, plastic influence functions for fully plastic J components are tabulated for practically interesting ranges of the mean radius-to-thickness ratio, the crack depth-to-length ratio, the crack depth-to-thickness ratio. the strain hardening index for the R-O material, and the location along the semi-elliptical crack front. Based on tabilated plastic influence functions, the J estimation equation along the crack front is proposed and validated for R-O materials. Good agreements between the FE results and the proposed J estimation provide confidence in the use of the proposed method to elastic-plastic fracture mechanics of pressurized piping.

Study on Ecological Instream Flow Estimation using River2D Model in the Seomjin River (River2D 모델을 이용한 섬진강의 생태유지유량 산정에 관한 연구)

  • Roh, Kyong-Bum;Park, Sung-Chun;Jin, Young-Hoon;Park, Myoung-Ok
    • Journal of Korean Society on Water Environment
    • /
    • v.27 no.6
    • /
    • pp.822-829
    • /
    • 2011
  • The purpose of the present study is to estimate the ecological instream flow for conservation and restoration of fish habitat in running water ecosystem which has very important status for stream environment. Estimation of the ecological instream flow in the present study was carried out by application of a two-dimensional depth averaged model of river hydrodynamics, River2D model. It can model fish habitat in natural streams and rivers and assess the quality of physical habitat accoriding to the species preferences for habitat suitability. Zacco platypus and Zacco temmincki were selected as target fish species in the study area of the Seomjin river. The Habitat Suitability Criteria (HSC) developed by Sung et al. (2005) were used for target fish species, life stages and habitat conditions in the study. Weighted usable area (WUA) was computed by the River2D model considering preferences of target fish species for velocity, depth, and channel substrate. The result revealed that the ecological instream flow of $10.0m^3/s$ is needed to maintain the target fish habitat at each life stage in the river.

Visual Tracking Control of Aerial Robotic Systems with Adaptive Depth Estimation

  • Metni, Najib;Hamel, Tarek
    • International Journal of Control, Automation, and Systems
    • /
    • v.5 no.1
    • /
    • pp.51-60
    • /
    • 2007
  • This paper describes a visual tracking control law of an Unmanned Aerial Vehicle(UAV) for monitoring of structures and maintenance of bridges. It presents a control law based on computer vision for quasi-stationary flights above a planar target. The first part of the UAV's mission is the navigation from an initial position to a final position to define a desired trajectory in an unknown 3D environment. The proposed method uses the homography matrix computed from the visual information and derives, using backstepping techniques, an adaptive nonlinear tracking control law allowing the effective tracking and depth estimation. The depth represents the desired distance separating the camera from the target.

Single Image Depth Estimation With Integration of Parametric Learning and Non-Parametric Sampling

  • Jung, Hyungjoo;Sohn, Kwanghoon
    • Journal of Korea Multimedia Society
    • /
    • v.19 no.9
    • /
    • pp.1659-1668
    • /
    • 2016
  • Understanding 3D structure of scenes is of a great interest in various vision-related tasks. In this paper, we present a unified approach for estimating depth from a single monocular image. The key idea of our approach is to take advantages both of parametric learning and non-parametric sampling method. Using a parametric convolutional network, our approach learns the relation of various monocular cues, which make a coarse global prediction. We also leverage the local prediction to refine the global prediction. It is practically estimated in a non-parametric framework. The integration of local and global predictions is accomplished by concatenating the feature maps of the global prediction with those from local ones. Experimental results demonstrate that the proposed method outperforms state-of-the-art methods both qualitatively and quantitatively.

Estimation of fresh weight for chinese cabbage using the Kinect sensor (키넥트를 이용한 배추 생체중 추정)

  • Lee, Sukin;Kim, Kwang Soo
    • Korean Journal of Agricultural and Forest Meteorology
    • /
    • v.20 no.2
    • /
    • pp.205-213
    • /
    • 2018
  • Development and validation of crop models often require measurements of biomass for the crop of interest. Considerable efforts would be needed to obtain a reasonable amount of biomass data because the destructive sampling of a given crop is usually used. The Kinect sensor, which has a combination of image and depth sensors, can be used for estimating crop biomass without using destructive sampling approach. This approach could provide more data sets for model development and validation. The objective of this study was to examine the applicability of the Kinect sensor for estimation of chinese cabbage fresh weight. The fresh weight of five chinese cabbage was measured and compared with estimates using the Kinect sensor. The estimates were obtained by scanning individual chinese cabbage to create point cloud, removing noise, and building a three dimensional model with a set of free software. It was found that the 3D model created using the Kinect sensor explained about 98.7% of variation in fresh weight of chinese cabbage. Furthermore, the correlation coefficient between estimates and measurements were highly significant, which suggested that the Kinect sensor would be applicable to estimation of fresh weight for chinese cabbage. Our results demonstrated that a depth sensor allows for a non-destructive sampling approach, which enables to collect observation data for crop fresh weight over time. This would help development and validation of a crop model using a large number of reliable data sets, which merits further studies on application of various depth sensors to crop dry weight measurements.

Markerless camera pose estimation framework utilizing construction material with standardized specification

  • Harim Kim;Heejae Ahn;Sebeen Yoon;Taehoon Kim;Thomas H.-K. Kang;Young K. Ju;Minju Kim;Hunhee Cho
    • Computers and Concrete
    • /
    • v.33 no.5
    • /
    • pp.535-544
    • /
    • 2024
  • In the rapidly advancing landscape of computer vision (CV) technology, there is a burgeoning interest in its integration with the construction industry. Camera calibration is the process of deriving intrinsic and extrinsic parameters that affect when the coordinates of the 3D real world are projected onto the 2D plane, where the intrinsic parameters are internal factors of the camera, and extrinsic parameters are external factors such as the position and rotation of the camera. Camera pose estimation or extrinsic calibration, which estimates extrinsic parameters, is essential information for CV application at construction since it can be used for indoor navigation of construction robots and field monitoring by restoring depth information. Traditionally, camera pose estimation methods for cameras relied on target objects such as markers or patterns. However, these methods, which are marker- or pattern-based, are often time-consuming due to the requirement of installing a target object for estimation. As a solution to this challenge, this study introduces a novel framework that facilitates camera pose estimation using standardized materials found commonly in construction sites, such as concrete forms. The proposed framework obtains 3D real-world coordinates by referring to construction materials with certain specifications, extracts the 2D coordinates of the corresponding image plane through keypoint detection, and derives the camera's coordinate through the perspective-n-point (PnP) method which derives the extrinsic parameters by matching 3D and 2D coordinate pairs. This framework presents a substantial advancement as it streamlines the extrinsic calibration process, thereby potentially enhancing the efficiency of CV technology application and data collection at construction sites. This approach holds promise for expediting and optimizing various construction-related tasks by automating and simplifying the calibration procedure.

RECONSTRUCTING A SUPER-RESOLUTION IMAGE FOR DEPTH-VARYING SCENES

  • Yokoyamay, Ami;Kubotaz, Akira;Hatoriz, Yoshinori
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2009.01a
    • /
    • pp.446-449
    • /
    • 2009
  • In this paper, we present a novel method for reconstructing a super-resolution image using multi-view low-resolution images captured for depth varying scene without requiring complex analysis such as depth estimation and feature matching. The proposed method is based on the iterative back projection technique that is extended to the 3D volume domain (i.e., space + depth), unlike the conventional superresolution methods that handle only 2D translation among captured images.

  • PDF

Robust Real-Time Visual Odometry Estimation for 3D Scene Reconstruction (3차원 장면 복원을 위한 강건한 실시간 시각 주행 거리 측정)

  • Kim, Joo-Hee;Kim, In-Cheol
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.4 no.4
    • /
    • pp.187-194
    • /
    • 2015
  • In this paper, we present an effective visual odometry estimation system to track the real-time pose of a camera moving in 3D space. In order to meet the real-time requirement as well as to make full use of rich information from color and depth images, our system adopts a feature-based sparse odometry estimation method. After matching features extracted from across image frames, it repeats both the additional inlier set refinement and the motion refinement to get more accurate estimate of camera odometry. Moreover, even when the remaining inlier set is not sufficient, our system computes the final odometry estimate in proportion to the size of the inlier set, which improves the tracking success rate greatly. Through experiments with TUM benchmark datasets and implementation of the 3D scene reconstruction application, we confirmed the high performance of the proposed visual odometry estimation method.

A Method for 3D Human Pose Estimation based on 2D Keypoint Detection using RGB-D information (RGB-D 정보를 이용한 2차원 키포인트 탐지 기반 3차원 인간 자세 추정 방법)

  • Park, Seohee;Ji, Myunggeun;Chun, Junchul
    • Journal of Internet Computing and Services
    • /
    • v.19 no.6
    • /
    • pp.41-51
    • /
    • 2018
  • Recently, in the field of video surveillance, deep learning based learning method is applied to intelligent video surveillance system, and various events such as crime, fire, and abnormal phenomenon can be robustly detected. However, since occlusion occurs due to the loss of 3d information generated by projecting the 3d real-world in 2d image, it is need to consider the occlusion problem in order to accurately detect the object and to estimate the pose. Therefore, in this paper, we detect moving objects by solving the occlusion problem of object detection process by adding depth information to existing RGB information. Then, using the convolution neural network in the detected region, the positions of the 14 keypoints of the human joint region can be predicted. Finally, in order to solve the self-occlusion problem occurring in the pose estimation process, the method for 3d human pose estimation is described by extending the range of estimation to the 3d space using the predicted result of 2d keypoint and the deep neural network. In the future, the result of 2d and 3d pose estimation of this research can be used as easy data for future human behavior recognition and contribute to the development of industrial technology.