• Title/Summary/Keyword: 3-D pose

Search Result 337, Processing Time 0.028 seconds

Robust Pelvic Coordinate System Determination for Pose Changes in Multidetector-row Computed Tomography Images

  • Kobashi, Syoji;Fujimoto, Satoshi;Nishiyama, Takayuki;Kanzaki, Noriyuki;Fujishiro, Takaaki;Shibanuma, Nao;Kuramoto, Kei;Kurosaka, Masahiro;Hata, Yutaka
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.10 no.1
    • /
    • pp.65-72
    • /
    • 2010
  • For developing navigation system of total hip arthroplasty (THA) and evaluating hip joint kinematics, 3-D pose position of the femur and acetabulum in the pelvic coordinate system has been quantified. The pelvic coordinate system is determined by manually indicating pelvic landmarks in multidetector-row computed tomography (MDCT) images. It includes intra- and inter-observer variability, and may result in a variability of THA operation or diagnosis. To reduce the variability of pelvic coordinate system determination, this paper proposes an automated method in MDCT images. The proposed method determines pelvic coordinate system automatically by detecting pelvic landmarks on anterior pelvic plane (APP) from MDCT images. The method calibrates pelvic pose by using silhouette images to suppress the affect of pelvic pose change. As a result of comparing with manual determination, the proposed method determined the coordinate system with a mean displacement of $2.6\;{\pm}\;1.6$ mm and a mean angle error of $0.78\;{\pm}\;0.34$ deg on 5 THA subjects. For changes of pelvic pose position within 10 deg, standard deviation of displacement was 3.7 mm, and of pose was 1.28 deg. We confirmed the proposed method was robust for pelvic pose changes.

3D Pose Estimation of a Human Arm for Human-Computer Interaction - Application of Mechanical Modeling Techniques to Computer Vision (인간-컴퓨터 상호 작용을 위한 인간 팔의 3차원 자세 추정 - 기계요소 모델링 기법을 컴퓨터 비전에 적용)

  • Han Young-Mo
    • Journal of the Institute of Electronics Engineers of Korea SC
    • /
    • v.42 no.4 s.304
    • /
    • pp.11-18
    • /
    • 2005
  • For expressing intention the human often use body languages as well as vocal languages. Of course the gestures using arms and hands are the representative ones among the body languages. Therefore it is very important to understand the human arm motion in human-computer interaction. In this respect we present here how to estimate 3D pose of human arms by using computer vision systems. For this we first focus on the idea that the human arm motion consists of mostly revolute joint motions, and then we present an algorithm for understanding 3D motion of a revolute joint using vision systems. Next we apply it to estimating 3D pose of human arms using vision systems. The fundamental idea for this algorithm extension is that we may apply the algorithm for a revolute joint to each of the revolute joints of hmm arms one after another. In designing the algorithms we focus on seeking closed-form solutions with high accuracy because we aim at applying them to human computer interaction for ubiquitous computing and virtual reality.

Skeleton-based 3D Pointcloud Registration Method (스켈레톤 기반의 3D 포인트 클라우드 정합 방법)

  • Park, Byung-Seo;Kim, Dong-Wook;Seo, Young-Ho
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2021.06a
    • /
    • pp.89-90
    • /
    • 2021
  • 본 논문에서는 3D(dimensional) 스켈레톤을 이용하여 멀티 뷰 RGB-D 카메라를 캘리브레이션 하는 새로운 기법을 제안하고자 한다. 멀티 뷰 카메라를 캘리브레이션 하기 위해서는 일관성 있는 특징점이 필요하다. 우리는 다시점 카메라를 캘리브레이션 하기 위한 특징점으로 사람의 스켈레톤을 사용한다. 사람의 스켈레톤은 최신의 자세 추정(pose estimation) 알고리즘들을 이용하여 쉽게 구할 수 있게 되었다. 우리는 자세 추정 알고리즘을 통해서 획득된 3D 스켈레톤의 관절 좌표를 특징점으로 사용하는 RGB-D 기반의 캘리브레이션 알고리즘을 제안한다.

  • PDF

A New Calibration of 3D Point Cloud using 3D Skeleton (3D 스켈레톤을 이용한 3D 포인트 클라우드의 캘리브레이션)

  • Park, Byung-Seo;Kang, Ji-Won;Lee, Sol;Park, Jung-Tak;Choi, Jang-Hwan;Kim, Dong-Wook;Seo, Young-Ho
    • Journal of Broadcast Engineering
    • /
    • v.26 no.3
    • /
    • pp.247-257
    • /
    • 2021
  • This paper proposes a new technique for calibrating a multi-view RGB-D camera using a 3D (dimensional) skeleton. In order to calibrate a multi-view camera, consistent feature points are required. In addition, it is necessary to acquire accurate feature points in order to obtain a high-accuracy calibration result. We use the human skeleton as a feature point to calibrate a multi-view camera. The human skeleton can be easily obtained using state-of-the-art pose estimation algorithms. We propose an RGB-D-based calibration algorithm that uses the joint coordinates of the 3D skeleton obtained through the posture estimation algorithm as a feature point. Since the human body information captured by the multi-view camera may be incomplete, the skeleton predicted based on the image information acquired through it may be incomplete. After efficiently integrating a large number of incomplete skeletons into one skeleton, multi-view cameras can be calibrated by using the integrated skeleton to obtain a camera transformation matrix. In order to increase the accuracy of the calibration, multiple skeletons are used for optimization through temporal iterations. We demonstrate through experiments that a multi-view camera can be calibrated using a large number of incomplete skeletons.

3D Face Alignment and Normalization Based on Feature Detection Using Active Shape Models : Quantitative Analysis on Aligning Process (ASMs을 이용한 특징점 추출에 기반한 3D 얼굴데이터의 정렬 및 정규화 : 정렬 과정에 대한 정량적 분석)

  • Shin, Dong-Won;Park, Sang-Jun;Ko, Jae-Pil
    • Korean Journal of Computational Design and Engineering
    • /
    • v.13 no.6
    • /
    • pp.403-411
    • /
    • 2008
  • The alignment of facial images is crucial for 2D face recognition. This is the same to facial meshes for 3D face recognition. Most of the 3D face recognition methods refer to 3D alignment but do not describe their approaches in details. In this paper, we focus on describing an automatic 3D alignment in viewpoint of quantitative analysis. This paper presents a framework of 3D face alignment and normalization based on feature points obtained by Active Shape Models (ASMs). The positions of eyes and mouth can give possibility of aligning the 3D face exactly in three-dimension space. The rotational transform on each axis is defined with respect to the reference position. In aligning process, the rotational transform converts an input 3D faces with large pose variations to the reference frontal view. The part of face is flopped from the aligned face using the sphere region centered at the nose tip of 3D face. The cropped face is shifted and brought into the frame with specified size for normalizing. Subsequently, the interpolation is carried to the face for sampling at equal interval and filling holes. The color interpolation is also carried at the same interval. The outputs are normalized 2D and 3D face which can be used for face recognition. Finally, we carry two sets of experiments to measure aligning errors and evaluate the performance of suggested process.

Omni-directional Visual-LiDAR SLAM for Multi-Camera System (다중 카메라 시스템을 위한 전방위 Visual-LiDAR SLAM)

  • Javed, Zeeshan;Kim, Gon-Woo
    • The Journal of Korea Robotics Society
    • /
    • v.17 no.3
    • /
    • pp.353-358
    • /
    • 2022
  • Due to the limited field of view of the pinhole camera, there is a lack of stability and accuracy in camera pose estimation applications such as visual SLAM. Nowadays, multiple-camera setups and large field of cameras are used to solve such issues. However, a multiple-camera system increases the computation complexity of the algorithm. Therefore, in multiple camera-assisted visual simultaneous localization and mapping (vSLAM) the multi-view tracking algorithm is proposed that can be used to balance the budget of the features in tracking and local mapping. The proposed algorithm is based on PanoSLAM architecture with a panoramic camera model. To avoid the scale issue 3D LiDAR is fused with omnidirectional camera setup. The depth is directly estimated from 3D LiDAR and the remaining features are triangulated from pose information. To validate the method, we collected a dataset from the outdoor environment and performed extensive experiments. The accuracy was measured by the absolute trajectory error which shows comparable robustness in various environments.

Camera pose estimation framework for array-structured images

  • Shin, Min-Jung;Park, Woojune;Kim, Jung Hee;Kim, Joonsoo;Yun, Kuk-Jin;Kang, Suk-Ju
    • ETRI Journal
    • /
    • v.44 no.1
    • /
    • pp.10-23
    • /
    • 2022
  • Despite the significant progress in camera pose estimation and structure-from-motion reconstruction from unstructured images, methods that exploit a priori information on camera arrangements have been overlooked. Conventional state-of-the-art methods do not exploit the geometric structure to recover accurate camera poses from a set of patch images in an array for mosaic-based imaging that creates a wide field-of-view image by sewing together a collection of regular images. We propose a camera pose estimation framework that exploits the array-structured image settings in each incremental reconstruction step. It consists of the two-way registration, the 3D point outlier elimination and the bundle adjustment with a constraint term for consistent rotation vectors to reduce reprojection errors during optimization. We demonstrate that by using individual images' connected structures at different camera pose estimation steps, we can estimate camera poses more accurately from all structured mosaic-based image sets, including omnidirectional scenes.

Segmentation of Polygons with Different Colors and its Application to the Development of Vision-based Tangram Puzzle Game (다른 색으로 구성된 다각형들의 분할과 이를 이용한 영상 인식 기반 칠교 퍼즐 놀이 개발)

  • Lee, Jihye;Yi, Kang;Kim, Kyungmi
    • Journal of Korea Multimedia Society
    • /
    • v.20 no.12
    • /
    • pp.1890-1900
    • /
    • 2017
  • Tangram game consists of seven pieces of polygons such as triangle, square, and parallelogram. Typical methods of image processing for object recognition may suffer from the existence of side thickness and shadow of the puzzle pieces that are dependent on the pose of 3D-shaped puzzle pieces and the direction of light sources. In this paper, we propose an image processing method that recognizes simple convex polygon-shaped objects irrespective of thickness and pose of puzzle objects. Our key algorithm to remove the thick side of piece of puzzle objects is based on morphological operations followed by logical operations with edge image and background image. By using the proposed object recognition method, we are able to implement a stable tangram game applications designed for tablet computers with front camera. As the experimental results, recognition rate is about 86 percent and recognition time is about 1ms on average. It shows the proposed algorithm is fast and accurate to recognize tangram blocks.

A Study on Hand Recognition in Image for Multimedia System (멀티미디어 시스템을 위한 영상내의 손 인식에 관한 연구)

  • Jung Hye-Won;Yang Hwan-Seok
    • The Journal of the Korea Contents Association
    • /
    • v.5 no.2
    • /
    • pp.267-274
    • /
    • 2005
  • In this paper, we proposed an algorithm which cognize hand pose in real time using only image. Hand recognizes using edge orientation histogram which comes under a constant quantity of 2D appearance because hand pose is intricate. This method suit hand pose recognition in real time because it extracts hand space accurately, has little computation quantify, and is less sensitive to lighting change using color information in complicated background. Method which reduces recognition error using principal component analysis method to can recognize through hand shape presentation direction change is explained. A case that hand shape changes by turning 3D also by using this method is possible to recognize. Besides, principal component space creation time is reduced remarkably because edge directional data is used.

  • PDF

Evaluation for Symmetry Ability of One Leg Standing Pose before and after Yoga Training (요가수련전후 한발서기자세의 좌우대칭력 평가)

  • Yoo, Sil
    • Korean Journal of Applied Biomechanics
    • /
    • v.24 no.4
    • /
    • pp.391-397
    • /
    • 2014
  • The purpose of this work is to biomechanically study the effect of the one leg standing pose in yoga.. The work have been done through the evaluation for the left and right symmetry ability of one leg standing pose in the before and after yoga training for the 14 female yoga subject group (height: $164.3{\pm}4.4cm$, mass: $53.4{\pm}6.4kg$, year: $20.0{\pm}0.49yrs$) participated in this experiment. The motions of one leg standing pose were captured with Vicon system and the parameters were calculated with Visual-3D and Ground reaction force system. The results were as followed; - Front and backward COPsd did not show the significant difference, compared the before training with the after. - Left and right COPsd showed the significant difference (p<0.05), compared the before training with the after. - COP distance showed the significant difference (p<0.01), compared the before training with the after. - The asymmetry index of front and backward COPsd did not show the significant difference, compared the before training with the after. - The asymmetry index of left and right COPsd did not show the significant difference, compared the before training with the after. - The asymmetry index of COP distance showed the significant difference (p<0.01), compared the before training with the after. Therefore, the yoga training demonstrated the stable improvement in the one leg standing pose of inferior feet and the positive effect to the left and right symmetry ability.