• Title/Summary/Keyword: 3D object reconstruction

Search Result 195, Processing Time 0.035 seconds

AI-Based Object Recognition Research for Augmented Reality Character Implementation (증강현실 캐릭터 구현을 위한 AI기반 객체인식 연구)

  • Seok-Hwan Lee;Jung-Keum Lee;Hyun Sim
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.18 no.6
    • /
    • pp.1321-1330
    • /
    • 2023
  • This study attempts to address the problem of 3D pose estimation for multiple human objects through a single image generated during the character development process that can be used in augmented reality. In the existing top-down method, all objects in the image are first detected, and then each is reconstructed independently. The problem is that inconsistent results may occur due to overlap or depth order mismatch between the reconstructed objects. The goal of this study is to solve these problems and develop a single network that provides consistent 3D reconstruction of all humans in a scene. Integrating a human body model based on the SMPL parametric system into a top-down framework became an important choice. Through this, two types of collision loss based on distance field and loss that considers depth order were introduced. The first loss prevents overlap between reconstructed people, and the second loss adjusts the depth ordering of people to render occlusion inference and annotated instance segmentation consistently. This method allows depth information to be provided to the network without explicit 3D annotation of the image. Experimental results show that this study's methodology performs better than existing methods on standard 3D pose benchmarks, and the proposed losses enable more consistent reconstruction from natural images.

Robust 3-D Motion Estimation Based on Stereo Vision and Kalman Filtering (스테레오 시각과 Kalman 필터링을 이용한 강인한 3차원 운동추정)

  • 계영철
    • Journal of Broadcast Engineering
    • /
    • v.1 no.2
    • /
    • pp.176-187
    • /
    • 1996
  • This paper deals with the accurate estimation of 3- D pose (position and orientation) of a moving object with reference to the world frame (or robot base frame), based on a sequence of stereo images taken by cameras mounted on the end - effector of a robot manipulator. This work is an extension of the previous work[1]. Emphasis is given to the 3-D pose estimation relative to the world (or robot base) frame under the presence of not only the measurement noise in 2 - D images[ 1] but also the camera position errors due to the random noise involved in joint angles of a robot manipulator. To this end, a new set of discrete linear Kalman filter equations is derived, based on the following: 1) the orientation error of the object frame due to measurement noise in 2 - D images is modeled with reference to the camera frame by analyzing the noise propagation through 3- D reconstruction; 2) an extended Jacobian matrix is formulated by combining the result of 1) and the orientation error of the end-effector frame due to joint angle errors through robot differential kinematics; and 3) the rotational motion of an object, which is nonlinear in nature, is linearized based on quaternions. Motion parameters are computed from the estimated quaternions based on the iterated least-squares method. Simulation results show the significant reduction of estimation errors and also demonstrate an accurate convergence of the actual motion parameters to the true values.

  • PDF

A Two-Phase Algorithm for Polyhedral 3D Object Reconstruction from Two Orthographic Views (이면도로부터 다면체 복원을 위한이단계 알고리즘)

  • O, Beom-Su;Kim, Chang-Heon
    • Journal of KIISE:Computer Systems and Theory
    • /
    • v.26 no.4
    • /
    • pp.513-526
    • /
    • 1999
  • 3 차원 입체 형상을 표현하기 위한 수단으로서 도면을 사용하는 방법이 생산현장에서 많이 활용되고 있다. 그러나 이 방법은 정투영 과정에서 정보 손실이 발생하기 때문에 3차원 후보 요소의 빈번한 조합 탐색 및 복잡한 기하 연산을 필요로 한다. 특히 , 이면도로부터 복원과정은 면도의 생략으로 인하여 수많은 허요소를 생성한다. 본 논문은 효율적인 허요소 축소를 통하여 이면도로부터 다면체를 바르게 복원하는 이단계 알고리즘을 제안한다. 1 단계에서는 이면도와의 정합성에 필수적인 최소한의 3차원 후보요소를 생성한후 , 정투영시 이면도와 일치하는 부분 물체를 복원한다. 2단계에서는 부분 물체에 직교면을 덧붙임으로써 기하학적으로 타당한 완전 물체를 복원한다. 실험결과를 통하여 제안방법이 기존 방법들에 비해 적은 수의 3차원 후보 요소를 생성시키면서 이면도로로부터 3차원 물체를 빠르게 생성하는 것을 보인다.

Geometric Fitting of Parametric Curves and Surfaces

  • Ahn, Sung-Joon
    • Journal of Information Processing Systems
    • /
    • v.4 no.4
    • /
    • pp.153-158
    • /
    • 2008
  • This paper deals with the geometric fitting algorithms for parametric curves and surfaces in 2-D/3-D space, which estimate the curve/surface parameters by minimizing the square sum of the shortest distances between the curve/surface and the given points. We identify three algorithmic approaches for solving the nonlinear problem of geometric fitting. As their general implementation we describe a new algorithm for geometric fitting of parametric curves and surfaces. The curve/surface parameters are estimated in terms of form, position, and rotation parameters. We test and evaluate the performances of the algorithms with fitting examples.

Constraint Relaxation using User Interaction in Reactive Scheduling Environment (동적 스케줄링 문제에서 사용자 상호작용을 이용한 제약조건 완화)

  • Lee, Hoon;Jung, Jong Jin;Jo, Geun Sik
    • Journal of Advanced Navigation Technology
    • /
    • v.2 no.2
    • /
    • pp.132-142
    • /
    • 1998
  • In optical scanning holography, 3-D holographic information of an object is generated by 2-D active optical scanning. The optical scanning beam can be a time-dependent Gaussian apodized Fresnel zone plate. In this technique, the holographic information manifests itself as an electrical signal which can be sent to an electron-beam-addressed spatial light modulator for coherent image reconstruction. This technique can be applied to 3-D optical remote sensing especially for identifying flying objects. In this paper, we first briefly review optical scanning holography and analyze the resolution achievable with the system. We then present mathematical expression of real and virtual image which are responsible for holographic image reconstruction by using Gaussian beam profile.

  • PDF

A FRINGE CHARACTER ANALYSIS OF FRINGE IMAGE (Fringe 영상의 주파수 특성 분석)

  • Seo Young-Ho;Choi Hyun-Jun;Kim Dong-Wook
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.30 no.11C
    • /
    • pp.1053-1059
    • /
    • 2005
  • The computer generated hologram (CGH) designs and produces digital information for generating 3-D (3-Dimension) image using computer and software instead of optically-sensed hologram of light interference, and it can synthesis a virtual object which is physically not in existence. Since digital hologram includes an amount of data as can be seen at the process of digitization, it is necessary that the data representing digital hologram is reduced for storing, transmission, and processing. As the efforts that are to handle hologram with a type of digital information have been increased, various methods to compress digital hologram called by fringe pattern are groped. Suitable proposal is encoding of hologram. In this paper, we analyzed the properties of CGH using tools of frequency transform, assuming that a generated CGH is a 2D image by introducing DWT that is known as the better tool than DCT for frequency transform. The compression and reconstruction result which was extracted from the wavelet-based codecs illustrates that it has better properties for reconstruction at the maximum 2 times higher compression rate than the Previous researches of Yoshikawa[2] and Thomas[3].

Usefulness of Region Cut Subtraction in Fusion & MIP 3D Reconstruction Image (Fusion & Maximum Intensity Projection 3D 재구성 영상에서 Region Cut Subtraction의 유용성)

  • Moon, A-Reum;Chi, Yong-Gi;Choi, Sung-Wook;Lee, Hyuk;Lee, Kyoo-Bok;Seok, Jae-Dong
    • The Korean Journal of Nuclear Medicine Technology
    • /
    • v.14 no.1
    • /
    • pp.18-23
    • /
    • 2010
  • Purpose: PET/CT combines functional and morphologic data and increases diagnostic accuracy in a variety of malignancies. Especially reconstructed Fusion PET/CT images or MIP (Maximum Intensity Projection) images from a 2-dimensional image to a 3-dimensional one are useful in visualization of the lesion. But in Fusion & MIP 3D reconstruction image, due to hot uptake by urine or urostomy bag, lesion is overlapped so it is difficult that we can distinguish the lesion with the naked eye. This research tries to improve a distinction by removing parts of hot uptake. Materials and Methods: This research has been conducted the object of patients who have went to our hospital from September 2008 to March 2009 and have a lot of urine of remaining volume as disease of uterus, bladder, rectum in the result of PET/CT examination. We used GE Company's Advantage Workstation AW4.3 05 Version Volume Viewer program. As an analysis method, set up ROI in region of removal in axial volume image, select Cut Outside and apply same method in coronal volume image. Next, adjust minimum value in Threshold of 3D Tools, select subtraction in Advanced Processing. It makes Fusion & MIP images and compares them with the image no using Region Cut Definition. Results: In Fusion & MIP 3D reconstruction image, it makes Fusion & MIP images and compares them by using Advantage Workstation AW4.3 05's Region Cut Subtraction, parts of hot uptake according to patient's urine can be removed. Distinction of lesion was clearly reconstructed in image using Region Cut Definition. Conclusion: After examining the patients showing hot uptake on account of volume of urine intake in bladder, in process of reconstruction image, if parts of hot uptake would be removed, it could contribute to offering much better diagnostic information than image subtraction of conventional method. Especially in case of disease of uterus, bladder and rectum, it will be helpful for qualitative improvement of image.

  • PDF

3D building modeling from airborne Lidar data by building model regularization (건물모델 정규화를 적용한 항공라이다의 3차원 건물 모델링)

  • Lee, Jeong Ho;Ga, Chill Ol;Kim, Yong Il;Lee, Byung Gil
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.30 no.4
    • /
    • pp.353-362
    • /
    • 2012
  • 3D building modeling from airborne Lidar without model regularization may cause positional errors or topological inconsistency in building models. Regularization of 3D building models, on the other hand, restricts the types of models which can be reconstructed. To resolve these issues, this paper modelled 3D buildings from airborne Lidar by building model regularization which considers more various types of buildings. Building points are first segmented into roof planes by clustering in feature space and segmentation in object space. Then, 3D building models are reconstructed by consecutive adjustment of planes, lines, and points to satisfy parallelism, symmetry, and consistency between model components. The experimental results demonstrated that the method could make more various types of 3d building models with regularity. The effects of regularization on the positional accuracies of models were also analyzed quantitatively.

Neighboring Elemental Image Exemplar Based Inpainting for Computational Integral Imaging Reconstruction with Partial Occlusion

  • Ko, Bumseok;Lee, Byung-Gook;Lee, Sukho
    • Journal of the Optical Society of Korea
    • /
    • v.19 no.4
    • /
    • pp.390-396
    • /
    • 2015
  • We propose a partial occlusion removal method for computational integral imaging reconstruction (CIIR) based on the usage of the exemplar based inpainting technique. The proposed method is an improved version of the original linear inpainting based CIIR (LI-CIIR), which uses the inpainting technique to fill in the data missing region. The LI-CIIR shows good results for images which contain objects with smooth surfaces. However, if the object has a textured surface, the result of the LI-CIIR deteriorates, since the linear inpainting cannot recover the textured data in the data missing region well. In this work, we utilize the exemplar based inpainting to fill in the textured data in the data missing region. We call the proposed method the neighboring elemental image exemplar based inpainting (NEI-exemplar inpainting) method, since it uses sources from neighboring elemental images to fill in the data missing region. Furthermore, we also propose an automatic occluding region extraction method based on the use of the mutual constraint using depth estimation (MC-DE) and the level set based bimodal segmentation. Experimental results show the validity of the proposed system.

Resolution enhanced integral imaging using super-resolution image reconstruction algorithm (초해상도 영상복원을 이용한 집적영상의 해상도 향상)

  • Hong, Kee-Hoon;Park, Jae-Hyeung;Lee, Byoung-Ho
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.34 no.10B
    • /
    • pp.1124-1132
    • /
    • 2009
  • We proposed a new method to improve the resolution of elemental image set in the integral imaging system using super-resolution image reconstruction method. Adjacent elemental images have same image region which is projected from the common area of object. These projected images in the elemental image can be used for low resolution images of super-resolution method. Two methods for resolution improvement of elemental image set using super-resolution method are proposed. One is super-resolution among the elemental image sets and the other is among the elemental images. Simulation results are compared with resolution improved elemental image set using interpolated method.