• Title/Summary/Keyword: 3D reconstruction

Search Result 1,140, Processing Time 0.031 seconds

A CPU-GPU Hybrid System of Environment Perception and 3D Terrain Reconstruction for Unmanned Ground Vehicle

  • Song, Wei;Zou, Shuanghui;Tian, Yifei;Sun, Su;Fong, Simon;Cho, Kyungeun;Qiu, Lvyang
    • Journal of Information Processing Systems
    • /
    • v.14 no.6
    • /
    • pp.1445-1456
    • /
    • 2018
  • Environment perception and three-dimensional (3D) reconstruction tasks are used to provide unmanned ground vehicle (UGV) with driving awareness interfaces. The speed of obstacle segmentation and surrounding terrain reconstruction crucially influences decision making in UGVs. To increase the processing speed of environment information analysis, we develop a CPU-GPU hybrid system of automatic environment perception and 3D terrain reconstruction based on the integration of multiple sensors. The system consists of three functional modules, namely, multi-sensor data collection and pre-processing, environment perception, and 3D reconstruction. To integrate individual datasets collected from different sensors, the pre-processing function registers the sensed LiDAR (light detection and ranging) point clouds, video sequences, and motion information into a global terrain model after filtering redundant and noise data according to the redundancy removal principle. In the environment perception module, the registered discrete points are clustered into ground surface and individual objects by using a ground segmentation method and a connected component labeling algorithm. The estimated ground surface and non-ground objects indicate the terrain to be traversed and obstacles in the environment, thus creating driving awareness. The 3D reconstruction module calibrates the projection matrix between the mounted LiDAR and cameras to map the local point clouds onto the captured video images. Texture meshes and color particle models are used to reconstruct the ground surface and objects of the 3D terrain model, respectively. To accelerate the proposed system, we apply the GPU parallel computation method to implement the applied computer graphics and image processing algorithms in parallel.

The Value of Three-Dimensional Reconstructions of MRI Imaging using Maximum Intensity Projection Technique (유방 MRI의 최대강도투사 기법에 의한 3차원 재구성 영상의 유용성)

  • Cho, Jae-Hwan;Lee, Hae-Kag;Hong, In-Sik;Kim, Hyun-Joo;Jang, Hyun-Cheol;Park, Cheol-Soo;Park, Tae-Nam
    • Journal of Digital Contents Society
    • /
    • v.12 no.2
    • /
    • pp.157-164
    • /
    • 2011
  • The purpose of this study was to examine the usefulness of 3D reconstruction images in breast MRI by performing a quantitative comparative analysis in patients diagnosed with DCIS. On a 3.0T MR scanner, subtraction images and 3D reconstruction images were obtained from 20 patients histologically diagnosed with ductal carcinoma in situ (DCIS). The findings from the quantitative image analysis are the following: The 3D reconstruction images showed higher SNR at the lesion area, ductal area, and fat area that of the subtraction image. In addition, the CNR were not significantly different in the lesion area itself between the subtraction images and 3D reconstruction images.

A 3D Face Reconstruction Method Robust to Errors of Automatic Facial Feature Point Extraction (얼굴 특징점 자동 추출 오류에 강인한 3차원 얼굴 복원 방법)

  • Lee, Youn-Joo;Lee, Sung-Joo;Park, Kang-Ryoung;Kim, Jai-Hie
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.1
    • /
    • pp.122-131
    • /
    • 2011
  • A widely used single image-based 3D face reconstruction method, 3D morphable shape model, reconstructs an accurate 3D facial shape when 2D facial feature points are correctly extracted from an input face image. However, in the case that a user's cooperation is not available such as a real-time 3D face reconstruction system, this method can be vulnerable to the errors of automatic facial feature point extraction. In order to solve this problem, we automatically classify extracted facial feature points into two groups, erroneous and correct ones, and then reconstruct a 3D facial shape by using only the correctly extracted facial feature points. The experimental results showed that the 3D reconstruction performance of the proposed method was remarkably improved compared to that of the previous method which does not consider the errors of automatic facial feature point extraction.

3D Printed Titanium Implant for the Skull Reconstruction: A Preliminary Case Study

  • Choi, Jong-Woo;Ahn, Jae-Sung
    • Journal of International Society for Simulation Surgery
    • /
    • v.1 no.2
    • /
    • pp.99-102
    • /
    • 2014
  • The skull defect can be made after the trauma, oncologic problems or neurosurgery. The skull reconstruction has been the challenging issue in craniofacial fields for a long time. So far the skull reconstruction with autogenous bone would be the standard. Although the autogenous bone would be the ideal one for skull reconstruction, donor site morbidity would be the inevitable problem in many cases. Meanwhile various types of allogenic and alloplastic materials have been also used. However, skull reconstruction with many alloplastic material have produced no less complications including infection, exposure, and delayed wound healing. Because the 3D printing technique evolved so fast that 3D printed titanium implant were possible recently. The aim of this trial is to try to restore the original skull anatomy as possible using the 3D printed titanium implant, based on the mirrored three dimensional CT images based on the computer simulation. Preoperative computed tomography (CT) data were processed for the patient and a rapid prototyping (RP) model was produced. At the same time, the uninjured side was mirrored and superimposed onto the traumatized side, to create a mirror-image of the RP model. And we fabricated Titanium implant to reconstruct three-dimensional orbital structure in advance, using the 3D printer. This prefabricated Titanium-implant was then inserted onto the defected skull and fixed. Three dimensional printing technique of titanium material based on the computer simulation turned out to be very successful in this patient. Individualized approach for each patient could be an ideal way to manage the traumatic patients in near future.

Image segmentation and line segment extraction for 3-d building reconstruction

  • Ye, Chul-Soo;Kim, Kyoung-Ok;Lee, Jong-Hun;Lee, Kwae-Hi
    • Proceedings of the KSRS Conference
    • /
    • 2002.10a
    • /
    • pp.59-64
    • /
    • 2002
  • This paper presents a method for line segment extraction for 3-d building reconstruction. Building roofs are described as a set of planar polygonal patches, each of which is extracted by watershed-based image segmentation, line segment matching and coplanar grouping. Coplanar grouping and polygonal patch formation are performed per region by selecting 3-d line segments that are matched using epipolar geometry and flight information. The algorithm has been applied to high resolution aerial images and the results show accurate 3-d building reconstruction.

  • PDF

A Visualization System of Brain MR image based on VTK

  • Du, Ruoyu;Lee, Hyo Jong
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2012.04a
    • /
    • pp.336-339
    • /
    • 2012
  • VTK is a free but professional development platform for images three-dimensional (3D) reconstruction and processing. It is powerful, open-source, and users can customize their own needs by self-development of great flexibility. To give the doctors more and detailed information by simulate dissection to the 3-D brain MRI image after reconstruction. A Visualization System (VS) is proposed to achieve 3D brain reconstruction and virtual dissection functions. Based on the free VTK visualization development platform and Visual Studio 2010 IDE development tools, through C++ language, using real people's MRI brain dataset, we realized the images 3D reconstruction and also its applications and extensions correspondingly. The display effect of the reconstructed 3D image is well and intuitive. With the related operations such as measurement, virtual dissection and so on, the good results we desired could be achieved.

Graph-Cut based Mesh Reconstruction Algorithm (Hole 이 발생하지 않는 Graph-Cut 기반 Mesh Reconstruction)

  • Han, HyeonDeok;Han, Jong-Ki
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2020.07a
    • /
    • pp.282-285
    • /
    • 2020
  • 포인트 클라우드는 2D 이미지를 3D 로 복원하고 표현하는 방법으로써 많은 연구가 진행되고 있다. 하지만 포인트 클라우드로만 표현할 경우 포인트와 포인트 사이에 빈 공간이 존재하여 실제 3D 물체와 차이가 존재한다. Mesh Reconstruction 은 보다 실제 3D 물체처럼 보이기 위해 포인트와 포인트를 이어 mesh 를 생성하는 방법인데 생성된 mesh 의 quality 는 texturing 을 거친 최종 결과에 큰 영향을 끼친다. 기존에 존재하는 이미지를 기반으로 생성된 포인트 클라우드의 Mesh Reconstruction 방법은 노이즈에 어느 정도 강한 면을 보이지만 최종 결과에서 잘 이어진 mesh 를 생성하지 못하고 hole 이 존재하는 문제가 있다. 본 논문에선 노이즈에 강하면서 최종 결과에서 잘 이어진 mesh 를 만들 수 있도록 하는 Mesh Reconstruction 알고리즘을 제안한다.

  • PDF

Rapid Implementation of 3D Facial Reconstruction from a Single Image on an Android Mobile Device

  • Truong, Phuc Huu;Park, Chang-Woo;Lee, Minsik;Choi, Sang-Il;Ji, Sang-Hoon;Jeong, Gu-Min
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.8 no.5
    • /
    • pp.1690-1710
    • /
    • 2014
  • In this paper, we propose the rapid implementation of a 3-dimensional (3D) facial reconstruction from a single frontal face image and introduce a design for its application on a mobile device. The proposed system can effectively reconstruct human faces in 3D using an approach robust to lighting conditions, and a fast method based on a Canonical Correlation Analysis (CCA) algorithm to estimate the depth. The reconstruction system is built by first creating 3D facial mapping from a personal identity vector of a face image. This mapping is then applied to real-world images captured with a built-in camera on a mobile device to form the corresponding 3D depth information. Finally, the facial texture from the face image is extracted and added to the reconstruction results. Experiments with an Android phone show that the implementation of this system as an Android application performs well. The advantage of the proposed method is an easy 3D reconstruction of almost all facial images captured in the real world with a fast computation. This has been clearly demonstrated in the Android application, which requires only a short time to reconstruct the 3D depth map.

The Study on the Implementation of the X-Ray CT System Using the Cone-Beam for the 3D Dynamic Image Acquisition (3D 동영상획득을 위한 Cone-Beam 형 X-Ray CT 시스템 구현에 관한 연구)

  • Jeong, Chan-Woong;Jun, Kyu-Suk
    • The Journal of the Acoustical Society of Korea
    • /
    • v.28 no.4
    • /
    • pp.370-374
    • /
    • 2009
  • In this paper, we presents a new cone beam computerized tomography (CB CT) system for the reconstruction of 3 dimensional dynamic images. The system using cone beam has less the exposure of radioactivity than fan beam, relatively. In the system, the reconstruction 3-D image is reconstructed with the radiation angle of X-ray in the image processing unit and transmitted to the monitor. And in the image processing unit, the Three Pass Shear Matrices, a kind of Rotation-based method, is applied to reconstruct 3D image because it has less transcendental functions than the one-pass shear matrix to decrease a time of calculations for the reconstruction 3-D image in the processor. The new system is able to get 3~5 3-D images a second, reconstruct the 3-D dynamic images in real time.

The Manufacture of Custom Made 3D Titanium Implant for Skull Reconstruction

  • Cho, Hyung Rok;Yun, In Sik;Shim, Kyu Won;Roh, Tai Suk;Kim, Yong Oock
    • Journal of International Society for Simulation Surgery
    • /
    • v.1 no.1
    • /
    • pp.13-15
    • /
    • 2014
  • Nowadays, with advanced 3D printing techniques, the custom-made implant can be manufactured for the patient. Especially in skull reconstruction, it is difficult to design the implant due to complicated geometry. In large defect, an autograft is inappropriate to cover the defect due to donor morbidity. We present the process of manufacturing the 3D custom-made implant for skull reconstruction. There was one patient with skull defect repaired using custom-made 3D titanium implant in the plastic and reconstructive surgery department. The patient had defect of the left parieto-temporal area after craniectomy due to traumatic subdural hematoma. Custom-made 3D titanium implants were manufactured by Medyssey Co., Ltd. using 3D CT data, Mimics software and an EBM (Electron Beam Melting) machine. The engineer and surgeon reviewed several different designs and simulated a mock surgery on 3D skull model. During the operation, the custom-made implant was fit to the defect properly without dead space. The operative site healed without any specific complications. In skull reconstruction, autograft has been the treatment of choice. However, it is not always available and depends on the size of defect and donor morbidity. As 3D printing technique has been advanced, it is useful to manufacture custom-made implant for skull reconstruction.