• Proceedings of the KSRS Conference
• /
• 2003.11a
• /
• pp.519-521
• /
• 2003

Within the paper an approach for the automatic extraction and reconstruction of buildings in urban built-up areas base on fusion of high-resolution satellite image and LIDAR data is presented. The presented data fusion scheme is essentially motivated by the fact that image and range data are quite complementary. Raised urban objects are first segmented from the terrain surface in the LIDAR data by making use of the spectral signature derived from satellite image, afterwards building potential regions are initially detected in a hierarchical scheme. A novel 3D building reconstruction model is also presented based on the assumption that most buildings can be approximately decomposed into polyhedral patches. With the constraints of presented building model, 3D edges are used to generate the hypothesis and follow the verification processes and a subsequent logical processing of the primitive geometric patches leads to 3D reconstruction of buildings with good details of shape. The approach is applied on the test sites and shows a good performance, an evaluation is described as well in the paper.

• Journal of Information Processing Systems
• /
• v.15 no.2
• /
• pp.399-409
• /
• 2019

Three-dimensional (3D) human pose reconstruction from single-view image is a difficult and challenging topic. Existing approaches mostly process frame-by-frame independently while inter-frames are highly correlated in a sequence. In contrast, we introduce a novel spatial-temporal 3D human pose reconstruction framework that leverages both intra and inter-frame relationships in consecutive 2D pose sequences. Orthogonal matching pursuit (OMP) algorithm, pre-trained pose-angle limits and temporal models have been implemented. Several quantitative comparisons between our proposed framework and recent works have been studied on CMU motion capture dataset and Vietnamese traditional dance sequences. Our framework outperforms others by 10% lower of Euclidean reconstruction error and more robust against Gaussian noise. Additionally, it is also important to mention that our reconstructed 3D pose sequences are more natural and smoother than others.

• KIPS Transactions on Software and Data Engineering
• /
• v.12 no.5
• /
• pp.229-236
• /
• 2023

Since 3D printed medical implant parts usually have surface defects, it is necessary to inspect the surface after manufacturing. In order to automate the surface inspection, it is effective to 3D scan the implant and reconstruct it as a scan model such as a point cloud. When constructing a scan model, the characteristics of the shape and material of the implant must be considered because it has characteristics different from those of general 3D printed parts. In this paper, we present a method to reconstruct the 3D scan model of a 3D printed metal bone-plate that is one kind of medical implant parts. Multiple partial scan data are produced by multi-view 3D scan, and then, we reconstruct a scan model by alignment and merging of partial data. We also present the process of the scan model reconstruction through experiments.

• Journal of the Korea Computer Graphics Society
• /
• v.23 no.1
• /
• pp.57-65
• /
• 2017

In this paper, we present a dictionary learning method for reducing errors in point cloud models and reconstructing their geometry. For this, 3D feature information is extracted from the models which have a similar shape characteristic as the target model. Then a dictionary is constructed and the geometry is reconstructed using the dictionary. The presented method in this paper consists of the following three steps. First, a geometric patch is constructed from a similar model. Second, a morphological 3D feature of the acquired patch is learned. Third, a geometry reconstruction is performed using the learned dictionary. Finally, the error between the original model and the reconstruction result is calculated, and the accuracy of the reconstruction result is checked.

• International conference on construction engineering and project management
• /
• 2015.10a
• /
• pp.671-672
• /
• 2015

Due to harsh conditions of disaster areas, understanding of current feature of collapsed buildings, terrain, and other infrastructures is critical issue for disaster managers. However, because of difficulties in acquiring the geographical information of the disaster site such as large disaster site and limited capability of rescue workers, comprehensive site investigation of current location of survivors buried under the remains of the building is not an easy task for disaster managers. To overcome these circumstances of disaster site, this study makes use of an unmanned aerial vehicle, commonly known as a drone to effectively acquire current image data from the large disaster areas. The framework of 3D model reconstruction of disaster site using aerial imagery acquired by drones was also presented. The proposed methodology is expected to assist rescue workers and disaster managers in achieving a rapid and accurate identification of survivors under the collapsed building.

• Journal of Information Processing Systems
• /
• v.14 no.6
• /
• pp.1445-1456
• /
• 2018

Environment perception and three-dimensional (3D) reconstruction tasks are used to provide unmanned ground vehicle (UGV) with driving awareness interfaces. The speed of obstacle segmentation and surrounding terrain reconstruction crucially influences decision making in UGVs. To increase the processing speed of environment information analysis, we develop a CPU-GPU hybrid system of automatic environment perception and 3D terrain reconstruction based on the integration of multiple sensors. The system consists of three functional modules, namely, multi-sensor data collection and pre-processing, environment perception, and 3D reconstruction. To integrate individual datasets collected from different sensors, the pre-processing function registers the sensed LiDAR (light detection and ranging) point clouds, video sequences, and motion information into a global terrain model after filtering redundant and noise data according to the redundancy removal principle. In the environment perception module, the registered discrete points are clustered into ground surface and individual objects by using a ground segmentation method and a connected component labeling algorithm. The estimated ground surface and non-ground objects indicate the terrain to be traversed and obstacles in the environment, thus creating driving awareness. The 3D reconstruction module calibrates the projection matrix between the mounted LiDAR and cameras to map the local point clouds onto the captured video images. Texture meshes and color particle models are used to reconstruct the ground surface and objects of the 3D terrain model, respectively. To accelerate the proposed system, we apply the GPU parallel computation method to implement the applied computer graphics and image processing algorithms in parallel.

• Journal of Broadcast Engineering
• /
• v.24 no.2
• /
• pp.264-272
• /
• 2019

In this paper, we propose a 3D human body reconstruction and refinement method from the frames extracted from a video to obtain natural and smooth motion in temporal domain. Individual frames extracted from the video are fed into convolutional neural network to estimate the location of the joint and the silhouette of the human body. This is done by projecting the parameter-based 3D deformable model to 2D image and by estimating the value of the optimal parameters. If the reconstruction process for each frame is performed independently, temporal consistency of human pose and shape cannot be guaranteed, yielding an inaccurate result. To alleviate this problem, the proposed method analyzes and interpolates the principal component parameters of the 3D morphable model reconstructed from each individual frame. Experimental result shows that the erroneous frames are corrected and refined by utilizing the relation between the previous and the next frames to obtain the improved 3D human reconstruction result.

• Journal of International Society for Simulation Surgery
• /
• v.1 no.2
• /
• pp.99-102
• /
• 2014

The skull defect can be made after the trauma, oncologic problems or neurosurgery. The skull reconstruction has been the challenging issue in craniofacial fields for a long time. So far the skull reconstruction with autogenous bone would be the standard. Although the autogenous bone would be the ideal one for skull reconstruction, donor site morbidity would be the inevitable problem in many cases. Meanwhile various types of allogenic and alloplastic materials have been also used. However, skull reconstruction with many alloplastic material have produced no less complications including infection, exposure, and delayed wound healing. Because the 3D printing technique evolved so fast that 3D printed titanium implant were possible recently. The aim of this trial is to try to restore the original skull anatomy as possible using the 3D printed titanium implant, based on the mirrored three dimensional CT images based on the computer simulation. Preoperative computed tomography (CT) data were processed for the patient and a rapid prototyping (RP) model was produced. At the same time, the uninjured side was mirrored and superimposed onto the traumatized side, to create a mirror-image of the RP model. And we fabricated Titanium implant to reconstruct three-dimensional orbital structure in advance, using the 3D printer. This prefabricated Titanium-implant was then inserted onto the defected skull and fixed. Three dimensional printing technique of titanium material based on the computer simulation turned out to be very successful in this patient. Individualized approach for each patient could be an ideal way to manage the traumatic patients in near future.

• Journal of the Institute of Convergence Signal Processing
• /
• v.4 no.3
• /
• pp.27-33
• /
• 2003

The image-based 3D modeling is the technique of generating a 3D graphic model from images acquired using cameras. It is being researched as an alternative technique for the expensive 3D scanner. In this paper, we propose the image-based, 3D modeling system using calibrated stereo cameras. The proposed algorithm for rendering, 3D model consists of three steps, camera calibration, 3D reconstruction, and 3D registration step. In the camera calibration step, we estimate the camera matrix for the image aquisition camera. In the 3D reconstruction step, we calculate 3D coordinates using triangulation from corresponding points of the stereo image. In the 3D registration step, we estimate the transformation matrix that transforms individually reconstructed 3D coordinates to the reference coordinate to render the single 3D model. As shown the result, we generated relatively accurate 3D model.

• Journal of International Society for Simulation Surgery
• /
• v.3 no.1
• /
• pp.12-15
• /
• 2016

Functional and esthetic reconstruction after segmental mandibulectomy is one of the most challenging surgeries in microsurgical reconstruction field. Simulation surgery before free flap reconstruction has been performed for efficient surgery and successful results. Fibula free flap is the flap of the choice for reconstruction of the segmental mandibular defect. Straight nature of the fibula bone requires multiple segmentations to fit into mandible. 3D rapid prototype (RP) model gives a lot of information for mandibular reconstruction. The purpose of this study was to report mandibular reconstruction with free fibular flap using simulation surgery. A total of 30 consecutive patients were included for functional and esthetic evaluation. Among 30 patients, two flaps showed necrosis after radiotherapy. The other flaps were all survived and showed successful reconstruction in both function and esthetics.