• 제목/요약/키워드: 3-D shape reconstruction

Search Result 171, Processing Time 0.028 seconds

Development of a Reliable Real-time 3D Reconstruction System for Tiny Defects on Steel Surfaces (금속 표면 미세 결함에 대한 신뢰성 있는 실시간 3차원 형상 추출 시스템 개발)

  • Jang, Yu Jin;Lee, Joo Seob
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.19 no.12
    • /
    • pp.1061-1066
    • /
    • 2013
  • In the steel industry, the detection of tiny defects including its 3D characteristics on steel surfaces is very important from the point of view of quality control. A multi-spectral photometric stereo method is an attractive scheme because the shape of the defect can be obtained based on the images which are acquired at the same time by using a multi-channel camera. Moreover, the calculation time required for this scheme can be greatly reduced for real-time application with the aid of a GPU (Graphic Processing Unit). Although a more reliable shape reconstruction of defects can be possible when the numbers of available images are increased, it is not an easy task to construct a camera system which has more than 3 channels in the visible light range. In this paper, a new 6-channel camera system, which can distinguish the vertical/horizontal linearly polarized lights of RGB light sources, was developed by adopting two 3-CCD cameras and two polarized lenses based on the fact that the polarized light is preserved on the steel surface. The photometric stereo scheme with 6 images was accelerated by using a GPU, and the performance of the proposed system was validated through experiments.

Multi-View Image Deblurring for 3D Shape Reconstruction (3차원 형상 복원을 위한 다중시점 영상 디블러링)

  • Choi, Ho Yeol;Park, In Kyu
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.49 no.11
    • /
    • pp.47-55
    • /
    • 2012
  • In this paper, we propose a method to reconstruct accurate 3D shape object by using multi-view images which are disturbed by motion blur. In multi-view deblurring, more precise PSF estimation can be done by using the geometric relationship between multi-view images. The proposed method first estimates initial 2D PSFs from individual input images. Then 3D PSF candidates are projected on the input images one by one to find the best one which are mostly consistent with the initial 2D PSFs. 3D PSF consists with direction and density and it represents the 3D trajectory of object motion. 야to restore 3D shape by using multi-view images computes the similarity map and estimates the position of 3D point. The estimated 3D PSF is again projected to input images and they replaces the intial 2D PSFs which are finally used in image deblurring. Experimental result shows that the quality of image deblurring and 3D reconstruction improves significantly compared with the result when the input images are independently deblurred.

3D Head Modeling using Depth Sensor

  • Song, Eungyeol;Choi, Jaesung;Jeon, Taejae;Lee, Sangyoun
    • Journal of International Society for Simulation Surgery
    • /
    • v.2 no.1
    • /
    • pp.13-16
    • /
    • 2015
  • Purpose We conducted a study on the reconstruction of the head's shape in 3D using the ToF depth sensor. A time-of-flight camera (ToF camera) is a range imaging camera system that resolves distance based on the known speed of light, measuring the time-of-flight of a light signal between the camera and the subject for each point of the image. The above method is the safest way of measuring the head shape of plagiocephaly patients in 3D. The texture, appearance and size of the head were reconstructed from the measured data and we used the SDF method for a precise reconstruction. Materials and Methods To generate a precise model, mesh was generated by using Marching cube and SDF. Results The ground truth was determined by measuring 10 people of experiment participants for 3 times repetitively and the created 3D model of the same part from this experiment was measured as well. Measurement of actual head circumference and the reconstructed model were made according to the layer 3 standard and measurement errors were also calculated. As a result, we were able to gain exact results with an average error of 0.9 cm, standard deviation of 0.9, min: 0.2 and max: 1.4. Conclusion The suggested method was able to complete the 3D model by minimizing errors. This model is very effective in terms of quantitative and objective evaluation. However, measurement range somewhat lacks 3D information for the manufacture of protective helmets, as measurements were made according to the layer 3 standard. As a result, measurement range will need to be widened to facilitate production of more precise and perfectively protective helmets by conducting scans on all head circumferences in the future.

Shape Adaptive Searching Region to Find Focused Image Points in 3D Shape Reconstruction (3차원 형체복원에 있어서 측정면에 적응적인 초점화소 탐색영역 결정기법)

  • 김현태;한문용;홍민철;차형태;한헌수
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.77-77
    • /
    • 2000
  • The shape of small or curved object is usually reconstructed using a single camera by moving its lens position to find a sequence of the focused images. Most conventional methods have used a window with fixed shape to test the focus measure, which resulted in a deterioration of accuracy. To solve this problem, this paper proposes a new approach of using a shape adaptive window. It estimates the shape of the object at every step and applies the same shape of window to calculate the focus measure. Focus measure is based on the variance of the pixels inside the window. This paper includes the experimental results.

  • PDF

3D Point Cloud Reconstruction Technique from 2D Image Using Efficient Feature Map Extraction Network (효율적인 feature map 추출 네트워크를 이용한 2D 이미지에서의 3D 포인트 클라우드 재구축 기법)

  • Kim, Jeong-Yoon;Lee, Seung-Ho
    • Journal of IKEEE
    • /
    • v.26 no.3
    • /
    • pp.408-415
    • /
    • 2022
  • In this paper, we propose a 3D point cloud reconstruction technique from 2D images using efficient feature map extraction network. The originality of the method proposed in this paper is as follows. First, we use a new feature map extraction network that is about 27% efficient than existing techniques in terms of memory. The proposed network does not reduce the size to the middle of the deep learning network, so important information required for 3D point cloud reconstruction is not lost. We solved the memory increase problem caused by the non-reduced image size by reducing the number of channels and by efficiently configuring the deep learning network to be shallow. Second, by preserving the high-resolution features of the 2D image, the accuracy can be further improved than that of the conventional technique. The feature map extracted from the non-reduced image contains more detailed information than the existing method, which can further improve the reconstruction accuracy of the 3D point cloud. Third, we use a divergence loss that does not require shooting information. The fact that not only the 2D image but also the shooting angle is required for learning, the dataset must contain detailed information and it is a disadvantage that makes it difficult to construct the dataset. In this paper, the accuracy of the reconstruction of the 3D point cloud can be increased by increasing the diversity of information through randomness without additional shooting information. In order to objectively evaluate the performance of the proposed method, using the ShapeNet dataset and using the same method as in the comparative papers, the CD value of the method proposed in this paper is 5.87, the EMD value is 5.81, and the FLOPs value is 2.9G. It was calculated. On the other hand, the lower the CD and EMD values, the better the accuracy of the reconstructed 3D point cloud approaches the original. In addition, the lower the number of FLOPs, the less memory is required for the deep learning network. Therefore, the CD, EMD, and FLOPs performance evaluation results of the proposed method showed about 27% improvement in memory and 6.3% in terms of accuracy compared to the methods in other papers, demonstrating objective performance.

Reconstruction of polygonal prisms from point-clouds of engineering facilities

  • Chida, Akisato;Masuda, Hiroshi
    • Journal of Computational Design and Engineering
    • /
    • v.3 no.4
    • /
    • pp.322-329
    • /
    • 2016
  • The advent of high-performance terrestrial laser scanners has made it possible to capture dense point-clouds of engineering facilities. 3D shape acquisition from engineering facilities is useful for supporting maintenance and repair tasks. In this paper, we discuss methods to reconstruct box shapes and polygonal prisms from large-scale point-clouds. Since many faces may be partly occluded by other objects in engineering plants, we estimate possible box shapes and polygonal prisms and verify their compatibility with measured point-clouds. We evaluate our method using actual point-clouds of engineering plants.

A Study on the 3D Reconstruction and Historical Evidence of Recumbent Buddha Based on Fusion of UAS, CRP and Terrestrial LiDAR (UAS, CRP 및 지상 LiDAR 융합기반 와형석조여래불의 3차원 재현과 고증 연구)

  • Oh, Seong-Jong;Lee, Yong-Chang
    • Journal of Cadastre & Land InformatiX
    • /
    • v.51 no.1
    • /
    • pp.111-124
    • /
    • 2021
  • Recently, Interest in the restoration and 3D reconstruction of cultural properties due to the fire of Notre Dame Cathedral on April 15, 2019 has been focused once again after the 2008 Sungnyemun fire incident in South Korea. In particular, research to restore and reconstruct the actual measurement of cultural properties using LiDAR(Light Detection and ranging) and conventional surveying, which were previously used, using various 3D reconstruction technologies, is being actively conducted. This study acquires data using unmanned aerial imagery of UAV(Unmanned Aerial Vehicle), which has recently established itself as a core technology in the era of the 4th industrial revolution, and the existing CRP(Closed Range Photogrammetry) and terrestrial LiDAR scanning for the Recumbent Buddha of Unju Temple. Then, the 3D reconstruction was performed with three fusion models based on SfM(Structure-from-Motion), and the reproducibility and accuracy of the models were compared and analyzed. In addition, using the best fusion model among the three models, the relationship with the Polar Star(Polaris) was confirmed based on the real world coordinates of the Recumbent Buddha, which contains the astronomical history of Buddhism in the early 11th century Goryeo Dynasty. Through this study, not only the simple external 3D reconstruction of cultural properties, but also the method of reconstructing the historical evidence according to the type and shape of the cultural properties was sought by confirming the historical evidence of the cultural properties in terms of spatial information.

Comparison of the Editing Method of Missing Area in 3D Scanned Image of Men's Crotch (3차원 스캔한 인체 샅부위의 결측부위 복원 방법 비교)

  • Kim, So-Young;Hong, Kyung-Hi
    • Journal of the Korean Society of Clothing and Textiles
    • /
    • v.33 no.3
    • /
    • pp.401-409
    • /
    • 2009
  • The shape of crotch area is very important to develop functional clothing as well as other ergonomic goods such as chair or saddle etc. However, it is inevitable that 3D scanned image of crotch would have missing part due to its folded shape including overlapping legs nearby. Therefore, the objectives of this research was to compare reconstruction methods of missing parts at crotch using seven dummies of real men's replicas. Two reconstruction methods adopted were kinds of 'fill- hole' in Rapidform 2004, one was 'smooth' and the other was 'curvature'. Each restored image was compared with the original shape of the dummies. As results, the average distance was 0.66mm between original and 'smooth' treated images and 0.59mm between original and 'curvature' treated, which was not statistically different. Average area of restored crotch region was $8740.04cm^2$ by 'smooth' method and $8405.02cm^2$ by 'curvature' method which is close to the original area of $8413.76cm^2$. Statistical difference was found between images of original and 'smooth' ones$(p=0.04^*)$. However, there was no difference between original and 'curvature' treated images, which indicates that 'curvature' method is more useful to fill the hole compared with 'smooth' method.

Algorithm for Fabricating 3D Breast Implants by Using MRI and 3D Scan Data (MRI와 3D 스캔 데이터를 이용한 3D 프린팅 유방 인공보형물의 제작 알고리즘)

  • Jeong, Young Jin;Choi, Dong Hun;Kim, Ku-Jin
    • Journal of Korea Multimedia Society
    • /
    • v.22 no.12
    • /
    • pp.1385-1395
    • /
    • 2019
  • In this paper, we propose a method to fabricate a patient-specific breast implant using MRI images and 3D scan data. Existing breast implants for breast reconstruction surgery are primarily fabricated products for shaping, and among the limited types of implants, products similar to the patient's breast have been used. In fact, the larger the difference between the shape of the breast and the implant, the more frequent the postoperative side effects and the lower the satisfaction. Previous researches on the fabrication of patient-specific breast implants have used limited information based on only MRI images or on only 3D scan data. In this paper, we propose an algorithm for the fabrication of patient-specific breast implants that combines MRI images with 3D scan data, considering anatomical suitability for external shape, volume, and pectoral muscle. Experimental results show that we can produce precise breast implants using the proposed algorithm.

3D Generic Vertebra Model for Computer Aided Diagnosis (컴퓨터를 이용한 의료 진단용 3차원 척추 제네릭 모델)

  • Lee, Ju-Sung;Baek, Seung-Yeob;Lee, Kun-Woo
    • Korean Journal of Computational Design and Engineering
    • /
    • v.15 no.4
    • /
    • pp.297-305
    • /
    • 2010
  • Medical image acquisition techniques such as CT and MRI have disadvantages in that the numerous time and efforts are needed. Furthermore, a great amount of radiation exposure is an inherent proberty of the CT imaging technique, a number of side-effects are expected from such method. To improve such conventional methods, a number of novel methods that can obtain 3D medical images from a few X-ray images, such as algebraic reconstruction technique (ART), have been developed. Such methods deform a generic model of the internal body part and fit them into the X-ray images to obtain the 3D model; the initial shape, therefore, affects the entire fitting process in a great deal. From this fact, we propose a novel method that can generate a 3D vertebraic generic model based on the statistical database of CT scans in this study. Moreover, we also discuss a method to generate patient-tailored generic model using the facts obtained from the statistical analysis. To do so, the mesh topologies of CT-scanned 3D vertebra models are modified to be identical to each other, and the database is constructed based on them. Furthermore, from the results of a statistical analysis on the database, the tendency of shape distribution is characterized, and the modeling parameters are extracted. By using these modeling parameters for generating the patient-tailored generic model, the computational speed and accuracy of ART can greatly be improved. Furthermore, although this study only includes an application to the C1 (Atlas) vertebra, the entire framework of our method can be applied to other body parts generally. Therefore, it is expected that the proposed method can benefit the various medical imaging applications.