• Title/Summary/Keyword: 2D-3D registration

Search Result 154, Processing Time 0.03 seconds

Automatic Surface Matching for the Registration of LIDAR Data and MR Imagery

  • Habib, Ayman F.;Cheng, Rita W.T.;Kim, Eui-Myoung;Mitishita, Edson A.;Frayne, Richard;Ronsky, Janet L.
    • ETRI Journal
    • /
    • v.28 no.2
    • /
    • pp.162-174
    • /
    • 2006
  • Several photogrammetric and geographic information system applications such as surface matching, object recognition, city modeling, environmental monitoring, and change detection deal with multiple versions of the same surface that have been derived from different sources and/or at different times. Surface registration is a necessary procedure prior to the manipulation of these 3D datasets. This need is also applicable in the field of medical imaging, where imaging modalities such as magnetic resonance imaging (MRI) can provide temporal 3D imagery for monitoring disease progression. This paper will present a general automated surface registration procedure that can establish correspondences between conjugate surface elements. Experimental results using light detection and ranging (LIDAR) and MRI data will verify the feasibility, robustness, and accuracy of this approach.

  • PDF

Development of the 3D Imaging System and Automatic Registration Algorithm for the Intelligent Excavation System (IES) (지능형 굴삭 시스템을 위한 모바일 3D 이미징 시스템 및 자동 정합 알고리즘의 개발)

  • Chae, Myung-Jin;Lee, Gyu-Won;Kim, Jung-Ryul;Park, Jae-Woo;Yoo, Hyun-Seok;Cho, Moon-Young
    • Korean Journal of Construction Engineering and Management
    • /
    • v.10 no.1
    • /
    • pp.136-145
    • /
    • 2009
  • The objective of the Intelligent Excavation System (IES) is to recognize the work environment and produce work plan and automatically control the excavator through integrating sensor and robot technologies. This paper discusses one of the core technologies of IES development project, development of 3D work environment modeling. 3D laser scanner is used for 3-dimensional mathematical model that can be visualized in virtual space in 3D. This paper describes (1) how the most appropriate 3D imaging system has been chosen; (2) the development of user interface and customization of the s/w to control the scanner for IES project; (3) the development of the mobile station for the scanner; (4) and the algorithm for the automatic registration of laser scan segments for IES project. The development system has been tested on the construction field and lessons learned and future development requirements are suggested.

Rotational Characteristics of Target Registration Error for Contour-based Registration in Neuronavigation System: A Phantom Study (뉴로내비게이션 시스템 표면정합에 대한 병변 정합 오차의 회전적 특성 분석: 팬텀 연구)

  • Park, Hyun-Joon;Mun, Joung Hwan;Yoo, Hakje;Shin, Ki-Young;Sim, Taeyong
    • Journal of Biomedical Engineering Research
    • /
    • v.37 no.2
    • /
    • pp.68-74
    • /
    • 2016
  • In this study, we investigated the rotational characteristics which were comprised of directionality and linearity of target registration error (TRE) as a study in advance to enhance the accuracy of contour-based registration in neuronavigation. For the experiment, two rigid head phantoms that have different faces with specially designed target frame fixed inside of the phantoms were used. Three-dimensional coordinates of facial surface point cloud and target point of the phantoms were acquired using computed tomography (CT) and 3D scanner. Iterative closest point (ICP) method was used for registration of two different point cloud and the directionality and linearity of TRE in overall head were calculated by using 3D position of targets after registration. As a result, it was represented that TRE had consistent direction in overall head region and was increased in linear fashion as distance from facial surface, but did not show high linearity. These results indicated that it is possible for decrease TRE by controlling orientation of facial surface point cloud acquired from scanner, and the prediction of TRE from surface registration error can decrease the registration accuracy in lesion. In the further studies, we have to develop the contour-based registration method for improvement of accuracy by considering rotational characteristics of TRE.

Registration System of 3D Footwear data by Foot Movements (발의 움직임 추적에 의한 3차원 신발모델 정합 시스템)

  • Jung, Da-Un;Seo, Yung-Ho;Choi, Jong-Soo
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.44 no.6
    • /
    • pp.24-34
    • /
    • 2007
  • Application systems that easy to access a information have been developed by IT growth and a human life variation. In this paper, we propose a application system to register a 3D footwear model using a monocular camera. In General, a human motion analysis research to body movement. However, this system research a new method to use a foot movement. This paper present a system process and show experiment results. For projection to 2D foot plane from 3D shoe model data, we construct processes that a foot tracking, a projection expression and pose estimation process. This system divide from a 2D image analysis and a 3D pose estimation. First, for a foot tracking, we propose a method that find fixing point by a foot characteristic, and propose a geometric expression to relate 2D coordinate and 3D coordinate to use a monocular camera without a camera calibration. We make a application system, and measure distance error. Then, we confirmed a registration very well.

Analysis of skin movement using MR images (자기공명 영상을 이용한 피부 움직임 분석에 관한 연구)

  • ;Natsuki Miyata;Makiko Kouchi;Masaaki Mochimaru
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2003.06a
    • /
    • pp.719-722
    • /
    • 2003
  • This paper describes a novel experiment that measures the skin movement of a hand based on MR (magnetic resonance) images in conjunction with surface modeling techniques. The proposed approach consists of 3 phases: (1) MR scanning of a hand with surface makers, (2) 3D reconstruction from the MR images. and (3) registration of the 3D models. The results of registration are used to trace the skin movement with respect to underlying bone motions by measuring the positions of the surface markers.

  • PDF

A Comprehensive Analysis of Deformable Image Registration Methods for CT Imaging

  • Kang Houn Lee;Young Nam Kang
    • Journal of Biomedical Engineering Research
    • /
    • v.44 no.5
    • /
    • pp.303-314
    • /
    • 2023
  • This study aimed to assess the practical feasibility of advanced deformable image registration (DIR) algorithms in radiotherapy by employing two distinct datasets. The first dataset included 14 4D lung CT scans and 31 head and neck CT scans. In the 4D lung CT dataset, we employed the DIR algorithm to register organs at risk and tumors based on respiratory phases. The second dataset comprised pre-, mid-, and post-treatment CT images of the head and neck region, along with organ at risk and tumor delineations. These images underwent registration using the DIR algorithm, and Dice similarity coefficients (DSCs) were compared. In the 4D lung CT dataset, registration accuracy was evaluated for the spinal cord, lung, lung nodules, esophagus, and tumors. The average DSCs for the non-learning-based SyN and NiftyReg algorithms were 0.92±0.07 and 0.88±0.09, respectively. Deep learning methods, namely Voxelmorph, Cyclemorph, and Transmorph, achieved average DSCs of 0.90±0.07, 0.91±0.04, and 0.89±0.05, respectively. For the head and neck CT dataset, the average DSCs for SyN and NiftyReg were 0.82±0.04 and 0.79±0.05, respectively, while Voxelmorph, Cyclemorph, and Transmorph showed average DSCs of 0.80±0.08, 0.78±0.11, and 0.78±0.09, respectively. Additionally, the deep learning DIR algorithms demonstrated faster transformation times compared to other models, including commercial and conventional mathematical algorithms (Voxelmorph: 0.36 sec/images, Cyclemorph: 0.3 sec/images, Transmorph: 5.1 sec/images, SyN: 140 sec/images, NiftyReg: 40.2 sec/images). In conclusion, this study highlights the varying clinical applicability of deep learning-based DIR methods in different anatomical regions. While challenges were encountered in head and neck CT registrations, 4D lung CT registrations exhibited favorable results, indicating the potential for clinical implementation. Further research and development in DIR algorithms tailored to specific anatomical regions are warranted to improve the overall clinical utility of these methods.

Registration and Visualization of Medical Image Using Conditional Entropy and 3D Volume Rendering (조건부 엔트로피와 3차원 볼륨 렌더링기법을 이용한 의료영상의 정합과 가시화)

  • Kim, Sun-Worl;Cho, Wan-Hyun
    • Communications for Statistical Applications and Methods
    • /
    • v.16 no.2
    • /
    • pp.277-286
    • /
    • 2009
  • Image registration is a process to establish the spatial correspondence between images of the same scene, which are acquired at different view points, at different times, or by different sensors. In this paper, we introduce a robust brain registration technique for correcting the difference between two temporal images by the different coordinate systems in MR and CT image obtained from the same patient. Two images are registered where this measure is minimized using a modified conditional entropy(MCE: Modified Conditional Entropy) computed from the joint histograms for the intensities of two given images, we conduct the rendering for visualization of 3D volume image.

2D-3D Vessel Registration for Image-guided Surgery based on distance map (영상유도시술을 위한 거리지도기반 2D-3D 혈관영상 정합)

  • 송수민;최유주;김민정;김명희
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2004.04a
    • /
    • pp.913-915
    • /
    • 2004
  • 시술 중 제공되는 2D영상은 실시간으로 환자와 시술도구의 상태정보를 제공해주지만 환부의 입체적ㆍ해부학적 파악이 어렵다. 따라서 긴 촬영시간으로 시술 전 획득되는 3D영상과 시술 중 얻어지는 2D영상간 정합영상은 영상 유도술에 있어서 유용한 정보를 제공한다. 이를 위해 본 논문에서는 볼륨영상으로부터 혈관모델을 추출하고 이를 평면으로 투영하였다. 두 2D영상에서 정차대상이 되는 혈관골격을 추출한 후 혈관의 분기특성을 고려 한 초기정합을 수행하였다. 크기와 초기 위치를 맞춘 혈관골격을 골격간 거리가 최소가 되도록 반복적으로 혈관을 기하변환시키고 최종 변환된 혈관골격을 시술 중 제공되는 2D영상에 겹쳐 가시화 하였다. 이로써 시술시간 경감과 시술성공률 향상을 유도할 수 있는 시술경로맵을 제시하고자 하였다.

3D Reconstruction of an Indoor Scene Using Depth and Color Images (깊이 및 컬러 영상을 이용한 실내환경의 3D 복원)

  • Kim, Se-Hwan;Woo, Woon-Tack
    • Journal of the HCI Society of Korea
    • /
    • v.1 no.1
    • /
    • pp.53-61
    • /
    • 2006
  • In this paper, we propose a novel method for 3D reconstruction of an indoor scene using a multi-view camera. Until now, numerous disparity estimation algorithms have been developed with their own pros and cons. Thus, we may be given various sorts of depth images. In this paper, we deal with the generation of a 3D surface using several 3D point clouds acquired from a generic multi-view camera. Firstly, a 3D point cloud is estimated based on spatio-temporal property of several 3D point clouds. Secondly, the evaluated 3D point clouds, acquired from two viewpoints, are projected onto the same image plane to find correspondences, and registration is conducted through minimizing errors. Finally, a surface is created by fine-tuning 3D coordinates of point clouds, acquired from several viewpoints. The proposed method reduces the computational complexity by searching for corresponding points in 2D image plane, and is carried out effectively even if the precision of 3D point cloud is relatively low by exploiting the correlation with the neighborhood. Furthermore, it is possible to reconstruct an indoor environment by depth and color images on several position by using the multi-view camera. The reconstructed model can be adopted for interaction with as well as navigation in a virtual environment, and Mediated Reality (MR) applications.

  • PDF

High Accuracy Skeleton Estimation using 3D Volumetric Model based on RGB-D

  • Kim, Kyung-Jin;Park, Byung-Seo;Kang, Ji-Won;Kim, Jin-Kyum;Kim, Woo-Suk;Kim, Dong-Wook;Seo, Young-Ho
    • Journal of Broadcast Engineering
    • /
    • v.25 no.7
    • /
    • pp.1095-1106
    • /
    • 2020
  • In this paper, we propose an algorithm that extracts a high-precision 3D skeleton using a model generated using a distributed RGB-D camera. When information about a 3D model is extracted through a distributed RGB-D camera, if the information of the 3D model is used, a skeleton with higher precision can be obtained. In this paper, in order to improve the precision of the 2D skeleton, we find the conditions to obtain the 2D skeleton well using the PCA. Through this, high-quality 2D skeletons are obtained, and high-precision 3D skeletons are extracted by combining the information of the 2D skeletons. Even though this process goes through, the generated skeleton may have errors, so we propose an algorithm that removes these errors by using the information of the 3D model. We were able to extract very high accuracy skeletons using the proposed method.