• 제목/요약/키워드: 3D facial reconstruction

검색결과 38건 처리시간 0.021초

얼굴 특징점 자동 추출 오류에 강인한 3차원 얼굴 복원 방법 (A 3D Face Reconstruction Method Robust to Errors of Automatic Facial Feature Point Extraction)

  • 이연주;이성주;박강령;김재희
    • 대한전자공학회논문지SP
    • /
    • 제48권1호
    • /
    • pp.122-131
    • /
    • 2011
  • 최근에 널리 사용되고 있는 단일 영상 기반의 3차원 얼굴 복원 방법인 변형 가능한 3차원 얼굴 형상 모델(3D morphable shape model)은 입력 영상으로부터 2차원 얼굴 특징점들을 정확하게 추출할 경우, 입력 얼굴과 유사한 3차원 얼굴 형상을 생성할 수 있다. 그러나 실시간 3차원 얼굴 복원 시스템과 같이 사용자의 협조가 불가능한 경우에는 자동으로 얼굴 특징점들을 추출해야 하기 때문에, 특징점 추출 오류가 발생하여 정확한 3차원 얼굴 형상을 생성하기 어려운 문제가 있다. 이러한 문제를 해결하기 위해서, 본 논문에서는 특징점 추출 시 오추출 특징점과 정추출 특징점을 자동으로 분류하고, 정추출 특징점들만을 이용하여 3차원 얼굴을 복원하는 방법을 제안하였다. 실험결과에서는 특징점 자동 추출 오류를 고려하지 않은 기존 방법과 비교한 결과, 제안방법의 3차원 얼굴 복원 성능이 크게 향상되었음을 확인하였다.

Reconstructing 3-D Facial Shape Based on SR Imagine

  • Hong, Yu-Jin;Kim, Jaewon;Kim, Ig-Jae
    • Journal of International Society for Simulation Surgery
    • /
    • 제1권2호
    • /
    • pp.57-61
    • /
    • 2014
  • We present a robust 3D facial reconstruction method using a single image generated by face-specific super resolution technique. Based on the several consecutive frames with low resolution, we generate a single high resolution image and a three dimensional facial model based on it. To do this, we apply PME method to compute patch similarities for SR after two-phase warping according to facial attributes. Based on the SRI, we extract facial features automatically and reconstruct 3D facial model with basis which selected adaptively according to facial statistical data less than a few seconds. Thereby, we can provide the facial image of various points of view which cannot be given by a single point of view of a camera.

Rapid Implementation of 3D Facial Reconstruction from a Single Image on an Android Mobile Device

  • Truong, Phuc Huu;Park, Chang-Woo;Lee, Minsik;Choi, Sang-Il;Ji, Sang-Hoon;Jeong, Gu-Min
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제8권5호
    • /
    • pp.1690-1710
    • /
    • 2014
  • In this paper, we propose the rapid implementation of a 3-dimensional (3D) facial reconstruction from a single frontal face image and introduce a design for its application on a mobile device. The proposed system can effectively reconstruct human faces in 3D using an approach robust to lighting conditions, and a fast method based on a Canonical Correlation Analysis (CCA) algorithm to estimate the depth. The reconstruction system is built by first creating 3D facial mapping from a personal identity vector of a face image. This mapping is then applied to real-world images captured with a built-in camera on a mobile device to form the corresponding 3D depth information. Finally, the facial texture from the face image is extracted and added to the reconstruction results. Experiments with an Android phone show that the implementation of this system as an Android application performs well. The advantage of the proposed method is an easy 3D reconstruction of almost all facial images captured in the real world with a fast computation. This has been clearly demonstrated in the Android application, which requires only a short time to reconstruct the 3D depth map.

측면 2차원 얼굴 영상들의 대칭성을 이용한 3차원 얼굴 복원 (A 3D Face Reconstruction Based on the Symmetrical Characteristics of Side View 2D Face Images)

  • 이성주;박강령;김재희
    • 대한전자공학회논문지SP
    • /
    • 제48권1호
    • /
    • pp.103-110
    • /
    • 2011
  • 기존에 널려 쓰이는 3차원 얼굴 복원 방식인 Structure from motion(SfM)은 정면 및 좌우 측면 영상들이 입력할 때, 좌우 얼굴 특정 점들이 검출되어 우수한 성능을 보인다. 그러나 감시 카메라 환경과 같이 한 쪽 측면 얼굴 영상들이 입력될 경우, 보이는 한 쪽 얼굴 특정 점들만이 입력되므로, 가려진 부분의 얼굴이 제대로 복원되지 않는 문제가 있다. 이러한 문제를 해결하기 위해, 본 논문은 사람의 얼굴이 좌우 대칭이라는 제한 조건을 이용하여 대칭이 되는 얼굴 특정 정들을 생성하였으며, 이렇게 생성된 얼굴 특정 점들과 입력된 얼굴 특정 점들을 결합하여 사용함으로써 기존 SfM 기반 3차원 얼굴 복원 방식의 성능을 향상시켰다. 제안한 3차원 얼굴 복원 방법을 정량적으로 평가하기 위해 3차원 스캐너를 이용해 3차원 얼굴을 취득하였고, 이를 복원한 3차원 얼굴과 비교한 결과 좌우 대칭 특정 점들을 함께 사용하는 제안한 3차원 복원 방식은 한 쪽 측면 특정 점들만을 사용하는 기존 방식에 비해 우수한 성능을 보였다.

Use of 3D Printing Model for the Management of Fibrous Dysplasia: Preliminary Case Study

  • Choi, Jong-Woo;Jeong, Woo Shik
    • Journal of International Society for Simulation Surgery
    • /
    • 제3권1호
    • /
    • pp.36-38
    • /
    • 2016
  • Fibrous dysplasia is a relatively rare disease but the management would be quite challenging. Because this is not a malignant tumor, the preservation of the facial contour and the various functions seems to be important in treatment planning. Until now the facial bone reconstruction with autogenous bone would be the standard. Although the autogenous bone would be the ideal one for facial bone reconstruction, donor site morbidity would be the inevitable problem in many cases. Meanwhile, various types of allogenic and alloplastic materials have been also used. However, facial bone reconstruction with many alloplastic material have produced no less complications including infection, exposure, and delayed wound healing. Because the 3D printing technique evolved so fast that 3D printed titanium implant were possible recently. The aim of this trial is to try to restore the original maxillary anatomy as possible using the 3D printing model, based on the mirrored three dimensional CT images based on the computer simulation. Preoperative computed tomography (CT) data were processed for the patient and a rapid prototyping (RP) model was produced. At the same time, the uninjured side was mirrored and superimposed onto the traumatized side, to create a mirror-image of the RP model. And we molded Titanium mesh to reconstruct three-dimensional maxillary structure during the operation. This prefabricated Titanium-mesh implant was then inserted onto the defected maxilla and fixed. Three dimensional printing technique of titanium material based on the computer simulation turned out to be successful in this patient. Individualized approach for each patient could be an ideal way to restore the facial bone.

반얼굴 연축 환자에서 삼차원 중첩 자기공명 혈관 조영술 기법의 유용성-초기 보고 (The Usefulness of the 3-D Overlapped Reconstruction MR Angiographic Technique in Patients with Hemifacial Spasm - A Preliminary Study)

  • 이윤미;박선원;편해욱;윤명관;김은영;서창해;임명관
    • Investigative Magnetic Resonance Imaging
    • /
    • 제11권1호
    • /
    • pp.33-38
    • /
    • 2007
  • 목적: 반얼굴 연축 환자에서 새로운 삼차원 중첩 자기공명 혈관 조영술 기법(3-D overlapped reconstruction MR angiographic technique, 3-D ORMRA) 을 기존의 MRA 원천영상과 비교하여 그 유용성을 알아보고자 하였다. 대상 및 방법: 수술로 반얼굴 연축이 증명된 총 27명을 대상으로 하였다. 모든 환자에서 전향적으로 기존의 MRA 원천영상과 3-D fast imaging employing steady state acquisition (FIESTA) 영상을 얻었다. 이 후 작업대 (workstation)에서 3-D MRA 영상을 만들고 GE A/W 4.2 add/sub software를 이용하여 이를 FIESTA영상과 겹쳐 3-D ORMRA영상을 얻었다. 그리고 나서 기존의 MRA 원천영상과 3-D ORMRA영상에서 각 각 얼굴신경의 신경근출구부와 병적 압박혈관 사이의 관계를 분석하였다. 결과: 기존의 MRA원천영상에서는 27명중 25명의 환자에서 얼굴 신경근출구부에서의 병적 압박혈관을 구별 할 수 있었고, 3-D ORMRA영상에서는 모든 환자에서 병적 압박혈관을 구별 할 수 있었으며, 이는 수술소견과 일치하였다. 무엇보다 3-D ORMRA영상에서 얼굴 신경근출구부와 병적 압박혈관 사이의 공간적인 관계를 좀 더 분명하게 볼 수 있었다. 결론: 3-D ORMRA 기법은 기존의 MRA 영상기법과 비교하여, 반얼굴 연축 환자에서 매우 유용하고 더 정확한 정보를 주는 방법이다.

  • PDF

3D CT Image Processing for 3D Printed Auricular Reconstruction of Unilateral Microtia Patient

  • Roh, Tae Suk;Yun, In Sik
    • Journal of International Society for Simulation Surgery
    • /
    • 제1권2호
    • /
    • pp.80-82
    • /
    • 2014
  • Purpose Microtia is congenital anomaly of external ear and the reconstruction method for the external ear of microtia patient was based on autogenous costal cartilage framework. The application of 3D printing technique in medical science has made more possibility of human tissue restoration, and we tried to apply this technique in auricular reconstruction field. Materials and Methods As for unilateral microtia patient, the contralateral side ear is normal and reconstructive surgeon tried to mimic it for reconstruction of affected ear. So, we obtained facial CT scan of microtia patient and made mirror image of normal side ear. Moreover, to make the 3D scaffold based on the mirror image of normal ear and to apply this scaffold for the auricular reconstruction surgery, we included auriculocephalic sulcus and anterior fixation part. Results We could successfully obtain mirror image of normal ear, auriculocephalic sulcus and anterior fixation part for 3D scaffold printing. Conclusions Using this CT image processing and 3D printing technique, we will be able to make the scaffold for auricular reconstruction of unilateral microtia patient, and perform auricular reconstruction in near future.

CBCT를 이용한 3차원 안면비대칭분석 (3D Analysis of Facial Asymmetry using CBCT)

  • 윤숙자
    • 대한치과의사협회지
    • /
    • 제48권10호
    • /
    • pp.724-728
    • /
    • 2010
  • Accurate analysis of facial asymmetry prior to any orthognathic or orthodontic treatment plan is essential in ensuring good treatment result. Dental CBCT (Cone-beam Computed Tomography) provides as actual three-dimensional measurements of distance and angle without any radiographic magnification as medical CT provides, while its field of view is limited to the oral and maxillofacial area. CBCT is a useful tool for the diagnosis of facial asymmetry. The coordinates of facial landmarks are obtained from the 3D reconstruction software which enables the establishment of perpendicular planes and the identification of the landmarks. Then, the bilateral discrepancies of the landmarks are obtained as spherical polar coordinates which can show the amount of asymmetry and its direction. A method of 3D analysis of facial asymmetry using CBCT is introduced in this report.

Three-dimensional bio-printing and bone tissue engineering: technical innovations and potential applications in maxillofacial reconstructive surgery

  • Salah, Muhja;Tayebi, Lobat;Moharamzadeh, Keyvan;Naini, Farhad B.
    • Maxillofacial Plastic and Reconstructive Surgery
    • /
    • 제42권
    • /
    • pp.18.1-18.9
    • /
    • 2020
  • Background: Bone grafting has been considered the gold standard for hard tissue reconstructive surgery and is widely used for large mandibular defect reconstruction. However, the midface encompasses delicate structures that are surrounded by a complex bone architecture, which makes bone grafting using traditional methods very challenging. Three-dimensional (3D) bioprinting is a developing technology that is derived from the evolution of additive manufacturing. It enables precise development of a scaffold from different available biomaterials that mimic the shape, size, and dimension of a defect without relying only on the surgeon's skills and capabilities, and subsequently, may enhance surgical outcomes and, in turn, patient satisfaction and quality of life. Review: This review summarizes different biomaterial classes that can be used in 3D bioprinters as bioinks to fabricate bone scaffolds, including polymers, bioceramics, and composites. It also describes the advantages and limitations of the three currently used 3D bioprinting technologies: inkjet bioprinting, micro-extrusion, and laserassisted bioprinting. Conclusions: Although 3D bioprinting technology is still in its infancy and requires further development and optimization both in biomaterials and techniques, it offers great promise and potential for facial reconstruction with improved outcome.

Realtime Facial Expression Representation Method For Virtual Online Meetings System

  • Zhu, Yinge;Yerkovich, Bruno Carvacho;Zhang, Xingjie;Park, Jong-il
    • 한국방송∙미디어공학회:학술대회논문집
    • /
    • 한국방송∙미디어공학회 2021년도 추계학술대회
    • /
    • pp.212-214
    • /
    • 2021
  • In a society with Covid-19 as part of our daily lives, we had to adapt ourselves to a new reality to maintain our lifestyles as normal as possible. An example of this is teleworking and online classes. However, several issues appeared on the go as we started the new way of living. One of them is the doubt of knowing if real people are in front of the camera or if someone is paying attention during a lecture. Therefore, we encountered this issue by creating a 3D reconstruction tool to identify human faces and expressions actively. We use a web camera, a lightweight 3D face model, and use the 2D facial landmark to fit expression coefficients to drive the 3D model. With this Model, it is possible to represent our faces with an Avatar and fully control its bones with rotation and translation parameters. Therefore, in order to reconstruct facial expressions during online meetings, we proposed the above methods as our solution to solve the main issue.

  • PDF