• Title/Summary/Keyword: Facial Landmarks

Search Result 118, Processing Time 0.027 seconds

Soft tissue evaluation using 3-dimensional face image after maxillary protraction therapy (3차원 얼굴 영상을 이용한 상악 전방견인 치료 후의 연조직 평가)

  • Choi, Dong-Soon;Lee, Kyoung-Hoon;Jang, Insan;Cha, Bong-Kuen
    • The Journal of the Korean dental association
    • /
    • v.54 no.3
    • /
    • pp.217-229
    • /
    • 2016
  • Purpose: The aim of this study was to evaluate the soft-tissue change after the maxillary protraction therapy using threedimensional (3D) facial images. Materials and Methods: This study used pretreatment (T1) and posttreatment (T2) 3D facial images from thirteen Class III malocclusion patients (6 boys and 7 girls; mean age, $8.9{\pm}2.2years$) who received maxillary protraction therapy. The facial images were taken using the optical scanner (Rexcan III 3D scanner), and T1 and T2 images were superimposed using forehead area as a reference. The soft-tissue changes after the treatment (T2-T1) were three-dimensionally calculated using 15 soft-tissue landmarks and 3 reference planes. Results: Anterior movements of the soft-tissue were observed on the pronasale, subnasale, nasal ala, soft-tissue zygoma, and upper lip area. Posterior movements were observed on the lower lip, soft-tissue B-point, and soft-tissue gnathion area. Vertically, most soft-tissue landmarks moved downward at T2. In transverse direction, bilateral landmarks, i.e. exocanthion, zygomatic point, nasal ala, and cheilion moved more laterally at T2. Conclusion: Facial soft-tissue of Class III malocclusion patients was changed three-dimensionally after maxillary protraction therapy. Especially, the facial profile was improved by forward movement of midface and downward and backward movement of lower face.

  • PDF

Landmark Selection Using CNN-Based Heat Map for Facial Age Prediction (안면 연령 예측을 위한 CNN기반의 히트 맵을 이용한 랜드마크 선정)

  • Hong, Seok-Mi;Yoo, Hyun
    • Journal of Convergence for Information Technology
    • /
    • v.11 no.7
    • /
    • pp.1-6
    • /
    • 2021
  • The purpose of this study is to improve the performance of the artificial neural network system for facial image analysis through the image landmark selection technique. For landmark selection, a CNN-based multi-layer ResNet model for classification of facial image age is required. From the configured ResNet model, a heat map that detects the change of the output node according to the change of the input node is extracted. By combining a plurality of extracted heat maps, facial landmarks related to age classification prediction are created. The importance of each pixel location can be analyzed through facial landmarks. In addition, by removing the pixels with low weights, a significant amount of input data can be reduced.

Improvement of Facial Emotion Recognition Performance through Addition of Geometric Features (기하학적 특징 추가를 통한 얼굴 감정 인식 성능 개선)

  • Hoyoung Jung;Hee-Il Hahn
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.24 no.1
    • /
    • pp.155-161
    • /
    • 2024
  • In this paper, we propose a new model by adding landmark information as a feature vector to the existing CNN-based facial emotion classification model. Facial emotion classification research using CNN-based models is being studied in various ways, but the recognition rate is very low. In order to improve the CNN-based models, we propose algorithms that improves facial expression classification accuracy by combining the CNN model with a landmark-based fully connected network obtained by ASM. By including landmarks in the CNN model, the recognition rate was improved by several percent, and experiments confirmed that further improved results could be obtained by adding FACS-based action units to the landmarks.

Optimal Facial Emotion Feature Analysis Method based on ASM-LK Optical Flow (ASM-LK Optical Flow 기반 최적 얼굴정서 특징분석 기법)

  • Ko, Kwang-Eun;Park, Seung-Min;Park, Jun-Heong;Sim, Kwee-Bo
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.21 no.4
    • /
    • pp.512-517
    • /
    • 2011
  • In this paper, we propose an Active Shape Model (ASM) and Lucas-Kanade (LK) optical flow-based feature extraction and analysis method for analyzing the emotional features from facial images. Considering the facial emotion feature regions are described by Facial Action Coding System, we construct the feature-related shape models based on the combination of landmarks and extract the LK optical flow vectors at each landmarks based on the centre pixels of motion vector window. The facial emotion features are modelled by the combination of the optical flow vectors and the emotional states of facial image can be estimated by the probabilistic estimation technique, such as Bayesian classifier. Also, we extract the optimal emotional features that are considered the high correlation between feature points and emotional states by using common spatial pattern (CSP) analysis in order to improvise the operational efficiency and accuracy of emotional feature extraction process.

Benefits of lateral cephalogram during landmark identification on posteroanterior cephalograms

  • Hwang, Sel-Ae;Lee, Jae-Seo;Hwang, Hyeon-Shik;Lee, Kyung-Min
    • The korean journal of orthodontics
    • /
    • v.49 no.1
    • /
    • pp.32-40
    • /
    • 2019
  • Objective: Precise identification of landmarks on posteroanterior (PA) cephalograms is necessary when evaluating lateral problems such as facial asymmetry. The aim of the present study was to investigate whether the use of lateral (LA) cephalograms can reduce errors in landmark identification on PA cephalograms. Methods: Five examiners identified 16 landmarks (Cg, N, ANS, GT, Me, RO, Lo, FM, Z, Or, Zyg, Cd, NC, Ms, M, and Ag) on 32 PA cephalograms with and without LA cephalograms at the same time. The positions of the landmarks were recorded and saved in the horizontal and vertical direction. The mean errors and standard deviation of landmarks location according to the use of LA cephalograms were compared for each landmark. Results: Relatively small errors were found for ANS, Me, Ms, and Ag, while relatively large errors were found for N, GT, Z, Or, and Cd. No significant difference was found between the horizontal and vertical errors for Z and Or, while large vertical errors were found for N, GT, and Cd. The value of identification error was lower when the landmarks were identified using LA cephalograms. Statistically significant error reductions were found at N and Cd with LA cephalograms, especially in the vertical direction. Conclusions: The use of LA cephalograms during identification of landmarks on PA cephalograms could help reduce identification errors.

A Study on Appearance-Based Facial Expression Recognition Using Active Shape Model (Active Shape Model을 이용한 외형기반 얼굴표정인식에 관한 연구)

  • Kim, Dong-Ju;Shin, Jeong-Hoon
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.5 no.1
    • /
    • pp.43-50
    • /
    • 2016
  • This paper introduces an appearance-based facial expression recognition method using ASM landmarks which is used to acquire a detailed face region. In particular, EHMM-based algorithm and SVM classifier with histogram feature are employed to appearance-based facial expression recognition, and performance evaluation of proposed method was performed with CK and JAFFE facial expression database. In addition, performance comparison was achieved through comparison with distance-based face normalization method and a geometric feature-based facial expression approach which employed geometrical features of ASM landmarks and SVM algorithm. As a result, the proposed method using ASM-based face normalization showed performance improvements of 6.39% and 7.98% compared to previous distance-based face normalization method for CK database and JAFFE database, respectively. Also, the proposed method showed higher performance compared to geometric feature-based facial expression approach, and we confirmed an effectiveness of proposed method.

Improvement of Active Shape Model for Detecting Face Features in iOS Platform (iOS 플랫폼에서 Active Shape Model 개선을 통한 얼굴 특징 검출)

  • Lee, Yong-Hwan;Kim, Heung-Jun
    • Journal of the Semiconductor & Display Technology
    • /
    • v.15 no.2
    • /
    • pp.61-65
    • /
    • 2016
  • Facial feature detection is a fundamental function in the field of computer vision such as security, bio-metrics, 3D modeling, and face recognition. There are many algorithms for the function, active shape model is one of the most popular local texture models. This paper addresses issues related to face detection, and implements an efficient extraction algorithm for extracting the facial feature points to use on iOS platform. In this paper, we extend the original ASM algorithm to improve its performance by four modifications. First, to detect a face and to initialize the shape model, we apply a face detection API provided from iOS CoreImage framework. Second, we construct a weighted local structure model for landmarks to utilize the edge points of the face contour. Third, we build a modified model definition and fitting more landmarks than the classical ASM. And last, we extend and build two-dimensional profile model for detecting faces within input images. The proposed algorithm is evaluated on experimental test set containing over 500 face images, and found to successfully extract facial feature points, clearly outperforming the original ASM.

The relationship of maxillary canines to the facial anatomical landmarks in a group of Thai people

  • Sinavarat, Potchaman;Anunmana, Chuchai;Hossain, Sharafat
    • The Journal of Advanced Prosthodontics
    • /
    • v.5 no.4
    • /
    • pp.369-373
    • /
    • 2013
  • PURPOSE. The objective was to evaluate canine positions, intercanine tip width (ICTW) and width of distal surface of canine (WDC), related to facial landmarks including interalar width (IAW), intercommissural width (ICoW), and distance between left and right projection lines drawn from inner canthus of eyes to alae of the nose (DPICa) in a group of Thai. MATERIALS AND METHODS. One hundred Thai subjects aged 18-35 years were selected. IAW and ICoW were measured on subject's face using digital vernier caliper. Irreversible hydrocolloid impression of the upper arch was taken, and a cast was poured with dental stone. Silicone impression material was used to take imprint of the incisal edge of upper six anterior teeth. DPICa was obtained from the subject's face using custom-made measuring equipment and marked on the silicone incisal imprint. The marks were then transferred from the imprint to the stone cast and measured with digital caliper. The ICTW and WDC were also measured on the stone cast. Pearson's correlation was used to determine the correlation. RESULTS. The results revealed that the correlation between ICTW-ICoW was 0.429 and ICTW-DPICa was 0.573. The correlation between WDC-ICoW was 0.426 and WDC-DPICa was 0.547. However, IAW did not show any correlation with ICTW or WDC (P>.05). CONCLUSION. The correlation between canine position and facial landmarks was found. ICTW and WDC had relationship with ICoW and DPICa. DPICa showed stronger correlation with the position of maxillary canine than that of ICoW.

Lip and perioral soft tissue changes after bracket bonding using 3-D laser scanner (브라켓의 접착 전후 입술 주위 연조직의 3차원적 변화)

  • Lee, Won-Je;Lee, Kee-Joon;Yu, Hyung-Seog;Baik, Hyoung-Seon
    • The korean journal of orthodontics
    • /
    • v.41 no.6
    • /
    • pp.411-422
    • /
    • 2011
  • Objective: The aim of this study was to evaluate the lip and perioral soft tissue changes after bracket bonding. Methods: The soft tissue changes in 45 adult patients (age greater than 18 years and less than 29 years) without severe skeletal discrepancy were evaluated using three-dimensional images acquired with a laser scanner before and after bracket bonding was performed using 4 types of labial orthodontic brackets. Results: Among the statistically significant changes in distance observed for the landmarks, the biggest change was observed in forward movement. The landmarks on the lateral sides also showed significant changes. While the landmarks on the upper lip showed significant upward movement, those on the lower lip showed significant downward movement. However, the changes were smaller for the landmarks on the upper lip (average, 0.87 mm) than for the landmarks on the lower lip (average, 1.21 mm). The type of bracket used did not significantly affect the soft tissue changes. Conclusions: These findings will help predict soft tissue changes after bracket bonding for orthodontic treatment.

Facial Nerve Decompression via Middle Fossa Approach : Report of Three Cases (말초성 안면마비에서 중두개와 접근법에 의한 안면신경 감압술 : 3례 보고)

  • Cho, Joon;Park, Sung-Ho;Kim, Jae-Young
    • Journal of Korean Neurosurgical Society
    • /
    • v.30 no.4
    • /
    • pp.479-485
    • /
    • 2001
  • Objective : Several conservative treatments have been tried in peripheral facial nerve paralysis, because 80% of patients recover spontaneously. Surgical decompression may be helpful to the residual, medically intractable patients. We present here our experiences of facial nerve decompression via middle fossa approach, which seems to be one of good surgical therapeutic options for medically refractory peripheral facial nerve paralysis. Method : Three cases of medically intractable peripheral type facial paralysis were microscopically operated via middle cranial fossa approach to decompress the labyrinthine segment of the facial nerve and geniculate ganglion by searching landmarks of middle meningeal artery, greater superficial petrosal nerve and facial hiatus. Results : After operation, two cases of Bell's palsy improved substantially and one case of post-traumatic facial paralysis improved partially. Conclusion : This report is presented to describe the surgical facial nerve decompression via middle fossa for early control of peripheral type facial paralysis. Surgical decompression of edematous peripherally paralysed facial nerve could be preferred to conservative treatment in some patients although more surgical experience should be required.

  • PDF