• Journal of Information Processing Systems
• /
• 제19권3호
• /
• pp.323-333
• /
• 2023

Facial expression recognition can aid in the development of fatigue driving detection, teaching quality evaluation, and other fields. In this study, a facial expression recognition method was proposed with a residual masking reconstruction network as its backbone to achieve more efficient expression recognition and classification. The residual layer was used to acquire and capture the information features of the input image, and the masking layer was used for the weight coefficients corresponding to different information features to achieve accurate and effective image analysis for images of different sizes. To further improve the performance of expression analysis, the loss function of the model is optimized from two aspects, feature dimension and data dimension, to enhance the accurate mapping relationship between facial features and emotional labels. The simulation results show that the ROC of the proposed method was maintained above 0.9995, which can accurately distinguish different expressions. The precision was 75.98%, indicating excellent performance of the facial expression recognition model.

• 한국컴퓨터그래픽스학회논문지
• /
• 제18권3호
• /
• pp.9-16
• /
• 2012

본 논문은 광학식 동작 포착 장비를 사용해 얼굴과 동작을 동시에 포착할 경우 발생하는 불완전한 표정 데이터의 복원에 관한 연구를 다룬다. 일반적으로 동작 포착과 표정 포착은 필요 해상도에서 차이가 나며, 이로 인해 동작과 표정을 동시에 포착하기 힘들었다. 본 연구에서는 표정과 동작의 동시 포착을 위해, 기존의 작은 마커를 촘촘히 얼굴에 부착하는 표정 포착 방식에서 탈피하여 적은 수의 마커만을 이용하여 표정을 포착하고, 이로부터 세밀한 얼굴 표정을 복원하는 방법을 제안한다. 본 방법의 핵심 아이디어는 얼굴 표정의 움직임을 미리 데이터베이스화하여, 적은 수의 마커로 표현된 얼굴 표정을 복원하는 것이다. 이를 위해 주성분분석을 사용하였으며, 제안된 기술을 실제 동적인 장면에 활용하여 표정의 복원이 잘 됨을 검증하였다.

• Archives of Plastic Surgery
• /
• 제42권4호
• /
• pp.461-468
• /
• 2015

Background Functional restoration of the facial expression is necessary after facial nerve resection to treat head and neck tumors. This study was conducted to evaluate the functional outcomes of patients who underwent facial nerve cable grafting immediately after tumor resection. Methods Patients who underwent cable grafting from April 2007 to August 2011 were reviewed, in which a harvested branch of the sural nerve was grafted onto each facial nerve division. Twelve patients underwent facial nerve cable grafting after radical parotidectomy, total parotidectomy, or schwannoma resection, and the functional facial expression of each patient was evaluated using the Facial Nerve Grading Scale 2.0. The results were analyzed according to patient age, follow-up duration, and the use of postoperative radiation therapy. Results Among the 12 patients who were evaluated, the mean follow-up duration was 21.8 months, the mean age at the time of surgery was 42.8 years, and the mean facial expression score was 14.6 points, indicating moderate dysfunction. Facial expression scores were not influenced by age at the time of surgery, follow-up duration, or the use of postoperative radiation therapy. Conclusions The results of this study indicate that facial nerve cable grafting using the sural nerve can restore facial expression. Although patients were provided with appropriate treatment, the survival rate for salivary gland cancer was poor. We conclude that immediate facial nerve reconstruction is a worthwhile procedure that improves quality of life by allowing the recovery of facial expression, even in patients who are older or may require radiation therapy.

• 한국방송∙미디어공학회:학술대회논문집
• /
• 한국방송∙미디어공학회 2021년도 추계학술대회
• /
• pp.212-214
• /
• 2021

In a society with Covid-19 as part of our daily lives, we had to adapt ourselves to a new reality to maintain our lifestyles as normal as possible. An example of this is teleworking and online classes. However, several issues appeared on the go as we started the new way of living. One of them is the doubt of knowing if real people are in front of the camera or if someone is paying attention during a lecture. Therefore, we encountered this issue by creating a 3D reconstruction tool to identify human faces and expressions actively. We use a web camera, a lightweight 3D face model, and use the 2D facial landmark to fit expression coefficients to drive the 3D model. With this Model, it is possible to represent our faces with an Avatar and fully control its bones with rotation and translation parameters. Therefore, in order to reconstruct facial expressions during online meetings, we proposed the above methods as our solution to solve the main issue.

• 한국전자통신학회논문지
• /
• 제8권8호
• /
• pp.1187-1193
• /
• 2013

본 논문은 사실적인 3D 얼굴 모델링과 얼굴 표정 생성 시스템을 제안한다. 사실적인 3D 얼굴 모델링 기법에서 개별적인 3D 얼굴 모양과 텍스쳐 맵을 만들기 위해 Generic Model Fitting 기법을 적용하였다. Generic Model Fitting에서 Deformation Function을 계산하기 위해 개별적인 얼굴과 Generic Model 사이의 대응점을 결정하였다. 그 후, Calibrated Stereo Camera로부터 캡쳐 된 영상들로부터 특징점을 3D로 복원하였다. 텍스쳐 매핑을 위해 Fitted된 Generic Model을 영상으로 Projection하였고 사전에 정의된 Triangle Mesh에서 텍스쳐를 Generic Model에 매핑 하였다. 잘못된 텍스쳐 매핑을 방지하기 위해, Modified Interpolation Function을 사용한 간단한 방법을 제안하였다. 3D 얼굴 표정을 생성하기 위해 Vector Muscle기반 알고리즘을 사용하고, 보다 사실적인 표정 생성을 위해 Deformation 과 vector muscle 기반의 턱 rotation을 적용하였다.

• 인지과학
• /
• 제11권2호
• /
• pp.53-58
• /
• 2000

본 논문은 FCM 군집화 알고리즘을 사용하여 표정영상에서 특징점들을 추출한 후 추출된 특징점으로부터 Gabor 웨이브렛들을 이용하여 표정영상의 국소영역을 복원한다. 얼굴의 특징점 추출은 두단계로 이루어진다. 1단계는 이차원 Gabor 웨이브렛 계수 히스토그램의 평균값을 적용하여 얼굴의 주요 요소성분들의 경계선을 추출한 후, 2단계에서는 추출된 경계선 정보로부터 FCM 군집화 알고리즘을 사용하여 얼굴의 주요 요소성분들의 최종적인 특징점들을 추출한다. 본 연구에서는 FCM 군집화 알고리즘을 이용하여 추출된 적은 수의 특징점들 만으로도 표정영상의 주요 요소들을 복원할 수 있음을 제시한다. 이것은 인간의 얼굴 표정인식 뿐만아니라 물체인식에도 적용되어질 수 있다.

• 대한두개안면성형외과학회지
• /
• 제25권1호
• /
• pp.1-10
• /
• 2024

The facial nerve stimulates the muscles of facial expression and the parasympathetic nerves of the face. Consequently, facial nerve paralysis can lead to facial asymmetry, deformation, and functional impairment. Facial nerve palsy is most commonly idiopathic, as with Bell palsy, but it can also result from a tumor or trauma. In this article, we discuss traumatic facial nerve injury. To identify the cause of the injury, it is important to first determine its location. The location and extent of the damage inform the treatment method, with options including primary repair, nerve graft, cross-face nerve graft, nerve crossover, and muscle transfer. Intracranial proximal facial nerve injuries present a challenge to surgical approaches due to the complexity of the temporal bone. Surgical intervention in these cases requires a collaborative approach between neurosurgery and otolaryngology, and nerve repair or grafting is difficult. This article describes the treatment of peripheral facial nerve injury. Primary repair generally offers the best prognosis. If primary repair is not feasible within 6 months of injury, nerve grafting should be attempted, and if more than 12 months have elapsed, functional muscle transfer should be performed. If the affected nerve cannot be utilized at that time, the contralateral facial nerve, ipsilateral masseter nerve, or hypoglossal nerve can serve as the donor nerve. Other accompanying symptoms, such as lagophthalmos or midface ptosis, must also be considered for the successful treatment of facial nerve injury.

• Archives of Plastic Surgery
• /
• 제34권3호
• /
• pp.325-329
• /
• 2007

Purpose: Mobius syndrome is a rare congenital disorder characterized by facial diplegia and bilateral abducens palsy, which occasionally combines with other cranial nerve dysfunction. The inability to show happiness, sadness or anger by facial expression frequently results in social dysfunction. The classic concept of cross facial nerve grafting and free muscle transplantation, which is standard in unilateral developmental facial palsy, cannot be used in these patients without special consideration. Our experience in the treatment of three patients with this syndrome using transfer of muscles innervated by trigeminal nerve showed rewarding results. Methods: We used bilateral temporalis muscle elevated from the bony temporal fossa. Muscles and their attached fascia were folded down over the anterior surface of the zygomatic arch. The divided strips from the attached fascia were passed subcutaneously and anchored to the medial canthus and the nasolabial crease for smiling and competence of mouth and eyelids. For the recent 13 years the authors applied this method in 3 Mobius syndrome cases- 45 year-old man and 13 year-old boy, 8 year-old girl. Results: One month after the surgery the patients had good support and already showed voluntary movement at the corner of their mouth. They showed full closure of both eyelids. There was no scleral showing during eyelid closure. Also full closure of the mouth was achieved. After six months, the reconstructed movements of face were maintained. Conclusion: Temporalis muscle transfer for Mobius syndrome is an excellent method for bilateral reconstruction at one stage, is easy to perform, and has a wide range of reconstruction and reproducibility.

• Journal of Multimedia Information System
• /
• 제6권1호
• /
• pp.15-22
• /
• 2019

There are many ways to perform face recognition. The first step of face recognition is the face detection step. If the face is not found in the first step, the face recognition fails. Face detection research has many difficulties because it can be varied according to face size change, left and right rotation and up and down rotation, side face and front face, facial expression, and light condition. In this study, facial features are extracted and the extracted features are geometrically reconstructed in order to improve face recognition rate in extracted face region. Also, it is aimed to adjust face angle using reconstructed facial feature vector, and to improve recognition rate for each face angle. In the recognition attempt using the result after the geometric reconstruction, both the up and down and the left and right facial angles have improved recognition performance.

• Maxillofacial Plastic and Reconstructive Surgery
• /
• 제29권6호
• /
• pp.543-547
• /
• 2007

The lips and corners of the mouth are not only important for appearance but are also essential for facial expression, speech, and nutrition. Defects in these areas can be caused by congenital clefts of the lip and face, trauma, infection, cysts, and excision of benign or malignant tumors. Numerous techniques have been introduced for reconstruction of the lips and corners of the mouth, and in particular, techniques such as the Kazanjian Roopenian I and II, Converse method, Zisser method, Platz and Wepner method. Gillies and Millard method are commonly utilized for elongation and reconstruction of the mouth corner. Few reports exist in the oral and maxillofacial surgery literature regarding correction of microsomia and reconstruction of the corners of the mouth. As such, the authors report a case of the corners of the mouth elongation in a patient with burn-induced microstomia using the Converse flap which yielded a satisfactory outcome.