• Journal of Information Processing Systems
• /
• v.19 no.3
• /
• pp.323-333
• /
• 2023

Facial expression recognition can aid in the development of fatigue driving detection, teaching quality evaluation, and other fields. In this study, a facial expression recognition method was proposed with a residual masking reconstruction network as its backbone to achieve more efficient expression recognition and classification. The residual layer was used to acquire and capture the information features of the input image, and the masking layer was used for the weight coefficients corresponding to different information features to achieve accurate and effective image analysis for images of different sizes. To further improve the performance of expression analysis, the loss function of the model is optimized from two aspects, feature dimension and data dimension, to enhance the accurate mapping relationship between facial features and emotional labels. The simulation results show that the ROC of the proposed method was maintained above 0.9995, which can accurately distinguish different expressions. The precision was 75.98%, indicating excellent performance of the facial expression recognition model.

• Journal of the Korea Computer Graphics Society
• /
• v.18 no.3
• /
• pp.9-16
• /
• 2012

In this paper, we present a new method for reconstructing detailed facial expression from roughly captured data with a small number of markers. Because of the difference in the required capture resolution between the full-body capture and the facial expression capture, they hardly have been performed simultaneously. However, for generating natural animation, a simultaneous capture for body and face is essential. For this purpose, we provide a method for capturing the detailed facial expression only with a small number of markers. Our basic idea is to build a database for the facial expressions and apply the principal component analysis for reducing the dimensionality. The dimensionality reduction enables us to estimate the full data from a part of the data. We justify our method by applying it to dynamic scenes to show the viability of the method.

• Archives of Plastic Surgery
• /
• v.42 no.4
• /
• pp.461-468
• /
• 2015

Background Functional restoration of the facial expression is necessary after facial nerve resection to treat head and neck tumors. This study was conducted to evaluate the functional outcomes of patients who underwent facial nerve cable grafting immediately after tumor resection. Methods Patients who underwent cable grafting from April 2007 to August 2011 were reviewed, in which a harvested branch of the sural nerve was grafted onto each facial nerve division. Twelve patients underwent facial nerve cable grafting after radical parotidectomy, total parotidectomy, or schwannoma resection, and the functional facial expression of each patient was evaluated using the Facial Nerve Grading Scale 2.0. The results were analyzed according to patient age, follow-up duration, and the use of postoperative radiation therapy. Results Among the 12 patients who were evaluated, the mean follow-up duration was 21.8 months, the mean age at the time of surgery was 42.8 years, and the mean facial expression score was 14.6 points, indicating moderate dysfunction. Facial expression scores were not influenced by age at the time of surgery, follow-up duration, or the use of postoperative radiation therapy. Conclusions The results of this study indicate that facial nerve cable grafting using the sural nerve can restore facial expression. Although patients were provided with appropriate treatment, the survival rate for salivary gland cancer was poor. We conclude that immediate facial nerve reconstruction is a worthwhile procedure that improves quality of life by allowing the recovery of facial expression, even in patients who are older or may require radiation therapy.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• fall
• /
• pp.212-214
• /
• 2021

In a society with Covid-19 as part of our daily lives, we had to adapt ourselves to a new reality to maintain our lifestyles as normal as possible. An example of this is teleworking and online classes. However, several issues appeared on the go as we started the new way of living. One of them is the doubt of knowing if real people are in front of the camera or if someone is paying attention during a lecture. Therefore, we encountered this issue by creating a 3D reconstruction tool to identify human faces and expressions actively. We use a web camera, a lightweight 3D face model, and use the 2D facial landmark to fit expression coefficients to drive the 3D model. With this Model, it is possible to represent our faces with an Avatar and fully control its bones with rotation and translation parameters. Therefore, in order to reconstruct facial expressions during online meetings, we proposed the above methods as our solution to solve the main issue.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.8 no.8
• /
• pp.1187-1193
• /
• 2013

In this paper, we present realistic 3D head modeling and facial expression systems. For 3D head modeling, we perform generic model fitting to make individual head shape and texture mapping. To calculate the deformation function in the generic model fitting, we determine correspondence between individual heads and the generic model. Then, we reconstruct the feature points to 3D with simultaneously captured images from calibrated stereo camera. For texture mapping, we project the fitted generic model to image and map the texture in the predefined triangle mesh to generic model. To prevent extracting the wrong texture, we propose a simple method using a modified interpolation function. For generating 3D facial expression, we use the vector muscle based algorithm. For more realistic facial expression, we add the deformation of the skin according to the jaw rotation to basic vector muscle model and apply mass spring model. Finally, several 3D facial expression results are shown at the end of the paper.

• Korean Journal of Cognitive Science
• /
• v.11 no.2
• /
• pp.53-58
• /
• 2000

This paper reconstructs local region of a facial expression image from extracted feature points of facial expression image using FCM(Fuzzy C-Meang) clustering algorithm with Gabor wavelets. The feature extraction in a face is two steps. In the first step, we accomplish the edge extraction of main components of face using average value of 2-D Gabor wavelets coefficient histogram of image and in the next step, extract final feature points from the extracted edge information using FCM clustering algorithm. This study presents that the principal components of facial expression images can be reconstructed with only a few feature points extracted from FCM clustering algorithm. It can also be applied to objects recognition as well as facial expressions recognition.

• Archives of Craniofacial Surgery
• /
• v.25 no.1
• /
• pp.1-10
• /
• 2024

The facial nerve stimulates the muscles of facial expression and the parasympathetic nerves of the face. Consequently, facial nerve paralysis can lead to facial asymmetry, deformation, and functional impairment. Facial nerve palsy is most commonly idiopathic, as with Bell palsy, but it can also result from a tumor or trauma. In this article, we discuss traumatic facial nerve injury. To identify the cause of the injury, it is important to first determine its location. The location and extent of the damage inform the treatment method, with options including primary repair, nerve graft, cross-face nerve graft, nerve crossover, and muscle transfer. Intracranial proximal facial nerve injuries present a challenge to surgical approaches due to the complexity of the temporal bone. Surgical intervention in these cases requires a collaborative approach between neurosurgery and otolaryngology, and nerve repair or grafting is difficult. This article describes the treatment of peripheral facial nerve injury. Primary repair generally offers the best prognosis. If primary repair is not feasible within 6 months of injury, nerve grafting should be attempted, and if more than 12 months have elapsed, functional muscle transfer should be performed. If the affected nerve cannot be utilized at that time, the contralateral facial nerve, ipsilateral masseter nerve, or hypoglossal nerve can serve as the donor nerve. Other accompanying symptoms, such as lagophthalmos or midface ptosis, must also be considered for the successful treatment of facial nerve injury.

• Archives of Plastic Surgery
• /
• v.34 no.3
• /
• pp.325-329
• /
• 2007

Purpose: Mobius syndrome is a rare congenital disorder characterized by facial diplegia and bilateral abducens palsy, which occasionally combines with other cranial nerve dysfunction. The inability to show happiness, sadness or anger by facial expression frequently results in social dysfunction. The classic concept of cross facial nerve grafting and free muscle transplantation, which is standard in unilateral developmental facial palsy, cannot be used in these patients without special consideration. Our experience in the treatment of three patients with this syndrome using transfer of muscles innervated by trigeminal nerve showed rewarding results. Methods: We used bilateral temporalis muscle elevated from the bony temporal fossa. Muscles and their attached fascia were folded down over the anterior surface of the zygomatic arch. The divided strips from the attached fascia were passed subcutaneously and anchored to the medial canthus and the nasolabial crease for smiling and competence of mouth and eyelids. For the recent 13 years the authors applied this method in 3 Mobius syndrome cases- 45 year-old man and 13 year-old boy, 8 year-old girl. Results: One month after the surgery the patients had good support and already showed voluntary movement at the corner of their mouth. They showed full closure of both eyelids. There was no scleral showing during eyelid closure. Also full closure of the mouth was achieved. After six months, the reconstructed movements of face were maintained. Conclusion: Temporalis muscle transfer for Mobius syndrome is an excellent method for bilateral reconstruction at one stage, is easy to perform, and has a wide range of reconstruction and reproducibility.

• Journal of Multimedia Information System
• /
• v.6 no.1
• /
• pp.15-22
• /
• 2019

There are many ways to perform face recognition. The first step of face recognition is the face detection step. If the face is not found in the first step, the face recognition fails. Face detection research has many difficulties because it can be varied according to face size change, left and right rotation and up and down rotation, side face and front face, facial expression, and light condition. In this study, facial features are extracted and the extracted features are geometrically reconstructed in order to improve face recognition rate in extracted face region. Also, it is aimed to adjust face angle using reconstructed facial feature vector, and to improve recognition rate for each face angle. In the recognition attempt using the result after the geometric reconstruction, both the up and down and the left and right facial angles have improved recognition performance.

• Maxillofacial Plastic and Reconstructive Surgery
• /
• v.29 no.6
• /
• pp.543-547
• /
• 2007

The lips and corners of the mouth are not only important for appearance but are also essential for facial expression, speech, and nutrition. Defects in these areas can be caused by congenital clefts of the lip and face, trauma, infection, cysts, and excision of benign or malignant tumors. Numerous techniques have been introduced for reconstruction of the lips and corners of the mouth, and in particular, techniques such as the Kazanjian Roopenian I and II, Converse method, Zisser method, Platz and Wepner method. Gillies and Millard method are commonly utilized for elongation and reconstruction of the mouth corner. Few reports exist in the oral and maxillofacial surgery literature regarding correction of microsomia and reconstruction of the corners of the mouth. As such, the authors report a case of the corners of the mouth elongation in a patient with burn-induced microstomia using the Converse flap which yielded a satisfactory outcome.