• Journal of Korea Multimedia Society
• /
• v.25 no.11
• /
• pp.1582-1590
• /
• 2022

Due to the situation of the widespread of the coronavirus, which causes the problem of lack of face image data occluded by masks at recent time, in order to solve the related problems, this paper proposes a method to generate face images with masks using a combination of generative adversarial networks and spatial transformation networks based on CNN model. The system we proposed in this paper is based on the GAN, combined with multi-scale convolution kernels to extract features at different details of the human face images, and used Wasserstein divergence as the measure of the distance between real samples and synthetic samples in order to optimize Generator performance. Experiments show that the proposed method can effectively put masks on face images with high efficiency and fast reaction time and the synthesized human face images are pretty natural and real.

• Journal of KIISE:Software and Applications
• /
• v.34 no.5
• /
• pp.476-486
• /
• 2007

This paper proposes a resolution enhancement method which can reconstruct high-resolution facial images from single-frame, low-resolution facial images. The proposed method is derived from example-based reconstruction methods and the morphable face model. In order to improve the performance of the example-based reconstruction, we propose the region-based reconstruction method which can maintain the characteristics of local facial regions. Also, in order to use the capability of the morphable face model to face resolution enhancement problems, we define the extended morphable face model in which an extended face is composed of a low-resolution face, its interpolated high-resolution face, and the high-resolution equivalent, and then an extended face is separated by an extended shape vector and an extended texture vector. The encouraging results show that the proposed methods can be used to improve the performance of face recognition systems, particularly to enhance the resolution of facial images captured from visual surveillance systems.

• International Journal of Internet, Broadcasting and Communication
• /
• v.15 no.2
• /
• pp.31-38
• /
• 2023

This paper introduces a real-time face swapping system that enables video influencers to swap their faces with arbitrary generated face images of their choice. The system is implemented as a Django-based server that uses a REST request to communicate with the generative model,specifically the pretrained stable diffusion model. Once generated, the generated image is displayed on the front page so that the influencer can decide whether to use the generated face or not, by clicking on the accept button on the front page. If they choose to use it, both their face and the generated face are sent to the landmark extraction module to extract the landmarks, which are then used to swap the faces. To minimize the fluctuation of landmarks over time that can cause instability or jitter in the output, a temporal filtering step is added. Furthermore, to increase the processing speed the system works on a reduced set of the extracted landmarks.

• Journal of Internet Computing and Services
• /
• v.5 no.6
• /
• pp.79-91
• /
• 2004

Various facial pose detection and recognition has been a difficult problem. The problem is due to the fact that the distribution of various poses in a feature space is mere dispersed and more complicated than that of frontal faces, This thesis proposes a robust pose-expression-invariant face recognition method in order to overcome insufficiency of the existing face recognition system. First, we apply the TSL color model for detecting facial region and estimate the direction of face using facial features. The estimated pose vector is decomposed into X-V-Z axes, Second, the input face is mapped by deformable template using this vectors and 3D CANDIDE face model. Final. the mapped face is transformed to frontal face which appropriates for face recognition by the estimated pose vector. Through the experiments, we come to validate the application of face detection model and the method for estimating facial poses, Moreover, the tests show that recognition rate is greatly boosted through the normalization of the poses and expressions.

• 제어로봇시스템학회:학술대회논문집
• /
• 2005.06a
• /
• pp.1244-1248
• /
• 2005

In this paper, we propose fuzzy c-means (FCM) to solve recognition errors in invariant range image, multi-pose face recognition. Scale, center and pose error problems were solved using geometric transformation. Range image face data was digitized into range image data by using the laser range finder that does not depend on the ambient light source. Then, the digitized range image face data is used as a model to generate multi-pose data. Each pose data size was reduced by linear reduction into the database. The reduced range image face data was transformed to the gradient face model for facial feature image extraction and also for matching using the fuzzy membership adjusted by fuzzy c-means. The proposed method was tested using facial range images from 40 people with normal facial expressions. The output of the detection and recognition system has to be accurate to about 93 percent. Simultaneously, the system must be robust enough to overcome typical image-acquisition problems such as noise, vertical rotated face and range resolution.

• Smart Media Journal
• /
• v.11 no.8
• /
• pp.65-72
• /
• 2022

Due to COVID-19, the importance of non-face-to-face counseling is increasing as the face-to-face counseling method has progressed to non-face-to-face counseling. The advantage of non-face-to-face counseling is that it can be consulted online anytime, anywhere and is safe from COVID-19. However, it is difficult to understand the client's mind because it is difficult to communicate with non-verbal expressions. Therefore, it is important to recognize emotions by accurately analyzing text and voice in order to understand the client's mind well during non-face-to-face counseling. Therefore, in this paper, text data is vectorized using FastText after separating consonants, and voice data is vectorized by extracting features using Log Mel Spectrogram and MFCC respectively. We propose a multi-emotion recognition model that recognizes five emotions using vectorized data using an LSTM model. Multi-emotion recognition is calculated using RMSE. As a result of the experiment, the RMSE of the proposed model was 0.2174, which was the lowest error compared to the model using text and voice data, respectively.

• Journal of Practical Engineering Education
• /
• v.15 no.3
• /
• pp.557-570
• /
• 2023

The purpose of this study is to develop a digital-based non-face-to-face instructional design model for national public servants. For this purpose, we reviewed the direction of non-face-to-face instructional design based on previous research, and interviewed a total of 10 instructors and learners with experience in non-face-to-face education to identify the success factors of non-face-to-face instructional design for government employees. In addition, to ensure the validity of the instructional design model, a Delphi survey was conducted with experts in instructional design and educational management. As a result, the digital-based instructional design model for national public servants reflects the importance of learning objectives and content design to enhance learning motivation and improve educational effectiveness, and includes detailed implementation plans to support specific and clear performance activities for instructors in non-face-to-face education situations. The instructional design model developed through this study can be expanded as a standard for improving the quality of education in public human resource development, and can be used as a teaching and learning guide according to learner types and characteristics.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.45 no.6
• /
• pp.38-43
• /
• 2008

Skin color information is an important feature for face region detection in color images. This can detect face region using statistical skin color model who is created from skin color information. However, due to the including of different race of people's skin color points, this general statistical model is not accurate enough to detect each specific image as we expected. This paper proposes method to detect correctly face region in various color image that other complexion part is included. In this method set face candidate region applying complexion Gausian distribution based on YCbCr skin color model and applied mathematical morphology to remove noise part and part except face region in color image. And achieved correct face region detection because using Haar-like feature. This approach is capable to distinguish face region from extremely similar skin colors, such as neck skin color or am skin color. Experimental results show that our method can effectively improve face detection results.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2002.05a
• /
• pp.134-138
• /
• 2002

The human faces do not have distinct features unlike other general objects. In general the features of eyes, nose and mouth which are first recognized when human being see the face are defined. These features have different characteristics depending on different human face. In this paper, We propose a face recognition algorithm using the hidden Markov model(HMM). In the preprocessing stage, we find edges of a face using the locally adaptive threshold scheme and extract features based on generic knowledge of a face, then construct a database with extracted features. In training stage, we generate HMM parameters for each person by using the forward-backward algorithm. In the recognition stage, we apply probability values calculated by the HMM to input data. Then the input face is recognized by the euclidean distance of face feature vector and the cross-correlation between the input image and the database image. Computer simulation shows that the proposed HMM algorithm gives higher recognition rate compared with conventional face recognition algorithms.

• Journal of Broadcast Engineering
• /
• v.24 no.3
• /
• pp.440-451
• /
• 2019

We propose a system that allows three dimensional manipulation of face in video. The 3D face manipulation of the proposed system overlays the 3D face model with the user 's manipulation on the face region of the video frame, and it allows 3D manipulation of the video in real time unlike existing applications or methods. To achieve this feature, first, the 3D morphable face model is registered with the image. At the same time, user's manipulation is applied to the registered model. Finally, the frame image mapped to the model as texture, and the texture-mapped and deformed model is rendered. Since this process requires lots of operations, parallel processing is adopted for real-time processing; the system is divided into modules according to functionalities, and each module runs in parallel on each thread. Experimental results show that specific parts of the face in video can be manipulated in real time.