• Journal of the Korean Institute of Intelligent Systems
• /
• v.24 no.3
• /
• pp.316-322
• /
• 2014

A movie recommendation system is proposed to learn a preference model of a viewer by using multimodal features of a video content and their evoked implicit responses of the viewer in synchronized manner. In this system, facial expression, body posture, and physiological signals are measured to estimate the affective states of the viewer, in accordance with the stimuli consisting of low-level and affective features from video, audio, and text streams. Experimental results show that it is possible to predict arousal response, which is measured by electrodermal activity, of a viewer from auditory and text features in a video stimuli, for estimating interestingness on the video.

• Journal of the Computational Structural Engineering Institute of Korea
• /
• v.29 no.4
• /
• pp.309-315
• /
• 2016

Recently, finite element analysis technique has been widely used for structural and mechanical understandings of human body in the dentistry field. This research proposed an effective finite element modeling method based on CT images, and parametric studies were performed for the occlusal simulation. The analyses were performed considering linear material behaviors and nonlinear geometrical effect, and validated with the experimental results. In addition, the skull models with two different molar relations such as Class I and full-CUSP Class II were generated and the analyses were performed using the proposed analytical method. As results, the relationships between the mandibular movement and occlusal force of both two models showed similar tendency in human occlusal force. However, stress was evenly distributed from teeth to facial bone in the skull model with Class I, while stress concentration was appeared in the model with full-CUSP Class II due to the changes of occlusal surfaces of the model.

• Journal of Korea Game Society
• /
• v.21 no.3
• /
• pp.13-24
• /
• 2021

This paper shows the face rotation applicable to game character facial illustration. Existing studies limited data to human face data, required a large amount of data, and the synthesized results were not good. In this paper, the following method was introduced to solve the existing problems of existing studies. First, a 3D model with features of the input image was rotated and then rendered as a 2D image to construct a data set. Second, by designing GAN that can learn features of various poses from the data built through the 3D model, the input image can be synthesized at a desired pose. This paper presents the results of synthesizing the game character face illustration. From the synthesized result, it can be confirmed that the proposed method works well.

• Journal of Service Research and Studies
• /
• v.14 no.1
• /
• pp.13-26
• /
• 2024

Multi-modal generation is the process of generating results based on a variety of information, such as text, images, and audio. With the rapid development of AI technology, there is a growing number of multi-modal based systems that synthesize different types of data to produce results. In this paper, we present an AI system that uses speech and text recognition to describe a person and generate a montage image. While the existing montage generation technology is based on the appearance of Westerners, the montage generation system developed in this paper learns a model based on Korean facial features. Therefore, it is possible to create more accurate and effective Korean montage images based on multi-modal voice and text specific to Korean. Since the developed montage generation app can be utilized as a draft montage, it can dramatically reduce the manual labor of existing montage production personnel. For this purpose, we utilized persona-based virtual person montage data provided by the AI-Hub of the National Information Society Agency. AI-Hub is an AI integration platform aimed at providing a one-stop service by building artificial intelligence learning data necessary for the development of AI technology and services. The image generation system was implemented using VQGAN, a deep learning model used to generate high-resolution images, and the KoDALLE model, a Korean-based image generation model. It can be confirmed that the learned AI model creates a montage image of a face that is very similar to what was described using voice and text. To verify the practicality of the developed montage generation app, 10 testers used it and more than 70% responded that they were satisfied. The montage generator can be used in various fields, such as criminal detection, to describe and image facial features.

• Journal of Institute of Control, Robotics and Systems
• /
• v.19 no.8
• /
• pp.738-744
• /
• 2013

According to the cognitive science research, the interaction intent of humans can be estimated through an analysis of the representing behaviors. This paper proposes a novel methodology for reliable intention analysis of humans by applying this approach. To identify the intention, 8 behavioral features are extracted from the 4 characteristics in human-human interaction and we outline a set of core components for nonverbal behavior of humans. These nonverbal behaviors are associated with various recognition modules including multimodal sensors which have each modality with localizing sound source of the speaker in the audition part, recognizing frontal face and facial expression in the vision part, and estimating human trajectories, body pose and leaning, and hand gesture in the spatial part. As a post-processing step, temporal confidential reasoning is utilized to improve the recognition performance and integrated human model is utilized to quantitatively classify the intention from multi-dimensional cues by applying the weight factor. Thus, interactive robots can make informed engagement decision to effectively interact with multiple persons. Experimental results show that the proposed scheme works successfully between human users and a robot in human-robot interaction.

• 한국디지털정책학회:학술대회논문집
• /
• 2005.06a
• /
• pp.145-175
• /
• 2005

In 2001, e-Credit guarantee system was introduced by the Korea Credit Guarantee Fund(KCGF) to extends the credit guarantee services for the purchasing amount on credit in the B2B e-Marketplace. It combines both the merits of bill of exchange and credit card and eliminates the uneasiness related to the unpaid accounts due to the non-facial e-Marketplace. The purpose of this paper is to empirically analyze both the causal relationship and influences among theoretical variables by the structural equation model(SEM). e-Credit guarantee system can be a good strategy for promoting B2R e-Marketplace. The level of application of e-Credit guarantee system is attributable to both the characteristics of B2B e-Marketplace and products. The cost reduction or saving in purchasing procedures, production and stockpiling will be possible through e-Credit guarantee system. The close linkage of financial institutions with the enterprises based on e-Credit guarantee system will further promote B2B e-Marketplace in Korea.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.7 no.6
• /
• pp.1449-1462
• /
• 2013

We present a novel approach to producing facial caricature with Simpson cartoon style based on Moving Least Squares (MLS). We take advantage of employing the caricature stylization rule of caricature artist, Justin. Our method allows Simpson-style cartoon character similar to user's features by using Justin's technique, which is a set of caricature stylization rules. Our method transforms input photo image into Simpson style caricature by using MLS approximation. The unique characteristics of user in the photo can be detected by comparing to the mean face feature and the input face feature extracted by AAM(Active Appearance Model). To exaggerate the detected unique characteristics, we set up the exaggeration rules using Justin's technique. In addition, during the cartooning process, user's hairs and accessories are used to the deformed image to make a close resemblance. Our method preserves the reliable and stylized caricature through the exaggeration rules of the actual caricature artist's techniques. From this study, we can easily create a Simpson-style cartoon caricature to resemble user's features by combining a caricature with existing cartoon researches.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.14 no.2
• /
• pp.631-653
• /
• 2020

Sign language is a natural, visually oriented and non-verbal communication channel between people that facilitates communication through facial/bodily expressions, postures and a set of gestures. It is basically used for communication with people who are deaf or hard of hearing. In order to understand such communication quickly and accurately, the design of a successful sign language translation system is considered in this paper. The proposed system includes object detection and classification stages. Firstly, Single Shot Multi Box Detection (SSD) architecture is utilized for hand detection, then a deep learning structure based on the Inception v3 plus Support Vector Machine (SVM) that combines feature extraction and classification stages is proposed to constructively translate the detected hand gestures. A sign language fingerspelling dataset is used for the design of the proposed model. The obtained results and comparative analysis demonstrate the efficiency of using the proposed hybrid structure in sign language translation.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2006.05a
• /
• pp.715-718
• /
• 2006

아바타를 이용한 얼굴 애니메이션은 가상 현실이나 엔터테인먼트와 같은 분야에서 많이 적용된다. 얼굴 애니메이션을 생성하는 방법에는 크게 3 차원 모델을 직접 변형시키는 기하학적인 변형 방법과 2 차원 이미지의 워핑이나 모핑방법을 이용한 이미지 변형 방법이 있다. 기하학적인 변형 방법 중 3 차원 모델을 변형시키기 위한 방법으로 RBF(Radial Basis Function)을 이용하는 방법이 있다. RBF 함수를 이용하여 모델의 부드러운 변형을 만들 수 있다. 이 방법은 모델의 임의의 한 점을 이동하게 되면 영향을 받는 정점들을 좀 더 자연스럽게 이동시킴으로써 자연스러운 애니메이션을 생성할 수 있다. 본 연구에서는 RBF 를 이용하여 3 차원 얼굴 메쉬 모델의 기하학적 변형을 통해 모델의 얼굴 표정을 생성하는 방법에 대해 제안하고자 한다. 얼굴 모델 변형을 위해 얼굴의 특징인 눈, 입, 턱 부분에 특징점을 정하고 각 특징점에 따라 영향을 받는 영역을 정하기 위해 얼굴 모델을 지역적으로 클러스터링한다. 각 특징점에 따라 영향을 받는 영역에 대해 클러스터링을 적용하고 RBF 를 이용하여 자연스러운 얼굴 표정을 생성하는 방법을 제안한다.

• Korean Journal of Head & Neck Oncology
• /
• v.12 no.1
• /
• pp.92-99
• /
• 1996

The primary treatment of the nasopharyngeal carcinoma is at this time, mainly based on radiotherapy. In most studies for patient treated with radiotherapy, overall 5-year survival rate is in the range of 35 to 55%. Obviously, these therapeutic results may be influenced by various factors such as clinical stages, histopathological types and radiation techniques, etc. Though the radiotherapy had a good therapeutic result, there is a limitation to apply the radiotherapy only in cases of the advanced nasopharyngeal carcinoma. Anatomical complexity of the skull base and difficulties in complete surgical intervention were the trouble of the surgery but in the case of radiation failure, there is no adequate choice of other curative modalities. So it is appropriate to investigate whether surgical resection may improve the outcome of treatment of nasopharyngeal carcinoma. The purpose of this papaer is to report our surgical experience of the nasopharyngeal carcinoma, then to take into consideration of the new model of treatment strategy of nasopharyngeal carcinoma.