• Title/Summary/Keyword: facial expression analysis

Search Result 164, Processing Time 0.029 seconds

Interaction Intent Analysis of Multiple Persons using Nonverbal Behavior Features (인간의 비언어적 행동 특징을 이용한 다중 사용자의 상호작용 의도 분석)

  • Yun, Sang-Seok;Kim, Munsang;Choi, Mun-Taek;Song, Jae-Bok
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.19 no.8
    • /
    • pp.738-744
    • /
    • 2013
  • According to the cognitive science research, the interaction intent of humans can be estimated through an analysis of the representing behaviors. This paper proposes a novel methodology for reliable intention analysis of humans by applying this approach. To identify the intention, 8 behavioral features are extracted from the 4 characteristics in human-human interaction and we outline a set of core components for nonverbal behavior of humans. These nonverbal behaviors are associated with various recognition modules including multimodal sensors which have each modality with localizing sound source of the speaker in the audition part, recognizing frontal face and facial expression in the vision part, and estimating human trajectories, body pose and leaning, and hand gesture in the spatial part. As a post-processing step, temporal confidential reasoning is utilized to improve the recognition performance and integrated human model is utilized to quantitatively classify the intention from multi-dimensional cues by applying the weight factor. Thus, interactive robots can make informed engagement decision to effectively interact with multiple persons. Experimental results show that the proposed scheme works successfully between human users and a robot in human-robot interaction.

Accuracy and reliability of 2-dimensional photography versus 3-dimensional soft tissue imaging

  • Ayaz, Irem;Shaheen, Eman;Aly, Medhat;Shujaat, Sohaib;Gallo, Giulia;Coucke, Wim;Politis, Constantinus;Jacobs, Reinhilde
    • Imaging Science in Dentistry
    • /
    • v.50 no.1
    • /
    • pp.15-22
    • /
    • 2020
  • Purpose: This study was conducted to objectively and subjectively compare the accuracy and reliability of 2-dimensional(2D) photography and 3-dimensional(3D) soft tissue imaging. Materials and Methods: Facial images of 50 volunteers(25 males, 25 females) were captured with a Nikon D800 2D camera (Nikon Corporation, Tokyo, Japan), 3D stereophotogrammetry (SPG), and laser scanning (LS). All subjects were imaged in a relaxed, closed-mouth position with a normal smile. The 2D images were then exported to Mirror® Software (Canfield Scientific, Inc, NJ, USA) and the 3D images into Proplan CMF® software (version 2.1, Materialise HQ, Leuven, Belgium) for further evaluation. For an objective evaluation, 2 observers identified soft tissue landmarks and performed linear measurements on subjects' faces (direct measurements) and both linear and angular measurements on all images(indirect measurements). For a qualitative analysis, 10 dental observers and an expert in facial imaging (subjective gold standard) completed a questionnaire regarding facial characteristics. The reliability of the quantitative data was evaluated using intraclass correlation coefficients, whereas the Fleiss kappa was calculated for qualitative data. Results: Linear and angular measurements carried out on 2D and 3D images showed excellent inter-observer and intra-observer reliability. The 2D photographs displayed the highest combined total error for linear measurements. SPG performed better than LS, with borderline significance (P=0.052). The qualitative assessment showed no significant differences among the 2D and 3D imaging modalities. Conclusion: SPG was found to a reliable and accurate tool for the morphological evaluation of soft tissue in comparison to 2D imaging and laser scanning.

Reduction of Proliferation and Induction of Apoptosis are Associated with Shrinkage of Head and Neck Squamous Cell Carcinoma due to Neoadjuvant Chemotherapy

  • Sarkar, Shreya;Maiti, Guru Prasad;Jha, Jayesh;Biswas, Jaydip;Roy, Anup;Roychoudhury, Susanta;Sharp, Tyson;Panda, Chinmay Kumar
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.14 no.11
    • /
    • pp.6419-6425
    • /
    • 2013
  • Background: Neoadjuvant chemotherapy (NACT) is a treatment modality whereby chemotherapy is used as the initial treatment of HNSCC in patients presenting with advanced cancer that cannot be treated by other means. It leads to shrinkage of tumours to an operable size without significant compromise to essential oro-facial organs of the patients. The molecular mechanisms behind shrinkage due to NACT is not well elucidated. Materials and Methods: Eleven pairs of primary HNSCCs and adjacent normal epithelium, before and after chemotherapy were screened for cell proliferation and apoptosis. This was followed by immunohistochemical analysis of some cell cycle (LIMD1, RBSP3, CDC25A, CCND1, cMYC, RB, pRB), DNA repair (MLH1, p53) and apoptosis (BAX, BCL2) associated proteins in the same set of samples. Results: Significant decrease in proliferation index and increase in apoptotic index was observed in post-therapy tumors compared to pre-therapy. Increase in the RB/pRB ratio, along with higher expression of RBSP3 and LIMD1 and lower expression of cMYC were observed in post-therapy tumours, while CCND1 and CDC25A remained unchanged. While MLH1 remained unchanged, p53 showed higher expression in post-therapy tumors, indicating inhibition of cell proliferation and induction of apoptosis. Increase in the BAX/BCL2 ratio was observed in post-therapy tumours, indicating up-regulation of apoptosis in response to therapy. Conclusions: Thus, modulation of the G1/S cell cycle regulatory proteins and apoptosis associated proteins might play an important role in tumour shrinkage due to NACT.

Difference analysis of importance perception and ability of communication among dental hygienists (치과위생사의 의사소통에 관한 중요도 인식과 능력 차이분석)

  • Lee, Sun-Mi;Jun, Mi-Kyoung
    • Journal of Korean society of Dental Hygiene
    • /
    • v.20 no.4
    • /
    • pp.491-503
    • /
    • 2020
  • Objectives: The purpose of this study is to identify the importance of perception and communication ability among dental hygienists and provide evidence for the activation of communication education necessary to improve communication ability required in the actual dental field. Methods: A questionnaire survey was conducted on 227 members attending conservative education in 2020. Results: The following are mean scores of each area of communication according to importance: message conversion ability, 3.82 points; interpretation ability, 3.74 points; goal setting ability, 3.51 points; self-expression ability, 3.48 points; and role performance ability, 3.46 points. The ability was interpreted in the following order: interpretation ability, 3.61 points; message conversion ability, 3.56 points; role performance ability, 3.43 points; self-expression ability, 3.32 points; and goal setting ability, 3.10 points. The highest score in terms of importance of awareness was 4.27 points, the highest among interpretive abilities, that is, to 'listen carefully to know what the other person intends to say.' When it comes to communication skills, the highest score was 4.12 points for 'a nod or a facial expression of understanding while listening to each other.' Conclusions: In devel oping a training program related to communication for dental hygienists at the clinical site, the curriculum reflecting seven items that needs improvement should be revised; and through this, it is expected that dental hygienists' communication skills will be improved.

A Study on Textile Fashion Design Using the Formativeness of the Works of Gustav Klimt (구스타브 클림트[Gustav Klimt] 작품의 조형성을 활용한 텍스타일 의상 디자인 연구)

  • Lee, In-Young;Kim, Soo-Kyong
    • Journal of the Korean Society of Costume
    • /
    • v.56 no.9 s.109
    • /
    • pp.83-97
    • /
    • 2006
  • This Study is a thesis presenting handicrafty and decorative textile design as well as sensual fashion design through the works of Gustav Klimt. The result is as below; The formative qualities in the works of Klimt could be featured as decorativeness, sensuality and symbolism. First, the decorative inclination is prominent in the portrait and the effect is maximized with the golden mosaic shape expressed on the dress and the background influenced by the Byzantine. Second, the sensuality could be recognized directly from the women's pose or facial expression in the works of Klimt, otherwise appeared on the refined expression showed on the portraits of noble lady Third, to surpass the reality, Klimt preferred the symbolic expression, which can be shown on the patterns in the works addressing the themes such as the legends and myths, or figures of men and women expressed with the image of an abstract features of membrum. The development of the textile design is as fellowed. First, it analyzes and reconstitutes the formativeness and the element of design in the works of Klimt by the flow of the form factor. Second. it makes a pattern of a single nature through perception, analysis, description and drawing and expresses with realization of the characteristics of Klimt. Focusing on the handicrafts and decorativeness out of the latest trends and making the most use of the sensuality, the designed textiles were completed by the handicrafty techniques, used in the fashion design and completed as the design of sensual images. The textile development aims at minimizing the limit of design that can be caused by the absence of silhouette and detail, expanding the range of its creativity of fashion designs and creating fashion design high value-added.

The relationship between condyle position, morphology and chin deviation in skeletal Class III patients with facial asymmetry using cone-beam CT (안면비대칭을 동반한 골격성 III급 부정교합자에서 하악 과두의, 위치 형태와 이부 편위의 관계: cone-beam CT를 이용한 연구)

  • Lee, Bo-Ram;Kang, Dae-Keun;Son, Woo-Sung;Park, Soo-Byung;Kim, Seong-Sik;Kim, Yong-Il;Lee, Kyung-Min
    • The korean journal of orthodontics
    • /
    • v.41 no.2
    • /
    • pp.87-97
    • /
    • 2011
  • Objective: Facial asymmetry is usually evaluated from the difference in length and angulation of the maxilla and mandible. However, asymmetric position or shape of the condyle can also affect the expression of asymmetry. The purpose of this study was to evaluate the correlation between condylar asymmetry and chin point deviation in facial asymmetry. Methods: Cone-beam CT images of fifty adult skeletal Class III patients were studied. Thirty patients who had more than 4 mm menton deviation were categorized in the asymmetric group. Twenty patients with less than 4 mm menton deviation were assigned to the symmetric group. Anteroposterior and transverse condyle positions were evaluated from the cranial base. The greatest mediolateral diameter (GMD) of the condyle in the axial plane and angulation to the coronal plane were measured. The height and volume of the condyles were evaluated. Results: The symmetric group had no statistical difference between both condyles in position, angulation, GMD, height and volume. In the asymmetric group, the non-deviated side condyle was larger in GMD, height and volume than the deviated side. There was no statistical difference in condyle position and angulation. The GMD, height difference and condylar volume ratio (non-deviated/deviated) were positively correlated with chin deviation. From the linear regression analysis, condylar volume ratio was a significant factor affecting chin deviation. Conclusions: These findings suggests that the non-deviated side condyle is larger than the deviated side. In addition, condylar asymmetry can affect the expression of facial asymmetry.

Expression Analysis System of Game Player based on Multi-modal Interface (멀티 모달 인터페이스 기반 플레이어 얼굴 표정 분석 시스템 개발)

  • Jung, Jang-Young;Kim, Young-Bin;Lee, Sang-Hyeok;Kang, Shin-Jin
    • Journal of Korea Game Society
    • /
    • v.16 no.2
    • /
    • pp.7-16
    • /
    • 2016
  • In this paper, we propose a method for effectively detecting specific behavior. The proposed method detects outlying behavior based on the game players' characteristics. These characteristics are captured non-invasively in a general game environment and add keystroke based on repeated pattern. In this paper, cameras were used to analyze observed data such as facial expressions and player movements. Moreover, multimodal data from the game players was used to analyze high-dimensional game-player data for a detection effect of repeated behaviour pattern. A support vector machine was used to efficiently detect outlying behaviors. We verified the effectiveness of the proposed method using games from several genres. The recall rate of the outlying behavior pre-identified by industry experts was approximately 70%. In addition, Repeated behaviour pattern can be analysed possible. The proposed method can also be used for feedback and quantification about analysis of various interactive content provided in PC environments.

Moderating Effects of User Gender and AI Voice on the Emotional Satisfaction of Users When Interacting with a Voice User Interface (음성 인터페이스와의 상호작용에서 AI 음성이 성별에 따른 사용자의 감성 만족도에 미치는 영향)

  • Shin, Jong-Gyu;Kang, Jun-Mo;Park, Yeong-Jin;Kim, Sang-Ho
    • Science of Emotion and Sensibility
    • /
    • v.25 no.3
    • /
    • pp.127-134
    • /
    • 2022
  • This study sought to identify the voice user interface (VUI) design parameters that evoked positive user emotions. Six VUI design parameters that could affect emotional user satisfaction were considered. The moderating effects of user gender and the design parameters were analyzed to determine the appropriate conditions for user satisfaction when interacting with the VUI. An interactive VUI system that could modify the six parameters was implemented using the Wizard of OZ experimental method. User emotions were assessed from the users' facial expression data, which was then converted into a valence score. The frequency analysis and chi-square test found that there were statistically significant moderating gender and AI effects. These results implied that it is beneficial to consider the users' gender when designing voice-based interactions. Adult/male/high-tone voices for males and adult/female/mid-tone voices for females are recommended as general guidelines for future VUI designs. Future analyses that consider various human factors will be able to more delicately assess human-AI interactions from a UX perspective.

A Face Recognition Method Robust to Variations in Lighting and Facial Expression (조명 변화, 얼굴 표정 변화에 강인한 얼굴 인식 방법)

  • Yang, Hui-Seong;Kim, Yu-Ho;Lee, Jun-Ho
    • Journal of KIISE:Software and Applications
    • /
    • v.28 no.2
    • /
    • pp.192-200
    • /
    • 2001
  • 본 논문은 조명 변화, 표정 변화, 부분적인 오클루전이 있는 얼굴 영상에 강인하고 적은 메모리양과 계산량을 갖는 효율적인 얼굴 인식 방법을 제안한다. SKKUface(Sungkyunkwan University face)라 명명한 이 방법은 먼저 훈련 영상에 PCA(principal component analysis)를 적용하여 차원을 줄일 때 구해지는 특징 벡터 공간에서 조명 변화, 얼굴 표정 변화 등에 해당되는 공간이 최대한 제외된 새로운 특징 벡터 공간을 생성한다. 이러한 특징 벡터 공간은 얼굴의 고유특징만을 주로 포함하는 벡터 공간이므로 이러한 벡터 공간에 Fisher linear discriminant를 적용하면 클래스간의 더욱 효과적인 분리가 이루어져 인식률을 획기적으로 향상시킨다. 또한, SKKUface 방법은 클래스간 분산(between-class covariance) 행렬과 클래스내 분산(within-class covariance) 행렬을 계산할 때 문제가 되는 메모리양과 계산 시간을 획기적으로 줄이는 방법을 제안하여 적용하였다. 제안된 SKKUface 방법의 얼굴 인식 성능을 평가하기 위하여 YALE, SKKU, ORL(Olivetti Research Laboratory) 얼굴 데이타베이스를 가지고 기존의 얼굴 인식 방법으로 널리 알려진 Eigenface 방법, Fisherface 방법과 함께 인식률을 비교 평가하였다. 실험 결과, 제안된 SKKUface 방법이 조명 변화, 부분적인 오클루전이 있는 얼굴 영상에 대해서 Eigenface 방법과 Fisherface 방법에 비해 인식률이 상당히 우수함을 알 수 있었다.

  • PDF

A Study on the Image of Male Flight Attendant on Customer Satisfaction

  • Kim, Min-Ji;Park, Hye-Yoon;Park, So-Yeon
    • Journal of Distribution Science
    • /
    • v.15 no.8
    • /
    • pp.37-46
    • /
    • 2017
  • Purpose - Many studies have shown the effects of the external images of female flight attendants on the customers' satisfaction. Recently, the perception of male flight attendants has become more important and positive, and airlines are hiring a significant number of male flight attendants every year. Due to the lack of research on the male flight attendant, however, the images of male flight attendants were investigated for this study. Research, design, data and methodology - Using survey techniques with 204 respondents, this study used analytical data based their resulting analysis. Results - The study examined whether the image of the male flight attendant affects the cognitive and emotional perceptions of customers. The focus of the present study is the external image of the male flight attendant, and the following image-component divisions were formed: hairstyle, body type, uniform, speech, and facial expression. Conclusions - The study purpose sought to determine whether the image of the male flight attendant exert effects on the emotional and cognitive images of airlines, and if these images have a positive effect on the customers' satisfaction and loyalty for an airline, so that airlines can use the external image of the male flight attendant to help with its own image reinforcement.