• International Journal of Contents
• /
• 제7권1호
• /
• pp.14-22
• /
• 2011

Temporal Sign Language Recognition (TSLR) from hand motion is an active area of gesture recognition research in facilitating efficient communication with deaf people. TSLR systems consist of two stages: a motion sensing step which extracts useful features from signers' motion and a classification process which classifies these features as a performed sign. This work focuses on two of the research problems, namely unknown time varying signal of sign languages in feature extraction stage and computing complexity and time consumption in classification stage due to a very large sign sequences database. In this paper, we propose a combination of Dynamic Time Warping (DTW) and application of the Single hidden Layer Feedforward Neural networks (SLFNs) trained by Extreme Learning Machine (ELM) to cope the limitations. DTW has several advantages over other approaches in that it can align the length of the time series data to a same prior size, while ELM is a useful technique for classifying these warped features. Our experiment demonstrates the efficiency of the proposed method with the recognition accuracy up to 98.67%. The proposed approach can be generalized to more detailed measurements so as to recognize hand gestures, body motion and facial expression.

• 한국멀티미디어학회논문지
• /
• 제18권2호
• /
• pp.253-259
• /
• 2015

The spread of smartphones enabled the two-way communication through the Internet, and character emoticons added fun and comfort to communication among users. To figure out laughter-arousing factors, a survey about emoticon designs of Kakaotalk Itemstore was conducted, targeting university students in their twenties. An interaction of 'user-preferred emoticons' and 'laughter-arousing emoticons' was analyzed. 90% of 'user-preferred emoticons' were 'humorous emoticons', and 84% of respondents answered that there is a relationship between 'user-preferred emoticons' and 'laughter-arousing emoticons'. Consequently, a high interaction between the 'rank of emoticons' and 'laughter-arousing emoticons' was derived. Also, factors of laughter-arousing emoticons were analyzed by studying the ranks of emoticon from 1st to 8th of Kakaotalk Itemstore. Two-divisional figures reminding pure kids, maximization of emotional expression by omission or exaggeration of mouth, and smoothness by concave curves aroused laughter. Intuitively understandable gestures were employed in terms of action. Furthermore, two-divisional figures' acting with comparably small body, hands and foot to their head, and people-mimicking motions of animals with cuteness and familiarity enabled arousal of laughter. In facial expressions, humorous articulation of sad, busy or mad expression enabled positive communion among users.

• International Journal of Contents
• /
• 제15권4호
• /
• pp.59-64
• /
• 2019

In recent years, emotion recognition has been an interesting and challenging topic. Compared to facial expressions and speech modality, gesture-based emotion recognition has not received much attention with only a few efforts using traditional hand-crafted methods. These approaches require major computational costs and do not offer many opportunities for improvement as most of the science community is conducting their research based on the deep learning technique. In this paper, we propose an end-to-end deep learning approach for classifying emotions based on bodily gestures. In particular, the informative keyframes are first extracted from raw videos as input for the 3D-CNN deep network. The 3D-CNN exploits the short-term spatiotemporal information of gesture features from selected keyframes, and the convolutional LSTM networks learn the long-term feature from the features results of 3D-CNN. The experimental results on the FABO dataset exceed most of the traditional methods results and achieve state-of-the-art results for the deep learning-based technique for gesture-based emotion recognition.

• 동의생리병리학회지
• /
• 제19권3호
• /
• pp.596-599
• /
• 2005

Human health is affected by not only physical conditions but also mental and social well-being. Changes of human emotions show up as gestures, facial expressions and sweating. Human emotions are affected by such automatic nerve system functions as blood pressure, blood circulation speed, heart beats, pupillary reflex, fluid transfusion, muscular contraction and digestive organs, all of which influence the holistic diseases. The Oriental Medicine sees from a perspective of unity of divinity and men that human life activities are united in terms of their physical and mental functions. From such a perspective, human Five Organs are linked with Five Mental(五神) and Seven Emotions(七情), while they are affected by each other, influencing the life activities both directly and indirectly. Based on Confucianism, Sa-Sang Theory argues that human emotions can be categorized into four energy states and therefore, that human diseases and physiological conditions there of may be determined differently depending on the Four Energies(四氣). There seems to be some common points between Sa-Sang Theory and the conventional Oriental Medicine in that human emotions affect individuals' health conditions, so there seems to be much room for mutual complementation.

• 한국간호교육학회지
• /
• 제25권4호
• /
• pp.459-470
• /
• 2019

Purpose: The purpose of this qualitative study was to identify the nature of precocious puberty and to explore what it means in primary schools. Methods: The participants of this phenomenological study were nine primary school girls who were diagnosed with precocious puberty and experienced hormone therapeutics, applying a convenience sampling method. Data were collected from July 2017 to January 2018 through individual in-depth interviews of the participants, including gestures, facial expressions and nonverbal means. The data analysis followed the method of Giorgi. Results: The study identified 37 concepts, 12 clusters, and five themes from experiences of precocious puberty. The essential five themes were as follows: 'ashamed and concealing experience', 'there is no therapeutics option', 'difficulties in the process of therapeutics', 'difficulties in daily life', and 'ambivalence toward therapeutics'. Conclusion: The findings of this study indicate physical, psychological and social difficulties faced by girls with precocious puberty. Based on this results of the study, it is necessary to develop nursing intervention programs focusing on healthy growth and development for children with precocious puberty.

• 예술인문사회 융합 멀티미디어 논문지
• /
• 제7권9호
• /
• pp.1-12
• /
• 2017

This study is the academic work to explore the potential meanings of print advertisements. Linguistic features such as repetition, variation, contrast and phonological structure in the verbal texts of ads can give rise to shades-of-meaning or slight variations in advertising. The language of advertising is not only language in words. It is also a language in images, colors, and pictures. Pictures and words combine to form the advertisement's visual text.. While the words are very important in delivering the sales message, the visual text cannot be ignored in advertisements. Forming part of the visual text is the paralanguage of the ad. Paralanguage is the meaningful behaviour accompanying language, such as voice quality, gestures, facial expressions and touch in speech, and choice of typeface and letter sizes in writing. Foregrounding is the throwing into relief of the linguistic sign against the background of the norms of ordinary language. This paper focuses its discussion on the advertisements within the framework of the paradigmatic and the syntagmatic relationship. The sources of ads have been confined to Malboro. The ads were reselected based on purposive sampling methods.

• 한국콘텐츠학회논문지
• /
• 제20권2호
• /
• pp.581-593
• /
• 2020

이 연구의 목적은 가상현실 시뮬레이션에서 아바타에 대한 사용자의 주의집중이 어떻게 일어나는가를 분석하기 위한 것이다. 주의집중 정도를 알기 위해서 시선추적 기법을 적용했으며, 이를 통하여 사용자가 아바타의 어느 부분에 초점을 두고 있는지 검증하고자 하였다. 이 연구에서는 수업시뮬레이션에서 아바타에 대한 사용자의 시선응시 시간과 가상실재감을 분석했다. 실험참가자는 대학생 45명(여학생=21명, 남학생=24명)이었다. 이 연구에서는 가상현실 기반의 수업시뮬레이션이 사용되었으며, 교권침해에 대한 시나리오들이 적용되었다. 종속변수는 아바타에 대한 사용자의 시선응시시간이며 3개의 관심영역(AOI)에 대한 차이분석을 실시했다. 또한 실험조건에 대한 사용자의 가상실재감(공간실재감, 몰두감, 사실성)을 측정했다. 실험참가자는 두 가지 시나리오를 모두 경험했으며, 반복측정에 의한 다변량분산분석을 실시했다. 연구결과에 의하면 시나리오와 AOI에 의한 유의미한 상호작용이 있었고, 시나리오와 AOI에 따른 주효과도 유의미한 차이가 보였다. 시나리오의 유형과 상관없이 사용자는 언제나 아바타의 얼굴표정에 상당히 많은 시선응시를 하고 있는 것으로 나타났다.

• 감성과학
• /
• 제20권2호
• /
• pp.161-170
• /
• 2017

감정은 학습능력, 행동, 판단력 등 삶의 많은 부분에 영향을 끼치므로 인간의 본질을 이해하는 데 중요한 역할을 한다. 그러나 감정은 개인이 느끼는 강도가 다르며, 시각 영상 자극을 통해 감정을 유도하는 경우 감정이 지속적으로 유지되지 않는다. 이러한 문제점을 극복하기 위하여 총 4가지 감정자극(행복, 슬픔, 공포, 보통) 시 생체신호(뇌전도, 맥파, 피부전도도, 피부 온도)를 획득하고, 이로부터 특징을 추출하여 분류기의 입력으로 사용하였다. 감정 패턴을 확률적으로 해석하여 다른 공간으로 매핑시켜주는 역할을 하는 Restricted Boltzmann Machine (RBM)과 Multilayer Neural Network (MNN)의 은닉층 노드를 이용하여 비선형적인 성질의 감정을 구별하는 Deep Belief Network (DBN) 감정 패턴 분류기를 설계하였다. 그 결과, DBN의 정확도(약 94%)는 오류 역전파 알고리즘의 정확도(약 40%)보다 높은 정확도를 가지며 감정 패턴 분류기로서 우수성을 가짐을 확인하였다. 이는 향후 인지과학 및 HCI 분야 등에서 활용 가능할 것으로 사료된다.

• 복식
• /
• 제51권4호
• /
• pp.71-80
• /
• 2001

Since the beginning of the 90's, Fashion shows appear to be a type of performance form of art combining with other areas to visually entertain the viewers. This can be explained by the modern tendency to escape from society which requires formality and complicated lifestyles. Fashion shows take place in a scene Influenced by the idea of post-modernism which redefines the definition of space. A church, old factory, unoccupied ground, subway stations, or even place like a waste disposal are used as a setting. The stage set is no longer the T shape run way and the procinium arch has disappeared. The gap between audience and stage has diminished and theatrical element is added to the fashion performance by using viewers living and working environments as setting of the show. The human relation with machine based on the cutting edge technology such as the stage automation, robots and mist making sprinkler system introduces new elements with spontaneity and detailed planning in the stage performance. Music also plays an Important role in attracting viewers. The sound track covers house music to techno music. Instead of music being abstract, folks orchestral music, choirs, piano. even live concert performed by pop artist provide the liveliness of the fashion show. And the catwalk itself is a performance. Model needs to be well trained as the capable talent who can handle sensitive gestures, facial expressions, dancing and choreography. The improvisatorial interaction between audience and model lead to audience participation. Models now range from pop star, ordinary people, handicapped people, to elderly and so on. John Galliano introduced the theatrical factors for the fashion show and Alexander Mcqueen approached the fashion show as the visual art of communication. Hussein Chalayan utilized high technology skewing futurism as if in a magic show. Today the Fashion show tends to be a total performance which includes audience participation, impromptu, and that break the limitation that fashion shows previously had. This will lead the fashion industry in opening new horizon of its own.

• Journal of Information Processing Systems
• /
• 제4권4호
• /
• pp.159-168
• /
• 2008

Human-Robot Interaction (HRI), based on already well-researched Human-Computer Interaction (HCI), has been under vigorous scrutiny since recent developments in robot technology. Robots may be more successful in establishing common ground in project-based education or foreign language learning for children than in traditional media. Backed by its strong IT environment and advances in robot technology, Korea has developed the world's first available e-Learning home robot. This has demonstrated the potential for robots to be used as a new educational media - robot-learning, referred to as 'r-Learning'. Robot technology is expected to become more interactive and user-friendly than computers. Also, robots can exhibit various forms of communication such as gestures, motions and facial expressions. This study compared the effects of non-computer based (NCB) media (using a book with audiotape) and Web-Based Instruction (WBI), with the effects of Home Robot-Assisted Learning (HRL) for children. The robot gestured and spoke in English, and children could touch its monitor if it did not recognize their voice command. Compared to other learning programs, the HRL was superior in promoting and improving children's concentration, interest, and academic achievement. In addition, the children felt that a home robot was friendlier than other types of instructional media. The HRL group had longer concentration spans than the other groups, and the p-value demonstrated a significant difference in concentration among the groups. In regard to the children's interest in learning, the HRL group showed the highest level of interest, the NCB group and the WBI group came next in order. Also, academic achievement was the highest in the HRL group, followed by the WBI group and the NCB group respectively. However, a significant difference was also found in the children's academic achievement among the groups. These results suggest that home robots are more effective as regards children's learning concentration, learning interest and academic achievement than other types of instructional media (such as: books with audiotape and WBI) for English as a foreign language.