• Title/Summary/Keyword: hand gesture

Search Result 401, Processing Time 0.035 seconds

Object Detection and Optical Character Recognition for Mobile-based Air Writing (모바일 기반 Air Writing을 위한 객체 탐지 및 광학 문자 인식 방법)

  • Kim, Tae-Il;Ko, Young-Jin;Kim, Tae-Young
    • The Journal of Korean Institute of Next Generation Computing
    • /
    • v.15 no.5
    • /
    • pp.53-63
    • /
    • 2019
  • To provide a hand gesture interface through deep learning in mobile environments, research on the light-weighting of networks is essential for high recognition rates while at the same time preventing degradation of execution speed. This paper proposes a method of real-time recognition of written characters in the air using a finger on mobile devices through the light-weighting of deep-learning model. Based on the SSD (Single Shot Detector), which is an object detection model that utilizes MobileNet as a feature extractor, it detects index finger and generates a result text image by following fingertip path. Then, the image is sent to the server to recognize the characters based on the learned OCR model. To verify our method, 12 users tested 1,000 words using a GALAXY S10+ and recognized their finger with an average accuracy of 88.6%, indicating that recognized text was printed within 124 ms and could be used in real-time. Results of this research can be used to send simple text messages, memos, and air signatures using a finger in mobile environments.

System implementation share of voice and sign language (지화인식 기반의 음성 및 SNS 공유 시스템 구현)

  • Kang, Jung-Hun;Yang, Dea-Sik;Oh, Min-Seok;Sir, Jung-Wook
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2016.10a
    • /
    • pp.644-646
    • /
    • 2016
  • Deaf are it is difficult to communicate to represent the voice heard, so theay use mostly using the speech, sign language, writing, etc. to communicate. It is the best way to use sign language, in order to communicate deaf and normal people each other. But they must understand to use sign language. In this paper, we designed and implementated finger language translation system to support communicate between deaf and normal people. We used leap motion as input device that can track finger and hand gesture. We used raspberry pi that is low power sing board computer to process input data and translate finger language. We implemented application used Node.js and MongoDB. The client application complied with HTML5 so that can be support any smart device with web browser.

  • PDF

Research on Human Posture Recognition System Based on The Object Detection Dataset (객체 감지 데이터 셋 기반 인체 자세 인식시스템 연구)

  • Liu, Yan;Li, Lai-Cun;Lu, Jing-Xuan;Xu, Meng;Jeong, Yang-Kwon
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.17 no.1
    • /
    • pp.111-118
    • /
    • 2022
  • In computer vision research, the two-dimensional human pose is a very extensive research direction, especially in pose tracking and behavior recognition, which has very important research significance. The acquisition of human pose targets, which is essentially the study of how to accurately identify human targets from pictures, is of great research significance and has been a hot research topic of great interest in recent years. Human pose recognition is used in artificial intelligence on the one hand and in daily life on the other. The excellent effect of pose recognition is mainly determined by the success rate and the accuracy of the recognition process, so it reflects the importance of human pose recognition in terms of recognition rate. In this human body gesture recognition, the human body is divided into 17 key points for labeling. Not only that but also the key points are segmented to ensure the accuracy of the labeling information. In the recognition design, use the comprehensive data set MS COCO for deep learning to design a neural network model to train a large number of samples, from simple step-by-step to efficient training, so that a good accuracy rate can be obtained.

The Sixteen Arhat Images of the Koryo Period at Sungbul-sa, Chunan (천안 성불사 고려시대 마애십육나한상 (天安 成佛寺 高麗時代 磨崖十六羅漢像))

  • Choe, Seong-Eun
    • Korean Journal of Heritage: History & Science
    • /
    • v.33
    • /
    • pp.162-181
    • /
    • 2000
  • This paper investigates sixteen rock-cut arhat images of the Koryo period at Sungbul-sa (成佛寺) in Chunan (天安), South Chungchung Province. These images, together with a Buddha triad in the center, are carved in thin relief on the large granite wall ($375cm{\times}248cm$), and below them is engraved a huge lotus petal which looks to be supporting all the images above. According to extant textual sources, arhats were popularly worshipped in the Koryo period. The Painting of Five Hundred Arhat Images was brought to Koryo from Later Liang (後梁) of the Five Dynasties (五代) in 923. From that time on, the cult of arhat had become gradually known in Koryo. More than thirty ceremonies worshipping arhats (羅漢齊) were officially held in Koryo court. The Sixteen Arhat images (十六羅漢像) were enshrined in many temples. In Boje-sa (普濟寺), which kings and aristocrats often visited for ritual ceremonies, had its main hall dominated by the Five Hundred Arhats, called Nahan-pocheon (羅漢寶殿). However, a limited number of arhat images of the Koryo period, originally made as sets of sixteen or five hundred arhats, are now extant. The Sixteen Arhat images at Sungbul-sa are unique examples that show all sixteen images in situ. The Sixteen Arhat images, though some of them are abraded, show various postures and gesture. One of them sits with his knee bent, and one arhat is sitting on a chair with his hand held upward. Each image is carved in a niche, just as the arhat images of Northern Song China are normally represented in niches of a cave, and are quite similar in style to the arhat images of the Northern Song period at Qinglindong (靑林洞) cave, Feilaifeng (飛來峰), Zejiang province (浙江省). This similarity between the arhat images of Sungbul-sa and those of Qinglindong certifies the strong impact of Song Buddhist art on Koryo frequently mentioned in texts. The Sixteen Arhat images surround the central Buddha raising his hand up to his chest. This Buddha triad could be ascribed to be either the Maitreya Buddha triad or the Sakyamuni Buddha triad based on the Lotus Sutra (妙法蓮華經). Still, the Sakyamuni Buddha triad was more often represented with sixteen or five hundred arhats in the Koryo period, as was seen in the record of Boje-sa where the Sakyamuni triad was enshrined with five hundred arhat images. The Sixteen Arhat images of Sungbul-sa arc most likely to be a rare example of Koryo Arhat images showing the Sakyamuni Buddha triad and the Sixteen Arhats who were predicted to be Buddhas by Sakyamuni in the Lotus Sutra.

A Study on the Wooden Seated Vairocana Tri-kaya Buddha Images in the Daeungjeon Hall of Hwaeomsa Temple (화엄사 대웅전 목조비로자나삼신 불좌상에 대한 고찰)

  • Choe, Songeun
    • MISULJARYO - National Museum of Korea Art Journal
    • /
    • v.100
    • /
    • pp.140-170
    • /
    • 2021
  • This paper investigates the Wooden Seated Tri-kaya Buddha Images(三身佛像) of Vairocana, Rushana, and Sakyamuni enshrined in Daeungjeon Hall of Hwaeomsa temple(華嚴寺) in Gurae, South Cheolla Province. They were produced in 1634 CE and placed in 1635 CE, about forty years after original images made in the Goryeo period were destroyed by the Japanese army during the war. The reconstruction of Hwaeomsa was conducted by Gakseong, one of the leading monks of Joseon Dynasty in the 17th century, who also conducted the reconstructions of many Buddhist temples after the war. In 2015, a prayer text (dated 1635) concerning the production of Hwaeomsa Tri-kaya Buddha images was found in the repository within Sakyamuni Buddha. It lists the names of participants, including royal family members (i.e., prince Yi Guang, the eighth son of King Seon-jo), and their relatives (i.e., Sin Ik-seong, son-in-law of King Seonjo), court ladies, monk-sculptors, and large numbers of monks and laymen Buddhists. A prayer text (dated 1634) listing the names of monk-sculptors written on the wooden panel inside the pedestal of Rushana Buddha was also found. A recent investigation into the repository within Rushana Buddha in 2020 CE has revealed a prayer text listing participants producing these images, similar to the former one from Sakyamuni Buddha, together with sacred relics of hoo-ryeong-tong copper bottle and a large quantity of Sutra books. These new materials opened a way to understand Hwaeomsa Trikaya images, including who made them and when they were made. The two above-mentioned prayer texts from the repository of Sakyamuni and Rushana Buddha statues, and the wooden panel inside the pedestal of Rushan Buddha tell us that eighteen monk-sculptors, including Eungwon, Cheongheon and Ingyun, who were well-known monk artisans of the 17th century, took part in the construction of these images. As a matter of fact, Cheongheon belonged to a different workshop from Eungwon and Ingyun, who were most likely teacher and disciple or senior and junior colleagues, which means that the production of Hwaeomsa Tri-kaya Buddha images was a collaboration between sculptors from two workshops. Eungwon and Ingyun seem to have belonged to the same community studying under the great Buddhist priest Seonsu, the teacher of Monk Gakseong who was in charge of the reconstruction of Haweonsa temple. Hwaeomsa Tri-kaya Buddha images show a big head, a squarish face with plump cheeks, narrow and drooping shoulders, and a short waist, which depict significant differences in body proportion to those of other Buddha statues of the first half of 17th century, which typically have wide shoulders and long waists. The body proportion shown in the Hwaeomsa images could be linked with images of late Goryeo and early Joseon period. Rushana Buddha, raising his two arms in a preaching hand gesture and wearing a crown and bracelets, shows unique iconography of the Bodhisattva form. This iconography of Rushana Buddha had appeared in a few Sutra paintings of Northern Song and Late Goryeo period of 13th and 14th century. BodhaSri-mudra of Vairocana Buddha, unlike the general type of BodhaSri-mudra that shows the right hand holding the left index finger, places his right hand upon the left hand in a fist. It is similar to that of Vairocana images of Northern and Southern Song, whose left hand is placed on the top of right hand in a fist. This type of mudra was most likely introduced during the Goryeo period. The dried lacquer Seated Vairocana image of Bulheosa Temple in Naju is datable to late Goryeo period, and exhibits similar forms of the mudra. Hwaeomsa Tri-kaya Buddha images also show new iconographic aspects, as well as traditional stylistic and iconographic features. The earth-touching (bhumisparsa) mudra of Sakymuni Buddha, putting his left thumb close to the middle finger, as if to make a preaching mudra, can be regarded as a new aspect that was influenced by the Sutra illustrations of the Ming dynasty, which were imported by the royal court of Joseon dynasty and most likely had an impact on Joseon Buddhist art from the 15th and 16th centuries. Stylistic and iconographical features of Hwaeomsa Tri-kaya Buddha images indicate that the traditional aspects of Goryeo period and new iconography of Joseon period are rendered together, side by side, in these sculptures. The coexistence of old and new aspects in one set of images could indicate that monk sculptors tried to find a new way to produce Hwaeomsa images based on the old traditional style of Goryeo period when the original Tri-kaya Buddha images were made, although some new iconography popular in Joseon period was also employed in the images. It is also probable that monk sculptors of Hwaeomsa Tri-kaya Buddha images intended to reconstruct these images following the original images of Goryeo period, which was recollected by surviving monks at Hwaeomsa, who had witnessed the original Tri-kaya Buddha images.

A Study on Directionality in Modern Utilization of 『Natya sastra』 -Focused on Facial Expression Acting Techniques- (『나띠야 샤스뜨라』의 현대적 활용에 대한 방향성 고찰 -표정연기술을 중심으로-)

  • Ahn, Jae-Beom
    • The Journal of the Korea Contents Association
    • /
    • v.17 no.12
    • /
    • pp.408-416
    • /
    • 2017
  • This researcher looked at the characteristics of "$N\bar{a}tya$ $\acute{s}\bar{a}stra$" acting techniques focused on body expressions and sought to utilize it as training method for modern actors. 'Body postponement as a symbol' is a key characteristic of "$N\bar{a}tya$ $\acute{s}\bar{a}stra$" acting techniques, and each facial expression, gesture, and movement performed by an actor has a specific meaning. Therefore, the study on "$N\bar{a}tya$ $\acute{s}\bar{a}stra$" has been treated as a major study mainly in the non-realistic expression style or the body-centered acting theory. Therefore, a study on "$N\bar{a}tya$ $\acute{s}\bar{a}stra$" acting techniques was mainly dealt with as a major research subject in the nonrealistic expression style or body-centered acting theory. This study, on the other hand, emphasized the importance of research on the utilization plan of actor training, which can be usually used in realistic plays as well as non-realistic plays. According to psychologists such as Damasio and Eckman, internal impulses can also be triggered through expressions and actions associated with emotions. In addition, not only acting through the actor's inner impulse, but also expression of the actor's faithful external emotion can trigger the emotion of the audience. Such a case can be a psychological basis that "$N\bar{a}tya$ $\acute{s}\bar{a}stra$" acting techniques, which defines rasa and expresses it physically, can be used as a methodology to enhance inner truth. Therefore, the study on the actor training utilizing ing "$N\bar{a}tya$ $\acute{s}\bar{a}stra$" can be applied as an effective approach in the study of contemporary acting theory which intends to integrate inner impulse and external expression.

Image Processing Algorithms for DI-method Multi Touch Screen Controllers (DI 방식의 대형 멀티터치스크린을 위한 영상처리 알고리즘 설계)

  • Kang, Min-Gu;Jeong, Yong-Jin
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.3
    • /
    • pp.1-12
    • /
    • 2011
  • Large-sized multi-touch screen is usually made using infrared rays. That is because it has technical constraints or cost problems to make the screen with the other ways using such as existing resistive overlays, capacitive overlay, or acoustic wave. Using infrared rays to make multi-touch screen is easy, but is likely to have technical limits to be implemented. To make up for these technical problems, two other methods were suggested through Surface project, which is a next generation user-interface concept of Microsoft. One is Frustrated Total Internal Reflection (FTIR) which uses infrared cameras, the other is Diffuse Illumination (DI). FTIR and DI are easy to be implemented in large screens and are not influenced by the number of touch points. Although FTIR method has an advantage in detecting touch-points, it also has lots of disadvantages such as screen size limit, quality of the materials, the module for infrared LED arrays, and high consuming power. On the other hand, DI method has difficulty in detecting touch-points because of it's structural problems but makes it possible to solve the problem of FTIR. In this thesis, we study the algorithms for effectively correcting the distort phenomenon of optical lens, and image processing algorithms in order to solve the touch detecting problem of the original DI method. Moreover, we suggest calibration algorithms for improving the accuracy of multi-touch, and a new tracking technique for accurate movement and gesture of the touch device. To verify our approaches, we implemented a table-based multi touch screen.

Hand Gesture Recognition Regardless of Sensor Misplacement for Circular EMG Sensor Array System (원형 근전도 센서 어레이 시스템의 센서 틀어짐에 강인한 손 제스쳐 인식)

  • Joo, SeongSoo;Park, HoonKi;Kim, InYoung;Lee, JongShill
    • Journal of rehabilitation welfare engineering & assistive technology
    • /
    • v.11 no.4
    • /
    • pp.371-376
    • /
    • 2017
  • In this paper, we propose an algorithm that can recognize the pattern regardless of the sensor position when performing EMG pattern recognition using circular EMG system equipment. Fourteen features were extracted by using the data obtained by measuring the eight channel EMG signals of six motions for 1 second. In addition, 112 features extracted from 8 channels were analyzed to perform principal component analysis, and only the data with high influence was cut out to 8 input signals. All experiments were performed using k-NN classifier and data was verified using 5-fold cross validation. When learning data in machine learning, the results vary greatly depending on what data is learned. EMG Accuracy of 99.3% was confirmed when using the learning data used in the previous studies. However, even if the position of the sensor was changed by only 22.5 degrees, it was clearly dropped to 67.28% accuracy. The accuracy of the proposed method is 98% and the accuracy of the proposed method is about 98% even if the sensor position is changed. Using these results, it is expected that the convenience of the users using the circular EMG system can be greatly increased.

A Preliminary research on Sixth-century Wooden Buddha Images from Funan (6세기 푸난 목조불상에 대한 시론(試論))

  • Noh, Namhee
    • MISULJARYO - National Museum of Korea Art Journal
    • /
    • v.99
    • /
    • pp.10-29
    • /
    • 2021
  • This paper is an introductory study of the wooden Buddha images excavated in the Mekong Delta in present-day southern Vietnam. Approximately thirty examples of wooden Buddha images have been recovered in the Mekong Delta. As they were found among the major historic sites of Funan (the first kingdom in Southeast Asia), including Oc Eo, and likely date to the sixth century, they can be regarded as the works of Funan. Similarly to stone Buddha images, these wooden examples are considered important for their demonstration of aspects of early Buddhist sculpture in Southeast Asia. Most of these Funan wooden Buddha images are presumed to have been produced around the sixth century based on radiocarbon dating and their stylistic characteristics. This paper analyzed the iconography and style of eight examples whose forms are relatively recognizable. The eight images can be divided into four types according to their postures, dress styles, and hand gestures. They all share features of the Sarnath style of the Gupta period in India as seen in their slender bodies and the outer robe that clings to the body. However, some display a South Indian style of Buddha images in their upright posture, style of wearing a monastic robe with the right shoulder exposed, and making the vitarka mudra (preaching gesture) that is often seen in Sri Lankan Buddha images. This suggests that Buddhist sculptors in Funan devised a new style by incorporating the principal styles of Indian Buddhist sculpture. Another notable feature of these Funan images is their material, namely, wood. While none of the contemporaneous Hindu sculptures discovered from the same historic sites are made of wood, numerous Buddhist sculptures are. This paper postulates that the use of wood in Buddhist sculptures was promoted for reasons beyond ease of carving. According to the Buddhist literature, the first-ever Buddha image was the so-called 'Udayana image' made out of sandalwood. This image and its story was well-known in the Southern Dynasty of China around the sixth century. Interestingly, some auspicious sandalwood images of the Buddha was believed to have been brought into the Southern Dynasty from Funan. This suggests the possibility that the legend of the Udayana image might have been known in Funan as well and resulted in the production of wooden sculptures there.

The post-epic characteristics in Jan Lauwers' theatre -, and - (얀 라우어스(Jan Lauwers) 공연의 탈서사적 특징들 -<이사벨라의 방(Isabella's Room)>, <랍스터 가게(The Lobster Shop)>, <사슴의 집(Deer House)>을 중심으로-)

  • Nam, Jisoo
    • Journal of Korean Theatre Studies Association
    • /
    • no.48
    • /
    • pp.447-484
    • /
    • 2012
  • This study aims to analyze the characteristics of post-epic theatre in the Belgian theatre director Jan Lauwers' trilogy titled in "Happy Face/Sad Face": (2004), (2006) and (2008). I regard that it played a very important junction for him to create his own theatrical style compared to earlier years. From this period, Lauwers has tried to create his original plays in order to concentrate the story of our era and has showed to combine a variety of media such as dance, installation, video, singing etc. In this context, I would like to study his own theatricality from the three perspectives of dramaturgy, directing and acting largely based on Hans-Thies Lehmann's theory of post-epic theatre, who pointed out the significance of Lauwer's theatrical leading role very early. First, from the dramaturgical point of view, we need to pay attention to the theme of translunary death; where the living and the dead coexist on the stage. In fact, death is the theme that Lauwers has been struggling to research for quite long time. In his trilogy, the dead never exits the stage. The dead, who is not a representative tragic character, even meddles the things among or with the living and provide comments to people. As a consequence, it happens to reduce a dramaturgical strong tension, leads depreciation of suspense and produces humanism in a way. This approach helps to create his unique comical theatrical atmosphere even though he deals with the contemporary tragic issues such as war, horror and death. Second, from the directing point of view, it is worth to take a look at the polyphonic strategy in terms to applying various media. Among all the things, the arts of dancing and singing in chorus are actively applied in Lauwer's trilogy. The dance is used in individual and microscopic way, on the other hand, singing shows collective and is a macroscopic quality. The dance is the representing media to show Lauwer's simultaneous microscopic mise-en-scene. While main plot takes place around the center-stage, actors perform a dance around the off-centered stage. Instead of exiting from the stage during the performance, the actors would continue dance -sometimes more like movements- around the off-centered stage. This not only describes the narrative, but also shows how each character is engaged to the main plot or incident, and how they look into it as a character. Its simultaneous microscopic mise-en-scene intends to function such as: showing a variety moments of lives, amplifying some moments or incidents, revealing character's emotion, creating illusionary theatrical atmosphere and so on. Meanwhile, singing simple lyrics and tunes are an example of the media to stimulate the audiences' catharsis. As the simple melody lingers in the audiences' mind, it ends up delivering a theatrical message or theme after the performance. This message would be transferred from the singing in chorus functions as a sort of leitmotive in order to make an impression to the audience. This not only richens their emotion but also creates an illusionary effect. Third, from the acting perspective, I'd like to point out the "detachment" aesthetic which Lehmann has pointed out. The actors never go deep into the drama by consistently doing recognize a theatrical illusion. The audience happens to pay attention to their presence through the actor's deliberate gesture, business, movement, rhythm, language, dance etc. The actors are against forming closed action by speaking in various languages or by revealing deliberately stage directions or acts, and by creating expressive mise-en-scene with multiple media. As a consequent, the stage can be transformed to not a metaphoric but a metonymic place. These actions are the ultimate intention for a direct effect to the audience. So to speak, Lauwers uses the anti-illusionary theatrical method: the scenes of fantastic death, interruption of singing and dance, speaking many kinds of languages, acting in detachment-status and so on. These strategies function to make cracks in spectators' desire who has a desire to construct a linear narrative. I'd like to say that it is the numerous potentiality to let the reality penetrate though and collide the reality with a fiction. By doing so, it induces for spectators to see the reality in the fiction. As Lehmann says, "when theatre presents itself as a sketch and not as a finished painting, the spectators are given the chance to feel their own presence, to reflect on it, and to contribute to the unfinished character themselves". In this sense the spectators can perform an objective criticism on our society and world in Lauwer's theatre because there are a number of gaps and cracks in his theatrical illusion where reality can penetrate. This is also the point that we can find out the artists' responsibility in this era of our being.