• Title/Summary/Keyword: handwritten

Search Result 353, Processing Time 0.024 seconds

Accelerometer-based Gesture Recognition for Robot Interface (로봇 인터페이스 활용을 위한 가속도 센서 기반 제스처 인식)

  • Jang, Min-Su;Cho, Yong-Suk;Kim, Jae-Hong;Sohn, Joo-Chan
    • Journal of Intelligence and Information Systems
    • /
    • v.17 no.1
    • /
    • pp.53-69
    • /
    • 2011
  • Vision and voice-based technologies are commonly utilized for human-robot interaction. But it is widely recognized that the performance of vision and voice-based interaction systems is deteriorated by a large margin in the real-world situations due to environmental and user variances. Human users need to be very cooperative to get reasonable performance, which significantly limits the usability of the vision and voice-based human-robot interaction technologies. As a result, touch screens are still the major medium of human-robot interaction for the real-world applications. To empower the usability of robots for various services, alternative interaction technologies should be developed to complement the problems of vision and voice-based technologies. In this paper, we propose the use of accelerometer-based gesture interface as one of the alternative technologies, because accelerometers are effective in detecting the movements of human body, while their performance is not limited by environmental contexts such as lighting conditions or camera's field-of-view. Moreover, accelerometers are widely available nowadays in many mobile devices. We tackle the problem of classifying acceleration signal patterns of 26 English alphabets, which is one of the essential repertoires for the realization of education services based on robots. Recognizing 26 English handwriting patterns based on accelerometers is a very difficult task to take over because of its large scale of pattern classes and the complexity of each pattern. The most difficult problem that has been undertaken which is similar to our problem was recognizing acceleration signal patterns of 10 handwritten digits. Most previous studies dealt with pattern sets of 8~10 simple and easily distinguishable gestures that are useful for controlling home appliances, computer applications, robots etc. Good features are essential for the success of pattern recognition. To promote the discriminative power upon complex English alphabet patterns, we extracted 'motion trajectories' out of input acceleration signal and used them as the main feature. Investigative experiments showed that classifiers based on trajectory performed 3%~5% better than those with raw features e.g. acceleration signal itself or statistical figures. To minimize the distortion of trajectories, we applied a simple but effective set of smoothing filters and band-pass filters. It is well known that acceleration patterns for the same gesture is very different among different performers. To tackle the problem, online incremental learning is applied for our system to make it adaptive to the users' distinctive motion properties. Our system is based on instance-based learning (IBL) where each training sample is memorized as a reference pattern. Brute-force incremental learning in IBL continuously accumulates reference patterns, which is a problem because it not only slows down the classification but also downgrades the recall performance. Regarding the latter phenomenon, we observed a tendency that as the number of reference patterns grows, some reference patterns contribute more to the false positive classification. Thus, we devised an algorithm for optimizing the reference pattern set based on the positive and negative contribution of each reference pattern. The algorithm is performed periodically to remove reference patterns that have a very low positive contribution or a high negative contribution. Experiments were performed on 6500 gesture patterns collected from 50 adults of 30~50 years old. Each alphabet was performed 5 times per participant using $Nintendo{(R)}$ $Wii^{TM}$ remote. Acceleration signal was sampled in 100hz on 3 axes. Mean recall rate for all the alphabets was 95.48%. Some alphabets recorded very low recall rate and exhibited very high pairwise confusion rate. Major confusion pairs are D(88%) and P(74%), I(81%) and U(75%), N(88%) and W(100%). Though W was recalled perfectly, it contributed much to the false positive classification of N. By comparison with major previous results from VTT (96% for 8 control gestures), CMU (97% for 10 control gestures) and Samsung Electronics(97% for 10 digits and a control gesture), we could find that the performance of our system is superior regarding the number of pattern classes and the complexity of patterns. Using our gesture interaction system, we conducted 2 case studies of robot-based edutainment services. The services were implemented on various robot platforms and mobile devices including $iPhone^{TM}$. The participating children exhibited improved concentration and active reaction on the service with our gesture interface. To prove the effectiveness of our gesture interface, a test was taken by the children after experiencing an English teaching service. The test result showed that those who played with the gesture interface-based robot content marked 10% better score than those with conventional teaching. We conclude that the accelerometer-based gesture interface is a promising technology for flourishing real-world robot-based services and content by complementing the limits of today's conventional interfaces e.g. touch screen, vision and voice.

Formative Stages of Establishing Royal Tombs Steles and Kings' Calligraphic Tombstones in Joseon Dynasty (조선시대 능비(陵碑)의 건립과 어필비(御筆碑)의 등장)

  • Hwang, Jung Yon
    • Korean Journal of Heritage: History & Science
    • /
    • v.42 no.4
    • /
    • pp.20-49
    • /
    • 2009
  • This paper explores the Korean royal tombs steles such as monumental steles and tombstone marks (神道碑, 表石) that are broadly fallen into the following three periods ; the 15~16th centuries, 17th~18th centuries, and 19th century. As a result, the royal tombs steles were built, unlike the private custom, on the heirs to the King's intentions. During the 15~17th centuries the construction and reconstruction of the monumental steles took place. In the late Joseon period, monumental steles had been replaced with a number of tombstone marks were built to appeal to the king's calligraphy carved on stone for the first time. During the Great Empire Han(大韓帝國) when the Joseon state was upgraded the empire, Emperors Gojong and Sunjong devoted to honor ancestors by rebuilding royal tombstone mark. Based on these periodical trends, it would not be exaggerated that the history of establishing the royal tombs steles formed in late Joseon. The type of royal tombs monuments originated from those of the Three Kingdoms era, a shapeless form, the new stele type of the Tang Dynasty (唐碑) has influenced on the building of monuments of the Unified Silla and Buddhist honorable monuments (塔碑) of the Goryeo Dynasty. From the 15th century, successive kings have wished to express the predecessors's achievements, nevertheless, the officials opposed it because the affairs of the King legacy (國史) were all recorded, so there is no need to establish the tombs steles. Although its lack of quantity, each Heonneung and Jereung monumental steles rebuilt in 1695 and 1744 respectively, is valuable to show the royal sculpture of the late Joseon period. Since the 15th century, the construction of the royal tombs monumental steles has been interrupted, the tombstone marks (boulders) with simpler format began to be erected within the tomb precincts. The Yeoneung tombstone mark(寧陵表石), built in 1682, shows the first magnificent scale and delicate sculpture technique. Many tombstone marks were erected since the 1740s on a large scale, largely caused by King Yeongjo's announce to the honorific business for the predecessors. Thanks to King Yeongjo's such appealing effort, over 20 pieces of tombstone marks were established during his reign. The fact that his handwritten calligraphic works first carved on tombstones was a remarkable phenomenon had never been appeared before. Since the 18th century, a double-slab high above the roof(加?石) and rectangular basement of the stele have been accepted as a typical format of the tombstone marks. In front of the stele, generally seal script calligraphic works after a Tang dynasty calligrapher Li Yangbing(李陽氷)'s brushwork were engraved. In 1897 when King Gojong declared the Empire, these tombstone marks were once again produced in large amounts. Because he tried to find the legitimacy of the Empire in the history of the Joseon dynasty and its four founding fathers in creating the monuments both of the front and back sides by carving his in-person-calligraphy as a ruler representing his symbolic authority. The tombstone marks made during this period, show an abstract sculpture features with the awkward techniques, and long and slim strokes. As mentioned above, the construction of monumental steles and tombstone marks is a historical and remarkable phenonenon to reveal the royal funeral custom, sculpture techniques, and successive kings' efforts to honor the royal predecessors.

Bibliographic Study on 『ChungMinKongKeicho (忠愍公啓草)』 by YI Sun-sin (이순신의 『충민공계초(忠愍公啓草)』에 대한 서지적 고찰)

  • Ro, Seung-Suk
    • Korean Journal of Heritage: History & Science
    • /
    • v.49 no.2
    • /
    • pp.4-19
    • /
    • 2016
  • Jangkei(狀啓) made to the Royal Court by Yi Sun-sin during the Japanese invasions of Korea is handed down under the names of Jangcho(狀草), Keicho(啓草), Keibon(啓本) and others depending on copying patterns of those times and later times as it was copied out by a third person. In particular, "YimjinJangcho(壬辰狀草)" which Yi drew up during his service as the director of the naval forces in Jeolla Jwasooyeong is known as the most popular Jangkei. "ChungMinKongKeicho" which has been re-located recently after loss is a national treasure level cultural property as valuable as "YimjinJangcho" and should be treated as a model of Yi Sun-sin's other Jangkeis by next generations. As of now, however it is not confirmed if it is a totally new book related to Yi Sun-sin or is supplementary to the lost Jangkei, this study decided to ascertain relevant information through a bibliographic discussion on the question. "Chungmin(忠愍)" was the title that was used after the death of Yi Sun-sin, and "ChungMinKongKeicho" was completed when Jangkei was copied in 1662. 12 books that would not be found in YimjinJangcho are included in the book and such books are also present in the Jangkei supplement which has been known lost so far. What should be especially focused on here is that the forms and contents of these (11) photographs that Japanese shot from "ChungMinKongKeicho" in 1928 turned out to be completely identical to those of the original copy. The point that Korean History Compilation Committee added the 12 books to Jangkei as referring to the book as "One Keicho(啓草) partially copied(抄寫) in separation" and that Cho Sung-do categorized the 12 books into a supplement and others can be solid proofs to make the Jangkei supplement called "ChungMinKongKeicho". In terms of "ChungMooKongKeicho", since it consists of 62 books in total, it is not reasonable to see the book as Jangkei supplement which has the extra 12 more books for itself. "ChungMooKongKeibon" in "ChungMooKongYusa" was written with a total of 16 books. In the body, Yidumun is only clearly present, and the three books in the later part are same with the original copy of "ChungMooKongKeicho". "YimjinJangcho" by Korean History Compilation Committee has been the only book in which Yidumun was observed so far but now, it is assumed that the publication date of "ChungMooKongKeibon" goes before that of the former. The counterargument to the opinion that "ChungMinKongKeicho" is the supplement to Jangkei is based on Lee Eun-sang's comment "One page of a log in the Jangkei copy supplement." At first Seol Ui-sik introduced a piece photo of the rough draft of "MoosulIlki" in a drawing form through "Nanjung Ilkicho by Yi Sun-sin" in 1953. Lee Eun-sang also added two pages of the handwritten Yilkicho in the Jangkeichobon supplement to "MoosulIlki" and for the second time, the phrase "One page of a log written during the last 10 days after the Jangkei copy supplement" and "Supplement" were used. Those views are originated from the comment "One photograph of the rough draft of "MoosulIlki"" which Seol Ui-sik introduced without knowledge of the exact source. Lee Eun-sang said, "One page of a log in the Jangkei copy supplement" because Lee mistook "ChungMooKongYusa" for a book related to Jangkei. Since it is the wrong argument different from the actual situation of the original copy, if it has to be corrected, it should be rephrased "One page of a log in ChungMooKongYusa." After all, the source of the counterargument is the mistake because there has never been the Jangkei supplement with one page of a log included. All the Jangkeis other than "YimjinJangcho" can be said as the Jangkei supplements but still, they are separated from the other Jangkeis for the extra 12 more books are present in the commonly-called Jangkei supplement. Due to that reason, the argument on how "ChungMinKongKeicho" with the 12 books added is the popular Jangkei supplement should be considered more reasonable.