• Journal of Intelligence and Information Systems
• /
• v.26 no.2
• /
• pp.79-104
• /
• 2020

Recently, as deep learning has attracted attention, the use of deep learning is being considered as a method for solving problems in various fields. In particular, deep learning is known to have excellent performance when applied to applying unstructured data such as text, sound and images, and many studies have proven its effectiveness. Owing to the remarkable development of text and image deep learning technology, interests in image captioning technology and its application is rapidly increasing. Image captioning is a technique that automatically generates relevant captions for a given image by handling both image comprehension and text generation simultaneously. In spite of the high entry barrier of image captioning that analysts should be able to process both image and text data, image captioning has established itself as one of the key fields in the A.I. research owing to its various applicability. In addition, many researches have been conducted to improve the performance of image captioning in various aspects. Recent researches attempt to create advanced captions that can not only describe an image accurately, but also convey the information contained in the image more sophisticatedly. Despite many recent efforts to improve the performance of image captioning, it is difficult to find any researches to interpret images from the perspective of domain experts in each field not from the perspective of the general public. Even for the same image, the part of interests may differ according to the professional field of the person who has encountered the image. Moreover, the way of interpreting and expressing the image also differs according to the level of expertise. The public tends to recognize the image from a holistic and general perspective, that is, from the perspective of identifying the image's constituent objects and their relationships. On the contrary, the domain experts tend to recognize the image by focusing on some specific elements necessary to interpret the given image based on their expertise. It implies that meaningful parts of an image are mutually different depending on viewers' perspective even for the same image. So, image captioning needs to implement this phenomenon. Therefore, in this study, we propose a method to generate captions specialized in each domain for the image by utilizing the expertise of experts in the corresponding domain. Specifically, after performing pre-training on a large amount of general data, the expertise in the field is transplanted through transfer-learning with a small amount of expertise data. However, simple adaption of transfer learning using expertise data may invoke another type of problems. Simultaneous learning with captions of various characteristics may invoke so-called 'inter-observation interference' problem, which make it difficult to perform pure learning of each characteristic point of view. For learning with vast amount of data, most of this interference is self-purified and has little impact on learning results. On the contrary, in the case of fine-tuning where learning is performed on a small amount of data, the impact of such interference on learning can be relatively large. To solve this problem, therefore, we propose a novel 'Character-Independent Transfer-learning' that performs transfer learning independently for each character. In order to confirm the feasibility of the proposed methodology, we performed experiments utilizing the results of pre-training on MSCOCO dataset which is comprised of 120,000 images and about 600,000 general captions. Additionally, according to the advice of an art therapist, about 300 pairs of 'image / expertise captions' were created, and the data was used for the experiments of expertise transplantation. As a result of the experiment, it was confirmed that the caption generated according to the proposed methodology generates captions from the perspective of implanted expertise whereas the caption generated through learning on general data contains a number of contents irrelevant to expertise interpretation. In this paper, we propose a novel approach of specialized image interpretation. To achieve this goal, we present a method to use transfer learning and generate captions specialized in the specific domain. In the future, by applying the proposed methodology to expertise transplant in various fields, we expected that many researches will be actively conducted to solve the problem of lack of expertise data and to improve performance of image captioning.

• (The) Research of the performance art and culture
• /
• no.20
• /
• pp.5-30
• /
• 2010

It has been diversified and serious attempt to establish the identity of Changgeuk, but it is still independent dramaturgy or the current unformed progressive art. In this situation, exploring works of the identity of changgeuk that is base on the performed individual and specific works in the title of Changgeuk is needed. The 80s and 90s Heo, Gyu was leading an active life as a director who was responsible for directing of Changgeuk. He dramatized Siljeon Pansori -which is a group of Pansori missing text- as well as 5-remained Songs in Pansori and he presented a number of creative Changgeuk works on stage. Especially, the completion of dramatizing 5-remained Songs in Pansori under the name of 'Wanpan Changgeuk -which means full version performance without omit-' is the one of his big achievement by performing "Heungbojeon" on the stage 1982 and "Jeokbyeokga" 1985. The purposes of this research are confirmation of Heo's direction of the formulation and considering its characteristics & significance through 'Wanpan Changgeuk' which written by Heo. Heo was a practical play who was interested in the subjective formulation of national culture and creative transmission for Korean traditional performance. He tried to formulate Changgeuk to a representative performance of Korea. In the process he pointed out those problems, (1) interpretation of a work problem, (2) actor's creative problems, (3) structure problem of theater for Changgeuk. He indicated that the other challenges are to use of the stage & device, to overcome sentimentalism, to stylize acting, to improve own quality, to control the speed and length of the song, to choose the suitable musical accompaniment, to create new repertories problems, and etc. Changgeuk is classified in 3 group by origin, (1)dramatizing of 5-remained Songs, (2)dramatizing of 7-missing Songs, (3)creative dramatizing. It contains all of 3 types that Heo's work. The dramatizing of remained 5 Songs are the great importance among those works. Heo hoped that Chaggeuk has become the most representative art work of Korea by performing 'Wanpan Changgeuk' compiled heritage of Korea's outstanding artistic achievement. The characteristics of 'Wanpan Changgeuk' can be summarized following four. (1) Directing attitudes that emphasizes tradition, (2) Accepting the elements of traditional performance actively, (3) Valuing the classy and ethic, (4) Emphasizing humor and active utilizing of the secondary characters. Heo's 'Wanpan Changgeuk' shows a peak of the artistic level which Changgeuk can be reached. He want to make Changgeuk a Korean representative artistic performance by compiling Pansori heritage and accommodating Korean traditional performance. Heo continued his effort to present Pansori's authenticity and to dramatize from beginning to end without missing. It shows very well that 'Wanpan Changgeuk' takes 4~5 hours for playing. It looks Heo's achievement in the 'Wanpan Changgeuk' influenced Changgeuk significantly since then. Heo's 'Wanpan Changgeuk' is matrix of 'Wanpan JangMak Changgeuk' attempted in the 1990s. Especially, their intent is consistent to synthesize texts and to show all the virtue of Pansori. But 90's 'Wanpan JangMak Changgeuk' aim for large stage, fancy device & costume and variety contents compared with 'Wanpan Changgeuk'. Recently, producers have tried not to make a impressive Changgeuk but to make a interesting one. They usually organize performance within 2 hours and prefer orchestral music to its unique sound. In those point of view, it seems that Heo's idle in 'Wanpan Changgeuk' has become one of target to conquer in these days.

• MISULJARYO - National Museum of Korea Art Journal
• /
• v.96
• /
• pp.123-154
• /
• 2019

Ancestral Burial Ground on the Inwangsan Mountain is a ten-panel folding screen with images and postscripts. Commissioned by Bak Gyeong-bin (dates unknown), this screen was painted by Jo Jung-muk (1820-after 1894) in 1868. The postscripts were written by Hong Seon-ju (dates unknown). The National Museum of Korea restored this painting, which had been housed in the museum on separate sheets, to its original folding screen format. The museum also opened the screen to the public for the first time at the special exhibition Through the Eyes of Joseon Painters: Real Scenery Landscapes of Korea held from July 23 to September 22, 2019. Ancestral Burial Ground on the Inwangsan Mountain depicts real scenery on the western slopes of Inwangsan Mountain spanning present-day Hongje-dong and Hongeun-dong in Seodaemun-gu, Seoul. In the distance, the Bukhansan Mountain ridges are illustrated. The painting also bears place names, including Inwangsan Mountain, Chumohyeon Hill, Hongjewon Inn, Samgaksan Mountain, Daenammun Gate, and Mireukdang Hall. The names and depictions of these places show similarities to those found on late Joseon maps. Jo Jung-muk is thought to have studied the geographical information marked on maps so as to illustrate a broad landscape in this painting. Field trips to the real scenery depicted in the painting have revealed that Jo exaggerated or omitted natural features and blended and arranged them into a row for the purposes of the horizontal picture plane. Jo Jung-muk was a painter proficient at drawing conventional landscapes in the style of the Southern School of Chinese painting. Details in Ancestral Burial Ground on the Inwangsan Mountain reflect the painting style of the School of Four Wangs. Jo also applied a more decorative style to some areas. The nineteenth-century court painters of the Dohwaseo(Royal Bureau of Painting), including Jo, employed such decorative painting styles by drawing houses based on painting manuals, applying dots formed like sprinkled black pepper to depict mounds of earth and illustrating flowers by dotted thick pigment. Moreover, Ancestral Burial Ground on the Inwangsan Mountain shows the individualistic style of Jeong Seon(1676~1759) in the rocks drawn with sweeping brushstrokes in dark ink, the massiveness of the mountain terrain, and the pine trees simply depicted using horizontal brushstrokes. Jo Jung-muk is presumed to have borrowed the authority and styles of Jeong Seon, who was well-known for his real scenery landscapes of Inwangsan Mountain. Nonetheless, the painting lacks an spontaneous sense of space and fails in conveying an impression of actual sites. Additionally, the excessively grand screen does not allow Jo Jung-muk to fully express his own style. In Ancestral Burial Ground on the Inwangsan Mountain, the texts of the postscripts nicely correspond to the images depicted. Their contents can be divided into six parts: (1) the occupant of the tomb and the reason for its relocation; (2) the location and geomancy of the tomb; (3) memorial services held at the tomb and mysterious responses received during the memorial services; (4) cooperation among villagers to manage the tomb; (5) the filial piety of Bak Gyeong-bin, who commissioned the painting and guarded the tomb; and (6) significance of the postscripts. The second part in particular is faithfully depicted in the painting since it can easily be visualized. According to the fifth part revealing the motive for the production of the painting, the commissioner Bak Gyeongbin was satisfied with the painting, stating that "it appears impeccable and is just as if the tomb were newly built." The composition of the natural features in a row as if explaining each one lacks painterly beauty, but it does succeed in providing information on the geomantic topography of the gravesite. A fair number of the existing depictions of gravesites are woodblock prints of family gravesites produced after the eighteenth century. Most of these are included in genealogical records and anthologies. According to sixteenth- and seventeenth-century historical records, hanging scrolls of family gravesites served as objects of worship. Bowing in front of these paintings was considered a substitute ritual when descendants could not physically be present to maintain their parents' or other ancestors' tombs. Han Hyo-won (1468-1534) and Jo Sil-gul (1591-1658) commissioned the production of family burial ground paintings and asked distinguished figures of the time to write a preface for the paintings, thus showing off their filial piety. Such examples are considered precedents for Ancestral Burial Ground on the Inwangsan Mountain. Hermitage of the Recluse Seokjeong in a private collection and Old Villa in Hwagae County at the National Museum of Korea are not paintings of family gravesites. However, they serve as references for seventeenth-century paintings depicting family gravesites in that they are hanging scrolls in the style of the paintings of literary gatherings and they illustrate geomancy. As an object of worship, Ancestral Burial Ground on the Inwangsan Mountain recalls a portrait. As indicated in the postscripts, the painting made Bak Gyeong-bin "feel like hearing his father's cough and seeing his attitudes and behaviors with my eyes." The fable of Xu Xiaosu, who gazed at the portrait of his father day and night, is reflected in this gravesite painting evoking a deceased parent. It is still unclear why Bak Gyeong-bin commissioned Ancestral Burial Ground on the Inwangsan Mountain to be produced as a real scenery landscape in the folding screen format rather than a hanging scroll or woodblock print, the conventional formats for a family gravesite paintings. In the nineteenth century, commoners came to produce numerous folding screens for use during the four rites of coming of age, marriage, burial, and ancestral rituals. However, they did not always use the screens in accordance with the nature of these rites. In the Ancestral Burial Ground on the Inwangsan Mountain, the real scenery landscape appears to have been emphasized more than the image of the gravesite in order to allow the screen to be applied during different rituals or for use to decorate space. The burial mound, which should be the essence of Ancestral Burial Ground on the Inwangsan Mountain, might have been obscured in order to hide its violation of the prohibition on the construction of tombs on the four mountains around the capital. At the western foot of Inwangsan Mountain, which was illustrated in this painting, the construction of tombs was forbidden. In 1832, a tomb discovered illegally built on the forbidden area was immediately dug up and the related people were severely punished. This indicates that the prohibition was effective until the mid-nineteenth century. The postscripts on the Ancestral Burial Ground on the Inwangsan Mountain document in detail Bak Gyeong-bin's efforts to obtain the land as a burial site. The help and connivance of villagers were necessary to use the burial site, probably because constructing tombs within the prohibited area was a burden on the family and villagers. Seokpajeong Pavilion by Yi Han-cheol (1808~1880), currently housed at the Los Angeles County Museum of Art, is another real scenery landscape in the format of a folding screen that is contemporaneous and comparable with Ancestral Burial Ground on the Inwangsan Mountain. In 1861 when Seokpajeong Pavilion was created, both Yi Han-cheol and Jo Jung-muk participated in the production of a portrait of King Cheoljong. Thus, it is highly probable that Jo Jung-muk may have observed the painting process of Yi's Seokpajeong Pavilion. A few years later, when Jo Jungmuk was commissioned to produce Ancestral Burial Ground on the Inwangsan Mountain, his experience with the impressive real scenery landscape of the Seokpajeong Pavilion screen could have been reflected in his work. The difference in the painting style between these two paintings is presumed to be a result of the tastes and purposes of the commissioners. Since Ancestral Burial Ground on the Inwangsan Mountain contains the multilayered structure of a real scenery landscape and family gravesite, it seems to have been perceived in myriad different ways depending on the viewer's level of knowledge, closeness to the commissioner, or viewing time. In the postscripts to the painting, the name and nickname of the tomb occupant as well as the place of his surname are not recorded. He is simply referred to as "Mister Bak." Biographical information about the commissioner Bak Gyeong-bin is also unavailable. However, given that his family did not enter government service, he is thought to have been a person of low standing who could not become a member of the ruling elite despite financial wherewithal. Moreover, it is hard to perceive Hong Seon-ju, who wrote the postscripts, as a member of the nobility. He might have been a low-level administrative official who belonged to the Gyeongajeon, as documented in the Seungjeongwon ilgi (Daily Records of Royal Secretariat of the Joseon Dynasty). Bak Gyeong-bin is presumed to have moved the tomb of his father to a propitious site and commissioned Ancestral Burial Ground on the Inwangsan Mountain to stress his filial piety, a conservative value, out of his desire to enter the upper class. However, Ancestral Burial Ground on the Inwangsan Mountain failed to live up to its original purpose and ended up as a contradictory image due to its multiple applications and the concern over the exposure of the violation of the prohibition on the construction of tombs on the prohibited area. Forty-seven years after its production, this screen became a part of the collection at the Royal Yi Household Museum with each panel being separated. This suggests that Bak Gyeong-bin's dream of bringing fortune and raising his family's social status by selecting a propitious gravesite did not come true.