• Title/Summary/Keyword: Primary System

Search Result 5,243, Processing Time 0.03 seconds

Transfer Learning using Multiple ConvNet Layers Activation Features with Principal Component Analysis for Image Classification (전이학습 기반 다중 컨볼류션 신경망 레이어의 활성화 특징과 주성분 분석을 이용한 이미지 분류 방법)

  • Byambajav, Batkhuu;Alikhanov, Jumabek;Fang, Yang;Ko, Seunghyun;Jo, Geun Sik
    • Journal of Intelligence and Information Systems
    • /
    • v.24 no.1
    • /
    • pp.205-225
    • /
    • 2018
  • Convolutional Neural Network (ConvNet) is one class of the powerful Deep Neural Network that can analyze and learn hierarchies of visual features. Originally, first neural network (Neocognitron) was introduced in the 80s. At that time, the neural network was not broadly used in both industry and academic field by cause of large-scale dataset shortage and low computational power. However, after a few decades later in 2012, Krizhevsky made a breakthrough on ILSVRC-12 visual recognition competition using Convolutional Neural Network. That breakthrough revived people interest in the neural network. The success of Convolutional Neural Network is achieved with two main factors. First of them is the emergence of advanced hardware (GPUs) for sufficient parallel computation. Second is the availability of large-scale datasets such as ImageNet (ILSVRC) dataset for training. Unfortunately, many new domains are bottlenecked by these factors. For most domains, it is difficult and requires lots of effort to gather large-scale dataset to train a ConvNet. Moreover, even if we have a large-scale dataset, training ConvNet from scratch is required expensive resource and time-consuming. These two obstacles can be solved by using transfer learning. Transfer learning is a method for transferring the knowledge from a source domain to new domain. There are two major Transfer learning cases. First one is ConvNet as fixed feature extractor, and the second one is Fine-tune the ConvNet on a new dataset. In the first case, using pre-trained ConvNet (such as on ImageNet) to compute feed-forward activations of the image into the ConvNet and extract activation features from specific layers. In the second case, replacing and retraining the ConvNet classifier on the new dataset, then fine-tune the weights of the pre-trained network with the backpropagation. In this paper, we focus on using multiple ConvNet layers as a fixed feature extractor only. However, applying features with high dimensional complexity that is directly extracted from multiple ConvNet layers is still a challenging problem. We observe that features extracted from multiple ConvNet layers address the different characteristics of the image which means better representation could be obtained by finding the optimal combination of multiple ConvNet layers. Based on that observation, we propose to employ multiple ConvNet layer representations for transfer learning instead of a single ConvNet layer representation. Overall, our primary pipeline has three steps. Firstly, images from target task are given as input to ConvNet, then that image will be feed-forwarded into pre-trained AlexNet, and the activation features from three fully connected convolutional layers are extracted. Secondly, activation features of three ConvNet layers are concatenated to obtain multiple ConvNet layers representation because it will gain more information about an image. When three fully connected layer features concatenated, the occurring image representation would have 9192 (4096+4096+1000) dimension features. However, features extracted from multiple ConvNet layers are redundant and noisy since they are extracted from the same ConvNet. Thus, a third step, we will use Principal Component Analysis (PCA) to select salient features before the training phase. When salient features are obtained, the classifier can classify image more accurately, and the performance of transfer learning can be improved. To evaluate proposed method, experiments are conducted in three standard datasets (Caltech-256, VOC07, and SUN397) to compare multiple ConvNet layer representations against single ConvNet layer representation by using PCA for feature selection and dimension reduction. Our experiments demonstrated the importance of feature selection for multiple ConvNet layer representation. Moreover, our proposed approach achieved 75.6% accuracy compared to 73.9% accuracy achieved by FC7 layer on the Caltech-256 dataset, 73.1% accuracy compared to 69.2% accuracy achieved by FC8 layer on the VOC07 dataset, 52.2% accuracy compared to 48.7% accuracy achieved by FC7 layer on the SUN397 dataset. We also showed that our proposed approach achieved superior performance, 2.8%, 2.1% and 3.1% accuracy improvement on Caltech-256, VOC07, and SUN397 dataset respectively compare to existing work.

Preservation of World Records Heritage in Korea and Further Registry (한국의 세계기록유산 보존 현황 및 과제)

  • Kim, Sung-Soo
    • Journal of Korean Society of Archives and Records Management
    • /
    • v.5 no.2
    • /
    • pp.27-48
    • /
    • 2005
  • This study investigates the current preservation and management of four records and documentary heritage in Korea that is in the UNESCO's Memory of the World Register. The study analyzes their problems and corresponding solutions in digitizing those world records heritages. This study also reviews additional four documentary books in Korea that are in the wish list to add to UNESCO's Memory of the World Register. This study is organized as the following: Chapter 2 examines the value and meanings of world records and documentary heritage in Korea. The registry requirements and procedures of UNESCO's Memory of the World Register are examined. The currently registered records of Korea include Hunmin-Chongum, the Annals of the Choson Dynasty, the Diaries of the Royal Secretariat (Seungjeongwon Ilgi), and Buljo- Jikji-Simche-Yojeol (vol. II). These records heritage's worth and significance are carefully analyzed. For example, Hunmin-Chongum("訓民正音") is consisted of unique and systematic letters. Letters were delicately explained with examples in its original manual at the time of letter's creation, which is an unparalleled case in the world documentary history. The Annals of the Choson Dynasty("朝鮮王朝實錄") are the most comprehensive historic documents that contain the longest period of time in history. Their truthfulness and reliability in describing history give credits to the annals. The Royal Secretariat Diary (called Seungjeongwon-Ilgi("承政院日記")) is the most voluminous primary resources in history, superior to the Annals of Choson Dynasty and Twenty Five Histories in China. Jikji("直指") is the oldest existing book published by movable metal print sets in the world. It evidences the beginning of metal printing in the world printing history and is worthy of being as world heritage. The review of the four registered records confirms that they are valuable world documentary heritage that transfers culture of mankind to next generations and should be preserved carefully and safely without deterioration or loss. Chapter 3 investigates the current status of preservation and management of three repositories that store the four registered records in Korea. The repositories include Kyujanggak Archives in Seoul National University, Pusan Records and Information Center of National Records and Archives Service, and Gansong Art Museum. The quality of their preservation and management are excellent in all of three institutions by the following aspects: 1) detailed security measures are close to perfection 2) archiving practices are very careful by using a special stack room in steady temperature and humidity and depositing it in stack or archival box made of paulownia tree and 3) fire prevention, lighting, and fumigation are thoroughly prepared. Chapter 4 summarizes the status quo of digitization projects of records heritage in Korea. The most important issue related to digitization and database construction on Korean records heritage is likely to set up the standardization of digitization processes and facilities. It is urgently necessary to develop comprehensive standard systems for digitization. Two institutions are closely interested in these tasks: 1) the National Records and Archives Service experienced in developing government records management systems; and 2) the Cultural Heritage Administration interested in digitization of Korean old documents. In collaboration of these two institutions, a new standard system will be designed for digitizing records heritage on Korean Studies. Chapter 5 deals with additional Korean records heritage in the wish list for UNESCO's Memory of the World Register, including: 1) Wooden Printing Blocks(經板) of Koryo-Taejangkyong(高麗大藏經) in Haein Temple(海印寺); 2) Dongui-Bogam("東醫寶鑑") 3) Samguk-Yusa("三國遺事") and 4) Mugujeonggwangdaedaranigyeong. Their world value and importance are examined as followings. Wooden Printing Blocks of Koryo-Taejangkyong in Haein Temple is the worldly oldest wooden printing block of cannon of Buddhism that still exist and was created over 750 years ago. It needs a special conservation treatment to disinfect germs residing in surface and inside of wooden plates. Otherwise, it may be damaged seriously. For its effective conservation and preservation, we hope that UNESCO and Government will schedule special care and budget and join the list of Memory of the Word Register. Dongui-Bogam is the most comprehensive and well-written medical book in the Korean history, summarizing all medical books in Korea and China from the Ancient Times through the early 17th century and concentrating on Korean herb medicine and prescriptions. It is proved as the best clinical guidebook in the 17th century for doctors and practitioners to easily use. The book was also published in China and Japan in the 18th century and greatly influenced the development of practical clinic and medical research in Asia at that time. This is why Dongui Bogam is in the wish list to register to the Memory of the World. Samguk-Yusa is evaluated as one of the most comprehensive history books and treasure sources in Korea, which illustrates foundations of Korean people and covers histories and cultures of ancient Korean peninsula and nearby countries. The book contains the oldest fixed form verse, called Hyang-Ka(鄕歌), and became the origin of Korean literature. In particular, the section of Gi-ee(紀異篇) describes the historical processes of dynasty transition from the first dynasty Gochosun(古朝鮮) to Goguryeo(高句麗) and illustrates the identity of Korean people from its historical origin. This book is worthy of adding to the Memory of the World Register. Mugujeonggwangdaedaranigyeong is the oldest book printed by wooden type plates, and it is estimated to print in between 706 and 751. It contains several reasons and evidence to be worthy of adding to the list of the Memory of the World. It is the greatest documentary heritage that represents the first wooden printing book that still exists in the world as well as illustrates the history of wooden printing in Korea.

Analysis of the Stage and Performance Elements for Bongsudang-jinchan Banquet in Joseon Dynasty (봉수당진찬(奉壽堂進饌)의 무대와 공연 요소 분석)

  • Song, Hye-jin
    • (The) Research of the performance art and culture
    • /
    • no.18
    • /
    • pp.413-444
    • /
    • 2009
  • This paper is an analysis of stage and performance elements for the ceremonial procedures and dance featured in bongsudang-jinchan, a feast celebrating the 60th birthday of Hyegyeong-gung Hongssi (Crown Princess Hong of Hyegyeonggung), the mother of King Jeongjo, which took place in Hwaseong haegung palace in 1795. The primary sources used are data on bongsudangjinchan recorded in Wonhaeng-eulmyojeongriuigwe, Jeongjo-sillok, Hongjae-jeonseo, pictorial sources such as Folding Screens of Hwaseong-neunghaeng and Hwaseong Ilgi, which is a journal in Korean by Yi Hui-pyeong. A court ceremony to offer music, dance, flowers, and food, as well as wine and poetry which express the sentiments of chung (fidelity) and hyo (filial piety) was considered a national ceremony and has constituted a unique musical culture during the 500 years of Joseon dynasty. However, after the fall of Joseon dynasty, ceremonial music and dance, which have been organically linked within the overall symbolic system of ye (courtesy), became scattered to become independent 'pieces.' As a result, all of their philosophy, principles, and the time-space interpretation of court music and dance became greatly reduced, leaving only the artistic expression and formal structure of the music and dance to become emphasized. Since the 1990s, there has been many research and events aiming to re-create the court ceremonial tradition, resulting in the increase of the related performance activities. This is especially true with bongsudang-jinchan, which is now being performed on modern stage in various forms. However there are still many problems to be solved, such as the issue of re-creating and restoring the original, and the question of artistic value found in the traditional pieces. Until now, much focus has been paid to the outer re-construction of uiju document as recorded in Wonhaeng-eulmyo-jeongriuigwe. On the other hand, there lacked an in-depth study which analyzes the stage situation and performance elements. Therefore in this paper, after focusing on the stage structure and performance elements, it is concluded that bongsudang-jinchan, the only court feast to be held in Haeng gung, not only consists of the fundamental aspects of court performance principle as 'governing through ye and ak (music),' but also served as an important occasion to bring together the sovereign and the subject. Bongsudang-jinchan had features of both naeyeon (feast for ladies) and oeyeon (feast for gentlemen). It minimized the use of screens and allowed every guest to enjoy food, music, and dance together, but provided a separate tent for foreign guests, maintaining the ideal balance between equality and distinction among different gender and social status. A screen symbolizing the venue for the feast is placed for all of the government officials. The king then pronounces the beginning of the banquet in which the ideal of gunsin-dongyeon (king and officials dining together) is realized. This indicates that bongsudang-jinchan, compared to other court ceremonies that emphasize the principle of yeak (courtesy and music), focuses more on the spirit of harmony and rapprochement. The king played a more active role in bongsudang-jinchan than in any other royal feasts. Examples as recorded in uiju documents are; Jeongjo's conversation with his retainers after the 7th wine, king's bestowing of food and flowers to the officials, writing his own majesty's poems with regard to the festival, and asking the retainers to write replying poems. All these played an important part in making the occasion more rich, extensive, and meaningful. Moreover, as analysis of the structure of orchestral music and court dance featured in bongsudang-jinchan shows, it was like any other court banquet in that it employed minimal use of extravagance in movements and conversation. However, the colors and tonal texture used in the music and dance were more brilliant in this case. Compared to other banquets that took place before king Jeongjo, the dance style was more diverse, which included some of the latest additions. There were past performances arranged anew. Noteworthy are; the incorporation of "Seonyurak (Boat Dance)" and "Geommu (Sword Dance)," traditionally used for local officials and civilians feast, to suit the court taste; and the use of saenghwang (mouth organ), which was a rising instrument in pungnyubang (literati's private salon), for "Hakmu (Cranes Dance)." This especially indicates the nature of the 'open structure' pursued by the court banquets at the time, which strove to break away from the traditional rules and customs and accept something new.