Design and Implementation of MongoDB-based Unstructured Log Processing System over Cloud Computing Environment (클라우드 환경에서 MongoDB 기반의 비정형 로그 처리 시스템 설계 및 구현)
-
- Journal of Internet Computing and Services
- /
- v.14 no.6
- /
- pp.71-84
- /
- 2013
Log data, which record the multitude of information created when operating computer systems, are utilized in many processes, from carrying out computer system inspection and process optimization to providing customized user optimization. In this paper, we propose a MongoDB-based unstructured log processing system in a cloud environment for processing the massive amount of log data of banks. Most of the log data generated during banking operations come from handling a client's business. Therefore, in order to gather, store, categorize, and analyze the log data generated while processing the client's business, a separate log data processing system needs to be established. However, the realization of flexible storage expansion functions for processing a massive amount of unstructured log data and executing a considerable number of functions to categorize and analyze the stored unstructured log data is difficult in existing computer environments. Thus, in this study, we use cloud computing technology to realize a cloud-based log data processing system for processing unstructured log data that are difficult to process using the existing computing infrastructure's analysis tools and management system. The proposed system uses the IaaS (Infrastructure as a Service) cloud environment to provide a flexible expansion of computing resources and includes the ability to flexibly expand resources such as storage space and memory under conditions such as extended storage or rapid increase in log data. Moreover, to overcome the processing limits of the existing analysis tool when a real-time analysis of the aggregated unstructured log data is required, the proposed system includes a Hadoop-based analysis module for quick and reliable parallel-distributed processing of the massive amount of log data. Furthermore, because the HDFS (Hadoop Distributed File System) stores data by generating copies of the block units of the aggregated log data, the proposed system offers automatic restore functions for the system to continually operate after it recovers from a malfunction. Finally, by establishing a distributed database using the NoSQL-based Mongo DB, the proposed system provides methods of effectively processing unstructured log data. Relational databases such as the MySQL databases have complex schemas that are inappropriate for processing unstructured log data. Further, strict schemas like those of relational databases cannot expand nodes in the case wherein the stored data are distributed to various nodes when the amount of data rapidly increases. NoSQL does not provide the complex computations that relational databases may provide but can easily expand the database through node dispersion when the amount of data increases rapidly; it is a non-relational database with an appropriate structure for processing unstructured data. The data models of the NoSQL are usually classified as Key-Value, column-oriented, and document-oriented types. Of these, the representative document-oriented data model, MongoDB, which has a free schema structure, is used in the proposed system. MongoDB is introduced to the proposed system because it makes it easy to process unstructured log data through a flexible schema structure, facilitates flexible node expansion when the amount of data is rapidly increasing, and provides an Auto-Sharding function that automatically expands storage. The proposed system is composed of a log collector module, a log graph generator module, a MongoDB module, a Hadoop-based analysis module, and a MySQL module. When the log data generated over the entire client business process of each bank are sent to the cloud server, the log collector module collects and classifies data according to the type of log data and distributes it to the MongoDB module and the MySQL module. The log graph generator module generates the results of the log analysis of the MongoDB module, Hadoop-based analysis module, and the MySQL module per analysis time and type of the aggregated log data, and provides them to the user through a web interface. Log data that require a real-time log data analysis are stored in the MySQL module and provided real-time by the log graph generator module. The aggregated log data per unit time are stored in the MongoDB module and plotted in a graph according to the user's various analysis conditions. The aggregated log data in the MongoDB module are parallel-distributed and processed by the Hadoop-based analysis module. A comparative evaluation is carried out against a log data processing system that uses only MySQL for inserting log data and estimating query performance; this evaluation proves the proposed system's superiority. Moreover, an optimal chunk size is confirmed through the log data insert performance evaluation of MongoDB for various chunk sizes.
To obtain basic information on the Korean local corn lines a total of 57 lines were selected from 1,000 Korean local collection at Chungnam National University, classified by principal component analysis, and genetic nature was investigated. The results are summarized as follows. 1. There were a great variation in mean values of plant characters of the lines. The mean values of plant characters except for density of kernels varied with types of crossing. All characters except. for tasselling dates were reduced in magnitude when selfed, while those characters were increased when topcrossed. 2. The correlation coefficients among characters studied ranged front 0.99 to -0.59. The correlation coefficients among characters were not greatly changed depending upon types of crosses. 3. In order to classify the lines more effectively, selected 12 plant characters were used to classify 57 local lines by principal component analysis. The first four component could explain 86.4%, 83.4% and 81.1% of the total variations in sibbed lines, selfed lines and topcrossed lines, respectively. 4. Contribution of characters to principal component was high at upper principal components and low at lower principal components. 5. Biological meaning of the principal component and plant types corresponding to the each principal component were explained clearly by the correlation coefficient between principal components and characters. The first principal component appeared to correspond to the size of plant and ear. The second principal component appeared to correspond to the degree of differentiation in organs and the duration of vegetative growing period. But biological meaning of the third and fourth principal components was not clear. 6. The lines were classified into 4 lineal groups by the taxonomic distance. Group I included 52 lines which was 91.2% of total lines, group II 3 lines, group III 1 lines and group IV I lines, respectively. Four groups could be characterized as follows : Group I : early maturity, short-culmed, medium height plant, small ears, medium kernels and medium yielding. Group II : late maturity, medium height plant, small ears, small kernels, prolific ears and higher yielding. Group III : medium maturity, tall-culmed, small ears, small kernels and low yielding. Group IV : medium maturity, tall-calmed, large ears, one ear plant and me yielding. 7. The inbreeding depression varied with plant characters and lines. The characters such as yield, kernel weight per ear, ear weight and plant height showed great degree of inbreeding depression. Group I showed high inbreeding depression in such characters as 100 kernel weight, leaf number, plant height and days to tasselling, while group II showed high inbreeding depression in other plant characters. 8. Heterosis of plant characters varied also with lines. The ear weight, kernel weight per ear, yield, 100 kernel weight, and plant height were some of the plant characters showing high heterosis. Group II showed high values of heterosis in such characters as ear length, ear diameter, ear weight, kernel weight per ear, 100 kernel weight, and leaf length, while group I was high in heterosis in other plant characters. 9. The degree of homozgosity was highest in ear weight (79.1%) and lowest in ear number per plant (-21%). Group II showed higher degree of homozygosity than group I. 10. Correlation coefficients between characters of ribbed and topcrossed lines were positive for all characters. Highly significant. correlation coefficients between ribbed and topcrossed lines were obtained especially for characters such as ear number per plant, plant height, leaf length and yield per plot.
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70
The wall shear stress in the vicinity of end-to end anastomoses under steady flow conditions was measured using a flush-mounted hot-film anemometer(FMHFA) probe. The experimental measurements were in good agreement with numerical results except in flow with low Reynolds numbers. The wall shear stress increased proximal to the anastomosis in flow from the Penrose tubing (simulating an artery) to the PTFE: graft. In flow from the PTFE graft to the Penrose tubing, low wall shear stress was observed distal to the anastomosis. Abnormal distributions of wall shear stress in the vicinity of the anastomosis, resulting from the compliance mismatch between the graft and the host artery, might be an important factor of ANFH formation and the graft failure. The present study suggests a correlation between regions of the low wall shear stress and the development of anastomotic neointimal fibrous hyperplasia(ANPH) in end-to-end anastomoses. 30523 T00401030523 ^x Air pressure decay(APD) rate and ultrafiltration rate(UFR) tests were performed on new and saline rinsed dialyzers as well as those roused in patients several times. C-DAK 4000 (Cordis Dow) and CF IS-11 (Baxter Travenol) reused dialyzers obtained from the dialysis clinic were used in the present study. The new dialyzers exhibited a relatively flat APD, whereas saline rinsed and reused dialyzers showed considerable amount of decay. C-DAH dialyzers had a larger APD(11.70
This paper examines the circulation and dissemination of painting during and after the nineteenth century through a case study on the One Hundred Fans paintings produced as decorative folding screens at the time. One Hundred Fans paintings refer to depictions of layers of fans in various shapes on which pictures of diverse themes are drawn. Fans and paintings on fans were depicted on paintings before the nineteenth century. However, it was in the nineteenth century that they began to be applied as subject matter for decorative paintings. Reflecting the trend of enjoying extravagant hobbies, fans and paintings on fans were mainly produced as folding screens. The folding screen of One Hundred Fans from the collection of the Museum am Rothenbaum Kulturen und Künste der Welt (hereafter Rothenbaum Museum) in Germany was first introduced to Korean in the exhibition The City in Art, Art in the City held at the National Museum of Korea in 2016. Each panel in this six-panel folding screen features more than five different fans painted with diverse topics. This folding screen is of particular significance since the National Museum of Korea holds the original drawings. In the nineteenth century, calligraphy and painting that had formerly been enjoyed by Joseon royal family members and the nobility in private spaces began to spread among common people and was distributed through markets. In accordance with the trend of adorning households, colorful decorative paintings were preferred, leading to the popularization of the production of One Hundred Fans folding screens with pictures in different shapes and themes. A majority of the Korean collection in the Rothenbaum Museum belonged to Heinrich Constantin Eduard Meyer(1841~1926), a German businessman who served as the Joseon consul general in Germany. From the late 1890s until 1905, Meyer traveled back and forth between Joseon and Germany and collected a wide range of Korean artifacts. After returning to Germany, he sequentially donated his collections, including One Hundred Fans, to the Rothenbaum Museum. Folding screens like One Hundred Fans with their fresh and decorative beauty may have attracted the attention of foreigners living in Joseon. The One Hundred Fans at the Rothenbaum Museum is an intriguing work in that during its treatment, a piece of paper with the inscription of the place name "Donghyeon" was found pasted upside down on the back of the second panel. Donghyeon was situated in between Euljiro 1-ga and Euljiro 2-ga in present-day Seoul. During the Joseon Dynasty, a domestic handicraft industry boomed in the area based on licensed shops and government offices, including the Dohwaseo (Royal Bureau of Painting), Hyeminseo (Royal Bureau of Public Dispensary), and Jangagwon (Royal Bureau of Music). In fact, in the early 1900s, shops selling calligraphy and painting existed in Donghyeon. Thus, it is very likely that the shops where Meyer purchased his collection of calligraphy and painting were located in Donghyeon. The six-panel folding screen One Hundred Fans in the collection of the Rothenbaum Museum is thought to have acquired its present form during a process of restoring Korean artifacts works in the 1980s. The original drawings of One Hundred Fans currently housed in the National Museum of Korea was acquired by the National Folk Museum of Korea between 1945 and 1950. Among the seven drawings of the painting, six indicate the order of their panels in the margins, which relates that the painting was originally an eight-panel folding screen. Each drawing shows more than five different fans. The details of these fans, including small decorations and patterns on the ribs, are realistically depicted. The names of the colors to be applied, including 'red ocher', 'red', 'ink', and 'blue', are written on most of the fans, while some are left empty or 'oil' is indicated on them. Ten fans have sketches of flowers, plants, and insects or historical figures. A comparison between these drawings and the folding screen of One Hundred Fans at the Rothenbaum Museum has revealed that their size and proportion are identical. This shows that the Rothenbaum Museum painting follows the directions set forth in the original drawings. The fans on the folding screen of One Hundred Fans at the Rothenbaum Museum are painted with images on diverse themes, including landscapes, narrative figures, birds and flowers, birds and animals, plants and insects, and fish and crabs. In particular, flowers and butterflies and fish and crabs were popular themes favored by nineteenth century Joseon painters. It is noteworthy that the folding screen One Hundred Fans at the Rothenbaum Museum includes several scenes recalling the typical painting style of Kim Hong-do, unlike other folding screens of One Hundred Fans or Various Paintings and Calligraphy. As a case in point, the theme of "Elegant Gathering in the Western Garden" is depicted in the Rothenbaum folding screen even though it is not commonly included in folding screens of One Hundred Fans or One Hundred Paintings due to spatial limitations. The scene of "Elegant Gathering in the Western Garden" in the Rothenbaum folding screen bears a resemblance to Kim Hong-do's folding screen of Elegant Gathering in the Western Garden at the National Museum of Korea in terms of its composition and style. Moreover, a few scenes on the Rothenbaum folding screen are similar to examples in the Painting Album of Byeongjin Year produced by Kim Hong-do in 1796. The painter who drew the fan paintings on the Rothenbaum folding screen is presumed to have been influenced by Kim Hong-do since the fan paintings of a landscape similar to Sainsam Rock, an Elegant Gathering in the Western Garden, and a Pair of Pheasants are all reminiscent of Kim's style. These paintings in the style of Kim Hong-do are reproduced on the fans left empty in the original drawings. The figure who produced both the original drawings and fan paintings appears to have been a professional painter influenced by Kim Hong-do. He might have appreciated Kim's Painting Album of Byeongjin Year or created duplicates of Painting Album of Byeongjin Year for circulation in the art market. We have so far identified about ten folding screens remaining with the One Hundred Fans. The composition of these folding screens are similar each other except for a slight difference in the number and proportion of the fans or reversed left and right sides of the fans. Such uniform composition can be also found in the paintings of scholar's accoutrements in the nineteenth century. This suggests that the increasing demand for calligraphy and painting in the nineteenth century led to the application of manuals for the mass production of decorative paintings. As the demand for colorful decorative folding screens with intricate designs increased from the nineteenth century, original drawings began to be used as models for producing various paintings. These were fully utilized when making large-scale folding screens with images such as Guo Ziyi's Enjoyment-of-Life Banquet, Banquet of the Queen Mother of the West, One Hundred Children, and the Sun, Cranes and Heavenly Peaches, all of which entailed complicated patterns. In fact, several designs repeatedly emerge in the extant folding screens, suggesting the use of original drawings as models. A tendency toward using original drawings as models for producing folding screens in large quantities in accordance with market demand is reflected in the production of the folding screens of One Hundred Fans filled with fans in different shapes and fan paintings on diverse themes. In the case of the folding screens of One Hundred Paintings, bordering frames are drawn first and then various paintings are executed inside the frames. In folding screens of One Hundred Fans, however, fans in diverse forms were drawn first. Accordingly, it must have been difficult to produce them in bulk. Existing examples are relatively fewer than other folding screens. As discussed above, the folding screen of One Hundred Fans at the Rothenbaum Museum and its original drawings at the National Museum of Korea aptly demonstrate the late Joseon painting trend of embracing and employing new painting styles. Further in-depth research into the Rothenbaum painting is required in that it is a rare example exhibiting the influence of Kim Hong-do compared to other paintings on the theme of One Hundred Fans whose composition and painting style are more similar to those found in the work of Bak Gi-jun.
The purpose of this paper was to schedule optimum cutting strategy which could maximize the total yield under certain restrictions on periodic timber removals and harvest areas from an industrial forest, based on a linear programming technique. Sensitivity of the regulation model to variations in restrictions has also been analyzed to get information on the changes of total yield in the planning period. The regulation procedure has been made on the experimental forest of the Agricultural College of Seoul National University. The forest is composed of 219 cutting units, and characterized by younger age group which is very common in Korea. The planning period is devided into 10 cutting periods of five years each, and cutting is permissible only on the stands of age groups 5-9. It is also assumed in the study that the subsequent forests are established immediately after cutting existing forests, non-stocked forest lands are planted in first cutting period, and established forests are fully stocked until next harvest. All feasible cutting regimes have been defined to each unit depending on their age groups. Total yield (Vi, k) of each regime expected in the planning period has been projected using stand yield tables and forest inventory data, and the regime which gives highest Vi, k has been selected as a optimum cutting regime. After calculating periodic yields and cutting areas, and total yield from the optimum regimes selected without any restrictions, the upper and lower limits of periodic yields(Vj-max, Vj-min) and those of periodic cutting areas (Aj-max, Aj-min) have been decided. The optimum regimes under such restrictions have been selected by linear programming. The results of the study may be summarized as follows:- 1. The fluctuations of periodic harvest yields and areas under cutting regimes selected without restrictions were very great, because of irregular composition of age classes and growing stocks of existing stands. About 68.8 percent of total yield is expected in period 10, while none of yield in periods 6 and 7. 2. After inspection of the above solution, restricted optimum cutting regimes were obtained under the restrictions of Amin=150 ha, Amax=400ha,
Go bears significant meanings in terms of cultural and entertaining functions in Asia Eastern such as China and Japan. Beyond the mere entertaining level, it produces philosophical and mythic discourse as well. As a part of effort to seek an identity of Korean traditional garden culture, this study traced back to find meanings of rock-go-board and taste for the arts which ancestors pursued in playing Go game, through analysis and interpretation of correlation among origin of place name, nearby scenery, carved letters and vicinal handed-down place name. At the same time, their position, shape and location types were interpreted through comprehensive research and analysis of stone-go-boards including rock-go-board. Particularly, it focused on the rock names related to Sundoism(仙道) Ideal world, fixed due to a connection between traces of Sundoism and places in a folk etymology. Series of this work is to highlight features of the immortal sceneries, one of traditional landscaping ideals, by understanding place identity and scenic features of where the rock-go-boards are carved. These works are expected to become foundation for promotion and preservation of the traditional landscaping remains. The contents of this study could be summarized as follows; First, round stone and square board for round sky and angled land, black and white color for harmony of yin and yang and 361paths for rotating sky are symbols projecting order of universe. Sayings of Gyuljungjirak(橘中之樂), Sangsansaho(商山四皓), Nangagosa(爛柯故事) formed based on the idea of eternity stand for union of sky and sun. It indicates Go game which matches life and nature spatiotemporally and elegant taste for arts pursuing beauty and leisure. Second, the stone-go-boards found through this research, are 18 in total. 3 of those(16.1%), Gangjin Weolnamsaji, Yangsan Sohanjeong and Banryongdae ones were classified into movable Seokguk and 15(83.9%) including Banghakdong were turned out to be non-movable rock-go-boards carved on natural rocks. Third, upon the result of materializing location types of rock-go-boards, 15 are mountain stream type(83.9%) and 3 are rock peak type(16.1%). Among those, the one at Sobaeksam Sinseonbong is located at the highest place(1,389m). Considering the fact that all of 15 rock-go-boards were found at mountainous areas lower than 500m, it is recognizable that where the Go-boards are the parts of the living space, not far from secular world. Fourth, there are 7 Sunjang(巡將) Go with 17 Hwajeoms(花點), which is a traditional Go board type, but their existences, numbers and shapes of Hwajeom appear variously. Based on the fact, it is recognizable that culture of making go-board had been handed down for an extended period of time. Among the studied rock-goboards, the biggest one was Muju Sasunam[
The purpose of the study was to find out possible ways for increasing farm income through the sheep and Korean native goats farming, and to investigate meat productivity, wool productivity; woolskin utility, physiological characteristics and correlation between economical college animal farm of the Chungnam National University and sample farms in the suburbs of Dae jeon City were selected for feeding 20 heads of Corriedale wethers and another 20 heads Korean native kids as research materials for the periods of 5th May-26th November, 1977. The data such as growth rate, carcass, viscera weight, blood picture and plamsa components, hebage intake and economic traits were obtained and analysed. The result of the study are summarized as follows: 1. Meat production and quality 1) After 196days of feeding, the body weight of sheep and Korean native goats was increased by two times of those at the beginning of the trial, i.e. 20kg and 8kg respectively. 2) There was no significance of growth rates of sheep in housing and grazing. 3) The growth rate of Korean native goats were excellent at the mountainous areas of Gong ju-Gun where infectious diseases were not found 4) Accroding to the body measurements of 18-month-old sheep, percentages of hip height, body length, rump length, chest depth, chest width, hip width, chest girth and forearm circumference to the withers height were 103,%, 104%, 33%, 44%, 31%, 23%, 135% and 15% respectively, and those of hip height, body length, chest depth and chest girth of 8-month-old native goats to the withers height were 106%, 109%, 46% and 122,% respecitively. As a result, it was found that the percentage of hip height, body length and chest depth of Korean native goats were higher than those of sheep while that of the chest girth of goats was lower. 5) In the carcass data, 47,
This study was performed to investigate: (i) the bending processing properties of silk worm oak (Quercus acutissima Carr.) and Korean red pine (Pinus densiflora S. et Z.) by boiling and steaming treatments; (ii) the effects of interrelated factors - sapwood and heartwood, annual ring placement, softening temperature and time, moisture content. and wood defects on bending processing properties; (iii) the changing rates of bending radii after release from a tension strap, and (iv) the improving methods of bending process by treatment with chemicals. The size of specimens tested was