• Title/Summary/Keyword: Large-scale experiments

Search Result 550, Processing Time 0.038 seconds

Task Balancing Scheme of MPI Gridding for Large-scale LiDAR Data Interpolation (대용량 LiDAR 데이터 보간을 위한 MPI 격자처리 과정의 작업량 발란싱 기법)

  • Kim, Seon-Young;Lee, Hee-Zin;Park, Seung-Kyu;Oh, Sang-Yoon
    • Journal of the Korea Society of Computer and Information
    • /
    • v.19 no.9
    • /
    • pp.1-10
    • /
    • 2014
  • In this paper, we propose MPI gridding algorithm of LiDAR data that minimizes the communication between the cores. The LiDAR data collected from aircraft is a 3D spatial information which is used in various applications. Since there are many cases where the LiDAR data has too high resolution than actually required or non-surface information is included in the data, filtering the raw LiDAR data is required. In order to use the filtered data, the interpolation using the data structure to search adjacent locations is conducted to reconstruct the data. Since the processing time of LiDAR data is directly proportional to the size of it, there have been many studies on the high performance parallel processing system using MPI. However, previously proposed methods in parallel approach possess possible performance degradations such as imbalanced data size among cores or communication overhead for resolving boundary condition inconsistency. We conduct empirical experiments to verify the effectiveness of our proposed algorithm. The results show that the total execution time of the proposed method decreased up to 4.2 times than that of the conventional method on heterogeneous clusters.

Optimization and Performance Analysis of Distributed Parallel Processing Platform for Terminology Recognition System (전문용어 인식 시스템을 위한 분산 병렬 처리 플랫폼 최적화 및 성능평가)

  • Choi, Yun-Soo;Lee, Won-Goo;Lee, Min-Ho;Choi, Dong-Hoon;Yoon, Hwa-Mook;Song, Sa-kwang;Jung, Han-Min
    • The Journal of the Korea Contents Association
    • /
    • v.12 no.10
    • /
    • pp.1-10
    • /
    • 2012
  • Many statistical methods have been adapted for terminology recognition to improve its accuracy. However, since previous studies have been carried out in a single core or a single machine, they have difficulties in real-time analysing explosively increasing documents. In this study, the task where bottlenecks occur in the process of terminology recognition is classified into linguistic processing in the process of 'candidate terminology extraction' and collection of statistical information in the process of 'terminology weight assignment'. A terminology recognition system is implemented and experimented to address each task by means of the distributed parallel processing-based MapReduce. The experiments were performed in two ways; the first experiment result revealed that distributed parallel processing by means of 12 nodes improves processing speed by 11.27 times as compared to the case of using a single machine and the second experiment was carried out on 1) default environment, 2) multiple reducers, 3) combiner, and 4) the combination of 2)and 3), and the use of 3) showed the best performance. Our terminology recognition system contributes to speed up knowledge extraction of large scale science and technology documents.

A Study on Seedling Production of Jicon Scallop, Chlamys farreri 1. Spawning, Development and Rearing of Larvae (비단가리비 종묘생산을 위한 연구 1. 산란, 발생 및 유생사육)

  • Na Gui-Hwan;Jeong Woo-Geon;Cho Chang-Hwan
    • Journal of Aquaculture
    • /
    • v.8 no.4
    • /
    • pp.307-316
    • /
    • 1995
  • Jicon scallop (Chlamys farreri), as one of new culture species, has been taken a growing interest in Korea recently. Artificial seeds are needed since seeds in natural waters are absolutely short. To develop the better methods for the artificial spawning and the rearing larvae on a large scale, experiments were carried out from July 1993 to May 1994. Mother shells were collected from the area near Tong-yeong and Geoje-do, the southern part of the Korean Penninsula. It was estimated that a period of 2-years was needed to be mother shells after the fertilization. Generally, spawning occourred intermittently from March to August and the maximum occurred in July. A best way for the artificial spawning was a chemical incentive, a 'serotonin injection' in parallel with the exposure and the temperature stimulation. Densities of the fertilized eggs for the normal development was from 30 to 40 per mililiter. It took 27-days from the fertilization to the settling larva averaging $155{\mu}m$ in size with water temperature 11.5\~13.0^{\circ}C$. Isochrysis galvana and Chaetoceros calcitrans with a density of $1,500\times10^4$ cells per ililiter were supplied for rearing the larvae. A proper density of larvae was 10 individuals per mililiter, and the survival rate of larvae from the flowing water system was much better than that of larvae from the still water.

  • PDF

Research on the Utilization of Recurrent Neural Networks for Automatic Generation of Korean Definitional Sentences of Technical Terms (기술 용어에 대한 한국어 정의 문장 자동 생성을 위한 순환 신경망 모델 활용 연구)

  • Choi, Garam;Kim, Han-Gook;Kim, Kwang-Hoon;Kim, You-eil;Choi, Sung-Pil
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.51 no.4
    • /
    • pp.99-120
    • /
    • 2017
  • In order to develop a semiautomatic support system that allows researchers concerned to efficiently analyze the technical trends for the ever-growing industry and market. This paper introduces a couple of Korean sentence generation models that can automatically generate definitional statements as well as descriptions of technical terms and concepts. The proposed models are based on a deep learning model called LSTM (Long Sort-Term Memory) capable of effectively labeling textual sequences by taking into account the contextual relations of each item in the sequences. Our models take technical terms as inputs and can generate a broad range of heterogeneous textual descriptions that explain the concept of the terms. In the experiments using large-scale training collections, we confirmed that more accurate and reasonable sentences can be generated by CHAR-CNN-LSTM model that is a word-based LSTM exploiting character embeddings based on convolutional neural networks (CNN). The results of this study can be a force for developing an extension model that can generate a set of sentences covering the same subjects, and furthermore, we can implement an artificial intelligence model that automatically creates technical literature.

PRIDE 3D Simulator for Virtual Verification of Remote Handling Procedures in Processing Cell (PRIDE 3D 시뮬레이터를 통한 공정셀 내부의 원격작업 가상검증)

  • Ryu, Dongseok;Han, Jonghui;Kim, Sunghyun;Kim, Kiho;Lee, Jong Kwang
    • Journal of Nuclear Fuel Cycle and Waste Technology(JNFCWT)
    • /
    • v.15 no.4
    • /
    • pp.333-341
    • /
    • 2017
  • The Korea Atomic Energy Research Institute (KAERI) constructed the PyRoprocessing Integrated inactive Demonstration facility (PRIDE) to carry out experiments on engineering scale pyroprocessing. PRIDE has a large processing cell that human workers are not allowed to access, and thus the equipment inside is operated from outside using remote handling systems. It is therefore essential to examine the operability and maintainability of the equipment in view of remote handling systems, and the equipment is thoroughly examined in a mockup cell before it is installed in the processing cell. If the equipment is tested in a virtual mockup rather than in a mockup cell, the development cost can be significantly reduced. The PRIDE 3D simulator was integrated for virtual verification of equipment that will be installed in the processing cell. All remote handling devices in the actual PRIDE were also virtually installed in the PRIDE 3D simulator. The 3D model of the equipment was loaded and located in the exact position in the virtual processing cell. A scenario to replace an actual electrode was implemented in the PRIDE 3D simulator. The design of the equipment and the working procedures in the scenario were successfully evaluated. The results demonstrated that the PRIDE 3D simulator can be used successfully as an alternative to actual mockup testing.

Study on Behaviour of Flood Wave-front Varied with Levee Breach Speed in Flat Inundation Area (평탄지형 제내지에서의 제방붕괴속도에 따른 범람홍수파 선단 거동에 관한 연구)

  • Yoon, Kwang Seok
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.18 no.1
    • /
    • pp.537-544
    • /
    • 2017
  • An experimental study was carried out to investigate the characteristics of the propagation distance of a flood wave considering the levee failure speed in a flat inundation area. The Ritter solution for one dimensional flow was considered to formulate the experimental results and a representative form with coefficients of k and m, which consider the three dimensional flow characteristics, was applied. The experiments showed that the propagation velocity of the wave front in the inundation area was influenced by the levee breach speed as well as the initial water level, which is a significant variable representing the flood wave behavior. In addition, coefficients k and m are not constants, but variables that vary with levee breach speed. An empirical formula was also suggested using the experimental results in the form of the relationships between k and m. In this study, a large-scale experiment for flood inundation was carried out to examine the behavior of flooding in the inundated area and the relationships between the levee breach speed and wave-front propagation velocity were suggested based on the experimental results. These research results are expected to be used as the baseline data to draw a flow inundation map, establish an emergency action plan, and verify the two-dimensional numerical model.

Simulation Study on E-commerce Recommender System by Use of LSI Method (LSI 기법을 이용한 전자상거래 추천자 시스템의 시뮬레이션 분석)

  • Kwon, Chi-Myung
    • Journal of the Korea Society for Simulation
    • /
    • v.15 no.3
    • /
    • pp.23-30
    • /
    • 2006
  • A recommender system for E-commerce site receives information from customers about which products they are interested in, and recommends products that are likely to fit their needs. In this paper, we investigate several methods for large-scale product purchase data for the purpose of producing useful recommendations to customers. We apply the traditional data mining techniques of cluster analysis and collaborative filtering(CF), and CF with reduction of product-dimensionality by use of latent semantic indexing(LSI). If reduced product-dimensionality obtained from LSI shows a similar latent trend of customers for buying products to that based on original customer-product purchase data, we expect less computational effort for obtaining the nearest-neighbor for target customer may improve the efficiency of recommendation performance. From simulation experiments on synthetic customer-product purchase data, CF-based method with reduction of product-dimensionality presents a better performance than the traditional CF methods with respect to the recall, precision and F1 measure. In general, the recommendation quality increases as the size of the neighborhood increases. However, our simulation results shows that, after a certain point, the improvement gain diminish. Also we find, as a number of products of recommendation increases, the precision becomes worse, but the improvement gain of recall is relatively small after a certain point. We consider these informations may be useful in applying recommender system.

  • PDF

Effect of Methylotrophic Bacteria in Seedling Development of Some Crops under Gnotobiotic Condition (Methylotrophic bacteria 접종이 작물 유묘 생장에 미치는 영향)

  • Hong, In-Soo;Kim, Jun-Seok;Lee, Min-Kyoung;Yim, Woo-Jong;Islam, Md. Rashedul;Boruah, Hari P. Deka;Chauhan, Puneet Singh;Han, Gwang-Hyun;Sa, Tong-Min
    • Korean Journal of Soil Science and Fertilizer
    • /
    • v.42 no.4
    • /
    • pp.317-322
    • /
    • 2009
  • Healthy seedling generation is the major concern in overcoming adverse effects of biotic and abiotic stresses during tender stage of development in vegetables and horticultural crops. Because of this, priority is given to research leading to the generation of healthy seedlings in crops subjected to transplanting and bedding. In this study, growth pouch experiments were conducted to determine the effect of inoculation of six different strains of Methylobacterium sp. namely, M. oryzae CBMB20, M. phyllosphaerae CBMB27, M. suomiense CBMB120, and Methylobacterium strains CBMB12, CBMB15 and CBMB17 on the seedling development of the vegetable crops cabbage, Chinese cabbage and cucumber; and horticultural crops tomato and red pepper. Crops treated with the test strains generally showed higher seedling dry matter accumulation compared to the control. Significantly higher accumulation was exhibited by CBMB12, CBMB17, and CBMB20 in cabbage, as well as for CBMB27 and CBMB120 on tomato and Chinese cabbage, respectively. Furthermore, all the strains promoted root elongation in cucumber and tomato seedlings while in Chinese cabbage and red pepper, root elongation was observed with CBMB120 and CBMB12 inoculation, respectively. Large scale nursery study is needed to develop a thorough protocol for healthy seedling development with the use of these strains.

Production of Fructose 6-Phoschate from Starch Using Thermostable Enzymes (내열성 효소를 이용한 전분으로부터 6-인산과당의 제조)

  • Kwun, Kyu-Hyuk;Cha, Wol-Suk;Kim, Bok-Hee;Shin, Hyun-Jae
    • KSBB Journal
    • /
    • v.22 no.5
    • /
    • pp.345-350
    • /
    • 2007
  • Phosphosugars are found in all living organisms and are commercially valuable compounds with possible applications in the development of a wide range of specialty chemicals and medicines. In carbohydrate metabolism, fructose 6-phosphate (F6P) is an essential intermediate formed by phosphorylation of 6' position of fructose in glycolysis, gluconeogenesis, pentose phosphate pathway and Calvin cycle. In glycolysis, F6P lies within the glycolysis metabolic pathway and is produced by isomerisation of glucose 6-phosphate. For large-scale production, F6P could be produced from starch using many enzymes such as pullulanase, starch phosphorylase, isomerase and mutase. In enzymatic reactions carried out at high temperatures, the solubility of starch is increased and microbial contamination is minimized. Thus, thermophile-derived enzymes are preferred over mesophile-derived enzymes for industrial applications using starch. Recently, we reported the production of glucose 1-phosphate (G1P) from starch by Thermus caldophilus GK24 enzymes. Here we report the production of F6P from starch through three steps; from starch to glucose 1-phosphate (glucan phosphorylase, GP), then glucose 6-phosphate (phosphoglucomutase, GM) and then F6P (phosphoglucoisomerase, GI). Using 200 L of 1.2% soluble starch solution in potassium phosphate buffer, 1,253 g of G1P were produced. Then, 30% yields of F6P were attained at the optimum reaction conditions of GM : G1 (1 : 2.3), 63.5$^{\circ}C$, and pH 6.85. The optimum conditions were found by response surface methodology and the theoretical values were confirmed by the experiments. The optimum starch concentrations were 20 g/L under the given conditions.

Implementation of an Intelligent Audio Graphic Equalizer System (지능형 오디오 그래픽 이퀄라이저 시스템 구현)

  • Lee Kang-Kyu;Cho Youn-Ho;Park Kyu-Sik
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.43 no.3 s.309
    • /
    • pp.76-83
    • /
    • 2006
  • A main objective of audio equalizer is for user to tailor acoustic frequency response to increase sound comfort and example applications of audio equalizer includes large-scale audio system to portable audio such as mobile MP3 player. Up to now, all the audio equalizer requires manual setting to equalize frequency bands to create suitable sound quality for each genre of music. In this paper, we propose an intelligent audio graphic equalizer system that automatically classifies the music genre using music content analysis and then the music sound is boosted with the given frequency gains according to the classified musical genre when playback. In order to reproduce comfort sound, the musical genre is determined based on two-step hierarchical algorithm - coarse-level and fine-level classification. It can prevent annoying sound reproduction due to the sudden change of the equalizer gains at the beginning of the music playback. Each stage of the music classification experiments shows at least 80% of success with complete genre classification and equalizer operation within 2 sec. Simple S/W graphical user interface of 3-band automatic equalizer is implemented using visual C on personal computer.