• Title/Summary/Keyword: parallel collection

Search Result 107, Processing Time 0.027 seconds

A Study on the Data Collection Methods based Hadoop Distributed Environment (하둡 분산 환경 기반의 데이터 수집 기법 연구)

  • Jin, Go-Whan
    • Journal of the Korea Convergence Society
    • /
    • v.7 no.5
    • /
    • pp.1-6
    • /
    • 2016
  • Many studies have been carried out for the development of big data utilization and analysis technology recently. There is a tendency that government agencies and companies to introduce a Hadoop of a processing platform for analyzing big data is increasing gradually. Increased interest with respect to the processing and analysis of these big data collection technology of data has become a major issue in parallel to it. However, study of the collection technology as compared to the study of data analysis techniques, it is insignificant situation. Therefore, in this paper, to build on the Hadoop cluster is a big data analysis platform, through the Apache sqoop, stylized from relational databases, to collect the data. In addition, to provide a sensor through the Apache flume, a system to collect on the basis of the data file of the Web application, the non-structured data such as log files to stream. The collection of data through these convergence would be able to utilize as a basic material of big data analysis.

Corona Discharge and Strong Electrolyzed Water Generation Characteristics of the Electrode System Bedded by Dielectric Pellets (유전체구 충진형 전극계의 코로나방전과 강전해수 발생특성)

  • 김진규
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.16 no.4
    • /
    • pp.46-54
    • /
    • 2002
  • A dielectric pellets bedded parallel plates with a membrane centered have been proposed as an ion separation and collection system in water. and effects of the relative dielectric constant and the applied square wave pulse voltage on the characteristics of ion separation and collection in tap water and NaCl dissolved tap water have been investigated. As a result, electrolyzed water of pH 3.1 and 10.6 were obtained with only tap water at the pulse current of 1.0[A] and flow rate of 0.5[LPM]. And the higher ionized water of pH 2.8 and pH 11.7 ware obtained in 0.1[%wt] NaCl dissolved water. When the dielectric pellets of BaTiO$_3$ having the highest dielectric constant were bedded in the ion separation and collection cell, the ionized water of pH 2.7 and pH 11.7 were obtained with only tap water. And the ionized water of pH 2.4 and pH 12.0 were obtained in 0.1[wt%] NaCl dissolved tap water with the dielectrics pellets bedded ones.

PVM Performance Enhancement over a High-Speed Myrinet (초고속 Myrinet 통신망에서의 PVM 성능 개선)

  • Kim, In-Soo;Shim, Jae-Hong;Choi, Kyung-Hee;Jung, Gi-Hyun;Moon, Kyeong-Deok;Kim, Tae-Geun
    • The Transactions of the Korea Information Processing Society
    • /
    • v.7 no.1
    • /
    • pp.74-87
    • /
    • 2000
  • PVM (parallel virtual machine) provides a programming environment that allows a collection of networked workstations to appear as a single parallel computational resource. The performance of parallel applications in this environment depends on the performance of data transfers between tasks. In this paper, we present a new Myrinet-based communication model of PVM that improves PVM communication performance over a high-speed Myrinet LAN. The proposed PVM communication model adopts a communication mechanism that allows any user-level process to directly access the network interface board without going through UDP/IP protocol stacks in the kernel. This mechanism provides faster data transfers between PVM tasks over the Myrinet since it avoids data copy overhead from kernel (user space) to user space (kernel) and reduces communication latency due to network protocol software layers. We implemented EPVM (Enhanced PVM), our updated version of the traditional PVM using UDP/IP, that is based on the proposed communication model over the Myrinet. Performance results show EPVM achieves communication speed-up of one to two over the traditional PVM.

  • PDF

EFFECT OF HOT SEASON ON LIVE SPERMATOZOA WITH INTACT ACROSOME IN HOLSTEIN BULLS

  • Terawaki, Y.;Fujita, H.;Fukui, Y.
    • Asian-Australasian Journal of Animal Sciences
    • /
    • v.8 no.5
    • /
    • pp.415-418
    • /
    • 1995
  • Semen characteristics were examined to find the deterioration of the percentage of live spermatozoa with intact acrosome during hot season using 5 Holstein bulls located in Shirnizu-cho Hokkaido Japan. Spermatozoal viability and acrosomal status were observed simultaneously with triple-stain technique for each spermatozoon. Spermatozoa were divided in four categories (live spermatozoa with intact acrosome, live spermatozoa without intact acrosome, dead spermatozoa with intact acrosome and dead spermatozoa without intact acrosome). Bull and collection month had significant effects on semen characteristics (p < 0.01). The percentage of live spermatozoa with intact acrosome and the percentage of live spermatozoa had the lowest least squares mean by collection month in August (72.7% and 76.7%). These two characteristics indicated the obvious deterioration during hot season. But the fluctuation of these two characteristics were not parallel and the differences between the two characteristics were largest during July to September. The present results indicate the necessity for the simultaneous determination of viability and acrosomal status of each Holstein bull's spermatozoa in order to keep fertility above an acceptable minimum level during hot season.

Implementation of Adaptive Hierarchical Fair Com pet ion-based Genetic Algorithms and Its Application to Nonlinear System Modeling (적응형 계층적 공정 경쟁 기반 병렬유전자 알고리즘의 구현 및 비선형 시스템 모델링으로의 적용)

  • Choi, Jeoung-Nae;Oh, Sung-Kwun;Kim, Hyun-Ki
    • Proceedings of the KIEE Conference
    • /
    • 2006.10c
    • /
    • pp.120-122
    • /
    • 2006
  • The paper concerns the hybrid optimization of fuzzy inference systems that is based on Hierarchical Fair Competition-based Parallel Genetic Algorithms (HFCGA) and information data granulation. The granulation is realized with the aid of the Hard C-means clustering and HFCGA is a kind of multi-populations of Parallel Genetic Algorithms (PGA), and it is used for structure optimization and parameter identification of fuzzy model. It concerns the fuzzy model-related parameters such as the number of input variables to be used, a collection of specific subset of input variables, the number of membership functions, the order of polynomial, and the apexes of the membership function. In the hybrid optimization process, two general optimization mechanisms are explored. Thestructural optimization is realized via HFCGA and HCM method whereas in case of the parametric optimization we proceed with a standard least square method as well as HFCGA method as well. A comparative analysis demonstrates that the proposed algorithm is superior to the conventional methods.

  • PDF

Optimization of Fuzzy Set Fuzzy Model by Means of Hierarchical Fair Competition-based Genetic Algorithm using UNDX operator (UNDX연산자를 이용한 계층적 공정 경쟁 유전자 알고리즘을 이용한 퍼지집합 퍼지 모델의 최적화)

  • Kim, Gil-Sung;Choi, Jeoung-Nae;Oh, Sung-Kwun
    • Proceedings of the KIEE Conference
    • /
    • 2007.04a
    • /
    • pp.204-206
    • /
    • 2007
  • In this study, we introduce the optimization method of fuzzy inference systems that is based on Hierarchical Fair Competition-based Parallel Genetic Algorithms (HFCGA) and information data granulation, The granulation is realized with the aid of the Hard C-means clustering and HFCGA is a kind of multi-populations of Parallel Genetic Algorithms (PGA), and it is used for structure optimization and parameter identification of fuzzy model. It concerns the fuzzy model-related parameters such as the number of input variables to be used, a collection of specific subset of input variables, the number of membership functions, the order of polynomial, and the apexes of the membership function. In the optimization process, two general optimization mechanisms are explored. The structural optimization is realized via HFCGA and HCM method whereas in case of the parametric optimization we proceed with a standard least square method as well as HFCGA method as well. A comparative analysis demonstrates that the proposed algorithm is superior to the conventional methods. Particularly, in parameter identification, we use the UNDX operator which uses multiple parents and generate offsprings around the geographic center off mass of these parents.

  • PDF

Global Internet Computing Environment based on Java (자바를 기반으로 한 글로벌 인터넷 컴퓨팅 환경)

  • Kim, Hui-Cheol;Sin, Pil-Seop;Park, Yeong-Jin;Lee, Yong-Du
    • The Transactions of the Korea Information Processing Society
    • /
    • v.6 no.9
    • /
    • pp.2320-2331
    • /
    • 1999
  • Over the Internet, in order to utilize a collection of idle computers as a parallel computing platform, we propose a new scheme called GICE(Global Internet Computing Environment). GICE is motivated to obtain high programmability, efficient support for heterogeneous computing resources, system scalability, and finally high performance. The programming model of GICE is based on a single address space. GICE is featured with a Java based programming environment, a dynamic resource management scheme, and efficient parallel task scheduling and execution mechanisms. Based on a prototype implementation of GICE, we address the concept, feasibility, complexity and performance of Internet computing.

  • PDF

A Study on the Filtration Characteristics of Baghouse with Tangential Inlet Depending on the Shape of Inner Tube (접선유입 방식 여과집진기의 내통형상 변화에 따른 집진특성 연구)

  • Choi, H.K.;Park, S.J.;Lim, J.H.;Kim, S.D.;Park, H.S.;Park, Y.O.
    • Proceedings of the KSME Conference
    • /
    • 2001.06e
    • /
    • pp.158-161
    • /
    • 2001
  • A new type baghouse with tangential inlet and inner tube was developed and it's performances were evaluated. Experiments with variable shapes of inner tube were performed to suggest an optimum shape of inner tube which might decrease the dust loading onto bag filter surface and the amount of reentrained particles by internal gas flow. The dust loading was lower when inner tubes parallel to outer casing exist. When an inner tube covering around the lower portion of bag filters was used, the dust particles detached from the filter surface by cleaning process were reentraind by internal recirculating gas flow.

  • PDF

Development of an Automated Diffusion Scrubber-Conductometry System for Measuring Atmospheric Ammonia

  • Lee, Bo-Kyoung;Lee, Chong-Keun;Lee, Dong-Soo
    • Bulletin of the Korean Chemical Society
    • /
    • v.32 no.6
    • /
    • pp.2039-2044
    • /
    • 2011
  • A semi-continuous and automated method for quantifying atmospheric ammonia at the parts per billion level has been developed. The instrument consists of a high efficiency diffusion scrubber, an electrolytic on-line anion exchange device, and a conductivity detector. Water soluble gases in sampled air diffuse through the porous membrane and are absorbed in an absorbing solution. Interferences are eliminated by using an anion exchange devises. The electrical conductivity of the solution is measured without chromatographic separation. The collection efficiency was over 99%. Over the 0-200 ppbv concentration range, the calibration was linear with $r^2$ = 0.99. The lower limit of detection was 0.09 ppbv. A parallel analysis of Seoul air over several days using this method and a diffusion scrubber coupled to an ion chromatography system showed acceptable agreement, $r^2$ = 0.940 (n = 686). This method can be applied for ambient air monitoring of ammonia.

Comparative Analysis of the Housing Performance Grading indication System in Korea & Japan (한일 주택성능등급표시제도 비교 분석)

  • Kim, Soo-Am;Lee, Sung-Ok;Shin, Sung-Eun
    • Proceeding of Spring/Autumn Annual Conference of KHA
    • /
    • 2009.04a
    • /
    • pp.226-229
    • /
    • 2009
  • Housing Performance Grade Indication System is one of the advanced system which operate globally in three countries. Housing Performance Grade Indication System of the Japan and Korea has points of similarity and distinction according to special situations of own condition and government. The purpose of a study is how characteristics have points of view about background, composition and an outline of the system, indication standard and method, the situation of issue, making progress direction and what is the clear differences. Also, it is to obtain hints for making progress direction of domestic Housing Performance Grade Indication System. The method of study is in parallel with literature survey, also collection through visiting to researcher, operation company, evaluation institution, housing company of the Japan. and to use data as a result of international workshop on November 2008. Because domestic research team is studying about making system and evaluation, revision, this study will make use this data.

  • PDF