• Title/Summary/Keyword: SPARK

Search Result 1,526, Processing Time 0.021 seconds

Parallel k-Modes Algorithm for Spark Framework (스파크 프레임워크를 위한 병렬적 k-Modes 알고리즘)

  • Chung, Jaehwa
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.6 no.10
    • /
    • pp.487-492
    • /
    • 2017
  • Clustering is a technique which is used to measure similarities between data in big data analysis and data mining field. Among various clustering methods, k-Modes algorithm is representatively used for categorical data. To increase the performance of iterative-centric tasks such as k-Modes, a distributed and concurrent framework Spark has been received great attention recently because it overcomes the limitation of Hadoop. Spark provides an environment that can process large amount of data in main memory using the concept of abstract objects called RDD. Spark provides Mllib, a dedicated library for machine learning, but Mllib only includes k-means that can process only continuous data, so there is a limitation that categorical data processing is impossible. In this paper, we design RDD for k-Modes algorithm for categorical data clustering in spark environment and implement an algorithm that can operate effectively. Experiments show that the proposed algorithm increases linearly in the spark environment.

Playing God: Self-Reflection, Religion, and Morality in Muriel Spark's Fiction (신을 연기하기: 뮤리엘 스파크 소설의 자아반영성, 종교, 윤리)

  • Kim, Heesun
    • English & American cultural studies
    • /
    • v.18 no.4
    • /
    • pp.33-64
    • /
    • 2018
  • Through the experimental narrative construction by authorial divinity, Muriel Spark's novels and films based on her fiction show the difficulty of living like a human being under various inhumane and manipulative circumstances of the modern capitalistic society. By adopting flash-forward, self-reflection, and deceptive omnipotent viewpoints, her work has surprisingly predicted the post-modern trend in which humans are increasingly attracted and interpellated to the digitalized media. Muriel Spark called the recent anesthetic situation by stimulation "a driver's seat" because it is a symbol of how humans should act to maintain the critical subject. Emphasizing the value of self-reflection, religion and morality in the mechanized society, Muriel Spark stressed literature should play the role of helmsman who sails safely in the rough sea. In Muriel Spark's works, God is often synonymous with writers. As a Jewish immigrant she experienced alienation in Scotland, marital violence, prejudices of the London-based publishing world, Nazism, and Watergate. For her, the harsh reality of the modern society needs to be guided and complemented by something beyond human control. But rather than relying entirely on traditional Catholic doctrines such as Graham Greene and Evelyn Waugh, Muriel Spark has taken a personal, religious view of literature and insists that the genuine writer must play God's play. Seeking for the speculative vision for the future of human life in God's plan, she tries to understand the complex twisted motives of human beings which are often far from the ideal form. Simply put, her search of self-reflection, religion and ethics is modeled on the God's plan for the ideal human being who is supposed as the writer with the transfigurative imagination of the trinity.

Performance Comparison of Spatial Split Algorithms for Spatial Data Analysis on Spark (Spark 기반 공간 분석에서 공간 분할의 성능 비교)

  • Yang, Pyoung Woo;Yoo, Ki Hyun;Nam, Kwang Woo
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.25 no.1
    • /
    • pp.29-36
    • /
    • 2017
  • In this paper, we implement a spatial big data analysis prototype based on Spark which is an in-memory system and compares the performance by the spatial split algorithm on this basis. In cluster computing environments, big data is divided into blocks of a certain size order to balance the computing load of big data. Existing research showed that in the case of the Hadoop based spatial big data system, the split method by spatial is more effective than the general sequential split method. Hadoop based spatial data system stores raw data as it is in spatial-divided blocks. However, in the proposed Spark-based spatial analysis system, there is a difference that spatial data is converted into a memory data structure and stored in a spatial block for search efficiency. Therefore, in this paper, we propose an in-memory spatial big data prototype and a spatial split block storage method. Also, we compare the performance of existing spatial split algorithms in the proposed prototype. We presented an appropriate spatial split strategy with the Spark based big data system. In the experiment, we compared the query execution time of the spatial split algorithm, and confirmed that the BSP algorithm shows the best performance.

Ion Migration Characteristics of a High Voltage Rotary Spark Airgap (고전압 회전 스파크 공격간의 이온 이동특성)

  • Moon Jae-Duk;Kim Tai-Hoon;Hwang Deok-hyun
    • The Transactions of the Korean Institute of Electrical Engineers C
    • /
    • v.54 no.9
    • /
    • pp.427-432
    • /
    • 2005
  • Ion migration characteristics of a rotary spark airgap of high voltage Pulse generator had been investigated. It was considered that the ion migration speed and the ions of the gases(atmosphere gases, $O_2,\;N_2,,\;and\;H_{2}O,\;etc$.) and the charged very fine particles(about $10\~100nm$ size) migrated through the upper stator ball and bottom stator ball of the rotary spark airgap would determined the rise and fall times of the output high voltage pulse. In this paper, a basic study on the ion migration characteristics of the rotary spark airgap between the spark stator ball and the ion-sensing electrode of the proposed high voltage pulse generator have been investigated experimentally. As a result, the three kinds of ion speeds were detected by the ion-sensing electrode installed at the position of the bottom stator ball of the ball type sparkgap high voltage pulse generator. The migration velocities, diameters, masses, charges, numbers of the ions and particles were obtained by experiments and calculations, which, however, would determine the rise and fall times of the output high voltage pulse.

IDLE PERFORMANCE OF AN SI ENGINE WITH VARIATIONS IN ENGINE CONTROL PARAMETERS

  • Kim, D.S.;Cho, Y.S.
    • International Journal of Automotive Technology
    • /
    • v.7 no.7
    • /
    • pp.763-768
    • /
    • 2006
  • Emission reduction in the cold start period of SI engines is crucial to meet stringent emission regulations such as SULEV Emissoin reduction is the starting point of the study in the which the variable valve timing (VVT) technology may be one promising method to minimize cold start emissions while maintaining engine performance. This is because it is possible to change valve overlap and residual gas fraction during cold start and idle operations. Our previous study showed that spark timing is another important factor for reducing cold-start emissions since it affects warm-up time of close-coupled catalysts (CCC) by changing exhaust gas temperature. However, even though these factors may be favorable for reduction of emissions, they may deteriorate combustion stability in these operating conditions. This means that the two variables should be optimized for best exhaust emissions and engine stability. This study investigated the effects of valve and spark timings in idle performance such as combustion stability and exhaust emissions. Experiments showed that valve timings significantly affected engine stability and exhaust emissions, especially CO and $NO_x$, due to change in residual gas fraction within the combustion chamber. Spark timing also affects HC emissions and exhaust gas temperature. Yet it has no significant effects on combustion stability. A control strategy of proper valve timing and spark timing is suggested in order to achieve a reduction in exhaust emissions and a stable operation of the engine in a cold start and idle operation.

The Development of the Ignition Spark Timing Conversion System for LPG/Gasoline Bi-fuel Vehicle (LPG 및 Gasoline 겸용 차량의 엔진 점화시기 변환 제어시스템 개발)

  • 전봉준;양인권;김재국;김성준
    • Journal of Advanced Marine Engineering and Technology
    • /
    • v.27 no.1
    • /
    • pp.117-123
    • /
    • 2003
  • In a bi-fuel engine using gasoline and LPG fuel, with the current ignition timing for gasoline being used, the effective performance could not be taken in LPG fuel supply mode. The ignition timing in LPG fuel mode must be advanced much more than that of gasoline mode for the compensation of its lower flame speed, due to engine torque drop. This study aims to develop the control system for ignition spark timing conversion which is composed of hardwares and control algorithm for gasoline/LPG engine. We propose the control system which can advance the ignition spark timing in LPG fuel mode more than used in gasoline fuel mode. The advance of ignition timing is achieved by change of the ignition dwell time of coil igniter. The engine torque and F/E(Fuel-Economy) in LPG fuel mode are measured to evaluate the difference of engine performance between before and alter changing ignition spark timings. The engine torque and F/E are increased respectively, which proves the developed control system is effective so much for gasoline and LPG bi-fuel engine.

Study on the Performance of an SI Gas Engine by Fuel Composition and Spark Plug Variation (연료 조성 및 스파크 플러그 위치 변경으로 인한 가스 엔진의 성능에 관한 연구)

  • Kim, Yongrae
    • Journal of the Korean Institute of Gas
    • /
    • v.18 no.6
    • /
    • pp.21-26
    • /
    • 2014
  • Renewable gas fuels such as biogas and landfill gas have carbon-neutral nature which can reduce carbon dioxide. However, it is necessary to make stable combustion when this fuel is used in power generating SI(spark ignition) gas engines due to its low heating value and non-uniformity. In this study, it was shown that addition of hydrogen can increase combustion stability of gas engine which is running with high inert gas composition. Thermal efficiency and emission characteristics of this engine was also investigated. In addition, a new spark plug with a long electrode was tested and compared with a base spark plug as a way to improve engine efficiency and reduce exhaust emissions.

2-Dimensional Visualization of the Flame Propagation in a Four-Valve Spark-Ignition Engine (가솔린엔진에서의 2차원 화염 가시화)

  • Bae, Choong-Sik
    • Journal of the Korean Society of Combustion
    • /
    • v.1 no.1
    • /
    • pp.65-73
    • /
    • 1996
  • Flame propagation in a four-valve spark-ignition optical engine was visualized under lean-bum conditions with A/F=18 at 2000rpm. The early flame development in a four-valve pentroof-chamber single-cylinder engine was examined with imaging of the laser-induced Mie scattered light using an image-intensified CCD camera. Flame profiles along the line-of-sight were also visualized through a quartz piston window. Two-dimensional flame structures were visualized with a Proxitronic HF-1 fast motion camera system by Mie scattering from titanium dioxide particles along a planar laser sheet generated by a copper vapor laser. The flame propagation images were subsequently analysed with an image processing programme to obtain information about the flame structure under different tumble flow conditions generated by sleeved and non-sleeved intake ports. This allowed enhancement of the flame images and calculation of the enflamed area, and the displacement of its center, as a function of the tumble flow induced by the pentroof-chamber in the vicinity of spark plug. Image processing of the early flame development quantified the correlation between flame and flow characteristics near the spark plug at the time of ignition which has been known to be one of the most important factors in cyclic combustion variations in lean-burn engines. The results were also compared with direct flame images obtained from the natural flame luminosity of the lean mixture.

  • PDF

SI Engine Closed-loop Spark Advance Control Using Cylinder Pressure (실린더 압력을 이용한 SI엔진의 페루프 점화시기 제어에 관한 연구)

  • Park, Seung-Beom;Yun, Pal-Ju
    • Transactions of the Korean Society of Mechanical Engineers A
    • /
    • v.24 no.9 s.180
    • /
    • pp.2361-2370
    • /
    • 2000
  • The introduction of inexpensive cylinder pressure sensors provides new opportunities for precise engine control. This paper presents a control strategy of spark advance based upon cylinder pressure of spark ignition engines. A location of peak pressure(LPP) is the major parameter for controlling the spark timing, and also the UP is estimated, using a multi-layer feedforward neural network, which needs only five pressure sensor output voltage samples at -40˚, -20˚, 0˚, 20˚, 40˚ after top dead center. The neural network plays an important role in mitigating the A/D conversion load of an electronic engine controller by increasing the sampling interval from 10 crank angle(CA) to 20˚ CA. A proposed control algorithm does not need a sensor calibration and pegging(bias calculation) procedure because the neural network estimates the UP from the raw sensor output voltage. The estimated LPP can be regarded as a good index for combustion phasing, and can also be used as an MBT control parameter. The feasibility of this methodology is closely examined through steady and transient engine operations to control individual cylinder spark advance. The experimental results have revealed a favorable agreement of individual cylinder optimal combustion phasing.

An Experimental Study on the Ignition Probability and Combustion Flame Characteristics of Spark-Ignited Direct-Injection CNG (스파크점화직분식 CNG의 점화성 및 연소화염 특성에 대한 연구)

  • Hwang, Seongill;Chung, Sungsik;Yeom, Jeongkuk;Jeon, Byongyeul;Lee, Jinhyun
    • Journal of ILASS-Korea
    • /
    • v.21 no.1
    • /
    • pp.37-46
    • /
    • 2016
  • For the SI engines, at only full load, the pumping loss has a negligible effect, while at part load conditions, the pumping loss increases. To avoid the pumping loss, the spark-ignited engines are designed to inject gasoline directly into the combustion chamber. In the spark-ignited direct-injection engines, ignition probability is important for successful combustion and the flame propagation characteristics are also different from that of pre-mixed combustion. In this paper, a visualization experiment system is designed to study the ignition probability and combustion flame characteristics of spark-ignited direct-injection CNG fuel. The visualization system is composed of a combustion chamber, fuel supply system, air supply system, electronic control system and data acquisition system. It is found that ambient pressure, ambient temperature and ambient air flow velocity are important parameters which affect the ignition probability of CNG-air mixture and flame propagation characteristics and the injected CNG fuel can be ignited directly by a spark-plug under proper ambient conditions. For all cases of successful ignition, the flame propagation images were digitally recorded with an intensified CCD camera and the flame propagation characteristics were analyzed.