• Title/Summary/Keyword: SparkR

Search Result 79, Processing Time 0.028 seconds

Distributed Indexing Methods for Moving Objects based on Spark Stream

  • Lee, Yunsou;Song, Seokil
    • International Journal of Contents
    • /
    • v.11 no.1
    • /
    • pp.69-72
    • /
    • 2015
  • Generally, existing parallel main-memory spatial index structures to avoid the trade-off between query freshness and CPU cost uses light-weight locking techniques. However, still, the lock based methods have some limits such as thrashing which is a well-known problem in lock based methods. In this paper, we propose a distributed index structure for moving objects exploiting the parallelism in multiple machines. The proposed index is a lock free multi-version concurrency technique based on the D-Stream model of Spark Stream. The proposed method exploits the multiversion nature of D-Stream of Spark Streaming.

Particulate Emissions from a Direct Injection Spark-ignition Engine Fuelled with Gasoline and LPG (가솔린 및 LPG 연료를 사용하는 직접분사식 불꽃점화엔진에서 배출되는 극미세입자 배출 특성에 관한 연구)

  • Lee, Seok-Hwan;Oh, Seung-Mook;Kang, Kern-Yong;Cho, Jun-Ho;Cha, Kyoung-Ok
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.19 no.3
    • /
    • pp.65-72
    • /
    • 2011
  • In this study, the numbers, sizes of particles from a single cylinder direct injection spark-ignition (DISI) engine fuelled with gasoline and LPG are examined over a wide range of engine operating conditions. Tests are conducted with various engine loads (2~10bar of IMEP) and fuel injection pressures (60, 90, and 120 bar) at the engine speed of 1,500 rpm. Particles are sampled directly from the exhaust pipe using rotating disk thermodiluter. The size distributions are measured using a scanning mobility particle sizer (SMPS) and the particle number concentrations are measured using a condensation particle counter (CPC). The results show that maximum brake torque (MBT) timing for LPG fuel is less sensitive to engine load and its combustion stability is also better than that for gasoline fuel. The total particle number concentration for LPG was lower by a factor of 100 compared to the results of gasoline emission due to the good vaporization characteristic of LPG. Test result presents that LPG for direct injection spark ignition engine help the particle emission level to reduce.

Compressive Deformation Behavior of Al-10Si-5Fe-1Zr Powder Alloys Consolidated by Spark Plasma Sintering Process (Spark Plasma Sintering법에 의해 예비 성형된 Al-10Si-5Fe-1Zr 분말합금의 고온 압축변형 거동)

  • Park, Sang-Choon;Kim, Mok-Soon;Kim, Kyung-Taek;Shin, Seung-Young;Lee, Jeong-Keun;Ryu, Kwan-Ho
    • Korean Journal of Metals and Materials
    • /
    • v.49 no.11
    • /
    • pp.853-859
    • /
    • 2011
  • Compressive deformation behavior of Al-10Si-5Fe-1Zr (wt%) alloy preform fabricated by SPS(spark plasma sintering) of gas atomized powder was investigated in the temperature range from 380 to $480^{\circ}C$ and at strain rates from $1.0{\times}10^{-3}$ to $1.0{\times}10^{0}s^{-1}$. Stress-strain curves showed a peak stress (${\sigma}_p$) during initial stage of deformation, followed by a steady state flow at all temperatures and strain rates tested. The (${\sigma}_p$) decreased with both increase in temperature and decrease in strain rate. Nearly full densification was found to occur in the compressively deformed specimens irrespective of test condition. TEM observation revealed a restricted grain growth during steady state flow.

Mechanical Property Evaluation of WC-Co-B4C Hard Materials by a Spark Plasma Sintering Process (방전플라즈마 소결 공정을 이용한 WC-Co-B4C 소재의 기계적 특성평가)

  • Lee, Jeong-Han;Park, Hyun-Kuk
    • Korean Journal of Materials Research
    • /
    • v.31 no.7
    • /
    • pp.397-402
    • /
    • 2021
  • In this study, binderless-WC, WC-6 wt%Co, WC-6wt% 1 and 2.5 B4C materials are fabricated by spark plasma sintering process (SPS process). Each fabricated WC material is almost completely dense, with a relative density up to 99.5 % after the simultaneous application of pressure of 60 MPa. The WC added Co and Co-B4C materials resulted in crystalline growth. The WC with HCP crystal structure has respective interfacial energy (basal facet direction: 1.07 ~ 1.34 J·m-2, prismatic direction: 1.43 ~ 3.02 J·m-2) that depends on the grain growth direction. It is confirmed that the continuous grain growth, biased by the basal facet, which has relatively low energy, is promoted at the WC/Co interface. As abnormal grain growth takes place, the grain size increases more than twice from 0.37 to 0.8 um. It is found through analysis that the hardness property also greatly decreases from about 2661.4 to 1721.4 kg/mm2, along with the grain growth.

Consolidation of Bulk Metallic Glass Composites

  • Lee, Jin-Kyu;Kim, Hwi-Jun;Kim, Taek-Soo;Shin, Seung-Yong;Bae, Jung-Chan
    • Proceedings of the Korean Powder Metallurgy Institute Conference
    • /
    • 2006.09b
    • /
    • pp.848-849
    • /
    • 2006
  • Bulk metallic glass (BMG) composites combining a $Cu_{54}Ni_6Zr_{22}Ti_{18}$ matrix with brass powders or $Zr_{62}A_{l8}Ni_{13}Cu_{17}$ metallic glass powders were fabricated by spark plasma sintering. The brass powders and Zr-based metallic glass powders added for the enhancement of plasticity are well distributed homogeneously in the Cu-based metallic glass matrix after consolidation. The BMG composites show macroscopic plasticity after yielding, and the plastic strain increased to around 2% without a decrease in strength for the composite material containing 20 vol% Zr-based amorphous powders. The proper combination of strength and plasticity in the BMG composites was obtained by introducing a second phase in the metallic glass matrix.

  • PDF

k-NN Join Based on LSH in Big Data Environment

  • Ji, Jiaqi;Chung, Yeongjee
    • Journal of information and communication convergence engineering
    • /
    • v.16 no.2
    • /
    • pp.99-105
    • /
    • 2018
  • k-Nearest neighbor join (k-NN Join) is a computationally intensive algorithm that is designed to find k-nearest neighbors from a dataset S for every object in another dataset R. Most related studies on k-NN Join are based on single-computer operations. As the data dimensions and data volume increase, running the k-NN Join algorithm on a single computer cannot generate results quickly. To solve this scalability problem, we introduce the locality-sensitive hashing (LSH) k-NN Join algorithm implemented in Spark, an approach for high-dimensional big data. LSH is used to map similar data onto the same bucket, which can reduce the data search scope. In order to achieve parallel implementation of the algorithm on multiple computers, the Spark framework is used to accelerate the computation of distances between objects in a cluster. Results show that our proposed approach is fast and accurate for high-dimensional and big data.

A Study for its Characteristics with Electric Variation in an Electrical Discharge Machining (방전가공에서 전기적 변화가 갖는 방전 특성에 관한 연구)

  • 신근하
    • Journal of the Korean Society of Manufacturing Technology Engineers
    • /
    • v.6 no.4
    • /
    • pp.72-79
    • /
    • 1997
  • A study is a experiment which is figure out to optimum discharge cutting condition of the surface roughness, electronic discharging speed and electrode wear ration with Ton , Toff and V(voltage) as an input condition according to the current(Ip) in an electric spark machine : 1) Electrode is utilized Cu and Graphite. 2) Work piece is used the material of carbon steel. The condition of experiment is : 1) Current is varied 0.7(A) to 50(A) and the time of electric discharging to work piece in each time is 30(min) to 60(min). 2) After the upper side of work piece was measured in radius(5$\mu$m) of stylus analyzed the surface roughness to ade the table and graph of Rmax by yielding data. 3) Electro wear ratio is : \circled1Cooper was measured ex-machining and post-machining by the electronic balance. \circled2The ex-machining of graphite measured by it, the post-machining was found the data from volume $\times$specific gravity and analyzed to made its table and graph on ground the data. 4) In order to keep the accuracy of voltage affected to the work piece was equipped with the A.V. R and the memory scope was sticked to the electric spark machine. 5) In order to preserve the precision of current, to get rid of the noise occured by internal resistance of electric spark machine and to force injecting for the discharge fluid , it made the fixed table for a work piece to minimize the work error by means of one's failure during the electric discharging.

  • PDF

S-PARAFAC: Distributed Tensor Decomposition using Apache Spark (S-PARAFAC: 아파치 스파크를 이용한 분산 텐서 분해)

  • Yang, Hye-Kyung;Yong, Hwan-Seung
    • Journal of KIISE
    • /
    • v.45 no.3
    • /
    • pp.280-287
    • /
    • 2018
  • Recently, the use of a recommendation system and tensor data analysis, which has high-dimensional data, is increasing, as they allow us to analyze the tensor and extract potential elements and patterns. However, due to the large size and complexity of the tensor, it needs to be decomposed in order to analyze the tensor data. While several tools are used for tensor decomposition such as rTensor, pyTensor, and MATLAB, since such tools run on a single machine, they are unable to handle large data. Also, while distributed tensor decomposition tools based on Hadoop can handle a scalable tensor, its computing speed is too slow. In this paper, we propose S-PARAFAC, which is a tensor decomposition tool based on Apache Spark, in distributed in-memory environments. We converted the PARAFAC algorithm into an Apache Spark version that enables rapid processing of tensor data. We also compared the performance of the Hadoop based tensor tool and S-PARAFAC. The result showed that S-PARAFAC is approximately 4~25 times faster than the Hadoop based tensor tool.

Method of Decreasing the Deviation of Corrected Engine Torque using Knock Correction Rate in Gasoline Engine Performance Test on Dynamometer (가솔린엔진 대상 성능시험시의 노킹보정률을 사용한 엔진 수정토크의 편차개선)

  • Cho, Yoon-Ho;Kim, Woo-Tai;Bae, Choong-Sik
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.16 no.4
    • /
    • pp.1-7
    • /
    • 2008
  • Recent trends of development in small size gasoline engines are both to have higher compression ratio for the purpose of improved fuel consumption and to advance spark timing up to DBL in a low to mid engine speed region for a good acceleration performance of vehicles. However, there occurs the deviation of corrected engine torque results during engine performance test on dynamometer because test conditions influence the onset of knock. Therefore, this research shows the test deviation of corrected engine torque decreases when knock correction rate is used.

A Performance Comparison Study on Data Analysis Tool -Applying Machine Learning- (데이터 분석 도구 성능 비교 연구 -기계 학습을 적용하여-)

  • Kwon, Tae-Hee
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2016.10a
    • /
    • pp.34-37
    • /
    • 2016
  • 빅데이터 시대가 도래되면서 과거와 비교할 수 없을 만큼의 방대하고 다양한 데이터가 생산됨에 따라 기존의 데이터 분석 도구의 사용은 한계에 부딪히게 되었다. 따라서 기존의 분석 도구보다 효율적이고 정확성이 높은 데이터 분석 도구를 필요로 하게 되었고, 빅데이터를 처리할 수 있는 분석 도구들에 대한 많은 연구들이 진행되어 왔다. R과 Apache Spark는 대표적인 데이터 분석 도구로 기계 학습을 위한 기능을 제공하고 있다. 본 논문에서는 기계 학습을 활용하여 두 개의 널리 알려진 데이터 분석 도구인 R과 Apache Spark의 데이터 분석 성능을 비교함으로써 보다 효율적이고 정확성이 높은 도구를 모색하고자 한다.