• 제목/요약/키워드: SparkR

검색결과 79건 처리시간 0.027초

Distributed Indexing Methods for Moving Objects based on Spark Stream

  • Lee, Yunsou;Song, Seokil
    • International Journal of Contents
    • /
    • 제11권1호
    • /
    • pp.69-72
    • /
    • 2015
  • Generally, existing parallel main-memory spatial index structures to avoid the trade-off between query freshness and CPU cost uses light-weight locking techniques. However, still, the lock based methods have some limits such as thrashing which is a well-known problem in lock based methods. In this paper, we propose a distributed index structure for moving objects exploiting the parallelism in multiple machines. The proposed index is a lock free multi-version concurrency technique based on the D-Stream model of Spark Stream. The proposed method exploits the multiversion nature of D-Stream of Spark Streaming.

가솔린 및 LPG 연료를 사용하는 직접분사식 불꽃점화엔진에서 배출되는 극미세입자 배출 특성에 관한 연구 (Particulate Emissions from a Direct Injection Spark-ignition Engine Fuelled with Gasoline and LPG)

  • 이석환;오승묵;강건용;조준호;차경옥
    • 한국자동차공학회논문집
    • /
    • 제19권3호
    • /
    • pp.65-72
    • /
    • 2011
  • In this study, the numbers, sizes of particles from a single cylinder direct injection spark-ignition (DISI) engine fuelled with gasoline and LPG are examined over a wide range of engine operating conditions. Tests are conducted with various engine loads (2~10bar of IMEP) and fuel injection pressures (60, 90, and 120 bar) at the engine speed of 1,500 rpm. Particles are sampled directly from the exhaust pipe using rotating disk thermodiluter. The size distributions are measured using a scanning mobility particle sizer (SMPS) and the particle number concentrations are measured using a condensation particle counter (CPC). The results show that maximum brake torque (MBT) timing for LPG fuel is less sensitive to engine load and its combustion stability is also better than that for gasoline fuel. The total particle number concentration for LPG was lower by a factor of 100 compared to the results of gasoline emission due to the good vaporization characteristic of LPG. Test result presents that LPG for direct injection spark ignition engine help the particle emission level to reduce.

Spark Plasma Sintering법에 의해 예비 성형된 Al-10Si-5Fe-1Zr 분말합금의 고온 압축변형 거동 (Compressive Deformation Behavior of Al-10Si-5Fe-1Zr Powder Alloys Consolidated by Spark Plasma Sintering Process)

  • 박상춘;김목순;김경택;신승용;이정근;류관호
    • 대한금속재료학회지
    • /
    • 제49권11호
    • /
    • pp.853-859
    • /
    • 2011
  • Compressive deformation behavior of Al-10Si-5Fe-1Zr (wt%) alloy preform fabricated by SPS(spark plasma sintering) of gas atomized powder was investigated in the temperature range from 380 to $480^{\circ}C$ and at strain rates from $1.0{\times}10^{-3}$ to $1.0{\times}10^{0}s^{-1}$. Stress-strain curves showed a peak stress (${\sigma}_p$) during initial stage of deformation, followed by a steady state flow at all temperatures and strain rates tested. The (${\sigma}_p$) decreased with both increase in temperature and decrease in strain rate. Nearly full densification was found to occur in the compressively deformed specimens irrespective of test condition. TEM observation revealed a restricted grain growth during steady state flow.

방전플라즈마 소결 공정을 이용한 WC-Co-B4C 소재의 기계적 특성평가 (Mechanical Property Evaluation of WC-Co-B4C Hard Materials by a Spark Plasma Sintering Process)

  • 이정한;박현국
    • 한국재료학회지
    • /
    • 제31권7호
    • /
    • pp.397-402
    • /
    • 2021
  • In this study, binderless-WC, WC-6 wt%Co, WC-6wt% 1 and 2.5 B4C materials are fabricated by spark plasma sintering process (SPS process). Each fabricated WC material is almost completely dense, with a relative density up to 99.5 % after the simultaneous application of pressure of 60 MPa. The WC added Co and Co-B4C materials resulted in crystalline growth. The WC with HCP crystal structure has respective interfacial energy (basal facet direction: 1.07 ~ 1.34 J·m-2, prismatic direction: 1.43 ~ 3.02 J·m-2) that depends on the grain growth direction. It is confirmed that the continuous grain growth, biased by the basal facet, which has relatively low energy, is promoted at the WC/Co interface. As abnormal grain growth takes place, the grain size increases more than twice from 0.37 to 0.8 um. It is found through analysis that the hardness property also greatly decreases from about 2661.4 to 1721.4 kg/mm2, along with the grain growth.

Consolidation of Bulk Metallic Glass Composites

  • Lee, Jin-Kyu;Kim, Hwi-Jun;Kim, Taek-Soo;Shin, Seung-Yong;Bae, Jung-Chan
    • 한국분말야금학회:학술대회논문집
    • /
    • 한국분말야금학회 2006년도 Extended Abstracts of 2006 POWDER METALLURGY World Congress Part2
    • /
    • pp.848-849
    • /
    • 2006
  • Bulk metallic glass (BMG) composites combining a $Cu_{54}Ni_6Zr_{22}Ti_{18}$ matrix with brass powders or $Zr_{62}A_{l8}Ni_{13}Cu_{17}$ metallic glass powders were fabricated by spark plasma sintering. The brass powders and Zr-based metallic glass powders added for the enhancement of plasticity are well distributed homogeneously in the Cu-based metallic glass matrix after consolidation. The BMG composites show macroscopic plasticity after yielding, and the plastic strain increased to around 2% without a decrease in strength for the composite material containing 20 vol% Zr-based amorphous powders. The proper combination of strength and plasticity in the BMG composites was obtained by introducing a second phase in the metallic glass matrix.

  • PDF

k-NN Join Based on LSH in Big Data Environment

  • Ji, Jiaqi;Chung, Yeongjee
    • Journal of information and communication convergence engineering
    • /
    • 제16권2호
    • /
    • pp.99-105
    • /
    • 2018
  • k-Nearest neighbor join (k-NN Join) is a computationally intensive algorithm that is designed to find k-nearest neighbors from a dataset S for every object in another dataset R. Most related studies on k-NN Join are based on single-computer operations. As the data dimensions and data volume increase, running the k-NN Join algorithm on a single computer cannot generate results quickly. To solve this scalability problem, we introduce the locality-sensitive hashing (LSH) k-NN Join algorithm implemented in Spark, an approach for high-dimensional big data. LSH is used to map similar data onto the same bucket, which can reduce the data search scope. In order to achieve parallel implementation of the algorithm on multiple computers, the Spark framework is used to accelerate the computation of distances between objects in a cluster. Results show that our proposed approach is fast and accurate for high-dimensional and big data.

방전가공에서 전기적 변화가 갖는 방전 특성에 관한 연구 (A Study for its Characteristics with Electric Variation in an Electrical Discharge Machining)

  • 신근하
    • 한국생산제조학회지
    • /
    • 제6권4호
    • /
    • pp.72-79
    • /
    • 1997
  • A study is a experiment which is figure out to optimum discharge cutting condition of the surface roughness, electronic discharging speed and electrode wear ration with Ton , Toff and V(voltage) as an input condition according to the current(Ip) in an electric spark machine : 1) Electrode is utilized Cu and Graphite. 2) Work piece is used the material of carbon steel. The condition of experiment is : 1) Current is varied 0.7(A) to 50(A) and the time of electric discharging to work piece in each time is 30(min) to 60(min). 2) After the upper side of work piece was measured in radius(5$\mu$m) of stylus analyzed the surface roughness to ade the table and graph of Rmax by yielding data. 3) Electro wear ratio is : \circled1Cooper was measured ex-machining and post-machining by the electronic balance. \circled2The ex-machining of graphite measured by it, the post-machining was found the data from volume $\times$specific gravity and analyzed to made its table and graph on ground the data. 4) In order to keep the accuracy of voltage affected to the work piece was equipped with the A.V. R and the memory scope was sticked to the electric spark machine. 5) In order to preserve the precision of current, to get rid of the noise occured by internal resistance of electric spark machine and to force injecting for the discharge fluid , it made the fixed table for a work piece to minimize the work error by means of one's failure during the electric discharging.

  • PDF

S-PARAFAC: 아파치 스파크를 이용한 분산 텐서 분해 (S-PARAFAC: Distributed Tensor Decomposition using Apache Spark)

  • 양혜경;용환승
    • 정보과학회 논문지
    • /
    • 제45권3호
    • /
    • pp.280-287
    • /
    • 2018
  • 최근 추천시스템과 데이터 분석 분야에서 고차원 형태의 텐서를 이용하는 연구가 증가하고 있다. 이는 고차원의 데이터인 텐서 분석을 통해 더 많은 잠재 요소와 잠재 패턴을 추출가능하기 때문이다. 그러나 고차원 형태인 텐서는 크기가 방대하고 계산이 복잡하기 때문에 텐서 분해를 통해 분석해야한다. 기존 텐서 도구들인 rTensor, pyTensor와 MATLAB은 단일 시스템에서 작동하기 때문에 방대한 양의 데이터를 처리하기 어렵다. 하둡을 이용한 텐서 분해 도구들도 있지만 처리 시간이 오래 걸린다. 따라서 본 논문에서는 인 메모리 기반의 빅데이터 시스템인 아파치 스파크를 기반으로 하는 텐서 분해 도구인 S-PARAFAC을 제안한다. S-PARAFAC은 텐서 분해 방법 중 PARAFAC 분해에 초점을 맞춰 아파치 스파크에 적합하게 변형하여 텐서 분해를 빠르게 분산 처리가능 하도록 하였다. 본 논문에서는 하둡을 기반의 텐서 분해 도구와 S-PARAFAC의 성능을 비교하여 약 4~25배 정도의 좋은 성능을 보였다.

가솔린엔진 대상 성능시험시의 노킹보정률을 사용한 엔진 수정토크의 편차개선 (Method of Decreasing the Deviation of Corrected Engine Torque using Knock Correction Rate in Gasoline Engine Performance Test on Dynamometer)

  • 조윤호;김우태;배충식
    • 한국자동차공학회논문집
    • /
    • 제16권4호
    • /
    • pp.1-7
    • /
    • 2008
  • Recent trends of development in small size gasoline engines are both to have higher compression ratio for the purpose of improved fuel consumption and to advance spark timing up to DBL in a low to mid engine speed region for a good acceleration performance of vehicles. However, there occurs the deviation of corrected engine torque results during engine performance test on dynamometer because test conditions influence the onset of knock. Therefore, this research shows the test deviation of corrected engine torque decreases when knock correction rate is used.

데이터 분석 도구 성능 비교 연구 -기계 학습을 적용하여- (A Performance Comparison Study on Data Analysis Tool -Applying Machine Learning-)

  • 권태희
    • 한국정보처리학회:학술대회논문집
    • /
    • 한국정보처리학회 2016년도 추계학술발표대회
    • /
    • pp.34-37
    • /
    • 2016
  • 빅데이터 시대가 도래되면서 과거와 비교할 수 없을 만큼의 방대하고 다양한 데이터가 생산됨에 따라 기존의 데이터 분석 도구의 사용은 한계에 부딪히게 되었다. 따라서 기존의 분석 도구보다 효율적이고 정확성이 높은 데이터 분석 도구를 필요로 하게 되었고, 빅데이터를 처리할 수 있는 분석 도구들에 대한 많은 연구들이 진행되어 왔다. R과 Apache Spark는 대표적인 데이터 분석 도구로 기계 학습을 위한 기능을 제공하고 있다. 본 논문에서는 기계 학습을 활용하여 두 개의 널리 알려진 데이터 분석 도구인 R과 Apache Spark의 데이터 분석 성능을 비교함으로써 보다 효율적이고 정확성이 높은 도구를 모색하고자 한다.