• Title/Summary/Keyword: Large Scale Data

Search Result 2,796, Processing Time 0.032 seconds

Federated Named Data Networking Testbed for Climate Science

  • Ni, Alexander;Lim, Huhnkuk
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.42 no.4
    • /
    • pp.780-784
    • /
    • 2017
  • Data discovery and distribution application that is utilized by climate, high energy physics, and other scientific communities are experiencing performance and large scale data managing problems, that are rooted from the shortcomings of IP architecture. To solve this problem, newly developed data managing applications based on NDN architecture were introduced. In this letter, we present the federated NDN testbed with an NDN-based climate science application and the set of experiments that reflect the performance of NDN based climate application in general with determined and applied optimization.

Predictive Analysis of Financial Fraud Detection using Azure and Spark ML

  • Priyanka Purushu;Niklas Melcher;Bhagyashree Bhagwat;Jongwook Woo
    • Asia pacific journal of information systems
    • /
    • v.28 no.4
    • /
    • pp.308-319
    • /
    • 2018
  • This paper aims at providing valuable insights on Financial Fraud Detection on a mobile money transactional activity. We have predicted and classified the transaction as normal or fraud with a small sample and massive data set using Azure and Spark ML, which are traditional systems and Big Data respectively. Experimenting with sample dataset in Azure, we found that the Decision Forest model is the most accurate to proceed in terms of the recall value. For the massive data set using Spark ML, it is found that the Random Forest classifier algorithm of the classification model proves to be the best algorithm. It is presented that the Spark cluster gets much faster to build and evaluate models as adding more servers to the cluster with the same accuracy, which proves that the large scale data set can be predictable using Big Data platform. Finally, we reached a recall score with 0.73, which implies a satisfying prediction quality in predicting fraudulent transactions.

Sr, Nd and Pb isotopic investigations of ultramafic xenoliths and their host basalts from Jeju Island, Baekryeong Island, Boeun and Ganseong, Korea: Implications for a large-scale difference in the source mantle beneath East Asia

  • Park, Seong-Hee;Kwon, Sung-Tack;Hee Sagong;Cheong, Chang-Sik
    • Proceedings of the Mineralogical Society of Korea Conference
    • /
    • 2001.06a
    • /
    • pp.75-75
    • /
    • 2001
  • We report Sr, Nd and Pb isotope data of clinopyroxene separates from ultramafic xenoliths and their host basaltic rocks in Jeju Island, Baekryeong Island, Boeun and Ganseong, Korea. The isotopic data of the xenoliths and host basalts are distinctly different from those of Korean basement rocks. Except for two xenoliths from Ganseong, all samples in this study have isotopic ratios within the combined range of MORB-OIB data. All basaltic rocks have Nd-Sr-Pb isotope compositions different from those of xenoliths, indicating that the host basaltic magma did not derive from the lithospheric mantle where the xenoliths originated. The range of isotopic composition of xenoliths is much greater than that observed in host basalts, which reflects small-scale heterogeneity of the lithospheric mantle. The greater isotopic heterogeneity of the lithospheric mantle probably reflects its long-term stability. The spinel peridotite xenolith data of Jeju Island, Baekryeong Island and Boeun display mixing hyperbolas between DMM and EM II end members. Since Jeju basalts have EM II-like isotopic signature, the mixing relationship shown by the isotopic data of the Jeju xenoliths can be interpreted as the result of infiltration of metasomatic fluid or melt derived from basaltic magma into DMM-like lithospheric mantle. In contrast to other xenolith sites, the Ganseong xenoliths are dominantly clinopyroxene megacryst and pyroxenite. Clinopyroxene megacrysts have different isotopic ratios from their host basalt, reflecting its exotic origin. Two Ganseong xenoliths (wherlite and clinopyroxenite) have much enriched Sr and Nd isotopic ratios and Nd model ages of 2.5-2.9 Ga, and plot in an array away from the MORB-OIB field. The mantle xenoliths from Korean Peninsula have similar $\^$87/Sr/$\^$86/Sr,$\^$143/Nd/$\^$144/Nd and $\^$207/Pb/$\^$204/Pb ratios to, but higher $\^$208/Pb/$\^$204/Pb ratios than, those from eastern China, indicating that Korean xenoliths are derived from the lithospheric mantle with higher Th/U ratio compared with Chinese ones. The isotopic data of xenolith-bearing basalts of Baekryeong Island and Ganseong, along with Ulreung and Dok Islands, show a mixing trend betlveen DMM and EM I in Sr-Nd-Pb isotopic correlation diagrams, which is also observed in tile northeastern Chinese basalts. However, the Jeju volcanic rocks show an EM II signature that is observed in southeastern Chinese basalts. The isotopic variations in volcanic rocks from the northern and southern portions of the East Asia reflect a large-scale isotopic heterogeneity in their source mantle.

  • PDF

A Study on Reversals after Stock Price Shock in the Korean Distribution Industry

  • Jeong-Hwan, LEE;Su-Kyu, PARK;Sam-Ho, SON
    • Journal of Distribution Science
    • /
    • v.21 no.3
    • /
    • pp.93-100
    • /
    • 2023
  • Purpose: The purpose of this paper is to confirm whether stocks belonging to the distribution industry in Korea have reversals, following large daily stock price changes accompanied by large trading volumes. Research design, data, and methodology: We examined whether there were reversals after the event date when large-scale stock price changes appeared for the entire sample of distribution-related companies listed on the Korea Composite Stock Price Index from January 2004 to July 2022. In addition, we reviewed whether the reversals differed depending on abnormal trading volume on the event date. Using multiple regression analysis, we tested whether high trading volume had a significant effect on the cumulative rate of return after the event date. Results: Reversals were confirmed after the stock price shock in the Korean distribution industry and the return after the event date varied depending on the size of the trading volume on the event day. In addition, even after considering both company-specific and event-specific factors, the trading volume on the event day was found to have significant explanatory power on the cumulative rate of return after the event date. Conclusions: Reversals identified in this paper can be used as a useful tool for establishing a trading strategy.

Streamlined GoogLeNet Algorithm Based on CNN for Korean Character Recognition (한글 인식을 위한 CNN 기반의 간소화된 GoogLeNet 알고리즘 연구)

  • Kim, Yeon-gyu;Cha, Eui-young
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.20 no.9
    • /
    • pp.1657-1665
    • /
    • 2016
  • Various fields are being researched through Deep Learning using CNN(Convolutional Neural Network) and these researches show excellent performance in the image recognition. In this paper, we provide streamlined GoogLeNet of CNN architecture that is capable of learning a large-scale Korean character database. The experimental data used in this paper is PHD08 that is the large-scale of Korean character database. PHD08 has 2,187 samples for each character and there are 2,350 Korean characters that make total 5,139,450 sample data. As a training result, streamlined GoogLeNet showed over 99% of test accuracy at PHD08. Also, we made additional Korean character data that have fonts that are not in the PHD08 in order to ensure objectivity and we compared the performance of classification between streamlined GoogLeNet and other OCR programs. While other OCR programs showed a classification success rate of 66.95% to 83.16%, streamlined GoogLeNet showed 89.14% of the classification success rate that is higher than other OCR program's rate.

Impacts of Large-scale Reclamation on Environment in Korea (한국의 대규모 간척사업이 주변의 환경 변화에 미치는 영향)

  • Lee, Hyoun-Young;Lee, Seung-Ho
    • Journal of the Korean Geographical Society
    • /
    • v.32 no.4
    • /
    • pp.463-478
    • /
    • 1997
  • This paper examines the impact of large-scale tidal flat reclamations on environment by analyzing land use change, ocean cultivation, water quality, sea biota and climate in Shiwha, Sosan and Saemankeum districts. The data used in this paper include Landsat TM images and documents related to population, industry, water quality, sea biota and climate at the time of the pre- and post-reclamation. Many times of field reclamations contribute to the creatation of newly available land for urban and industrial development, but cause environmental degradation significantly. The increase of pollution load and the change of coastal ecology, also cause some changes of climatic element such as relative humidity. As tidal flats were reduced, the area of ocean cultivation and the population of fishing industries were decreased. Conceming the sustainable development. it is necessary to carry out a careful environmental impact assessment accumulating monitoring environmental data continuously by using GIS techniques.

  • PDF

Research of Topography Changes by Artificial Structures and Scattering Mechanism in Yoobu-Do Inter-tidal Flat Using Remote Sensing Data (원격탐사자료를 이용한 인공구조물 건설에 의한 군산 유부도 조간대의 지형변화 및 표면특성에 관한 연구)

  • Xu, Zhen;Kim, Duk-Jin;Kim, Seung Hee
    • Korean Journal of Remote Sensing
    • /
    • v.29 no.1
    • /
    • pp.57-68
    • /
    • 2013
  • Large-scale coastal construction projects, such as land reclamation and dykes, were constructed from the late twentieth century in Yoobu-Do region. Land reclamation combined with the dynamics of tidal currents may have accelerated local sedimentation and erosion resulting in rapid reformation of coastal topography. This study presents the results of the topography changes around Yoobu-Do by large-scale coastal constructions using time-series waterline extraction technique of Landsat TM/ETM+ data acquired from 1998 to 2012. Furthermore, the Freeman-Durden decomposition was applied to fully polarimetric RADARSAT-2 SAR data in order to analyze the scattering mechanisms of the deposited surface. According to the case study, the deposition areas were over 4.5 $km^2$ and distributed in the east, northeast, and west of Yoobu-Do. In the eastern deposition area, it was found that the scattering mechanism was difference from other deposition areas possibly indicating that different types of soil were deposited.

A Development of the Correlation for Predicting the Frost Height in Applying Photoelectric Sensors (광센서를 이용한 서리높이 예측 상관식 개발)

  • Jeon, Chang-Duk
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.16 no.10
    • /
    • pp.7138-7145
    • /
    • 2015
  • In this study, experiments were conducted to investigate the correspondence between the output voltage of the photoelectric sensor and the frost height under heating and defrosting capacity test condition (dry bulb temperature $2^{\circ}C$, wet bulb temperature $1^{\circ}C$) described at KS C 9306, where a real heat exchanger was used as a test rig instead of a large-scale model. A digital microscope and a photoelectric sensor unit consisting of an emitter and a transistor (receiver) were installed in the front of it. A linear correlation is proposed to predict the frost height based on 150 experimental data, approximately 54% of the measured data are consistent with the predicted frost heights within a relative deviation of ${\pm}10%$, it yields good agreement with 90% of the measured data when the frost height larger than 0.3mm with in a relative deviation of ${\pm}10%$. Compared with Xiao's correlation, the slope namely, the change of frost height in accordance with the change of output voltage is consistent within the error of 2.3%. But vertical intercept shows big difference with Xiao's correlation, because it was developed with a large scale model instead of a real heat exchanger.

GPU Based Incremental Connected Component Processing in Dynamic Graphs (동적 그래프에서 GPU 기반의 점진적 연결 요소 처리)

  • Kim, Nam-Young;Choi, Do-Jin;Bok, Kyoung-Soo;Yoo, Jae-Soo
    • The Journal of the Korea Contents Association
    • /
    • v.22 no.6
    • /
    • pp.56-68
    • /
    • 2022
  • Recently, as the demand for real-time processing increases, studies on a dynamic graph that changes over time has been actively done. There is a connected components processing algorithm as one of the algorithms for analyzing dynamic graphs. GPUs are suitable for large-scale graph calculations due to their high memory bandwidth and computational performance. However, when computing the connected components of a dynamic graph using the GPU, frequent data exchange occurs between the CPU and the GPU during real graph processing due to the limited memory of the GPU. The proposed scheme utilizes the Weighted-Quick-Union algorithm to process large-scale graphs on the GPU. It supports fast connected components computation by applying the size to the connected component label. It computes the connected component by determining the parts to be recalculated and minimizing the data to be transmitted to the GPU. In addition, we propose a processing structure in which the GPU and the CPU execute asynchronously to reduce the data transfer time between GPU and CPU. We show the excellence of the proposed scheme through performance evaluation using real dataset.

High-Fidelity Ship Airwake CFD Simulation Method Using Actual Large Ship Measurement and Wind Tunnel Test Results (대형 비행갑판을 갖는 함정과 풍동시험 결과를 활용한 고신뢰도 함정 Airwake 예측)

  • Jindeog Chung;Taehwan Cho;Sunghoon Lee;Jaehoon Choi;Hakmin Lee
    • Journal of the Society of Naval Architects of Korea
    • /
    • v.60 no.2
    • /
    • pp.135-145
    • /
    • 2023
  • Developing high-fidelity Computational Fluid Dynamics (CFD) simulation methods used to evaluate the airwake characteristics along a flight deck of a large ship, the various kind of data such as actual ship measurement and wind tunnel results are required to verify the accuracy of CFD simulation. Inflow velocity profile at the bow, local unsteady flow field data around the flight deck, and highly reliable wind tunnel data which were measured after reviewing Atmospheric Boundary Layer (ABL) simulation and Reynolds Number effects were also used to determine the key parameters such as turbulence model, time resolution and accuracy, grid resolution and type, inflow condition, domain size, simulation length, and so on in STAR CCM+. Velocity ratio and turbulent intensity difference between Full-scale CFD and actual ship measurement at the measurement points show less than 2% and 1.7% respectively. And differences in velocity ratio and turbulence intensity between wind tunnel test and small-scale CFD are both less than 2.2%. Based upon this fact, the selected parameters in CFD simulation are highly reliable for a specific wind condition.