• 제목/요약/키워드: Large-scale Analysis Data

검색결과 1,157건 처리시간 0.027초

다중시기 위성영상을 이용한 시화 방조제 내만 식생변화탐지 (Vegetation Change Detection in the Sihwa Embankment using Multi-Temporal Satellite Data)

  • 정종철;서영상;김상욱
    • 한국환경과학회지
    • /
    • 제15권4호
    • /
    • pp.373-378
    • /
    • 2006
  • The western coast of South Korea is famous for its large and broad tidal lands. Nevertheless, land reclamation, which has been conducted on a large scale, such as Sihwa embankment construction project has accelerated coastal environmental changes in the embankment inland. For monitoring of environmental change, vegetation change detecting of the embankment inland were carried out and field survey data compared with Landsat TM, ETM+, IKONOS, and EOC satellite remotely sensed data. In order to utilize multi-temporal remotely sensed images effectively, all data set with pixel size were analyzed by same geometric correction method. To detect the tidal land vegetation change, the spectral characteristics and spatial resolution of Landsat TM and ETM+ images were analyzed by SMA(spectral mixture analysis). We obtained the 78.96% classification accuracy and Kappa index 0.2376 using March 2000 Landsat data. The SMA(spectral mixture analysis) results were considered with comparing of vegetation seasonal change detection method.

기후변화 시나리오를 활용한 공간정보 기반 극단적 기후사상 분석 도구(EEAT) 개발 (Development of Extreme Event Analysis Tool Base on Spatial Information Using Climate Change Scenarios)

  • 한국진;이명진
    • 대한원격탐사학회지
    • /
    • 제36권3호
    • /
    • pp.475-486
    • /
    • 2020
  • 기후변화 시나리오는 기후변화 대응 연구의 기반이 되는 사항으로, 대용량 시공간 데이터로 구성되어 있다. 데이터의 관점에서는 1종의 시나리오가 약 83 기가바이트(Giga bytes) 이상의 대용량이며, 데이터 형식은 반정형으로 검색, 추출, 저장 및 분석 등 활용상 제약이 있다. 본 연구에서는 대용량, 다중시기 기후변화 시나리오의 활용을 편리하게 개선하기 위하여 공간정보 기반의 극단적 기후사상 분석 도구를 개발하였다. 또한, 개발된 도구를 RCP8.5 기후변화 시나리오에 적용하여 과거 발생한 집중호우 임계치가 미래 발생 가능한 시기와 공간에 대한 시범 분석을 수행하였다. 분석결과, 3일 누적 강우량 587.6 mm 이상인 날이 2080년대 약 76회 발생하는 것으로 분석되었으며, 집중호우는 국지적으로 발생하였다. 개발된 분석도구는 초기 설정부터 분석결과를 도출하는 전 과정이 단일 플랫폼에서 구현되도록 하였다. 더불어 상용 소프트웨어가 없어도 분석결과를 다양한 형식(웹 문서형식(HTML), 이미지(PNG), 기후변화 시나리오(ESR), 통계(XLS))으로 구현되도록 하였다. 따라서 본 분석도구 활용을 통해 기후변화에 대한 미래 전망이나 취약성 평가 등의 활용에 도움이 될 것으로 사료되며, 향후 제공될 기후변화 보고서에 따른 기후변화 시나리오 분석 도구 개발에도 사용될 것으로 기대된다.

Implementation of AIoT Edge Cluster System via Distributed Deep Learning Pipeline

  • Jeon, Sung-Ho;Lee, Cheol-Gyu;Lee, Jae-Deok;Kim, Bo-Seok;Kim, Joo-Man
    • International journal of advanced smart convergence
    • /
    • 제10권4호
    • /
    • pp.278-288
    • /
    • 2021
  • Recently, IoT systems are cloud-based, so that continuous and large amounts of data collected from sensor nodes are processed in the data server through the cloud. However, in the centralized configuration of large-scale cloud computing, computational processing must be performed at a physical location where data collection and processing take place, and the need for edge computers to reduce the network load of the cloud system is gradually expanding. In this paper, a cluster system consisting of 6 inexpensive Raspberry Pi boards was constructed to perform fast data processing. And we propose "Kubernetes cluster system(KCS)" for processing large data collection and analysis by model distribution and data pipeline method. To compare the performance of this study, an ensemble model of deep learning was built, and the accuracy, processing performance, and processing time through the proposed KCS system and model distribution were compared and analyzed. As a result, the ensemble model was excellent in accuracy, but the KCS implemented as a data pipeline proved to be superior in processing speed..

Comparative Study of Dimension Reduction Methods for Highly Imbalanced Overlapping Churn Data

  • Lee, Sujee;Koo, Bonhyo;Jung, Kyu-Hwan
    • Industrial Engineering and Management Systems
    • /
    • 제13권4호
    • /
    • pp.454-462
    • /
    • 2014
  • Retention of possible churning customer is one of the most important issues in customer relationship management, so companies try to predict churn customers using their large-scale high-dimensional data. This study focuses on dealing with large data sets by reducing the dimensionality. By using six different dimension reduction methods-Principal Component Analysis (PCA), factor analysis (FA), locally linear embedding (LLE), local tangent space alignment (LTSA), locally preserving projections (LPP), and deep auto-encoder-our experiments apply each dimension reduction method to the training data, build a classification model using the mapped data and then measure the performance using hit rate to compare the dimension reduction methods. In the result, PCA shows good performance despite its simplicity, and the deep auto-encoder gives the best overall performance. These results can be explained by the characteristics of the churn prediction data that is highly correlated and overlapped over the classes. We also proposed a simple out-of-sample extension method for the nonlinear dimension reduction methods, LLE and LTSA, utilizing the characteristic of the data.

LONG-TERM STREAMFLOW SENSITIVITY TO RAINFALL VARIABILITY UNDER IPCC SRES CLIMATE CHANGE SCENARIO

  • Kang, Boo-sik;Jorge a. ramirez, Jorge-A.-Ramirez
    • Water Engineering Research
    • /
    • 제5권2호
    • /
    • pp.81-99
    • /
    • 2004
  • Long term streamflow regime under virtual climate change scenario was examined. Rainfall forecast simulation of the Canadian Global Coupled Model (CGCM2) of the Canadian Climate Center for modeling and analysis for the IPCC SRES B2 scenario was used for analysis. The B2 scenario envisions slower population growth (10.4 billion by 2010) with a more rapidly evolving economy and more emphasis on environmental protection. The relatively large scale of GCM hinders the accurate computation of the important streamflow characteristics such as the peak flow rate and lag time, etc. The GCM rainfall with more than 100km scale was downscaled to 2km-scale using the space-time stochastic random cascade model. The HEC-HMS was used for distributed hydrologic model which can take the grid rainfall as input data. The result illustrates that the annual variation of the total runoff and the peak flow can be much greater than rainfall variation, which means actual impact of rainfall variation for the available water resources can be much greater than the extent of the rainfall variation.

  • PDF

CFD investigation of a JAEA 7-pin fuel assembly experiment with local blockage for SFR

  • Jeong, Jae-Ho;Song, Min-Seop
    • Nuclear Engineering and Technology
    • /
    • 제53권10호
    • /
    • pp.3207-3216
    • /
    • 2021
  • Three-dimensional structures of a vortical flow field and heat transfer characteristics in a partially blocked 7-pin fuel assembly mock-up of sodium-cooled fast reactor have been investigated through a numerical analysis using a commercial computational fluid dynamics code, ANSYS CFX. The simulation with the SST turbulence model agrees well with the experimental data of outlet and cladding wall temperatures. From the analysis on the limiting streamline at the wall, multi-scale vortexes developed in axial direction were found around the blockage. The vortex core has a high cladding wall temperature, and the attachment line has a low cladding wall temperature. The small-scale vortex structures significantly enhance the convective heat transfer because it increases the turbulent mixing and the turbulence kinetic energy. The large-scale vortex structures supply thermal energy near the heated cladding wall surface. It is expected that control of the vortex structures in the fuel assembly plays a significant role in the convective heat transfer enhancement. Furthermore, the blockage plate and grid spacer increase the pressure drop to about 36% compared to the bare case.

Sensor placement selection of SHM using tolerance domain and second order eigenvalue sensitivity

  • He, L.;Zhang, C.W.;Ou, J.P.
    • Smart Structures and Systems
    • /
    • 제2권2호
    • /
    • pp.189-208
    • /
    • 2006
  • Monitoring large-scale civil engineering structures such as offshore platforms and high-large buildings requires a large number of sensors of different types. Innovative sensor data information technologies are very extremely important for data transmission, storage and retrieval of large volume sensor data generated from large sensor networks. How to obtain the optimal sensor set and placement is more and more concerned by researchers in vibration-based SHM. In this paper, a method of determining the sensor location which aims to extract the dynamic parameter effectively is presented. The method selects the number and place of sensor being installed on or in structure by through the tolerance domain statistical inference algorithm combined with second order sensitivity technology. The method proposal first finds and determines the sub-set sensors from the theoretic measure point derived from analytical model by the statistical tolerance domain procedure under the principle of modal effective independence. The second step is to judge whether the sorted out measured point set has sensitive to the dynamic change of structure by utilizing second order characteristic value sensitivity analysis. A 76-high-building benchmark mode and an offshore platform structure sensor optimal selection are demonstrated and result shows that the method is available and feasible.

Reduction of Ambiguity in Phosphorylation-site Localization in Large-scale Phosphopeptide Profiling by Data Filter using Unique Mass Class Information

  • Madar, Inamul Hasan;Back, Seunghoon;Mun, Dong-Gi;Kim, Hokeun;Jung, Jae Hun;Kim, Kwang Pyo;Lee, Sang-Won
    • Bulletin of the Korean Chemical Society
    • /
    • 제35권3호
    • /
    • pp.845-850
    • /
    • 2014
  • The rapid development of shotgun proteomics is paving the way for extensive proteome profiling, while providing extensive information on various post translational modifications (PTMs) that occur to a proteome of interest. For example, the current phosphoproteomic methods can yield more than 10,000 phosphopeptides identified from a proteome sample. Despite these developments, it remains a challenging issue to pinpoint the true phosphorylation sites, especially when multiple sites are possible for phosphorylation in the peptides. We developed the Phospho-UMC filter, which is a simple method of localizing the site of phosphorylation using unique mass classes (UMCs) information to differentiate phosphopeptides with different phosphorylation sites and increase the confidence in phosphorylation site localization. The method was applied to large scale phosphopeptide profiling data and was demonstrated to be effective in the reducing ambiguity associated with the tandem mass spectrometric data analysis of phosphopeptides.

A study on the rock fracture mechanism of cutter penetration and the assessment system of TBM tunnelling procedure

  • Baek, Seung-Han;Moon, Hyun-Koo
    • 한국지구물리탐사학회:학술대회논문집
    • /
    • 한국지구물리탐사학회 2003년도 Proceedings of the international symposium on the fusion technology
    • /
    • pp.162-169
    • /
    • 2003
  • Excavation by TBM can be characterized by a rock-machine interaction during the cutting process on a small scale, but on a large scale the interaction between the rock mass and TBM becomes very significant. For the planning and evaluation of TBM tunnelling it needs to understand rock fracture mechanism by a cutter or cutters on a small scale, and to estimate penetration rate, advance rate and utilization on a large scale. In this study rock chipping mechanism due to cutter-penetration is analysed by numerical simulation, showing that rock chipping is mainly occurred by tensile failure. Also, through the analysis of factors that affect on TBM procedures in various assessment systems, it is determined that the key elements that should be considered in the planning and evaluation of TBM tunnelling are classified into rock properties, the geological structures and properties of rock mass, and the structural and functional specifications of the machine. The user-friendly assessment tool is developed, so that penetration rate, advance rate and TBM utilization are evaluated from various input data. The tool developed in this study can be applied to a practical TBM tunnelling by understanding TBM tunnelling procedures.

  • PDF

A Controllable Parallel CBC Block Cipher Mode of Operation

  • Ke Yuan;Keke Duanmu;Jian Ge;Bingcai Zhou;Chunfu Jia
    • Journal of Information Processing Systems
    • /
    • 제20권1호
    • /
    • pp.24-37
    • /
    • 2024
  • To address the requirement for high-speed encryption of large amounts of data, this study improves the widely adopted cipher block chaining (CBC) mode and proposes a controllable parallel cipher block chaining (CPCBC) block cipher mode of operation. The mode consists of two phases: extension and parallel encryption. In the extension phase, the degree of parallelism n is determined as needed. In the parallel encryption phase, n cipher blocks generated in the expansion phase are used as the initialization vectors to open n parallel encryption chains for parallel encryption. The security analysis demonstrates that CPCBC mode can enhance the resistance to byte-flipping attacks and padding oracle attacks if parallelism n is kept secret. Security has been improved when compared to the traditional CBC mode. Performance analysis reveals that this scheme has an almost linear acceleration ratio in the case of encrypting a large amount of data. Compared with the conventional CBC mode, the encryption speed is significantly faster.