• Title/Summary/Keyword: Grid-based data

Search Result 1,145, Processing Time 0.029 seconds

Formalized Web-based Data Searching System for GRID Environment (그리드 환경을 위한 정형화된 웹 기반 데이터 검색 시스템)

  • Lee, Sang-keon;Hwang, Seog-chan;Choi, Jae-young;No, Kyoung-Tai
    • The KIPS Transactions:PartA
    • /
    • v.11A no.1
    • /
    • pp.75-80
    • /
    • 2004
  • To interact database data with GRID system, implementation and installation of data manipulation module which manipulates database data and its index is required. Developing a search system searching data on web-based database, and integrating it with grid system, it is possible that searching data on web and use it directly on GRID system without independent data module. So, we can build easy and effective grid system, and the system could have more flexible architecture adapting data change. In this paper, we propose a searching system which interacting web-based database with GRID systems. We integrated the searching system with a bio god system which runs virtual screening jobs. As a result, UB Grid (Universal Bio Grid) is constructed. Developer could reduce time and effort required to integrate web data to GRID system, and user could use UB Grid system easily and effectively.

A Dynamic Data Grid Replication Strategy Based on Internet Architecture (인터넷 구조 기반의 동적 데이터 그리드 복제 정책)

  • Kim, Jun-Sang;Lee, Won-Joo;Jeon, Chang-Ho
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.45 no.3
    • /
    • pp.1-6
    • /
    • 2008
  • Data grid shares distributed large data via wide-band network. Such grid environment consumes much time for large data transmission. Because it is implemented on internet as physical network. Many replication strategies were proposed for solving this problem, but they are not optimal in real Data grid environments. Because they were proposed that based on logical topology without consideration of real internet architecture. Grid data access time is largely influenced by internet architecture as physical network of Data grid. In this paper, we propose a new data replication strategy RSIA(Replication Strategy based on Internet Architecture) based on internet architecture. The RSIA places replicas considering structural hierarchy in each element of internet, and avoid the performance bottlenecks to reduce system performance degradation when a data transfer. Through simulation, we show that the proposed RSIA data replication strategy improves the performance of Data Grid environment compared with previous strategies.

Grid Management System and Information System for Semantic Grid Middleware

  • Kim, Hyung-Lae;Han, Byong-John;Jeong, In-Yong;Jeong, Chang-Sung
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.4 no.6
    • /
    • pp.1080-1097
    • /
    • 2010
  • Well organized and easy usable Grid management system is very important for executing various Grid applications and managing Grid computing environment. Moreover, information system which can support Grid management system by providing various Grid environment related information is also one of the most interesting issue in the Grid middleware system area. Effective cooperation between Grid management system and information system can make a novel Grid middleware system. Especially, service oriented architecture based Grid management system is flexible and extensible for providing various type of Grid services. Also, information system based on data mining process which comprises various different kinds of domains such as users, resources and applications can make Grid management system more precise and efficient. In this paper, we propose semantic Grid middleware system which is a combination of Grid management system and semantic information system.

Analyzing Smart Grid Energy Data using Hadoop Based Big Data System (하둡기반 빅데이터 시스템을 이용한 스마트그리드 전력데이터 분석)

  • Cho, YoungTak;Lee, WonJin;Lee, Ingyu;On, Byung-Won;Choi, Jung-In
    • The Transactions of the Korean Institute of Electrical Engineers P
    • /
    • v.64 no.2
    • /
    • pp.85-91
    • /
    • 2015
  • With the increasing popularity of Smart Grid infrastructure, it is much easier to collect energy usage data using AMI (Advanced Measuring Instrument) from residential housing, buildings and factories. Several researches have been done to improve an energy efficiency by analyzing the collected energy usage data. However, it is not easy to store and analyze the energy data using a traditional relational database management system since the data size grows exponentially with an increasing popularity of Smart grid infrastructure. In this paper, we are proposing a Hadoop based Big data system to store and analyze energy usage data. Based on our limited experiments, Hadoop based energy data analysis is three times faster than that of a relational database management system based approach with the current system.

Design and Evaluation of a Quorum-Based Adaptive Dissemination Algorithm for Critical Data in IoTs (IoT에서 중요한 데이터를 위한 쿼럼 기반 적응적 전파 알고리즘의 설계 및 평가)

  • Bae, Ihn Han;Noh, Heung Tae
    • Journal of Korea Multimedia Society
    • /
    • v.22 no.8
    • /
    • pp.913-922
    • /
    • 2019
  • The Internet of Things (IoT) envisions smart objects collecting and sharing data at a massive scale via the Internet. One challenging issue is how to disseminate data to relevant data consuming objects efficiently. In such a massive IoT network, Mission critical data dissemination imposes constraints on the message transfer delay between objects. Due to the low power and communication range of IoT objects, data is relayed over multi-hops before arriving at the destination. In this paper, we propose a quorum-based adaptive dissemination algorithm (QADA) for the critical data in the monitoring-based applications of massive IoTs. To design QADA, we first design a new stepped-triangular grid structures (sT-grid) that support data dissemination, then construct a triangular grid overlay in the fog layer on the lower IoT layer and propose the data dissemination algorithm of the publish/subscribe model that adaptively uses triangle grid (T-grid) and sT-grid quorums depending on the mission critical in the overlay constructed to disseminate the critical data, and evaluate its performance as an analytical model.

A Study on Data Management and Communication Infrastructure Based Upon Standards for Smart Grid Operation (스마트그리드 운영을 위한 표준 기반 데이터 관리 및 통신 인프라에 관한 연구)

  • Choi, Seung-Hwan;Shin, Jin-Ho;Kim, Jun-Sung
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.62 no.9
    • /
    • pp.1209-1216
    • /
    • 2013
  • Recently, there is a rising interest in smart grid operating system which manages various types of distributed generation, smart meters, and electric vehicles with power grid. Considering the features of smart grid environment, the interoperability should be one of the important factors to build smart grid environment successfully. To secure interoperability, smart grid operating system should conform to some standards in terms of the data representation and communication. CIM and OPC-UA are the international standards widely used in smart grid domain for enabling interoperability. They provide common information model and the unified architecture for communicating between each systems or applications. In this paper, we illustrate a smart grid operating system that we have developed to secure interoperability between not only applications but also numerous legacy systems(applications) by implementing CIM based information model and OPC-UA based communication interface services.

Communication Architecture of the IEC 61850-based Micro Grid System

  • Yoo, Byong-Kwan;Yang, Seung-Ho;Yang, Hyo-Sik;Kim, Won-Yong;Jeong, Yu-Seok;Han, Byung-Moon;Jang, Kwang-Soo
    • Journal of Electrical Engineering and Technology
    • /
    • v.6 no.5
    • /
    • pp.605-612
    • /
    • 2011
  • As the power grids are integrated into one big umbrella called a "smart grid," communication protocol plays a key role in successful operations. The successful deployment of smart grid interoperability is a major hurdle that must be overcome. The micro grid, a small power system that distributes energy resource, is operated in diverse regions. Different vendors use different communication protocols in the operation of the micro grid. Recently, the IEC 61850 has been legislated to solve the interoperability problems in power utility automation. The present paper presents a micro grid system based on the IEC 61850 protocol. It consists of a micro grid monitoring system, a protocol converter that transforms serial data to IEC 61850 data, and distributed energy resource controllers for diverse DER nodes. A developed communication gateway can be deployed for DER controllers with serial links to exchange data with IEC 61850-based devices. The gateway can be extended to IEC 61850-based distribution automation systems, substation automation systems, or SCADA.

A Metadata-based Data Grid System for the Integration of Military Information (군 정보통합을 위한 메타데이터 기반의 데이터 그리드 시스템)

  • Ra, Min-Young
    • Journal of the Korea Society of Computer and Information
    • /
    • v.13 no.2
    • /
    • pp.95-103
    • /
    • 2008
  • Recently, the need for integration of military-related information is increasing. The fundamental problem for integrating existing information systems is semantic inconsistency. To solve this problem, the use of metadata is essential, because metadata is a key component for effective information integration. In this paper, we present a metadata-based data grid system for integrating military data sources. First, we investigate federated database approach and data grid approach for information integration, and deal with metadata-based data grid. Then we present a data grid system for the integration of military information.

  • PDF

An Optimization Method for the Calculation of SCADA Main Grid's Theoretical Line Loss Based on DBSCAN

  • Cao, Hongyi;Ren, Qiaomu;Zou, Xiuguo;Zhang, Shuaitang;Qian, Yan
    • Journal of Information Processing Systems
    • /
    • v.15 no.5
    • /
    • pp.1156-1170
    • /
    • 2019
  • In recent years, the problem of data drifted of the smart grid due to manual operation has been widely studied by researchers in the related domain areas. It has become an important research topic to effectively and reliably find the reasonable data needed in the Supervisory Control and Data Acquisition (SCADA) system has become an important research topic. This paper analyzes the data composition of the smart grid, and explains the power model in two smart grid applications, followed by an analysis on the application of each parameter in density-based spatial clustering of applications with noise (DBSCAN) algorithm. Then a comparison is carried out for the processing effects of the boxplot method, probability weight analysis method and DBSCAN clustering algorithm on the big data driven power grid. According to the comparison results, the performance of the DBSCAN algorithm outperforming other methods in processing effect. The experimental verification shows that the DBSCAN clustering algorithm can effectively screen the power grid data, thereby significantly improving the accuracy and reliability of the calculation result of the main grid's theoretical line loss.

A Grid-based Efficient Routing Protocol for a Mobile Sink in Wireless Sensor Networks

  • Lee, Taekkyeun
    • Journal of the Korea Society of Computer and Information
    • /
    • v.23 no.2
    • /
    • pp.35-43
    • /
    • 2018
  • In this paper, we propose a grid-based efficient routing protocol for a mobile sink in wireless sensor networks. In the proposed protocol, the network is partitioned into grids and each grid has a grid head. For the efficient routing to a mobile sink, the proposed protocol uses a mobile sink representative node to send the data to a mobile sink and grid heads are used as a mobile sink representative node. Furthermore, the proposed protocol uses nodes in the boundary of the center grid as position storage nodes. The position storage nodes store the position of a mobile sink representative node and provide source nodes with it for data delivery. With these features, the proposed protocol can reduce a lot of overhead to update the position information and improve the delay of data delivery to a mobile sink. The proposed protocol performs better than other protocols in terms of the delay and the energy consumption per node in the performance evaluation.