• Title/Summary/Keyword: Data Management Platform

Search Result 953, Processing Time 0.032 seconds

A Data-driven Approach for Computational Simulation: Trend, Requirement and Technology

  • Lee, Sunghee;Ahn, Sunil;Joo, Wonkyun;Yang, Myungseok;Yu, Eunji
    • Journal of Internet Computing and Services
    • /
    • v.19 no.1
    • /
    • pp.123-130
    • /
    • 2018
  • With the emergence of a new paradigm called Open Science and Big Data, the need for data sharing and collaboration is also emerging in the computational science field. This paper, we analyzed data-driven research cases for computational science by field; material design, bioinformatics, high energy physics. We also studied the characteristics of the computational science data and the data management issues. To manage computational science data effectively it is required to have data quality management, increased data reliability, flexibility to support a variety of data types, and tools for analysis and linkage to the computing infrastructure. In addition, we analyzed trends of platform technology for efficient sharing and management of computational science data. The main contribution of this paper is to review the various computational science data repositories and related platform technologies to analyze the characteristics of computational science data and the problems of data management, and to present design considerations for building a future computational science data platform.

The Method of Failure Management through Big Data Flow Management in Platform Service Operation Environment (플랫폼 서비스 운용환경에서 빅데이터 플로우 관리를 통한 장애 상황 관리 방법)

  • Baik, Song-Ki;Lim, Jae-Hyun
    • Journal of Convergence for Information Technology
    • /
    • v.11 no.5
    • /
    • pp.23-29
    • /
    • 2021
  • Recently, a situation in which a specific content service is impossible worldwide has occurred due to a failure of the platform service and a significant social and economic problem has been caused in the global service market. In order to secure the stability of platform services, intelligent platform operation management is required. In this study, big data flow management(BDFM) and implementation method were proposed to quickly detect to abnormal service status in the platform operation environment. As a result of analyzing, BDFM technique improved the characteristics of abnormal failure detection by more than 30% compared to the traditional NMS. The big data flow management method has the advantage of being able to quickly detect platform system failures and abnormal service conditions, and it is expected that when connected with AI-based technology, platform management is performed intelligently and the ability to prevent and preserve failures can be greatly improved.

Development of a integrated platform for urban river management (도시하천관리를 위한 연계플랫폼 개발)

  • Koo, Bonhyun;Oh, Seunguk;Koo, Jaseob;Shim, Kyucheoul
    • Journal of Korea Water Resources Association
    • /
    • v.55 no.6
    • /
    • pp.471-480
    • /
    • 2022
  • In this study, a integrated platform applied with various analysis and evaluation models and data collection modules was developed for urban river management. Modules applied to the integrated platform are data collection and provision module, flood analysis module, river evaluation module, and levee breach simulation module, which were selected and applied for efficient urban river management. The integrated platform collects data for application to analysis and evaluation modules from various institutions. The collected data is refined through pre-processing and stored. The stored data is used as input data for each module and is also provided as an Open API through the platform. The flood analysis module is provided to analyze and prepare for floods occurring in cities and rivers. The river evaluation module is used for river planning and management by evaluating rivers in various ways. Finally, the levee breach simulation module can be used to establish countermeasures by deriving a possible damage area due to levee breach through analysis of a virtual breach situation.

Development of personal health management data server platform based on health care data (헬스케어 데이터 기반의 개인 건강관리 데이터 서버 플랫폼 개발)

  • Park, Doyoung;Song, Hojun
    • Journal of Platform Technology
    • /
    • v.10 no.1
    • /
    • pp.29-34
    • /
    • 2022
  • The emergence of new diseases such as the Covid 19 pandemic that occurs in the 21st century and the occurrence of health abnormalities according to the busy daily life of modern people are increasing. Accordingly, the importance of health care management and data-based health management is being highlighted, and in particular, interest in personal health management data based on personal health care data of patients is rapidly increasing. In this study, to solve the difficult problems of personal health management, we developed a personal health care platform incorporating IT for self-diagnosis and solution and developed an application that measures bio-signals generated in the human body and transmits them to the platform. A health management system was established. Through this, not only the health care of modern people, but also the psychological and emotional care support needs through psychological and emotional monitoring of the developmentally disabled and the vulnerable who have difficulty in expressing their opinions are to be addressed. In addition, the overall health and living environment data of the individual was integrated to develop an optimized medical and health management service for the individual.

3D Ground Terrain Processing Platform for Automated Excavation System

  • Kim, Seok;Kim, Tae-yeong;Park, Jae-Woo
    • International conference on construction engineering and project management
    • /
    • 2015.10a
    • /
    • pp.669-670
    • /
    • 2015
  • Efficient management of the construction heavy equipment is required to reduce the rate of carbon emissions and on-site accidents. The intelligent excavation system (IES) will improve the construction quality and productivity through information technologies and efficient equipment operation, especially in large earthwork projects. Three-dimensional digitized ground data should be required for identifying the path of heavy equipment and work-site environment. Rapid development of terrain laser scanners (TLS) is more readily to acquire the digital data. This study suggests the '3D ground terrain processing platform (3DGTPP)' including data manipulating module and analyzing module of the scanned data for intelligent earthmoving equipment operation. The processing platform consists of six modules, including scanning, registering, manipulating, analyzing, transmitting, and storing. 3D ground terrain processing platform presented in this study will provide fundamental information for intelligent excavation system (IES), which will increase the efficiency of earthworks and safety of workers in significant.

  • PDF

A Study on implementation model for security log analysis system using Big Data platform (빅데이터 플랫폼을 이용한 보안로그 분석 시스템 구현 모델 연구)

  • Han, Ki-Hyoung;Jeong, Hyung-Jong;Lee, Doog-Sik;Chae, Myung-Hui;Yoon, Cheol-Hee;Noh, Kyoo-Sung
    • Journal of Digital Convergence
    • /
    • v.12 no.8
    • /
    • pp.351-359
    • /
    • 2014
  • The log data generated by security equipment have been synthetically analyzed on the ESM(Enterprise Security Management) base so far, but due to its limitations of the capacity and processing performance, it is not suited for big data processing. Therefore the another way of technology on the big data platform is necessary. Big Data platform can achieve a large amount of data collection, storage, processing, retrieval, analysis, and visualization by using Hadoop Ecosystem. Currently ESM technology has developed in the way of SIEM (Security Information & Event Management) technology, and to implement security technology in SIEM way, Big Data platform technology is essential that can handle large log data which occurs in the current security devices. In this paper, we have a big data platform Hadoop Ecosystem technology for analyzing the security log for sure how to implement the system model is studied.

Fishery R&D Big Data Platform and Metadata Management Strategy (수산과학 빅데이터 플랫폼 구축과 메타 데이터 관리방안)

  • Kim, Jae-Sung;Choi, Youngjin;Han, Myeong-Soo;Hwang, Jae-Dong;Cho, Wan-Sup
    • The Journal of Bigdata
    • /
    • v.4 no.2
    • /
    • pp.93-103
    • /
    • 2019
  • In this paper, we introduce a big data platform and a metadata management technique for fishery science R & D information. The big data platform collects and integrates various types of fisheries science R & D information and suggests how to build it in the form of a data lake. In addition to existing data collected and accumulated in the field of fisheries science, we also propose to build a big data platform that supports diverse analysis by collecting unstructured big data such as satellite image data, research reports, and research data. Next, by collecting and managing metadata during data extraction, preprocessing and storage, systematic management of fisheries science big data is possible. By establishing metadata in a standard form along with the construction of a big data platform, it is meaningful to suggest a systematic and continuous big data management method throughout the data lifecycle such as data collection, storage, utilization and distribution.

  • PDF

Requirements for Operation Procedure and Plan for the Korean Aviation Safety Big-Data Platform based on the Case of FAA ASIAS (국내 항공안전 빅데이터 플랫폼 운영관리체계 수립 중점 - FAA ASIAS를 중심으로 -)

  • Kim, Jun Hwan;Lim, Jae Jin;Park, Yu Rim;Lee, Jang Ryong
    • Journal of the Korean Society for Aviation and Aeronautics
    • /
    • v.29 no.4
    • /
    • pp.105-116
    • /
    • 2021
  • The importance of a systematic approach to collect, process, analyze, and share safety data in aviation safety management is continuously increasing. Accordingly, the domestic aviation industry has been making efforts to build a Big-data platform that can utilize multi-field safety data generated and managed by various stakeholders and to develop safety management technology based on them. Big data platforms not only must meet appropriate technical requirements, but also need to establish a management system for effective operation. The purpose of this study is to suggest the requirements of the aviation safety big data platform operation procedure and plan by reviewing the advanced overseas cases (FAA ASIAS). This study can provide overall framework and managerial direction for the operation of the aviation safety big data platform.

Design and Implementation of a Personal Health Record Platform Based on Patient-consent Blockchain Technology

  • Kim, Heongkyun;Lee, Sangmin;Kwon, Hyunwoo;Kim, Eunmin
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.12
    • /
    • pp.4400-4419
    • /
    • 2021
  • In the 4th Industrial Revolution, the healthcare industry is undergoing a paradigm shift from post-care and management systems based on diagnosis and treatment to disease prevention and management based on personal precision medicine. To optimize medical services for individual patients, an open ecosystem for the healthcare industry that allows the exchange and utilization of personal health records (PHRs) is required. However, under the current system of hospital-centered data management, it is difficult to implement the linking and sharing of PHRs in practice. To address this problem, in this study, we present the design and implementation of a patient-centered PHR platform using blockchain technology. This platform achieved transparency and reliability in information management by eliminating the risk of leakage and tampering/altering personal information, which could occur when using a PHR. In addition, the patient-consent system was applied to a PHR; thus, the patient acted as the user with ownership. The proposed blockchain-based PHR platform enables the integration of personal medical information with scattered distribution across multiple hospitals, and allows patients to freely use their health records in their daily lives and emergencies. The proposed platform is expected to serve as a stepping stone for patient-centered healthcare data management and utilization.

A Design on The Zone Master Platform based on IIoT communication for Smart Factory Digital Twin (스마트 팩토리 디지털 트윈(Digital Twin)을 위한 IIoT 통신 기반 ZMP(Zone Master Platform) 설계)

  • Park, Seon-Hui;Bae, Jong-Hwan
    • Journal of Internet of Things and Convergence
    • /
    • v.6 no.4
    • /
    • pp.81-87
    • /
    • 2020
  • This paper creates a standard node for acquiring sensor data from various industrial sensors (IoT/non-IoT) for the establishment of Smart Factory Digital Twin, and provides inter-compatible data by linking zones by group/process to secure data stability and to ensure the digital twin (Digital Twin) of Smart Factory. The process of the Zone Master platform contains interface specifications to define sensor objects and how sensor interactions between independent systems are performed and carries out individual policies for unique data exchange rules. The interface for execution control of the Zone Master Platform processor provides system management, declaration management for public-subscribe, object management for registering and communicating status information of sensor objects, ownership management for property ownership sharing, time management for data synchronization, and data distribution management for Route information on data exchange.