• Title/Summary/Keyword: data platform

Search Result 3,405, Processing Time 0.032 seconds

Detection of Abnormal Ship Operation using a Big Data Platform based on Hadoop and Spark (하둡 및 스파크 기반 빅데이터 플랫폼을 이용한 선박 운항 효율 이상 상태 분석)

  • Lee, Taehyeon;Yu, Eun-seop;Park, Kaemyoung;Yu, Seongsang;Park, Jinpyo;Mun, Duhwan
    • Journal of the Korean Society of Manufacturing Process Engineers
    • /
    • v.18 no.6
    • /
    • pp.82-90
    • /
    • 2019
  • To reduce emissions of marine pollutants, regulations are being tightened around the world. In the shipbuilding and shipping industries, various countermeasures are being put forward. As there are limits to applying countermeasures to ships already in operation, however, it is necessary for these vessels to use energy efficiently. The sensors installed on ships typically gather a very large amount of data, and thus a big data platform is needed to manage and analyze the data. In this paper, we build a big data analysis platform based on Hadoop and Spark, and we present a method to detect abnormal ship operation using the platform. We also utilize real ship operation data to discuss the data analysis experiment.

Requirements for Operation Procedure and Plan for the Korean Aviation Safety Big-Data Platform based on the Case of FAA ASIAS (국내 항공안전 빅데이터 플랫폼 운영관리체계 수립 중점 - FAA ASIAS를 중심으로 -)

  • Kim, Jun Hwan;Lim, Jae Jin;Park, Yu Rim;Lee, Jang Ryong
    • Journal of the Korean Society for Aviation and Aeronautics
    • /
    • v.29 no.4
    • /
    • pp.105-116
    • /
    • 2021
  • The importance of a systematic approach to collect, process, analyze, and share safety data in aviation safety management is continuously increasing. Accordingly, the domestic aviation industry has been making efforts to build a Big-data platform that can utilize multi-field safety data generated and managed by various stakeholders and to develop safety management technology based on them. Big data platforms not only must meet appropriate technical requirements, but also need to establish a management system for effective operation. The purpose of this study is to suggest the requirements of the aviation safety big data platform operation procedure and plan by reviewing the advanced overseas cases (FAA ASIAS). This study can provide overall framework and managerial direction for the operation of the aviation safety big data platform.

Platform Business and Value Creation: Using Public Open Data (플랫폼 비즈니스와 가치 창출: 개방형 공공데이터 활용)

  • Han, Junghee
    • Knowledge Management Research
    • /
    • v.20 no.1
    • /
    • pp.155-174
    • /
    • 2019
  • Variety of data have been opened or connected by several levels of government. In smart city initiatives, open data become the source of a new business model. This paper is to foster ways of public open data (POD) by analyzing the start-up company that utilizes POD. In order to fulfill it, this paper adapts the case study research. Findings say that POD has potential to validate and further enrich the platform business. But to find which types of public open data are most prevalent is insufficient. To do this, it is more needed that sophisticated and many cases should be examined. However, this paper shows that platform business by using POD could lead to reduce the cost and increase the benefits for both providers and customers. From the findings, this paper shows that public open data has an important role not only to boost new venture creations which are prevalent ways of smart city but also to foster different platforms enabling new value capture and creation according to development of internet of things based on ICT technology.

Implementation of Interworking between the Smart City Platforms for Enhancing City Data Interoperability (도시 플랫폼의 상호운용성을 위한 플랫폼 연동 구현 사례)

  • Kim, Seongyun;Sung, NakMyoung;Park, Seungwook
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2022.10a
    • /
    • pp.156-159
    • /
    • 2022
  • There are lots of data-driven analytics approaches to realize smart city. In Korea, Smart City Integration Platform has been deployed in more than 108 cities so It is very important to utilize the platform for smart city. This paper introduces interworking PoC(Proof of Concept) case between Smart City Data Hub, one of the data platform technologies for smart city, and Smart City Integration Platform for enhancing interoperability of city platforms; Smart City Integration Platform sends various city events to Smart City Data Hub and receives predicted city events produced by data analytics in Smart City Data Hub.

  • PDF

A Study on implementation model for security log analysis system using Big Data platform (빅데이터 플랫폼을 이용한 보안로그 분석 시스템 구현 모델 연구)

  • Han, Ki-Hyoung;Jeong, Hyung-Jong;Lee, Doog-Sik;Chae, Myung-Hui;Yoon, Cheol-Hee;Noh, Kyoo-Sung
    • Journal of Digital Convergence
    • /
    • v.12 no.8
    • /
    • pp.351-359
    • /
    • 2014
  • The log data generated by security equipment have been synthetically analyzed on the ESM(Enterprise Security Management) base so far, but due to its limitations of the capacity and processing performance, it is not suited for big data processing. Therefore the another way of technology on the big data platform is necessary. Big Data platform can achieve a large amount of data collection, storage, processing, retrieval, analysis, and visualization by using Hadoop Ecosystem. Currently ESM technology has developed in the way of SIEM (Security Information & Event Management) technology, and to implement security technology in SIEM way, Big Data platform technology is essential that can handle large log data which occurs in the current security devices. In this paper, we have a big data platform Hadoop Ecosystem technology for analyzing the security log for sure how to implement the system model is studied.

Designing an Agricultural Data Sharing Platform for Digital Agriculture Data Utilization and Service Delivery (디지털 농업 데이터 활용 및 서비스 제공을 위한 농산업 데이터 공유 플랫폼 설계)

  • Seung-Jae Kim;Meong-Hun Lee;Jin-Gwang Koh
    • The Journal of Bigdata
    • /
    • v.8 no.1
    • /
    • pp.1-10
    • /
    • 2023
  • This paper presents the design process of an agricultural data sharing platform intended to address major challenges faced by the domestic agricultural industry. The platform was designed with a user interface that prioritizes user requirements for ease of use and offers various analysis techniques to provide growth prediction for field environment, growth, management, and control data. Additionally, the platform supports File to DB and DB to DB linkage methods to ensure seamless linkage between the platform and farmhouses. The UI design process utilized HTML/CSS-based languages, JavaScript, and React to provide a comprehensive user experience from platform login to data upload, analysis, and detailed inquiry visualization. The study is expected to contribute to the development of Korean smart farm models and provide reliable data sets to agricultural industry sites and researchers.

Development and Implementation of Smart Manufacturing Big-Data Platform Using Opensource for Failure Prognostics and Diagnosis Technology of Industrial Robot (제조로봇 고장예지진단을 위한 오픈소스기반 스마트 제조 빅데이터 플랫폼 구현)

  • Chun, Seung-Man;Suk, Soo-Young
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.14 no.4
    • /
    • pp.187-195
    • /
    • 2019
  • In the fourth industrial revolution era, various commercial smart platforms for smart system implementation are being developed and serviced. However, since most of the smart platforms have been developed for general purposes, they are difficult to apply / utilize because they cannot satisfy the requirements of real-time data management, data visualization and data storage of smart factory system. In this paper, we implemented an open source based smart manufacturing big data platform that can manage highly efficient / reliable data integration for the diagnosis diagnostic system of manufacturing robots.

Development of a National Research Data Platform for Sharing and Utilizing Research Data

  • Shin, Youngho;Um, Jungho;Seo, Dongmin;Shin, Sungho
    • Journal of Information Science Theory and Practice
    • /
    • v.10 no.spc
    • /
    • pp.25-38
    • /
    • 2022
  • Research data means data used or created in the course of research or experiments. Research data is very important for validation of research conducted and for use in future research and projects. Recently, convergence research between various fields and international cooperation has been continuously done due to the explosive increase of research data and the increase in the complexity of science and technology. Developed countries are actively promoting open science policies that share research results and processes to create new knowledge and values through convergence research. Communities to promote the sharing and utilization of research data such as RDA (Research Data Alliance) and COAR (Confederation of Open Access Repositories) are active, and various platforms for managing and sharing research data are being developed and used. OpenAIRE (Open Access Infrastructure for Research In Europe), a research data platform in Europe, ARDC (Australian Research Data Commons) in Australia, and IRDB (Institutional Repositories DataBase) in Japan provide research data or research data related services. Korea has been establishing and implementing a research data sharing and utilization strategy to promote the sharing and utilization of research data at the national level, led by the central government. Based on this strategy, KISTI has been building a Korean research data platform (DataON) since 2018, and has been providing research data sharing and utilization services to users since January 2020. This paper reviews the characteristics of DataON and how it is used for research by showing its applications.

A Study on the Strategy of Platform Operator for Free Mobile Data : from the Perspectives of Business Opportunity and Risk (모바일 데이터 비과금에 대한 플랫폼사업자의 전략에 관한 연구: 사업기회 및 위기 관점에서)

  • Cho, Dae-Keun;Song, In-Kuk
    • Journal of Internet Computing and Services
    • /
    • v.18 no.5
    • /
    • pp.123-131
    • /
    • 2017
  • With the rapid growth of mobile services, the various charging methods for mobile data have emerged in the mobile service market. Among them, network operators have begun to provide the zero-rating without any extra charge for the data that use the specific mobile application & services. Zero-rating, the free mobile data services by the network operators provoked many platform operators to confront business opportunity and risk. Though the platform operators are in urgent need of the strategy planning that considers business environments, any research endeavors explaining zero-rating and platform does not exist. Moreover, the analyses of potential effects of zero-rating on the business acts of platform operators has not been performed. Therefore, the study aims to identify the potential business opportunity and risk to prepare the various strategic countermeasure in platform operators' shoes. The study might enable the researchers to properly understand zero-rating and platform, and be utilized as a reference in planning the business strategy of the platform operators.

Big Data Platform Based on Hadoop and Application to Weight Estimation of FPSO Topside

  • Kim, Seong-Hoon;Roh, Myung-Il;Kim, Ki-Su;Oh, Min-Jae
    • Journal of Advanced Research in Ocean Engineering
    • /
    • v.3 no.1
    • /
    • pp.32-40
    • /
    • 2017
  • Recently, the amount of data to be processed and the complexity thereof have been increasing due to the development of information and communication technology, and industry's interest in such big data is increasing day by day. In the shipbuilding and offshore industry also, there is growing interest in the effective utilization of data, since various and vast amounts of data are being generated in the process of design, production, and operation. In order to effectively utilize big data in the shipbuilding and offshore industry, it is necessary to store and process large amounts of data. In this study, it was considered efficient to apply Hadoop and R, which are mostly used in big data related research. Hadoop is a framework for storing and processing big data. It provides the Hadoop Distributed File System (HDFS) for storing big data, and the MapReduce function for processing. Meanwhile, R provides various data analysis techniques through the language and environment for statistical calculation and graphics. While Hadoop makes it is easy to handle big data, it is difficult to finely process data; and although R has advanced analysis capability, it is difficult to use to process large data. This study proposes a big data platform based on Hadoop for applications in the shipbuilding and offshore industry. The proposed platform includes the existing data of the shipyard, and makes it possible to manage and process the data. To check the applicability of the platform, it is applied to estimate the weights of offshore structure topsides. In this study, we store data of existing FPSOs in Hadoop-based Hortonworks Data Platform (HDP), and perform regression analysis using RHadoop. We evaluate the effectiveness of large data processing by RHadoop by comparing the results of regression analysis and the processing time, with the results of using the conventional weight estimation program.