• Title/Summary/Keyword: 빅데이터플랫폼

Search Result 483, Processing Time 0.026 seconds

Research of Water-related Disaster Monitoring Using Satellite Bigdata Based on Google Earth Engine Cloud Computing Platform (구글어스엔진 클라우드 컴퓨팅 플랫폼 기반 위성 빅데이터를 활용한 수재해 모니터링 연구)

  • Park, Jongsoo;Kang, Ki-mook
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.6_3
    • /
    • pp.1761-1775
    • /
    • 2022
  • Due to unpredictable climate change, the frequency of occurrence of water-related disasters and the scale of damage are also continuously increasing. In terms of disaster management, it is essential to identify the damaged area in a wide area and monitor for mid-term and long-term forecasting. In the field of water disasters, research on remote sensing technology using Synthetic Aperture Radar (SAR) satellite images for wide-area monitoring is being actively conducted. Time-series analysis for monitoring requires a complex preprocessing process that collects a large amount of images and considers the noisy radar characteristics, and for this, a considerable amount of time is required. With the recent development of cloud computing technology, many platforms capable of performing spatiotemporal analysis using satellite big data have been proposed. Google Earth Engine (GEE)is a representative platform that provides about 600 satellite data for free and enables semi real time space time analysis based on the analysis preparation data of satellite images. Therefore, in this study, immediate water disaster damage detection and mid to long term time series observation studies were conducted using GEE. Through the Otsu technique, which is mainly used for change detection, changes in river width and flood area due to river flooding were confirmed, centered on the torrential rains that occurred in 2020. In addition, in terms of disaster management, the change trend of the time series waterbody from 2018 to 2022 was confirmed. The short processing time through javascript based coding, and the strength of spatiotemporal analysis and result expression, are expected to enable use in the field of water disasters. In addition, it is expected that the field of application will be expanded through connection with various satellite bigdata in the future.

컨테이너 터미널의 내륙운송 효율화를 위한 플랫폼 개발 모델 구축

  • 황제호;조동현;김시현
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • 2023.05a
    • /
    • pp.123-125
    • /
    • 2023
  • 4차 산업혁명의 가속화에 따라 해운 항만 산업 분야 또한 정보적 측면에서 빅 데이터에 대한 업종별 통합과 공유를 통해 연계 산업 간 산업활동 효율화를 위한 노력이 요구된다. 현재 물류 분야에 다양한 플랫폼들이 도입되고 있지만 대부분 화물운송업 또는 창고 중개업 분야에 편중되어 있다. 항만산업의 경우 코로나 펜데믹 이후 발생한 컨테이너 반입 제한 및 장치율 증가 등에 따라 운송사와 컨테이너터미널 간 갈등이 지속적으로 유발되는 상황이 발생되었다. 이에 따라 본 연구는 플랫폼을 활용한 컨테이너터미널과 운송사 간 플랫폼 개발의 필요성을 인지하고 상호 기업 간 연계 효율성을 높일 수 있는 방안을 모색하였으며 산업 관계자인 컨테이너터미널 운영사, 운송사, 포워더 업종 종사자들을 대상으로 설문지 기반 실증 분석을 수행하였다. 결과적으로 EFA를 통해 추출된 14가지 요인으로 IPA 분석을 수행한 결과 1사분면(사용 용이성, 보안성, 정보 정확성, 정보 적시성, 차량 반출/반입정보, 공컨테이너 반입/반출 정보, 풀컨테이너 반입/반출정보)으로 품질에 대한 지속적인 개선이 수행되어야 하며 2사분면(APP 시스템 품질)에 대한 고려가 종합적으로 수행되어야 함이 도출되었다. 또한, 플랫폼 개발의 주체와 이용자의 참여 유도가 필요하며 상호 이해관계자 간 효율적인 연계와 효율화를 위한 인식 구조 개선이 필요하다고 나타났다. 연구결과는 향후 컨테이너터미널과 내륙운송의 효율적인 연계를 위한 플랫폼 구축에 중대한 시사점을 제공한다.

  • PDF

Design and Implementation of Smart Home Managerment System Using Open Hardward Platform in IOT. (사물인터넷 오픈 하드웨어 플랫폼을 활용한 스마트홈 관리 시스템 설계 및 구현)

  • Kang, Jung-Ku;Park, Seok-Cheon;Kim, Jong-Hyun
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2015.04a
    • /
    • pp.633-636
    • /
    • 2015
  • ICT 시대를 맞아 하루가 다르게 새로운 기술이 등장하고 있다. 최근에는 빅데이터, 모바일, 웨어러블 컴퓨팅 등이 새로운 화두가 되고 있으며, 더 나아가 사물인터넷 시대까지 도래하였다. 스마트 홈은 인간에게 가장 쾌적하고 안락한 환경을 제공할 수 있도록 자율적으로 관리되면서 실감 그런 감성화된 가정환경으로 발전 중이다. 본 논문에서는 사물인터넷 환경에서 온도, 습도, 조도, 인체 동작 감지 센서 등을 통해 데이터를 수집하는 오픈 하드웨어 플랫폼인 아두이노를 활용하여 스마트홈 관리 시스템을 구축하고자 한다.

Heterogeneous Lifelog Mining Model in Health Big-data Platform (헬스 빅데이터 플랫폼에서 이기종 라이프로그 마이닝 모델)

  • Kang, JI-Soo;Chung, Kyungyong
    • Journal of the Korea Convergence Society
    • /
    • v.9 no.10
    • /
    • pp.75-80
    • /
    • 2018
  • In this paper, we propose heterogeneous lifelog mining model in health big-data platform. It is an ontology-based mining model for collecting user's lifelog in real-time and providing healthcare services. The proposed method distributes heterogeneous lifelog data and processes it in real time in a cloud computing environment. The knowledge base is reconstructed by an upper ontology method suitable for the environment constructed based on the heterogeneous ontology. The restructured knowledge base generates inference rules using Jena 4.0 inference engines, and provides real-time healthcare services by rule-based inference methods. Lifelog mining constructs an analysis of hidden relationships and a predictive model for time-series bio-signal. This enables real-time healthcare services that realize preventive health services to detect changes in the users' bio-signal by exploring negative or positive correlations that are not included in the relationships or inference rules. The performance evaluation shows that the proposed heterogeneous lifelog mining model method is superior to other models with an accuracy of 0.734, a precision of 0.752.

Design of Spark SQL Based Framework for Advanced Analytics (Spark SQL 기반 고도 분석 지원 프레임워크 설계)

  • Chung, Jaehwa
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.5 no.10
    • /
    • pp.477-482
    • /
    • 2016
  • As being the advanced analytics indispensable on big data for agile decision-making and tactical planning in enterprises, distributed processing platforms, such as Hadoop and Spark which distribute and handle the large volume of data on multiple nodes, receive great attention in the field. In Spark platform stack, Spark SQL unveiled recently to make Spark able to support distributed processing framework based on SQL. However, Spark SQL cannot effectively handle advanced analytics that involves machine learning and graph processing in terms of iterative tasks and task allocations. Motivated by these issues, this paper proposes the design of SQL-based big data optimal processing engine and processing framework to support advanced analytics in Spark environments. Big data optimal processing engines copes with complex SQL queries that involves multiple parameters and join, aggregation and sorting operations in distributed/parallel manner and the proposing framework optimizes machine learning process in terms of relational operations.

Development and Application of Middle School STEAM Program Using Big Data of World Wide Telescope (WWT 빅데이터를 활용한 중학교 STEAM 프로그램 개발 및 적용)

  • You, Samgmi;Kim, Hyoungbum;Kim, Yonggi;Kim, Heoungtae
    • Journal of the Korean Society of Earth Science Education
    • /
    • v.14 no.1
    • /
    • pp.33-47
    • /
    • 2021
  • This study developed a big data-based STEAM (Science, Technology, Engineering, Art & Mathematics) program using WWT (World Wide Telescope), focusing on content elements of 'solar system', 'star and universe' in the 2015 revised science curriculum, and in order to find out the effectiveness of the STEAM program, analyzed creative problem solving, STEAM attitude, and STEAM satisfaction by applying it to one middle school 176 students simple random sampled. The results of this study are as follows. First, we developed a program to encourage students to actively and voluntarily participating, utilizing the astronomical data platform WWT. Second, in the paired t-test based on the difference between the pre- and post-scores of the creative problem solving measurement test, significant statistical test results were shown in 'idea adaptation', 'imaging', 'analogy', 'idea production' and 'elaboration' sub-factors except 'attention task' sub-factor (p < .05). Third, in the paired t-test based on the difference between the pre- and post-scores of the STEAM attitude test, significant statistical test results were shown in 'interest', 'communication', 'self-concept', 'self-efficacy' and 'science and engineering career choice' sub-factors except 'consideration' and 'usefulness / value recognition' sub-factors (p < .05). Fourth, in the STEAM satisfaction test conducted after class application, the average values of sub-factors were 3.16~3.90. The results indicated that students' understanding and interest in the science subject improved significantly through the big data-based STEAM program using the WWT.

Development of Retargetable Hadoop Simulation Environment Based on DEVS Formalism (DEVS 형식론 기반의 재겨냥성 하둡 시뮬레이션 환경 개발)

  • Kim, Byeong Soo;Kang, Bong Gu;Kim, Tag Gon;Song, Hae Sang
    • Journal of the Korea Society for Simulation
    • /
    • v.26 no.4
    • /
    • pp.51-61
    • /
    • 2017
  • Hadoop platform is a representative storing and managing platform for big data. Hadoop consists of distributed computing system called MapReduce and distributed file system called HDFS. It is important to analyse the effectiveness according to the change of cluster constructions and several parameters. However, since it is hard to construct thousands of clusters and analyse the constructed system, simulation method is required to analyse the system. This paper proposes Hadoop simulator based on DEVS formalism which provides hierarchical and modular modeling. Hadoop simulator provides a retargetable experimental environment that is possible to change of various parameters, algorithms and models. It is also possible to design input models reflecting the characteristics of Hadoop applications. To maximize the user's convenience, the user interface, real-time model viewer, and input scenario editor are also provided. In this paper, we validate Hadoop Simulator through the comparison with the Hadoop execution results and perform various experiments.

Exploring the Direction of Digital Platform Government by Text Mining Technique: Lessons from the Fourth Industrial Revolution Agenda (텍스트마이닝을 통한 디지털플랫폼정부의 방향 모색: 4차산업혁명시대 담론으로부터의 교훈)

  • Park, Soo-Kyung;Cho, Ji-Yeon;Lee, Bong-Gyou
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.22 no.5
    • /
    • pp.139-146
    • /
    • 2022
  • Recently, solving industrial and social problems and creating new values based on big data and AI is being discussed as the main policy goal. The new government also set the digital platform government as a national task in order to achieve new value creation based on big data and AI. However, studies that summarize and diagnose discussions over the past five years are insufficient. Therefore, this study diagnoses the discussions over the past 5 years using the 4th industrial revolution as a keyword. After collecting news editorials from 2017 to 2022 by applying the text mining technique, 9 major topics were discovered. In conclusion, this study provided implications for the government's task to prepare for the future society.

Leading, Coincident, Lagging INdicators to Analyze the Predictability of the Composite Regional Index Based on TCS Data (지역 경기종합지수 예측 가능성 검토를 위한 TCS 데이터 선행·동행·후행성 분석 연구)

  • Kang, Youjeong;Hong, Jungyeol;Na, Jieun;Kim, Dongho;Cheon, Seunghun
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.21 no.1
    • /
    • pp.209-220
    • /
    • 2022
  • With the worldwide spread of African swine fever, interest in livestock epidemics has increased. Livestock transport vehicles are the main cause of the spread of livestock epidemics, but there are no empirical quarantine procedures and standards related to the mobility of livestock transport vehicles in South Korea. This study extracted the trajectory of livestock-related vehicles using the facility-visit history data from the Korea Animal Health Integrated System and the DTG (Digital Tachograph) data from the Korea Transportation Safety Authority. The results are presented as exposure indices aggregating the link-time occupancy of each vehicle. As a result, 274,519 livestock-related vehicle trajectories were extracted, and the exposure values by link and zone were derived quantitatively. This study highlights the need for prior monitoring of livestock transport vehicles and the establishment of post-disaster prevention policies.

A Study on Big Data Analysis of Public Library in Busan: Based on the Library Collection/Circulation Data (부산지역 공공도서관의 빅데이터 분석 연구 - 도서관 정보나루 장서/대출데이터를 중심으로 -)

  • Lee, Soon-Young;Lee, Soo-Sang
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.55 no.4
    • /
    • pp.89-114
    • /
    • 2021
  • This study analyzed the previous studies and utilization cases on library big data, and based on this, analyzed the collection/circulation data of the library big data platform and tried to derive meaningful analysis results. And five analysis indicators were selected: the increase rate of collections by annual, the composition of collections by subject, the composition of unborrowed collections by subject, the rate of borrowed collections, and use factor by subject. The analysis data is 6,722,603 cases of collection/circulation data from 33 public libraries in Busan. The main analysis results are as follows. First, it was found that the gap in the number of circulation was larger than the number of collection in the 33 public libraries. Second, the annual increase rate of collections also showed a clear decline. Third, each library showed a similar pattern in the composition of both the collections and the unborrowed collections by subject. Fourth, it was found that users' circulation were very different by subject and library. Fifth, in most libraries, the rate of circulation of collections and use factor in the natural science field were the highest.