• Title/Summary/Keyword: big data service platform

Search Result 156, Processing Time 0.022 seconds

Development of Big-data Management Platform Considering Docker Based Real Time Data Connecting and Processing Environments (도커 기반의 실시간 데이터 연계 및 처리 환경을 고려한 빅데이터 관리 플랫폼 개발)

  • Kim, Dong Gil;Park, Yong-Soon;Chung, Tae-Yun
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.16 no.4
    • /
    • pp.153-161
    • /
    • 2021
  • Real-time access is required to handle continuous and unstructured data and should be flexible in management under dynamic state. Platform can be built to allow data collection, storage, and processing from local-server or multi-server. Although the former centralize method is easy to control, it creates an overload problem because it proceeds all the processing in one unit, and the latter distributed method performs parallel processing, so it is fast to respond and can easily scale system capacity, but the design is complex. This paper provides data collection and processing on one platform to derive significant insights from various data held by an enterprise or agency in the latter manner, which is intuitively available on dashboards and utilizes Spark to improve distributed processing performance. All service utilize dockers to distribute and management. The data used in this study was 100% collected from Kafka, showing that when the file size is 4.4 gigabytes, the data processing speed in spark cluster mode is 2 minute 15 seconds, about 3 minutes 19 seconds faster than the local mode.

Policy Achievements and Tasks for Using Big-Data in Regional Tourism -The Case of Jeju Special Self-Governing Province- (지역관광 빅데이터 정책성과와 과제 -제주특별자치도를 사례로-)

  • Koh, Sun-Young;JEONG, GEUNOH
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.22 no.3
    • /
    • pp.579-586
    • /
    • 2021
  • This study examines the application of big data and tasks of tourism based on the case of Jeju Special Self-Governing Province, which used big data for regional tourism policy. Through the use of big data, it is possible to understand rapidly changing tourism trends and trends in the tourism industry in a timely and detailed manner. and also could be used to elaborate existing tourism statistics. In addition, beyond the level of big data analysis to understand tourism phenomena, its scope has expanded to provide a platform for providing real-time customized services. This was made possible by the cooperative governance of industry, government, and academia for data building, analysis, infrastructure, and utilization. As a task, the limitation of budget dependence and institutional problems such as the infrastructure for building personal-level data for personalized services, which are the ultimate goal of smart tourism, and the Personal Information Protection Act remain. In addition, expertise and technical limitations for data analysis and data linkage remain.

A Bridge Technique of Heterogeneous Smart Platform supporting Social Immersive Game (소셜 실감 게임을 위한 이기종 스마트 플랫폼 브릿지 기술)

  • Jang, S.E.;Tang, J.M.;Kim, Sangwook
    • Journal of Korea Multimedia Society
    • /
    • v.17 no.8
    • /
    • pp.1033-1040
    • /
    • 2014
  • Recently, the concept of mobile content service has changed from providing unilaterally contents for single-device to providing same contents for multi-device. This service should be able to provide diverse contents for multi-devices without platform and specification of multi-device. In this study, we propose a bridge technique of heterogeneous smart platform supporting social immersive game. It is possible to access social immersive game by using a multi-platform bridge. To achieve this, we explain techniques of device connection and data transmission between heterogeneous devices using server-client structure and UPnP. It provides an immersive game environment for multi-user, which is able to play in a public place using big screen.

A study on the Construction of a Big Data-based Urban Information and Public Transportation Accessibility Analysis Platforms- Focused on Gwangju Metropolitan City - (빅데이터 기반의 도시정보·접대중교통근성 분석 플랫폼 구축 방안에 관한 연구 -광주광역시를 중심으로-)

  • Sangkeun Lee;Seungmin Yu;Jun Lee;Daeill Kim
    • Smart Media Journal
    • /
    • v.11 no.11
    • /
    • pp.49-62
    • /
    • 2022
  • Recently, with the development of Smart City Solutions such as Big data, AI, IoT, Autonomous driving, and Digital twins around the world, the proliferation of various smart devices and social media, and the record of the deeds that people have left everywhere, the construction of Smart Cities using the "Big Data" environment in which so much information and data is produced that it is impossible to gauge the scale is actively underway. The Purpose of this study is to construct an objective and systematic analysis Model based on Big Data to improve the transportation convenience of citizens and formulate efficient policies in Urban Information and Public Transportation accessibility in sustainable Smart Cities following the 4th Industrial Revolution. It is also to derive the methodology of developing a Big Data-Based public transport accessibility and policy management Platform using a sustainable Urban Public DB and a Private DB. To this end, Detailed Living Areas made a division and the accessibility of basic living amenities of Gwangju Metropolitan City, and the Public Transportation system based on Big Data were analyzed. As a result, it was Proposed to construct a Big Data-based Urban Information and Public Transportation accessibility Platform, such as 1) Using Big Data for public transportation network evaluation, 2) Supporting Transportation means/service decision-making based on Big Data, 3) Providing urban traffic network monitoring services, and 4) Analyzing parking demand sources and providing improvement measures.

Data Analysis Platform Construct of Fault Prediction and Diagnosis of RCP(Reactor Coolant Pump) (원자로 냉각재 펌프 고장예측진단을 위한 데이터 분석 플랫폼 구축)

  • Kim, Ju Sik;Jo, Sung Han;Jeoung, Rae Hyuck;Cho, Eun Ju;Na, Young Kyun;You, Ki Hyun
    • Journal of Information Technology Services
    • /
    • v.20 no.3
    • /
    • pp.1-12
    • /
    • 2021
  • Reactor Coolant Pump (RCP) is core part of nuclear power plant to provide the forced circulation of reactor coolant for the removal of core heat. Properly monitoring vibration of RCP is a key activity of a successful predictive maintenance and can lead to a decrease in failure, optimization of machine performance, and a reduction of repair and maintenance costs. Here, we developed real-time RCP Vibration Analysis System (VAS) that web based platform using NoSQL DB (Mongo DB) to handle vibration data of RCP. In this paper, we explain how to implement digital signal process of vibration data from time domain to frequency domain using Fast Fourier transform and how to design NoSQL DB structure, how to implement web service using Java spring framework, JavaScript, High-Chart. We have implement various plot according to standard of the American Society of Mechanical Engineers (ASME) and it can show on web browser based on HTML 5. This data analysis platform shows a upgraded method to real-time analyze vibration data and easily uses without specialist. Furthermore to get better precision we have plan apply to additional machine learning technology.

Housework and Care in the Era of the 4th Industrial Revolution through Big Data: Changes in the Aspects of Household Service based on the Platform (빅데이터로 살펴본 4차 산업혁명 시대의 가사노동과 돌봄: 플랫폼을 통한 가사서비스 양상 변화)

  • Lee, hyunah;Kwon, Soonbum
    • Journal of Family Resource Management and Policy Review
    • /
    • v.27 no.1
    • /
    • pp.13-24
    • /
    • 2023
  • The 4th industrial revolution came deep into family life and changed the way of housework and care. The change in the family caused by the technological change of the 4th industrial revolution is remarkable in terms of socialization of housework. In this study, the socialization of housework, which is accelerating in the era of the 4th industrial revolution, was examined focusing on the change in the aspect of "household service" through the "platform". Since 2015, when technological changes in the 4th industrial revolution began to decline, related newspaper articles were extracted for daily and economic newspapers nationwide and analyzed big data. The results of big data analysis show that the platform economy using the 4th industrial revolution technology is rapidly spreading the socialization of housework not only at the business level but also at the public policy level. It has been confirmed that support for household services through the platform is growing into a new business area of companies, and at the public policy level, it is being treated as an important policy task in supporting work-family balance or responding to infectious diseases. This study is meaningful in that it provided an opportunity to reflect on the roles and tasks of the family, market, and state for housework and care in the future through changes in housework and care caused by the 4th industrial revolution technology.

An Assessment System for Evaluating Big Data Capability Based on a Reference Model (빅데이터 역량 평가를 위한 참조모델 및 수준진단시스템 개발)

  • Cheon, Min-Kyeong;Baek, Dong-Hyun
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.39 no.2
    • /
    • pp.54-63
    • /
    • 2016
  • As technology has developed and cost for data processing has reduced, big data market has grown bigger. Developed countries such as the United States have constantly invested in big data industry and achieved some remarkable results like improving advertisement effects and getting patents for customer service. Every company aims to achieve long-term survival and profit maximization, but it needs to establish a good strategy, considering current industrial conditions so that it can accomplish its goal in big data industry. However, since domestic big data industry is at its initial stage, local companies lack systematic method to establish competitive strategy. Therefore, this research aims to help local companies diagnose their big data capabilities through a reference model and big data capability assessment system. Big data reference model consists of five maturity levels such as Ad hoc, Repeatable, Defined, Managed and Optimizing and five key dimensions such as Organization, Resources, Infrastructure, People, and Analytics. Big data assessment system is planned based on the reference model's key factors. In the Organization area, there are 4 key diagnosis factors, big data leadership, big data strategy, analytical culture and data governance. In Resource area, there are 3 factors, data management, data integrity and data security/privacy. In Infrastructure area, there are 2 factors, big data platform and data management technology. In People area, there are 3 factors, training, big data skills and business-IT alignment. In Analytics area, there are 2 factors, data analysis and data visualization. These reference model and assessment system would be a useful guideline for local companies.

Governance of A Public Platform Project in the Context of Digital Transformation Focusing on the 'Special Delivery' (공공플랫폼 구축사업의 거버넌스: 경기도 배달플랫폼 '배달특급'의 사례를 중심으로)

  • Seo, Jeongone
    • Journal of Information Technology Services
    • /
    • v.21 no.5
    • /
    • pp.15-28
    • /
    • 2022
  • Recently, government agencies are actively adopting the platform model as a means of public policy. However, existing studies on the public platform are minimal and have focused on user experiences or the possibility of public usage of the platform model. Now the research concerning building governance structure and utilizing network effects of the platform after adopting the platform model in the public sector is keenly required. This study intended to ignite academic dialogue on the governance of public platforms in the context of digital transformation. This study focused on a case of the 'Special delivery,' a public delivery app established by Gyeonggi-do. In order to analyze the characteristics of the public platform and its governance structure, data were collected from press releases, policy reports, and news articles. Data was analyzed using the frame of Hagui's platform design factors and Ansell & Gash's collaborative governance model. The results of the public platform analyses showed 1) incompleteness in the value trade-off accounting, which was designed for platform business based on general cost-benefit analysis, and 2) a closed governance structure that limits direct participation of diverse user groups(i.e., service provider, customer) in order to enhance providers' utility by preventing customers' excessive online activities. The results of this study provided theoretical and policy implications regarding designing the strategy for accounting for value trade-offs and functioning governance structure for public platforms.

Design and Evaluation Security Control Iconology for Big Data Processing (빅데이터 처리를 위한 보안관제 시각화 구현과 평가)

  • Jeon, Sang June;Yun, Seong Yul;Kim, Jeong Ho
    • Journal of Platform Technology
    • /
    • v.8 no.4
    • /
    • pp.38-46
    • /
    • 2020
  • This study describes how to build a security control system using an open source big data solution so that private companies can build an overall security control infrastructure. In particular, the infrastructure was built using the Elastic Stack, one of the free open source big data analysis solutions, as a way to shorten the cost and development time when building a security control system. A comparative experiment was conducted. In addition, as a result of comparing and analyzing the functions, convenience, service and technical support of the two solution, it was found that the Elastic Stack has advantages in the security control of Big Data in terms of community and open solution. Using the Elastic Stack, security logs were collected, analyzed, and visualized step by step to create a dashboard, input large logs, and measure the search speed. Through this, we discovered the possibility of the Elastic Stack as a big data analysis solution that could replace Splunk.

  • PDF

Trends in Disaster Prediction Technology Development and Service Delivery (재난예측 기술 개발 및 서비스 제공 동향)

  • Park, Soyoung;Hong, Sanggi;Lee, Kangbok
    • Electronics and Telecommunications Trends
    • /
    • v.35 no.1
    • /
    • pp.80-88
    • /
    • 2020
  • This paper describes the development trends and service provision examples of disaster occurrence and spread prediction technology for various disasters such as tsunamis, floods, and fires. In terms of fires, we introduce the WIFIRE system, which predicts the spread of large forest fires in the United States, and the Metro21: Smart Cities Institute project, which predicts the risk of building fires. This paper describes the development trends in tsunami prediction technology in the United States and Japan using artificial intelligence (AI) to predict the occurrence and size of tsunamis that cause great damage to coastal cities in Japan, Indonesia, and the United States. In addition, it introduces the NOAA big data platform built for natural disaster prediction, considering that the use of big data is very important for AI-based disaster prediction. In addition, Google's flood forecasting system, domestic and overseas earthquake early warning system development, and service delivery cases will be introduced.