• Title/Summary/Keyword: 빅데이터 서비스

Search Result 1,005, Processing Time 0.029 seconds

A Study on Construction of Platform Using Spectrum Big Data (전파 빅데이터 활용을 위한 플랫폼 구축방안 연구)

  • Kim, Hyoung Ju;Ra, Jong Hei;Jeon, Woong Ryul;Kim, Pankoo
    • Smart Media Journal
    • /
    • v.9 no.2
    • /
    • pp.99-109
    • /
    • 2020
  • This paper proposes a platform construction plan for the use of spectrum big data, collects and analyzes the big data in the radio wave field, establishes a linkage plan, and presents a support system scheme for linking and using the spectrum and public sector big data. It presented a plan to build a big data platform in connection with the spectrum public sector. In a situation where there is a lack of a support system for systematic analysis and utilization of big data in the field of radio waves, by establishing a platform construction plan for the use of big data by radio-related industries, the preemptive response to realize the 4th Industrial Revolution and the status and state of the domestic radio field. The company intends to contribute to enhancing the convenience of users of the big data platform in the public sector by securing the innovation growth engine of the company and contributing to the fair competition of the radio wave industry and the improvement of service quality. In addition, it intends to contribute to raising the social awareness of the value of spectrum management data utilization and establishing a collaboration system that uses spectrum big data through joint use of the platform.

Development of Data Profiling Software Supporting a Microservice Architecture (마이크로 서비스 아키텍처를 지원하는 데이터 프로파일링 소프트웨어의 개발)

  • Chang, Jae-Young;Kim, Jihoon;Jee, Seowoo
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.21 no.5
    • /
    • pp.127-134
    • /
    • 2021
  • Recently, acquisition of high quality data has become an important issue as the expansion of the big data industry. In order to acquiring high quality data, accurate evaluation of data quality should be preceded first. The quality of data can be evaluated through meta-information such as statistics on data, and the task to extract such meta-information is called data profiling. Until now, data profiling software has typically been provided as a component or an additional service of traditional data quality or visualization tools. Hence, it was not suitable for utilizing directly in various environments. To address this problem, this paper presents the development result of data profiling software based on a microservice architecture that can be serviced in various environments. The presented data profiler provides an easy-to-use interface that requests of meta-information can be serviced through the restful API. Also, a proposed data profiler is independent of a specific environment, thus can be integrated efficiently with the various big data platforms or data analysis tools.

Design and Implementation of Efficient Storage and Retrieval Technology of Traffic Big Data (교통 빅데이터의 효율적 저장 및 검색 기술의 설계와 구현)

  • Kim, Ki-su;Yi, Jae-Jin;Kim, Hong-Hoi;Jang, Yo-lim;Hahm, Yu-Kun
    • The Journal of Bigdata
    • /
    • v.4 no.2
    • /
    • pp.207-220
    • /
    • 2019
  • Recent developments in information and communication technology has enabled the deployment of sensor based data to provide real-time services. In Korea, The Korea Transportation Safety Authority is collecting driving information of all commercial vehicles through a fitted digital tachograph (DTG). This information gathered using DTG can be utilized in various ways in the field of transportation. Notably in autonomous driving, the real-time analysis of this information can be used to prevent or respond to dangerous driving behavior. However, there is a limit to processing a large amount of data at a level suitable for real-time services using a traditional database system. In particular, due to a such technical problem, the processing of large quantity of traffic big data for real-time commercial vehicle operation information analysis has never been attempted in Korea. In order to solve this problem, this study optimized the new database server system and confirmed that a real-time service is possible. It is expected that the constructed database system will be used to secure base data needed to establish digital twin and autonomous driving environments.

  • PDF

Design and Implementation of Automated Twitter Data Collecting System : Focus on Environmental Data (자동화된 트위터 데이터 수집 시스템 설계 및 구현 : 환경 데이터를 중심으로)

  • Kim, Do-Hyung;Koo, Jahwan;Kim, Ung-Mo
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2020.05a
    • /
    • pp.361-364
    • /
    • 2020
  • 소셜 네트워크 서비스의 사용자가 늘어나면서, 소셜 네트워크 서비스상에서 발생하는 빅데이터를 활용한 서비스가 늘어나고 있다. 소셜 네트워크 서비스 데이터는 실시간으로 생성되며, 따라서 데이터 수집 시스템 역시 자동화하여 준 실시간으로 데이터를 수집할 필요가 있다. 본 논문에서는 대표적인 소셜 네트워크 서비스인 트위터의 데이터를 지속적으로 수집하기 위한 자동 수집 시스템을 제안한다. 수집 시스템은 Twitter API 를 활용하는 Python 라이브러리를 통해 내용 및 메타데이터를 수집하며, 수집된 데이터를 재 검증한 뒤 저장한다. 또한 구현된 시스템에 환경 데이터를 주제로 하는 쿼리를 입력하여 실제 트위터 데이터를 수집하며 구현된 시스템을 검증해보았다.

An Analysis of Utilization on Virtualized Computing Resource for Hadoop and HBase based Big Data Processing Applications (Hadoop과 HBase 기반의 빅 데이터 처리 응용을 위한 가상 컴퓨팅 자원 이용률 분석)

  • Cho, Nayun;Ku, Mino;Kim, Baul;Xuhua, Rui;Min, Dugki
    • Journal of Information Technology and Architecture
    • /
    • v.11 no.4
    • /
    • pp.449-462
    • /
    • 2014
  • In big data era, there are a number of considerable parts in processing systems for capturing, storing, and analyzing stored or streaming data. Unlike traditional data handling systems, a big data processing system needs to concern the characteristics (format, velocity, and volume) of being handled data in the system. In this situation, virtualized computing platform is an emerging platform for handling big data effectively, since virtualization technology enables to manage computing resources dynamically and elastically with minimum efforts. In this paper, we analyze resource utilization of virtualized computing resources to discover suitable deployment models in Apache Hadoop and HBase-based big data processing environment. Consequently, Task Tracker service shows high CPU utilization and high Disk I/O overhead during MapReduce phases. Moreover, HRegion service indicates high network resource consumption for transfer the traffic data from DataNode to Task Tracker. DataNode shows high memory resource utilization and Disk I/O overhead for reading stored data.

Convergence Analysis of Recognition and Influence on Bigdata in the e-Learning Field (이러닝 분야의 빅데이터에 관한 인식과 영향에 관한 융합적 분석)

  • Noh, Kyoo-Sung
    • Journal of Digital Convergence
    • /
    • v.13 no.10
    • /
    • pp.51-58
    • /
    • 2015
  • The utilization of Big data in the field of education has spread around the developed countries. However, in Korea, there are only experimental approaches related to Bigdata, yet for the related researches and services to appear. Therefore, it is the situation that needs to understand the reason for poor use of big data in the e-Learning industry, study and seek out alternatives to solve these problems. The result of this study shows that it was investigated that the high level of understanding of Bigdata has recognized large impact on e-Learning of Big Data and the more large-scale sales companies have recognized large impact on e-Learning of Big Data in the e-Learning industry. In conclusion, this study makes a proposal to expand the training and utilization policies of Bigdata relating to different sales scales.

Design and Implementation of a Food Information Analysis System Based on Big Data (빅데이터 기반의 식품 정보 분석 시스템의 설계 및 구현)

  • Lim, Jongtae;Ryu, Eunkyung;Kim, Cheonjung;Park, Jaeyeol;Lee, Suji;Choi, Kitae;Bok, Kyoungsoo;Yoo, Jaesoo
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2014.11a
    • /
    • pp.295-296
    • /
    • 2014
  • 정부 3.0이 출범하면서 공공 데이터들의 개방이 활성화되기 시작했다. 공공 빅데이터로부터 다양한 분석을 수행하고 의미 있는 정보들을 도출하기 위해서는 빅데이터 분석 도구를 이용한 복잡한 분석들을 수행하여야한다. 본 논문에서는 빅데이터 분석을 이용한 식품 정보 분석 시스템을 설계하고 구현한다. 설계한 시스템은 식품에 대한 정보를 분석하여 특징에 따라 분류하고, 빅데이터 분석을 통해 실생활에서 구매자에게 유용한 서비스를 제공하는 것을 목적으로 하고 있다.

  • PDF

A study on the Construction of a Big Data-based Urban Information and Public Transportation Accessibility Analysis Platforms- Focused on Gwangju Metropolitan City - (빅데이터 기반의 도시정보·접대중교통근성 분석 플랫폼 구축 방안에 관한 연구 -광주광역시를 중심으로-)

  • Sangkeun Lee;Seungmin Yu;Jun Lee;Daeill Kim
    • Smart Media Journal
    • /
    • v.11 no.11
    • /
    • pp.49-62
    • /
    • 2022
  • Recently, with the development of Smart City Solutions such as Big data, AI, IoT, Autonomous driving, and Digital twins around the world, the proliferation of various smart devices and social media, and the record of the deeds that people have left everywhere, the construction of Smart Cities using the "Big Data" environment in which so much information and data is produced that it is impossible to gauge the scale is actively underway. The Purpose of this study is to construct an objective and systematic analysis Model based on Big Data to improve the transportation convenience of citizens and formulate efficient policies in Urban Information and Public Transportation accessibility in sustainable Smart Cities following the 4th Industrial Revolution. It is also to derive the methodology of developing a Big Data-Based public transport accessibility and policy management Platform using a sustainable Urban Public DB and a Private DB. To this end, Detailed Living Areas made a division and the accessibility of basic living amenities of Gwangju Metropolitan City, and the Public Transportation system based on Big Data were analyzed. As a result, it was Proposed to construct a Big Data-based Urban Information and Public Transportation accessibility Platform, such as 1) Using Big Data for public transportation network evaluation, 2) Supporting Transportation means/service decision-making based on Big Data, 3) Providing urban traffic network monitoring services, and 4) Analyzing parking demand sources and providing improvement measures.

Design and Implementation of a Flood Disaster Safety System Using Realtime Weather Big Data (실시간 기상 빅데이터를 활용한 홍수 재난안전 시스템 설계 및 구현)

  • Kim, Yeonwoo;Kim, Byounghoon;Ko, Geonsik;Choi, Minwoong;Song, Heesub;Kim, Gihoon;Yoo, Seunghun;Lim, Jongtae;Bok, Kyungsoo;Yoo, Jaesoo
    • The Journal of the Korea Contents Association
    • /
    • v.17 no.1
    • /
    • pp.351-362
    • /
    • 2017
  • Recently, analysis techniques to extract new meanings using big data analysis and various services using them have been developed. A disaster safety service among such services has been paid attention as the most important service. In this paper, we design and implement a flood disaster safety system using real time weather big data. The proposed system retrieves and processes vast amounts of information being collected in real time. In addition, it analyzes risk factors by aggregating the collected real time and past data and then provides users with prediction information. The proposed system also provides users with the risk prediction information by processing real time data such as user messages and news, and by analyzing disaster risk factors such a typhoon and a flood. As a result, users can prepare for potential disaster safety risks through the proposed system.

Exploratory research based on big data for Improving the revisit rate of foreign tourists and invigorating consumption (외국인 관광객 재방문율 향상과 소비 활성화를 위한 빅데이터 기반의 탐색적 연구)

  • An, Sung-Hyun;Park, Seong-Taek
    • Journal of Industrial Convergence
    • /
    • v.18 no.6
    • /
    • pp.19-25
    • /
    • 2020
  • Big data analytics are indispensable today in various industries and public sectors. Therefore, in this study, we will utilize big data analysis to search for improvement plans for domestic tourism services using the LDA analysis method. In particular, we have tried an exploratory approach that can improve tourist satisfaction, which can improve revisit and service, especially in Seoul, which has the largest number of foreign tourists. In this study, we collected and analyzed statistical data of Seoul City and Korea Tourism Organization and Internet information such as SNS via R. And we utilized text mining methods including LDA. As a result of the analysis, one of the purposes of visiting South Korea by foreigners was gastronomic tourism. We will try to derive measures to improve the quality of services centered on gastronomic tourism.