• Title/Summary/Keyword: 공간 빅 데이터

Search Result 306, Processing Time 0.025 seconds

OLAP-based Big Table Generation for Efficient Analysis of Large-sized IoT Data (대용량 IoT 데이터의 빠른 분석을 위한 OLAP 기반의 빅테이블 생성 방안)

  • Lee, Dohoon;Jo, Chanyoung;On, Byung-Won
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2021.10a
    • /
    • pp.2-5
    • /
    • 2021
  • With the recent development of the Internet of Things (IoT) technology, various terminals are being connected to the Internet. As a result, the amount of IoT data is also increasing, and an index key that can efficient analyze the large-scale IoT data is proposed. Existing index keys have only time and space information, so if data stored in index tables and instance tables were queried using repetition or join operation, IoT data was embedded in the index key of the proposal to create OLAP-based big tables to minimize the number of repetitions or join times.

  • PDF

Travel Time Prediction Algorithm for Trajectory data by using Rule-Based Classification on MapReduce (맵리듀스 환경에서 규칙 기반 분류화를 이용한 궤적 데이터 주행 시간 예측 알고리즘)

  • Kim, JaeWon;Lee, HyunJo;Chang, JaeWoo
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2014.11a
    • /
    • pp.798-801
    • /
    • 2014
  • 여행 정보 시스템(ATIS), 교통 관리 시스템 (ITS) 등 궤적 기반 서비스에서, 서비스 품질을 향상시키기 위해서는 주어진 궤적 질의에 대한 정확한 주행시간을 예측하는 것이 필수적이다. 이를 위한 대표적인 공간 데이터 분석 기법으로는 데이터 분류에서 높은 정확도를 보장하는 규칙 기반 분류화 기법이 존재한다. 그러나 기존 규칙 기반 분류화 기법은 단일 컴퓨터 환경만을 고려하기 때문에, 대용량 공간 데이터 처리에 적합하지 않은 문제점이 존재한다. 이를 해결하기 위해, 본 연구에서는 맵리듀스 환경에서 규칙 기반 분류화를 이용한 궤적 데이터 주행 시간 예측 알고리즘을 개발하고자 한다. 제안하는 알고리즘은 첫째, 맵리듀스를 이용하여 대용량 공간 데이터를 병렬적으로 분석함으로써, 활용도 높은 궤적 데이터 규칙을 생성한다. 이를 통해 대용량 공간 데이터 기반의 규칙 생성 시간을 감소시킨다. 둘째, 그리드 구조 기반의 지도 데이터 분할을 통해, 사용자 질의처리 시 탐색 성능을 향상시킨다. 즉, 주행 시간 예측을 위한 규칙 그룹을 탐색 시 질의를 포함하는 그리드 셀만을 탐색하기 때문에, 질의처리 성능이 향상된다. 마지막으로 맵리듀스 구조에 적합한 질의처리 알고리즘을 설계하여, 효율적인 병렬 질의처리를 지원한다. 이를 위해 맵 함수에서는 선정된 그리드 셀에 대해, 질의에 포함된 도로 구간에서의 주행 시간을 병렬적으로 측정한다. 아울러 리듀스 함수에서는 출발 시간 및 구간별 주행 시간을 바탕으로 맵 함수의 결과를 병합함으로써, 최종 결과를 생성한다. 이를 통해 공간 빅데이터 분석을 통한 주행 시간 예측 기법의 처리 시간 및 결과 정확도를 향상시킨다.

A Study on the Consumer Perception of Metaverse Before and After COVID-19 through Big Data Analysis (빅데이터 분석을 통한 코로나 이전과 이후 메타버스에 대한 소비자의 인식에 관한 연구)

  • Park, Sung-Woo;Park, Jun-Ho;Ryu, Ki-Hwan
    • The Journal of the Convergence on Culture Technology
    • /
    • v.8 no.6
    • /
    • pp.287-294
    • /
    • 2022
  • The purpose of this study is to find out consumers' perceptions of "metaverse," a newly spotlighted technology, through big data analysis as a non-face-to-face society continues after the outbreak of COVID-19. This study conducted a big data analysis using text mining to analyze consumers' perceptions of metaverse before and after COVID-19. The top 30 keywords were extracted through word purification, and visualization was performed through network analysis and concor analysis between each keyword based on this. As a result of the analysis, it was confirmed that the non-face-to-face society continued and metaverse emerged as a trend. Previously, metaverse was focused on textual data such as SNS as a part of life logging, but after that, it began to pay attention to virtual reality space, creating many platforms and expanding industries. The limitation of this study is that since data was collected through the search frequency of portal sites, anonymity was guaranteed, so demographic characteristics were not reflected when data was collected.

Changes in Floating Population Distribution in Jeju Island Tourist Destinations Before and After COVID-19 Using Spatial Big Data Analysis (공간 빅데이터 분석을 활용한 COVID-19 전후 제주도 관광지의 유동인구 분포 변화)

  • Heonkyu Jeong;Yong-Bok Choi
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.27 no.1
    • /
    • pp.12-28
    • /
    • 2024
  • This study aims to identify the trend of changes in tourist floating population before and after COVID-19 in major tourist destinations in Jeju Island through spatial analysis. Seongsan-eup and Andeok-myeon in Jeju Island were selected as the research area, and the research period was set at 1 year before and 2 years after the COVID-19 outbreak. For the analysis, mobile floating population data was refined and processed to calculate floating population distribution and floating population increase/decrease data. This was converted into spatial data and an overlay analysis was performed with location data of major tourist attractions. As a result of the analysis, it was confirmed that the floating population of indoor tourist attractions and small facilities decreased immediately after COVID-19, and that in open coastal areas or large facilities, the floating population decreased less or actually increased. In conclusion, in tourism development, it is necessary to identify changes in floating population according to the characteristics of tourist facilities, and it is necessary to develop tourism facilities and strategies that can respond to risk situations such as pandemics when developing tourist destinations.

Using Data Deduplication In A Cloud Environment, Efficient Data Synchronization Algorithm Design (클라우드 환경에서 데이터 중복제거를 활용한 효율적인 데이터 동기화 알고리즘 설계)

  • Lim, Kwang-Soo;Park, Suk-chun;Kim, Young-Hee
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2015.04a
    • /
    • pp.626-628
    • /
    • 2015
  • 빅 데이터의 시대가 도래 하면서 데이터의 양이 기하급수적으로 증가 하고 있으며, 이에 따라 데이터를 효율적으로 처리하는 기술의 중요성이 부각 되고 있다. 데이터를 효율적으로 처리하기 위한 기술 중 하나인, 데이터 중복제거 기술은 저장 시스템 공간을 효율적으로 사용 할 수 있게 할 뿐만 아니라, 네트워크 환경에서 전송되는 데이터의 양도 획기적으로 줄여 주어 통신비용을 절감하게 한다. 기존의 데이터 중복제거 기술과 데이터 동기화 기법을 분석하고, 이를 바탕으로 클라우드 환경에서 데이터 중복제거를 통한 효율적인 데이터 동기화 기법을 제안하고자 한다.

Efficient 3D Modeling Automation Technique for Underground Facilities Using 3D Spatial Data (3차원 공간 데이터를 활용한 지하시설물의 효율적인 3D 모델링 자동화 기법)

  • Lee, Jongseo
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.25 no.11
    • /
    • pp.1670-1675
    • /
    • 2021
  • The adoption of smart construction technology in the construction industry is progressing rapidly. By utilizing smart construction technologies such as BIM (Building Information Modeling), drones, artificial intelligence, big data, and Internet of Things technology, it has the effect of lowering the accident rate at the construction site and shortening the construction period. In order to introduce a digital twin platform for construction site management, real-time construction site management is possible in real time by constructing the same virtual space. The digital twin virtual space construction method collects and processes data from the entire construction cycle and visualizes it using a 3D model file. In this paper, we introduce a modeling automation technique that constructs an efficient digital twin space by automatically generating 3D modeling that composes a digital twin space based on 3D spatial data.

The Method for Real-time Complex Event Detection of Unstructured Big data (비정형 빅데이터의 실시간 복합 이벤트 탐지를 위한 기법)

  • Lee, Jun Heui;Baek, Sung Ha;Lee, Soon Jo;Bae, Hae Young
    • Spatial Information Research
    • /
    • v.20 no.5
    • /
    • pp.99-109
    • /
    • 2012
  • Recently, due to the growth of social media and spread of smart-phone, the amount of data has considerably increased by full use of SNS (Social Network Service). According to it, the Big Data concept is come up and many researchers are seeking solutions to make the best use of big data. To maximize the creative value of the big data held by many companies, it is required to combine them with existing data. The physical and theoretical storage structures of data sources are so different that a system which can integrate and manage them is needed. In order to process big data, MapReduce is developed as a system which has advantages over processing data fast by distributed processing. However, it is difficult to construct and store a system for all key words. Due to the process of storage and search, it is to some extent difficult to do real-time processing. And it makes extra expenses to process complex event without structure of processing different data. In order to solve this problem, the existing Complex Event Processing System is supposed to be used. When it comes to complex event processing system, it gets data from different sources and combines them with each other to make it possible to do complex event processing that is useful for real-time processing specially in stream data. Nevertheless, unstructured data based on text of SNS and internet articles is managed as text type and there is a need to compare strings every time the query processing should be done. And it results in poor performance. Therefore, we try to make it possible to manage unstructured data and do query process fast in complex event processing system. And we extend the data complex function for giving theoretical schema of string. It is completed by changing the string key word into integer type with filtering which uses keyword set. In addition, by using the Complex Event Processing System and processing stream data at real-time of in-memory, we try to reduce the time of reading the query processing after it is stored in the disk.

Development of Information Technology Infrastructures through Construction of Big Data Platform for Road Driving Environment Analysis (도로 주행환경 분석을 위한 빅데이터 플랫폼 구축 정보기술 인프라 개발)

  • Jung, In-taek;Chong, Kyu-soo
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.19 no.3
    • /
    • pp.669-678
    • /
    • 2018
  • This study developed information technology infrastructures for building a driving environment analysis platform using various big data, such as vehicle sensing data, public data, etc. First, a small platform server with a parallel structure for big data distribution processing was developed with H/W technology. Next, programs for big data collection/storage, processing/analysis, and information visualization were developed with S/W technology. The collection S/W was developed as a collection interface using Kafka, Flume, and Sqoop. The storage S/W was developed to be divided into a Hadoop distributed file system and Cassandra DB according to the utilization of data. Processing S/W was developed for spatial unit matching and time interval interpolation/aggregation of the collected data by applying the grid index method. An analysis S/W was developed as an analytical tool based on the Zeppelin notebook for the application and evaluation of a development algorithm. Finally, Information Visualization S/W was developed as a Web GIS engine program for providing various driving environment information and visualization. As a result of the performance evaluation, the number of executors, the optimal memory capacity, and number of cores for the development server were derived, and the computation performance was superior to that of the other cloud computing.

Extraction of Crime Vulnerable Areas Using Crime Statistics and Spatial Big Data (공간 빅데이터와 범죄통계자료를 이용한 범죄취약지 추출)

  • Park, So-Rang;Park, Jae-Kook
    • Journal of Convergence for Information Technology
    • /
    • v.8 no.1
    • /
    • pp.161-171
    • /
    • 2018
  • This study set out to identify crime vulnerable areas with the GIS spatial analysis technique for the prediction of crimes. Crime vulnerable areas were extracted from the statistics of crimes with the GIS hotspot analysis technique and the inverse distance weighted(IDW) method applied to different crimes according to places and use districts. The scope of surveillance and weight were calculated for each of CPTED surveillance elements including CCTV, streetlamp, patrol division, and police substation. Maps of crime vulnerable areas were overlapped one after another to make a CPTED-based one expressed in four grades(safety, attention, warning, and risk).

A Study for Space-based Energy Management System to Minimizing Power Consumption in the Big Data Environments (소비전력 최소화를 위한 빅데이터 환경에서의 공간기반 에너지 관리 시스템에 관한 연구)

  • Lee, Yong-Soo;Heo, Jun;Choi, Yong-Hoon
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.13 no.6
    • /
    • pp.229-235
    • /
    • 2013
  • This paper proposed the method to reduce and manage the amount of using power by using the Self-Learning of inference engine that evolves through learning increasingly smart ways for each spaces with in the Space-Based Energy Management System (SEMS, Space-based Energy Management System) that is defined as smallest unit space with constant size and similar characteristics by using the collectible Big Data from the various information networks and the informations of various sensors from the existing Energy Management System(EMS), mostly including such as the Energy Management Systems for the Factory (FEMS, Factory Energy Management System), the Energy Management Systems for Buildings (BEMS, Building Energy Management System), and Energy Management Systems for Residential (HEMS, Home Energy Management System), that is monitoring and controlling the power of systems through various sensors and administrators by measuring the temperature and illumination.