• Title/Summary/Keyword: Spatial Big Data System

Search Result 90, Processing Time 0.032 seconds

Load Balancing for Distributed Processing of Real-time Spatial Big Data Stream (실시간 공간 빅데이터 스트림 분산 처리를 위한 부하 균형화 방법)

  • Yoon, Susik;Lee, Jae-Gil
    • Journal of KIISE
    • /
    • v.44 no.11
    • /
    • pp.1209-1218
    • /
    • 2017
  • A variety of sensors is widely used these days, and it has become much easier to acquire spatial big data streams from various sources. Since spatial data streams have inherently skewed and dynamically changing distributions, the system must effectively distribute the load among workers. Previous studies to solve this load imbalance problem are not directly applicable to processing spatial data. In this research, we propose Adaptive Spatial Key Grouping (ASKG). The main idea of ASKG is, by utilizing the previous distribution of the data streams, to adaptively suggest a new grouping scheme that evenly distributes the future load among workers. We evaluate the validity of the proposed algorithm in various environments, by conducting an experiment with real datasets while varying the number of workers, input rate, and processing overhead. Compared to two other alternative algorithms, ASKG improves the system performance in terms of load imbalance, throughput, and latency.

AR Tourism Recommendation System Based on Character-Based Tourism Preference Using Big Data

  • Kim, In-Seon;Jeong, Chi-Seo;Jung, Tae-Won;Kang, Jin-Kyu;Jung, Kye-Dong
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.13 no.1
    • /
    • pp.61-68
    • /
    • 2021
  • The development of the fourth industry has enabled users to quickly share a lot of data online. We can analyze big data on information about tourist attractions and users' experiences and opinions using artificial intelligence. It can also analyze the association between characteristics of users and types of tourism. This paper analyzes individual characteristics, recommends customized tourist sites and proposes a system to provide the sacred texts of recommended tourist sites as AR services. The system uses machine learning to analyze the relationship between personality type and tourism type preference. Based on this, it recommends tourist attractions according to the gender and personality types of users. When the user finishes selecting a tourist destination from the recommendation list, it visualizes the information of the selected tourist destination with AR.

Update Frequency Reducing Method of Spatio-Temporal Big Data based on MapReduce (MapReduce와 시공간 데이터를 이용한 빅 데이터 크기의 이동객체 갱신 횟수 감소 기법)

  • Choi, Youn-Gwon;Baek, Sung-Ha;Kim, Gyung-Bae;Bae, Hae-Young
    • Spatial Information Research
    • /
    • v.20 no.2
    • /
    • pp.137-153
    • /
    • 2012
  • Until now, many indexing methods that can reduce update cost have been proposed for managing massive moving objects. Because indexing methods for moving objects have to be updated periodically for managing moving objects that change their location data frequently. However these kinds indexing methods occur big load that exceed system capacity when the number of moving objects increase dramatically. In this paper, we propose the update frequency reducing method to combine MapReduce and existing indices. We use the update request grouping method for each moving object by using MapReduce. We decide to update by comparing the latest data and the oldest data in grouping data. We reduce update frequency by updating the latest data only. When update is delayed, for the data should not be lost and updated periodically, we store the data in a certain period of time in the hash table that keep previous update data. By the performance evaluation, we can prove that the proposed method reduces the update frequency by comparison with methods that are not applied the proposed method.

Changes in Measuring Methods of Walking Behavior and the Potentials of Mobile Big Data in Recent Walkability Researches (보행행태조사방법론의 변화와 모바일 빅데이터의 가능성 진단 연구 - 보행환경 분석연구 최근 사례를 중심으로 -)

  • Kim, Hyunju;Park, So-Hyun;Lee, Sunjae
    • Journal of the Architectural Institute of Korea Planning & Design
    • /
    • v.35 no.1
    • /
    • pp.19-28
    • /
    • 2019
  • The purpose of this study is to evaluate the walking behavior analysis methodology used in the previous studies, paying attention to the demand for empirical data collecting for urban and neighborhood planning. The preceding researches are divided into (1)Recording, (2) Surveys, (3)Statistical data, (4)Global positioning system (GPS) devices, and (5)Mobile Big Data analysis. Next, we analyze the precedent research and identify the changes of the walkability research. (1)being required empirical data on the actual walking and moving patterns of people, (2)beginning to be measured micro-walking behaviors such as actual route, walking facilities, detour, walking area. In addition, according to the trend of research, it is analyzed that the use of GPS device and the mobile big data are newly emerged. Finally, we analyze pedestrian data based on mobile big data in terms of 'application' and distinguishing it from existing survey methodology. We present the possibility of mobile big data. (1)Improvement of human, temporal and spatial constraints of data collection, (2)Improvement of inaccuracy of collected data, (3)Improvement of subjective intervention in data collection and preprocessing, (4)Expandability of walking environment research.

Dynamic Load Management Method for Spatial Data Stream Processing on MapReduce Online Frameworks (맵리듀스 온라인 프레임워크에서 공간 데이터 스트림 처리를 위한 동적 부하 관리 기법)

  • Jeong, Weonil
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.19 no.8
    • /
    • pp.535-544
    • /
    • 2018
  • As the spread of mobile devices equipped with various sensors and high-quality wireless network communications functionsexpands, the amount of spatio-temporal data generated from mobile devices in various service fields is rapidly increasing. In conventional research into processing a large amount of real-time spatio-temporal streams, it is very difficult to apply a Hadoop-based spatial big data system, designed to be a batch processing platform, to a real-time service for spatio-temporal data streams. This paper extends the MapReduce online framework to support real-time query processing for continuous-input, spatio-temporal data streams, and proposes a load management method to distribute overloads for efficient query processing. The proposed scheme shows a dynamic load balancing method for the nodes based on the inflow rate and the load factor of the input data based on the space partition. Experiments show that it is possible to support efficient query processing by distributing the spatial data stream in the corresponding area to the shared resources when load management in a specific area is required.

Data Source Management using weight table in u-GIS DSMS

  • Kim, Sang-Ki;Baek, Sung-Ha;Lee, Dong-Wook;Chung, Warn-Il;Kim, Gyoung-Bae;Bae, Hae-Young
    • Journal of Korea Spatial Information System Society
    • /
    • v.11 no.2
    • /
    • pp.27-33
    • /
    • 2009
  • The emergences of GeoSensor and researches about GIS have promoted many researches of u-GIS. The disaster application coupled in the u-GIS can apply to monitor accident area and to prevent spread of accident. The application needs the u-GIS DSMS technique to acquire, to process GeoSensor data and to integrate them with GIS data. The u-GIS DSMS must process big and large-volume data stream such as spatial data and multimedia data. Due to the feature of the data stream, in u-GIS DSMS, query processing can be delayed. Moreover, as increasing the input rate of data in the area generating events, the network traffic is increased. To solve this problem, in this paper we describe TRIGGER ACTION clause in CQ on the u-GIS DSMS environment and proposes data source management. Data source weight table controls GES information and incoming data rate. It controls incoming data rate as increasing weight at GES of disaster area. Consequently, it can contribute query processing rate and accuracy

  • PDF

A Study on Big Data Information System based on Artificial Intelligence -Filmmaker and Focusing on Movie case analysis of 10 million Viewers- (인공지능 기반형 빅데이터 정보시스템에 관한 연구 -영화제작자와 천만 영화 사례분석 중심으로-)

  • Lee, Sang-Yun;Yoon, Hong-Joo
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.14 no.2
    • /
    • pp.377-388
    • /
    • 2019
  • The system proposed in this paper was suggested as a big data system that works in the age of artificial intelligence of the 4th Industrial Revolution. The proposed system can be a good example in terms of government 's development of new intelligent big data information system. For example, the proposed system may be introduced into the system of a department as a function of the integration of existing cinema ticket integration network or its networking. For this purpose, the proposed system transmits the user's profile to the film producer or other company, where it is provided as comparison data. Soon, the information is sent to the user-specific characteristic data and then the film-maker will be able to gauge the success of the three elements of the movie's performance, cinematic quality, and break-even point in real time, which are revealed through the movie review that the actual user feels, including the so-called 'new reinterpretation.

Development of Performance Evaluation Method for Urban Regeneration Project based on Spatial Big Data (공간 빅데이터 기반의 도시재생사업 성과 평가기법 개발)

  • Yun Byung-Hun;Seong Soon-A;Lee Sam-Su
    • Journal of the Korean Regional Science Association
    • /
    • v.39 no.1
    • /
    • pp.21-36
    • /
    • 2023
  • Entering the era of low growth due to changes in social and economic conditions, most cities across the country are actively promoting urban regeneration. Although urban regeneration is a project with huge national finances, a clear evaluation system has not yet been established. In order to ensure the sustainability of urban regeneration, it is necessary to secure the validity of urban regeneration policies and establish a reflux system to supplement the policies. The purpose of this study is to derive the limitations of the existing comprehensive performance evaluation and to develop an improved urban regeneration policy comprehensive performance evaluation technique based on spatial big data. The urban regeneration comprehensive performance evaluation technique differentiated the areas affected by the urban regeneration project and the surrounding areas based on the type of urban regeneration project and the presence or absence of large cities and middle cities. The effects of urban regeneration were quantitatively verified through relative comparison between the areas affected by urban regeneration projects and the surrounding areas of population, society, economy, industry, physical and environmental evaluation indicators.

A Study on the Visiting Areas Classification of Cargo Vehicles Using Dynamic Clustering Method (화물차량의 방문시설 공간설정 방법론 연구)

  • Bum Chul Cho;Eun A Cho
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.22 no.6
    • /
    • pp.141-156
    • /
    • 2023
  • This study aims to improve understanding of freight movement, crucial for logistics facility investment and policy making. It addresses the limitations of traditional freight truck traffic data, aggregated only at city and county levels, by developing a new methodology. This method uses trip chain data for more detailed, facility-level analysis of freight truck movements. It employs DTG (Digital Tachograph) data to identify individual truck visit locations and creates H3 system-based polygons to represent these visits spatially. The study also involves an algorithm to dynamically determine the optimal spatial resolution of these polygons. Tested nationally, the approach resulted in polygons with 81.26% spatial fit and 14.8% error rate, offering insights into freight characteristics and enabling clustering based on traffic chain characteristics of freight trucks and visited facility types.

Improvement of the Local Government's Spatial Information Policy - A Case of Seoul Metropolitan Government - (지방자치단체 공간정보정책 개선방안 연구 - 서울특별시 공간정보정책 및 시스템 분석 사례 -)

  • Choi, Jun-Young;Won, Jong-Seok
    • Journal of Cadastre & Land InformatiX
    • /
    • v.45 no.1
    • /
    • pp.17-30
    • /
    • 2015
  • Local governments' spatial information policies are very important in that it can increase the relatedness to upper policy regarding the share, openness and converged utilization of spatial information and contribute to voluntary participation and creative uses linked to big data. However, local governments' spatial information policies require enhancement since it need to update framework spatial data, to derive spatial information service and to share the data. In this research, we compared the spatial information policies and related systems of central and local governments, and analyzed the local governments' spatial information policy enforcement plans and the Seoul metropolitan government's utilization survey on 32 spatial information systems. In the result, for the improvement of local governments' spatial policies, on-demand updating of base map using the as built drawings linked to field work departments, securing up-to-date public domain spatial information through the NSDI system, sharing of spatial information based on the spatial information platform and benchmarking of best practices related to the spatial information based policy participation are suggested.