• Title/Summary/Keyword: Spatial Data Stream Processing

Search Result 55, Processing Time 0.021 seconds

A Study on Mapping 3-D River Boundary Using the Spatial Information Datasets (공간정보를 이용한 3차원 하천 경계선 매핑에 관한 연구)

  • Choung, Yun-Jae;Park, Hyen-Cheol;Jo, Myung-Hee
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.15 no.1
    • /
    • pp.87-98
    • /
    • 2012
  • A river boundary is defined as the intersection between a main stream of a river and the land. Mapping of the river boundary is important for the protection of the properties in river areas, the prevention of flooding and the monitoring of the topographic changes in river areas. However, the utilization of the ground surveying technologies is not efficient for the mapping of the river boundary due to the irregular surfaces of river zones and the dynamic changes of water level of a river stream. Recently, the spatial information data sets such as the airborne LiDAR and aerial images are widely used for coastal mapping due to the acquisition of the topographic information without human accessibility. Due to these advantages, this research proposes a semi-automatic method for mapping of the river boundary using the spatial information data set such as the airborne LiDAR and the aerial photographs. Multiple image processing technologies such as the image segmentation algorithm and the edge detection algorithm are applied for the generation of the 3D river boundary using the aerial photographs and airborne topographic LiDAR data. Check points determined by the experienced expert are used for the measurement of the horizontal and vertical accuracy of the generated 3D river boundary. Statistical results show that the generated river boundary has a high accuracy in horizontal and vertical direction.

Multi-query Indexing Technique for Efficient Query Processing on Stream Data in Sensor Networks (센서 네트워크에서 스트림 데이터 질의의 효율적인 처리를 위한 다중 질의 색인 기법)

  • Lee, Min-Soo;Kim, Yearn-Jeong;Yoon, Hye-Jung
    • Journal of Korea Multimedia Society
    • /
    • v.10 no.11
    • /
    • pp.1367-1383
    • /
    • 2007
  • A sensor network consists of a network of sensors that can perform computation and also communicate with each other through wireless communication. Some important characteristics of sensor networks are that the network should be self administered and the power efficiency should be greatly considered due to the fact that it uses battery power. In sensor networks, when large amounts of various stream data is produced and multiple queries need to be processed simultaneously, the power efficiency should be maximized. This work proposes a technique to create an index on multiple monitoring queries so that the multi-query processing performance could be increased and the memory and power could be efficiently used. The proposed SMILE tree modifies and combines the ideas of spatial indexing techniques such as k-d trees and R+-trees. The k-d tree can divide the dimensions at each level, while the R+-tree improves the R-tree by dividing the space into a hierarchical manner and reduces the overlapping areas. By applying the SMILE tree on multiple queries and using it on stream data in sensor networks, the response time for finding an indexed query takes in some cases 50% of the time taken for a linear search to find the query.

  • PDF

The Method for Real-time Complex Event Detection of Unstructured Big data (비정형 빅데이터의 실시간 복합 이벤트 탐지를 위한 기법)

  • Lee, Jun Heui;Baek, Sung Ha;Lee, Soon Jo;Bae, Hae Young
    • Spatial Information Research
    • /
    • v.20 no.5
    • /
    • pp.99-109
    • /
    • 2012
  • Recently, due to the growth of social media and spread of smart-phone, the amount of data has considerably increased by full use of SNS (Social Network Service). According to it, the Big Data concept is come up and many researchers are seeking solutions to make the best use of big data. To maximize the creative value of the big data held by many companies, it is required to combine them with existing data. The physical and theoretical storage structures of data sources are so different that a system which can integrate and manage them is needed. In order to process big data, MapReduce is developed as a system which has advantages over processing data fast by distributed processing. However, it is difficult to construct and store a system for all key words. Due to the process of storage and search, it is to some extent difficult to do real-time processing. And it makes extra expenses to process complex event without structure of processing different data. In order to solve this problem, the existing Complex Event Processing System is supposed to be used. When it comes to complex event processing system, it gets data from different sources and combines them with each other to make it possible to do complex event processing that is useful for real-time processing specially in stream data. Nevertheless, unstructured data based on text of SNS and internet articles is managed as text type and there is a need to compare strings every time the query processing should be done. And it results in poor performance. Therefore, we try to make it possible to manage unstructured data and do query process fast in complex event processing system. And we extend the data complex function for giving theoretical schema of string. It is completed by changing the string key word into integer type with filtering which uses keyword set. In addition, by using the Complex Event Processing System and processing stream data at real-time of in-memory, we try to reduce the time of reading the query processing after it is stored in the disk.

The application of GIS and RS for extracting Sumjin Watershed hydrologic-parameter (섬진강 유역 수문인자 추출을 위한 GIS와 RS의 활용)

  • 김지은;이근상;조기성;장영률
    • Spatial Information Research
    • /
    • v.8 no.2
    • /
    • pp.257-274
    • /
    • 2000
  • Recently, natural environment is being forced by the quick increasing of population and industrialization, and especially, capacity and pollution of water resource is being come to the front. It needs to extract the accurate topological and hydrological parameters of watershed in order to manage water resource efficiently. But, these data are processed yet by manual work and simple operation in hydrological fields. In this paper, we presented algorithm that could extract topological any hydrological parameters over Sumjin watershed using GIS and RS and it gives the saving of data processing time and the confidency of data. The extraction procedure of topological characteristics and hydrological parameters is as below. First, watershed and stream are extracted by DEM and curve number is extracted throughout the overlay of landcov map and soil map. Also, we extracted surface parameters like watershed length and the slope of watershed length by Grid computation into watershed and stream. And we gave the method that could extract hydrologic parameters like Muskingum K and sub-basin lag time by executing computation into surface parameters and average SCS curve number being extracted.

  • PDF

A Block-Based Adaptive Data Hiding Approach Using Pixel Value Difference and LSB Substitution to Secure E-Governance Documents

  • Halder, Tanmoy;Karforma, Sunil;Mandal, Rupali
    • Journal of Information Processing Systems
    • /
    • v.15 no.2
    • /
    • pp.261-270
    • /
    • 2019
  • In order to protect secret digital documents against vulnerabilities while communicating, steganography algorithms are applied. It protects a digital file from unauthorized access by hiding the entire content. Pixel-value-difference being a method from spatial domain steganography utilizes the difference gap between neighbor pixels to fulfill the same. The proposed approach is a block-wise embedding process where blocks of variable size are chosen from the cover image, therefore, a stream of secret digital contents is hidden. Least significant bit (LSB) substitution method is applied as an adaptive mechanism and optimal pixel adjustment process (OPAP) is used to minimize the error rate. The proposed application succeeds to maintain good hiding capacity and better signal-to-noise ratio when compared against other existing methods. Any means of digital communication specially e-Governance applications could be highly benefited from this approach.

Automatic Video Genre Identification Method in MPEG compressed domain

  • Kim, Tae-Hee;Lee, Woong-Hee;Jeong, Dong-Seok
    • Proceedings of the IEEK Conference
    • /
    • 2002.07c
    • /
    • pp.1527-1530
    • /
    • 2002
  • Video summary is one of the tools which can provide the fast and effective browsing fur a lengthy video. Video summary consists of many key-frames that could be defined differently depending on the video genre it belongs to. Consequently, the video summary constructed by the uniform manner might lead into inadequate result. Therefore, identifying the video genre is the important first step in generating the meaningful video summary. We propose a new method that can classify the genre of the video data in MPEG compressed bit-stream domain. Since the proposed method operates directly on the com- pressed bit-stream without decoding the frame, it has merits such as simple calculation and short processing time. In the proposed method, only the visual information is utilized through the spatial-temporal analysis to classify the video genre. Experiments are done for 6 genres of video: Cartoon, Commercial, Music Video, News, Sports, and Talk Show. Experimental result shows more than 90% of accuracy in genre classification for the well-structured video data such as Talk Show and Sports.

  • PDF

A Study on the Development and Application of GIS-based Stream Water Quality Management System (GIS기반의 하천수질관리시스템 구축 및 활용에 관한 연구)

  • 최연웅;성동권;전형섭;조기성
    • Spatial Information Research
    • /
    • v.10 no.2
    • /
    • pp.289-299
    • /
    • 2002
  • Recently, as the social interest about environmental problems is increased and the importance is highlighted, the related information and the demand of information are increased. and, the Total Pollution System will be executed soon. Therefore, the information management system which can manage and analysis related information efficiently and systematically become required. Especially, the development and application of GIS which can effectively manage and analyze information using spatial data have been processing by government, private institute, and related academic institute of all over the world. also their potentiality of application have been recognizing. The main purpose of this study is to develop the stream water quality management system which can simulate future water quality using water quality model(QUAL2E) and be integrated the whole step from calculating pollutant load divided by administrative district and watershed to displaying the result of modeling visually.

  • PDF

Design and Implementation of Storage Manager for Real-Time Compressed Storing of Large Volume Datastream (대용량 데이터스트림 실시간 압축 저장을 위한 저장관리자 설계 및 구현)

  • Lee, Dong-Wook;Baek, Sung-Ha;Kim, Gyoung-Bae;Bae, Hae-Young
    • Journal of Korea Spatial Information System Society
    • /
    • v.11 no.3
    • /
    • pp.31-39
    • /
    • 2009
  • Requirement level regarding processing and managing real-time datastream in an ubiquitous environment is increased. Especially, due to the unbounded, high frequency and real-time characteristics of datastream, development of specialized stroge manager for DSMS is necessary to process such datastream. Existing DSMS, e.g. Coral8, can support datastream processing but it is not scalable and cannot perform well when handling large-volume real-time datastream, e.g. 100 thousand over per second. In the case of Oracle10g, which is generally used in related field, it supports storing and management processing. However, it does not support real-time datastream processing. In this paper, we propose specialized storage manager of DSMS for real-time compressed storing on semiconductor or LCD production facility of Samsung electronics, Hynix and HP. Hynix and HP. This paper describes the proposed system architecture and major components and show better performance of the proposed system compared with similar systems in the experiment section.

  • PDF

High-Performance Loading Method for Historical Spatial Query Processing in Data Stream System (데이터 스트림 시스템에서 과거 공간질의 처리를 위한 고속 로딩 기법)

  • Jae-Wan Shin;Sung-Ha Baek;Dong-Wook Lee;Soong-Sun Shin;Kyung-Bae Kim;Hae-Young Bae
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2008.11a
    • /
    • pp.397-400
    • /
    • 2008
  • 무한히 발생되는 실시간 데이터와 디스크에 저장된 히스토리컬 데이터를 동시에 처리하는 하이브리드 질의에 관한 연구가 활발히 이루어지고 있다. 하이브리드 질의는 디스크에 저장된 대용량의 공간 데이터 처리를 위해 빠른 디스크 입/출력을 요구한다. 이러한 데이터를 처리하기 위해 인덱스, 데이터 축소 기법등이 연구되었다. 데이터의 빠른 검색을 위한 인덱스 기법은 디스크에 분산 저장된 데이터에 대한 탐색 비용과 입/출력 비용을 줄이지 못한다. 또한, 샘플링을 통해 디스크 입/출력 시간 비용을 줄이는 데이터 축소 기법은 데이터의 정확성을 떨어뜨려 정확성을 요구하는 하이브리드 질의에서는 이용하기가 어렵다. 이논문에서는 디스크 입/출력 시간과 디스크 탐색 시간 비용을 줄이고, 정확성을 보장하는 과거 공간질의 처리를 위한 고속로딩 기법을 제아난다. 제안기법은 공간을 그리드 형태로 나누고 인접한 공간 데이터를 함께 관리함으로써 디스크 입/출력 비용을 줄 일 수 있다. 또한, 공간적으로 인접한 데이터를 물리적으로 인접한 곳에 저장하여 디스크 탐색시간 비용을 줄일 수 있다. 이렇게 저장된 데이터는 손실 없이 모두 저장되며, 정확성 또는 보장할 수 있다.

Phase-Locked Three-Dimensional Structures in the Cylinder Wake Observed from Cinematic PIV Data (Cinematic PIV에 의한 실린더 후류의 위상평균된 3차원 구조)

  • Sung, Jae-Yong;Park, Kang-Kuk;Yoo, Jung-Yul
    • Proceedings of the KSME Conference
    • /
    • 2000.04b
    • /
    • pp.661-666
    • /
    • 2000
  • Near-wake flow field of a circular cylinder is studied by means of a cinematic PIV system with high sampling rate and large internal memory block. Experiments are conducted in a closed-cycle water tunnel system and a cross-correlation algorithm in conjunction with FFT (Fast Fourier Transform) analysis and an offset correlation technique is used for vector processing. With the help of very high sampling frequency compared to the shedding frequency, it is possible to obtain phase-averaged information of the three-dimensional wake, even though the shedding is not forced but natural. Phase-locked vortical structures observed simultaneously from the spanwise and cross-stream planes are displayed in the wake-transition regime where fine-scale secondary vortices have a spanwise wavelength or around one diameter. Spatial relations and temporal evolutions of the primary Karman vortex and the secondary vortex are also discussed schematically.

  • PDF