• Title/Summary/Keyword: spatial split method

Search Result 34, Processing Time 0.033 seconds

Performance Comparison of Spatial Split Algorithms for Spatial Data Analysis on Spark (Spark 기반 공간 분석에서 공간 분할의 성능 비교)

  • Yang, Pyoung Woo;Yoo, Ki Hyun;Nam, Kwang Woo
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.25 no.1
    • /
    • pp.29-36
    • /
    • 2017
  • In this paper, we implement a spatial big data analysis prototype based on Spark which is an in-memory system and compares the performance by the spatial split algorithm on this basis. In cluster computing environments, big data is divided into blocks of a certain size order to balance the computing load of big data. Existing research showed that in the case of the Hadoop based spatial big data system, the split method by spatial is more effective than the general sequential split method. Hadoop based spatial data system stores raw data as it is in spatial-divided blocks. However, in the proposed Spark-based spatial analysis system, there is a difference that spatial data is converted into a memory data structure and stored in a spatial block for search efficiency. Therefore, in this paper, we propose an in-memory spatial big data prototype and a spatial split block storage method. Also, we compare the performance of existing spatial split algorithms in the proposed prototype. We presented an appropriate spatial split strategy with the Spark based big data system. In the experiment, we compared the query execution time of the spatial split algorithm, and confirmed that the BSP algorithm shows the best performance.

The Dynamic Split Policy of the KDB-Tree in Moving Objects Databases (이동 객체 데이타베이스에서 KDB-tree의 동적 분할 정책)

  • Lim Duk-Sung;Lee Chang-Heun;Hong Bong-Hee
    • Journal of KIISE:Databases
    • /
    • v.33 no.4
    • /
    • pp.396-408
    • /
    • 2006
  • Moving object databases manage a large amount of past location data which are accumulated as the time goes. To retrieve fast the past location of moving objects, we need index structures which consider features of moving objects. The KDB-tree has a good performance in processing range queries. Although we use the KDB-tree as an index structure for moving object databases, there has an over-split problem in the spatial domain since the feature of moving object databases is to increase the time domain. Because the over-split problem reduces spatial regions in the MBR of nodes inverse proportion to the number of splits, there has a problem that the cost for processing spatial-temporal range queries is increased. In this paper, we propose the dynamic split strategy of the KDB-tree to process efficiently the spatial-temporal range queries. The dynamic split strategy uses the space priority splitting method for choosing the split domain, the recent time splitting policy for splitting a point page to maximize the space utilization, and the last division policy for splitting a region page. We compare the performance of proposed dynamic split strategy with the 3DR-tree, the MV3R-tree, and the KDB-tree. In our performance study for range queries, the number of node access in the MKDB-tree is average 30% less than compared index structures.

Comparison of Two Methods for Size-interpolation on CRT Display : Analog Stimulus-Digital Response Vs. Digital Stimulus-Analog Response (CRT 표시장치에서 두 형태의 크기-내삽 추정 방법의 비교 연구 : 상사자극-계수 반응과 계수 자극-상사반응)

  • Ro, Jae-ho
    • Journal of Industrial Technology
    • /
    • v.14
    • /
    • pp.127-140
    • /
    • 1994
  • This study is concerned with the accuracy and the patterns when different methods was used in interpolation task. Although 3 methods employed the same modality for input (visual) and for output (manual responding), they differed in central processing, which method 1 is relatively more tendency of verbal processing, method 2 is realtively more tendency of spatial processing and method 3 needed a number of switching code (verbal/spatial) performing task. Split-plot design was adopted, which whole plot consisted of methods (3), orientations (horizon, vertical), base-line sizes (300, 500, 700 pixels) and split plot consisted of target locations (1-99). The results showed the anchor effect and the range effect. Method 2, method 3 and method 1 that order was better accuracy. ANOVA showed that the accuracy was significantly influenced by the method, the location of target, and its interactions ($method{\times}location$, $size{\times}location$). Analysis of error data, response time and frequency of under, just, over estimate indicated that a systematic error pattern was made in task and methods changed not only the performance but also the pattern. The results provided support for the importance of the multiple resources theory in accounting for S-C-R compatibility and task performance. They are discussed in terms of multiple resources theory and guidelines for system design is suggested by the S-C-R compatibility.

  • PDF

A Spectral-spatial Cooperative Noise-evaluation Method for Hyperspectral Imaging

  • Zhou, Bing;Li, Bingxuan;He, Xuan;Liu, Hexiong
    • Current Optics and Photonics
    • /
    • v.4 no.6
    • /
    • pp.530-539
    • /
    • 2020
  • Hyperspectral images feature a relatively narrow band and are easily disturbed by noise. Accurate estimation of the types and parameters of noise in hyperspectral images can provide prior knowledge for subsequent image processing. Existing hyperspectral-noise estimation methods often pay more attention to the use of spectral information while ignoring the spatial information of hyperspectral images. To evaluate the noise in hyperspectral images more accurately, we have proposed a spectral-spatial cooperative noise-evaluation method. First, the feature of spatial information was extracted by Gabor-filter and K-means algorithms. Then, texture edges were extracted by the Otsu threshold algorithm, and homogeneous image blocks were automatically separated. After that, signal and noise values for each pixel in homogeneous blocks were split with a multiple-linear-regression model. By experiments with both simulated and real hyperspectral images, the proposed method was demonstrated to be effective and accurate, and the composition of the hyperspectral image was verified.

A Efficient Method of Extracting Split Points for Continuous k Nearest Neighbor Search Without Order (무순위 연속 k 최근접 객체 탐색을 위한 효율적인 분할점 추출기법)

  • Kim, Jin-Deog
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2010.05a
    • /
    • pp.927-930
    • /
    • 2010
  • Recently, continuous k-nearest neighbor query(CkNN) which is defined as a query to find the nearest points of interest to all the points on a given path is widely used in the LBS(Location Based Service) and ITS(Intelligent Transportation System) applications. It is necessary to acquire results quickly in the above applications and be applicable to spatial network databases. This paper proposes a new method to search nearest POIs(Point Of Interest) for moving query objects on the spatial networks. The method produces a set of split points and their corresponding k-POIs as results. There is no order between the POIs. The analysis show that the proposed method outperforms the existing methods.

  • PDF

Segmentation and Classification of Lidar data

  • Tseng, Yi-Hsing;Wang, Miao
    • Proceedings of the KSRS Conference
    • /
    • 2003.11a
    • /
    • pp.153-155
    • /
    • 2003
  • Laser scanning has become a viable technique for the collection of a large amount of accurate 3D point data densely distributed on the scanned object surface. The inherent 3D nature of the sub-randomly distributed point cloud provides abundant spatial information. To explore valuable spatial information from laser scanned data becomes an active research topic, for instance extracting digital elevation model, building models, and vegetation volumes. The sub-randomly distributed point cloud should be segmented and classified before the extraction of spatial information. This paper investigates some exist segmentation methods, and then proposes an octree-based split-and-merge segmentation method to divide lidar data into clusters belonging to 3D planes. Therefore, the classification of lidar data can be performed based on the derived attributes of extracted 3D planes. The test results of both ground and airborne lidar data show the potential of applying this method to extract spatial features from lidar data.

  • PDF

A Method for Continuous k Nearest Neighbor Search With Partial Order (부분순위 연속 k 최근접 객체 탐색 기법)

  • Kim, Jin-Deog
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.15 no.1
    • /
    • pp.126-132
    • /
    • 2011
  • In the application areas of LBS(Location Based Service) and ITS(Intelligent Transportation System), continuous k-nearest neighbor query(CkNN) which is defined as a query to find the nearest points of interest to all the points on a given path is widely used. It is necessary to acquire results quickly in the above applications and be applicable to spatial network databases. It is also able to cope successfully with frequent updates of POI objects. This paper proposes a new method to search nearest POIs for moving query objects on the spatial networks. The method produces a set of split points and their corresponding k-POIs as results with partial order among k-POIs. The results obtained from experiments with real dataset show that the proposed method outperforms the existing methods. The proposed method achieves very short processing time(15%) compared with the existing method.

A Spatial Split Method for Processing of Region Monitoring Queries (영역 모니터링 질의 처리를 위한 공간 분할 기법)

  • Chung, Jaewoo;Jung, HaRim;Kim, Ung-Mo
    • Journal of Internet Computing and Services
    • /
    • v.19 no.1
    • /
    • pp.67-76
    • /
    • 2018
  • This paper addresses the problem of efficient processing of region monitoring queries. The centralized methods used for existing region monitoring query processing assumes that the mobile object periodically sends location-updates to the server and the server continues to update the query results. However, a large amount of location updates seriously degrade the system performance. Recently, some distributed methods have been proposed for region monitoring query processing. In the distributed methods, the server allocates to all objects i) a resident domain that is a subspace of the workspace, and ii) a number of nearby query regions. All moving objects send location updates to the server only when they leave the resident domain or cross the boundary of the query region. In order to allocate the resident domain to the moving object along with the nearby query region, we use a query index structure that is constructed by splitting the workspace recursively into equal halves. However, However, the above index structure causes unnecessary division, resulting in deterioration of system performance. In this paper, we propose an adaptive split method to reduce unnecessary splitting. The workspace splitting is dynamically allocated i) considering the spatial relationship between the query region and the resultant subspace, and ii) the distribution of the query region. We proposed an enhanced QR-tree with a new splitting method. Through a set of simulations, we verify the efficiency of the proposed split methods.

A Entropy Coding Method using Temporal and Spatial Correlation on HEVC (HEVC에서 시공간적 상관관계를 이용한 엔트로피 부호화 방법)

  • Kim, Tae-Ryong;Kim, Kyung-Yong;Lee, Han-Soo;Park, Gwang-Hoon
    • Journal of Broadcast Engineering
    • /
    • v.17 no.1
    • /
    • pp.191-194
    • /
    • 2012
  • The split flag and the skip flag in CU syntax have high correlation on spatial domain as well as temporal domain. This paper suggests a method for enhancing coding efficiency by using not only spatial correlation but also temporal correlation when coding CU information. In the CABAC case, temporal collocated CU information is used for selecting context model of the split flag and the skip flag. In the CAVLC case, current CU information is estimated from temporal collocated CU information then encoded. As a result, a coding efficiency was increased by 0.1%~0.6% in CABAC, 0.1%~0.4% in CAVLC compared with HM 3.0. This method shows better performance on lowdelay condition which uses reference frame close to current frame.

Spatial Indexing Method of Moving Objects for Efficient Mobile Map Services (효율적인 모바일 지도 서비스를 위한 이동 객체의 공간 색인 기법)

  • Kim, Jin-Deog
    • The Journal of Korean Association of Computer Education
    • /
    • v.6 no.4
    • /
    • pp.49-59
    • /
    • 2003
  • In order to index exactly moving objects(vehicle, mobile phone, PDA, etc.) in a mobile database, continuous updates of their locations arc inevitable as well as time-consuming. In this paper, we propose a spatial indexing method of moving objects for the efficient mobile map services. In detail, we analyze the characteristics of both the method to re-index all the objects after each time period and the method to update immediately the locations on reporting their locations. We also newly propose a bucket split method using the properties of moving objects in order to minimize the number of database updates. The experiments conducted on the environments of moving object show that the proposed indexing method is appropriate to map services for mobile devices.

  • PDF