• Title/Summary/Keyword: high dimensional data sets

Search Result 72, Processing Time 0.037 seconds

Comparison of the Wind Speed from an Atmospheric Pressure Map (Na Wind) and Satellite Scatterometer­observed Wind Speed (NSCAT) over the East (Japan) Sea

  • Park, Kyung-Ae;Kim, Kyung-Ryul;Kim, Kuh;Chung, Jong-Yul;Conillor, Peter-C.
    • Journal of the korean society of oceanography
    • /
    • v.38 no.4
    • /
    • pp.173-184
    • /
    • 2003
  • Major differences between wind speeds from atmospheric pressure maps (Na wind) and near­surface wind speeds derived from satellite scatterometer (NSCAT) observations over the East (Japan) Sea have been examined. The root­mean­square errors of Na wind and NSCAT wind speeds collocated with Japanese Meteorological Agency (JMA) buoy winds are about $3.84\;ms^{-1}\;and\;1.53\;ms^{-1}$, respectively. Time series of NSCAT wind speeds showed a high coherency of 0.92 with the real buoy measurements and contained higher spectral energy at low frequencies (>3 days) than the Na wind. The magnitudes of monthly Na winds are lower than NSCAT winds by up to 45%, particularly in September 1996. The spatial structures between the two are mostly coherent on basin­wide large scales; however, significant differences and energy loss are found on a spatial scale of less than 100 km. This was evidenced by the temporal EOFs (Empirical Orthogonal Functions) of the two wind speed data sets and by their two­dimensional spectra. Since the Na wind was based on the atmospheric pressures on the weather map, it overlooked small­scale features of less than 100 km. The center of the cold­air outbreak through Vladivostok, expressed by the Na wind in January 1997, was shifted towards the North Korean coast when compared with that of the NSCAT wind, whereas NSCAT winds revealed its temporal evolution as well as spatial distribution.

Incremental Clustering Algorithm by Modulating Vigilance Parameter Dynamically (경계변수 값의 동적인 변경을 이용한 점층적 클러스터링 알고리즘)

  • 신광철;한상용
    • Journal of KIISE:Software and Applications
    • /
    • v.30 no.11
    • /
    • pp.1072-1079
    • /
    • 2003
  • This study is purported for suggesting a new clustering algorithm that enables incremental categorization of numerous documents. The suggested algorithm adopts the natures of the spherical k-means algorithm, which clusters a mass amount of high-dimensional documents, and the fuzzy ART(adaptive resonance theory) neural network, which performs clustering incrementally. In short, the suggested algorithm is a combination of the spherical k-means vector space model and concept vector and fuzzy ART vigilance parameter. The new algorithm not only supports incremental clustering and automatically sets the appropriate number of clusters, but also solves the current problems of overfitting caused by outlier and noise. Additionally, concerning the objective function value, which measures the cluster's coherence that is used to evaluate the quality of produced clusters, tests on the CLASSIC3 data set showed that the newly suggested algorithm works better than the spherical k-means by 8.04% in average.

Three dimensional GPR survey for the exploration of old remains at Buyeo area (부여지역 유적지 발굴을 위한 3차원 GPR 탐사)

  • Kim Jung-Bo;Son Jeong-Sul;Yi Myeong-Jong;Lim Seong-Keun;Cho Seong-Jun;Jeong Ji-Min;Park Sam-Gyu
    • 한국지구물리탐사학회:학술대회논문집
    • /
    • 2004.08a
    • /
    • pp.49-69
    • /
    • 2004
  • One of the important roles of geophysical exploration in archeological survey may be to provide the subsurface information for effective and systematic excavations of historical remains. Ground Penetrating Radar (GPA) can give us images of shallow subsurface structure with high resolution and is regarded as a useful and important technology in archeological exploration. Since the buried cultural relics are the three-dimensional (3-D) objects in nature, the 3-D or areal survey is more desirable in archeological exploration. 3-D GPR survey based on the very dense data in principle, however, might need much higher cost and longer time of exploration than the other geophysical methods, thus it could have not been applied to the wide area exploration as one of routine procedures. Therefore, it is important to develop an effective way of 3-D GPR survey. In this study, we applied 3-D GPR method to investigate the possible historical remains of Baekje Kingdom at Gatap-Ri, Buyeo city, prior to the excavation. The principal purpose of the investigation was to provide the subsurface images of high resolution for the excavation of the surveyed area. Besides this, another purpose was to investigate the applicability and effectiveness of the continuous data acquisition system which was newly devised for the archeological investigation. The system consists of two sets of GPR antennas and the precise measurement device tracking the path of GPR antenna movement automatically and continuously Besides this hardware system, we adopted a concept of data acquisition that the data were acquired arbitrary not along the pre-established profile lines, because establishing the many profile lines itself would make the field work much longer, which results in the higher cost of field work. Owing to the newly devised system, we could acquire 3-D GPR data of an wide area over about $17,000 m^2$ as a result of the just two-days field work. Although the 3-D GPR data were gathered randomly not along the pre-established profile lines, we could have the 3-D images with high resolution showing many distinctive anomalies which could be interpreted as old agricultural lands, waterways, and artificial structures or remains. This case history led us to the conclusion that 3-D GPR method can be used easily not only to examine a small anomalous area but also to investigate the wider region of archeological interests. We expect that the 3-D GPR method will be applied as a one of standard exploration procedures to the exploration of historical remains in Korea in the near future.

  • PDF

Spatial Hedonic Modeling using Geographically Weighted LASSO Model (GWL을 적용한 공간 헤도닉 모델링)

  • Jin, Chanwoo;Lee, Gunhak
    • Journal of the Korean Geographical Society
    • /
    • v.49 no.6
    • /
    • pp.917-934
    • /
    • 2014
  • Geographically weighted regression(GWR) model has been widely used to estimate spatially heterogeneous real estate prices. The GWR model, however, has some limitations of the selection of different price determinants over space and the restricted number of observations for local estimation. Alternatively, the geographically weighted LASSO(GWL) model has been recently introduced and received a growing interest. In this paper, we attempt to explore various local price determinants for the real estate by utilizing the GWL and its applicability to forecasting the real estate price. To do this, we developed the three hedonic models of OLS, GWR, and GWL focusing on the sales price of apartments in Seoul and compared those models in terms of model fit, prediction, and multicollinearity. As a result, local models appeared to be better than the global OLS on the whole, and in particular, the GWL appeared to be more explanatory and predictable than other models. Moreover, the GWL enabled to provide spatially different sets of price determinants which no multicollinearity exists. The GWL helps select the significant sets of independent variables from a high dimensional dataset, and hence will be a useful technique for large and complex spatial big data.

  • PDF

Parallel Range Query processing on R-tree with Graphics Processing Units (GPU를 이용한 R-tree에서의 범위 질의의 병렬 처리)

  • Yu, Bo-Seon;Kim, Hyun-Duk;Choi, Won-Ik;Kwon, Dong-Seop
    • Journal of Korea Multimedia Society
    • /
    • v.14 no.5
    • /
    • pp.669-680
    • /
    • 2011
  • R-trees are widely used in various areas such as geographical information systems, CAD systems and spatial databases in order to efficiently index multi-dimensional data. As data sets used in these areas grow in size and complexity, however, range query operations on R-tree are needed to be further faster to meet the area-specific constraints. To address this problem, there have been various research efforts to develop strategies for acceleration query processing on R-tree by using the buffer mechanism or parallelizing the query processing on R-tree through multiple disks and processors. As a part of the strategies, approaches which parallelize query processing on R-tree through Graphics Processor Units(GPUs) have been explored. The use of GPUs may guarantee improved performances resulting from faster calculations and reduced disk accesses but may cause additional overhead costs caused by high memory access latencies and low data exchange rate between GPUs and the CPU. In this paper, to address the overhead problems and to adapt GPUs efficiently, we propose a novel approach which uses a GPU as a buffer to parallelize query processing on R-tree. The use of buffer algorithm can give improved performance by reducing the number of disk access and maximizing coalesced memory access resulting in minimizing GPU memory access latencies. Through the extensive performance studies, we observed that the proposed approach achieved up to 5 times higher query performance than the original CPU-based R-trees.

A 3D ground penetrating radar imaging of the heavy rainfall-induced deformation around a river levee: a case study of Ara River, Saitama, Japan (폭우에 의해 발생된 강 제방 주변 변형의 3차원 GPR 영상화: 일본 사이타마현의 아라강에 대한 현장적용사례)

  • Yokota, Toshiyuki;Inazaki, Tomio;Shinagawa, Shunsuke;Ueda, Takumi
    • Geophysics and Geophysical Exploration
    • /
    • v.12 no.1
    • /
    • pp.49-55
    • /
    • 2009
  • This paper describes a three-dimensional ground penetrating radar (GPR) survey carried out around a levee of the Ara River in Saitama, Japan, where deformation of the ground was observed after heavy rainfall associated with the typhoon of September 2007. The high-density 3D GPR survey was conducted as a series of closely adjacent four directional sets of 2D surveys at an area surrounding vertical cracks on the paved road caused by deformations induced by heavy rain. The survey directions of the 2D surveys were 0, 90, 45, and -45 degrees with respect to the paved road and the intervals between lines were less than 0.5 m. The 3D subsurface structure was accurately imaged by the result of data processing using Kirchhoff-type 3D migration. As a result, locations and vertical continuities of the heavy rainfall induced cracks in the paved road were clearly imaged. This will be a great help in considering the generation mechanisms of the cracks. Moreover, the current risk of a secondary disaster was found to be low, as no air-filled cavities were detected by the 3D GPR survey.

Three-dimensional S-wave Velocity Structure and Radial Anisotropy of Crust and Uppermost Mantle Beneath East Asia (동아시아 지각과 최상부맨틀의 3차원 S파 속도구조 및 이방성 연구)

  • Lim, DoYoon;Chang, Sung-Joon
    • Geophysics and Geophysical Exploration
    • /
    • v.21 no.1
    • /
    • pp.33-40
    • /
    • 2018
  • We investigate the crustal and uppermost mantle SV- and SH-wave velocity structure and radial anisotropy beneath East Asia including Korea, China and Japan. Rayleigh waves and Love waves were extracted from the seismic data recorded at broadband seismic stations in East Asia. Using the MFT (Multiple Filter Technique), we obtained group velocity dispersion curves of Rayleigh and Love waves with a period range of 3 to 200 s. We obtained 62466 Rayleigh-waves dispersion-curve measurements in vertical components and 54141 Love-waves dispersion-curve measurements in transverse components, respectively. The inverted models using these data sets provide SV- and SH-wave velocity structure of crust and uppermost mantle down to 100 km depth. In both cases of the S-wave velocity structures, strong high-velocity anomalies are observed down to 30 km depth beneath the East Sea, and deeper than 30 km depth, strong low-velocity anomalies are found beneath the Tibetan plateau. In the case of the SH-wave velocity structure, strong low-velocity anomalies are observed beneath the East Sea deeper than 30 km depth, leading to negative anisotropy. On the other hand, positive anisotropy is usually observed beneath the Tibetan plateau.

Design of a Deep Neural Network Model for Image Caption Generation (이미지 캡션 생성을 위한 심층 신경망 모델의 설계)

  • Kim, Dongha;Kim, Incheol
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.6 no.4
    • /
    • pp.203-210
    • /
    • 2017
  • In this paper, we propose an effective neural network model for image caption generation and model transfer. This model is a kind of multi-modal recurrent neural network models. It consists of five distinct layers: a convolution neural network layer for extracting visual information from images, an embedding layer for converting each word into a low dimensional feature, a recurrent neural network layer for learning caption sentence structure, and a multi-modal layer for combining visual and language information. In this model, the recurrent neural network layer is constructed by LSTM units, which are well known to be effective for learning and transferring sequence patterns. Moreover, this model has a unique structure in which the output of the convolution neural network layer is linked not only to the input of the initial state of the recurrent neural network layer but also to the input of the multimodal layer, in order to make use of visual information extracted from the image at each recurrent step for generating the corresponding textual caption. Through various comparative experiments using open data sets such as Flickr8k, Flickr30k, and MSCOCO, we demonstrated the proposed multimodal recurrent neural network model has high performance in terms of caption accuracy and model transfer effect.

A Comparative Experiment on Dimensional Reduction Methods Applicable for Dissimilarity-Based Classifications (비유사도-기반 분류를 위한 차원 축소방법의 비교 실험)

  • Kim, Sang-Woon
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.53 no.3
    • /
    • pp.59-66
    • /
    • 2016
  • This paper presents an empirical evaluation on dimensionality reduction strategies by which dissimilarity-based classifications (DBC) can be implemented efficiently. In DBC, classification is not based on feature measurements of individual objects (a set of attributes), but rather on a suitable dissimilarity measure among the individual objects (pair-wise object comparisons). One problem of DBC is the high dimensionality of the dissimilarity space when a lots of objects are treated. To address this issue, two kinds of solutions have been proposed in the literature: prototype selection (PS)-based methods and dimension reduction (DR)-based methods. In this paper, instead of utilizing the PS-based or DR-based methods, a way of performing DBC in Eigen spaces (ES) is considered and empirically compared. In ES-based DBC, classifications are performed as follows: first, a set of principal eigenvectors is extracted from the training data set using a principal component analysis; second, an Eigen space is expanded using a subset of the extracted and selected Eigen vectors; third, after measuring distances among the projected objects in the Eigen space using $l_p$-norms as the dissimilarity, classification is performed. The experimental results, which are obtained using the nearest neighbor rule with artificial and real-life benchmark data sets, demonstrate that when the dimensionality of the Eigen spaces has been selected appropriately, compared to the PS-based and DR-based methods, the performance of the ES-based DBC can be improved in terms of the classification accuracy.

Effective 3-D GPR Survey for the Exploration of Old Remains (유적지 발굴을 위한 효율적 3차원 GPR 탐사)

  • Kim, Jung-Ho;Yi, Myeong-Jong;Son, Jeong-Sul;Cho, Seong-Jun;Park, Sam-Gyu
    • Geophysics and Geophysical Exploration
    • /
    • v.8 no.4
    • /
    • pp.262-269
    • /
    • 2005
  • Since the buried cultural relics are three-dimensional (3-D) objects in nature, 3-D survey is more preferable in archeological exploration. 3-D Ground Penetrating Radar (GPR) survey based on very dense data in principle, however, might need much higher cost and longer time of exploration than other geophysical methods commonly used for the archeological exploration, such as magnetic and electromagnetic methods. We developed a small-scale continuous data acquisition system which consists of two sets of GPR antennas and the precise positioning device tracking the moving-path of GPR antenna automatically and continuously. Since the high cost of field work may be partly attributed to establishing many profile lines, we adopted a concept of data acquisition at arbitrary locations not along the pre-established profile lines. Besides this hardware system, we also developed several software packages in order to effectively process and visualize the 3-D data obtained by the developed system and the data acquisition concept. Using the developed system, we performed 3-D GPR survey to investigate the possible historical remains of Baekje Kingdom at Buyeo city, South Korea, prior to the excavation. Owing to the newly devised system, we could obtain 3-D GPR data of this survey area having areal extent over about $17,000m^2$ within only six-hours field work. Although the GPR data were obtained at random locations not along the pre-established profile lines, we could obtain high-resolution 3-D images showing many distinctive anomalies, which could be interpreted as old agricultural lands, waterways, and artificial structures or remains. This cast: history led us to the conclusion that 3-D GPR method is very useful not only to examine a small anomalous area but also to investigate the wider region of the archeological interests.