• Title/Summary/Keyword: SOM Algorithm

Search Result 128, Processing Time 0.033 seconds

Study on Dimensionality Reduction for Sea-level Variations by Using Altimetry Data around the East Asia Coasts

  • Hwang, Do-Hyun;Bak, Suho;Jeong, Min-Ji;Kim, Na-Kyeong;Park, Mi-So;Kim, Bo-Ram;Yoon, Hong-Joo
    • Korean Journal of Remote Sensing
    • /
    • v.37 no.1
    • /
    • pp.85-95
    • /
    • 2021
  • Recently, as data mining and artificial neural network techniques are developed, analyzing large amounts of data is proposed to reduce the dimension of the data. In general, empirical orthogonal function (EOF) used to reduce the dimension in the ocean data and recently, Self-organizing maps (SOM) algorithm have been investigated to apply to the ocean field. In this study, both algorithms used the monthly Sea level anomaly (SLA) data from 1993 to 2018 around the East Asia Coasts. There was dominated by the influence of the Kuroshio Extension and eddy kinetic energy. It was able to find the maximum amount of variance of EOF modes. SOM algorithm summarized the characteristic of spatial distributions and periods in EOF mode 1 and 2. It was useful to find the change of SLA variable through the movement of nodes. Node 1 and 5 appeared in the early 2000s and the early 2010s when the sea level was high. On the other hand, node 2 and 6 appeared in the late 1990s and the late 2000s, when the sea level was relatively low. Therefore, it is considered that the application of the SOM algorithm around the East Asia Coasts is well distinguished. In addition, SOM results processed by SLA data, it is able to apply the other climate data to explain more clearly SLA variation mechanisms.

Analysis of spatial mixing characteristics of water quality at the confluence using artificial intelligence (인공지능을 활용한 합류부에서 수질의 공간혼합 특성 분석)

  • Lee, Seo Gyeong;Kim, Dongsu;Kim, Kyungdong;Kim, Young Do;Lyu, Siwan
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2022.05a
    • /
    • pp.482-482
    • /
    • 2022
  • 하천의 합류부에서는 수질이 다른 유체가 혼합하여 합류 전과 다른 특성을 보인다. 하천의 합류부에서 수질을 효율적으로 관리하기 위해서는 수질의 공간적인 혼합 특성을 규명하는 것이 중요하다. 합류부에서 수질의 공간적인 혼합 특성을 분석하기 위해 본 연구에서는 토폴로지 데이터 분석(topological data analysis, TDA), 자기 조직화 지도(Self-Organizing Map, SOM), k-평균 알고리즘(K-means clustering algorithm) 세 가지 기법을 이용하였다. 세 가지 기법을 비교하여 어떤 알고리즘이 합류부의 수질 변화 특성을 더 뚜렷하게 나타내는지 분석하였다. 수질 변화 비교 인자들은 pH, chlorophyll, DO, Turbidity 등이 있고, 수질 인자들은 YSI를 활용해 측정하였다. 자료의 측정 지역은 낙동강과 황강이 합류하는 지역이며, 보트에 YSI 장비를 부착하고 횡단하여 측정하였다. 측정한 데이터를 R 프로그램을 통해 세 가지 기법을 적용시켜 수질 변화 비교를 분석한다. 토폴로지 데이터 분석(topological data analysis, TDA)은 거대하고 복잡한 데이터로부터 유의미한 정보를 추출하는 데 사용하고, 자기조직화지도(Self-Organizing Map, SOM) 기법은 차원 축소와 군집화를 동시에 수행한다. k-평균 알고리즘(K-means clustering algorithm) 기법은 주어진 데이터를 k개의 클러스터로 묶는 머신러닝 비지도학습에 속하는 알고리즘이다. 세 가지 방법들의 주목적은 클러스터링이다. 클러스터 분석(Cluster analysis)이란 주어진 데이터들의 특성을 고려해 동일한 성격을 가진 여러 개의 그룹으로 대상을 분류하는 데이터 마이닝의 한 방법이다. 군집화 방법들인 TDA, SOM, K-means를 이용해 합류 지역의 수질 특성들을 클러스터링하여 수질 패턴들을 분석해 하천 수질 오염을 방지할 수 있을 것이다. 본 연구에서는 토폴로지 데이터 분석(topological data analysis, TDA), 자기조직화지도(Self-Organizing Map, SOM), k-평균 알고리즘(K-means clustering algorithm) 세 가지 기법을 이용하여 합류부에서의 수질 특성을 비교하며 어떤 기법이 합류의 특성을 더욱 뚜렷하게 나타내는지 규명했다. 합류의 특성을 군집화 방법을 이용해 알게 된다면, 합류부의 수질 변화 패턴을 다른 합류 지역에서도 적용할 수 있을 것으로 기대된다.

  • PDF

Application of Self-Organizing Map Theory for the Development of Rainfall-Runoff Prediction Model (강우-유출 예측모형 개발을 위한 자기조직화 이론의 적용)

  • Park, Sung Chun;Jin, Young Hoon;Kim, Yong Gu
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.26 no.4B
    • /
    • pp.389-398
    • /
    • 2006
  • The present study compositely applied the self-organizing map (SOM), which is a kind of artificial neural networks (ANNs), and the back propagation algorithm (BPA) for the rainfall-runoff prediction model taking account of the irregular variation of the spatiotemporal distribution of rainfall. To solve the problems from the previous studies on ANNs, such as the overestimation of low flow during the dry season, the underestimation of runoff during the flood season and the persistence phenomenon, in which the predicted values continuously represent the preceding runoffs, we introduced SOM theory for the preprocessing in the prediction model. The theory is known that it has the pattern classification ability. The method proposed in the present research initially includes the classification of the rainfall-runoff relationship using SOM and the construction of the respective models according to the classification by SOM. The individually constructed models used the data corresponding to the respectively classified patterns for the runoff prediction. Consequently, the method proposed in the present study resulted in the better prediction ability of runoff than that of the past research using the usual application of ANNs and, in addition, there were no such problems of the under/over-estimation of runoff and the persistence.

Improved SIM Algorithm for Contents-based Image Retrieval (내용 기반 이미지 검색을 위한 개선된 SIM 방법)

  • Kim, Kwang-Baek
    • Journal of Intelligence and Information Systems
    • /
    • v.15 no.2
    • /
    • pp.49-59
    • /
    • 2009
  • Contents-based image retrieval methods are in general more objective and effective than text-based image retrieval algorithms since they use color and texture in search and avoid annotating all images for search. SIM(Self-organizing Image browsing Map) is one of contents-based image retrieval algorithms that uses only browsable mapping results obtained by SOM(Self Organizing Map). However, SOM may have an error in selecting the right BMU in learning phase if there are similar nodes with distorted color information due to the intensity of light or objects' movements in the image. Such images may be mapped into other grouping nodes thus the search rate could be decreased by this effect. In this paper, we propose an improved SIM that uses HSV color model in extracting image features with color quantization. In order to avoid unexpected learning error mentioned above, our SOM consists of two layers. In learning phase, SOM layer 1 has the color feature vectors as input. After learning SOM Layer 1, the connection weights of this layer become the input of SOM Layer 2 and re-learning occurs. With this multi-layered SOM learning, we can avoid mapping errors among similar nodes of different color information. In search, we put the query image vector into SOM layer 2 and select nodes of SOM layer 1 that connects with chosen BMU of SOM layer 2. In experiment, we verified that the proposed SIM was better than the original SIM and avoid mapping error effectively.

  • PDF

Pattern Recognition of Meteorological fields Using Self-Organizing Map (SOM)

  • Nishiyama Koji;Endo Shinichi;Jinno Kenji
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2005.05b
    • /
    • pp.9-18
    • /
    • 2005
  • In order to systematically and visually understand well-known but qualitative and rotatively complicated relationships between synoptic fields in the BAIU season and heavy rainfall events in Japan, these synoptic fields were classified using the Self-Organizing Map (SOM) algorithm. This algorithm can convert complex nonlinear features into simple two-dimensional relationships, and was followed by the application of the clustering techniques of the U-matrix and the K-means. It was assumed that the meteorological field patterns be simply expressed by the spatial distribution of wind components at the 850 hPa level and Precipitable Water (PW) in the southwestern area including Kyushu in Japan. Consequently, the synoptic fields could be divided into eight kinds of patterns (clusters). One of the clusters has the notable spatial feature represented by high PW accompanied by strong wind components known as Low-Level Jet (LLJ). The features of this cluster indicate a typical meteorological field pattern that frequently causes disastrous heavy rainfall in Kyushu in the rainy season. From these results, the SOM technique may be an effective tool for the classification of complicated non-linear synoptic fields.

  • PDF

Peach & Pit Volume Measurement and 3D Visualization using Magnetic Resonance Imaging Data (자기공명영상을 이용한 복숭아 및 씨의 부피 측정과 3차원 가시화)

  • 김철수
    • Journal of Biosystems Engineering
    • /
    • v.27 no.3
    • /
    • pp.227-234
    • /
    • 2002
  • This study was conducted to nondestructively estimate the volumetric information of peach and pit and to visualize the 3D information of internal structure from magnetic resonance imaging(MRI) data. Bruker Biospec 7T spectrometer operating at a proton reosonant frequency of 300 MHz was used for acquisition of MRI data of peach. Image processing algorithms and visualization techniques were implemented by using MATLAB (Mathworks) and Visualization Toolkit(Kitware), respectively. Thresholding algorithm and Kohonen's self organizing map(SOM) were applied to MRI data fur region segmentation. Volumetric information were estimated from segemented images and compared to the actual measurements. The average prediction errors of peach and pit volumes were 4.5%, 26.1%, respectively for the thresholding algorithm. and were 2.1%, 19.9%. respectively for the SOM. Although we couldn't get the statistically meaningful results with the limited number of samples, the average prediction errors were lower when the region segmentation was done by SOM rather than thresholding. The 3D visualization techniques such as isosurface construction and volume rendering were successfully implemented, by which we could nondestructively obtain the useful information of internal structures of peach.

Digital Watermarking using the suitable watermark strength and length (최적의 워터마크 강도와 길이를 이용한 디지털 워터마킹)

  • Lee, Young-Hee;Lee, Jung-Hee;Cha, Eui-Young
    • The Journal of Korean Association of Computer Education
    • /
    • v.9 no.5
    • /
    • pp.77-84
    • /
    • 2006
  • In this paper, we propose an adaptive image watermarking algorithm in DWT domain by using HVS(human Visual system) and SOM(Self-Organizing Map) among neural networks. HVS can be described in terms of two properties of HVS: brightness and texture sensitivity. The SOM is used to obtain the local characteristics of image, Therefore, the suitable strength and length of embedded watermark is determined by using HVS and SOM. The experimental results show that proposed method provides a suitable strength and length of watermark and has good perceptual invisibility and robustness for various attacks.

  • PDF

A STUDY ON THE SIMULATED ANNEALING OF SELF ORGANIZED MAP ALGORITHM FOR KOREAN PHONEME RECOGNITION

  • Kang, Myung-Kwang;Ann, Tae-Ock;Kim, Lee-Hyung;Kim, Soon-Hyob
    • Proceedings of the Acoustical Society of Korea Conference
    • /
    • 1994.06c
    • /
    • pp.407-410
    • /
    • 1994
  • In this paper, we describe the new unsuperivised learning algorithm, SASOM. It can solve the defects of the conventional SOM that the state of network can't converge to the minimum point. The proposed algorithm uses the object function which can evaluate the state of network in learning and adjusts the learning rate flexibly according to the evaluation of the object function. We implement the simulated annealing which is applied to the conventional network using the object function and the learning rate. Finally, the proposed algorithm can make the state of network converged to the global minimum. Using the two-dimensional input vectors with uniform distribution, we graphically compared the ordering ability of SOM with that of SASOM. We carried out the recognitioin on the new algorithm for all Korean phonemes and some continuous speech.

  • PDF

Edge Preserving Image Compression with Weighted Centroid Neural Network (신경망에 의한 테두리를 보존하는 영상압축)

  • 박동철;우영준
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.24 no.10B
    • /
    • pp.1946-1952
    • /
    • 1999
  • A new image compression method to preserve edge characteristics in reconstructed images using an unsupervised learning neural is proposed in this paper. By the unsupervised competitive learning which generalizes previously proposed Centroid Neural Network(CNN) algorithm with the geometric characteristics of edge area and statistical characteristics of image data, more codevectors are allocated in the edge areas to provide the more accurate edges in reconstructed image. Experimental results show that the proposed method gives improved edge in reconstructed images when compared with SOM, Modified SOM and M/R-CNN.

  • PDF

Flood Stage Forecasting using Kohonen Self-Organizing Map (코호넨 자기조직화함수를 이용한 홍수위 예측)

  • Kim, Seong-Won;Kim, Hyeong-Su
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2007.05a
    • /
    • pp.1427-1431
    • /
    • 2007
  • In this study, the new methodology which combines Kohonen self-organizing map(KSOM) neural networks model and the conventional neural networks models such as feedforward neural networks model and generalized neural networks model is introduced to forecast flood stage in Nakdong river, Republic of Korea. It is possible to train without output data in KSOM neural networks model. KSOM neural networks model is used to classify the input data before it combines with the conventional neural networks model. Four types of models such as SOM-FFNNM-BP, SOM-GRNNM-GA, FFNNM-BP, and GRNNM-GA are used to train and test performances respectively. From the statistical analysis for training and testing performances, SOM-GRNNM-GA shows the best results compared with the other models such as SOM-FFNNM-BP, FFNNM-BP, and GRNNM-GA and FFNNM-BP shows vice-versa. From this study, we can suggest the new methodology to forecast flood stage and construct flood warning system in river basin.

  • PDF