• Title/Summary/Keyword: self-organizing map networks

Search Result 65, Processing Time 0.027 seconds

Word sense disambiguation using modular neural networks (모듈화된 신경망을 이용한 한국어 중의성 해결 시스템)

  • Han, Tae-Sik;Song, Man-Suk
    • Annual Conference on Human and Language Technology
    • /
    • 1995.10a
    • /
    • pp.39-42
    • /
    • 1995
  • 문장 안에서 한 단어가 가지는 올바른 의미를 얻기 위해 모듈화된 신경망을 이용하였다. 앞부분에 놓인 신경망은 코호넨 신경망으로 사용자의 지도가 개입되지 않은 상태로 자율학습(Unsupervised learning)이 이루어지고, 뒤에 놓인 신경망은 앞에서 결과로 얻은 2차원의 자기 조직화 형상지도(Self-organizing feature map)를 바탕으로 역전파 신경망을 이용한 지도학습(Supervised learning)을 하게 하였다. 입력 자료는 구문분석된 문장의 조사 정보를 활용하여 입력 위치를 정해준 명사의 의미표지와 동사의 의미표지를 사용하였다. 중의성이 있는 단어를 가지는 문장은 중의성의 가지수 만큼 테스트 입력 자료가 되어 신경망을 통과하여 의미를 결정하도록 한다.

  • PDF

A Dynamically Reconfiguring Backpropagation Neural Network and Its Application to the Inverse Kinematic Solution of Robot Manipulators (동적 변화구조의 역전달 신경회로와 로보트의 역 기구학 해구현에의 응용)

  • 오세영;송재명
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.39 no.9
    • /
    • pp.985-996
    • /
    • 1990
  • An inverse kinematic solution of a robot manipulator using multilayer perceptrons is proposed. Neural networks allow the solution of some complex nonlinear equations such as the inverse kinematics of a robot manipulator without the need for its model. However, the back-propagation (BP) learning rule for multilayer perceptrons has the major limitation of being too slow in learning to be practical. In this paper, a new algorithm named Dynamically Reconfiguring BP is proposed to improve its learning speed. It uses a modified version of Kohonen's Self-Organizing Feature Map (SOFM) to partition the input space and for each input point, select a subset of the hidden processing elements or neurons. A subset of the original network results from these selected neuron which learns the desired mapping for this small input region. It is this selective property that accelerates convergence as well as enhances resolution. This network was used to learn the parity function and further, to solve the inverse kinematic problem of a robot manipulator. The results demonstrate faster learning than the BP network.

A Study on the Forcasting and Fuzzy Control of Maximum demand Power Using SOFM Neural Networks (SOFM신경망을 이용한 최대수요전력 예측과 퍼지제어에 관한 연구)

  • 조성원;안준식;석진욱
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1998.10a
    • /
    • pp.427-432
    • /
    • 1998
  • 최근 산업발전에 따라 야기되는 문제점 중 전력수요의 증가에 의한 피해가 증대되고 있다. 여름철 하계부하등에 의한 과부하는 가정이나 대형건물의 정전을 발생시키거나 공장의 기계를 파손시키기도 하기 때문에 이를 미연에 방지할 수 있는 부하예측기법이 점차로 강조되고 있는 현실이다. 이에 본 논문에서는 초(sec)단위의 순시부하예측/제어를 위한 새로운 방법과 퍼지제어기를 제안한다. 제안한 순시부하예측/제어는 크게 과거의 데이터를 가지고 일정시간 후의 값을 예측하는 예측부와 이 결과의 신뢰도를 높여주기 위한 퍼지제어기로나눌 수 있다. 예측부는 SOFM (Self-Organizing Feature Map) 신경망을 이용하며, 예측된 출력값을 퍼지제어기의 입력으로 사용한다.

  • PDF

Application of Artificial Neural Networks Technique for the Improvement of Flood Forecasting and Warning System (홍수 예.경보시스템 개선을 위한 인공신경망 이론의 적용)

  • Park, Sung-Chun;Kim, Yong-Gu;Jeong, Choen-Lee;Jin, Young-Hoon
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2009.05a
    • /
    • pp.1265-1271
    • /
    • 2009
  • 본 연구에서는 강우의 시 공간적 분포의 불규칙한 변동성을 고려한 강우-유출예측모형을 위해 인공신경망(Artificial Neural Networks: ANNs)의 기법의 일종인 자기조직화(Self Organizing Map: SOM) 이론과 역전파 학습 알고리즘(Back Propagation Algorithm: BPA) 이론을 복합적으로 이용하였다. 기존의 인공신경망 연구에서 야기된 저 갈수기의 유출량에 대한 과대평가, 홍수기의 유출량에 대한 과소평가, 예측값이 연속적으로 선행 유출량을 나타내는 Persistence 현상을 해결하기 위하여 패턴분류 성능을 지닌 SOM 이론을 예측모형의 전처리 과정으로 이용하였다. 먼저, 본 연구에서 제안한 방법은 SOM에 의해 강우-유출 관계를 분류하고, SOM에 의한 분류에 따라 각각의 모형을 구성한다. 개별적으로 구축된 모형은 유출량의 예측을 위해 각각의 양상에 따라 분류된 자료를 이용한다. 결과적으로 본 연구에서 제안한 방법은 과거의 인공신경망의 일반적인 적용에 의한 결과보다 더 나은 예측능력을 보여주었으며, 더불어 유출량의 과소 및 과대추정과 Persistence 현상과 같은 문제점이 나타나지 않았다. 또한 강우량 및 유출량의 범위에 제한을 받지 않는 강우-유출예측 모형의 개발 및 홍수기로부터 갈수기까지의 보다 넓은 범위의 유출량의 예측에 기여할 것으로 기대된다.

  • PDF

Bankruptcy Type Prediction Using A Hybrid Artificial Neural Networks Model (하이브리드 인공신경망 모형을 이용한 부도 유형 예측)

  • Jo, Nam-ok;Kim, Hyun-jung;Shin, Kyung-shik
    • Journal of Intelligence and Information Systems
    • /
    • v.21 no.3
    • /
    • pp.79-99
    • /
    • 2015
  • The prediction of bankruptcy has been extensively studied in the accounting and finance field. It can have an important impact on lending decisions and the profitability of financial institutions in terms of risk management. Many researchers have focused on constructing a more robust bankruptcy prediction model. Early studies primarily used statistical techniques such as multiple discriminant analysis (MDA) and logit analysis for bankruptcy prediction. However, many studies have demonstrated that artificial intelligence (AI) approaches, such as artificial neural networks (ANN), decision trees, case-based reasoning (CBR), and support vector machine (SVM), have been outperforming statistical techniques since 1990s for business classification problems because statistical methods have some rigid assumptions in their application. In previous studies on corporate bankruptcy, many researchers have focused on developing a bankruptcy prediction model using financial ratios. However, there are few studies that suggest the specific types of bankruptcy. Previous bankruptcy prediction models have generally been interested in predicting whether or not firms will become bankrupt. Most of the studies on bankruptcy types have focused on reviewing the previous literature or performing a case study. Thus, this study develops a model using data mining techniques for predicting the specific types of bankruptcy as well as the occurrence of bankruptcy in Korean small- and medium-sized construction firms in terms of profitability, stability, and activity index. Thus, firms will be able to prevent it from occurring in advance. We propose a hybrid approach using two artificial neural networks (ANNs) for the prediction of bankruptcy types. The first is a back-propagation neural network (BPN) model using supervised learning for bankruptcy prediction and the second is a self-organizing map (SOM) model using unsupervised learning to classify bankruptcy data into several types. Based on the constructed model, we predict the bankruptcy of companies by applying the BPN model to a validation set that was not utilized in the development of the model. This allows for identifying the specific types of bankruptcy by using bankruptcy data predicted by the BPN model. We calculated the average of selected input variables through statistical test for each cluster to interpret characteristics of the derived clusters in the SOM model. Each cluster represents bankruptcy type classified through data of bankruptcy firms, and input variables indicate financial ratios in interpreting the meaning of each cluster. The experimental result shows that each of five bankruptcy types has different characteristics according to financial ratios. Type 1 (severe bankruptcy) has inferior financial statements except for EBITDA (earnings before interest, taxes, depreciation, and amortization) to sales based on the clustering results. Type 2 (lack of stability) has a low quick ratio, low stockholder's equity to total assets, and high total borrowings to total assets. Type 3 (lack of activity) has a slightly low total asset turnover and fixed asset turnover. Type 4 (lack of profitability) has low retained earnings to total assets and EBITDA to sales which represent the indices of profitability. Type 5 (recoverable bankruptcy) includes firms that have a relatively good financial condition as compared to other bankruptcy types even though they are bankrupt. Based on the findings, researchers and practitioners engaged in the credit evaluation field can obtain more useful information about the types of corporate bankruptcy. In this paper, we utilized the financial ratios of firms to classify bankruptcy types. It is important to select the input variables that correctly predict bankruptcy and meaningfully classify the type of bankruptcy. In a further study, we will include non-financial factors such as size, industry, and age of the firms. Thus, we can obtain realistic clustering results for bankruptcy types by combining qualitative factors and reflecting the domain knowledge of experts.

Unsupervised Scheme for Reverse Social Engineering Detection in Online Social Networks (온라인 소셜 네트워크에서 역 사회공학 탐지를 위한 비지도학습 기법)

  • Oh, Hayoung
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.4 no.3
    • /
    • pp.129-134
    • /
    • 2015
  • Since automatic social engineering based spam attacks induce for users to click or receive the short message service (SMS), e-mail, site address and make a relationship with an unknown friend, it is very easy for them to active in online social networks. The previous spam detection schemes only apply manual filtering of the system managers or labeling classifications regardless of the features of social networks. In this paper, we propose the spam detection metric after reflecting on a couple of features of social networks followed by analysis of real social network data set, Twitter spam. In addition, we provide the online social networks based unsupervised scheme for automated social engineering spam with self organizing map (SOM). Through the performance evaluation, we show the detection accuracy up to 90% and the possibility of real time training for the spam detection without the manager.

Analysis of Two-Dimensional Fluorescence Spectra in Biotechnological Processes by Artificial Neural Networks II - Process Modeling using Backpropagation Neural Network - (인공신경망에 의만 생물공정에서 2차원 영광스펙트럼의 분석 II - 역전파 신경망에 의한 공정의 모델링 -)

  • Lee Kum-Il;Yim Yong-Sik;Sohn Ok-Jae;Chung Sang-Wook;Rhee Jong Il
    • KSBB Journal
    • /
    • v.20 no.4
    • /
    • pp.299-304
    • /
    • 2005
  • A two-dimensional (2D) spectrofluorometer was used to monitor various fermentation processes with recombinant E. coli for the production of 5-aminolevulinic acid (ALA). The whole fluorescence spectral data obtained during a process were analyed using artificial neural networks, i.e. self-organizing map (SOM) and feedforward backpropagation neural network (BPNN).Based on the classified fluorescence spectra a supervised BPNN algorithm was used to predict some of the process parameters. It was also shown that the BPNN models could elucidate some sections of the process performance, e.g. forecasting the process performance.

A Framework for Developing interoperable Knowledge Discovery System

  • Li, Sheng-Tun;Shue, Li-Yen
    • Proceedings of the Korea Inteligent Information System Society Conference
    • /
    • 2001.01a
    • /
    • pp.435-440
    • /
    • 2001
  • The development of web-aware knowledge discovery system has received a great deal of attention in recent years. It plays a key-enabling role for competitive businesses in the E-commerce era. One of the challenges in developing web-aware knowledge discovery systems is to integrate and coordinate and coordinate existing standalone or legacy knowledge discovery applications in a seamless manner, so that cost-effective systems can be developed without the need of costly proprietary products. In this paper, we present an approach for developing a framework of web-aware interoperable knowledge discovery system to achieve this purpose. This approach applies RMI and high-level code wrapper of Java distributed object computing to address the issues of interoperability in heterogeneous environments, which includes programming language, platform, and visual object model. The effectiveness of the proposed framework is demonstrated through the integration and extension of the two well-known standalone knowledge discovery tools, SOM_PAK and Nenet. It confirms that a variety of interoperable knowledge discovery systems can be constructed efficiently on the basis of the framework to meet various requirements of knowledge discovery tasks.

  • PDF

Intelligent Deployment Method of Sensor Networks using SOFM (SOFM을 이용한 센서 네트워크의 지능적인 배치 방식)

  • Jung, Kyung-Kwon;Eom, Ki-Hwan
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.11 no.2
    • /
    • pp.430-435
    • /
    • 2007
  • In this paper, we propose an intelligent deployment of sensor network for reliable communication. The proposed method determines optimal transmission range based on the wireless channel characteristics, and searches the optimal number of sensor nodes, and optimal locations with SOFM. We calculate PRR against a distance uses the log-normal path loss model, and decide the communication range of sensor node from PRR. In order to verify the effectiveness of the proposed method, we performed simulations on the searching for intelligent deployment and checking for link condition of sensor network.

The Pattern Analysis of Financial Distress for Non-audited Firms using Data Mining (데이터마이닝 기법을 활용한 비외감기업의 부실화 유형 분석)

  • Lee, Su Hyun;Park, Jung Min;Lee, Hyoung Yong
    • Journal of Intelligence and Information Systems
    • /
    • v.21 no.4
    • /
    • pp.111-131
    • /
    • 2015
  • There are only a handful number of research conducted on pattern analysis of corporate distress as compared with research for bankruptcy prediction. The few that exists mainly focus on audited firms because financial data collection is easier for these firms. But in reality, corporate financial distress is a far more common and critical phenomenon for non-audited firms which are mainly comprised of small and medium sized firms. The purpose of this paper is to classify non-audited firms under distress according to their financial ratio using data mining; Self-Organizing Map (SOM). SOM is a type of artificial neural network that is trained using unsupervised learning to produce a lower dimensional discretized representation of the input space of the training samples, called a map. SOM is different from other artificial neural networks as it applies competitive learning as opposed to error-correction learning such as backpropagation with gradient descent, and in the sense that it uses a neighborhood function to preserve the topological properties of the input space. It is one of the popular and successful clustering algorithm. In this study, we classify types of financial distress firms, specially, non-audited firms. In the empirical test, we collect 10 financial ratios of 100 non-audited firms under distress in 2004 for the previous two years (2002 and 2003). Using these financial ratios and the SOM algorithm, five distinct patterns were distinguished. In pattern 1, financial distress was very serious in almost all financial ratios. 12% of the firms are included in these patterns. In pattern 2, financial distress was weak in almost financial ratios. 14% of the firms are included in pattern 2. In pattern 3, growth ratio was the worst among all patterns. It is speculated that the firms of this pattern may be under distress due to severe competition in their industries. Approximately 30% of the firms fell into this group. In pattern 4, the growth ratio was higher than any other pattern but the cash ratio and profitability ratio were not at the level of the growth ratio. It is concluded that the firms of this pattern were under distress in pursuit of expanding their business. About 25% of the firms were in this pattern. Last, pattern 5 encompassed very solvent firms. Perhaps firms of this pattern were distressed due to a bad short-term strategic decision or due to problems with the enterpriser of the firms. Approximately 18% of the firms were under this pattern. This study has the academic and empirical contribution. In the perspectives of the academic contribution, non-audited companies that tend to be easily bankrupt and have the unstructured or easily manipulated financial data are classified by the data mining technology (Self-Organizing Map) rather than big sized audited firms that have the well prepared and reliable financial data. In the perspectives of the empirical one, even though the financial data of the non-audited firms are conducted to analyze, it is useful for find out the first order symptom of financial distress, which makes us to forecast the prediction of bankruptcy of the firms and to manage the early warning and alert signal. These are the academic and empirical contribution of this study. The limitation of this research is to analyze only 100 corporates due to the difficulty of collecting the financial data of the non-audited firms, which make us to be hard to proceed to the analysis by the category or size difference. Also, non-financial qualitative data is crucial for the analysis of bankruptcy. Thus, the non-financial qualitative factor is taken into account for the next study. This study sheds some light on the non-audited small and medium sized firms' distress prediction in the future.