• 제목/요약/키워드: matrix learning

검색결과 351건 처리시간 0.031초

Two Dimensional Slow Feature Discriminant Analysis via L2,1 Norm Minimization for Feature Extraction

  • Gu, Xingjian;Shu, Xiangbo;Ren, Shougang;Xu, Huanliang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제12권7호
    • /
    • pp.3194-3216
    • /
    • 2018
  • Slow Feature Discriminant Analysis (SFDA) is a supervised feature extraction method inspired by biological mechanism. In this paper, a novel method called Two Dimensional Slow Feature Discriminant Analysis via $L_{2,1}$ norm minimization ($2DSFDA-L_{2,1}$) is proposed. $2DSFDA-L_{2,1}$ integrates $L_{2,1}$ norm regularization and 2D statically uncorrelated constraint to extract discriminant feature. First, $L_{2,1}$ norm regularization can promote the projection matrix row-sparsity, which makes the feature selection and subspace learning simultaneously. Second, uncorrelated features of minimum redundancy are effective for classification. We define 2D statistically uncorrelated model that each row (or column) are independent. Third, we provide a feasible solution by transforming the proposed $L_{2,1}$ nonlinear model into a linear regression type. Additionally, $2DSFDA-L_{2,1}$ is extended to a bilateral projection version called $BSFDA-L_{2,1}$. The advantage of $BSFDA-L_{2,1}$ is that an image can be represented with much less coefficients. Experimental results on three face databases demonstrate that the proposed $2DSFDA-L_{2,1}/BSFDA-L_{2,1}$ can obtain competitive performance.

프로세스 마이닝을 위한 거리 기반의 API(Anomaly Process Instance) 탐지법 (Detection of API(Anomaly Process Instance) Based on Distance for Process Mining)

  • 전대욱;배혜림
    • 대한산업공학회지
    • /
    • 제41권6호
    • /
    • pp.540-550
    • /
    • 2015
  • There have been many attempts to find knowledge from data using conventional statistics, data mining, artificial intelligence, machine learning and pattern recognition. In those research areas, knowledge is approached in two ways. Firstly, researchers discover knowledge represented in general features for universal recognition, and secondly, they discover exceptional and distinctive features. In process mining, an instance is sequential information bounded by case ID, known as process instance. Here, an exceptional process instance can cause a problem in the analysis and discovery algorithm. Hence, in this paper we develop a method to detect the knowledge of exceptional and distinctive features when performing process mining. We propose a method for anomaly detection named Distance-based Anomaly Process Instance Detection (DAPID) which utilizes distance between process instances. DAPID contributes to a discovery of distinctive characteristic of process instance. For verifying the suggested methodology, we discovered characteristics of exceptional situations from log data. Additionally, we experiment on real data from a domestic port terminal to demonstrate our proposed methodology.

A Modified Approach to Density-Induced Support Vector Data Description

  • Park, Joo-Young;Kang, Dae-Sung
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제7권1호
    • /
    • pp.1-6
    • /
    • 2007
  • The SVDD (support vector data description) is one of the most well-known one-class support vector learning methods, in which one tries the strategy of utilizing balls defined on the feature space in order to distinguish a set of normal data from all other possible abnormal objects. Recently, with the objective of generalizing the SVDD which treats all training data with equal importance, the so-called D-SVDD (density-induced support vector data description) was proposed incorporating the idea that the data in a higher density region are more significant than those in a lower density region. In this paper, we consider the problem of further improving the D-SVDD toward the use of a partial reference set for testing, and propose an LMI (linear matrix inequality)-based optimization approach to solve the improved version of the D-SVDD problems. Our approach utilizes a new class of density-induced distance measures based on the RSDE (reduced set density estimator) along with the LMI-based mathematical formulation in the form of the SDP (semi-definite programming) problems, which can be efficiently solved by interior point methods. The validity of the proposed approach is illustrated via numerical experiments using real data sets.

Preliminary Test of Adaptive Neuro-Fuzzy Inference System Controller for Spacecraft Attitude Control

  • Kim, Sung-Woo;Park, Sang-Young;Park, Chan-Deok
    • Journal of Astronomy and Space Sciences
    • /
    • 제29권4호
    • /
    • pp.389-395
    • /
    • 2012
  • The problem of spacecraft attitude control is solved using an adaptive neuro-fuzzy inference system (ANFIS). An ANFIS produces a control signal for one of the three axes of a spacecraft's body frame, so in total three ANFISs are constructed for 3-axis attitude control. The fuzzy inference system of the ANFIS is initialized using a subtractive clustering method. The ANFIS is trained by a hybrid learning algorithm using the data obtained from attitude control simulations using state-dependent Riccati equation controller. The training data set for each axis is composed of state errors for 3 axes (roll, pitch, and yaw) and a control signal for one of the 3 axes. The stability region of the ANFIS controller is estimated numerically based on Lyapunov stability theory using a numerical method to calculate Jacobian matrix. To measure the performance of the ANFIS controller, root mean square error and correlation factor are used as performance indicators. The performance is tested on two ANFIS controllers trained in different conditions. The test results show that the performance indicators are proper in the sense that the ANFIS controller with the larger stability region provides better performance according to the performance indicators.

시각화를 이용한 선형대수학 교수학습모델 - $R^n$의 부분공간 - (Linear Algebra Class Model using Technology(Matlab) - LINEAR SUBSPACES OF $R^n$ -)

  • 김덕선;이상구;정경훈
    • 한국수학교육학회지시리즈E:수학교육논문집
    • /
    • 제21권4호
    • /
    • pp.621-646
    • /
    • 2007
  • 컴퓨터의 발전은 수학교육 특히 선형대수학 교수-학습 방법에 큰 개선 가능성을 보여준다. 수학 교육 및 연구용으로 많이 쓰이는 프로그램은 MATHEMATICA, MATLAB, MAPLE, Drive, LINPRAC 등 다양하다. 그 중 MATLAB(MATrix LABoratory)은 행렬 연산 속도가 뛰어나고 계산 수학 특히 수치적 선형대수학 연구와 교육에 잘 맞는 프로그램이다. 본 논문에서는 $R^n$의 부분공간 개념을 중심으로 선형대수학의 주요 개념을 시각적 이해를 통하여 효과적으로 전달하는 교수학습법을 MATLAB를 이용하여 소개한다.

  • PDF

An Improved Multiplicative Updating Algorithm for Nonnegative Independent Component Analysis

  • Li, Hui;Shen, Yue-Hong;Wang, Jian-Gong
    • ETRI Journal
    • /
    • 제35권2호
    • /
    • pp.193-199
    • /
    • 2013
  • This paper addresses nonnegative independent component analysis (NICA), with the aim to realize the blind separation of nonnegative well-grounded independent source signals, which arises in many practical applications but is hardly ever explored. Recently, Bertrand and Moonen presented a multiplicative NICA (M-NICA) algorithm using multiplicative update and subspace projection. Based on the principle of the mutual correlation minimization, we propose another novel cost function to evaluate the diagonalization level of the correlation matrix, and apply the multiplicative exponentiated gradient (EG) descent update to it to maintain nonnegativity. An efficient approach referred to as the EG-NICA algorithm is derived and its validity is confirmed by numerous simulations conducted on different types of source signals. Results show that the separation performance of the proposed EG-NICA algorithm is superior to that of the previous M-NICA algorithm, with a better unmixing accuracy. In addition, its convergence speed is adjustable by an appropriate user-defined learning rate.

Automated epileptic seizure waveform detection method based on the feature of the mean slope of wavelet coefficient counts using a hidden Markov model and EEG signals

  • Lee, Miran;Ryu, Jaehwan;Kim, Deok-Hwan
    • ETRI Journal
    • /
    • 제42권2호
    • /
    • pp.217-229
    • /
    • 2020
  • Long-term electroencephalography (EEG) monitoring is time-consuming, and requires experts to interpret EEG signals to detect seizures in patients. In this paper, we propose a novel automated method called adaptive slope of wavelet coefficient counts over various thresholds (ASCOT) to classify patient episodes as seizure waveforms. ASCOT involves extracting the feature matrix by calculating the mean slope of wavelet coefficient counts over various thresholds in each frequency subband. We validated our method using our own database and a public database to avoid overtuning. The experimental results show that the proposed method achieved a reliable and promising accuracy in both our own database (98.93%) and the public database (99.78%). Finally, we evaluated the performance of the method considering various window sizes. In conclusion, the proposed method achieved a reliable seizure detection performance with a short-term window size. Therefore, our method can be utilized to interpret long-term EEG results and detect momentary seizure waveforms in diagnostic systems.

실시간 근전도 패턴인식을 위한 특징투영 기법에 관한 연구 (A Study on Feature Projection Methods for a Real-Time EMG Pattern Recognition)

  • 추준욱;김신기;문무성;문인혁
    • 제어로봇시스템학회논문지
    • /
    • 제12권9호
    • /
    • pp.935-944
    • /
    • 2006
  • EMG pattern recognition is essential for the control of a multifunction myoelectric hand. The main goal of this study is to develop an efficient feature projection method for EMC pattern recognition. To this end, we propose a linear supervised feature projection that utilizes linear discriminant analysis (LDA). We first perform wavelet packet transform (WPT) to extract the feature vector from four channel EMC signals. For dimensionality reduction and clustering of the WPT features, the LDA incorporates class information into the learning procedure, and finds a linear matrix to maximize the class separability for the projected features. Finally, the multilayer perceptron classifies the LDA-reduced features into nine hand motions. To evaluate the performance of LDA for the WPT features, we compare LDA with three other feature projection methods. From a visualization and quantitative comparison, we show that LDA has better performance for the class separability, and the LDA-projected features improve the classification accuracy with a short processing time. We implemented a real-time pattern recognition system for a multifunction myoelectric hand. In experiment, we show that the proposed method achieves 97.2% recognition accuracy, and that all processes, including the generation of control commands for myoelectric hand, are completed within 97 msec. These results confirm that our method is applicable to real-time EMG pattern recognition far myoelectric hand control.

반복학습제어와 시스템 및 외란인식기술을 응용한 복합구조물의 정밀도 품질보증 (Precision Quality Assurance of the Multiple Dynamic Systems in Iterative Loaming and Repetitive Control with System and Disturbance Identification)

  • 이수철
    • 한국산업정보학회논문지
    • /
    • 제7권1호
    • /
    • pp.10-15
    • /
    • 2002
  • 시스템 외란과 계측 외란이 겹친 플랜트의 시스템과 외란 인식기술의 확장성을 소개하고자 한다. 시스템의 수의 상한영역과 외란주파수의 상한영역내에서 외란제거 모형과 외란효과가 외란이 겹친 입출력자료로부터 정기적인 외란의 직접적인 측정없이 정확히 회복될 수 있음을 보여 주고 있다. 시스템 및 외란 인식으로 계산되어 활용되는 자료: 성능관점의 모형 기저 반복학습제어시스템에 사용할 수 있게 된다. 이는 원치 않는 정기적인 외란을 제거하기 위함이다. 반복학습제어와 시스템 및 외란인식기술을 응용하면 복합구조물의 정밀도 품질보증 확보에 큰 기여를 하게 된다.

  • PDF

퍼지 클러스터링 기반 퍼지뉴럴네트워크 설계 및 적용 (Design of Fuzzy Neural Networks Based on Fuzzy Clustering and Its Application)

  • 박건준;이동윤
    • 한국산학기술학회논문지
    • /
    • 제14권1호
    • /
    • pp.378-384
    • /
    • 2013
  • 본 논문에서는 FCM 클러스터링 알고리즘을 기반으로 하는 퍼지뉴럴네트워크를 제안한다. 일반적으로, 퍼지규칙을 생성할 때 차원이 증가하면 퍼지 규칙의 수가 기하급수적으로 증가하는 문제를 가지고 있다. 이를 해결하기 위해, 제안된 네트워크의 퍼지 규칙은 FCM 클러스터링 알고리즘을 이용하여 입력 공간을 분산 형태로 분할함으로써 생성한다. 퍼지 규칙의 전반부 파라미터는 FCM 클러스터링 알고리즘에 의한 소속행렬로 결정된다. 퍼지 규칙의 후반부는 다항식 함수의 형태로 표현되며, 퍼지뉴럴네트워크의 학습은 뉴런의 연결을 조절함으로써 실현되고, 오류 역전파 알고리즘에 의해 행해진다. 마지막으로, 제안된 네트워크는 비선형 공정으로의 적용을 통해 성능을 평가한다.