• Title/Summary/Keyword: Unsupervised Neural Network

Search Result 129, Processing Time 0.026 seconds

Depth Image Restoration Using Generative Adversarial Network (Generative Adversarial Network를 이용한 손실된 깊이 영상 복원)

  • Nah, John Junyeop;Sim, Chang Hun;Park, In Kyu
    • Journal of Broadcast Engineering
    • /
    • v.23 no.5
    • /
    • pp.614-621
    • /
    • 2018
  • This paper proposes a method of restoring corrupted depth image captured by depth camera through unsupervised learning using generative adversarial network (GAN). The proposed method generates restored face depth images using 3D morphable model convolutional neural network (3DMM CNN) with large-scale CelebFaces Attribute (CelebA) and FaceWarehouse dataset for training deep convolutional generative adversarial network (DCGAN). The generator and discriminator equip with Wasserstein distance for loss function by utilizing minimax game. Then the DCGAN restore the loss of captured facial depth images by performing another learning procedure using trained generator and new loss function.

Centroid Neural Network with Bhattacharyya Kernel (Bhattacharyya 커널을 적용한 Centroid Neural Network)

  • Lee, Song-Jae;Park, Dong-Chul
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.32 no.9C
    • /
    • pp.861-866
    • /
    • 2007
  • A clustering algorithm for Gaussian Probability Distribution Function (GPDF) data called Centroid Neural Network with a Bhattacharyya Kernel (BK-CNN) is proposed in this paper. The proposed BK-CNN is based on the unsupervised competitive Centroid Neural Network (CNN) and employs a kernel method for data projection. The kernel method adopted in the proposed BK-CNN is used to project data from the low dimensional input feature space into higher dimensional feature space so as the nonlinear problems associated with input space can be solved linearly in the feature space. In order to cluster the GPDF data, the Bhattacharyya kernel is used to measure the distance between two probability distributions for data projection. With the incorporation of the kernel method, the proposed BK-CNN is capable of dealing with nonlinear separation boundaries and can successfully allocate more code vector in the region that GPDF data are densely distributed. When applied to GPDF data in an image classification probleml, the experiment results show that the proposed BK-CNN algorithm gives 1.7%-4.3% improvements in average classification accuracy over other conventional algorithm such as k-means, Self-Organizing Map (SOM) and CNN algorithms with a Bhattacharyya distance, classed as Bk-Means, B-SOM, B-CNN algorithms.

A Study on Atmospheric Data Anomaly Detection Algorithm based on Unsupervised Learning Using Adversarial Generative Neural Network (적대적 생성 신경망을 활용한 비지도 학습 기반의 대기 자료 이상 탐지 알고리즘 연구)

  • Yang, Ho-Jun;Lee, Seon-Woo;Lee, Mun-Hyung;Kim, Jong-Gu;Choi, Jung-Mu;Shin, Yu-mi;Lee, Seok-Chae;Kwon, Jang-Woo;Park, Ji-Hoon;Jung, Dong-Hee;Shin, Hye-Jung
    • Journal of Convergence for Information Technology
    • /
    • v.12 no.4
    • /
    • pp.260-269
    • /
    • 2022
  • In this paper, We propose an anomaly detection model using deep neural network to automate the identification of outliers of the national air pollution measurement network data that is previously performed by experts. We generated training data by analyzing missing values and outliers of weather data provided by the Institute of Environmental Research and based on the BeatGAN model of the unsupervised learning method, we propose a new model by changing the kernel structure, adding the convolutional filter layer and the transposed convolutional filter layer to improve anomaly detection performance. In addition, by utilizing the generative features of the proposed model to implement and apply a retraining algorithm that generates new data and uses it for training, it was confirmed that the proposed model had the highest performance compared to the original BeatGAN models and other unsupervised learning model like Iforest and One Class SVM. Through this study, it was possible to suggest a method to improve the anomaly detection performance of proposed model while avoiding overfitting without additional cost in situations where training data are insufficient due to various factors such as sensor abnormalities and inspections in actual industrial sites.

The Robust Pattern Recognition System for Flexible Manufacture Automation (유연 생산 자동화를 위한 Robust 패턴인식 시스템)

  • Wi, Young-Ryang;Kim, Mun-Hwa;Jang, Dong-Sik
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.24 no.2
    • /
    • pp.223-240
    • /
    • 1998
  • The purpose of this paper is to develop the pattern recognition system with a 'Robust' concept to be applicable to flexible manufacture automation in practice. The 'Robust' concept has four meanings as follows. First, pattern recognition is performed invariantly in case the object to be recognized is translated, scaled, and rotated. Second, it must have strong resistance against noise. Third, the completely learned system is adjusted flexibly regardless of new objects being added. Finally, it has to recognize objects fast. To develop the proposed system, contouring, spectral analysis and Fuzzy ART neural network are used in this study. Contouring and spectral analysis are used in preprocessing stage, and Fuzzy ART is used in object classification stage. Fuzzy ART is an unsupervised neural network for solving the stability-plasticity dilemma.

  • PDF

Neural Network Cubes (N-Cubes) for Unsupervised learning in Gray-Scale noise

  • Lee, Won-Hee
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.9 no.6
    • /
    • pp.571-576
    • /
    • 1999
  • We consider a class of auto-associative memories namely N-Cubes (Neural-network Cubes) in which 2-D gray-level images and hidden sinusoidal 1-D wavelets are stored in cubical memories. First we develop a learning procedure based upon the least-squares algorithm, Therefore each 2-D training image is mapped into the associated 1-D waveform in the training phase. Second we show how the recall procedure minimizes errors among the orthogonal basis functions in the hidden layer. As a 2-D images ould be retrieved in the recall phase. Simulation results confirm the efficiency and the noise-free properties of N-Cubes.

  • PDF

Acoustic Emission Source Characterization and Fracture Behavior of Finite-width Plate with a Circular Hole Defect using Artificial Neural Network (인공신경회로망을 이용한 원공결함을 갖는 유한 폭 판재의 음향방출 음원특성과 파괴거동에 관한 연구)

  • Rhee, Zhang-Kyu;Woo, Chang-Ki
    • Transactions of the Korean Society of Machine Tool Engineers
    • /
    • v.18 no.2
    • /
    • pp.170-177
    • /
    • 2009
  • The objective of this study is to evaluate an acoustic emission (AE) source characterization and fracture behavior of the SM45C steel by using back-propagation neural network (BPN). In previous research Ref. [8] about k-nearest neighbor classifier (k-NNC) continuity, we used K-means clustering method as an unsupervised learning method for obtaining multi-variate AE main data sets, such as AE counts, energy, amplitude, risetime, duration and counts to peak. Similarly, we applied k-NNC and BPN as a supervised learning method for obtaining multi-variate AE working data sets. According to the error of convergence for determinant criterion Wilk's ${\lambda}$, heuristic criteria D&B(Rij) and Tou values are discussed. As a result, in k-NNC before fracture signal is detected or when fracture signal is detected, showed that produce some empty classes in BPN. And we confirmed that could save trouble in AE signal processing if suitable error of convergence or acceptable encoding error give to BPN.

Multi-stage structural damage diagnosis method based on "energy-damage" theory

  • Yi, Ting-Hua;Li, Hong-Nan;Sun, Hong-Min
    • Smart Structures and Systems
    • /
    • v.12 no.3_4
    • /
    • pp.345-361
    • /
    • 2013
  • Locating and assessing the severity of damage in large or complex structures is one of the most challenging problems in the field of civil engineering. Considering that the wavelet packet transform (WPT) has the ability to clearly reflect the damage characteristics of structural response signals and the artificial neural network (ANN) is capable of learning in an unsupervised manner and of forming new classes when the structural exhibits change, this paper investigates a multi-stage structural damage diagnosis method by using the WPT and ANN based on "energy-damage" theory, in which, the wavelet packet component energies are first extracted to be damage sensitive feature and then adopted as input into an improved back propagation (BP) neural network model for damage diagnosis in a step by step mode. To validate the efficacy of the presented approach of the damage diagnosis, the benchmark structure of the American Society of Civil Engineers (ASCE) is employed in the case study. The results of damage diagnosis indicate that the method herein is computationally efficient and is able to detect the existence of different damage patterns in the simulated experiment where minor, moderate and severe damages corresponds to involving in the loss of stiffness on braces or the removal bracing in various combinations.

Motion Search Region Prediction using Neural Network Vector Quantization (신경 회로망 벡터 양자화를 이용한 움직임 탐색 영역의 예측)

  • Ryu, Dae-Hyun;Kim, Jae-Chang
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.33B no.1
    • /
    • pp.161-169
    • /
    • 1996
  • This paper presents a new search region prediction method using vector quantization for the motion estimation. We find motion vectors using the full search BMA from two successive frame images first. Then the motion vectors are used for training a codebook. The trained codebook is the predicted search region. We used the unsupervised neural network for VQ encoding and codebook design. A major advantage of formulating VQ as neural networks is that the large number of adaptive training algorithm that are used for neural networks can be applied to VQ. The proposed method reduces the computation and reduce the bits required to represent the motion vectors because of the smaller search points. The computer simulation results show the increased PSNR as compared with the other block matching algorithms.

  • PDF

Feature Impact Evaluation Based Pattern Classification System

  • Rhee, Hyun-Sook
    • Journal of the Korea Society of Computer and Information
    • /
    • v.23 no.11
    • /
    • pp.25-30
    • /
    • 2018
  • Pattern classification system is often an important component of intelligent systems. In this paper, we present a pattern classification system consisted of the feature selection module, knowledge base construction module and decision module. We introduce a feature impact evaluation selection method based on fuzzy cluster analysis considering computational approach and generalization capability of given data characteristics. A fuzzy neural network, OFUN-NET based on unsupervised learning data mining technique produces knowledge base for representative clusters. 240 blemish pattern images are prepared and applied to the proposed system. Experimental results show the feasibility of the proposed classification system as an automating defect inspection tool.

Fuzzy TAM Network Model Using SOM (SOM을 이용한 퍼지 TAM 네트워크 모델)

  • Hong, Jung-Pyo;Hwang, Seung-Gook
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.16 no.5
    • /
    • pp.642-646
    • /
    • 2006
  • The fuzzy TAM(Topographical Attentive Mapping) network is a supervised method of pattern analysis which is composed of input layer, category layer, and output layer. But if we don't know the target value of the pattern, the network can not be trained. In this case, the target value can be replaced by a result induced by using an unsupervised neural network as the SOM (Self-organizing Map). In this paper, we apply the results of SOM to fuzzy TAM network and show its usefulness through the case study.