• Journal of Information Processing Systems
• /
• 제18권2호
• /
• pp.188-196
• /
• 2022

Recently, neural architecture search (NAS) has received increasing attention as it can replace human experts in designing the architecture of neural networks for different tasks and has achieved remarkable results in many challenging tasks. In this study, a path-based computation neural architecture encoder (PCE) was proposed. Our PCE first encodes the computation of information on each path in a neural network, and then aggregates the encodings on all paths together through an attention mechanism, simulating the process of information computation along paths in a neural network and encoding the computation on the neural network instead of the structure of the graph, which is more consistent with the computational properties of neural networks. We performed an extensive comparison with eight encoding methods on two commonly used NAS search spaces (NAS-Bench-101 and NAS-Bench-201), which included a comparison of the predictive capabilities of performance predictors and search capabilities based on two search strategies (reinforcement learning-based and Bayesian optimization-based) when equipped with different encoders. Experimental evaluation shows that PCE is an efficient encoding method that effectively ranks and predicts neural architecture performance, thereby improving the search efficiency of neural architectures.

• 대한전기학회:학술대회논문집
• /
• 대한전기학회 2003년도 학술회의 논문집 정보 및 제어부문 A
• /
• pp.263-266
• /
• 2003

In this paper, we have proposed a realization method of tactile sense of virtual objects using multi-layer Neural Networks(NN). Inputs of the NN are position data of non-rigid objects and outputs of the NN are forces at that time and point. First, the position and forte data are measured from non-rigid objects (a sponge and a balloon) using two PHANToMS, one as a master and the other as a slave manipulator, then the data are used to train a multi-layer Neural Networks whose inputs and outputs are designed to represent tactile information. The trained Neural Networks is used to regenerate the tactile sense on the virtual objects graphically made by a computer, and one can feel a quite similar sense of touch by using the system while touching the virtual objects.

• 한국전기전자재료학회논문지
• /
• 제17권8호
• /
• pp.898-903
• /
• 2004

In this paper, neural networks is studied to apply as a PD source classification in XLPE power cable specimen. For treeing discharge sources in the specimen, three defected models are made. And these data making use of a computer-aided discharge analyser, statistical and other discharge parameters is calculated to discrimination between different models of discharge sources. And also these parameter is applied to classify PD sources by neural networks. Neural Networks has good recognition rate for three PD sources.

• 제어로봇시스템학회논문지
• /
• 제6권3호
• /
• pp.263-272
• /
• 2000

In this paper we give some geometric condition for a stochastic nonlinear system and we propose a control method for a stochastic nonlinear system using neural networks. Since a competitive learning neural networks has been developed based on the stochastcic approximation method it is regarded as a stochastic recursive filter algorithm. In addition we provide a filtering and control condition for a stochastic nonlinear system called the perfect filtering condition in a viewpoint of stochastic geometry. The stochastic nonlinear system satisfying the perfect filtering condition is decoupled with a deterministic part and purely semi martingale part. Hence the above system can be controlled by conventional control laws and various intelligent control laws. Computer simulation shows that the stochastic nonlinear system satisfying the perfect filtering condition is controllable and the proposed neural controller is more efficient than the conventional LQG controller and the canonical LQ-Neural controller.

• 한국정보처리학회:학술대회논문집
• /
• 한국정보처리학회 2018년도 춘계학술발표대회
• /
• pp.377-380
• /
• 2018

인간의 추론 능력이란 문제에 주어진 조건을 보고 문제 해결에 필요한 것이 무엇인지를 논리적으로 생각해 보는 것으로 문제 상황 속에서 일정한 규칙이나 성질을 발견하고 이를 수학적인 방법으로 법칙을 찾아내거나 해결하는 능력을 말한다. 이러한 인간인지 능력과 유사한 인공지능 시스템을 개발하는데 있어서 핵심적 도전은 비구조적 데이터(unstructured data)로부터 그 개체들(object)과 그들간의 관계(relation)에 대해 추론하는 능력을 부여하는 것이라고 할 수 있다. 지금까지 딥러닝(deep learning) 방법은 구조화 되지 않은 데이터로부터 문제를 해결하는 엄청난 진보를 가져왔지만, 명시적으로 개체간의 관계를 고려하지 않고 이를 수행해왔다. 최근 발표된 구조화되지 않은 데이터로부터 복잡한 관계 추론을 수행하는 심층신경망(deep neural networks)은 관계추론(relational reasoning)의 시도를 이해하는데 기대할 만한 접근법을 보여주고 있다. 그 첫 번째는 관계추론을 위한 간단한 신경망 모듈(A simple neural network module for relational reasoning) 인 RN(Relation Networks)이고, 두 번째는 시각적 관찰을 기반으로 실제대상의 미래 상태를 예측하는 범용 목적의 VIN(Visual Interaction Networks)이다. 관계 추론을 수행하는 이들 심층신경망(deep neural networks)은 세상을 객체(objects)와 그들의 관계(their relations)라는 체계로 분해하고, 신경망(neural networks)이 피상적으로는 매우 달라 보이지만 근본적으로는 공통관계를 갖는 장면들에 대하여 객체와 관계라는 새로운 결합(combinations)을 일반화할 수 있는 강력한 추론 능력(powerful ability to reason)을 보유할 수 있다는 것을 보여주고 있다. 본 논문에서는 관계 추론을 수행하는 심층신경망(deep neural networks) 중에서 Sort-of-CLEVR 데이터 셋(dataset)을 사용하여 RN(Relation Networks)의 성능을 재현 및 관찰해 보았으며, 더 나아가 파라미터(parameters) 튜닝을 통하여 RN(Relation Networks) 모델의 성능 개선방법을 제시하여 보았다.

• KIEE International Transaction on Electrical Machinery and Energy Conversion Systems
• /
• 제5B권2호
• /
• pp.103-110
• /
• 2005

Broken rotor bars in induction motors can be detected by monitoring any abnormality of the spectrum amplitudes at certain frequencies in the motor current spectrum. Broken rotor bar fault detection schemes should rely on multiple signatures in order to overcome or reduce the effect of any misinterpretation of the signatures that are obscured by factors such as measurement noises and different load conditions. Multiple Discriminant Analysis (MDA) and Artificial Neural Networks (ANN) provide appropriate environments to develop such fault detection schemes because of their multi-input processing capabilities. This paper describes two fault detection schemes for broken rotor bar fault detection with multiple signature processing, and demonstrates that multiple signature processing is more efficient than single signature processing.

• 대한전기학회:학술대회논문집
• /
• 대한전기학회 2007년도 학술대회 논문집 전문대학교육위원
• /
• pp.83-87
• /
• 2007

Correlation Propagation Neural Networks is proposed for On-line interpolation. The proposed neural network technique is the real time computation method through the inter-node diffusion. In the network, a node corresponds to a state in the quantized input space. Each node is composed of a processing unit and fixed weights from its neighbor nodes as well as its input terminal. Information propagates among neighbor nodes laterally and inter-node interpolation is achieved. Through several simulation experiments, real time reconstruction of the nonlinear image information is processed. 1-D CPNN hardware has been implemented with general purpose analog ICs to test the interpolation capability of the proposed neural networks. Experiments with static and dynamic signals have been done upon the CPNN hardware.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 2008년도 하계종합학술대회
• /
• pp.679-680
• /
• 2008

When we apply the neural networks to applications, we need to select proper architecture of the network and the activation function of the network is one of most important characteristics. In this research, we propose a method to make a network using multiple activation functions. The performance of the proposed method is investigated through the computer simulations on various regression problems.

• 한국정보처리학회:학술대회논문집
• /
• 한국정보처리학회 2019년도 춘계학술발표대회
• /
• pp.401-403
• /
• 2019

In this paper, we propose a generative adversarial networks (GAN) based text-to-image generating method. In many natural language processing tasks, which word expressions are determined by their term frequency -inverse document frequency scores. Word2Vec is a type of neural network model that, in the case of an unlabeled corpus, produces a vector that expresses semantics for words in the corpus and an image is generated by GAN training according to the obtained vector. Thanks to the understanding of the word we can generate higher and more realistic images. Our GAN structure is based on deep convolution neural networks and pixel recurrent neural networks. Comparing the generated image with the real image, we get about 88% similarity on the Oxford-102 flowers dataset.

• 한국지능시스템학회:학술대회논문집
• /
• 한국퍼지및지능시스템학회 1998년도 The Third Asian Fuzzy Systems Symposium
• /
• pp.707-712
• /
• 1998

This paper presents several softcomputing techniques such as neural networks, fuzzy logic and genetic algorithms : Neural networks as brain metaphor provide fundamental structure, fuzzy logic gives a possibility to utilize top-down knowledge from designer, and genetic algorithms as evolution metaphor determine several system parameters with the process of bottom up development. With these techniques, we develop a pattern recognizer which consists of multiple neural networks aggregated by fuzzy integral in which genetic algorithms determine the fuzzy density values. The experimental results with the problem of recognizing totally unconstrained handwritten numeral show that the performance of the proposed method is superior to that of conventional methods.