• 제목/요약/키워드: transformer network

검색결과 275건 처리시간 0.032초

Neural Network Based Dissolved Gas Analysis Using Gas Composition Patterns Against Fault Causes

  • J. H. Sun;Kim, K. H.;P. B. Ha
    • KIEE International Transactions on Electrophysics and Applications
    • /
    • 제3C권4호
    • /
    • pp.130-135
    • /
    • 2003
  • This study describes neural network based dissolved gas analysis using composition patterns of gas concentrations for transformer fault diagnosis. DGA samples were gathered from related literatures and classified into six types of faults and then a neural network was trained using the DGA samples. Diagnosis tests were performed by the trained neural network with DGA samples of serviced transformers, fault causes of which were identified by actual inspection. Diagnosis results by the neural network were in good agreement with actual faults.

Vision Transformer를 활용한 비디오 분류 성능 향상을 위한 Fine-tuning 신경망 (Fine-tuning Neural Network for Improving Video Classification Performance Using Vision Transformer)

  • 이광엽;이지원;박태룡
    • 전기전자학회논문지
    • /
    • 제27권3호
    • /
    • pp.313-318
    • /
    • 2023
  • 본 논문은 Vision Transformer를 기반으로 하는 Video Classification의 성능을 개선하는 방법으로 fine-tuning를 적용한 신경망을 제안한다. 최근 딥러닝 기반 실시간 비디오 영상 분석의 필요성이 대두되고 있다. Image Classification에 사용되는 기존 CNN 모델의 특징상 연속된 Frame에 대한 연관성을 분석하기 어렵다는 단점이 있다. 이와 같은 문제를 Attention 메커니즘이 적용된 Vistion Transformer와 Non-local 신경망 모델을 비교 분석하여 최적의 모델을 찾아 해결하고자 한다. 또한, 전이 학습 방법으로 fine-tuning의 다양한 방법을 적용하여 최적의 fine-tuning 신경망 모델을 제안한다. 실험은 UCF101 데이터셋으로 모델을 학습시킨 후, UTA-RLDD 데이터셋에 전이 학습 방법을 적용하여 모델의 성능을 검증하였다.

Hyperparameter experiments on end-to-end automatic speech recognition

  • Yang, Hyungwon;Nam, Hosung
    • 말소리와 음성과학
    • /
    • 제13권1호
    • /
    • pp.45-51
    • /
    • 2021
  • End-to-end (E2E) automatic speech recognition (ASR) has achieved promising performance gains with the introduced self-attention network, Transformer. However, due to training time and the number of hyperparameters, finding the optimal hyperparameter set is computationally expensive. This paper investigates the impact of hyperparameters in the Transformer network to answer two questions: which hyperparameter plays a critical role in the task performance and training speed. The Transformer network for training has two encoder and decoder networks combined with Connectionist Temporal Classification (CTC). We have trained the model with Wall Street Journal (WSJ) SI-284 and tested on devl93 and eval92. Seventeen hyperparameters were selected from the ESPnet training configuration, and varying ranges of values were used for experiments. The result shows that "num blocks" and "linear units" hyperparameters in the encoder and decoder networks reduce Word Error Rate (WER) significantly. However, performance gain is more prominent when they are altered in the encoder network. Training duration also linearly increased as "num blocks" and "linear units" hyperparameters' values grow. Based on the experimental results, we collected the optimal values from each hyperparameter and reduced the WER up to 2.9/1.9 from dev93 and eval93 respectively.

상태감시용 센서를 내장한 배전용 변압기 및 데이터 처리장치 개발 (Development of Distribution Transformer with Condition Monitoring Sensors and Data Processing Unit)

  • 정준홍;유남철
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2009년도 제40회 하계학술대회
    • /
    • pp.201_202
    • /
    • 2009
  • This paper presents a design methodology of a distribution transformer with condition monitoring sensors and its data processing unit. The proposed distribution transformer includes various type of condition monitoring sensors such as load current/voltage, temperature and heat aging of insulating oil. The data processing unit is installed at the distribution transformer site. It integrates sensed data and transmits these to a central server system. The proposed distribution transformer and its data processing unit will help an on-line condition monitoring system for distribution transformers.

  • PDF

Internal Fault Classification in Transformer Windings using Combination of Discrete Wavelet-Transforms and Back-propagation Neural Networks

  • Ngaopitakkul Atthapol;Kunakorn Anantawat
    • International Journal of Control, Automation, and Systems
    • /
    • 제4권3호
    • /
    • pp.365-371
    • /
    • 2006
  • This paper presents an algorithm based on a combination of Discrete Wavelet Transforms and neural networks for detection and classification of internal faults in a two-winding three-phase transformer. Fault conditions of the transformer are simulated using ATP/EMTP in order to obtain current signals. The training process for the neural network and fault diagnosis decision are implemented using toolboxes on MATLAB/Simulink. Various cases and fault types based on Thailand electricity transmission and distribution systems are studied to verify the validity of the algorithm. It is found that the proposed method gives a satisfactory accuracy, and will be particularly useful in a development of a modern differential relay for a transformer protection scheme.

A Low-Loss On-Chip Transformer Using an Auxiliary Primary Part (APP) for CMOS Power Amplifier Applications

  • Im, Haemin;Park, Changkun
    • 전기전자학회논문지
    • /
    • 제23권2호
    • /
    • pp.403-406
    • /
    • 2019
  • We propose a low-loss on-chip transformer using an auxiliary primary part (APP) for an output matching network for fully integrated CMOS power amplifiers. The APP is designed using a fifth metal layer while the primary and secondary parts are designed using a sixth metal layer with a width smaller than that of the primary and secondary parts of the transformer to minimize the substrate loss and the parasitic capacitance between the primary and secondary parts. By adapting the APP in the on-chip transformer, we obtain an improved maximum available gain value without the need for any additional chip area. The feasibility of the proposed APP structure is successfully verified.

벡터 회로망 분석기 측정을 기반으로 한 3상 변압기의 시간영역 펄스 신호에 대한 응답 분석 (The Response to Impulse Signal on Three Phase Transformer using Vector Network Analyzer)

  • 김광호;정종만;나완수
    • KEPCO Journal on Electric Power and Energy
    • /
    • 제1권1호
    • /
    • pp.79-84
    • /
    • 2015
  • Transformer is widely used element on power system and industrial area. Especially the transformers installed at power system are exposed to an environment of arbitrary changed. Thus the prediction of degradation and the analysis of response to impulse are important. To conduct those works, the electrical characteristics of system should be analyzed, effectively. But the analysis of electrical characteristic in electric machine level such as pole and pad-mounted transformer is almost no, thus commercial VNA (Vector Network Analyzer) is used to getting the response in wide frequency range. However, the output power of VNA is usually under 10mW, so verification for effectiveness of measuring electrically large component should be conducted, firstly. Next, after getting total S-parameter of transformer, predicting impulse response can be performed in time-domain with circuit simulator. In this paper, it is introduced that verification effectiveness of VNA using transfer function from SFRA (Sweep Frequency Response Analyzer), firstly. Next, total S-parameter, six by six matix form, was built using measured 2 port S-parameter from vector network analyzer. To get the response to impulse which is defined by IEC 60060-1, time-domain simulation is conducted to ADS (Advenced Design System) circuit simulator.

HVAC 시스템의 이상 탐지를 위한 Transformer 기반 딥러닝 기법 (Transformer Based Deep Learning Techniques for HVAC System Anomaly Detection)

  • 박창준;박준휘;김남중;이재현;곽정환
    • 한국컴퓨터정보학회:학술대회논문집
    • /
    • 한국컴퓨터정보학회 2024년도 제69차 동계학술대회논문집 32권1호
    • /
    • pp.47-48
    • /
    • 2024
  • Heating, Ventilating, and Air Conditioning(HVAC) 시스템은 난방(Heating), 환기(Ventilating), 공기조화(Air Conditioning)를 제공하는 공조시스템으로, 실내 환경의 온도, 습도 조절 및 지속적인 순환 및 여과를 통해 실내 공기 질을 개선한다. 이러한 HVAC 시스템에 이상이 생기는 경우 공기 여과율이 낮아지며, COVID-19와 같은 법정 감염병 예방에 취약해진다. 또한 장비의 과부하를 유발하여, 시스템의 효율성 저하 및 에너지 낭비를 불러올 수 있다. 따라서 본 논문에서는 HVAC 시스템의 이상 탐지 및 조기 조치를 위한 Transformer 기반 이상 탐지 기법의 적용을 제안한다. Transformer는 기존 시계열 데이터 처리를 위한 기법인 Recurrent Neural Network(RNN)기반 모델의 구조적 한계점을 극복함에 따라 Long Term Dependency 문제를 해결하고, 병렬처리를 통해 효율적인 Feature 추출이 가능하다. Transformer 모델이 HVAC 시스템의 이상 탐지에서 RNN 기반의 비교군 모델보다 약 1.31%의 향상을 보이며, Transformer 모델을 통한 HVAC의 이상 탐지에 효율적임을 확인하였다.

  • PDF

배전용 변압기의 무선 부하감시 시스템 개발 (Development of Wireless Monitoring System for Distribution Transformer)

  • 정준홍;강태구;김일경
    • 대한전기학회:학술대회논문집
    • /
    • 대한전기학회 2008년도 제39회 하계학술대회
    • /
    • pp.414-415
    • /
    • 2008
  • In this paper, we consider the development methodology of wireless monitoring system for a distribution transformer. The master/ slave devices are installed in the power distribution feeder and measure the current state of pole or ground transformers. After measuring, the devices send the measurement data to operating room through the wireless network such as RF and CDMA so that the power distribution supervisor can prevent a distribution transformer damaging caused by overloads and imbalance of loads.

  • PDF

Dissolved Gas Analysis of Power Transformer Using Fuzzy Clustering and Radial Basis Function Neural Network

  • Lee, J.P.;Lee, D.J.;Kim, S.S.;Ji, P.S.;Lim, J.Y.
    • Journal of Electrical Engineering and Technology
    • /
    • 제2권2호
    • /
    • pp.157-164
    • /
    • 2007
  • Diagnosis techniques based on the dissolved gas analysis(DGA) have been developed to detect incipient faults in power transformers. Various methods exist based on DGA such as IEC, Roger, Dornenburg, and etc. However, these methods have been applied to different problems with different standards. Furthermore, it is difficult to achieve an accurate diagnosis by DGA without experienced experts. In order to resolve these drawbacks, this paper proposes a novel diagnosis method using fuzzy clustering and a radial basis neural network(RBFNN). In the neural network, fuzzy clustering is effective for selecting the efficient training data and reducing learning process time. After fuzzy clustering, the RBF neural network is developed to analyze and diagnose the state of the transformer. The proposed method measures the possibility and degree of aging as well as the faults occurred in the transformer. To demonstrate the validity of the proposed method, various experiments are performed and their results are presented.