• Title/Summary/Keyword: transformer network

Search Result 275, Processing Time 0.023 seconds

Cross-Domain Recommendation based on K-Means Clustering and Transformer (K-means 클러스터링과 트랜스포머 기반의 교차 도메인 추천)

  • Tae-Hoon Kim;Young-Gon Kim;Jeong-Min Park
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.23 no.5
    • /
    • pp.1-8
    • /
    • 2023
  • Cross-domain recommendation is a method that shares related user information data and item data in different domains. It is mainly used in online shopping malls with many users or multimedia service contents, such as YouTube or Netflix. Through K-means clustering, embeddings are created by performing clustering based on user data and ratings. After learning the result through a transformer network, user satisfaction is predicted. Then, items suitable for the user are recommended using a transformer-based recommendation model. Through this study, it was shown through experiments that recommendations can predict cold-start problems at a lesser time cost and increase user satisfaction.

Lightening of Human Pose Estimation Algorithm Using MobileViT and Transfer Learning

  • Kunwoo Kim;Jonghyun Hong;Jonghyuk Park
    • Journal of the Korea Society of Computer and Information
    • /
    • v.28 no.9
    • /
    • pp.17-25
    • /
    • 2023
  • In this paper, we propose a model that can perform human pose estimation through a MobileViT-based model with fewer parameters and faster estimation. The based model demonstrates lightweight performance through a structure that combines features of convolutional neural networks with features of Vision Transformer. Transformer, which is a major mechanism in this study, has become more influential as its based models perform better than convolutional neural network-based models in the field of computer vision. Similarly, in the field of human pose estimation, Vision Transformer-based ViTPose maintains the best performance in all human pose estimation benchmarks such as COCO, OCHuman, and MPII. However, because Vision Transformer has a heavy model structure with a large number of parameters and requires a relatively large amount of computation, it costs users a lot to train the model. Accordingly, the based model overcame the insufficient Inductive Bias calculation problem, which requires a large amount of computation by Vision Transformer, with Local Representation through a convolutional neural network structure. Finally, the proposed model obtained a mean average precision of 0.694 on the MS COCO benchmark with 3.28 GFLOPs and 9.72 million parameters, which are 1/5 and 1/9 the number compared to ViTPose, respectively.

Intrusion Detection System based on Packet Payload Analysis using Transformer

  • Woo-Seung Park;Gun-Nam Kim;Soo-Jin Lee
    • Journal of the Korea Society of Computer and Information
    • /
    • v.28 no.11
    • /
    • pp.81-87
    • /
    • 2023
  • Intrusion detection systems that learn metadata of network packets have been proposed recently. However these approaches require time to analyze packets to generate metadata for model learning, and time to pre-process metadata before learning. In addition, models that have learned specific metadata cannot detect intrusion by using original packets flowing into the network as they are. To address the problem, this paper propose a natural language processing-based intrusion detection system that detects intrusions by learning the packet payload as a single sentence without an additional conversion process. To verify the performance of our approach, we utilized the UNSW-NB15 and Transformer models. First, the PCAP files of the dataset were labeled, and then two Transformer (BERT, DistilBERT) models were trained directly in the form of sentences to analyze the detection performance. The experimental results showed that the binary classification accuracy was 99.03% and 99.05%, respectively, which is similar or superior to the detection performance of the techniques proposed in previous studies. Multi-class classification showed better performance with 86.63% and 86.36%, respectively.

Development of Wireless Diagnostic System for Substation Equipments Using SMS Mode of Mobile Communication Network (이동통신망의 SMS방식을 이용한 변전기기 무선진단 시스템 개발)

  • Kim, Jin-Cheol;Kim, Ji-Ho;Yun, Man-Sik;Song, Ho-Jun;Lee, Hyang-Beom
    • Proceedings of the KIEE Conference
    • /
    • 2003.07a
    • /
    • pp.259-261
    • /
    • 2003
  • This paper suggests wireless diagnosis and monitoring system using SMS mode of mobile communication network for distribution transformer which could prevent electrical accident in the near future. Data are acquired by measuring the temperature of insulator oil in the distribution transformer and load current. Data acquisition of sensor using mobile communication network carried out filtering of sensor's output to optimize the size of send data Merit of this inspection method is that management, control and monitoring some transformers can be carried out using only one server. This inspection method will be the way of inspection to be worth spotlight in the near future because it is able to solve easily with the minimum facility inspection about state of transformer which is operating, to wide coverage about machine's wrong operation in other field.

  • PDF

A New method for the Calculation of Leakage Reactance in Power Transformers

  • Dawood, Kamran;Alboyaci, Bora;Cinar, Mehmet Aytac;Sonmez, Olus
    • Journal of Electrical Engineering and Technology
    • /
    • v.12 no.5
    • /
    • pp.1883-1890
    • /
    • 2017
  • Transformers are one of the most precious elements of the electric power system. Stability and reliability of the electric power network mainly depend on the working of the transformer. Leakage reactance of the transformer is one of the important factors and accurate calculation of the leakage reactance is necessary for the transformer designers and electric distributors. Leakage reactance of the transformer depends on the geometry of the transformer. There are many different methods for the calculations of the leakage reactance however mostly are usable when the axial heights of the high voltage and low voltage windings are equal. When the axial heights of high voltage and low voltage windings are asymmetric most of the analytical methods are not reliable. In this study, a new analytical method is introduced for the calculation of the leakage reactance. Fourteen different transformers are investigated in this study and four of them are presented in this paper. The results of the new analytical method are compared with the experimental results. Other analytical and numerical methods are also compared with this new method. Results show that this method is more reliable and accurate as compared to the other analytical methods. The maximum relative error between short-circuit test and proposed method for these fourteen transformers was less than 2.8%.

An Analysis on Surge Voltage Transfer Phenomena of Transformers by Minor Network (Minor netowrk에 의한 변압기의 충격전압파의 이행현상해석)

  • 이승원
    • 전기의세계
    • /
    • v.20 no.6
    • /
    • pp.7-18
    • /
    • 1971
  • Secondary-side transfer phenomena of primary-side surge voltage in concentric-cylindrical transformers of a high turn-ratio still present a problem in transformer insulation design even in the case of a neutral solid-grounding type. The conventional methods of analyzing them so far are much complicated for practical applications. Therefore, this paper describes a new approach to the analysis of secondary-side transfer phenomena of surge in concentric-cylindrical transformers of high turn-ratio and solid-grounding type. This generalized approach is thought to be more simple with the use of minor network concepts than the conventional one by major network only. The result shows that the secondary-side transfer phenomena of surge voltage could not be neglected even in concentric-cylindrical transformer of high turn-ratio and solid-grounding type, and will be satisfactorily applicable to the design of neutral-solid-grounding type transformers.

  • PDF

On-Line Estimation of Partial Discharge Location in Power Transformer

  • Yoon, Yong-Han;Kim, Jae-Chul;Chung, Chan-Soo;Kwak, Hee-Ro;Kweon, Dong-Jin
    • Journal of Electrical Engineering and information Science
    • /
    • v.1 no.2
    • /
    • pp.45-51
    • /
    • 1996
  • This paper presents a neural network approach for on-line estimation of partial discharge(PD) location using advanced correlation technique in power transformer. Ultrasonic sensors detect ultrasonic signals generated by a PD and the proposed method calculates time difference between the ultrasonic signals at each sensor pair using the cross-correlation technique applied by moving average and the Hamming window. The neural network takes distance difference as inputs converted from time difference, and estimates the PD location. Case studies showed that the proposed method using advanced correlation technique and a neural network estimated the PD location better than conventional methods.

  • PDF

Investigation and Mitigation of Overvoltage Due to Ferroresonance in the Distribution Network

  • Sakarung, Preecha;Bunyagul, Teratam;Chatratana, Somchai
    • Journal of Electrical Engineering and Technology
    • /
    • v.2 no.3
    • /
    • pp.300-305
    • /
    • 2007
  • This paper reports an investigation of overvoltages caused by ferroresonance in the distribution system, which consists of a bank of open-delta single-phase voltage transformers. The high voltage sides of the voltage transformer are connected to the distribution system via three single-phase fuse cutouts. Due to the saturation characteristic of the transformer cores, ferroresonance can occur in the condition that the transformer is energized or deenergized with single-phase switching operation of the fuse cutouts. The simulation tool based on EMTP is used to investigate the overvoltages at the high side of voltage transformer. Bifurcation diagrams are used to present the ferroresonance behavior in ranges of different operating conditions. The simulation results are in good agreement with the results from the experiment of 22 kV voltage transformers. The mitigation technique with additional damping resistors in the secondary windings of the voltage transformers will be introduced. Brief discussion will be made on the physical phenomena related to the overvoltage and the damage of voltage transformer.

Korean Sentiment Model Interpretation using LIME Algorithm (LIME 알고리즘을 이용한 한국어 감성 분류 모델 해석)

  • Nam, Chung-Hyeon;Jang, Kyung-Sik
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.25 no.12
    • /
    • pp.1784-1789
    • /
    • 2021
  • Korean sentiment classification task is used in real-world services such as chatbots and analysis of user's purchase reviews. And due to the development of deep learning technology, neural network models with high performance are being applied. However, the neural network model is not easy to interpret what the input sentences are predicting due to which words, and recently, model interpretation methods for interpreting these neural network models have been popularly proposed. In this paper, we used the LIME algorithm among the model interpretation methods to interpret which of the words in the input sentences of the models learned with the korean sentiment classification dataset. As a result, the interpretation of the Bi-LSTM model with 85.24% performance included 25,283 words, but 84.20% of the transformer model with relatively low performance showed that the transformer model was more reliable than the Bi-LSTM model because it contains 26,447 words.

Design of Isolation-Type Matching Network for Underwater Acoustic Piezoelectric Transducer Using Chebyshev Filter Function (체비셰프 필터함수를 이용한 수중 음향 압전 트랜스듀서의 절연형 정합회로 설계)

  • Lee, Jeong-Min;Lee, Byung-Hwa;Baek, Kwang-Ryul
    • The Journal of the Acoustical Society of Korea
    • /
    • v.28 no.6
    • /
    • pp.491-498
    • /
    • 2009
  • This paper presents the design method of an impedance matching network using an isolation transformer and the Chebyshev filter function for the high efficiency and the flat power driving of an underwater acoustic piezoelectric transducer. The proposed impedance matching network is designed for minimizing the reactance component of transducer and having the flat power response in the wide frequency range. We design a low pass filter with ladder-type circuit using the Chebyshev function as standard prototype filter function. In addition, we design the impedance matching network which is suitable for the equivalent circuit of transducer and the turn ratio of transformer through the bandpass frequency transformation. The proposed method is applied to the simulated dummy load of the tonpilz-type transducer operating in the middle frequency range. The simulation results are compared with the measured characteristics and the validity of the proposed method is verified.