• Title/Summary/Keyword: sequence-to-sequence learning

Search Result 426, Processing Time 0.031 seconds

An Improved Reinforcement Learning Technique for Mission Completion (임무수행을 위한 개선된 강화학습 방법)

  • 권우영;이상훈;서일홍
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.52 no.9
    • /
    • pp.533-539
    • /
    • 2003
  • Reinforcement learning (RL) has been widely used as a learning mechanism of an artificial life system. However, RL usually suffers from slow convergence to the optimum state-action sequence or a sequence of stimulus-response (SR) behaviors, and may not correctly work in non-Markov processes. In this paper, first, to cope with slow-convergence problem, if some state-action pairs are considered as disturbance for optimum sequence, then they no to be eliminated in long-term memory (LTM), where such disturbances are found by a shortest path-finding algorithm. This process is shown to let the system get an enhanced learning speed. Second, to partly solve a non-Markov problem, if a stimulus is frequently met in a searching-process, then the stimulus will be classified as a sequential percept for a non-Markov hidden state. And thus, a correct behavior for a non-Markov hidden state can be learned as in a Markov environment. To show the validity of our proposed learning technologies, several simulation result j will be illustrated.

Predictive Convolutional Networks for Learning Stream Data (스트림 데이터 학습을 위한 예측적 컨볼루션 신경망)

  • Heo, Min-Oh;Zhang, Byoung-Tak
    • KIISE Transactions on Computing Practices
    • /
    • v.22 no.11
    • /
    • pp.614-618
    • /
    • 2016
  • As information on the internet and the data from smart devices are growing, the amount of stream data is also increasing in the real world. The stream data, which is a potentially large data, requires online learnable models and algorithms. In this paper, we propose a novel class of models: predictive convolutional neural networks to be able to perform online learning. These models are designed to deal with longer patterns as the layers become higher due to layering convolutional operations: detection and max-pooling on the time axis. As a preliminary check of the concept, we chose two-month gathered GPS data sequence as an observation sequence. On learning them with the proposed method, we compared the original sequence and the regenerated sequence from the abstract information of the models. The result shows that the models can encode long-range patterns, and can generate a raw observation sequence within a low error.

Sequence-to-Sequence based Mobile Trajectory Prediction Model in Wireless Network (무선 네트워크에서 시퀀스-투-시퀀스 기반 모바일 궤적 예측 모델)

  • Bang, Sammy Yap Xiang;Yang, Huigyu;Raza, Syed M.;Choo, Hyunseung
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2022.05a
    • /
    • pp.517-519
    • /
    • 2022
  • In 5G network environment, proactive mobility management is essential as 5G mobile networks provide new services with ultra-low latency through dense deployment of small cells. The importance of a system that actively controls device handover is emerging and it is essential to predict mobile trajectory during handover. Sequence-to-sequence model is a kind of deep learning model where it converts sequences from one domain to sequences in another domain, and mainly used in natural language processing. In this paper, we developed a system for predicting mobile trajectory in a wireless network environment using sequence-to-sequence model. Handover speed can be increased by utilize our sequence-to-sequence model in actual mobile network environment.

Two-Agent Scheduling with Sequence-Dependent Exponential Learning Effects Consideration (처리순서기반 지수함수 학습효과를 고려한 2-에이전트 스케줄링)

  • Choi, Jin Young
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.36 no.4
    • /
    • pp.130-137
    • /
    • 2013
  • In this paper, we consider a two-agent scheduling with sequence-dependent exponential learning effects consideration, where two agents A and B have to share a single machine for processing their jobs. The objective function for agent A is to minimize the total completion time of jobs for agent A subject to a given upper bound on the objective function of agent B, representing the makespan of jobs for agent B. By assuming that the learning ratios for all jobs are the same, we suggest an enumeration-based backward allocation scheduling for finding an optimal solution and exemplify it by using a small numerical example. This problem has various applications in production systems as well as in operations management.

A Study on the Wiring Control Method of Hand & Auto Operation of an Easy Elevator (간이 승강기 수·자동 배선제어방식에 관한 연구)

  • 위성동;구할본
    • Journal of the Korean Institute of Electrical and Electronic Material Engineers
    • /
    • v.16 no.4
    • /
    • pp.351-357
    • /
    • 2003
  • An easy learning elevator originated is opened to compare the existed teaming equipment, and it had a high studied efficiency that the sequence control circuit can open and close with the wire. The structure of equipment to be controlled from the first floor to the fifth floors is demostrated by the constructive apparatus with the lamps to express the function of the open-close of the door according to the cage moving with a mechanical actuation of the forward reverse breaker and the motor of load, and the mechanical actuation of hand-operation control components of push-button S/W and L/S and relay etc. These components let connect each other in order to control of the elevator function with the auto program and the designed sequence control circuit. Consequently the cage could go and come till 1∼5 steps with an auto program of the elevator and the sequence control circuit. The sequence control circuit is controlled by the step of forward and reverse to follow as that the sensor function of L/S1 ∼ L/S5 let posit with the control switchs of S/W1 ∼ S/W5 of PLC testing panel and switchs of S/W1 ∼ S/W5 installed on the transparent acryl plate of the frame. In here, improved apparatus is the hand-auto operation combined learning equipment to study the principle and technique of the originate sequence control circuit and the auto program of PLC.

Improving Malicious Web Code Classification with Sequence by Machine Learning

  • Paik, Incheon
    • IEIE Transactions on Smart Processing and Computing
    • /
    • v.3 no.5
    • /
    • pp.319-324
    • /
    • 2014
  • Web applications make life more convenient. Many web applications have several kinds of user input (e.g. personal information, a user's comment of commercial goods, etc.) for the activities. On the other hand, there are a range of vulnerabilities in the input functions of Web applications. Malicious actions can be attempted using the free accessibility of many web applications. Attacks by the exploitation of these input vulnerabilities can be achieved by injecting malicious web code; it enables one to perform a variety of illegal actions, such as SQL Injection Attacks (SQLIAs) and Cross Site Scripting (XSS). These actions come down to theft, replacing personal information, or phishing. The existing solutions use a parser for the code, are limited to fixed and very small patterns, and are difficult to adapt to variations. A machine learning method can give leverage to cover a far broader range of malicious web code and is easy to adapt to variations and changes. Therefore, this paper suggests the adaptable classification of malicious web code by machine learning approaches for detecting the exploitation user inputs. The approach usually identifies the "looks-like malicious" code for real malicious code. More detailed classification using sequence information is also introduced. The precision for the "looks-like malicious code" is 99% and for the precise classification with sequence is 90%.

A Study on the wiring Control Method of Hand & Auto Operation of an easy Elevator (간이 승강기 수.자동 배선제어방식에 관한 연구)

  • Wee, Sung-Dong;Gu, Hal-Bon
    • Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
    • /
    • 2002.11a
    • /
    • pp.596-602
    • /
    • 2002
  • An easy elevator for learning originated is opened to compare the existed learning equipment, and it had a high studying efficient that the sequence control circuit can opens and closes with the wire. The structure of equipment to be controlled from the first floor to the fifth floors is demonstrated a constructive apparatus by a lamp atc to express the function of the open-close of the door according to the cage moving with a mechanical actuation of the forward-reverse breaker and the motor of load and a mechanical actuation of hand-operation control components of push-button S/W and L/S and relay etc. These components let connects each other in order to control of the elevator function with the auto program and the designed sequence control circuit. Consequent1y the process of these functions of 1~5steps could operates the cage with an auto program of the elevator and the sequence control circuit. The sequence control circuit is controlled by the step of forward and reverse to follow as that the sensor function of the L/S1~L/S5 let posit with the control switchs of S/W1~S/W5 of PLC testing panel and switchs of S/W1~S/W5 installed on the transparent acryl plate of the frame. In here, improved apparatus is a hand-auto operation combined learning equipment to study the principle and a technique of the originated sequence control circuit and the auto program of PLC.

  • PDF

A Study of the Sequence of Figure Transformation Learning (도형의 변환학습의 순차성 고찰)

  • Park Sung Teak
    • The Mathematical Education
    • /
    • v.17 no.2
    • /
    • pp.1-13
    • /
    • 1979
  • This study aimed at studying the sequence of the Figure Transformation Learning, inquiring relationship among these transformations and then researching whether there is the difference of the learning ability or not between by teaching them as it is independent and by teaching them as it is contains. (Hypothesis 1) It may be more effective to teach The Sequence of Transformation Learning by beginning with peculiar field, ending with general field than vice versa At the result of verification-C $R_{M}$=2.59, 0.005$R_{M}$=5.19, p<0.005-significant difference appeared. It is proved more effective to teach the Figure Transformation Learning the way it contains than the way it is independent. Synthesizing two hypothesises of the above, the conclusion is following The Figure Transformation Learning should be taught by beginning with peculiar field. ending with general field (congruent transformationlongrightarrowsimilar transformationlongrightarrowprojective transformationlongrightarrowtopological transformation). To teach it the way it contains is more effective.ive.

  • PDF

A Study on the Control Method of Hand & Automatic Operation of On-Off Wiring of an Easy Elevator (간이 엘리베이터 수.자동 개폐배선 제어방식에 관한연구)

  • Wee, Sung-Dong;Gu, Hal-Bon;Kim, Tae-Sung
    • Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
    • /
    • 2002.07b
    • /
    • pp.1107-1112
    • /
    • 2002
  • An easy elevator originated is an opened system to compare an existing equipment, and learning efficient is high as a wiring that the sequence control circuit is on and off. The structure of an equipment to be controled from the first floor to the fifth floor is constructed by a lamp to express the function of the open-close of the door according to the cage moving, to express the mechanical actuation of the forward-reverse break and motor of load and of hand-worked control component of Push-Button S/W, L/S and Relay. In order to act of the elevator function that these components connected, designed the auto program and the sequence control circuit. Consequently the process that these(1~5steps) operated the cage with an auto program of the elevator and the sequence control circuit is controled by the step of forward and reverse that the L/S1~L/S5 of sensor adjust function let posit, by the adjustable S/W1~S/W5 of PLC testing panel and the S/W1~S/W5 which installed on the transparent acryl plate of a frame. In here, improved apparatus is the learning equipment of combined use to study the principle and the technique of the originated sequence control circuit and the auto program of PLC.

  • PDF

INSTABILITY OF THE BETTI SEQUENCE FOR PERSISTENT HOMOLOGY AND A STABILIZED VERSION OF THE BETTI SEQUENCE

  • JOHNSON, MEGAN;JUNG, JAE-HUN
    • Journal of the Korean Society for Industrial and Applied Mathematics
    • /
    • v.25 no.4
    • /
    • pp.296-311
    • /
    • 2021
  • Topological Data Analysis (TDA), a relatively new field of data analysis, has proved very useful in a variety of applications. The main persistence tool from TDA is persistent homology in which data structure is examined at many scales. Representations of persistent homology include persistence barcodes and persistence diagrams, both of which are not straightforward to reconcile with traditional machine learning algorithms as they are sets of intervals or multisets. The problem of faithfully representing barcodes and persistent diagrams has been pursued along two main avenues: kernel methods and vectorizations. One vectorization is the Betti sequence, or Betti curve, derived from the persistence barcode. While the Betti sequence has been used in classification problems in various applications, to our knowledge, the stability of the sequence has never before been discussed. In this paper we show that the Betti sequence is unstable under the 1-Wasserstein metric with regards to small perturbations in the barcode from which it is calculated. In addition, we propose a novel stabilized version of the Betti sequence based on the Gaussian smoothing seen in the Stable Persistence Bag of Words for persistent homology. We then introduce the normalized cumulative Betti sequence and provide numerical examples that support the main statement of the paper.