• 제목/요약/키워드: Sequential algorithm

검색결과 804건 처리시간 0.027초

Sequential Pattern Mining for Intrusion Detection System with Feature Selection on Big Data

  • Fidalcastro, A;Baburaj, E
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제11권10호
    • /
    • pp.5023-5038
    • /
    • 2017
  • Big data is an emerging technology which deals with wide range of data sets with sizes beyond the ability to work with software tools which is commonly used for processing of data. When we consider a huge network, we have to process a large amount of network information generated, which consists of both normal and abnormal activity logs in large volume of multi-dimensional data. Intrusion Detection System (IDS) is required to monitor the network and to detect the malicious nodes and activities in the network. Massive amount of data makes it difficult to detect threats and attacks. Sequential Pattern mining may be used to identify the patterns of malicious activities which have been an emerging popular trend due to the consideration of quantities, profits and time orders of item. Here we propose a sequential pattern mining algorithm with fuzzy logic feature selection and fuzzy weighted support for huge volumes of network logs to be implemented in Apache Hadoop YARN, which solves the problem of speed and time constraints. Fuzzy logic feature selection selects important features from the feature set. Fuzzy weighted supports provide weights to the inputs and avoid multiple scans. In our simulation we use the attack log from NS-2 MANET environment and compare the proposed algorithm with the state-of-the-art sequential Pattern Mining algorithm, SPADE and Support Vector Machine with Hadoop environment.

블라인드 동채널 신호 분리를 위한 순차적인 Joint Maximum Likelihood 알고리듬 (A Sequential Joint Maximum Likelihood Algorithm for Blind Co-Channel Signal Separation)

  • Inseon Jang;Park, Seungjin
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2001년도 제14회 신호처리 합동 학술대회 논문집
    • /
    • pp.85-88
    • /
    • 2001
  • In this paper we consider a problem of blind co-channel signal separation, the goal of which is to estimate multiple co-channel digitally modulated signals using an antenna array. We employ the joint maximum likelihood estimation and present a sequential algorithm, which is referred to as sequential joint maximum likelihood (SJML) algorithm. It separates multiple co-channel signal on-line and converges fast in overdetermined noisy communication environment. And the computational complexity of SJML for M-QAM (M=8, 16, 64,...) signals is less expensive compared to the SLSP. Useful behavior of this algorithm are confirmed by simulations.

  • PDF

Short-Term Load Forecasting Based on Sequential Relevance Vector Machine

  • Jang, Youngchan
    • Industrial Engineering and Management Systems
    • /
    • 제14권3호
    • /
    • pp.318-324
    • /
    • 2015
  • This paper proposes a dynamic short-term load forecasting method that utilizes a new sequential learning algorithm based on Relevance Vector Machine (RVM). The method performs general optimization of weights and hyperparameters using the current relevance vectors and newly arriving data. By doing so, the proposed algorithm is trained with the most recent data. Consequently, it extends the RVM algorithm to real-time and nonstationary learning processes. The results of application of the proposed algorithm to prediction of electrical loads indicate that its accuracy is comparable to that of existing nonparametric learning algorithms. Further, the proposed model reduces computational complexity.

선행순서결정문제를 위한 Out-of-Kilter 해법의 적용과 부분순환로의 제거 (Elimination of Subtours Obtained by the Out-of-Kilter Algorithm for the Sequential Ordering Problem)

  • 권상호
    • 한국경영과학회지
    • /
    • 제32권3호
    • /
    • pp.47-61
    • /
    • 2007
  • This paper presents two elimination methods of subtours, which is obtained by applying the Out-of-Kilter algorithm to the sequential ordering problem (SOP) to produce a feasible solution for the SOP. Since the SOP is a kind of asymmetric traveling salesman problem (ATSP) with precedence constraints, we can apply the Out-of-Kilter algorithm to the SOP by relaxing the precedence constraints. Instead of patching subtours, both of two elimination methods construct a feasible solution of the SOP by using arcs constructing the subtours, and they improve solution by running 3-opt and 4-opt at each iteration. We also use a perturbation method. cost relaxation to explore a global solution. Six cases from two elimination methods are presented and their experimental results are compared to each other. The proposed algorithm found 32 best known solutions out of the 34 instances from the TSPLIB in a reasonable time.

데이터 마이닝에서 샘플링 기법을 이용한 연속패턴 알고리듬 (An Algorithm for Sequential Sampling Method in Data Mining)

  • 홍지명;김낙현;김성집
    • 산업경영시스템학회지
    • /
    • 제21권45호
    • /
    • pp.101-112
    • /
    • 1998
  • Data mining, which is also referred to as knowledge discovery in database, means a process of nontrivial extraction of implicit, previously unknown and potentially useful information (such as knowledge rules, constraints, regularities) from data in databases. The discovered knowledge can be applied to information management, decision making, and many other applications. In this paper, a new data mining problem, discovering sequential patterns, is proposed which is to find all sequential patterns using sampling method. Recognizing that the quantity of database is growing exponentially and transaction database is frequently updated, sampling method is a fast algorithm reducing time and cost while extracting the trend of customer behavior. This method analyzes the fraction of database but can in general lead to results of a very high degree of accuracy. The relaxation factor, as well as the sample size, can be properly adjusted so as to improve the result accuracy while minimizing the corresponding execution time. The superiority of the proposed algorithm will be shown through analyzing accuracy and efficiency by comparing with Apriori All algorithm.

  • PDF

Training HMM Structure and Parameters with Genetic Algorithm and Harmony Search Algorithm

  • Ko, Kwang-Eun;Park, Seung-Min;Park, Jun-Heong;Sim, Kwee-Bo
    • Journal of Electrical Engineering and Technology
    • /
    • 제7권1호
    • /
    • pp.109-114
    • /
    • 2012
  • In this paper, we utilize training strategy of hidden Markov model (HMM) to use in versatile issues such as classification of time-series sequential data such as electric transient disturbance problem in power system. For this, an automatic means of optimizing HMMs would be highly desirable, but it raises important issues: model interpretation and complexity control. With this in mind, we explore the possibility of using genetic algorithm (GA) and harmony search (HS) algorithm for optimizing the HMM. GA is flexible to allow incorporating other methods, such as Baum-Welch, within their cycle. Furthermore, operators that alter the structure of HMMs can be designed to simple structures. HS algorithm with parameter-setting free technique is proper for optimizing the parameters of HMM. HS algorithm is flexible so as to allow the elimination of requiring tedious parameter assigning efforts. In this paper, a sequential data analysis simulation is illustrated, and the optimized-HMMs are evaluated. The optimized HMM was capable of classifying a sequential data set for testing compared with the normal HMM.

A Study on Counter Design using Sequential Systems based on Synchronous Techniques

  • Park, Chun-Myoung
    • Journal of information and communication convergence engineering
    • /
    • 제8권4호
    • /
    • pp.421-426
    • /
    • 2010
  • This paper presents a method of design the counter using sequential system based on synchronous techniques. For the design the counter, first of all, we derive switching algebras and their operations. Also, we obtain the next-state functions, flip-flop excitations and their input functions from the flip-flop. Then, we propose the algorithm which is a method of implementation of the synchronous sequential digital logic circuits. Finally, we apply proposed the sequential logic based on synchronous techniques to counter.

VLSI 설계자동화 시스템을 위한 순서회로의 최적상태코드 할당 알고리듬 (An Optimal State-Code Assignment Algorithm of Sequential Circuits for VLSI Design Automation Systems)

  • 임재윤;임인칠
    • 대한전자공학회논문지
    • /
    • 제26권1호
    • /
    • pp.104-112
    • /
    • 1989
  • 순서회로를 PLA로 실현하기 위한 설계자동화 방법에 대해 논했으며, PLA로 회로 실현시 면적최소화를 위한 최적 상태코드할당 알고리듬을 제안하였다. 회로기술이 용이하고 합성력이 강한 하드웨어 기술언어인 DASL9design automation support language)을 이용하여 회로를 기술한 후 이를 컴파일하여 그 결과를 PLA롸 자동설계하는 시스템을 제안한다. 순서회로의 각 상태에 대한 코드할당시 출력 및 다음상태를 동시에 고려하여 코드할당을 수행함으로서 종래의 할당법에 비해 평균 10%의 PLA 면적을 감ㅂ소 시킬 수 있었다. 본 시스템은 마이크로 인스트럭션, FSM, VLSI의 제어부설계등에 확장 적용할 수 있게 구성하였다.

  • PDF

P2P Ranging-Based Cooperative Localization Method for a Cluster of Mobile Nodes Containing IR-UWB PHY

  • Cho, Seong Yun;Kim, Joo Young;Enkhtur, Munkhzul
    • ETRI Journal
    • /
    • 제35권6호
    • /
    • pp.1084-1093
    • /
    • 2013
  • problem of pedestrian localization using mobile nodes containing impulse radio ultra wideband (IR-UWB) is considered. IEEE 802.15.4a-based IR-UWB can achieve accurate ranging. However, the coverage is as short as 30 m, owing to the restricted transmit power. This factor may cause a poor geometric relationship among the mobile nodes and anchor nodes in certain environments. To localize a group of pedestrians accurately, an enhanced cooperative localization method is proposed. We describe a sequential algorithm and define problems that may occur in the implementation of the algorithm. To solve these problems, a batch algorithm is proposed. The batch algorithm can be carried out after performing the sequential algorithm to linearize the nonlinear range equation. When a sequential algorithm cannot be performed due to a poor geometric relationship among nodes, a batch algorithm can be carried out directly. Herein, Monte Carlo simulations are presented to illustrate the proposed method and verify its performance.

병렬처리를 이용한 대규모 동적 시스템의 최적제어 (Optimal Control of Large-Scale Dynamic Systems using Parallel Processing)

  • 박기홍
    • 제어로봇시스템학회논문지
    • /
    • 제5권4호
    • /
    • pp.403-410
    • /
    • 1999
  • In this study, a parallel algorithm has been developed that can quickly solve the optiaml control problem of large-scale dynamic systems. The algorithm adopts the sequential quadratic programming methods and achieves domain decomposition-type parallelism in computing sensitivities for search direction computation. A silicon wafer thermal process problem has been solved using the algorithm, and a parallel efficiency of 45% has been achieved with 16 processors. Practical methods have also been investigated in this study as a way to further speed up the computation time.

  • PDF