• Title/Summary/Keyword: improved detection algorithm

Search Result 622, Processing Time 0.024 seconds

A Novel Network Anomaly Detection Method based on Data Balancing and Recursive Feature Addition

  • Liu, Xinqian;Ren, Jiadong;He, Haitao;Wang, Qian;Sun, Shengting
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.7
    • /
    • pp.3093-3115
    • /
    • 2020
  • Network anomaly detection system plays an essential role in detecting network anomaly and ensuring network security. Anomaly detection system based machine learning has become an increasingly popular solution. However, due to the unbalance and high-dimension characteristics of network traffic, the existing methods unable to achieve the excellent performance of high accuracy and low false alarm rate. To address this problem, a new network anomaly detection method based on data balancing and recursive feature addition is proposed. Firstly, data balancing algorithm based on improved KNN outlier detection is designed to select part respective data on each category. Combination optimization about parameters of improved KNN outlier detection is implemented by genetic algorithm. Next, recursive feature addition algorithm based on correlation analysis is proposed to select effective features, in which a cross contingency test is utilized to analyze correlation and obtain a features subset with a strong correlation. Then, random forests model is as the classification model to detection anomaly. Finally, the proposed algorithm is evaluated on benchmark datasets KDD Cup 1999 and UNSW_NB15. The result illustrates the proposed strategies enhance accuracy and recall, and decrease the false alarm rate. Compared with other algorithms, this algorithm still achieves significant effects, especially recall in the small category.

A Defect Detection Algorithm of Denim Fabric Based on Cascading Feature Extraction Architecture

  • Shuangbao, Ma;Renchao, Zhang;Yujie, Dong;Yuhui, Feng;Guoqin, Zhang
    • Journal of Information Processing Systems
    • /
    • v.19 no.1
    • /
    • pp.109-117
    • /
    • 2023
  • Defect detection is one of the key factors in fabric quality control. To improve the speed and accuracy of denim fabric defect detection, this paper proposes a defect detection algorithm based on cascading feature extraction architecture. Firstly, this paper extracts these weight parameters of the pre-trained VGG16 model on the large dataset ImageNet and uses its portability to train the defect detection classifier and the defect recognition classifier respectively. Secondly, retraining and adjusting partial weight parameters of the convolution layer were retrained and adjusted from of these two training models on the high-definition fabric defect dataset. The last step is merging these two models to get the defect detection algorithm based on cascading architecture. Then there are two comparative experiments between this improved defect detection algorithm and other feature extraction methods, such as VGG16, ResNet-50, and Xception. The results of experiments show that the defect detection accuracy of this defect detection algorithm can reach 94.3% and the speed is also increased by 1-3 percentage points.

A vehicle detection and tracking algorithm for supervision of illegal parking (불법 주정차 차량 단속을 위한 차량 검지 및 추적 기법)

  • Kim, Seung-Kyun;Kim, Hyo-Kak;Zhang, Dongni;Park, Sang-Hee;Ko, Sung-Jea
    • Journal of IKEEE
    • /
    • v.13 no.2
    • /
    • pp.232-240
    • /
    • 2009
  • This paper presents a robust vehicle detection and tracking algorithm for supervision of illegal parking. The proposed algorithm is composed of four parts. First, a vehicle detection algorithm is proposed using the improved codebook object detection algorithm to segment moving vehicles from the input sequence. Second, a preprocessing technique using the geometric characteristics of vehicles is employed to exclude non-vehicle objects. Then, the detected vehicles are tracked by an object tracker which incorporates histogram tracking method with Kalman filter. To make the tracking results more accurate, histogram tracking results are used as measurement data for Kalman filter. Finally, Real Stop Counter (RSC) is introduced for trustworthy and accurate performance of the stopped vehicle detection. Experimental results show that the proposed algorithm can track multiple vehicles simultaneously and detect stopped vehicles successfully in the complicated street environment.

  • PDF

Lattice Reduction Aided MIMO Detection using Seysen's Algorithm (Seysen 알고리즘을 이용한 Lattice Reduction-aided 다중 안테나 검출기법)

  • An, Hong-Sun;Mohaisen, Manar;Chang, Kyung-Hi
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.34 no.6C
    • /
    • pp.642-648
    • /
    • 2009
  • In this paper, we use SA (Seysen's Algorithm) instead of LLL (Lenstra-Lenstra-Lovasz) to perform LRA (Lattice Reduction-Aided) detection. By using SA, the complexity of lattice reduction is reduced and the detection performance is improved Although the performance is improved using SA, there still exists a gap in the performance between SA-LRA and ML detection. To reduce the performance difference, we apply list of candidates scheme to SA-LRA. The list of candidates scheme finds a list of candidates. Then, the candidate with the smallest squared Euclidean distance is considered as the estimate of the transmitted signal. Simulation results show that the SA-LRA detection learn to quasi-ML performance. Moreover, the efficiency of the SA is shown to highly improve the channel matrix conditionality.

Improvement of Network Intrusion Detection Rate by Using LBG Algorithm Based Data Mining (LBG 알고리즘 기반 데이터마이닝을 이용한 네트워크 침입 탐지율 향상)

  • Park, Seong-Chul;Kim, Jun-Tae
    • Journal of Intelligence and Information Systems
    • /
    • v.15 no.4
    • /
    • pp.23-36
    • /
    • 2009
  • Network intrusion detection have been continuously improved by using data mining techniques. There are two kinds of methods in intrusion detection using data mining-supervised learning with class label and unsupervised learning without class label. In this paper we have studied the way of improving network intrusion detection accuracy by using LBG clustering algorithm which is one of unsupervised learning methods. The K-means method, that starts with random initial centroids and performs clustering based on the Euclidean distance, is vulnerable to noisy data and outliers. The nonuniform binary split algorithm uses binary decomposition without assigning initial values, and it is relatively fast. In this paper we applied the EM(Expectation Maximization) based LBG algorithm that incorporates the strength of two algorithms to intrusion detection. The experimental results using the KDD cup dataset showed that the accuracy of detection can be improved by using the LBG algorithm.

  • PDF

Triqubit-State Measurement-Based Image Edge Detection Algorithm

  • Wang, Zhonghua;Huang, Faliang
    • Journal of Information Processing Systems
    • /
    • v.14 no.6
    • /
    • pp.1331-1346
    • /
    • 2018
  • Aiming at the problem that the gradient-based edge detection operators are sensitive to the noise, causing the pseudo edges, a triqubit-state measurement-based edge detection algorithm is presented in this paper. Combing the image local and global structure information, the triqubit superposition states are used to represent the pixel features, so as to locate the image edge. Our algorithm consists of three steps. Firstly, the improved partial differential method is used to smooth the defect image. Secondly, the triqubit-state is characterized by three elements of the pixel saliency, edge statistical characteristics and gray scale contrast to achieve the defect image from the gray space to the quantum space mapping. Thirdly, the edge image is outputted according to the quantum measurement, local gradient maximization and neighborhood chain code searching. Compared with other methods, the simulation experiments indicate that our algorithm has less pseudo edges and higher edge detection accuracy.

Improved Crash Detection Algorithm for Vehicle Crash Detection

  • An, Byoungman;Kim, YoungSeop
    • Journal of the Semiconductor & Display Technology
    • /
    • v.19 no.3
    • /
    • pp.93-99
    • /
    • 2020
  • A majority of car crash is affected by careless driving that causes extensive economic and social costs, as well as injuries and fatalities. Thus, the research of precise crash detection systems is very significant issues in automotive safety. A lot of crash detection algorithms have been developed, but the coverage of these algorithms has been limited to few scenarios. Road scenes and situations need to be considered in order to expand the scope of a collision detection system to include a variety of collision modes. The proposed algorithm effectively handles the x, y, and z axes of the sensor, while considering time and suggests a method suitable for various real worlds. To reduce nuisance and false crash detection events, the algorithm discriminated between driving mode and parking mode. The performance of the suggested algorithm was evaluated under various scenarios, and it successfully discriminated between driving and parking modes, and it adjusted crash detection events depending on the real scenario. The proposed algorithm is expected to efficiently manage the space and lifespan of the storage device by allowing the vehicle's black box system to store only necessary crash event's videos.

Local Similarity based Document Layout Analysis using Improved ARLSA

  • Kim, Gwangbok;Kim, SooHyung;Na, InSeop
    • International Journal of Contents
    • /
    • v.11 no.2
    • /
    • pp.15-19
    • /
    • 2015
  • In this paper, we propose an efficient document layout analysis algorithm that includes table detection. Typical methods of document layout analysis use the height and gap between words or columns. To correspond to the various styles and sizes of documents, we propose an algorithm that uses the mean value of the distance transform representing thickness and compare with components in the local area. With this algorithm, we combine a table detection algorithm using the same feature as that of the text classifier. Table candidates, separators, and big components are isolated from the image using Connected Component Analysis (CCA) and distance transform. The key idea of text classification is that the characteristics of the text parallel components that have a similar thickness and height. In order to estimate local similarity, we detect a text region using an adaptive searching window size. An improved adaptive run-length smoothing algorithm (ARLSA) was proposed to create the proper boundary of a text zone and non-text zone. Results from experiments on the ICDAR2009 page segmentation competition test set and our dataset demonstrate the superiority of our dataset through f-measure comparison with other algorithms.

Improvement of Image Processing Algorithm for Particle Size Measurement Using Hough Transform (Hough 변환을 이용한 입경 측정을 위한 영상처리 알고리즘의 개선)

  • Kim, Yu-Dong;Lee, Sang-Yong
    • Journal of ILASS-Korea
    • /
    • v.6 no.1
    • /
    • pp.35-43
    • /
    • 2001
  • Previous studies on image processing techniques for panicle size measurement usually have focused on a single panicle or weakly overlapped particles. In the present work, the image processing algorithm for particle size measurement has been improved to process heavily-overlapped spherical-particle images. The algorithm consists of two steps; detection of boundaries which separate the images of the overlapped panicles from the background and the panicle identification process. For the first step, Sobel operator (using gray-level gradient) and the thinning process was adopted, and compared with the gray-level thresholding method that has been widely adopted. In the second, Hough transform was used. Hough transform is the detection algorithm of parametric curves such as straight lines or circles which can be described by several parameters. To reduce the measurement error, the process of finding the true center was added. The improved algorithm was tested by processing an image frame which contains heavily overlapped spherical panicles. The results showed that both the performances of detecting the overlapped images and separating the panicle from them were improved.

  • PDF

Shot Boundary Detection Using Relative Difference between Two Frames (프레임간의 상대적인 차이를 이용한 비디오의 셔트 검출 기법)

  • 정인식;권오진
    • Proceedings of the IEEK Conference
    • /
    • 2001.06d
    • /
    • pp.101-104
    • /
    • 2001
  • This paper proposes a unique shot boundary detection algorithm for the video indexing and/or browsing. Conventional methods based on the frame differences and the histogram differences are improved. Instead of using absolute frame differences, block by block based relative frame differences are employed. Frame adaptive thresholding values are also employed for the better detection. for the cases that the frame differences are not enough to detect the shot boundary, histogram differences are selectively applied. Experimental results show that the proposed algorithm reduces both the “false positive” errors and the “false negative” errors especially for the videos of dynamic local and/or global motions

  • PDF