• Title/Summary/Keyword: Error patterns

Search Result 684, Processing Time 0.027 seconds

Correlation Analysis of Event Logs for System Fault Detection (시스템 결함 분석을 위한 이벤트 로그 연관성에 관한 연구)

  • Park, Ju-Won;Kim, Eunhye;Yeom, Jaekeun;Kim, Sungho
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.39 no.2
    • /
    • pp.129-137
    • /
    • 2016
  • To identify the cause of the error and maintain the health of system, an administrator usually analyzes event log data since it contains useful information to infer the cause of the error. However, because today's systems are huge and complex, it is almost impossible for administrators to manually analyze event log files to identify the cause of an error. In particular, as OpenStack, which is being widely used as cloud management system, operates with various service modules being linked to multiple servers, it is hard to access each node and analyze event log messages for each service module in the case of an error. For this, in this paper, we propose a novel message-based log analysis method that enables the administrator to find the cause of an error quickly. Specifically, the proposed method 1) consolidates event log data generated from system level and application service level, 2) clusters the consolidated data based on messages, and 3) analyzes interrelations among message groups in order to promptly identify the cause of a system error. This study has great significance in the following three aspects. First, the root cause of the error can be identified by collecting event logs of both system level and application service level and analyzing interrelations among the logs. Second, administrators do not need to classify messages for training since unsupervised learning of event log messages is applied. Third, using Dynamic Time Warping, an algorithm for measuring similarity of dynamic patterns over time increases accuracy of analysis on patterns generated from distributed system in which time synchronization is not exactly consistent.

Improving the Error Back-Propagation Algorithm of Multi-Layer Perceptrons with a Modified Error Function (역전파 학습의 오차함수 개선에 의한 다층퍼셉트론의 학습성능 향상)

  • 오상훈;이영직
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.32B no.6
    • /
    • pp.922-931
    • /
    • 1995
  • In this paper, we propose a modified error function to improve the EBP(Error Back-Propagation) algorithm of Multi-Layer Perceptrons. Using the modified error function, the output node of MLP generates a strong error signal in the case that the output node is far from the desired value, and generates a weak error signal in the opposite case. This accelerates the learning speed of EBP algorothm in the initial stage and prevents overspecialization for training patterns in the final stage. The effectiveness of our modification is verified through the simulation of handwritten digit recognition.

  • PDF

BAYESIAN CLASSIFICATION AND FREQUENT PATTERN MINING FOR APPLYING INTRUSION DETECTION

  • Lee, Heon-Gyu;Noh, Ki-Yong;Ryu, Keun-Ho
    • Proceedings of the KSRS Conference
    • /
    • 2005.10a
    • /
    • pp.713-716
    • /
    • 2005
  • In this paper, in order to identify and recognize attack patterns, we propose a Bayesian classification using frequent patterns. In theory, Bayesian classifiers guarantee the minimum error rate compared to all other classifiers. However, in practice this is not always the case owing to inaccuracies in the unrealistic assumption{ class conditional independence) made for its use. Our method addresses the problem of attribute dependence by discovering frequent patterns. It generates frequent patterns using an efficient FP-growth approach. Since the volume of patterns produced can be large, we propose a pruning technique for selection only interesting patterns. Also, this method estimates the probability of a new case using different product approximations, where each product approximation assumes different independence of the attributes. Our experiments show that the proposed classifier achieves higher accuracy and is more efficient than other classifiers.

  • PDF

Integrated Procedure of Self-Organizing Map Neural Network and Case-Based Reasoning for Multivariate Process Control (자기조직화 지도 신경망과 사례기반추론을 이용한 다변량 공정관리)

  • 강부식
    • Journal of Intelligence and Information Systems
    • /
    • v.9 no.1
    • /
    • pp.53-69
    • /
    • 2003
  • Many process variables in modem manufacturing processes have influence on quality of products with complicated relationships. Therefore, it is necessary to control multiple quality variables in order to monitor abnormal signals in the processes. This study proposes an integrated procedure of self-organizing map (SOM) neural network and case-based reasoning (CBR) for multivariate process control. SOM generates patterns of quality variables. The patterns are compared with the reference patterns in order to decide whether their states are normal or abnormal using the goodness-of-fitness test. For validation, it generates artificial datasets consisting of six patterns, normal and abnormal patterns. Experimental results show that the abnormal patterns can be detected effectively. This study also shows that the CBR procedure enables to keep Type 2 error at very low level and reduce Type 1 error gradually, and then the proposed method can be a solution fur multivariate process control.

  • PDF

A Tow-stage Recognition Approach Based on Error Pattern Hypotheses for Connected Digit Recognition

  • Oh, Wook-Kwon;Un, Chong-Kwan
    • The Journal of the Acoustical Society of Korea
    • /
    • v.15 no.3E
    • /
    • pp.31-36
    • /
    • 1996
  • In this paper, a two-stage recognition approach based on error pattern hypotheses is proposed to reduce errors of a connected digit recognizer. In the approach, a conventional recognizer is first used to produce N-best candidate strings, and then error patterns are hypothesized by examining the candidate strings. For substitution error pattern hypotheses, error-pattern-dependent classifiers having more discriminative power than the first-stage classifier are used ; and for insertion and deletion errors, word duration and energy contour information are exploited are exploited to discriminated confusing pairs. Simulation results showed that the proposed approach achieves 15% decrease in word error rate for speaker-independent Korean connected digit recognition when a hidden Markov model-based recognizer is used for the first-stage classifier.

  • PDF

Automatic Optical Inspection System for Holograms with Multiple Patterns (다중패턴 홀로그램을 위한 자동광학검사 시스템)

  • Kwon, Hyuk-Joong;Park, Tae-Hyoung
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.15 no.5
    • /
    • pp.548-554
    • /
    • 2009
  • We propose an automatic inspection system for hologram with multiple patterns. The system hardware consists of illuminations, camera, and vision processor. Multiple illuminations using LEDs are arranged in different directions to acquire each image of patterns. The system software consists of pre-processing, pattern generation, and pattern matching. The acquired images of input hologram are compared with their reference patterns by developed matching algorithm. To compensate for the positioning error of input hologram, reference patterns of hologram for different position should be generated in on-line. We apply a frequency transformation based CGH(computer-generated hologram) method to generate reference images. For the fast pattern matching, we also apply the matching method in the frequency domain. Experimental results for hologram of Korean currency are then presented to verify the usefulness of proposed system.

A New Empirical Investigation of Employment, Wages and Output -A Comparative Study of the US and Japan-

  • Sung, Jaewhan
    • Journal of Labour Economics
    • /
    • v.21 no.2
    • /
    • pp.17-46
    • /
    • 1998
  • In this paper, I pursue an empirical analysis of different patterns of employment and wage adjustments to demand changes for the US and Japan. Analyzed are the data in the 70's and 80's, the period that the two countries are believed to show most conspicuous diverging patterns. Using the framework of cointegration and error correction, I establish that in the US it is employment level, while in Japan it is wages, that is more responsive to output fluctuations both in the long run and the short run. All the comparisons on the long run relationships are estimated and tested based on the system cointegrating regressions, and the transition from the short run to the long run responses are investigated using impulse response analysis of the error correction models. I also study differences across genders and establishment sizes within each country. For males and females in Japan, the adjustments are significantly different both in the long run and the short run, but for the firms of different sizes they diverge only in the short run. In contrast to some of the earlier work, the gender effect turns out to be insignificant in the US.

  • PDF

Sensor Fusion and Error Compensation Algorithm for Pedestrian Navigation System

  • Cho, Seong-Yun;Park, Chan-Gook;Yim, Hwa-Young
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.1001-1006
    • /
    • 2003
  • This paper presents the pedestrian navigation algorithm and the error compensation filter. The pedestrian navigation system (PNS) consists of the MEMS inertial sensors, the fluxgate, and the small-size GPS receiver. PNS calculates the navigational information using the signal patterns of the accelerometers. And the navigational information is completed by integration of the patterns, the fluxgate, and the GPS information. In general, PNS can provide the better solution than the low-cost inertial navigation system.

  • PDF

Analysis of Error Patterns in ]Korean Connected Digit Telephone Speech Recognition (한국어 연속 숫자음 전화 음성 인식에서의 오인식 유형 분석)

  • Kim Min Sung;Jung Sung Yun;Son Jong Mok;Bae Keun Sung;Kim Sang Hun
    • MALSORI
    • /
    • no.46
    • /
    • pp.77-86
    • /
    • 2003
  • Channel distortion and coarticulation effect in the Korean connected digit telephone speech make it difficult to achieve high performance of connected digit recognition in the telephone environment. In this paper, as a basic research to improve the recognition performance of Korean connected digit telephone speech, recognition error patterns are investigated and analyzed. Korean connected digit telephone speech database released by SiTEC and HTK system are used for recognition experiments. Both DWFBA and MRTCN methods are used for feature extraction and channel compensation, respectively. Experimental results are discussed with our findings.

  • PDF

A study on the Automatic Recognition of Hand Printed Hangeul patterns by the Computer (전자계산기에 의한 필기체 한글 인식에 관한 연구)

  • 남궁재찬;김영건
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.5 no.1
    • /
    • pp.44-48
    • /
    • 1980
  • This paper proposes a method of the automatic recognition of the handprinted Hanguel patterns. A certain pattern oriented basic letters is normalized to the prototype Hanguel patten by the linking compansation and nomalization algorithm. Tree grammar is used in recognition process. Compared with the previous method. automata processing is simplified and the error is reduced by the new parsing method. This method shows the effectiveness for the constrained pattern. We expect that the new parsing method is very useful for the on-line pattern recognition.

  • PDF