• 제목/요약/키워드: Very large real-time data

검색결과 130건 처리시간 0.034초

A Study on Data Pre-filtering Methods for Fault Diagnosis (시스템 결함원인분석을 위한 데이터 로그 전처리 기법 연구)

  • Lee, Yang-Ji;Kim, Duck-Young;Hwang, Min-Soon;Cheong, Young-Soo
    • Korean Journal of Computational Design and Engineering
    • /
    • 제17권2호
    • /
    • pp.97-110
    • /
    • 2012
  • High performance sensors and modern data logging technology with real-time telemetry facilitate system fault diagnosis in a very precise manner. Fault detection, isolation and identification in fault diagnosis systems are typical steps to analyze the root cause of failures. This systematic failure analysis provides not only useful clues to rectify the abnormal behaviors of a system, but also key information to redesign the current system for retrofit. The main barriers to effective failure analysis are: (i) the gathered data (event) logs are too large in general, and further (ii) they usually contain noise and redundant data that make precise analysis difficult. This paper therefore applies suitable pre-processing techniques to data reduction and feature extraction, and then converts the reduced data log into a new format of event sequence information. Finally the event sequence information is decoded to investigate the correlation between specific event patterns and various system faults. The efficiency of the developed pre-filtering procedure is examined with a terminal box data log of a marine diesel engine.

An Effective Similarity Search Technique supporting Time Warping in Sequence Databases (시퀀스 데이타베이스에서 타임 워핑을 지원하는 효과적인 유살 검색 기법)

  • Kim, Sang-Wook;Park, Sang-Hyun
    • Journal of KIISE:Databases
    • /
    • 제28권4호
    • /
    • pp.643-654
    • /
    • 2001
  • This paper discusses an effective processing of similarity search that supports time warping in large sequence database. Time warping enables finding sequences with similar patterns even when they are of different length, Previous methods fail to employ multi-dimensional indexes without false dismissal since the time warping distance does not satisfy the triangular inequality. They have to scan all the database, thus suffer from serious performance degradation in large database. Another method that hires the suffix tree also shows poor performance due to the large tree size. In this paper we propose a new novel method for similarity search that supports time warping Our primary goal is to innovate on search performance in large database without false dismissal. to attain this goal ,we devise a new distance function $D_{tw-Ib}$ consistently underestimates the time warping distance and also satisfies the triangular inequality, $D_{tw-Ib}$ uses a 4-tuple feature vector extracted from each sequence and is invariant to time warping, For efficient processing, we employ a distance function, We prove that our method does not incur false dismissal. To verify the superiority of our method, we perform extensive experiments . The results reveal that our method achieves significant speedup up to 43 times with real-world S&P 500 stock data and up to 720 times with very large synthetic data.

  • PDF

WIRELESS SENSOR NETWORK BASED BRIDGE MANAGEMENT SYSTEM FOR INFRASTRUCTURE ASSET MANAGEMENT

  • Jung-Yeol Kim;Myung-Jin Chae;Giu Lee;Jae-Woo Park;Moon-Young Cho
    • International conference on construction engineering and project management
    • /
    • The 3th International Conference on Construction Engineering and Project Management
    • /
    • pp.1324-1327
    • /
    • 2009
  • Social infrastructure is the basis of public welfare and should be recognized and managed as important assets. Bridge is one of the most important infrastructures to be managed systematically because the impact of the failure is critical. It is essential to monitor the performance of bridges in order to manage them as an asset. But current analytical methods such as predictive modeling and structural analysis are very complicated and difficult to use in practice. To apply these methods, structural and material condition data collection should be performed in each element of bridge. But it is difficult to collect these detailed data in large numbers and various kinds of bridges. Therefore, it is necessary to collect data of major measurement items and predict the life of bridges roughly with advanced information technologies. When certain measurement items reach predefined limits in the monitoring bridges, precise performance measurement will be done by detailed site measurement. This paper describes the selection of major measurement items that can represent the tendency of bridge life and introduces automated bridge data collection test-bed using wireless sensor network technology. The following will be major parts of this paper: 1) Examining the features of conventional bridge management system and data collection method 2) Mileage concept as a bridge life indicator and measuring method of the indicator 3) Test-bed of automated and real-time based bridge life indicator monitoring system using wireless sensor network

  • PDF

The study on effective PDV control for IEE1588 (초소형 기지국에서 타이밍 품질 향상을 위한 PDV 제어 방안)

  • Kim, Hyun-Soo;Shin, Jun-Hyo;Kim, Jung-Hun;Jeong, Seok-Jong
    • 한국정보통신설비학회:학술대회논문집
    • /
    • 한국정보통신설비학회 2009년도 정보통신설비 학술대회
    • /
    • pp.275-280
    • /
    • 2009
  • Femtocells are viewed as a promising option for mobile operators to improve coverage and provide high-data-rate services in a cost-effective manner Femtocells can be used to serve indoor users, resulting in a powerful solution for ubiquitous indoor and outdoor coverage. TThe frequency accuracy and phase alignment is necessary for ensuring the quality of service (QoS) forapplications such as voice, real-time video, wireless hand-off, and data over a converged access medium at the femtocell. But, the GPS has some problem to be used at the femtocell, because it is difficult to set-up, depends on the satellite condition, and very expensive. The IEEE 1588 specification provides a low-cost means for clock synchronisation over a broadband Internet connection. The Time of Packet (ToP) specified in IEEE 1588 is able to synchronize distributed clocks with an accuracy of less than one microsecond in packet networks. However, the timing synchronization over packet switched networks is a difficult task because packet networks introduce large and highly variable packet delays. This paper proposes an enhanced filter algorithm to reduce ths packet delay variation effects and maintain ToP slave clock synchronization performance. The results are presented to demonstrate in the intra-networks and show the improved performance case when the efficient ToP filter algorithm is applied.

  • PDF

KMTNet time-series photometry of the doubly eclipsing candidate stars in the LMC

  • Hong, Kyeongsoo;Lee, Jae Woo;Koo, Jae-Rim;Kim, Seung-Lee;Lee, Chung-Uk;Kim, Dong-Jin
    • The Bulletin of The Korean Astronomical Society
    • /
    • 제42권1호
    • /
    • pp.44.2-44.2
    • /
    • 2017
  • Multiple stellar systems composed of triple, double+double or double+triple, etc. are very rare and interesting objects for understanding the star formation and dynamical evolution. However, only six systems have been found to be a doubly eclipsing quadruple, which consists of two eclipsing binaries, and four systems to be a triply eclipsing hierarchical triple. Recently, the 15 doubly eclipsing multiple candidates located in the Large Magellanic Cloud (LMC) have been reported by the OGLE project. In order to examine whether these candidates are real multiple systems with eclipsing features, we performed a high-cadence time-series photometry for the LMC using the KMTNet (Korea Microlensing Telescope Network) 1.6 m telescopes in three site (CTIO, SAAO, and SSO) during 2016-2017. The KMTNet data will help reveal the photometric properties of the multiple-star candidates. In this paper, we present the VI light curves and their preliminarily analyses for 12 of the 15 eclipsing systems in the LMC, based on our KMTNet observations and the OGLE-III survey data from 2001-2009.

  • PDF

An Approach for the Automatic Box-Jenkins Modelling

  • Park, Sung-Joo;Hong, Chang-Soo;Jeon, Tae-Joon
    • Journal of Korean Institute of Industrial Engineers
    • /
    • 제10권1호
    • /
    • pp.17-25
    • /
    • 1984
  • The use of Box-Jenkins technique is still very limited due to the high level of knowledge required in comprehending the technique and the cumbersome iterative procedure which requires a large amount of cost and time. This paper proposes a method of automating the univariate Box-Jekins modelling to overcome the limitations of subjective identification in iterative procedure by using Variate Difference method, D-statistic and Pattern Recognition algorithm combined with Akaike's Information Criterion. The results of the application to real data show that the average performance of automatic modelling procedure is better or not worse, at least, than those of the existing models which have been manually set up and reported in the literature.

  • PDF

Design and Performance Analysis of NHC/ZUPT Kalman Filter with Mounting Misalignment Estimation (NHC/ZUPT의 장착 비정렬 추정 칼만필터 설계 및 성능분석)

  • Park, Young-Bum;Kim, Kap-Jin;Park, Jun-Pyo
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • 제12권5호
    • /
    • pp.636-643
    • /
    • 2009
  • NHC means that the velocity of the vehicle in the plane perpendicular to the forward direction is almost zero. The main error source of NHC is the mounting misalignment which is the difference between the body frame of a land vehicle and the sensor frame of an inertial measurement unit. This paper suggests new NHC algorithm that can reduce position errors by real-time estimation of mounting misalignment. Then NHC/ZUPT integrated land navigation system is designed and its performances are analyzed by simulations with van test data. Simulation results show that the proposed NHC/ZUPT land navigation system improves navigation accuracy regardless of misalignment angle and is very useful when SDINS operates stand-alone for land vehicle navigation with large mounting misalignment.

Face Recognition System with SVDD-based Incremental Learning Scheme (SVDD기반의 점진적 학습기능을 갖는 얼굴인식 시스템)

  • Kang, Woo-Sung;Na, Jin-Hee;Ahn, Ho-Seok;Choi, Jin-Young
    • The Journal of Korea Robotics Society
    • /
    • 제1권1호
    • /
    • pp.66-72
    • /
    • 2006
  • In face recognition, learning speed of face is very important since the system should be trained again whenever the size of dataset increases. In existing methods, training time increases rapidly with the increase of data, which leads to the difficulty of training with a large dataset. To overcome this problem, we propose SVDD (Support Vector Domain Description)-based learning method that can learn a dataset of face rapidly and incrementally. In experimental results, we show that the training speed of the proposed method is much faster than those of other methods. Moreover, it is shown that our face recognition system can improve the accuracy gradually by learning faces incrementally at real environments with illumination changes.

  • PDF

Radar Signal Processor Design Using FPGA (FPGA를 이용한 레이더 신호처리 설계)

  • Ha, Changhun;Kwon, Bojun;Lee, Mangyu
    • Journal of the Korea Institute of Military Science and Technology
    • /
    • 제20권4호
    • /
    • pp.482-490
    • /
    • 2017
  • The radar signal processing procedure is divided into the pre-processing such as frequency down converting, down sampling, pulse compression, and etc, and the post-processing such as doppler filtering, extracting target information, detecting, tracking, and etc. The former is generally designed using FPGA because the procedure is relatively simple even though there are large amounts of ADC data to organize very quickly. On the other hand, in general, the latter is parallel processed by multiple DSPs because of complexity, flexibility and real-time processing. This paper presents the radar signal processor design using FPGA which includes not only the pre-processing but also the post-processing such as doppler filtering, bore-sight error, NCI(Non-Coherent Integration), CFAR(Constant False Alarm Rate) and etc.