• Title/Summary/Keyword: 데이터스트림

Search Result 917, Processing Time 0.027 seconds

A Query Preprocessing Tool for Performance Improvement in Complex Event Stream Query Processing (복합 이벤트 스트림 질의 처리 성능 개선을 위한 질의 전처리 도구)

  • Choi, Joong-Hyun;Cho, Eun-Sun;Lee, Kang-Woo
    • KIISE Transactions on Computing Practices
    • /
    • v.21 no.8
    • /
    • pp.513-523
    • /
    • 2015
  • A complex event processing system, becoming useful in real life domains, efficiently processes stream of continuous events like sensor data from IoT systems. However, those systems do not work well on some types of queries yet, so that programmers should be careful about that. For instance, they do not sufficiently provide detailed guide to choose efficient queries among the almost same meaning queries. In this paper, we propose an query preprocessing tool for event stream processing systems, which helps programmers by giving them the hints to improve performance whenever their queries fall in any possible bad formats in the performance sense. We expect that our proposed module would be a big help to increases productivity of writing programs where debugging, testing, and performance tuning are not straightforward.

Finding Frequent Itemsets based on Open Data Mining in Data Streams (데이터 스트림에서 개방 데이터 마이닝 기반의 빈발항목 탐색)

  • Chang, Joong-Hyuk;Lee, Won-Suk
    • The KIPS Transactions:PartD
    • /
    • v.10D no.3
    • /
    • pp.447-458
    • /
    • 2003
  • The basic assumption of conventional data mining methodology is that the data set of a knowledge discovery process should be fixed and available before the process can proceed. Consequently, this assumption is valid only when the static knowledge embedded in a specific data set is the target of data mining. In addition, a conventional data mining method requires considerable computing time to produce the result of mining from a large data set. Due to these reasons, it is almost impossible to apply the mining method to a realtime analysis task in a data stream where a new transaction is continuously generated and the up-to-dated result of data mining including the newly generated transaction is needed as quickly as possible. In this paper, a new mining concept, open data mining in a data stream, is proposed for this purpose. In open data mining, whenever each transaction is newly generated, the updated mining result of whole transactions including the newly generated transactions is obtained instantly. In order to implement this mechanism efficiently, it is necessary to incorporate the delayed-insertion of newly identified information in recent transactions as well as the pruning of insignificant information in the mining result of past transactions. The proposed algorithm is analyzed through a series of experiments in order to identify the various characteristics of the proposed algorithm.

Multi-stream Generation Method for Intra-media Synchronization of Very Low Bit Rate Video (초저속 고압축 비디오의 미디어내 동기화를 위한 멀티 스트림 생성 기법)

  • 강경원;류권열;권기룡;문광석;김문수
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.2 no.3
    • /
    • pp.9-15
    • /
    • 2001
  • Very low bit rate video coding uses the inter-picture video coding method for high compression. The inter-picture video coding is coded based on the information of the previous frames so any packet loss can lead to reduce the image quality on the transmission. In this paper, we proposed the multi-stream generation method for inter-media synchronization of very low bit rate video based on TCP for reliable transmission. The proposed approach performs a reliable transmission via a TCP based protocol. This method incorporates multi-streams in order to enhance the robustness of delivery and can withstand against network jitter. Moreover, the client bandwidths are fully utilized in a highly efficient way.

  • PDF

Multi-stream Delivery Method of the Video Data Based on SPIHT Wavelet (SPIHT 웨이브릿 기반의 비디오 데이터의 멀티스트림 전송 기법)

  • 강경원;류권열;김기룡;문광석;김문수
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.3 no.3
    • /
    • pp.14-20
    • /
    • 2002
  • In this paper, we proposed the compression technique of the video data using SPIHT(set partitioning in hierarchical trees) based on wavelet and the multi-stream delivery method for best-effort service as fully utilizing the clients bandwidth over the current Internet. The experiment shows that the proposed method provides about 1.5dB better picture quality without block effects than DCT(discrete consine transform) based coding schemes at the same bit rates because of using the wavelet video coder. In addition, this technique implements the multi-stream transmission based on TCP(transmission control protocol). Thus, it is provided with the best-efforts service which is robust to the network jitter problem, and maximally utilizes the bandwidth of the client's.

  • PDF

Performance Evaluation of Big Stream based High Speed Data Storage (빅 스트림 기반 초고속 데이터 스토리지 성능 평가)

  • Song, Min-Gyu;Kang, Yong-Woo;Kim, Hyo-Ryoung
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.12 no.5
    • /
    • pp.817-828
    • /
    • 2017
  • It is very hard to find the system which processes single 10Gbps stream, and the related application is also rare. But in the field of science such as physics and astronomy, these high speed systems have been widely used and now more upgraded performance is expected. For this reason, high speed network based storage which captures and records 10Gbps level of packets was developed for the support of small astronomical company in KASI. But for the use of the system in research, system performance should be not only evaluated but also optimized. In this paper, we first implement system environment for the performance evaluation and discuss the experiment procedure and solution to acquire numerical results.

A Split Proxy for Multimedia Streaming (멀티미디어 스트리밍을 위한 Split 프록시)

  • 이종민;차호정
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2002.04a
    • /
    • pp.316-318
    • /
    • 2002
  • 본 논문은 멀티미디어 스트림을 Split 하는 기능을 가진 프록시 서버의 설계와 구현에 대하여 기술한다. Split 기능을 통해 프록시와 스트리밍 서버간의 네트워크 트래픽을 감소시킬 수 있으며 스트리밍 서버 부하를 줄일 수 있다. Split 기능을 구현하기 위해서는 클라이언트와 스트리밍 서버간의 제어 메시지의 필터링과 데이터 자료의 복사 및 전송 방법에 대한 연구가 필요하며 프록시에 연결된 클라이언트들에게 서비스의 안정성과 독립성을 보장해 줄 수 있어야 한다. 구현된 프록시는 RTSP, RTP, RTCP 프로토콜을 지윈하며 실험을 통해 스트림 Split 기능이 올바로 동작함을 보인다.

  • PDF

Data Structure and Visualization Algorithm in a Post-processing Program (가시화 프로그램에서의 데이터 구조와 가시화 알고리즘)

  • Na J. S.;Kim K. Y.;Kim B. S.
    • 한국전산유체공학회:학술대회논문집
    • /
    • 2003.08a
    • /
    • pp.82-87
    • /
    • 2003
  • Post-processing programs play an important role in the CFD data visualization and analysis. A variety of post-processing softwares have been developed and are being used in the CFD community. Developing a good quality of post-processing program requires dedication and efforts. In this paper an experience obtained through previous studies and developing post-processing programs are introduced which includes data structure and visualization algorithms.

  • PDF

Handoff Control Scheme of MPEG Video (MPEG VIdeo의 핸드오프 제어 기법)

  • Goo, Jung-Du
    • Proceedings of the KAIS Fall Conference
    • /
    • 2010.05a
    • /
    • pp.326-329
    • /
    • 2010
  • 본 논문은 인터넷 및 모바일 통신에서 많이 사용되는 MPEG video을 모바일 통신망에서 전송 및 재생하고, 모바일 환경에서 발생되는 Handoff 상에서 부드러운 스트림(stream) 재생(presentation)을 위한 멀티미디어 동기화 기법을 제안한다. 본 논문에서는 멀티미디어 동기화 기법으로 핸드오프 시MPEG 데이터의 특성을 이용한 핸드오프 제어 방법을 제안하였다. 분석결과, 제안된 기법은 기존의 기법보다 미디어 스트림의 끊김없는 재생(stream of continuous play out)을 제공하는 것뿐만 아니라 패킷의 높은 재생률(play?out rate)과 낮은 손실률(loss rate)을 보였다.

  • PDF

Error Control in TCP Using Timers on Real-Time Operating Systems (실시간 운영체제에서 타이머를 이용한 TCP 오류 제어')

  • 류현수;성영락;이철훈
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2003.04d
    • /
    • pp.232-234
    • /
    • 2003
  • TCP(Transmission Control Protocol)는 신뢰성 있는 전송계층 프로토콜이다. 이것은 데이터 스트림을 TCP 로 전달하는 응용프로그램이 전체 스트림을 순서에 맞고 오류 없이 전달하는 것을 의미한다. TCP 는 오류 제어를 이용하여 신뢰성을 제공하는데, 오류제어는 손상 세그먼트, 손실 세그먼트, 순서가 어긋난 세그먼트, 그리고 중복 세그먼트를 감지하는 메커니즘이 포함되며 특히 타이머(timer)를 이용한 오류제어를 본 내용에서 설명하고 있다.

  • PDF

Anomaly Detection Using Subgraph Pattern Analysis in Graph Streams (스트림 그래프에서 서브 그래프 패턴 분석을 이용한 이상 패턴 감지)

  • Wee, ji-woon;Choi, do-jin;Lim, jong-tae;Bok, kyoung-soo;Yoo, jae-soo
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2019.05a
    • /
    • pp.287-288
    • /
    • 2019
  • 그래프에서 이상 패턴은 정상 그래프와 상이하게 다른 양상을 갖는 그래프를 의미한다. 이상 패턴을 판단하기 위해서는 정상데이터 정확한 정의가 요구된다. 본 논문에서는 스트림 그래프에서 실시간으로 이상 패턴을 감지하는 기법을 제안한다. 제안하는 기법은 정상 서브그래프의 패턴(정상 패턴)을 정의하고 정점 간 연결 관계를 고려한다.

  • PDF