• Title/Summary/Keyword: Real-Time Data

Search Result 9,371, Processing Time 0.036 seconds

Techniques to Guarantee Real-Time Fault Recovery in Spark Streaming Based Cloud System (Spark Streaming 기반 클라우드 시스템에서 실시간 고장 복구를 지원하기 위한 기법들)

  • Kim, Jungho;Park, Daedong;Kim, Sangwook;Moon, Yongshik;Hong, Seongsoo
    • Journal of KIISE
    • /
    • v.44 no.5
    • /
    • pp.460-468
    • /
    • 2017
  • In a real-time cloud environment, the data analysis framework plays a pivotal role. Spark Streaming meets most real-time requirements among existing frameworks. However, the framework does not meet the second scale real-time fault recovery requirement. Spark Streaming fault recovery time increases in proportion to the transformation history length called lineage. This is because it recovers the last state data based on the cumulative lineage recorded during normal operation. Therefore, fault recovery time is not bounded within a limited time. In addition, it is impossible to achieve a second-scale fault recovery time because it costs tens of seconds to read initial state data from fault-tolerant storage. In this paper, we propose two techniques to solve the problems mentioned above. We apply the proposed techniques to Spark Streaming 1.6.2. Experimental results show that the fault recovery time is bounded and the average fault recovery time is reduced by up to 41.57%.

Wafer state prediction in 64M DRAM s-Poly etching process using real-time data (실시간 데이터를 위한 64M DRAM s-Poly 식각공정에서의 웨이퍼 상태 예측)

  • 이석주;차상엽;우광방
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1997.10a
    • /
    • pp.664-667
    • /
    • 1997
  • For higher component density per chip, it is necessary to identify and control the semiconductor manufacturing process more stringently. Recently, neural networks have been identified as one of the most promising techniques for modeling and control of complicated processes such as plasma etching process. Since wafer states after each run using identical recipe may differ from each other, conventional neural network models utilizing input factors only cannot represent the actual state of process and equipment. In this paper, in addition to the input factors of the recipe, real-time tool data are utilized for modeling of 64M DRAM s-poly plasma etching process to reflect the actual state of process and equipment. For real-time tool data, we collect optical emission spectroscopy (OES) data. Through principal component analysis (PCA), we extract principal components from entire OES data. And then these principal components are included to input parameters of neural network model. Finally neural network model is trained using feed forward error back propagation (FFEBP) algorithm. As a results, simulation results exhibit good wafer state prediction capability after plasma etching process.

  • PDF

Performance Analysis of Switched Ethernets with Different Topologies for Industrial Communications (공장자동화를 위한 토폴로지에 따른 스위칭 이더넷의 성능분석)

  • Kim, Myung-Kyun;Park, Zin-Won
    • The KIPS Transactions:PartC
    • /
    • v.11C no.1
    • /
    • pp.99-108
    • /
    • 2004
  • In this paper, the performance of switched ethernet networks with different topologies as an industrial control networks is analyzed. The switched ethernet eliminated data collisions on the network and can be used to transmit real-time data. While the amount of data on the network is small compared to the computer networks, the industrial control networks require the real-time data delivery. In this paper, we analyze and compare the network performance of switched ethernet networks with linear and tree topologies whether they satisfy the real-time data delivery requirement needed to be used as the industrial control networks.

A Design of Agent Model for Real-time Intrusion Detection (실시간 침입 탐지를 위한 에이전트 모델의 설계)

  • Lee, Mun-Gu;Jeon, Mun-Seok
    • The Transactions of the Korea Information Processing Society
    • /
    • v.6 no.11
    • /
    • pp.3001-3010
    • /
    • 1999
  • The most of intrusion detection methods do not detect intrusion on real-time because it takes a long time to analyze an auditing data for intrusions. To solve the problem, we are studying a real-time intrusion detection. Therefore, this paper proposes an agent model using multi warning level for real-time intrusion detection. It applies to distributed environment using an extensibility and communication mechanism among agents, supports a portability, an extensibility and a confidentiality of IDS.

  • PDF

Web-based Servo Motor Controller Design with Real-time Micro Embedded Operating System

  • Kim, Ga-Gue;Lee, Hyung-Seok
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2004.08a
    • /
    • pp.1655-1658
    • /
    • 2004
  • In this paper, we design and implement remote servo motor control system with real-time micro embedded operating system. The system, where controller and camera image grabber are mounted, handles control commands transmitted from a remote PC web browser. A hard real-time servo motor driver running on the real-time micro embedded OS and then a digital control application which confirms precise sampling time intervals is constructed. Frame grabber images transmitted from camera are saved in a image data format to view on remote PC web browser.

  • PDF

A Study on Real-Time Multimedia Service Considering Network Performance in ATM Networks (ATM망에서 Network Performance를 고려한 Real-Time Multimedia Service에 관한 연구)

  • 김영준;이병호
    • Proceedings of the IEEK Conference
    • /
    • 1998.10a
    • /
    • pp.91-94
    • /
    • 1998
  • ATM technology is reaching a certain level of maturity that allow for its deployment in local as well as in wide area networks. Concurrently, audiovisual applications are foreseen as one of the major users of such broadband networks. We present in this paper requriement of real-time multimedia service on B-ISDN networks and simulating the transport of MPEG-2 encoded multimedia data over ATM networks using CBR, VBR, ABR of ATM Traffic Service. We compare each delay time considering network performance and propose need for real-time multimedia service.

  • PDF

Performance Evaluation of Switched Ethernet for Real-time Industrial Communication (실시간 산업용 통신을 위한 Switched Ethernet의 성능 평가)

  • Kim, D. H.;Lee, K. C.;Lee, S.
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2002.05a
    • /
    • pp.491-494
    • /
    • 2002
  • The real-time industrial network often referred to as fieldbus, is an important element for building automated manufacturing systems. Thus, in order to satisfy the real-time requirements of field devices such as sensors, actuators, and controllers. numerous standard organizations and vendors have developed various fieldbus protocols such as Profibus, WorldFIP and Foundation Fieldbus. However, the application of fieldbus has been limited due to the high cost of hardware and the difficulty in interfacing with multi-vendor products. In order to solve these problems, the computer network technology, especially Ethernet (IEEE 802.3), is being adopted lo the industrial environment. The crucial technical obstacle for Ethernet is that its non-deterministic behavior makes it inadequate for industrial applications where real-time data such as control command and alarm signal hale to be delivered within a certain time limit. Recently, the development of switched Ethernet shows a very promising prospect for industrial application due to the elimination of uncertainties in the network operation resulting in much improved performance. This paper focuses on the application of the switched Ethernet for industrial comm unications.

  • PDF

A Concurrency Control Method of Mobile Real-time Transactions Using Committed Transaction Precedence (완료 트랜잭션 우선의 이동 실시간 트랜잭션 동시성 제어 기법)

  • Kim, Gyoung-Bae;Cho, Sook-Kyoung;Bae, Hae-Young
    • The KIPS Transactions:PartD
    • /
    • v.11D no.6
    • /
    • pp.1213-1220
    • /
    • 2004
  • With the significant advances in mobile computing technology, there is an increasing demand for various mobile applications to process trans-actions in a real-time. When remote data access is considered in a mobile environment, data access delay becomes one of the most serious problems in meeting the deadline of real-time transaction. The mobile real-time transaction should be assured not only correctness of result of trans-action but also completion time of transaction. In this paper, we propose an optimistic concurrency control method to solve conflict among mobile real-time transactions. It minimizes influence on the cascade abort and delay of transactions that occur by disconnection and hand over in a mobile environment.

A Design and Implementation of Real-time Video frame data Processing control for Block Matching Algorithm (고속블럭정합 알고리즘을 위한 실시간 영상프레임 데이터 처리 제어 방법의 설계 및 구현)

  • 이강환;황호정
    • Proceedings of the IEEK Conference
    • /
    • 2001.06b
    • /
    • pp.373-376
    • /
    • 2001
  • This paper has been studied a real-time video frame data processing control that used the linear systolic array for motion estimation. The proposed data control processing provides to the input data into the multiple processor array unit(MPAU) from search area and reference block data. The proposed data control architecture has based on two slice band for input data processing. And it has no required external control logic blocks for input data as like reference block or search area data.

  • PDF

Network scheduling algorithm for field bus system (필드 버스 시스템을 위한 네트웍 스케쥴링 알고리즘)

  • 추성호;김일환
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1996.10b
    • /
    • pp.1348-1351
    • /
    • 1996
  • In field bus network, field device are connected with a medium. Because a medium must be shared for transmitting data, there are random delay time when data arrive destination station. It is difficult that all data packets are guaranteed synchronization and real-time restriction. In this paper, we show an algorithm that makes network utilization to maximum, guarantees real-time restriction, calculates sampling time at all control loop.

  • PDF