• Title/Summary/Keyword: Real-time Data Processing

Search Result 2,093, Processing Time 0.028 seconds

Design and Implementation of a Spatio-Temporal Middleware for Ubiquitous Environments (유비쿼터스 환경을 위한 시공간 미들웨어의 설계 및 구현)

  • Kim, Jeong-Joon;Jeong, Yeon-Jong;Kim, Dong-Oh;Han, Ki-Joon
    • Journal of Korea Spatial Information System Society
    • /
    • v.11 no.1
    • /
    • pp.43-54
    • /
    • 2009
  • As R&D(Research and Development) is going on actively to develop technologies for the ubiquitous computing environment, which Is the human-oriented future computing environment, GIS dealing with spatio-temporal data is emerging as a promising technology. This also increases the necessity of the middleware for providing services to give interoperability in various heterogeneous environments. The core technologies of the middleware are real-time processing technology of data streams coming unceasingly from positioning systems and data stream processing technology developed for non-spatio-temporal data. However, it has problems in processing queries on spatio-temporal data efficiently. Accordingly, this paper designed and implemented the spatio-temporal middleware that provides interoperability between a mobile spatio-temporal DBMS(DataBase Management System) and a server spatio-temporal MMDBMS(Main Memory DataBase Management System). The spatio-temporal middleware maintains interoperability among heterogeneous devices and guarantees data integrity in query processing through real-time processing of unceasing spatio-temporal data streams and two way synchronization of spatio-temporal DBMSs. In addition, it manages session for the connection of each spatio-temporal DBMS and manages resources for its stable operation. Finally, this paper proved the usability of the spatio-temporal middleware by applying it to a real-time position tracking system.

  • PDF

Important Facility Guard System Using Edge Computing for LiDAR (LiDAR용 엣지 컴퓨팅을 활용한 중요시설 경계 시스템)

  • Jo, Eun-Kyung;Lee, Eun-Seok;Shin, Byeong-Seok
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.11 no.10
    • /
    • pp.345-352
    • /
    • 2022
  • Recent LiDAR(Light Detection And Ranging) sensor is used for scanning object around in real-time. This sensor can detect movement of the object and how it has changed. As the production cost of the sensors has been decreased, LiDAR begins to be used for various industries such as facility guard, smart city and self-driving car. However, LiDAR has a large input data size due to its real-time scanning process. So another way for processing a large amount of data are needed in LiDAR system because it can cause a bottleneck. This paper proposes edge computing to compress massive point cloud for processing quickly. Since laser's reflection range of LiDAR sensor is limited, multiple LiDAR should be used to scan a large area. In this reason multiple LiDAR sensor's data should be processed at once to detect or recognize object in real-time. Edge computer compress point cloud efficiently to accelerate data processing and decompress every data in the main cloud in real-time. In this way user can control LiDAR sensor in the main system without any bottleneck. The system we suggest solves the bottleneck which was problem on the cloud based method by applying edge computing service.

Real-Time Streaming Traffic Prediction Using Deep Learning Models Based on Recurrent Neural Network (순환 신경망 기반 딥러닝 모델들을 활용한 실시간 스트리밍 트래픽 예측)

  • Jinho, Kim;Donghyeok, An
    • KIPS Transactions on Computer and Communication Systems
    • /
    • v.12 no.2
    • /
    • pp.53-60
    • /
    • 2023
  • Recently, the demand and traffic volume for various multimedia contents are rapidly increasing through real-time streaming platforms. In this paper, we predict real-time streaming traffic to improve the quality of service (QoS). Statistical models have been used to predict network traffic. However, since real-time streaming traffic changes dynamically, we used recurrent neural network-based deep learning models rather than a statistical model. Therefore, after the collection and preprocessing for real-time streaming data, we exploit vanilla RNN, LSTM, GRU, Bi-LSTM, and Bi-GRU models to predict real-time streaming traffic. In evaluation, the training time and accuracy of each model are measured and compared.

Concurrency Control Based on Triggering Relationship for Real-Time Active Database (실시간 능동 데이터베이스에서 triggering 관계를 고려한 동시성 제어 기법)

  • 홍석희
    • The KIPS Transactions:PartD
    • /
    • v.8D no.1
    • /
    • pp.10-23
    • /
    • 2001
  • Transactions in real-time active databases have the notion of activeness where transactions are generated by external effects and another transaction. In this paper, we propose the multi version concurrency control algorithm for real-time active transactions. A real-time active transaction has a timing constraint in the form of a deadline until which the user wants to complete the transaction, and is characterized by triggering relationships which mean that association between a transaction that triggers the execution of another transaction and the triggered transaction. The triggering relationship is an important factor to resolve data conflicts among real-time active transactions. The proposed concurrency control mechanism resolves data conflicts by considering triggering relationships between conflicting transactions as well as priorities and precedence relationships. The conflict resolution mechanism considers association types of the triggering relationship such as abort and commit dependency, and then resolves data conflicts in favor of higher priority transactions. We also present the experimental results of our algorithm comparing other real-time active concurrency control algorithms.

  • PDF

A Review of Window Query Processing for Data Streams

  • Kim, Hyeon Gyu;Kim, Myoung Ho
    • Journal of Computing Science and Engineering
    • /
    • v.7 no.4
    • /
    • pp.220-230
    • /
    • 2013
  • In recent years, progress in hardware technology has resulted in the possibility of monitoring many events in real time. The volume of incoming data may be so large, that monitoring all individual data might be intractable. Revisiting any particular record can also be impossible in this environment. Therefore, many database schemes, such as aggregation, join, frequent pattern mining, and indexing, become more challenging in this context. This paper surveys the previous efforts to resolve these issues in processing data streams. The emphasis is on specifying and processing sliding window queries, which are supported in many stream processing engines. We also review the related work on stream query processing, including synopsis structures, plan sharing, operator scheduling, load shedding, and disorder control.

Development of Alarm Processing Algorithm for SAS (변전소 자동화를 위한 Alarm Processing 방법 개발)

  • Jin, B.G.;Hyun, S.H.;Lee, S.J.
    • Proceedings of the KIEE Conference
    • /
    • 2006.07a
    • /
    • pp.161-162
    • /
    • 2006
  • There are many alarms in Substation Automation System because of data types and quantities increasing, so it is very difficult for operators to know the actual situations. In order to help operators easily make decision, some unnecessary alarms should be removed or combined as one. In this paper, alarm processing is using the structure of substation system and the relation of measured data and events to make some rules. Conventional alarm processing just gives data, but proposed alarm processing gives the whole information. In a simulation model system, the data such as voltage, current and CB status are collected by HyperSim and saved in DB, then proposed alarm processing has been testified using those data based on real-time simulation.

  • PDF

Technique of Serving 3D GSIS Data on the Internet (인터넷3D GSIS를 위한 3차원 데이터의 효율적 구축 및 생성방안)

  • Kang, In-Joon;Lee, Jun-Seok
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.10 no.1 s.19
    • /
    • pp.19-26
    • /
    • 2002
  • To provide 3D GSIS data on the internet, 3D data structures need to be researched and applied for spatial analysis for subsurface modeling. As for GSIS software R&D trend the following things have pointed out : 3-dimensional geo-processing technologies, internet-based application system development, distributed processing technologies for large volume of spatial information, real-time geo-data processing methodologies, Among them research scope within Internet-based application system or Web-based GSIS generally contains core parts of software development such as Internet application, large volume of spatial database handling, real-time spatial data processing, spatial data transfer and transformation, and volumetric display of processing results. This study shows the method of providing 3D GSIS on the internet using VRML model, which are made of DEM data, draped aerial photo, and VRML script programming. And it is also studied that offering 3D GSIS engine on the internet and precise texture mapping using satellite image and aerial photos.

  • PDF

A Study on Developing Intrusion Detection System Using APEX : A Collaborative Research Project with Jade Solution Company (APEX 기반 침입 탐지 시스템 개발에 관한 연구 : (주)제이드 솔류션과 공동 연구)

  • Kim, Byung-Joo
    • The Journal of Korea Institute of Information, Electronics, and Communication Technology
    • /
    • v.10 no.1
    • /
    • pp.38-45
    • /
    • 2017
  • Attacking of computer and network is increasing as information processing technology heavily depends on computer and network. To prevent the attack of system and network, host and network based intrusion detection system has developed. But previous rule based system has a lot of difficulties. For this reason demand for developing a intrusion detection system which detects and cope with the attack of system and network resource in real time. In this paper we develop a real time intrusion detection system which is combination of APEX and LS-SVM classifier. Proposed system is for nonlinear data and guarantees convergence. While real time processing system has its advantages, such as memory efficiency and allowing a new training data, it also has its disadvantages of inaccuracy compared to batch way. Therefore proposed real time intrusion detection system shows similar performance in accuracy compared to batch way intrusion detection system, it can be deployed on a commercial scale.

Development of Real-time Mission Monitoring for the Korea Augmentation Satellite System

  • Daehee, Won;Koontack, Kim;Eunsung, Lee;Jungja, Kim;Youngjae, Song
    • Journal of Positioning, Navigation, and Timing
    • /
    • v.12 no.1
    • /
    • pp.23-35
    • /
    • 2023
  • Korea Augmentation Satellite System (KASS) is a satellite-based augmentation system (SBAS) that provides approach procedure with vertical guidance-I (APV-I) level corrections and integrity information to Korea territory. KASS is used to monitor navigation performance in real-time, and this paper introduces the design, implementation, and verification process of mission monitoring (MIMO) in KASS. MIMO was developed in compliance with the Minimum Operational Performance Standards of the Radio Technical Commission for Aeronautics for Global Positioning System (GPS)/SBAS airborne equipment. In this study, the MIMO system was verified by comparing and analyzing the outputs of reference tools. Additionally, the definition and derivation method of accuracy, integrity, continuity, and availability subject to MIMO were examined. The internal and external interfaces and functions were then designed and implemented. The GPS data pre-processing was minimized during the implementation to evaluate the navigation performance experienced by general users. Subsequently, tests and verification methods were used to compare the obtained results based on reference tools. The test was performed using the KASS dataset, which included GPS and SBAS observations. The decoding performance of the developed MIMO was identical to that of the reference tools. Additionally, the navigation performance was verified by confirming the similarity in trends. As MIMO is a component of KASS used for real-time monitoring of the navigation performance of SBAS, the KASS operator can identify whether an abnormality exists in the navigation performance in real-time. Moreover, the preliminary identification of the abnormal point during the post-processing of data can improve operational efficiency.

System Design and Realization for Real Time DVR System with Robust Video Watermarking (강인한 비디오 워터마킹을 적용한 실시간 DVR 시스템의 설계 구현)

  • Ryu Kwang-Ryol;Kim Ja-Hwan
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.10 no.6
    • /
    • pp.1019-1024
    • /
    • 2006
  • A system design and realization for real time DVR system with robust video watermarking algorithm for contents security is presented in this paper. The robust video watermarking is used the intraframe space region and interframe insertion simultaneously, and to be processed at real time on image data and algorithm is used the 64bits special purpose quad DSP processor with assembly and soft pipeline codes. The experimental result shows that the processing time takes about 2.5ms in the D1 image per frame for 60% moving image.