• Title/Summary/Keyword: data streams

Search Result 821, Processing Time 0.022 seconds

Design and Implementation of a Spatio-Temporal Middleware for Ubiquitous Environments (유비쿼터스 환경을 위한 시공간 미들웨어의 설계 및 구현)

  • Kim, Jeong-Joon;Jeong, Yeon-Jong;Kim, Dong-Oh;Han, Ki-Joon
    • Journal of Korea Spatial Information System Society
    • /
    • v.11 no.1
    • /
    • pp.43-54
    • /
    • 2009
  • As R&D(Research and Development) is going on actively to develop technologies for the ubiquitous computing environment, which Is the human-oriented future computing environment, GIS dealing with spatio-temporal data is emerging as a promising technology. This also increases the necessity of the middleware for providing services to give interoperability in various heterogeneous environments. The core technologies of the middleware are real-time processing technology of data streams coming unceasingly from positioning systems and data stream processing technology developed for non-spatio-temporal data. However, it has problems in processing queries on spatio-temporal data efficiently. Accordingly, this paper designed and implemented the spatio-temporal middleware that provides interoperability between a mobile spatio-temporal DBMS(DataBase Management System) and a server spatio-temporal MMDBMS(Main Memory DataBase Management System). The spatio-temporal middleware maintains interoperability among heterogeneous devices and guarantees data integrity in query processing through real-time processing of unceasing spatio-temporal data streams and two way synchronization of spatio-temporal DBMSs. In addition, it manages session for the connection of each spatio-temporal DBMS and manages resources for its stable operation. Finally, this paper proved the usability of the spatio-temporal middleware by applying it to a real-time position tracking system.

  • PDF

Changes and Influences of Stream Water Quantity due to Urbanization: Focusing on Urban Streams in Gyeonggi-do (도시화에 따른 하천수량 변화 및 영향_경기도 도심하천을 중심으로)

  • Noh, Huiseong;Jo, Dongho;Kim, Yonsoo;Ahn, Taejin
    • Journal of Wetlands Research
    • /
    • v.19 no.4
    • /
    • pp.491-500
    • /
    • 2017
  • Stream water quantity is the most basic, fundamental and important element for stream water quality and for conservation of ecological environment. This study aims to analyze causes of changes in stream water quantity based on the percentage of impervious surface area (%ISA) in urban streams of Gyeonggi-do, and also to present a method to secure water quantity of urban streams in Gyeonggi-do and data to be applied to River Management Policy. For this purpose, the Anyangcheon watershed, the Tancheon watershed, and the Osancheon watershed were selected as samples of the urban streams. In addition, the stream water quantity and the changes in stream water quality which were based on the amount of ISA, and methods to directly and indirectly secure stream water quantity were investigated. The results are as follows. The amounts of ISA of the Anyangcheon watershed, of the Tancheon watershed, and of the Osancheon watershed showed a 5.32%, 6.32%, and 7.22% increase, respectively, from 2014 which was approximately 10 years ago. The runoff coefficient generally increased as the amount of ISA was increased. Water reuse quantity of stream in the Tanchon watershed had a positive effect on securing stream water quantity, but both in the Anyangcheon watershed and in the Osancheon watershed, it did not have a positive effect on that. However, water reuse quantity of stream improved the water quality of each stream.

Establishing Diagnosis Systems for Impaired Stream Ecosystem using Stream/River Ecosystem Survey and Health Assessment (수생태계 현황 조사 및 건강성 평가결과를 활용한 수생태계 훼손원인 진단체계 구축)

  • Lee, Jong-Won;Lee, Sang-Woo;Hwang, Soon-Jin;Jang, Min-Ho;Won, Doo-Hee;An, Kyung-Jin;Park, Hye-Jin;Lee, Junga
    • Korean Journal of Ecology and Environment
    • /
    • v.53 no.1
    • /
    • pp.1-10
    • /
    • 2020
  • The Stream/River Ecosystem Survey and Health Assessment has been carried out regarding the ecological health of the streams by the Ministry of Environment (MOE), South Korea. However, the sources of impairment of the stream ecosystem and the interactions between the sources, stressors, and the responses of impaired streams have not been taken into consideration. The purpose of this study is to propose the establishment of diagnosis systems for the impaired stream ecosystem because of the need to incorporate the same in the making of the policy to enable the recovery and improvement of the health of the impaired streams or river ecosystem. First, we define the concept of a diagnosis of the impaired stream or river ecosystem through a literature review. Second, through case studies [e.g., US CADDIS (Causal Analysis/Diagnosis Decision Information System), AUS. Eco Evidence, EU WFD (Water Framework Directive)], we try to develop the diagnosis system for the making of policy. In this study, the diagnosis system that is proposed consists of eight steps including the basic data collection, detecting or suspecting impairment, defining the impaired stream reach, identifying the biological impaired cases and listing the candidate causes, illustrating the interactive conceptual diagrams between stressors and responses, investigating the stressors-responses in the field, verifying causes and identifying the probable causes of the impaired cases, and summarizing and proposing the restoration of the streams. The results of this study will support and enable efficient decision-making for sustainable stream restoration and management based on the diagnosis of the probable causes for the impaired complex and the diverse stream ecosystem.

Epidemiological Survey on Metugonimus yokogawui Infection in the Eastern Coast area of Kangwon-Province, Korea (강원도 동해시 황강흡충 감염의 역학적 조사연구)

  • 안영겸;정평림
    • Parasites, Hosts and Diseases
    • /
    • v.25 no.1
    • /
    • pp.59-68
    • /
    • 1987
  • An epidemiological survey on Metagonimus yokogawai infection was performed in the eastern coast area of Kangwon province. Formalin-ether concentration technique and Stoll's dilution egg counting method were employed to figure out the prevalence and intensity of M. yokogawai infection and eating habits of inhabitants with raw freshwater fish. The results are summarized as follows: 1. The prevalence rate of M. yokogawai infection was 6.6% among a total of 2, 357 examinees; 8.6% (115 out of 1, 345) in male and 4.0% (40 out of 1, 012) in female. 2. The prevalence rates were different by the streams where the examinees were residing: 17.8% along the area of Ohsip-cheon (stream), 11.8% along Maeup-cheon, 1.7% along Hwasang-cheon, 1.3% along Yeongok-cheon, 0.9% along Namdae-cheon, 0.9% along Sa-cheon and 0% in the other streams (Yongchon-cheon, Kangnung Namdae-cheon and Jusoo.cheon) in decreasing order. 3. By social strata, the positive rate was 8.0% (122 out of 1, 521) in general inhabitants and 3.9% (33 out of 836) in school children. 4. By the intensity of infection by means of EPG counts in feces; the light infection (less than 400/EPG) was 74.1%, moderate infection (401-1, 000/EPG) 17.3% and heavy infection (more than 1, 001/EPG) 8.6%. 5. Twelves out of 50 sweetfish (Plecoglossus altivelis) (24%) caught from the streams in eastern coast of Kangwon-Do were infected with metacercariae of M. yokogawai, and the number of larvae detected were 70.7 per 6sh in average. The metacercarial infection rates in fish were also different by the streams; 100% in Ohsip-cheon of Samcheok-Gun, 14.3% in Sa-cheon, 16.7% in Yeongokcheon of Myeongju-Gun and 0% in Namdae-cheon of Yangyang-Gun, respectively. 6. Six hundred ninety live (695) out of 1, 396 inhabitants and school children (49.8%) were experienced in eating raw freshwater fishes (Plecoglossus altivezis, Triboledon hakonensis, Coreoperca sp., Morose sp., Carassius sp. & Cyprinus sp. and Zacco platypus). The data were assayed with the questionnaire collected from the examinees. In summarizing the above results, it is known that the Ohsip-cheon area of Samcheok-Gun is highly infected region, and the other areas of Kangnung Namdae-cheon, Yeongok-cheon and Yangyang Namdae-cheon are very lowly infected or non-infected regions for M yokogawai infection.

  • PDF

Detecting Anomalies in Time-Series Data using Unsupervised Learning and Analysis on Infrequent Signatures

  • Bian, Xingchao
    • Journal of IKEEE
    • /
    • v.24 no.4
    • /
    • pp.1011-1016
    • /
    • 2020
  • We propose a framework called Stacked Gated Recurrent Unit - Infrequent Residual Analysis (SG-IRA) that detects anomalies in time-series data that can be trained on streams of raw sensor data without any pre-labeled dataset. To enable such unsupervised learning, SG-IRA includes an estimation model that uses a stacked Gated Recurrent Unit (GRU) structure and an analysis method that detects anomalies based on the difference between the estimated value and the actual measurement (residual). SG-IRA's residual analysis method dynamically adapts the detection threshold from the population using frequency analysis, unlike the baseline model that relies on a constant threshold. In this paper, SG-IRA is evaluated using the industrial control systems (ICS) datasets. SG-IRA improves the detection performance (F1 score) by 5.9% compared to the baseline model.

Mining Frequent Trajectory Patterns in RFID Data Streams (RFID 데이터 스트림에서 이동궤적 패턴의 탐사)

  • Seo, Sung-Bo;Lee, Yong-Mi;Lee, Jun-Wook;Nam, Kwang-Woo;Ryu, Keun-Ho;Park, Jin-Soo
    • Journal of Korea Spatial Information System Society
    • /
    • v.11 no.1
    • /
    • pp.127-136
    • /
    • 2009
  • This paper proposes an on-line mining algorithm of moving trajectory patterns in RFID data streams considering changing characteristics over time and constraints of single-pass data scan. Since RFID, sensor, and mobile network technology have been rapidly developed, many researchers have been recently focused on the study of real-time data gathering from real-world and mining the useful patterns from them. Previous researches for sequential patterns or moving trajectory patterns based on stream data have an extremely time-consum ing problem because of multi-pass database scan and tree traversal, and they also did not consider the time-changing characteristics of stream data. The proposed method preserves the sequential strength of 2-lengths frequent patterns in binary relationship table using the time-evolving graph to exactly reflect changes of RFID data stream from time to time. In addition, in order to solve the problem of the repetitive data scans, the proposed algorithm infers candidate k-lengths moving trajectory patterns beforehand at a time point t, and then extracts the patterns after screening the candidate patterns by only one-pass at a time point t+1. Through the experiment, the proposed method shows the superior performance in respect of time and space complexity than the Apriori-like method according as the reduction ratio of candidate sets is about 7 percent.

  • PDF

Secure and Efficient Storage of Video Data in a CCTV Environment

  • Kim, Won-Bin;Lee, Im-Yeong
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.13 no.6
    • /
    • pp.3238-3257
    • /
    • 2019
  • Closed-circuit television (CCTV) technology continuously captures and stores video streams. Users are typically required by policy to store all the captured video for a certain period. Accordingly, increasing the number of CCTV operation cycles and photographing positions expands the amount of data to be stored. However, expanding the available storage space for video data incurs increased costs. In recent years, this problem has been addressed with cloud storage solutions, which enable multiple users and devices to access and store data simultaneously. However, because of the large amount of data to be stored, a vast storage space is required. Consequently, cloud storage administrators need a way to store data more efficiently. To save storage space, deduplication technology has been proposed to prevent duplicate storage of the same data. However, because cloud storage is hosted on remote servers, data encryption technology must be applied to address data exposure issues. Although deduplication techniques for encrypted data have been studied, there have been various security vulnerabilities. We attempted to solve this problem by addressing various issues such as poison attacks, property forgery, and ownership management while removing the redundant data and handling the data more securely.

IMAGE DATA CHAIN ANALYSIS FOR SATELLITE CAMERA ELECTRONIC SYSTEM

  • Park, Jong-Euk;Kong, Jong-Pil;Heo, Haeng-Pal;Kim, Young-Sun;Chang, Young-Jun
    • Proceedings of the KSRS Conference
    • /
    • v.2
    • /
    • pp.791-793
    • /
    • 2006
  • In the satellite camera, the incoming light source is converted to electronic analog signals by the electronic component for example CCD (Charge Coupled Device) detectors. The analog signals are amplified, biased and converted into digital signals (pixel data stream) in the video processor (A/Ds). The outputs of the A/Ds are digitally multiplexed and driven out using differential line drivers (two pairs of wires) for cross strap requirement. The MSC (Multi-Spectral Camera) in the KOMPSAT-2 which is a LEO spacecraft will be used to generate observation imagery data in two main channels. The MSC is to obtain data for high-resolution images by converting incoming light from the earth into digital stream of pixel data. The video data outputs are then MUXd, converted to 8 bit bytes, serialized and transmitted to the NUC (Non-Uniformity Correction) module by the Hotlink data transmitter. In this paper, the video data streams, the video data format, and the image data processing routine for satellite camera are described in terms of satellite camera control hardware. The advanced satellite with very high resolution requires faster and more complex image data chain than this algorithm. So, the effective change of the used image data chain and the fast video data transmission method are discussed in this paper

  • PDF

Finding Frequent Itemsets Over Data Streams in Confined Memory Space (한정된 메모리 공간에서 데이터 스트림의 빈발항목 최적화 방법)

  • Kim, Min-Jung;Shin, Se-Jung;Lee, Won-Suk
    • The KIPS Transactions:PartD
    • /
    • v.15D no.6
    • /
    • pp.741-754
    • /
    • 2008
  • Due to the characteristics of a data stream, it is very important to confine the memory usage of a data mining process regardless of the amount of information generated in the data stream. For this purpose, this paper proposes the Prime pattern tree(PPT) for finding frequent itemsets over data streams with using the confined memory space. Unlike a prefix tree, a node of a PPT can maintain the information necessary to estimate the current supports of several itemsets together. The length of items in a prime pattern can be reduced the total number of nodes and controlled by split_delta $S_{\delta}$. The size and the accuracy of the PPT is determined by $S_{\delta}$. The accuracy is better as the value of $S_{\delta}$ is smaller since the value of $S_{\delta}$ is large, many itemsets are estimated their frequencies. So it is important to consider trade-off between the size of a PPT and the accuracy of the mining result. Based on this characteristic, the size and the accuracy of the PPT can be flexibly controlled by merging or splitting nodes in a mining process. For finding all frequent itemsets over the data stream, this paper proposes a PPT to replace the role of a prefix tree in the estDec method which was proposed as a previous work. It is efficient to optimize the memory usage for finding frequent itemsets over a data stream in confined memory space. Finally, the performance of the proposed method is analyzed by a series of experiments to identify its various characteristics.

Header Data Interpreting S/W Design for MSC(Multi-Spectral Camera) image data

  • Kong Jong-Pil;Heo Haeng-Pal;Kim YoungSun;Park Jong-Euk;Youn Heong-Sik
    • Proceedings of the KSRS Conference
    • /
    • 2004.10a
    • /
    • pp.436-439
    • /
    • 2004
  • Output data streams of the MSC contain flags, Headers and image data according to the established protocols and data formats. Especially the Header added to each data lines contain information of a line sync, a line counter and, ancillary data which consist of ancillary identification bit and one ancillary data byte. This information is used by ground station to calculate the geographic coordinates of the image and get the on-board time and several EOS(Electro-Optical Subsystem) parameters used at the time of imaging. Therefore, the EGSE(Electrical Ground Supporting Equipment) that is used for testing MSC has to have functions of interpreting and displaying this Header information correctly following the protocols. This paper describes the design of the header data processing module which is in EOS­EGSE. This module provides users with various test functions such as header validation, ancillary block validation, line-counter and In-line counter validation checks which allow convenient and fast test on imagery data.

  • PDF