• Title/Summary/Keyword: Multiple Stream

Search Result 363, Processing Time 0.022 seconds

Adaptive Upstream Backup Scheme based on Throughput Rate in Distributed Spatial Data Stream System (분산 공간 데이터 스트림 시스템에서 연산 처리율 기반의 적응적 업스트림 백업 기법)

  • Jeong, Weonil
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.14 no.10
    • /
    • pp.5156-5161
    • /
    • 2013
  • In distributed spatial data stream processing, processed tuples of downstream nodes are replicated to the upstream node in order to increase the utilization of distributed nodes and to recover the whole system for the case of system failure. However, while the data input rate increases and multiple downstream nodes share the operation result of the upstream node, the data which stores to output queues as a backup can be lost since the deletion operation delay may be occurred by the delay of the tuple processing of upstream node. In this paper, the adaptive upstream backup scheme based on operation throughput in distributed spatial data stream system is proposed. This method can cut down the average load rate of nodes by efficient spatial operation migration as it processes spatial temporal data stream, and it can minimize the data loss by fluid change of backup mode. The experiments show the proposed approach can prevent data loss and can decrease, on average, 20% of CPU utilization by node monitoring.

A High-Speed Data Processing Algorithm for RFID Input Data Stream Using Multi-Buffer (RFID 입력 데이터 스트림에 대한 다중 버퍼 기반의 고속 데이터 처리 알고리즘)

  • Han, Soo;Park, Sang-Hyun;Shin, Seung-Ho
    • Journal of the Korea Society of Computer and Information
    • /
    • v.13 no.2
    • /
    • pp.79-85
    • /
    • 2008
  • The middleware that provides RFID-based ubiquitous application service should process the data inputted constantly in real time, and acquire and deliver the answers of the questions in the application service. Studies for developing a Data Stream Management System(DSMS) has been performed in order to process a large amount of data stream inputted constantly in this way. Previous algorithms on data stream were mostly focused on reducing the average error between the answers of the successive questions and abandon the data according to the priority of them when a load occurs. This article is composed of presenting the necessity of the studies on the DSMS and speedy data processing, suggesting an algorithm to make Possible the speedy data processing using buffers and prompt questions and answers, and testing the performance of the data processing rate and whether a buffer is generated correspondingly to the algorithm suggested, in either a single or a multiple buffer, through simulations.

  • PDF

Customized Digital TV System for Individuals/Communities based on Data Stream Mining (데이터 스트림 마이닝 기법을 적용한 개인/커뮤니티 맞춤형 Digital TV 시스템)

  • Shin, Se-Jung;Lee, Won-Suk
    • The KIPS Transactions:PartD
    • /
    • v.17D no.6
    • /
    • pp.453-462
    • /
    • 2010
  • The switch from analog to digital broadcast television is extended rapidly. The DTV can offer multiple programming choices, interactive capabilities and so on. Moreover, with the spread of Internet, the information exchange between the communities is increasing, too. These facts lead to the new TV service environment which can offer customized TV programs to personal/community users. This paper proposes a 'Customized Digital TV System for Individuals/Communities based on Data Stream Mining' which can analyze user's pattern of TV watching behavior. Due to the characteristics of TV program data stream and EPG(electronic program guide), the data stream mining methods are employed in the proposed system. When a user is watching DTV, the proposed system can control the surrounding circumstances as using the user behavior profiles. Furthermore, the channel recommendation system on the smart phone environment is proposed to utilize the profiles widely.

Analysis of Various Ecological Parameters from Molecular to Community Levels for Ecological Health Assessments (생태 건강성 평가로서 분자지표에서 군집지표 수준까지의 다양한 변수분석)

  • Lee, Jae-Hoon;An, Kwang-Guk
    • Korean Journal of Ecology and Environment
    • /
    • v.43 no.1
    • /
    • pp.24-34
    • /
    • 2010
  • This study was carried out to analyze some influences on ecological health conditions, threaten by various stressors such as physical, chemical and biological parameters. We collected samples in 2008 from three zones of upstream, midstream and downstream, Gap Stream. We applied multi-metric fish assessment index (MFAI), based on biotic integrity model to the three zones along with habitat evaluations based on Qualitative Habitat Evaluation Index (QHEI). We also examined fish fauna and compositions, and analyzed relations with MFAI values, QHEI values, and various guild types. Chemical parameters such as oragnic matter (BOD, COD), nutrients (TP, $NH_3$-N), coli-form number (as MPN), and suspended solids (SS) were analyzed to identify the relationship among multiple stressor effects. Using the sentinel species of Zacco platypus, the population structures and condition factors were analyzed along with DNA damages related with genotoxicant effects by comet assay. This study using all these parameters showed that stream condition was degraded along the longitudinal gradient from upstream to downstream, and the downstream, especially, was impacted by nutrient enrichment and toxicant exposure from the point source, wastewater treatment plant. Overall results indicated that our approaches applying various parameters may be used as a cause-effect technique in the stream health assessments and also used as a pre-warning tool for diagnosis of ecological degradation.

The Effects of Hydrologic Characteristics on Sediment Discharge in Streams with Small and Medium Size Watersheds (중소유역의 수문학적 특성이 하천유사량에 미치는 영향)

  • 김활곤;서승덕
    • Magazine of the Korean Society of Agricultural Engineers
    • /
    • v.38 no.3
    • /
    • pp.127-136
    • /
    • 1996
  • The purpose of this study is to provide with information for the water resources development and management in stream management planning, such as information on the sediment trensport, design of dam and water facilities, river improvement and flood plains management. The major results obtained from the field measurement and analysis of the watershed characteristics, hydraulic and sediment characteristics are as follows ; 1. The rating curve formulas obtained from the analysis of the hydraulic characteristics data collected are ; Q-=110.563 $(H-0.474)^2$ for 0.7m$(H-0.146)^2$ for 0.4m$Sr=aX{^2} {_1} X^{c}{_2}$, in the experimental watershed.

  • PDF

Flux of Dissolved Organic and Inorganic Constituents in Forested Headwater Streams

  • Choi, Byoung-Koo;Mangum, Clay N.;Hatten, Jeffery A.;Dewey, Janet C.;Ouyang, Ying
    • Journal of Environmental Science International
    • /
    • v.21 no.10
    • /
    • pp.1171-1179
    • /
    • 2012
  • Headwaters initiate material export to downstream environments. A nested headwater study examined the flux of dissolved constituents and water from a perennial stream and four ephemeral/intermittent streams in the Upper Gulf Coastal Plain of Mississippi. Water was collected during storm and baseflow conditions. Multiple linear regression was used to model constituent concentration and calculate flux. Event was the major source of water discharged from the ephemeral and intermittent streams however, baseflow was the major source for water discharged by the perennial stream during events. The perennial stream had an area weighted average yields of 10.1, 0.01, 1.03, 0.65 kg/ha/yr of DON (dissolved organic nitrogen), $NO_3^-$-N, $NH_4^+$-N and $PO_4^{-3}$, respectively while large variabilities existed between the ephemeral and intermittent streams. These findings highlight the importance of headwaters in protecting the low order drainage basins as a key to water quality within perennial streams.

Efficient Processing of an Aggregate Query Stream in MapReduce (맵리듀스에서 집계 질의 스트림의 효율적인 처리 기법)

  • Choi, Hyunjean;Lee, Ki Yong
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.3 no.2
    • /
    • pp.73-80
    • /
    • 2014
  • MapReduce is a widely used programming model for analyzing and processing Big data. Aggregate queries are one of the most common types of queries used for analyzing Big data. In this paper, we propose an efficient method for processing an aggregate query stream, where many concurrent users continuously issue different aggregate queries on the same data. Instead of processing each aggregate query separately, the proposed method processes multiple aggregate queries together in a batch by a single, optimized MapReduce job. As a result, the number of queries processed per unit time increases significantly. Through various experiments, we show that the proposed method improves the performance significantly compared to a naive method.

Multiple Multicast Tree Allocation Algorithm in Multicast Network

  • Lee Chae Y.;Cho Hee K.
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2002.05a
    • /
    • pp.120-127
    • /
    • 2002
  • The multicasting is defined as the distribution of the same information stream from one to many nodes concurrently. There has been an intensive research effort to design protocols and construct multicast routing graphs for a single multicast group. However. there have been few researches about the relation between multiple and concurrent multicast groups. In this paper, the multiple multicast tree allocation algorithm to avoid congestion is proposed. The multicast group with different bandwidth requirement is also considered. A two-phase algorithm is proposed. The first phase is for basic search and the second phase for further improvement. The performance of the proposed algorithm is experimented with computational results. Computational results show that the proposed algorithm outperforms an existing algorithm.

  • PDF

Session Management and Control Architecture for N-Screen Services (N-스크린 서비스를 위한 세션 제어 및 관리 구조)

  • Kim, Jae-Woo;Ullah, Farman;Sarwar, Ghulam;Lee, Hyun-Woo;Lee, Sung-Chang
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.13 no.2
    • /
    • pp.15-23
    • /
    • 2013
  • In this paper, we propose a session management and control architecture for N-Screen services, which enable users to change devices and transfer contents among user's devices during service by session transfer and split. In N-Screen services, users may have multiple devices with different attribute such as screen resolution, CPU capability and access network interfaces. Also, since users may change devices during service, or one user may use multiple stream, N-Screen services need to enable the user to share and transfer contents across N-Screen devices. We introduce the management and control servers to provide session split over user multiple devices and session continuity while changing device. Furthermore, the proposed architecture provides the device capabilities aware session continuity. In addition, the proposed scheme minimizes the session transfer delay and content server processing load. We present results that show the effectiveness and usefulness of proposed architecture.

Advanced Fast-Forward/Backward Algorithm for VOD Server (VOD서버를 위한 개선된 Fast-Forward/Fast-Backward 알고리즘)

  • Jin-Uok Kim;Soo-Mok Jung
    • Journal of the Korea Computer Industry Society
    • /
    • v.5 no.2
    • /
    • pp.293-300
    • /
    • 2004
  • In this paper, we devise both methods supporting interactive VCR-like functions for MPEG stream and minimizing the storage space. Specifically, we proposed both methods to efficiently stripe MPEG stream into multiple disks, and an access strategy to retrieve the distributed streams over the disks. To accurately locate the streams to be referred to, we introduce a table indexing the location. When client request Fast Forward(FF)/Fast Backward(FB), VOD(Video on Demand) server refer to this index table supporting FF/FB functions. Experimental result shows that the proposed method can reduce the additional storage space needed when VOD server services FF/FB functions.

  • PDF