• Title/Summary/Keyword: Multiple Stream Model

Search Result 79, Processing Time 0.031 seconds

Application of the QUAL2Kw model to a Polluted River for Automatic Calibration and Sensitivity Analysis of Genetic Algorithm Parameters (오염하천의 자동보정을 위한 QUAL2Kw 모형의 적용과 유전알고리즘의 매개변수에 관한 민감도분석)

  • Cho, Jae-Heon
    • Journal of Environmental Impact Assessment
    • /
    • v.20 no.3
    • /
    • pp.357-365
    • /
    • 2011
  • The QUAL2K has the same basic characteristics as the QUAL2E model, which has been widely used in stream water quality modeling; in QUAL2K, however, various functions are supplemented. The QUAL2Kw model uses a genetic algorithm(GA) for automatic calibration of QUAL2K, and it can search for optimum water quality parameters efficiently using the calculation results of the model. The QUAL2Kw model was applied to the Gangneung Namdaecheon River on the east side of the Korean Peninsula. Because of the effluents from the urban area, the middle and lower parts of the river are more polluted than the upper parts. Moreover, the hydraulic characteristics differ between the lower and upper parts of rivers. Thus, the river reaches were divided into seven parts, auto-calibration for the multiple reaches was performed using the function of the user-defined automatic calibration of the rates worksheets. Because GA parameters affect the optimal solution of the model, the impact of the GA parameters used in QUAL2Kw on the fitness of the model was analyzed. Sensitivity analysis of various factors, such as population size, crossover probability, crossover mode, strategy for mutation and elitism, mutation rate, and reproduction plan, were performed. Using the results of this sensitivity analysis, the optimum GA parameters were selected to achieve the best fitness value.

Forecasting of Dissolved Oxygen at Kongju Station using a Transfer Function Noise Model (전이함수잡음모형에 의한 공주지점의 용존산소 예측)

  • 류병로;조정석;한양수
    • Journal of Environmental Science International
    • /
    • v.8 no.3
    • /
    • pp.349-354
    • /
    • 1999
  • The transfer function was introduced to establish the prediction method for the DO concentration at the intaking point of Kongju Water Works System. In the mose cases we analyze a single time series without explicitly using information contained in the related time series. In many forecasting situations, other events will systematically influence the series to be forecasted(the dependent variables), and therefore, there is need to go beyond a univariate forecasting model. Thus, we must bulid a forecasting model that incorporates more than one time series and introduces explicitly the dynamic characteristics of the system. Such a model is called a multiple time series model or transfer function model. The purpose of this study is to develop the stochastic stream water quality model for the intaking station of Kongju city waterworks in Keum river system. The performance of the multiplicative ARIMA model and the transfer function noise model were examined through comparisons between the historical and generated monthly dissolved oxygen series. The result reveal that the transfer function noise model lead to the improved accuracy.

  • PDF

Squall: A Real-time Big Data Processing Framework based on TMO Model for Real-time Events and Micro-batch Processing (Squall: 실시간 이벤트와 마이크로-배치의 동시 처리 지원을 위한 TMO 모델 기반의 실시간 빅데이터 처리 프레임워크)

  • Son, Jae Gi;Kim, Jung Guk
    • Journal of KIISE
    • /
    • v.44 no.1
    • /
    • pp.84-94
    • /
    • 2017
  • Recently, the importance of velocity, one of the characteristics of big data (5V: Volume, Variety, Velocity, Veracity, and Value), has been emphasized in the data processing, which has led to several studies on the real-time stream processing, a technology for quick and accurate processing and analyses of big data. In this paper, we propose a Squall framework using Time-triggered Message-triggered Object (TMO) technology, a model that is widely used for processing real-time big data. Moreover, we provide a description of Squall framework and its operations under a single node. TMO is an object model that supports the non-regular real-time processing method for certain conditions as well as regular periodic processing for certain amount of time. A Squall framework can support the real-time event stream of big data and micro-batch processing with outstanding performances, as compared to Apache storm and Spark Streaming. However, additional development for processing real-time stream under multiple nodes that is common under most frameworks is needed. In conclusion, the advantages of a TMO model can overcome the drawbacks of Apache storm or Spark Streaming in the processing of real-time big data. The TMO model has potential as a useful model in real-time big data processing.

A Study on the Efficiency of Join Operation On Stream Data Using Sliding Windows (스트림 데이터에서 슬라이딩 윈도우를 사용한 조인 연산의 효율에 관한 연구)

  • Yang, Young-Hyoo
    • Journal of the Korea Society of Computer and Information
    • /
    • v.17 no.2
    • /
    • pp.149-157
    • /
    • 2012
  • In this thesis, the problem of computing approximate answers to continuous sliding-window joins over data streams when the available memory may be insufficient to keep the entire join state. One approximation scenario is to provide a maximum subset of the result, with the objective of losing as few result tuples as possible. An alternative scenario is to provide a random sample of the join result, e.g., if the output of the join is being aggregated. It is shown formally that neither approximation can be addressed effectively for a sliding-window join of arbitrary input streams. Previous work has addressed only the maximum-subset problem, and has implicitly used a frequency based model of stream arrival. There exists a sampling problem for this model. More importantly, it is shown that a broad class of applications for which an age-based model of stream arrival is more appropriate, and both approximation scenarios under this new model are addressed. Finally, for the case of multiple joins being executed with an overall memory constraint, an algorithm for memory allocation across the join that optimizes a combined measure of approximation in all scenarios considered is provided.

An Emergency Alert Message Broadcasting System using Null-Packet on Digital TV Broadcasting

  • Kim, Yoo-Won;Park, Seung-Bo;Hong, Myung-Duk;Jo, Geun-Sik
    • Journal of Korea Multimedia Society
    • /
    • v.13 no.12
    • /
    • pp.1767-1777
    • /
    • 2010
  • In digital TV broadcasting, such as terrestrial, cable, satellite, and IPTV, the head-end of digital TV broadcasting has a more complicated transmission structure than that of analog TV broadcasting. Furthermore, digital TV broadcasting has a feature that supports multiplex models, such as Multiple Program Transport Stream (MPTS). Therefore, the purpose of our work was to design and examine a more efficient new system of emergency alert message transmission to support the digital TV broadcasting environments. Digital TV broadcasting is the IP generation or RF transmission of 8-VSB, QAM, and QPSK modulated through a multiplexer or re-multiplexer multiplexed stream as a MPEG-2 Transport Stream after content encoding. The new system proposed in this paper transmits an emergency alert message without scrambling after replacing the PID and payload of the -packet with the message prototype in the TS stream from the multiplexer. If we need to transmit an emergency alert message under digital TV broadcasting services, then the receiver first checks the PID of each packet in the TS stream for the emergency alert message. Next, if a packet is determined to be an emergency alert message, then the set-top box displays the message on the TV screen using its function of On Screen Display, or the PC based software displays the message on the monitor screen using its function of overlay with user interface if the packet is found to be an emergency alert message. We have designed an emergency alert message protocol and a system model. By experiments and analysis of the system, we concluded that the system achieved efficiency and the ability to send and receive emergency alert messages using the system under different digital TV broadcasting service environments.

Long-Term Performance Evaluation of Scheduling Disciplines in OFDMA Multi-Rate Video Multicast Transmission (OFDMA 다중률 비디오 멀티캐스트 전송에서 스케줄링 방식의 장기적 성능 평가)

  • Hong, Jin Pyo;Han, Minkyu
    • Journal of KIISE
    • /
    • v.43 no.2
    • /
    • pp.246-255
    • /
    • 2016
  • The orthogonal frequency-division multiple access (OFDMA) systems are well suited to multi-rate multicast transmission, as they allow flexible resource allocation across both frequency and time, and provide adaptive modulation and coding schemes. Unlike layered video coding, the multiple description coding (MDC) enables flexible decomposition of the raw video stream into two or more substreams. The quality of the video stream is expected to be roughly proportional to data rate sustained by the receiver. This paper describes a mathematical model of resource allocation and throughput in the multi-rate video multicast for the OFDMA wireless and mobile networks. The impact on mean opinion score (MOS), as a measurement of user-perceived quality (by employing a variety of scheduling disciplines) is discussed in terms of utility maximization and proportional fairness. We propose a pruning algorithm to ensure a minimum video quality even for a subset of users at the resource limitation, and show the optimal number of substreams and their rates can sustain.

Analysis of Various Ecological Parameters from Molecular to Community Levels for Ecological Health Assessments (생태 건강성 평가로서 분자지표에서 군집지표 수준까지의 다양한 변수분석)

  • Lee, Jae-Hoon;An, Kwang-Guk
    • Korean Journal of Ecology and Environment
    • /
    • v.43 no.1
    • /
    • pp.24-34
    • /
    • 2010
  • This study was carried out to analyze some influences on ecological health conditions, threaten by various stressors such as physical, chemical and biological parameters. We collected samples in 2008 from three zones of upstream, midstream and downstream, Gap Stream. We applied multi-metric fish assessment index (MFAI), based on biotic integrity model to the three zones along with habitat evaluations based on Qualitative Habitat Evaluation Index (QHEI). We also examined fish fauna and compositions, and analyzed relations with MFAI values, QHEI values, and various guild types. Chemical parameters such as oragnic matter (BOD, COD), nutrients (TP, $NH_3$-N), coli-form number (as MPN), and suspended solids (SS) were analyzed to identify the relationship among multiple stressor effects. Using the sentinel species of Zacco platypus, the population structures and condition factors were analyzed along with DNA damages related with genotoxicant effects by comet assay. This study using all these parameters showed that stream condition was degraded along the longitudinal gradient from upstream to downstream, and the downstream, especially, was impacted by nutrient enrichment and toxicant exposure from the point source, wastewater treatment plant. Overall results indicated that our approaches applying various parameters may be used as a cause-effect technique in the stream health assessments and also used as a pre-warning tool for diagnosis of ecological degradation.

The Effects of Hydrologic Characteristics on Sediment Discharge in Streams with Small and Medium Size Watersheds (중소유역의 수문학적 특성이 하천유사량에 미치는 영향)

  • 김활곤;서승덕
    • Magazine of the Korean Society of Agricultural Engineers
    • /
    • v.38 no.3
    • /
    • pp.127-136
    • /
    • 1996
  • The purpose of this study is to provide with information for the water resources development and management in stream management planning, such as information on the sediment trensport, design of dam and water facilities, river improvement and flood plains management. The major results obtained from the field measurement and analysis of the watershed characteristics, hydraulic and sediment characteristics are as follows ; 1. The rating curve formulas obtained from the analysis of the hydraulic characteristics data collected are ; Q-=110.563 $(H-0.474)^2$ for 0.7m$(H-0.146)^2$ for 0.4m$Sr=aX{^2} {_1} X^{c}{_2}$, in the experimental watershed.

  • PDF

Flux of Dissolved Organic and Inorganic Constituents in Forested Headwater Streams

  • Choi, Byoung-Koo;Mangum, Clay N.;Hatten, Jeffery A.;Dewey, Janet C.;Ouyang, Ying
    • Journal of Environmental Science International
    • /
    • v.21 no.10
    • /
    • pp.1171-1179
    • /
    • 2012
  • Headwaters initiate material export to downstream environments. A nested headwater study examined the flux of dissolved constituents and water from a perennial stream and four ephemeral/intermittent streams in the Upper Gulf Coastal Plain of Mississippi. Water was collected during storm and baseflow conditions. Multiple linear regression was used to model constituent concentration and calculate flux. Event was the major source of water discharged from the ephemeral and intermittent streams however, baseflow was the major source for water discharged by the perennial stream during events. The perennial stream had an area weighted average yields of 10.1, 0.01, 1.03, 0.65 kg/ha/yr of DON (dissolved organic nitrogen), $NO_3^-$-N, $NH_4^+$-N and $PO_4^{-3}$, respectively while large variabilities existed between the ephemeral and intermittent streams. These findings highlight the importance of headwaters in protecting the low order drainage basins as a key to water quality within perennial streams.

Efficient Processing of an Aggregate Query Stream in MapReduce (맵리듀스에서 집계 질의 스트림의 효율적인 처리 기법)

  • Choi, Hyunjean;Lee, Ki Yong
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.3 no.2
    • /
    • pp.73-80
    • /
    • 2014
  • MapReduce is a widely used programming model for analyzing and processing Big data. Aggregate queries are one of the most common types of queries used for analyzing Big data. In this paper, we propose an efficient method for processing an aggregate query stream, where many concurrent users continuously issue different aggregate queries on the same data. Instead of processing each aggregate query separately, the proposed method processes multiple aggregate queries together in a batch by a single, optimized MapReduce job. As a result, the number of queries processed per unit time increases significantly. Through various experiments, we show that the proposed method improves the performance significantly compared to a naive method.