• Title/Summary/Keyword: data streams

Search Result 821, Processing Time 0.026 seconds

Hazelcast Vs. Ignite: Opportunities for Java Programmers

  • Maxim, Bartkov;Tetiana, Katkova;S., Kruglyk Vladyslav;G., Murtaziev Ernest;V., Kotova Olha
    • International Journal of Computer Science & Network Security
    • /
    • v.22 no.2
    • /
    • pp.406-412
    • /
    • 2022
  • Storing large amounts of data has always been a big problem from the beginning of computing history. Big Data has made huge advancements in improving business processes by finding the customers' needs using prediction models based on web and social media search. The main purpose of big data stream processing frameworks is to allow programmers to directly query the continuous stream without dealing with the lower-level mechanisms. In other words, programmers write the code to process streams using these runtime libraries (also called Stream Processing Engines). This is achieved by taking large volumes of data and analyzing them using Big Data frameworks. Streaming platforms are an emerging technology that deals with continuous streams of data. There are several streaming platforms of Big Data freely available on the Internet. However, selecting the most appropriate one is not easy for programmers. In this paper, we present a detailed description of two of the state-of-the-art and most popular streaming frameworks: Apache Ignite and Hazelcast. In addition, the performance of these frameworks is compared using selected attributes. Different types of databases are used in common to store the data. To process the data in real-time continuously, data streaming technologies are developed. With the development of today's large-scale distributed applications handling tons of data, these databases are not viable. Consequently, Big Data is introduced to store, process, and analyze data at a fast speed and also to deal with big users and data growth day by day.

Field Investigation of Bridge Scours in Small and Medium Streams(2) (우리나라 중.소 하천의 세굴특성 조사연구(2))

  • Yeo, Un-Gwang;Gang, Jun-Gu
    • Journal of Korea Water Resources Association
    • /
    • v.32 no.1
    • /
    • pp.49-59
    • /
    • 1999
  • In order to understand the present situation of bridge scouring and to provide the fundamental information for bridge design, in-situ measured data is analyzed for bridge scours at small and medium streams in the heartland of Korea. The physical parameters affecting the bridge scouring such as flow depth, velocity, pier length and width, scouring depth, and the angle between flow and pier are extensively surveyed and measured. According to the locality and the pier type data are classified to analyze. With these data, some important factors for the scour depth such as flow depth, angle and Froude number are investigated and applied to existing formulas proposed by many researchers. In addition, the computational results are compared with the measured and some of the applicable formulas in this region are recommended.

  • PDF

Downlink Space Division Multiple Access with Dynamic Slot Allocation for Multi-User MIMO Systems (복수 사용자 MIMO 시스템을 위한 동적 슬롯 할당 하향링크 공간분할 다중접속 기술)

  • 임민중
    • Journal of the Institute of Electronics Engineers of Korea TC
    • /
    • v.41 no.10
    • /
    • pp.61-67
    • /
    • 2004
  • The next generation cellular wireless communication systems require high data rate transmissions and large system capacities. In order to meet these requirements, multiple antennas can be used at the base and mobile stations, forming MIMO(Multiple Input Multiple Output) channels. This paper proposes a MIMO SDMA(Space Division Multiple Access) technique with dynamic slot allocation which allows the transmitter to efficiently transmit parallel data streams to each of multiple receivers. The proposed technique can increase system capacities significantly by transmitting a larger number of data streams than conventional MIMO techniques while minimizing the performance degradation due to the beamforming dimension reduction.

A Study on the MRC and EGC in Nakagami-m Fading Channel (나까카미-m 페이딩 채널에서 최대비합성과 동이득합성에 관한 연구)

  • Lee, Kwan-Houng;Lee, Myung-Ho
    • Journal of the Korea Society of Computer and Information
    • /
    • v.11 no.5 s.43
    • /
    • pp.195-201
    • /
    • 2006
  • In multicarrier code division multiple access(MC-CDMA), the total system bandwidth is divided into a number of sub-bands, where each subband may use direct-sequence(DS) spreading and each subband signal is transmitted using a subcarrier frequency. In this paper, the system performance analysis of MC-CDMA using to gain combining(EGC) and maximal ratio combining(MRC) method over frequency selective Nakagami-m fading channel is analyzed. In the proposed system, a data sequence is serial-to-parallel converted, and MC-CDMA is used on each of the parallel data streams. The data streams are spread at both the symbol fraction level and at the chip level by the transmitter. In this paper, the compare to analysis,two standard diversity combining techniques, EGC and MRC, The good performance of system using to MRC more than EGC

  • PDF

A Study on Encryption Techniques for Digital Rights Management of MPEG-4 Video Streams (MPEG-4 비디오 스트림의 디지털 저작권 관리를 위한 암호화 기법 연구)

  • Kim Gunhee;Shin Dongkyoo;Shin Dongil
    • The KIPS Transactions:PartC
    • /
    • v.12C no.2 s.98
    • /
    • pp.175-182
    • /
    • 2005
  • This paper presents encryption techniques for digital right management solutions of MPEG-4 streams. MPEG-4 is a format for multimedia streaming and stored in the MPEG-4 file format. We designed three kinds of encryption methods, which encrypt macro blocks (MBs) or motion vectors (MVs) of I-, P-VOPs (Video Object Planes), extracted from the MPEG-4 file format. We used DES to encrypt MPEG-4 data Based on theses three methods, we designed and implemented a DRM solution for an Internet broadcasting service, which enabled a MPEG-4 data streaming, and then compared the results of decryption speed and quality of rendered video sequences to get an optimal encryption method.

Design and Implementation of Intelligent IP Switch with Packet FEC for Ensuring Reliability of ATSC 3.0 Broadcast Streams

  • Lee, Song Yeon;Paik, Jong Ho;Dan, Hyun Seok
    • Journal of Internet Computing and Services
    • /
    • v.20 no.2
    • /
    • pp.21-27
    • /
    • 2019
  • The terrestrial ATSC 3.0 broadcasting system, which is capable of converging broadcast and communication services, uses IP based technology for data transmission between broadcasting equipment. In addition, data transmission between broadcasting equipment uses IP-based technology like existing wired communication network, which has advantageous in terms of equipment construction and maintenance In case IP based data transmission technology is used, however, it may inevitably cause an error that a packet is lost during transmission depending on the network environments. In order to cope with a broadcasting accident caused by such a transmission error or a malfunction of a broadcasting apparatus, a broadcasting system is generally configured as a duplication, which can transmit a normal packet when various types of error may occur. By this reason, correction method of error packets and intelligent switching technology are essential. Therefore, in this paper, we propose a design and implementation of intelligent IP switch for Ensuring Reliability of ATSC 3.0 Broadcast Streams. The proposed intelligent IP consists of IP Stream Analysis Module, ALP Stream Analysis Module, STL Stream Analysis Module and SMPTE 2022-1 based FEC Encoding/Decoding Module.

Research on Relationship of Bed Material and Channel Characteristics (대표 입경과 하도 특성의 관계 분석)

  • Lee, Du-Han;Son, Min-Woo;Kim, Myoung-Hwan;Kim, Chang-Wan
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2006.05a
    • /
    • pp.613-617
    • /
    • 2006
  • Bed material in natural streams is affected by geological characteristics of upstream and acting focre by flow of stream. Acting force in streams are also affected by bed slope and discharge of streams. Yamamoto(1994) suggested that channel reaches with similar slope share similar characteristics values in representative bed material size, tractive force, channel width and depth. He also suggested that main factors dominating channel characteristics are mean annual discharge, epresentative bed material size and bed slope. Bed material shows physical and ecological characteristics of channels. In this research, characteristics of bed material in natural or close to natural streams were studied and compared with Janpanese stream data. In the result, characteristics of gravel and sand material can be presented in the term of non-dimensional tractive force, bed slope and bed material size.

  • PDF

Test Stream Generation Method for UHDTV Broadcasting Standard (UHD 방송 표준 검증을 위한 시험 스트림 개발에 관한 연구)

  • Kim, Jaeil;Bae, Sungpo;Yang, Jinyoung;Kwon, Donghyun
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.41 no.7
    • /
    • pp.823-832
    • /
    • 2016
  • This paper presents a generation method of test streams for verifying conformance of an UHD broadcasting receiver including decoders for video and audio as well as parsers for PSIP and closed caption data. The proposed test streams for video/audio signals can evaluate conformance of HEVC, AC-3 and DTS-HD standards. Especially, test streams for HEVC video compression standard can be used for testing syntax compliance and error resilience for a HEVC decoder. Moreover, the proposed test streams for system/program and closed caption can be applied for verifying parsers for PSIP and CEA-708 standards.

Diagnosis of Vegetation for the Ecological Rehabilitation of Streams - The Case of the Namhan River - (하천의 생태적 복원을 위한 식생학적 진단 - 남한강을 중심으로 -)

  • Myung, Hyun;Kwon, Sang-Zoon;Kim, Chang-Hwan
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.30 no.5
    • /
    • pp.98-106
    • /
    • 2002
  • This study was designed to present a river model with the aim of restoring the ecosystem and improving the landscape along the urban rivers on the basin of the Namhanl river, a core life channel for the National Capital regin. The revelation of botanical status, transition trend and correlation of plants might lead to providing the urban river restoration projects and ecological river formation projects with basic data for a model of ideal aquatic ecology and landscape. The outcomes of this study could be summed up as follows: 1. The plant communities of river flora found on the basin of the Namhan river could be categorized largely into 39 plant communities 2. Most diverse plants were distributed in the rivers lower reaches such as Unsim-ri where the protected zone of Paldang reservoir for city water borders the body of Jodae swamp where natural streams flow nearby. 3. One of the greatest threats to the biomass of the River Namhan is that the communities of such invasive alien plants as Panicum dichotomiflorum and Ambrosia artemisiifolia var. elatior dominate most parts of the area, a fact that has resulted in a reduced variety of plants and will, sooner or later, be likely to cause an ecological imbalance in the hitherto healthy Aquatic plant life. It is highly advisable to gradually diversify the species of trees and to return the plants bark to their original state since, besides the naturalized plants, plantations afforested with Erigeron canadensis and Erigeron annuus stocks in buckwheat field, Robinia Pseudo-accacia in riverside forest, Pinus rigida in terrestrial forest on the river basin and Larix leptolepis are anticipated to act as interceptors of normal migrations of the fluvial and terrestrial ecosystems. Finally, it seems also desirable to continue to explore the relationship between fluvial and terrestrial ecologies with the purpose of building up a model of natural streams in urban areas based on the surveyed factors for plant life, soil and landscape and, moreover, on the forecasting for overall influences derived from the rotation upon the ecosystem.

Analysis of Drying Streams Characteristics Using a GIS (GIS를 이용한 건천화 하천의 특성분석)

  • Jung, Kwan-Sue;Cho, Hyo-Seob;Kim, Jeong-Yup;Shim, Myung-Pil
    • Journal of Korea Water Resources Association
    • /
    • v.36 no.6
    • /
    • pp.1083-1095
    • /
    • 2003
  • The analysis of drying stream characteristics for about 500 streams from field survey data with 19 items has been fulfilled. Also, a study area has been determined, and criteria of estimation has been established : criteria such as, available hydrological data, the size of stream lengths and basin areas and regional characteristics. Then they are applied to designated study areas. The final selected study areas are 8 basins. The analysis of drying stream characteristics using a GIS has been applied to 5 basins in which spacial data is comparatively implemented among the final 8 target catchments. The spacial analysis using a GIS is applied to stream slopes for upstream and downstram at weirs, overlaying the map of buffering stream networks and ground water pump stations map, sinuosity of drying stream. As a result of drying streams survey analysis, drying stream characteristics are followed; levee types are earth and natural, cross sectional shapes are trapezoid, stream bed materials are gravels and sands, facilities in streams are weirs. As a result of GIS analysis, stream slopes are comparatively larger downstream than upstream close to weirs. There are arranged ground water pump stations less than 500m from stream networks. Also the average of sinuosity for each drying stream is in the range of 1.229∼1.475, comparatively a serious.