• Title/Summary/Keyword: real-time databases

Search Result 185, Processing Time 0.022 seconds

Hazelcast Vs. Ignite: Opportunities for Java Programmers

  • Maxim, Bartkov;Tetiana, Katkova;S., Kruglyk Vladyslav;G., Murtaziev Ernest;V., Kotova Olha
    • International Journal of Computer Science & Network Security
    • /
    • v.22 no.2
    • /
    • pp.406-412
    • /
    • 2022
  • Storing large amounts of data has always been a big problem from the beginning of computing history. Big Data has made huge advancements in improving business processes by finding the customers' needs using prediction models based on web and social media search. The main purpose of big data stream processing frameworks is to allow programmers to directly query the continuous stream without dealing with the lower-level mechanisms. In other words, programmers write the code to process streams using these runtime libraries (also called Stream Processing Engines). This is achieved by taking large volumes of data and analyzing them using Big Data frameworks. Streaming platforms are an emerging technology that deals with continuous streams of data. There are several streaming platforms of Big Data freely available on the Internet. However, selecting the most appropriate one is not easy for programmers. In this paper, we present a detailed description of two of the state-of-the-art and most popular streaming frameworks: Apache Ignite and Hazelcast. In addition, the performance of these frameworks is compared using selected attributes. Different types of databases are used in common to store the data. To process the data in real-time continuously, data streaming technologies are developed. With the development of today's large-scale distributed applications handling tons of data, these databases are not viable. Consequently, Big Data is introduced to store, process, and analyze data at a fast speed and also to deal with big users and data growth day by day.

Implementation of an integrated monitoring system that support heterogeneous databases and convenient visualization (이기종 데이터베이스와 시각화 편의를 제공하는 통합 모니터링 시스템 구현)

  • Jeon, Seun;Kim, Minyoung;Park, Yoo-Hyun
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.25 no.11
    • /
    • pp.1463-1470
    • /
    • 2021
  • With the development of ICT technology, a monitoring system to check the status of an object to be managed in real time in various industrial fields is widely used. Existing monitoring systems implemented individual systems according to monitoring targets, but recently, monitoring systems have been implemented using open sources such as Prometheus and Grafana. When using Prometheus and Grafana, many parts become more convenient compared to the existing monitoring system development method, but there are still problems. In this paper, to solve this problem, we propose an integrated monitoring system that supports Prometheus and Grafana. The proposed system is a detailed module that collects, stores, visualizes, and manages data to be monitored, and each module is implemented so that roles can be divided and existing problems can be solved. The proposed system can conveniently manage and monitor monitoring targets stored in heterogeneous databases, and create dashboards through simple operation.

Effects of Culture Mechanism of Cinnamomum kanehirae and C. camphora on the Expression of Genes Related to Terpene Biosynthesis in Antrodia cinnamomea

  • Zhang, Zhang;Wang, Yi;Yuan, Xiao-Long;Luo, Ya-Na;Luo, Ma-Niya;Zheng, Yuan
    • Mycobiology
    • /
    • v.50 no.2
    • /
    • pp.121-131
    • /
    • 2022
  • The rare edible and medicinal fungus Antrodia cinnamomea has a substantial potential for development. In this study, Illumina HiSeq 2000 was used to sequence its transcriptome. The results were assembled de novo, and 66,589 unigenes with an N50 of 4413 bp were obtained. Compared with public databases, 6,061, 3,257, and 2,807 unigenes were annotated to the Non-Redundant, Gene Ontology, and Kyoto Encyclopedia of Genes and Genomes databases, respectively. The genes related to terpene biosynthesis in the mycelia of A. cinnamomea were analyzed, and acetyl CoA synthase (ACS2 and ACS4), hydroxymethylglutaryl CoA reductase (HMGR), farnesyl transferase (FTase), and squalene synthase (SQS) were found to be upregulated in XZJ (twig of C. camphora) and NZJ (twig of C. kanehirae). Moreover, ACS5 and 2,3-oxidized squalene cyclase (OCS) were highly expressed in NZJ, while heme IX farnesyl transferase (IX-FIT) and ACS3 were significantly expressed in XZJ. The differential expression of ACS1, ACS2, HMGR, IX-FIT, SQS, and OCS was confirmed by real-time quantitative reverse transcription PCR. This study provides a new concept for the additional exploration of the molecular regulatory mechanism of terpenoid biosynthesis and data for the biotechnology of terpenoid production.

The Design of Manufacturing Simulation Modeling Based on Digital Twin Concept (Digital Twin 개념을 적용한 제조환경 시뮬레이션 모형 설계)

  • Hwang, Sung-Bum;Jeong, Suk-Jae;Yoon, Sung-Wook
    • Journal of the Korea Society for Simulation
    • /
    • v.29 no.2
    • /
    • pp.11-20
    • /
    • 2020
  • As the manufacturing environment becomes more complex, traditional simulation models alone are having a lot of difficulties in reflecting real-time manufacturing situations. Although the Digital Twin concept is actively discussed as an alternative to overcome theses issues, many studies are being carried out only in the product design phase. This research presents a Digital Twin-based manufacturing environment framework for applying the Digital Twin concept to the manufacturing process. Twin model that is operated in virtual space, physical system and databases describing the actual manufacturing environment, are proposed as detailed components that make up the framework. To check the applicability of proposed framework, a simple Digital Twin-based manufacturing system was simulated in a conveyor system using Arena software and Excel VBA. Experiment results have shown that the twin model is transmitted real time data from the physical system via DB and were operating in the same time unit. The Excel VBA fitted parameters defined by cycle time based on historical data that real-time and training data are being accumulated together. This study proposes operating method of digital twin model through the simple experiment examples. The results lead to the applicability of Digital twin model.

High-Volume Data Processing using Complex Event Processing Engine in the Web of Next Generation (차세대 웹 환경에서 Complex Event Processing 엔진을 이용한 대용량데이터 처리)

  • Kang, Man-Mo;Koo, Ra-Rok;Lee, Dong-Hyung
    • Journal of KIISE:Databases
    • /
    • v.37 no.6
    • /
    • pp.300-307
    • /
    • 2010
  • According to growth of web, data processing technology is developing. In the Web of next generation, high-speed or high-volume data processing technologies for various wire-wireless users, USN and RFID are developing too. In this paper, we propose a high-volume data processing technology using Complex Event Processing(CEP) engine. CEP is the technology to process complex events. CEP Engine is the following characteristics. First it collects a high-volume event(data). Secondly it analyses events. Finally it lets event connect to new actions. In other words, CEP engine collects, analyses, filters high-volume events. Also it extracts events using pattern-matching for registered events and new events. As the results extracted. We use it by an input event of other work, real-time response for demanded event and can trigger to database for only valid data.

Facial Expression Recognition using Face Alignment and AdaBoost (얼굴정렬과 AdaBoost를 이용한 얼굴 표정 인식)

  • Jeong, Kyungjoong;Choi, Jaesik;Jang, Gil-Jin
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.51 no.11
    • /
    • pp.193-201
    • /
    • 2014
  • This paper suggests a facial expression recognition system using face detection, face alignment, facial unit extraction, and training and testing algorithms based on AdaBoost classifiers. First, we find face region by a face detector. From the results, face alignment algorithm extracts feature points. The facial units are from a subset of action units generated by combining the obtained feature points. The facial units are generally more effective for smaller-sized databases, and are able to represent the facial expressions more efficiently and reduce the computation time, and hence can be applied to real-time scenarios. Experimental results in real scenarios showed that the proposed system has an excellent performance over 90% recognition rates.

A Research on the Development of a GIS-based Real-time Urban Water Management System (GIS기반 실시간 도시용수 관리시스템 구현에 관한 연구)

  • Kim, Seong-Hoon;Kim, Eui-Myoung;Lim, Yong-Min
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.12 no.11
    • /
    • pp.5290-5299
    • /
    • 2011
  • The ultimate purpose of this research is to propose a method to improve water supply management efficiency. As an effort to solve this comprehensive problem, the purposes of this paper are summarized into the following two main subjects. One is the development of a series of demand forecasting models targeting for each theme of urban water such as residential, commercial, industrial water. The other is the suggestion on the development and utilization plan of a GIS-based information system where the developed models are incorporated. For these, a series of efforts were performed such as evaluating and choosing of the candidate field areas, selecting a proper sensor and an installation point for each theme. Installed are sensors, a wireless communication infrastructure, and a field data acquisition and management server. Developed are a protocol for the wireless communication and a real-time data monitoring system. Nextly, the urban water facility-related and other necessary data were handled to make those into a series of GIS-ready databases. Finally, a GIS-based management system was designed and a blueprint for the implementation is suggested.

Implementation of Mobile Digital Signage System on the Moving Vehicle (차량 탑재형 모바일 디지털 사이니지 구현)

  • Kim, Hee Dong;Kim, Cha Sung
    • Journal of Information Technology Services
    • /
    • v.14 no.4
    • /
    • pp.257-267
    • /
    • 2015
  • We propose a vehicle-mounted, location-aware mobile digital signage system that can be used for public transportation through mobile communication. This paper proposes the installations of the LED display panels at the backside of the bus., which display traffic information to cars behind the bus. Information to be displayed would include, but is not limited to, road information, public commercials and private commercials. We propose the system architecture and further implement the prototype of mobile digital signage system for demonstration. The system is based on the Client-Server system. Each bus has a client terminal which detects the current location by a GPS receiver and sends its location information to the server using mobile communication function. The terminal device receives advertisements and traffic information from the server and displays it to the large LCD or LED panel installed at the inside and outside of the bus. We use the Android smartphone as a client system, which inherently equipped with GPS and mobile communication function. GPS detects the location of bus and reports its geo-location data to the traffic information center server via a wireless communication network. On the server side, we developed a specially designed control server, where it communicates with the other traffic information center and updates and manages the databases contents being displayed by each position. The server contains location dependent variable information and returns selected information back to the vehicle in real time. Spatial database is used to process location based data. Server system periodically receives the real time traffic information from the road information center database. And it process the information by bus location and bus line number. In this paper, we propose a mobile digital signage service and explain the system implementation of this service.

Design and Implementation of an Efficient Buffer Replacement Method for Real-time Multimedia Databases Environments (실시간 멀티미디어 데이터베이스 환경을 위한 효율적인 버퍼교체 기법 설계 및 구현)

  • 신재룡;피준일;유재수;조기형
    • Journal of Korea Multimedia Society
    • /
    • v.5 no.4
    • /
    • pp.372-385
    • /
    • 2002
  • In this paper, we propose an efficient buffer replacement method for the real-time multimedia data. The proposed method has multi level priority to consider the real-time characteristics. Each priority level is divided into a cold data set that is likely to be referenced for the first time and a hot data set that is likely to be re-referenced. An operation to select the victim data is sequentially executed from the cold set with the minimum priority level to the hot set with the maximum Priority level. It is chosen only at the lower level than or equal to the priority of the transaction that requests a buffer allocation. In the cold set, our method selects a media that has the maximum size in the level for a target of victim first of all. And in the hot set, our method selects a medium that has the maximum interval of the reference first of all. Since it maintains many popular media in the limited buffer space, the buffer hit ratio is increased. It also manages many service requests. As a result, our method improves the overall performance of the system. We compare the proposed method with the Priority-Hints method in terms of the buffer hit ratio and the deadline missing ratio of transactions. It is shown through the performance evaluation that our method outperforms the existing methods.

  • PDF

Performance Analysis of the Time-series Pattern Index File for Content-based Music Genre Retrieval (내용기반 음악장르 검색에서 시계열 패턴 인덱스 화일의 성능 분석)

  • Kim, Young-In;Kim, Seon-Jong
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.11 no.5
    • /
    • pp.18-27
    • /
    • 2006
  • Rapid increase of the amount of music data demands for a new method that allows efficient similarity retrieval of music genre using audio features in music databases. To build this similarity retrieval, an indexing techniques that support audio features as a time-series pattern and data mining technologies are needed. In this paper, we address the development of a system that retrieves similar genre music based on the indexing techniques. We first propose the structure of content-based music genre retrieval system based on the time-series pattern index file and data mining technologies. In addition, we implement the time-series pattern index file using audio features and present performance analysis of the time-series pattern index file for similar genre retrieval. The experiments are performed on real data to verify the performance of the proposed method.

  • PDF