• Title/Summary/Keyword: Real-Time Data

Search Result 9,307, Processing Time 0.044 seconds

Real-time Acquisition of Three Dimensional NMR Spectra by Non-uniform Sampling and Maximum Entropy Processing

  • Jee, Jun-Goo
    • Bulletin of the Korean Chemical Society
    • /
    • v.29 no.10
    • /
    • pp.2017-2022
    • /
    • 2008
  • Of the experiments to shorten NMR measuring time by sparse sampling, non-uniform sampling (NUS) is advantageous. NUS miminizes systematic errors which arise due to the lack of samplings by randomization. In this study, I report the real-time acquisition of 3D NMR data using NUS and maximum-entropy (MaxEnt) data processing. The real-time acquisition combined with NUS can reduce NMR measuring time much more. Compared with multidimensional decomposition (MDD) method, which was originally suggested by Jaravine and Orekhov (JACS 2006, 13421-13426), MaxEnt is faster at least several times and more suitable for the realtime acquisition. The designed sampling schedule of current study makes all the spectra during acquisition have the comparable resulting resolutions by MaxEnt. Therefore, one can judge the quality of spectra easily by examining the intensities of peaks. I report two cases of 3D experiments as examples with the simulated subdataset from experimental data. In both cases, the spectra having good qualitie for data analysis could be obtained only with 3% of original data. Its corresponding NMR measuring time was 8 minutes for 3D HNCO of ubiquitin.

The Real -Time Dispersion Modeling System

  • Koo, Youn-Seo
    • Journal of Korean Society for Atmospheric Environment
    • /
    • v.18 no.E4
    • /
    • pp.215-221
    • /
    • 2002
  • The real-time modeling system, named AirWatch System, has been developed to evaluate the environmental impact from a large source. It consists of stack TMS (TeleMetering System) that measures the emission data from the source, AWS (Automatic Weather Station) that monitors the weather data and computer system with the dispersion modeling software. The modeling theories used in the system are Gaussian plume and puff models. The Gaussian plume model is used for the dispersion in the simple terrain with a point meteorological data while the puff model is for the dispersion in complex terrain with three dimensional wind fields. The AirWatch System predicts the impact of the emitted pollutants from the large source on the near-by environment on the real -time base and the alarm is issued to control the emission rate if the calculated concentrations exceed the modeling significance level.

Real-Time Transmission Method of wireless Control Network Using Zigbee Networks (지그비 망 기반의 무선 제어망 설계를 위한 실시간 전송 기법에 대한 연구)

  • Lee, Jung-Il;Jung, Ji-Won;Kim, Dong-Sung
    • Proceedings of the IEEK Conference
    • /
    • 2007.07a
    • /
    • pp.39-40
    • /
    • 2007
  • In this Paper a transmission algorithm based on Zigbee Networks is proposed. The superframe of IEEE 802. 15.4 is applied to the transmission method of real-time mixed data (periodic data, sporadic data, and non real-time message). The simulation results show the real-time performance of sporadic data is improved by using the proposed transmission algorithm.

  • PDF

Application Of Open Data Framework For Real-Time Data Processing (실시간 데이터 처리를 위한 개방형 데이터 프레임워크 적용 방안)

  • Park, Sun-ho;Kim, Young-kil
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.23 no.10
    • /
    • pp.1179-1187
    • /
    • 2019
  • In today's technology environment, most big data-based applications and solutions are based on real-time processing of streaming data. Real-time processing and analysis of big data streams plays an important role in the development of big data-based applications and solutions. In particular, in the maritime data processing environment, the necessity of developing a technology capable of rapidly processing and analyzing a large amount of real-time data due to the explosion of data is accelerating. Therefore, this paper analyzes the characteristics of NiFi, Kafka, and Druid as suitable open source among various open data technologies for processing big data, and provides the latest information on external linkage necessary for maritime service analysis in Korean e-Navigation service. To this end, we will lay the foundation for applying open data framework technology for real-time data processing.

EXCUTE REAL-TIME PROCESSING IN RTOS ON 8BIT MCU WITH TEMP AND HUMIDITY SENSOR

  • Kim, Ki-Su;Lee, Jong-Chan
    • Journal of the Korea Society of Computer and Information
    • /
    • v.24 no.11
    • /
    • pp.21-27
    • /
    • 2019
  • Recently, embedded systems have been introduced in various fields such as smart factories, industrial drones, and medical robots. Since sensor data collection and IoT functions for machine learning and big data processing are essential in embedded systems, it is essential to port the operating system that is suitable for the function requirements. However, in embedded systems, it is necessary to separate the hard real-time system, which must process within a fixed time according to service characteristics, and the flexible real-time system, which is more flexible in processing time. It is difficult to port the operating system to a low-performance embedded device such as 8BIT MCU to perform simultaneous real-time. When porting a real-time OS (RTOS) to a low-specification MCU and performing a number of tasks, the performance of the real-time and general processing greatly deteriorates, causing a problem of re-designing the hardware and software if a hard real-time system is required for an operating system ported to a low-performance MCU such as an 8BIT MCU. Research on the technology that can process real-time processing system requirements on RTOS (ported in low-performance MCU) is needed.

Interactive chinese Character Distance Learning System on the WWW (WWW에서 대화형 원격 한자학습 시스템)

  • Gang, Jong-Gyu;Park, Sang-U;Kim, Hyeon-Suk;Kim, Gye-Hwan;Jin, Seong-Il
    • The Transactions of the Korea Information Processing Society
    • /
    • v.4 no.3
    • /
    • pp.698-708
    • /
    • 1997
  • To construct distance learing servers and provide their service using the WWW(World Wide Web), it is necessary that we use a real-time processing mehtod rather than the processing after downloading method for multimedia data transmission and their processing.To fulfill such requirements, we developed a real-time processing muduloe for distance education which can process multimedia data in AVI and WAV formats in distrbuted eviroments.We in turn developede a real-time WWW server that can provide real-time services of hypertxt and motion poctures data in temsw of adding the real-time porcessing modute to the MuX framework and intergarting them with WWW. We frnally developed as distance lerming system for real-time interactive chinese character learming, bassed on the results from the pre-vious steps.

  • PDF

Real-Time Stock Price Prediction using Apache Spark (Apache Spark를 활용한 실시간 주가 예측)

  • Dong-Jin Shin;Seung-Yeon Hwang;Jeong-Joon Kim
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.23 no.4
    • /
    • pp.79-84
    • /
    • 2023
  • Apache Spark, which provides the fastest processing speed among recent distributed and parallel processing technologies, provides real-time functions and machine learning functions. Although official documentation guides for these functions are provided, a method for fusion of functions to predict a specific value in real time is not provided. Therefore, in this paper, we conducted a study to predict the value of data in real time by fusion of these functions. The overall configuration is collected by downloading stock price data provided by the Python programming language. And it creates a model of regression analysis through the machine learning function, and predicts the adjusted closing price among the stock price data in real time by fusing the real-time streaming function with the machine learning function.

Review on Data Acquisition of Renewable Power Generators (신재생발전기의 데이터 취득방안에 대한 고찰)

  • Lee, Bong-Kil;Kim, Wan-Hong;Choi, Joon-Ho
    • Journal of the Korean Solar Energy Society
    • /
    • v.40 no.3
    • /
    • pp.1-20
    • /
    • 2020
  • In accordance with the Government's policy, renewable power generation is expanding very largely. This leads to increasing uncertainty in the power market and power system owing to the intermittent and fluctuating output characteristics of renewable power generators. Data on the acquisition of renewable power generators can be largely classified according to the operation of the power market and power system. Data on the settlement for the payment for the power amount are acquired in the power market, and real-time data for monitoring the status and output of the generators are acquired in the power system. However, renewable power generators operating in the power market have different acquisition cycles depending on the method of communication of the power meter. They acquire data only for settlement purposes and have no real-time data, which requires improvement. In this paper, the acquisition status is reviewed by classifying the data of renewable power generators into settlement and real-time data. In addition, measures and acquisition criteria for real-time data of renewable power generators for improving the acquisition method are proposed.

On Benchmarking of Real-time Mechanisms in Various Periodic Tasks for Real-time Embedded Linux (실시간 임베디드 리눅스에서 다양한 주기적 타스크의 실시간 메커니즘 성능 분석)

  • Koh, Jae-Hwan;Choi, Byoung-Wook
    • The Journal of Korea Robotics Society
    • /
    • v.7 no.4
    • /
    • pp.292-298
    • /
    • 2012
  • It is a real-time system that the system correctness depends not only on the correctness of the logical result of the computation but also on the result delivery time. Real-time Operating System (RTOS) is a software that manages the time of a microprocessor to ensure that the most important code runs first so that it is a good building block to design the real-time system. The real-time performance is achieved by using real-time mechanisms through data communication and synchronization of inter-task communication (ITC) between tasks. Therefore, test on the response time of real-time mechanisms is a good measure to predict the performance of real-time systems. This paper aims to analysis the response characteristics of real-time mechanisms in kernel space for real-time embedded Linux: RTAI and Xenomai. The performance evaluations of real-time mechanism depending on the changes of task periods are conducted. Test metrics are jitter of periodic tasks and response time of real-time mechanisms including semaphore, real-time FIFO, Mailbox and Message queue. The periodicity of tasks is relatively consistent for Xenomai but RTAI reveals smaller jitter as an average result. As for real-time mechanisms, semaphore and message transfer mechanism of Xenomai has a superior response to estimate deterministic real-time task execution. But real-time FIFO in RTAI shows faster response. The results are promising to estimate deterministic real-time task execution in implementing real-time systems using real-time embedded Linux.

Data anomaly detection and Data fusion based on Incremental Principal Component Analysis in Fog Computing

  • Yu, Xue-Yong;Guo, Xin-Hui
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.10
    • /
    • pp.3989-4006
    • /
    • 2020
  • The intelligent agriculture monitoring is based on the perception and analysis of environmental data, which enables the monitoring of the production environment and the control of environmental regulation equipment. As the scale of the application continues to expand, a large amount of data will be generated from the perception layer and uploaded to the cloud service, which will bring challenges of insufficient bandwidth and processing capacity. A fog-based offline and real-time hybrid data analysis architecture was proposed in this paper, which combines offline and real-time analysis to enable real-time data processing on resource-constrained IoT devices. Furthermore, we propose a data process-ing algorithm based on the incremental principal component analysis, which can achieve data dimensionality reduction and update of principal components. We also introduce the concept of Squared Prediction Error (SPE) value and realize the abnormal detection of data through the combination of SPE value and data fusion algorithm. To ensure the accuracy and effectiveness of the algorithm, we design a regular-SPE hybrid model update strategy, which enables the principal component to be updated on demand when data anomalies are found. In addition, this strategy can significantly reduce resource consumption growth due to the data analysis architectures. Practical datasets-based simulations have confirmed that the proposed algorithm can perform data fusion and exception processing in real-time on resource-constrained devices; Our model update strategy can reduce the overall system resource consumption while ensuring the accuracy of the algorithm.