• Title/Summary/Keyword: Real-time data analysis

Search Result 2,797, Processing Time 0.03 seconds

Development of a Limit Order Book Analysis Tool for Automated Stock Trading Systems

  • Gyu-Sang Cho
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.16 no.3
    • /
    • pp.363-369
    • /
    • 2024
  • In this paper, we develope a LOB(Limit Order Book) analyzing tool for an automated trading system, which features real-time and offline analysis of LOB data in conjunction with execution data. The 10-tier LOB data analyzer developed in this paper, which contains ask/bid prices and the execution data, receivs transaction requests in real-time from the Kiwoom Open API+ server. In the OnReceiveTrData event, the transaction data from the server is received and processed. The real-time data, triggered by the transaction, is received and processed in the OnReceiveRealData event. These two types of data are stored in a database and replayed in the same way as if it were a real-time situation in simulation mode. The LOB data are selectively read and analyzed in a necessary time points. The tool provides various features such as bar chart analysis and pattern analysis of the total shares on the bid side and ask side, which are used to develop a tool to accurately determine the timing of stock trading.

Road Surface Data Collection and Analysis using A2B Communication in Vehicles from Bearings and Deep Learning Research

  • Young-Min KIM;Jae-Yong HWANG;Sun-Kyoung KANG
    • Korean Journal of Artificial Intelligence
    • /
    • v.11 no.4
    • /
    • pp.21-27
    • /
    • 2023
  • This paper discusses a deep learning-based road surface analysis system that collects data by installing vibration sensors on the 4-axis wheel bearings of a vehicle, analyzes the data, and appropriately classifies the characteristics of the current driving road surface for use in the vehicle's control system. The data used for road surface analysis is real-time large-capacity data, with 48K samples per second, and the A2B protocol, which is used for large-capacity real-time data communication in modern vehicles, was used to collect the data. CAN and CAN-FD commonly used in vehicle communication, are unable to perform real-time road surface analysis due to bandwidth limitations. By using A2B communication, data was collected at a maximum bandwidth for real-time analysis, requiring a minimum of 24K samples/sec for evaluation. Based on the data collected for real-time analysis, performance was assessed using deep learning models such as LSTM, GRU, and RNN. The results showed similar road surface classification performance across all models. It was also observed that the quality of data used during the training process had an impact on the performance of each model.

Real-Time Characteristic Analysis of a DCS Communication Network for Nuclear Power Plants (원자력 발전소 분산 제어 시스템을 위한 네트워크의 실시간 특성 해석)

  • Lee, Sung-Woo;Yim, Han-Suck
    • The Transactions of the Korean Institute of Electrical Engineers A
    • /
    • v.48 no.5
    • /
    • pp.650-657
    • /
    • 1999
  • In this paper, a real-time communication method using a PICNET-NP(Plant Instrumentation and Control Network for Nuclear Power plant) is proposed with an analysis of the control network requirements of DCS(Distributed Control System) in unclear power plants. The method satisfies deadline in case of worst data traffics by considering aperiodic and periodic real-time data and others.

  • PDF

Real-Time Characteristic Analysis of a DCS Communication Network for Nuclear Power Plants (원자력 발전소 디지털 제어 시스템을 위한 네트워크의 실시간 특성 해석)

  • Lee, Sung-Woo;Kim, Seok-Gon;Song, Seong-Il
    • Proceedings of the KIEE Conference
    • /
    • 2003.11c
    • /
    • pp.797-801
    • /
    • 2003
  • In this paper, a real-time communication method using a PICNET-NP (Plant Instrumentation and Control Network for Nuclear Power plant) is proposed with an analysis of the control network requirements of DCS (Distributed Control System) in nuclear power plants. The method satisfies deadline in case of worst data traffics by considering aperiodic and periodic real-time data and others.

  • PDF

A Realtime Analytical System of Football Game

  • Min, Dae-kee
    • Communications for Statistical Applications and Methods
    • /
    • v.8 no.2
    • /
    • pp.557-564
    • /
    • 2001
  • The objective of he study is to record the real conditions along with the soccer ball that is, each player's ball keeping time, the number football keeping, accuracy of passing to other player, direction, etc., on a real-time basis, measure them in numbers and get necessary analyzed output as much as one needs. The study consists of the following stages: (1) Record the data by drawing through Visual Interface on a real-time basis; (2) Graphic windows to display the recorded data item by item in graphic; (3) Form windows to display the individual or team scores anytime when needed; (4) Windows to display the analyzed data in visualized form. The effect of the study is threefold: (1) It inputs all the game-related data on a real-time basis, which was impossible before and shows analyzed contents during the game enabling each tea manager o use; (2) In cse of TV broadcasting or newspaper articles, it explains objectively the situations of he game to the TV viewers or readers; (3) After the game, it provides importance information on each team's playing ability and individual player's technical improvement through data analysis.

  • PDF

InTouch HMI Development to Real-Time Power System Analysis (실시간 전력 계통 해석을 위한 InTouch HMI 구현)

  • Ahn, Chang-Han;Lee, Sang-Deok;Park, Ji-Ho;Chang, Byung-Hoon;Lee, Hyun-Chul;Lee, Geun-Joon;Baek, Young-Sik
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.58 no.12
    • /
    • pp.2322-2327
    • /
    • 2009
  • Uncertainty of power system operation increases due to complexity and facilities diversification in the power system. Therefore the importance of SCADA(Supervisory Control and Data Acquisition) system which obtain and manage the actual data in real-time is very important. Accordingly in the studies of power system analysis, the efforts to include real-time power system analysis in simulation and applications are made in many ways. The real-time communication characteristics of SCADA system is considered so as to develop the power system analysis program that matches actual system conditions. The observation and management of SCADA system is realized by Intouch which is mainly used for factory automation and PSS/E(Power System Simulator for Engineers) provides real time system data. SQL DB and Python language is used for real-time communication between the softwares. It is very comfortable to use the various functions in Intouch WindowMaker.

Data anomaly detection and Data fusion based on Incremental Principal Component Analysis in Fog Computing

  • Yu, Xue-Yong;Guo, Xin-Hui
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.10
    • /
    • pp.3989-4006
    • /
    • 2020
  • The intelligent agriculture monitoring is based on the perception and analysis of environmental data, which enables the monitoring of the production environment and the control of environmental regulation equipment. As the scale of the application continues to expand, a large amount of data will be generated from the perception layer and uploaded to the cloud service, which will bring challenges of insufficient bandwidth and processing capacity. A fog-based offline and real-time hybrid data analysis architecture was proposed in this paper, which combines offline and real-time analysis to enable real-time data processing on resource-constrained IoT devices. Furthermore, we propose a data process-ing algorithm based on the incremental principal component analysis, which can achieve data dimensionality reduction and update of principal components. We also introduce the concept of Squared Prediction Error (SPE) value and realize the abnormal detection of data through the combination of SPE value and data fusion algorithm. To ensure the accuracy and effectiveness of the algorithm, we design a regular-SPE hybrid model update strategy, which enables the principal component to be updated on demand when data anomalies are found. In addition, this strategy can significantly reduce resource consumption growth due to the data analysis architectures. Practical datasets-based simulations have confirmed that the proposed algorithm can perform data fusion and exception processing in real-time on resource-constrained devices; Our model update strategy can reduce the overall system resource consumption while ensuring the accuracy of the algorithm.

A Study on the Calculation and Provision of Accruals-Quality by Big Data Real-Time Predictive Analysis Program

  • Shin, YeounOuk
    • International journal of advanced smart convergence
    • /
    • v.8 no.3
    • /
    • pp.193-200
    • /
    • 2019
  • Accruals-Quality(AQ) is an important proxy for evaluating the quality of accounting information disclosures. High-quality accounting information will provide high predictability and precision in the disclosure of earnings and will increase the response to stock prices. And high Accruals-Quality, such as mitigating heterogeneity in accounting information interpretation, provides information usefulness in capital markets. The purpose of this study is to suggest how AQ, which represents the quality of accounting information disclosure, is transformed into digitized data in real-time in combination with IT information technology and provided to financial analyst's information environment in real-time. And AQ is a framework for predictive analysis through big data log analysis system. This real-time information from AQ will help financial analysts to increase their activity and reduce information asymmetry. In addition, AQ, which is provided in real time through IT information technology, can be used as an important basis for decision-making by users of capital market information, and is expected to contribute in providing companies with incentives to voluntarily improve the quality of accounting information disclosure.

A study on the MD&A Disclosure Quality in real-time calculated and provided By Programming Technology

  • Shin, YeounOuk
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.11 no.3
    • /
    • pp.41-48
    • /
    • 2019
  • The Management Discussion and Analysis(MD&A) provides investors with an opportunity to gain insight into the company from a manager's perspective and enables short-term and long-term analysis of the business. And MD&A is an important channel through which companies and investors can communicate, providing a useful source of information for analyzing financialstatements. MD&A is measured by the quality of disclosure and there are many previous studies on the usefulness of disclosure information. Therefore, it is very important for the financial analyst who is the representative information user group in the capital market that MD&A Disclosure Quality is measured in real-time in combination with IT information technology and provided timely to financial analyst. In this study, we propose a method that real-time data is converted to digitalized data by combining MD&A disclosure with IT information technology and provided to financial analyst's information environment in real-time. The real-time information provided by MD&A can help the financial analysts' activities and reduce information asymmetry.

Effective Real-Time Data Transmission in the Foundation Fieldbus (Foundation Fieldbus에서 효율적인 실시간 데이터 전송)

  • 홍승호
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.52 no.11
    • /
    • pp.644-649
    • /
    • 2003
  • This study develops an analytical model for the delay analysis of real-time data in the token-passing service of Foundation Fieldbus(FF). Using the analytical model, this study proposes a network design scheme of FF Two design criteria are introduced in this study; one is the average delay of real-time data, and the other is the maximum allowable delay of real-time data. The network design scheme determines the network parameters that satisfies the performance requirements given by these design criteria.