• Title/Summary/Keyword: Data Processing Time

Search Result 5,280, Processing Time 0.03 seconds

Implementation of Query Processing System in Temporal Databases (시간지원 데이터베이스의 질의처리 시스템 구현)

  • Lee, Eon-Bae;Kim, Dong-Ho;Ryu, Keun-Ho
    • The Transactions of the Korea Information Processing Society
    • /
    • v.5 no.6
    • /
    • pp.1418-1430
    • /
    • 1998
  • Temporal databases support an efficient historical management by means of valid time and transaction time. Valid time stands for the time when a data happens in the real world. And transaction time stands for the time when a data is stored in the database, Temporal Query Processing System(TQPS) should be extended so as tc process the temporal operations for the historical informations in the user query as well as the conventional relational operations. In this paper, the extended temporal query processing systems which is based on the previous temporal query processing system for TQuel(Temporal Query Language) consists of the temporal syntax analyzer, temporal semantic analyzer, temporal code generator, and temporal interpreter is to be described, The algorithm for additional functions such as transaction time management, temporal aggregates, temporal views, temporal joins and the heuristic optimization functions and their example how to be processed is shown.

  • PDF

Dynamic Load Management Method for Spatial Data Stream Processing on MapReduce Online Frameworks (맵리듀스 온라인 프레임워크에서 공간 데이터 스트림 처리를 위한 동적 부하 관리 기법)

  • Jeong, Weonil
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.19 no.8
    • /
    • pp.535-544
    • /
    • 2018
  • As the spread of mobile devices equipped with various sensors and high-quality wireless network communications functionsexpands, the amount of spatio-temporal data generated from mobile devices in various service fields is rapidly increasing. In conventional research into processing a large amount of real-time spatio-temporal streams, it is very difficult to apply a Hadoop-based spatial big data system, designed to be a batch processing platform, to a real-time service for spatio-temporal data streams. This paper extends the MapReduce online framework to support real-time query processing for continuous-input, spatio-temporal data streams, and proposes a load management method to distribute overloads for efficient query processing. The proposed scheme shows a dynamic load balancing method for the nodes based on the inflow rate and the load factor of the input data based on the space partition. Experiments show that it is possible to support efficient query processing by distributing the spatial data stream in the corresponding area to the shared resources when load management in a specific area is required.

Real-time Acquisition of Three Dimensional NMR Spectra by Non-uniform Sampling and Maximum Entropy Processing

  • Jee, Jun-Goo
    • Bulletin of the Korean Chemical Society
    • /
    • v.29 no.10
    • /
    • pp.2017-2022
    • /
    • 2008
  • Of the experiments to shorten NMR measuring time by sparse sampling, non-uniform sampling (NUS) is advantageous. NUS miminizes systematic errors which arise due to the lack of samplings by randomization. In this study, I report the real-time acquisition of 3D NMR data using NUS and maximum-entropy (MaxEnt) data processing. The real-time acquisition combined with NUS can reduce NMR measuring time much more. Compared with multidimensional decomposition (MDD) method, which was originally suggested by Jaravine and Orekhov (JACS 2006, 13421-13426), MaxEnt is faster at least several times and more suitable for the realtime acquisition. The designed sampling schedule of current study makes all the spectra during acquisition have the comparable resulting resolutions by MaxEnt. Therefore, one can judge the quality of spectra easily by examining the intensities of peaks. I report two cases of 3D experiments as examples with the simulated subdataset from experimental data. In both cases, the spectra having good qualitie for data analysis could be obtained only with 3% of original data. Its corresponding NMR measuring time was 8 minutes for 3D HNCO of ubiquitin.

DEVELOPMENT OF HIGH-RESOLUTION SATELLITE IMAGE PROCESSING SYSTEM BY USING CBD

  • Yoon, Chang-Pak;Seo, Ji-Hoon;Kim, Kyung-Ok
    • Proceedings of the KSRS Conference
    • /
    • 2002.10a
    • /
    • pp.49-52
    • /
    • 2002
  • High-resolution satellite image processing software should be able to ensure accurate, fast, compact data processing in offline or online environment. In this paper, component software for high-resolution satellite image processing is developed using OpenGIS components and real-time data processing architecture. The developed component software is composed of three major packages, which are data provide package, user interface package, and fast data processing package. The data provider package encodes and decodes diverse image/vector data formats and give identical data access methods to developers. The user interface package supports menus, toolbars, dialogs, and events to use easier. The fast data processing package follows the OpenGIS's data processing standards, which can deal with several processors as components with standard procedural functionalities.

  • PDF

Vehicle Plate Extraction Using Wavelet Transform and Polarized Light Filter (웨이브렛 변환과 편광 필터를 이용한 차량번호판 축출)

  • 김옥규;이창윤;황형덕;강혜진;박영식
    • Proceedings of the Korea Institute of Convergence Signal Processing
    • /
    • 2003.06a
    • /
    • pp.102-105
    • /
    • 2003
  • Up to the present studies of the car number recognition system, it is generally known to have serious problems such as relatively long processing time due to the excessive length of data extracted from the number plate based on the current image characteristics, and the image blurring with the physical damage of the brightness and darkness signals of the number plate caused by external impulses with many difficulties in the extraction of the highlighted numbers. In this Paper we used the characteristics firstly having a constant brightness of number plate, and a high density to the horizontal axis, and the influences of highlighted signal could be reduced by making reflections less through the polarized filter on the camera for any highlighted signal. For the more, the data processing time and the noise reduction are effectively implemented by using the wavelet transform of time-space scale with the considerations on the physical loss and processing time.

  • PDF

Associative Memory Model for Time Series Data (시계열정보 처리를 위한 연상기억 모델)

  • 박철영
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.6 no.3
    • /
    • pp.29-34
    • /
    • 2001
  • In this paper, a new associative memory system for analog time-sequential data processing is proposed. This system effectively associate time-sequential data using not only matching with present data but also matching with past data. Furthermore in order to improve error correction ability, weight varying in time domain is introduced in this system. The network is simulated with several periodic time-sequential input patterns including noise. The results show that the proposed system has ability to correct input errors. We expect that the proposed system may be applied for a real time processing of analog time-sequential information.

  • PDF

A Structured Overlay Network Scheme Based on Multiple Different Time Intervals

  • Kawakami, Tomoya
    • Journal of Information Processing Systems
    • /
    • v.16 no.6
    • /
    • pp.1447-1458
    • /
    • 2020
  • This paper describes a structured overlay network scheme based on multiple different time intervals. Many types of data (e.g., sensor data) can be requested at specific time intervals that depend on the user and the system. These queries are referred to as "interval queries." A method for constructing an overlay network that efficiently processes interval queries based on multiple different time intervals is proposed herein. The proposed method assumes a ring topology and assigns nodes to a keyspace based on one-dimensional time information. To reduce the number of forwarded messages for queries, each node constructs shortcut links for each interval that users tend to request. This study confirmed that the proposed method reduces the number of messages needed to process interval queries. The contributions of this study include the clarification of interval queries with specific time intervals; establishment of a structured overlay network scheme based on multiple different time intervals; and experimental verification of the scheme in terms of communication load, delay, and maintenance cost.

A Model Comparison for Spatiotemporal Data in Ubiquitous Environments: A Case Study

  • Noh, Seo-Young;Gadia, Shashi K.
    • Journal of Information Processing Systems
    • /
    • v.7 no.4
    • /
    • pp.635-652
    • /
    • 2011
  • In ubiquitous environments, many applications need to process data with time and space dimensions. Because of this, there is growing attention not only on gathering spatiotemporal data in ubiquitous environments, but also on processing such data in databases. In order to obtain the full benefits from spatiotemporal data, we need a data model that naturally expresses the properties of spatiotemporal data. In this paper, we introduce three spatiotemporal data models extended from temporal data models. The main goal of this paper is to determine which data model is less complex in the spatiotemporal context. To this end, we compare their query languages in the complexity aspect because the complexity of a query language is tightly coupled with its underlying data model. Throughout our investigations, we show that it is important to intertwine space and time dimensions and keep one-to-one correspondence between an object in the real world and a tuple in a database in order to naturally express queries in ubiquitous applications.

Development of Receiving and Image Processing System of GMS/WEFAX Using PC(II) - Software for Receiving and Image Processing - (PC를 이용한 GMS/WEFAX 수신 및 영상처리 시스템 개발(II) - 수신 및 영상처리 소프트 웨어 -)

  • ;;Yun, Gi-Joon;Park, Jong-Hyun
    • Korean Journal of Remote Sensing
    • /
    • v.9 no.1
    • /
    • pp.37-49
    • /
    • 1993
  • In this research, the WEF AX and APT(Automatic Picture Transmission) data receiving and image processing software using PC/AT called WADIPS(WEFAX and APT Data Integrated Processing System) Software has been developed. The main functions of WADIPS software are follow : 1) Real time receiving and saving to hard disk of WEFAX and APT data 2) B/W(Black and White) and false color display 3) Image enhancement using histogram stretch and color control 4) 2-4 times zooming 5) Hard copy of data using dithering and patterning 6) Animation 7) File management 8) On line help. WADIPS can be used in the offices or persons need real time meteorological information and education offices to teach the image processing technique and general characteristics of meteorological satellites.

A Study on Implementation of Line Array Sensor Data Processing Platform Using PowerPC and Vxworks (PowerPC 및 VxWorks를 이용한 예인선배열센서 데이터처리 플랫폼 구현에 관한 연구)

  • Lim, Byeong-Seon;Kim, Young-Kil
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.14 no.7
    • /
    • pp.1603-1609
    • /
    • 2010
  • This Paper deals with a design, making a prtotype and test methods of Real-time towed Line Array Sensor Data processing board for fast data communication and long range data transmission with SFM(Serial FPDP Module) through Optic-fiber channel. Towed line array sensors are installed in Frigate and the each LAS A, B, C group data from LAS is packed a previously agreed protocol and transmitted to the signal processing unit. Considering the limited space of VME 6U size, LAS Data processing board is designed with MPC8265 PowerPC Controller of Freescale for main system control and Altera's CycloneIII FPGA for sensor data packing, self-test simulation data generation, S/W FIFO et cetera. LAS Data processing board have VxWorks, the RTOS(Real Time Operating System) that present many device drivers, peripheral control libraries on board for real-time data processing.