• Title/Summary/Keyword: real-time databases

Search Result 185, Processing Time 0.022 seconds

A Single Index Approach for Time-Series Subsequence Matching that Supports Moving Average Transform of Arbitrary Order (단일 색인을 사용한 임의 계수의 이동평균 변환 지원 시계열 서브시퀀스 매칭)

  • Moon Yang-Sae;Kim Jinho
    • Journal of KIISE:Databases
    • /
    • v.33 no.1
    • /
    • pp.42-55
    • /
    • 2006
  • We propose a single Index approach for subsequence matching that supports moving average transform of arbitrary order in time-series databases. Using the single index approach, we can reduce both storage space overhead and index maintenance overhead. Moving average transform is known to reduce the effect of noise and has been used in many areas such as econometrics since it is useful in finding overall trends. However, the previous research results have a problem of occurring index overhead both in storage space and in update maintenance since tile methods build several indexes to support arbitrary orders. In this paper, we first propose the concept of poly-order moving average transform, which uses a set of order values rather than one order value, by extending the original definition of moving average transform. That is, the poly-order transform makes a set of transformed windows from each original window since it transforms each window not for just one order value but for a set of order values. We then present theorems to formally prove the correctness of the poly-order transform based subsequence matching methods. Moreover, we propose two different subsequence matching methods supporting moving average transform of arbitrary order by applying the poly-order transform to the previous subsequence matching methods. Experimental results show that, for all the cases, the proposed methods improve performance significantly over the sequential scan. For real stock data, the proposed methods improve average performance by 22.4${\~}$33.8 times over the sequential scan. And, when comparing with the cases of building each index for all moving average orders, the proposed methods reduce the storage space required for indexes significantly by sacrificing only a little performance degradation(when we use 7 orders, the methods reduce the space by up to 1/7.0 while the performance degradation is only $9\%{\~}42\%$ on the average). In addition to the superiority in performance, index space, and index maintenance, the proposed methods have an advantage of being generalized to many sorts of other transforms including moving average transform. Therefore, we believe that our work can be widely and practically used in many sort of transform based subsequence matching methods.

An Efficient Algorithm for Streaming Time-Series Matching that Supports Normalization Transform (정규화 변환을 지원하는 스트리밍 시계열 매칭 알고리즘)

  • Loh, Woong-Kee;Moon, Yang-Sae;Kim, Young-Kuk
    • Journal of KIISE:Databases
    • /
    • v.33 no.6
    • /
    • pp.600-619
    • /
    • 2006
  • According to recent technical advances on sensors and mobile devices, processing of data streams generated by the devices is becoming an important research issue. The data stream of real values obtained at continuous time points is called streaming time-series. Due to the unique features of streaming time-series that are different from those of traditional time-series, similarity matching problem on the streaming time-series should be solved in a new way. In this paper, we propose an efficient algorithm for streaming time- series matching problem that supports normalization transform. While the existing algorithms compare streaming time-series without any transform, the algorithm proposed in the paper compares them after they are normalization-transformed. The normalization transform is useful for finding time-series that have similar fluctuation trends even though they consist of distant element values. The major contributions of this paper are as follows. (1) By using a theorem presented in the context of subsequence matching that supports normalization transform[4], we propose a simple algorithm for solving the problem. (2) For improving search performance, we extend the simple algorithm to use $k\;({\geq}\;1)$ indexes. (3) For a given k, for achieving optimal search performance of the extended algorithm, we present an approximation method for choosing k window sizes to construct k indexes. (4) Based on the notion of continuity[8] on streaming time-series, we further extend our algorithm so that it can simultaneously obtain the search results for $m\;({\geq}\;1)$ time points from present $t_0$ to a time point $(t_0+m-1)$ in the near future by retrieving the index only once. (5) Through a series of experiments, we compare search performances of the algorithms proposed in this paper, and show their performance trends according to k and m values. To the best of our knowledge, since there has been no algorithm that solves the same problem presented in this paper, we compare search performances of our algorithms with the sequential scan algorithm. The experiment result showed that our algorithms outperformed the sequential scan algorithm by up to 13.2 times. The performances of our algorithms should be more improved, as k is increased.

Development of Traffic Safety Monitoring Technique by Detection and Analysis of Hazardous Driving Events in V2X Environment (V2X 환경에서 위험운전이벤트 검지 및 분석을 통한 교통안전 모니터링기법 개발)

  • Jeong, Eunbi;Oh, Cheol;Kang, Kyeongpyo;Kang, Younsoo
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.11 no.6
    • /
    • pp.1-14
    • /
    • 2012
  • Traffic management centers (TMC) collect real-time traffic data from the field and have powerful databases for analysing, recording, and archiving the data. Recent advanced sensor and communication technologies have been widely applied to intelligent transportation systems (ITS). Regarding sensors, various in-vehicle sensors, in addition to global positioning system (GPS) receiver, are capable of providing high resolution data representing vehicle maneuverings. Regarding communication technologies, advanced wireless communication technologies including vehicle-to-vehicle (V2V) and vehicle-to-vehicle infrastructure (V2I), which are generally referred to as V2X, have been widely used for traffic information and operations (references). The V2X environment considers the transportation system as a network in which each element, such as the vehicles, infrastructure, and drivers, communicates and reacts systematically to acquire information without any time and/or place restrictions. This study is motivated by needs of exploiting aforementioned cutting-edge technologies for developing smarter transportation services. The proposed system has been implemented in the field and discussed in this study. The proposed system is expected to be used effectively to support the development of various traffic information control strategies for the purpose of enhancing traffic safety on highways.

The Evaluation of Location Decision Factors of Environmental Foundation Facilities using Environmental Geographic Information System (환경지리정보시스템을 이용한 환경기초시설의 입지 결정요인 평가)

  • Cho, Deok-Ho;Bae, Min-Ki
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.11 no.1
    • /
    • pp.45-57
    • /
    • 2008
  • The purpose of this research is to select an appropriate location of water pollution prevention facilities(WPPF) through evaluating location decision factor using environmental geographic information system. To do that, this research reviewed the current location policies of WPPFs and its related researches. And this paper builds water pollutant statistical databases, integrated them with the geographic information system of the administrative areas where water pollutants are generated, and gears it with statistical programs such as correlation and regression analysis in order to figure out the pollution factors which influence on the location decision of WPPF on the real time base. The volume of discharge of industrial wastewater is one of the most important water pollutants on the location decision of WPPF. And the number of industrial facilities also was the most important location decision factor in constructing the WPPFs. In addition, this paper noted that the number of population in each area makes a role to restraint the construction of WPPF. It identified that the disposal facility in Nackdong river upper-middle watersheds was insufficient in treating the livestock pollutants. Therefore, Gyeongbuk should concentrate on the construction of disposal facilities of livestock pollutant in these areas. The results of this research will contribute to decide what kinds of WPPF should be constructed on which watershed in Nackdong River, and to forecast the future water quality of each watershed.

  • PDF

An Information Management Strategy Over Entire Life Cycles of Hazardous Waste Streams (유해폐기물 생애 전주기 흐름 기반 정보 관리 전략)

  • Lee, Sang-hun;Kim, Jungeun
    • Clean Technology
    • /
    • v.26 no.3
    • /
    • pp.228-236
    • /
    • 2020
  • Korea has an economy based on manufacturing industrial fields, which produce high amounts of hazardous wastes, in spite of few landfill candidates, and a significant concern for fine airborne particulates; therefore, traditional waste management is difficult to apply in this country. Moreover, waste collection and accumulation have recently been intensified by the waste import prohibitions or regulations in developing nations, the universalization of delivery services in Korea, and the global COVID-19 crisis. This study thus presents a domestic waste management strategy that aims to address the recent issues on waste. The contents of the strategy as the main results of the study include the (1) improvement of the compatibility of the classification codes between the domestic hazardous waste and the international ones such as those of the Basel Convention; (2) consideration of the mixed hazard indices to represent toxicity from low-content components such as rare earth metals often contained in electrical and electronic equipment waste; (3) management application based on risks throughout the life cycles of waste; (4) establishment of detailed material flow information of waste by integrating the Albaro system, Pollutant Release and Transfer Register (PRTR) system, and online trade databases; (5) real-time monitoring and prediction of the waste movement or discharge using positional sensors and geographic information systems, among others; and (6) selection and implementation of optimal treatment or recycling practices through Life Cycle Assessment (LCA) and clean technologies.

ACE-BIS: A Cost-Effective Bus Information System (ACE-BIS: 최적의 버스 노선을 선택하기 위한 비용 효율적인 알고리즘의 개발)

  • Lee, Jong-Chan;Park, Sang-Hyun;Seo, Min-Koo;Kim, Sang-Wook
    • Journal of KIISE:Databases
    • /
    • v.33 no.7
    • /
    • pp.655-667
    • /
    • 2006
  • Due to the rapid development in mobile communication technologies, the usage of mobile devices such as cellular phones and PDAs becomes increasingly popular. One of the best ways to maximize the usability of mobile devices is to make them aware of their current locations and the locations of other fixed and mobile objects. In this paper, we propose a cost-effective Bus Information System, ACE-BIS, which utilizes a mobile device to retrieve the bus routes to reach a destination from the current location. To accomplish this task, ACE-BIS maintains a small amount of information on bus stops and bus routes in a mobile device and runs a heuristic routing algorithm based on such information. When a user asks more accurate route information or calls for a 'leave later query', ACE-BIS entrusts the task to a server into which real-time traffic and bus location information is being collected. By separating the roles into a mobile device and a server, ACE-BIS is able to provide bus routes at the lowest cost for wireless communications, without imposing much burden to a server. The results of extensive experiments revealed that ACE-BIS is effective and scalable in most experimental settings.

A Plan for Establishing IOT-based Building Maintenance Platform (S-LCC): Focusing a Concept Model on the Function Configuration and Practical Use of Measurement Data (IOT 기반 건축물 유지관리 플랫폼 구축(S-LCC) 방안 : 기능구성과 계측 데이터 활용을 위한 개념 모델을 중심으로)

  • Park, Tae-Keun
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.21 no.2
    • /
    • pp.611-618
    • /
    • 2020
  • The reliability of the results of LCC analysis is determined by accurate analytical procedures and energy data from which the uncertainty is removed. Until now, systems that can automatically measure these energy data and produce databases have not been commercialized. Therefore this paper proposes a concept model of an S-LCC platform that can automatically collect and analyze electric energy consumption data of equipment systems using the IOT, which is the core tool in the Fourth Industrial Revolution and operates the equipment system efficiently using the analyzed results. The proposed concept model was developed by the convergence of existing BLCS and IOT and was comprised of five modules: Facility Control Module, LCC Analysis Module, Energy Consumption Control Module, Efficiency Analysis Module, and Maintenance Standard Reestablishment Module. Using the results of LCC analysis deduced from this system, the deterioration condition of an equipment system can be identified in real-time. The results can be used as the baseline data to re-establish standards for the maintenance factor, replacement frequency, and lifetime of existing equipment, and establish new maintenance standards for new equipment. If the S-LCC platform is established, it would increase the reliability of LCC analysis, reduce the labor force for entering data and improve accuracy, and would also change disregarded data into big data with high potential.

Development and Implementation of Prototype for Intelligent Integrated Agricultural Water Management Information System and Service including Reservoirs managed by City and County (시군관리 저수지를 고려한 지능형 통합 물관리정보시스템 원형 개발 및 구현)

  • Kim, Dae-Sik;Kang, Seok-Man;Kim, Jin-Taek;Kim, Jeong-Dae;Kim, Hyun-Ho;Jang, Jin-Uk
    • Journal of Korean Society of Rural Planning
    • /
    • v.23 no.3
    • /
    • pp.163-174
    • /
    • 2017
  • This study developed the prototype of the system and implemented its main functions, which is the intelligent integrated agricultural water management information system and service (IaWAMISS). The developed system was designed to be able to collect, process and analyze the agricultural water information of spatially dispersed reservoirs in whole country and spatial geographic information distributed in various systems of other organizations. The system, IaWAMISS, is also possible to provide the reproduced information services in each reservoir and space units, such as agricultural water demand and supply analysis and drought prediction, to the people, experts, and policy makers. This study defined the 6 step modules to develop the system, which are to design the components of intelligent integrated information system, to derive the utilization contents of existing systems, to design the new development elements for IaWAMISS, to design the reservoir information system can be used by managers of city and county, to designate the monitoring reservoirs managed by city and county, and finally to prepare the sharing system between organizations with the existing information systems. In order to implement the prototype of the system, this study shows the results for three important functions of the system: spatial integration of reservoirs' information, data link integration between the existing systems, and intelligent analysis program development to assist decision support for agricultural water management. For the spatial integration with the reservoir water information of the Korea Rural Community Corporation, this study get IaWAMISS to receive the real-time reservoir storage information from the measurement facility installed in the municipal management reservoir. The data link integration connecting databases of the existing systems, was implemented by integrating the meteorological information of the Korea Meteorological Administration with IaWAMISS, so that the rainfall forecast data could be derived and used. For the implementation of the intelligent analysis program, this study also showed the results of analysis and prediction of agricultural water demand and supply amount, estimation of Palmer drought index, analysis of flood risk area in typhoon course region, and analysis of the storage status of reservoirs related to each storm. This study confirmed the possibility and efficiency of an useful system development through the prototype design and implementation of IaWAMISS. By solving the preliminary 6 step modules presented in this study, it is possible not only to efficiently manage water by spatial unit, but also to provide the service of information and to enhance the relevant policy and national understanding to the people.

Proposed Landslide Warning System Based on Real-time Rainfall Data (급경사지 붕괴위험 판단을 위한 강우기반의 한계영역 설정 기법 연구)

  • Kim, Hong Gyun;Park, Sung Wook;Yeo, Kang Dong;Lee, Moon Se;Park, Hyuck Jin;Lee, Jung Hyun;Hong, Sung Jin
    • The Journal of Engineering Geology
    • /
    • v.26 no.2
    • /
    • pp.197-205
    • /
    • 2016
  • Rainfall-induced landslide disaster case histories are typically required to establish critical lines based on the decrease coefficient for judging the likelihood of slope collapse or failure; however, reliably setting critical lines is difficult because the number of nationwide disaster case histories is insufficient and not well distributed across the region. In this study, we propose a method for setting the critical area to judge the risk of slope collapse without disaster case history information. Past 10 years rainfall data based on decrease coefficient are plotted as points, and a reference line is established by connecting the outermost points. When realtime working rainfall cross the reference line, warning system is operating and this system can be utilized nationwide through setting of reference line for each AWS (Automatic Weather Station). Warnings were effectively predicted at 10 of the sites, and warnings could have been issued 30 min prior to the landslide movement at eight of the sites. These results indicate a reliability of about 67%. To more fully utilize this model, it is necessary to establish nationwide rainfall databases and conduct further studies to develop regional critical areas for landslide disaster prevention.

Development of Low-Power IoT Sensor and Cloud-Based Data Fusion Displacement Estimation Method for Ambient Bridge Monitoring (상시 교량 모니터링을 위한 저전력 IoT 센서 및 클라우드 기반 데이터 융합 변위 측정 기법 개발)

  • Park, Jun-Young;Shin, Jun-Sik;Won, Jong-Bin;Park, Jong-Woong;Park, Min-Yong
    • Journal of the Computational Structural Engineering Institute of Korea
    • /
    • v.34 no.5
    • /
    • pp.301-308
    • /
    • 2021
  • It is important to develop a digital SOC (Social Overhead Capital) maintenance system for preemptive maintenance in response to the rapid aging of social infrastructures. Abnormal signals induced from structures can be detected quickly and optimal decisions can be made promptly using IoT sensors deployed on the structures. In this study, a digital SOC monitoring system incorporating a multimetric IoT sensor was developed for long-term monitoring, for use in cloud-computing server for automated and powerful data analysis, and for establishing databases to perform : (1) multimetric sensing, (2) long-term operation, and (3) LTE-based direct communication. The developed sensor had three axes of acceleration, and five axes of strain sensing channels for multimetric sensing, and had an event-driven power management system that activated the sensors only when vibration exceeded a predetermined limit, or the timer was triggered. The power management system could reduce power consumption, and an additional solar panel charging could enable long-term operation. Data from the sensors were transmitted to the server in real-time via low-power LTE-CAT M1 communication, which does not require an additional gateway device. Furthermore, the cloud server was developed to receive multi-variable data from the sensor, and perform a displacement fusion algorithm to obtain reference-free structural displacement for ambient structural assessment. The proposed digital SOC system was experimentally validated on a steel railroad and concrete girder bridge.