• Title/Summary/Keyword: Real-time data analysis

Search Result 2,809, Processing Time 0.04 seconds

TOVS retrieved data with the real time synoptic surface data (종관 지상 자료를 이용한 TOVS수치 해석 산출 자료)

  • 주상원;정효상;김금란
    • Korean Journal of Remote Sensing
    • /
    • v.10 no.1
    • /
    • pp.55-67
    • /
    • 1994
  • The International TOVS(TIROS Oprational Vertical Sounders) Process Package(ITPP-VI)is for a global usage, which needs a surface data to generate atmospheric soundings. If the initial input process in the ITPP-VI is not modified, it takes climatic surface data for producing sounding data in general. Korea Meteorological Administration(KMA) is trying to improve the quality of TOVS sounding data using real-time synoptic observations and make a use weather prediction and analysis in various ways. Serval cases in this study show that TOVS retrieved meteolorogical parameters such as atmopheric temperature, dew point depression and geopotential heights used by synoptic surface observations can delineate more detailed atmospheric feature rather than those used by climate surface data. In addition, the collocated comparisons of TOVS synoptic retrieved parameters with radiosonde observations are performed statistically. TOVS retrieved fields with the synoptic surface analyzed data show smaller bias reatively than those with the climatic data and also reduced root mean square differences below 700 hPa as expected.

Plurality Rule-based Density and Correlation Coefficient-based Clustering for K-NN

  • Aung, Swe Swe;Nagayama, Itaru;Tamaki, Shiro
    • IEIE Transactions on Smart Processing and Computing
    • /
    • v.6 no.3
    • /
    • pp.183-192
    • /
    • 2017
  • k-nearest neighbor (K-NN) is a well-known classification algorithm, being feature space-based on nearest-neighbor training examples in machine learning. However, K-NN, as we know, is a lazy learning method. Therefore, if a K-NN-based system very much depends on a huge amount of history data to achieve an accurate prediction result for a particular task, it gradually faces a processing-time performance-degradation problem. We have noticed that many researchers usually contemplate only classification accuracy. But estimation speed also plays an essential role in real-time prediction systems. To compensate for this weakness, this paper proposes correlation coefficient-based clustering (CCC) aimed at upgrading the performance of K-NN by leveraging processing-time speed and plurality rule-based density (PRD) to improve estimation accuracy. For experiments, we used real datasets (on breast cancer, breast tissue, heart, and the iris) from the University of California, Irvine (UCI) machine learning repository. Moreover, real traffic data collected from Ojana Junction, Route 58, Okinawa, Japan, was also utilized to lay bare the efficiency of this method. By using these datasets, we proved better processing-time performance with the new approach by comparing it with classical K-NN. Besides, via experiments on real-world datasets, we compared the prediction accuracy of our approach with density peaks clustering based on K-NN and principal component analysis (DPC-KNN-PCA).

Implementation of Real-Time Software GPS Receiver and Performance Analysis (실시간 소프트웨어 GPS 수신기 구현 및 성능 분석)

  • Kwag, Heui-Sam;Ko, Sun-Jun;Won, Jong-Hoon;Lee, Ja-Sung
    • Proceedings of the KIEE Conference
    • /
    • 2004.07d
    • /
    • pp.2350-2352
    • /
    • 2004
  • This paper presents the implementation-tation of the real-time software GPS Receiver based on FFT and FLL assisted PLL tracking algorithm. The FFT(fast fourier transform) based GPS si-gnal acquisition scheme provides a fast TTFF(time to first fix) performance. The tracking based on FLL assisted PLL enables tracking of GPS signal in a high dynamic environment. The designed software GPS receiver uses the indexing method for generating replica carrier to reduce computation load. The performance of the implemented GPS receiver is evaluated using high-dynamic simulated data from a simulator and real static data.

  • PDF

Application of Neural Network Model to the Real-time Forecasting of Water Quality (실시간 수질 예측을 위한 신경망 모형의 적용)

  • Cho, Yong-Jin;Yeon, In-Sung;Lee, Jae-Kwan
    • Journal of Korean Society on Water Environment
    • /
    • v.20 no.4
    • /
    • pp.321-326
    • /
    • 2004
  • The objective of this study is to test the applicability of neural network models to forecast water quality at Naesa and Pyongchang river. Water quality data devided into rainy day and non-rainy day to find characteristics of them. The mean and maximum data of rainy day show higher than those of non-rainy day. And discharge correlate with TOC at Pyongchang river. Neural network model is trained to the correlation of discharge with water quality. As a result, it is convinced that the proposed neural network model can apply to the analysis of real time water quality monitoring.

Development & Evaluation of Real-time Ensemble Drought Prediction System (실시간 앙상블 가뭄전망정보 생산 체계 구축 및 평가)

  • Bae, Deg-Hyo;Ahn, Joong-Bae;Kim, Hyun-Kyung;Kim, Heon-Ae;Son, Kyung-Hwan;Cho, Se-Ra;Jung, Ui-Seok
    • Atmosphere
    • /
    • v.23 no.1
    • /
    • pp.113-121
    • /
    • 2013
  • The objective of this study is to develop and evaluate the system to produce the real-time ensemble drought prediction data. Ensemble drought prediction consists of 3 processes (meteorological outlook using the multi-initial conditions, hydrological analysis and drought index calculation) therefore, more processing time and data is required than that of single member. For ensemble drought prediction, data process time is optimized and hardware of existing system is upgraded. Ensemble drought data is estimated for year 2012 and to evaluate the accuracy of drought prediction data by using ROC (Relative Operating Characteristics) analysis. We obtained 5 ensembles as optimal number and predicted drought condition for every tenth day i.e. 5th, 15th and 25th of each month. The drought indices used are SPI (Standard Precipitation Index), SRI (Standard Runoff Index), SSI (Standard Soil moisture Index). Drought conditions were determined based on results obtained for each ensemble member. Overall the results showed higher accuracy using ensemble members as compared to single. The ROC score of SRI and SSI showed significant improvement in drought period however SPI was higher in the demise period. The proposed ensemble drought prediction system can be contributed to drought forecasting techniques in Korea.

Real-time and Parallel Semantic Translation Technique for Large-Scale Streaming Sensor Data in an IoT Environment (사물인터넷 환경에서 대용량 스트리밍 센서데이터의 실시간·병렬 시맨틱 변환 기법)

  • Kwon, SoonHyun;Park, Dongwan;Bang, Hyochan;Park, Youngtack
    • Journal of KIISE
    • /
    • v.42 no.1
    • /
    • pp.54-67
    • /
    • 2015
  • Nowadays, studies on the fusion of Semantic Web technologies are being carried out to promote the interoperability and value of sensor data in an IoT environment. To accomplish this, the semantic translation of sensor data is essential for convergence with service domain knowledge. The existing semantic translation technique, however, involves translating from static metadata into semantic data(RDF), and cannot properly process real-time and large-scale features in an IoT environment. Therefore, in this paper, we propose a technique for translating large-scale streaming sensor data generated in an IoT environment into semantic data, using real-time and parallel processing. In this technique, we define rules for semantic translation and store them in the semantic repository. The sensor data is translated in real-time with parallel processing using these pre-defined rules and an ontology-based semantic model. To improve the performance, we use the Apache Storm, a real-time big data analysis framework for parallel processing. The proposed technique was subjected to performance testing with the AWS observation data of the Meteorological Administration, which are large-scale streaming sensor data for demonstration purposes.

Fault Detection System Development for a Spin Coater Through Vibration Assessment (스핀코터의 진동 평가를 통한 이상 검출 시스템 개발)

  • Moon, Jun-Hee;Lee, Bong-Gu
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.26 no.11
    • /
    • pp.47-54
    • /
    • 2009
  • Spin coaters are the essential instruments in micro-fabrication processes, which apply uniform thin films to flat substrates. In this research, a spin coater diagnosis system is developed to detect the abnormal operation of TFT-LCD process in real time. To facilitate the real-time data acquisition and analysis, the circular-buffered continuous data transfer and the short-time Fourier transform are applied to the fault diagnosis system. To determine whether the system condition is normal or not, a steady-state detection algorithm and a frequency spectrum comparison algorithm using confidence interval are newly devised. Since abnormal condition of a spin coater is rarely encountered, algorithm is tested on a CD-ROM drive and the developed program is verified by a function generator. Actual threshold values for the fault detection are tuned in a spin coater in process.

A Design of a TV Advertisement Effectiveness Analysis System Using SNS Big-data (SNS Big-data를 활용한 TV 광고 효과 분석 시스템 설계)

  • Lee, Areum;Bang, Jiseon;Kim, Yoonhee
    • KIISE Transactions on Computing Practices
    • /
    • v.21 no.9
    • /
    • pp.579-586
    • /
    • 2015
  • As smart-phone usage increases, the number of Social Networking Service (SNS) users has also exponentially increased. SNS allows people to efficiently exchange their personal opinion, and for this reason, it is possible to collect the reaction of each individual to a given event in real-time. Nevertheless, new methods need to be developed to collect and analyze people's opinion in real-time in order to effectively evaluate the impact of a TV advertisement. Hence, we designed and constructed a system that analyzes the effect of an advertisement in real-time by using data related to the advertisement collected from SNS, specifically, Twitter. In detail, Hadoop is used in the system to enable big-data analysis in parallel, and various analyses can be conducted by conducting separate numerical analyses of the degrees of mentioning, preference and reliability. The analysis can be accurate if the reliability is assessed using opinion mining technology. The proposed system is therefore proven to effectively handle and analyze data responses to divers TV advertisement.

Implementation of a Real-time SIFT Pitch Detector (실시간 SIFT 기본주파수 검출기의 구현)

  • Lee, Jong Seok;Lee, Sang Uk
    • Journal of the Korean Institute of Telematics and Electronics
    • /
    • v.23 no.1
    • /
    • pp.101-113
    • /
    • 1986
  • In this paper, a real-time pitch detector LPC vocoder as implemented on a high speed digital signal processor, NEC 7720, is described. The pitch detector was based mainly on the SIFT algorithm. The SIFT pitch detector consists primarily of a digital low pass filter, inverse filter, computation of autocorrelation, a peak picker, interpolation, V/UV defcision and a final pitch smoother. In our approach, modification, mainly on the V/UV decision and a final pitch smoother, was made to estimate more accurate pitches. An 16-bit fixed-point aithmatic was employed for all necessary computation and the simulated results were compared with the eye detected pitches obtained from real speech data. The pitch detector occupies 98.8% of the instruction ROM, 37% of the data ROM, and 94% of internal RAM and takes 15.2ms to estimate a pitch when an analysis frame is consisted of 128 sampled speech data. It is observed that the tested results were well agreed with the computer simulation results.

  • PDF

Methodological study on the High Dynamic Range Imaging Processing (채광·조명설비시스템의 광학 분석을 위한 이미지 프로세싱 기법에 관한 연구)

  • Lim, Hong Soo;Kim, Gon
    • KIEAE Journal
    • /
    • v.10 no.4
    • /
    • pp.3-8
    • /
    • 2010
  • Recently, various daylight evaluation methods for visual environment have been developed; simulation analysis methods, numerical calculation, and data monitoring methods. However, it is impossible for simulation analysis to make real scenes and visualize real images exactly. Also, a numerical calculation is considered as an out of date and time-consuming mean. Therefore, for acquisition of accurate results, many studies often use the monitoring data methods. Especially, most studies regarding discomfort glare are evaluated by measuring the physical quantity of luminance through traditional measuring Minolta Luminance meters as an instrument. But, this method has a difficulty in measuring several points at the same time because of the limitation of spaces and time when mapping. So, this study focused on the potential usefulness of High Dynamic Range photography technique as a luminance mapping tool. In order to evaluate the accuracy of proposed programs such as webHDR, Photomatix and PHOTOLUX, this paper has conducted an experiment by using Canon EOS 5D and NICON Coolpix8400 digital camera.