• 제목/요약/키워드: Real-time data analysis

검색결과 2,781건 처리시간 0.029초

Real-time Acquisition of Three Dimensional NMR Spectra by Non-uniform Sampling and Maximum Entropy Processing

  • Jee, Jun-Goo
    • Bulletin of the Korean Chemical Society
    • /
    • 제29권10호
    • /
    • pp.2017-2022
    • /
    • 2008
  • Of the experiments to shorten NMR measuring time by sparse sampling, non-uniform sampling (NUS) is advantageous. NUS miminizes systematic errors which arise due to the lack of samplings by randomization. In this study, I report the real-time acquisition of 3D NMR data using NUS and maximum-entropy (MaxEnt) data processing. The real-time acquisition combined with NUS can reduce NMR measuring time much more. Compared with multidimensional decomposition (MDD) method, which was originally suggested by Jaravine and Orekhov (JACS 2006, 13421-13426), MaxEnt is faster at least several times and more suitable for the realtime acquisition. The designed sampling schedule of current study makes all the spectra during acquisition have the comparable resulting resolutions by MaxEnt. Therefore, one can judge the quality of spectra easily by examining the intensities of peaks. I report two cases of 3D experiments as examples with the simulated subdataset from experimental data. In both cases, the spectra having good qualitie for data analysis could be obtained only with 3% of original data. Its corresponding NMR measuring time was 8 minutes for 3D HNCO of ubiquitin.

Oil Spill Response System using Server-client GIS

  • Kim, Hye-Jin;Lee, Moon-Jin;Oh, Se-Woong
    • 한국항해항만학회지
    • /
    • 제35권9호
    • /
    • pp.735-740
    • /
    • 2011
  • It is necessary to develop the one stop system in order to protect our marine environment rapidly from oil spill accident. The purpose of this study is to develop real time database for oil spill prediction modeling and implement real time prediction modelling with ESI and server-client GIS based user interface. The existing oil spill prediction model cannot provide one stop information system for public and government who should protect sea from oil spill accident. The development of multi user based information system permits integrated handling of real time meteorological data from external ftp. A server-client GIS based model is integrated on the basis of real time database and ESI map to provide the result of the oil spill prediction model. End users can access through the client interface and request analysis such as oil spill prediction and GIS functions on the network as their own purpose.

패스트 데이터 기반 실시간 비정상 행위 탐지 시스템 (Real-time Abnormal Behavior Detection System based on Fast Data)

  • 이명철;문대성;김익균
    • 정보보호학회논문지
    • /
    • 제25권5호
    • /
    • pp.1027-1041
    • /
    • 2015
  • 최근, Verizon(2010), 농협(2011), SK컴즈(2011), 그리고 3.20 사이버 테러(2013)와 같이 소중한 정보가 누출되고 자산에 피해가 발생한 후에야 보안 공격을 인지하는 APT (Advanced Persistent Threat) 공격 사례가 증가하고 있다. 이러한 APT 공격을 해결하고자 이상 행위 탐지 기술 관련 연구가 일부 진행되고 있으나, 대부분 알려진 악성 코드의 시그너쳐 기반으로 명백한 이상 행위를 탐지하는데 초점을 맞추고 있어서, 장기간 잠복하며 제로데이 취약점을 이용하고, 새로운 또는 변형된 악성 코드를 일관되게 사용하는 APT 공격에는 취약하여, 미탐율이 굉장히 높은 문제들을 겪고 있다. APT 공격을 탐지하기 위해서는 다양한 소스로부터 장기간에 걸쳐 대규모 데이터를 수집, 처리 및 분석하는 기술과, 데이터를 수집 즉시 실시간 분석하는 기술, 그리고 개별 공격들 간의 상관(correlation) 분석 기술이 동시에 요구되나, 기존 보안 시스템들은 이러한 복잡한 분석 능력이나 컴퓨팅 파워, 신속성 등이 부족하다. 본 논문에서는 기존 시스템들의 실시간 처리 및 분석 한계를 극복하기 위해, 패스트 데이터 기반 실시간 비정상 행위 탐지 시스템을 제안한다.

IoT 기반의 실시간 에너지 사용 데이터 수집 및 분석 시스템 개발 (A Development of Real-time Energy Usage Data Collection and Analysis System based on the IoT)

  • 황현숙;서영원
    • 한국멀티미디어학회논문지
    • /
    • 제22권3호
    • /
    • pp.366-373
    • /
    • 2019
  • The development of monitoring and analysis systems to increase productivity while saving energy is needed as a method to reduce huge amount of energy consumed in the process of producing large forged products. In this paper, we propose a system to monitor and analyze energy usage in real-time collected from gas-meter, wattmeter, and thermometer based on IoT installed in forging factories. The system consists of a data collection server for collecting and processing data from IoT- based platform and existing SCADA equipment and ERP/MES system in forging factories, and an application server for providing services to users. To develop the system, the overall system structure is logically diagrammed, and the databases configuration and implementation modules to efficiently store and manage data are presented. In the future, the system will be utilized to reduce energy consumption by analyzing energy usage pattern and optimizing process works with real-time energy usage and production process data for each facility.

도시 빅데이터를 활용한 스마트시티의 교통 예측 모델 - 환경 데이터와의 상관관계 기계 학습을 통한 예측 모델의 구축 및 검증 - (Big Data Based Urban Transportation Analysis for Smart Cities - Machine Learning Based Traffic Prediction by Using Urban Environment Data -)

  • 장선영;신동윤
    • 한국BIM학회 논문집
    • /
    • 제8권3호
    • /
    • pp.12-19
    • /
    • 2018
  • The research aims to find implications of machine learning and urban big data as a way to construct the flexible transportation network system of smart city by responding the urban context changes. This research deals with a problem that existing a bus headway model is difficult to respond urban situations in real-time. Therefore, utilizing the urban big data and machine learning prototyping tool in weathers, traffics, and bus statues, this research presents a flexible headway model to predict bus delay and analyze the result. The prototyping model is composed by real-time data of buses. The data is gathered through public data portals and real time Application Program Interface (API) by the government. These data are fundamental resources to organize interval pattern models of bus operations as traffic environment factors (road speeds, station conditions, weathers, and bus information of operating in real-time). The prototyping model is implemented by the machine learning tool (RapidMiner Studio) and conducted several tests for bus delays prediction according to specific circumstances. As a result, possibilities of transportation system are discussed for promoting the urban efficiency and the citizens' convenience by responding to urban conditions.

SOM과 LSTM을 활용한 지역기반의 부동산 가격 예측 (Real Estate Price Forecasting by Exploiting the Regional Analysis Based on SOM and LSTM)

  • 신은경;김은미;홍태호
    • 한국정보시스템학회지:정보시스템연구
    • /
    • 제30권2호
    • /
    • pp.147-163
    • /
    • 2021
  • Purpose The study aims to predict real estate prices by utilizing regional characteristics. Since real estate has the characteristic of immobility, the characteristics of a region have a great influence on the price of real estate. In addition, real estate prices are closely related to economic development and are a major concern for policy makers and investors. Accurate house price forecasting is necessary to prepare for the impact of house price fluctuations. To improve the performance of our predictive models, we applied LSTM, a widely used deep learning technique for predicting time series data. Design/methodology/approach This study used time series data on real estate prices provided by the Ministry of Land, Infrastructure and Transport. For time series data preprocessing, HP filters were applied to decompose trends and SOM was used to cluster regions with similar price directions. To build a real estate price prediction model, SVR and LSTM were applied, and the prices of regions classified into similar clusters by SOM were used as input variables. Findings The clustering results showed that the region of the same cluster was geographically close, and it was possible to confirm the characteristics of being classified as the same cluster even if there was a price level and a similar industry group. As a result of predicting real estate prices in 1, 2, and 3 months, LSTM showed better predictive performance than SVR, and LSTM showed better predictive performance in long-term forecasting 3 months later than in 1-month short-term forecasting.

소셜 빅데이터 마이닝 기반 실시간 랜섬웨어 전파 감지 시스템 (Real-Time Ransomware Infection Detection System Based on Social Big Data Mining)

  • 김미희;윤준혁
    • 정보처리학회논문지:컴퓨터 및 통신 시스템
    • /
    • 제7권10호
    • /
    • pp.251-258
    • /
    • 2018
  • 파일을 암호화시켜 몸값을 요구하는 악성 소프트웨어인 랜섬웨어는 빠른 전파력과 지능화로 더욱 위협적이 되고 있다. 이에 빠른 탐지 및 위험 분석이 요구되고 있지만, 실시간 분석 및 보고가 미비한 상태이다. 본 논문에서는 실시간 분석이 가능하도록 소셜 빅데이터 마이닝 기술을 활용하여 랜섬웨어 전파 감지 시스템을 제안한다. 본 시스템에서는 트위터 스트림을 실시간 분석하여 랜섬웨어와 관련된 키워드를 가진 트윗을 크롤링한다. 또한 뉴스피드 분석기를 통해 뉴스서버를 크롤링하여 랜섬웨어 관련 키워드를 추출하고, 보안업체의 서버나 탐색 엔진을 통해 뉴스나 통계데이터를 추출한다. 수집된 데이터는 데이터 마이닝 알고리즘으로 랜섬웨어 감염 정도를 분석한다. 2017년 전파가 많이 되었던 워너크라이와 록키 랜섬웨어 감염전파 시 관련 트윗의 수와 구글 트렌드(통계 정보) 정보, 관련 기사를 비교하여 트윗을 이용한 본 시스템의 랜섬웨어 감염 탐지 가능성을 보이고, 엔트로피와 카이-스퀘어 분석을 통해 제안 시스템 성능을 보인다.

물리구축환경의 지능적 부활로서의 실시간 행태 공간의 특성 분석 - onl과 NOX의 작품을 중심으로 - (A Study on the Analysis of the Characteristics of the Real-time Behavior Space Design - Focused on the Works of onl and NOX -)

  • 이한나;박현옥
    • 한국실내디자인학회논문집
    • /
    • 제14권4호
    • /
    • pp.19-26
    • /
    • 2005
  • Digital technology continually makes a space evolves. The real-time behavior design communicates the data with the situation of circumference of the space(visitors moving, interior and exterior situations). The space form was changed because it interfaces in real time. The purpose of this study was finding out the characteristics of real-time behavior space design through the analysis of space formative languages, sensorium, S-R and material. This study will be the one of basic references for the digital space design. The boundary of this study set limits to the works of digital space designer who applies the real-time exchanging data to their design among the digital space design works from 1996 to 2004. But it excepted from the real-time behavior space in virtual realty. Therefore, the objects of this study were the works of onl and NOX(paraSITE, Trans-port 2001, Muscle, MotormeCCa, Handdrawspace, Saltwater Pavilion, Son-O-House, H2O Expo). The method was the contents analysis of space formative languages(Greg Lynn's ten space formative languages; bleb, blob, branch, flower, fold, lattice, teeth, shred, skins and strand), sensorium, S-R and material. The results of the study are as follows: 1) The organizational elements; Space formative languages(bleb, blob, fold, shred, skins, strand), stimulation(Human Participation, Human Moving, Weather Conditions), and response(Spatial Moving, Sound Pattern, Lighting Pattern, color Pattern, Activating Particles, Moving Picture, Virtual Friend) 2) The material Use; Sound, lights, and network have been used in the space. Immaterial matter will be used the main material of space design in 21"'century, 3)The spatial types; formal changing of space, projecting immaterial elements, and changing the sound.

Real-Time Road Traffic Management Using Floating Car Data

  • Runyoro, Angela-Aida K.;Ko, Jesuk
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • 제13권4호
    • /
    • pp.269-276
    • /
    • 2013
  • Information and communication technology (ICT) is a promising solution for mitigating road traffic congestion. ICT allows road users and vehicles to be managed based on real-time road status information. In Tanzania, traffic congestion causes losses of TZS 655 billion per year. The main objective of this study was to develop an optimal approach for integrating real-time road information (RRI) to mitigate traffic congestion. Our research survey focused on three cities that are highly affected by traffic congestion, i.e., Arusha, Mwanza, and Dar es Salaam. The results showed that ICT is not yet utilized fully to solve road traffic congestion. Thus, we established a possible approach for Tanzania based on an analysis of road traffic data provided by organizations responsible for road traffic management and road users. Furthermore, we evaluated the available road information management techniques to test their suitability for use in Tanzania. Using the floating car data technique, fuzzy logic was implemented for real-time traffic level detection and decision making. Based on this solution, we propose a RRI system architecture, which considers the effective utilization of readily available communication technology in Tanzania.

자율주행을 위한 라이다 기반의 실시간 그라운드 세그멘테이션 알고리즘 (LiDAR based Real-time Ground Segmentation Algorithm for Autonomous Driving)

  • 이아영;이경수
    • 자동차안전학회지
    • /
    • 제14권2호
    • /
    • pp.51-56
    • /
    • 2022
  • This paper presents an Ground Segmentation algorithm to eliminate unnecessary Lidar Point Cloud Data (PCD) in an autonomous driving system. We consider Random Sample Consensus (Ransac) Algorithm to process lidar ground data. Ransac designates inlier and outlier to erase ground point cloud and classified PCD into two parts. Test results show removal of PCD from ground area by distinguishing inlier and outlier. The paper validates ground rejection algorithm in real time calculating the number of objects recognized by ground data compared to lidar raw data and ground segmented data based on the z-axis. Ground Segmentation is simulated by Robot Operating System (ROS) and an analysis of autonomous driving data is constructed by Matlab. The proposed algorithm can enhance performance of autonomous driving as misrecognizing circumstances are reduced.