• Title/Summary/Keyword: Data processing

Search Result 16,488, Processing Time 0.057 seconds

A Study on Development of Middleware for Real Time Data Processing with RFID (RFID 시스템 도입을 위한 실시간 정보처리용 미들웨어의 개발에 관한 연구)

  • Li Guang Zhu;Jho Yong-Chul;Lee Chang-Ho
    • Journal of the Korea Safety Management & Science
    • /
    • v.8 no.4
    • /
    • pp.109-117
    • /
    • 2006
  • This paper deals with the middleware development for real time data processing using ubiquitous RFID(Radio Frequency Identification). This middleware system supports the real time data gathering, filtering, and collaborative operations within SCM. We expect to decrease the data processing cost and to upgrade the status of RTE(Real Time Enterprise) and competitive power of company.

On XML Data Processing through Implementing A Deductive and Object-oriented Database Language (연역 객체 지향 데이터베이스 언어 구현을 통한 XML 데이터 처리에 관한 연구)

  • Kim, Seong-Gyu
    • The KIPS Transactions:PartD
    • /
    • v.9D no.6
    • /
    • pp.991-998
    • /
    • 2002
  • With the advent of XML and database languages armed with the object-oriented concept and deductive logic, the problem of efficient query processing for them has become a major issue. We describe a way of processing semi-structured XML data through an implementation of a Deductive and Object-oriented Database (DOODB) language with the explanation of query processing. We have shown how to convert an XML data model to a DOODB data model. We have then presented an efficient query processing method based on Connection Graph Resolution. We also present a knowledge-based query processing method that uses the homomorphism of objects in the database and the associative rule of substitutions.

MAHA-FS : A Distributed File System for High Performance Metadata Processing and Random IO (MAHA-FS : 고성능 메타데이터 처리 및 랜덤 입출력을 위한 분산 파일 시스템)

  • Kim, Young Chang;Kim, Dong Oh;Kim, Hong Yeon;Kim, Young Kyun;Choi, Wan
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.2 no.2
    • /
    • pp.91-96
    • /
    • 2013
  • The application field of supercomputing systems are changing to support into the field for both a large-volume data processing and high-performance computing at the same time such as bio-applications. These applications require high-performance distributed file system for storage management and efficient high-speed processing of large amounts of data that occurs. In this paper, we introduce MAHA-FS for supercomputing systems for processing large amounts of data and high-performance computing, providing excellent metadata operation performance and IO performance. It is shown through performance analysis that MAHA-FS provides excellent performance in terms of the metadata processing and random IO processing.

GPS Software Development for Calculation of Cadastral Control Points (지적기준점 성과계산을 위한 GPS 소프트웨어 개발)

  • 우인제;이종기;김병국;이민석
    • Spatial Information Research
    • /
    • v.12 no.1
    • /
    • pp.101-110
    • /
    • 2004
  • Research that establish new cadastral survey model that use GPS to introduce GPS observation technique in cadastral survey and research that develop connection technologies are now abuzz. The purpose of this research is to keep in step in such trend and grasp present condition and performance of surveying connection to common use GPS data processing software, and analyze data processing algorithm, and develop suitable GPS data processing software in our real condition regarding GPS data processing and result of control point calculation. This research studies analysis common use software and error occurrence by data processing method that college and company have. Also, It analyzes algorithm that is applied to existing GPS data processing software. After that we study algorithm that is most suitable with cadastral survey and then develop cadastral survey calculation software for new cadastral control points.

  • PDF

The Estimation of Physical/Biological Parameters of Greenhouse Soil by Image Processing (컬러 영상처리에 의한 시설재배지 토양의 생물 물리적 환경변수 추정)

  • Kim, H.T.;Kim, J.D.;Moon, J.H.;Lee, K.S.;Kang, K.H.;Kim, W.;Lee, D.W.
    • Journal of Biosystems Engineering
    • /
    • v.28 no.4
    • /
    • pp.343-350
    • /
    • 2003
  • This study was conducted to find out the coefficient relationships between intensity values of image processing and biological/physical parameters of soil in greenhouses. Soil images were obtained by an image processing system consisting of a personal computer and a CCD earners. A software written in Visual C$\^$++/ systematically integrated the functions of image capture, image processing, and image analysis. Image processing data of the soil samples were analyzed by the method of regression analysis. The results are as follows. For detecting soil density of unbroken soil samples, the highest correlation coefficients of 0.82 and 0.84, respectively were obtained fur R-value and S-value among image processing data while it was 0.97 for G-value. Considering the relationship between biological characteristics and image processing data of soil in greenhouse, the correlation was found generally low. For pH of unbroken soil sample, the correlation coefficients were found 0.87, 0.85, and 0.94, respectively with G, I, and H values of image processing data. In the case of bacteria, any correlation was not found with the image processing data For Actinomyctes, they were 0.86 and 0.85, respectively with G-value and B-value of image processing data showing high correlation coefficient compared to the other variables. The correlation coefficient between Fungi and H-value was shown 0.88, the highest among the variables higher than 0.8 while the other variables showed low correlation. For broken soil samples from greenhouse, the relation between biological parameter and image processing data were rarely shown in this study. The results of this study indicated that most of correlation coefficient between the variables were usually lower than 0.01. Accordingly, it was assumed that the soil should be used without broken to fairly estimate biological characteristics using CCD camera.

Performance Comparison of LSTM-Based Groundwater Level Prediction Model Using Savitzky-Golay Filter and Differential Method (Savitzky-Golay 필터와 미분을 활용한 LSTM 기반 지하수 수위 예측 모델의 성능 비교)

  • Keun-San Song;Young-Jin Song
    • Journal of the Semiconductor & Display Technology
    • /
    • v.22 no.3
    • /
    • pp.84-89
    • /
    • 2023
  • In water resource management, data prediction is performed using artificial intelligence, and companies, governments, and institutions continue to attempt to efficiently manage resources through this. LSTM is a model specialized for processing time series data, which can identify data patterns that change over time and has been attempted to predict groundwater level data. However, groundwater level data can cause sen-sor errors, missing values, or outliers, and these problems can degrade the performance of the LSTM model, and there is a need to improve data quality by processing them in the pretreatment stage. Therefore, in pre-dicting groundwater data, we will compare the LSTM model with the MSE and the model after normaliza-tion through distribution, and discuss the important process of analysis and data preprocessing according to the comparison results and changes in the results.

  • PDF

A Quality Evaluation Model for Distributed Processing Systems of Big Data (빅데이터 분산처리시스템의 품질평가모델)

  • Choi, Seung-Jun;Park, Jea-Won;Kim, Jong-Bae;Choi, Jae-Hyun
    • Journal of Digital Contents Society
    • /
    • v.15 no.4
    • /
    • pp.533-545
    • /
    • 2014
  • According to the evolving of IT technologies, the amount of data we are facing increasing exponentially. Thus, the technique for managing and analyzing these vast data that has emerged is a distributed processing system of big data. A quality evaluation for the existing distributed processing systems has been proceeded by the structured data environment. Thus, if we apply this to the evaluation of distributed processing systems of big data which has to focus on the analysis of the unstructured data, a precise quality assessment cannot be made. Therefore, a study of the quality evaluation model for the distributed processing systems is needed, which considers the environment of the analysis of big data. In this paper, we propose a new quality evaluation model by deriving the quality evaluation elements based on the ISO/IEC9126 which is the international standard on software quality, and defining metrics for validating the elements.

3D Surface Representation and Manipulation Scheme for Web-based 3D Geo-Processing

  • Choe, Seung-Keol;Kim, Kyong-Ho;Lee, Jong-Hun;Yang, Young-Kyu
    • Proceedings of the Korean Association of Geographic Inforamtion Studies Conference
    • /
    • 1999.12a
    • /
    • pp.66-71
    • /
    • 1999
  • For given 3D geographic data which is usually of DEM(Data Elevation Model) format, we have to represent and manipulate the data in various ways. For example, we have to draw a part of them in drawing canvas. To do this we give users a way of selecting area they want to visualize. And we have to give a base tool for users to select the local area which can be chosen for some geographic operation. In this paper, we propose a 3D data processing method for representation and manipulation. The method utilizes the major properties of DEM and TIN(Triangular Irregular Network), respectively. Furthermore, by approximating DEM with a TIN of an appropriate resolution, we can support a fast and realistic surface modeling. We implement the structure with the following 4 level stages. The first is an optimal resolution of DEM which represent all of wide range of geographic data. The second is the full resolution DEM which is a subarea of original data generated by user's selection in our implemeatation. The third is the TIN approximation of this data with a proper resolution determined by the relative position with the camera. And the last step is multi-resolution TIN data whose resolution is dynamically decided by considering which direction user take notice currently. Specialty, the TIN of the last step is designed for realtime camera navigation. By using the structure we implemented realtime surface clipping, efficient approximation of height field and the locally detailed surface LOD(Level of Detail). We used the initial 10-meter sampling DEM data of Seoul, KOREA and implement the structure to the 3D Virtual GIS based on the Internet.

  • PDF

A Design of LAS data processing board using PowerPC and VxWorks (PowerPC 및 VxWorks를 이용한 예인배열센서 데이터처리보드 개발)

  • Lim, Byeong-Seon;Kim, Young-Kil
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2009.10a
    • /
    • pp.371-374
    • /
    • 2009
  • This Paper deal with a design, making a prtotype and test methods of Real-time towed Line Array Sensor Data processing board for fast data communication and long range transmission with SFM(Serial FPDP Module) through Optic-fiber channel. The LAS A,B,C group Data from towed line array sensor which is installed in FFX(Fast Frigate eXperimental) of Korean Navy is packed a previously agreed protocol and transmitted to the Signal processing unit. Consider the limited space of VME 6U size, LAS Data processing board is designed with MPC8265 PowerPC Controller of Freescale for main system control and Altera's CycloneIII FPGA for sensor data packing, self-test simulation data generation, S/W FIFO et cetera. LAS Data processing board have VxWorks, the RTOS(Real Time Operating System) that present many device drivers, peripheral control libraries on board for real-time data processing.

  • PDF

A Method for Analyzing Web Log of the Hadoop System for Analyzing a Effective Pattern of Web Users (효과적인 웹 사용자의 패턴 분석을 위한 하둡 시스템의 웹 로그 분석 방안)

  • Lee, Byungju;Kwon, Jungsook;Go, Gicheol;Choi, Yonglak
    • Journal of Information Technology Services
    • /
    • v.13 no.4
    • /
    • pp.231-243
    • /
    • 2014
  • Of the various data that corporations can approach, web log data are important data that correspond to data analysis to implement customer relations management strategies. As the volume of approachable data has increased exponentially due to the Internet and popularization of smart phone, web log data have also increased a lot. As a result, it has become difficult to expand storage to process large amounts of web logs data flexibly and extremely hard to implement a system capable of categorizing, analyzing, and processing web log data accumulated over a long period of time. This study thus set out to apply Hadoop, a distributed processing system that had recently come into the spotlight for its capacity of processing large volumes of data, and propose an efficient analysis plan for large amounts of web log. The study checked the forms of web log by the effective web log collection methods and the web log levels by using Hadoop and proposed analysis techniques and Hadoop organization designs accordingly. The present study resolved the difficulty with processing large amounts of web log data and proposed the activity patterns of users through web log analysis, thus demonstrating its advantages as a new means of marketing.