• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.23 no.10
• /
• pp.1179-1187
• /
• 2019

In today's technology environment, most big data-based applications and solutions are based on real-time processing of streaming data. Real-time processing and analysis of big data streams plays an important role in the development of big data-based applications and solutions. In particular, in the maritime data processing environment, the necessity of developing a technology capable of rapidly processing and analyzing a large amount of real-time data due to the explosion of data is accelerating. Therefore, this paper analyzes the characteristics of NiFi, Kafka, and Druid as suitable open source among various open data technologies for processing big data, and provides the latest information on external linkage necessary for maritime service analysis in Korean e-Navigation service. To this end, we will lay the foundation for applying open data framework technology for real-time data processing.

• 한국지구물리탐사학회:학술대회논문집
• /
• 2000.09a
• /
• pp.147-157
• /
• 2000

Primary purpose of the system developed in this study is 3-D seismic data processing system for underground investigation and this system is developed in PC based on Linux for lower-cost system. Basic data processing modules are originated from SU (Seismic Unix) which is widely used in 2-D seismic data processing and auxilious modules are developed for 3-D data processing The system which is constructed by using these data processing modules Is designed to GUI (Graphic User Interface) in order that one can easily control and for this purpose, GTK (Gimp Tool KiT) conventionally adapted in producing Linux application.

• Journal of the Korean Society for Aeronautical & Space Sciences
• /
• v.38 no.10
• /
• pp.1012-1019
• /
• 2010

In this paper, The flight data processing system was designed for multiple target flight test. For flight data processing, multiple target grouping, data fusion processing, and data slaving processing were performed and, as a data fusion filter, centralized, and federated Kalman filters were designed. A centralized kalman filter was modified in order to improve the vehicle's low altitude measurement using radar's SNR and estimation process. From the testing of multiple target missile, it confirmed flight trajectory measurement was improved in low altitude area and the beginning stage of vehicle.

• Proceedings of the KSRS Conference
• /
• 1998.09a
• /
• pp.361-369
• /
• 1998

Recently, the improvement of on-board satellite sensors covering hyperspectral image sensors, high spatial resolution sensors provide data on earth in diverse aspect. The application field relating remotely sensed data also varies depending on what type of job one wants. The various resolution of sensors from low to extremely high is also available on the market with a user defined specific location. The expense to purchase remote sensed data is going down compare to the cost it need past few years ago in terms of research or private use. Now, the satellite remote sensed data is used on the field of forecasting, forestry, agriculture, urban reconstruction, geology, or other research field in order to extract meaningful information by applying special techniques of image processing. There are many image processing packages available worldwide and one common aspect is that they are expensive. There need to be a advanced satellite data processing package for people who can not afford commercial packages to apply special remote sensing techniques on their data and produce valued-added product. The study was carried out with the purpose of developing a special satellite data processing package which covers almost every satellite produced data with normal image processing functions and also special functions needed on specific research field with friendly graphical user interface (GUI). And for the people with any background of remote sensing with windows platform.

• Journal of Korea Multimedia Society
• /
• v.17 no.10
• /
• pp.1182-1188
• /
• 2014

Recently, the research on database outsourcing has been actively done with the popularity of cloud computing. However, because users' data may contain sensitive personal information, such as health, financial and location information, the data encryption methods have attracted much interest. Existing data encryption schemes process a query without decrypting the encrypted databases in order to support user privacy protection. On the other hand, to efficiently handle the large amount of data in cloud computing, it is necessary to study the distributed index structure. However, existing index structure and query processing algorithms have a limitation that they only consider single-column query processing. In this paper, we propose a grid-based multi column indexing scheme and an encrypted query processing algorithm. In order to support multi-column query processing, the multi-dimensional index keys are generated by using a space decomposition method, i.e. grid index. To support encrypted query processing over encrypted data, we adopt the Hilbert curve when generating a index key. Finally, we prove that the proposed scheme is more efficient than existing scheme for processing the exact and range query.

• Journal of Korean Society of Forest Science
• /
• v.99 no.2
• /
• pp.197-203
• /
• 2010

The data of average temperature, average relative humidity, precipitation and average wind speed were collected from 674 meteorological stations in China. A specific procedure that processes original data into a new data format needed in forest fire danger rating forecast system of China was introduced systematically, and the feasibility of this method was validated in this paper. In addition, a set of meteorological data processing software was constructed by the secondary development of GIS in order to realize automation of processing data for the system. Results showed that the approach preformed well in handling temperature, average relative humidity and average wind speed, and the processing effect of precipitation was acceptable. Moreover, the automated procedure could be achieved by GIS and the working efficiency was about 3 times as much as that of manual handling. The informationization level of processing meteorological data was greatly enhanced.

• Proceedings of the IEEK Conference
• /
• 2007.07a
• /
• pp.133-134
• /
• 2007

The effective data processing mechanism in the sensor network means data stream model and real-time query processing model for real-time processing of stream data. This mechanism can improve satisfaction of users and reduce delay rate of data processing. In this paper, we explain the problem which is occurred when users need to search certain information among information of stream data and describe reduction model of delay rate according to data transmission.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2008.11a
• /
• pp.874-877
• /
• 2008

Nowadays the existing data processing systems can only support some simple query for sensor network. It is increasingly important to process the vast data streams in sensor network, and achieve effective acknowledges for users. In this paper, we propose a holistic distributed k-means algorithm for sensor network. In order to verify the effectiveness of this method, we compare it with central k-means algorithm to process the data streams in sensor network. From the evaluation experiments, we can verify that the proposed algorithm is highly capable of processing vast data stream with less computation time. This algorithm prefers to cluster the data streams at the distributed nodes, and therefore it largely reduces redundant data communications compared to the central processing algorithm.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.10 no.10
• /
• pp.5153-5170
• /
• 2016

The benefit of the scalability and flexibility inherent in cloud computing motivates clients to upload data and computation to public cloud servers. Because data is placed on public clouds, which are very likely to reside outside of the trusted domain of clients, this strategy introduces concerns regarding the security of sensitive client data. Thus, to provide sufficient security for the data stored in the cloud, it is essential to encrypt sensitive data before the data are uploaded onto cloud servers. Although data encryption is considered the most effective solution for protecting sensitive data from unauthorized users, it imposes a significant amount of overhead during the query processing phase, due to the limitations of directly executing operations against encrypted data. Recently, substantial research work that addresses the execution of SQL queries against encrypted data has been conducted. However, there has been little research on top-k join query processing over encrypted data within the cloud computing environments. In this paper, we develop an efficient algorithm that processes a top-k join query against encrypted cloud data. The proposed top-k join processing algorithm is, at an early phase, able to prune unpromising data sets which are guaranteed not to produce top-k highest scores. The experiment results show that the proposed approach provides significant performance gains over the naive solution.

• Proceedings of the Korean Institute of Navigation and Port Research Conference
• /
• 2000.04a
• /
• pp.33-43
• /
• 2000

In order to streamline the procedure of data transmission in port and logistics industries, MOMAF introduced EDI systems as the method of data transmission of 19 documents 5 years ago. While operating EDI system, MOMAF has found the inconvenience and the inefficiency of using EDI systems in the field of requesting fast response. This thesis focuses on finding the possible fields of on-line processing system instead of EDI system and suggests the economic effects occurred by the on-line processing system. The result of the paper presents that if data transmission area such as 'ocean vessel entrance report', 'application for using tug boat'and 'application for pilot'is changed to on-line processing method, the processing cost and time will be reduced compared with EDI processing method.