• 한국정보통신학회논문지
• /
• 제23권10호
• /
• pp.1179-1187
• /
• 2019

오늘날의 기술 환경에서 대다수의 빅 데이터 기반 애플리케이션 및 솔루션은 스트리밍 데이터의 실시간 처리를 기반으로 한다. 빅 데이터 스트림의 실시간 처리 및 분석은 빅 데이터 기반 애플리케이션 및 솔루션 개발에서 중요한 역할을 한다. 특히 해사 분야 데이터 처리 환경에서도 데이터의 폭발적 증대에 따른 대용량 실시간 데이터를 빠르게 처리 및 분석할 수 있는 기술 개발의 필요성이 가속화되고 있다. 따라서 본 논문에서는 다양한 빅 데이터 처리를 위한 오픈소스 기술 중에 적합한 오픈소스로 NiFi, Kafka, Druid의 특징을 분석하여 한국형 e-Navigation 서비스에서 해사 분야 서비스 분석에 필요한 외부 연계 필요 정보들을 상시 최신 정보로 제공할 수 있도록 실시간 데이터 처리를 위한 개방형 데이터 프레임워크 기술 적용의 기초를 마련하고자 한다.

• 한국지구물리탐사학회:학술대회논문집
• /
• 한국지구물리탐사학회 2000년도 정기총회 및 특별심포지움
• /
• pp.147-157
• /
• 2000

본 연구에서 개발된 시스템의 일차적인 목적은 지반조사에 사용될 3차원 탄성파 자료처리시스템으로써, 저렴한 환경의 시스템을 구축하기 위해 Linux 환경의 PC를 기반으로 개발되었다. 기본적인 자료처리 모듈들은 2차윈 탄성파 자료처리에 널리 사용되고 있는 SU(Seismic Unix)를 기반으로 하였으며, 3차원 지반조사에 적합하도록 추가적인 자료처리 모듈들이 개발되었다. 이러한 자료처리 모듈들을 이용하여 구축된 시스템은, 처리과정 중에 사용자가 쉽게 QC (Quality Control)를 할 수 있도록 GUI (Graphic User Interface)환경으로 설계되었으며, 이를 구현하기 위해 최근 Linux용 어플리케이션 개발에 보편적으로 쓰이는 GTK (Gimp Tool Kit)가 사용되었다.

• 한국항공우주학회지
• /
• 제38권10호
• /
• pp.1012-1019
• /
• 2010

본 논문에서는 다중표적 비행시험을 위한 비행 자료처리 시스템이 설계되었다. 비행자료 처리를 위해 표적그룹 처리, 자료융합 처리 및 자료연동 처리가 수행 되었으며, 자료융합 필터로서 집중형 칼만필터와 연합형 칼만필터를 설계하였다. 특히 집중형 필터에 레이더의 SNR과 추정기법을 적용하여 비행체의 저고도 계측을 개선하였다. 개발된 시스템을 다중표적 비행시험에 적용한 결과, 저고도 및 초기구간에서 개선된 비행궤적을 확인할 수 있었다.

• 대한원격탐사학회:학술대회논문집
• /
• 대한원격탐사학회 1998년도 Proceedings of International Symposium on Remote Sensing
• /
• pp.361-369
• /
• 1998

Recently, the improvement of on-board satellite sensors covering hyperspectral image sensors, high spatial resolution sensors provide data on earth in diverse aspect. The application field relating remotely sensed data also varies depending on what type of job one wants. The various resolution of sensors from low to extremely high is also available on the market with a user defined specific location. The expense to purchase remote sensed data is going down compare to the cost it need past few years ago in terms of research or private use. Now, the satellite remote sensed data is used on the field of forecasting, forestry, agriculture, urban reconstruction, geology, or other research field in order to extract meaningful information by applying special techniques of image processing. There are many image processing packages available worldwide and one common aspect is that they are expensive. There need to be a advanced satellite data processing package for people who can not afford commercial packages to apply special remote sensing techniques on their data and produce valued-added product. The study was carried out with the purpose of developing a special satellite data processing package which covers almost every satellite produced data with normal image processing functions and also special functions needed on specific research field with friendly graphical user interface (GUI). And for the people with any background of remote sensing with windows platform.

• 한국멀티미디어학회논문지
• /
• 제17권10호
• /
• pp.1182-1188
• /
• 2014

Recently, the research on database outsourcing has been actively done with the popularity of cloud computing. However, because users' data may contain sensitive personal information, such as health, financial and location information, the data encryption methods have attracted much interest. Existing data encryption schemes process a query without decrypting the encrypted databases in order to support user privacy protection. On the other hand, to efficiently handle the large amount of data in cloud computing, it is necessary to study the distributed index structure. However, existing index structure and query processing algorithms have a limitation that they only consider single-column query processing. In this paper, we propose a grid-based multi column indexing scheme and an encrypted query processing algorithm. In order to support multi-column query processing, the multi-dimensional index keys are generated by using a space decomposition method, i.e. grid index. To support encrypted query processing over encrypted data, we adopt the Hilbert curve when generating a index key. Finally, we prove that the proposed scheme is more efficient than existing scheme for processing the exact and range query.

• 한국산림과학회지
• /
• 제99권2호
• /
• pp.197-203
• /
• 2010

The data of average temperature, average relative humidity, precipitation and average wind speed were collected from 674 meteorological stations in China. A specific procedure that processes original data into a new data format needed in forest fire danger rating forecast system of China was introduced systematically, and the feasibility of this method was validated in this paper. In addition, a set of meteorological data processing software was constructed by the secondary development of GIS in order to realize automation of processing data for the system. Results showed that the approach preformed well in handling temperature, average relative humidity and average wind speed, and the processing effect of precipitation was acceptable. Moreover, the automated procedure could be achieved by GIS and the working efficiency was about 3 times as much as that of manual handling. The informationization level of processing meteorological data was greatly enhanced.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 2007년도 하계종합학술대회 논문집
• /
• pp.133-134
• /
• 2007

The effective data processing mechanism in the sensor network means data stream model and real-time query processing model for real-time processing of stream data. This mechanism can improve satisfaction of users and reduce delay rate of data processing. In this paper, we explain the problem which is occurred when users need to search certain information among information of stream data and describe reduction model of delay rate according to data transmission.

• 한국정보처리학회:학술대회논문집
• /
• 한국정보처리학회 2008년도 추계학술발표대회
• /
• pp.874-877
• /
• 2008

Nowadays the existing data processing systems can only support some simple query for sensor network. It is increasingly important to process the vast data streams in sensor network, and achieve effective acknowledges for users. In this paper, we propose a holistic distributed k-means algorithm for sensor network. In order to verify the effectiveness of this method, we compare it with central k-means algorithm to process the data streams in sensor network. From the evaluation experiments, we can verify that the proposed algorithm is highly capable of processing vast data stream with less computation time. This algorithm prefers to cluster the data streams at the distributed nodes, and therefore it largely reduces redundant data communications compared to the central processing algorithm.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제10권10호
• /
• pp.5153-5170
• /
• 2016

The benefit of the scalability and flexibility inherent in cloud computing motivates clients to upload data and computation to public cloud servers. Because data is placed on public clouds, which are very likely to reside outside of the trusted domain of clients, this strategy introduces concerns regarding the security of sensitive client data. Thus, to provide sufficient security for the data stored in the cloud, it is essential to encrypt sensitive data before the data are uploaded onto cloud servers. Although data encryption is considered the most effective solution for protecting sensitive data from unauthorized users, it imposes a significant amount of overhead during the query processing phase, due to the limitations of directly executing operations against encrypted data. Recently, substantial research work that addresses the execution of SQL queries against encrypted data has been conducted. However, there has been little research on top-k join query processing over encrypted data within the cloud computing environments. In this paper, we develop an efficient algorithm that processes a top-k join query against encrypted cloud data. The proposed top-k join processing algorithm is, at an early phase, able to prune unpromising data sets which are guaranteed not to produce top-k highest scores. The experiment results show that the proposed approach provides significant performance gains over the naive solution.

• 한국항해항만학회:학술대회논문집
• /
• 한국항해항만학회 2000년도 춘계학술대회논문집
• /
• pp.33-43
• /
• 2000

In order to streamline the procedure of data transmission in port and logistics industries, MOMAF introduced EDI systems as the method of data transmission of 19 documents 5 years ago. While operating EDI system, MOMAF has found the inconvenience and the inefficiency of using EDI systems in the field of requesting fast response. This thesis focuses on finding the possible fields of on-line processing system instead of EDI system and suggests the economic effects occurred by the on-line processing system. The result of the paper presents that if data transmission area such as 'ocean vessel entrance report', 'application for using tug boat'and 'application for pilot'is changed to on-line processing method, the processing cost and time will be reduced compared with EDI processing method.