Browse > Article
http://dx.doi.org/10.9708/jksci.2013.18.11.013

Optimization and Stabilization of Satellite Data Distributed Processing System  

Choi, Yun-Soo (Korea Institute of Science & Technology Information)
Lee, Won-Goo (Korea Institute of Science & Technology Information)
Lee, Min-Ho (Korea Institute of Science & Technology Information)
Kim, Sun-Tae (Korea Institute of Science & Technology Information)
Lee, Sang-Hwan (Korea Institute of Science & Technology Information)
Publication Information
Journal of the Korea Society of Computer and Information / v.18, no.11, 2013 , pp. 13-21 More about this Journal
Abstract
The goal of this paper is to provide performance improvement and stability for satellite data correction of some distortions due to cloud or radiance through distributed processing on cluster. To do this, we proposed and implemented SGE(Sun Grid Engine) based distributed processing methods using local storages and a status table. In the verification, the experiment result revealed that the proposed system on seven nodes improved the processing speed by 138.81% as compare to the existing system and provided good stability as well. This result showed that the proposed distributed processing work is more appropriate to process CPU bound jobs than I/O bound jobs. We expect that the proposed system will give scientists improved analysis performance in various fields and near-real time analysis services.
Keywords
Satellite Data; Distributed Processing; Optimization; Sun Grid Engine;
Citations & Related Records
연도 인용수 순위
  • Reference
1 M. A. Mustapha, S. Sei-Ichi, T. Lihan, "Satellite-measured seasonal variations in primary production in the scallop-farming region of the Okhotsk Sea," ICES Journal of Marine Science, Vol. 66, No. 7, pp. 1557-1569, April 2009.   DOI   ScienceOn
2 Adam Keith, Steve Bochinger, Euroconsult, "Satellite-based Earth Observation: Market Prospects to 2018" Euroconsult, 2009.
3 OBPG, "SeaDAS Training Manual," http://seadas.gsfc.nasa.gov/SeaDAS_Training
4 OBPG, "Ancillary Files for Level 1B and Level 2," http://seadas.gsfc.nasa.gov/doc/toplevel/ancinfo.html
5 Sakharin Suwannathatsa, Prungchan Wongwises, "Chlorophyll distribution by oceanic model and satellite data in the Bay of Bengal and Andaman Sea," Oceanological and Hydrobiological Studies, Vol. 42, No. 2, pp. 132-138, June 2013.   DOI
6 "Grid Schduler/Grid Engine HOWTOs," http://gridscheduler.sourceforge.net/howto/GridEngine Howto.html
7 Amit Sheth, "A new landscape for distributed and parallel data management," Distributed and Parallel Databases, Vol. 30, No. 2, pp. 101-103 , April 2012.   DOI
8 W. Gentzsch, "Sun Grid Engine: towards creating a computing power grid," Proceedings 1st IEEE/ACM Intl. Symp. on CC&G, pp. 35-36, May 2001.
9 Akihiro Nakamura, Jong Geol Park, Kotaro Matsushita, Kenneth J. Mackin, Eiji Nunohiro, "Development and evaluation of satellite image data analysis infrastructure," Artificial Life and Robotics, Vol. 16, No. 4, pp. 511-513, Feb. 2012.   DOI
10 El-Sayed M. T. El-kenawy, Ali Ibraheem El-Desoky, Mohamed F. Al-rahamawy, "Distributing Graphic Rendering using Grid Computing with Load Balancing," International Journal of Computer Applications, Vol. 47, No. 9, pp. 1-6, June 2012.
11 Yunsoo Choi, Minho Lee, SangHwan Lee, "Evaluating the Scalability of Distributed Satellite Data Processing System," Proceeding of KSCI, Vol. 21, No. 2, pp. 395-397, July 2013.   과학기술학회마을