Korean Journal of Remote Sensing (대한원격탐사학회지)

Korean Society of Remote Sensing (대한원격탐사학회)
권호 표지
DOI QR코드

DOI QR Code

GOCI Products Re-processing System (GPRS) Using Server Virtualization and Distributed Processing

서버가상화 및 분산처리를 이용한 천리안해양관측위성 산출물 재처리 시스템

  • 양현 (한국해양과학기술원 ICT융합연구단) ;
  • 유정미 (한국해양과학기술원 해양위성센터) ;
  • 최우창 (한국해양과학기술원 해양위성센터) ;
  • 한희정 (한국해양과학기술원 해양위성센터) ;
  • 박영제 (한국해양과학기술원 부원장실)
  • Received : 2016.01.15
  • Accepted : 2017.03.21
  • Published : 2017.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

Recent advance in the satellite-based remote sensing technology demands abilities to efficiently processthe massive satellite data. In thisstudy, we focused on developing GOCI Products Reprocessing System (GPRS) based on server virtualization and distributed processing in order to efficiently reprocess massive GOCI data. Experimental results revealed that GPRS allows raising the usage rates of memory and central processing unit (CPU) up to about 100% and 75%, respectively. This meansthat the proposed system enables us to save the hardware resources and increase the work process speed at the same time when we process massive satellite data.

최근 위성 기반 윈격 탐사 기술의 발전과 더불어 대용량 위성 자료를 효율적으로 처리하기 위한 능력이 요구되고 있다. 이 연구에서는 대용량 GOCI 산출물을 효율적으로 재처리하기 위해 서버가상화와 분산처리를 기반으로 한 GOCI 산출물 재처리 시스템(GOCI Products Re-processing System; GPRS)을 개발하는데 집중하였다. 실험 결과 GPRS를 이용하여 메모리 및 CPU의 사용률을 각각 약 100%, 75%까지 올릴 수 있었다. 이는 제안 시스템을 통해 하드웨어 자원을 절약함과 동시에 작업 처리 속도를 향상시킬 수 있다는 것을 의미한다.

Keywords

References

  1. Choi, J.K., Y.J. Park, B.R. Lee, J. Eom, J.E. Moon, and J.H. Ryu, 2014. Application of the Geostationary Ocean Color Imager (GOCI) to mapping the temporal dynamics of coastal water turbidity. Remote Sensing of Environment, 146: 24-35. https://doi.org/10.1016/j.rse.2013.05.032
  2. Daniels, J., 2009. Server virtualization architecture and implementation. Crossroads, 16(1): 8-12. https://doi.org/10.1145/1618588.1618592
  3. Goldberg, R.P., 1974. Survey of virtual machine research. Computer, 7(6): 34-45. https://doi.org/10.1109/MC.1974.6323581
  4. Hawick, K.A., P.D. Coddington, and H.A. James, 2003. Distributed frameworks and parallel algorithms for processing large-scale geographic data. Parallel Computing, 29(10): 1297-1333. https://doi.org/10.1016/j.parco.2003.04.001
  5. Justice, C.O., J.R.G. Townshend, E.F. Vermote, E. Masuoka, R.E. Wolfe, N. Saleousc, D.P. Roya, and J.T. Morisette, 2002. An overview of MODIS Land data processing and product status. Remote Sensing of Environment, 83: 3-15. https://doi.org/10.1016/S0034-4257(02)00084-6
  6. Laudon, K.C., and J.P. Laudon, 2004. Management information systems: managing the digital firm, Prentice Hall, New Jersey, USA.
  7. Lea, R., 1988, ASP: A cost-effective parallel microcomputer. IEEE Micro, 8(5): 10-29. https://doi.org/10.1109/40.87518
  8. Parhami, B. 2006. Introduction to parallel processing: algorithms and architectures. Springer, New York, USA.
  9. Qian, L., Z. Luo, Y. Du, and L. Guo, 2009. Cloud Computing: An Overview. Springer , Berlin Heidelberg, Germany.
  10. Rosenblum, M., and T. Garfinkel, 2005. Virtual machine monitors: current technology and future trends. Computer, 38(5): 39-47. https://doi.org/10.1109/MC.2005.176
  11. Ryu, J.-H., H.-J. Han, S. Cho, Y.-J. Park, and Y.-H. Ahn, 2012. Overview of geostationary ocean color imager (GOCI) and GOCI data processing system (GDPS). Ocean Science Journal, 47(3): 223-233. https://doi.org/10.1007/s12601-012-0024-4
  12. Sharp, J.A. 1986. An introduction to distributed and parallel processing, Blackwell Scientific Pub., Boston, USA.
  13. Waldspurger, C.A., 2002. Memory resource management in VMware ESX server. SIGOPS Operating Systems Review, 36(SI): 181-194. https://doi.org/10.1145/844128.844146
  14. Yang, H., J.-K. Choi, Y.-J. Park, H.-J. Han, and J.-H. Ryu, 2014a. Application of the Geostationary Ocean Color Imager (GOCI) to estimates of ocean surface currents. Journal of Geophysical Research: Oceans, 119(6): 3988-4000. https://doi.org/10.1002/2014JC009981
  15. Yang, H., E. Oh, T.-H. Han, H.-J. Han, and J.-K. Choi, 2014b. An Efficient Data Processing Method to Improve the Geostationary Ocean Color Imager (GOCI) Data Service. Korean Journal of Remote Sensing, 30(1): 137-147 (in Korean with English abstract). https://doi.org/10.7780/kjrs.2014.30.1.11
  16. Yang, H., J.-M. Ryu, H.-J. Han, J.-H. Ryu, and Y.-J. Park, 2012. Ocean Disaster Detection System (OD2S) using Geostationary Ocean Color Imager (GOCI). Journal of the Korea society of IT services, 11: 177-189 (in Korean with English abstract).
  17. Yichao, J., W. Yonggang, and C. Qinghua, 2012. Energy efficiency and server virtualization in data centers: An empirical investigation, IEEE Computer Communications Workshops (INFOCOM WKSHPS), 133-138.