Browse > Article
http://dx.doi.org/10.7850/jkso.2022.27.3.127

Performance Optimization of Numerical Ocean Modeling on Cloud Systems  

JUNG, KWANGWOOG (School of Earth and Environmental Sciences, Seoul National University)
CHO, YANG-KI (School of Earth and Environmental Sciences/ Research Institute of Oceanography, Seoul National University)
TAK, YONG-JIN (Department of Atmospheric sciences, Yonsei University)
Publication Information
The Sea:JOURNAL OF THE KOREAN SOCIETY OF OCEANOGRAPHY / v.27, no.3, 2022 , pp. 127-143 More about this Journal
Abstract
Recently, many attempts to run numerical ocean models in cloud computing environments have been tried actively. A cloud computing environment can be an effective means to implement numerical ocean models requiring a large-scale resource or quickly preparing modeling environment for global or large-scale grids. Many commercial and private cloud computing systems provide technologies such as virtualization, high-performance CPUs and instances, ether-net based high-performance-networking, and remote direct memory access for High Performance Computing (HPC). These new features facilitate ocean modeling experimentation on commercial cloud computing systems. Many scientists and engineers expect cloud computing to become mainstream in the near future. Analysis of the performance and features of commercial cloud services for numerical modeling is essential in order to select appropriate systems as this can help to minimize execution time and the amount of resources utilized. The effect of cache memory is large in the processing structure of the ocean numerical model, which processes input/output of data in a multidimensional array structure, and the speed of the network is important due to the communication characteristics through which a large amount of data moves. In this study, the performance of the Regional Ocean Modeling System (ROMS), the High Performance Linpack (HPL) benchmarking software package, and STREAM, the memory benchmark were evaluated and compared on commercial cloud systems to provide information for the transition of other ocean models into cloud computing. Through analysis of actual performance data and configuration settings obtained from virtualization-based commercial clouds, we evaluated the efficiency of the computer resources for the various model grid sizes in the virtualization-based cloud systems. We found that cache hierarchy and capacity are crucial in the performance of ROMS using huge memory. The memory latency time is also important in the performance. Increasing the number of cores to reduce the running time for numerical modeling is more effective with large grid sizes than with small grid sizes. Our analysis results will be helpful as a reference for constructing the best computing system in the cloud to minimize time and cost for numerical ocean modeling.
Keywords
ROMS; HPC; HPL; STREAM; Cloud computing; Virtualization; High-performance networking; Cache hierarchy; Cache capacity;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Antonov, J.I., D. Seidov, T.P. Boyer, R.A. Locarnini, A.V. Mishonov, H.E. Garcia, O.K. Baranova, M.M. Zweng and D.R. Johnson, 2010. World Ocean Atlas 2009, Volume 2: Salinity. S. Levitus, Ed. NOAA Atlas NESDIS 69, U.S. Government Printing Office, Washington, D.C., 184 pp.
2 AWS, 2017. Amazon Machine Images, Available at: http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/AMIs.html (Accessed: 03 March 2022).
3 AWS, 2018. Spot-Instance, Available at: https://aws.amazon.com/ec2/spot/?nc1=h_ls/ (Accessed: 03 Feb 2019).
4 AWS, 2022. Instance types, Available at: http://aws.amazon.com/ec2/instance-types (Accessed: 03 March 2022).
5 Carton, J.A. and B.S. Giese, 2008. A reanalysis of ocean climate using Simple Ocean Data Assimilation (SODA). Mon. Weather Rev., 136(8): 2999-3017.   DOI
6 Cheng, K.-Y., L.M. Harris and Y.Q. Sun, 2022. Enhancing the accessibility of unified modeling systems: GFDL System for High-resolution prediction on Earth-to-Local Domains (SHiELD) v2021b in a container. Geosci. Model Dev., 15(3): 1097-1105.   DOI
7 Fairall, C.W., E.F. Bradley, D.P. Rogers, J.B. Edson and G.S. Young, 1996. Bulk parameterization of air-sea fluxes for Tropical Ocean-Global Atmosphere Coupled-Ocean Atmosphere Response Experiment. J. Geophys. Res., 101(C2): 3747-3764.   DOI
8 GFDL, 2022. Geophysical Fluid Dynamics Laboratory, https://www.gfdl.noaa.gov/climate-modeling/ (Accessed 01 2022).
9 Large, W.G., J.C. McWilliams and S.C. Doney, 1994. Oceanic vertical mixing: A review and a model with a nonlocal boundary layer parameterization. Rev. Geophys., 32(4): 363-403.   DOI
10 Locarnini, R.A., A.V. Mishonov, J.I. Antonov, T.P. Boyer, H.E. Garcia, O.K. Baranova, M.M. Zweng and D.R. Johnson, 2010. World Ocean Atlas 2009, Volume 1: Temperature. S. Levitus, Ed. NOAA Atlas NESDIS 68, U.S. Government Printing Office, Washington, D.C., 184 pp.
11 McCalpin, J.D., 2017. STREAM: Sustainable memory bandwidth in high performance computers, a continually updated technical report (1991-2007) (Available at: https://www.cs.virginia.edu/stream/) (Accessed: 02 Feb 2022).
12 Mell, P. and T. Grance, 2011. The NIST Definition of Cloud Computing. National Institute of Standards and Technology Speical Publication 800-145, Gaithersburg, 3 pp.
13 Montes, D., J.A. Anel, T.F. Pena, P. Uhe and D.C.H. Wallom, 2017. Enabling BOINC in infrastructure as a service cloud system. Geosci. Model Dev., 10(2): 811-826.   DOI
14 Oesterle, F., S. Ostermann, R. Prodan and G.J. Mayr, 2015. Experiences with distributed computing for meteorological applications: Grid computing and cloud computing. Geosci. Model Dev., 8(7): 2067-2078.   DOI
15 ROMS, 2015. Regional Ocean Modeling System (ROMS), Available at: https://www.myroms.org/ (Accessed: 09 Mar 2022).
16 Seo, G.-H., Y.-K. Cho, B.-J. Cho, K.-Y. Kim, B. Kim and Y.-J. Tak, 2014. Climate change projection in the Northwest Pacific marginal seas through dynamic downscaling. J. Geophys. Res., 119(6): 3497-3516.   DOI
17 Vorosmarty, C., B. Fekete and B. Tucker, 1996. River discharge database version 1.0 (RivDIS v1.0). Volumes 0 through 6. A contribution to IHP-V Theme 1. Technical Documents in Hydrology Series.
18 Wang, Q., X. Guo and H. Takeoka, 2008. Seasonal variations of the Yellow River plume in the Bohai Sea: A model study. J. Geophys. Res., 113(C8): C08046.
19 Amante, C. and B.W. Eakins, 2009. ETOP01 1 arc-minute global relief model: Procedures, data sources and analysis, NOAA Tech. Memo., NESDIS NGDC-24, 19 pp.
20 Zhuang, J., D.J. Jacob, J.F. Gaya, R.M. Yantosca, E.W. Lundgren, M.P. Sulprizio and S.D. Eastham, 2019. Enabling Immediate Access to Earth Science Models through Cloud Computing: Application to the GEOS-Chem Model. Bull. Amer. Meteor. Soc., 100(10): 1943-1960.   DOI
21 Chen, X., X. Huang, C. Jiao, M. Flanner, T. Raeker and B. Palen, 2017. Running climate model on a commercial cloud computing environment: A case study using Community Earth System Model (CESM) on Amazon AWS. Computers & Geo., 98: 21-25.   DOI
22 Dee, D.P., S.M. Uppala, A.J. Simmons, P. Berrisford, P. Poli, S. Kobayashi, 2011. The ERA-Interim reanalysis: Configuration and performance of the data assimilation system. Q. J. R. Meteorol. Soc., 137(656): 553-597.   DOI
23 HPL, 2016. High-performance Linpack Benchmark, Available at: http://www.netlib.org/benchmark/hpl/index.html (Accessed: 02 Mar 2022).
24 Egbert, G.D. and S.Y. Erofeeva, 2002. Efficient inverse modeling of Barotropic Ocean Tides. J. Atmos. Oceanic Technol., 19(2): 183-204.   DOI
25 Fox-Kemper, B., A. Adcroft, C.W. Boning, E.P. Chassignet, E. Curchitser, G. Danabasoglu, C. Eden, M.H. England, R. Gerdes, R.J. Greatbatch, S.M. Griffies, R.W. Hallberg, E. Hanert, P. Heimbach, H.T. Hewitt, C.N. Hill, Y. Komuro, S. Legg, J.L. Sommer, S. Masina, S.J. Marsland, S.G. Penny, F. Qiao, T.D. Ringler, A.M. Treguier, H. Tsujino, P. Uotila and S.G. Yeager, 2019. Challenges and Prospects in Ocean Circulation Models. Front. Mar. Sci., 6: 65.   DOI
26 Gartner, 2018. Public Cloud Service, Available at: https://www.gartner.com/en/newsroom/press-releases/2018-08-01-gartner-says-worldwide-iaas-public-cloud-services-market-grew-30-percent-in-2017 (Accessed: 01 March 2022).
27 Google, 2019. Pre-emptible VM Instances, Available at: https://cloud.google.com/compute/docs/instances/preemptible (Accessed: 01 Jan 2022).
28 Gupta, A., L.V. Kale, F. Gioachin, V. March, C.H. Suen, B.-S. Lee, P. Faraboschi, R. Kaufmann and D. Milojicic, 2013. The who, what, why and how of high performance computing in the cloud. 2013 IEEE International Conference on Cloud Computing Technology and Science, 306-314.
29 Intel, 2013. Memory Latency Checker, Available at: https://www.intel.com/content/www/us/en/developer/articles/tool/intelr-memory-latency-checker.html (Accessed: 03 Feb 2019).
30 Intel, 2017. Xeon Processor Scalable Family Technical Overview, Available at: https://software.intel.com/en-us/articles/intel-xeon-processor-scalable-family-technical-overview (Accessed: 02 Mar 2022).
31 Intel, 2018. MPI Benchmark, Available at: https://software.intel.com/en-us/articles/intel-mpi-benchmarks (Accessed: 03 Mar 2018).
32 Rajan, A., B.K. Joshi, A. Rawat, R. Jha and K. Bhachavat, 2012. Analysis of process distribution in HPC cluster using HPL: 2nd IEEE International Conference on Parallel, Distributed and Grid Computing, Solan, India, 85-88.
33 Jung, K., Y.-K. Cho and Y.-J. Tak, 2021. Containers and orchestration of numerical ocean model for computational reproducibility and portability in public and private clouds: Application of ROMS 3.6. Simul. Model Pract. Theory, 109: 102305.   DOI
34 McCalpin, J.D., 1995. Memory bandwidth and machine balance in current high performance computers. IEEE Computer Society Technical Committee on Computer Architecture (TCCA) Newsletter, 2: 19-25.
35 Microsoft, 2015. Azure support for Linux RDMA, Available at https://azure.microsoft.com/en-us/updates/azure-support-for-linux-rdma (Accessed: 03 Jan 2022).
36 Shchepetkin, A.F. and J.C. McWilliams, 2005. The Regional Oceanic Modeling System (ROMS): A split-explicit, free-surface, topography-following-coordinate oceanic model. Ocean Modell., 9(4): 347-404.   DOI
37 Zhuang, J., D.J. Jacob, H. Lin, E.W. Lundgren, R.M. Yantosca, J.F. Gaya, M.P. Sulprizio and S.D. Eastham, 2020. Enabling High-Performance Cloud Computing for Earth Science Modeling on Over a Thousand Cores: Application to the GEOS-Chem Atmospheric Chemistry Model. J. Adv. Model. Earth Syst., 12(5): e2020MS002064.   DOI