Optimization of the computing environment to improve the speed of the modeling (WRF and CMAQ) calculation of the National Air Quality Forecast System |
Myoung, Jisu
(Air Quality Forecasting Center, National Institute of Environmental Research)
Kim, Taehee (Air Quality Forecasting Center, National Institute of Environmental Research) Lee, Yonghee (Air Quality Forecasting Center, National Institute of Environmental Research) Suh, Insuk (Air Quality Forecasting Center, National Institute of Environmental Research) Jang, Limsuk (Air Quality Forecasting Center, National Institute of Environmental Research) |
1 | Balle, T., Johnsen, P., 2016, Improving I/O performance of the Weather Research and Forecast (WRF) model, Cray user group, https://cug.org/proceedings/cug2016_proceedings/includes/files/pap123s2-file2.pdf. |
2 | Binkowski, F. S., Roselle, S. J., 2003, Models-3 Community Multiscale Air Quality (CMAQ) model aerosol component, 1, Model description, J. Geophys. Res., 108, 4183. DOI |
3 | Carter, W. P. L., 1990, A Detailed mechanism for the gas-phases atmospheric reactions of organic compounds. Atmos. Environ., 24, 481-518. DOI |
4 | Cho, J. Y., Jin, H. W., 2013, An Optimization tool for determining processor affinity of networking processes, KIPS tran softw data eng, http://dx.doi.org/10.3745/KTSDE.2013.2.2.131. DOI |
5 | Chou, M. D., Suarez, M. J., 1994, An Efficient thermal infrared radiation parameterization for use in general circulation models, NASA tech, Memo, 104606, 3, 85. |
6 | Delic, G., 2011, CMAQ performance with three compilers on two platforms, 10th Annual CMAS conference, Chapel Hill, NC, 24-26. |
7 | Delic, G., 2017, CMAQ 5.1 performance with portland and intel compilers, 16th Annual CMAS conference, 23-25. |
8 | Dell EMC, 2017, 14G with skylake - how much better for HPC?, Ready solutions Enginerring test results, Dell EMC HPC innovation lab, Sep, 2017. |
9 | ENVIRON, 2015, Final report : CAMx speed improvements, Prepared for the texas commission on environmental quality, Austin, TX, Prepared by ENVIRON international corp., Work order no. 582-15-52944-05, Novato, CA. |
10 | Etsion, Y., Tsafrir, D., 2005, A Short survey of commercial cluster batch schedulers, Technical report 2005-13, School of computer ccience and engineering, the Hebrew university, Jerusalem, Israe. |
11 | Hong, D. Y., Dudia, Y. J., 2006, A New vertical diffusion package with an explicit treatment of entrainment processes, Mon, Weather rev, 134, 2318-2341. DOI |
12 | Hong, S. Y., Dudhia, J., Chen, S. H., 2004, A Revised approach to ice microphysical processes for the bulk parameterization of clouds and precipitation, Mon, Weather rev, 132, 103-120. DOI |
13 | HPC Advisory Council, 2009, Interconnect analysis : 10GigE and InfinBand in high performance computing, http://www.hpcadvisorycouncil.com. |
14 | Jeon, B. J., Choi, H. G., 2014, Performance analysis of the parallel cupid fode for various parallel programming models in a cluster system based on infiniband, Korean society of computational fluids engineering, 325-326. |
15 | Kain, J. S., 2004, The kain-fritsch convective parameterization: an update, J. appled meteorology, 43, 170-181. DOI |
16 | Kim, J. S., Kim, S. K., Kim, S., Rho, S., Hwang, S., 2014, An Analysis of multi-level scheduling mechanism for large-scale scientific computing, Journal of KIISE: Computing Practices and Letters, 20(7), 379-385. |
17 | Kordenbrock, T. H., Oidfield, R. A., Young, J., 2006, Parallel I/O advancements in air quality modeling system, CMAS conference, 16-18. |
18 | Krouse, C. G., Vento, D. D., Montuoro, R., Lubin, M., McMillan, S., 2013, Evaluation of WRF scaling to several thousand cores on the yellowstone supercomputer, Front range consortium for research computing 2013, http://n2t.net/ark:/85065/d7cn736p. |
19 | Langkamp, T., Bohner, J., 2011, Influence of the compiler on multi-cpu performance of WRFv3, Geosci. Model Dev., 4, 611-623. DOI |
20 | Mlawer, E. J., Taubman, S. J., Brown, P. D., Iacono, M. J., Clough, S. A., 1997, Radiative transfer for inhomogeneous atmosphere: RRTM, a validated correlated-k model for the long-wave, J. Geophys. Res, 102, 16663-16682. DOI |
21 | Odman, M. T., 1997, A Quantitative analysis of numerical diffusion introduced by advection algorithms in air quality models, Atmos. Environ, 31, 1933-1940. DOI |
22 | Odman, M. T., Russel, A., 2000, Mass conservative coupling of non-hydrostatic meteorological models with air quality models, Air pollution modeling and its application, dordrecht, Kluwer, 651-660. |
23 | Schmuck, F., Haskin, R., 2002, GPFS: A Shared-disk file system for large computing clusters, proceedings of the conference on file and storage technologies, Monterey, CA, 231-244. |
24 | Shainer, G., Liu, T., Michalakes., J., Liberman, J., Layton., J., Celebioglu, O., Schultz, S. A., Mora, J., Cownie, D., 2009, Weather Research and Forecast (WRF) model performance and profiling analysis on advanced multi-core HPC clusters, 10th LCI conference, Boulder, Colorado, USA, http://www.linuxclustersinstitute.org. |
25 | Yang, M., McGrath, R. E., Folk, M., 2004, Performance study of HDF5-WRF IO modules, In: Fifth WRF user workshop, 22-25. |
26 | Yoon, J. W., Hong, T. Y., Kong, K. S., Park, C. Y., 2015, Improving the job success rate through analysis of user logs in HPC, Journal of Digital Contents Society, 16(5), 691-697. DOI |
27 | Yoon, J. W., Song, U. S., 2016, Study of optimization through performance analsysis of parallel distributed filesystem, Journal of Digital Contents Society, 17(5), 409-416. DOI |
28 | Yoon, J. W., Song, U. S., 2017, Study of scheduling optimization through the bath job logs analysis, Journal of Digital Contents Society, 18(7), 1411-1418. DOI |