Browse > Article
http://dx.doi.org/10.7846/JKOSMEE.2011.14.2.107

Skill Assessments for Evaluating the Performance of the Hydrodynamic Model  

Kim, Tae-Yun (Pacific Northwest National Laboratory)
Yoon, Han-Sam (Research Center for Ocean Industrial Development, Pukyong National Univ.)
Publication Information
Journal of the Korean Society for Marine Environment & Energy / v.14, no.2, 2011 , pp. 107-113 More about this Journal
Abstract
To evaluate the performance of the hydrodynamic model, we introduced 10 skill assessments that are assorted by two groups: quantitative skill assessments (Absolute Average Error or AAE, Root Mean Squared Error or RMSE, Relative Absolute Average Error or RAAE, Percentage Model Error or PME) and qualitative skill assessments (Correlation Coefficient or CC, Reliability Index or RI, Index of Agreement or IA, Modeling Efficiency or MEF, Cost Function or CF, Coefficient of Residual Mass or CRM). These skill assessments were applied and calculated to evaluate the hydrodynamic modeling at one of Florida estuaries for water level, current, and salinity as comparing measured and simulated values. We found that AAE, RMSE, RAAE, CC, IA, MEF, CF, and CRM are suitable for the error assessment of water level and current, and AAE, RMSE, RAAE, PME, CC, RI, IA, CF, and CRM are good at the salinity error assessment. Quantitative and qualitative skill assessments showed the similar trend in terms of the classification for good and bad performance of model. Furthermore, this paper suggested the criteria of the "good" model performance for water level, current, and salinity. The criteria are RAAE < 10%, CC > 0.95, IA > 0.98, MEF > 0.93, CF < 0.21 for water level, RAAE < 20%, CC > 0.7, IA > 0.8, MEF > 0.5, CF < 0.5 for current, and RAAE < 10%, PME < 10%, CC > 0.9, RI < 1.15, CF < 0.1 for salinity.
Keywords
Hydrodynamic model; Skill assessment; Performance criteria; Water level; Current; Salinity;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Wilmott, C.J., 1982, "Some comments on the evaluation of model performance", Bulletin American Meteorological Society, No. 63, 1309-1313.   DOI
2 Zhang, A., Fan, W., and Ji, F., 2007, "The standards for skill assessment of operational marine forecast system", Chinese Journal of Oceanology and Limnology, No.25, 27-35.   DOI   ScienceOn
3 Radach, G. and Moll, A., 2006, "Review of three-dimensional ecological modelling related to the North Sea shelf system. Part II: model validation and data needs", Oceanog. Mar. Biol., No.44, 1-60.
4 Warner, J.C., Geyer, W.R., and Lerczak, J.A., 2005, "Numerical modeling of an estuary: A comprehensive skill assessment", Journal of geophysical research, 110, C05001, doi:10.1029/ 2004JC002691.
5 OSPAR Commission, 1998, Report of the modeling workshop on eutrophication issues. 5-8 November 1996, Den Haag, The Netherlands, OSPAR report, 86pp.
6 Ma, G., Shi, F., Liu, S. and Qi, D., 2011, "Hydrodynamic modeling of Changjiang Estuary: Model skill assessment and large-scale structure impacts", Applied Ocean Research, No.33, 69-78.   DOI   ScienceOn
7 Marechal, D., 2004, A soil-based approach to rainfall-runoff modeling in ungauged catchments for England and Wales, PhD Thesis, Cranfield University, 157pp.
8 Moreels, E., De Neve, S., Hofman, G., and Van Meirvenne, M., 2003, "Simulating nitrate leaching in bare fallow soils: a model comparison", Nutrient Cycling in Agroecosystems, No.67, 137- 144.   DOI   ScienceOn
9 Haidvogel, D.B., Arango, H., Budgell, W.P., Cornuelle, B.D., Curchitser, E., Lorenzo, E.D., Fennel, K., Geyer, W.R., Hermann, A.J., Laneorlle, L., Levin, J., McWilliams, j.C., Miller, A.J., Moore, A.M., Powell, T.M., Shchepetkin, A.F., Sherwood, C.R., Signell, R.P., Warner, J.C., and Wilkin, J., 2008, "Ocean forecasting in terrain-following coordinates: Formulation and skill assessment of the Regional Ocean Modeling System", Journal of computational physics, No.227, 3595-3624.   DOI   ScienceOn
10 Loague, K. and Green, R.E., 1991, "Statistical and graphical methods for evaluating solute transport models: Overview and application", Journal of Contaminant Hydrology, No.7, 51-73.   DOI   ScienceOn
11 Jolliff, J.K., Kindle, J.C., Shulman, I., Penta, B., Friedrichs, M.A.M, Helber, R., and Arnone, R.A., 2009, "Summary diagrams for coupled hydrodynamic-ecosystem model skill assessment", Journal of Marine Systems, No.76, 64-82.   DOI   ScienceOn
12 Kim, T., 2007, Modeling of Florida's estuaries: upper Charlotte Harbor and Indian River Lagoon, Ph.D. Dissertation, University of Florida, USA, 305pp.
13 Leggett, R.W. and Williams, L.R., 1981, "A reliability index for models", Ecological Modelling, No.13, 303-312.   DOI   ScienceOn
14 Kim, T., Sheng, Y.P., Park, K., 2010, "Modeling water quality and hypoxia dynamics in Upper Charlotte Harbor, Florida, U.S.A. during 2000", Estuarine, Coastal and Shelf Science, No.90, 250- 263.