DOI QR코드

DOI QR Code

Detection of Abnormal Ship Operation using a Big Data Platform based on Hadoop and Spark

하둡 및 스파크 기반 빅데이터 플랫폼을 이용한 선박 운항 효율 이상 상태 분석

  • Lee, Taehyeon (Dept. of Precision Mechanical Engineering, Kyungpook Nat'l UNIV.) ;
  • Yu, Eun-seop (Dept. of Precision Mechanical Engineering, Kyungpook Nat'l UNIV.) ;
  • Park, Kaemyoung (e-Navigation TFT, Korean Register of Shipping) ;
  • Yu, Seongsang (e-Navigation TFT, Korean Register of Shipping) ;
  • Park, Jinpyo (Softhills) ;
  • Mun, Duhwan (Dept. of Precision Mechanical Engineering, Kyungpook Nat'l UNIV.)
  • 이태현 (경북대학교 정밀기계공학과) ;
  • 유은섭 (경북대학교 정밀기계공학과) ;
  • 박개명 (한국선급e-Navigation TFT) ;
  • 유성상 (한국선급e-Navigation TFT) ;
  • 박진표 ((주)소프트힐스) ;
  • 문두환 (경북대학교 정밀기계공학과)
  • Received : 2019.03.26
  • Accepted : 2019.05.13
  • Published : 2019.06.30

Abstract

To reduce emissions of marine pollutants, regulations are being tightened around the world. In the shipbuilding and shipping industries, various countermeasures are being put forward. As there are limits to applying countermeasures to ships already in operation, however, it is necessary for these vessels to use energy efficiently. The sensors installed on ships typically gather a very large amount of data, and thus a big data platform is needed to manage and analyze the data. In this paper, we build a big data analysis platform based on Hadoop and Spark, and we present a method to detect abnormal ship operation using the platform. We also utilize real ship operation data to discuss the data analysis experiment.

Keywords

References

  1. Jung, R. T., "Recent International Development on the Technical and Operational Measures of IMOs CO 2 Emission Control From Ships", Journal of the Korean Society for Marine Environment & Energy, Vol. 14, No. 1, pp. 65-71, 2011. https://doi.org/10.7846/JKOSMEE.2011.14.1.065
  2. Kim, M., "Eco-friendly Technology Trends in Ocean Transportation", Shipper's Journal, pp. 27-38, 2013.
  3. Yu, E., Park, K., and Mun, D., "Study on Prediction of Ship Navigation Efficiency Using Open Source-based Big Data Platform", Korean Journal of Computational Design and Engineering, Vol. 23, No. 3, pp. 275-284, 2018. https://doi.org/10.7315/CDE.2018.275
  4. Perera, L. P., and Mo, B., "Machine intelligence for energy efficient ships: A big data solution. Maritime Engineering and Technology III", Guedes Soares & Santos (Eds.), Vol. 1, pp. 143-150, 2016.
  5. Besikci, E. B., Arslan, O., Turan, O., and Olcer, A. I., "An artificial neural network based decision support system for energy efficient ship operations", Computers & Operations Research, Vol. 66, pp. 393-401, 2016. https://doi.org/10.1016/j.cor.2015.04.004
  6. Kim, Y., Yoon, H., and Kang, N., "Design and Implementation of Ship Energy Efficiency Monitoring System", The Journal of Korea Navigation Institute, Vol. 20, No. 5, pp. 408-416, 2016.
  7. Kwon, Y. J., and Kim, D. Y., "A Research on the Approximate Formulae for the Speed Loss at Sea", Journal of Ocean Engineering and Technology, Vol. 19, No. 2, pp. 90-93, 2005.
  8. Kim, S. K., Lee, Y. S., Kong, G. Y., Kim, J. P., and Jung, C. H., "A Study on the Ships Speed for Reducing the Fuel Oil Consumption in Actual Ships", Journal of the Korean Society of Marine Environment & Safety, Vol. 18, No. 1, pp. 41-47, 2012. https://doi.org/10.7837/kosomes.2012.18.1.041
  9. Byeon, S., Jun, C., Kim, K., Lee, S., and Park, K., "A statistical procedure of analyzing container ship operation data for finding fuel consumption patterns", The Korean Journal of Applied Statistics, Vol. 30, No. 5, pp. 633-645, 2017. https://doi.org/10.5351/KJAS.2017.30.5.633
  10. "R project" (2016), https://cran.r-project.org/web/packages/nnet/index.html (accessed 01 August, 2018).
  11. Lee, T. H., Park, J. H., ""Modelling for the Full Ranges of the Steam Table using Neural Networks"", J. Korean Soc. Mech. Technol, Vol, 20, No. 1, pp. 82-88, 2018. https://doi.org/10.17958/ksmt.20.1.201802.82
  12. Choi, H. J., Moon, I. K., "A Study on the Panel Sensitivity to Predict Resistance Performance of High Speed Ship", J. Korean Soc. Mech. Technol, Vol. 20, No. 2, pp.160-165, 2018. https://doi.org/10.17958/ksmt.20.2.201804.160