DOI QR코드

DOI QR Code

Real Time Distributed Parallel Processing to Visualize Noise Map with Big Sensor Data and GIS Data for Smart Cities

스마트시티의 빅 센서 데이터와 빅 GIS 데이터를 융합하여 실시간 온라인 소음지도로 시각화하기 위한 분산병렬처리 방법론

  • Park, Jong-Won (School of Electrical and Computer Engineering, University of Seoul) ;
  • Sim, Ye-Chan (School of Electrical and Computer Engineering, University of Seoul) ;
  • Jung, Hae-Sun (School of Electrical and Computer Engineering, University of Seoul) ;
  • Lee, Yong-Woo (School of Electrical and Computer Engineering, University of Seoul)
  • Accepted : 2018.07.19
  • Published : 2018.08.31

Abstract

In smart cities, data from various kinds of sensors are collected and processed to provide smart services to the citizens. Noise information services with noise maps using the collected sensor data from various kinds of ubiquitous sensor networks is one of them. This paper presents a research result which generates three dimensional (3D) noise maps in real-time for smart cities. To make a noise map, we have to converge many informal data which include big image data of geographical Information and massive sensor data. Making such a 3D noise map in real-time requires the processing of the stream data from the ubiquitous sensor networks in real-time and the convergence operation in real-time. They are very challenging works. We developed our own methodology for real-time distributed and parallel processing for it and present it in this paper. Further, we developed our own real-time 3D noise map generation system, with the methodology. The system uses open source softwares for it. Here in this paper, we do introduce one of our systems which uses Apache Storm. We did performance evaluation using the developed system. Cloud computing was used for the performance evaluation experiments. It was confirmed that our system was working properly with good performance and the system can produce the 3D noise maps in real-time. The performance evaluation results are given in this paper, as well.

스마트시티는, 각종 센서들로부터의 데이터를 수집, 처리하여 시민들을 위하여, 다양한 스마트 서비스들을 제공한다. 본 논문에서는, 이과 같은 스마트시티 서비스 중의 하나로서, 소음지도를 시민에게 실시간으로 제공하기 위한 연구 결과를 발표한다. 본 논문은, 스마트 시티의 융복합된 유비쿼터스센서네트워크들로부터 끊임없이 전달되는 대량의 스트림 데이터를, 실시간으로 전달받아서, 지리정보시스템 (GIS)의 정보들과 융합하여, 시각적으로 소음정보를 표시하여 주는, 3차원 소음지도를 실시간으로 제작하는, 실시간 분산병렬처리 방법론을 제시하였다. 이 방법론을 오픈소스소프트웨어를 활용하여 실제 시스템으로 개발되어 구현하였다. 본 논문에서는, 이와 같이 구현된 시스템들 중에서, 아파치 스톰(Apache Storm) 프레임워크를 사용하여 구현한 실제 시스템을 소개한다. 본 연구에서는, 이 실제 구현된 시스템을 성능평가하였다. 대량의 비정형 데이터를 실시간으로 처리하려면, 큰 컴퓨팅 파워가 필요하며, 필요한 컴퓨팅 파워의 규모도 사전에 알 수 없다는 문제들이 있다. 이 문제들을 해결하기 위하여, 본 연구에서는, 컴퓨팅 파워를 자유롭게 조절하여 공급할 수 있는. 클라우드 컴퓨팅을 사용하여 성능평가를 하였다. 이와 같은 성능평가를 통하여, 본 논문에서 제시한 방법론이 적절함을 확인하였고, 개발하여 구현한 시스템이 잘 작동함도 확인하였다. 나아가서는. 실시간으로 소음지도를 생산할 수 있음을 확인하였다. 본 논문은 이와 같은 성능평가 내용도 소개하고 상세히 설명한다.

Keywords

References

  1. Hae Sun Jung, Chang Sung Jeong, Yong Woo Lee, and Phil Doo Hong, "An Intelligent Ubiquitous Middleware for U-City: SmartUM," Journal of Information Science and Engineering, vol. 25, issue 2, pp. 375-388, March, 2009, http://jise.iis.sinica.edu.tw/JISESearch/pages/View/PaperView.jsf?keyId=35_562.
  2. Y. W. Lee, "Smart-city," European Union Parliament Seminar, May, 2013, [Online]. Available: http://www.europarl.europa.eu/document/activities/cont/201305/20130514ATT66084/20130514ATT66084EN.pdf
  3. Kai-Di Chang, Jiann-Liang Chen, "A Survey of Trust Management in WSNs, Internet of Things and Future Internet", KSII Transactions on Internet and Information Systems, vol. 6, no. 1, pp. 5-23, January 30, 2012, http://dx.doi.org/10.3837/tiis.2012.01.001.
  4. Hak Geon Lee, Chang Ho Yun, Jong Won Park, Yong Woo Lee, "An Analysis of Big Video Data with Cloud Computing in Ubiquitous City," Journal of Korean Society for Internet Information, vol. 15, no. 3, pp. 45-52, June, 2014, http://dx.doi.org/10.7472/jksii. 2014.15.3.45.
  5. European Parliament, Directive 2002/49/EC, 25 June 2002, Available From : http://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:32002L0049
  6. Paris Noise Map [Online], Available : http://parisisinvisible.blogspot.co.uk/2011/10/noise-maps-of-paris.html
  7. Hyun Kyu Park, Yong Woo Lee, seo Il Jang, Im Pyeong Lee, "Online visualization of Urban Noise in Ubiquitous-city Middleware," Advanced Communication Technology (ICACT), vol. 1, pp. 268-271, 2010, ISBN: 978-1-4244-5427-3, http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=5440461&isnumber=5440112.
  8. Jong Won Park et al, "Cloud computing for online visualization of GIS applications in ubiquitous city." CLOUD COMPUTING 2010, The First International Conference on Cloud Computing, GRIDs, and Virtualization. pp. 170-175, 2010, ISBN: 978-1-61208-106-9, https://www.thinkmind.org/index.php?view=article&articleid=cloud_computing_2010_7_ 30_50082.
  9. Chang Ho Yun, Jong Won Park, Hae Sun Jung, and Yong Woo Lee, "Real-Time IoT Big-data Processing for Stream Reasoning," Journal of Korean Society for Internet Information, vol. 18, no.3, pp. 1-9, June, 2017, http://dx.doi.org/10.7472/jksii.2017.18.3.01.
  10. Zeqiang Chen, Nengcheng Chen, and Jianya Gong, "Design and implementation of the real-time GIS data model and Sensor Web service platform for environmental big data management with the Apache Storm," Agro-Geoinformatics (Agro-geoinformatics), 2015 Fourth International Conference on, pp. 32-35, 2015, http://dx.doi.org/10.1109/Agro-Geoinformatics.2015.7248139.
  11. Yiyang Pei et al, "A Cloud-Based Stream Processing Platform for Traffic Monitoring Using Large-Scale Probe Vehicle Data," 2017 IEEE Wireless Communications and Networking Conference (WCNC), pp. 1-6, 2017, http://dx.doi.org/10.1109/WCNC.2017. 7925820.
  12. Noise Info (National Noise Information System), [Online]. Avaliable from : http://www.noiseinfo.or.kr/about/noisemapinfo.jsp?pageNo=1102
  13. Yong Woo LEE et al, "Online Image Processing of Urban Noise for Ubiquitous Environment," Proceedings of the KSII Spring Conference, Vol. 11, No. 1, pp. 157-160, 2010, http://www.dbpia.co.kr/Journal/ArticleDetail/NODE01467519.
  14. Sojung Oh, Impyeong Lee, Seongjoon Kim, Kyoung Ah Choi, "Generation of a City Spatial Model using a Digital Map and Draft Maps for a 3D Noise Map," Korean Journal of Remote Sensing, vol. 24, no 2, pp. 179-188, http://uci.or.kr/G704-000443.2008.24.2.006 https://doi.org/10.7780/kjrs.2008.24.2.179
  15. Apache Storm [Online]. Available from : http://storm.apache.org/

Cited by

  1. 마르코브 체인을 적용한 유동인구의 매출 및 이동 패턴 분석 vol.21, pp.1, 2018, https://doi.org/10.7472/jksii.2020.21.1.71